2024-08-28T19:16:22.741 INFO:root:teuthology version: 1.2.1.dev4+gcf5021f 2024-08-28T19:16:22.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-28T19:16:22.961 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} email: mchangir@redhat.com first_in_suite: false job_id: '7877762' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 500 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7797 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 139/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLtUV/WNk3mvV/6B/SR4t6FfcvGmGN5k1suqfYf1KevyXUSDgzTQYAVRO+HR/ZYmcb6kbrFIvf84qoIDRbmLXVk= smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETkRa2R9IFmuti1qYvvREFWyBUi7EVs91rg4bt7tar75j4S9mLLfRvzAS/iQ4QUpeC4QNWv06C6UkqOfl8yMnM= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIJ7jeNUjYdtmGl1hSwxiX7zCByjyypMVgwJxzocmI+3ZWp8Xt0H9hgaMmDxNMdXr73meIRqqREvwEN4m9Ozk/0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: cf5021f85c4b0bf435c74a1183036b3d19af44b5 timestamp: 2024-08-28_12:36:35 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-28T19:16:22.962 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-28T19:16:22.962 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-28T19:16:22.962 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-28T19:16:22.964 INFO:teuthology.task.internal:Checking packages... 2024-08-28T19:16:22.985 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-28T19:16:22.985 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-28T19:16:22.985 INFO:teuthology.packaging:ref: None 2024-08-28T19:16:22.985 INFO:teuthology.packaging:tag: None 2024-08-28T19:16:22.985 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-28T19:16:22.985 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:16:22.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-28T19:16:23.150 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560.gd19e6118 2024-08-28T19:16:23.152 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-28T19:16:23.158 INFO:teuthology.task.internal:no buildpackages task found 2024-08-28T19:16:23.159 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-28T19:16:23.173 INFO:teuthology.task.internal:Saving configuration 2024-08-28T19:16:23.220 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-28T19:16:23.227 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-28T19:16:23.258 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-28 19:11:26.423266', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLtUV/WNk3mvV/6B/SR4t6FfcvGmGN5k1suqfYf1KevyXUSDgzTQYAVRO+HR/ZYmcb6kbrFIvf84qoIDRbmLXVk='} 2024-08-28T19:16:23.287 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-28 19:11:26.426930', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETkRa2R9IFmuti1qYvvREFWyBUi7EVs91rg4bt7tar75j4S9mLLfRvzAS/iQ4QUpeC4QNWv06C6UkqOfl8yMnM='} 2024-08-28T19:16:23.318 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-28 19:11:26.421252', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIJ7jeNUjYdtmGl1hSwxiX7zCByjyypMVgwJxzocmI+3ZWp8Xt0H9hgaMmDxNMdXr73meIRqqREvwEN4m9Ozk/0='} 2024-08-28T19:16:23.318 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-28T19:16:23.325 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-28T19:16:23.325 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-28T19:16:23.325 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-28T19:16:23.325 INFO:teuthology.run_tasks:Running task console_log... 2024-08-28T19:16:23.450 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc46c213ac0>, signals=[15]) 2024-08-28T19:16:23.450 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-28T19:16:23.457 INFO:teuthology.task.internal:Opening connections... 2024-08-28T19:16:23.457 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-08-28T19:16:23.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T19:16:23.559 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-08-28T19:16:23.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T19:16:23.643 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-08-28T19:16:23.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T19:16:23.727 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-28T19:16:23.732 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-08-28T19:16:23.750 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-08-28T19:16:23.750 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-08-28T19:16:23.807 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-28T19:16:23.808 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-28T19:16:23.809 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-08-28T19:16:23.838 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-08-28T19:16:23.856 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-08-28T19:16:23.856 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-08-28T19:16:23.913 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-08-28T19:16:23.913 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-28T19:16:23.914 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-28T19:16:23.915 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-08-28T19:16:23.946 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-08-28T19:16:23.966 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-08-28T19:16:23.966 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-08-28T19:16:24.024 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-08-28T19:16:24.024 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-08-28T19:16:24.024 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-08-28T19:16:24.024 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-08-28T19:16:24.024 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-08-28T19:16:24.025 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-08-28T19:16:24.025 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-28T19:16:24.025 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-08-28T19:16:24.025 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-08-28T19:16:24.025 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-28T19:16:24.025 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-08-28T19:16:24.025 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-28T19:16:24.025 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-28T19:16:24.025 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-28T19:16:24.025 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-08-28T19:16:24.055 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-28T19:16:24.064 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-28T19:16:24.070 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-28T19:16:24.070 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-08-28T19:16:24.073 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-08-28T19:16:24.075 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-08-28T19:16:24.092 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-28T19:16:24.098 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-28T19:16:24.098 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-08-28T19:16:24.130 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-08-28T19:16:24.132 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-08-28T19:16:24.158 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-28T19:16:24.260 INFO:teuthology.run_tasks:Running task kernel... 2024-08-28T19:16:24.276 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-28T19:16:24.276 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-08-28T19:16:24.276 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-08-28T19:16:24.276 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-28T19:16:24.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:16:24.293 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-08-28T19:16:24.351 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-496.el9.x86_64 2024-08-28T19:16:24.351 INFO:teuthology.task.kernel:Running kernel on smithi033: 5.14.0-496.el9.x86_64 2024-08-28T19:16:24.351 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2024-08-28T19:16:29.134 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-08-28T19:16:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-08-28T19:16:36.069 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.6 MB 00:01 2024-08-28T19:16:37.602 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 18 kB 00:00 2024-08-28T19:16:38.482 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-28T19:16:44.037 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-08-28T19:16:45.952 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-28T19:16:45.952 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-496.el9.x86_64 is already installed. 2024-08-28T19:16:46.039 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-08-28T19:16:46.040 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-08-28T19:16:46.040 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-08-28T19:16:46.142 DEBUG:teuthology.orchestra.run.smithi033:> echo no | sudo yum reinstall kernel || true 2024-08-28T19:16:46.705 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:02 ago on Wed 28 Aug 2024 07:16:44 PM UTC. 2024-08-28T19:16:46.853 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-08-28T19:16:46.861 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-08-28T19:16:46.861 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-08-28T19:16:46.861 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-08-28T19:16:46.862 INFO:teuthology.orchestra.run.smithi033.stdout:Reinstalling: 2024-08-28T19:16:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 5.14.0-496.el9 baseos 1.8 M 2024-08-28T19:16:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:16:46.862 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-08-28T19:16:46.862 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-08-28T19:16:46.862 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:16:46.862 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 1.8 M 2024-08-28T19:16:46.862 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 0 2024-08-28T19:16:46.862 INFO:teuthology.orchestra.run.smithi033.stderr:Operation aborted. 2024-08-28T19:16:46.913 INFO:teuthology.orchestra.run.smithi033.stdout:Is this ok [y/N]: 2024-08-28T19:16:46.914 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum reinstall -y kernel || true 2024-08-28T19:16:47.475 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:03 ago on Wed 28 Aug 2024 07:16:44 PM UTC. 2024-08-28T19:16:47.602 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-08-28T19:16:47.603 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-08-28T19:16:47.603 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-08-28T19:16:47.603 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-08-28T19:16:47.603 INFO:teuthology.orchestra.run.smithi033.stdout:Reinstalling: 2024-08-28T19:16:47.604 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 5.14.0-496.el9 baseos 1.8 M 2024-08-28T19:16:47.604 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:16:47.604 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-08-28T19:16:47.604 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-08-28T19:16:47.604 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:16:47.604 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 1.8 M 2024-08-28T19:16:47.604 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 0 2024-08-28T19:16:47.604 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-08-28T19:16:48.047 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-496.el9.x86_64.rpm 9.6 MB/s | 1.8 MB 00:00 2024-08-28T19:16:48.048 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-08-28T19:16:48.048 INFO:teuthology.orchestra.run.smithi033.stdout:Total 4.0 MB/s | 1.8 MB 00:00 2024-08-28T19:16:48.076 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-08-28T19:16:48.313 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-08-28T19:16:48.313 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-08-28T19:16:48.343 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-08-28T19:16:48.343 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-08-28T19:16:48.524 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-08-28T19:16:48.608 INFO:teuthology.orchestra.run.smithi033.stdout: Reinstalling : kernel-5.14.0-496.el9.x86_64 1/2 2024-08-28T19:16:48.608 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : kernel-5.14.0-496.el9.x86_64 2/2 2024-08-28T19:16:49.341 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-5.14.0-496.el9.x86_64 2/2 2024-08-28T19:16:49.341 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-5.14.0-496.el9.x86_64 1/2 2024-08-28T19:16:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-5.14.0-496.el9.x86_64 2/2 2024-08-28T19:16:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:16:50.093 INFO:teuthology.orchestra.run.smithi033.stdout:Reinstalled: 2024-08-28T19:16:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-5.14.0-496.el9.x86_64 2024-08-28T19:16:50.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:16:50.093 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-08-28T19:16:50.268 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-08-28T19:16:50.326 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-496.el9.x86_64 2024-08-28T19:16:50.326 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-496.el9.x86_64 2024-08-28T19:16:50.326 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-28T19:16:50.326 DEBUG:teuthology.parallel:result is None 2024-08-28T19:16:50.327 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-28T19:16:50.333 INFO:teuthology.task.internal:Creating test directory... 2024-08-28T19:16:50.333 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-28T19:16:50.335 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-28T19:16:50.338 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-28T19:16:50.357 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-28T19:16:50.363 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-28T19:16:50.370 INFO:teuthology.task.internal:Creating archive directory... 2024-08-28T19:16:50.370 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-28T19:16:50.391 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-28T19:16:50.396 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-28T19:16:50.429 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-28T19:16:50.436 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-28T19:16:50.436 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-28T19:16:50.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:16:50.476 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-28T19:16:50.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:16:50.493 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-28T19:16:50.496 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-28T19:16:50.519 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-28T19:16:50.552 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T19:16:50.552 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T19:16:50.566 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T19:16:50.568 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T19:16:50.595 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T19:16:50.613 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-28T19:16:50.615 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-28T19:16:50.622 INFO:teuthology.task.internal:Configuring sudo... 2024-08-28T19:16:50.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-28T19:16:50.624 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-28T19:16:50.627 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-28T19:16:50.657 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-28T19:16:50.665 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-28T19:16:50.666 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-28T19:16:50.690 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-28T19:16:50.693 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-28T19:16:50.715 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T19:16:50.792 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T19:16:50.829 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T19:16:50.919 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T19:16:50.949 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:16:50.950 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-28T19:16:51.013 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T19:16:51.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T19:16:51.111 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T19:16:51.201 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T19:16:51.237 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:16:51.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-28T19:16:51.304 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T19:16:51.357 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-28T19:16:51.406 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T19:16:51.501 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-28T19:16:51.537 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:16:51.537 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-28T19:16:51.605 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-08-28T19:16:51.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-08-28T19:16:51.610 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-08-28T19:16:51.643 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T19:16:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T19:16:51.687 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T19:16:52.091 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-28T19:16:52.098 INFO:teuthology.task.internal:Starting timer... 2024-08-28T19:16:52.098 INFO:teuthology.run_tasks:Running task pcp... 2024-08-28T19:16:52.108 INFO:teuthology.run_tasks:Running task selinux... 2024-08-28T19:16:52.116 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-28T19:16:52.116 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2024-08-28T19:16:52.149 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2024-08-28T19:16:52.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2024-08-28T19:16:52.224 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2024-08-28T19:16:52.226 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2024-08-28T19:16:52.290 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2024-08-28T19:16:52.292 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-28T19:16:52.292 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2024-08-28T19:16:52.333 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2024-08-28T19:16:52.334 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2024-08-28T19:16:52.358 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2024-08-28T19:16:52.358 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2024-08-28T19:16:52.382 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2024-08-28T19:16:52.382 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive'} 2024-08-28T19:16:52.383 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T19:16:52.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:16:52.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T19:16:52.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:16:52.435 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T19:16:52.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:16:52.467 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-28T19:16:52.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2024-08-28T19:16:52.494 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2024-08-28T19:16:52.527 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2024-08-28T19:16:52.557 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-28T19:16:52.565 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-28T19:16:52.568 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-28T19:16:52.756 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-28T19:16:52.768 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-28T19:16:52.769 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi059.front.sepia.ceph.com,smithi122.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-28T19:18:55.951 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com')] 2024-08-28T19:18:55.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-08-28T19:18:55.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T19:18:56.039 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-08-28T19:18:56.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-08-28T19:18:56.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-08-28T19:18:56.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T19:18:56.204 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-08-28T19:18:56.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-08-28T19:18:56.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-08-28T19:18:56.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-28T19:18:56.373 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-08-28T19:18:56.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-08-28T19:18:56.453 INFO:teuthology.run_tasks:Running task clock... 2024-08-28T19:18:56.467 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-28T19:18:56.467 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-28T19:18:56.468 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T19:18:56.470 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-28T19:18:56.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T19:18:56.472 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-28T19:18:56.473 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T19:18:56.498 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-28T19:18:56.502 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-28T19:18:56.512 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-28T19:18:56.519 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-28T19:18:56.523 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-28T19:18:56.537 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2024-08-28T19:18:56.537 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-28T19:18:56.545 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2024-08-28T19:18:56.548 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2024-08-28T19:18:56.556 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2024-08-28T19:18:56.562 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2024-08-28T19:18:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-28T19:18:56.571 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-28T19:18:56.573 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2024-08-28T19:18:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-28T19:18:56.586 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-28T19:18:56.588 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-28T19:18:56.602 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-28T19:18:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-08-28T19:18:56.638 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T19:18:56.638 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-08-28T19:18:56.638 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.638 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.638 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.638 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.642 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-08-28T19:18:56.645 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T19:18:56.646 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-08-28T19:18:56.646 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.646 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.646 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.646 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.668 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-08-28T19:18:56.671 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T19:18:56.671 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-08-28T19:18:56.671 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.671 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.671 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.671 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:18:56.672 INFO:teuthology.run_tasks:Running task install... 2024-08-28T19:18:56.680 DEBUG:teuthology.task.install:project ceph 2024-08-28T19:18:56.680 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-28T19:18:56.680 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-28T19:18:56.680 INFO:teuthology.task.install:Using flavor: default 2024-08-28T19:18:56.685 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-28T19:18:56.686 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-28T19:18:56.686 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-28T19:18:56.686 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:18:56.688 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-28T19:18:56.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:18:56.689 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-28T19:18:56.690 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:18:56.840 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-28T19:18:56.840 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-28T19:18:56.855 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-28T19:18:56.855 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-28T19:18:56.866 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-28T19:18:56.866 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-28T19:18:56.959 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-28T19:18:56.959 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:18:56.960 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-28T19:18:56.971 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-28T19:18:56.971 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:18:56.971 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-28T19:18:56.979 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-28T19:18:56.979 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:18:56.979 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-28T19:18:56.985 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-28T19:18:56.985 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-28T19:18:56.997 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-28T19:18:56.997 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-28T19:18:57.005 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-28T19:18:57.005 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-28T19:18:57.051 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-28T19:18:57.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-28T19:18:57.071 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-28T19:18:57.126 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-28T19:18:57.138 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-28T19:18:57.146 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-28T19:18:57.189 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2024-08-28T19:18:57.190 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2024-08-28T19:18:57.203 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2024-08-28T19:18:57.204 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2024-08-28T19:18:57.213 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2024-08-28T19:18:57.213 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2024-08-28T19:18:57.421 INFO:teuthology.orchestra.run.smithi033.stdout:45 files removed 2024-08-28T19:18:57.433 INFO:teuthology.orchestra.run.smithi059.stdout:45 files removed 2024-08-28T19:18:57.441 INFO:teuthology.orchestra.run.smithi122.stdout:45 files removed 2024-08-28T19:18:57.448 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-28T19:18:57.461 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-28T19:18:57.467 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-28T19:18:58.006 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-08-28T19:18:58.014 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-08-28T19:18:58.019 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-08-28T19:18:58.299 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-08-28T19:18:58.307 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-08-28T19:18:58.312 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-08-28T19:18:58.575 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-28T19:18:58.587 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-28T19:18:58.591 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-08-28T19:18:59.125 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-08-28T19:18:59.671 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 8.2 MB 00:01 2024-08-28T19:19:01.349 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-08-28T19:19:02.856 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-08-28T19:19:03.792 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-08-28T19:19:04.642 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-08-28T19:19:07.156 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.6 MB 00:00 2024-08-28T19:19:08.682 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 18 kB 00:00 2024-08-28T19:19:09.368 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 6.6 MB 00:00 2024-08-28T19:19:09.511 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-28T19:19:09.535 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.6 MB 00:01 2024-08-28T19:19:10.927 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 18 kB 00:00 2024-08-28T19:19:11.077 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 18 kB 00:00 2024-08-28T19:19:11.889 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-28T19:19:11.947 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-28T19:19:14.934 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-08-28T19:19:17.054 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T19:19:17.055 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T19:19:17.068 INFO:teuthology.orchestra.run.smithi122.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-28T19:19:17.069 INFO:teuthology.orchestra.run.smithi122.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-28T19:19:17.070 INFO:teuthology.orchestra.run.smithi122.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-28T19:19:17.071 INFO:teuthology.orchestra.run.smithi122.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-28T19:19:17.072 INFO:teuthology.orchestra.run.smithi122.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-28T19:19:17.075 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-28T19:19:17.076 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-28T19:19:17.136 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-08-28T19:19:17.148 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-28T19:19:17.149 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-28T19:19:17.150 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-28T19:19:17.151 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-28T19:19:17.152 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-28T19:19:17.153 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-28T19:19:17.154 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-28T19:19:17.154 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-28T19:19:17.154 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-28T19:19:17.154 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-28T19:19:17.154 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-28T19:19:17.154 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-28T19:19:17.154 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-28T19:19:17.154 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-28T19:19:17.154 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-28T19:19:17.155 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-28T19:19:17.156 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-28T19:19:17.157 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-28T19:19:17.158 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-28T19:19:17.159 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-28T19:19:17.160 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout:Installing weak dependencies: 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout:======================================================================================= 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout:Install 148 Packages 2024-08-28T19:19:17.161 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 2 Packages 2024-08-28T19:19:17.162 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:19:17.162 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 224 M 2024-08-28T19:19:17.162 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-08-28T19:19:17.570 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-28T19:19:17.578 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-08-28T19:19:17.660 INFO:teuthology.orchestra.run.smithi122.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 56 kB/s | 6.6 kB 00:00 2024-08-28T19:19:17.886 INFO:teuthology.orchestra.run.smithi122.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 3.8 MB/s | 874 kB 00:00 2024-08-28T19:19:18.002 INFO:teuthology.orchestra.run.smithi122.stdout:(3/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 12 MB/s | 5.5 MB 00:00 2024-08-28T19:19:18.028 INFO:teuthology.orchestra.run.smithi122.stdout:(4/150): ceph-immutable-object-cache-19.3.0-456 1.0 MB/s | 148 kB 00:00 2024-08-28T19:19:18.120 INFO:teuthology.orchestra.run.smithi122.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 19 MB/s | 2.3 MB 00:00 2024-08-28T19:19:18.161 INFO:teuthology.orchestra.run.smithi122.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 11 MB/s | 1.5 MB 00:00 2024-08-28T19:19:18.428 INFO:teuthology.orchestra.run.smithi122.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 16 MB/s | 4.9 MB 00:00 2024-08-28T19:19:18.712 INFO:teuthology.orchestra.run.smithi122.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 17 MB/s | 20 MB 00:01 2024-08-28T19:19:18.762 INFO:teuthology.orchestra.run.smithi122.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 505 kB/s | 25 kB 00:00 2024-08-28T19:19:19.096 INFO:teuthology.orchestra.run.smithi122.stdout:(10/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 16 MB/s | 10 MB 00:00 2024-08-28T19:19:19.155 INFO:teuthology.orchestra.run.smithi122.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 3.8 MB/s | 226 kB 00:00 2024-08-28T19:19:19.222 INFO:teuthology.orchestra.run.smithi122.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 406 kB/s | 27 kB 00:00 2024-08-28T19:19:19.280 INFO:teuthology.orchestra.run.smithi122.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 545 kB/s | 32 kB 00:00 2024-08-28T19:19:19.372 INFO:teuthology.orchestra.run.smithi122.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 8.2 MB/s | 766 kB 00:00 2024-08-28T19:19:19.548 INFO:teuthology.orchestra.run.smithi122.stdout:(15/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 13 MB/s | 18 MB 00:01 2024-08-28T19:19:19.573 INFO:teuthology.orchestra.run.smithi122.stdout:(16/150): libcephsqlite-19.3.0-4560.gd19e6118.e 793 kB/s | 159 kB 00:00 2024-08-28T19:19:19.598 INFO:teuthology.orchestra.run.smithi122.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 2.5 MB/s | 127 kB 00:00 2024-08-28T19:19:19.623 INFO:teuthology.orchestra.run.smithi122.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 9.9 MB/s | 506 kB 00:00 2024-08-28T19:19:19.673 INFO:teuthology.orchestra.run.smithi122.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 906 kB/s | 45 kB 00:00 2024-08-28T19:19:19.741 INFO:teuthology.orchestra.run.smithi122.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 2.1 MB/s | 141 kB 00:00 2024-08-28T19:19:19.806 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T19:19:19.807 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T19:19:19.808 INFO:teuthology.orchestra.run.smithi122.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 2.4 MB/s | 161 kB 00:00 2024-08-28T19:19:19.819 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-28T19:19:19.820 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-28T19:19:19.820 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-28T19:19:19.821 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-28T19:19:19.823 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-28T19:19:19.825 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-28T19:19:19.826 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-28T19:19:19.841 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T19:19:19.842 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-28T19:19:19.856 INFO:teuthology.orchestra.run.smithi033.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-28T19:19:19.857 INFO:teuthology.orchestra.run.smithi033.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-28T19:19:19.858 INFO:teuthology.orchestra.run.smithi033.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-28T19:19:19.859 INFO:teuthology.orchestra.run.smithi033.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-28T19:19:19.861 INFO:teuthology.orchestra.run.smithi033.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-28T19:19:19.864 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-28T19:19:19.865 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-28T19:19:19.890 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-08-28T19:19:19.891 INFO:teuthology.orchestra.run.smithi122.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 3.8 MB/s | 321 kB 00:00 2024-08-28T19:19:19.908 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-08-28T19:19:19.908 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-08-28T19:19:19.908 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-28T19:19:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-28T19:19:19.910 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-28T19:19:19.911 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-28T19:19:19.912 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-28T19:19:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-28T19:19:19.914 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-28T19:19:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-28T19:19:19.916 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-28T19:19:19.917 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-28T19:19:19.918 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-28T19:19:19.919 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-08-28T19:19:19.920 INFO:teuthology.orchestra.run.smithi059.stdout:Install 148 Packages 2024-08-28T19:19:19.921 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 2 Packages 2024-08-28T19:19:19.921 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:19:19.921 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 224 M 2024-08-28T19:19:19.921 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-08-28T19:19:19.930 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-08-28T19:19:19.939 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-08-28T19:19:19.939 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-08-28T19:19:19.939 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-08-28T19:19:19.939 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-08-28T19:19:19.939 INFO:teuthology.orchestra.run.smithi033.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-28T19:19:19.939 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-28T19:19:19.939 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-28T19:19:19.939 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-28T19:19:19.939 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-28T19:19:19.940 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-28T19:19:19.941 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-28T19:19:19.942 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-28T19:19:19.943 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-28T19:19:19.943 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-28T19:19:19.943 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-28T19:19:19.943 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-28T19:19:19.943 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-28T19:19:19.943 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-28T19:19:19.944 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-28T19:19:19.945 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-28T19:19:19.946 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-28T19:19:19.947 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-28T19:19:19.948 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-28T19:19:19.949 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-28T19:19:19.950 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout:Installing weak dependencies: 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-08-28T19:19:19.951 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-08-28T19:19:19.952 INFO:teuthology.orchestra.run.smithi033.stdout:Install 148 Packages 2024-08-28T19:19:19.952 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 2 Packages 2024-08-28T19:19:19.952 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:19:19.952 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 224 M 2024-08-28T19:19:19.952 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-08-28T19:19:19.975 INFO:teuthology.orchestra.run.smithi122.stdout:(23/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 14 MB/s | 5.3 MB 00:00 2024-08-28T19:19:20.000 INFO:teuthology.orchestra.run.smithi122.stdout:(24/150): python3-rbd-19.3.0-4560.gd19e6118.el9 2.7 MB/s | 305 kB 00:00 2024-08-28T19:19:20.034 INFO:teuthology.orchestra.run.smithi122.stdout:(25/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.7 MB/s | 99 kB 00:00 2024-08-28T19:19:20.059 INFO:teuthology.orchestra.run.smithi122.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.4 MB/s | 86 kB 00:00 2024-08-28T19:19:20.109 INFO:teuthology.orchestra.run.smithi122.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 3.3 MB/s | 170 kB 00:00 2024-08-28T19:19:20.176 INFO:teuthology.orchestra.run.smithi122.stdout:(28/150): ceph-grafana-dashboards-19.3.0-4560.g 515 kB/s | 34 kB 00:00 2024-08-28T19:19:20.268 INFO:teuthology.orchestra.run.smithi122.stdout:(29/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 13 MB/s | 3.1 MB 00:00 2024-08-28T19:19:20.294 INFO:teuthology.orchestra.run.smithi122.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 1.3 MB/s | 154 kB 00:00 2024-08-28T19:19:20.613 INFO:teuthology.orchestra.run.smithi033.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-08-28T19:19:20.613 INFO:teuthology.orchestra.run.smithi059.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-08-28T19:19:20.719 INFO:teuthology.orchestra.run.smithi122.stdout:(31/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 22 MB/s | 44 MB 00:01 2024-08-28T19:19:20.786 INFO:teuthology.orchestra.run.smithi122.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 4.3 MB/s | 290 kB 00:00 2024-08-28T19:19:20.886 INFO:teuthology.orchestra.run.smithi122.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 493 kB/s | 49 kB 00:00 2024-08-28T19:19:20.987 INFO:teuthology.orchestra.run.smithi122.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 164 kB/s | 16 kB 00:00 2024-08-28T19:19:21.087 INFO:teuthology.orchestra.run.smithi122.stdout:(35/150): ceph-mgr-diskprediction-local-19.3.0- 9.3 MB/s | 7.4 MB 00:00 2024-08-28T19:19:21.096 INFO:teuthology.orchestra.run.smithi033.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 1.8 MB/s | 874 kB 00:00 2024-08-28T19:19:21.121 INFO:teuthology.orchestra.run.smithi122.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 2.1 MB/s | 285 kB 00:00 2024-08-28T19:19:21.180 INFO:teuthology.orchestra.run.smithi033.stdout:(3/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 8.0 MB/s | 5.5 MB 00:00 2024-08-28T19:19:21.196 INFO:teuthology.orchestra.run.smithi122.stdout:(37/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 7.0 MB/s | 781 kB 00:00 2024-08-28T19:19:21.205 INFO:teuthology.orchestra.run.smithi059.stdout:(2/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 7.6 MB/s | 5.5 MB 00:00 2024-08-28T19:19:21.221 INFO:teuthology.orchestra.run.smithi122.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 182 kB/s | 18 kB 00:00 2024-08-28T19:19:21.222 INFO:teuthology.orchestra.run.smithi033.stdout:(4/150): ceph-immutable-object-cache-19.3.0-456 1.2 MB/s | 148 kB 00:00 2024-08-28T19:19:21.272 INFO:teuthology.orchestra.run.smithi059.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 2.2 MB/s | 148 kB 00:00 2024-08-28T19:19:21.330 INFO:teuthology.orchestra.run.smithi122.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-08-28T19:19:21.389 INFO:teuthology.orchestra.run.smithi033.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 11 MB/s | 2.3 MB 00:00 2024-08-28T19:19:21.397 INFO:teuthology.orchestra.run.smithi122.stdout:(40/150): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-08-28T19:19:21.431 INFO:teuthology.orchestra.run.smithi122.stdout:(41/150): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-08-28T19:19:21.456 INFO:teuthology.orchestra.run.smithi059.stdout:(4/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 1.0 MB/s | 874 kB 00:00 2024-08-28T19:19:21.464 INFO:teuthology.orchestra.run.smithi122.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-08-28T19:19:21.498 INFO:teuthology.orchestra.run.smithi059.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 10 MB/s | 2.3 MB 00:00 2024-08-28T19:19:21.506 INFO:teuthology.orchestra.run.smithi122.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-08-28T19:19:21.548 INFO:teuthology.orchestra.run.smithi122.stdout:(44/150): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-08-28T19:19:21.573 INFO:teuthology.orchestra.run.smithi122.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-08-28T19:19:21.598 INFO:teuthology.orchestra.run.smithi122.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-28T19:19:21.624 INFO:teuthology.orchestra.run.smithi122.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-08-28T19:19:21.790 INFO:teuthology.orchestra.run.smithi059.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 4.5 MB/s | 1.5 MB 00:00 2024-08-28T19:19:21.872 INFO:teuthology.orchestra.run.smithi033.stdout:(6/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 10 MB/s | 4.9 MB 00:00 2024-08-28T19:19:21.915 INFO:teuthology.orchestra.run.smithi059.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 12 MB/s | 4.9 MB 00:00 2024-08-28T19:19:21.924 INFO:teuthology.orchestra.run.smithi122.stdout:(48/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 8.5 MB/s | 14 MB 00:01 2024-08-28T19:19:21.948 INFO:teuthology.orchestra.run.smithi033.stdout:(7/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-08-28T19:19:21.991 INFO:teuthology.orchestra.run.smithi122.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 689 kB 00:00 2024-08-28T19:19:22.050 INFO:teuthology.orchestra.run.smithi122.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-08-28T19:19:22.067 INFO:teuthology.orchestra.run.smithi122.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-08-28T19:19:22.109 INFO:teuthology.orchestra.run.smithi122.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-08-28T19:19:22.134 INFO:teuthology.orchestra.run.smithi122.stdout:(53/150): boost-program-options-1.75.0-8.el9.x8 511 kB/s | 107 kB 00:00 2024-08-28T19:19:22.151 INFO:teuthology.orchestra.run.smithi122.stdout:(54/150): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-08-28T19:19:22.176 INFO:teuthology.orchestra.run.smithi122.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-08-28T19:19:22.193 INFO:teuthology.orchestra.run.smithi122.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-08-28T19:19:22.235 INFO:teuthology.orchestra.run.smithi122.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-28T19:19:22.257 INFO:teuthology.orchestra.run.smithi033.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 11 MB/s | 20 MB 00:01 2024-08-28T19:19:22.285 INFO:teuthology.orchestra.run.smithi122.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-08-28T19:19:22.327 INFO:teuthology.orchestra.run.smithi122.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-08-28T19:19:22.332 INFO:teuthology.orchestra.run.smithi033.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 337 kB/s | 25 kB 00:00 2024-08-28T19:19:22.394 INFO:teuthology.orchestra.run.smithi122.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 382 kB/s | 25 kB 00:00 2024-08-28T19:19:22.436 INFO:teuthology.orchestra.run.smithi122.stdout:(61/150): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-08-28T19:19:22.453 INFO:teuthology.orchestra.run.smithi122.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 814 kB/s | 47 kB 00:00 2024-08-28T19:19:22.495 INFO:teuthology.orchestra.run.smithi122.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-08-28T19:19:22.520 INFO:teuthology.orchestra.run.smithi122.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-08-28T19:19:22.554 INFO:teuthology.orchestra.run.smithi122.stdout:(65/150): openblas-0.3.26-1.el9.x86_64.rpm 654 kB/s | 38 kB 00:00 2024-08-28T19:19:22.599 INFO:teuthology.orchestra.run.smithi059.stdout:(8/150): ceph-radosgw-19.3.0-4560.gd19e6118.el9 15 MB/s | 10 MB 00:00 2024-08-28T19:19:22.674 INFO:teuthology.orchestra.run.smithi059.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 337 kB/s | 25 kB 00:00 2024-08-28T19:19:23.157 INFO:teuthology.orchestra.run.smithi033.stdout:(10/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 14 MB/s | 18 MB 00:01 2024-08-28T19:19:23.241 INFO:teuthology.orchestra.run.smithi033.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 2.7 MB/s | 226 kB 00:00 2024-08-28T19:19:23.308 INFO:teuthology.orchestra.run.smithi033.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 406 kB/s | 27 kB 00:00 2024-08-28T19:19:23.363 INFO:teuthology.orchestra.run.smithi122.stdout:(66/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.4 MB/s | 3.0 MB 00:01 2024-08-28T19:19:23.366 INFO:teuthology.orchestra.run.smithi033.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 544 kB/s | 32 kB 00:00 2024-08-28T19:19:23.432 INFO:teuthology.orchestra.run.smithi059.stdout:(10/150): ceph-common-19.3.0-4560.gd19e6118.el9 6.8 MB/s | 20 MB 00:02 2024-08-28T19:19:23.433 INFO:teuthology.orchestra.run.smithi033.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 11 MB/s | 766 kB 00:00 2024-08-28T19:19:23.491 INFO:teuthology.orchestra.run.smithi059.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 3.8 MB/s | 226 kB 00:00 2024-08-28T19:19:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 2.1 MB/s | 159 kB 00:00 2024-08-28T19:19:23.558 INFO:teuthology.orchestra.run.smithi059.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 407 kB/s | 27 kB 00:00 2024-08-28T19:19:23.584 INFO:teuthology.orchestra.run.smithi033.stdout:(16/150): librados-devel-19.3.0-4560.gd19e6118. 1.7 MB/s | 127 kB 00:00 2024-08-28T19:19:23.625 INFO:teuthology.orchestra.run.smithi059.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 476 kB/s | 32 kB 00:00 2024-08-28T19:19:23.667 INFO:teuthology.orchestra.run.smithi033.stdout:(17/150): libradosstriper1-19.3.0-4560.gd19e611 6.0 MB/s | 506 kB 00:00 2024-08-28T19:19:23.800 INFO:teuthology.orchestra.run.smithi059.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 4.3 MB/s | 766 kB 00:00 2024-08-28T19:19:23.892 INFO:teuthology.orchestra.run.smithi059.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 1.7 MB/s | 159 kB 00:00 2024-08-28T19:19:23.984 INFO:teuthology.orchestra.run.smithi059.stdout:(16/150): librados-devel-19.3.0-4560.gd19e6118. 1.4 MB/s | 127 kB 00:00 2024-08-28T19:19:24.101 INFO:teuthology.orchestra.run.smithi033.stdout:(18/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 12 MB/s | 5.3 MB 00:00 2024-08-28T19:19:24.126 INFO:teuthology.orchestra.run.smithi059.stdout:(17/150): libradosstriper1-19.3.0-4560.gd19e611 3.5 MB/s | 506 kB 00:00 2024-08-28T19:19:24.168 INFO:teuthology.orchestra.run.smithi033.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 677 kB/s | 45 kB 00:00 2024-08-28T19:19:24.230 INFO:teuthology.orchestra.run.smithi122.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2024-08-28T19:19:24.251 INFO:teuthology.orchestra.run.smithi033.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.7 MB/s | 141 kB 00:00 2024-08-28T19:19:24.327 INFO:teuthology.orchestra.run.smithi033.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 2.1 MB/s | 161 kB 00:00 2024-08-28T19:19:24.394 INFO:teuthology.orchestra.run.smithi033.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 4.7 MB/s | 321 kB 00:00 2024-08-28T19:19:24.426 INFO:teuthology.orchestra.run.smithi059.stdout:(18/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 6.8 MB/s | 18 MB 00:02 2024-08-28T19:19:24.461 INFO:teuthology.orchestra.run.smithi033.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 4.5 MB/s | 305 kB 00:00 2024-08-28T19:19:24.493 INFO:teuthology.orchestra.run.smithi059.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 680 kB/s | 45 kB 00:00 2024-08-28T19:19:24.536 INFO:teuthology.orchestra.run.smithi033.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.3 MB/s | 99 kB 00:00 2024-08-28T19:19:24.576 INFO:teuthology.orchestra.run.smithi059.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.7 MB/s | 141 kB 00:00 2024-08-28T19:19:24.611 INFO:teuthology.orchestra.run.smithi033.stdout:(25/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.1 MB/s | 86 kB 00:00 2024-08-28T19:19:24.630 INFO:teuthology.orchestra.run.smithi122.stdout:(68/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 2.1 MB/s | 4.4 MB 00:02 2024-08-28T19:19:24.660 INFO:teuthology.orchestra.run.smithi059.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 1.9 MB/s | 161 kB 00:00 2024-08-28T19:19:24.744 INFO:teuthology.orchestra.run.smithi059.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 3.8 MB/s | 321 kB 00:00 2024-08-28T19:19:24.780 INFO:teuthology.orchestra.run.smithi122.stdout:(69/150): openblas-openmp-0.3.26-1.el9.x86_64.r 2.2 MB/s | 4.9 MB 00:02 2024-08-28T19:19:24.802 INFO:teuthology.orchestra.run.smithi059.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 5.1 MB/s | 305 kB 00:00 2024-08-28T19:19:24.805 INFO:teuthology.orchestra.run.smithi122.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 785 kB/s | 137 kB 00:00 2024-08-28T19:19:24.831 INFO:teuthology.orchestra.run.smithi122.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 1.5 MB/s | 910 kB 00:00 2024-08-28T19:19:24.869 INFO:teuthology.orchestra.run.smithi059.stdout:(24/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 7.1 MB/s | 5.3 MB 00:00 2024-08-28T19:19:24.894 INFO:teuthology.orchestra.run.smithi059.stdout:(25/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.1 MB/s | 99 kB 00:00 2024-08-28T19:19:24.911 INFO:teuthology.orchestra.run.smithi059.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 2.0 MB/s | 86 kB 00:00 2024-08-28T19:19:24.915 INFO:teuthology.orchestra.run.smithi122.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-08-28T19:19:24.962 INFO:teuthology.orchestra.run.smithi059.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 3.3 MB/s | 170 kB 00:00 2024-08-28T19:19:24.973 INFO:teuthology.orchestra.run.smithi122.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 6.0 MB/s | 1.0 MB 00:00 2024-08-28T19:19:25.023 INFO:teuthology.orchestra.run.smithi122.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-08-28T19:19:25.078 INFO:teuthology.orchestra.run.smithi033.stdout:(26/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 16 MB/s | 44 MB 00:02 2024-08-28T19:19:25.090 INFO:teuthology.orchestra.run.smithi122.stdout:(75/150): python3-devel-3.9.19-7.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-08-28T19:19:25.145 INFO:teuthology.orchestra.run.smithi033.stdout:(27/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 5.8 MB/s | 3.1 MB 00:00 2024-08-28T19:19:25.149 INFO:teuthology.orchestra.run.smithi122.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-28T19:19:25.170 INFO:teuthology.orchestra.run.smithi033.stdout:(28/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 1.8 MB/s | 170 kB 00:00 2024-08-28T19:19:25.196 INFO:teuthology.orchestra.run.smithi033.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 685 kB/s | 34 kB 00:00 2024-08-28T19:19:25.199 INFO:teuthology.orchestra.run.smithi122.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-08-28T19:19:25.213 INFO:teuthology.orchestra.run.smithi033.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 3.6 MB/s | 154 kB 00:00 2024-08-28T19:19:25.249 INFO:teuthology.orchestra.run.smithi122.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-08-28T19:19:25.308 INFO:teuthology.orchestra.run.smithi122.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-08-28T19:19:25.367 INFO:teuthology.orchestra.run.smithi122.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-08-28T19:19:25.370 INFO:teuthology.orchestra.run.smithi059.stdout:(28/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 16 MB/s | 44 MB 00:02 2024-08-28T19:19:25.395 INFO:teuthology.orchestra.run.smithi059.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 79 kB/s | 34 kB 00:00 2024-08-28T19:19:25.462 INFO:teuthology.orchestra.run.smithi059.stdout:(30/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 5.4 MB/s | 3.1 MB 00:00 2024-08-28T19:19:25.488 INFO:teuthology.orchestra.run.smithi059.stdout:(31/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 1.3 MB/s | 154 kB 00:00 2024-08-28T19:19:25.534 INFO:teuthology.orchestra.run.smithi122.stdout:(81/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-08-28T19:19:25.538 INFO:teuthology.orchestra.run.smithi033.stdout:(31/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 2.9 MB/s | 10 MB 00:03 2024-08-28T19:19:25.554 INFO:teuthology.orchestra.run.smithi059.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 4.3 MB/s | 290 kB 00:00 2024-08-28T19:19:25.592 INFO:teuthology.orchestra.run.smithi122.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-08-28T19:19:25.613 INFO:teuthology.orchestra.run.smithi059.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 848 kB/s | 49 kB 00:00 2024-08-28T19:19:25.630 INFO:teuthology.orchestra.run.smithi033.stdout:(32/150): ceph-mgr-diskprediction-local-19.3.0- 18 MB/s | 7.4 MB 00:00 2024-08-28T19:19:25.655 INFO:teuthology.orchestra.run.smithi033.stdout:(33/150): ceph-mgr-modules-core-19.3.0-4560.gd1 2.4 MB/s | 290 kB 00:00 2024-08-28T19:19:25.659 INFO:teuthology.orchestra.run.smithi122.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-08-28T19:19:25.672 INFO:teuthology.orchestra.run.smithi059.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 281 kB/s | 16 kB 00:00 2024-08-28T19:19:25.681 INFO:teuthology.orchestra.run.smithi033.stdout:(34/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 984 kB/s | 49 kB 00:00 2024-08-28T19:19:25.706 INFO:teuthology.orchestra.run.smithi033.stdout:(35/150): ceph-prometheus-alerts-19.3.0-4560.gd 327 kB/s | 16 kB 00:00 2024-08-28T19:19:25.735 INFO:teuthology.orchestra.run.smithi122.stdout:(84/150): python3-babel-2.9.1-2.el9.noarch.rpm 7.3 MB/s | 6.0 MB 00:00 2024-08-28T19:19:25.739 INFO:teuthology.orchestra.run.smithi059.stdout:(35/150): ceph-volume-19.3.0-4560.gd19e6118.el9 4.2 MB/s | 285 kB 00:00 2024-08-28T19:19:25.739 INFO:teuthology.orchestra.run.smithi033.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 4.8 MB/s | 285 kB 00:00 2024-08-28T19:19:25.760 INFO:teuthology.orchestra.run.smithi122.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 769 kB/s | 77 kB 00:00 2024-08-28T19:19:25.785 INFO:teuthology.orchestra.run.smithi122.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-08-28T19:19:25.815 INFO:teuthology.orchestra.run.smithi033.stdout:(37/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 242 kB/s | 18 kB 00:00 2024-08-28T19:19:25.819 INFO:teuthology.orchestra.run.smithi122.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-08-28T19:19:25.856 INFO:teuthology.orchestra.run.smithi059.stdout:(36/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 6.5 MB/s | 781 kB 00:00 2024-08-28T19:19:25.865 INFO:teuthology.orchestra.run.smithi122.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-08-28T19:19:25.894 INFO:teuthology.orchestra.run.smithi122.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-08-28T19:19:25.906 INFO:teuthology.orchestra.run.smithi059.stdout:(37/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 367 kB/s | 18 kB 00:00 2024-08-28T19:19:25.920 INFO:teuthology.orchestra.run.smithi122.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 944 kB/s | 51 kB 00:00 2024-08-28T19:19:25.991 INFO:teuthology.orchestra.run.smithi033.stdout:(38/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 18 MB/s | 14 MB 00:00 2024-08-28T19:19:26.003 INFO:teuthology.orchestra.run.smithi122.stdout:(91/150): postgresql-server-13.16-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-08-28T19:19:26.020 INFO:teuthology.orchestra.run.smithi122.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2024-08-28T19:19:26.024 INFO:teuthology.orchestra.run.smithi033.stdout:(39/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 2.4 MB/s | 781 kB 00:00 2024-08-28T19:19:26.046 INFO:teuthology.orchestra.run.smithi122.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 987 kB/s | 42 kB 00:00 2024-08-28T19:19:26.063 INFO:teuthology.orchestra.run.smithi122.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-08-28T19:19:26.082 INFO:teuthology.orchestra.run.smithi059.stdout:(38/150): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-08-28T19:19:26.107 INFO:teuthology.orchestra.run.smithi059.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 399 kB/s | 80 kB 00:00 2024-08-28T19:19:26.107 INFO:teuthology.orchestra.run.smithi033.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 273 kB/s | 80 kB 00:00 2024-08-28T19:19:26.113 INFO:teuthology.orchestra.run.smithi122.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-08-28T19:19:26.130 INFO:teuthology.orchestra.run.smithi122.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-08-28T19:19:26.163 INFO:teuthology.orchestra.run.smithi122.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-08-28T19:19:26.182 INFO:teuthology.orchestra.run.smithi059.stdout:(40/150): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-08-28T19:19:26.189 INFO:teuthology.orchestra.run.smithi122.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-28T19:19:26.222 INFO:teuthology.orchestra.run.smithi122.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-08-28T19:19:26.248 INFO:teuthology.orchestra.run.smithi122.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-08-28T19:19:26.266 INFO:teuthology.orchestra.run.smithi059.stdout:(41/150): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-08-28T19:19:26.291 INFO:teuthology.orchestra.run.smithi059.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-08-28T19:19:26.292 INFO:teuthology.orchestra.run.smithi033.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-08-28T19:19:26.317 INFO:teuthology.orchestra.run.smithi033.stdout:(42/150): libquadmath-11.5.0-2.el9.x86_64.rpm 654 kB/s | 191 kB 00:00 2024-08-28T19:19:26.400 INFO:teuthology.orchestra.run.smithi033.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-08-28T19:19:26.415 INFO:teuthology.orchestra.run.smithi122.stdout:(101/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-08-28T19:19:26.440 INFO:teuthology.orchestra.run.smithi122.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 233 kB/s | 45 kB 00:00 2024-08-28T19:19:26.458 INFO:teuthology.orchestra.run.smithi033.stdout:(44/150): libgfortran-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 801 kB 00:00 2024-08-28T19:19:26.465 INFO:teuthology.orchestra.run.smithi122.stdout:(103/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 262 kB/s | 64 kB 00:00 2024-08-28T19:19:26.474 INFO:teuthology.orchestra.run.smithi059.stdout:(43/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 13 MB/s | 14 MB 00:01 2024-08-28T19:19:26.484 INFO:teuthology.orchestra.run.smithi033.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-08-28T19:19:26.500 INFO:teuthology.orchestra.run.smithi059.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 510 kB/s | 106 kB 00:00 2024-08-28T19:19:26.524 INFO:teuthology.orchestra.run.smithi122.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-08-28T19:19:26.533 INFO:teuthology.orchestra.run.smithi059.stdout:(45/150): python3-cryptography-36.0.1-4.el9.x86 4.6 MB/s | 1.2 MB 00:00 2024-08-28T19:19:26.534 INFO:teuthology.orchestra.run.smithi033.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-08-28T19:19:26.549 INFO:teuthology.orchestra.run.smithi122.stdout:(105/150): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-08-28T19:19:26.583 INFO:teuthology.orchestra.run.smithi122.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 5.2 MB/s | 309 kB 00:00 2024-08-28T19:19:26.592 INFO:teuthology.orchestra.run.smithi059.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-08-28T19:19:26.601 INFO:teuthology.orchestra.run.smithi033.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-08-28T19:19:26.608 INFO:teuthology.orchestra.run.smithi122.stdout:(107/150): grpc-data-1.46.7-10.el9.noarch.rpm 331 kB/s | 19 kB 00:00 2024-08-28T19:19:26.617 INFO:teuthology.orchestra.run.smithi059.stdout:(47/150): python3-pycparser-2.20-6.el9.noarch.r 950 kB/s | 135 kB 00:00 2024-08-28T19:19:26.633 INFO:teuthology.orchestra.run.smithi122.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-28T19:19:26.642 INFO:teuthology.orchestra.run.smithi059.stdout:(48/150): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-08-28T19:19:26.667 INFO:teuthology.orchestra.run.smithi122.stdout:(109/150): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-08-28T19:19:26.692 INFO:teuthology.orchestra.run.smithi122.stdout:(110/150): liboath-2.6.7-2.el9.x86_64.rpm 829 kB/s | 49 kB 00:00 2024-08-28T19:19:26.701 INFO:teuthology.orchestra.run.smithi033.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 3.0 MB/s | 1.2 MB 00:00 2024-08-28T19:19:26.734 INFO:teuthology.orchestra.run.smithi122.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 4.3 MB/s | 151 kB 00:00 2024-08-28T19:19:26.759 INFO:teuthology.orchestra.run.smithi122.stdout:(112/150): libunwind-1.6.2-1.el9.x86_64.rpm 730 kB/s | 67 kB 00:00 2024-08-28T19:19:26.776 INFO:teuthology.orchestra.run.smithi059.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 803 kB/s | 107 kB 00:00 2024-08-28T19:19:26.818 INFO:teuthology.orchestra.run.smithi059.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-08-28T19:19:26.818 INFO:teuthology.orchestra.run.smithi122.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-08-28T19:19:26.835 INFO:teuthology.orchestra.run.smithi059.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-08-28T19:19:26.843 INFO:teuthology.orchestra.run.smithi122.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-08-28T19:19:26.843 INFO:teuthology.orchestra.run.smithi033.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 755 kB/s | 107 kB 00:00 2024-08-28T19:19:26.860 INFO:teuthology.orchestra.run.smithi059.stdout:(52/150): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-08-28T19:19:26.869 INFO:teuthology.orchestra.run.smithi122.stdout:(115/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 863 kB/s | 43 kB 00:00 2024-08-28T19:19:26.877 INFO:teuthology.orchestra.run.smithi059.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 778 kB/s | 33 kB 00:00 2024-08-28T19:19:26.877 INFO:teuthology.orchestra.run.smithi033.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-08-28T19:19:26.894 INFO:teuthology.orchestra.run.smithi122.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 638 kB/s | 32 kB 00:00 2024-08-28T19:19:26.902 INFO:teuthology.orchestra.run.smithi033.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-08-28T19:19:26.902 INFO:teuthology.orchestra.run.smithi059.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 313 kB 00:00 2024-08-28T19:19:26.919 INFO:teuthology.orchestra.run.smithi122.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-08-28T19:19:26.928 INFO:teuthology.orchestra.run.smithi059.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-08-28T19:19:26.944 INFO:teuthology.orchestra.run.smithi033.stdout:(52/150): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-08-28T19:19:26.945 INFO:teuthology.orchestra.run.smithi122.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-28T19:19:26.953 INFO:teuthology.orchestra.run.smithi059.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-28T19:19:26.970 INFO:teuthology.orchestra.run.smithi033.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-08-28T19:19:26.970 INFO:teuthology.orchestra.run.smithi122.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-08-28T19:19:26.978 INFO:teuthology.orchestra.run.smithi059.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-28T19:19:27.003 INFO:teuthology.orchestra.run.smithi059.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-08-28T19:19:27.020 INFO:teuthology.orchestra.run.smithi033.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-08-28T19:19:27.037 INFO:teuthology.orchestra.run.smithi122.stdout:(120/150): libarrow-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 4.4 MB 00:00 2024-08-28T19:19:27.045 INFO:teuthology.orchestra.run.smithi059.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-28T19:19:27.062 INFO:teuthology.orchestra.run.smithi122.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-08-28T19:19:27.079 INFO:teuthology.orchestra.run.smithi033.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-08-28T19:19:27.096 INFO:teuthology.orchestra.run.smithi059.stdout:(60/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-08-28T19:19:27.096 INFO:teuthology.orchestra.run.smithi122.stdout:(122/150): python3-google-auth-2.34.0-1.el9.noa 1.7 MB/s | 220 kB 00:00 2024-08-28T19:19:27.121 INFO:teuthology.orchestra.run.smithi059.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 339 kB/s | 25 kB 00:00 2024-08-28T19:19:27.121 INFO:teuthology.orchestra.run.smithi122.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-08-28T19:19:27.129 INFO:teuthology.orchestra.run.smithi033.stdout:(56/150): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-08-28T19:19:27.146 INFO:teuthology.orchestra.run.smithi059.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-08-28T19:19:27.146 INFO:teuthology.orchestra.run.smithi122.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-08-28T19:19:27.154 INFO:teuthology.orchestra.run.smithi033.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-08-28T19:19:27.171 INFO:teuthology.orchestra.run.smithi059.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-28T19:19:27.172 INFO:teuthology.orchestra.run.smithi122.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-08-28T19:19:27.179 INFO:teuthology.orchestra.run.smithi033.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-08-28T19:19:27.197 INFO:teuthology.orchestra.run.smithi122.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-08-28T19:19:27.205 INFO:teuthology.orchestra.run.smithi059.stdout:(64/150): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-08-28T19:19:27.222 INFO:teuthology.orchestra.run.smithi122.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-08-28T19:19:27.230 INFO:teuthology.orchestra.run.smithi059.stdout:(65/150): openblas-0.3.26-1.el9.x86_64.rpm 654 kB/s | 38 kB 00:00 2024-08-28T19:19:27.239 INFO:teuthology.orchestra.run.smithi122.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 468 kB/s | 20 kB 00:00 2024-08-28T19:19:27.256 INFO:teuthology.orchestra.run.smithi059.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-08-28T19:19:27.264 INFO:teuthology.orchestra.run.smithi122.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-28T19:19:27.281 INFO:teuthology.orchestra.run.smithi033.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-08-28T19:19:27.290 INFO:teuthology.orchestra.run.smithi122.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-28T19:19:27.323 INFO:teuthology.orchestra.run.smithi059.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-08-28T19:19:27.323 INFO:teuthology.orchestra.run.smithi122.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-08-28T19:19:27.330 INFO:teuthology.orchestra.run.smithi033.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 508 kB/s | 25 kB 00:00 2024-08-28T19:19:27.374 INFO:teuthology.orchestra.run.smithi122.stdout:(132/150): python3-grpcio-1.46.7-10.el9.x86_64. 6.0 MB/s | 2.0 MB 00:00 2024-08-28T19:19:27.380 INFO:teuthology.orchestra.run.smithi033.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 953 kB/s | 47 kB 00:00 2024-08-28T19:19:27.390 INFO:teuthology.orchestra.run.smithi059.stdout:(68/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-08-28T19:19:27.399 INFO:teuthology.orchestra.run.smithi122.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-28T19:19:27.433 INFO:teuthology.orchestra.run.smithi122.stdout:(134/150): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-08-28T19:19:27.447 INFO:teuthology.orchestra.run.smithi033.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 2.1 MB/s | 581 kB 00:00 2024-08-28T19:19:27.456 INFO:teuthology.orchestra.run.smithi059.stdout:(69/150): openblas-openmp-0.3.26-1.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-08-28T19:19:27.458 INFO:teuthology.orchestra.run.smithi122.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-08-28T19:19:27.464 INFO:teuthology.orchestra.run.smithi033.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-08-28T19:19:27.473 INFO:teuthology.orchestra.run.smithi059.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-08-28T19:19:27.475 INFO:teuthology.orchestra.run.smithi122.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-08-28T19:19:27.499 INFO:teuthology.orchestra.run.smithi059.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-08-28T19:19:27.501 INFO:teuthology.orchestra.run.smithi122.stdout:(137/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-08-28T19:19:27.514 INFO:teuthology.orchestra.run.smithi033.stdout:(64/150): openblas-0.3.26-1.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-08-28T19:19:27.517 INFO:teuthology.orchestra.run.smithi122.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 522 kB/s | 31 kB 00:00 2024-08-28T19:19:27.534 INFO:teuthology.orchestra.run.smithi122.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-08-28T19:19:27.541 INFO:teuthology.orchestra.run.smithi059.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-08-28T19:19:27.551 INFO:teuthology.orchestra.run.smithi122.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-08-28T19:19:27.565 INFO:teuthology.orchestra.run.smithi033.stdout:(65/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-08-28T19:19:27.566 INFO:teuthology.orchestra.run.smithi059.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-08-28T19:19:27.576 INFO:teuthology.orchestra.run.smithi122.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-28T19:19:27.590 INFO:teuthology.orchestra.run.smithi033.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-08-28T19:19:27.601 INFO:teuthology.orchestra.run.smithi122.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-08-28T19:19:27.608 INFO:teuthology.orchestra.run.smithi059.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-08-28T19:19:27.627 INFO:teuthology.orchestra.run.smithi122.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-28T19:19:27.660 INFO:teuthology.orchestra.run.smithi122.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-08-28T19:19:27.683 INFO:teuthology.orchestra.run.smithi059.stdout:(75/150): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-08-28T19:19:27.685 INFO:teuthology.orchestra.run.smithi122.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-08-28T19:19:27.700 INFO:teuthology.orchestra.run.smithi059.stdout:(76/150): python3-devel-3.9.19-7.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-08-28T19:19:27.711 INFO:teuthology.orchestra.run.smithi122.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-28T19:19:27.745 INFO:teuthology.orchestra.run.smithi122.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-08-28T19:19:27.775 INFO:teuthology.orchestra.run.smithi059.stdout:(77/150): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-08-28T19:19:27.795 INFO:teuthology.orchestra.run.smithi122.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-28T19:19:27.800 INFO:teuthology.orchestra.run.smithi059.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 255 kB/s | 26 kB 00:00 2024-08-28T19:19:27.826 INFO:teuthology.orchestra.run.smithi059.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-08-28T19:19:27.851 INFO:teuthology.orchestra.run.smithi059.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-28T19:19:27.866 INFO:teuthology.orchestra.run.smithi033.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-08-28T19:19:27.876 INFO:teuthology.orchestra.run.smithi059.stdout:(81/150): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-08-28T19:19:27.893 INFO:teuthology.orchestra.run.smithi059.stdout:(82/150): python3-markupsafe-1.1.1-12.el9.x86_6 517 kB/s | 35 kB 00:00 2024-08-28T19:19:27.927 INFO:teuthology.orchestra.run.smithi059.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-08-28T19:19:27.952 INFO:teuthology.orchestra.run.smithi059.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-08-28T19:19:27.977 INFO:teuthology.orchestra.run.smithi059.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-28T19:19:27.994 INFO:teuthology.orchestra.run.smithi059.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-08-28T19:19:28.003 INFO:teuthology.orchestra.run.smithi122.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 12 MB/s | 3.4 MB 00:00 2024-08-28T19:19:28.028 INFO:teuthology.orchestra.run.smithi059.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-08-28T19:19:28.045 INFO:teuthology.orchestra.run.smithi059.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-28T19:19:28.058 INFO:teuthology.orchestra.run.smithi033.stdout:(68/150): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-08-28T19:19:28.071 INFO:teuthology.orchestra.run.smithi122.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 9.7 MB/s | 3.1 MB 00:00 2024-08-28T19:19:28.076 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-08-28T19:19:28.077 INFO:teuthology.orchestra.run.smithi122.stdout:Total 20 MB/s | 224 MB 00:10 2024-08-28T19:19:28.078 INFO:teuthology.orchestra.run.smithi059.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-28T19:19:28.095 INFO:teuthology.orchestra.run.smithi059.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-28T19:19:28.116 INFO:teuthology.orchestra.run.smithi033.stdout:(69/150): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-08-28T19:19:28.154 INFO:teuthology.orchestra.run.smithi059.stdout:(91/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-08-28T19:19:28.171 INFO:teuthology.orchestra.run.smithi059.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 582 kB/s | 54 kB 00:00 2024-08-28T19:19:28.188 INFO:teuthology.orchestra.run.smithi059.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-08-28T19:19:28.205 INFO:teuthology.orchestra.run.smithi059.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-08-28T19:19:28.238 INFO:teuthology.orchestra.run.smithi059.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-08-28T19:19:28.264 INFO:teuthology.orchestra.run.smithi059.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 610 kB/s | 36 kB 00:00 2024-08-28T19:19:28.266 INFO:teuthology.orchestra.run.smithi033.stdout:(70/150): openblas-openmp-0.3.26-1.el9.x86_64.r 6.6 MB/s | 4.9 MB 00:00 2024-08-28T19:19:28.289 INFO:teuthology.orchestra.run.smithi059.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 940 kB/s | 47 kB 00:00 2024-08-28T19:19:28.314 INFO:teuthology.orchestra.run.smithi059.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-28T19:19:28.339 INFO:teuthology.orchestra.run.smithi059.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-08-28T19:19:28.357 INFO:teuthology.orchestra.run.smithi059.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-08-28T19:19:28.382 INFO:teuthology.orchestra.run.smithi059.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-08-28T19:19:28.407 INFO:teuthology.orchestra.run.smithi059.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-08-28T19:19:28.417 INFO:teuthology.orchestra.run.smithi033.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-08-28T19:19:28.457 INFO:teuthology.orchestra.run.smithi059.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-08-28T19:19:28.467 INFO:teuthology.orchestra.run.smithi033.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-08-28T19:19:28.499 INFO:teuthology.orchestra.run.smithi059.stdout:(104/150): protobuf-compiler-3.14.0-13.el9.x86_ 9.2 MB/s | 863 kB 00:00 2024-08-28T19:19:28.558 INFO:teuthology.orchestra.run.smithi059.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-08-28T19:19:28.583 INFO:teuthology.orchestra.run.smithi059.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-08-28T19:19:28.609 INFO:teuthology.orchestra.run.smithi059.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-08-28T19:19:28.634 INFO:teuthology.orchestra.run.smithi059.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-28T19:19:28.659 INFO:teuthology.orchestra.run.smithi059.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-28T19:19:28.684 INFO:teuthology.orchestra.run.smithi059.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-28T19:19:28.712 INFO:teuthology.orchestra.run.smithi059.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-08-28T19:19:28.752 INFO:teuthology.orchestra.run.smithi059.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-08-28T19:19:28.909 INFO:teuthology.orchestra.run.smithi033.stdout:(73/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-08-28T19:19:28.910 INFO:teuthology.orchestra.run.smithi059.stdout:(113/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-08-28T19:19:28.944 INFO:teuthology.orchestra.run.smithi059.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-08-28T19:19:28.959 INFO:teuthology.orchestra.run.smithi033.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-08-28T19:19:28.969 INFO:teuthology.orchestra.run.smithi059.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-08-28T19:19:28.994 INFO:teuthology.orchestra.run.smithi059.stdout:(116/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-08-28T19:19:29.020 INFO:teuthology.orchestra.run.smithi059.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-08-28T19:19:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-08-28T19:19:29.060 INFO:teuthology.orchestra.run.smithi033.stdout:(75/150): postgresql-server-13.16-1.el9.x86_64. 6.1 MB/s | 5.8 MB 00:00 2024-08-28T19:19:29.079 INFO:teuthology.orchestra.run.smithi059.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-28T19:19:29.084 INFO:teuthology.orchestra.run.smithi033.stdout:(76/150): python3-devel-3.9.19-7.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-08-28T19:19:29.112 INFO:teuthology.orchestra.run.smithi059.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-28T19:19:29.120 INFO:teuthology.orchestra.run.smithi033.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-28T19:19:29.135 INFO:teuthology.orchestra.run.smithi033.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-08-28T19:19:29.137 INFO:teuthology.orchestra.run.smithi059.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-08-28T19:19:29.155 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-08-28T19:19:29.155 INFO:teuthology.orchestra.run.smithi059.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 8.5 MB/s | 144 kB 00:00 2024-08-28T19:19:29.160 INFO:teuthology.orchestra.run.smithi033.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-08-28T19:19:29.180 INFO:teuthology.orchestra.run.smithi059.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-08-28T19:19:29.202 INFO:teuthology.orchestra.run.smithi033.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 834 kB/s | 35 kB 00:00 2024-08-28T19:19:29.205 INFO:teuthology.orchestra.run.smithi059.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-08-28T19:19:29.228 INFO:teuthology.orchestra.run.smithi033.stdout:(81/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-08-28T19:19:29.230 INFO:teuthology.orchestra.run.smithi059.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-08-28T19:19:29.264 INFO:teuthology.orchestra.run.smithi059.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 580 kB/s | 19 kB 00:00 2024-08-28T19:19:29.282 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-08-28T19:19:29.283 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-08-28T19:19:29.289 INFO:teuthology.orchestra.run.smithi059.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 796 kB/s | 20 kB 00:00 2024-08-28T19:19:29.303 INFO:teuthology.orchestra.run.smithi033.stdout:(82/150): python3-babel-2.9.1-2.el9.noarch.rpm 7.1 MB/s | 6.0 MB 00:00 2024-08-28T19:19:29.345 INFO:teuthology.orchestra.run.smithi033.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-08-28T19:19:29.370 INFO:teuthology.orchestra.run.smithi033.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-08-28T19:19:29.381 INFO:teuthology.orchestra.run.smithi059.stdout:(128/150): libarrow-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-08-28T19:19:29.404 INFO:teuthology.orchestra.run.smithi033.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-28T19:19:29.407 INFO:teuthology.orchestra.run.smithi059.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-28T19:19:29.429 INFO:teuthology.orchestra.run.smithi033.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-08-28T19:19:29.432 INFO:teuthology.orchestra.run.smithi059.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-28T19:19:29.457 INFO:teuthology.orchestra.run.smithi059.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-28T19:19:29.488 INFO:teuthology.orchestra.run.smithi033.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-08-28T19:19:29.499 INFO:teuthology.orchestra.run.smithi059.stdout:(132/150): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-08-28T19:19:29.513 INFO:teuthology.orchestra.run.smithi033.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-08-28T19:19:29.524 INFO:teuthology.orchestra.run.smithi059.stdout:(133/150): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2024-08-28T19:19:29.538 INFO:teuthology.orchestra.run.smithi033.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-28T19:19:29.550 INFO:teuthology.orchestra.run.smithi059.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-08-28T19:19:29.563 INFO:teuthology.orchestra.run.smithi033.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-28T19:19:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-28T19:19:29.589 INFO:teuthology.orchestra.run.smithi033.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-28T19:19:29.592 INFO:teuthology.orchestra.run.smithi059.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-08-28T19:19:29.617 INFO:teuthology.orchestra.run.smithi059.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 737 kB/s | 31 kB 00:00 2024-08-28T19:19:29.639 INFO:teuthology.orchestra.run.smithi033.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 837 kB/s | 42 kB 00:00 2024-08-28T19:19:29.642 INFO:teuthology.orchestra.run.smithi059.stdout:(138/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-08-28T19:19:29.668 INFO:teuthology.orchestra.run.smithi059.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-28T19:19:29.693 INFO:teuthology.orchestra.run.smithi059.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-08-28T19:19:29.706 INFO:teuthology.orchestra.run.smithi033.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 662 kB/s | 44 kB 00:00 2024-08-28T19:19:29.710 INFO:teuthology.orchestra.run.smithi059.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-08-28T19:19:29.727 INFO:teuthology.orchestra.run.smithi059.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-08-28T19:19:29.752 INFO:teuthology.orchestra.run.smithi059.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-08-28T19:19:29.769 INFO:teuthology.orchestra.run.smithi059.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-28T19:19:29.773 INFO:teuthology.orchestra.run.smithi033.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-08-28T19:19:29.794 INFO:teuthology.orchestra.run.smithi059.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-08-28T19:19:29.819 INFO:teuthology.orchestra.run.smithi059.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-28T19:19:29.845 INFO:teuthology.orchestra.run.smithi059.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-08-28T19:19:29.865 INFO:teuthology.orchestra.run.smithi033.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 392 kB/s | 36 kB 00:00 2024-08-28T19:19:29.895 INFO:teuthology.orchestra.run.smithi059.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-28T19:19:29.941 INFO:teuthology.orchestra.run.smithi033.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-08-28T19:19:30.024 INFO:teuthology.orchestra.run.smithi033.stdout:(97/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.2 MB/s | 5.1 MB 00:00 2024-08-28T19:19:30.050 INFO:teuthology.orchestra.run.smithi033.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-08-28T19:19:30.083 INFO:teuthology.orchestra.run.smithi033.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 992 kB/s | 58 kB 00:00 2024-08-28T19:19:30.108 INFO:teuthology.orchestra.run.smithi033.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-08-28T19:19:30.120 INFO:teuthology.orchestra.run.smithi059.stdout:(149/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 3.1 MB 00:00 2024-08-28T19:19:30.142 INFO:teuthology.orchestra.run.smithi033.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-28T19:19:30.167 INFO:teuthology.orchestra.run.smithi033.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-08-28T19:19:30.187 INFO:teuthology.orchestra.run.smithi059.stdout:(150/150): librados2-19.3.0-4560.gd19e6118.el9. 9.2 MB/s | 3.4 MB 00:00 2024-08-28T19:19:30.193 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-08-28T19:19:30.193 INFO:teuthology.orchestra.run.smithi059.stdout:Total 22 MB/s | 224 MB 00:10 2024-08-28T19:19:30.276 INFO:teuthology.orchestra.run.smithi033.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-08-28T19:19:30.335 INFO:teuthology.orchestra.run.smithi033.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-08-28T19:19:30.368 INFO:teuthology.orchestra.run.smithi033.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-08-28T19:19:30.393 INFO:teuthology.orchestra.run.smithi033.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-08-28T19:19:30.511 INFO:teuthology.orchestra.run.smithi033.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-08-28T19:19:30.544 INFO:teuthology.orchestra.run.smithi033.stdout:(108/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-08-28T19:19:30.578 INFO:teuthology.orchestra.run.smithi033.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-08-28T19:19:30.603 INFO:teuthology.orchestra.run.smithi033.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-08-28T19:19:30.628 INFO:teuthology.orchestra.run.smithi033.stdout:(111/150): liboath-2.6.7-2.el9.x86_64.rpm 579 kB/s | 49 kB 00:00 2024-08-28T19:19:30.654 INFO:teuthology.orchestra.run.smithi033.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-08-28T19:19:30.695 INFO:teuthology.orchestra.run.smithi033.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-08-28T19:19:30.721 INFO:teuthology.orchestra.run.smithi033.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-28T19:19:30.746 INFO:teuthology.orchestra.run.smithi033.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-28T19:19:30.772 INFO:teuthology.orchestra.run.smithi033.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-08-28T19:19:30.805 INFO:teuthology.orchestra.run.smithi033.stdout:(117/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 839 kB 00:00 2024-08-28T19:19:30.822 INFO:teuthology.orchestra.run.smithi033.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-28T19:19:30.856 INFO:teuthology.orchestra.run.smithi033.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-08-28T19:19:30.881 INFO:teuthology.orchestra.run.smithi033.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-28T19:19:30.915 INFO:teuthology.orchestra.run.smithi033.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-08-28T19:19:30.940 INFO:teuthology.orchestra.run.smithi033.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-08-28T19:19:30.966 INFO:teuthology.orchestra.run.smithi033.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-08-28T19:19:30.991 INFO:teuthology.orchestra.run.smithi033.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-08-28T19:19:31.016 INFO:teuthology.orchestra.run.smithi033.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-08-28T19:19:31.025 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-08-28T19:19:31.026 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-08-28T19:19:31.042 INFO:teuthology.orchestra.run.smithi033.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-08-28T19:19:31.067 INFO:teuthology.orchestra.run.smithi033.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-08-28T19:19:31.125 INFO:teuthology.orchestra.run.smithi033.stdout:(128/150): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2024-08-28T19:19:31.151 INFO:teuthology.orchestra.run.smithi033.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-28T19:19:31.176 INFO:teuthology.orchestra.run.smithi033.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-28T19:19:31.201 INFO:teuthology.orchestra.run.smithi033.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-28T19:19:31.235 INFO:teuthology.orchestra.run.smithi033.stdout:(132/150): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-08-28T19:19:31.261 INFO:teuthology.orchestra.run.smithi033.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-08-28T19:19:31.277 INFO:teuthology.orchestra.run.smithi033.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 5.3 MB/s | 90 kB 00:00 2024-08-28T19:19:31.303 INFO:teuthology.orchestra.run.smithi033.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-08-28T19:19:31.315 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-08-28T19:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 678 kB/s | 28 kB 00:00 2024-08-28T19:19:31.337 INFO:teuthology.orchestra.run.smithi033.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-08-28T19:19:31.362 INFO:teuthology.orchestra.run.smithi033.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-08-28T19:19:31.379 INFO:teuthology.orchestra.run.smithi033.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-08-28T19:19:31.396 INFO:teuthology.orchestra.run.smithi033.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-08-28T19:19:31.413 INFO:teuthology.orchestra.run.smithi033.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 2.2 MB/s | 74 kB 00:00 2024-08-28T19:19:31.438 INFO:teuthology.orchestra.run.smithi033.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-28T19:19:31.452 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-08-28T19:19:31.452 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-08-28T19:19:31.463 INFO:teuthology.orchestra.run.smithi033.stdout:(143/150): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-08-28T19:19:31.530 INFO:teuthology.orchestra.run.smithi033.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-08-28T19:19:31.556 INFO:teuthology.orchestra.run.smithi033.stdout:(145/150): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2024-08-28T19:19:31.589 INFO:teuthology.orchestra.run.smithi033.stdout:(146/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-08-28T19:19:31.748 INFO:teuthology.orchestra.run.smithi033.stdout:(147/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-08-28T19:19:31.799 INFO:teuthology.orchestra.run.smithi033.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-08-28T19:19:31.990 INFO:teuthology.orchestra.run.smithi033.stdout:(149/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 13 MB/s | 3.1 MB 00:00 2024-08-28T19:19:32.207 INFO:teuthology.orchestra.run.smithi033.stdout:(150/150): librados2-19.3.0-4560.gd19e6118.el9. 5.5 MB/s | 3.4 MB 00:00 2024-08-28T19:19:32.212 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-08-28T19:19:32.212 INFO:teuthology.orchestra.run.smithi033.stdout:Total 18 MB/s | 224 MB 00:12 2024-08-28T19:19:33.296 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-08-28T19:19:33.296 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-08-28T19:19:33.340 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-08-28T19:19:33.479 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-08-28T19:19:33.480 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-08-28T19:19:35.331 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-08-28T19:19:35.332 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-08-28T19:19:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-08-28T19:19:37.098 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-28T19:19:37.124 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-28T19:19:37.166 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-28T19:19:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-28T19:19:37.738 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-28T19:19:37.867 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-28T19:19:37.892 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-28T19:19:37.966 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-28T19:19:38.009 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-28T19:19:38.038 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-28T19:19:38.080 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-28T19:19:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-28T19:19:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-28T19:19:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-28T19:19:38.403 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-28T19:19:38.424 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-28T19:19:38.469 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-28T19:19:38.491 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-28T19:19:38.515 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-28T19:19:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-28T19:19:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-28T19:19:38.931 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-28T19:19:38.964 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-28T19:19:39.000 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-28T19:19:39.083 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-28T19:19:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-28T19:19:39.174 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-28T19:19:39.213 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-08-28T19:19:39.218 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-28T19:19:39.250 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-28T19:19:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-28T19:19:39.286 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-28T19:19:39.357 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-28T19:19:39.368 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-28T19:19:39.426 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-28T19:19:39.455 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-28T19:19:39.494 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-28T19:19:39.499 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-28T19:19:39.578 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-28T19:19:39.619 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-28T19:19:39.654 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-28T19:19:39.674 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-28T19:19:39.746 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-28T19:19:39.797 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-28T19:19:39.852 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-28T19:19:39.873 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-28T19:19:39.974 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-28T19:19:40.007 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-28T19:19:40.058 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-28T19:19:40.103 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-28T19:19:40.134 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-28T19:19:40.235 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-28T19:19:40.276 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-28T19:19:40.296 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-28T19:19:40.322 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-28T19:19:40.486 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-28T19:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-28T19:19:40.564 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-28T19:19:40.596 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-28T19:19:40.671 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-28T19:19:40.671 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-28T19:19:40.698 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-28T19:19:40.699 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-28T19:19:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-28T19:19:40.761 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-28T19:19:40.780 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-28T19:19:40.782 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-28T19:19:40.802 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-28T19:19:40.805 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-28T19:19:40.898 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-28T19:19:40.962 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-28T19:19:41.034 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-28T19:19:41.065 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-28T19:19:41.101 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-28T19:19:41.114 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-28T19:19:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-28T19:19:41.149 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-28T19:19:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-28T19:19:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-28T19:19:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-08-28T19:19:41.261 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-28T19:19:41.262 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-28T19:19:41.289 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-28T19:19:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-28T19:19:41.325 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-28T19:19:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-28T19:19:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-28T19:19:41.392 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-28T19:19:41.399 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-28T19:19:41.443 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-28T19:19:41.446 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-28T19:19:41.482 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-28T19:19:41.487 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-28T19:19:41.526 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-28T19:19:41.558 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-28T19:19:41.591 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-28T19:19:41.594 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-28T19:19:41.629 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-28T19:19:41.667 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-28T19:19:41.669 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-28T19:19:41.695 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-28T19:19:41.718 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-28T19:19:41.719 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-28T19:19:41.746 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-28T19:19:41.782 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-28T19:19:41.791 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-28T19:19:41.794 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-28T19:19:41.855 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-28T19:19:41.869 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-28T19:19:41.885 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-28T19:19:41.920 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-28T19:19:41.921 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-28T19:19:41.948 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-28T19:19:41.960 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-28T19:19:41.988 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-28T19:19:41.998 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-28T19:19:42.011 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-28T19:19:42.022 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-28T19:19:42.024 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-28T19:19:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-28T19:19:42.072 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-28T19:19:42.087 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-28T19:19:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-28T19:19:42.129 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-28T19:19:42.135 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-28T19:19:42.151 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-28T19:19:42.158 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-28T19:19:42.165 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-28T19:19:42.184 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-28T19:19:42.191 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-28T19:19:42.224 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-28T19:19:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-28T19:19:42.300 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-28T19:19:42.301 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-28T19:19:42.347 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-28T19:19:42.361 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-28T19:19:42.388 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-28T19:19:42.407 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-28T19:19:42.434 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-28T19:19:42.525 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-28T19:19:42.552 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-28T19:19:42.598 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-28T19:19:42.620 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-28T19:19:42.629 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-28T19:19:42.645 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-28T19:19:42.663 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-28T19:19:42.767 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-28T19:19:42.814 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-28T19:19:42.938 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-28T19:19:42.960 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-28T19:19:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-28T19:19:43.025 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-28T19:19:43.057 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-28T19:19:43.100 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-28T19:19:43.111 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-28T19:19:43.130 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-28T19:19:43.143 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-28T19:19:43.154 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-28T19:19:43.187 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-28T19:19:43.244 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-28T19:19:43.263 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-28T19:19:43.305 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-28T19:19:43.314 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-28T19:19:43.362 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-28T19:19:43.387 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-28T19:19:43.406 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-28T19:19:43.423 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-28T19:19:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-28T19:19:43.460 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-28T19:19:43.466 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-28T19:19:43.508 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-28T19:19:43.538 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-28T19:19:43.541 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-28T19:19:43.542 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-28T19:19:43.586 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-28T19:19:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-28T19:19:43.598 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-28T19:19:43.619 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-28T19:19:43.628 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-28T19:19:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-28T19:19:43.680 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-28T19:19:43.719 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-28T19:19:43.761 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-28T19:19:43.766 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-28T19:19:43.774 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-28T19:19:43.790 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-28T19:19:43.811 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-28T19:19:43.812 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-28T19:19:43.825 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-28T19:19:43.854 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-28T19:19:43.854 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-28T19:19:43.891 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-28T19:19:43.922 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-28T19:19:43.931 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-28T19:19:43.964 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-28T19:19:43.978 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-28T19:19:43.995 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-28T19:19:44.036 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-28T19:19:44.057 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-28T19:19:44.060 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-28T19:19:44.085 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-28T19:19:44.106 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-28T19:19:44.136 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-28T19:19:44.164 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-28T19:19:44.205 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-28T19:19:44.214 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-28T19:19:44.257 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-28T19:19:44.294 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-28T19:19:44.334 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-28T19:19:44.362 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-28T19:19:44.405 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-28T19:19:44.450 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-28T19:19:44.487 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-28T19:19:44.527 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-28T19:19:44.556 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-28T19:19:44.591 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-28T19:19:44.624 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-28T19:19:44.740 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-28T19:19:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-28T19:19:44.821 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-28T19:19:44.868 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-28T19:19:44.876 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-28T19:19:44.904 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-28T19:19:44.931 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-28T19:19:44.938 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-28T19:19:44.961 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-28T19:19:44.973 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-28T19:19:44.986 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-28T19:19:45.011 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-28T19:19:45.044 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-28T19:19:45.072 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-28T19:19:45.131 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-28T19:19:45.140 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-28T19:19:45.202 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-28T19:19:45.276 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-28T19:19:45.313 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-28T19:19:45.349 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-28T19:19:45.389 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-28T19:19:45.424 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-28T19:19:45.468 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-28T19:19:45.510 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-28T19:19:45.653 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-28T19:19:45.694 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-28T19:19:45.736 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-28T19:19:45.844 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-28T19:19:45.886 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-28T19:19:45.906 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-28T19:19:45.926 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-28T19:19:45.951 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-28T19:19:45.952 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-28T19:19:45.976 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-28T19:19:45.985 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-28T19:19:46.054 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-28T19:19:46.090 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-28T19:19:46.141 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-28T19:19:46.183 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-28T19:19:46.186 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-28T19:19:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-28T19:19:46.225 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-28T19:19:46.245 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-28T19:19:46.278 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-28T19:19:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-28T19:19:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-28T19:19:46.312 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-28T19:19:46.325 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-28T19:19:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-28T19:19:46.362 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-28T19:19:46.371 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-28T19:19:46.401 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-28T19:19:46.431 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-28T19:19:46.466 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-28T19:19:46.499 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-28T19:19:46.504 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-28T19:19:46.541 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-28T19:19:46.543 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-28T19:19:46.575 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-28T19:19:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-28T19:19:46.666 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-28T19:19:46.689 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-28T19:19:46.715 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-28T19:19:46.733 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-28T19:19:46.825 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-28T19:19:46.837 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-28T19:19:46.847 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-28T19:19:46.883 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-28T19:19:47.043 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-28T19:19:47.099 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-28T19:19:47.325 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-28T19:19:47.379 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-28T19:19:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-28T19:19:47.439 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-28T19:19:47.475 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-28T19:19:47.506 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-28T19:19:47.873 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-28T19:19:47.919 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-28T19:19:47.953 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-28T19:19:48.051 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-28T19:19:48.101 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-28T19:19:48.146 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-28T19:19:48.238 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-28T19:19:48.281 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-28T19:19:48.463 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-28T19:19:48.495 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-28T19:19:48.574 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-28T19:19:48.776 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-28T19:19:48.853 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-28T19:19:48.882 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-28T19:19:48.923 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-28T19:19:49.263 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-28T19:19:49.268 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-28T19:19:49.310 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-28T19:19:49.392 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-28T19:19:49.394 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-28T19:19:49.415 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-28T19:19:49.452 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-28T19:19:49.755 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-28T19:19:49.786 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-28T19:19:49.977 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-28T19:19:50.005 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-28T19:19:50.060 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-28T19:19:50.090 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-28T19:19:50.358 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-28T19:19:50.398 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-28T19:19:50.491 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-28T19:19:50.491 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-28T19:19:50.492 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-28T19:19:50.492 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:19:50.525 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-28T19:19:50.705 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-28T19:19:50.789 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-28T19:19:50.809 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-28T19:19:50.833 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-28T19:19:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-28T19:19:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-28T19:19:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-28T19:19:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-28T19:19:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-28T19:19:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-28T19:19:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-28T19:19:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-28T19:19:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-28T19:19:52.710 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-28T19:19:52.745 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-28T19:19:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-28T19:19:53.390 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-28T19:19:53.482 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-28T19:19:53.482 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-28T19:19:53.482 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-28T19:19:53.482 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:19:53.524 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-28T19:19:54.376 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-28T19:19:54.414 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-28T19:19:55.013 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-28T19:19:55.067 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-28T19:19:55.160 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-28T19:19:55.160 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-28T19:19:55.160 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-28T19:19:55.160 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:19:55.193 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-28T19:20:02.167 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-28T19:20:02.167 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2024-08-28T19:20:02.167 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2024-08-28T19:20:02.167 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2024-08-28T19:20:02.167 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2024-08-28T19:20:02.167 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2024-08-28T19:20:02.167 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /root 2024-08-28T19:20:02.167 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2024-08-28T19:20:02.167 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:02.334 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-28T19:20:02.349 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-28T19:20:02.349 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:02.349 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-28T19:20:02.349 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:03.945 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-28T19:20:03.972 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-28T19:20:03.972 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:03.972 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-28T19:20:03.972 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T19:20:03.972 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T19:20:03.972 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:04.206 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-28T19:20:04.230 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-28T19:20:04.230 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:04.230 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-28T19:20:04.230 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T19:20:04.230 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T19:20:04.230 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:04.690 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-28T19:20:04.714 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-28T19:20:04.714 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:04.714 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-28T19:20:04.714 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T19:20:04.714 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T19:20:04.714 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:04.820 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-28T19:20:04.877 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-28T19:20:04.932 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-28T19:20:05.115 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-28T19:20:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-28T19:20:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-28T19:20:05.354 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-28T19:20:05.488 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-28T19:20:05.534 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-28T19:20:05.535 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-28T19:20:05.535 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2024-08-28T19:20:05.535 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2024-08-28T19:20:05.535 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2024-08-28T19:20:05.535 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2024-08-28T19:20:05.536 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2024-08-28T19:20:05.536 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /root 2024-08-28T19:20:05.536 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2024-08-28T19:20:05.536 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:05.566 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-28T19:20:05.594 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-28T19:20:05.712 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-28T19:20:05.728 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-28T19:20:05.728 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:05.728 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-28T19:20:05.728 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:06.082 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-28T19:20:06.101 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-28T19:20:06.134 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-28T19:20:06.199 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-28T19:20:06.233 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-28T19:20:07.374 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-28T19:20:07.401 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-28T19:20:07.401 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:07.401 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-28T19:20:07.402 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T19:20:07.402 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T19:20:07.402 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:07.633 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-28T19:20:07.656 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-28T19:20:07.656 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:07.656 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-28T19:20:07.656 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T19:20:07.657 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T19:20:07.657 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:07.705 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-28T19:20:07.706 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2024-08-28T19:20:07.706 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2024-08-28T19:20:07.706 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2024-08-28T19:20:07.706 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2024-08-28T19:20:07.706 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2024-08-28T19:20:07.706 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /root 2024-08-28T19:20:07.706 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2024-08-28T19:20:07.706 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:07.897 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-28T19:20:07.912 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-28T19:20:07.912 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:07.912 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-28T19:20:07.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:08.142 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-28T19:20:08.165 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-28T19:20:08.165 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:08.165 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-28T19:20:08.165 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T19:20:08.166 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T19:20:08.166 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:08.273 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-28T19:20:08.331 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-28T19:20:08.394 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-28T19:20:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-28T19:20:08.635 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-28T19:20:08.716 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-28T19:20:08.806 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-28T19:20:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-28T19:20:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-28T19:20:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-28T19:20:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-28T19:20:09.403 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-28T19:20:09.407 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-28T19:20:09.426 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-28T19:20:09.450 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-28T19:20:09.474 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-28T19:20:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-28T19:20:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-28T19:20:09.550 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-28T19:20:09.576 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-28T19:20:09.576 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:09.576 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-28T19:20:09.576 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T19:20:09.576 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-28T19:20:09.576 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:09.817 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-28T19:20:09.840 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-28T19:20:09.840 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:09.840 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-28T19:20:09.840 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T19:20:09.840 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-28T19:20:09.841 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:10.326 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-28T19:20:10.349 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-28T19:20:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-28T19:20:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T19:20:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-28T19:20:10.349 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:10.433 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-28T19:20:10.456 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-28T19:20:10.465 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-28T19:20:10.514 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-28T19:20:10.569 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-28T19:20:10.578 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-28T19:20:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-28T19:20:10.761 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-28T19:20:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-28T19:20:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-28T19:20:10.800 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:10.800 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-28T19:20:10.800 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T19:20:10.800 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T19:20:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:10.810 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-28T19:20:10.835 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-28T19:20:10.847 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-28T19:20:10.890 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-28T19:20:10.938 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-28T19:20:10.979 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-28T19:20:10.991 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-28T19:20:11.122 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-28T19:20:11.168 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-28T19:20:11.200 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-28T19:20:11.228 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-28T19:20:11.625 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-28T19:20:11.651 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-28T19:20:11.684 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-28T19:20:11.752 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-28T19:20:11.791 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-28T19:20:11.947 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-28T19:20:11.980 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-28T19:20:12.003 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-28T19:20:12.003 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:12.003 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-28T19:20:12.004 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T19:20:12.004 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T19:20:12.004 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:12.047 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-28T19:20:12.070 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-28T19:20:12.070 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:12.070 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-28T19:20:12.070 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:12.115 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-28T19:20:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-28T19:20:12.138 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:12.138 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-28T19:20:12.138 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T19:20:12.138 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T19:20:12.138 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:12.449 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-28T19:20:12.472 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-28T19:20:12.472 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:12.472 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-28T19:20:12.472 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T19:20:12.472 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T19:20:12.473 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:12.910 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-28T19:20:12.972 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-28T19:20:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-28T19:20:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-28T19:20:14.168 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-28T19:20:14.339 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-28T19:20:14.374 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-28T19:20:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-28T19:20:14.399 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:14.399 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-28T19:20:14.399 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T19:20:14.399 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T19:20:14.399 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:14.450 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-28T19:20:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-28T19:20:14.565 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-28T19:20:14.616 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-28T19:20:15.136 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-28T19:20:15.181 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-28T19:20:15.632 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-28T19:20:15.661 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-28T19:20:15.685 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-28T19:20:15.685 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:15.685 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-28T19:20:15.686 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T19:20:15.686 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T19:20:15.686 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:15.729 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-28T19:20:15.752 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-28T19:20:15.752 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:15.752 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-28T19:20:15.752 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:15.805 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-28T19:20:15.828 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-28T19:20:15.828 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:15.829 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-28T19:20:15.829 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T19:20:15.829 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T19:20:15.829 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:16.163 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-28T19:20:16.187 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-28T19:20:16.187 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:16.187 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-28T19:20:16.187 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T19:20:16.187 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T19:20:16.188 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:16.192 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-28T19:20:16.214 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-28T19:20:16.332 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-28T19:20:16.505 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-28T19:20:16.533 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-28T19:20:16.556 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-28T19:20:16.556 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:16.556 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-28T19:20:16.557 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T19:20:16.557 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-28T19:20:16.557 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:16.600 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-28T19:20:16.611 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-28T19:20:16.714 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-28T19:20:16.766 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-28T19:20:16.795 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-28T19:20:16.837 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-28T19:20:16.877 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-28T19:20:16.901 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-28T19:20:16.920 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-28T19:20:17.100 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-28T19:20:17.142 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-28T19:20:17.172 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-28T19:20:17.752 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-28T19:20:17.779 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-28T19:20:17.796 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-28T19:20:17.811 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-28T19:20:17.816 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-28T19:20:17.834 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-28T19:20:17.835 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:17.835 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-28T19:20:17.835 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T19:20:17.835 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-28T19:20:17.835 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:17.878 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-28T19:20:17.900 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-28T19:20:17.901 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:17.901 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-28T19:20:17.901 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:17.954 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-28T19:20:17.977 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-28T19:20:17.977 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:17.977 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-28T19:20:17.977 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T19:20:17.978 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-28T19:20:17.978 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:18.305 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-28T19:20:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-28T19:20:18.328 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-28T19:20:18.328 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-28T19:20:18.328 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T19:20:18.328 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-28T19:20:18.328 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:18.635 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-28T19:20:18.720 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-28T19:20:18.760 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-28T19:20:18.840 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-28T19:20:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-28T19:20:18.874 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-28T19:20:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-28T19:20:18.958 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-28T19:20:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-28T19:20:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-28T19:20:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-28T19:20:20.898 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-28T19:20:20.926 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-28T19:20:21.129 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-28T19:20:21.172 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-28T19:20:21.201 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-28T19:20:21.720 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-28T19:20:21.758 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-28T19:20:21.778 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-28T19:20:22.690 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-28T19:20:22.780 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-28T19:20:22.813 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-28T19:20:22.897 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-28T19:20:22.925 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-28T19:20:22.933 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-28T19:20:22.934 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-28T19:20:22.967 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-28T19:20:23.007 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-28T19:20:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-28T19:20:23.017 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-28T19:20:23.039 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-28T19:20:23.066 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-28T19:20:23.257 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-28T19:20:23.312 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-28T19:20:23.342 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-28T19:20:23.872 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-28T19:20:23.915 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-28T19:20:23.935 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-28T19:20:24.808 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-28T19:20:24.903 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-28T19:20:24.945 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-28T19:20:25.028 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-28T19:20:25.057 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-28T19:20:25.057 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-28T19:20:25.124 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-28T19:20:25.124 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-28T19:20:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-28T19:20:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-28T19:20:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-28T19:20:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-28T19:20:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-28T19:20:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-28T19:20:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-28T19:20:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-28T19:20:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-28T19:20:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-28T19:20:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-28T19:20:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-28T19:20:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-28T19:20:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-28T19:20:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-28T19:20:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-28T19:20:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-28T19:20:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-28T19:20:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-28T19:20:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-28T19:20:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-28T19:20:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-28T19:20:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-28T19:20:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-28T19:20:28.346 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-28T19:20:28.346 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout: automake-1.16.2-8.el9.noarch 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout: bison-3.7.4-5.el9.x86_64 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.347 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:28.348 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: flex-2.6.4-9.el9.x86_64 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-28T19:20:28.349 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-28T19:20:28.350 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: lua-5.4.4-4.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-28T19:20:28.351 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-13.16-1.el9.x86_64 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-28T19:20:28.352 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-28T19:20:28.353 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-28T19:20:28.354 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply-3.11-14.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-28T19:20:28.355 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-28T19:20:28.356 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.357 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:28.358 INFO:teuthology.orchestra.run.smithi122.stdout: re2-1:20211101-20.el9.x86_64 2024-08-28T19:20:28.358 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-28T19:20:28.358 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-28T19:20:28.358 INFO:teuthology.orchestra.run.smithi122.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-28T19:20:28.358 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-28T19:20:28.358 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-28T19:20:28.358 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-28T19:20:28.359 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:20:28.359 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-08-28T19:20:28.696 DEBUG:teuthology.parallel:result is None 2024-08-28T19:20:29.379 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-28T19:20:29.379 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-28T19:20:29.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-28T19:20:29.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-28T19:20:29.382 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-28T19:20:29.382 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-28T19:20:29.382 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-28T19:20:29.382 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-28T19:20:29.393 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-28T19:20:29.393 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-28T19:20:29.393 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-28T19:20:29.393 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-28T19:20:29.393 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-28T19:20:29.393 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-28T19:20:29.393 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-28T19:20:29.393 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-28T19:20:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-28T19:20:29.395 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-28T19:20:29.396 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-28T19:20:29.397 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-28T19:20:29.398 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-28T19:20:29.399 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-28T19:20:29.400 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-28T19:20:29.401 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-28T19:20:29.402 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-28T19:20:31.483 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-28T19:20:31.484 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-28T19:20:31.485 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-28T19:20:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-28T19:20:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-28T19:20:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-28T19:20:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-28T19:20:31.486 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-28T19:20:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-28T19:20:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-28T19:20:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-28T19:20:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-28T19:20:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-28T19:20:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-28T19:20:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-28T19:20:31.497 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-28T19:20:31.498 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-28T19:20:31.499 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-28T19:20:31.500 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-28T19:20:31.501 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-28T19:20:31.502 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-28T19:20:31.503 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-28T19:20:31.504 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-28T19:20:31.505 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-28T19:20:31.506 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-28T19:20:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-28T19:20:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:31.833 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2024-08-28T19:20:31.833 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.834 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-08-28T19:20:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-28T19:20:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.2-8.el9.noarch 2024-08-28T19:20:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.7.4-5.el9.x86_64 2024-08-28T19:20:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-28T19:20:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.4-9.el9.x86_64 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-28T19:20:31.836 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-28T19:20:31.837 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-28T19:20:31.838 INFO:teuthology.orchestra.run.smithi059.stdout: lua-5.4.4-4.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-13.16-1.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-28T19:20:31.839 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-28T19:20:31.840 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-28T19:20:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-28T19:20:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-28T19:20:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-28T19:20:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-28T19:20:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-28T19:20:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-28T19:20:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-28T19:20:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-28T19:20:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-28T19:20:31.841 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-28T19:20:31.842 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply-3.11-14.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-28T19:20:31.843 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-28T19:20:31.844 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-28T19:20:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-28T19:20:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-28T19:20:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-28T19:20:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-28T19:20:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-28T19:20:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-28T19:20:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-28T19:20:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-28T19:20:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-28T19:20:31.845 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-28T19:20:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: re2-1:20211101-20.el9.x86_64 2024-08-28T19:20:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-28T19:20:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-28T19:20:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-28T19:20:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-28T19:20:31.846 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-28T19:20:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-28T19:20:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:20:31.847 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-08-28T19:20:32.178 DEBUG:teuthology.parallel:result is None 2024-08-28T19:20:33.988 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-28T19:20:33.988 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout: automake-1.16.2-8.el9.noarch 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout: bison-3.7.4-5.el9.x86_64 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.989 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:33.990 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: flex-2.6.4-9.el9.x86_64 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-28T19:20:33.991 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-28T19:20:33.992 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-28T19:20:33.993 INFO:teuthology.orchestra.run.smithi033.stdout: lua-5.4.4-4.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-13.16-1.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-28T19:20:33.994 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-28T19:20:33.995 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-28T19:20:33.996 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-28T19:20:33.997 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply-3.11-14.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.998 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-28T19:20:33.999 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: re2-1:20211101-20.el9.x86_64 2024-08-28T19:20:34.000 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-28T19:20:34.001 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-28T19:20:34.001 INFO:teuthology.orchestra.run.smithi033.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-28T19:20:34.001 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-28T19:20:34.001 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-28T19:20:34.001 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-28T19:20:34.001 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:20:34.001 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-08-28T19:20:34.334 DEBUG:teuthology.parallel:result is None 2024-08-28T19:20:34.335 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:20:34.490 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-28T19:20:34.512 INFO:teuthology.orchestra.run.smithi033.stdout:19.3.0-4560.gd19e6118.el9 2024-08-28T19:20:34.513 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-28T19:20:34.513 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-28T19:20:34.515 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:20:34.665 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-28T19:20:34.690 INFO:teuthology.orchestra.run.smithi059.stdout:19.3.0-4560.gd19e6118.el9 2024-08-28T19:20:34.691 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-28T19:20:34.691 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-28T19:20:34.693 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:20:34.837 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-28T19:20:34.863 INFO:teuthology.orchestra.run.smithi122.stdout:19.3.0-4560.gd19e6118.el9 2024-08-28T19:20:34.864 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-28T19:20:34.864 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-28T19:20:34.866 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-28T19:20:34.866 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:20:34.866 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-28T19:20:34.893 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:20:34.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-28T19:20:34.925 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:20:34.925 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-28T19:20:34.957 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-28T19:20:34.957 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:20:34.957 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-08-28T19:20:34.982 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-28T19:20:35.049 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:20:35.049 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-08-28T19:20:35.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-28T19:20:35.149 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:20:35.150 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-08-28T19:20:35.180 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-28T19:20:35.250 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-28T19:20:35.250 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:20:35.250 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-28T19:20:35.275 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-28T19:20:35.340 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:20:35.340 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-28T19:20:35.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-28T19:20:35.439 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:20:35.440 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-28T19:20:35.468 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-28T19:20:35.538 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-28T19:20:35.538 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:20:35.538 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-08-28T19:20:35.563 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-28T19:20:35.629 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:20:35.629 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-08-28T19:20:35.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-28T19:20:35.726 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:20:35.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-08-28T19:20:35.756 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-28T19:20:35.827 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-28T19:20:35.926 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-08-28T19:20:35.926 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:20:35.927 INFO:tasks.cephadm:Cluster fsid is 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:20:35.927 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-28T19:20:35.927 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.33', 'mon.b': '172.21.15.59', 'mon.c': '172.21.15.122'} 2024-08-28T19:20:35.927 INFO:tasks.cephadm:First mon is mon.a on smithi033 2024-08-28T19:20:35.927 INFO:tasks.cephadm:First mgr is x 2024-08-28T19:20:35.928 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-28T19:20:35.928 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname $(hostname -s) 2024-08-28T19:20:35.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname $(hostname -s) 2024-08-28T19:20:35.983 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname $(hostname -s) 2024-08-28T19:20:36.012 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-28T19:20:36.012 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:20:36.162 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82586/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4560-gd19e6118', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4560.gd19e6118'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-28 11:15:32.801765', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240828.085847-main-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-28T19:20:36.305 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-mchangir-testing-20240828.085847-main-debug, sha1 d19e6118f7015f0047264006cb0c873528eb3ae6 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:20:36.307 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-28T19:20:36.307 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-28T19:20:36.307 DEBUG:teuthology.orchestra.run.smithi033:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-28T19:20:37.020 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 28 19:20 /home/ubuntu/cephtest/cephadm 2024-08-28T19:20:37.021 DEBUG:teuthology.orchestra.run.smithi059:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-28T19:20:37.638 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 28 19:20 /home/ubuntu/cephtest/cephadm 2024-08-28T19:20:37.638 DEBUG:teuthology.orchestra.run.smithi122:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-28T19:20:38.477 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 28 19:20 /home/ubuntu/cephtest/cephadm 2024-08-28T19:20:38.478 DEBUG:teuthology.orchestra.run.smithi033:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-28T19:20:38.496 DEBUG:teuthology.orchestra.run.smithi059:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-28T19:20:38.516 DEBUG:teuthology.orchestra.run.smithi122:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-28T19:20:38.551 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 on all hosts... 2024-08-28T19:20:38.551 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-28T19:20:38.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-28T19:20:38.558 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-28T19:20:40.179 INFO:teuthology.orchestra.run.smithi033.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-28T19:20:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-28T19:20:40.297 INFO:teuthology.orchestra.run.smithi122.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-28T19:21:09.718 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-08-28T19:21:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-28T19:21:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-28T19:21:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "repo_digests": [ 2024-08-28T19:21:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-28T19:21:09.719 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-08-28T19:21:09.719 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-08-28T19:21:11.871 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-08-28T19:21:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-28T19:21:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-28T19:21:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "repo_digests": [ 2024-08-28T19:21:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-28T19:21:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-08-28T19:21:11.871 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-08-28T19:21:12.377 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:21:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-28T19:21:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-28T19:21:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "repo_digests": [ 2024-08-28T19:21:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-28T19:21:12.377 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:21:12.377 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:21:12.403 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph 2024-08-28T19:21:12.445 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph 2024-08-28T19:21:12.478 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph 2024-08-28T19:21:12.507 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /etc/ceph 2024-08-28T19:21:12.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /etc/ceph 2024-08-28T19:21:12.561 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /etc/ceph 2024-08-28T19:21:12.587 INFO:tasks.cephadm:Writing seed config... 2024-08-28T19:21:12.588 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-28T19:21:12.588 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-08-28T19:21:12.588 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-28T19:21:12.588 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-28T19:21:12.589 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-08-28T19:21:12.590 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-28T19:21:12.590 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-28T19:21:12.590 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-28T19:21:12.590 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-28T19:21:12.590 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-28T19:21:12.590 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-28T19:21:12.590 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-08-28T19:21:12.591 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:21:12.591 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-28T19:21:12.606 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 9a2fc37c-6572-11ef-bcd4-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-08-28T19:21:12.607 DEBUG:teuthology.orchestra.run.smithi033:mon.a> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.a.service 2024-08-28T19:21:12.649 DEBUG:teuthology.orchestra.run.smithi033:mgr.x> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.x.service 2024-08-28T19:21:12.693 INFO:tasks.cephadm:Bootstrapping... 2024-08-28T19:21:12.693 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 -v bootstrap --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.33 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-28T19:21:12.901 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-08-28T19:21:12.901 INFO:teuthology.orchestra.run.smithi033.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', '-v', 'bootstrap', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.33', '--skip-admin-label'] 2024-08-28T19:21:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-28T19:21:12.902 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying podman|docker is present... 2024-08-28T19:21:12.926 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 5.2.1 2024-08-28T19:21:12.926 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying lvm2 is present... 2024-08-28T19:21:12.926 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying time synchronization is in place... 2024-08-28T19:21:12.934 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-28T19:21:12.934 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-28T19:21:12.940 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-28T19:21:12.940 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-08-28T19:21:12.947 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout enabled 2024-08-28T19:21:12.953 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout active 2024-08-28T19:21:12.953 INFO:teuthology.orchestra.run.smithi033.stdout:Unit chronyd.service is enabled and running 2024-08-28T19:21:12.953 INFO:teuthology.orchestra.run.smithi033.stdout:Repeating the final host check... 2024-08-28T19:21:12.975 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 5.2.1 2024-08-28T19:21:12.975 INFO:teuthology.orchestra.run.smithi033.stdout:podman (/bin/podman) version 5.2.1 is present 2024-08-28T19:21:12.976 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl is present 2024-08-28T19:21:12.976 INFO:teuthology.orchestra.run.smithi033.stdout:lvcreate is present 2024-08-28T19:21:12.982 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-28T19:21:12.982 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-28T19:21:12.988 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-28T19:21:12.988 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-08-28T19:21:12.994 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout enabled 2024-08-28T19:21:13.001 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout active 2024-08-28T19:21:13.001 INFO:teuthology.orchestra.run.smithi033.stdout:Unit chronyd.service is enabled and running 2024-08-28T19:21:13.001 INFO:teuthology.orchestra.run.smithi033.stdout:Host looks OK 2024-08-28T19:21:13.001 INFO:teuthology.orchestra.run.smithi033.stdout:Cluster fsid: 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:13.001 INFO:teuthology.orchestra.run.smithi033.stdout:Acquiring lock 140437662323760 on /run/cephadm/9a2fc37c-6572-11ef-bcd4-c7b262605968.lock 2024-08-28T19:21:13.001 INFO:teuthology.orchestra.run.smithi033.stdout:Lock 140437662323760 acquired on /run/cephadm/9a2fc37c-6572-11ef-bcd4-c7b262605968.lock 2024-08-28T19:21:13.002 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying IP 172.21.15.33 port 3300 ... 2024-08-28T19:21:13.002 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying IP 172.21.15.33 port 6789 ... 2024-08-28T19:21:13.002 INFO:teuthology.orchestra.run.smithi033.stdout:Base mon IP(s) is [172.21.15.33:3300, 172.21.15.33:6789], mon addrv is [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-08-28T19:21:13.005 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.33 metric 100 2024-08-28T19:21:13.005 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.33 metric 100 2024-08-28T19:21:13.008 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-28T19:21:13.008 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-08-28T19:21:13.008 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-08-28T19:21:13.010 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-28T19:21:13.010 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-28T19:21:13.011 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-28T19:21:13.011 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-28T19:21:13.011 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout inet6 fe80::ece5:e6c5:1ad7:1682/64 scope link noprefixroute 2024-08-28T19:21:13.011 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-28T19:21:13.011 INFO:teuthology.orchestra.run.smithi033.stdout:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2024-08-28T19:21:13.011 INFO:teuthology.orchestra.run.smithi033.stdout:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2024-08-28T19:21:13.012 INFO:teuthology.orchestra.run.smithi033.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-28T19:21:13.012 INFO:teuthology.orchestra.run.smithi033.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-28T19:21:13.012 INFO:teuthology.orchestra.run.smithi033.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-28T19:21:13.513 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-28T19:21:13.514 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-28T19:21:13.514 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Getting image source signatures 2024-08-28T19:21:13.514 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying blob sha256:1c7f48e91f1eb9e77df623f13bab8a42aaf12d95954655c07fb62a1a85ca19b2 2024-08-28T19:21:13.514 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-28T19:21:13.514 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying config sha256:79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-28T19:21:13.514 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-28T19:21:14.335 INFO:teuthology.orchestra.run.smithi033.stdout:ceph: stdout ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-28T19:21:14.335 INFO:teuthology.orchestra.run.smithi033.stdout:Ceph version: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-28T19:21:14.335 INFO:teuthology.orchestra.run.smithi033.stdout:Extracting ceph user uid/gid from container image... 2024-08-28T19:21:15.175 INFO:teuthology.orchestra.run.smithi033.stdout:stat: stdout 167 167 2024-08-28T19:21:15.175 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial keys... 2024-08-28T19:21:19.645 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQCreM9mWiOaHxAAw/SXT8QVBd5G7sA6ijPB8Q== 2024-08-28T19:21:28.775 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQCyeM9mipTuFhAAS7RmIqX4qJ9ndnlN0MLpxA== 2024-08-28T19:21:30.020 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQC5eM9muVQDHxAApkPnvqr9qTj4x0vElwRWxA== 2024-08-28T19:21:30.021 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial monmap... 2024-08-28T19:21:30.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-28T19:21:30.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-28T19:21:30.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:30.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-28T19:21:30.903 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool for a [v2:172.21.15.33:3300,v1:172.21.15.33:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-28T19:21:30.903 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = quincy 2024-08-28T19:21:30.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: set fsid to 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:30.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-28T19:21:30.903 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:21:30.903 INFO:teuthology.orchestra.run.smithi033.stdout:Creating mon... 2024-08-28T19:21:31.925 INFO:teuthology.orchestra.run.smithi033.stdout:create mon.a on 2024-08-28T19:21:32.132 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-28T19:21:32.282 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-28T19:21:32.460 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968.target. 2024-08-28T19:21:32.460 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968.target. 2024-08-28T19:21:32.695 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.a 2024-08-28T19:21:32.695 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.a.service: Unit ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.a.service not loaded. 2024-08-28T19:21:32.866 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968.target.wants/ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.a.service → /etc/systemd/system/ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@.service. 2024-08-28T19:21:33.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:33 smithi033 podman[18161]: 2024-08-28 19:21:33.107593029 +0000 UTC m=+0.122163247 container create 199fa534572251d5a0876807ce8f84f9b9d843272578523559e859e0514b11e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:21:33.458 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-28T19:21:33.458 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-08-28T19:21:33.465 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-28T19:21:33.466 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-08-28T19:21:33.466 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-08-28T19:21:33.466 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to enable service . firewalld.service is not available 2024-08-28T19:21:33.466 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mon to start... 2024-08-28T19:21:33.466 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mon... 2024-08-28T19:21:33.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:33 smithi033 podman[18161]: 2024-08-28 19:21:33.326849617 +0000 UTC m=+0.341419836 container init 199fa534572251d5a0876807ce8f84f9b9d843272578523559e859e0514b11e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-28T19:21:33.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:33 smithi033 podman[18161]: 2024-08-28 19:21:33.330106247 +0000 UTC m=+0.344676470 container start 199fa534572251d5a0876807ce8f84f9b9d843272578523559e859e0514b11e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-28T19:21:33.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:33 smithi033 ceph-mon[18180]: mkfs 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:33.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:33 smithi033 ceph-mon[18180]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-28T19:21:33.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:33 smithi033 bash[18161]: 199fa534572251d5a0876807ce8f84f9b9d843272578523559e859e0514b11e4 2024-08-28T19:21:33.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:33 smithi033 systemd[1]: Started Ceph mon.a for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:21:34.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-28T19:21:34.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: monmap epoch 1 2024-08-28T19:21:34.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:34.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: last_changed 2024-08-28T19:21:30.339419+0000 2024-08-28T19:21:34.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: created 2024-08-28T19:21:30.339419+0000 2024-08-28T19:21:34.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: min_mon_release 19 (squid) 2024-08-28T19:21:34.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: election_strategy: 1 2024-08-28T19:21:34.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-08-28T19:21:34.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: fsmap 2024-08-28T19:21:34.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: osdmap e1: 0 total, 0 up, 0 in 2024-08-28T19:21:34.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: mgrmap e1: no daemons active 2024-08-28T19:21:34.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:34 smithi033 ceph-mon[18180]: from='client.? 172.21.15.33:0/4074505006' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-28T19:21:35.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout cluster: 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout id: 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout services: 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.598139s) 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout data: 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-28T19:21:35.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout pgs: 2024-08-28T19:21:35.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:35.354 INFO:teuthology.orchestra.run.smithi033.stdout:mon is available 2024-08-28T19:21:35.354 INFO:teuthology.orchestra.run.smithi033.stdout:Assimilating anything we can from ceph.conf... 2024-08-28T19:21:36.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:35 smithi033 ceph-mon[18180]: from='client.? 172.21.15.33:0/6140811' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-28T19:21:36.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:35 smithi033 ceph-mon[18180]: from='client.? 172.21.15.33:0/6140811' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-28T19:21:36.359 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:36.359 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [global] 2024-08-28T19:21:36.359 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout fsid = 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:36.359 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-28T19:21:36.359 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-08-28T19:21:36.359 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-28T19:21:36.359 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-28T19:21:36.359 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-28T19:21:36.359 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-28T19:21:36.359 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:36.360 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-28T19:21:36.360 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-28T19:21:36.360 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:36.360 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [osd] 2024-08-28T19:21:36.360 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-28T19:21:36.360 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-28T19:21:36.360 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-28T19:21:36.360 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-28T19:21:36.360 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-28T19:21:36.360 INFO:teuthology.orchestra.run.smithi033.stdout:Generating new minimal ceph.conf... 2024-08-28T19:21:37.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:36 smithi033 ceph-mon[18180]: from='client.? 172.21.15.33:0/2801918820' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:21:37.456 INFO:teuthology.orchestra.run.smithi033.stdout:Restarting the monitor... 2024-08-28T19:21:37.740 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:37 smithi033 systemd[1]: Stopping Ceph mon.a for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:21:38.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:37 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a[18176]: 2024-08-28T19:21:37.739+0000 7fb485303640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:21:38.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:37 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a[18176]: 2024-08-28T19:21:37.739+0000 7fb485303640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-28T19:21:38.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:37 smithi033 podman[18424]: 2024-08-28 19:21:37.923224664 +0000 UTC m=+0.296670073 container died 199fa534572251d5a0876807ce8f84f9b9d843272578523559e859e0514b11e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:21:38.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:38 smithi033 podman[18424]: 2024-08-28 19:21:38.247200076 +0000 UTC m=+0.620645528 container cleanup 199fa534572251d5a0876807ce8f84f9b9d843272578523559e859e0514b11e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-28T19:21:38.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:38 smithi033 bash[18424]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a 2024-08-28T19:21:38.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:38 smithi033 podman[18436]: 2024-08-28 19:21:38.464928665 +0000 UTC m=+0.538691771 container remove 199fa534572251d5a0876807ce8f84f9b9d843272578523559e859e0514b11e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T19:21:38.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:38 smithi033 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-28T19:21:38.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:38 smithi033 systemd[1]: Stopped Ceph mon.a for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:21:38.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:38 smithi033 systemd[1]: Starting Ceph mon.a for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:21:39.144 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:38 smithi033 podman[18531]: 2024-08-28 19:21:38.783901476 +0000 UTC m=+0.015669546 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:21:39.144 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:38 smithi033 podman[18531]: 2024-08-28 19:21:38.892712743 +0000 UTC m=+0.124480795 container create 35ddce2b1800f9567bb54a228711bd7eea7f7c5f3b14be89fbc33bb9b405167e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-28T19:21:39.144 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 podman[18531]: 2024-08-28 19:21:39.07641972 +0000 UTC m=+0.308187774 container init 35ddce2b1800f9567bb54a228711bd7eea7f7c5f3b14be89fbc33bb9b405167e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T19:21:39.144 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 podman[18531]: 2024-08-28 19:21:39.079348137 +0000 UTC m=+0.311116191 container start 35ddce2b1800f9567bb54a228711bd7eea7f7c5f3b14be89fbc33bb9b405167e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-28T19:21:39.144 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: set uid:gid to 167:167 (ceph:ceph) 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: pidfile_write: ignore empty --pid-file 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: load: jerasure load: lrc 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: RocksDB version: 7.9.2 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Git sha 0 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: DB SUMMARY 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: DB Session ID: OZJQIWBPN2O4BWXVAY1Y 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: CURRENT file: CURRENT 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: IDENTITY file: IDENTITY 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-28T19:21:39.145 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94967 ; 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.error_if_exists: 0 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.create_if_missing: 0 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.paranoid_checks: 1 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.env: 0x56243f5ad5a0 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.fs: PosixFileSystem 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.info_log: 0x5624452034e0 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_file_opening_threads: 16 2024-08-28T19:21:39.146 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.statistics: (nil) 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.use_fsync: 0 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_log_file_size: 0 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.keep_log_file_num: 1000 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.recycle_log_file_num: 0 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.allow_fallocate: 1 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.allow_mmap_reads: 0 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.allow_mmap_writes: 0 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.use_direct_reads: 0 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.create_missing_column_families: 0 2024-08-28T19:21:39.147 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.db_log_dir: 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.wal_dir: 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.advise_random_on_open: 1 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.db_write_buffer_size: 0 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.write_buffer_manager: 0x5624452075e0 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-28T19:21:39.148 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.rate_limiter: (nil) 2024-08-28T19:21:39.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-28T19:21:39.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.wal_recovery_mode: 2 2024-08-28T19:21:39.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.enable_thread_tracking: 0 2024-08-28T19:21:39.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.enable_pipelined_write: 0 2024-08-28T19:21:39.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.unordered_write: 0 2024-08-28T19:21:39.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-28T19:21:39.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-28T19:21:39.150 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.row_cache: None 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.wal_filter: None 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.allow_ingest_behind: 0 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.two_write_queues: 0 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.manual_wal_flush: 0 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.wal_compression: 0 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.atomic_flush: 0 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-28T19:21:39.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.log_readahead_size: 0 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.best_efforts_recovery: 0 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.allow_data_in_errors: 0 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.db_host_id: __hostname__ 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_background_jobs: 2 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_background_compactions: -1 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_subcompactions: 1 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-28T19:21:39.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_total_wal_size: 0 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_open_files: -1 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bytes_per_sync: 0 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_readahead_size: 0 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_background_flushes: -1 2024-08-28T19:21:39.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Compression algorithms supported: 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: kZSTD supported: 0 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: kXpressCompression supported: 0 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: kBZip2Compression supported: 0 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: kLZ4Compression supported: 1 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: kZlibCompression supported: 1 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: kLZ4HCCompression supported: 1 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: kSnappyCompression supported: 1 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-28T19:21:39.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.merge_operator: 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_filter: None 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_filter_factory: None 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.sst_partitioner_factory: None 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562445203100) 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout: cache_index_and_filter_blocks: 1 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout: pin_top_level_index_and_filter: 1 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_type: 0 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout: data_block_index_type: 0 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_shortening: 1 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout: checksum: 4 2024-08-28T19:21:39.155 INFO:journalctl@ceph.mon.a.smithi033.stdout: no_block_cache: 0 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache: 0x5624411c6850 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_name: BinnedLRUCache 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_options: 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: capacity : 536870912 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: num_shard_bits : 4 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: strict_capacity_limit : 0 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: high_pri_pool_ratio: 0.000 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_compressed: (nil) 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: persistent_cache: (nil) 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_size: 4096 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_size_deviation: 10 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_restart_interval: 16 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_block_restart_interval: 1 2024-08-28T19:21:39.156 INFO:journalctl@ceph.mon.a.smithi033.stdout: metadata_block_size: 4096 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: partition_filters: 0 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: use_delta_encoding: 1 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: filter_policy: bloomfilter 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: whole_key_filtering: 1 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: verify_compression: 0 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: read_amp_bytes_per_bit: 0 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: format_version: 5 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: enable_index_compression: 1 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_align: 0 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: max_auto_readahead_size: 262144 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: prepopulate_block_cache: 0 2024-08-28T19:21:39.157 INFO:journalctl@ceph.mon.a.smithi033.stdout: initial_auto_readahead_size: 8192 2024-08-28T19:21:39.158 INFO:journalctl@ceph.mon.a.smithi033.stdout: num_file_reads_for_auto_readahead: 2 2024-08-28T19:21:39.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.write_buffer_size: 33554432 2024-08-28T19:21:39.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_write_buffer_number: 2 2024-08-28T19:21:39.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compression: NoCompression 2024-08-28T19:21:39.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bottommost_compression: Disabled 2024-08-28T19:21:39.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.prefix_extractor: nullptr 2024-08-28T19:21:39.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-28T19:21:39.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.num_levels: 7 2024-08-28T19:21:39.158 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compression_opts.level: 32767 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compression_opts.strategy: 0 2024-08-28T19:21:39.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compression_opts.enabled: false 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.target_file_size_base: 67108864 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-28T19:21:39.160 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.arena_block_size: 1048576 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.disable_auto_compactions: 0 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-28T19:21:39.161 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.inplace_update_support: 0 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.bloom_locality: 0 2024-08-28T19:21:39.162 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.max_successive_merges: 0 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.paranoid_file_checks: 0 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.force_consistency_checks: 1 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.report_bg_io_stats: 0 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.ttl: 2592000 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.enable_blob_files: false 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.min_blob_size: 0 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.blob_file_size: 268435456 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-28T19:21:39.163 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.blob_file_starting_level: 0 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6af08b2c-6c17-426b-853a-79b22d9d1139 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724872899114364, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724872899115468, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91118, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 282, "table_properties": {"data_size": 89166, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11619, "raw_average_key_size": 48, "raw_value_size": 82640, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 241, "num_filter_entries": 241, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724872899, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6af08b2c-6c17-426b-853a-79b22d9d1139", "db_session_id": "OZJQIWBPN2O4BWXVAY1Y", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724872899115571, "job": 1, "event": "recovery_finished"} 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-28T19:21:39.164 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562445226a80 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: DB pointer 0x562445fc8000 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** DB Stats ** 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-28T19:21:39.165 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** Compaction Stats [default] ** 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: L0 2/0 90.84 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: Sum 2/0 90.84 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** Compaction Stats [default] ** 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 127.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-28T19:21:39.166 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative compaction: 0.00 GB write, 26.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval compaction: 0.00 GB write, 26.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: Block cache BinnedLRUCache@0x5624411c6850#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-28T19:21:39.167 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: starting mon.a rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: mon.a@-1(???) e1 preinit fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: mon.a@-1(???).mds e1 new map 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: mon.a@-1(???).mds e1 print_map 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout: e1 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout: btime 2024-08-28T19:21:33:380247+0000 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout: legacy client fscid: -1 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout: No filesystems configured 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-28T19:21:39.168 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T19:21:39.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T19:21:39.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T19:21:39.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-28T19:21:39.169 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 bash[18531]: 35ddce2b1800f9567bb54a228711bd7eea7f7c5f3b14be89fbc33bb9b405167e 2024-08-28T19:21:39.169 INFO:teuthology.orchestra.run.smithi033.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-28T19:21:39.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 systemd[1]: Started Ceph mon.a for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:21:39.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-28T19:21:39.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: monmap epoch 1 2024-08-28T19:21:39.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:39.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: last_changed 2024-08-28T19:21:30.339419+0000 2024-08-28T19:21:39.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: created 2024-08-28T19:21:30.339419+0000 2024-08-28T19:21:39.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: min_mon_release 19 (squid) 2024-08-28T19:21:39.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: election_strategy: 1 2024-08-28T19:21:39.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-08-28T19:21:39.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: fsmap 2024-08-28T19:21:39.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: osdmap e1: 0 total, 0 up, 0 in 2024-08-28T19:21:39.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:39 smithi033 ceph-mon[18549]: mgrmap e1: no daemons active 2024-08-28T19:21:40.863 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-28T19:21:40.875 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-28T19:21:40.875 INFO:teuthology.orchestra.run.smithi033.stdout:Creating mgr... 2024-08-28T19:21:40.876 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-28T19:21:40.876 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-28T19:21:40.934 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:40 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3380661215' entity='client.admin' 2024-08-28T19:21:41.102 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.x 2024-08-28T19:21:41.102 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.x.service: Unit ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.x.service not loaded. 2024-08-28T19:21:41.251 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968.target.wants/ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@.service. 2024-08-28T19:21:41.561 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:21:41 smithi033 podman[18761]: 2024-08-28 19:21:41.38539452 +0000 UTC m=+0.016026669 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:21:41.561 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:21:41 smithi033 podman[18761]: 2024-08-28 19:21:41.560963782 +0000 UTC m=+0.191595956 container create bb24acc153bbd360a38ae44807b79e4ea364cb18feed854ba4db43b381fc15f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD) 2024-08-28T19:21:41.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:21:41 smithi033 podman[18761]: 2024-08-28 19:21:41.746464982 +0000 UTC m=+0.377097126 container init bb24acc153bbd360a38ae44807b79e4ea364cb18feed854ba4db43b381fc15f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-28T19:21:41.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:21:41 smithi033 podman[18761]: 2024-08-28 19:21:41.749318539 +0000 UTC m=+0.379950674 container start bb24acc153bbd360a38ae44807b79e4ea364cb18feed854ba4db43b381fc15f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T19:21:41.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:21:41 smithi033 bash[18761]: bb24acc153bbd360a38ae44807b79e4ea364cb18feed854ba4db43b381fc15f1 2024-08-28T19:21:41.836 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-28T19:21:41.836 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-08-28T19:21:41.845 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-28T19:21:41.845 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-08-28T19:21:41.845 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-08-28T19:21:41.845 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to enable service . firewalld.service is not available 2024-08-28T19:21:41.856 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-28T19:21:41.856 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-08-28T19:21:41.864 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-28T19:21:41.865 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-08-28T19:21:41.865 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-08-28T19:21:41.865 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-28T19:21:41.865 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr to start... 2024-08-28T19:21:41.865 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr... 2024-08-28T19:21:42.107 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:21:41 smithi033 systemd[1]: Started Ceph mgr.x for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:21:42.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:42 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2309730779' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-28T19:21:43.067 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:43.067 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-08-28T19:21:43.068 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-28T19:21:43.069 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-28T19:21:43.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:43.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-28T19:21:43.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-28T19:21:43.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "btime": "2024-08-28T19:21:33:380247+0000", 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-28T19:21:43.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-08-28T19:21:33.381118+0000", 2024-08-28T19:21:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T19:21:43.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:43.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-28T19:21:43.076 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-08-28T19:21:43.076 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (1/15)... 2024-08-28T19:21:45.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:45 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3021078353' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-28T19:21:46.216 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:46.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-08-28T19:21:46.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:21:46.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-08-28T19:21:46.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-28T19:21:46.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-28T19:21:46.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-28T19:21:46.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:46.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-28T19:21:46.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-28T19:21:46.217 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-28T19:21:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-28T19:21:46.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-28T19:21:46.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-28T19:21:46.219 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-28T19:21:46.222 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:46.222 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-28T19:21:46.222 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-28T19:21:46.222 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-28T19:21:46.222 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-28T19:21:46.222 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-28T19:21:46.222 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-28T19:21:46.222 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "btime": "2024-08-28T19:21:33:380247+0000", 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-28T19:21:46.223 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-08-28T19:21:33.381118+0000", 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-08-28T19:21:46.224 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (2/15)... 2024-08-28T19:21:47.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: Activating manager daemon x 2024-08-28T19:21:47.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: mgrmap e2: x(active, starting, since 0.0037715s) 2024-08-28T19:21:47.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: from='mgr.14100 172.21.15.33:0/316601369' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-28T19:21:47.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: from='mgr.14100 172.21.15.33:0/316601369' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-28T19:21:47.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: from='mgr.14100 172.21.15.33:0/316601369' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-28T19:21:47.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: from='mgr.14100 172.21.15.33:0/316601369' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:21:47.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: from='mgr.14100 172.21.15.33:0/316601369' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-28T19:21:47.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: Manager daemon x is now available 2024-08-28T19:21:47.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: from='mgr.14100 172.21.15.33:0/316601369' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-28T19:21:47.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: from='mgr.14100 172.21.15.33:0/316601369' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-28T19:21:47.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: from='mgr.14100 172.21.15.33:0/316601369' entity='mgr.x' 2024-08-28T19:21:47.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: from='mgr.14100 172.21.15.33:0/316601369' entity='mgr.x' 2024-08-28T19:21:47.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:47 smithi033 ceph-mon[18549]: from='mgr.14100 172.21.15.33:0/316601369' entity='mgr.x' 2024-08-28T19:21:49.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:49 smithi033 ceph-mon[18549]: mgrmap e3: x(active, since 1.00704s) 2024-08-28T19:21:49.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:49 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/910462677' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-28T19:21:49.548 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-28T19:21:49.549 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-28T19:21:49.550 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-28T19:21:49.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-28T19:21:49.551 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-28T19:21:49.554 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:49.554 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-28T19:21:49.554 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-28T19:21:49.554 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "btime": "2024-08-28T19:21:33:380247+0000", 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-28T19:21:49.555 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-28T19:21:49.556 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-08-28T19:21:33.381118+0000", 2024-08-28T19:21:49.557 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-28T19:21:49.557 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-08-28T19:21:49.557 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-28T19:21:49.557 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-08-28T19:21:49.557 INFO:teuthology.orchestra.run.smithi033.stdout:mgr is available 2024-08-28T19:21:50.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:50 smithi033 ceph-mon[18549]: mgrmap e4: x(active, since 2s) 2024-08-28T19:21:50.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:50.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [global] 2024-08-28T19:21:50.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout fsid = 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:21:50.675 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [osd] 2024-08-28T19:21:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-28T19:21:50.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-28T19:21:50.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-28T19:21:50.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-28T19:21:50.677 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-28T19:21:50.677 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling cephadm module... 2024-08-28T19:21:51.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:51 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/178071738' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-28T19:21:52.333 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:52 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1262911509' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-28T19:21:52.333 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:21:52 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: ignoring --setuser ceph since I am not root 2024-08-28T19:21:52.333 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:21:52 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: ignoring --setgroup ceph since I am not root 2024-08-28T19:21:53.251 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:53 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1262911509' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-28T19:21:53.251 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:53 smithi033 ceph-mon[18549]: mgrmap e5: x(active, since 5s) 2024-08-28T19:21:53.805 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-08-28T19:21:53.805 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-28T19:21:53.806 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-28T19:21:53.806 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-28T19:21:53.806 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-28T19:21:53.806 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-08-28T19:21:53.806 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for the mgr to restart... 2024-08-28T19:21:53.806 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr epoch 5... 2024-08-28T19:21:54.091 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:54 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2677971108' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-28T19:21:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:57 smithi033 ceph-mon[18549]: Active manager daemon x restarted 2024-08-28T19:21:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:57 smithi033 ceph-mon[18549]: Activating manager daemon x 2024-08-28T19:21:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:57 smithi033 ceph-mon[18549]: osdmap e2: 0 total, 0 up, 0 in 2024-08-28T19:21:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:57 smithi033 ceph-mon[18549]: mgrmap e6: x(active, starting, since 0.00399052s) 2024-08-28T19:21:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:57 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:21:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:57 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-28T19:21:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:57 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-28T19:21:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:57 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-28T19:21:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:57 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-28T19:21:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:57 smithi033 ceph-mon[18549]: Manager daemon x is now available 2024-08-28T19:21:58.803 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-08-28T19:21:58.803 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-28T19:21:58.803 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-28T19:21:58.803 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-08-28T19:21:58.804 INFO:teuthology.orchestra.run.smithi033.stdout:mgr epoch 5 is available 2024-08-28T19:21:58.804 INFO:teuthology.orchestra.run.smithi033.stdout:Setting orchestrator backend to cephadm... 2024-08-28T19:21:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:58 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:21:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:58 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:21:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:58 smithi033 ceph-mon[18549]: Found migration_current of "None". Setting to last migration. 2024-08-28T19:21:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:58 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:21:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:58 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:21:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:58 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:21:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:58 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:21:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:58 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-28T19:21:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:58 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-28T19:21:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:58 smithi033 ceph-mon[18549]: mgrmap e7: x(active, since 1.00824s) 2024-08-28T19:22:00.032 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:59 smithi033 ceph-mon[18549]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-28T19:22:00.032 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:59 smithi033 ceph-mon[18549]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-28T19:22:00.032 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:59 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:22:00.032 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:21:59 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:22:00.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-mon[18549]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:00.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-mon[18549]: mgrmap e8: x(active, since 2s) 2024-08-28T19:22:00.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:22:00.955 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:22:00.766+0000 7f31e20b6640 -1 log_channel(cephadm) log [ERR] : [28/Aug/2024:19:22:00] ENGINE Error in HTTPServer.serve 2024-08-28T19:22:00.955 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: Traceback (most recent call last): 2024-08-28T19:22:00.955 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T19:22:00.955 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self._connections.run(self.expiration_interval) 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self._run(expiration_interval) 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: s = self.context.wrap_socket( 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: return self.sslsocket_class._create( 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self.do_handshake() 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T19:22:00.956 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self._sslobj.do_handshake() 2024-08-28T19:22:00.957 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T19:22:00.957 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:22:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-28T19:22:01.233 INFO:teuthology.orchestra.run.smithi033.stdout:Generating ssh key... 2024-08-28T19:22:02.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:01 smithi033 ceph-mon[18549]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:02.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:01 smithi033 ceph-mon[18549]: [28/Aug/2024:19:22:00] ENGINE Bus STARTING 2024-08-28T19:22:02.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:01 smithi033 ceph-mon[18549]: [28/Aug/2024:19:22:00] ENGINE Serving on https://172.21.15.33:7150 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:01 smithi033 ceph-mon[18549]: [28/Aug/2024:19:22:00] ENGINE Error in HTTPServer.serve 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: Traceback (most recent call last): 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._connections.run(self.expiration_interval) 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._run(expiration_interval) 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: s = self.context.wrap_socket( 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: return self.sslsocket_class._create( 2024-08-28T19:22:02.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mon.a.smithi033.stdout: self.do_handshake() 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._sslobj.do_handshake() 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mon.a.smithi033.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:01 smithi033 ceph-mon[18549]: [28/Aug/2024:19:22:00] ENGINE Serving on http://172.21.15.33:8765 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:01 smithi033 ceph-mon[18549]: [28/Aug/2024:19:22:00] ENGINE Bus STARTED 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: Generating public/private rsa key pair. 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: Your identification has been saved in /tmp/tmparz_9rq5/key 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: Your public key has been saved in /tmp/tmparz_9rq5/key.pub 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: The key fingerprint is: 2024-08-28T19:22:02.132 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: SHA256:NZpqDBwsDJbewlLSRrpFBZOEhhx1rOvWLfZnJSAeJbQ ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: The key's randomart image is: 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: +---[RSA 3072]----+ 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: |+BX=+o | 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: |=O=o.o.. | 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: |=+= +Eo o | 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: |.* = + . + . | 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: |o . = o S | 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: | . + . . . | 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: | . . = o | 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: | o = . o | 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: | . . o.o | 2024-08-28T19:22:02.133 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: +----[SHA256]-----+ 2024-08-28T19:22:03.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:03 smithi033 ceph-mon[18549]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:03.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:03 smithi033 ceph-mon[18549]: Generating ssh key... 2024-08-28T19:22:03.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:03 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:22:03.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:03 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:22:03.845 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+a6H82UssoxOfosYvsuus3rS4owhSYNmzRa6cSY6EFJ1pRN1wBoLtaPgBkgexruQLpCpciX5QrRBdqC673rRXY4flp5v34YikUya/xWFWMpj5/43q2JcBxPQ6E9hAFT0MELyVJJNwpdbFJYHmB7LFDR2+MAaQPXX5Xn+NGw29vnEaHGyiGMvOvxstscd60rJYJnhNrM4+9sf6cRRRHZoiaME6Hd+/9bbMCtbDBJ9PNTd5E5fc8QEPA6UEtwMYaNKv6YDNeYx0ykX9nCA1cJHAtSKttKpie2YIHN7TsyubzyQ41A57mXa2IWGSZYNyDy6Fl63NART2rbXoVTElMzfDqynImOLTiy+1QctoCNrNLxvtMCrrtDwxNKucXYF6JdNsBAR23RL6PzA7gqYB1TvXI6y8v4gqUJ2PiVATPS84i2OEz74cgf0dfD4CAXCIB+9xpE71xPkVdlPbQ2z5TMJlnnS08vvilyRy6ZC2lPbIxuNgHPqATsFc/s6VDG/qTaM= ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:22:03.846 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-28T19:22:03.846 INFO:teuthology.orchestra.run.smithi033.stdout:Adding key to root@localhost authorized_keys... 2024-08-28T19:22:03.846 INFO:teuthology.orchestra.run.smithi033.stdout:Adding host smithi033... 2024-08-28T19:22:04.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:04 smithi033 ceph-mon[18549]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:05.488 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:05 smithi033 ceph-mon[18549]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:06.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:06 smithi033 ceph-mon[18549]: Deploying cephadm binary to smithi033 2024-08-28T19:22:08.878 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Added host 'smithi033' with addr '172.21.15.33' 2024-08-28T19:22:08.878 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying unmanaged mon service... 2024-08-28T19:22:09.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:09 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:22:09.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:09 smithi033 ceph-mon[18549]: Added host smithi033 2024-08-28T19:22:09.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:09 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:22:10.262 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-28T19:22:10.262 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying unmanaged mgr service... 2024-08-28T19:22:10.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:10 smithi033 ceph-mon[18549]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:10.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:10 smithi033 ceph-mon[18549]: Saving service mon spec with placement count:5 2024-08-28T19:22:10.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:10 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:22:11.445 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-28T19:22:11.979 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:11 smithi033 ceph-mon[18549]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:11.979 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:11 smithi033 ceph-mon[18549]: Saving service mgr spec with placement count:2 2024-08-28T19:22:11.979 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:11 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:22:13.554 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:13 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:22:13.554 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:13 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:22:13.555 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:13 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1996427453' entity='client.admin' 2024-08-28T19:22:15.082 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling the dashboard module... 2024-08-28T19:22:15.583 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:15 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/759373230' entity='client.admin' 2024-08-28T19:22:15.583 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:15 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:22:16.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:16 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1209253968' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-28T19:22:16.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:16 smithi033 ceph-mon[18549]: from='mgr.14118 172.21.15.33:0/1907563345' entity='mgr.x' 2024-08-28T19:22:16.630 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:16 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: ignoring --setuser ceph since I am not root 2024-08-28T19:22:16.631 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:16 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: ignoring --setgroup ceph since I am not root 2024-08-28T19:22:17.875 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:17 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1209253968' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-28T19:22:17.875 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:17 smithi033 ceph-mon[18549]: mgrmap e9: x(active, since 19s) 2024-08-28T19:22:18.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:18 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3914154031' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-28T19:22:19.168 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-08-28T19:22:19.169 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-28T19:22:19.169 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-28T19:22:19.169 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-28T19:22:19.169 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-28T19:22:19.169 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-08-28T19:22:19.169 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for the mgr to restart... 2024-08-28T19:22:19.169 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr epoch 9... 2024-08-28T19:22:22.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:21 smithi033 ceph-mon[18549]: Active manager daemon x restarted 2024-08-28T19:22:22.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:21 smithi033 ceph-mon[18549]: Activating manager daemon x 2024-08-28T19:22:22.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:21 smithi033 ceph-mon[18549]: osdmap e3: 0 total, 0 up, 0 in 2024-08-28T19:22:22.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:21 smithi033 ceph-mon[18549]: mgrmap e10: x(active, starting, since 0.00359324s) 2024-08-28T19:22:22.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:21 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:22:22.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:21 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-28T19:22:22.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:21 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-28T19:22:22.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:21 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-28T19:22:22.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:21 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-28T19:22:22.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:21 smithi033 ceph-mon[18549]: Manager daemon x is now available 2024-08-28T19:22:23.103 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:22 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:22:23.103 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:22 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-28T19:22:23.104 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:22 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-28T19:22:23.104 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:22 smithi033 ceph-mon[18549]: mgrmap e11: x(active, since 1.00662s) 2024-08-28T19:22:23.374 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-08-28T19:22:23.374 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-28T19:22:23.374 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-28T19:22:23.374 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-08-28T19:22:23.374 INFO:teuthology.orchestra.run.smithi033.stdout:mgr epoch 9 is available 2024-08-28T19:22:23.374 INFO:teuthology.orchestra.run.smithi033.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-28T19:22:23.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-mon[18549]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-28T19:22:23.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-mon[18549]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-28T19:22:23.880 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:22:23.866+0000 7fe791657640 -1 log_channel(cephadm) log [ERR] : [28/Aug/2024:19:22:23] ENGINE Error in HTTPServer.serve 2024-08-28T19:22:23.880 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: Traceback (most recent call last): 2024-08-28T19:22:23.880 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T19:22:23.880 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self._connections.run(self.expiration_interval) 2024-08-28T19:22:23.880 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T19:22:23.880 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self._run(expiration_interval) 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: s = self.context.wrap_socket( 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: return self.sslsocket_class._create( 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self.do_handshake() 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self._sslobj.do_handshake() 2024-08-28T19:22:23.881 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T19:22:23.882 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:22:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:22:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:24 smithi033 ceph-mon[18549]: [28/Aug/2024:19:22:23] ENGINE Bus STARTING 2024-08-28T19:22:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:24 smithi033 ceph-mon[18549]: [28/Aug/2024:19:22:23] ENGINE Serving on http://172.21.15.33:8765 2024-08-28T19:22:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:24 smithi033 ceph-mon[18549]: mgrmap e12: x(active, since 2s) 2024-08-28T19:22:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:24 smithi033 ceph-mon[18549]: [28/Aug/2024:19:22:23] ENGINE Serving on https://172.21.15.33:7150 2024-08-28T19:22:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:24 smithi033 ceph-mon[18549]: [28/Aug/2024:19:22:23] ENGINE Bus STARTED 2024-08-28T19:22:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:24 smithi033 ceph-mon[18549]: [28/Aug/2024:19:22:23] ENGINE Error in HTTPServer.serve 2024-08-28T19:22:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout: Traceback (most recent call last): 2024-08-28T19:22:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T19:22:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._connections.run(self.expiration_interval) 2024-08-28T19:22:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._run(expiration_interval) 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: s = self.context.wrap_socket( 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: return self.sslsocket_class._create( 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: self.do_handshake() 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T19:22:25.131 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._sslobj.do_handshake() 2024-08-28T19:22:25.132 INFO:journalctl@ceph.mon.a.smithi033.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T19:22:25.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:24 smithi033 ceph-mon[18549]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:25.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:24 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:25.534 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUc9Dk1IjzG7u6FDC1Py2O/CtS4t8wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgyODE5MjIyNFoXDTM0\nMDgyOTE5MjIyNFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjMzMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAzhXzB6NhdKwdpPz+gmHJdHPIY2xYNArs+8rH\n5bkJsRO/VpEKnPEaCznnJFTVUKGfJBXl1+Xczif9rmoUukQP9aeZAyFJ0PjhDSvo\nD3Hfz2Wm2S5oeMJbmI/IOezq0+DVk3eL284VQAfBFNC8XivHRnQyPYg+xS97BfWl\nuQcBWfp4RvBZzpphF0g9R59tDIIa17b6DkrQZWFZfxNhZ+l3aTmDUoCgOY/XCl8Y\ndiWABRExIftbcky8wzqcK7ILHTcfuLvoCHjHAFJuP/Ct0XheCj7k8eIhjsGlTPdk\nrYeyiPV4lYhisFs6cr6W0c4xlJydGTzSuHNGSMEiw3cmILRMCK5B2+n7fAPNne8B\n59ObxZ4nF8zZUlhhjG/YpGlnL0WgUqyLVPXuIAZMpEh4Az8Zg96qIQS3E0+DDFkv\nPpvtgMmk6XyWu1EhNK6p/dQxO5VXuswkXv6dvLZCyTttuMYa6a5xBcJgpfD1cRfF\nTCikJwxLqVYMTqm5DD3u5yqEYqCfKjDCbGNB0/QwXaVkLZmqSo1rcqGw7omTQiPh\nQ/oC0rEOnTornu2EuhJ8URGUgZA9OR4Sx/T/+hPMM2uOxZaLVXyur8WWyiKMd1Wd\nvow6vQYD8Nth/UOwy11J4Pcu3JkeVReysIn5a3et/DLNLJ4O8TtgSAgpNKVCFva4\nEUmmPp0CAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDMzghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPITAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQBm\nTfZvw5B/qeuMpr2colUhjCMpR0XpEjKs4dnQKhFaYxpyZ5kCIZlD6t5tNRuHnaUt\njct3qcYDJAwiEctEeR2dyduvrSkBmKyCQf/lI0E5JSQ8ZyDhgKMhrh1tokpQ5d9M\nDaGAn9XW2FfD+OOXrfu70Mn0oM8fYc4UbB+ANsHHprUaaGUnA72g4q9yh06a4IJi\n9ISZ008J3/BAaj3bIqeXGB2WSKJLJulK32+xBHd+ZWwakiyqUzfvgNq7o6petRKm\nenwS0qqdwk1pymaZS81ZcAaBYBWI0Ki1LJEzjYtddVABd8Hz2orF99/Nuzg4YWVU\n7dpl+rDq/f0bWgIIX3m3dkq+xDHGpu1Uj/l3dT02OuDIWJD24/ET2wMgUdqFvJur\nWnZw7+itru9y5x0hTv+i1wp/Gp2Xhxr3wTqtQ3cdysAouufNFFv2ZnSZFC4NGh4T\nqGMkDB/mYKPvSvhlMiLdCdS5BV4SIS7MD4dpMap5zrsCruyvE1eNXuv0rQf9w9Gl\nosGBziMVga2AuBanI0+xyUUQIVHZPF+nfCbv4KZ0xPoUZC80Qf/CSR2Ek++HAuAY\nvMERKqmeWH3dJsaQUQwJZzyCAVoyelluBtyrxlYXS7gx2YJuHRB4eBAk9Z3GcUh8\nZbFRgzGlpDxelGww+hhQPyVA52Jzac+Qil9rM6+g1g==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEAzhXzB6NhdKwdpPz+gmHJdHPIY2xYNArs+8rH5bkJsRO/VpEK\nnPEaCznnJFTVUKGfJBXl1+Xczif9rmoUukQP9aeZAyFJ0PjhDSvoD3Hfz2Wm2S5o\neMJbmI/IOezq0+DVk3eL284VQAfBFNC8XivHRnQyPYg+xS97BfWluQcBWfp4RvBZ\nzpphF0g9R59tDIIa17b6DkrQZWFZfxNhZ+l3aTmDUoCgOY/XCl8YdiWABRExIftb\ncky8wzqcK7ILHTcfuLvoCHjHAFJuP/Ct0XheCj7k8eIhjsGlTPdkrYeyiPV4lYhi\nsFs6cr6W0c4xlJydGTzSuHNGSMEiw3cmILRMCK5B2+n7fAPNne8B59ObxZ4nF8zZ\nUlhhjG/YpGlnL0WgUqyLVPXuIAZMpEh4Az8Zg96qIQS3E0+DDFkvPpvtgMmk6XyW\nu1EhNK6p/dQxO5VXuswkXv6dvLZCyTttuMYa6a5xBcJgpfD1cRfFTCikJwxLqVYM\nTqm5DD3u5yqEYqCfKjDCbGNB0/QwXaVkLZmqSo1rcqGw7omTQiPhQ/oC0rEOnTor\nnu2EuhJ8URGUgZA9OR4Sx/T/+hPMM2uOxZaLVXyur8WWyiKMd1Wdvow6vQYD8Nth\n/UOwy11J4Pcu3JkeVReysIn5a3et/DLNLJ4O8TtgSAgpNKVCFva4EUmmPp0CAwEA\nAQKCAgAp8DgMlCBDPrpqpqyBanZ1axF6wCPj9Vw8MkxDMMhq33am3m3POdZftfkW\ngOgHGFjbHlSvfqDUWDmM+pv8utiXmHNwOmA79UXRKR/4sqcF3O0bEdFjT8QVlB7+\nQLsaAo1cDO4qfTIAXYOaoY7PyC9tpDxMHtONS6gIsrB2qpkJD0pWP1e7TlnXQ9Vq\no6QssTZWsy8IZQurMeglTtOZ8p4hDPnvOmtAw4eSnf8Lnf6DKXg67tyxcjHQtfbt\ngnY2DA95x82EmdV/eIbknq00rT7P7XQoUCkdlMU3mDnGAZEgw3l2TrKsqmgGzUfC\nauhWkpd6uRC1xgmlyR3ysqbQ7XfyR3RLUFtXGmsZmEP7oCrq1v5hc7xgbExSl4Pt\n99me7B9HAZTuxhX73/nyODIf2X7713rmb/aQqP6UhCXY7ojomMM/mtCsEP7Lcr7L\nI3imWT9mNnjzcoiutvdS51PIbMk26LrnvP3uXHH/XYIE2HU0IKVZ/ePVuGdwj1yh\nILIdJ6Won5x/ufTdWtq8q2wrpbF0nmgKgIrR4xWn7laqcP0Kc7A7HqKl9q4YEbKt\n1YDfuiiG5s8zHMzK+t9tOYvimaoVQ3E/2b7CBA7cFj2+QT8ePnUsW/9D0MPUr60R\nCSqp9ZX3TbFxU40PlSqscd6XcJQN+IPDIN14B6CzD2ikrogPUQKCAQEA+msGS8U6\nzmc/QaCD5BoOaTevnEfJlSP+eaPSFoy2ba2FLj/O8Xlu0E34GKj0kmscoKea7djg\nTYwHknPV5ZWqv/l9UnrJOhnPuCjDWJv9Jhiw0548xSDcBk1P55ipQuZ/zsNwh3W8\nfwBz1USg5cyG5+cc4OmfbHOarCcJVvybbh4Uf2lqzEphSCrfGUKdaGimlqTJA7oN\n9xsop0ku+QG24hWwApAzUMMPLPCt4DaBw5sc7Z0Vmq8/cDVFft1pxWXzUIq6Dr4W\n+lxnidlWFklALCU5kDEMJO9VXa40jRiANSuY1yPVCbxMpnjfGl3Z0GN58qXOzGAY\nDdJ5dSluWxaGDQKCAQEA0q3y1bditqQp0QxWzGcily+O2Kw2XA/qYSumxPnetkRP\n6YeN2UCaMmALpV4GtghPtbI2kRU/lYg3ACqXGDtC/ZWhCT8lnHOmo1tOVcDoE+40\nVP49JV0zdpkzbPloDGsIwxhosdoV3qbfrhfgUlE/rh9nxC3qlMYVv7EVB6egKLke\nnQDbHTD1w+6VpAvkAqYWT8y8Ga4ZtoMKWzUI7CYzEFBPpblhyamMiLaZqe1wi7wO\nUHwb/jC8LlkJq+0unwdpaJI182BHfsxfwr+w4RBbvi2I1WN5/Xa9fsaEhIs/NsJ1\nAa9DXZp34gDH6pxW7o+IB80nBfrbleaaGgeGfHiG0QKCAQEAg/dsvPd2UxmT+1jE\nyKt2lrpS4E/wipkKXT4Y0+tZpBkCi2ny+8xbuoisSwqWwKaT0pIhEmDta9B0mRhU\nS4YBEuQ+x/2PGABMOCe7MnIaCT6PySWlrtjvOp75kfogkPH5vpO+NJS2PlOVt3lQ\nNWoAWiuwS1Kywit2Am0b/exnWLOfZ7m9H2W/OJHnOl+hpkkoKVEz4bPl8igs12O4\nzl656xE0zVUCxffVgoBfkT4ISnXu28WhggACtXZNZlr2h6F/hR1miahhYZTat4mC\nVYJKwDjpyfQfC0PZP+IzLXwQ7HRKOm5Wsae62SvvnuyAgdI6jMYWYhvt8TLO8RBh\naL1I7QKCAQEAxN225O4QWAre6HFXSnm1YQEXwnBp+20D3vkjRT0YV8lNwzLf4fr0\nG86UE1rheogZs/dr9fadC+XVP1qNBh+aYcvIRxOy2ZdYR52yfX9dXgJg9Gr+SEPn\nKxPNci88gx4heez9J/RaK0xUCCJXg5RYpSTDmhYt9geDmzSmKhkBGAykBqIeHhD6\nFrSDMF/MGI2Km9b8jiKZ9GpO6xuL0t9/J+dkBcBNGFxO7hFzVc6CNJDt71eJ8OUp\nc0XQO8/OmNwcK5M0xs9Y/6uKcDkf16+pivSRwJTMEYU7XZOzkQdtcoYTQBe+I2GM\nVKvWI+0jbpjAzElwBa58Mn7h0SDnEritgQKCAQBXvABR6dy4nXYLm452fimr2aTQ\nPeOr3u5ecib0NSEcJFUlyhM8NBnyDilFE0vq/C1YoiGKddcnkkgkEQOpeKWaTgi6\n0Fup8HsycNjByRtIp/Vzmtu1FLzGR0DQjrHLF7ezmGCVZLoFyK5HgOW+J6lIi+oi\n0M3fyyTivPhbvlqEwupSG6/FPt1G0G0i4sEyRV25xmTCqOR+uweRKIy7OiHmyonS\nxhHSOz2MofUvvcg/1S/GuTpYQDA92H8NZViR1NlJRQv4GjJG1bHOcoLje8bk4PPB\n8+amDxpSdB+6PNDhN0OLlnsj46mXL1gvOkr1w59bX6oXwheOUyRwOOiq7WgJ\n-----END RSA PRIVATE KEY-----\n"} 2024-08-28T19:22:26.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:26 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:26.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:26 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:26.734 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-28T19:22:27.586 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:27 smithi033 ceph-mon[18549]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:28.594 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-28T19:22:28.594 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial admin user... 2024-08-28T19:22:29.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:29 smithi033 ceph-mon[18549]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:29.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:29 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:30.051 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$vbM/z4bRH6id1CWVamlNgO0M/Gi9qAHhAZk56mqbyzRsk/golTMz2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1724872949, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-28T19:22:30.051 INFO:teuthology.orchestra.run.smithi033.stdout:Fetching dashboard port number... 2024-08-28T19:22:30.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:30 smithi033 ceph-mon[18549]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:30.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:30 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:31.207 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 8443 2024-08-28T19:22:31.218 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-28T19:22:31.218 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-08-28T19:22:31.226 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-28T19:22:31.226 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-08-28T19:22:31.226 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-08-28T19:22:31.226 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-28T19:22:31.227 INFO:teuthology.orchestra.run.smithi033.stdout:Ceph Dashboard is now available at: 2024-08-28T19:22:31.228 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:31.228 INFO:teuthology.orchestra.run.smithi033.stdout: URL: https://smithi033:8443/ 2024-08-28T19:22:31.228 INFO:teuthology.orchestra.run.smithi033.stdout: User: admin 2024-08-28T19:22:31.228 INFO:teuthology.orchestra.run.smithi033.stdout: Password: d0g68qrmy7 2024-08-28T19:22:31.228 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:31.228 INFO:teuthology.orchestra.run.smithi033.stdout:Saving cluster configuration to /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config directory 2024-08-28T19:22:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:31 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/511998785' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-28T19:22:32.497 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-28T19:22:32.497 INFO:teuthology.orchestra.run.smithi033.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-28T19:22:32.497 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:32.497 INFO:teuthology.orchestra.run.smithi033.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-28T19:22:32.497 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:32.497 INFO:teuthology.orchestra.run.smithi033.stdout:Or, if you are only running a single cluster on this host: 2024-08-28T19:22:32.497 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:32.497 INFO:teuthology.orchestra.run.smithi033.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-28T19:22:32.497 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:32.497 INFO:teuthology.orchestra.run.smithi033.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-28T19:22:32.498 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:32.498 INFO:teuthology.orchestra.run.smithi033.stdout: ceph telemetry on 2024-08-28T19:22:32.498 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:32.498 INFO:teuthology.orchestra.run.smithi033.stdout:For more information see: 2024-08-28T19:22:32.498 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:32.498 INFO:teuthology.orchestra.run.smithi033.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-28T19:22:32.498 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:32.498 INFO:teuthology.orchestra.run.smithi033.stdout:Bootstrap complete. 2024-08-28T19:22:32.537 INFO:tasks.cephadm:Fetching config... 2024-08-28T19:22:32.537 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:22:32.537 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-28T19:22:32.553 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-28T19:22:32.553 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:22:32.553 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-28T19:22:32.607 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-28T19:22:32.607 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:22:32.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-28T19:22:32.673 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-28T19:22:32.673 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:22:32.673 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-28T19:22:32.730 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-28T19:22:32.730 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+a6H82UssoxOfosYvsuus3rS4owhSYNmzRa6cSY6EFJ1pRN1wBoLtaPgBkgexruQLpCpciX5QrRBdqC673rRXY4flp5v34YikUya/xWFWMpj5/43q2JcBxPQ6E9hAFT0MELyVJJNwpdbFJYHmB7LFDR2+MAaQPXX5Xn+NGw29vnEaHGyiGMvOvxstscd60rJYJnhNrM4+9sf6cRRRHZoiaME6Hd+/9bbMCtbDBJ9PNTd5E5fc8QEPA6UEtwMYaNKv6YDNeYx0ykX9nCA1cJHAtSKttKpie2YIHN7TsyubzyQ41A57mXa2IWGSZYNyDy6Fl63NART2rbXoVTElMzfDqynImOLTiy+1QctoCNrNLxvtMCrrtDwxNKucXYF6JdNsBAR23RL6PzA7gqYB1TvXI6y8v4gqUJ2PiVATPS84i2OEz74cgf0dfD4CAXCIB+9xpE71xPkVdlPbQ2z5TMJlnnS08vvilyRy6ZC2lPbIxuNgHPqATsFc/s6VDG/qTaM= ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-28T19:22:32.805 INFO:teuthology.orchestra.run.smithi033.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+a6H82UssoxOfosYvsuus3rS4owhSYNmzRa6cSY6EFJ1pRN1wBoLtaPgBkgexruQLpCpciX5QrRBdqC673rRXY4flp5v34YikUya/xWFWMpj5/43q2JcBxPQ6E9hAFT0MELyVJJNwpdbFJYHmB7LFDR2+MAaQPXX5Xn+NGw29vnEaHGyiGMvOvxstscd60rJYJnhNrM4+9sf6cRRRHZoiaME6Hd+/9bbMCtbDBJ9PNTd5E5fc8QEPA6UEtwMYaNKv6YDNeYx0ykX9nCA1cJHAtSKttKpie2YIHN7TsyubzyQ41A57mXa2IWGSZYNyDy6Fl63NART2rbXoVTElMzfDqynImOLTiy+1QctoCNrNLxvtMCrrtDwxNKucXYF6JdNsBAR23RL6PzA7gqYB1TvXI6y8v4gqUJ2PiVATPS84i2OEz74cgf0dfD4CAXCIB+9xpE71xPkVdlPbQ2z5TMJlnnS08vvilyRy6ZC2lPbIxuNgHPqATsFc/s6VDG/qTaM= ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:22:32.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+a6H82UssoxOfosYvsuus3rS4owhSYNmzRa6cSY6EFJ1pRN1wBoLtaPgBkgexruQLpCpciX5QrRBdqC673rRXY4flp5v34YikUya/xWFWMpj5/43q2JcBxPQ6E9hAFT0MELyVJJNwpdbFJYHmB7LFDR2+MAaQPXX5Xn+NGw29vnEaHGyiGMvOvxstscd60rJYJnhNrM4+9sf6cRRRHZoiaME6Hd+/9bbMCtbDBJ9PNTd5E5fc8QEPA6UEtwMYaNKv6YDNeYx0ykX9nCA1cJHAtSKttKpie2YIHN7TsyubzyQ41A57mXa2IWGSZYNyDy6Fl63NART2rbXoVTElMzfDqynImOLTiy+1QctoCNrNLxvtMCrrtDwxNKucXYF6JdNsBAR23RL6PzA7gqYB1TvXI6y8v4gqUJ2PiVATPS84i2OEz74cgf0dfD4CAXCIB+9xpE71xPkVdlPbQ2z5TMJlnnS08vvilyRy6ZC2lPbIxuNgHPqATsFc/s6VDG/qTaM= ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-28T19:22:32.860 INFO:teuthology.orchestra.run.smithi059.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+a6H82UssoxOfosYvsuus3rS4owhSYNmzRa6cSY6EFJ1pRN1wBoLtaPgBkgexruQLpCpciX5QrRBdqC673rRXY4flp5v34YikUya/xWFWMpj5/43q2JcBxPQ6E9hAFT0MELyVJJNwpdbFJYHmB7LFDR2+MAaQPXX5Xn+NGw29vnEaHGyiGMvOvxstscd60rJYJnhNrM4+9sf6cRRRHZoiaME6Hd+/9bbMCtbDBJ9PNTd5E5fc8QEPA6UEtwMYaNKv6YDNeYx0ykX9nCA1cJHAtSKttKpie2YIHN7TsyubzyQ41A57mXa2IWGSZYNyDy6Fl63NART2rbXoVTElMzfDqynImOLTiy+1QctoCNrNLxvtMCrrtDwxNKucXYF6JdNsBAR23RL6PzA7gqYB1TvXI6y8v4gqUJ2PiVATPS84i2OEz74cgf0dfD4CAXCIB+9xpE71xPkVdlPbQ2z5TMJlnnS08vvilyRy6ZC2lPbIxuNgHPqATsFc/s6VDG/qTaM= ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:22:32.873 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+a6H82UssoxOfosYvsuus3rS4owhSYNmzRa6cSY6EFJ1pRN1wBoLtaPgBkgexruQLpCpciX5QrRBdqC673rRXY4flp5v34YikUya/xWFWMpj5/43q2JcBxPQ6E9hAFT0MELyVJJNwpdbFJYHmB7LFDR2+MAaQPXX5Xn+NGw29vnEaHGyiGMvOvxstscd60rJYJnhNrM4+9sf6cRRRHZoiaME6Hd+/9bbMCtbDBJ9PNTd5E5fc8QEPA6UEtwMYaNKv6YDNeYx0ykX9nCA1cJHAtSKttKpie2YIHN7TsyubzyQ41A57mXa2IWGSZYNyDy6Fl63NART2rbXoVTElMzfDqynImOLTiy+1QctoCNrNLxvtMCrrtDwxNKucXYF6JdNsBAR23RL6PzA7gqYB1TvXI6y8v4gqUJ2PiVATPS84i2OEz74cgf0dfD4CAXCIB+9xpE71xPkVdlPbQ2z5TMJlnnS08vvilyRy6ZC2lPbIxuNgHPqATsFc/s6VDG/qTaM= ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-28T19:22:32.914 INFO:teuthology.orchestra.run.smithi122.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+a6H82UssoxOfosYvsuus3rS4owhSYNmzRa6cSY6EFJ1pRN1wBoLtaPgBkgexruQLpCpciX5QrRBdqC673rRXY4flp5v34YikUya/xWFWMpj5/43q2JcBxPQ6E9hAFT0MELyVJJNwpdbFJYHmB7LFDR2+MAaQPXX5Xn+NGw29vnEaHGyiGMvOvxstscd60rJYJnhNrM4+9sf6cRRRHZoiaME6Hd+/9bbMCtbDBJ9PNTd5E5fc8QEPA6UEtwMYaNKv6YDNeYx0ykX9nCA1cJHAtSKttKpie2YIHN7TsyubzyQ41A57mXa2IWGSZYNyDy6Fl63NART2rbXoVTElMzfDqynImOLTiy+1QctoCNrNLxvtMCrrtDwxNKucXYF6JdNsBAR23RL6PzA7gqYB1TvXI6y8v4gqUJ2PiVATPS84i2OEz74cgf0dfD4CAXCIB+9xpE71xPkVdlPbQ2z5TMJlnnS08vvilyRy6ZC2lPbIxuNgHPqATsFc/s6VDG/qTaM= ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:22:32.927 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-28T19:22:33.178 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:22:33.299 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:32 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1304063469' entity='client.admin' 2024-08-28T19:22:35.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:34 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1029236018' entity='client.admin' 2024-08-28T19:22:35.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:34 smithi033 ceph-mon[18549]: mgrmap e13: x(active, since 12s) 2024-08-28T19:22:35.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:34 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:35.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:34 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:35.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:34 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"} : dispatch 2024-08-28T19:22:35.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:34 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:35.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:34 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:22:35.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:34 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:35.295 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-28T19:22:35.295 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-28T19:22:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:22:37.465 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi059 2024-08-28T19:22:37.465 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:22:37.465 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/etc/ceph/ceph.conf 2024-08-28T19:22:37.483 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:22:37.484 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:22:37.541 INFO:tasks.cephadm:Adding host smithi059 to orchestrator... 2024-08-28T19:22:37.542 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch host add smithi059 2024-08-28T19:22:37.786 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:22:37.999 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:38.000 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:38.000 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:22:38.000 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:22:38.000 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:22:38.000 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: Updating smithi033:/etc/ceph/ceph.conf 2024-08-28T19:22:38.001 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:22:38.001 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:22:38.001 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:22:38.001 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:38.001 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:38.001 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:37 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:39.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:38 smithi033 ceph-mon[18549]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi059", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:40.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:39 smithi033 ceph-mon[18549]: Deploying cephadm binary to smithi059 2024-08-28T19:22:42.326 INFO:teuthology.orchestra.run.smithi033.stdout:Added host 'smithi059' with addr '172.21.15.59' 2024-08-28T19:22:42.976 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-28T19:22:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:22:43.586 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:43 smithi033 ceph-mon[18549]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:22:43.586 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:43 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:43.587 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:43 smithi033 ceph-mon[18549]: Added host smithi059 2024-08-28T19:22:43.587 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:43 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:22:43.587 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:43 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:43.587 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:43 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:43.876 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:43.876 INFO:teuthology.orchestra.run.smithi033.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}] 2024-08-28T19:22:44.453 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi122 2024-08-28T19:22:44.453 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:22:44.453 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.conf 2024-08-28T19:22:44.469 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:22:44.470 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:22:44.527 INFO:tasks.cephadm:Adding host smithi122 to orchestrator... 2024-08-28T19:22:44.527 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch host add smithi122 2024-08-28T19:22:44.785 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:22:45.005 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:44 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:45.005 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:44 smithi033 ceph-mon[18549]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:22:45.005 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:44 smithi033 ceph-mon[18549]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:22:46.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:45 smithi033 ceph-mon[18549]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:47.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:22:47.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:47.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:47.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:47.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:47.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"} : dispatch 2024-08-28T19:22:47.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:22:47.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:22:47.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: Updating smithi059:/etc/ceph/ceph.conf 2024-08-28T19:22:47.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:47.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:47.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:47 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:48.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:48 smithi033 ceph-mon[18549]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:22:48.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:48 smithi033 ceph-mon[18549]: Deploying cephadm binary to smithi122 2024-08-28T19:22:48.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:48 smithi033 ceph-mon[18549]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:22:48.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:48 smithi033 ceph-mon[18549]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:22:49.534 INFO:teuthology.orchestra.run.smithi033.stdout:Added host 'smithi122' with addr '172.21.15.122' 2024-08-28T19:22:49.845 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:49 smithi033 ceph-mon[18549]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:22:49.846 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:49 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:49.846 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:49 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:22:50.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-28T19:22:50.385 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:22:50.765 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:50 smithi033 ceph-mon[18549]: Added host smithi122 2024-08-28T19:22:50.766 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:50 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:50.766 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:50 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:22:51.059 INFO:teuthology.orchestra.run.smithi033.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}, {"addr": "172.21.15.122", "hostname": "smithi122", "labels": [], "status": ""}] 2024-08-28T19:22:51.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:51 smithi033 ceph-mon[18549]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:22:51.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:51 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:51.674 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-28T19:22:51.675 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd crush tunables default 2024-08-28T19:22:51.923 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:22:52.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:52 smithi033 ceph-mon[18549]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:22:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-08-28T19:22:53.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:53 smithi033 ceph-mon[18549]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:22:53.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:53 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1805807949' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-28T19:22:54.265 INFO:tasks.cephadm:Adding mon.a on smithi033 2024-08-28T19:22:54.265 INFO:tasks.cephadm:Adding mon.b on smithi059 2024-08-28T19:22:54.265 INFO:tasks.cephadm:Adding mon.c on smithi122 2024-08-28T19:22:54.265 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch apply mon '3;smithi033:172.21.15.33=a;smithi059:172.21.15.59=b;smithi122:172.21.15.122=c' 2024-08-28T19:22:54.509 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1805807949' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"} : dispatch 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:54.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:54 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:55.144 INFO:teuthology.orchestra.run.smithi122.stdout:Scheduled mon update... 2024-08-28T19:22:55.733 DEBUG:teuthology.orchestra.run.smithi059:mon.b> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.b.service 2024-08-28T19:22:55.736 DEBUG:teuthology.orchestra.run.smithi122:mon.c> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.c.service 2024-08-28T19:22:55.738 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-28T19:22:55.738 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-28T19:22:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: Updating smithi122:/etc/ceph/ceph.conf 2024-08-28T19:22:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:22:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:22:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:22:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:22:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:22:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:22:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:22:55.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:22:55.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:22:55.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:55 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:22:56.355 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:22:56.862 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:56 smithi033 ceph-mon[18549]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi059:172.21.15.59=b;smithi122:172.21.15.122=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:22:56.862 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:56 smithi033 ceph-mon[18549]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi059:172.21.15.59=b;smithi122:172.21.15.122=c;count:3 2024-08-28T19:22:56.862 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:56 smithi033 ceph-mon[18549]: Deploying daemon mon.c on smithi122 2024-08-28T19:22:57.003 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:22:57.003 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","modified":"2024-08-28T19:21:30.339419Z","created":"2024-08-28T19:21:30.339419Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-28T19:22:57.003 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-08-28T19:22:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:57 smithi033 ceph-mon[18549]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:22:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:57 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/3271646988' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:22:59.190 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-28T19:22:59.190 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-28T19:22:59.557 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:22:59.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:22:59 smithi033 ceph-mon[18549]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:00.217 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:23:00.218 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":1,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","modified":"2024-08-28T19:21:30.339419Z","created":"2024-08-28T19:21:30.339419Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-28T19:23:00.218 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 1 2024-08-28T19:23:00.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:00 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/3542142615' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:02.022 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-28T19:23:02.022 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-28T19:23:02.279 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:23:05.974 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:23:05.975 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":2,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","modified":"2024-08-28T19:23:00.611921Z","created":"2024-08-28T19:21:30.339419Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-28T19:23:05.975 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 2 2024-08-28T19:23:06.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:23:06.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:06.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: mon.a calling monitor election 2024-08-28T19:23:06.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:06.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:06.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:06.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: mon.c calling monitor election 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: monmap epoch 2 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: last_changed 2024-08-28T19:23:00.611921+0000 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: created 2024-08-28T19:21:30.339419+0000 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: min_mon_release 19 (squid) 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: election_strategy: 1 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-08-28T19:23:06.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-08-28T19:23:06.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: fsmap 2024-08-28T19:23:06.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T19:23:06.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: mgrmap e13: x(active, since 43s) 2024-08-28T19:23:06.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: overall HEALTH_OK 2024-08-28T19:23:06.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:06.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:06.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:06.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:06.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:05 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:06.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:06 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:07.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:06 smithi033 ceph-mon[18549]: Deploying daemon mon.b on smithi059 2024-08-28T19:23:07.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:06 smithi033 ceph-mon[18549]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:07.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:06 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/390756834' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:07.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:06 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:07.562 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-28T19:23:07.562 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-28T19:23:07.812 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:23:08.499 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:23:08.499 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":2,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","modified":"2024-08-28T19:23:00.611921Z","created":"2024-08-28T19:21:30.339419Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-28T19:23:08.499 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 2 2024-08-28T19:23:09.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:08 smithi033 ceph-mon[18549]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:08 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/2712820625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:09.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:08 smithi122 ceph-mon[22174]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:08 smithi122 ceph-mon[22174]: from='client.? 172.21.15.122:0/2712820625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:09.450 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 podman[22033]: 2024-08-28 19:23:09.418697211 +0000 UTC m=+0.455996729 container start 2a861e19a77454b6fb0914fb51ed3d17735370621f6e6054b2ff2c3ff03dc3a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-b, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:23:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: set uid:gid to 167:167 (ceph:ceph) 2024-08-28T19:23:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-28T19:23:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pidfile_write: ignore empty --pid-file 2024-08-28T19:23:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: load: jerasure load: lrc 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: RocksDB version: 7.9.2 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Git sha 0 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: DB SUMMARY 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: DB Session ID: L20F0WPH02SAW5IB3LMH 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: CURRENT file: CURRENT 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: IDENTITY file: IDENTITY 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.error_if_exists: 0 2024-08-28T19:23:09.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.create_if_missing: 0 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.paranoid_checks: 1 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.env: 0x561721ad25a0 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.fs: PosixFileSystem 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.info_log: 0x5617265fb4e0 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_file_opening_threads: 16 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.statistics: (nil) 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.use_fsync: 0 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_log_file_size: 0 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-28T19:23:09.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.keep_log_file_num: 1000 2024-08-28T19:23:09.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.recycle_log_file_num: 0 2024-08-28T19:23:09.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.allow_fallocate: 1 2024-08-28T19:23:09.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.allow_mmap_reads: 0 2024-08-28T19:23:09.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.allow_mmap_writes: 0 2024-08-28T19:23:09.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.use_direct_reads: 0 2024-08-28T19:23:09.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-28T19:23:09.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.create_missing_column_families: 0 2024-08-28T19:23:09.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.db_log_dir: 2024-08-28T19:23:09.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.wal_dir: 2024-08-28T19:23:09.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-28T19:23:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-28T19:23:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-28T19:23:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-28T19:23:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-28T19:23:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-28T19:23:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.advise_random_on_open: 1 2024-08-28T19:23:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.db_write_buffer_size: 0 2024-08-28T19:23:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.write_buffer_manager: 0x5617265ff5e0 2024-08-28T19:23:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-28T19:23:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.rate_limiter: (nil) 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.wal_recovery_mode: 2 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.enable_thread_tracking: 0 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.enable_pipelined_write: 0 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.unordered_write: 0 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.row_cache: None 2024-08-28T19:23:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.wal_filter: None 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.allow_ingest_behind: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.two_write_queues: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.manual_wal_flush: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.wal_compression: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.atomic_flush: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.log_readahead_size: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.best_efforts_recovery: 0 2024-08-28T19:23:09.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-28T19:23:09.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-28T19:23:09.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.allow_data_in_errors: 0 2024-08-28T19:23:09.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.db_host_id: __hostname__ 2024-08-28T19:23:09.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-28T19:23:09.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_background_jobs: 2 2024-08-28T19:23:09.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_background_compactions: -1 2024-08-28T19:23:09.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_subcompactions: 1 2024-08-28T19:23:09.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-28T19:23:09.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_total_wal_size: 0 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_open_files: -1 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bytes_per_sync: 0 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_readahead_size: 0 2024-08-28T19:23:09.792 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_background_flushes: -1 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Compression algorithms supported: 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: kZSTD supported: 0 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: kXpressCompression supported: 0 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: kBZip2Compression supported: 0 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: kLZ4Compression supported: 1 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: kZlibCompression supported: 1 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: kLZ4HCCompression supported: 1 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: kSnappyCompression supported: 1 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-28T19:23:09.793 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.merge_operator: 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_filter: None 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_filter_factory: None 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.sst_partitioner_factory: None 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5617265fb100) 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout: cache_index_and_filter_blocks: 1 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout: pin_top_level_index_and_filter: 1 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout: index_type: 0 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout: data_block_index_type: 0 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout: index_shortening: 1 2024-08-28T19:23:09.794 INFO:journalctl@ceph.mon.b.smithi059.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: checksum: 4 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: no_block_cache: 0 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: block_cache: 0x5617225be850 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: block_cache_name: BinnedLRUCache 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: block_cache_options: 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: capacity : 536870912 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: num_shard_bits : 4 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: strict_capacity_limit : 0 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: high_pri_pool_ratio: 0.000 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: block_cache_compressed: (nil) 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: persistent_cache: (nil) 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: block_size: 4096 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: block_size_deviation: 10 2024-08-28T19:23:09.795 INFO:journalctl@ceph.mon.b.smithi059.stdout: block_restart_interval: 16 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: index_block_restart_interval: 1 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: metadata_block_size: 4096 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: partition_filters: 0 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: use_delta_encoding: 1 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: filter_policy: bloomfilter 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: whole_key_filtering: 1 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: verify_compression: 0 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: read_amp_bytes_per_bit: 0 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: format_version: 5 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: enable_index_compression: 1 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: block_align: 0 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: max_auto_readahead_size: 262144 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: prepopulate_block_cache: 0 2024-08-28T19:23:09.796 INFO:journalctl@ceph.mon.b.smithi059.stdout: initial_auto_readahead_size: 8192 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout: num_file_reads_for_auto_readahead: 2 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.write_buffer_size: 33554432 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_write_buffer_number: 2 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compression: NoCompression 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bottommost_compression: Disabled 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.prefix_extractor: nullptr 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.num_levels: 7 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-28T19:23:09.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compression_opts.level: 32767 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compression_opts.strategy: 0 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compression_opts.enabled: false 2024-08-28T19:23:09.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.target_file_size_base: 67108864 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-28T19:23:09.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.arena_block_size: 1048576 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.disable_auto_compactions: 0 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-28T19:23:09.800 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.inplace_update_support: 0 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.bloom_locality: 0 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.max_successive_merges: 0 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.paranoid_file_checks: 0 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.force_consistency_checks: 1 2024-08-28T19:23:09.801 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.report_bg_io_stats: 0 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.ttl: 2592000 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.enable_blob_files: false 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.min_blob_size: 0 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.blob_file_size: 268435456 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.blob_file_starting_level: 0 2024-08-28T19:23:09.802 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 77759279-ea68-4d2a-b0d1-1b4371f2e659 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724872989455616, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724872989456053, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724872989, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "77759279-ea68-4d2a-b0d1-1b4371f2e659", "db_session_id": "L20F0WPH02SAW5IB3LMH", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724872989456150, "job": 1, "event": "recovery_finished"} 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56172661ea80 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: DB pointer 0x5617273c0000 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout: ** DB Stats ** 2024-08-28T19:23:09.803 INFO:journalctl@ceph.mon.b.smithi059.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: ** Compaction Stats [default] ** 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T19:23:09.804 INFO:journalctl@ceph.mon.b.smithi059.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: ** Compaction Stats [default] ** 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-28T19:23:09.805 INFO:journalctl@ceph.mon.b.smithi059.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout: Block cache BinnedLRUCache@0x5617225be850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout: 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: using public_addr v2:172.21.15.59:0/0 -> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: starting mon.b rank -1 at public addrs [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] at bind addrs [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(???) e0 preinit fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).mds e1 new map 2024-08-28T19:23:09.806 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).mds e1 print_map 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout: e1 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout: btime 2024-08-28T19:21:33:380247+0000 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout: legacy client fscid: -1 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout: 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout: No filesystems configured 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-28T19:23:09.807 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Deploying cephadm binary to smithi122 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Added host smithi122 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.808 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1805807949' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1805807949' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"} : dispatch 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:09.809 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Updating smithi122:/etc/ceph/ceph.conf 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:09.810 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi059:172.21.15.59=b;smithi122:172.21.15.122=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi059:172.21.15.59=b;smithi122:172.21.15.122=c;count:3 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Deploying daemon mon.c on smithi122 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/3271646988' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/3542142615' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.a calling monitor election 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.c calling monitor election 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:09.811 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: monmap epoch 2 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: last_changed 2024-08-28T19:23:00.611921+0000 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: created 2024-08-28T19:21:30.339419+0000 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: min_mon_release 19 (squid) 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: election_strategy: 1 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: fsmap 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mgrmap e13: x(active, since 43s) 2024-08-28T19:23:09.812 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: overall HEALTH_OK 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: Deploying daemon mon.b on smithi059 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/390756834' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/2712820625' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 ceph-mon[22052]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 bash[22033]: 2a861e19a77454b6fb0914fb51ed3d17735370621f6e6054b2ff2c3ff03dc3a2 2024-08-28T19:23:09.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:09 smithi059 systemd[1]: Started Ceph mon.b for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:23:10.093 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-28T19:23:10.093 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-28T19:23:10.342 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:23:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:23:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: mon.a calling monitor election 2024-08-28T19:23:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: mon.c calling monitor election 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: mon.b calling monitor election 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: monmap epoch 3 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: last_changed 2024-08-28T19:23:09.482943+0000 2024-08-28T19:23:14.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: created 2024-08-28T19:21:30.339419+0000 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: min_mon_release 19 (squid) 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: election_strategy: 1 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: 2: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: fsmap 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: mgrmap e13: x(active, since 52s) 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: overall HEALTH_OK 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:14.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:14 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:23:15.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: mon.a calling monitor election 2024-08-28T19:23:15.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: mon.c calling monitor election 2024-08-28T19:23:15.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:15.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: mon.b calling monitor election 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: monmap epoch 3 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: last_changed 2024-08-28T19:23:09.482943+0000 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: created 2024-08-28T19:21:30.339419+0000 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: min_mon_release 19 (squid) 2024-08-28T19:23:15.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: election_strategy: 1 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: 2: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: fsmap 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: mgrmap e13: x(active, since 52s) 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: overall HEALTH_OK 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:14 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: mon.a calling monitor election 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: mon.c calling monitor election 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: mon.b calling monitor election 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: monmap epoch 3 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: last_changed 2024-08-28T19:23:09.482943+0000 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: created 2024-08-28T19:21:30.339419+0000 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: min_mon_release 19 (squid) 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: election_strategy: 1 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: 1: [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon.c 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: 2: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: fsmap 2024-08-28T19:23:15.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: osdmap e4: 0 total, 0 up, 0 in 2024-08-28T19:23:15.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: mgrmap e13: x(active, since 52s) 2024-08-28T19:23:15.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: overall HEALTH_OK 2024-08-28T19:23:15.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:14 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.407 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:23:15.408 INFO:teuthology.orchestra.run.smithi122.stdout:{"epoch":3,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","modified":"2024-08-28T19:23:09.482943Z","created":"2024-08-28T19:21:30.339419Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-28T19:23:15.408 INFO:teuthology.orchestra.run.smithi122.stderr:dumped monmap epoch 3 2024-08-28T19:23:15.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:15 smithi122 ceph-mon[22174]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:15.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:15 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:15.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:15 smithi122 ceph-mon[22174]: from='client.? 172.21.15.122:0/3077662187' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:15.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:15 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:15 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.833 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:15 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:15 smithi033 ceph-mon[18549]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:15 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:15 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/3077662187' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:15 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:15 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:15 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:15 smithi059 ceph-mon[22052]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:16.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:15 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:16.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:15 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/3077662187' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-28T19:23:16.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:15 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:16.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:15 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:15 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.277 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-28T19:23:16.277 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config generate-minimal-conf 2024-08-28T19:23:16.588 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:23:16.481+0000 7fe7ca8c9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-28T19:23:16.854 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.854 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: Updating smithi033:/etc/ceph/ceph.conf 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: Updating smithi059:/etc/ceph/ceph.conf 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: Updating smithi122:/etc/ceph/ceph.conf 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: Reconfiguring mon.a (unknown last config time)... 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:16.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:16 smithi033 ceph-mon[18549]: Reconfiguring daemon mon.a on smithi033 2024-08-28T19:23:17.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: Updating smithi033:/etc/ceph/ceph.conf 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: Updating smithi059:/etc/ceph/ceph.conf 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: Updating smithi122:/etc/ceph/ceph.conf 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:17.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: Reconfiguring mon.a (unknown last config time)... 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:17.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:17.036 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:16 smithi059 ceph-mon[22052]: Reconfiguring daemon mon.a on smithi033 2024-08-28T19:23:17.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:17.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:17.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: Updating smithi033:/etc/ceph/ceph.conf 2024-08-28T19:23:17.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: Updating smithi059:/etc/ceph/ceph.conf 2024-08-28T19:23:17.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: Updating smithi122:/etc/ceph/ceph.conf 2024-08-28T19:23:17.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:17.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: Reconfiguring mon.a (unknown last config time)... 2024-08-28T19:23:17.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:17.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:17.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:17.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:16 smithi122 ceph-mon[22174]: Reconfiguring daemon mon.a on smithi033 2024-08-28T19:23:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:17.775 INFO:teuthology.orchestra.run.smithi033.stdout:# minimal ceph.conf for 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:23:17.775 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-08-28T19:23:17.775 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:23:17.775 INFO:teuthology.orchestra.run.smithi033.stdout: mon_host = [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] 2024-08-28T19:23:18.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:18 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:18.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:18 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2545308681' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:18.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:18 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:18.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:18 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:18.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:18 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:18.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:18 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:18.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:18 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:18 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:18 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2545308681' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:18 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:18 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:18 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:18 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:18 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:18.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:18 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:18.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:18 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2545308681' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:18.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:18 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:18.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:18 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:18.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:18 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:18.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:18 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:18.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:18 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:18.685 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-28T19:23:18.685 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:23:18.685 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.conf 2024-08-28T19:23:18.713 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:23:18.713 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:18.778 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:23:18.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.conf 2024-08-28T19:23:18.806 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:23:18.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:18.871 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:23:18.871 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.conf 2024-08-28T19:23:18.904 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:23:18.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:18.973 INFO:tasks.cephadm:enabling module snap_schedule 2024-08-28T19:23:18.974 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-08-28T19:23:19.219 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:19.332 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:19 smithi033 ceph-mon[18549]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:19.332 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:19 smithi033 ceph-mon[18549]: Reconfiguring mon.b (monmap changed)... 2024-08-28T19:23:19.332 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:19 smithi033 ceph-mon[18549]: Reconfiguring daemon mon.b on smithi059 2024-08-28T19:23:19.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:19 smithi059 ceph-mon[22052]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:19.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:19 smithi059 ceph-mon[22052]: Reconfiguring mon.b (monmap changed)... 2024-08-28T19:23:19.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:19 smithi059 ceph-mon[22052]: Reconfiguring daemon mon.b on smithi059 2024-08-28T19:23:19.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:19 smithi122 ceph-mon[22174]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:19.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:19 smithi122 ceph-mon[22174]: Reconfiguring mon.b (monmap changed)... 2024-08-28T19:23:19.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:19 smithi122 ceph-mon[22174]: Reconfiguring daemon mon.b on smithi059 2024-08-28T19:23:20.405 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:20 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:20.406 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:20 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:20.406 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:20 smithi122 ceph-mon[22174]: Reconfiguring mon.c (monmap changed)... 2024-08-28T19:23:20.406 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:20 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:20.406 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:20 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:20.406 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:20 smithi122 ceph-mon[22174]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:20.406 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:20 smithi122 ceph-mon[22174]: Reconfiguring daemon mon.c on smithi122 2024-08-28T19:23:20.406 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:20 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/661224052' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-28T19:23:20.630 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:20 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: ignoring --setuser ceph since I am not root 2024-08-28T19:23:20.630 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:20 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: ignoring --setgroup ceph since I am not root 2024-08-28T19:23:20.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:20 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:20.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:20 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:20.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:20 smithi033 ceph-mon[18549]: Reconfiguring mon.c (monmap changed)... 2024-08-28T19:23:20.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:20 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:20.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:20 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:20.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:20 smithi033 ceph-mon[18549]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:20.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:20 smithi033 ceph-mon[18549]: Reconfiguring daemon mon.c on smithi122 2024-08-28T19:23:20.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:20 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/661224052' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-28T19:23:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:20 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:20 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' 2024-08-28T19:23:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:20 smithi059 ceph-mon[22052]: Reconfiguring mon.c (monmap changed)... 2024-08-28T19:23:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:20 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:20 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:20 smithi059 ceph-mon[22052]: from='mgr.14150 172.21.15.33:0/1812252686' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:20.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:20 smithi059 ceph-mon[22052]: Reconfiguring daemon mon.c on smithi122 2024-08-28T19:23:20.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:20 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/661224052' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-28T19:23:21.033 INFO:tasks.cephadm:Adding mgr.x on smithi033 2024-08-28T19:23:21.033 INFO:tasks.cephadm:Adding mgr.y on smithi059 2024-08-28T19:23:21.033 INFO:tasks.cephadm:Adding mgr.z on smithi122 2024-08-28T19:23:21.034 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch apply mgr '3;smithi033=x;smithi059=y;smithi122=z' 2024-08-28T19:23:21.270 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:23:21.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:21 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/661224052' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-28T19:23:21.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:21 smithi033 ceph-mon[18549]: mgrmap e14: x(active, since 58s) 2024-08-28T19:23:21.634 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:21 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/661224052' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-28T19:23:21.634 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:21 smithi122 ceph-mon[22174]: mgrmap e14: x(active, since 58s) 2024-08-28T19:23:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:21 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/661224052' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-28T19:23:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:21 smithi059 ceph-mon[22052]: mgrmap e14: x(active, since 58s) 2024-08-28T19:23:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: Active manager daemon x restarted 2024-08-28T19:23:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: Activating manager daemon x 2024-08-28T19:23:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: osdmap e5: 0 total, 0 up, 0 in 2024-08-28T19:23:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: mgrmap e15: x(active, starting, since 0.00467082s) 2024-08-28T19:23:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:23:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:26.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-28T19:23:26.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-28T19:23:26.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-28T19:23:26.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-28T19:23:26.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:25 smithi059 ceph-mon[22052]: Manager daemon x is now available 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: Active manager daemon x restarted 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: Activating manager daemon x 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: osdmap e5: 0 total, 0 up, 0 in 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: mgrmap e15: x(active, starting, since 0.00467082s) 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-28T19:23:26.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:25 smithi122 ceph-mon[22174]: Manager daemon x is now available 2024-08-28T19:23:26.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: Active manager daemon x restarted 2024-08-28T19:23:26.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: Activating manager daemon x 2024-08-28T19:23:26.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: osdmap e5: 0 total, 0 up, 0 in 2024-08-28T19:23:26.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: mgrmap e15: x(active, starting, since 0.00467082s) 2024-08-28T19:23:26.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:23:26.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:23:26.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:23:26.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-28T19:23:26.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-28T19:23:26.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-28T19:23:26.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-28T19:23:26.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:25 smithi033 ceph-mon[18549]: Manager daemon x is now available 2024-08-28T19:23:26.635 INFO:teuthology.orchestra.run.smithi122.stdout:Scheduled mgr update... 2024-08-28T19:23:26.668 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:26.668 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-28T19:23:26.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:26.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-28T19:23:26.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-28T19:23:26.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:26 smithi033 ceph-mon[18549]: mgrmap e16: x(active, since 1.01007s) 2024-08-28T19:23:26.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:26.937 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:26.937 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-28T19:23:26.937 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-28T19:23:26.937 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:26 smithi122 ceph-mon[22174]: mgrmap e16: x(active, since 1.01007s) 2024-08-28T19:23:26.937 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:27.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-28T19:23:27.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:26 smithi059 ceph-mon[22052]: mgrmap e16: x(active, since 1.01007s) 2024-08-28T19:23:27.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:27.224 DEBUG:teuthology.orchestra.run.smithi059:mgr.y> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.y.service 2024-08-28T19:23:27.227 DEBUG:teuthology.orchestra.run.smithi122:mgr.z> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.z.service 2024-08-28T19:23:27.230 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-28T19:23:27.230 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-28T19:23:27.232 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-28T19:23:27.232 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set client debug_client 20 2024-08-28T19:23:27.275 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-28T19:23:27.275 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set client debug_ms 1 2024-08-28T19:23:27.317 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-28T19:23:27.318 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-28T19:23:27.360 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-28T19:23:27.361 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-28T19:23:27.404 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-28T19:23:27.404 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-28T19:23:27.447 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-28T19:23:27.447 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-28T19:23:27.498 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-28T19:23:27.498 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-28T19:23:27.550 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-28T19:23:27.551 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-28T19:23:27.598 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-28T19:23:27.598 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-28T19:23:27.641 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-28T19:23:27.641 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-28T19:23:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:27.672 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-28T19:23:27.672 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-28T19:23:27.731 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-28T19:23:27.732 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-28T19:23:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:27.747 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-28T19:23:27.747 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-28T19:23:27.793 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-28T19:23:27.793 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-28T19:23:27.840 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-28T19:23:27.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-28T19:23:27.916 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-28T19:23:27.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-28T19:23:27.975 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-28T19:23:27.975 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-28T19:23:28.028 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-28T19:23:28.028 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-28T19:23:28.074 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-08-28T19:23:28.074 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-08-28T19:23:28.142 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-08-28T19:23:28.142 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-08-28T19:23:28.195 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-08-28T19:23:28.195 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-08-28T19:23:28.239 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-08-28T19:23:28.239 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-08-28T19:23:28.306 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-28T19:23:28.306 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-28T19:23:28.372 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-28T19:23:28.372 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-28T19:23:28.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-mon[18549]: Saving service mgr spec with placement smithi033=x;smithi059=y;smithi122=z;count:3 2024-08-28T19:23:28.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"} : dispatch 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:23:28.292+0000 7feafef39640 -1 log_channel(cephadm) log [ERR] : [28/Aug/2024:19:23:28] ENGINE Error in HTTPServer.serve 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: Traceback (most recent call last): 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self._connections.run(self.expiration_interval) 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self._run(expiration_interval) 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T19:23:28.403 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: s = self.context.wrap_socket( 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: return self.sslsocket_class._create( 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self.do_handshake() 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self._sslobj.do_handshake() 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T19:23:28.404 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:23:28 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:23:28.405 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-28T19:23:28.405 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-28T19:23:28.454 DEBUG:tasks.cephadm:set 26 configs 2024-08-28T19:23:28.455 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi033') 2024-08-28T19:23:28.760 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:28 smithi059 ceph-mon[22052]: Saving service mgr spec with placement smithi033=x;smithi059=y;smithi122=z;count:3 2024-08-28T19:23:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"} : dispatch 2024-08-28T19:23:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:28 smithi122 ceph-mon[22174]: Saving service mgr spec with placement smithi033=x;smithi059=y;smithi122=z;count:3 2024-08-28T19:23:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"} : dispatch 2024-08-28T19:23:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: [28/Aug/2024:19:23:28] ENGINE Bus STARTING 2024-08-28T19:23:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: [28/Aug/2024:19:23:28] ENGINE Serving on http://172.21.15.33:8765 2024-08-28T19:23:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: [28/Aug/2024:19:23:28] ENGINE Serving on https://172.21.15.33:7150 2024-08-28T19:23:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: [28/Aug/2024:19:23:28] ENGINE Bus STARTED 2024-08-28T19:23:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: [28/Aug/2024:19:23:28] ENGINE Error in HTTPServer.serve 2024-08-28T19:23:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout: Traceback (most recent call last): 2024-08-28T19:23:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T19:23:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._connections.run(self.expiration_interval) 2024-08-28T19:23:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T19:23:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._run(expiration_interval) 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: s = self.context.wrap_socket( 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: return self.sslsocket_class._create( 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: self.do_handshake() 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: self._sslobj.do_handshake() 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T19:23:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: mgrmap e17: x(active, since 2s) 2024-08-28T19:23:29.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"} : dispatch 2024-08-28T19:23:29.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: from='client.? ' entity='client.admin' 2024-08-28T19:23:29.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3093379852' entity='client.admin' 2024-08-28T19:23:29.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"} : dispatch 2024-08-28T19:23:29.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:29.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: [28/Aug/2024:19:23:28] ENGINE Bus STARTING 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: [28/Aug/2024:19:23:28] ENGINE Serving on http://172.21.15.33:8765 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: [28/Aug/2024:19:23:28] ENGINE Serving on https://172.21.15.33:7150 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: [28/Aug/2024:19:23:28] ENGINE Bus STARTED 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: [28/Aug/2024:19:23:28] ENGINE Error in HTTPServer.serve 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout: Traceback (most recent call last): 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout: self._connections.run(self.expiration_interval) 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout: self._run(expiration_interval) 2024-08-28T19:23:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: s = self.context.wrap_socket( 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: return self.sslsocket_class._create( 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: self.do_handshake() 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: self._sslobj.do_handshake() 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T19:23:29.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: mgrmap e17: x(active, since 2s) 2024-08-28T19:23:29.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"} : dispatch 2024-08-28T19:23:29.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: from='client.? ' entity='client.admin' 2024-08-28T19:23:29.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3093379852' entity='client.admin' 2024-08-28T19:23:29.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"} : dispatch 2024-08-28T19:23:29.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:29.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: [28/Aug/2024:19:23:28] ENGINE Bus STARTING 2024-08-28T19:23:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: [28/Aug/2024:19:23:28] ENGINE Serving on http://172.21.15.33:8765 2024-08-28T19:23:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: [28/Aug/2024:19:23:28] ENGINE Serving on https://172.21.15.33:7150 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: [28/Aug/2024:19:23:28] ENGINE Bus STARTED 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: [28/Aug/2024:19:23:28] ENGINE Error in HTTPServer.serve 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: Traceback (most recent call last): 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: self._connections.run(self.expiration_interval) 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: self._run(expiration_interval) 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-28T19:23:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout: s = self.context.wrap_socket( 2024-08-28T19:23:29.795 INFO:journalctl@ceph.mon.c.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-28T19:23:29.795 INFO:journalctl@ceph.mon.c.smithi122.stdout: return self.sslsocket_class._create( 2024-08-28T19:23:29.795 INFO:journalctl@ceph.mon.c.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-28T19:23:29.795 INFO:journalctl@ceph.mon.c.smithi122.stdout: self.do_handshake() 2024-08-28T19:23:29.795 INFO:journalctl@ceph.mon.c.smithi122.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-28T19:23:29.795 INFO:journalctl@ceph.mon.c.smithi122.stdout: self._sslobj.do_handshake() 2024-08-28T19:23:29.795 INFO:journalctl@ceph.mon.c.smithi122.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-28T19:23:29.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: mgrmap e17: x(active, since 2s) 2024-08-28T19:23:29.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"} : dispatch 2024-08-28T19:23:29.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: from='client.? ' entity='client.admin' 2024-08-28T19:23:29.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3093379852' entity='client.admin' 2024-08-28T19:23:29.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:29.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"} : dispatch 2024-08-28T19:23:29.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:29.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:30.158 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:30.598 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: Updating smithi033:/etc/ceph/ceph.conf 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: Updating smithi059:/etc/ceph/ceph.conf 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: Updating smithi122:/etc/ceph/ceph.conf 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='client.? ' entity='client.admin' 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T19:23:30.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T19:23:30.600 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T19:23:30.600 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:30.626 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi033') 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: Updating smithi033:/etc/ceph/ceph.conf 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: Updating smithi059:/etc/ceph/ceph.conf 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: Updating smithi122:/etc/ceph/ceph.conf 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='client.? ' entity='client.admin' 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.720 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T19:23:30.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T19:23:30.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T19:23:30.721 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: Updating smithi033:/etc/ceph/ceph.conf 2024-08-28T19:23:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: Updating smithi059:/etc/ceph/ceph.conf 2024-08-28T19:23:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: Updating smithi122:/etc/ceph/ceph.conf 2024-08-28T19:23:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='client.? ' entity='client.admin' 2024-08-28T19:23:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:30.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T19:23:30.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T19:23:30.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T19:23:30.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:31.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:31 smithi033 ceph-mon[18549]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:31.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:31 smithi033 ceph-mon[18549]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:31.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:31 smithi033 ceph-mon[18549]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:31.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:31 smithi033 ceph-mon[18549]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:31.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:31 smithi033 ceph-mon[18549]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:31.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:31 smithi033 ceph-mon[18549]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:31.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:31 smithi033 ceph-mon[18549]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:31.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:31 smithi033 ceph-mon[18549]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:31.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:31 smithi033 ceph-mon[18549]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:31.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:31 smithi033 ceph-mon[18549]: Deploying daemon mgr.z on smithi122 2024-08-28T19:23:31.647 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:31 smithi122 ceph-mon[22174]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:31.647 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:31 smithi122 ceph-mon[22174]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:31.647 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:31 smithi122 ceph-mon[22174]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:31.648 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:31 smithi122 ceph-mon[22174]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:31.648 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:31 smithi122 ceph-mon[22174]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:31.648 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:31 smithi122 ceph-mon[22174]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:31.648 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:31 smithi122 ceph-mon[22174]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:31.648 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:31 smithi122 ceph-mon[22174]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:31.648 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:31 smithi122 ceph-mon[22174]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:31.648 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:31 smithi122 ceph-mon[22174]: Deploying daemon mgr.z on smithi122 2024-08-28T19:23:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:31 smithi059 ceph-mon[22052]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:31 smithi059 ceph-mon[22052]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:31 smithi059 ceph-mon[22052]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-28T19:23:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:31 smithi059 ceph-mon[22052]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:31 smithi059 ceph-mon[22052]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:31 smithi059 ceph-mon[22052]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-08-28T19:23:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:31 smithi059 ceph-mon[22052]: Updating smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:31 smithi059 ceph-mon[22052]: Updating smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:31 smithi059 ceph-mon[22052]: Updating smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-28T19:23:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:31 smithi059 ceph-mon[22052]: Deploying daemon mgr.z on smithi122 2024-08-28T19:23:32.241 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi033') 2024-08-28T19:23:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.369+0000 7f85d7549640 1 -- 172.21.15.33:0/1102411951 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f85bc03f300 msgr2=0x7f85bc041810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.369+0000 7f85d7549640 1 --2- 172.21.15.33:0/1102411951 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f85bc03f300 0x7f85bc041810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00b9c0 tx=0x7f85cc005d30 comp rx=0 tx=0).stop 2024-08-28T19:23:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.369+0000 7f85d7549640 1 -- 172.21.15.33:0/1102411951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d010ff40 msgr2=0x7f85d01a1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.369+0000 7f85d7549640 1 --2- 172.21.15.33:0/1102411951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d010ff40 0x7f85d01a1b40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85c800cce0 tx=0x7f85c800a620 comp rx=0 tx=0).stop 2024-08-28T19:23:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.369+0000 7f85d7549640 1 -- 172.21.15.33:0/1102411951 shutdown_connections 2024-08-28T19:23:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.369+0000 7f85d7549640 1 --2- 172.21.15.33:0/1102411951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d010ff40 0x7f85d01a1b40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.369+0000 7f85d7549640 1 --2- 172.21.15.33:0/1102411951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85d0102ce0 0x7f85d019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.369+0000 7f85d7549640 1 --2- 172.21.15.33:0/1102411951 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f85bc03f300 0x7f85bc041810 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:32.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.369+0000 7f85d7549640 1 --2- 172.21.15.33:0/1102411951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f85d0102390 0x7f85d019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:32.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.370+0000 7f85d7549640 1 -- 172.21.15.33:0/1102411951 >> 172.21.15.33:0/1102411951 conn(0x7f85d00794e0 msgr2=0x7f85d01113e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:32.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.370+0000 7f85d7549640 1 -- 172.21.15.33:0/1102411951 shutdown_connections 2024-08-28T19:23:32.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:32.370+0000 7f85d7549640 1 -- 172.21.15.33:0/1102411951 wait complete. 2024-08-28T19:23:32.543 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Aug 28 19:23:32 smithi122 systemd[1]: Started Ceph mgr.z for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:23:32.775 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:32.786 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:32.790 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:32.801 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:32.804 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:32.807 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:33.127 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:33.513 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:33 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1102411951' entity='client.admin' 2024-08-28T19:23:33.513 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:33.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:33.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:33.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T19:23:33.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T19:23:33.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T19:23:33.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:33.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:33 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1102411951' entity='client.admin' 2024-08-28T19:23:33.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:33.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:33.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:33.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T19:23:33.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T19:23:33.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T19:23:33.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:33.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.606+0000 7f7bb46dc640 1 -- 172.21.15.33:0/796430269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bac108ad0 msgr2=0x7f7bac10f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.606+0000 7f7bb46dc640 1 --2- 172.21.15.33:0/796430269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bac108ad0 0x7f7bac10f300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009ca0 tx=0x7f7ba402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.606+0000 7f7bb46dc640 1 -- 172.21.15.33:0/796430269 shutdown_connections 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.606+0000 7f7bb46dc640 1 --2- 172.21.15.33:0/796430269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bac108ad0 0x7f7bac10f300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.606+0000 7f7bb46dc640 1 --2- 172.21.15.33:0/796430269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bac108180 0x7f7bac108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.606+0000 7f7bb46dc640 1 --2- 172.21.15.33:0/796430269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bac102840 0x7f7bac102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.606+0000 7f7bb46dc640 1 -- 172.21.15.33:0/796430269 >> 172.21.15.33:0/796430269 conn(0x7f7bac079580 msgr2=0x7f7bac079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.606+0000 7f7bb46dc640 1 -- 172.21.15.33:0/796430269 shutdown_connections 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.606+0000 7f7bb46dc640 1 -- 172.21.15.33:0/796430269 wait complete. 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.606+0000 7f7bb46dc640 1 Processor -- start 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb46dc640 1 -- start start 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb46dc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bac102840 0x7f7bac19a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:33.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb46dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bac108180 0x7f7bac19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb46dc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bac108ad0 0x7f7bac19f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb46dc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac113740 con 0x7f7bac108180 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb46dc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1135c0 con 0x7f7bac102840 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb46dc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac1138c0 con 0x7f7bac108ad0 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb1c77640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bac108180 0x7f7bac19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb1c77640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bac108180 0x7f7bac19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46620/0 (socket says 172.21.15.33:46620) 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb1c77640 1 -- 172.21.15.33:0/2557122170 learned_addr learned my addr 172.21.15.33:0/2557122170 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb2478640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bac102840 0x7f7bac19a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb2c79640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bac108ad0 0x7f7bac19f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb1c77640 1 -- 172.21.15.33:0/2557122170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bac108ad0 msgr2=0x7f7bac19f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb1c77640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bac108ad0 0x7f7bac19f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:33.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb1c77640 1 -- 172.21.15.33:0/2557122170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bac102840 msgr2=0x7f7bac19a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb1c77640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bac102840 0x7f7bac19a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb1c77640 1 -- 172.21.15.33:0/2557122170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bac1a0100 con 0x7f7bac108180 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.607+0000 7f7bb1c77640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bac108180 0x7f7bac19a730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00c970 tx=0x7f7b9c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.608+0000 7f7ba37fe640 1 -- 172.21.15.33:0/2557122170 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c007bb0 con 0x7f7bac108180 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.608+0000 7f7ba37fe640 1 -- 172.21.15.33:0/2557122170 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7b9c007d50 con 0x7f7bac108180 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.608+0000 7f7ba37fe640 1 -- 172.21.15.33:0/2557122170 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c004e20 con 0x7f7bac108180 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.608+0000 7f7bb46dc640 1 -- 172.21.15.33:0/2557122170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bac1a03f0 con 0x7f7bac108180 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.608+0000 7f7bb46dc640 1 -- 172.21.15.33:0/2557122170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bac1a6b50 con 0x7f7bac108180 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.609+0000 7f7bb46dc640 1 -- 172.21.15.33:0/2557122170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bac102c50 con 0x7f7bac108180 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.609+0000 7f7ba37fe640 1 -- 172.21.15.33:0/2557122170 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f7b9c00f450 con 0x7f7bac108180 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.609+0000 7f7ba37fe640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7b9803f2d0 0x7f7b980417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.609+0000 7f7ba37fe640 1 -- 172.21.15.33:0/2557122170 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7b9c053900 con 0x7f7bac108180 2024-08-28T19:23:33.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.609+0000 7f7bb2478640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7b9803f2d0 0x7f7b980417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:33.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.610+0000 7f7bb2478640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7b9803f2d0 0x7f7b980417e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8005fd0 tx=0x7f7ba800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:33.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.614+0000 7f7ba37fe640 1 -- 172.21.15.33:0/2557122170 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7b9c014030 con 0x7f7bac108180 2024-08-28T19:23:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:33 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1102411951' entity='client.admin' 2024-08-28T19:23:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T19:23:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-28T19:23:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T19:23:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:33.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.802+0000 7f7bb46dc640 1 -- 172.21.15.33:0/2557122170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f7bac02e430 con 0x7f7bac108180 2024-08-28T19:23:33.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.806+0000 7f7ba37fe640 1 -- 172.21.15.33:0/2557122170 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v14)=0 v14) ==== 127+0+0 (secure 0 0 0) 0x7f7b9c00fb60 con 0x7f7bac108180 2024-08-28T19:23:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 -- 172.21.15.33:0/2557122170 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7b9803f2d0 msgr2=0x7f7b980417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7b9803f2d0 0x7f7b980417e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8005fd0 tx=0x7f7ba800b390 comp rx=0 tx=0).stop 2024-08-28T19:23:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 -- 172.21.15.33:0/2557122170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bac108180 msgr2=0x7f7bac19a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bac108180 0x7f7bac19a730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00c970 tx=0x7f7b9c00ce30 comp rx=0 tx=0).stop 2024-08-28T19:23:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 -- 172.21.15.33:0/2557122170 shutdown_connections 2024-08-28T19:23:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7b9803f2d0 0x7f7b980417e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7bac108ad0 0x7f7bac19f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bac108180 0x7f7bac19a730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 --2- 172.21.15.33:0/2557122170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bac102840 0x7f7bac19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 -- 172.21.15.33:0/2557122170 >> 172.21.15.33:0/2557122170 conn(0x7f7bac079580 msgr2=0x7f7bac104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 -- 172.21.15.33:0/2557122170 shutdown_connections 2024-08-28T19:23:33.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:33.808+0000 7f7bb46dc640 1 -- 172.21.15.33:0/2557122170 wait complete. 2024-08-28T19:23:34.369 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:23:34 smithi059 systemd[1]: Starting Ceph mgr.y for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:23:34.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:34 smithi033 ceph-mon[18549]: Deploying daemon mgr.y on smithi059 2024-08-28T19:23:34.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:34 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2557122170' entity='client.admin' 2024-08-28T19:23:34.478 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.481 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.488 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.489 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.489 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.494 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.494 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.494 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:34.635 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:34 smithi059 ceph-mon[22052]: Deploying daemon mgr.y on smithi059 2024-08-28T19:23:34.635 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:34 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2557122170' entity='client.admin' 2024-08-28T19:23:34.635 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:23:34 smithi059 podman[24361]: 2024-08-28 19:23:34.428595451 +0000 UTC m=+0.111954449 container create 9ffbb7fe24ac6b05fb5b75f4c387213da9c47bf91e34c26e4de56e3d78d3546e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-28T19:23:34.635 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:23:34 smithi059 podman[24361]: 2024-08-28 19:23:34.332438603 +0000 UTC m=+0.015797618 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:23:34.635 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:23:34 smithi059 podman[24361]: 2024-08-28 19:23:34.59763168 +0000 UTC m=+0.280990679 container init 9ffbb7fe24ac6b05fb5b75f4c387213da9c47bf91e34c26e4de56e3d78d3546e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731) 2024-08-28T19:23:34.635 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:23:34 smithi059 podman[24361]: 2024-08-28 19:23:34.600329159 +0000 UTC m=+0.283688166 container start 9ffbb7fe24ac6b05fb5b75f4c387213da9c47bf91e34c26e4de56e3d78d3546e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:23:34.747 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:34 smithi122 ceph-mon[22174]: Deploying daemon mgr.y on smithi059 2024-08-28T19:23:34.747 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:34 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2557122170' entity='client.admin' 2024-08-28T19:23:35.033 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:23:34 smithi059 ceph-mgr[24379]: -- 172.21.15.59:0/1441410385 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5608b27f50e0 con 0x5608b7594480 2024-08-28T19:23:35.033 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:23:34 smithi059 bash[24361]: 9ffbb7fe24ac6b05fb5b75f4c387213da9c47bf91e34c26e4de56e3d78d3546e 2024-08-28T19:23:35.033 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:23:34 smithi059 systemd[1]: Started Ceph mgr.y for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:23:35.645 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi033') 2024-08-28T19:23:35.645 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi033') 2024-08-28T19:23:35.875 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:35 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:35.875 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:35 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:35.875 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:35 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:35.875 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:35 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:35.875 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:35 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:35.875 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:35 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/154855881' entity='client.admin' 2024-08-28T19:23:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:35 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:35 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:35 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:35 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:35 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:35 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/154855881' entity='client.admin' 2024-08-28T19:23:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:35 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:35 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:35 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:35 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:35 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:35 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/154855881' entity='client.admin' 2024-08-28T19:23:36.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.292+0000 7f242e34d640 1 -- 172.21.15.33:0/2268260466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2428108a90 msgr2=0x7f242810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:36.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.292+0000 7f242e34d640 1 --2- 172.21.15.33:0/2268260466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2428108a90 0x7f242810f2c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2420009ca0 tx=0x7f242002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.292+0000 7f242e34d640 1 -- 172.21.15.33:0/2268260466 shutdown_connections 2024-08-28T19:23:36.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.292+0000 7f242e34d640 1 --2- 172.21.15.33:0/2268260466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2428108a90 0x7f242810f2c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.292+0000 7f242e34d640 1 --2- 172.21.15.33:0/2268260466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2428108140 0x7f2428108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.292+0000 7f242e34d640 1 --2- 172.21.15.33:0/2268260466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2428102800 0x7f2428102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.292+0000 7f242e34d640 1 -- 172.21.15.33:0/2268260466 >> 172.21.15.33:0/2268260466 conn(0x7f24280794d0 msgr2=0x7f24280798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:36.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.292+0000 7f242e34d640 1 -- 172.21.15.33:0/2268260466 shutdown_connections 2024-08-28T19:23:36.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.292+0000 7f242e34d640 1 -- 172.21.15.33:0/2268260466 wait complete. 2024-08-28T19:23:36.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.293+0000 7f242e34d640 1 Processor -- start 2024-08-28T19:23:36.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.293+0000 7f242e34d640 1 -- start start 2024-08-28T19:23:36.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f242e34d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2428102800 0x7f24280ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:36.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f242e34d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2428108140 0x7f24280ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:36.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f242e34d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2428108a90 0x7f24280ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:36.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f242e34d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f24281125b0 con 0x7f2428108140 2024-08-28T19:23:36.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f242e34d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2428112430 con 0x7f2428108a90 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f242e34d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2428112730 con 0x7f2428102800 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f24277fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2428108140 0x7f24280ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f2427fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2428102800 0x7f24280ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f24277fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2428108140 0x7f24280ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46656/0 (socket says 172.21.15.33:46656) 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f2427fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2428102800 0x7f24280ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:48220/0 (socket says 172.21.15.33:48220) 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f24277fe640 1 -- 172.21.15.33:0/3700061861 learned_addr learned my addr 172.21.15.33:0/3700061861 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f242c8ea640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2428108a90 0x7f24280ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f2427fff640 1 -- 172.21.15.33:0/3700061861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2428108a90 msgr2=0x7f24280ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f2427fff640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2428108a90 0x7f24280ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f2427fff640 1 -- 172.21.15.33:0/3700061861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2428108140 msgr2=0x7f24280ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f2427fff640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2428108140 0x7f24280ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f2427fff640 1 -- 172.21.15.33:0/3700061861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24281a8430 con 0x7f2428102800 2024-08-28T19:23:36.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.294+0000 7f2427fff640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2428102800 0x7f24280ff410 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f241800e9f0 tx=0x7f241800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:36.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.295+0000 7f24257fa640 1 -- 172.21.15.33:0/3700061861 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241800ccc0 con 0x7f2428102800 2024-08-28T19:23:36.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.295+0000 7f24257fa640 1 -- 172.21.15.33:0/3700061861 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f24180108c0 con 0x7f2428102800 2024-08-28T19:23:36.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.295+0000 7f242e34d640 1 -- 172.21.15.33:0/3700061861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24281a8720 con 0x7f2428102800 2024-08-28T19:23:36.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.295+0000 7f24257fa640 1 -- 172.21.15.33:0/3700061861 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24180187c0 con 0x7f2428102800 2024-08-28T19:23:36.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.295+0000 7f242e34d640 1 -- 172.21.15.33:0/3700061861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24281a8c60 con 0x7f2428102800 2024-08-28T19:23:36.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.296+0000 7f24257fa640 1 -- 172.21.15.33:0/3700061861 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f2418018960 con 0x7f2428102800 2024-08-28T19:23:36.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.296+0000 7f242e34d640 1 -- 172.21.15.33:0/3700061861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2428102c10 con 0x7f2428102800 2024-08-28T19:23:36.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.296+0000 7f24257fa640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f241003f2d0 0x7f24100417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:36.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.296+0000 7f24257fa640 1 -- 172.21.15.33:0/3700061861 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2418053f70 con 0x7f2428102800 2024-08-28T19:23:36.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.296+0000 7f24277fe640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f241003f2d0 0x7f24100417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:36.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.297+0000 7f24277fe640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f241003f2d0 0x7f24100417e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f242806a000 tx=0x7f241c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:36.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.301+0000 7f24257fa640 1 -- 172.21.15.33:0/3700061861 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2418020360 con 0x7f2428102800 2024-08-28T19:23:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.490+0000 7f242e34d640 1 -- 172.21.15.33:0/3700061861 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f242802e430 con 0x7f2428102800 2024-08-28T19:23:36.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.497+0000 7f24257fa640 1 -- 172.21.15.33:0/3700061861 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v16)=0 v16) ==== 115+0+0 (secure 0 0 0) 0x7f2418017e20 con 0x7f2428102800 2024-08-28T19:23:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 -- 172.21.15.33:0/3700061861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f241003f2d0 msgr2=0x7f24100417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f241003f2d0 0x7f24100417e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f242806a000 tx=0x7f241c005f90 comp rx=0 tx=0).stop 2024-08-28T19:23:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 -- 172.21.15.33:0/3700061861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2428102800 msgr2=0x7f24280ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2428102800 0x7f24280ff410 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f241800e9f0 tx=0x7f241800eeb0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 -- 172.21.15.33:0/3700061861 shutdown_connections 2024-08-28T19:23:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2428108a90 0x7f24280ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2428108140 0x7f24280ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f241003f2d0 0x7f24100417e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 --2- 172.21.15.33:0/3700061861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2428102800 0x7f24280ff410 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 -- 172.21.15.33:0/3700061861 >> 172.21.15.33:0/3700061861 conn(0x7f24280794d0 msgr2=0x7f242806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:36.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 -- 172.21.15.33:0/3700061861 shutdown_connections 2024-08-28T19:23:36.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.500+0000 7f242e34d640 1 -- 172.21.15.33:0/3700061861 wait complete. 2024-08-28T19:23:36.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.516+0000 7facf3140640 1 -- 172.21.15.33:0/2148580344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec108160 msgr2=0x7facec108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:36.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.516+0000 7facf3140640 1 --2- 172.21.15.33:0/2148580344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec108160 0x7facec108570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7facd8009900 tx=0x7facd802a410 comp rx=0 tx=0).stop 2024-08-28T19:23:36.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.516+0000 7facf3140640 1 -- 172.21.15.33:0/2148580344 shutdown_connections 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.516+0000 7facf3140640 1 --2- 172.21.15.33:0/2148580344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facec108ab0 0x7facec10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.516+0000 7facf3140640 1 --2- 172.21.15.33:0/2148580344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec108160 0x7facec108570 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.516+0000 7facf3140640 1 --2- 172.21.15.33:0/2148580344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec102820 0x7facec102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.516+0000 7facf3140640 1 -- 172.21.15.33:0/2148580344 >> 172.21.15.33:0/2148580344 conn(0x7facec0794e0 msgr2=0x7facec0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.516+0000 7facf3140640 1 -- 172.21.15.33:0/2148580344 shutdown_connections 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.516+0000 7facf3140640 1 -- 172.21.15.33:0/2148580344 wait complete. 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.516+0000 7facf3140640 1 Processor -- start 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf3140640 1 -- start start 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf3140640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec102820 0x7facec19af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf3140640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facec108160 0x7facec19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf3140640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec108ab0 0x7facec19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf3140640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7facec1125a0 con 0x7facec102820 2024-08-28T19:23:36.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf3140640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7facec112420 con 0x7facec108ab0 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf3140640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7facec112720 con 0x7facec108160 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf0edc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec102820 0x7facec19af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf0edc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec102820 0x7facec19af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46662/0 (socket says 172.21.15.33:46662) 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facebfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facec108160 0x7facec19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf0edc640 1 -- 172.21.15.33:0/1719700764 learned_addr learned my addr 172.21.15.33:0/1719700764 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf16dd640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec108ab0 0x7facec19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facebfff640 1 -- 172.21.15.33:0/1719700764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec108ab0 msgr2=0x7facec19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facebfff640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec108ab0 0x7facec19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facebfff640 1 -- 172.21.15.33:0/1719700764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec102820 msgr2=0x7facec19af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facebfff640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec102820 0x7facec19af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facebfff640 1 -- 172.21.15.33:0/1719700764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec1a61f0 con 0x7facec108160 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.517+0000 7facf0edc640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec102820 0x7facec19af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:23:36.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.518+0000 7facebfff640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facec108160 0x7facec19b470 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7facd8006010 tx=0x7facd8005e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.518+0000 7face9ffb640 1 -- 172.21.15.33:0/1719700764 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd803f030 con 0x7facec108160 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.518+0000 7face9ffb640 1 -- 172.21.15.33:0/1719700764 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7facd80043d0 con 0x7facec108160 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.518+0000 7face9ffb640 1 -- 172.21.15.33:0/1719700764 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8035070 con 0x7facec108160 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.518+0000 7facf3140640 1 -- 172.21.15.33:0/1719700764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec1a6480 con 0x7facec108160 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.518+0000 7facf3140640 1 -- 172.21.15.33:0/1719700764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec1a68c0 con 0x7facec108160 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.519+0000 7face9ffb640 1 -- 172.21.15.33:0/1719700764 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7facd8042030 con 0x7facec108160 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.519+0000 7face9ffb640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facdc03f2d0 0x7facdc0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.519+0000 7face9ffb640 1 -- 172.21.15.33:0/1719700764 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7facd8003c30 con 0x7facec108160 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.520+0000 7facf0edc640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facdc03f2d0 0x7facdc0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.520+0000 7facf3140640 1 -- 172.21.15.33:0/1719700764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec103aa0 con 0x7facec108160 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.520+0000 7facf0edc640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facdc03f2d0 0x7facdc0417e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7facec06c140 tx=0x7face0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:36.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.525+0000 7face9ffb640 1 -- 172.21.15.33:0/1719700764 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7facd8041d80 con 0x7facec108160 2024-08-28T19:23:36.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.714+0000 7facf3140640 1 -- 172.21.15.33:0/1719700764 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7facec06b9f0 con 0x7facec108160 2024-08-28T19:23:36.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.721+0000 7face9ffb640 1 -- 172.21.15.33:0/1719700764 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v17)=0 v17) ==== 133+0+0 (secure 0 0 0) 0x7facd803acc0 con 0x7facec108160 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.724+0000 7facf3140640 1 -- 172.21.15.33:0/1719700764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facdc03f2d0 msgr2=0x7facdc0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.724+0000 7facf3140640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facdc03f2d0 0x7facdc0417e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7facec06c140 tx=0x7face0005f90 comp rx=0 tx=0).stop 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.724+0000 7facf3140640 1 -- 172.21.15.33:0/1719700764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facec108160 msgr2=0x7facec19b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.724+0000 7facf3140640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facec108160 0x7facec19b470 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7facd8006010 tx=0x7facd8005e30 comp rx=0 tx=0).stop 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.724+0000 7facf3140640 1 -- 172.21.15.33:0/1719700764 shutdown_connections 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.724+0000 7facf3140640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec108ab0 0x7facec19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.724+0000 7facf3140640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facdc03f2d0 0x7facdc0417e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.724+0000 7facf3140640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facec108160 0x7facec19b470 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.724+0000 7facf3140640 1 --2- 172.21.15.33:0/1719700764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facec102820 0x7facec19af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.724+0000 7facf3140640 1 -- 172.21.15.33:0/1719700764 >> 172.21.15.33:0/1719700764 conn(0x7facec0794e0 msgr2=0x7facec104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.725+0000 7facf3140640 1 -- 172.21.15.33:0/1719700764 shutdown_connections 2024-08-28T19:23:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:36.725+0000 7facf3140640 1 -- 172.21.15.33:0/1719700764 wait complete. 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: Reconfiguring mgr.x (unknown last config time)... 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T19:23:37.034 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:37.035 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: Reconfiguring daemon mgr.x on smithi033 2024-08-28T19:23:37.035 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='client.? ' entity='client.admin' 2024-08-28T19:23:37.035 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:36 smithi033 ceph-mon[18549]: from='client.? ' entity='client.admin' 2024-08-28T19:23:37.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.251+0000 7f847614c640 1 -- 172.21.15.33:0/2612906014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8470109260 msgr2=0x7f8470109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.251+0000 7f847614c640 1 --2- 172.21.15.33:0/2612906014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8470109260 0x7f8470109670 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8464009900 tx=0x7f846402a410 comp rx=0 tx=0).stop 2024-08-28T19:23:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.251+0000 7f847614c640 1 -- 172.21.15.33:0/2612906014 shutdown_connections 2024-08-28T19:23:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.251+0000 7f847614c640 1 --2- 172.21.15.33:0/2612906014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8470109bb0 0x7f84701103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.251+0000 7f847614c640 1 --2- 172.21.15.33:0/2612906014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8470109260 0x7f8470109670 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.251+0000 7f847614c640 1 --2- 172.21.15.33:0/2612906014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470103920 0x7f8470103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.251+0000 7f847614c640 1 -- 172.21.15.33:0/2612906014 >> 172.21.15.33:0/2612906014 conn(0x7f84700ff3b0 msgr2=0x7f8470101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.251+0000 7f847614c640 1 -- 172.21.15.33:0/2612906014 shutdown_connections 2024-08-28T19:23:37.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.251+0000 7f847614c640 1 -- 172.21.15.33:0/2612906014 wait complete. 2024-08-28T19:23:37.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.252+0000 7f847614c640 1 Processor -- start 2024-08-28T19:23:37.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.252+0000 7f847614c640 1 -- start start 2024-08-28T19:23:37.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.252+0000 7f847614c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8470103920 0x7f847019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:37.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.252+0000 7f847614c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8470109260 0x7f847019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:37.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.252+0000 7f847614c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470109bb0 0x7f847019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:37.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.252+0000 7f847614c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f84701137a0 con 0x7f8470109260 2024-08-28T19:23:37.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.252+0000 7f847614c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8470113620 con 0x7f8470109bb0 2024-08-28T19:23:37.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.252+0000 7f847614c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8470113920 con 0x7f8470103920 2024-08-28T19:23:37.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8470109260 0x7f847019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8470103920 0x7f847019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8470109260 0x7f847019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46696/0 (socket says 172.21.15.33:46696) 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846effd640 1 -- 172.21.15.33:0/2137466689 learned_addr learned my addr 172.21.15.33:0/2137466689 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470109bb0 0x7f847019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8470103920 0x7f847019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:48264/0 (socket says 172.21.15.33:48264) 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846f7fe640 1 -- 172.21.15.33:0/2137466689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470109bb0 msgr2=0x7f847019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846f7fe640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470109bb0 0x7f847019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846f7fe640 1 -- 172.21.15.33:0/2137466689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8470109260 msgr2=0x7f847019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846f7fe640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8470109260 0x7f847019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846f7fe640 1 -- 172.21.15.33:0/2137466689 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84701a0100 con 0x7f8470103920 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846effd640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8470109260 0x7f847019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846f7fe640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8470103920 0x7f847019a190 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8460005fd0 tx=0x7f846000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:37.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.253+0000 7f846cff9640 1 -- 172.21.15.33:0/2137466689 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460009c30 con 0x7f8470103920 2024-08-28T19:23:37.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.254+0000 7f846cff9640 1 -- 172.21.15.33:0/2137466689 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f84600044c0 con 0x7f8470103920 2024-08-28T19:23:37.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.254+0000 7f847614c640 1 -- 172.21.15.33:0/2137466689 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84701a03f0 con 0x7f8470103920 2024-08-28T19:23:37.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.254+0000 7f846cff9640 1 -- 172.21.15.33:0/2137466689 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460003d80 con 0x7f8470103920 2024-08-28T19:23:37.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.254+0000 7f847614c640 1 -- 172.21.15.33:0/2137466689 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84701a6b50 con 0x7f8470103920 2024-08-28T19:23:37.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.255+0000 7f846cff9640 1 -- 172.21.15.33:0/2137466689 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f8460010460 con 0x7f8470103920 2024-08-28T19:23:37.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.255+0000 7f847614c640 1 -- 172.21.15.33:0/2137466689 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8470104ba0 con 0x7f8470103920 2024-08-28T19:23:37.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.255+0000 7f846cff9640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f845803f2d0 0x7f84580417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:37.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.255+0000 7f846cff9640 1 -- 172.21.15.33:0/2137466689 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8460053730 con 0x7f8470103920 2024-08-28T19:23:37.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.255+0000 7f846effd640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f845803f2d0 0x7f84580417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:37.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.255+0000 7f846effd640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f845803f2d0 0x7f84580417e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8464005790 tx=0x7f8464005e60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:37.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.260+0000 7f846cff9640 1 -- 172.21.15.33:0/2137466689 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8460017020 con 0x7f8470103920 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: Reconfiguring mgr.x (unknown last config time)... 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T19:23:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T19:23:37.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:37.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: Reconfiguring daemon mgr.x on smithi033 2024-08-28T19:23:37.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='client.? ' entity='client.admin' 2024-08-28T19:23:37.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:36 smithi059 ceph-mon[22052]: from='client.? ' entity='client.admin' 2024-08-28T19:23:37.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:37.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:37.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:37.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: Reconfiguring mgr.x (unknown last config time)... 2024-08-28T19:23:37.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-28T19:23:37.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-28T19:23:37.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:37.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: Reconfiguring daemon mgr.x on smithi033 2024-08-28T19:23:37.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='client.? ' entity='client.admin' 2024-08-28T19:23:37.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:36 smithi122 ceph-mon[22174]: from='client.? ' entity='client.admin' 2024-08-28T19:23:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.405+0000 7ff68344e640 1 -- 172.21.15.33:0/3515143359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c1050f0 msgr2=0x7ff67c10d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.405+0000 7ff68344e640 1 --2- 172.21.15.33:0/3515143359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c1050f0 0x7ff67c10d730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009900 tx=0x7ff66c02a410 comp rx=0 tx=0).stop 2024-08-28T19:23:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.405+0000 7ff68344e640 1 -- 172.21.15.33:0/3515143359 shutdown_connections 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.405+0000 7ff68344e640 1 --2- 172.21.15.33:0/3515143359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c10dc70 0x7ff67c110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.405+0000 7ff68344e640 1 --2- 172.21.15.33:0/3515143359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c1050f0 0x7ff67c10d730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.405+0000 7ff68344e640 1 --2- 172.21.15.33:0/3515143359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c1046c0 0x7ff67c104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.405+0000 7ff68344e640 1 -- 172.21.15.33:0/3515143359 >> 172.21.15.33:0/3515143359 conn(0x7ff67c0794d0 msgr2=0x7ff67c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.405+0000 7ff68344e640 1 -- 172.21.15.33:0/3515143359 shutdown_connections 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.405+0000 7ff68344e640 1 -- 172.21.15.33:0/3515143359 wait complete. 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.406+0000 7ff68344e640 1 Processor -- start 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.406+0000 7ff68344e640 1 -- start start 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.406+0000 7ff68344e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1046c0 0x7ff67c19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.406+0000 7ff68344e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c1050f0 0x7ff67c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.406+0000 7ff68344e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c10dc70 0x7ff67c19f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.406+0000 7ff68344e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c113780 con 0x7ff67c10dc70 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.406+0000 7ff68344e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c113600 con 0x7ff67c1050f0 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.406+0000 7ff68344e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c113900 con 0x7ff67c1046c0 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.406+0000 7ff6819eb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c10dc70 0x7ff67c19f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6819eb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c10dc70 0x7ff67c19f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46640/0 (socket says 172.21.15.33:46640) 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6819eb640 1 -- 172.21.15.33:0/154855881 learned_addr learned my addr 172.21.15.33:0/154855881 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6811ea640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1046c0 0x7ff67c19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6809e9640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c1050f0 0x7ff67c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6819eb640 1 -- 172.21.15.33:0/154855881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1046c0 msgr2=0x7ff67c19a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6819eb640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1046c0 0x7ff67c19a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6819eb640 1 -- 172.21.15.33:0/154855881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c1050f0 msgr2=0x7ff67c19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6819eb640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c1050f0 0x7ff67c19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6819eb640 1 -- 172.21.15.33:0/154855881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c1a0120 con 0x7ff67c10dc70 2024-08-28T19:23:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6819eb640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c10dc70 0x7ff67c19f9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff67400eb10 tx=0x7ff67400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6727fc640 1 -- 172.21.15.33:0/154855881 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674004b20 con 0x7ff67c10dc70 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6727fc640 1 -- 172.21.15.33:0/154855881 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff674004cc0 con 0x7ff67c10dc70 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff68344e640 1 -- 172.21.15.33:0/154855881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c1a0410 con 0x7ff67c10dc70 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff6727fc640 1 -- 172.21.15.33:0/154855881 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674010690 con 0x7ff67c10dc70 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.407+0000 7ff68344e640 1 -- 172.21.15.33:0/154855881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c1a6b70 con 0x7ff67c10dc70 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.408+0000 7ff6727fc640 1 -- 172.21.15.33:0/154855881 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7ff674010830 con 0x7ff67c10dc70 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.408+0000 7ff68344e640 1 -- 172.21.15.33:0/154855881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67c06bf80 con 0x7ff67c10dc70 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.409+0000 7ff6727fc640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff66803f2d0 0x7ff6680417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.409+0000 7ff6727fc640 1 -- 172.21.15.33:0/154855881 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff674053fc0 con 0x7ff67c10dc70 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.409+0000 7ff6811ea640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff66803f2d0 0x7ff6680417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.409+0000 7ff6811ea640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff66803f2d0 0x7ff6680417e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff67c06c680 tx=0x7ff67800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.413+0000 7ff6727fc640 1 -- 172.21.15.33:0/154855881 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff674016330 con 0x7ff67c10dc70 2024-08-28T19:23:37.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.599+0000 7ff68344e640 1 -- 172.21.15.33:0/154855881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7ff67c1a6e70 con 0x7ff67c10dc70 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.602+0000 7ff6727fc640 1 -- 172.21.15.33:0/154855881 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v15)=0 v15) ==== 106+0+0 (secure 0 0 0) 0x7ff674007d10 con 0x7ff67c10dc70 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 -- 172.21.15.33:0/154855881 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff66803f2d0 msgr2=0x7ff6680417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff66803f2d0 0x7ff6680417e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff67c06c680 tx=0x7ff67800b390 comp rx=0 tx=0).stop 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 -- 172.21.15.33:0/154855881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c10dc70 msgr2=0x7ff67c19f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c10dc70 0x7ff67c19f9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff67400eb10 tx=0x7ff67400c2d0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 -- 172.21.15.33:0/154855881 shutdown_connections 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c10dc70 0x7ff67c19f9f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c1050f0 0x7ff67c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff66803f2d0 0x7ff6680417e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 --2- 172.21.15.33:0/154855881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1046c0 0x7ff67c19a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 -- 172.21.15.33:0/154855881 >> 172.21.15.33:0/154855881 conn(0x7ff67c0794d0 msgr2=0x7ff67c107810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 -- 172.21.15.33:0/154855881 shutdown_connections 2024-08-28T19:23:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:35.605+0000 7ff68344e640 1 -- 172.21.15.33:0/154855881 wait complete. 2024-08-28T19:23:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.450+0000 7f847614c640 1 -- 172.21.15.33:0/2137466689 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f847002e430 con 0x7f8470103920 2024-08-28T19:23:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.457+0000 7f846cff9640 1 -- 172.21.15.33:0/2137466689 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f84600035f0 con 0x7f8470103920 2024-08-28T19:23:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 -- 172.21.15.33:0/2137466689 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f845803f2d0 msgr2=0x7f84580417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f845803f2d0 0x7f84580417e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8464005790 tx=0x7f8464005e60 comp rx=0 tx=0).stop 2024-08-28T19:23:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 -- 172.21.15.33:0/2137466689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8470103920 msgr2=0x7f847019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8470103920 0x7f847019a190 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8460005fd0 tx=0x7f846000dde0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 -- 172.21.15.33:0/2137466689 shutdown_connections 2024-08-28T19:23:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8470109bb0 0x7f847019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8470109260 0x7f847019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f845803f2d0 0x7f84580417e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 --2- 172.21.15.33:0/2137466689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8470103920 0x7f847019a190 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 -- 172.21.15.33:0/2137466689 >> 172.21.15.33:0/2137466689 conn(0x7f84700ff3b0 msgr2=0x7f84701017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 -- 172.21.15.33:0/2137466689 shutdown_connections 2024-08-28T19:23:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.460+0000 7f847614c640 1 -- 172.21.15.33:0/2137466689 wait complete. 2024-08-28T19:23:38.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:38 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2410110033' entity='client.admin' 2024-08-28T19:23:38.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:38 smithi033 ceph-mon[18549]: from='client.? ' entity='client.admin' 2024-08-28T19:23:38.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:38 smithi033 ceph-mon[18549]: Standby manager daemon z started 2024-08-28T19:23:38.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:38 smithi033 ceph-mon[18549]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-28T19:23:38.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:38 smithi033 ceph-mon[18549]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T19:23:38.515 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:38 smithi033 ceph-mon[18549]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-28T19:23:38.515 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:38 smithi033 ceph-mon[18549]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T19:23:38.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:38 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2410110033' entity='client.admin' 2024-08-28T19:23:38.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:38 smithi059 ceph-mon[22052]: from='client.? ' entity='client.admin' 2024-08-28T19:23:38.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:38 smithi059 ceph-mon[22052]: Standby manager daemon z started 2024-08-28T19:23:38.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:38 smithi059 ceph-mon[22052]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-28T19:23:38.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:38 smithi059 ceph-mon[22052]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T19:23:38.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:38 smithi059 ceph-mon[22052]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-28T19:23:38.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:38 smithi059 ceph-mon[22052]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T19:23:38.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:38 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2410110033' entity='client.admin' 2024-08-28T19:23:38.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:38 smithi122 ceph-mon[22174]: from='client.? ' entity='client.admin' 2024-08-28T19:23:38.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:38 smithi122 ceph-mon[22174]: Standby manager daemon z started 2024-08-28T19:23:38.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:38 smithi122 ceph-mon[22174]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-28T19:23:38.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:38 smithi122 ceph-mon[22174]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T19:23:38.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:38 smithi122 ceph-mon[22174]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-28T19:23:38.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:38 smithi122 ceph-mon[22174]: from='mgr.? 172.21.15.122:0/3926124789' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T19:23:38.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.126+0000 7f24a8f87640 1 -- 172.21.15.33:0/564712756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24a41092a0 msgr2=0x7f24a41096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:38.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.126+0000 7f24a8f87640 1 --2- 172.21.15.33:0/564712756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24a41092a0 0x7f24a41096b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2498009900 tx=0x7f249802a410 comp rx=0 tx=0).stop 2024-08-28T19:23:38.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.126+0000 7f24a8f87640 1 -- 172.21.15.33:0/564712756 shutdown_connections 2024-08-28T19:23:38.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.126+0000 7f24a8f87640 1 --2- 172.21.15.33:0/564712756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4109bf0 0x7f24a4110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:38.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.126+0000 7f24a8f87640 1 --2- 172.21.15.33:0/564712756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24a41092a0 0x7f24a41096b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.126+0000 7f24a8f87640 1 --2- 172.21.15.33:0/564712756 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4101d60 0x7f24a4102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.126+0000 7f24a8f87640 1 -- 172.21.15.33:0/564712756 >> 172.21.15.33:0/564712756 conn(0x7f24a4079d30 msgr2=0x7f24a407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.126+0000 7f24a8f87640 1 -- 172.21.15.33:0/564712756 shutdown_connections 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.126+0000 7f24a8f87640 1 -- 172.21.15.33:0/564712756 wait complete. 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.127+0000 7f24a8f87640 1 Processor -- start 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.127+0000 7f24a8f87640 1 -- start start 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a8f87640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4101d60 0x7f24a419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a8f87640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24a41092a0 0x7f24a419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a8f87640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4109bf0 0x7f24a419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a8f87640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4113790 con 0x7f24a41092a0 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a8f87640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4113610 con 0x7f24a4101d60 2024-08-28T19:23:38.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a8f87640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4113910 con 0x7f24a4109bf0 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a1d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24a41092a0 0x7f24a419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a1d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24a41092a0 0x7f24a419a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46680/0 (socket says 172.21.15.33:46680) 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a1d9b640 1 -- 172.21.15.33:0/2410110033 learned_addr learned my addr 172.21.15.33:0/2410110033 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a259c640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4101d60 0x7f24a419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a2d9d640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4109bf0 0x7f24a419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a1d9b640 1 -- 172.21.15.33:0/2410110033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4109bf0 msgr2=0x7f24a419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a1d9b640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4109bf0 0x7f24a419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a1d9b640 1 -- 172.21.15.33:0/2410110033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4101d60 msgr2=0x7f24a419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a1d9b640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4101d60 0x7f24a419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a1d9b640 1 -- 172.21.15.33:0/2410110033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a41a0150 con 0x7f24a41092a0 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a1d9b640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24a41092a0 0x7f24a419a780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2498005940 tx=0x7f24980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:38.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24937fe640 1 -- 172.21.15.33:0/2410110033 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249803f030 con 0x7f24a41092a0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24937fe640 1 -- 172.21.15.33:0/2410110033 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f24980044c0 con 0x7f24a41092a0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24a8f87640 1 -- 172.21.15.33:0/2410110033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a41a03e0 con 0x7f24a41092a0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.128+0000 7f24937fe640 1 -- 172.21.15.33:0/2410110033 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498035070 con 0x7f24a41092a0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.129+0000 7f24a8f87640 1 -- 172.21.15.33:0/2410110033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a41a6ba0 con 0x7f24a41092a0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.129+0000 7f24937fe640 1 -- 172.21.15.33:0/2410110033 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f2498042030 con 0x7f24a41092a0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.130+0000 7f24a8f87640 1 -- 172.21.15.33:0/2410110033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a4102170 con 0x7f24a41092a0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.130+0000 7f24937fe640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f248c03f2d0 0x7f248c0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.130+0000 7f24937fe640 1 -- 172.21.15.33:0/2410110033 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2498073eb0 con 0x7f24a41092a0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.130+0000 7f24a259c640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f248c03f2d0 0x7f248c0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.130+0000 7f24a259c640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f248c03f2d0 0x7f248c0417e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2494009bd0 tx=0x7f2494005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.135+0000 7f24937fe640 1 -- 172.21.15.33:0/2410110033 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f24980303a0 con 0x7f24a41092a0 2024-08-28T19:23:38.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.324+0000 7f24a8f87640 1 -- 172.21.15.33:0/2410110033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f24a410ba10 con 0x7f24a41092a0 2024-08-28T19:23:38.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.329+0000 7f24937fe640 1 -- 172.21.15.33:0/2410110033 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v18)=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f249802f300 con 0x7f24a41092a0 2024-08-28T19:23:38.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 -- 172.21.15.33:0/2410110033 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f248c03f2d0 msgr2=0x7f248c0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:38.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f248c03f2d0 0x7f248c0417e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2494009bd0 tx=0x7f2494005f90 comp rx=0 tx=0).stop 2024-08-28T19:23:38.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 -- 172.21.15.33:0/2410110033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24a41092a0 msgr2=0x7f24a419a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:38.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24a41092a0 0x7f24a419a780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2498005940 tx=0x7f24980040c0 comp rx=0 tx=0).stop 2024-08-28T19:23:38.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 -- 172.21.15.33:0/2410110033 shutdown_connections 2024-08-28T19:23:38.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f248c03f2d0 0x7f248c0417e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:38.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24a4109bf0 0x7f24a419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:38.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24a41092a0 0x7f24a419a780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:38.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 --2- 172.21.15.33:0/2410110033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a4101d60 0x7f24a419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:38.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 -- 172.21.15.33:0/2410110033 >> 172.21.15.33:0/2410110033 conn(0x7f24a4079d30 msgr2=0x7f24a4105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:38.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 -- 172.21.15.33:0/2410110033 shutdown_connections 2024-08-28T19:23:38.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:37.332+0000 7f24a8f87640 1 -- 172.21.15.33:0/2410110033 wait complete. 2024-08-28T19:23:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:39 smithi059 ceph-mon[22052]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-28T19:23:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-28T19:23:39.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:39 smithi033 ceph-mon[18549]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-28T19:23:39.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-28T19:23:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:39 smithi122 ceph-mon[22174]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-28T19:23:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-28T19:23:40.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.234+0000 7fe17b746640 1 -- 172.21.15.33:0/665777538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe174104660 msgr2=0x7fe174104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:40.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.234+0000 7fe17b746640 1 --2- 172.21.15.33:0/665777538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe174104660 0x7fe174104a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe170009900 tx=0x7fe17002a3f0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.234+0000 7fe17b746640 1 -- 172.21.15.33:0/665777538 shutdown_connections 2024-08-28T19:23:40.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.234+0000 7fe17b746640 1 --2- 172.21.15.33:0/665777538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe17410dc10 0x7fe1741100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.234+0000 7fe17b746640 1 --2- 172.21.15.33:0/665777538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe174105040 0x7fe17410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.234+0000 7fe17b746640 1 --2- 172.21.15.33:0/665777538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe174104660 0x7fe174104a70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.234+0000 7fe17b746640 1 -- 172.21.15.33:0/665777538 >> 172.21.15.33:0/665777538 conn(0x7fe174079500 msgr2=0x7fe174079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:40.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.234+0000 7fe17b746640 1 -- 172.21.15.33:0/665777538 shutdown_connections 2024-08-28T19:23:40.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.234+0000 7fe17b746640 1 -- 172.21.15.33:0/665777538 wait complete. 2024-08-28T19:23:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.235+0000 7fe17b746640 1 Processor -- start 2024-08-28T19:23:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.235+0000 7fe17b746640 1 -- start start 2024-08-28T19:23:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.235+0000 7fe17b746640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe174104660 0x7fe17419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.235+0000 7fe17b746640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe174105040 0x7fe17419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.235+0000 7fe17b746640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe17410dc10 0x7fe17419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.235+0000 7fe17b746640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe174113730 con 0x7fe17410dc10 2024-08-28T19:23:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.235+0000 7fe17b746640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe1741135b0 con 0x7fe174104660 2024-08-28T19:23:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.235+0000 7fe17b746640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe1741138b0 con 0x7fe174105040 2024-08-28T19:23:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe179ce3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe17410dc10 0x7fe17419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe1794e2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe174104660 0x7fe17419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe1794e2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe174104660 0x7fe17419a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:57350/0 (socket says 172.21.15.33:57350) 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe1794e2640 1 -- 172.21.15.33:0/2861907150 learned_addr learned my addr 172.21.15.33:0/2861907150 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe179ce3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe17410dc10 0x7fe17419fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55696/0 (socket says 172.21.15.33:55696) 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe178ce1640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe174105040 0x7fe17419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe1794e2640 1 -- 172.21.15.33:0/2861907150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe174105040 msgr2=0x7fe17419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe1794e2640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe174105040 0x7fe17419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe1794e2640 1 -- 172.21.15.33:0/2861907150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe17410dc10 msgr2=0x7fe17419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe1794e2640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe17410dc10 0x7fe17419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe1794e2640 1 -- 172.21.15.33:0/2861907150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1741a00d0 con 0x7fe174104660 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe178ce1640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe174105040 0x7fe17419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe179ce3640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe17410dc10 0x7fe17419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe1794e2640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe174104660 0x7fe17419a220 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe170005940 tx=0x7fe1700040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.236+0000 7fe16a7fc640 1 -- 172.21.15.33:0/2861907150 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17003f030 con 0x7fe174104660 2024-08-28T19:23:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.237+0000 7fe17b746640 1 -- 172.21.15.33:0/2861907150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1741a0360 con 0x7fe174104660 2024-08-28T19:23:40.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.237+0000 7fe16a7fc640 1 -- 172.21.15.33:0/2861907150 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe1700044c0 con 0x7fe174104660 2024-08-28T19:23:40.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.237+0000 7fe16a7fc640 1 -- 172.21.15.33:0/2861907150 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170035070 con 0x7fe174104660 2024-08-28T19:23:40.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.237+0000 7fe17b746640 1 -- 172.21.15.33:0/2861907150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1741a0890 con 0x7fe174104660 2024-08-28T19:23:40.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.238+0000 7fe17b746640 1 -- 172.21.15.33:0/2861907150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe174104a70 con 0x7fe174104660 2024-08-28T19:23:40.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.238+0000 7fe16a7fc640 1 -- 172.21.15.33:0/2861907150 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 101904+0+0 (secure 0 0 0) 0x7fe170042030 con 0x7fe174104660 2024-08-28T19:23:40.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.239+0000 7fe16a7fc640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe160079f10 0x7fe16007c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:40.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.239+0000 7fe16a7fc640 1 -- 172.21.15.33:0/2861907150 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe1700bbc10 con 0x7fe174104660 2024-08-28T19:23:40.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.239+0000 7fe178ce1640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe160079f10 0x7fe16007c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:40.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.239+0000 7fe178ce1640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe160079f10 0x7fe16007c420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe17410f770 tx=0x7fe164005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:40.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.244+0000 7fe16a7fc640 1 -- 172.21.15.33:0/2861907150 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe1741a0890 con 0x7fe174104660 2024-08-28T19:23:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.429+0000 7fe17b746640 1 -- 172.21.15.33:0/2861907150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fe174108d90 con 0x7fe174104660 2024-08-28T19:23:40.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.435+0000 7fe16a7fc640 1 -- 172.21.15.33:0/2861907150 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v20)=0 v20) ==== 116+0+0 (secure 0 0 0) 0x7fe17008be20 con 0x7fe174104660 2024-08-28T19:23:40.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 -- 172.21.15.33:0/2861907150 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe160079f10 msgr2=0x7fe16007c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:40.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe160079f10 0x7fe16007c420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe17410f770 tx=0x7fe164005f90 comp rx=0 tx=0).stop 2024-08-28T19:23:40.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 -- 172.21.15.33:0/2861907150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe174104660 msgr2=0x7fe17419a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:40.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe174104660 0x7fe17419a220 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe170005940 tx=0x7fe1700040c0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 -- 172.21.15.33:0/2861907150 shutdown_connections 2024-08-28T19:23:40.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe17410dc10 0x7fe17419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe160079f10 0x7fe16007c420 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe174105040 0x7fe17419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 --2- 172.21.15.33:0/2861907150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe174104660 0x7fe17419a220 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 -- 172.21.15.33:0/2861907150 >> 172.21.15.33:0/2861907150 conn(0x7fe174079500 msgr2=0x7fe1740ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:40.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 -- 172.21.15.33:0/2861907150 shutdown_connections 2024-08-28T19:23:40.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.437+0000 7fe17b746640 1 -- 172.21.15.33:0/2861907150 wait complete. 2024-08-28T19:23:40.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.678+0000 7f8ee35ee640 1 -- 172.21.15.33:0/632985341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8edc109b90 msgr2=0x7f8edc1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:40.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.678+0000 7f8ee35ee640 1 --2- 172.21.15.33:0/632985341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8edc109b90 0x7f8edc1103c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009ca0 tx=0x7f8ed402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.678+0000 7f8ee35ee640 1 -- 172.21.15.33:0/632985341 shutdown_connections 2024-08-28T19:23:40.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.678+0000 7f8ee35ee640 1 --2- 172.21.15.33:0/632985341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8edc109b90 0x7f8edc1103c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.678+0000 7f8ee35ee640 1 --2- 172.21.15.33:0/632985341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc109240 0x7f8edc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.678+0000 7f8ee35ee640 1 --2- 172.21.15.33:0/632985341 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc103900 0x7f8edc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.678+0000 7f8ee35ee640 1 -- 172.21.15.33:0/632985341 >> 172.21.15.33:0/632985341 conn(0x7f8edc07b5f0 msgr2=0x7f8edc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:40.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.678+0000 7f8ee35ee640 1 -- 172.21.15.33:0/632985341 shutdown_connections 2024-08-28T19:23:40.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.678+0000 7f8ee35ee640 1 -- 172.21.15.33:0/632985341 wait complete. 2024-08-28T19:23:40.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee35ee640 1 Processor -- start 2024-08-28T19:23:40.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee35ee640 1 -- start start 2024-08-28T19:23:40.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee35ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc103900 0x7f8edc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:40.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee35ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc109240 0x7f8edc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:40.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee35ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8edc109b90 0x7f8edc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:40.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee35ee640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc113730 con 0x7f8edc109b90 2024-08-28T19:23:40.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee35ee640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1135b0 con 0x7f8edc109240 2024-08-28T19:23:40.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee35ee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1138b0 con 0x7f8edc103900 2024-08-28T19:23:40.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee1b8b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8edc109b90 0x7f8edc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:40.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee1b8b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8edc109b90 0x7f8edc075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55722/0 (socket says 172.21.15.33:55722) 2024-08-28T19:23:40.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.679+0000 7f8ee1b8b640 1 -- 172.21.15.33:0/1617079606 learned_addr learned my addr 172.21.15.33:0/1617079606 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:40.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ee138a640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc103900 0x7f8edc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:40.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ee0b89640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc109240 0x7f8edc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:40.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:40 smithi033 ceph-mon[18549]: Standby manager daemon y started 2024-08-28T19:23:40.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:40 smithi033 ceph-mon[18549]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-28T19:23:40.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:40 smithi033 ceph-mon[18549]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T19:23:40.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:40 smithi033 ceph-mon[18549]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-28T19:23:40.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:40 smithi033 ceph-mon[18549]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T19:23:40.683 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:40 smithi033 ceph-mon[18549]: from='client.? ' entity='client.admin' 2024-08-28T19:23:40.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ee1b8b640 1 -- 172.21.15.33:0/1617079606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc103900 msgr2=0x7f8edc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:40.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ee1b8b640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc103900 0x7f8edc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ee1b8b640 1 -- 172.21.15.33:0/1617079606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc109240 msgr2=0x7f8edc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:40.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ee1b8b640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc109240 0x7f8edc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ee1b8b640 1 -- 172.21.15.33:0/1617079606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc1a83f0 con 0x7f8edc109b90 2024-08-28T19:23:40.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ee0b89640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc109240 0x7f8edc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:23:40.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ee1b8b640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8edc109b90 0x7f8edc075f30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4006010 tx=0x7f8ed40093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:40.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ed27fc640 1 -- 172.21.15.33:0/1617079606 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4003b70 con 0x7f8edc109b90 2024-08-28T19:23:40.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ed27fc640 1 -- 172.21.15.33:0/1617079606 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8ed4003d10 con 0x7f8edc109b90 2024-08-28T19:23:40.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ee35ee640 1 -- 172.21.15.33:0/1617079606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8edc1a8680 con 0x7f8edc109b90 2024-08-28T19:23:40.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.680+0000 7f8ed27fc640 1 -- 172.21.15.33:0/1617079606 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4004550 con 0x7f8edc109b90 2024-08-28T19:23:40.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.681+0000 7f8ee35ee640 1 -- 172.21.15.33:0/1617079606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8edc1a8c10 con 0x7f8edc109b90 2024-08-28T19:23:40.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.682+0000 7f8ee35ee640 1 -- 172.21.15.33:0/1617079606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8edc103d10 con 0x7f8edc109b90 2024-08-28T19:23:40.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.683+0000 7f8ed27fc640 1 -- 172.21.15.33:0/1617079606 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f8ed4004710 con 0x7f8edc109b90 2024-08-28T19:23:40.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.684+0000 7f8ed27fc640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4b70 0x7f8ec80b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:40.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.684+0000 7f8ee138a640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4b70 0x7f8ec80b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:40.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.684+0000 7f8ed27fc640 1 -- 172.21.15.33:0/1617079606 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8ed41044b0 con 0x7f8edc109b90 2024-08-28T19:23:40.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.685+0000 7f8ee138a640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4b70 0x7f8ec80b7080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8edc076f00 tx=0x7f8ed800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:40.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.689+0000 7f8ed27fc640 1 -- 172.21.15.33:0/1617079606 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8ed40cd1e0 con 0x7f8edc109b90 2024-08-28T19:23:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:40 smithi059 ceph-mon[22052]: Standby manager daemon y started 2024-08-28T19:23:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:40 smithi059 ceph-mon[22052]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-28T19:23:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:40 smithi059 ceph-mon[22052]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T19:23:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:40 smithi059 ceph-mon[22052]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-28T19:23:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:40 smithi059 ceph-mon[22052]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T19:23:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:40 smithi059 ceph-mon[22052]: from='client.? ' entity='client.admin' 2024-08-28T19:23:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:40 smithi122 ceph-mon[22174]: Standby manager daemon y started 2024-08-28T19:23:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:40 smithi122 ceph-mon[22174]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-28T19:23:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:40 smithi122 ceph-mon[22174]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-28T19:23:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:40 smithi122 ceph-mon[22174]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-28T19:23:40.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:40 smithi122 ceph-mon[22174]: from='mgr.? 172.21.15.59:0/228440568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-28T19:23:40.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:40 smithi122 ceph-mon[22174]: from='client.? ' entity='client.admin' 2024-08-28T19:23:40.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.882+0000 7f8ee35ee640 1 -- 172.21.15.33:0/1617079606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f8edc02e430 con 0x7f8edc109b90 2024-08-28T19:23:40.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.889+0000 7f8ed27fc640 1 -- 172.21.15.33:0/1617079606 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v21)=0 v21) ==== 108+0+0 (secure 0 0 0) 0x7f8ed40ccae0 con 0x7f8edc109b90 2024-08-28T19:23:40.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 -- 172.21.15.33:0/1617079606 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4b70 msgr2=0x7f8ec80b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:40.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4b70 0x7f8ec80b7080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8edc076f00 tx=0x7f8ed800a2d0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 -- 172.21.15.33:0/1617079606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8edc109b90 msgr2=0x7f8edc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:40.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8edc109b90 0x7f8edc075f30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4006010 tx=0x7f8ed40093d0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 -- 172.21.15.33:0/1617079606 shutdown_connections 2024-08-28T19:23:40.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8edc109b90 0x7f8edc075f30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc109240 0x7f8edc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4b70 0x7f8ec80b7080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 --2- 172.21.15.33:0/1617079606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8edc103900 0x7f8edc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:40.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 -- 172.21.15.33:0/1617079606 >> 172.21.15.33:0/1617079606 conn(0x7f8edc07b5f0 msgr2=0x7f8edc1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:40.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 -- 172.21.15.33:0/1617079606 shutdown_connections 2024-08-28T19:23:40.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:40.892+0000 7f8ee35ee640 1 -- 172.21.15.33:0/1617079606 wait complete. 2024-08-28T19:23:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:41 smithi033 ceph-mon[18549]: mgrmap e19: x(active, since 14s), standbys: y, z 2024-08-28T19:23:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:41 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-28T19:23:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:41 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1617079606' entity='client.admin' 2024-08-28T19:23:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:41 smithi059 ceph-mon[22052]: mgrmap e19: x(active, since 14s), standbys: y, z 2024-08-28T19:23:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:41 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-28T19:23:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:41 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1617079606' entity='client.admin' 2024-08-28T19:23:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:41 smithi122 ceph-mon[22174]: mgrmap e19: x(active, since 14s), standbys: y, z 2024-08-28T19:23:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:41 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-28T19:23:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:41 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1617079606' entity='client.admin' 2024-08-28T19:23:41.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.931+0000 7fca36fef640 1 -- 172.21.15.33:0/488128980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca3010dc30 msgr2=0x7fca30110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:41.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.931+0000 7fca36fef640 1 --2- 172.21.15.33:0/488128980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca3010dc30 0x7fca30110120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fca28009900 tx=0x7fca2802a410 comp rx=0 tx=0).stop 2024-08-28T19:23:41.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.931+0000 7fca36fef640 1 -- 172.21.15.33:0/488128980 shutdown_connections 2024-08-28T19:23:41.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.931+0000 7fca36fef640 1 --2- 172.21.15.33:0/488128980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca3010dc30 0x7fca30110120 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:41.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.931+0000 7fca36fef640 1 --2- 172.21.15.33:0/488128980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca30105120 0x7fca3010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:41.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.931+0000 7fca36fef640 1 --2- 172.21.15.33:0/488128980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca301047d0 0x7fca30104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:41.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.931+0000 7fca36fef640 1 -- 172.21.15.33:0/488128980 >> 172.21.15.33:0/488128980 conn(0x7fca30079510 msgr2=0x7fca30079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:41.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.931+0000 7fca36fef640 1 -- 172.21.15.33:0/488128980 shutdown_connections 2024-08-28T19:23:41.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.931+0000 7fca36fef640 1 -- 172.21.15.33:0/488128980 wait complete. 2024-08-28T19:23:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.932+0000 7fca36fef640 1 Processor -- start 2024-08-28T19:23:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.932+0000 7fca36fef640 1 -- start start 2024-08-28T19:23:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.932+0000 7fca36fef640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca301047d0 0x7fca30102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.932+0000 7fca36fef640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca30105120 0x7fca30102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.932+0000 7fca36fef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3010dc30 0x7fca30102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.932+0000 7fca36fef640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca30113770 con 0x7fca301047d0 2024-08-28T19:23:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.932+0000 7fca36fef640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fca301135f0 con 0x7fca30105120 2024-08-28T19:23:41.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.932+0000 7fca36fef640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca301138f0 con 0x7fca3010dc30 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca34d8b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca301047d0 0x7fca30102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca27fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca30105120 0x7fca30102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca34d8b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca301047d0 0x7fca30102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55740/0 (socket says 172.21.15.33:55740) 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca34d8b640 1 -- 172.21.15.33:0/821978889 learned_addr learned my addr 172.21.15.33:0/821978889 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca3558c640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3010dc30 0x7fca30102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca34d8b640 1 -- 172.21.15.33:0/821978889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3010dc30 msgr2=0x7fca30102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca34d8b640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3010dc30 0x7fca30102f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca34d8b640 1 -- 172.21.15.33:0/821978889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca30105120 msgr2=0x7fca30102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca34d8b640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca30105120 0x7fca30102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca34d8b640 1 -- 172.21.15.33:0/821978889 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca301a8460 con 0x7fca301047d0 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca3558c640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3010dc30 0x7fca30102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca34d8b640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca301047d0 0x7fca30102510 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00db80 tx=0x7fca2c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca25ffb640 1 -- 172.21.15.33:0/821978889 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c017070 con 0x7fca301047d0 2024-08-28T19:23:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca25ffb640 1 -- 172.21.15.33:0/821978889 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fca2c004020 con 0x7fca301047d0 2024-08-28T19:23:41.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca36fef640 1 -- 172.21.15.33:0/821978889 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca301a8750 con 0x7fca301047d0 2024-08-28T19:23:41.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.933+0000 7fca25ffb640 1 -- 172.21.15.33:0/821978889 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c00be60 con 0x7fca301047d0 2024-08-28T19:23:41.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.934+0000 7fca36fef640 1 -- 172.21.15.33:0/821978889 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca301a8ce0 con 0x7fca301047d0 2024-08-28T19:23:41.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.935+0000 7fca36fef640 1 -- 172.21.15.33:0/821978889 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3006c000 con 0x7fca301047d0 2024-08-28T19:23:41.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.936+0000 7fca25ffb640 1 -- 172.21.15.33:0/821978889 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fca2c003b70 con 0x7fca301047d0 2024-08-28T19:23:41.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.937+0000 7fca25ffb640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca180b4b70 0x7fca180b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:41.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.937+0000 7fca27fff640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca180b4b70 0x7fca180b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:41.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.937+0000 7fca25ffb640 1 -- 172.21.15.33:0/821978889 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fca2c0e33d0 con 0x7fca301047d0 2024-08-28T19:23:41.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.937+0000 7fca27fff640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca180b4b70 0x7fca180b7080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca300ffeb0 tx=0x7fca2000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:41.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:41.941+0000 7fca25ffb640 1 -- 172.21.15.33:0/821978889 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fca2c020070 con 0x7fca301047d0 2024-08-28T19:23:42.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.130+0000 7fca36fef640 1 -- 172.21.15.33:0/821978889 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fca301a9020 con 0x7fca301047d0 2024-08-28T19:23:42.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.134+0000 7fca25ffb640 1 -- 172.21.15.33:0/821978889 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fca2c0ac060 con 0x7fca301047d0 2024-08-28T19:23:42.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 -- 172.21.15.33:0/821978889 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca180b4b70 msgr2=0x7fca180b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:42.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca180b4b70 0x7fca180b7080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fca300ffeb0 tx=0x7fca2000b410 comp rx=0 tx=0).stop 2024-08-28T19:23:42.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 -- 172.21.15.33:0/821978889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca301047d0 msgr2=0x7fca30102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:42.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca301047d0 0x7fca30102510 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00db80 tx=0x7fca2c00b630 comp rx=0 tx=0).stop 2024-08-28T19:23:42.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 -- 172.21.15.33:0/821978889 shutdown_connections 2024-08-28T19:23:42.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca180b4b70 0x7fca180b7080 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca3010dc30 0x7fca30102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca30105120 0x7fca30102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 --2- 172.21.15.33:0/821978889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca301047d0 0x7fca30102510 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 -- 172.21.15.33:0/821978889 >> 172.21.15.33:0/821978889 conn(0x7fca30079510 msgr2=0x7fca30107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:42.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 -- 172.21.15.33:0/821978889 shutdown_connections 2024-08-28T19:23:42.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.137+0000 7fca36fef640 1 -- 172.21.15.33:0/821978889 wait complete. 2024-08-28T19:23:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.491+0000 7f8b91669640 1 -- 172.21.15.33:0/1201122288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c10dbb0 msgr2=0x7f8b8c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.491+0000 7f8b91669640 1 --2- 172.21.15.33:0/1201122288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c10dbb0 0x7f8b8c1100a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009ca0 tx=0x7f8b8402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.491+0000 7f8b91669640 1 -- 172.21.15.33:0/1201122288 shutdown_connections 2024-08-28T19:23:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.491+0000 7f8b91669640 1 --2- 172.21.15.33:0/1201122288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c10dbb0 0x7f8b8c1100a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.491+0000 7f8b91669640 1 --2- 172.21.15.33:0/1201122288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c1050a0 0x7f8b8c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.491+0000 7f8b91669640 1 --2- 172.21.15.33:0/1201122288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b8c104750 0x7f8b8c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.491+0000 7f8b91669640 1 -- 172.21.15.33:0/1201122288 >> 172.21.15.33:0/1201122288 conn(0x7f8b8c0794d0 msgr2=0x7f8b8c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:42.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.491+0000 7f8b91669640 1 -- 172.21.15.33:0/1201122288 shutdown_connections 2024-08-28T19:23:42.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.491+0000 7f8b91669640 1 -- 172.21.15.33:0/1201122288 wait complete. 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.491+0000 7f8b91669640 1 Processor -- start 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b91669640 1 -- start start 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b91669640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c104750 0x7f8b8c102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b91669640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1050a0 0x7f8b8c1029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b91669640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b8c10dbb0 0x7f8b8c102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b91669640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c1136f0 con 0x7f8b8c1050a0 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b91669640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c113570 con 0x7f8b8c104750 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b91669640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c113870 con 0x7f8b8c10dbb0 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1050a0 0x7f8b8c1029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1050a0 0x7f8b8c1029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55756/0 (socket says 172.21.15.33:55756) 2024-08-28T19:23:42.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8a7fc640 1 -- 172.21.15.33:0/1903193552 learned_addr learned my addr 172.21.15.33:0/1903193552 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8affd640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c104750 0x7f8b8c102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8b7fe640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b8c10dbb0 0x7f8b8c102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8a7fc640 1 -- 172.21.15.33:0/1903193552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b8c10dbb0 msgr2=0x7f8b8c102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8a7fc640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b8c10dbb0 0x7f8b8c102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8a7fc640 1 -- 172.21.15.33:0/1903193552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c104750 msgr2=0x7f8b8c102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8a7fc640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c104750 0x7f8b8c102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8a7fc640 1 -- 172.21.15.33:0/1903193552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8c1a8460 con 0x7f8b8c1050a0 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.492+0000 7f8b8b7fe640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b8c10dbb0 0x7f8b8c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.493+0000 7f8b8a7fc640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1050a0 0x7f8b8c1029d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000d740 tx=0x7f8b8000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.493+0000 7f8b73fff640 1 -- 172.21.15.33:0/1903193552 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80017070 con 0x7f8b8c1050a0 2024-08-28T19:23:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.493+0000 7f8b91669640 1 -- 172.21.15.33:0/1903193552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8c1a8750 con 0x7f8b8c1050a0 2024-08-28T19:23:42.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.493+0000 7f8b73fff640 1 -- 172.21.15.33:0/1903193552 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8b8000de50 con 0x7f8b8c1050a0 2024-08-28T19:23:42.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.493+0000 7f8b73fff640 1 -- 172.21.15.33:0/1903193552 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8000f620 con 0x7f8b8c1050a0 2024-08-28T19:23:42.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.493+0000 7f8b91669640 1 -- 172.21.15.33:0/1903193552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8c1a8c90 con 0x7f8b8c1050a0 2024-08-28T19:23:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.494+0000 7f8b91669640 1 -- 172.21.15.33:0/1903193552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b8c104b60 con 0x7f8b8c1050a0 2024-08-28T19:23:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.495+0000 7f8b73fff640 1 -- 172.21.15.33:0/1903193552 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f8b8001a070 con 0x7f8b8c1050a0 2024-08-28T19:23:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.496+0000 7f8b73fff640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b740b4af0 0x7f8b740b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.496+0000 7f8b8affd640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b740b4af0 0x7f8b740b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.496+0000 7f8b73fff640 1 -- 172.21.15.33:0/1903193552 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8b800e2f30 con 0x7f8b8c1050a0 2024-08-28T19:23:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.497+0000 7f8b8affd640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b740b4af0 0x7f8b740b7000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0058c0 tx=0x7f8b7c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:42.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.500+0000 7f8b73fff640 1 -- 172.21.15.33:0/1903193552 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8b800abc60 con 0x7f8b8c1050a0 2024-08-28T19:23:42.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.688+0000 7f8b91669640 1 -- 172.21.15.33:0/1903193552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f8b8c02e430 con 0x7f8b8c1050a0 2024-08-28T19:23:42.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.692+0000 7f8b73fff640 1 -- 172.21.15.33:0/1903193552 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f8b800ab560 con 0x7f8b8c1050a0 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.694+0000 7f8b91669640 1 -- 172.21.15.33:0/1903193552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b740b4af0 msgr2=0x7f8b740b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.694+0000 7f8b91669640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b740b4af0 0x7f8b740b7000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0058c0 tx=0x7f8b7c00a2d0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.694+0000 7f8b91669640 1 -- 172.21.15.33:0/1903193552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1050a0 msgr2=0x7f8b8c1029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.694+0000 7f8b91669640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1050a0 0x7f8b8c1029d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000d740 tx=0x7f8b8000dc00 comp rx=0 tx=0).stop 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.695+0000 7f8b91669640 1 -- 172.21.15.33:0/1903193552 shutdown_connections 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.695+0000 7f8b91669640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b740b4af0 0x7f8b740b7000 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.695+0000 7f8b91669640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b8c10dbb0 0x7f8b8c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.695+0000 7f8b91669640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b8c1050a0 0x7f8b8c1029d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.695+0000 7f8b91669640 1 --2- 172.21.15.33:0/1903193552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c104750 0x7f8b8c102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.695+0000 7f8b91669640 1 -- 172.21.15.33:0/1903193552 >> 172.21.15.33:0/1903193552 conn(0x7f8b8c0794d0 msgr2=0x7f8b8c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.695+0000 7f8b91669640 1 -- 172.21.15.33:0/1903193552 shutdown_connections 2024-08-28T19:23:42.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:42.695+0000 7f8b91669640 1 -- 172.21.15.33:0/1903193552 wait complete. 2024-08-28T19:23:43.251 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:43 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/821978889' entity='client.admin' 2024-08-28T19:23:43.251 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:43 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1903193552' entity='client.admin' 2024-08-28T19:23:43.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:43 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/821978889' entity='client.admin' 2024-08-28T19:23:43.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:43 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1903193552' entity='client.admin' 2024-08-28T19:23:43.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:43 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/821978889' entity='client.admin' 2024-08-28T19:23:43.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:43 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1903193552' entity='client.admin' 2024-08-28T19:23:43.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.344+0000 7fdced863640 1 -- 172.21.15.33:0/2009599016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdce8105120 msgr2=0x7fdce810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:43.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.344+0000 7fdced863640 1 --2- 172.21.15.33:0/2009599016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdce8105120 0x7fdce810d670 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009900 tx=0x7fdcdc02a410 comp rx=0 tx=0).stop 2024-08-28T19:23:43.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.344+0000 7fdced863640 1 -- 172.21.15.33:0/2009599016 shutdown_connections 2024-08-28T19:23:43.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.344+0000 7fdced863640 1 --2- 172.21.15.33:0/2009599016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdce810dc00 0x7fdce81100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.344+0000 7fdced863640 1 --2- 172.21.15.33:0/2009599016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdce8105120 0x7fdce810d670 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.344+0000 7fdced863640 1 --2- 172.21.15.33:0/2009599016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce81047d0 0x7fdce8104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.344+0000 7fdced863640 1 -- 172.21.15.33:0/2009599016 >> 172.21.15.33:0/2009599016 conn(0x7fdce8079530 msgr2=0x7fdce8079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.344+0000 7fdced863640 1 -- 172.21.15.33:0/2009599016 shutdown_connections 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.344+0000 7fdced863640 1 -- 172.21.15.33:0/2009599016 wait complete. 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.345+0000 7fdced863640 1 Processor -- start 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.345+0000 7fdced863640 1 -- start start 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.345+0000 7fdced863640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce81047d0 0x7fdce819a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.345+0000 7fdced863640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdce8105120 0x7fdce819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.345+0000 7fdced863640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdce810dc00 0x7fdce819f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.345+0000 7fdced863640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdce8113720 con 0x7fdce8105120 2024-08-28T19:23:43.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.345+0000 7fdced863640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdce81135a0 con 0x7fdce81047d0 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.345+0000 7fdced863640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdce81138a0 con 0x7fdce810dc00 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce67fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdce8105120 0x7fdce819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce67fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdce8105120 0x7fdce819a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55788/0 (socket says 172.21.15.33:55788) 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce67fc640 1 -- 172.21.15.33:0/3507746824 learned_addr learned my addr 172.21.15.33:0/3507746824 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce77fe640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdce810dc00 0x7fdce819f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce6ffd640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce81047d0 0x7fdce819a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce67fc640 1 -- 172.21.15.33:0/3507746824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdce810dc00 msgr2=0x7fdce819f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce67fc640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdce810dc00 0x7fdce819f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce67fc640 1 -- 172.21.15.33:0/3507746824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce81047d0 msgr2=0x7fdce819a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce67fc640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce81047d0 0x7fdce819a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce67fc640 1 -- 172.21.15.33:0/3507746824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce81a00a0 con 0x7fdce8105120 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdce67fc640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdce8105120 0x7fdce819a6d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc005940 tx=0x7fdcdc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdcec861640 1 -- 172.21.15.33:0/3507746824 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc03f030 con 0x7fdce8105120 2024-08-28T19:23:43.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdcec861640 1 -- 172.21.15.33:0/3507746824 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdcdc031800 con 0x7fdce8105120 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdced863640 1 -- 172.21.15.33:0/3507746824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce81a0330 con 0x7fdce8105120 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdcec861640 1 -- 172.21.15.33:0/3507746824 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc035070 con 0x7fdce8105120 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.346+0000 7fdced863640 1 -- 172.21.15.33:0/3507746824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce81a6af0 con 0x7fdce8105120 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.347+0000 7fdced863640 1 -- 172.21.15.33:0/3507746824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce8104be0 con 0x7fdce8105120 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.349+0000 7fdcec861640 1 -- 172.21.15.33:0/3507746824 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fdcdc042030 con 0x7fdce8105120 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.349+0000 7fdcec861640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdcd00b4b70 0x7fdcd00b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.350+0000 7fdce6ffd640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdcd00b4b70 0x7fdcd00b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.350+0000 7fdcec861640 1 -- 172.21.15.33:0/3507746824 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdcdc103a10 con 0x7fdce8105120 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.350+0000 7fdce6ffd640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdcd00b4b70 0x7fdcd00b7080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8005d00 tx=0x7fdcd8005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.354+0000 7fdcec861640 1 -- 172.21.15.33:0/3507746824 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdcdc0cc740 con 0x7fdce8105120 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.552+0000 7fdced863640 1 -- 172.21.15.33:0/3507746824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fdce8108d10 con 0x7fdce8105120 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.558+0000 7fdcec861640 1 -- 172.21.15.33:0/3507746824 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v24)=0 v24) ==== 125+0+0 (secure 0 0 0) 0x7fdcdc0cc040 con 0x7fdce8105120 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.560+0000 7fdced863640 1 -- 172.21.15.33:0/3507746824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdcd00b4b70 msgr2=0x7fdcd00b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.560+0000 7fdced863640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdcd00b4b70 0x7fdcd00b7080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8005d00 tx=0x7fdcd8005c50 comp rx=0 tx=0).stop 2024-08-28T19:23:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.560+0000 7fdced863640 1 -- 172.21.15.33:0/3507746824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdce8105120 msgr2=0x7fdce819a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.560+0000 7fdced863640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdce8105120 0x7fdce819a6d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc005940 tx=0x7fdcdc0042f0 comp rx=0 tx=0).stop 2024-08-28T19:23:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.560+0000 7fdced863640 1 -- 172.21.15.33:0/3507746824 shutdown_connections 2024-08-28T19:23:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.560+0000 7fdced863640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdcd00b4b70 0x7fdcd00b7080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.560+0000 7fdced863640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdce810dc00 0x7fdce819f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.560+0000 7fdced863640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdce8105120 0x7fdce819a6d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.560+0000 7fdced863640 1 --2- 172.21.15.33:0/3507746824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce81047d0 0x7fdce819a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.560+0000 7fdced863640 1 -- 172.21.15.33:0/3507746824 >> 172.21.15.33:0/3507746824 conn(0x7fdce8079530 msgr2=0x7fdce8100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.561+0000 7fdced863640 1 -- 172.21.15.33:0/3507746824 shutdown_connections 2024-08-28T19:23:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:43.561+0000 7fdced863640 1 -- 172.21.15.33:0/3507746824 wait complete. 2024-08-28T19:23:44.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.763+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3733140301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24c4108a90 msgr2=0x7f24c410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.763+0000 7f24ca3b7640 1 --2- 172.21.15.33:0/3733140301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24c4108a90 0x7f24c410f2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009ca0 tx=0x7f24bc02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.763+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3733140301 shutdown_connections 2024-08-28T19:23:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.763+0000 7f24ca3b7640 1 --2- 172.21.15.33:0/3733140301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24c4108a90 0x7f24c410f2c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.763+0000 7f24ca3b7640 1 --2- 172.21.15.33:0/3733140301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c4108140 0x7f24c4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.763+0000 7f24ca3b7640 1 --2- 172.21.15.33:0/3733140301 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c4102800 0x7f24c4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.763+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3733140301 >> 172.21.15.33:0/3733140301 conn(0x7f24c40794d0 msgr2=0x7f24c40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.763+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3733140301 shutdown_connections 2024-08-28T19:23:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.763+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3733140301 wait complete. 2024-08-28T19:23:44.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.764+0000 7f24ca3b7640 1 Processor -- start 2024-08-28T19:23:44.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.764+0000 7f24ca3b7640 1 -- start start 2024-08-28T19:23:44.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24ca3b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24c4102800 0x7f24c4199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:44.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24ca3b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c4108140 0x7f24c41995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:44.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24ca3b7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c4108a90 0x7f24c419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:44.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24ca3b7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f24c41125d0 con 0x7f24c4102800 2024-08-28T19:23:44.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24ca3b7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24c4112450 con 0x7f24c4108140 2024-08-28T19:23:44.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24ca3b7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f24c4112750 con 0x7f24c4108a90 2024-08-28T19:23:44.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24c4102800 0x7f24c4199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24c4102800 0x7f24c4199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55828/0 (socket says 172.21.15.33:55828) 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c3fff640 1 -- 172.21.15.33:0/3527450242 learned_addr learned my addr 172.21.15.33:0/3527450242 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c8954640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c4108a90 0x7f24c419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c37fe640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c4108140 0x7f24c41995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c3fff640 1 -- 172.21.15.33:0/3527450242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c4108a90 msgr2=0x7f24c419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c3fff640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c4108a90 0x7f24c419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c3fff640 1 -- 172.21.15.33:0/3527450242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c4108140 msgr2=0x7f24c41995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c3fff640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c4108140 0x7f24c41995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c3fff640 1 -- 172.21.15.33:0/3527450242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c419ef90 con 0x7f24c4102800 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c37fe640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c4108140 0x7f24c41995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c8954640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c4108a90 0x7f24c419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c3fff640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24c4102800 0x7f24c4199020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f24b400e9f0 tx=0x7f24b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:44.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c17fa640 1 -- 172.21.15.33:0/3527450242 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b400cd80 con 0x7f24c4102800 2024-08-28T19:23:44.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24c17fa640 1 -- 172.21.15.33:0/3527450242 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f24b40054b0 con 0x7f24c4102800 2024-08-28T19:23:44.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.765+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3527450242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c419f280 con 0x7f24c4102800 2024-08-28T19:23:44.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.766+0000 7f24c17fa640 1 -- 172.21.15.33:0/3527450242 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b4010430 con 0x7f24c4102800 2024-08-28T19:23:44.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.766+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3527450242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c41a59e0 con 0x7f24c4102800 2024-08-28T19:23:44.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.767+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3527450242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24c4102c10 con 0x7f24c4102800 2024-08-28T19:23:44.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.768+0000 7f24c17fa640 1 -- 172.21.15.33:0/3527450242 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f24b40046c0 con 0x7f24c4102800 2024-08-28T19:23:44.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.769+0000 7f24c17fa640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24ac0b4af0 0x7f24ac0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:44.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.769+0000 7f24c37fe640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24ac0b4af0 0x7f24ac0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:44.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.769+0000 7f24c17fa640 1 -- 172.21.15.33:0/3527450242 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f24b40e3c10 con 0x7f24c4102800 2024-08-28T19:23:44.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.770+0000 7f24c37fe640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24ac0b4af0 0x7f24ac0b7000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f24b8005fd0 tx=0x7f24b80094d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:44.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.773+0000 7f24c17fa640 1 -- 172.21.15.33:0/3527450242 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f24b4056130 con 0x7f24c4102800 2024-08-28T19:23:44.863 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:44 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3507746824' entity='client.admin' 2024-08-28T19:23:44.863 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:44 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/669975533' entity='client.admin' 2024-08-28T19:23:44.863 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:44 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3082882594' entity='client.admin' 2024-08-28T19:23:44.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.963+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3527450242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f24c419a150 con 0x7f24c4102800 2024-08-28T19:23:44.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.967+0000 7f24c17fa640 1 -- 172.21.15.33:0/3527450242 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v27)=0 v27) ==== 116+0+0 (secure 0 0 0) 0x7f24b40ac940 con 0x7f24c4102800 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.969+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3527450242 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24ac0b4af0 msgr2=0x7f24ac0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.969+0000 7f24ca3b7640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24ac0b4af0 0x7f24ac0b7000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f24b8005fd0 tx=0x7f24b80094d0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.969+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3527450242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24c4102800 msgr2=0x7f24c4199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.969+0000 7f24ca3b7640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24c4102800 0x7f24c4199020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f24b400e9f0 tx=0x7f24b400edf0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.969+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3527450242 shutdown_connections 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.969+0000 7f24ca3b7640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24ac0b4af0 0x7f24ac0b7000 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.969+0000 7f24ca3b7640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c4108a90 0x7f24c419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.969+0000 7f24ca3b7640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c4108140 0x7f24c41995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.969+0000 7f24ca3b7640 1 --2- 172.21.15.33:0/3527450242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24c4102800 0x7f24c4199020 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.969+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3527450242 >> 172.21.15.33:0/3527450242 conn(0x7f24c40794d0 msgr2=0x7f24c4105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.970+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3527450242 shutdown_connections 2024-08-28T19:23:44.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.970+0000 7f24ca3b7640 1 -- 172.21.15.33:0/3527450242 wait complete. 2024-08-28T19:23:45.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:44 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3507746824' entity='client.admin' 2024-08-28T19:23:45.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:44 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/669975533' entity='client.admin' 2024-08-28T19:23:45.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:44 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3082882594' entity='client.admin' 2024-08-28T19:23:45.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:44 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3507746824' entity='client.admin' 2024-08-28T19:23:45.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:44 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/669975533' entity='client.admin' 2024-08-28T19:23:45.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:44 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3082882594' entity='client.admin' 2024-08-28T19:23:45.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.283+0000 7fc3da6fb640 1 -- 172.21.15.33:0/3168260625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3d4102800 msgr2=0x7fc3d4102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:45.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.283+0000 7fc3da6fb640 1 --2- 172.21.15.33:0/3168260625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3d4102800 0x7fc3d4102c10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009900 tx=0x7fc3c402a410 comp rx=0 tx=0).stop 2024-08-28T19:23:45.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.283+0000 7fc3da6fb640 1 -- 172.21.15.33:0/3168260625 shutdown_connections 2024-08-28T19:23:45.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.283+0000 7fc3da6fb640 1 --2- 172.21.15.33:0/3168260625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d4108a90 0x7fc3d410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.283+0000 7fc3da6fb640 1 --2- 172.21.15.33:0/3168260625 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d4108140 0x7fc3d4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.283+0000 7fc3da6fb640 1 --2- 172.21.15.33:0/3168260625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3d4102800 0x7fc3d4102c10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.283+0000 7fc3da6fb640 1 -- 172.21.15.33:0/3168260625 >> 172.21.15.33:0/3168260625 conn(0x7fc3d40794d0 msgr2=0x7fc3d40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:45.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.283+0000 7fc3da6fb640 1 -- 172.21.15.33:0/3168260625 shutdown_connections 2024-08-28T19:23:45.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.283+0000 7fc3da6fb640 1 -- 172.21.15.33:0/3168260625 wait complete. 2024-08-28T19:23:45.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3da6fb640 1 Processor -- start 2024-08-28T19:23:45.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3da6fb640 1 -- start start 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3da6fb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3d4102800 0x7fc3d419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3da6fb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d4108140 0x7fc3d419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3da6fb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d4108a90 0x7fc3d419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3da6fb640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4112600 con 0x7fc3d4102800 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3da6fb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4112480 con 0x7fc3d4108140 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3da6fb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4112780 con 0x7fc3d4108a90 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3d4102800 0x7fc3d419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3d4102800 0x7fc3d419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55854/0 (socket says 172.21.15.33:55854) 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3d3fff640 1 -- 172.21.15.33:0/1755203699 learned_addr learned my addr 172.21.15.33:0/1755203699 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3d37fe640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d4108140 0x7fc3d419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.284+0000 7fc3d8c98640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d4108a90 0x7fc3d419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3d3fff640 1 -- 172.21.15.33:0/1755203699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d4108a90 msgr2=0x7fc3d419f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:45.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3d3fff640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d4108a90 0x7fc3d419f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3d3fff640 1 -- 172.21.15.33:0/1755203699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d4108140 msgr2=0x7fc3d419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:45.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3d3fff640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d4108140 0x7fc3d419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3d3fff640 1 -- 172.21.15.33:0/1755203699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d41a0090 con 0x7fc3d4102800 2024-08-28T19:23:45.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3d3fff640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3d4102800 0x7fc3d419a120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4004770 tx=0x7fc3c4003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:45.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3d17fa640 1 -- 172.21.15.33:0/1755203699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c403f070 con 0x7fc3d4102800 2024-08-28T19:23:45.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3d17fa640 1 -- 172.21.15.33:0/1755203699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc3c403bd00 con 0x7fc3d4102800 2024-08-28T19:23:45.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3da6fb640 1 -- 172.21.15.33:0/1755203699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d41a0320 con 0x7fc3d4102800 2024-08-28T19:23:45.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3d17fa640 1 -- 172.21.15.33:0/1755203699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4035030 con 0x7fc3d4102800 2024-08-28T19:23:45.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.285+0000 7fc3da6fb640 1 -- 172.21.15.33:0/1755203699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d41a6ae0 con 0x7fc3d4102800 2024-08-28T19:23:45.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.286+0000 7fc3da6fb640 1 -- 172.21.15.33:0/1755203699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d4102c10 con 0x7fc3d4102800 2024-08-28T19:23:45.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.288+0000 7fc3d17fa640 1 -- 172.21.15.33:0/1755203699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fc3c4042070 con 0x7fc3d4102800 2024-08-28T19:23:45.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.288+0000 7fc3d17fa640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3bc0b4af0 0x7fc3bc0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:45.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.288+0000 7fc3d37fe640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3bc0b4af0 0x7fc3bc0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:45.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.288+0000 7fc3d17fa640 1 -- 172.21.15.33:0/1755203699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc3c4104240 con 0x7fc3d4102800 2024-08-28T19:23:45.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.289+0000 7fc3d37fe640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3bc0b4af0 0x7fc3bc0b7000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4100c10 tx=0x7fc3c800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:45.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.292+0000 7fc3d17fa640 1 -- 172.21.15.33:0/1755203699 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc3c40cc920 con 0x7fc3d4102800 2024-08-28T19:23:45.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.478+0000 7fc3da6fb640 1 -- 172.21.15.33:0/1755203699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc3d41a6ce0 con 0x7fc3d4102800 2024-08-28T19:23:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.482+0000 7fc3d17fa640 1 -- 172.21.15.33:0/1755203699 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v28)=0 v28) ==== 120+0+0 (secure 0 0 0) 0x7fc3c40d10e0 con 0x7fc3d4102800 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.484+0000 7fc3da6fb640 1 -- 172.21.15.33:0/1755203699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3bc0b4af0 msgr2=0x7fc3bc0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3bc0b4af0 0x7fc3bc0b7000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4100c10 tx=0x7fc3c800b390 comp rx=0 tx=0).stop 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 -- 172.21.15.33:0/1755203699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3d4102800 msgr2=0x7fc3d419a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3d4102800 0x7fc3d419a120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4004770 tx=0x7fc3c4003ca0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 -- 172.21.15.33:0/1755203699 shutdown_connections 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3bc0b4af0 0x7fc3bc0b7000 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3d4108a90 0x7fc3d419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d4108140 0x7fc3d419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 --2- 172.21.15.33:0/1755203699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3d4102800 0x7fc3d419a120 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 -- 172.21.15.33:0/1755203699 >> 172.21.15.33:0/1755203699 conn(0x7fc3d40794d0 msgr2=0x7fc3d41017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 -- 172.21.15.33:0/1755203699 shutdown_connections 2024-08-28T19:23:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.485+0000 7fc3da6fb640 1 -- 172.21.15.33:0/1755203699 wait complete. 2024-08-28T19:23:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.812+0000 7efd8f876640 1 -- 172.21.15.33:0/388564245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd88108a90 msgr2=0x7efd8810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.812+0000 7efd8f876640 1 --2- 172.21.15.33:0/388564245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd88108a90 0x7efd8810f2c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efd80009ca0 tx=0x7efd8002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.813+0000 7efd8f876640 1 -- 172.21.15.33:0/388564245 shutdown_connections 2024-08-28T19:23:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.813+0000 7efd8f876640 1 --2- 172.21.15.33:0/388564245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd88108a90 0x7efd8810f2c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.813+0000 7efd8f876640 1 --2- 172.21.15.33:0/388564245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88108140 0x7efd88108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.813+0000 7efd8f876640 1 --2- 172.21.15.33:0/388564245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd88102800 0x7efd88102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.813+0000 7efd8f876640 1 -- 172.21.15.33:0/388564245 >> 172.21.15.33:0/388564245 conn(0x7efd880794d0 msgr2=0x7efd880798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.813+0000 7efd8f876640 1 -- 172.21.15.33:0/388564245 shutdown_connections 2024-08-28T19:23:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.813+0000 7efd8f876640 1 -- 172.21.15.33:0/388564245 wait complete. 2024-08-28T19:23:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.813+0000 7efd8f876640 1 Processor -- start 2024-08-28T19:23:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.813+0000 7efd8f876640 1 -- start start 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8f876640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd88102800 0x7efd8819afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8f876640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88108140 0x7efd8819b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8f876640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd88108a90 0x7efd8819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8f876640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd88112620 con 0x7efd88102800 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8f876640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd881124a0 con 0x7efd88108a90 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8f876640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efd881127a0 con 0x7efd88108140 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8d612640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd88102800 0x7efd8819afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8d612640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd88102800 0x7efd8819afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55898/0 (socket says 172.21.15.33:55898) 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8d612640 1 -- 172.21.15.33:0/3091992498 learned_addr learned my addr 172.21.15.33:0/3091992498 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8de13640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd88108a90 0x7efd8819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8ce11640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88108140 0x7efd8819b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8d612640 1 -- 172.21.15.33:0/3091992498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88108140 msgr2=0x7efd8819b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8d612640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88108140 0x7efd8819b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8d612640 1 -- 172.21.15.33:0/3091992498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd88108a90 msgr2=0x7efd8819ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8d612640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd88108a90 0x7efd8819ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8d612640 1 -- 172.21.15.33:0/3091992498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd881a6240 con 0x7efd88102800 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.814+0000 7efd8d612640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd88102800 0x7efd8819afb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efd8400d950 tx=0x7efd8400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.815+0000 7efd7e7fc640 1 -- 172.21.15.33:0/3091992498 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84017070 con 0x7efd88102800 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.815+0000 7efd7e7fc640 1 -- 172.21.15.33:0/3091992498 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7efd8400de80 con 0x7efd88102800 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.815+0000 7efd7e7fc640 1 -- 172.21.15.33:0/3091992498 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8400f620 con 0x7efd88102800 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.815+0000 7efd8f876640 1 -- 172.21.15.33:0/3091992498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd881a6530 con 0x7efd88102800 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.815+0000 7efd8f876640 1 -- 172.21.15.33:0/3091992498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd881a6ac0 con 0x7efd88102800 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.816+0000 7efd8f876640 1 -- 172.21.15.33:0/3091992498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd88102c10 con 0x7efd88102800 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.817+0000 7efd7e7fc640 1 -- 172.21.15.33:0/3091992498 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7efd84005030 con 0x7efd88102800 2024-08-28T19:23:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.818+0000 7efd7e7fc640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd740b4ba0 0x7efd740b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.818+0000 7efd8ce11640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd740b4ba0 0x7efd740b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.818+0000 7efd7e7fc640 1 -- 172.21.15.33:0/3091992498 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7efd840e3010 con 0x7efd88102800 2024-08-28T19:23:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.818+0000 7efd8ce11640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd740b4ba0 0x7efd740b70b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd88079e20 tx=0x7efd78009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.821+0000 7efd7e7fc640 1 -- 172.21.15.33:0/3091992498 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efd840abdc0 con 0x7efd88102800 2024-08-28T19:23:46.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.082+0000 7f0f2a60a640 1 -- 172.21.15.33:0/2209148809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24103960 msgr2=0x7f0f24103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.082+0000 7f0f2a60a640 1 --2- 172.21.15.33:0/2209148809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24103960 0x7f0f24103d70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009900 tx=0x7f0f1402a410 comp rx=0 tx=0).stop 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.082+0000 7f0f2a60a640 1 -- 172.21.15.33:0/2209148809 shutdown_connections 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.082+0000 7f0f2a60a640 1 --2- 172.21.15.33:0/2209148809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f24109ba0 0x7f0f241103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.082+0000 7f0f2a60a640 1 --2- 172.21.15.33:0/2209148809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24109250 0x7f0f24109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.082+0000 7f0f2a60a640 1 --2- 172.21.15.33:0/2209148809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24103960 0x7f0f24103d70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.082+0000 7f0f2a60a640 1 -- 172.21.15.33:0/2209148809 >> 172.21.15.33:0/2209148809 conn(0x7f0f2407b6b0 msgr2=0x7f0f2407bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.082+0000 7f0f2a60a640 1 -- 172.21.15.33:0/2209148809 shutdown_connections 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.083+0000 7f0f2a60a640 1 -- 172.21.15.33:0/2209148809 wait complete. 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.083+0000 7f0f2a60a640 1 Processor -- start 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.083+0000 7f0f2a60a640 1 -- start start 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f2a60a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24103960 0x7f0f2419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f2a60a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f24109250 0x7f0f2419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f2a60a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24109ba0 0x7f0f2419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f2a60a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0f24113740 con 0x7f0f24103960 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f2a60a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0f241135c0 con 0x7f0f24109ba0 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f2a60a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0f241138c0 con 0x7f0f24109250 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f23fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24103960 0x7f0f2419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f23fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24103960 0x7f0f2419a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55808/0 (socket says 172.21.15.33:55808) 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f23fff640 1 -- 172.21.15.33:0/669975533 learned_addr learned my addr 172.21.15.33:0/669975533 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f28ba7640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24109ba0 0x7f0f2419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f237fe640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f24109250 0x7f0f2419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f23fff640 1 -- 172.21.15.33:0/669975533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f24109250 msgr2=0x7f0f2419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f23fff640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f24109250 0x7f0f2419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f23fff640 1 -- 172.21.15.33:0/669975533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24109ba0 msgr2=0x7f0f2419f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f23fff640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24109ba0 0x7f0f2419f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f23fff640 1 -- 172.21.15.33:0/669975533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f241a00e0 con 0x7f0f24103960 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.084+0000 7f0f23fff640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24103960 0x7f0f2419a170 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f14006010 tx=0x7f0f140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.085+0000 7f0f217fa640 1 -- 172.21.15.33:0/669975533 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1403f030 con 0x7f0f24103960 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.085+0000 7f0f217fa640 1 -- 172.21.15.33:0/669975533 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0f14003c90 con 0x7f0f24103960 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.085+0000 7f0f2a60a640 1 -- 172.21.15.33:0/669975533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f241a0370 con 0x7f0f24103960 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.085+0000 7f0f217fa640 1 -- 172.21.15.33:0/669975533 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14035070 con 0x7f0f24103960 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.085+0000 7f0f2a60a640 1 -- 172.21.15.33:0/669975533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f241a6b30 con 0x7f0f24103960 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.086+0000 7f0f2a60a640 1 -- 172.21.15.33:0/669975533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f24103d70 con 0x7f0f24103960 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.087+0000 7f0f217fa640 1 -- 172.21.15.33:0/669975533 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f0f14042030 con 0x7f0f24103960 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.088+0000 7f0f217fa640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0f0c0b4af0 0x7f0f0c0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.088+0000 7f0f237fe640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0f0c0b4af0 0x7f0f0c0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.088+0000 7f0f217fa640 1 -- 172.21.15.33:0/669975533 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0f14103d10 con 0x7f0f24103960 2024-08-28T19:23:46.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.089+0000 7f0f237fe640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0f0c0b4af0 0x7f0f0c0b7000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f2407bb00 tx=0x7f0f1800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.093+0000 7f0f217fa640 1 -- 172.21.15.33:0/669975533 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0f140cc3f0 con 0x7f0f24103960 2024-08-28T19:23:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.287+0000 7f0f2a60a640 1 -- 172.21.15.33:0/669975533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f0f2410b950 con 0x7f0f24103960 2024-08-28T19:23:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.291+0000 7f0f217fa640 1 -- 172.21.15.33:0/669975533 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v25)=0 v25) ==== 138+0+0 (secure 0 0 0) 0x7f0f140d0bb0 con 0x7f0f24103960 2024-08-28T19:23:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.293+0000 7f0f2a60a640 1 -- 172.21.15.33:0/669975533 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0f0c0b4af0 msgr2=0x7f0f0c0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.293+0000 7f0f2a60a640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0f0c0b4af0 0x7f0f0c0b7000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f2407bb00 tx=0x7f0f1800b390 comp rx=0 tx=0).stop 2024-08-28T19:23:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.293+0000 7f0f2a60a640 1 -- 172.21.15.33:0/669975533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24103960 msgr2=0x7f0f2419a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.293+0000 7f0f2a60a640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24103960 0x7f0f2419a170 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f14006010 tx=0x7f0f140042f0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.294+0000 7f0f2a60a640 1 -- 172.21.15.33:0/669975533 shutdown_connections 2024-08-28T19:23:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.294+0000 7f0f2a60a640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24109ba0 0x7f0f2419f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.294+0000 7f0f2a60a640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0f0c0b4af0 0x7f0f0c0b7000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.294+0000 7f0f2a60a640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f24109250 0x7f0f2419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.294+0000 7f0f2a60a640 1 --2- 172.21.15.33:0/669975533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24103960 0x7f0f2419a170 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.294+0000 7f0f2a60a640 1 -- 172.21.15.33:0/669975533 >> 172.21.15.33:0/669975533 conn(0x7f0f2407b6b0 msgr2=0x7f0f24107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:46.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.294+0000 7f0f2a60a640 1 -- 172.21.15.33:0/669975533 shutdown_connections 2024-08-28T19:23:46.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.294+0000 7f0f2a60a640 1 -- 172.21.15.33:0/669975533 wait complete. 2024-08-28T19:23:46.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.008+0000 7efd8f876640 1 -- 172.21.15.33:0/3091992498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7efd8806b010 con 0x7efd88102800 2024-08-28T19:23:46.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.012+0000 7efd7e7fc640 1 -- 172.21.15.33:0/3091992498 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v30)=0 v30) ==== 120+0+0 (secure 0 0 0) 0x7efd8806b010 con 0x7efd88102800 2024-08-28T19:23:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 -- 172.21.15.33:0/3091992498 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd740b4ba0 msgr2=0x7efd740b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd740b4ba0 0x7efd740b70b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd88079e20 tx=0x7efd78009110 comp rx=0 tx=0).stop 2024-08-28T19:23:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 -- 172.21.15.33:0/3091992498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd88102800 msgr2=0x7efd8819afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd88102800 0x7efd8819afb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efd8400d950 tx=0x7efd8400dd50 comp rx=0 tx=0).stop 2024-08-28T19:23:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 -- 172.21.15.33:0/3091992498 shutdown_connections 2024-08-28T19:23:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd88108a90 0x7efd8819ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd740b4ba0 0x7efd740b70b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd88108140 0x7efd8819b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 --2- 172.21.15.33:0/3091992498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd88102800 0x7efd8819afb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 -- 172.21.15.33:0/3091992498 >> 172.21.15.33:0/3091992498 conn(0x7efd880794d0 msgr2=0x7efd88105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:46.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 -- 172.21.15.33:0/3091992498 shutdown_connections 2024-08-28T19:23:46.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:46.015+0000 7efd8f876640 1 -- 172.21.15.33:0/3091992498 wait complete. 2024-08-28T19:23:46.105 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:45 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3527450242' entity='client.admin' 2024-08-28T19:23:46.105 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:45 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1755203699' entity='client.admin' 2024-08-28T19:23:46.105 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:45 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1092491043' entity='client.admin' 2024-08-28T19:23:46.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:45 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3527450242' entity='client.admin' 2024-08-28T19:23:46.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:45 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1755203699' entity='client.admin' 2024-08-28T19:23:46.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:45 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1092491043' entity='client.admin' 2024-08-28T19:23:46.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:45 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3527450242' entity='client.admin' 2024-08-28T19:23:46.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:45 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1755203699' entity='client.admin' 2024-08-28T19:23:46.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:45 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1092491043' entity='client.admin' 2024-08-28T19:23:46.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.182+0000 7f73d9135640 1 -- 172.21.15.33:0/3532895262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d4108a90 msgr2=0x7f73d410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.182+0000 7f73d9135640 1 --2- 172.21.15.33:0/3532895262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d4108a90 0x7f73d410f2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009ca0 tx=0x7f73cc02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.182+0000 7f73d9135640 1 -- 172.21.15.33:0/3532895262 shutdown_connections 2024-08-28T19:23:46.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.182+0000 7f73d9135640 1 --2- 172.21.15.33:0/3532895262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d4108a90 0x7f73d410f2c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.182+0000 7f73d9135640 1 --2- 172.21.15.33:0/3532895262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73d4108140 0x7f73d4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.182+0000 7f73d9135640 1 --2- 172.21.15.33:0/3532895262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73d4102800 0x7f73d4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.182+0000 7f73d9135640 1 -- 172.21.15.33:0/3532895262 >> 172.21.15.33:0/3532895262 conn(0x7f73d40794d0 msgr2=0x7f73d40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.182+0000 7f73d9135640 1 -- 172.21.15.33:0/3532895262 shutdown_connections 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.182+0000 7f73d9135640 1 -- 172.21.15.33:0/3532895262 wait complete. 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.183+0000 7f73d9135640 1 Processor -- start 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.183+0000 7f73d9135640 1 -- start start 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d9135640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73d4102800 0x7f73d419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d9135640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73d4108140 0x7f73d419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d9135640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d4108a90 0x7f73d419fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d9135640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f73d4113700 con 0x7f73d4108a90 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d9135640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73d4113580 con 0x7f73d4108140 2024-08-28T19:23:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d9135640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f73d4113880 con 0x7f73d4102800 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d359e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d4108a90 0x7f73d419fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d359e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d4108a90 0x7f73d419fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55818/0 (socket says 172.21.15.33:55818) 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d359e640 1 -- 172.21.15.33:0/3082882594 learned_addr learned my addr 172.21.15.33:0/3082882594 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d259c640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73d4108140 0x7f73d419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d2d9d640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73d4102800 0x7f73d419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d359e640 1 -- 172.21.15.33:0/3082882594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73d4102800 msgr2=0x7f73d419a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d359e640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73d4102800 0x7f73d419a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d359e640 1 -- 172.21.15.33:0/3082882594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73d4108140 msgr2=0x7f73d419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d359e640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73d4108140 0x7f73d419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d359e640 1 -- 172.21.15.33:0/3082882594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d41a01c0 con 0x7f73d4108a90 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.184+0000 7f73d359e640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d4108a90 0x7f73d419fa90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f73cc006010 tx=0x7f73cc0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.185+0000 7f73bbfff640 1 -- 172.21.15.33:0/3082882594 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc003b70 con 0x7f73d4108a90 2024-08-28T19:23:46.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.185+0000 7f73d9135640 1 -- 172.21.15.33:0/3082882594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d41a0450 con 0x7f73d4108a90 2024-08-28T19:23:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.185+0000 7f73bbfff640 1 -- 172.21.15.33:0/3082882594 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f73cc003d10 con 0x7f73d4108a90 2024-08-28T19:23:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.185+0000 7f73bbfff640 1 -- 172.21.15.33:0/3082882594 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc004600 con 0x7f73d4108a90 2024-08-28T19:23:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.185+0000 7f73d9135640 1 -- 172.21.15.33:0/3082882594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d41a6c10 con 0x7f73d4108a90 2024-08-28T19:23:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.186+0000 7f73d9135640 1 -- 172.21.15.33:0/3082882594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d4102c10 con 0x7f73d4108a90 2024-08-28T19:23:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.187+0000 7f73bbfff640 1 -- 172.21.15.33:0/3082882594 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f73cc030740 con 0x7f73d4108a90 2024-08-28T19:23:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.188+0000 7f73bbfff640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73bc0b4af0 0x7f73bc0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.188+0000 7f73d2d9d640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73bc0b4af0 0x7f73bc0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.188+0000 7f73bbfff640 1 -- 172.21.15.33:0/3082882594 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f73cc104600 con 0x7f73d4108a90 2024-08-28T19:23:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.188+0000 7f73d2d9d640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73bc0b4af0 0x7f73bc0b7000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009bd0 tx=0x7f73c4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.197+0000 7f73bbfff640 1 -- 172.21.15.33:0/3082882594 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f73cc0cd330 con 0x7f73d4108a90 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.390+0000 7f73d9135640 1 -- 172.21.15.33:0/3082882594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f73d410a880 con 0x7f73d4108a90 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.396+0000 7f73bbfff640 1 -- 172.21.15.33:0/3082882594 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v26)=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f73cc0ccc30 con 0x7f73d4108a90 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 -- 172.21.15.33:0/3082882594 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73bc0b4af0 msgr2=0x7f73bc0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73bc0b4af0 0x7f73bc0b7000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009bd0 tx=0x7f73c4005f90 comp rx=0 tx=0).stop 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 -- 172.21.15.33:0/3082882594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d4108a90 msgr2=0x7f73d419fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d4108a90 0x7f73d419fa90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f73cc006010 tx=0x7f73cc0093d0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 -- 172.21.15.33:0/3082882594 shutdown_connections 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73d4108a90 0x7f73d419fa90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73d4108140 0x7f73d419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73bc0b4af0 0x7f73bc0b7000 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 --2- 172.21.15.33:0/3082882594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73d4102800 0x7f73d419a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 -- 172.21.15.33:0/3082882594 >> 172.21.15.33:0/3082882594 conn(0x7f73d40794d0 msgr2=0x7f73d4104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 -- 172.21.15.33:0/3082882594 shutdown_connections 2024-08-28T19:23:46.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:44.398+0000 7f73d9135640 1 -- 172.21.15.33:0/3082882594 wait complete. 2024-08-28T19:23:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.503+0000 7f8d89ea2640 1 -- 172.21.15.33:0/3062471384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d84108220 msgr2=0x7f8d8410ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.503+0000 7f8d89ea2640 1 --2- 172.21.15.33:0/3062471384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d84108220 0x7f8d8410ea50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009ca0 tx=0x7f8d7c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.503+0000 7f8d89ea2640 1 -- 172.21.15.33:0/3062471384 shutdown_connections 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.503+0000 7f8d89ea2640 1 --2- 172.21.15.33:0/3062471384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d84108220 0x7f8d8410ea50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.503+0000 7f8d89ea2640 1 --2- 172.21.15.33:0/3062471384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d841078d0 0x7f8d84107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.503+0000 7f8d89ea2640 1 --2- 172.21.15.33:0/3062471384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d84101f90 0x7f8d841023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.503+0000 7f8d89ea2640 1 -- 172.21.15.33:0/3062471384 >> 172.21.15.33:0/3062471384 conn(0x7f8d84077a00 msgr2=0x7f8d84077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.503+0000 7f8d89ea2640 1 -- 172.21.15.33:0/3062471384 shutdown_connections 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.503+0000 7f8d89ea2640 1 -- 172.21.15.33:0/3062471384 wait complete. 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.504+0000 7f8d89ea2640 1 Processor -- start 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.504+0000 7f8d89ea2640 1 -- start start 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d89ea2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d84101f90 0x7f8d8419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d89ea2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d841078d0 0x7f8d8419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d89ea2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d84108220 0x7f8d8419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d89ea2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84112640 con 0x7f8d84108220 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d89ea2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841124c0 con 0x7f8d841078d0 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d89ea2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841127c0 con 0x7f8d84101f90 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d84108220 0x7f8d8419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d84108220 0x7f8d8419b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55872/0 (socket says 172.21.15.33:55872) 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d83fff640 1 -- 172.21.15.33:0/1092491043 learned_addr learned my addr 172.21.15.33:0/1092491043 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d82ffd640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d841078d0 0x7f8d8419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d837fe640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d84101f90 0x7f8d8419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d83fff640 1 -- 172.21.15.33:0/1092491043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d84101f90 msgr2=0x7f8d8419aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d83fff640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d84101f90 0x7f8d8419aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d83fff640 1 -- 172.21.15.33:0/1092491043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d841078d0 msgr2=0x7f8d8419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d83fff640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d841078d0 0x7f8d8419b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d83fff640 1 -- 172.21.15.33:0/1092491043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d841a6200 con 0x7f8d84108220 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d82ffd640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d841078d0 0x7f8d8419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:23:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.505+0000 7f8d83fff640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d84108220 0x7f8d8419b970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c005e30 tx=0x7f8d7c009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.506+0000 7f8d80ff9640 1 -- 172.21.15.33:0/1092491043 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c003c30 con 0x7f8d84108220 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.506+0000 7f8d80ff9640 1 -- 172.21.15.33:0/1092491043 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8d7c003dd0 con 0x7f8d84108220 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.506+0000 7f8d89ea2640 1 -- 172.21.15.33:0/1092491043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d841a6490 con 0x7f8d84108220 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.506+0000 7f8d80ff9640 1 -- 172.21.15.33:0/1092491043 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c004550 con 0x7f8d84108220 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.506+0000 7f8d89ea2640 1 -- 172.21.15.33:0/1092491043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d841a6a20 con 0x7f8d84108220 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.507+0000 7f8d89ea2640 1 -- 172.21.15.33:0/1092491043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d841023a0 con 0x7f8d84108220 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.509+0000 7f8d80ff9640 1 -- 172.21.15.33:0/1092491043 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f8d7c030c40 con 0x7f8d84108220 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.510+0000 7f8d80ff9640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d700b4b70 0x7f8d700b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.511+0000 7f8d837fe640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d700b4b70 0x7f8d700b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.511+0000 7f8d80ff9640 1 -- 172.21.15.33:0/1092491043 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8d7c104550 con 0x7f8d84108220 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.511+0000 7f8d837fe640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d700b4b70 0x7f8d700b7080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8d8410ffd0 tx=0x7f8d6c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.513+0000 7f8d80ff9640 1 -- 172.21.15.33:0/1092491043 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d7c0cd280 con 0x7f8d84108220 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.704+0000 7f8d89ea2640 1 -- 172.21.15.33:0/1092491043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f8d8410f880 con 0x7f8d84108220 2024-08-28T19:23:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.708+0000 7f8d80ff9640 1 -- 172.21.15.33:0/1092491043 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v29)=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7f8d7c0ccb80 con 0x7f8d84108220 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 -- 172.21.15.33:0/1092491043 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d700b4b70 msgr2=0x7f8d700b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d700b4b70 0x7f8d700b7080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8d8410ffd0 tx=0x7f8d6c005f90 comp rx=0 tx=0).stop 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 -- 172.21.15.33:0/1092491043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d84108220 msgr2=0x7f8d8419b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d84108220 0x7f8d8419b970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c005e30 tx=0x7f8d7c009870 comp rx=0 tx=0).stop 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 -- 172.21.15.33:0/1092491043 shutdown_connections 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d84108220 0x7f8d8419b970 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d841078d0 0x7f8d8419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d700b4b70 0x7f8d700b7080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 --2- 172.21.15.33:0/1092491043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d84101f90 0x7f8d8419aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 -- 172.21.15.33:0/1092491043 >> 172.21.15.33:0/1092491043 conn(0x7f8d84077a00 msgr2=0x7f8d841059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 -- 172.21.15.33:0/1092491043 shutdown_connections 2024-08-28T19:23:46.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:45.710+0000 7f8d89ea2640 1 -- 172.21.15.33:0/1092491043 wait complete. 2024-08-28T19:23:47.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:47 smithi033 ceph-mon[18549]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:47.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:47 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3091992498' entity='client.admin' 2024-08-28T19:23:47.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:47 smithi059 ceph-mon[22052]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:47.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:47 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3091992498' entity='client.admin' 2024-08-28T19:23:47.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:47 smithi122 ceph-mon[22174]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:47.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:47 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3091992498' entity='client.admin' 2024-08-28T19:23:49.253 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:49 smithi033 ceph-mon[18549]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:49.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:49 smithi059 ceph-mon[22052]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:49.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:49 smithi122 ceph-mon[22174]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.822+0000 7fede7def640 1 -- 172.21.15.33:0/1431669022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede0109240 msgr2=0x7fede0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.822+0000 7fede7def640 1 --2- 172.21.15.33:0/1431669022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede0109240 0x7fede0109650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fedd0009900 tx=0x7fedd002a3f0 comp rx=0 tx=0).stop 2024-08-28T19:23:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.822+0000 7fede7def640 1 -- 172.21.15.33:0/1431669022 shutdown_connections 2024-08-28T19:23:49.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.822+0000 7fede7def640 1 --2- 172.21.15.33:0/1431669022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede0109b90 0x7fede01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.822+0000 7fede7def640 1 --2- 172.21.15.33:0/1431669022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede0109240 0x7fede0109650 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.822+0000 7fede7def640 1 --2- 172.21.15.33:0/1431669022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fede0103900 0x7fede0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.822+0000 7fede7def640 1 -- 172.21.15.33:0/1431669022 >> 172.21.15.33:0/1431669022 conn(0x7fede007b5f0 msgr2=0x7fede007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.822+0000 7fede7def640 1 -- 172.21.15.33:0/1431669022 shutdown_connections 2024-08-28T19:23:49.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.822+0000 7fede7def640 1 -- 172.21.15.33:0/1431669022 wait complete. 2024-08-28T19:23:49.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede7def640 1 Processor -- start 2024-08-28T19:23:49.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede7def640 1 -- start start 2024-08-28T19:23:49.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede7def640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede0103900 0x7fede00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:49.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede7def640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fede0109240 0x7fede00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:49.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede7def640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede0109b90 0x7fede0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:49.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede7def640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fede0113780 con 0x7fede0103900 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede7def640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fede0113600 con 0x7fede0109240 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede7def640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fede0113900 con 0x7fede0109b90 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede5b8b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede0103900 0x7fede00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede5b8b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede0103900 0x7fede00754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53118/0 (socket says 172.21.15.33:53118) 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede5b8b640 1 -- 172.21.15.33:0/867349322 learned_addr learned my addr 172.21.15.33:0/867349322 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede538a640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fede0109240 0x7fede00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.823+0000 7fede638c640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede0109b90 0x7fede0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fede5b8b640 1 -- 172.21.15.33:0/867349322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede0109b90 msgr2=0x7fede0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fede5b8b640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede0109b90 0x7fede0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fede5b8b640 1 -- 172.21.15.33:0/867349322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fede0109240 msgr2=0x7fede00759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fede5b8b640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fede0109240 0x7fede00759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:49.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fede5b8b640 1 -- 172.21.15.33:0/867349322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede01a83c0 con 0x7fede0103900 2024-08-28T19:23:49.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fede538a640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fede0109240 0x7fede00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:23:49.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fede5b8b640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede0103900 0x7fede00754b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c920 tx=0x7feddc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:49.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fedd6ffd640 1 -- 172.21.15.33:0/867349322 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc007c70 con 0x7fede0103900 2024-08-28T19:23:49.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fedd6ffd640 1 -- 172.21.15.33:0/867349322 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7feddc007e10 con 0x7fede0103900 2024-08-28T19:23:49.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fede7def640 1 -- 172.21.15.33:0/867349322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede01a86b0 con 0x7fede0103900 2024-08-28T19:23:49.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fedd6ffd640 1 -- 172.21.15.33:0/867349322 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc018720 con 0x7fede0103900 2024-08-28T19:23:49.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.824+0000 7fede7def640 1 -- 172.21.15.33:0/867349322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede01a8c10 con 0x7fede0103900 2024-08-28T19:23:49.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.826+0000 7fede7def640 1 -- 172.21.15.33:0/867349322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede0103d10 con 0x7fede0103900 2024-08-28T19:23:49.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.827+0000 7fedd6ffd640 1 -- 172.21.15.33:0/867349322 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7feddc00f450 con 0x7fede0103900 2024-08-28T19:23:49.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.828+0000 7fedd6ffd640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fedcc0b4b70 0x7fedcc0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:49.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.828+0000 7fede538a640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fedcc0b4b70 0x7fedcc0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:49.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.828+0000 7fedd6ffd640 1 -- 172.21.15.33:0/867349322 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7feddc0e3880 con 0x7fede0103900 2024-08-28T19:23:49.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.829+0000 7fede538a640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fedcc0b4b70 0x7fedcc0b7080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedd002a9e0 tx=0x7fedd0000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:49.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.831+0000 7fedd6ffd640 1 -- 172.21.15.33:0/867349322 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7feddc014030 con 0x7fede0103900 2024-08-28T19:23:50.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.021+0000 7fede7def640 1 -- 172.21.15.33:0/867349322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fede00767b0 con 0x7fede0103900 2024-08-28T19:23:50.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.025+0000 7fedd6ffd640 1 -- 172.21.15.33:0/867349322 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v33)=0 v33) ==== 123+0+0 (secure 0 0 0) 0x7fede00767b0 con 0x7fede0103900 2024-08-28T19:23:50.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.026+0000 7fedd6ffd640 1 -- 172.21.15.33:0/867349322 <== mon.0 v2:172.21.15.33:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feddc0abad0 con 0x7fede0103900 2024-08-28T19:23:50.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 -- 172.21.15.33:0/867349322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fedcc0b4b70 msgr2=0x7fedcc0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fedcc0b4b70 0x7fedcc0b7080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fedd002a9e0 tx=0x7fedd0000bc0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 -- 172.21.15.33:0/867349322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede0103900 msgr2=0x7fede00754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede0103900 0x7fede00754b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c920 tx=0x7feddc00cde0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 -- 172.21.15.33:0/867349322 shutdown_connections 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fedcc0b4b70 0x7fedcc0b7080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fede0109b90 0x7fede0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fede0109240 0x7fede00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 --2- 172.21.15.33:0/867349322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede0103900 0x7fede00754b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 -- 172.21.15.33:0/867349322 >> 172.21.15.33:0/867349322 conn(0x7fede007b5f0 msgr2=0x7fede0105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 -- 172.21.15.33:0/867349322 shutdown_connections 2024-08-28T19:23:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:50.027+0000 7fede7def640 1 -- 172.21.15.33:0/867349322 wait complete. 2024-08-28T19:23:50.310 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:50 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2021822674' entity='client.admin' 2024-08-28T19:23:50.310 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:50 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4272743817' entity='client.admin' 2024-08-28T19:23:50.311 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:50 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/867349322' entity='client.admin' 2024-08-28T19:23:50.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:50 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2021822674' entity='client.admin' 2024-08-28T19:23:50.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:50 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4272743817' entity='client.admin' 2024-08-28T19:23:50.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:50 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/867349322' entity='client.admin' 2024-08-28T19:23:50.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:50 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2021822674' entity='client.admin' 2024-08-28T19:23:50.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:50 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4272743817' entity='client.admin' 2024-08-28T19:23:50.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:50 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/867349322' entity='client.admin' 2024-08-28T19:23:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.464+0000 7f43b1f38640 1 -- 172.21.15.33:0/2021201539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ac108ac0 msgr2=0x7f43ac10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.464+0000 7f43b1f38640 1 --2- 172.21.15.33:0/2021201539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ac108ac0 0x7f43ac10f2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009ca0 tx=0x7f43a402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.464+0000 7f43b1f38640 1 -- 172.21.15.33:0/2021201539 shutdown_connections 2024-08-28T19:23:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.464+0000 7f43b1f38640 1 --2- 172.21.15.33:0/2021201539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ac108ac0 0x7f43ac10f2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.464+0000 7f43b1f38640 1 --2- 172.21.15.33:0/2021201539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43ac108170 0x7f43ac108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.464+0000 7f43b1f38640 1 --2- 172.21.15.33:0/2021201539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ac102880 0x7f43ac102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.464+0000 7f43b1f38640 1 -- 172.21.15.33:0/2021201539 >> 172.21.15.33:0/2021201539 conn(0x7f43ac079530 msgr2=0x7f43ac079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.464+0000 7f43b1f38640 1 -- 172.21.15.33:0/2021201539 shutdown_connections 2024-08-28T19:23:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.464+0000 7f43b1f38640 1 -- 172.21.15.33:0/2021201539 wait complete. 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43b1f38640 1 Processor -- start 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43b1f38640 1 -- start start 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43b1f38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ac102880 0x7f43ac19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43b1f38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43ac108170 0x7f43ac19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43b1f38640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ac108ac0 0x7f43ac19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43b1f38640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac112630 con 0x7f43ac102880 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43b1f38640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1124b0 con 0x7f43ac108ac0 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43b1f38640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1127b0 con 0x7f43ac108170 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43ab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ac102880 0x7f43ac19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43ab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ac102880 0x7f43ac19a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53098/0 (socket says 172.21.15.33:53098) 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43ab7fe640 1 -- 172.21.15.33:0/4272743817 learned_addr learned my addr 172.21.15.33:0/4272743817 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43abfff640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ac108ac0 0x7f43ac19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43a3fff640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43ac108170 0x7f43ac19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43ab7fe640 1 -- 172.21.15.33:0/4272743817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43ac108170 msgr2=0x7f43ac19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43ab7fe640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43ac108170 0x7f43ac19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43ab7fe640 1 -- 172.21.15.33:0/4272743817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ac108ac0 msgr2=0x7f43ac19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43ab7fe640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ac108ac0 0x7f43ac19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43ab7fe640 1 -- 172.21.15.33:0/4272743817 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac1a0140 con 0x7f43ac102880 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43a3fff640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43ac108170 0x7f43ac19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.465+0000 7f43ab7fe640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ac102880 0x7f43ac19a1d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f439c00d950 tx=0x7f439c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.466+0000 7f43a97fa640 1 -- 172.21.15.33:0/4272743817 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c017070 con 0x7f43ac102880 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.466+0000 7f43b1f38640 1 -- 172.21.15.33:0/4272743817 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ac1a0430 con 0x7f43ac102880 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.466+0000 7f43a97fa640 1 -- 172.21.15.33:0/4272743817 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f439c009c30 con 0x7f43ac102880 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.466+0000 7f43a97fa640 1 -- 172.21.15.33:0/4272743817 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c00f620 con 0x7f43ac102880 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.466+0000 7f43b1f38640 1 -- 172.21.15.33:0/4272743817 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ac1a6b90 con 0x7f43ac102880 2024-08-28T19:23:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.467+0000 7f43b1f38640 1 -- 172.21.15.33:0/4272743817 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ac102c90 con 0x7f43ac102880 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.469+0000 7f43a97fa640 1 -- 172.21.15.33:0/4272743817 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f439c005030 con 0x7f43ac102880 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.470+0000 7f43a97fa640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43980b4af0 0x7f43980b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.471+0000 7f43a3fff640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43980b4af0 0x7f43980b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.471+0000 7f43a97fa640 1 -- 172.21.15.33:0/4272743817 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f439c0e3180 con 0x7f43ac102880 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.471+0000 7f43a3fff640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43980b4af0 0x7f43980b7000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4394005fd0 tx=0x7f4394005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.473+0000 7f43a97fa640 1 -- 172.21.15.33:0/4272743817 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f439c0abeb0 con 0x7f43ac102880 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.663+0000 7f43b1f38640 1 -- 172.21.15.33:0/4272743817 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f43ac19b300 con 0x7f43ac102880 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.667+0000 7f43a97fa640 1 -- 172.21.15.33:0/4272743817 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f439c009de0 con 0x7f43ac102880 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 -- 172.21.15.33:0/4272743817 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43980b4af0 msgr2=0x7f43980b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43980b4af0 0x7f43980b7000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4394005fd0 tx=0x7f4394005850 comp rx=0 tx=0).stop 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 -- 172.21.15.33:0/4272743817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ac102880 msgr2=0x7f43ac19a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ac102880 0x7f43ac19a1d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f439c00d950 tx=0x7f439c00de10 comp rx=0 tx=0).stop 2024-08-28T19:23:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 -- 172.21.15.33:0/4272743817 shutdown_connections 2024-08-28T19:23:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43ac108ac0 0x7f43ac19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43980b4af0 0x7f43980b7000 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43ac108170 0x7f43ac19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 --2- 172.21.15.33:0/4272743817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43ac102880 0x7f43ac19a1d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 -- 172.21.15.33:0/4272743817 >> 172.21.15.33:0/4272743817 conn(0x7f43ac079530 msgr2=0x7f43ac1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 -- 172.21.15.33:0/4272743817 shutdown_connections 2024-08-28T19:23:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.670+0000 7f43b1f38640 1 -- 172.21.15.33:0/4272743817 wait complete. 2024-08-28T19:23:51.157 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:51 smithi033 ceph-mon[18549]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:51 smithi059 ceph-mon[22052]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:51 smithi122 ceph-mon[22174]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.837+0000 7f88a0672640 1 -- 172.21.15.33:0/3384816049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8898108a90 msgr2=0x7f889810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.837+0000 7f88a0672640 1 --2- 172.21.15.33:0/3384816049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8898108a90 0x7f889810f2c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8890009ca0 tx=0x7f889002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.837+0000 7f88a0672640 1 -- 172.21.15.33:0/3384816049 shutdown_connections 2024-08-28T19:23:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.837+0000 7f88a0672640 1 --2- 172.21.15.33:0/3384816049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8898108a90 0x7f889810f2c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.837+0000 7f88a0672640 1 --2- 172.21.15.33:0/3384816049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8898108140 0x7f8898108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.837+0000 7f88a0672640 1 --2- 172.21.15.33:0/3384816049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8898102800 0x7f8898102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.837+0000 7f88a0672640 1 -- 172.21.15.33:0/3384816049 >> 172.21.15.33:0/3384816049 conn(0x7f88980794d0 msgr2=0x7f88980798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.837+0000 7f88a0672640 1 -- 172.21.15.33:0/3384816049 shutdown_connections 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.837+0000 7f88a0672640 1 -- 172.21.15.33:0/3384816049 wait complete. 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f88a0672640 1 Processor -- start 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f88a0672640 1 -- start start 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f88a0672640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8898102800 0x7f889819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f88a0672640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8898108140 0x7f889819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f88a0672640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8898108a90 0x7f889819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f88a0672640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f88981125d0 con 0x7f8898108140 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f88a0672640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8898112450 con 0x7f8898102800 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f88a0672640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8898112750 con 0x7f8898108a90 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889dc0d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8898108140 0x7f889819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889dc0d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8898108140 0x7f889819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53080/0 (socket says 172.21.15.33:53080) 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889dc0d640 1 -- 172.21.15.33:0/2021822674 learned_addr learned my addr 172.21.15.33:0/2021822674 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889ec0f640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8898108a90 0x7f889819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889e40e640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8898102800 0x7f889819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889dc0d640 1 -- 172.21.15.33:0/2021822674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8898108a90 msgr2=0x7f889819f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889dc0d640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8898108a90 0x7f889819f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889dc0d640 1 -- 172.21.15.33:0/2021822674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8898102800 msgr2=0x7f889819a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889dc0d640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8898102800 0x7f889819a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889dc0d640 1 -- 172.21.15.33:0/2021822674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88981a0100 con 0x7f8898108140 2024-08-28T19:23:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889ec0f640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8898108a90 0x7f889819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.838+0000 7f889e40e640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8898102800 0x7f889819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.839+0000 7f889dc0d640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8898108140 0x7f889819a730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f888c00d770 tx=0x7f888c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.839+0000 7f888b7fe640 1 -- 172.21.15.33:0/2021822674 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c017070 con 0x7f8898108140 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.839+0000 7f88a0672640 1 -- 172.21.15.33:0/2021822674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88981a03f0 con 0x7f8898108140 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.839+0000 7f888b7fe640 1 -- 172.21.15.33:0/2021822674 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f888c009c30 con 0x7f8898108140 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.839+0000 7f888b7fe640 1 -- 172.21.15.33:0/2021822674 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c00f620 con 0x7f8898108140 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.839+0000 7f88a0672640 1 -- 172.21.15.33:0/2021822674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88981a6b50 con 0x7f8898108140 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.840+0000 7f88a0672640 1 -- 172.21.15.33:0/2021822674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8898102c10 con 0x7f8898108140 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.841+0000 7f888b7fe640 1 -- 172.21.15.33:0/2021822674 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f888c01a070 con 0x7f8898108140 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.842+0000 7f888b7fe640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88840b4af0 0x7f88840b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.842+0000 7f889e40e640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88840b4af0 0x7f88840b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.842+0000 7f888b7fe640 1 -- 172.21.15.33:0/2021822674 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f888c0e30f0 con 0x7f8898108140 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.843+0000 7f889e40e640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88840b4af0 0x7f88840b7000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f88940058c0 tx=0x7f8894005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:48.845+0000 7f888b7fe640 1 -- 172.21.15.33:0/2021822674 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f888c009de0 con 0x7f8898108140 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.035+0000 7f88a0672640 1 -- 172.21.15.33:0/2021822674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f889819b2c0 con 0x7f8898108140 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.039+0000 7f888b7fe640 1 -- 172.21.15.33:0/2021822674 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v31)=0 v31) ==== 122+0+0 (secure 0 0 0) 0x7f889819b2c0 con 0x7f8898108140 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 -- 172.21.15.33:0/2021822674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88840b4af0 msgr2=0x7f88840b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88840b4af0 0x7f88840b7000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f88940058c0 tx=0x7f8894005850 comp rx=0 tx=0).stop 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 -- 172.21.15.33:0/2021822674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8898108140 msgr2=0x7f889819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8898108140 0x7f889819a730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f888c00d770 tx=0x7f888c00dc30 comp rx=0 tx=0).stop 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 -- 172.21.15.33:0/2021822674 shutdown_connections 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88840b4af0 0x7f88840b7000 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8898108a90 0x7f889819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8898108140 0x7f889819a730 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 --2- 172.21.15.33:0/2021822674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8898102800 0x7f889819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 -- 172.21.15.33:0/2021822674 >> 172.21.15.33:0/2021822674 conn(0x7f88980794d0 msgr2=0x7f889806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 -- 172.21.15.33:0/2021822674 shutdown_connections 2024-08-28T19:23:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:49.042+0000 7f88a0672640 1 -- 172.21.15.33:0/2021822674 wait complete. 2024-08-28T19:23:52.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:52.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:52.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:52 smithi033 ceph-mon[18549]: Reconfiguring mon.c (monmap changed)... 2024-08-28T19:23:52.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:52.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:52.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:52.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:52 smithi033 ceph-mon[18549]: Reconfiguring daemon mon.c on smithi122 2024-08-28T19:23:52.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:52 smithi033 ceph-mon[18549]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:52 smithi059 ceph-mon[22052]: Reconfiguring mon.c (monmap changed)... 2024-08-28T19:23:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:52 smithi059 ceph-mon[22052]: Reconfiguring daemon mon.c on smithi122 2024-08-28T19:23:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:52 smithi059 ceph-mon[22052]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:52.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:52.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:52.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:52 smithi122 ceph-mon[22174]: Reconfiguring mon.c (monmap changed)... 2024-08-28T19:23:52.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-28T19:23:52.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-28T19:23:52.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:52.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:52 smithi122 ceph-mon[22174]: Reconfiguring daemon mon.c on smithi122 2024-08-28T19:23:52.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:52 smithi122 ceph-mon[22174]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:54.067 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:54.067 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:54.067 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:54.067 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:54.067 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:54.067 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:54.227 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:54.228 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:23:54.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:54.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:54.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:54.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:54.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:54.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:54.297 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:54.297 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:54.297 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:54.297 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:54.297 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:54.297 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:54.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:54 smithi033 ceph-mon[18549]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:55.067 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.067 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.069 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi033') 2024-08-28T19:23:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:54 smithi059 ceph-mon[22052]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:55.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:54 smithi122 ceph-mon[22174]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:55.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.576+0000 7fc12599c640 1 -- 172.21.15.33:0/3720232440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc120102810 msgr2=0x7fc120102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:55.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.576+0000 7fc12599c640 1 --2- 172.21.15.33:0/3720232440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc120102810 0x7fc120102c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc110009ca0 tx=0x7fc11002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.577+0000 7fc12599c640 1 -- 172.21.15.33:0/3720232440 shutdown_connections 2024-08-28T19:23:55.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.577+0000 7fc12599c640 1 --2- 172.21.15.33:0/3720232440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc120108aa0 0x7fc12010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.577+0000 7fc12599c640 1 --2- 172.21.15.33:0/3720232440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc120108150 0x7fc120108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.577+0000 7fc12599c640 1 --2- 172.21.15.33:0/3720232440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc120102810 0x7fc120102c20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.577+0000 7fc12599c640 1 -- 172.21.15.33:0/3720232440 >> 172.21.15.33:0/3720232440 conn(0x7fc1200794b0 msgr2=0x7fc1200798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:55.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.577+0000 7fc12599c640 1 -- 172.21.15.33:0/3720232440 shutdown_connections 2024-08-28T19:23:55.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.577+0000 7fc12599c640 1 -- 172.21.15.33:0/3720232440 wait complete. 2024-08-28T19:23:55.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.577+0000 7fc12599c640 1 Processor -- start 2024-08-28T19:23:55.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc12599c640 1 -- start start 2024-08-28T19:23:55.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc12599c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc120102810 0x7fc12019b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:55.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc12599c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc120108150 0x7fc12019b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:55.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc12599c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc120108aa0 0x7fc12019bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:55.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc12599c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc1201127a0 con 0x7fc120102810 2024-08-28T19:23:55.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc12599c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc120112620 con 0x7fc120108150 2024-08-28T19:23:55.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc12599c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc120112920 con 0x7fc120108aa0 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc120102810 0x7fc12019b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc120102810 0x7fc12019b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53138/0 (socket says 172.21.15.33:53138) 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11effd640 1 -- 172.21.15.33:0/3570861669 learned_addr learned my addr 172.21.15.33:0/3570861669 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11e7fc640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc120108150 0x7fc12019b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11f7fe640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc120108aa0 0x7fc12019bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11effd640 1 -- 172.21.15.33:0/3570861669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc120108aa0 msgr2=0x7fc12019bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11effd640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc120108aa0 0x7fc12019bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11effd640 1 -- 172.21.15.33:0/3570861669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc120108150 msgr2=0x7fc12019b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11effd640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc120108150 0x7fc12019b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11effd640 1 -- 172.21.15.33:0/3570861669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1201a6320 con 0x7fc120102810 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.578+0000 7fc11effd640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc120102810 0x7fc12019b090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc110005e30 tx=0x7fc11002f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:55.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.579+0000 7fc12499a640 1 -- 172.21.15.33:0/3570861669 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110003bf0 con 0x7fc120102810 2024-08-28T19:23:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.579+0000 7fc12499a640 1 -- 172.21.15.33:0/3570861669 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc110003d90 con 0x7fc120102810 2024-08-28T19:23:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.579+0000 7fc12599c640 1 -- 172.21.15.33:0/3570861669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1201a65b0 con 0x7fc120102810 2024-08-28T19:23:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.579+0000 7fc12499a640 1 -- 172.21.15.33:0/3570861669 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11002fb10 con 0x7fc120102810 2024-08-28T19:23:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.579+0000 7fc12599c640 1 -- 172.21.15.33:0/3570861669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1201a6b40 con 0x7fc120102810 2024-08-28T19:23:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.580+0000 7fc12599c640 1 -- 172.21.15.33:0/3570861669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc120103a90 con 0x7fc120102810 2024-08-28T19:23:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.582+0000 7fc12499a640 1 -- 172.21.15.33:0/3570861669 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fc110004680 con 0x7fc120102810 2024-08-28T19:23:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.582+0000 7fc12499a640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc10c0b4ba0 0x7fc10c0b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.582+0000 7fc11e7fc640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc10c0b4ba0 0x7fc10c0b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.582+0000 7fc12499a640 1 -- 172.21.15.33:0/3570861669 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc1101049c0 con 0x7fc120102810 2024-08-28T19:23:55.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.583+0000 7fc11e7fc640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc10c0b4ba0 0x7fc10c0b70b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc120107ed0 tx=0x7fc10800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:55.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.585+0000 7fc12499a640 1 -- 172.21.15.33:0/3570861669 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc1100cd6d0 con 0x7fc120102810 2024-08-28T19:23:55.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.777+0000 7fc12599c640 1 -- 172.21.15.33:0/3570861669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fc12006bd30 con 0x7fc120102810 2024-08-28T19:23:55.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.781+0000 7fc12499a640 1 -- 172.21.15.33:0/3570861669 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v34)=0 v34) ==== 129+0+0 (secure 0 0 0) 0x7fc1100ccfd0 con 0x7fc120102810 2024-08-28T19:23:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 -- 172.21.15.33:0/3570861669 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc10c0b4ba0 msgr2=0x7fc10c0b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc10c0b4ba0 0x7fc10c0b70b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc120107ed0 tx=0x7fc10800b390 comp rx=0 tx=0).stop 2024-08-28T19:23:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 -- 172.21.15.33:0/3570861669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc120102810 msgr2=0x7fc12019b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc120102810 0x7fc12019b090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc110005e30 tx=0x7fc11002f3e0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 -- 172.21.15.33:0/3570861669 shutdown_connections 2024-08-28T19:23:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc10c0b4ba0 0x7fc10c0b70b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc120108aa0 0x7fc12019bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc120108150 0x7fc12019b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 --2- 172.21.15.33:0/3570861669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc120102810 0x7fc12019b090 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:55.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 -- 172.21.15.33:0/3570861669 >> 172.21.15.33:0/3570861669 conn(0x7fc1200794b0 msgr2=0x7fc120106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:55.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 -- 172.21.15.33:0/3570861669 shutdown_connections 2024-08-28T19:23:55.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.784+0000 7fc12599c640 1 -- 172.21.15.33:0/3570861669 wait complete. 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.908+0000 7f7f37034640 1 -- 172.21.15.33:0/4238563879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f30103900 msgr2=0x7f7f30103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.908+0000 7f7f37034640 1 --2- 172.21.15.33:0/4238563879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f30103900 0x7f7f30103d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009900 tx=0x7f7f2402a410 comp rx=0 tx=0).stop 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.908+0000 7f7f37034640 1 -- 172.21.15.33:0/4238563879 shutdown_connections 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.908+0000 7f7f37034640 1 --2- 172.21.15.33:0/4238563879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f30109b90 0x7f7f301103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.908+0000 7f7f37034640 1 --2- 172.21.15.33:0/4238563879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f30109240 0x7f7f30109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.908+0000 7f7f37034640 1 --2- 172.21.15.33:0/4238563879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f30103900 0x7f7f30103d10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.908+0000 7f7f37034640 1 -- 172.21.15.33:0/4238563879 >> 172.21.15.33:0/4238563879 conn(0x7f7f3007b5f0 msgr2=0x7f7f3007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.909+0000 7f7f37034640 1 -- 172.21.15.33:0/4238563879 shutdown_connections 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.909+0000 7f7f37034640 1 -- 172.21.15.33:0/4238563879 wait complete. 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.909+0000 7f7f37034640 1 Processor -- start 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.909+0000 7f7f37034640 1 -- start start 2024-08-28T19:23:56.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f37034640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f30103900 0x7f7f3019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f37034640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f30109240 0x7f7f3019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f37034640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f30109b90 0x7f7f3019fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f37034640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7f301138a0 con 0x7f7f30103900 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f37034640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7f30113720 con 0x7f7f30109240 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f37034640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f30113a20 con 0x7f7f30109b90 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f34dd0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f30103900 0x7f7f3019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f34dd0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f30103900 0x7f7f3019a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53154/0 (socket says 172.21.15.33:53154) 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f34dd0640 1 -- 172.21.15.33:0/3035690503 learned_addr learned my addr 172.21.15.33:0/3035690503 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f355d1640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f30109b90 0x7f7f3019fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f2ffff640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f30109240 0x7f7f3019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f34dd0640 1 -- 172.21.15.33:0/3035690503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f30109b90 msgr2=0x7f7f3019fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:56.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f34dd0640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f30109b90 0x7f7f3019fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f34dd0640 1 -- 172.21.15.33:0/3035690503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f30109240 msgr2=0x7f7f3019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f34dd0640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f30109240 0x7f7f3019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f34dd0640 1 -- 172.21.15.33:0/3035690503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f301a0200 con 0x7f7f30103900 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f2ffff640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f30109240 0x7f7f3019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f34dd0640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f30103900 0x7f7f3019a290 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7f24005ab0 tx=0x7f7f24003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f2dffb640 1 -- 172.21.15.33:0/3035690503 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2403f070 con 0x7f7f30103900 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f37034640 1 -- 172.21.15.33:0/3035690503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f301a0490 con 0x7f7f30103900 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f2dffb640 1 -- 172.21.15.33:0/3035690503 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f24031d60 con 0x7f7f30103900 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.910+0000 7f7f2dffb640 1 -- 172.21.15.33:0/3035690503 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24035030 con 0x7f7f30103900 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.911+0000 7f7f37034640 1 -- 172.21.15.33:0/3035690503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f301a6c50 con 0x7f7f30103900 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.912+0000 7f7f37034640 1 -- 172.21.15.33:0/3035690503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f30103d10 con 0x7f7f30103900 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.913+0000 7f7f2dffb640 1 -- 172.21.15.33:0/3035690503 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f7f24042070 con 0x7f7f30103900 2024-08-28T19:23:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.914+0000 7f7f2dffb640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f200b4b70 0x7f7f200b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.914+0000 7f7f2ffff640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f200b4b70 0x7f7f200b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.914+0000 7f7f2dffb640 1 -- 172.21.15.33:0/3035690503 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7f24104500 con 0x7f7f30103900 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.914+0000 7f7f2ffff640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f200b4b70 0x7f7f200b7080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0058c0 tx=0x7f7f1c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:55.917+0000 7f7f2dffb640 1 -- 172.21.15.33:0/3035690503 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7f240cd190 con 0x7f7f30103900 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.105+0000 7f7f37034640 1 -- 172.21.15.33:0/3035690503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f7f3019b3c0 con 0x7f7f30103900 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.109+0000 7f7f2dffb640 1 -- 172.21.15.33:0/3035690503 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v35)=0 v35) ==== 119+0+0 (secure 0 0 0) 0x7f7f3019b3c0 con 0x7f7f30103900 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 -- 172.21.15.33:0/3035690503 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f200b4b70 msgr2=0x7f7f200b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f200b4b70 0x7f7f200b7080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0058c0 tx=0x7f7f1c005850 comp rx=0 tx=0).stop 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 -- 172.21.15.33:0/3035690503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f30103900 msgr2=0x7f7f3019a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f30103900 0x7f7f3019a290 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7f24005ab0 tx=0x7f7f24003cd0 comp rx=0 tx=0).stop 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 -- 172.21.15.33:0/3035690503 shutdown_connections 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f200b4b70 0x7f7f200b7080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:56.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f30109b90 0x7f7f3019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:56.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f30109240 0x7f7f3019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:56.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 --2- 172.21.15.33:0/3035690503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f30103900 0x7f7f3019a290 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:23:56.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 -- 172.21.15.33:0/3035690503 >> 172.21.15.33:0/3035690503 conn(0x7f7f3007b5f0 msgr2=0x7f7f301072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:23:56.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 -- 172.21.15.33:0/3035690503 shutdown_connections 2024-08-28T19:23:56.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:23:56.112+0000 7f7f37034640 1 -- 172.21.15.33:0/3035690503 wait complete. 2024-08-28T19:23:57.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:56 smithi059 ceph-mon[22052]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:57.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:56 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3570861669' entity='client.admin' 2024-08-28T19:23:57.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:57.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:57.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:57.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:57.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:56 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3035690503' entity='client.admin' 2024-08-28T19:23:57.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:56 smithi122 ceph-mon[22174]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:57.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:56 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3570861669' entity='client.admin' 2024-08-28T19:23:57.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:57.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:57.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:57.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:57.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:56 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3035690503' entity='client.admin' 2024-08-28T19:23:57.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:56 smithi033 ceph-mon[18549]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:57.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:56 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3570861669' entity='client.admin' 2024-08-28T19:23:57.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:23:57.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:23:57.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:23:57.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:23:57.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:56 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3035690503' entity='client.admin' 2024-08-28T19:23:57.199 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi033') 2024-08-28T19:23:57.199 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi033') 2024-08-28T19:23:57.199 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi033') 2024-08-28T19:23:57.200 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi033') 2024-08-28T19:23:57.200 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi033') 2024-08-28T19:23:57.200 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi033') 2024-08-28T19:23:57.200 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi033') 2024-08-28T19:23:57.200 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi033') 2024-08-28T19:23:57.200 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi033') 2024-08-28T19:23:57.200 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '9a2fc37c-6572-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi033') 2024-08-28T19:23:57.201 INFO:tasks.cephadm:Deploying OSDs... 2024-08-28T19:23:57.201 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:23:57.201 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-08-28T19:23:57.219 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-28T19:23:57.219 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-08-28T19:23:57.276 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-28T19:23:57.276 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:57.276 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-28T19:23:57.276 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:57.276 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:57.276 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-08-28 19:22:35.185263136 +0000 2024-08-28T19:23:57.276 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-08-28 19:18:16.269499050 +0000 2024-08-28T19:23:57.276 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-08-28 19:18:16.269499050 +0000 2024-08-28T19:23:57.276 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-08-28 19:18:16.269499050 +0000 2024-08-28T19:23:57.276 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-28T19:23:57.344 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-08-28T19:23:57.344 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-08-28T19:23:57.344 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000277741 s, 1.8 MB/s 2024-08-28T19:23:57.346 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-28T19:23:57.403 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-08-28T19:23:57.459 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-28T19:23:57.459 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:57.460 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-08-28T19:23:57.460 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:57.460 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:57.460 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-08-28 19:22:35.220262542 +0000 2024-08-28T19:23:57.460 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-08-28 19:18:16.597493452 +0000 2024-08-28T19:23:57.460 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-08-28 19:18:16.597493452 +0000 2024-08-28T19:23:57.460 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-08-28 19:18:16.597493452 +0000 2024-08-28T19:23:57.460 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-28T19:23:57.524 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-08-28T19:23:57.524 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-08-28T19:23:57.524 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000211144 s, 2.4 MB/s 2024-08-28T19:23:57.526 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-28T19:23:57.583 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-08-28T19:23:57.638 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-28T19:23:57.639 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:57.639 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-28T19:23:57.639 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:57.639 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:57.639 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-08-28 19:22:35.254261966 +0000 2024-08-28T19:23:57.639 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-08-28 19:18:16.929487785 +0000 2024-08-28T19:23:57.640 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-08-28 19:18:16.929487785 +0000 2024-08-28T19:23:57.640 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-08-28 19:18:16.929487785 +0000 2024-08-28T19:23:57.640 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-28T19:23:57.704 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-08-28T19:23:57.704 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-08-28T19:23:57.704 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000242141 s, 2.1 MB/s 2024-08-28T19:23:57.705 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-28T19:23:57.762 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-08-28T19:23:57.819 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-28T19:23:57.819 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:57.819 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-28T19:23:57.819 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:57.819 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:57.819 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-08-28 19:22:35.292261321 +0000 2024-08-28T19:23:57.819 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-08-28 19:18:17.265482050 +0000 2024-08-28T19:23:57.819 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-08-28 19:18:17.265482050 +0000 2024-08-28T19:23:57.819 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-08-28 19:18:17.265482050 +0000 2024-08-28T19:23:57.820 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-28T19:23:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-08-28T19:23:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-08-28T19:23:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000185143 s, 2.8 MB/s 2024-08-28T19:23:57.885 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-28T19:23:57.942 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-08-28T19:23:57.942 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-08-28T19:23:57.962 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-28T19:23:57.962 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-08-28T19:23:58.021 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-28T19:23:58.021 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-28T19:23:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-08-28 19:23:34.161199390 +0000 2024-08-28T19:23:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-08-28 19:18:37.250432216 +0000 2024-08-28T19:23:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-08-28 19:18:37.250432216 +0000 2024-08-28T19:23:58.022 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-08-28 19:18:37.250432216 +0000 2024-08-28T19:23:58.022 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-28T19:23:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-08-28T19:23:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-08-28T19:23:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000288254 s, 1.8 MB/s 2024-08-28T19:23:58.093 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-28T19:23:58.152 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-08-28T19:23:58.210 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-28T19:23:58.210 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:58.210 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-28T19:23:58.210 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:58.210 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:58.210 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-08-28 19:23:34.161199390 +0000 2024-08-28T19:23:58.210 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-08-28 19:18:37.580428577 +0000 2024-08-28T19:23:58.210 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-08-28 19:18:37.580428577 +0000 2024-08-28T19:23:58.210 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-08-28 19:18:37.580428577 +0000 2024-08-28T19:23:58.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-28T19:23:58.277 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-08-28T19:23:58.277 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-08-28T19:23:58.277 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000208856 s, 2.5 MB/s 2024-08-28T19:23:58.278 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-28T19:23:58.338 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-08-28T19:23:58.396 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-28T19:23:58.397 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:58.397 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-28T19:23:58.397 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:58.397 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:58.397 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-08-28 19:23:34.162199378 +0000 2024-08-28T19:23:58.397 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-08-28 19:18:37.914424894 +0000 2024-08-28T19:23:58.397 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-08-28 19:18:37.914424894 +0000 2024-08-28T19:23:58.397 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-08-28 19:18:37.914424894 +0000 2024-08-28T19:23:58.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-28T19:23:58.464 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-08-28T19:23:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-08-28T19:23:58.465 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000208286 s, 2.5 MB/s 2024-08-28T19:23:58.466 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-28T19:23:58.525 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-08-28T19:23:58.585 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-28T19:23:58.585 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:58.585 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-28T19:23:58.585 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:58.585 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:58.585 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-08-28 19:23:34.162199378 +0000 2024-08-28T19:23:58.585 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-08-28 19:18:38.247421222 +0000 2024-08-28T19:23:58.585 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-08-28 19:18:38.247421222 +0000 2024-08-28T19:23:58.585 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-08-28 19:18:38.247421222 +0000 2024-08-28T19:23:58.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-28T19:23:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-08-28T19:23:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-08-28T19:23:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000313009 s, 1.6 MB/s 2024-08-28T19:23:58.654 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-28T19:23:58.714 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-08-28T19:23:58.714 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-08-28T19:23:58.733 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-28T19:23:58.733 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-08-28T19:23:58.792 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-28T19:23:58.792 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:58.792 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-28T19:23:58.793 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:58.793 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:58.793 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-08-28 19:23:31.921763586 +0000 2024-08-28T19:23:58.793 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-08-28 19:18:35.854080209 +0000 2024-08-28T19:23:58.793 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-08-28 19:18:35.854080209 +0000 2024-08-28T19:23:58.793 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-08-28 19:18:35.854080209 +0000 2024-08-28T19:23:58.793 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-28T19:23:58.865 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-08-28T19:23:58.865 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-08-28T19:23:58.865 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000344599 s, 1.5 MB/s 2024-08-28T19:23:58.866 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-28T19:23:58.925 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-08-28T19:23:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-28T19:23:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:58.983 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-28T19:23:58.983 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:58.983 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:58.983 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-08-28 19:23:31.922763581 +0000 2024-08-28T19:23:58.984 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-08-28 19:18:36.169079364 +0000 2024-08-28T19:23:58.984 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-08-28 19:18:36.169079364 +0000 2024-08-28T19:23:58.984 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-08-28 19:18:36.169079364 +0000 2024-08-28T19:23:58.984 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-28T19:23:59.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:23:58 smithi122 ceph-mon[22174]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:59.048 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-08-28T19:23:59.048 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-08-28T19:23:59.048 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000252938 s, 2.0 MB/s 2024-08-28T19:23:59.049 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-28T19:23:59.099 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:23:58 smithi033 ceph-mon[18549]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:59.107 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-08-28T19:23:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-28T19:23:59.163 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:59.163 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-08-28T19:23:59.163 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:59.163 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:59.163 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-08-28 19:23:31.922763581 +0000 2024-08-28T19:23:59.163 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-08-28 19:18:36.484078519 +0000 2024-08-28T19:23:59.164 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-08-28 19:18:36.484078519 +0000 2024-08-28T19:23:59.164 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-08-28 19:18:36.484078519 +0000 2024-08-28T19:23:59.164 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-28T19:23:59.228 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-08-28T19:23:59.228 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-08-28T19:23:59.228 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000276425 s, 1.9 MB/s 2024-08-28T19:23:59.229 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-28T19:23:59.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:23:58 smithi059 ceph-mon[22052]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:23:59.285 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-08-28T19:23:59.341 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-28T19:23:59.342 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-28T19:23:59.342 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-28T19:23:59.342 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:23:59.342 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-08-28T19:23:59.342 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-08-28 19:23:31.922763581 +0000 2024-08-28T19:23:59.342 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-08-28 19:18:36.800077671 +0000 2024-08-28T19:23:59.342 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-08-28 19:18:36.800077671 +0000 2024-08-28T19:23:59.342 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-08-28 19:18:36.800077671 +0000 2024-08-28T19:23:59.342 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-28T19:23:59.405 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-08-28T19:23:59.406 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-08-28T19:23:59.406 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000193432 s, 2.6 MB/s 2024-08-28T19:23:59.407 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-28T19:23:59.463 INFO:tasks.cephadm:Deploying osd.0 on smithi033 with /dev/vg_nvme/lv_4... 2024-08-28T19:23:59.463 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-28T19:23:59.742 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:24:01.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:00 smithi033 ceph-mon[18549]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:01.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:00 smithi122 ceph-mon[22174]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:01.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:00 smithi059 ceph-mon[22052]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:02.098 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:24:02.125 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_4 2024-08-28T19:24:02.376 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:24:02.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.807+0000 7f3355dea640 1 -- 172.21.15.33:0/2715972691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33501039d0 msgr2=0x7f3350103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:02.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.807+0000 7f3355dea640 1 --2- 172.21.15.33:0/2715972691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33501039d0 0x7f3350103de0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3340009ca0 tx=0x7f334002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:24:02.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.807+0000 7f3355dea640 1 -- 172.21.15.33:0/2715972691 shutdown_connections 2024-08-28T19:24:02.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.807+0000 7f3355dea640 1 --2- 172.21.15.33:0/2715972691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3350109c60 0x7f3350110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:02.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.807+0000 7f3355dea640 1 --2- 172.21.15.33:0/2715972691 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3350109310 0x7f3350109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:02.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.807+0000 7f3355dea640 1 --2- 172.21.15.33:0/2715972691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33501039d0 0x7f3350103de0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:02.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.807+0000 7f3355dea640 1 -- 172.21.15.33:0/2715972691 >> 172.21.15.33:0/2715972691 conn(0x7f335007b670 msgr2=0x7f335007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:24:02.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.807+0000 7f3355dea640 1 -- 172.21.15.33:0/2715972691 shutdown_connections 2024-08-28T19:24:02.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.807+0000 7f3355dea640 1 -- 172.21.15.33:0/2715972691 wait complete. 2024-08-28T19:24:02.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.808+0000 7f3355dea640 1 Processor -- start 2024-08-28T19:24:02.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.808+0000 7f3355dea640 1 -- start start 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.808+0000 7f3355dea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33501039d0 0x7f335019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.808+0000 7f3355dea640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3350109310 0x7f335019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.808+0000 7f3355dea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3350109c60 0x7f335019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f3355dea640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3350113880 con 0x7f3350109310 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f3355dea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3350113700 con 0x7f33501039d0 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f3355dea640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3350113a00 con 0x7f3350109c60 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3350109310 0x7f335019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3350109310 0x7f335019a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35900/0 (socket says 172.21.15.33:35900) 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334effd640 1 -- 172.21.15.33:0/589187251 learned_addr learned my addr 172.21.15.33:0/589187251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334f7fe640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33501039d0 0x7f335019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334ffff640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3350109c60 0x7f335019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334effd640 1 -- 172.21.15.33:0/589187251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3350109c60 msgr2=0x7f335019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334effd640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3350109c60 0x7f335019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:02.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334effd640 1 -- 172.21.15.33:0/589187251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33501039d0 msgr2=0x7f335019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:02.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334effd640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33501039d0 0x7f335019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:02.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334effd640 1 -- 172.21.15.33:0/589187251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33501a00e0 con 0x7f3350109310 2024-08-28T19:24:02.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334ffff640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3350109c60 0x7f335019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:24:02.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334effd640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3350109310 0x7f335019a7d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f333800c8c0 tx=0x7f333800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:24:02.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334cff9640 1 -- 172.21.15.33:0/589187251 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338007bb0 con 0x7f3350109310 2024-08-28T19:24:02.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334cff9640 1 -- 172.21.15.33:0/589187251 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3338007d50 con 0x7f3350109310 2024-08-28T19:24:02.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f3355dea640 1 -- 172.21.15.33:0/589187251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33501a03d0 con 0x7f3350109310 2024-08-28T19:24:02.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f334cff9640 1 -- 172.21.15.33:0/589187251 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33380187c0 con 0x7f3350109310 2024-08-28T19:24:02.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.809+0000 7f3355dea640 1 -- 172.21.15.33:0/589187251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33501a6bf0 con 0x7f3350109310 2024-08-28T19:24:02.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.810+0000 7f3355dea640 1 -- 172.21.15.33:0/589187251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3350103de0 con 0x7f3350109310 2024-08-28T19:24:02.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.813+0000 7f334cff9640 1 -- 172.21.15.33:0/589187251 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f333800fa20 con 0x7f3350109310 2024-08-28T19:24:02.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.814+0000 7f334cff9640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f333c0b4ba0 0x7f333c0b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:02.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.814+0000 7f334f7fe640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f333c0b4ba0 0x7f333c0b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:02.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.814+0000 7f334cff9640 1 -- 172.21.15.33:0/589187251 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f33380e3a00 con 0x7f3350109310 2024-08-28T19:24:02.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.815+0000 7f334f7fe640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f333c0b4ba0 0x7f333c0b70b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3340000f80 tx=0x7f3340009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:24:02.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:02.817+0000 7f334cff9640 1 -- 172.21.15.33:0/589187251 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3338014030 con 0x7f3350109310 2024-08-28T19:24:03.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:03.013+0000 7f3355dea640 1 -- 172.21.15.33:0/589187251 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f33500635a0 con 0x7f333c0b4ba0 2024-08-28T19:24:03.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:02 smithi122 ceph-mon[22174]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:03.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:02 smithi033 ceph-mon[18549]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:03.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:02 smithi059 ceph-mon[22052]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:04.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:03 smithi033 ceph-mon[18549]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:24:04.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:24:04.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:24:04.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:04.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:03 smithi059 ceph-mon[22052]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:24:04.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:24:04.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:24:04.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:04.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:03 smithi122 ceph-mon[22174]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:24:04.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:24:04.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:24:04.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:04.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:04 smithi033 ceph-mon[18549]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:05.184 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:04 smithi059 ceph-mon[22052]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:05.194 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:04 smithi122 ceph-mon[22174]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:05 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/864648486' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28b050d5-5123-449b-a514-0404c1520c85"} : dispatch 2024-08-28T19:24:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:05 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/864648486' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28b050d5-5123-449b-a514-0404c1520c85"}]': finished 2024-08-28T19:24:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:05 smithi033 ceph-mon[18549]: osdmap e6: 1 total, 0 up, 1 in 2024-08-28T19:24:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:06.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:05 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/864648486' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28b050d5-5123-449b-a514-0404c1520c85"} : dispatch 2024-08-28T19:24:06.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:05 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/864648486' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28b050d5-5123-449b-a514-0404c1520c85"}]': finished 2024-08-28T19:24:06.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:05 smithi059 ceph-mon[22052]: osdmap e6: 1 total, 0 up, 1 in 2024-08-28T19:24:06.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:06.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:05 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/864648486' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28b050d5-5123-449b-a514-0404c1520c85"} : dispatch 2024-08-28T19:24:06.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:05 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/864648486' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28b050d5-5123-449b-a514-0404c1520c85"}]': finished 2024-08-28T19:24:06.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:05 smithi122 ceph-mon[22174]: osdmap e6: 1 total, 0 up, 1 in 2024-08-28T19:24:06.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:07.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:06 smithi033 ceph-mon[18549]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:07.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:06 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4245946704' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:24:07.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:06 smithi059 ceph-mon[22052]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:07.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:06 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4245946704' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:24:07.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:06 smithi122 ceph-mon[22174]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:07.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:06 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4245946704' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:24:09.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:08 smithi033 ceph-mon[18549]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:09.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:08 smithi059 ceph-mon[22052]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:09.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:08 smithi122 ceph-mon[22174]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:10.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:10 smithi033 ceph-mon[18549]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:10 smithi059 ceph-mon[22052]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:11.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:10 smithi122 ceph-mon[22174]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:13.121 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:12 smithi033 ceph-mon[18549]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:13.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:12 smithi059 ceph-mon[22052]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:13.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:12 smithi122 ceph-mon[22174]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:14.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-28T19:24:14.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:14.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-28T19:24:14.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:14.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-28T19:24:14.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:15.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:14 smithi033 ceph-mon[18549]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:15.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:14 smithi033 ceph-mon[18549]: Deploying daemon osd.0 on smithi033 2024-08-28T19:24:15.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:14 smithi059 ceph-mon[22052]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:15.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:14 smithi059 ceph-mon[22052]: Deploying daemon osd.0 on smithi033 2024-08-28T19:24:15.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:14 smithi122 ceph-mon[22174]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:15.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:14 smithi122 ceph-mon[22174]: Deploying daemon osd.0 on smithi033 2024-08-28T19:24:17.122 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:16 smithi033 ceph-mon[18549]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:17.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:16 smithi059 ceph-mon[22052]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:17.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:16 smithi122 ceph-mon[22174]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:18.907 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:18 smithi033 ceph-mon[18549]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:19.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:18 smithi059 ceph-mon[22052]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:19.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:18 smithi122 ceph-mon[22174]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:19.925 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:19 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:19.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:19 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:19.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:19 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:20.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:19 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:20.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:19 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:20.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:19 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:20.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:19 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:20.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:19 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:20.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:19 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:21.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:20 smithi059 ceph-mon[22052]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:21.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:20 smithi122 ceph-mon[22174]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:21.342 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:20 smithi033 ceph-mon[18549]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:22 smithi059 ceph-mon[22052]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:22.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:22.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:22.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:22.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:22.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:22.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:22 smithi122 ceph-mon[22174]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:22.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:22.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:22.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:22.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:22.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:22.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:22 smithi033 ceph-mon[18549]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:23.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.184+0000 7f334cff9640 1 -- 172.21.15.33:0/589187251 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f33500635a0 con 0x7f333c0b4ba0 2024-08-28T19:24:23.186 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 0 on host 'smithi033' 2024-08-28T19:24:23.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.186+0000 7f3355dea640 1 -- 172.21.15.33:0/589187251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f333c0b4ba0 msgr2=0x7f333c0b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:23.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.186+0000 7f3355dea640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f333c0b4ba0 0x7f333c0b70b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3340000f80 tx=0x7f3340009360 comp rx=0 tx=0).stop 2024-08-28T19:24:23.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.187+0000 7f3355dea640 1 -- 172.21.15.33:0/589187251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3350109310 msgr2=0x7f335019a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:23.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.187+0000 7f3355dea640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3350109310 0x7f335019a7d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f333800c8c0 tx=0x7f333800cd80 comp rx=0 tx=0).stop 2024-08-28T19:24:23.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.187+0000 7f3355dea640 1 -- 172.21.15.33:0/589187251 shutdown_connections 2024-08-28T19:24:23.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.187+0000 7f3355dea640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f333c0b4ba0 0x7f333c0b70b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:23.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.187+0000 7f3355dea640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3350109c60 0x7f335019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:23.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.187+0000 7f3355dea640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3350109310 0x7f335019a7d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:23.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.187+0000 7f3355dea640 1 --2- 172.21.15.33:0/589187251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33501039d0 0x7f335019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.187+0000 7f3355dea640 1 -- 172.21.15.33:0/589187251 >> 172.21.15.33:0/589187251 conn(0x7f335007b670 msgr2=0x7f3350107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:24:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.187+0000 7f3355dea640 1 -- 172.21.15.33:0/589187251 shutdown_connections 2024-08-28T19:24:23.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:24:23.187+0000 7f3355dea640 1 -- 172.21.15.33:0/589187251 wait complete. 2024-08-28T19:24:23.749 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:23 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:23.790 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:23 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:23.790 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:23 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:23.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:23 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:23.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:23 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:23.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:23 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:23.791 DEBUG:teuthology.orchestra.run.smithi033:osd.0> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.0.service 2024-08-28T19:24:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:23 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:23 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:23 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:23.794 INFO:tasks.cephadm:Deploying osd.1 on smithi059 with /dev/vg_nvme/lv_4... 2024-08-28T19:24:23.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-28T19:24:24.054 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:24:24.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:24 smithi033 ceph-mon[18549]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:24 smithi059 ceph-mon[22052]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:24 smithi122 ceph-mon[22174]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:25.325 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:24:24 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0[37223]: 2024-08-28T19:24:24.993+0000 7f0520238640 -1 osd.0 0 log_to_monitors true 2024-08-28T19:24:25.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:25 smithi033 ceph-mon[18549]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-28T19:24:25.762 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:25 smithi059 ceph-mon[22052]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-28T19:24:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:25 smithi122 ceph-mon[22174]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-28T19:24:26.382 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:24:26.411 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_4 2024-08-28T19:24:26.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:26 smithi033 ceph-mon[18549]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-28T19:24:26.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:26 smithi033 ceph-mon[18549]: osdmap e7: 1 total, 0 up, 1 in 2024-08-28T19:24:26.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:26 smithi033 ceph-mon[18549]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:24:26.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:26.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:26 smithi033 ceph-mon[18549]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:26.630 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:24:26 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0[37223]: 2024-08-28T19:24:26.509+0000 7f051c1ba640 -1 osd.0 0 waiting for initial osdmap 2024-08-28T19:24:26.630 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:24:26 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0[37223]: 2024-08-28T19:24:26.512+0000 7f0517fb8640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:24:26.671 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:24:26.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:26 smithi059 ceph-mon[22052]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-28T19:24:26.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:26 smithi059 ceph-mon[22052]: osdmap e7: 1 total, 0 up, 1 in 2024-08-28T19:24:26.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:26 smithi059 ceph-mon[22052]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:24:26.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:26.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:26 smithi059 ceph-mon[22052]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:26 smithi122 ceph-mon[22174]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-28T19:24:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:26 smithi122 ceph-mon[22174]: osdmap e7: 1 total, 0 up, 1 in 2024-08-28T19:24:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:26 smithi122 ceph-mon[22174]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:24:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:26 smithi122 ceph-mon[22174]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:27.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.143+0000 7fafe2ab0640 1 -- 172.21.15.59:0/3724341259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafdc10dbc0 msgr2=0x7fafdc1100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.143+0000 7fafe2ab0640 1 --2- 172.21.15.59:0/3724341259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafdc10dbc0 0x7fafdc1100b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009ca0 tx=0x7fafd402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.143+0000 7fafe2ab0640 1 -- 172.21.15.59:0/3724341259 shutdown_connections 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.143+0000 7fafe2ab0640 1 --2- 172.21.15.59:0/3724341259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafdc10dbc0 0x7fafdc1100b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.143+0000 7fafe2ab0640 1 --2- 172.21.15.59:0/3724341259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafdc1050b0 0x7fafdc10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.143+0000 7fafe2ab0640 1 --2- 172.21.15.59:0/3724341259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafdc104760 0x7fafdc104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.143+0000 7fafe2ab0640 1 -- 172.21.15.59:0/3724341259 >> 172.21.15.59:0/3724341259 conn(0x7fafdc0794d0 msgr2=0x7fafdc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.143+0000 7fafe2ab0640 1 -- 172.21.15.59:0/3724341259 shutdown_connections 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.143+0000 7fafe2ab0640 1 -- 172.21.15.59:0/3724341259 wait complete. 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe2ab0640 1 Processor -- start 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe2ab0640 1 -- start start 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe2ab0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafdc104760 0x7fafdc1024a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:27.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe2ab0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafdc1050b0 0x7fafdc1029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe2ab0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafdc10dbc0 0x7fafdc102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe2ab0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc113890 con 0x7fafdc10dbc0 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe2ab0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc113710 con 0x7fafdc104760 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe2ab0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc113a10 con 0x7fafdc1050b0 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe084c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafdc104760 0x7fafdc1024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe084c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafdc104760 0x7fafdc1024a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39282/0 (socket says 172.21.15.59:39282) 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.144+0000 7fafe084c640 1 -- 172.21.15.59:0/1367669764 learned_addr learned my addr 172.21.15.59:0/1367669764 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafdbfff640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafdc1050b0 0x7fafdc1029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafe104d640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafdc10dbc0 0x7fafdc102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafe084c640 1 -- 172.21.15.59:0/1367669764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafdc1050b0 msgr2=0x7fafdc1029e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafe084c640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafdc1050b0 0x7fafdc1029e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafe084c640 1 -- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafdc10dbc0 msgr2=0x7fafdc102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafe084c640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafdc10dbc0 0x7fafdc102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:27.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafe084c640 1 -- 172.21.15.59:0/1367669764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafdc1a8500 con 0x7fafdc104760 2024-08-28T19:24:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafe104d640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafdc10dbc0 0x7fafdc102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:24:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafdbfff640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafdc1050b0 0x7fafdc1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:24:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafe084c640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafdc104760 0x7fafdc1024a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fafd000e9c0 tx=0x7fafd000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:24:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafd9ffb640 1 -- 172.21.15.59:0/1367669764 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd000cd80 con 0x7fafdc104760 2024-08-28T19:24:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafd9ffb640 1 -- 172.21.15.59:0/1367669764 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafd00035f0 con 0x7fafdc104760 2024-08-28T19:24:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafe2ab0640 1 -- 172.21.15.59:0/1367669764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafdc1a87f0 con 0x7fafdc104760 2024-08-28T19:24:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.145+0000 7fafd9ffb640 1 -- 172.21.15.59:0/1367669764 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0010690 con 0x7fafdc104760 2024-08-28T19:24:27.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.146+0000 7fafe2ab0640 1 -- 172.21.15.59:0/1367669764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafdc1a8ce0 con 0x7fafdc104760 2024-08-28T19:24:27.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.147+0000 7fafe2ab0640 1 -- 172.21.15.59:0/1367669764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafdc06bf80 con 0x7fafdc104760 2024-08-28T19:24:27.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.148+0000 7fafd9ffb640 1 -- 172.21.15.59:0/1367669764 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fafd0004000 con 0x7fafdc104760 2024-08-28T19:24:27.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.149+0000 7fafd9ffb640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fafcc0b4b70 0x7fafcc0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:27.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.149+0000 7fafd9ffb640 1 -- 172.21.15.59:0/1367669764 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7fafd00e3f30 con 0x7fafdc104760 2024-08-28T19:24:27.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.149+0000 7fafdbfff640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fafcc0b4b70 0x7fafcc0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:27.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.150+0000 7fafdbfff640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fafcc0b4b70 0x7fafcc0b7080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fafdc10f790 tx=0x7fafc8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:24:27.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.153+0000 7fafd9ffb640 1 -- 172.21.15.59:0/1367669764 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fafd00aca70 con 0x7fafdc104760 2024-08-28T19:24:27.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:27.348+0000 7fafe2ab0640 1 -- 172.21.15.59:0/1367669764 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fafdc107d80 con 0x7fafcc0b4b70 2024-08-28T19:24:27.677 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:24:27.677 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: osdmap e8: 1 total, 0 up, 1 in 2024-08-28T19:24:27.677 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:27.677 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:27.677 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi033 2024-08-28T19:24:27.677 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.677 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.677 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:24:27.677 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi033 to 17092M 2024-08-28T19:24:27.678 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.678 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:27.678 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:27.678 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.678 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:24:27.678 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:24:27.678 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:24:27.678 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:24:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: osdmap e8: 1 total, 0 up, 1 in 2024-08-28T19:24:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi033 2024-08-28T19:24:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:24:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi033 to 17092M 2024-08-28T19:24:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:24:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:24:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:24:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:27.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:24:27.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: osdmap e8: 1 total, 0 up, 1 in 2024-08-28T19:24:27.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:27.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:27.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi033 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi033 to 17092M 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:24:27.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:28.766 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:28 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:24:28.766 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:28 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:24:28.766 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:28 smithi059 ceph-mon[22052]: osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] boot 2024-08-28T19:24:28.766 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:28 smithi059 ceph-mon[22052]: osdmap e9: 1 total, 1 up, 1 in 2024-08-28T19:24:28.766 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:28.766 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:28 smithi059 ceph-mon[22052]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:28 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:24:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:28 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:24:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:28 smithi122 ceph-mon[22174]: osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] boot 2024-08-28T19:24:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:28 smithi122 ceph-mon[22174]: osdmap e9: 1 total, 1 up, 1 in 2024-08-28T19:24:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:28 smithi122 ceph-mon[22174]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:28.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:28 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:24:28.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:28 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:24:28.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:28 smithi033 ceph-mon[18549]: osd.0 [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] boot 2024-08-28T19:24:28.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:28 smithi033 ceph-mon[18549]: osdmap e9: 1 total, 1 up, 1 in 2024-08-28T19:24:28.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-28T19:24:28.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:28 smithi033 ceph-mon[18549]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-28T19:24:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:29 smithi059 ceph-mon[22052]: osdmap e10: 1 total, 1 up, 1 in 2024-08-28T19:24:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:29 smithi122 ceph-mon[22174]: osdmap e10: 1 total, 1 up, 1 in 2024-08-28T19:24:29.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:29 smithi033 ceph-mon[18549]: osdmap e10: 1 total, 1 up, 1 in 2024-08-28T19:24:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:30 smithi059 ceph-mon[22052]: from='client.? 172.21.15.59:0/3020421341' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5a49e77-f9e9-4419-a08f-d61a8b5d08bb"} : dispatch 2024-08-28T19:24:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:30 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5a49e77-f9e9-4419-a08f-d61a8b5d08bb"} : dispatch 2024-08-28T19:24:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:30 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5a49e77-f9e9-4419-a08f-d61a8b5d08bb"}]': finished 2024-08-28T19:24:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:30 smithi059 ceph-mon[22052]: osdmap e11: 2 total, 1 up, 2 in 2024-08-28T19:24:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:30 smithi059 ceph-mon[22052]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:30 smithi059 ceph-mon[22052]: from='client.? 172.21.15.59:0/1417469876' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:24:30.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:30 smithi122 ceph-mon[22174]: from='client.? 172.21.15.59:0/3020421341' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5a49e77-f9e9-4419-a08f-d61a8b5d08bb"} : dispatch 2024-08-28T19:24:30.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:30 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5a49e77-f9e9-4419-a08f-d61a8b5d08bb"} : dispatch 2024-08-28T19:24:30.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:30 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5a49e77-f9e9-4419-a08f-d61a8b5d08bb"}]': finished 2024-08-28T19:24:30.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:30 smithi122 ceph-mon[22174]: osdmap e11: 2 total, 1 up, 2 in 2024-08-28T19:24:30.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:30.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:30 smithi122 ceph-mon[22174]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:30.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:30 smithi122 ceph-mon[22174]: from='client.? 172.21.15.59:0/1417469876' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:24:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:30 smithi033 ceph-mon[18549]: from='client.? 172.21.15.59:0/3020421341' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5a49e77-f9e9-4419-a08f-d61a8b5d08bb"} : dispatch 2024-08-28T19:24:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:30 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5a49e77-f9e9-4419-a08f-d61a8b5d08bb"} : dispatch 2024-08-28T19:24:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:30 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5a49e77-f9e9-4419-a08f-d61a8b5d08bb"}]': finished 2024-08-28T19:24:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:30 smithi033 ceph-mon[18549]: osdmap e11: 2 total, 1 up, 2 in 2024-08-28T19:24:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:30 smithi033 ceph-mon[18549]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:30 smithi033 ceph-mon[18549]: from='client.? 172.21.15.59:0/1417469876' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:24:33.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:32 smithi059 ceph-mon[22052]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:33.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:32 smithi122 ceph-mon[22174]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:33.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:32 smithi033 ceph-mon[18549]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:34.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:34 smithi059 ceph-mon[22052]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:35.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:34 smithi122 ceph-mon[22174]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:35.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:34 smithi033 ceph-mon[18549]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:36.716 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:36 smithi059 ceph-mon[22052]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:37.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:36 smithi122 ceph-mon[22174]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:37.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:36 smithi033 ceph-mon[18549]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:37.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:37 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-28T19:24:37.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:37 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:38.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:37 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-28T19:24:38.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:37 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:38.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:37 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-28T19:24:38.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:37 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:38.941 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:38 smithi059 ceph-mon[22052]: Deploying daemon osd.1 on smithi059 2024-08-28T19:24:38.942 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:38 smithi059 ceph-mon[22052]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:39.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:38 smithi122 ceph-mon[22174]: Deploying daemon osd.1 on smithi059 2024-08-28T19:24:39.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:38 smithi122 ceph-mon[22174]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:39.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:38 smithi033 ceph-mon[18549]: Deploying daemon osd.1 on smithi059 2024-08-28T19:24:39.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:38 smithi033 ceph-mon[18549]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:40.778 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:40 smithi059 ceph-mon[22052]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:41.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:40 smithi122 ceph-mon[22174]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:41.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:40 smithi033 ceph-mon[18549]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:43.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:42 smithi059 ceph-mon[22052]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:43.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:42 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:43.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:42 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:43.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:42 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:43.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:42 smithi122 ceph-mon[22174]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:43.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:42 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:43.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:42 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:43.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:42 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:43.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:42 smithi033 ceph-mon[18549]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:43.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:42 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:43.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:42 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:43.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:42 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:45.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:44 smithi059 ceph-mon[22052]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:45.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:45.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:45.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:44 smithi122 ceph-mon[22174]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:45.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:45.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:45.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:44 smithi033 ceph-mon[18549]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:45.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:45.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:45.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:45 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:45.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:45 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:45.813 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:45 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.855+0000 7fafd9ffb640 1 -- 172.21.15.59:0/1367669764 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fafdc107d80 con 0x7fafcc0b4b70 2024-08-28T19:24:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 1 on host 'smithi059' 2024-08-28T19:24:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.857+0000 7fafe2ab0640 1 -- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fafcc0b4b70 msgr2=0x7fafcc0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.857+0000 7fafe2ab0640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fafcc0b4b70 0x7fafcc0b7080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fafdc10f790 tx=0x7fafc8005f90 comp rx=0 tx=0).stop 2024-08-28T19:24:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.857+0000 7fafe2ab0640 1 -- 172.21.15.59:0/1367669764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafdc104760 msgr2=0x7fafdc1024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.857+0000 7fafe2ab0640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafdc104760 0x7fafdc1024a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fafd000e9c0 tx=0x7fafd000ee80 comp rx=0 tx=0).stop 2024-08-28T19:24:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.857+0000 7fafe2ab0640 1 -- 172.21.15.59:0/1367669764 shutdown_connections 2024-08-28T19:24:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.857+0000 7fafe2ab0640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafdc10dbc0 0x7fafdc102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.857+0000 7fafe2ab0640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fafcc0b4b70 0x7fafcc0b7080 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.857+0000 7fafe2ab0640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fafdc1050b0 0x7fafdc1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.857+0000 7fafe2ab0640 1 --2- 172.21.15.59:0/1367669764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafdc104760 0x7fafdc1024a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.857+0000 7fafe2ab0640 1 -- 172.21.15.59:0/1367669764 >> 172.21.15.59:0/1367669764 conn(0x7fafdc0794d0 msgr2=0x7fafdc107670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:24:45.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.858+0000 7fafe2ab0640 1 -- 172.21.15.59:0/1367669764 shutdown_connections 2024-08-28T19:24:45.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:24:45.858+0000 7fafe2ab0640 1 -- 172.21.15.59:0/1367669764 wait complete. 2024-08-28T19:24:46.031 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:45 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:46.031 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:45 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:46.031 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:45 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:45 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:45 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:45 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:46.418 DEBUG:teuthology.orchestra.run.smithi059:osd.1> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.1.service 2024-08-28T19:24:46.420 INFO:tasks.cephadm:Deploying osd.2 on smithi122 with /dev/vg_nvme/lv_4... 2024-08-28T19:24:46.421 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-28T19:24:46.680 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:24:46.985 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:46 smithi059 ceph-mon[22052]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:46.985 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:46 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:46.985 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:46 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:46.985 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:46 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:47.029 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:46 smithi122 ceph-mon[22174]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:47.029 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:46 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:47.029 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:46 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:47.029 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:46 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:47.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:46 smithi033 ceph-mon[18549]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:47.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:46 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:24:47.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:46 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:47.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:46 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:48.533 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:24:48 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1[27610]: 2024-08-28T19:24:48.221+0000 7fe186d55640 -1 osd.1 0 log_to_monitors true 2024-08-28T19:24:48.844 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:48 smithi059 ceph-mon[22052]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:48.844 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:48 smithi059 ceph-mon[22052]: from='osd.1 [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T19:24:48.844 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:48 smithi059 ceph-mon[22052]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T19:24:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:24:48.944 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_4 2024-08-28T19:24:48.967 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:48 smithi122 ceph-mon[22174]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:48.967 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:48 smithi122 ceph-mon[22174]: from='osd.1 [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T19:24:48.967 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:48 smithi122 ceph-mon[22174]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T19:24:49.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:48 smithi033 ceph-mon[18549]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:49.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:48 smithi033 ceph-mon[18549]: from='osd.1 [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T19:24:49.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:48 smithi033 ceph-mon[18549]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-28T19:24:49.188 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:24:49.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.627+0000 7ff0029ac640 1 -- 172.21.15.122:0/3499064838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feffc102840 msgr2=0x7feffc102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:49.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.627+0000 7ff0029ac640 1 --2- 172.21.15.122:0/3499064838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feffc102840 0x7feffc102c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec02a410 comp rx=0 tx=0).stop 2024-08-28T19:24:49.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.627+0000 7ff0029ac640 1 -- 172.21.15.122:0/3499064838 shutdown_connections 2024-08-28T19:24:49.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.627+0000 7ff0029ac640 1 --2- 172.21.15.122:0/3499064838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feffc108ad0 0x7feffc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:49.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.627+0000 7ff0029ac640 1 --2- 172.21.15.122:0/3499064838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc108180 0x7feffc108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:49.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.627+0000 7ff0029ac640 1 --2- 172.21.15.122:0/3499064838 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feffc102840 0x7feffc102c50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:49.640 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.627+0000 7ff0029ac640 1 -- 172.21.15.122:0/3499064838 >> 172.21.15.122:0/3499064838 conn(0x7feffc079580 msgr2=0x7feffc079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.627+0000 7ff0029ac640 1 -- 172.21.15.122:0/3499064838 shutdown_connections 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.627+0000 7ff0029ac640 1 -- 172.21.15.122:0/3499064838 wait complete. 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7ff0029ac640 1 Processor -- start 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7ff0029ac640 1 -- start start 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7ff0029ac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc102840 0x7feffc19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7ff0029ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feffc108180 0x7feffc19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7ff0029ac640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feffc108ad0 0x7feffc1a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7ff0029ac640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7feffc112780 con 0x7feffc102840 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7ff0029ac640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feffc112600 con 0x7feffc108ad0 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7ff0029ac640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feffc112900 con 0x7feffc108180 2024-08-28T19:24:49.641 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7feff3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feffc108180 0x7feffc19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7feff3fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feffc108180 0x7feffc19cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:49848/0 (socket says 172.21.15.122:49848) 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.628+0000 7feff3fff640 1 -- 172.21.15.122:0/4266283787 learned_addr learned my addr 172.21.15.122:0/4266283787 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feffbfff640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc102840 0x7feffc19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feff3fff640 1 -- 172.21.15.122:0/4266283787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feffc108ad0 msgr2=0x7feffc1a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feff3fff640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feffc108ad0 0x7feffc1a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feff3fff640 1 -- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc102840 msgr2=0x7feffc19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feff3fff640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc102840 0x7feffc19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feff3fff640 1 -- 172.21.15.122:0/4266283787 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feffc1a23f0 con 0x7feffc108180 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feffbfff640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc102840 0x7feffc19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feff3fff640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feffc108180 0x7feffc19cae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fefe400d770 tx=0x7fefe400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feff9ffb640 1 -- 172.21.15.122:0/4266283787 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4017070 con 0x7feffc108180 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feff9ffb640 1 -- 172.21.15.122:0/4266283787 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefe4009c30 con 0x7feffc108180 2024-08-28T19:24:49.642 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7ff0029ac640 1 -- 172.21.15.122:0/4266283787 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feffc1a26e0 con 0x7feffc108180 2024-08-28T19:24:49.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7feff9ffb640 1 -- 172.21.15.122:0/4266283787 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe400f620 con 0x7feffc108180 2024-08-28T19:24:49.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.629+0000 7ff0029ac640 1 -- 172.21.15.122:0/4266283787 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feffc1a8f00 con 0x7feffc108180 2024-08-28T19:24:49.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.630+0000 7ff0029ac640 1 -- 172.21.15.122:0/4266283787 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feffc102c50 con 0x7feffc108180 2024-08-28T19:24:49.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.632+0000 7feff9ffb640 1 -- 172.21.15.122:0/4266283787 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fefe401a070 con 0x7feffc108180 2024-08-28T19:24:49.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.632+0000 7feff9ffb640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefe80b4ba0 0x7fefe80b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:24:49.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.633+0000 7feff9ffb640 1 -- 172.21.15.122:0/4266283787 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2118+0+0 (secure 0 0 0) 0x7fefe40e3380 con 0x7feffc108180 2024-08-28T19:24:49.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.633+0000 7feffbfff640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefe80b4ba0 0x7fefe80b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:24:49.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.633+0000 7feffbfff640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefe80b4ba0 0x7fefe80b70b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fefec02a930 tx=0x7fefec005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:24:49.643 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.636+0000 7feff9ffb640 1 -- 172.21.15.122:0/4266283787 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fefe40abe40 con 0x7feffc108180 2024-08-28T19:24:49.834 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:24:49.832+0000 7ff0029ac640 1 -- 172.21.15.122:0/4266283787 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7feffc06bd80 con 0x7fefe80b4ba0 2024-08-28T19:24:49.834 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-28T19:24:49.834 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='osd.1 [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:24:49.834 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: osdmap e12: 2 total, 1 up, 2 in 2024-08-28T19:24:49.834 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:49.834 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:24:49.834 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi059 2024-08-28T19:24:49.834 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:49.834 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:49.834 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:24:49.834 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi059 to 17092M 2024-08-28T19:24:49.835 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:49.835 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:49.835 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:49.835 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:50.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-28T19:24:50.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='osd.1 [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:24:50.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: osdmap e12: 2 total, 1 up, 2 in 2024-08-28T19:24:50.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:50.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:24:50.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi059 2024-08-28T19:24:50.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:50.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:50.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:24:50.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi059 to 17092M 2024-08-28T19:24:50.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:50.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:50.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:50.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-28T19:24:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='osd.1 [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:24:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: osdmap e12: 2 total, 1 up, 2 in 2024-08-28T19:24:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:24:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi059 2024-08-28T19:24:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:24:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi059 to 17092M 2024-08-28T19:24:50.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:50.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:50.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:24:50.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:24:50.533 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1[27610]: 2024-08-28T19:24:50.254+0000 7fe182cd7640 -1 osd.1 0 waiting for initial osdmap 2024-08-28T19:24:50.533 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1[27610]: 2024-08-28T19:24:50.258+0000 7fe17aacd640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:24:50.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:50 smithi122 ceph-mon[22174]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:50.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:50 smithi122 ceph-mon[22174]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:24:50.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:50 smithi122 ceph-mon[22174]: osdmap e13: 2 total, 1 up, 2 in 2024-08-28T19:24:50.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:50.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:50.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:50 smithi122 ceph-mon[22174]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:24:50.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:24:50.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:24:50.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:50.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:50 smithi122 ceph-mon[22174]: from='osd.1 ' entity='osd.1' 2024-08-28T19:24:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-mon[22052]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-mon[22052]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:24:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-mon[22052]: osdmap e13: 2 total, 1 up, 2 in 2024-08-28T19:24:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-mon[22052]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:24:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:24:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:24:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:50 smithi059 ceph-mon[22052]: from='osd.1 ' entity='osd.1' 2024-08-28T19:24:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:50 smithi033 ceph-mon[18549]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:50 smithi033 ceph-mon[18549]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:24:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:50 smithi033 ceph-mon[18549]: osdmap e13: 2 total, 1 up, 2 in 2024-08-28T19:24:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:50 smithi033 ceph-mon[18549]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:24:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:24:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:24:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:24:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:50 smithi033 ceph-mon[18549]: from='osd.1 ' entity='osd.1' 2024-08-28T19:24:51.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:51 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:24:51.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:51 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:24:51.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:51.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:51 smithi122 ceph-mon[22174]: osd.1 [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] boot 2024-08-28T19:24:51.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:51 smithi122 ceph-mon[22174]: osdmap e14: 2 total, 2 up, 2 in 2024-08-28T19:24:51.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:51 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:24:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:51 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:24:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:51 smithi059 ceph-mon[22052]: osd.1 [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] boot 2024-08-28T19:24:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:51 smithi059 ceph-mon[22052]: osdmap e14: 2 total, 2 up, 2 in 2024-08-28T19:24:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:52.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:51 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:24:52.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:51 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:24:52.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:52.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:51 smithi033 ceph-mon[18549]: osd.1 [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] boot 2024-08-28T19:24:52.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:51 smithi033 ceph-mon[18549]: osdmap e14: 2 total, 2 up, 2 in 2024-08-28T19:24:52.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-28T19:24:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:52 smithi059 ceph-mon[22052]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:52 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/335371836' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f65f62b9-a463-4efc-b62d-ee08a3ae7a29"} : dispatch 2024-08-28T19:24:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:52 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f65f62b9-a463-4efc-b62d-ee08a3ae7a29"} : dispatch 2024-08-28T19:24:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:52 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f65f62b9-a463-4efc-b62d-ee08a3ae7a29"}]': finished 2024-08-28T19:24:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:52 smithi059 ceph-mon[22052]: osdmap e15: 3 total, 2 up, 3 in 2024-08-28T19:24:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:24:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:52 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/1663219600' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:24:53.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:52 smithi122 ceph-mon[22174]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:53.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:52 smithi122 ceph-mon[22174]: from='client.? 172.21.15.122:0/335371836' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f65f62b9-a463-4efc-b62d-ee08a3ae7a29"} : dispatch 2024-08-28T19:24:53.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:52 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f65f62b9-a463-4efc-b62d-ee08a3ae7a29"} : dispatch 2024-08-28T19:24:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:52 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f65f62b9-a463-4efc-b62d-ee08a3ae7a29"}]': finished 2024-08-28T19:24:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:52 smithi122 ceph-mon[22174]: osdmap e15: 3 total, 2 up, 3 in 2024-08-28T19:24:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:24:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:52 smithi122 ceph-mon[22174]: from='client.? 172.21.15.122:0/1663219600' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:24:53.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:52 smithi033 ceph-mon[18549]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-28T19:24:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:52 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/335371836' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f65f62b9-a463-4efc-b62d-ee08a3ae7a29"} : dispatch 2024-08-28T19:24:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:52 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f65f62b9-a463-4efc-b62d-ee08a3ae7a29"} : dispatch 2024-08-28T19:24:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:52 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f65f62b9-a463-4efc-b62d-ee08a3ae7a29"}]': finished 2024-08-28T19:24:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:52 smithi033 ceph-mon[18549]: osdmap e15: 3 total, 2 up, 3 in 2024-08-28T19:24:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:24:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:52 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/1663219600' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:24:55.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:54 smithi059 ceph-mon[22052]: pgmap v47: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:24:55.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:54 smithi122 ceph-mon[22174]: pgmap v47: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:24:55.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:54 smithi033 ceph-mon[18549]: pgmap v47: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:24:57.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:56 smithi059 ceph-mon[22052]: pgmap v48: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:24:57.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:56 smithi122 ceph-mon[22174]: pgmap v48: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:24:57.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:56 smithi033 ceph-mon[18549]: pgmap v48: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:24:58.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:24:58 smithi122 ceph-mon[22174]: pgmap v49: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:24:59.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:24:58 smithi059 ceph-mon[22052]: pgmap v49: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:24:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:24:58 smithi033 ceph-mon[18549]: pgmap v49: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:00.877 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:00 smithi122 ceph-mon[22174]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:00.878 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:00 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-28T19:25:00.878 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:00 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:00.878 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:00 smithi122 ceph-mon[22174]: Deploying daemon osd.2 on smithi122 2024-08-28T19:25:01.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:00 smithi059 ceph-mon[22052]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:01.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:00 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-28T19:25:01.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:00 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:01.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:00 smithi059 ceph-mon[22052]: Deploying daemon osd.2 on smithi122 2024-08-28T19:25:01.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:00 smithi033 ceph-mon[18549]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:01.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:00 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-28T19:25:01.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:00 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:01.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:00 smithi033 ceph-mon[18549]: Deploying daemon osd.2 on smithi122 2024-08-28T19:25:02.911 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:02 smithi122 ceph-mon[22174]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:03.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:02 smithi059 ceph-mon[22052]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:03.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:02 smithi033 ceph-mon[18549]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:04.903 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:04 smithi122 ceph-mon[22174]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:04 smithi059 ceph-mon[22052]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:05.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:04 smithi033 ceph-mon[18549]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:05.869 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:05.869 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:05.870 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:06.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:06.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:06.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:06.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:07.395 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:07 smithi122 ceph-mon[22174]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:07 smithi059 ceph-mon[22052]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:07.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:07 smithi033 ceph-mon[18549]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:08.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:08 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:08.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:08 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:08.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:08 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:08.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:08 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:08.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:08 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:08.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:08 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:08.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:08 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:08.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:08 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:08.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:08 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:08.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:08 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:08.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:08 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:08.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:08 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:08.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:08 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:08.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:08 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:08.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:08 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:09.192 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.190+0000 7feff9ffb640 1 -- 172.21.15.122:0/4266283787 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feffc06bd80 con 0x7fefe80b4ba0 2024-08-28T19:25:09.193 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 2 on host 'smithi122' 2024-08-28T19:25:09.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 -- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefe80b4ba0 msgr2=0x7fefe80b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:09.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefe80b4ba0 0x7fefe80b70b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fefec02a930 tx=0x7fefec005fd0 comp rx=0 tx=0).stop 2024-08-28T19:25:09.194 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 -- 172.21.15.122:0/4266283787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feffc108180 msgr2=0x7feffc19cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:09.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feffc108180 0x7feffc19cae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fefe400d770 tx=0x7fefe400dc30 comp rx=0 tx=0).stop 2024-08-28T19:25:09.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 -- 172.21.15.122:0/4266283787 shutdown_connections 2024-08-28T19:25:09.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feffc108ad0 0x7feffc1a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:09.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefe80b4ba0 0x7fefe80b70b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:09.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feffc108180 0x7feffc19cae0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:09.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 --2- 172.21.15.122:0/4266283787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc102840 0x7feffc19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:09.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 -- 172.21.15.122:0/4266283787 >> 172.21.15.122:0/4266283787 conn(0x7feffc079580 msgr2=0x7feffc06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:25:09.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 -- 172.21.15.122:0/4266283787 shutdown_connections 2024-08-28T19:25:09.195 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:25:09.193+0000 7ff0029ac640 1 -- 172.21.15.122:0/4266283787 wait complete. 2024-08-28T19:25:09.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:09 smithi122 ceph-mon[22174]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:09.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:09 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:09.744 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:09 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:09.745 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:09 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:09.776 DEBUG:teuthology.orchestra.run.smithi122:osd.2> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.2.service 2024-08-28T19:25:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:09 smithi059 ceph-mon[22052]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:09 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:09 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:09 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:09.819 INFO:tasks.cephadm:Deploying osd.3 on smithi033 with /dev/vg_nvme/lv_3... 2024-08-28T19:25:09.819 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-28T19:25:09.847 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:09 smithi033 ceph-mon[18549]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:09.847 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:09 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:09.847 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:09 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:09.847 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:09 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:10.084 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:25:11.183 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:10 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2[28490]: 2024-08-28T19:25:10.967+0000 7fe9d3c67640 -1 osd.2 0 log_to_monitors true 2024-08-28T19:25:11.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:11 smithi059 ceph-mon[22052]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:11.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:11 smithi059 ceph-mon[22052]: from='osd.2 [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T19:25:11.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:11 smithi059 ceph-mon[22052]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T19:25:11.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:11 smithi122 ceph-mon[22174]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:11.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:11 smithi122 ceph-mon[22174]: from='osd.2 [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T19:25:11.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:11 smithi122 ceph-mon[22174]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T19:25:11.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:11 smithi033 ceph-mon[18549]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:11.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:11 smithi033 ceph-mon[18549]: from='osd.2 [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T19:25:11.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:11 smithi033 ceph-mon[18549]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-28T19:25:12.491 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:12 smithi122 ceph-mon[22174]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-28T19:25:12.491 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:12 smithi122 ceph-mon[22174]: from='osd.2 [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:25:12.491 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:12 smithi122 ceph-mon[22174]: osdmap e16: 3 total, 2 up, 3 in 2024-08-28T19:25:12.491 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:12 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:12.491 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:12 smithi122 ceph-mon[22174]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:25:12.491 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:12 smithi122 ceph-mon[22174]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:12.527 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:25:12.556 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_3 2024-08-28T19:25:12.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:12 smithi033 ceph-mon[18549]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-28T19:25:12.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:12 smithi033 ceph-mon[18549]: from='osd.2 [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:25:12.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:12 smithi033 ceph-mon[18549]: osdmap e16: 3 total, 2 up, 3 in 2024-08-28T19:25:12.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:12 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:12.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:12 smithi033 ceph-mon[18549]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:25:12.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:12 smithi033 ceph-mon[18549]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:12.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:12 smithi059 ceph-mon[22052]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-28T19:25:12.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:12 smithi059 ceph-mon[22052]: from='osd.2 [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:25:12.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:12 smithi059 ceph-mon[22052]: osdmap e16: 3 total, 2 up, 3 in 2024-08-28T19:25:12.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:12 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:12.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:12 smithi059 ceph-mon[22052]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:25:12.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:12 smithi059 ceph-mon[22052]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-28T19:25:12.793 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:12 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2[28490]: 2024-08-28T19:25:12.488+0000 7fe9cfbe9640 -1 osd.2 0 waiting for initial osdmap 2024-08-28T19:25:12.793 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:12 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2[28490]: 2024-08-28T19:25:12.494+0000 7fe9cb9e7640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:25:12.859 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:25:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.370+0000 7f88543a6640 1 -- 172.21.15.33:0/1631852642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c1050e0 msgr2=0x7f884c10d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.370+0000 7f88543a6640 1 --2- 172.21.15.33:0/1631852642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c1050e0 0x7f884c10d630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8848009900 tx=0x7f884802a410 comp rx=0 tx=0).stop 2024-08-28T19:25:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.370+0000 7f88543a6640 1 -- 172.21.15.33:0/1631852642 shutdown_connections 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.370+0000 7f88543a6640 1 --2- 172.21.15.33:0/1631852642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f884c10dbf0 0x7f884c1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.370+0000 7f88543a6640 1 --2- 172.21.15.33:0/1631852642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c1050e0 0x7f884c10d630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.370+0000 7f88543a6640 1 --2- 172.21.15.33:0/1631852642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f884c104790 0x7f884c104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.370+0000 7f88543a6640 1 -- 172.21.15.33:0/1631852642 >> 172.21.15.33:0/1631852642 conn(0x7f884c079580 msgr2=0x7f884c079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.370+0000 7f88543a6640 1 -- 172.21.15.33:0/1631852642 shutdown_connections 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.370+0000 7f88543a6640 1 -- 172.21.15.33:0/1631852642 wait complete. 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f88543a6640 1 Processor -- start 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f88543a6640 1 -- start start 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f88543a6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f884c104790 0x7f884c19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f88543a6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f884c1050e0 0x7f884c19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:25:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f88543a6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c10dbf0 0x7f884c19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f88543a6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f884c113850 con 0x7f884c10dbf0 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f88543a6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f884c1136d0 con 0x7f884c1050e0 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f88543a6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f884c1139d0 con 0x7f884c104790 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f8852943640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c10dbf0 0x7f884c19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f8852943640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c10dbf0 0x7f884c19fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40518/0 (socket says 172.21.15.33:40518) 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.371+0000 7f8852943640 1 -- 172.21.15.33:0/3864599298 learned_addr learned my addr 172.21.15.33:0/3864599298 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f8852142640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f884c104790 0x7f884c19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f8851941640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f884c1050e0 0x7f884c19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f8852943640 1 -- 172.21.15.33:0/3864599298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f884c104790 msgr2=0x7f884c19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f8852943640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f884c104790 0x7f884c19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f8852943640 1 -- 172.21.15.33:0/3864599298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f884c1050e0 msgr2=0x7f884c19a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f8852943640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f884c1050e0 0x7f884c19a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f8852943640 1 -- 172.21.15.33:0/3864599298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c1a01b0 con 0x7f884c10dbf0 2024-08-28T19:25:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f8852142640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f884c104790 0x7f884c19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:25:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f8852943640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c10dbf0 0x7f884c19fb40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f884400cce0 tx=0x7f884400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:25:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f883f7fe640 1 -- 172.21.15.33:0/3864599298 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884400f450 con 0x7f884c10dbf0 2024-08-28T19:25:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f883f7fe640 1 -- 172.21.15.33:0/3864599298 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f884400faa0 con 0x7f884c10dbf0 2024-08-28T19:25:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f88543a6640 1 -- 172.21.15.33:0/3864599298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884c1a04a0 con 0x7f884c10dbf0 2024-08-28T19:25:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f883f7fe640 1 -- 172.21.15.33:0/3864599298 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844018b70 con 0x7f884c10dbf0 2024-08-28T19:25:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.372+0000 7f88543a6640 1 -- 172.21.15.33:0/3864599298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884c1a6cc0 con 0x7f884c10dbf0 2024-08-28T19:25:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.373+0000 7f88543a6640 1 -- 172.21.15.33:0/3864599298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f884c104ba0 con 0x7f884c10dbf0 2024-08-28T19:25:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.376+0000 7f883f7fe640 1 -- 172.21.15.33:0/3864599298 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f8844018d10 con 0x7f884c10dbf0 2024-08-28T19:25:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.376+0000 7f883f7fe640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88380b4ba0 0x7f88380b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:25:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.377+0000 7f8852142640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88380b4ba0 0x7f88380b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:25:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.377+0000 7f883f7fe640 1 -- 172.21.15.33:0/3864599298 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2786+0+0 (secure 0 0 0) 0x7f88440e3fb0 con 0x7f884c10dbf0 2024-08-28T19:25:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.377+0000 7f8852142640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88380b4ba0 0x7f88380b70b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f88400058c0 tx=0x7f8840005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:25:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.379+0000 7f883f7fe640 1 -- 172.21.15.33:0/3864599298 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8844014030 con 0x7f884c10dbf0 2024-08-28T19:25:13.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:13.578+0000 7f88543a6640 1 -- 172.21.15.33:0/3864599298 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f884c108d60 con 0x7f88380b4ba0 2024-08-28T19:25:13.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:25:13.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: osdmap e17: 3 total, 2 up, 3 in 2024-08-28T19:25:13.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:13.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:13.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi122 2024-08-28T19:25:13.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:25:13.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi122 to 17087M 2024-08-28T19:25:13.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:13.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:13.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: osdmap e17: 3 total, 2 up, 3 in 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi122 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi122 to 17087M 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:13.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:13.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:25:13.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: osdmap e17: 3 total, 2 up, 3 in 2024-08-28T19:25:13.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:13.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:13.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi122 2024-08-28T19:25:13.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:25:13.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi122 to 17087M 2024-08-28T19:25:13.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:13.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:13.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:13.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:14.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:25:14.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:25:14.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: osd.2 [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] boot 2024-08-28T19:25:14.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: osdmap e18: 3 total, 3 up, 3 in 2024-08-28T19:25:14.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:14.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:25:14.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:25:14.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:25:14.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:14.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: pgmap v60: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:14.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:14 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-28T19:25:14.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:25:14.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:25:14.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: osd.2 [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] boot 2024-08-28T19:25:14.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: osdmap e18: 3 total, 3 up, 3 in 2024-08-28T19:25:14.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:14.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:25:14.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:25:14.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:25:14.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:14.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: pgmap v60: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:14.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:14 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: osd.2 [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] boot 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: osdmap e18: 3 total, 3 up, 3 in 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: pgmap v60: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:14 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-28T19:25:15.592 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-28T19:25:15.592 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 ceph-mon[18549]: osdmap e19: 3 total, 3 up, 3 in 2024-08-28T19:25:15.592 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-28T19:25:15.758 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-28T19:25:15.758 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 ceph-mon[22174]: osdmap e19: 3 total, 3 up, 3 in 2024-08-28T19:25:15.758 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-28T19:25:15.758 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32123]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T19:25:15.758 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32123]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:15.758 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:15.758 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32123]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:15.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-28T19:25:15.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 ceph-mon[22052]: osdmap e19: 3 total, 3 up, 3 in 2024-08-28T19:25:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-28T19:25:15.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31578]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T19:25:15.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31578]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:15.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:15.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31578]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:15.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31581]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T19:25:15.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31581]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:15.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:15.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31581]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41936]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T19:25:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41936]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41936]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41942]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T19:25:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41942]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41942]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:15.880 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41915]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T19:25:15.880 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41915]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:15.880 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:15.881 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41915]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:15.881 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41918]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T19:25:15.881 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41918]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:15.881 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:15.881 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:25:15 smithi033 sudo[41918]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:16.043 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32126]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T19:25:16.044 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32126]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:16.044 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:16.044 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32126]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:16.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32129]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T19:25:16.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32129]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:16.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:16.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32129]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:16.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32132]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T19:25:16.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32132]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:16.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:16.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:15 smithi122 sudo[32132]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:16.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31584]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-28T19:25:16.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31584]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:16.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:16.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31584]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:16.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31587]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-28T19:25:16.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31587]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-28T19:25:16.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-28T19:25:16.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:15 smithi059 sudo[31587]: pam_unix(sudo:session): session closed for user root 2024-08-28T19:25:16.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:16.520+0000 7f883f7fe640 1 -- 172.21.15.33:0/3864599298 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f88440a83f0 con 0x7f884c10dbf0 2024-08-28T19:25:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-28T19:25:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: osdmap e20: 3 total, 3 up, 3 in 2024-08-28T19:25:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T19:25:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1848149927' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d8d82b3-299e-4ee6-ba28-19aeb3d9def4"} : dispatch 2024-08-28T19:25:16.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1848149927' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d8d82b3-299e-4ee6-ba28-19aeb3d9def4"}]': finished 2024-08-28T19:25:16.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: osdmap e21: 4 total, 3 up, 4 in 2024-08-28T19:25:16.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:16.793 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-28T19:25:16.793 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: osdmap e20: 3 total, 3 up, 3 in 2024-08-28T19:25:16.793 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:16.793 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:16.793 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:16.793 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:16.793 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:25:16.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T19:25:16.795 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1848149927' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d8d82b3-299e-4ee6-ba28-19aeb3d9def4"} : dispatch 2024-08-28T19:25:16.795 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1848149927' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d8d82b3-299e-4ee6-ba28-19aeb3d9def4"}]': finished 2024-08-28T19:25:16.795 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: osdmap e21: 4 total, 3 up, 4 in 2024-08-28T19:25:16.795 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:16.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-28T19:25:16.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: osdmap e20: 3 total, 3 up, 3 in 2024-08-28T19:25:16.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: pgmap v63: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:16.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:16.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-28T19:25:16.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-28T19:25:16.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-28T19:25:16.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-28T19:25:16.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1848149927' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d8d82b3-299e-4ee6-ba28-19aeb3d9def4"} : dispatch 2024-08-28T19:25:16.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1848149927' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d8d82b3-299e-4ee6-ba28-19aeb3d9def4"}]': finished 2024-08-28T19:25:16.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: osdmap e21: 4 total, 3 up, 4 in 2024-08-28T19:25:16.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:17.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:17 smithi059 ceph-mon[22052]: mgrmap e20: x(active, since 110s), standbys: y, z 2024-08-28T19:25:17.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:17 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1814576375' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:25:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:17 smithi122 ceph-mon[22174]: mgrmap e20: x(active, since 110s), standbys: y, z 2024-08-28T19:25:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:17 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1814576375' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:25:17.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:17 smithi033 ceph-mon[18549]: mgrmap e20: x(active, since 110s), standbys: y, z 2024-08-28T19:25:17.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:17 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1814576375' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:25:18.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:18 smithi059 ceph-mon[22052]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:18.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:18 smithi122 ceph-mon[22174]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:18.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:18 smithi033 ceph-mon[18549]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:21.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:20 smithi059 ceph-mon[22052]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:21.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:20 smithi122 ceph-mon[22174]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:21.044 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:20 smithi033 ceph-mon[18549]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:22.804 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:22 smithi033 ceph-mon[18549]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:23.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:22 smithi059 ceph-mon[22052]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:23.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:22 smithi122 ceph-mon[22174]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:25.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:24 smithi059 ceph-mon[22052]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:25.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:24 smithi122 ceph-mon[22174]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:25.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:24 smithi033 ceph-mon[18549]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:25.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-28T19:25:25.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:25.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:25 smithi033 ceph-mon[18549]: Deploying daemon osd.3 on smithi033 2024-08-28T19:25:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-28T19:25:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:25 smithi059 ceph-mon[22052]: Deploying daemon osd.3 on smithi033 2024-08-28T19:25:26.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-28T19:25:26.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:26.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:25 smithi122 ceph-mon[22174]: Deploying daemon osd.3 on smithi033 2024-08-28T19:25:26.802 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:26 smithi033 ceph-mon[18549]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:27.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:26 smithi059 ceph-mon[22052]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:27.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:26 smithi122 ceph-mon[22174]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:28.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:28 smithi033 ceph-mon[18549]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:29.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:28 smithi059 ceph-mon[22052]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:29.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:28 smithi122 ceph-mon[22174]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:31.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:30 smithi059 ceph-mon[22052]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:31.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:30 smithi122 ceph-mon[22174]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:31.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:30 smithi033 ceph-mon[18549]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:32.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:31 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:32.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:31 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:32.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:31 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:32.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:31 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:32.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:31 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:32.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:31 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:32.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:31 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:32.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:31 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:32.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:31 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:33.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:32 smithi059 ceph-mon[22052]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:33.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:32 smithi122 ceph-mon[22174]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:33.045 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:32 smithi033 ceph-mon[18549]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:34.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.271+0000 7f883f7fe640 1 -- 172.21.15.33:0/3864599298 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f884000a2b0 con 0x7f88380b4ba0 2024-08-28T19:25:34.272 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 3 on host 'smithi033' 2024-08-28T19:25:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 -- 172.21.15.33:0/3864599298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88380b4ba0 msgr2=0x7f88380b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88380b4ba0 0x7f88380b70b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f88400058c0 tx=0x7f8840005ec0 comp rx=0 tx=0).stop 2024-08-28T19:25:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 -- 172.21.15.33:0/3864599298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c10dbf0 msgr2=0x7f884c19fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c10dbf0 0x7f884c19fb40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f884400cce0 tx=0x7f884400a620 comp rx=0 tx=0).stop 2024-08-28T19:25:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 -- 172.21.15.33:0/3864599298 shutdown_connections 2024-08-28T19:25:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f884c10dbf0 0x7f884c19fb40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:34.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f884c1050e0 0x7f884c19a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:34.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f88380b4ba0 0x7f88380b70b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:34.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 --2- 172.21.15.33:0/3864599298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f884c104790 0x7f884c19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:34.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 -- 172.21.15.33:0/3864599298 >> 172.21.15.33:0/3864599298 conn(0x7f884c079580 msgr2=0x7f884c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:25:34.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 -- 172.21.15.33:0/3864599298 shutdown_connections 2024-08-28T19:25:34.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:25:34.273+0000 7f88543a6640 1 -- 172.21.15.33:0/3864599298 wait complete. 2024-08-28T19:25:34.876 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:34 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:34.876 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:34 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:34.877 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:34 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:34.877 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:34 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:34.877 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:34 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:34.877 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:34 smithi033 ceph-mon[18549]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:34.877 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:34 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:34.877 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:34 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:34.877 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:34 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:34.903 DEBUG:teuthology.orchestra.run.smithi033:osd.3> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.3.service 2024-08-28T19:25:34.946 INFO:tasks.cephadm:Deploying osd.4 on smithi059 with /dev/vg_nvme/lv_3... 2024-08-28T19:25:34.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-28T19:25:34.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:34 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:34.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:34 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:34.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:34 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:34.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:34 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:34.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:34 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:34.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:34 smithi059 ceph-mon[22052]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:34.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:34 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:34.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:34 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:34.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:34 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:35.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:34 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:35.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:34 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:35.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:34 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:35.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:34 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:35.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:34 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:35.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:34 smithi122 ceph-mon[22174]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:35.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:34 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:35.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:34 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:35.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:34 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:35.210 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:25:36.630 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:25:36 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3[43973]: 2024-08-28T19:25:36.548+0000 7f88420eb640 -1 osd.3 0 log_to_monitors true 2024-08-28T19:25:36.938 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:36 smithi059 ceph-mon[22052]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:36.938 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:36 smithi059 ceph-mon[22052]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-28T19:25:37.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:36 smithi122 ceph-mon[22174]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:37.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:36 smithi122 ceph-mon[22174]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-28T19:25:37.093 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:36 smithi033 ceph-mon[18549]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:37.093 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:36 smithi033 ceph-mon[18549]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-28T19:25:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:25:37.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_3 2024-08-28T19:25:37.943 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:25:38.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:37 smithi059 ceph-mon[22052]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-28T19:25:38.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:37 smithi059 ceph-mon[22052]: osdmap e22: 4 total, 3 up, 4 in 2024-08-28T19:25:38.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:37 smithi059 ceph-mon[22052]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:25:38.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:37 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:38.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:37 smithi059 ceph-mon[22052]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:25:38.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:37 smithi122 ceph-mon[22174]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-28T19:25:38.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:37 smithi122 ceph-mon[22174]: osdmap e22: 4 total, 3 up, 4 in 2024-08-28T19:25:38.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:37 smithi122 ceph-mon[22174]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:25:38.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:37 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:38.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:37 smithi122 ceph-mon[22174]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:25:38.130 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:25:37 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3[43973]: 2024-08-28T19:25:37.706+0000 7f883e06d640 -1 osd.3 0 waiting for initial osdmap 2024-08-28T19:25:38.130 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:25:37 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3[43973]: 2024-08-28T19:25:37.711+0000 7f8839e6b640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:25:38.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:37 smithi033 ceph-mon[18549]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-28T19:25:38.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:37 smithi033 ceph-mon[18549]: osdmap e22: 4 total, 3 up, 4 in 2024-08-28T19:25:38.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:37 smithi033 ceph-mon[18549]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:25:38.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:37 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:38.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:37 smithi033 ceph-mon[18549]: from='osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:25:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.387+0000 7fbcba614640 1 -- 172.21.15.59:0/1251377342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb410dbb0 msgr2=0x7fbcb41100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.387+0000 7fbcba614640 1 --2- 172.21.15.59:0/1251377342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb410dbb0 0x7fbcb41100c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009ca0 tx=0x7fbcac02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:25:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.387+0000 7fbcba614640 1 -- 172.21.15.59:0/1251377342 shutdown_connections 2024-08-28T19:25:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.387+0000 7fbcba614640 1 --2- 172.21.15.59:0/1251377342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb410dbb0 0x7fbcb41100c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.387+0000 7fbcba614640 1 --2- 172.21.15.59:0/1251377342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcb4105030 0x7fbcb410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.387+0000 7fbcba614640 1 --2- 172.21.15.59:0/1251377342 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcb4104600 0x7fbcb4104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.387+0000 7fbcba614640 1 -- 172.21.15.59:0/1251377342 >> 172.21.15.59:0/1251377342 conn(0x7fbcb40794e0 msgr2=0x7fbcb40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:25:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.387+0000 7fbcba614640 1 -- 172.21.15.59:0/1251377342 shutdown_connections 2024-08-28T19:25:38.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.387+0000 7fbcba614640 1 -- 172.21.15.59:0/1251377342 wait complete. 2024-08-28T19:25:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.388+0000 7fbcba614640 1 Processor -- start 2024-08-28T19:25:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.388+0000 7fbcba614640 1 -- start start 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.388+0000 7fbcba614640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcb4104600 0x7fbcb419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.388+0000 7fbcba614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcb4105030 0x7fbcb419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.388+0000 7fbcba614640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb410dbb0 0x7fbcb419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcba614640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb41138a0 con 0x7fbcb4105030 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcba614640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb4113720 con 0x7fbcb410dbb0 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcba614640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb4113a20 con 0x7fbcb4104600 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb8bb1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb410dbb0 0x7fbcb419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcb4105030 0x7fbcb419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcb4105030 0x7fbcb419a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.59:48866/0 (socket says 172.21.15.59:48866) 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb37fe640 1 -- 172.21.15.59:0/2482152560 learned_addr learned my addr 172.21.15.59:0/2482152560 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb3fff640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcb4104600 0x7fbcb419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:25:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb37fe640 1 -- 172.21.15.59:0/2482152560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcb4104600 msgr2=0x7fbcb419a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb37fe640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcb4104600 0x7fbcb419a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb37fe640 1 -- 172.21.15.59:0/2482152560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb410dbb0 msgr2=0x7fbcb419fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb37fe640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb410dbb0 0x7fbcb419fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb37fe640 1 -- 172.21.15.59:0/2482152560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb41a01e0 con 0x7fbcb4105030 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb8bb1640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb410dbb0 0x7fbcb419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb3fff640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcb4104600 0x7fbcb419a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb37fe640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcb4105030 0x7fbcb419a810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbca800e9f0 tx=0x7fbca800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.389+0000 7fbcb17fa640 1 -- 172.21.15.59:0/2482152560 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca800ccc0 con 0x7fbcb4105030 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.390+0000 7fbcba614640 1 -- 172.21.15.59:0/2482152560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb41a04d0 con 0x7fbcb4105030 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.390+0000 7fbcb17fa640 1 -- 172.21.15.59:0/2482152560 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbca80108e0 con 0x7fbcb4105030 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.390+0000 7fbcb17fa640 1 -- 172.21.15.59:0/2482152560 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8018860 con 0x7fbcb4105030 2024-08-28T19:25:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.390+0000 7fbcba614640 1 -- 172.21.15.59:0/2482152560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb41a6c30 con 0x7fbcb4105030 2024-08-28T19:25:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.391+0000 7fbcba614640 1 -- 172.21.15.59:0/2482152560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb406bf80 con 0x7fbcb4105030 2024-08-28T19:25:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.392+0000 7fbcb17fa640 1 -- 172.21.15.59:0/2482152560 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fbca8010430 con 0x7fbcb4105030 2024-08-28T19:25:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.393+0000 7fbcb17fa640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbc9c0b4b80 0x7fbc9c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:25:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.393+0000 7fbcb17fa640 1 -- 172.21.15.59:0/2482152560 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3604+0+0 (secure 0 0 0) 0x7fbca80e46b0 con 0x7fbcb4105030 2024-08-28T19:25:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.393+0000 7fbcb3fff640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbc9c0b4b80 0x7fbc9c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:25:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.394+0000 7fbcb3fff640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbc9c0b4b80 0x7fbc9c0b7090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbcb406c680 tx=0x7fbca4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:25:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.396+0000 7fbcb17fa640 1 -- 172.21.15.59:0/2482152560 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbca80ac350 con 0x7fbcb4105030 2024-08-28T19:25:38.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:38.590+0000 7fbcba614640 1 -- 172.21.15.59:0/2482152560 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbcb41067a0 con 0x7fbc9c0b4b80 2024-08-28T19:25:39.002 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:39.002 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: osdmap e23: 4 total, 3 up, 4 in 2024-08-28T19:25:39.002 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:39.002 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:39.002 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi033 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi033 to 8546M 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:39.003 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] boot 2024-08-28T19:25:39.004 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: osdmap e24: 4 total, 4 up, 4 in 2024-08-28T19:25:39.004 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:39.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: osdmap e23: 4 total, 3 up, 4 in 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi033 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi033 to 8546M 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:39.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:39.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:25:39.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:25:39.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:39.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] boot 2024-08-28T19:25:39.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: osdmap e24: 4 total, 4 up, 4 in 2024-08-28T19:25:39.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:39.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-28T19:25:39.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: osdmap e23: 4 total, 3 up, 4 in 2024-08-28T19:25:39.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:39.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:39.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi033 2024-08-28T19:25:39.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi033 to 8546M 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: osd.3 [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] boot 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: osdmap e24: 4 total, 4 up, 4 in 2024-08-28T19:25:39.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-28T19:25:40.439 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:40 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:25:40.439 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:40 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:25:40.439 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:40 smithi059 ceph-mon[22052]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:25:40.439 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:40 smithi059 ceph-mon[22052]: osdmap e25: 4 total, 4 up, 4 in 2024-08-28T19:25:40.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:40 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:25:40.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:40 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:25:40.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:40 smithi122 ceph-mon[22174]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:25:40.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:40 smithi122 ceph-mon[22174]: osdmap e25: 4 total, 4 up, 4 in 2024-08-28T19:25:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:40 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:25:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:40 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:25:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:40 smithi033 ceph-mon[18549]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:25:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:40 smithi033 ceph-mon[18549]: osdmap e25: 4 total, 4 up, 4 in 2024-08-28T19:25:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:41 smithi059 ceph-mon[22052]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:41 smithi059 ceph-mon[22052]: osdmap e26: 4 total, 4 up, 4 in 2024-08-28T19:25:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:41 smithi059 ceph-mon[22052]: from='client.? 172.21.15.59:0/2047461375' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2a493d3-6deb-48d7-9e3c-984bc4ef7837"} : dispatch 2024-08-28T19:25:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:41 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2a493d3-6deb-48d7-9e3c-984bc4ef7837"} : dispatch 2024-08-28T19:25:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:41 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2a493d3-6deb-48d7-9e3c-984bc4ef7837"}]': finished 2024-08-28T19:25:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:41 smithi059 ceph-mon[22052]: osdmap e27: 5 total, 4 up, 5 in 2024-08-28T19:25:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:41 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:25:41.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:41 smithi122 ceph-mon[22174]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:41.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:41 smithi122 ceph-mon[22174]: osdmap e26: 4 total, 4 up, 4 in 2024-08-28T19:25:41.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:41 smithi122 ceph-mon[22174]: from='client.? 172.21.15.59:0/2047461375' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2a493d3-6deb-48d7-9e3c-984bc4ef7837"} : dispatch 2024-08-28T19:25:41.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:41 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2a493d3-6deb-48d7-9e3c-984bc4ef7837"} : dispatch 2024-08-28T19:25:41.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:41 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2a493d3-6deb-48d7-9e3c-984bc4ef7837"}]': finished 2024-08-28T19:25:41.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:41 smithi122 ceph-mon[22174]: osdmap e27: 5 total, 4 up, 5 in 2024-08-28T19:25:41.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:41 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:25:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:41 smithi033 ceph-mon[18549]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:41 smithi033 ceph-mon[18549]: osdmap e26: 4 total, 4 up, 4 in 2024-08-28T19:25:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:41 smithi033 ceph-mon[18549]: from='client.? 172.21.15.59:0/2047461375' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2a493d3-6deb-48d7-9e3c-984bc4ef7837"} : dispatch 2024-08-28T19:25:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:41 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2a493d3-6deb-48d7-9e3c-984bc4ef7837"} : dispatch 2024-08-28T19:25:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:41 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2a493d3-6deb-48d7-9e3c-984bc4ef7837"}]': finished 2024-08-28T19:25:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:41 smithi033 ceph-mon[18549]: osdmap e27: 5 total, 4 up, 5 in 2024-08-28T19:25:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:41 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:25:42.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:42 smithi059 ceph-mon[22052]: from='client.? 172.21.15.59:0/868552133' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:25:42.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:42 smithi122 ceph-mon[22174]: from='client.? 172.21.15.59:0/868552133' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:25:42.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:42 smithi033 ceph-mon[18549]: from='client.? 172.21.15.59:0/868552133' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:25:43.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:43 smithi059 ceph-mon[22052]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:43.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:43 smithi122 ceph-mon[22174]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:43.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:43 smithi033 ceph-mon[18549]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:45.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:45 smithi059 ceph-mon[22052]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-08-28T19:25:45.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:45 smithi122 ceph-mon[22174]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-08-28T19:25:45.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:45 smithi033 ceph-mon[18549]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-08-28T19:25:47.463 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:47 smithi059 ceph-mon[22052]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-08-28T19:25:47.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:47 smithi122 ceph-mon[22174]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-08-28T19:25:47.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:47 smithi033 ceph-mon[18549]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-08-28T19:25:49.497 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:49 smithi059 ceph-mon[22052]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:25:49.497 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-28T19:25:49.497 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:49.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:49 smithi122 ceph-mon[22174]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:25:49.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-28T19:25:49.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:49.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:49 smithi033 ceph-mon[18549]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:25:49.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-28T19:25:49.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:50.326 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:50 smithi059 ceph-mon[22052]: Deploying daemon osd.4 on smithi059 2024-08-28T19:25:50.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:50 smithi122 ceph-mon[22174]: Deploying daemon osd.4 on smithi059 2024-08-28T19:25:50.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:50 smithi033 ceph-mon[18549]: Deploying daemon osd.4 on smithi059 2024-08-28T19:25:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:51 smithi059 ceph-mon[22052]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-28T19:25:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:51 smithi122 ceph-mon[22174]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-28T19:25:51.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:51 smithi033 ceph-mon[18549]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-28T19:25:53.432 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:53 smithi059 ceph-mon[22052]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-28T19:25:53.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:53 smithi122 ceph-mon[22174]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-28T19:25:53.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:53 smithi033 ceph-mon[18549]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-28T19:25:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:55 smithi059 ceph-mon[22052]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:25:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:55 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:55 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:55 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:55.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:55 smithi122 ceph-mon[22174]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:25:55.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:55 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:55.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:55 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:55.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:55 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:55.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:55 smithi033 ceph-mon[18549]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:25:55.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:55 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:55.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:55 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:55.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:55 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:57.478 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:57 smithi059 ceph-mon[22052]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:57.478 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:57 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:57.478 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:57 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:57.478 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:57 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:57.478 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:57 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:57.478 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:57 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:57.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:57 smithi122 ceph-mon[22174]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:57.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:57 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:57.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:57 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:57.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:57 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:57.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:57 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:57.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:57 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:57.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:57 smithi033 ceph-mon[18549]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:57.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:57 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:57 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:57 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:25:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:57 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:25:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:57 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:58.079 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 4 on host 'smithi059' 2024-08-28T19:25:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.078+0000 7fbcb17fa640 1 -- 172.21.15.59:0/2482152560 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbcb41067a0 con 0x7fbc9c0b4b80 2024-08-28T19:25:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.080+0000 7fbcba614640 1 -- 172.21.15.59:0/2482152560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbc9c0b4b80 msgr2=0x7fbc9c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.080+0000 7fbcba614640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbc9c0b4b80 0x7fbc9c0b7090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbcb406c680 tx=0x7fbca4005f90 comp rx=0 tx=0).stop 2024-08-28T19:25:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.080+0000 7fbcba614640 1 -- 172.21.15.59:0/2482152560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcb4105030 msgr2=0x7fbcb419a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:25:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.080+0000 7fbcba614640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcb4105030 0x7fbcb419a810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbca800e9f0 tx=0x7fbca800eeb0 comp rx=0 tx=0).stop 2024-08-28T19:25:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.081+0000 7fbcba614640 1 -- 172.21.15.59:0/2482152560 shutdown_connections 2024-08-28T19:25:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.081+0000 7fbcba614640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb410dbb0 0x7fbcb419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.081+0000 7fbcba614640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcb4105030 0x7fbcb419a810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.081+0000 7fbcba614640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbc9c0b4b80 0x7fbc9c0b7090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.081+0000 7fbcba614640 1 --2- 172.21.15.59:0/2482152560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbcb4104600 0x7fbcb419a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:25:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.081+0000 7fbcba614640 1 -- 172.21.15.59:0/2482152560 >> 172.21.15.59:0/2482152560 conn(0x7fbcb40794e0 msgr2=0x7fbcb4106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:25:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.081+0000 7fbcba614640 1 -- 172.21.15.59:0/2482152560 shutdown_connections 2024-08-28T19:25:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:25:58.081+0000 7fbcba614640 1 -- 172.21.15.59:0/2482152560 wait complete. 2024-08-28T19:25:58.373 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:58 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:58.373 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:58 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:58.373 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:58 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:58.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:58 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:58.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:58 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:58.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:58 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:58.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:58 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:25:58.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:58 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:58.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:58 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:25:58.675 DEBUG:teuthology.orchestra.run.smithi059:osd.4> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.4.service 2024-08-28T19:25:58.677 INFO:tasks.cephadm:Deploying osd.5 on smithi122 with /dev/vg_nvme/lv_3... 2024-08-28T19:25:58.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-28T19:25:58.933 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:25:59.343 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:25:59 smithi122 ceph-mon[22174]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:59.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:25:59 smithi059 ceph-mon[22052]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:25:59.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:25:59 smithi033 ceph-mon[18549]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:26:00.694 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:26:00 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4[34214]: 2024-08-28T19:26:00.327+0000 7fd7e7efa640 -1 osd.4 0 log_to_monitors true 2024-08-28T19:26:01.133 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:26:01.163 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_3 2024-08-28T19:26:01.414 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:26:01.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:01 smithi059 ceph-mon[22052]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:26:01.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:01 smithi059 ceph-mon[22052]: from='osd.4 [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T19:26:01.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:01 smithi059 ceph-mon[22052]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T19:26:01.535 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:01 smithi122 ceph-mon[22174]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:26:01.535 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:01 smithi122 ceph-mon[22174]: from='osd.4 [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T19:26:01.535 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:01 smithi122 ceph-mon[22174]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T19:26:01.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:01 smithi033 ceph-mon[18549]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:26:01.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:01 smithi033 ceph-mon[18549]: from='osd.4 [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T19:26:01.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:01 smithi033 ceph-mon[18549]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-28T19:26:01.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.916+0000 7f4129b6d640 1 -- 172.21.15.122:0/1174784092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f412410dbe0 msgr2=0x7f41241100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:01.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.916+0000 7f4129b6d640 1 --2- 172.21.15.122:0/1174784092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f412410dbe0 0x7f41241100c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f411c009ca0 tx=0x7f411c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:26:01.918 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.917+0000 7f4129b6d640 1 -- 172.21.15.122:0/1174784092 shutdown_connections 2024-08-28T19:26:01.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.917+0000 7f4129b6d640 1 --2- 172.21.15.122:0/1174784092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f412410dbe0 0x7f41241100c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:01.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.917+0000 7f4129b6d640 1 --2- 172.21.15.122:0/1174784092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4124105060 0x7f412410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:01.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.917+0000 7f4129b6d640 1 --2- 172.21.15.122:0/1174784092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4124104630 0x7f4124104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:01.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.917+0000 7f4129b6d640 1 -- 172.21.15.122:0/1174784092 >> 172.21.15.122:0/1174784092 conn(0x7f41240794f0 msgr2=0x7f4124079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:26:01.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.917+0000 7f4129b6d640 1 -- 172.21.15.122:0/1174784092 shutdown_connections 2024-08-28T19:26:01.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.917+0000 7f4129b6d640 1 -- 172.21.15.122:0/1174784092 wait complete. 2024-08-28T19:26:01.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.917+0000 7f4129b6d640 1 Processor -- start 2024-08-28T19:26:01.919 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.917+0000 7f4129b6d640 1 -- start start 2024-08-28T19:26:01.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4129b6d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4124104630 0x7f412419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:01.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4129b6d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4124105060 0x7f412419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:01.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4129b6d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412410dbe0 0x7f412419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:01.921 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4129b6d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4124113830 con 0x7f4124104630 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4129b6d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f41241136b0 con 0x7f412410dbe0 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4129b6d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f41241139b0 con 0x7f4124105060 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4122ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4124105060 0x7f412419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4122ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4124105060 0x7f412419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:54082/0 (socket says 172.21.15.122:54082) 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4122ffd640 1 -- 172.21.15.122:0/2219641287 learned_addr learned my addr 172.21.15.122:0/2219641287 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4123fff640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412410dbe0 0x7f412419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f41237fe640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4124104630 0x7f412419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4122ffd640 1 -- 172.21.15.122:0/2219641287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412410dbe0 msgr2=0x7f412419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4122ffd640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412410dbe0 0x7f412419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4122ffd640 1 -- 172.21.15.122:0/2219641287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4124104630 msgr2=0x7f412419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4122ffd640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4124104630 0x7f412419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:01.922 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4122ffd640 1 -- 172.21.15.122:0/2219641287 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41241a00b0 con 0x7f4124105060 2024-08-28T19:26:01.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.918+0000 7f4122ffd640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4124105060 0x7f412419a7a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f411800c8c0 tx=0x7f411800cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:26:01.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.919+0000 7f4120ff9640 1 -- 172.21.15.122:0/2219641287 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118007bb0 con 0x7f4124105060 2024-08-28T19:26:01.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.919+0000 7f4129b6d640 1 -- 172.21.15.122:0/2219641287 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41241a03a0 con 0x7f4124105060 2024-08-28T19:26:01.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.919+0000 7f4120ff9640 1 -- 172.21.15.122:0/2219641287 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4118007d50 con 0x7f4124105060 2024-08-28T19:26:01.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.919+0000 7f4120ff9640 1 -- 172.21.15.122:0/2219641287 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41180187c0 con 0x7f4124105060 2024-08-28T19:26:01.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.919+0000 7f4129b6d640 1 -- 172.21.15.122:0/2219641287 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41241a6bc0 con 0x7f4124105060 2024-08-28T19:26:01.923 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.920+0000 7f4129b6d640 1 -- 172.21.15.122:0/2219641287 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f412406bf40 con 0x7f4124105060 2024-08-28T19:26:01.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.921+0000 7f4120ff9640 1 -- 172.21.15.122:0/2219641287 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f411800fa20 con 0x7f4124105060 2024-08-28T19:26:01.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.922+0000 7f4120ff9640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f410c0b4bb0 0x7f410c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:01.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.922+0000 7f4120ff9640 1 -- 172.21.15.122:0/2219641287 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4020+0+0 (secure 0 0 0) 0x7f41180e44e0 con 0x7f4124105060 2024-08-28T19:26:01.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.922+0000 7f41237fe640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f410c0b4bb0 0x7f410c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:01.924 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.923+0000 7f41237fe640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f410c0b4bb0 0x7f410c0b70c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41140058c0 tx=0x7f411400a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:26:01.926 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:01.925+0000 7f4120ff9640 1 -- 172.21.15.122:0/2219641287 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4118014030 con 0x7f4124105060 2024-08-28T19:26:02.115 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:02.114+0000 7f4129b6d640 1 -- 172.21.15.122:0/2219641287 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4124107e60 con 0x7f410c0b4bb0 2024-08-28T19:26:02.509 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-28T19:26:02.509 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: osdmap e28: 5 total, 4 up, 5 in 2024-08-28T19:26:02.509 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:02.509 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='osd.4 [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi059 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi059 to 8546M 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.510 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:26:02.511 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:26:02.511 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:02.533 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4[34214]: 2024-08-28T19:26:02.239+0000 7fd7e3e7c640 -1 osd.4 0 waiting for initial osdmap 2024-08-28T19:26:02.533 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4[34214]: 2024-08-28T19:26:02.245+0000 7fd7dfc7a640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:26:02.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-28T19:26:02.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: osdmap e28: 5 total, 4 up, 5 in 2024-08-28T19:26:02.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:02.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='osd.4 [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:26:02.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:26:02.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi059 2024-08-28T19:26:02.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:02.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:02.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi059 to 8546M 2024-08-28T19:26:02.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:02.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:02.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:26:02.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:26:02.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:02.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-28T19:26:02.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: osdmap e28: 5 total, 4 up, 5 in 2024-08-28T19:26:02.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:02.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='osd.4 [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:26:02.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:26:02.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi059 2024-08-28T19:26:02.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:02.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:02.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi059 to 8546M 2024-08-28T19:26:02.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:02.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:02.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:02.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:26:02.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:26:02.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:03.511 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:03 smithi122 ceph-mon[22174]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:26:03.512 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:03 smithi122 ceph-mon[22174]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:26:03.512 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:03 smithi122 ceph-mon[22174]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:26:03.512 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:03 smithi122 ceph-mon[22174]: osdmap e29: 5 total, 4 up, 5 in 2024-08-28T19:26:03.512 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:03.512 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:03.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:03 smithi059 ceph-mon[22052]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:26:03.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:03 smithi059 ceph-mon[22052]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:26:03.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:03 smithi059 ceph-mon[22052]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:26:03.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:03 smithi059 ceph-mon[22052]: osdmap e29: 5 total, 4 up, 5 in 2024-08-28T19:26:03.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:03.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:03.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:03 smithi033 ceph-mon[18549]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:26:03.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:03 smithi033 ceph-mon[18549]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:26:03.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:03 smithi033 ceph-mon[18549]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:26:03.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:03 smithi033 ceph-mon[18549]: osdmap e29: 5 total, 4 up, 5 in 2024-08-28T19:26:03.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:03.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:04.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:04 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:26:04.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:04 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:26:04.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:04 smithi059 ceph-mon[22052]: osd.4 [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] boot 2024-08-28T19:26:04.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:04 smithi059 ceph-mon[22052]: osdmap e30: 5 total, 5 up, 5 in 2024-08-28T19:26:04.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:04.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:04 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:26:04.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:04 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:26:04.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:04 smithi122 ceph-mon[22174]: osd.4 [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] boot 2024-08-28T19:26:04.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:04 smithi122 ceph-mon[22174]: osdmap e30: 5 total, 5 up, 5 in 2024-08-28T19:26:04.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:04.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:04 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:26:04.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:04 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:26:04.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:04 smithi033 ceph-mon[18549]: osd.4 [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] boot 2024-08-28T19:26:04.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:04 smithi033 ceph-mon[18549]: osdmap e30: 5 total, 5 up, 5 in 2024-08-28T19:26:04.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-28T19:26:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:05 smithi059 ceph-mon[22052]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:26:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:05 smithi059 ceph-mon[22052]: osdmap e31: 5 total, 5 up, 5 in 2024-08-28T19:26:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:05 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/2837633059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b68288c-6c14-46db-9a5a-eff806c6bc02"} : dispatch 2024-08-28T19:26:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:05 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b68288c-6c14-46db-9a5a-eff806c6bc02"} : dispatch 2024-08-28T19:26:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:05 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b68288c-6c14-46db-9a5a-eff806c6bc02"}]': finished 2024-08-28T19:26:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:05 smithi059 ceph-mon[22052]: osdmap e32: 6 total, 5 up, 6 in 2024-08-28T19:26:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:05 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/476726468' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:26:05.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:05 smithi122 ceph-mon[22174]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:26:05.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:05 smithi122 ceph-mon[22174]: osdmap e31: 5 total, 5 up, 5 in 2024-08-28T19:26:05.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:05 smithi122 ceph-mon[22174]: from='client.? 172.21.15.122:0/2837633059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b68288c-6c14-46db-9a5a-eff806c6bc02"} : dispatch 2024-08-28T19:26:05.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:05 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b68288c-6c14-46db-9a5a-eff806c6bc02"} : dispatch 2024-08-28T19:26:05.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:05 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b68288c-6c14-46db-9a5a-eff806c6bc02"}]': finished 2024-08-28T19:26:05.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:05 smithi122 ceph-mon[22174]: osdmap e32: 6 total, 5 up, 6 in 2024-08-28T19:26:05.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:05.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:05 smithi122 ceph-mon[22174]: from='client.? 172.21.15.122:0/476726468' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:26:05.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:05 smithi033 ceph-mon[18549]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-28T19:26:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:05 smithi033 ceph-mon[18549]: osdmap e31: 5 total, 5 up, 5 in 2024-08-28T19:26:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:05 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/2837633059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b68288c-6c14-46db-9a5a-eff806c6bc02"} : dispatch 2024-08-28T19:26:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:05 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8b68288c-6c14-46db-9a5a-eff806c6bc02"} : dispatch 2024-08-28T19:26:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:05 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b68288c-6c14-46db-9a5a-eff806c6bc02"}]': finished 2024-08-28T19:26:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:05 smithi033 ceph-mon[18549]: osdmap e32: 6 total, 5 up, 6 in 2024-08-28T19:26:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:05 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/476726468' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:26:07.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:07 smithi059 ceph-mon[22052]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:07.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:07 smithi122 ceph-mon[22174]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:07.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:07 smithi033 ceph-mon[18549]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:09.522 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:09 smithi122 ceph-mon[22174]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:09.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:09 smithi059 ceph-mon[22052]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:09.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:09 smithi033 ceph-mon[18549]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:11.392 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:11 smithi122 ceph-mon[22174]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:11.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:11 smithi059 ceph-mon[22052]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:11.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:11 smithi033 ceph-mon[18549]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:13.496 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:13 smithi122 ceph-mon[22174]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:13.496 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-28T19:26:13.496 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:13.497 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:13 smithi122 ceph-mon[22174]: Deploying daemon osd.5 on smithi122 2024-08-28T19:26:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:13 smithi059 ceph-mon[22052]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-28T19:26:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:13 smithi059 ceph-mon[22052]: Deploying daemon osd.5 on smithi122 2024-08-28T19:26:13.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:13 smithi033 ceph-mon[18549]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:13.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-28T19:26:13.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:13.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:13 smithi033 ceph-mon[18549]: Deploying daemon osd.5 on smithi122 2024-08-28T19:26:15.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:15 smithi059 ceph-mon[22052]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:15.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:15 smithi122 ceph-mon[22174]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:15.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:15 smithi033 ceph-mon[18549]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:17.468 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:17 smithi122 ceph-mon[22174]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:17.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:17 smithi059 ceph-mon[22052]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:17.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:17 smithi033 ceph-mon[18549]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:18.321 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:18 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:18.321 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:18 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:18.321 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:18 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:18 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:18 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:18 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:18.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:18 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:18.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:18 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:18.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:18 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:19.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:19 smithi059 ceph-mon[22052]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:19.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:19 smithi122 ceph-mon[22174]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:19.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:19 smithi033 ceph-mon[18549]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:21.490 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:21 smithi122 ceph-mon[22174]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:21.490 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:21 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:21.490 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:21 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:21.490 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:21 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:21.490 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:21 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:21.490 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:21 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:21 smithi059 ceph-mon[22052]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:21 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:21 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:21 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:21 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:21 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:21.835 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.834+0000 7f4120ff9640 1 -- 172.21.15.122:0/2219641287 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4124107e60 con 0x7f410c0b4bb0 2024-08-28T19:26:21.836 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 5 on host 'smithi122' 2024-08-28T19:26:21.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 -- 172.21.15.122:0/2219641287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f410c0b4bb0 msgr2=0x7f410c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:21.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f410c0b4bb0 0x7f410c0b70c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41140058c0 tx=0x7f411400a4c0 comp rx=0 tx=0).stop 2024-08-28T19:26:21.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 -- 172.21.15.122:0/2219641287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4124105060 msgr2=0x7f412419a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:21.838 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4124105060 0x7f412419a7a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f411800c8c0 tx=0x7f411800cd80 comp rx=0 tx=0).stop 2024-08-28T19:26:21.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 -- 172.21.15.122:0/2219641287 shutdown_connections 2024-08-28T19:26:21.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412410dbe0 0x7f412419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:21.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f410c0b4bb0 0x7f410c0b70c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:21.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4124105060 0x7f412419a7a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:21.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 --2- 172.21.15.122:0/2219641287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4124104630 0x7f412419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:21.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 -- 172.21.15.122:0/2219641287 >> 172.21.15.122:0/2219641287 conn(0x7f41240794f0 msgr2=0x7f4124107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:26:21.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 -- 172.21.15.122:0/2219641287 shutdown_connections 2024-08-28T19:26:21.839 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:26:21.837+0000 7f4129b6d640 1 -- 172.21.15.122:0/2219641287 wait complete. 2024-08-28T19:26:21.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:21 smithi033 ceph-mon[18549]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:21.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:21 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:21.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:21 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:21.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:21 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:21.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:21 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:21.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:21 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:22.455 DEBUG:teuthology.orchestra.run.smithi122:osd.5> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.5.service 2024-08-28T19:26:22.457 INFO:tasks.cephadm:Deploying osd.6 on smithi033 with /dev/vg_nvme/lv_2... 2024-08-28T19:26:22.458 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-28T19:26:22.670 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:22.670 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:22.670 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:22.720 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:26:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:22.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:22.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:22.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:23.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:23 smithi033 ceph-mon[18549]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:23.681 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:23 smithi122 ceph-mon[22174]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:23.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:23 smithi059 ceph-mon[22052]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:24.294 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:26:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:26:24.045+0000 7f06ed4b3640 -1 osd.5 0 log_to_monitors true 2024-08-28T19:26:24.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:24 smithi033 ceph-mon[18549]: from='osd.5 [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T19:26:24.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:24 smithi033 ceph-mon[18549]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T19:26:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:24 smithi059 ceph-mon[22052]: from='osd.5 [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T19:26:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:24 smithi059 ceph-mon[22052]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T19:26:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:24 smithi122 ceph-mon[22174]: from='osd.5 [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T19:26:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:24 smithi122 ceph-mon[22174]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-28T19:26:25.399 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:26:25.431 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_2 2024-08-28T19:26:25.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: osdmap e33: 6 total, 5 up, 6 in 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='osd.5 [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:25.545 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:25.545 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.682 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:26:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-28T19:26:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: osdmap e33: 6 total, 5 up, 6 in 2024-08-28T19:26:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='osd.5 [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:26:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:26:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:25.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:25.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:25.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:25.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.802 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:25.802 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-28T19:26:25.802 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: osdmap e33: 6 total, 5 up, 6 in 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='osd.5 [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:25.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.176+0000 7fe7a32a3640 1 -- 172.21.15.33:0/121449929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c108180 msgr2=0x7fe79c108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.176+0000 7fe7a32a3640 1 --2- 172.21.15.33:0/121449929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c108180 0x7fe79c108590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009900 tx=0x7fe78c02a410 comp rx=0 tx=0).stop 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.176+0000 7fe7a32a3640 1 -- 172.21.15.33:0/121449929 shutdown_connections 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.176+0000 7fe7a32a3640 1 --2- 172.21.15.33:0/121449929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe79c108ad0 0x7fe79c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.176+0000 7fe7a32a3640 1 --2- 172.21.15.33:0/121449929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c108180 0x7fe79c108590 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.176+0000 7fe7a32a3640 1 --2- 172.21.15.33:0/121449929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c102840 0x7fe79c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.176+0000 7fe7a32a3640 1 -- 172.21.15.33:0/121449929 >> 172.21.15.33:0/121449929 conn(0x7fe79c079580 msgr2=0x7fe79c079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.176+0000 7fe7a32a3640 1 -- 172.21.15.33:0/121449929 shutdown_connections 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.176+0000 7fe7a32a3640 1 -- 172.21.15.33:0/121449929 wait complete. 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a32a3640 1 Processor -- start 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a32a3640 1 -- start start 2024-08-28T19:26:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a32a3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c102840 0x7fe79c19b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a32a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c108180 0x7fe79c19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a32a3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe79c108ad0 0x7fe79c19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a32a3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c112700 con 0x7fe79c108180 2024-08-28T19:26:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a32a3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c112580 con 0x7fe79c102840 2024-08-28T19:26:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a32a3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c112880 con 0x7fe79c108ad0 2024-08-28T19:26:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a083e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c108180 0x7fe79c19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a083e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c108180 0x7fe79c19b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39818/0 (socket says 172.21.15.33:39818) 2024-08-28T19:26:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.177+0000 7fe7a083e640 1 -- 172.21.15.33:0/2098099241 learned_addr learned my addr 172.21.15.33:0/2098099241 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:26:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7a1840640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe79c108ad0 0x7fe79c19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7a103f640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c102840 0x7fe79c19b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7a083e640 1 -- 172.21.15.33:0/2098099241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe79c108ad0 msgr2=0x7fe79c19ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7a083e640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe79c108ad0 0x7fe79c19ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7a083e640 1 -- 172.21.15.33:0/2098099241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c102840 msgr2=0x7fe79c19b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7a083e640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c102840 0x7fe79c19b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7a083e640 1 -- 172.21.15.33:0/2098099241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c1a6240 con 0x7fe79c108180 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7a083e640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c108180 0x7fe79c19b550 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe78c032fd0 tx=0x7fe78c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7927fc640 1 -- 172.21.15.33:0/2098099241 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c03f030 con 0x7fe79c108180 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7927fc640 1 -- 172.21.15.33:0/2098099241 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe78c004490 con 0x7fe79c108180 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7a32a3640 1 -- 172.21.15.33:0/2098099241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79c1a64d0 con 0x7fe79c108180 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7927fc640 1 -- 172.21.15.33:0/2098099241 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c035070 con 0x7fe79c108180 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.178+0000 7fe7a32a3640 1 -- 172.21.15.33:0/2098099241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79c1a6a00 con 0x7fe79c108180 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.179+0000 7fe7a32a3640 1 -- 172.21.15.33:0/2098099241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe79c102c50 con 0x7fe79c108180 2024-08-28T19:26:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.182+0000 7fe7927fc640 1 -- 172.21.15.33:0/2098099241 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fe78c042030 con 0x7fe79c108180 2024-08-28T19:26:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.183+0000 7fe7927fc640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7880b4c00 0x7fe7880b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.183+0000 7fe7a103f640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7880b4c00 0x7fe7880b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.183+0000 7fe7927fc640 1 -- 172.21.15.33:0/2098099241 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4468+0+0 (secure 0 0 0) 0x7fe78c104bb0 con 0x7fe79c108180 2024-08-28T19:26:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.183+0000 7fe7a103f640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7880b4c00 0x7fe7880b7110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe798005fd0 tx=0x7fe798005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:26:26.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.186+0000 7fe7927fc640 1 -- 172.21.15.33:0/2098099241 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe78c0ccbe0 con 0x7fe79c108180 2024-08-28T19:26:26.293 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:26:25.838+0000 7f06e9435640 -1 osd.5 0 waiting for initial osdmap 2024-08-28T19:26:26.293 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:26:25 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:26:25.844+0000 7f06e122b640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:26:26.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:26.387+0000 7fe7a32a3640 1 -- 172.21.15.33:0/2098099241 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe79c0635a0 con 0x7fe7880b4c00 2024-08-28T19:26:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:26 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi122 2024-08-28T19:26:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:26 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi122 to 8543M 2024-08-28T19:26:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:26 smithi059 ceph-mon[22052]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:26:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:26 smithi059 ceph-mon[22052]: osdmap e34: 6 total, 5 up, 6 in 2024-08-28T19:26:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:26 smithi059 ceph-mon[22052]: from='osd.5 ' entity='osd.5' 2024-08-28T19:26:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:26:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:26:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:26 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi122 2024-08-28T19:26:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:26 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi122 to 8543M 2024-08-28T19:26:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:26 smithi122 ceph-mon[22174]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:26:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:26 smithi122 ceph-mon[22174]: osdmap e34: 6 total, 5 up, 6 in 2024-08-28T19:26:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:26 smithi122 ceph-mon[22174]: from='osd.5 ' entity='osd.5' 2024-08-28T19:26:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:26:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:26:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:26.799 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:26 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi122 2024-08-28T19:26:26.800 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:26 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi122 to 8543M 2024-08-28T19:26:26.800 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:26 smithi033 ceph-mon[18549]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:26:26.800 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:26 smithi033 ceph-mon[18549]: osdmap e34: 6 total, 5 up, 6 in 2024-08-28T19:26:26.800 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:26.800 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:26.800 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:26 smithi033 ceph-mon[18549]: from='osd.5 ' entity='osd.5' 2024-08-28T19:26:26.800 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:26:26.800 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:26:26.800 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:27 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:26:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:27 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:26:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:27 smithi059 ceph-mon[22052]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:27 smithi059 ceph-mon[22052]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:26:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:27 smithi059 ceph-mon[22052]: osd.5 [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] boot 2024-08-28T19:26:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:27 smithi059 ceph-mon[22052]: osdmap e35: 6 total, 6 up, 6 in 2024-08-28T19:26:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:27 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:26:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:27 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:26:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:27 smithi122 ceph-mon[22174]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:27 smithi122 ceph-mon[22174]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:26:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:27 smithi122 ceph-mon[22174]: osd.5 [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] boot 2024-08-28T19:26:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:27 smithi122 ceph-mon[22174]: osdmap e35: 6 total, 6 up, 6 in 2024-08-28T19:26:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:27.806 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:27 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:26:27.807 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:27 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:26:27.807 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:27 smithi033 ceph-mon[18549]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-28T19:26:27.807 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:27 smithi033 ceph-mon[18549]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:26:27.807 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:27.807 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:27 smithi033 ceph-mon[18549]: osd.5 [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] boot 2024-08-28T19:26:27.807 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:27 smithi033 ceph-mon[18549]: osdmap e35: 6 total, 6 up, 6 in 2024-08-28T19:26:27.807 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-28T19:26:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:28 smithi059 ceph-mon[22052]: osdmap e36: 6 total, 6 up, 6 in 2024-08-28T19:26:28.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:28 smithi122 ceph-mon[22174]: osdmap e36: 6 total, 6 up, 6 in 2024-08-28T19:26:28.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:28 smithi033 ceph-mon[18549]: osdmap e36: 6 total, 6 up, 6 in 2024-08-28T19:26:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:29 smithi059 ceph-mon[22052]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:29 smithi059 ceph-mon[22052]: osdmap e37: 6 total, 6 up, 6 in 2024-08-28T19:26:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:29 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2242194627' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "35915467-02f3-452e-905a-6587abdb8224"} : dispatch 2024-08-28T19:26:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:29 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2242194627' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35915467-02f3-452e-905a-6587abdb8224"}]': finished 2024-08-28T19:26:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:29 smithi059 ceph-mon[22052]: osdmap e38: 7 total, 6 up, 7 in 2024-08-28T19:26:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:29 smithi122 ceph-mon[22174]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:29 smithi122 ceph-mon[22174]: osdmap e37: 6 total, 6 up, 6 in 2024-08-28T19:26:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:29 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2242194627' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "35915467-02f3-452e-905a-6587abdb8224"} : dispatch 2024-08-28T19:26:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:29 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2242194627' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35915467-02f3-452e-905a-6587abdb8224"}]': finished 2024-08-28T19:26:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:29 smithi122 ceph-mon[22174]: osdmap e38: 7 total, 6 up, 7 in 2024-08-28T19:26:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:29.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:29 smithi033 ceph-mon[18549]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:29.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:29 smithi033 ceph-mon[18549]: osdmap e37: 6 total, 6 up, 6 in 2024-08-28T19:26:29.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:29 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2242194627' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "35915467-02f3-452e-905a-6587abdb8224"} : dispatch 2024-08-28T19:26:29.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:29 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2242194627' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35915467-02f3-452e-905a-6587abdb8224"}]': finished 2024-08-28T19:26:29.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:29 smithi033 ceph-mon[18549]: osdmap e38: 7 total, 6 up, 7 in 2024-08-28T19:26:29.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:30 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/678041626' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:26:30.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:30 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/678041626' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:26:30.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:30 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/678041626' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:26:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:31 smithi059 ceph-mon[22052]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:31 smithi122 ceph-mon[22174]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:31 smithi033 ceph-mon[18549]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:33.746 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:33 smithi033 ceph-mon[18549]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:33.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:33 smithi059 ceph-mon[22052]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:33 smithi122 ceph-mon[22174]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:35.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:35 smithi033 ceph-mon[18549]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-08-28T19:26:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:35 smithi059 ceph-mon[22052]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-08-28T19:26:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:35 smithi122 ceph-mon[22174]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-08-28T19:26:37.716 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:37 smithi033 ceph-mon[18549]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:26:37.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:37 smithi059 ceph-mon[22052]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:26:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:37 smithi122 ceph-mon[22174]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:26:38.776 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-28T19:26:38.776 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:38 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:38.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-28T19:26:38.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:38 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:38.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-28T19:26:38.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:38 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:39.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:39 smithi059 ceph-mon[22052]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-28T19:26:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:39 smithi059 ceph-mon[22052]: Deploying daemon osd.6 on smithi033 2024-08-28T19:26:39.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:39 smithi033 ceph-mon[18549]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-28T19:26:39.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:39 smithi033 ceph-mon[18549]: Deploying daemon osd.6 on smithi033 2024-08-28T19:26:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:39 smithi122 ceph-mon[22174]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-28T19:26:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:39 smithi122 ceph-mon[22174]: Deploying daemon osd.6 on smithi033 2024-08-28T19:26:41.694 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:41 smithi033 ceph-mon[18549]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-28T19:26:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:41 smithi059 ceph-mon[22052]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-28T19:26:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:41 smithi122 ceph-mon[22174]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-28T19:26:43.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:43 smithi033 ceph-mon[18549]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:26:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:43 smithi059 ceph-mon[22052]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:26:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:43 smithi122 ceph-mon[22174]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:26:44.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:44.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:44.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:44.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:44.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:44.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:44.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:44.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:44.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:45.605 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:45 smithi033 ceph-mon[18549]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:26:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:45 smithi059 ceph-mon[22052]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:26:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:45 smithi122 ceph-mon[22174]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:26:47.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.103+0000 7fe7927fc640 1 -- 172.21.15.33:0/2098099241 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe79c0635a0 con 0x7fe7880b4c00 2024-08-28T19:26:47.106 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 6 on host 'smithi033' 2024-08-28T19:26:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 -- 172.21.15.33:0/2098099241 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7880b4c00 msgr2=0x7fe7880b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7880b4c00 0x7fe7880b7110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe798005fd0 tx=0x7fe798005850 comp rx=0 tx=0).stop 2024-08-28T19:26:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 -- 172.21.15.33:0/2098099241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c108180 msgr2=0x7fe79c19b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c108180 0x7fe79c19b550 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe78c032fd0 tx=0x7fe78c004270 comp rx=0 tx=0).stop 2024-08-28T19:26:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 -- 172.21.15.33:0/2098099241 shutdown_connections 2024-08-28T19:26:47.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7880b4c00 0x7fe7880b7110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe79c108ad0 0x7fe79c19ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c108180 0x7fe79c19b550 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 --2- 172.21.15.33:0/2098099241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c102840 0x7fe79c19b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 -- 172.21.15.33:0/2098099241 >> 172.21.15.33:0/2098099241 conn(0x7fe79c079580 msgr2=0x7fe79c104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:26:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 -- 172.21.15.33:0/2098099241 shutdown_connections 2024-08-28T19:26:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:26:47.106+0000 7fe7a32a3640 1 -- 172.21.15.33:0/2098099241 wait complete. 2024-08-28T19:26:47.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:47 smithi033 ceph-mon[18549]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:47.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:47.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:47.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:47 smithi059 ceph-mon[22052]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:47.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:47.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:47 smithi122 ceph-mon[22174]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:47.804 DEBUG:teuthology.orchestra.run.smithi033:osd.6> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.6.service 2024-08-28T19:26:47.807 INFO:tasks.cephadm:Deploying osd.7 on smithi059 with /dev/vg_nvme/lv_2... 2024-08-28T19:26:47.807 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-28T19:26:48.073 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:26:49.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:48 smithi033 ceph-mon[18549]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:49.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:48 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:49.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:48 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:49.205 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:48 smithi059 ceph-mon[22052]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:49.205 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:48 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:49.205 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:48 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:49.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:48 smithi122 ceph-mon[22174]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:49.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:48 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:49.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:48 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:49.914 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:49 smithi033 ceph-mon[18549]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-28T19:26:49.915 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:26:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:26:49.638+0000 7efc493b5640 -1 osd.6 0 log_to_monitors true 2024-08-28T19:26:50.049 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:49 smithi059 ceph-mon[22052]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-28T19:26:50.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:49 smithi122 ceph-mon[22174]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-28T19:26:50.911 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:26:50.937 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_2 2024-08-28T19:26:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:50 smithi033 ceph-mon[18549]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:50 smithi033 ceph-mon[18549]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-28T19:26:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:50 smithi033 ceph-mon[18549]: osdmap e39: 7 total, 6 up, 7 in 2024-08-28T19:26:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:50 smithi033 ceph-mon[18549]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:26:51.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:51.192 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:26:51.266 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:50 smithi059 ceph-mon[22052]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:51.266 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:50 smithi059 ceph-mon[22052]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-28T19:26:51.267 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:50 smithi059 ceph-mon[22052]: osdmap e39: 7 total, 6 up, 7 in 2024-08-28T19:26:51.267 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:50 smithi059 ceph-mon[22052]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:26:51.267 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:51.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:50 smithi122 ceph-mon[22174]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:51.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:50 smithi122 ceph-mon[22174]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-28T19:26:51.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:50 smithi122 ceph-mon[22174]: osdmap e39: 7 total, 6 up, 7 in 2024-08-28T19:26:51.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:50 smithi122 ceph-mon[22174]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:26:51.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:51.629 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:26:51.307+0000 7efc45337640 -1 osd.6 0 waiting for initial osdmap 2024-08-28T19:26:51.630 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:26:51.318+0000 7efc3d12d640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:26:51.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.729+0000 7fdb57522640 1 -- 172.21.15.59:0/789639658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb50102d40 msgr2=0x7fdb5010fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.729+0000 7fdb57522640 1 --2- 172.21.15.59:0/789639658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb50102d40 0x7fdb5010fa60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009900 tx=0x7fdb4002a480 comp rx=0 tx=0).stop 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.729+0000 7fdb57522640 1 -- 172.21.15.59:0/789639658 shutdown_connections 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.729+0000 7fdb57522640 1 --2- 172.21.15.59:0/789639658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb5010ffa0 0x7fdb501123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.729+0000 7fdb57522640 1 --2- 172.21.15.59:0/789639658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb50102d40 0x7fdb5010fa60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.729+0000 7fdb57522640 1 --2- 172.21.15.59:0/789639658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb501023f0 0x7fdb50102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.729+0000 7fdb57522640 1 -- 172.21.15.59:0/789639658 >> 172.21.15.59:0/789639658 conn(0x7fdb50079530 msgr2=0x7fdb50079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.729+0000 7fdb57522640 1 -- 172.21.15.59:0/789639658 shutdown_connections 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.729+0000 7fdb57522640 1 -- 172.21.15.59:0/789639658 wait complete. 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.730+0000 7fdb57522640 1 Processor -- start 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.730+0000 7fdb57522640 1 -- start start 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.730+0000 7fdb57522640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb501023f0 0x7fdb5019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.730+0000 7fdb57522640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb50102d40 0x7fdb5019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.730+0000 7fdb57522640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb5010ffa0 0x7fdb501a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.730+0000 7fdb57522640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50115a40 con 0x7fdb5010ffa0 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.730+0000 7fdb57522640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdb501158c0 con 0x7fdb501023f0 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.730+0000 7fdb57522640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50115bc0 con 0x7fdb50102d40 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb552be640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb501023f0 0x7fdb5019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb552be640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb501023f0 0x7fdb5019c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46482/0 (socket says 172.21.15.59:46482) 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb552be640 1 -- 172.21.15.59:0/4057471300 learned_addr learned my addr 172.21.15.59:0/4057471300 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb55abf640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb5010ffa0 0x7fdb501a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb54abd640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb50102d40 0x7fdb5019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb552be640 1 -- 172.21.15.59:0/4057471300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb50102d40 msgr2=0x7fdb5019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb552be640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb50102d40 0x7fdb5019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb552be640 1 -- 172.21.15.59:0/4057471300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb5010ffa0 msgr2=0x7fdb501a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:26:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb552be640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb5010ffa0 0x7fdb501a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:26:51.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb552be640 1 -- 172.21.15.59:0/4057471300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb501a2360 con 0x7fdb501023f0 2024-08-28T19:26:51.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb552be640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb501023f0 0x7fdb5019c3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00ea60 tx=0x7fdb4c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:26:51.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb467fc640 1 -- 172.21.15.59:0/4057471300 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00cde0 con 0x7fdb501023f0 2024-08-28T19:26:51.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb57522640 1 -- 172.21.15.59:0/4057471300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb501a2650 con 0x7fdb501023f0 2024-08-28T19:26:51.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb467fc640 1 -- 172.21.15.59:0/4057471300 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb4c0035f0 con 0x7fdb501023f0 2024-08-28T19:26:51.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb467fc640 1 -- 172.21.15.59:0/4057471300 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c010690 con 0x7fdb501023f0 2024-08-28T19:26:51.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.731+0000 7fdb57522640 1 -- 172.21.15.59:0/4057471300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb501a8db0 con 0x7fdb501023f0 2024-08-28T19:26:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.732+0000 7fdb57522640 1 -- 172.21.15.59:0/4057471300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5006bc70 con 0x7fdb501023f0 2024-08-28T19:26:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.734+0000 7fdb467fc640 1 -- 172.21.15.59:0/4057471300 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fdb4c0037a0 con 0x7fdb501023f0 2024-08-28T19:26:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.735+0000 7fdb467fc640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb3c0b4b80 0x7fdb3c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:26:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.735+0000 7fdb467fc640 1 -- 172.21.15.59:0/4057471300 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4900+0+0 (secure 0 0 0) 0x7fdb4c0e4b70 con 0x7fdb501023f0 2024-08-28T19:26:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.735+0000 7fdb54abd640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb3c0b4b80 0x7fdb3c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:26:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.735+0000 7fdb54abd640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb3c0b4b80 0x7fdb3c0b7090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdb40031440 tx=0x7fdb40009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:26:51.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.738+0000 7fdb467fc640 1 -- 172.21.15.59:0/4057471300 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdb4c0ac950 con 0x7fdb501023f0 2024-08-28T19:26:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:26:51.935+0000 7fdb57522640 1 -- 172.21.15.59:0/4057471300 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fdb5010a1e0 con 0x7fdb3c0b4b80 2024-08-28T19:26:52.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:26:52.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: osdmap e40: 7 total, 6 up, 7 in 2024-08-28T19:26:52.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:52.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:52.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' 2024-08-28T19:26:52.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi033 2024-08-28T19:26:52.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi033 to 5697M 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:52.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:26:52.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: osdmap e40: 7 total, 6 up, 7 in 2024-08-28T19:26:52.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:52.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:52.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' 2024-08-28T19:26:52.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi033 2024-08-28T19:26:52.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:52.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:52.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:52.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi033 to 5697M 2024-08-28T19:26:52.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:52.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:52.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:52.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:52.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:52.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:26:52.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: osdmap e40: 7 total, 6 up, 7 in 2024-08-28T19:26:52.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:52.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:52.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784]' entity='osd.6' 2024-08-28T19:26:52.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi033 2024-08-28T19:26:52.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:52.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:52.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:26:52.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi033 to 5697M 2024-08-28T19:26:52.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:52.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:52.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:52.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:26:52.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:52.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:26:52.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] boot 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: osdmap e41: 7 total, 7 up, 7 in 2024-08-28T19:26:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:53.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:26:53.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:26:53.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:53.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:53.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:26:53.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:26:53.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:26:53.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:53.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] boot 2024-08-28T19:26:53.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: osdmap e41: 7 total, 7 up, 7 in 2024-08-28T19:26:53.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:53.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:26:53.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:26:53.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-08-28T19:26:53.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:53.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:26:53.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:26:53.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:26:53.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:26:53.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: osd.6 [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] boot 2024-08-28T19:26:53.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: osdmap e41: 7 total, 7 up, 7 in 2024-08-28T19:26:53.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-28T19:26:54.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:54 smithi059 ceph-mon[22052]: osdmap e42: 7 total, 7 up, 7 in 2024-08-28T19:26:54.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:54 smithi059 ceph-mon[22052]: from='client.? 172.21.15.59:0/3125227614' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b817ce35-db7a-4d3d-828b-c10ac52c6681"} : dispatch 2024-08-28T19:26:54.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:54 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b817ce35-db7a-4d3d-828b-c10ac52c6681"} : dispatch 2024-08-28T19:26:54.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:54 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b817ce35-db7a-4d3d-828b-c10ac52c6681"}]': finished 2024-08-28T19:26:54.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:54 smithi059 ceph-mon[22052]: osdmap e43: 8 total, 7 up, 8 in 2024-08-28T19:26:54.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:26:54.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:54 smithi122 ceph-mon[22174]: osdmap e42: 7 total, 7 up, 7 in 2024-08-28T19:26:54.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:54 smithi122 ceph-mon[22174]: from='client.? 172.21.15.59:0/3125227614' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b817ce35-db7a-4d3d-828b-c10ac52c6681"} : dispatch 2024-08-28T19:26:54.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:54 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b817ce35-db7a-4d3d-828b-c10ac52c6681"} : dispatch 2024-08-28T19:26:54.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:54 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b817ce35-db7a-4d3d-828b-c10ac52c6681"}]': finished 2024-08-28T19:26:54.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:54 smithi122 ceph-mon[22174]: osdmap e43: 8 total, 7 up, 8 in 2024-08-28T19:26:54.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:26:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:54 smithi033 ceph-mon[18549]: osdmap e42: 7 total, 7 up, 7 in 2024-08-28T19:26:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:54 smithi033 ceph-mon[18549]: from='client.? 172.21.15.59:0/3125227614' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b817ce35-db7a-4d3d-828b-c10ac52c6681"} : dispatch 2024-08-28T19:26:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:54 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b817ce35-db7a-4d3d-828b-c10ac52c6681"} : dispatch 2024-08-28T19:26:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:54 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b817ce35-db7a-4d3d-828b-c10ac52c6681"}]': finished 2024-08-28T19:26:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:54 smithi033 ceph-mon[18549]: osdmap e43: 8 total, 7 up, 8 in 2024-08-28T19:26:54.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:26:55.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:55 smithi059 ceph-mon[22052]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:26:55.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:55 smithi059 ceph-mon[22052]: from='client.? 172.21.15.59:0/3854365389' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:26:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:55 smithi122 ceph-mon[22174]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:26:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:55 smithi122 ceph-mon[22174]: from='client.? 172.21.15.59:0/3854365389' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:26:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:55 smithi033 ceph-mon[18549]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:26:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:55 smithi033 ceph-mon[18549]: from='client.? 172.21.15.59:0/3854365389' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:26:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:57 smithi059 ceph-mon[22052]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:26:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:57 smithi122 ceph-mon[22174]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:26:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:57 smithi033 ceph-mon[18549]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:26:59.741 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:26:59 smithi033 ceph-mon[18549]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:26:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:26:59 smithi059 ceph-mon[22052]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:26:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:26:59 smithi122 ceph-mon[22174]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:01.766 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:01 smithi059 ceph-mon[22052]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:01 smithi122 ceph-mon[22174]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:01.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:01 smithi033 ceph-mon[18549]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:02.744 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-28T19:27:02.744 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-28T19:27:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:02.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-28T19:27:02.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:03.693 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:03 smithi059 ceph-mon[22052]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:03.693 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:03 smithi059 ceph-mon[22052]: Deploying daemon osd.7 on smithi059 2024-08-28T19:27:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:03 smithi122 ceph-mon[22174]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:03 smithi122 ceph-mon[22174]: Deploying daemon osd.7 on smithi059 2024-08-28T19:27:03.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:03 smithi033 ceph-mon[18549]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:03.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:03 smithi033 ceph-mon[18549]: Deploying daemon osd.7 on smithi059 2024-08-28T19:27:04.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:04 smithi059 ceph-mon[22052]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:04.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:04 smithi122 ceph-mon[22174]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:04.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:04 smithi033 ceph-mon[18549]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:07.005 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:06 smithi059 ceph-mon[22052]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:07.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:06 smithi122 ceph-mon[22174]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:07.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:06 smithi033 ceph-mon[18549]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:07.966 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:07 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:07.966 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:07 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:07.966 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:07 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:08.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:07 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:08.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:07 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:08.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:07 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:08.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:07 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:08.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:07 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:08.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:07 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:09.496 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:09 smithi059 ceph-mon[22052]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:09.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:09 smithi122 ceph-mon[22174]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:09.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:09 smithi033 ceph-mon[18549]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:10.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.745+0000 7fdb467fc640 1 -- 172.21.15.59:0/4057471300 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdb5010a1e0 con 0x7fdb3c0b4b80 2024-08-28T19:27:10.746 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 7 on host 'smithi059' 2024-08-28T19:27:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 -- 172.21.15.59:0/4057471300 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb3c0b4b80 msgr2=0x7fdb3c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:27:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb3c0b4b80 0x7fdb3c0b7090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdb40031440 tx=0x7fdb40009560 comp rx=0 tx=0).stop 2024-08-28T19:27:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 -- 172.21.15.59:0/4057471300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb501023f0 msgr2=0x7fdb5019c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:27:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb501023f0 0x7fdb5019c3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00ea60 tx=0x7fdb4c00ef20 comp rx=0 tx=0).stop 2024-08-28T19:27:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 -- 172.21.15.59:0/4057471300 shutdown_connections 2024-08-28T19:27:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb5010ffa0 0x7fdb501a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb3c0b4b80 0x7fdb3c0b7090 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb50102d40 0x7fdb5019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 --2- 172.21.15.59:0/4057471300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb501023f0 0x7fdb5019c3f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 -- 172.21.15.59:0/4057471300 >> 172.21.15.59:0/4057471300 conn(0x7fdb50079530 msgr2=0x7fdb50109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:27:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 -- 172.21.15.59:0/4057471300 shutdown_connections 2024-08-28T19:27:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:27:10.747+0000 7fdb57522640 1 -- 172.21.15.59:0/4057471300 wait complete. 2024-08-28T19:27:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:11 smithi059 ceph-mon[22052]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:11 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:11 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:11 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:11 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:11 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:11 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:11 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:11 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:10 smithi122 ceph-mon[22174]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:11.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:11.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:11.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:11.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.378 DEBUG:teuthology.orchestra.run.smithi059:osd.7> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.7.service 2024-08-28T19:27:11.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:10 smithi033 ceph-mon[18549]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:11.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:11.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:11.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:11.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:11.381 INFO:tasks.cephadm:Deploying osd.8 on smithi122 with /dev/vg_nvme/lv_2... 2024-08-28T19:27:11.381 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-28T19:27:11.636 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:27:12.869 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:27:12 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:27:12.804+0000 7fd042726640 -1 osd.7 0 log_to_monitors true 2024-08-28T19:27:13.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:13 smithi122 ceph-mon[22174]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:13.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:13 smithi122 ceph-mon[22174]: from='osd.7 [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T19:27:13.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:13 smithi122 ceph-mon[22174]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T19:27:13.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:13 smithi059 ceph-mon[22052]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:13.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:13 smithi059 ceph-mon[22052]: from='osd.7 [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T19:27:13.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:13 smithi059 ceph-mon[22052]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T19:27:13.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:13 smithi033 ceph-mon[18549]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:13.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:13 smithi033 ceph-mon[18549]: from='osd.7 [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T19:27:13.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:13 smithi033 ceph-mon[18549]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-28T19:27:14.274 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:27:14 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:27:14.019+0000 7fd03e6a8640 -1 osd.7 0 waiting for initial osdmap 2024-08-28T19:27:14.274 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:27:14 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:27:14.032+0000 7fd03a4a6640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:27:14.274 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:14 smithi059 ceph-mon[22052]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-28T19:27:14.274 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:14 smithi059 ceph-mon[22052]: osdmap e44: 8 total, 7 up, 8 in 2024-08-28T19:27:14.275 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:14 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:14.275 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:14 smithi059 ceph-mon[22052]: from='osd.7 [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:27:14.275 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:14 smithi059 ceph-mon[22052]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:27:14.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:14 smithi122 ceph-mon[22174]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-28T19:27:14.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:14 smithi122 ceph-mon[22174]: osdmap e44: 8 total, 7 up, 8 in 2024-08-28T19:27:14.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:14 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:14.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:14 smithi122 ceph-mon[22174]: from='osd.7 [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:27:14.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:14 smithi122 ceph-mon[22174]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:27:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:27:14.345 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_2 2024-08-28T19:27:14.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:14 smithi033 ceph-mon[18549]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-28T19:27:14.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:14 smithi033 ceph-mon[18549]: osdmap e44: 8 total, 7 up, 8 in 2024-08-28T19:27:14.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:14 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:14.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:14 smithi033 ceph-mon[18549]: from='osd.7 [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:27:14.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:14 smithi033 ceph-mon[18549]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:27:14.596 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:27:15.068 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.061+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2376153376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e741082d0 msgr2=0x7f4e7410eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.061+0000 7f4e7b93c640 1 --2- 172.21.15.122:0/2376153376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e741082d0 0x7f4e7410eb00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009ca0 tx=0x7f4e6c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.061+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2376153376 shutdown_connections 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.061+0000 7f4e7b93c640 1 --2- 172.21.15.122:0/2376153376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e741082d0 0x7f4e7410eb00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.061+0000 7f4e7b93c640 1 --2- 172.21.15.122:0/2376153376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e74107980 0x7f4e74107d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.061+0000 7f4e7b93c640 1 --2- 172.21.15.122:0/2376153376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e74102040 0x7f4e74102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.061+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2376153376 >> 172.21.15.122:0/2376153376 conn(0x7f4e74079c60 msgr2=0x7f4e7407a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.061+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2376153376 shutdown_connections 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.061+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2376153376 wait complete. 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e7b93c640 1 Processor -- start 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e7b93c640 1 -- start start 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e7b93c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e74102040 0x7f4e741980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:27:15.069 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e7b93c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e74107980 0x7f4e74198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e7b93c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e741082d0 0x7f4e7419d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e7b93c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74111710 con 0x7f4e741082d0 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e7b93c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74111590 con 0x7f4e74102040 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e7b93c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74111890 con 0x7f4e74107980 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e78ed7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e74107980 0x7f4e74198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e78ed7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e74107980 0x7f4e74198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45308/0 (socket says 172.21.15.122:45308) 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.062+0000 7f4e78ed7640 1 -- 172.21.15.122:0/2078890190 learned_addr learned my addr 172.21.15.122:0/2078890190 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e79ed9640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e741082d0 0x7f4e7419d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e796d8640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e74102040 0x7f4e741980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e78ed7640 1 -- 172.21.15.122:0/2078890190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e74102040 msgr2=0x7f4e741980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e78ed7640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e74102040 0x7f4e741980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:15.070 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e78ed7640 1 -- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e741082d0 msgr2=0x7f4e7419d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e78ed7640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e741082d0 0x7f4e7419d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e78ed7640 1 -- 172.21.15.122:0/2078890190 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7419df70 con 0x7f4e74107980 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e79ed9640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e741082d0 0x7f4e7419d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e78ed7640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e74107980 0x7f4e74198660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c8c0 tx=0x7f4e6400cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e6a7fc640 1 -- 172.21.15.122:0/2078890190 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64007bb0 con 0x7f4e74107980 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e6a7fc640 1 -- 172.21.15.122:0/2078890190 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e64007d50 con 0x7f4e74107980 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e6a7fc640 1 -- 172.21.15.122:0/2078890190 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e640187c0 con 0x7f4e74107980 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2078890190 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7419e260 con 0x7f4e74107980 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.063+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2078890190 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741a4a80 con 0x7f4e74107980 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.064+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2078890190 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e74102450 con 0x7f4e74107980 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.066+0000 7f4e6a7fc640 1 -- 172.21.15.122:0/2078890190 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f4e6400fa20 con 0x7f4e74107980 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.067+0000 7f4e6a7fc640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e600b4bb0 0x7f4e600b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.067+0000 7f4e6a7fc640 1 -- 172.21.15.122:0/2078890190 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5645+0+0 (secure 0 0 0) 0x7f4e640e4ab0 con 0x7f4e74107980 2024-08-28T19:27:15.071 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.067+0000 7f4e796d8640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e600b4bb0 0x7f4e600b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:27:15.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.067+0000 7f4e796d8640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e600b4bb0 0x7f4e600b70c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e70005fd0 tx=0x7f4e70005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:27:15.072 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.069+0000 7f4e6a7fc640 1 -- 172.21.15.122:0/2078890190 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4e64014030 con 0x7f4e74107980 2024-08-28T19:27:15.260 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:15.259+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2078890190 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4e740635a0 con 0x7f4e600b4bb0 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: osdmap e45: 8 total, 7 up, 8 in 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: osd.7 [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] boot 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: osdmap e46: 8 total, 8 up, 8 in 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi059 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.261 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:15.262 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:15.262 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:15.262 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi059 to 5697M 2024-08-28T19:27:15.262 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.262 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:15.262 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:15.262 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:15 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:15.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:27:15.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: osdmap e45: 8 total, 7 up, 8 in 2024-08-28T19:27:15.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:15.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:15.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: osd.7 [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] boot 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: osdmap e46: 8 total, 8 up, 8 in 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi059 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi059 to 5697M 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:15.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:15.285 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:15 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-08-28T19:27:15.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:27:15.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: osdmap e45: 8 total, 7 up, 8 in 2024-08-28T19:27:15.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:15.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:15.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: osd.7 [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] boot 2024-08-28T19:27:15.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: osdmap e46: 8 total, 8 up, 8 in 2024-08-28T19:27:15.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-28T19:27:15.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi059 2024-08-28T19:27:15.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:15.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:15.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:15.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi059 to 5697M 2024-08-28T19:27:15.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:15.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:15.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:15.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:15 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:16.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:16 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:27:16.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:16 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:27:16.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:16 smithi122 ceph-mon[22174]: osdmap e47: 8 total, 8 up, 8 in 2024-08-28T19:27:16.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:16 smithi122 ceph-mon[22174]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:27:16.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:27:16.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:27:16.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:16 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:27:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:16 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:27:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:16 smithi059 ceph-mon[22052]: osdmap e47: 8 total, 8 up, 8 in 2024-08-28T19:27:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:16 smithi059 ceph-mon[22052]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:27:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:27:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:27:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:16.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:16 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:27:16.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:16 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:27:16.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:16 smithi033 ceph-mon[18549]: osdmap e47: 8 total, 8 up, 8 in 2024-08-28T19:27:16.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:16 smithi033 ceph-mon[18549]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:27:16.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:27:16.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:27:16.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:17.531 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:17 smithi033 ceph-mon[18549]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:17.531 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:17 smithi033 ceph-mon[18549]: osdmap e48: 8 total, 8 up, 8 in 2024-08-28T19:27:17.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:17 smithi059 ceph-mon[22052]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:17.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:17 smithi059 ceph-mon[22052]: osdmap e48: 8 total, 8 up, 8 in 2024-08-28T19:27:17.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:17 smithi122 ceph-mon[22174]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:17.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:17 smithi122 ceph-mon[22174]: osdmap e48: 8 total, 8 up, 8 in 2024-08-28T19:27:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:18 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/2865607955' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6fda6eb9-377c-426e-8dc6-5a16f4b0556b"} : dispatch 2024-08-28T19:27:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:18 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6fda6eb9-377c-426e-8dc6-5a16f4b0556b"} : dispatch 2024-08-28T19:27:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:18 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fda6eb9-377c-426e-8dc6-5a16f4b0556b"}]': finished 2024-08-28T19:27:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:18 smithi059 ceph-mon[22052]: osdmap e49: 9 total, 8 up, 9 in 2024-08-28T19:27:18.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:18 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:18.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:18 smithi122 ceph-mon[22174]: from='client.? 172.21.15.122:0/2865607955' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6fda6eb9-377c-426e-8dc6-5a16f4b0556b"} : dispatch 2024-08-28T19:27:18.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:18 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6fda6eb9-377c-426e-8dc6-5a16f4b0556b"} : dispatch 2024-08-28T19:27:18.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:18 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fda6eb9-377c-426e-8dc6-5a16f4b0556b"}]': finished 2024-08-28T19:27:18.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:18 smithi122 ceph-mon[22174]: osdmap e49: 9 total, 8 up, 9 in 2024-08-28T19:27:18.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:18 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:18.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:18 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/2865607955' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6fda6eb9-377c-426e-8dc6-5a16f4b0556b"} : dispatch 2024-08-28T19:27:18.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:18 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6fda6eb9-377c-426e-8dc6-5a16f4b0556b"} : dispatch 2024-08-28T19:27:18.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:18 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fda6eb9-377c-426e-8dc6-5a16f4b0556b"}]': finished 2024-08-28T19:27:18.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:18 smithi033 ceph-mon[18549]: osdmap e49: 9 total, 8 up, 9 in 2024-08-28T19:27:18.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:18 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:19.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:19 smithi059 ceph-mon[22052]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:19.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:19 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/2984261198' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:27:19.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:19 smithi122 ceph-mon[22174]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:19.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:19 smithi122 ceph-mon[22174]: from='client.? 172.21.15.122:0/2984261198' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:27:19.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:19 smithi033 ceph-mon[18549]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:19.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:19 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/2984261198' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:27:21.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:21 smithi059 ceph-mon[22052]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:21.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:21 smithi122 ceph-mon[22174]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:21.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:21 smithi033 ceph-mon[18549]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:23.453 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:23 smithi122 ceph-mon[22174]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-08-28T19:27:23.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:23 smithi059 ceph-mon[22052]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-08-28T19:27:23.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:23 smithi033 ceph-mon[18549]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-08-28T19:27:25.287 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:25 smithi122 ceph-mon[22174]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:27:25.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:25 smithi059 ceph-mon[22052]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:27:25.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:25 smithi033 ceph-mon[18549]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:27:27.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:27 smithi122 ceph-mon[22174]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-28T19:27:27.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-28T19:27:27.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:27.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:27 smithi122 ceph-mon[22174]: Deploying daemon osd.8 on smithi122 2024-08-28T19:27:27.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:27 smithi059 ceph-mon[22052]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-28T19:27:27.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-28T19:27:27.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:27.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:27 smithi059 ceph-mon[22052]: Deploying daemon osd.8 on smithi122 2024-08-28T19:27:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:27 smithi033 ceph-mon[18549]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-28T19:27:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-28T19:27:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:27 smithi033 ceph-mon[18549]: Deploying daemon osd.8 on smithi122 2024-08-28T19:27:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:29 smithi059 ceph-mon[22052]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T19:27:29.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:29 smithi122 ceph-mon[22174]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T19:27:29.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:29 smithi033 ceph-mon[18549]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-28T19:27:31.439 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:31 smithi122 ceph-mon[22174]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:27:31.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:31 smithi059 ceph-mon[22052]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:27:31.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:31 smithi033 ceph-mon[18549]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:27:32.407 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:32 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:32.407 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:32 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:32.407 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:32 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:32.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:32 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:32.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:32 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:32.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:32 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:32.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:32 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:32.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:32 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:32.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:32 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:33.444 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:33 smithi122 ceph-mon[22174]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:27:33.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:33 smithi059 ceph-mon[22052]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:27:33.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:33 smithi033 ceph-mon[18549]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:27:35.622 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:35 smithi122 ceph-mon[22174]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:35.622 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:35 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:35.622 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:35 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:35.622 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:35 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:35.622 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:35 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:35.623 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:35 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:35.665 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.664+0000 7f4e6a7fc640 1 -- 172.21.15.122:0/2078890190 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4e740635a0 con 0x7f4e600b4bb0 2024-08-28T19:27:35.665 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 8 on host 'smithi122' 2024-08-28T19:27:35.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e600b4bb0 msgr2=0x7f4e600b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:27:35.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e600b4bb0 0x7f4e600b70c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e70005fd0 tx=0x7f4e70005850 comp rx=0 tx=0).stop 2024-08-28T19:27:35.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2078890190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e74107980 msgr2=0x7f4e74198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:27:35.667 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e74107980 0x7f4e74198660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c8c0 tx=0x7f4e6400cd80 comp rx=0 tx=0).stop 2024-08-28T19:27:35.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2078890190 shutdown_connections 2024-08-28T19:27:35.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e741082d0 0x7f4e7419d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:35.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e600b4bb0 0x7f4e600b70c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:35.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e74107980 0x7f4e74198660 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:35.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 --2- 172.21.15.122:0/2078890190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e74102040 0x7f4e741980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:35.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2078890190 >> 172.21.15.122:0/2078890190 conn(0x7f4e74079c60 msgr2=0x7f4e74103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:27:35.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2078890190 shutdown_connections 2024-08-28T19:27:35.668 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:27:35.666+0000 7f4e7b93c640 1 -- 172.21.15.122:0/2078890190 wait complete. 2024-08-28T19:27:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:35 smithi059 ceph-mon[22052]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:35 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:35 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:35 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:35 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:35 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:35.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:35 smithi033 ceph-mon[18549]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:35.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:35 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:35.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:35 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:35.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:35 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:35.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:35 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:35.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:35 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:36.237 DEBUG:teuthology.orchestra.run.smithi122:osd.8> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.8.service 2024-08-28T19:27:36.239 INFO:tasks.cephadm:Deploying osd.9 on smithi033 with /dev/vg_nvme/lv_1... 2024-08-28T19:27:36.240 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-28T19:27:36.506 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:27:36.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:36.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:36.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:36.626 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:36.626 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:36.626 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:36.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:36.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:36.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:37.620 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:37 smithi122 ceph-mon[22174]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:37.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:37 smithi059 ceph-mon[22052]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:37.818 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:37 smithi033 ceph-mon[18549]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:38.043 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:27:37 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:27:37.761+0000 7f02403ef640 -1 osd.8 0 log_to_monitors true 2024-08-28T19:27:38.654 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:38 smithi122 ceph-mon[22174]: from='osd.8 [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T19:27:38.654 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:38 smithi122 ceph-mon[22174]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T19:27:38.663 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:38 smithi033 ceph-mon[18549]: from='osd.8 [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T19:27:38.663 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:38 smithi033 ceph-mon[18549]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T19:27:38.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:38 smithi059 ceph-mon[22052]: from='osd.8 [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T19:27:38.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:38 smithi059 ceph-mon[22052]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-28T19:27:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:27:39.297 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_1 2024-08-28T19:27:39.552 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:27:39.624 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:39.624 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-28T19:27:39.624 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: osdmap e50: 9 total, 8 up, 9 in 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='osd.8 [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:39.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-28T19:27:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: osdmap e50: 9 total, 8 up, 9 in 2024-08-28T19:27:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='osd.8 [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:27:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:27:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:39.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:39.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:39.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:39.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:39.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: osdmap e50: 9 total, 8 up, 9 in 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='osd.8 [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:27:39.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.041+0000 7fc99a751640 1 -- 172.21.15.33:0/3411195353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc994108ab0 msgr2=0x7fc99410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:27:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.041+0000 7fc99a751640 1 --2- 172.21.15.33:0/3411195353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc994108ab0 0x7fc99410f2e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc988009900 tx=0x7fc98802a410 comp rx=0 tx=0).stop 2024-08-28T19:27:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.041+0000 7fc99a751640 1 -- 172.21.15.33:0/3411195353 shutdown_connections 2024-08-28T19:27:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.041+0000 7fc99a751640 1 --2- 172.21.15.33:0/3411195353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc994108ab0 0x7fc99410f2e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.041+0000 7fc99a751640 1 --2- 172.21.15.33:0/3411195353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc994108160 0x7fc994108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.041+0000 7fc99a751640 1 --2- 172.21.15.33:0/3411195353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc994102820 0x7fc994102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.041+0000 7fc99a751640 1 -- 172.21.15.33:0/3411195353 >> 172.21.15.33:0/3411195353 conn(0x7fc9940794e0 msgr2=0x7fc9940798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:27:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.041+0000 7fc99a751640 1 -- 172.21.15.33:0/3411195353 shutdown_connections 2024-08-28T19:27:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.041+0000 7fc99a751640 1 -- 172.21.15.33:0/3411195353 wait complete. 2024-08-28T19:27:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.042+0000 7fc99a751640 1 Processor -- start 2024-08-28T19:27:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.042+0000 7fc99a751640 1 -- start start 2024-08-28T19:27:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.042+0000 7fc99a751640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc994102820 0x7fc99419c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:27:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.042+0000 7fc99a751640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc994108160 0x7fc99419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:27:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc99a751640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc994108ab0 0x7fc9941a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:27:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc99a751640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc994112730 con 0x7fc994108ab0 2024-08-28T19:27:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc99a751640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9941125b0 con 0x7fc994102820 2024-08-28T19:27:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc99a751640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9941128b0 con 0x7fc994108160 2024-08-28T19:27:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc998cee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc994108ab0 0x7fc9941a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:27:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc998cee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc994108ab0 0x7fc9941a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58930/0 (socket says 172.21.15.33:58930) 2024-08-28T19:27:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc998cee640 1 -- 172.21.15.33:0/3091700589 learned_addr learned my addr 172.21.15.33:0/3091700589 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:27:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc9937fe640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc994108160 0x7fc99419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc993fff640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc994102820 0x7fc99419c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc998cee640 1 -- 172.21.15.33:0/3091700589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc994108160 msgr2=0x7fc99419c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc998cee640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc994108160 0x7fc99419c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc998cee640 1 -- 172.21.15.33:0/3091700589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc994102820 msgr2=0x7fc99419c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc998cee640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc994102820 0x7fc99419c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc998cee640 1 -- 172.21.15.33:0/3091700589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9941a2350 con 0x7fc994108ab0 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc998cee640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc994108ab0 0x7fc9941a1c20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc988004770 tx=0x7fc988004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc9917fa640 1 -- 172.21.15.33:0/3091700589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98803f030 con 0x7fc994108ab0 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc9917fa640 1 -- 172.21.15.33:0/3091700589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc988003aa0 con 0x7fc994108ab0 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc99a751640 1 -- 172.21.15.33:0/3091700589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9941a25e0 con 0x7fc994108ab0 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.043+0000 7fc9917fa640 1 -- 172.21.15.33:0/3091700589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc988035070 con 0x7fc994108ab0 2024-08-28T19:27:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.044+0000 7fc99a751640 1 -- 172.21.15.33:0/3091700589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9941a8da0 con 0x7fc994108ab0 2024-08-28T19:27:40.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.045+0000 7fc99a751640 1 -- 172.21.15.33:0/3091700589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc994103aa0 con 0x7fc994108ab0 2024-08-28T19:27:40.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.046+0000 7fc9917fa640 1 -- 172.21.15.33:0/3091700589 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fc988042030 con 0x7fc994108ab0 2024-08-28T19:27:40.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.047+0000 7fc9917fa640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc97c0b4c00 0x7fc97c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:27:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.047+0000 7fc993fff640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc97c0b4c00 0x7fc97c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:27:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.047+0000 7fc9917fa640 1 -- 172.21.15.33:0/3091700589 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5764+0+0 (secure 0 0 0) 0x7fc988105070 con 0x7fc994108ab0 2024-08-28T19:27:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.047+0000 7fc993fff640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc97c0b4c00 0x7fc97c0b7110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc98400bbe0 tx=0x7fc98400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:27:40.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.050+0000 7fc9917fa640 1 -- 172.21.15.33:0/3091700589 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc9880cc540 con 0x7fc994108ab0 2024-08-28T19:27:40.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:27:40.245+0000 7fc99a751640 1 -- 172.21.15.33:0/3091700589 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc99406c050 con 0x7fc97c0b4c00 2024-08-28T19:27:40.293 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:27:39.867+0000 7f023c371640 -1 osd.8 0 waiting for initial osdmap 2024-08-28T19:27:40.293 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:27:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:27:39.881+0000 7f0234167640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:27:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:40 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi122 2024-08-28T19:27:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:40 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi122 to 5695M 2024-08-28T19:27:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:40 smithi033 ceph-mon[18549]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:27:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:40 smithi033 ceph-mon[18549]: osdmap e51: 9 total, 8 up, 9 in 2024-08-28T19:27:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:40 smithi033 ceph-mon[18549]: from='osd.8 ' entity='osd.8' 2024-08-28T19:27:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:27:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:27:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:40 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi122 2024-08-28T19:27:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:40 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi122 to 5695M 2024-08-28T19:27:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:40 smithi059 ceph-mon[22052]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:27:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:40 smithi059 ceph-mon[22052]: osdmap e51: 9 total, 8 up, 9 in 2024-08-28T19:27:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:40 smithi059 ceph-mon[22052]: from='osd.8 ' entity='osd.8' 2024-08-28T19:27:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:27:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:27:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:40 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi122 2024-08-28T19:27:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:40 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi122 to 5695M 2024-08-28T19:27:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:40 smithi122 ceph-mon[22174]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:27:40.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:40 smithi122 ceph-mon[22174]: osdmap e51: 9 total, 8 up, 9 in 2024-08-28T19:27:40.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:40.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:40.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:40 smithi122 ceph-mon[22174]: from='osd.8 ' entity='osd.8' 2024-08-28T19:27:40.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:27:40.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:27:40.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:41 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:27:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:41 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:27:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:41 smithi059 ceph-mon[22052]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:41 smithi059 ceph-mon[22052]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:27:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:41 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:41 smithi059 ceph-mon[22052]: osd.8 [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] boot 2024-08-28T19:27:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:41 smithi059 ceph-mon[22052]: osdmap e52: 9 total, 9 up, 9 in 2024-08-28T19:27:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:41 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:41.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:41 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:27:41.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:41 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:27:41.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:41 smithi033 ceph-mon[18549]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:41.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:41 smithi033 ceph-mon[18549]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:27:41.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:41 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:41.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:41 smithi033 ceph-mon[18549]: osd.8 [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] boot 2024-08-28T19:27:41.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:41 smithi033 ceph-mon[18549]: osdmap e52: 9 total, 9 up, 9 in 2024-08-28T19:27:41.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:41 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:41 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:27:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:41 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:27:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:41 smithi122 ceph-mon[22174]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-08-28T19:27:41.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:41 smithi122 ceph-mon[22174]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:27:41.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:41 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:41.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:41 smithi122 ceph-mon[22174]: osd.8 [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] boot 2024-08-28T19:27:41.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:41 smithi122 ceph-mon[22174]: osdmap e52: 9 total, 9 up, 9 in 2024-08-28T19:27:41.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:41 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-28T19:27:42.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:42 smithi059 ceph-mon[22052]: osdmap e53: 9 total, 9 up, 9 in 2024-08-28T19:27:42.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:42 smithi122 ceph-mon[22174]: osdmap e53: 9 total, 9 up, 9 in 2024-08-28T19:27:42.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:42 smithi033 ceph-mon[18549]: osdmap e53: 9 total, 9 up, 9 in 2024-08-28T19:27:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:43 smithi059 ceph-mon[22052]: pgmap v169: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:27:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:43 smithi059 ceph-mon[22052]: osdmap e54: 9 total, 9 up, 9 in 2024-08-28T19:27:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:43 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3440669878' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3410400b-dc26-4823-b1d3-b1811bae8b73"} : dispatch 2024-08-28T19:27:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:43 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3440669878' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3410400b-dc26-4823-b1d3-b1811bae8b73"}]': finished 2024-08-28T19:27:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:43 smithi059 ceph-mon[22052]: osdmap e55: 10 total, 9 up, 10 in 2024-08-28T19:27:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:43 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:27:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:43 smithi122 ceph-mon[22174]: pgmap v169: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:27:43.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:43 smithi122 ceph-mon[22174]: osdmap e54: 9 total, 9 up, 9 in 2024-08-28T19:27:43.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:43 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3440669878' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3410400b-dc26-4823-b1d3-b1811bae8b73"} : dispatch 2024-08-28T19:27:43.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:43 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3440669878' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3410400b-dc26-4823-b1d3-b1811bae8b73"}]': finished 2024-08-28T19:27:43.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:43 smithi122 ceph-mon[22174]: osdmap e55: 10 total, 9 up, 10 in 2024-08-28T19:27:43.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:43 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:27:43.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:43 smithi033 ceph-mon[18549]: pgmap v169: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:27:43.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:43 smithi033 ceph-mon[18549]: osdmap e54: 9 total, 9 up, 9 in 2024-08-28T19:27:43.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:43 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3440669878' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3410400b-dc26-4823-b1d3-b1811bae8b73"} : dispatch 2024-08-28T19:27:43.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:43 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3440669878' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3410400b-dc26-4823-b1d3-b1811bae8b73"}]': finished 2024-08-28T19:27:43.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:43 smithi033 ceph-mon[18549]: osdmap e55: 10 total, 9 up, 10 in 2024-08-28T19:27:43.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:43 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:27:44.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:44 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2587399068' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:27:44.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:44 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2587399068' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:27:44.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:44 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2587399068' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:27:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:45 smithi059 ceph-mon[22052]: pgmap v172: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:27:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:45 smithi122 ceph-mon[22174]: pgmap v172: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:27:45.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:45 smithi033 ceph-mon[18549]: pgmap v172: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:27:47.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:47 smithi033 ceph-mon[18549]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-28T19:27:47.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:47 smithi059 ceph-mon[22052]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-28T19:27:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:47 smithi122 ceph-mon[22174]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-28T19:27:49.597 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:49 smithi033 ceph-mon[18549]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-28T19:27:49.707 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:49 smithi122 ceph-mon[22174]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-28T19:27:49.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:49 smithi059 ceph-mon[22052]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-28T19:27:51.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:51 smithi059 ceph-mon[22052]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:27:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:51 smithi122 ceph-mon[22174]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:27:51.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:51 smithi033 ceph-mon[18549]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:27:52.676 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-28T19:27:52.676 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-28T19:27:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:52.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-28T19:27:52.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:27:53.754 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:53 smithi033 ceph-mon[18549]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-28T19:27:53.754 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:53 smithi033 ceph-mon[18549]: Deploying daemon osd.9 on smithi033 2024-08-28T19:27:53.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:53 smithi059 ceph-mon[22052]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-28T19:27:53.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:53 smithi059 ceph-mon[22052]: Deploying daemon osd.9 on smithi033 2024-08-28T19:27:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:53 smithi122 ceph-mon[22174]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-28T19:27:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:53 smithi122 ceph-mon[22174]: Deploying daemon osd.9 on smithi033 2024-08-28T19:27:55.745 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:55 smithi033 ceph-mon[18549]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-28T19:27:55.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:55 smithi059 ceph-mon[22052]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-28T19:27:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:55 smithi122 ceph-mon[22174]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-28T19:27:57.734 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:57 smithi033 ceph-mon[18549]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:27:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:57 smithi059 ceph-mon[22052]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:27:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:57 smithi122 ceph-mon[22174]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:27:58.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:58 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:58.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:58 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:58.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:58 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:58.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:58 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:58.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:58 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:58.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:58 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:58.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:58 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:27:58.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:58 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:58.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:58 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:27:59.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:27:59 smithi033 ceph-mon[18549]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:27:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:27:59 smithi059 ceph-mon[22052]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:27:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:27:59 smithi122 ceph-mon[22174]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:01.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.282+0000 7fc9917fa640 1 -- 172.21.15.33:0/3091700589 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc99406c050 con 0x7fc97c0b4c00 2024-08-28T19:28:01.284 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 9 on host 'smithi033' 2024-08-28T19:28:01.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 -- 172.21.15.33:0/3091700589 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc97c0b4c00 msgr2=0x7fc97c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:01.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc97c0b4c00 0x7fc97c0b7110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc98400bbe0 tx=0x7fc98400b390 comp rx=0 tx=0).stop 2024-08-28T19:28:01.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 -- 172.21.15.33:0/3091700589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc994108ab0 msgr2=0x7fc9941a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:01.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc994108ab0 0x7fc9941a1c20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc988004770 tx=0x7fc988004270 comp rx=0 tx=0).stop 2024-08-28T19:28:01.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 -- 172.21.15.33:0/3091700589 shutdown_connections 2024-08-28T19:28:01.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc994108ab0 0x7fc9941a1c20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:01.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc97c0b4c00 0x7fc97c0b7110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:01.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc994108160 0x7fc99419c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:01.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 --2- 172.21.15.33:0/3091700589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc994102820 0x7fc99419c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:01.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 -- 172.21.15.33:0/3091700589 >> 172.21.15.33:0/3091700589 conn(0x7fc9940794e0 msgr2=0x7fc99406b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:01.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 -- 172.21.15.33:0/3091700589 shutdown_connections 2024-08-28T19:28:01.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:01.285+0000 7fc99a751640 1 -- 172.21.15.33:0/3091700589 wait complete. 2024-08-28T19:28:01.602 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:01 smithi033 ceph-mon[18549]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:01.602 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:01 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.603 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:01 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.603 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:01 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:01.603 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:01 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:01.603 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:01 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.603 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:01 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:01.603 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:01 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.603 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:01 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:01 smithi059 ceph-mon[22052]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:01 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:01 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:01 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:01 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:01 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:01 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:01.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:01 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:01 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:01 smithi122 ceph-mon[22174]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:01 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:01 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:01 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:01.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:01 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:01.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:01 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:01 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:01.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:01 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:01 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:01.948 DEBUG:teuthology.orchestra.run.smithi033:osd.9> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.9.service 2024-08-28T19:28:01.951 INFO:tasks.cephadm:Deploying osd.10 on smithi059 with /dev/vg_nvme/lv_1... 2024-08-28T19:28:01.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-28T19:28:02.218 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:28:03.538 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:03 smithi033 ceph-mon[18549]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:03.715 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:03 smithi059 ceph-mon[22052]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:03 smithi122 ceph-mon[22174]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:04.260 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:28:03 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:28:03.894+0000 7ff1e2b2a640 -1 osd.9 0 log_to_monitors true 2024-08-28T19:28:04.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:04 smithi033 ceph-mon[18549]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-28T19:28:04.601 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:04 smithi059 ceph-mon[22052]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-28T19:28:04.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:04 smithi122 ceph-mon[22174]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-28T19:28:04.808 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-08-28T19:28:04.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_1 2024-08-28T19:28:05.092 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:28:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.627+0000 7f3e43743640 1 -- 172.21.15.59:0/4049613612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e3c108aa0 msgr2=0x7f3e3c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.627+0000 7f3e43743640 1 --2- 172.21.15.59:0/4049613612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e3c108aa0 0x7f3e3c10f2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009ca0 tx=0x7f3e3402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:28:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.627+0000 7f3e43743640 1 -- 172.21.15.59:0/4049613612 shutdown_connections 2024-08-28T19:28:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.627+0000 7f3e43743640 1 --2- 172.21.15.59:0/4049613612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e3c108aa0 0x7f3e3c10f2d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.627+0000 7f3e43743640 1 --2- 172.21.15.59:0/4049613612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e3c108150 0x7f3e3c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:05.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.627+0000 7f3e43743640 1 --2- 172.21.15.59:0/4049613612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e3c102810 0x7f3e3c102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.627+0000 7f3e43743640 1 -- 172.21.15.59:0/4049613612 >> 172.21.15.59:0/4049613612 conn(0x7f3e3c0794d0 msgr2=0x7f3e3c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.627+0000 7f3e43743640 1 -- 172.21.15.59:0/4049613612 shutdown_connections 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.627+0000 7f3e43743640 1 -- 172.21.15.59:0/4049613612 wait complete. 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.628+0000 7f3e43743640 1 Processor -- start 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.628+0000 7f3e43743640 1 -- start start 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.628+0000 7f3e43743640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e3c102810 0x7f3e3c199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.628+0000 7f3e43743640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e3c108150 0x7f3e3c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.628+0000 7f3e43743640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e3c108aa0 0x7f3e3c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e43743640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c112700 con 0x7f3e3c108150 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e43743640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c112580 con 0x7f3e3c102810 2024-08-28T19:28:05.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e43743640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c112880 con 0x7f3e3c108aa0 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e414df640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e3c102810 0x7f3e3c199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e414df640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e3c102810 0x7f3e3c199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40436/0 (socket says 172.21.15.59:40436) 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e414df640 1 -- 172.21.15.59:0/33951074 learned_addr learned my addr 172.21.15.59:0/33951074 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e41ce0640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e3c108aa0 0x7f3e3c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e40cde640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e3c108150 0x7f3e3c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e414df640 1 -- 172.21.15.59:0/33951074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e3c108aa0 msgr2=0x7f3e3c19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e414df640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e3c108aa0 0x7f3e3c19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e414df640 1 -- 172.21.15.59:0/33951074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e3c108150 msgr2=0x7f3e3c199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e414df640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e3c108150 0x7f3e3c199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e414df640 1 -- 172.21.15.59:0/33951074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3c19f000 con 0x7f3e3c102810 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e414df640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e3c102810 0x7f3e3c199090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800d950 tx=0x7f3e3800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e2e7fc640 1 -- 172.21.15.59:0/33951074 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38017070 con 0x7f3e3c102810 2024-08-28T19:28:05.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e43743640 1 -- 172.21.15.59:0/33951074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3c19f2f0 con 0x7f3e3c102810 2024-08-28T19:28:05.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e2e7fc640 1 -- 172.21.15.59:0/33951074 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e38009c30 con 0x7f3e3c102810 2024-08-28T19:28:05.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e2e7fc640 1 -- 172.21.15.59:0/33951074 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3800f620 con 0x7f3e3c102810 2024-08-28T19:28:05.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.629+0000 7f3e43743640 1 -- 172.21.15.59:0/33951074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3c06b880 con 0x7f3e3c102810 2024-08-28T19:28:05.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.631+0000 7f3e43743640 1 -- 172.21.15.59:0/33951074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3c103a90 con 0x7f3e3c102810 2024-08-28T19:28:05.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.632+0000 7f3e2e7fc640 1 -- 172.21.15.59:0/33951074 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f3e38010460 con 0x7f3e3c102810 2024-08-28T19:28:05.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.633+0000 7f3e2e7fc640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e280b4b80 0x7f3e280b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:05.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.633+0000 7f3e2e7fc640 1 -- 172.21.15.59:0/33951074 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6196+0+0 (secure 0 0 0) 0x7f3e380e4590 con 0x7f3e3c102810 2024-08-28T19:28:05.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.633+0000 7f3e40cde640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e280b4b80 0x7f3e280b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:05.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.634+0000 7f3e40cde640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e280b4b80 0x7f3e280b7090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e30005fd0 tx=0x7f3e30005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:05.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.636+0000 7f3e2e7fc640 1 -- 172.21.15.59:0/33951074 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3e380abf00 con 0x7f3e3c102810 2024-08-28T19:28:05.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: osdmap e56: 10 total, 9 up, 10 in 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:05.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: osdmap e56: 10 total, 9 up, 10 in 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:05.831+0000 7f3e43743640 1 -- 172.21.15.59:0/33951074 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3e3c06c370 con 0x7f3e280b4b80 2024-08-28T19:28:05.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:28:05.480+0000 7ff1deaac640 -1 osd.9 0 waiting for initial osdmap 2024-08-28T19:28:05.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:28:05.495+0000 7ff1da8aa640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:28:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-28T19:28:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: osdmap e56: 10 total, 9 up, 10 in 2024-08-28T19:28:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]} : dispatch 2024-08-28T19:28:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:05.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:05.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:05.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:05.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:06.503 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:06 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi033 2024-08-28T19:28:06.503 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:06 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi033 to 4273M 2024-08-28T19:28:06.503 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:06 smithi059 ceph-mon[22052]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:28:06.504 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:06 smithi059 ceph-mon[22052]: osdmap e57: 10 total, 9 up, 10 in 2024-08-28T19:28:06.504 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:06.504 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:06.504 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:28:06.504 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:28:06.504 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:06.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:06 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi033 2024-08-28T19:28:06.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:06 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi033 to 4273M 2024-08-28T19:28:06.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:06 smithi122 ceph-mon[22174]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:28:06.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:06 smithi122 ceph-mon[22174]: osdmap e57: 10 total, 9 up, 10 in 2024-08-28T19:28:06.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:06.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:06.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:28:06.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:28:06.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:06 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi033 2024-08-28T19:28:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:06 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi033 to 4273M 2024-08-28T19:28:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:06 smithi033 ceph-mon[18549]: from='osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-08-28T19:28:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:06 smithi033 ceph-mon[18549]: osdmap e57: 10 total, 9 up, 10 in 2024-08-28T19:28:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:28:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:28:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:07 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:28:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:07 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:28:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:07 smithi059 ceph-mon[22052]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:07 smithi059 ceph-mon[22052]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:28:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:07 smithi059 ceph-mon[22052]: osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] boot 2024-08-28T19:28:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:07 smithi059 ceph-mon[22052]: osdmap e58: 10 total, 10 up, 10 in 2024-08-28T19:28:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:07 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:07.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:07 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:28:07.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:07 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:28:07.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:07 smithi122 ceph-mon[22174]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:07.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:07 smithi122 ceph-mon[22174]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:28:07.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:07 smithi122 ceph-mon[22174]: osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] boot 2024-08-28T19:28:07.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:07 smithi122 ceph-mon[22174]: osdmap e58: 10 total, 10 up, 10 in 2024-08-28T19:28:07.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:07 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:07.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:07 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:28:07.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:07 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:28:07.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:07 smithi033 ceph-mon[18549]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-08-28T19:28:07.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:07 smithi033 ceph-mon[18549]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:28:07.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:07 smithi033 ceph-mon[18549]: osd.9 [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] boot 2024-08-28T19:28:07.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:07 smithi033 ceph-mon[18549]: osdmap e58: 10 total, 10 up, 10 in 2024-08-28T19:28:07.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:07 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-28T19:28:08.754 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:08 smithi059 ceph-mon[22052]: osdmap e59: 10 total, 10 up, 10 in 2024-08-28T19:28:08.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:08 smithi122 ceph-mon[22174]: osdmap e59: 10 total, 10 up, 10 in 2024-08-28T19:28:08.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:08 smithi033 ceph-mon[18549]: osdmap e59: 10 total, 10 up, 10 in 2024-08-28T19:28:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:09 smithi059 ceph-mon[22052]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:09 smithi059 ceph-mon[22052]: from='client.? 172.21.15.59:0/530872285' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6d6159a-9538-4ae7-8950-46356be55137"} : dispatch 2024-08-28T19:28:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:09 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6d6159a-9538-4ae7-8950-46356be55137"} : dispatch 2024-08-28T19:28:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:09 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6d6159a-9538-4ae7-8950-46356be55137"}]': finished 2024-08-28T19:28:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:09 smithi059 ceph-mon[22052]: osdmap e60: 11 total, 10 up, 11 in 2024-08-28T19:28:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:09 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:09 smithi059 ceph-mon[22052]: from='client.? 172.21.15.59:0/4176079246' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:28:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:09 smithi122 ceph-mon[22174]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:09 smithi122 ceph-mon[22174]: from='client.? 172.21.15.59:0/530872285' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6d6159a-9538-4ae7-8950-46356be55137"} : dispatch 2024-08-28T19:28:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:09 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6d6159a-9538-4ae7-8950-46356be55137"} : dispatch 2024-08-28T19:28:09.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:09 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6d6159a-9538-4ae7-8950-46356be55137"}]': finished 2024-08-28T19:28:09.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:09 smithi122 ceph-mon[22174]: osdmap e60: 11 total, 10 up, 11 in 2024-08-28T19:28:09.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:09 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:09.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:09 smithi122 ceph-mon[22174]: from='client.? 172.21.15.59:0/4176079246' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:28:09.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:09 smithi033 ceph-mon[18549]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:09.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:09 smithi033 ceph-mon[18549]: from='client.? 172.21.15.59:0/530872285' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6d6159a-9538-4ae7-8950-46356be55137"} : dispatch 2024-08-28T19:28:09.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:09 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6d6159a-9538-4ae7-8950-46356be55137"} : dispatch 2024-08-28T19:28:09.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:09 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6d6159a-9538-4ae7-8950-46356be55137"}]': finished 2024-08-28T19:28:09.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:09 smithi033 ceph-mon[18549]: osdmap e60: 11 total, 10 up, 11 in 2024-08-28T19:28:09.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:09 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:09.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:09 smithi033 ceph-mon[18549]: from='client.? 172.21.15.59:0/4176079246' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:28:11.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:11 smithi059 ceph-mon[22052]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:11.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:11 smithi122 ceph-mon[22174]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:11.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:11 smithi033 ceph-mon[18549]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:12.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:12 smithi059 ceph-mon[22052]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:12.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:12 smithi122 ceph-mon[22174]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:12.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:12 smithi033 ceph-mon[18549]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:15.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:14 smithi059 ceph-mon[22052]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:15.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:14 smithi122 ceph-mon[22174]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:15.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:14 smithi033 ceph-mon[18549]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:17.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:16 smithi059 ceph-mon[22052]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:17.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:16 smithi122 ceph-mon[22174]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:17.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:16 smithi033 ceph-mon[18549]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:18.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:17 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-28T19:28:18.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:17 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:18.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:17 smithi033 ceph-mon[18549]: Deploying daemon osd.10 on smithi059 2024-08-28T19:28:18.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:17 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-28T19:28:18.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:17 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:18.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:17 smithi059 ceph-mon[22052]: Deploying daemon osd.10 on smithi059 2024-08-28T19:28:18.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:17 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-28T19:28:18.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:17 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:18.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:17 smithi122 ceph-mon[22174]: Deploying daemon osd.10 on smithi059 2024-08-28T19:28:19.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:18 smithi059 ceph-mon[22052]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:19.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:18 smithi122 ceph-mon[22174]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:19.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:18 smithi033 ceph-mon[18549]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:20 smithi059 ceph-mon[22052]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:21.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:20 smithi122 ceph-mon[22174]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:21.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:20 smithi033 ceph-mon[18549]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:22.840 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:22 smithi059 ceph-mon[22052]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:22.840 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:22.840 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:22.841 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:23.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:22 smithi122 ceph-mon[22174]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:23.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:23.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:23.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:23.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:22 smithi033 ceph-mon[18549]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:23.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:23.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:23.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:25.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:24 smithi059 ceph-mon[22052]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:25.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:24 smithi122 ceph-mon[22174]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:25.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:24 smithi033 ceph-mon[18549]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:25.729 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 10 on host 'smithi059' 2024-08-28T19:28:25.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.728+0000 7f3e2e7fc640 1 -- 172.21.15.59:0/33951074 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3e3c06c370 con 0x7f3e280b4b80 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.730+0000 7f3e43743640 1 -- 172.21.15.59:0/33951074 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e280b4b80 msgr2=0x7f3e280b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.730+0000 7f3e43743640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e280b4b80 0x7f3e280b7090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e30005fd0 tx=0x7f3e30005850 comp rx=0 tx=0).stop 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.730+0000 7f3e43743640 1 -- 172.21.15.59:0/33951074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e3c102810 msgr2=0x7f3e3c199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.730+0000 7f3e43743640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e3c102810 0x7f3e3c199090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800d950 tx=0x7f3e3800de10 comp rx=0 tx=0).stop 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.730+0000 7f3e43743640 1 -- 172.21.15.59:0/33951074 shutdown_connections 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.730+0000 7f3e43743640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e280b4b80 0x7f3e280b7090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.730+0000 7f3e43743640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e3c108aa0 0x7f3e3c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.730+0000 7f3e43743640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e3c108150 0x7f3e3c199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.730+0000 7f3e43743640 1 --2- 172.21.15.59:0/33951074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e3c102810 0x7f3e3c199090 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.730+0000 7f3e43743640 1 -- 172.21.15.59:0/33951074 >> 172.21.15.59:0/33951074 conn(0x7f3e3c0794d0 msgr2=0x7f3e3c104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:25.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.731+0000 7f3e43743640 1 -- 172.21.15.59:0/33951074 shutdown_connections 2024-08-28T19:28:25.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-08-28T19:28:25.731+0000 7f3e43743640 1 -- 172.21.15.59:0/33951074 wait complete. 2024-08-28T19:28:26.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:26.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:26.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:26.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:26.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:26.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:26.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.372 DEBUG:teuthology.orchestra.run.smithi059:osd.10> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.10.service 2024-08-28T19:28:26.374 INFO:tasks.cephadm:Deploying osd.11 on smithi122 with /dev/vg_nvme/lv_1... 2024-08-28T19:28:26.374 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-28T19:28:26.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:26.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:26.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:26.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:26.639 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:28:27.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:27 smithi059 ceph-mon[22052]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:27.786 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:27 smithi122 ceph-mon[22174]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:27.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:27 smithi033 ceph-mon[18549]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:28.783 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:28:28 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:28:28.507+0000 7f1541c29640 -1 osd.10 0 log_to_monitors true 2024-08-28T19:28:29.293 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-08-28T19:28:29.321 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_1 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='osd.10 [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:29.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:29.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:29.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='osd.10 [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:29.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.579 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:28:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='osd.10 [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T19:28:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-28T19:28:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:29.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:30.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.070+0000 7f9bc2367640 1 -- 172.21.15.122:0/3794805228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bbc108140 msgr2=0x7f9bbc108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:30.073 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.070+0000 7f9bc2367640 1 --2- 172.21.15.122:0/3794805228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bbc108140 0x7f9bbc108550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009900 tx=0x7f9bb002a410 comp rx=0 tx=0).stop 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.070+0000 7f9bc2367640 1 -- 172.21.15.122:0/3794805228 shutdown_connections 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.070+0000 7f9bc2367640 1 --2- 172.21.15.122:0/3794805228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc108a90 0x7f9bbc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.070+0000 7f9bc2367640 1 --2- 172.21.15.122:0/3794805228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bbc108140 0x7f9bbc108550 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.070+0000 7f9bc2367640 1 --2- 172.21.15.122:0/3794805228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc102800 0x7f9bbc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.070+0000 7f9bc2367640 1 -- 172.21.15.122:0/3794805228 >> 172.21.15.122:0/3794805228 conn(0x7f9bbc0794d0 msgr2=0x7f9bbc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.070+0000 7f9bc2367640 1 -- 172.21.15.122:0/3794805228 shutdown_connections 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.070+0000 7f9bc2367640 1 -- 172.21.15.122:0/3794805228 wait complete. 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc2367640 1 Processor -- start 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc2367640 1 -- start start 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc2367640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc102800 0x7f9bbc0ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc2367640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc108140 0x7f9bbc0ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:30.074 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc2367640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bbc108a90 0x7f9bbc0ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc2367640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc1126e0 con 0x7f9bbc108140 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc2367640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc112560 con 0x7f9bbc102800 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc2367640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc112860 con 0x7f9bbc108a90 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc0904640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bbc108a90 0x7f9bbc0ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc0904640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bbc108a90 0x7f9bbc0ffe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:42600/0 (socket says 172.21.15.122:42600) 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bc0904640 1 -- 172.21.15.122:0/4134966783 learned_addr learned my addr 172.21.15.122:0/4134966783 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bbb7fe640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc108140 0x7f9bbc0ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.071+0000 7f9bbbfff640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc102800 0x7f9bbc0ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bc0904640 1 -- 172.21.15.122:0/4134966783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc102800 msgr2=0x7f9bbc0ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bc0904640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc102800 0x7f9bbc0ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bc0904640 1 -- 172.21.15.122:0/4134966783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc108140 msgr2=0x7f9bbc0ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:30.075 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bc0904640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc108140 0x7f9bbc0ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:30.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bc0904640 1 -- 172.21.15.122:0/4134966783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bbc1a8580 con 0x7f9bbc108a90 2024-08-28T19:28:30.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bc0904640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bbc108a90 0x7f9bbc0ffe90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400eaa0 tx=0x7f9bb400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:30.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bb97fa640 1 -- 172.21.15.122:0/4134966783 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400cdb0 con 0x7f9bbc108a90 2024-08-28T19:28:30.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bb97fa640 1 -- 172.21.15.122:0/4134966783 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bb4005020 con 0x7f9bbc108a90 2024-08-28T19:28:30.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bb97fa640 1 -- 172.21.15.122:0/4134966783 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb40116d0 con 0x7f9bbc108a90 2024-08-28T19:28:30.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bc2367640 1 -- 172.21.15.122:0/4134966783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bbc1a8870 con 0x7f9bbc108a90 2024-08-28T19:28:30.076 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.072+0000 7f9bc2367640 1 -- 172.21.15.122:0/4134966783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bbc1a8d30 con 0x7f9bbc108a90 2024-08-28T19:28:30.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.074+0000 7f9bc2367640 1 -- 172.21.15.122:0/4134966783 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bbc102c10 con 0x7f9bbc108a90 2024-08-28T19:28:30.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.075+0000 7f9bb97fa640 1 -- 172.21.15.122:0/4134966783 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f9bb40051d0 con 0x7f9bbc108a90 2024-08-28T19:28:30.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.076+0000 7f9bb97fa640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9ba40b4b80 0x7f9ba40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:30.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.076+0000 7f9bb97fa640 1 -- 172.21.15.122:0/4134966783 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6613+0+0 (secure 0 0 0) 0x7f9bb40e5000 con 0x7f9bbc108a90 2024-08-28T19:28:30.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.076+0000 7f9bbbfff640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9ba40b4b80 0x7f9ba40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:30.077 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.076+0000 7f9bbbfff640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9ba40b4b80 0x7f9ba40b7090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0058c0 tx=0x7f9bac00a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:30.080 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.079+0000 7f9bb97fa640 1 -- 172.21.15.122:0/4134966783 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9bb4016030 con 0x7f9bbc108a90 2024-08-28T19:28:30.268 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:30.267+0000 7f9bc2367640 1 -- 172.21.15.122:0/4134966783 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9bbc104d60 con 0x7f9ba40b4b80 2024-08-28T19:28:30.540 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:30 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi059 2024-08-28T19:28:30.540 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:30 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi059 to 4273M 2024-08-28T19:28:30.540 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:30 smithi122 ceph-mon[22174]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-28T19:28:30.540 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:30 smithi122 ceph-mon[22174]: osdmap e61: 11 total, 10 up, 11 in 2024-08-28T19:28:30.540 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:30.540 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:30 smithi122 ceph-mon[22174]: from='osd.10 [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:28:30.540 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:30 smithi122 ceph-mon[22174]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:28:30.540 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:28:30.540 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:28:30.541 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi059 2024-08-28T19:28:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi059 to 4273M 2024-08-28T19:28:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-mon[22052]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-28T19:28:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-mon[22052]: osdmap e61: 11 total, 10 up, 11 in 2024-08-28T19:28:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-mon[22052]: from='osd.10 [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:28:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-mon[22052]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:28:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:28:30.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:28:30.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:30 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi059 2024-08-28T19:28:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:30 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi059 to 4273M 2024-08-28T19:28:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:30 smithi033 ceph-mon[18549]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-28T19:28:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:30 smithi033 ceph-mon[18549]: osdmap e61: 11 total, 10 up, 11 in 2024-08-28T19:28:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:30 smithi033 ceph-mon[18549]: from='osd.10 [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:28:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:30 smithi033 ceph-mon[18549]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-08-28T19:28:30.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-28T19:28:30.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-28T19:28:30.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:31.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:28:30.923+0000 7f153dbab640 -1 osd.10 0 waiting for initial osdmap 2024-08-28T19:28:31.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:28:30 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:28:30.935+0000 7f15359a1640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:28:31.760 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:31 smithi122 ceph-mon[22174]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:31.760 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:31 smithi122 ceph-mon[22174]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:28:31.760 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:31 smithi122 ceph-mon[22174]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:28:31.760 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:31 smithi122 ceph-mon[22174]: osdmap e62: 11 total, 10 up, 11 in 2024-08-28T19:28:31.761 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:31 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:31.761 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:31 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:31.761 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:31 smithi122 ceph-mon[22174]: from='osd.10 ' entity='osd.10' 2024-08-28T19:28:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:31 smithi059 ceph-mon[22052]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:31 smithi059 ceph-mon[22052]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:28:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:31 smithi059 ceph-mon[22052]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:28:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:31 smithi059 ceph-mon[22052]: osdmap e62: 11 total, 10 up, 11 in 2024-08-28T19:28:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:31 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:31 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:31 smithi059 ceph-mon[22052]: from='osd.10 ' entity='osd.10' 2024-08-28T19:28:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:31 smithi033 ceph-mon[18549]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:31 smithi033 ceph-mon[18549]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:28:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:31 smithi033 ceph-mon[18549]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-08-28T19:28:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:31 smithi033 ceph-mon[18549]: osdmap e62: 11 total, 10 up, 11 in 2024-08-28T19:28:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:31 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:31 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:31 smithi033 ceph-mon[18549]: from='osd.10 ' entity='osd.10' 2024-08-28T19:28:32.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:32 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:28:32.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:32 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:28:32.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:32 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:32.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:32 smithi059 ceph-mon[22052]: osd.10 [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] boot 2024-08-28T19:28:32.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:32 smithi059 ceph-mon[22052]: osdmap e63: 11 total, 11 up, 11 in 2024-08-28T19:28:32.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:32 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:32.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:32 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:28:32.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:32 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:28:32.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:32 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:32.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:32 smithi122 ceph-mon[22174]: osd.10 [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] boot 2024-08-28T19:28:32.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:32 smithi122 ceph-mon[22174]: osdmap e63: 11 total, 11 up, 11 in 2024-08-28T19:28:32.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:32 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:32.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:32 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:28:32.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:32 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:28:32.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:32 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:32.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:32 smithi033 ceph-mon[18549]: osd.10 [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] boot 2024-08-28T19:28:32.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:32 smithi033 ceph-mon[18549]: osdmap e63: 11 total, 11 up, 11 in 2024-08-28T19:28:32.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:32 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-28T19:28:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:33 smithi059 ceph-mon[22052]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:33 smithi059 ceph-mon[22052]: osdmap e64: 11 total, 11 up, 11 in 2024-08-28T19:28:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:33 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/1774179720' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "539ae544-528f-4eb7-bca0-dc8adebffbf5"} : dispatch 2024-08-28T19:28:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:33 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "539ae544-528f-4eb7-bca0-dc8adebffbf5"} : dispatch 2024-08-28T19:28:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:33 smithi059 ceph-mon[22052]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "539ae544-528f-4eb7-bca0-dc8adebffbf5"}]': finished 2024-08-28T19:28:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:33 smithi059 ceph-mon[22052]: osdmap e65: 12 total, 11 up, 12 in 2024-08-28T19:28:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:33 smithi059 ceph-mon[22052]: from='client.? 172.21.15.122:0/1988616072' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:28:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:33 smithi122 ceph-mon[22174]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:33 smithi122 ceph-mon[22174]: osdmap e64: 11 total, 11 up, 11 in 2024-08-28T19:28:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:33 smithi122 ceph-mon[22174]: from='client.? 172.21.15.122:0/1774179720' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "539ae544-528f-4eb7-bca0-dc8adebffbf5"} : dispatch 2024-08-28T19:28:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:33 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "539ae544-528f-4eb7-bca0-dc8adebffbf5"} : dispatch 2024-08-28T19:28:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:33 smithi122 ceph-mon[22174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "539ae544-528f-4eb7-bca0-dc8adebffbf5"}]': finished 2024-08-28T19:28:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:33 smithi122 ceph-mon[22174]: osdmap e65: 12 total, 11 up, 12 in 2024-08-28T19:28:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:33 smithi122 ceph-mon[22174]: from='client.? 172.21.15.122:0/1988616072' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:28:33.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:33 smithi033 ceph-mon[18549]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-28T19:28:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:33 smithi033 ceph-mon[18549]: osdmap e64: 11 total, 11 up, 11 in 2024-08-28T19:28:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:33 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/1774179720' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "539ae544-528f-4eb7-bca0-dc8adebffbf5"} : dispatch 2024-08-28T19:28:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:33 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "539ae544-528f-4eb7-bca0-dc8adebffbf5"} : dispatch 2024-08-28T19:28:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:33 smithi033 ceph-mon[18549]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "539ae544-528f-4eb7-bca0-dc8adebffbf5"}]': finished 2024-08-28T19:28:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:33 smithi033 ceph-mon[18549]: osdmap e65: 12 total, 11 up, 12 in 2024-08-28T19:28:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:33 smithi033 ceph-mon[18549]: from='client.? 172.21.15.122:0/1988616072' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-28T19:28:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:35 smithi059 ceph-mon[22052]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:35 smithi122 ceph-mon[22174]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:35.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:35 smithi033 ceph-mon[18549]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:37.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:37 smithi059 ceph-mon[22052]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-28T19:28:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:37 smithi122 ceph-mon[22174]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-28T19:28:37.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:37 smithi033 ceph-mon[18549]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-28T19:28:39.777 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:39 smithi122 ceph-mon[22174]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-28T19:28:39.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:39 smithi059 ceph-mon[22052]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-28T19:28:39.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:39 smithi033 ceph-mon[18549]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-28T19:28:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:41 smithi059 ceph-mon[22052]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:28:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:41 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-28T19:28:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:41 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:41 smithi122 ceph-mon[22174]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:28:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:41 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-28T19:28:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:41 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:41 smithi033 ceph-mon[18549]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-28T19:28:41.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:41 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-28T19:28:41.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:41 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:42.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:42 smithi059 ceph-mon[22052]: Deploying daemon osd.11 on smithi122 2024-08-28T19:28:42.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:42 smithi122 ceph-mon[22174]: Deploying daemon osd.11 on smithi122 2024-08-28T19:28:42.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:42 smithi033 ceph-mon[18549]: Deploying daemon osd.11 on smithi122 2024-08-28T19:28:43.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:43 smithi059 ceph-mon[22052]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-28T19:28:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:43 smithi122 ceph-mon[22174]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-28T19:28:43.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:43 smithi033 ceph-mon[18549]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-28T19:28:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:45 smithi059 ceph-mon[22052]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-28T19:28:45.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:45 smithi122 ceph-mon[22174]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-28T19:28:45.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:45 smithi033 ceph-mon[18549]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-28T19:28:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:47 smithi059 ceph-mon[22052]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:28:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:47 smithi122 ceph-mon[22174]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:28:47.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:47.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:47.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:47.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:47 smithi033 ceph-mon[18549]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-28T19:28:47.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:47.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:47.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:49.626 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:49 smithi122 ceph-mon[22174]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:49.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:49 smithi059 ceph-mon[22052]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:49.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:49 smithi033 ceph-mon[18549]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:50.860 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.858+0000 7f9bb97fa640 1 -- 172.21.15.122:0/4134966783 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9bbc104d60 con 0x7f9ba40b4b80 2024-08-28T19:28:50.860 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 11 on host 'smithi122' 2024-08-28T19:28:50.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 -- 172.21.15.122:0/4134966783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9ba40b4b80 msgr2=0x7f9ba40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:50.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9ba40b4b80 0x7f9ba40b7090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0058c0 tx=0x7f9bac00a250 comp rx=0 tx=0).stop 2024-08-28T19:28:50.862 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 -- 172.21.15.122:0/4134966783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bbc108a90 msgr2=0x7f9bbc0ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:50.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bbc108a90 0x7f9bbc0ffe90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400eaa0 tx=0x7f9bb400ef60 comp rx=0 tx=0).stop 2024-08-28T19:28:50.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 -- 172.21.15.122:0/4134966783 shutdown_connections 2024-08-28T19:28:50.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9ba40b4b80 0x7f9ba40b7090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:50.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bbc108a90 0x7f9bbc0ffe90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:50.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bbc108140 0x7f9bbc0ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:50.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 --2- 172.21.15.122:0/4134966783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc102800 0x7f9bbc0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:50.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 -- 172.21.15.122:0/4134966783 >> 172.21.15.122:0/4134966783 conn(0x7f9bbc0794d0 msgr2=0x7f9bbc101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:50.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 -- 172.21.15.122:0/4134966783 shutdown_connections 2024-08-28T19:28:50.863 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:28:50.861+0000 7f9bc2367640 1 -- 172.21.15.122:0/4134966783 wait complete. 2024-08-28T19:28:51.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:50 smithi033 ceph-mon[18549]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:51.151 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:51.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:51.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:51.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:50 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.171 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:50 smithi122 ceph-mon[22174]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:51.171 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.171 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.172 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:51.172 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:51.172 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.172 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:51.172 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.172 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:50 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:50 smithi059 ceph-mon[22052]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:51.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:51.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:51.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:28:51.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:50 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:51.482 DEBUG:teuthology.orchestra.run.smithi122:osd.11> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.11.service 2024-08-28T19:28:51.485 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-28T19:28:51.485 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-28T19:28:51.739 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:28:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.400+0000 7f1cdab06640 1 -- 172.21.15.33:0/2455327673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4108140 msgr2=0x7f1cd4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.400+0000 7f1cdab06640 1 --2- 172.21.15.33:0/2455327673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4108140 0x7f1cd4108550 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009900 tx=0x7f1cc802a410 comp rx=0 tx=0).stop 2024-08-28T19:28:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.400+0000 7f1cdab06640 1 -- 172.21.15.33:0/2455327673 shutdown_connections 2024-08-28T19:28:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.400+0000 7f1cdab06640 1 --2- 172.21.15.33:0/2455327673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd4108a90 0x7f1cd410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.400+0000 7f1cdab06640 1 --2- 172.21.15.33:0/2455327673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4108140 0x7f1cd4108550 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.400+0000 7f1cdab06640 1 --2- 172.21.15.33:0/2455327673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cd4102800 0x7f1cd4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.400+0000 7f1cdab06640 1 -- 172.21.15.33:0/2455327673 >> 172.21.15.33:0/2455327673 conn(0x7f1cd40794d0 msgr2=0x7f1cd40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.400+0000 7f1cdab06640 1 -- 172.21.15.33:0/2455327673 shutdown_connections 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.400+0000 7f1cdab06640 1 -- 172.21.15.33:0/2455327673 wait complete. 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.401+0000 7f1cdab06640 1 Processor -- start 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.401+0000 7f1cdab06640 1 -- start start 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.401+0000 7f1cdab06640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cd4102800 0x7f1cd419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.401+0000 7f1cdab06640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4108140 0x7f1cd419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.401+0000 7f1cdab06640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd4108a90 0x7f1cd419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.401+0000 7f1cdab06640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd4113820 con 0x7f1cd4108140 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.401+0000 7f1cdab06640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41136a0 con 0x7f1cd4108a90 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.401+0000 7f1cdab06640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41139a0 con 0x7f1cd4102800 2024-08-28T19:28:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.401+0000 7f1cd3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4108140 0x7f1cd419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.401+0000 7f1cd88a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cd4102800 0x7f1cd419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd88a2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cd4102800 0x7f1cd419a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:34060/0 (socket says 172.21.15.33:34060) 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4108140 0x7f1cd419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48314/0 (socket says 172.21.15.33:48314) 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd88a2640 1 -- 172.21.15.33:0/2447890076 learned_addr learned my addr 172.21.15.33:0/2447890076 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd90a3640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd4108a90 0x7f1cd419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd3fff640 1 -- 172.21.15.33:0/2447890076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cd4102800 msgr2=0x7f1cd419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd3fff640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cd4102800 0x7f1cd419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd3fff640 1 -- 172.21.15.33:0/2447890076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd4108a90 msgr2=0x7f1cd419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd3fff640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd4108a90 0x7f1cd419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd3fff640 1 -- 172.21.15.33:0/2447890076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd41a02a0 con 0x7f1cd4108140 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd88a2640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cd4102800 0x7f1cd419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:28:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd3fff640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4108140 0x7f1cd419a8d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1cc802a930 tx=0x7f1cc8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd1ffb640 1 -- 172.21.15.33:0/2447890076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc803f070 con 0x7f1cd4108140 2024-08-28T19:28:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd1ffb640 1 -- 172.21.15.33:0/2447890076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cc8003ca0 con 0x7f1cd4108140 2024-08-28T19:28:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cdab06640 1 -- 172.21.15.33:0/2447890076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd41a0530 con 0x7f1cd4108140 2024-08-28T19:28:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.402+0000 7f1cd1ffb640 1 -- 172.21.15.33:0/2447890076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8035070 con 0x7f1cd4108140 2024-08-28T19:28:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.403+0000 7f1cdab06640 1 -- 172.21.15.33:0/2447890076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd41a6cf0 con 0x7f1cd4108140 2024-08-28T19:28:52.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.404+0000 7f1cdab06640 1 -- 172.21.15.33:0/2447890076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd4102c10 con 0x7f1cd4108140 2024-08-28T19:28:52.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.405+0000 7f1cd1ffb640 1 -- 172.21.15.33:0/2447890076 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f1cc803b4f0 con 0x7f1cd4108140 2024-08-28T19:28:52.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.406+0000 7f1cd1ffb640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1cbc0b4b80 0x7f1cbc0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:52.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.406+0000 7f1cd88a2640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1cbc0b4b80 0x7f1cbc0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:52.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.406+0000 7f1cd1ffb640 1 -- 172.21.15.33:0/2447890076 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7024+0+0 (secure 0 0 0) 0x7f1cc8105670 con 0x7f1cd4108140 2024-08-28T19:28:52.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.406+0000 7f1cd88a2640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1cbc0b4b80 0x7f1cbc0b7090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40104e0 tx=0x7f1cc400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:52.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.409+0000 7f1cd1ffb640 1 -- 172.21.15.33:0/2447890076 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1cc80cc5e0 con 0x7f1cd4108140 2024-08-28T19:28:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.596+0000 7f1cdab06640 1 -- 172.21.15.33:0/2447890076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1cd419b460 con 0x7f1cd4108140 2024-08-28T19:28:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.596+0000 7f1cd1ffb640 1 -- 172.21.15.33:0/2447890076 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f1cd419b460 con 0x7f1cd4108140 2024-08-28T19:28:52.599 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 -- 172.21.15.33:0/2447890076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1cbc0b4b80 msgr2=0x7f1cbc0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1cbc0b4b80 0x7f1cbc0b7090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40104e0 tx=0x7f1cc400b410 comp rx=0 tx=0).stop 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 -- 172.21.15.33:0/2447890076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4108140 msgr2=0x7f1cd419a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4108140 0x7f1cd419a8d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1cc802a930 tx=0x7f1cc8004270 comp rx=0 tx=0).stop 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 -- 172.21.15.33:0/2447890076 shutdown_connections 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd4108a90 0x7f1cd419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4108140 0x7f1cd419a8d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1cbc0b4b80 0x7f1cbc0b7090 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 --2- 172.21.15.33:0/2447890076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cd4102800 0x7f1cd419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 -- 172.21.15.33:0/2447890076 >> 172.21.15.33:0/2447890076 conn(0x7f1cd40794d0 msgr2=0x7f1cd4104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 -- 172.21.15.33:0/2447890076 shutdown_connections 2024-08-28T19:28:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:52.599+0000 7f1cdab06640 1 -- 172.21.15.33:0/2447890076 wait complete. 2024-08-28T19:28:53.094 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:52 smithi122 ceph-mon[22174]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:53.094 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:52 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2447890076' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T19:28:53.094 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:28:52 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:28:52.911+0000 7f7c57276640 -1 osd.11 0 log_to_monitors true 2024-08-28T19:28:53.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:52 smithi059 ceph-mon[22052]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:53.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:52 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2447890076' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T19:28:53.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:52 smithi033 ceph-mon[18549]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:53.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:52 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2447890076' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T19:28:53.416 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1724873311,"num_in_osds":12,"osd_in_since":1724873312,"num_remapped_pgs":0} 2024-08-28T19:28:54.122 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:53 smithi122 ceph-mon[22174]: from='osd.11 [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T19:28:54.122 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:53 smithi122 ceph-mon[22174]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T19:28:54.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:53 smithi059 ceph-mon[22052]: from='osd.11 [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T19:28:54.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:53 smithi059 ceph-mon[22052]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T19:28:54.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:53 smithi033 ceph-mon[18549]: from='osd.11 [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T19:28:54.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:53 smithi033 ceph-mon[18549]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-28T19:28:54.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-28T19:28:54.684 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:28:55.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:55.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-28T19:28:55.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='osd.11 [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:28:55.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: osdmap e66: 12 total, 11 up, 12 in 2024-08-28T19:28:55.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:55.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:28:55.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: Detected new or changed devices on smithi122 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi122 to 4271M 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:55.131 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.140+0000 7f3bd82d9640 1 -- 172.21.15.33:0/285847549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bd0101f90 msgr2=0x7f3bd01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:55.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.140+0000 7f3bd82d9640 1 --2- 172.21.15.33:0/285847549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bd0101f90 0x7f3bd01023a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009900 tx=0x7f3bcc02a410 comp rx=0 tx=0).stop 2024-08-28T19:28:55.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.140+0000 7f3bd82d9640 1 -- 172.21.15.33:0/285847549 shutdown_connections 2024-08-28T19:28:55.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.140+0000 7f3bd82d9640 1 --2- 172.21.15.33:0/285847549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd0108220 0x7f3bd010ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:55.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.140+0000 7f3bd82d9640 1 --2- 172.21.15.33:0/285847549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bd01078d0 0x7f3bd0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.140+0000 7f3bd82d9640 1 --2- 172.21.15.33:0/285847549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bd0101f90 0x7f3bd01023a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.140+0000 7f3bd82d9640 1 -- 172.21.15.33:0/285847549 >> 172.21.15.33:0/285847549 conn(0x7f3bd0077a00 msgr2=0x7f3bd0077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.140+0000 7f3bd82d9640 1 -- 172.21.15.33:0/285847549 shutdown_connections 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.140+0000 7f3bd82d9640 1 -- 172.21.15.33:0/285847549 wait complete. 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.141+0000 7f3bd82d9640 1 Processor -- start 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.141+0000 7f3bd82d9640 1 -- start start 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.141+0000 7f3bd82d9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bd0101f90 0x7f3bd019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.141+0000 7f3bd82d9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01078d0 0x7f3bd019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.141+0000 7f3bd82d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bd0108220 0x7f3bd019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.141+0000 7f3bd82d9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd0113870 con 0x7f3bd0101f90 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.141+0000 7f3bd82d9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01136f0 con 0x7f3bd0108220 2024-08-28T19:28:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.141+0000 7f3bd82d9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01139f0 con 0x7f3bd01078d0 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd6075640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bd0101f90 0x7f3bd019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd6075640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bd0101f90 0x7f3bd019a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48336/0 (socket says 172.21.15.33:48336) 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd6075640 1 -- 172.21.15.33:0/3923825469 learned_addr learned my addr 172.21.15.33:0/3923825469 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd5874640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01078d0 0x7f3bd019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd6876640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bd0108220 0x7f3bd019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd6075640 1 -- 172.21.15.33:0/3923825469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01078d0 msgr2=0x7f3bd019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd6075640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01078d0 0x7f3bd019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd6075640 1 -- 172.21.15.33:0/3923825469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bd0108220 msgr2=0x7f3bd019fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd6075640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bd0108220 0x7f3bd019fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd6075640 1 -- 172.21.15.33:0/3923825469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd01a0210 con 0x7f3bd0101f90 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd6075640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bd0101f90 0x7f3bd019a2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005940 tx=0x7f3bcc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:55.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bc77fe640 1 -- 172.21.15.33:0/3923825469 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc03f030 con 0x7f3bd0101f90 2024-08-28T19:28:55.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bc77fe640 1 -- 172.21.15.33:0/3923825469 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bcc003aa0 con 0x7f3bd0101f90 2024-08-28T19:28:55.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd82d9640 1 -- 172.21.15.33:0/3923825469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd01a04a0 con 0x7f3bd0101f90 2024-08-28T19:28:55.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bc77fe640 1 -- 172.21.15.33:0/3923825469 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc035070 con 0x7f3bd0101f90 2024-08-28T19:28:55.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.142+0000 7f3bd82d9640 1 -- 172.21.15.33:0/3923825469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd01a6c60 con 0x7f3bd0101f90 2024-08-28T19:28:55.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.143+0000 7f3bd82d9640 1 -- 172.21.15.33:0/3923825469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd01023a0 con 0x7f3bd0101f90 2024-08-28T19:28:55.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.145+0000 7f3bc77fe640 1 -- 172.21.15.33:0/3923825469 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f3bcc042030 con 0x7f3bd0101f90 2024-08-28T19:28:55.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.146+0000 7f3bc77fe640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bbc0b4b80 0x7f3bbc0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:55.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.146+0000 7f3bd5874640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bbc0b4b80 0x7f3bbc0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:55.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.146+0000 7f3bc77fe640 1 -- 172.21.15.33:0/3923825469 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7062+0+0 (secure 0 0 0) 0x7f3bcc1053f0 con 0x7f3bd0101f90 2024-08-28T19:28:55.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.146+0000 7f3bd5874640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bbc0b4b80 0x7f3bbc0b7090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0104890 tx=0x7f3bc000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:55.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.151+0000 7f3bc77fe640 1 -- 172.21.15.33:0/3923825469 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3bcc0cca00 con 0x7f3bd0101f90 2024-08-28T19:28:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-28T19:28:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='osd.11 [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:28:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: osdmap e66: 12 total, 11 up, 12 in 2024-08-28T19:28:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:28:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: Detected new or changed devices on smithi122 2024-08-28T19:28:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi122 to 4271M 2024-08-28T19:28:55.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:55.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:55.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='osd.11 [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: osdmap e66: 12 total, 11 up, 12 in 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]} : dispatch 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: Detected new or changed devices on smithi122 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T19:28:55.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi122 to 4271M 2024-08-28T19:28:55.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:28:55.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:28:55.295 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:28:55.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.339+0000 7f3bd82d9640 1 -- 172.21.15.33:0/3923825469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3bd0109ff0 con 0x7f3bd0101f90 2024-08-28T19:28:55.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.339+0000 7f3bc77fe640 1 -- 172.21.15.33:0/3923825469 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f3bcc0cc300 con 0x7f3bd0101f90 2024-08-28T19:28:55.341 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:28:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 -- 172.21.15.33:0/3923825469 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bbc0b4b80 msgr2=0x7f3bbc0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bbc0b4b80 0x7f3bbc0b7090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0104890 tx=0x7f3bc000a2d0 comp rx=0 tx=0).stop 2024-08-28T19:28:55.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 -- 172.21.15.33:0/3923825469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bd0101f90 msgr2=0x7f3bd019a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bd0101f90 0x7f3bd019a2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005940 tx=0x7f3bcc004270 comp rx=0 tx=0).stop 2024-08-28T19:28:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 -- 172.21.15.33:0/3923825469 shutdown_connections 2024-08-28T19:28:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bd0108220 0x7f3bd019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bbc0b4b80 0x7f3bbc0b7090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bd01078d0 0x7f3bd019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 --2- 172.21.15.33:0/3923825469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bd0101f90 0x7f3bd019a2a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 -- 172.21.15.33:0/3923825469 >> 172.21.15.33:0/3923825469 conn(0x7f3bd0077a00 msgr2=0x7f3bd01059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 -- 172.21.15.33:0/3923825469 shutdown_connections 2024-08-28T19:28:55.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:55.342+0000 7f3bd82d9640 1 -- 172.21.15.33:0/3923825469 wait complete. 2024-08-28T19:28:55.793 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:28:55 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:28:55.338+0000 7f7c53a0d640 -1 osd.11 0 waiting for initial osdmap 2024-08-28T19:28:55.793 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:28:55 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:28:55.350+0000 7f7c4afee640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-28T19:28:56.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:55 smithi033 ceph-mon[18549]: purged_snaps scrub starts 2024-08-28T19:28:56.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:55 smithi033 ceph-mon[18549]: purged_snaps scrub ok 2024-08-28T19:28:56.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:55 smithi033 ceph-mon[18549]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:28:56.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:55 smithi033 ceph-mon[18549]: osdmap e67: 12 total, 11 up, 12 in 2024-08-28T19:28:56.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:55 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:56.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:55 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:56.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:55 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3923825469' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T19:28:56.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:55 smithi033 ceph-mon[18549]: from='osd.11 ' entity='osd.11' 2024-08-28T19:28:56.199 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1724873311,"num_in_osds":12,"osd_in_since":1724873312,"num_remapped_pgs":0} 2024-08-28T19:28:56.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:55 smithi059 ceph-mon[22052]: purged_snaps scrub starts 2024-08-28T19:28:56.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:55 smithi059 ceph-mon[22052]: purged_snaps scrub ok 2024-08-28T19:28:56.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:55 smithi059 ceph-mon[22052]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:28:56.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:55 smithi059 ceph-mon[22052]: osdmap e67: 12 total, 11 up, 12 in 2024-08-28T19:28:56.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:55 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:56.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:55 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:56.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:55 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3923825469' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T19:28:56.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:55 smithi059 ceph-mon[22052]: from='osd.11 ' entity='osd.11' 2024-08-28T19:28:56.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:55 smithi122 ceph-mon[22174]: purged_snaps scrub starts 2024-08-28T19:28:56.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:55 smithi122 ceph-mon[22174]: purged_snaps scrub ok 2024-08-28T19:28:56.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:55 smithi122 ceph-mon[22174]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-08-28T19:28:56.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:55 smithi122 ceph-mon[22174]: osdmap e67: 12 total, 11 up, 12 in 2024-08-28T19:28:56.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:55 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:56.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:55 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:56.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:55 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3923825469' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T19:28:56.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:55 smithi122 ceph-mon[22174]: from='osd.11 ' entity='osd.11' 2024-08-28T19:28:57.200 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-28T19:28:57.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:56 smithi033 ceph-mon[18549]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:57.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:57.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:56 smithi033 ceph-mon[18549]: osd.11 [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] boot 2024-08-28T19:28:57.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:56 smithi033 ceph-mon[18549]: osdmap e68: 12 total, 12 up, 12 in 2024-08-28T19:28:57.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:57.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:56 smithi059 ceph-mon[22052]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:57.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:57.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:56 smithi059 ceph-mon[22052]: osd.11 [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] boot 2024-08-28T19:28:57.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:56 smithi059 ceph-mon[22052]: osdmap e68: 12 total, 12 up, 12 in 2024-08-28T19:28:57.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:57.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:56 smithi122 ceph-mon[22174]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-08-28T19:28:57.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:57.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:56 smithi122 ceph-mon[22174]: osd.11 [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] boot 2024-08-28T19:28:57.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:56 smithi122 ceph-mon[22174]: osdmap e68: 12 total, 12 up, 12 in 2024-08-28T19:28:57.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-28T19:28:57.464 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:28:58.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.109+0000 7f81d151b640 1 -- 172.21.15.33:0/2679227357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81cc108160 msgr2=0x7f81cc108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:58.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.109+0000 7f81d151b640 1 --2- 172.21.15.33:0/2679227357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81cc108160 0x7f81cc108570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009900 tx=0x7f81c002a410 comp rx=0 tx=0).stop 2024-08-28T19:28:58.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.109+0000 7f81d151b640 1 -- 172.21.15.33:0/2679227357 shutdown_connections 2024-08-28T19:28:58.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.109+0000 7f81d151b640 1 --2- 172.21.15.33:0/2679227357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81cc108ab0 0x7f81cc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:58.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.109+0000 7f81d151b640 1 --2- 172.21.15.33:0/2679227357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81cc108160 0x7f81cc108570 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:58.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.109+0000 7f81d151b640 1 --2- 172.21.15.33:0/2679227357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81cc102870 0x7f81cc102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:58.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.110+0000 7f81d151b640 1 -- 172.21.15.33:0/2679227357 >> 172.21.15.33:0/2679227357 conn(0x7f81cc079470 msgr2=0x7f81cc079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:58.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.110+0000 7f81d151b640 1 -- 172.21.15.33:0/2679227357 shutdown_connections 2024-08-28T19:28:58.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.110+0000 7f81d151b640 1 -- 172.21.15.33:0/2679227357 wait complete. 2024-08-28T19:28:58.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.110+0000 7f81d151b640 1 Processor -- start 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.110+0000 7f81d151b640 1 -- start start 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81d151b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81cc102870 0x7f81cc10fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81d151b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81cc108160 0x7f81cc110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81d151b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81cc108ab0 0x7f81cc110840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81d151b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc113890 con 0x7f81cc102870 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81d151b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc113710 con 0x7f81cc108160 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81d151b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc113a10 con 0x7f81cc108ab0 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81caffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81cc102870 0x7f81cc10fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81caffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81cc102870 0x7f81cc10fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48344/0 (socket says 172.21.15.33:48344) 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81caffd640 1 -- 172.21.15.33:0/4264156231 learned_addr learned my addr 172.21.15.33:0/4264156231 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81ca7fc640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81cc108160 0x7f81cc110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:58.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81cb7fe640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81cc108ab0 0x7f81cc110840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81caffd640 1 -- 172.21.15.33:0/4264156231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81cc108ab0 msgr2=0x7f81cc110840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81caffd640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81cc108ab0 0x7f81cc110840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81caffd640 1 -- 172.21.15.33:0/4264156231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81cc108160 msgr2=0x7f81cc110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81caffd640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81cc108160 0x7f81cc110300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81caffd640 1 -- 172.21.15.33:0/4264156231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc1a84f0 con 0x7f81cc102870 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81caffd640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81cc102870 0x7f81cc10fdc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00c920 tx=0x7f81bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.111+0000 7f81b3fff640 1 -- 172.21.15.33:0/4264156231 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc007c70 con 0x7f81cc102870 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.112+0000 7f81d151b640 1 -- 172.21.15.33:0/4264156231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81cc1a87e0 con 0x7f81cc102870 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.112+0000 7f81b3fff640 1 -- 172.21.15.33:0/4264156231 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81bc007e10 con 0x7f81cc102870 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.112+0000 7f81b3fff640 1 -- 172.21.15.33:0/4264156231 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc018820 con 0x7f81cc102870 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.112+0000 7f81d151b640 1 -- 172.21.15.33:0/4264156231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81cc1a8dc0 con 0x7f81cc102870 2024-08-28T19:28:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.113+0000 7f81d151b640 1 -- 172.21.15.33:0/4264156231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81cc103aa0 con 0x7f81cc102870 2024-08-28T19:28:58.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.114+0000 7f81b3fff640 1 -- 172.21.15.33:0/4264156231 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f81bc00f450 con 0x7f81cc102870 2024-08-28T19:28:58.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.115+0000 7f81b3fff640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81b40b4b80 0x7f81b40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:58.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.115+0000 7f81ca7fc640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81b40b4b80 0x7f81b40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:58.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.115+0000 7f81b3fff640 1 -- 172.21.15.33:0/4264156231 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f81bc0e4fc0 con 0x7f81cc102870 2024-08-28T19:28:58.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.115+0000 7f81ca7fc640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81b40b4b80 0x7f81b40b7090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009230 tx=0x7f81c0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:58.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.119+0000 7f81b3fff640 1 -- 172.21.15.33:0/4264156231 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f81bc014030 con 0x7f81cc102870 2024-08-28T19:28:58.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.306+0000 7f81d151b640 1 -- 172.21.15.33:0/4264156231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f81cc10a310 con 0x7f81cc102870 2024-08-28T19:28:58.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.306+0000 7f81b3fff640 1 -- 172.21.15.33:0/4264156231 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f81bc0ac420 con 0x7f81cc102870 2024-08-28T19:28:58.308 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:28:58.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 -- 172.21.15.33:0/4264156231 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81b40b4b80 msgr2=0x7f81b40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81b40b4b80 0x7f81b40b7090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009230 tx=0x7f81c0031400 comp rx=0 tx=0).stop 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 -- 172.21.15.33:0/4264156231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81cc102870 msgr2=0x7f81cc10fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81cc102870 0x7f81cc10fdc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00c920 tx=0x7f81bc00cde0 comp rx=0 tx=0).stop 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 -- 172.21.15.33:0/4264156231 shutdown_connections 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81b40b4b80 0x7f81b40b7090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81cc108ab0 0x7f81cc110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81cc108160 0x7f81cc110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 --2- 172.21.15.33:0/4264156231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81cc102870 0x7f81cc10fdc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 -- 172.21.15.33:0/4264156231 >> 172.21.15.33:0/4264156231 conn(0x7f81cc079470 msgr2=0x7f81cc106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 -- 172.21.15.33:0/4264156231 shutdown_connections 2024-08-28T19:28:58.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:58.309+0000 7f81d151b640 1 -- 172.21.15.33:0/4264156231 wait complete. 2024-08-28T19:28:59.052 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:58 smithi033 ceph-mon[18549]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:28:59.052 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:58 smithi033 ceph-mon[18549]: osdmap e69: 12 total, 12 up, 12 in 2024-08-28T19:28:59.052 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:28:58 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4264156231' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T19:28:59.084 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":69,"num_osds":12,"num_up_osds":12,"osd_up_since":1724873336,"num_in_osds":12,"osd_in_since":1724873312,"num_remapped_pgs":0} 2024-08-28T19:28:59.084 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:28:59.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:58 smithi059 ceph-mon[22052]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:28:59.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:58 smithi059 ceph-mon[22052]: osdmap e69: 12 total, 12 up, 12 in 2024-08-28T19:28:59.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:28:58 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4264156231' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T19:28:59.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:58 smithi122 ceph-mon[22174]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:28:59.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:58 smithi122 ceph-mon[22174]: osdmap e69: 12 total, 12 up, 12 in 2024-08-28T19:28:59.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:28:58 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4264156231' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-28T19:28:59.380 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:28:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.878+0000 7f2a3c83e640 1 -- 172.21.15.33:0/172186447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a38103900 msgr2=0x7f2a38103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.878+0000 7f2a3c83e640 1 --2- 172.21.15.33:0/172186447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a38103900 0x7f2a38103d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009900 tx=0x7f2a2802a410 comp rx=0 tx=0).stop 2024-08-28T19:28:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.878+0000 7f2a3c83e640 1 -- 172.21.15.33:0/172186447 shutdown_connections 2024-08-28T19:28:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.878+0000 7f2a3c83e640 1 --2- 172.21.15.33:0/172186447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a38109b90 0x7f2a381103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.878+0000 7f2a3c83e640 1 --2- 172.21.15.33:0/172186447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a38109240 0x7f2a38109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.878+0000 7f2a3c83e640 1 --2- 172.21.15.33:0/172186447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a38103900 0x7f2a38103d10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.878+0000 7f2a3c83e640 1 -- 172.21.15.33:0/172186447 >> 172.21.15.33:0/172186447 conn(0x7f2a3807b5f0 msgr2=0x7f2a3807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.878+0000 7f2a3c83e640 1 -- 172.21.15.33:0/172186447 shutdown_connections 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.879+0000 7f2a3c83e640 1 -- 172.21.15.33:0/172186447 wait complete. 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.879+0000 7f2a3c83e640 1 Processor -- start 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.879+0000 7f2a3c83e640 1 -- start start 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3c83e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a38103900 0x7f2a3819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3c83e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a38109240 0x7f2a3819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3c83e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a38109b90 0x7f2a3819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3c83e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2a381138b0 con 0x7f2a38103900 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3c83e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2a38113730 con 0x7f2a38109240 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3c83e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2a38113a30 con 0x7f2a38109b90 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a38103900 0x7f2a3819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a38103900 0x7f2a3819a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43592/0 (socket says 172.21.15.33:43592) 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3659c640 1 -- 172.21.15.33:0/333374623 learned_addr learned my addr 172.21.15.33:0/333374623 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:28:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a2dd9b640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a38109240 0x7f2a3819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a36d9d640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a38109b90 0x7f2a3819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3659c640 1 -- 172.21.15.33:0/333374623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a38109b90 msgr2=0x7f2a3819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3659c640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a38109b90 0x7f2a3819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3659c640 1 -- 172.21.15.33:0/333374623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a38109240 msgr2=0x7f2a3819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3659c640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a38109240 0x7f2a3819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a3659c640 1 -- 172.21.15.33:0/333374623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a381a0150 con 0x7f2a38103900 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a2dd9b640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a38109240 0x7f2a3819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.880+0000 7f2a36d9d640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a38109b90 0x7f2a3819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.881+0000 7f2a3659c640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a38103900 0x7f2a3819a2a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2a28006010 tx=0x7f2a280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.881+0000 7f2a2ffff640 1 -- 172.21.15.33:0/333374623 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2803f030 con 0x7f2a38103900 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.881+0000 7f2a3c83e640 1 -- 172.21.15.33:0/333374623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a381a03e0 con 0x7f2a38103900 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.881+0000 7f2a2ffff640 1 -- 172.21.15.33:0/333374623 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a28003800 con 0x7f2a38103900 2024-08-28T19:28:59.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.881+0000 7f2a2ffff640 1 -- 172.21.15.33:0/333374623 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28035070 con 0x7f2a38103900 2024-08-28T19:28:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.881+0000 7f2a3c83e640 1 -- 172.21.15.33:0/333374623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a381a6c60 con 0x7f2a38103900 2024-08-28T19:28:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.882+0000 7f2a3c83e640 1 -- 172.21.15.33:0/333374623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a38104b80 con 0x7f2a38103900 2024-08-28T19:28:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.883+0000 7f2a2ffff640 1 -- 172.21.15.33:0/333374623 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f2a28003cb0 con 0x7f2a38103900 2024-08-28T19:28:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.885+0000 7f2a2ffff640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a240b4bb0 0x7f2a240b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:28:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.885+0000 7f2a2dd9b640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a240b4bb0 0x7f2a240b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:28:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.885+0000 7f2a2ffff640 1 -- 172.21.15.33:0/333374623 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f2a28105a10 con 0x7f2a38103900 2024-08-28T19:28:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.885+0000 7f2a2dd9b640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a240b4bb0 0x7f2a240b70c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2a38108f40 tx=0x7f2a2000a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:28:59.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:28:59.888+0000 7f2a2ffff640 1 -- 172.21.15.33:0/333374623 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2a280ccf10 con 0x7f2a38103900 2024-08-28T19:29:00.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.075+0000 7f2a3c83e640 1 -- 172.21.15.33:0/333374623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a3810b990 con 0x7f2a38103900 2024-08-28T19:29:00.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.076+0000 7f2a2ffff640 1 -- 172.21.15.33:0/333374623 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18727 (secure 0 0 0) 0x7f2a280cc810 con 0x7f2a38103900 2024-08-28T19:29:00.078 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:00.078 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":69,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:28:57.917859+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:29:00.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 -- 172.21.15.33:0/333374623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a240b4bb0 msgr2=0x7f2a240b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:00.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a240b4bb0 0x7f2a240b70c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2a38108f40 tx=0x7f2a2000a5c0 comp rx=0 tx=0).stop 2024-08-28T19:29:00.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 -- 172.21.15.33:0/333374623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a38103900 msgr2=0x7f2a3819a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:00.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a38103900 0x7f2a3819a2a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2a28006010 tx=0x7f2a280042f0 comp rx=0 tx=0).stop 2024-08-28T19:29:00.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 -- 172.21.15.33:0/333374623 shutdown_connections 2024-08-28T19:29:00.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a240b4bb0 0x7f2a240b70c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:00.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a38109b90 0x7f2a3819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:00.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a38109240 0x7f2a3819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:00.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 --2- 172.21.15.33:0/333374623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a38103900 0x7f2a3819a2a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:00.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 -- 172.21.15.33:0/333374623 >> 172.21.15.33:0/333374623 conn(0x7f2a3807b5f0 msgr2=0x7f2a381072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:00.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 -- 172.21.15.33:0/333374623 shutdown_connections 2024-08-28T19:29:00.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:00.078+0000 7f2a3c83e640 1 -- 172.21.15.33:0/333374623 wait complete. 2024-08-28T19:29:00.968 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-28T19:25:14.079616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-28T19:29:00.969 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-28T19:29:01.223 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:00 smithi033 ceph-mon[18549]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:01.223 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:00 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/333374623' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:29:01.223 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:01.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:00 smithi059 ceph-mon[22052]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:01.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:00 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/333374623' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:29:01.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:00 smithi122 ceph-mon[22174]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:01.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:00 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/333374623' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:29:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.695+0000 7f18398a5640 1 -- 172.21.15.33:0/4016345491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834108a90 msgr2=0x7f183410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.695+0000 7f18398a5640 1 --2- 172.21.15.33:0/4016345491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834108a90 0x7f183410f2c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f182c009ca0 tx=0x7f182c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:29:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.695+0000 7f18398a5640 1 -- 172.21.15.33:0/4016345491 shutdown_connections 2024-08-28T19:29:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.695+0000 7f18398a5640 1 --2- 172.21.15.33:0/4016345491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834108a90 0x7f183410f2c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.695+0000 7f18398a5640 1 --2- 172.21.15.33:0/4016345491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1834108140 0x7f1834108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:01.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.695+0000 7f18398a5640 1 --2- 172.21.15.33:0/4016345491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1834102800 0x7f1834102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:01.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.695+0000 7f18398a5640 1 -- 172.21.15.33:0/4016345491 >> 172.21.15.33:0/4016345491 conn(0x7f18340794d0 msgr2=0x7f18340798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:01.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.695+0000 7f18398a5640 1 -- 172.21.15.33:0/4016345491 shutdown_connections 2024-08-28T19:29:01.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.695+0000 7f18398a5640 1 -- 172.21.15.33:0/4016345491 wait complete. 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18398a5640 1 Processor -- start 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18398a5640 1 -- start start 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18398a5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1834102800 0x7f183419b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18398a5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834108140 0x7f183419b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18398a5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1834108a90 0x7f183419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18398a5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1834112760 con 0x7f1834108140 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18398a5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f18341125e0 con 0x7f1834102800 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18398a5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f18341128e0 con 0x7f1834108a90 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18327fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834108140 0x7f183419b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18327fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834108140 0x7f183419b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43614/0 (socket says 172.21.15.33:43614) 2024-08-28T19:29:01.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f18327fc640 1 -- 172.21.15.33:0/1565046027 learned_addr learned my addr 172.21.15.33:0/1565046027 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.696+0000 7f1832ffd640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1834102800 0x7f183419b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18337fe640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1834108a90 0x7f183419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18327fc640 1 -- 172.21.15.33:0/1565046027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1834108a90 msgr2=0x7f183419baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18327fc640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1834108a90 0x7f183419baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18327fc640 1 -- 172.21.15.33:0/1565046027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1834102800 msgr2=0x7f183419b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18327fc640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1834102800 0x7f183419b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18327fc640 1 -- 172.21.15.33:0/1565046027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18341a6330 con 0x7f1834108140 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18337fe640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1834108a90 0x7f183419baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18327fc640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834108140 0x7f183419b5b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f182800d770 tx=0x7f182800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18388a3640 1 -- 172.21.15.33:0/1565046027 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1828017070 con 0x7f1834108140 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18398a5640 1 -- 172.21.15.33:0/1565046027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18341a6620 con 0x7f1834108140 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18388a3640 1 -- 172.21.15.33:0/1565046027 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1828009c30 con 0x7f1834108140 2024-08-28T19:29:01.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18388a3640 1 -- 172.21.15.33:0/1565046027 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182800f620 con 0x7f1834108140 2024-08-28T19:29:01.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.697+0000 7f18398a5640 1 -- 172.21.15.33:0/1565046027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18341a6b60 con 0x7f1834108140 2024-08-28T19:29:01.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.698+0000 7f18398a5640 1 -- 172.21.15.33:0/1565046027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1834102c10 con 0x7f1834108140 2024-08-28T19:29:01.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.700+0000 7f18388a3640 1 -- 172.21.15.33:0/1565046027 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f182801a070 con 0x7f1834108140 2024-08-28T19:29:01.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.701+0000 7f18388a3640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f181c0b4b80 0x7f181c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:01.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.701+0000 7f1832ffd640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f181c0b4b80 0x7f181c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:01.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.701+0000 7f18388a3640 1 -- 172.21.15.33:0/1565046027 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f18280e4840 con 0x7f1834108140 2024-08-28T19:29:01.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.701+0000 7f1832ffd640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f181c0b4b80 0x7f181c0b7090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f183406b780 tx=0x7f182400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:01.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.704+0000 7f18388a3640 1 -- 172.21.15.33:0/1565046027 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1828009de0 con 0x7f1834108140 2024-08-28T19:29:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.889+0000 7f18398a5640 1 -- 172.21.15.33:0/1565046027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f183402e430 con 0x7f1834108140 2024-08-28T19:29:01.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.889+0000 7f18388a3640 1 -- 172.21.15.33:0/1565046027 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7f18280abd40 con 0x7f1834108140 2024-08-28T19:29:01.891 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-28T19:29:01.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.891+0000 7f18398a5640 1 -- 172.21.15.33:0/1565046027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f181c0b4b80 msgr2=0x7f181c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:01.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.891+0000 7f18398a5640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f181c0b4b80 0x7f181c0b7090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f183406b780 tx=0x7f182400b390 comp rx=0 tx=0).stop 2024-08-28T19:29:01.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.891+0000 7f18398a5640 1 -- 172.21.15.33:0/1565046027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834108140 msgr2=0x7f183419b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:01.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.891+0000 7f18398a5640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834108140 0x7f183419b5b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f182800d770 tx=0x7f182800dc30 comp rx=0 tx=0).stop 2024-08-28T19:29:01.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.891+0000 7f18398a5640 1 -- 172.21.15.33:0/1565046027 shutdown_connections 2024-08-28T19:29:01.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.891+0000 7f18398a5640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f181c0b4b80 0x7f181c0b7090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:01.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.891+0000 7f18398a5640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1834108a90 0x7f183419baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:01.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.891+0000 7f18398a5640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1834108140 0x7f183419b5b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:01.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.891+0000 7f18398a5640 1 --2- 172.21.15.33:0/1565046027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1834102800 0x7f183419b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:01.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.891+0000 7f18398a5640 1 -- 172.21.15.33:0/1565046027 >> 172.21.15.33:0/1565046027 conn(0x7f18340794d0 msgr2=0x7f18341041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:01.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.892+0000 7f18398a5640 1 -- 172.21.15.33:0/1565046027 shutdown_connections 2024-08-28T19:29:01.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:01.892+0000 7f18398a5640 1 -- 172.21.15.33:0/1565046027 wait complete. 2024-08-28T19:29:02.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:01 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1565046027' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T19:29:02.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:01 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1565046027' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T19:29:02.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:01 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1565046027' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T19:29:02.655 INFO:tasks.cephadm:Adding mds.a on smithi033 2024-08-28T19:29:02.655 INFO:tasks.cephadm:Adding mds.d on smithi033 2024-08-28T19:29:02.655 INFO:tasks.cephadm:Adding mds.g on smithi033 2024-08-28T19:29:02.655 INFO:tasks.cephadm:Adding mds.j on smithi033 2024-08-28T19:29:02.656 INFO:tasks.cephadm:Adding mds.b on smithi059 2024-08-28T19:29:02.656 INFO:tasks.cephadm:Adding mds.e on smithi059 2024-08-28T19:29:02.656 INFO:tasks.cephadm:Adding mds.h on smithi059 2024-08-28T19:29:02.656 INFO:tasks.cephadm:Adding mds.k on smithi059 2024-08-28T19:29:02.656 INFO:tasks.cephadm:Adding mds.c on smithi122 2024-08-28T19:29:02.656 INFO:tasks.cephadm:Adding mds.f on smithi122 2024-08-28T19:29:02.656 INFO:tasks.cephadm:Adding mds.i on smithi122 2024-08-28T19:29:02.656 INFO:tasks.cephadm:Adding mds.l on smithi122 2024-08-28T19:29:02.656 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph orch apply mds all '12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l' 2024-08-28T19:29:02.912 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:29:03.191 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:02 smithi122 ceph-mon[22174]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:03.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:02 smithi059 ceph-mon[22052]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:03.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:02 smithi033 ceph-mon[18549]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:03.443 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.435+0000 7f49d98cf640 1 -- 172.21.15.122:0/867186424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d41050a0 msgr2=0x7f49d410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.435+0000 7f49d98cf640 1 --2- 172.21.15.122:0/867186424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d41050a0 0x7f49d410d5f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009900 tx=0x7f49c802a410 comp rx=0 tx=0).stop 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.435+0000 7f49d98cf640 1 -- 172.21.15.122:0/867186424 shutdown_connections 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.435+0000 7f49d98cf640 1 --2- 172.21.15.122:0/867186424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d410dbb0 0x7f49d41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.435+0000 7f49d98cf640 1 --2- 172.21.15.122:0/867186424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d41050a0 0x7f49d410d5f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.435+0000 7f49d98cf640 1 --2- 172.21.15.122:0/867186424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d4104750 0x7f49d4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.435+0000 7f49d98cf640 1 -- 172.21.15.122:0/867186424 >> 172.21.15.122:0/867186424 conn(0x7f49d40794d0 msgr2=0x7f49d40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.435+0000 7f49d98cf640 1 -- 172.21.15.122:0/867186424 shutdown_connections 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.435+0000 7f49d98cf640 1 -- 172.21.15.122:0/867186424 wait complete. 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d98cf640 1 Processor -- start 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d98cf640 1 -- start start 2024-08-28T19:29:03.444 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d98cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d4104750 0x7f49d419c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d98cf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d41050a0 0x7f49d419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d98cf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d410dbb0 0x7f49d41a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d98cf640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41137f0 con 0x7f49d4104750 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d98cf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f49d4113670 con 0x7f49d41050a0 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d98cf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f49d4113970 con 0x7f49d410dbb0 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d410dbb0 0x7f49d41a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d410dbb0 0x7f49d41a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:53566/0 (socket says 172.21.15.122:53566) 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d37fe640 1 -- 172.21.15.122:0/4290715612 learned_addr learned my addr 172.21.15.122:0/4290715612 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d2ffd640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d4104750 0x7f49d419c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d27fc640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d41050a0 0x7f49d419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d37fe640 1 -- 172.21.15.122:0/4290715612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d41050a0 msgr2=0x7f49d419cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d37fe640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d41050a0 0x7f49d419cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:03.445 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d37fe640 1 -- 172.21.15.122:0/4290715612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d4104750 msgr2=0x7f49d419c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d37fe640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d4104750 0x7f49d419c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d37fe640 1 -- 172.21.15.122:0/4290715612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d41a23f0 con 0x7f49d410dbb0 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.436+0000 7f49d27fc640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d41050a0 0x7f49d419cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.437+0000 7f49d37fe640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d410dbb0 0x7f49d41a1d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00eb10 tx=0x7f49cc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.437+0000 7f49d88cd640 1 -- 172.21.15.122:0/4290715612 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc004b20 con 0x7f49d410dbb0 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.437+0000 7f49d98cf640 1 -- 172.21.15.122:0/4290715612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d41a26e0 con 0x7f49d410dbb0 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.437+0000 7f49d88cd640 1 -- 172.21.15.122:0/4290715612 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49cc004cc0 con 0x7f49d410dbb0 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.437+0000 7f49d88cd640 1 -- 172.21.15.122:0/4290715612 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc010690 con 0x7f49d410dbb0 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.437+0000 7f49d98cf640 1 -- 172.21.15.122:0/4290715612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d41a8f00 con 0x7f49d410dbb0 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.438+0000 7f49d98cf640 1 -- 172.21.15.122:0/4290715612 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d4104b60 con 0x7f49d410dbb0 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.439+0000 7f49d88cd640 1 -- 172.21.15.122:0/4290715612 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f49cc005000 con 0x7f49d410dbb0 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.440+0000 7f49d88cd640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49bc0b4bb0 0x7f49bc0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.440+0000 7f49d88cd640 1 -- 172.21.15.122:0/4290715612 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f49cc0e54e0 con 0x7f49d410dbb0 2024-08-28T19:29:03.446 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.440+0000 7f49d2ffd640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49bc0b4bb0 0x7f49bc0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:03.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.441+0000 7f49d2ffd640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49bc0b4bb0 0x7f49bc0b70c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f49d406ba00 tx=0x7f49c4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:03.447 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.444+0000 7f49d88cd640 1 -- 172.21.15.122:0/4290715612 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f49cc056130 con 0x7f49d410dbb0 2024-08-28T19:29:03.637 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.635+0000 7f49d98cf640 1 -- 172.21.15.122:0/4290715612 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}) -- 0x7f49d4100bc0 con 0x7f49bc0b4bb0 2024-08-28T19:29:03.645 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.644+0000 7f49d88cd640 1 -- 172.21.15.122:0/4290715612 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f49d4100bc0 con 0x7f49bc0b4bb0 2024-08-28T19:29:03.645 INFO:teuthology.orchestra.run.smithi122.stdout:Scheduled mds.all update... 2024-08-28T19:29:03.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 -- 172.21.15.122:0/4290715612 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49bc0b4bb0 msgr2=0x7f49bc0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:03.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49bc0b4bb0 0x7f49bc0b70c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f49d406ba00 tx=0x7f49c4005f90 comp rx=0 tx=0).stop 2024-08-28T19:29:03.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 -- 172.21.15.122:0/4290715612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d410dbb0 msgr2=0x7f49d41a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:03.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d410dbb0 0x7f49d41a1d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00eb10 tx=0x7f49cc00c2d0 comp rx=0 tx=0).stop 2024-08-28T19:29:03.648 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 -- 172.21.15.122:0/4290715612 shutdown_connections 2024-08-28T19:29:03.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49bc0b4bb0 0x7f49bc0b70c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:03.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d410dbb0 0x7f49d41a1d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:03.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d41050a0 0x7f49d419cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:03.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 --2- 172.21.15.122:0/4290715612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49d4104750 0x7f49d419c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:03.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 -- 172.21.15.122:0/4290715612 >> 172.21.15.122:0/4290715612 conn(0x7f49d40794d0 msgr2=0x7f49d41003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:03.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 -- 172.21.15.122:0/4290715612 shutdown_connections 2024-08-28T19:29:03.649 INFO:teuthology.orchestra.run.smithi122.stderr:2024-08-28T19:29:03.647+0000 7f49d98cf640 1 -- 172.21.15.122:0/4290715612 wait complete. 2024-08-28T19:29:04.451 DEBUG:teuthology.orchestra.run.smithi033:mds.a> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.a.service 2024-08-28T19:29:04.454 DEBUG:teuthology.orchestra.run.smithi033:mds.d> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.d.service 2024-08-28T19:29:04.497 DEBUG:teuthology.orchestra.run.smithi033:mds.g> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.g.service 2024-08-28T19:29:04.540 DEBUG:teuthology.orchestra.run.smithi033:mds.j> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.j.service 2024-08-28T19:29:04.582 DEBUG:teuthology.orchestra.run.smithi059:mds.b> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.b.service 2024-08-28T19:29:04.585 DEBUG:teuthology.orchestra.run.smithi059:mds.e> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.e.service 2024-08-28T19:29:04.628 DEBUG:teuthology.orchestra.run.smithi059:mds.h> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.h.service 2024-08-28T19:29:04.668 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:29:04.668 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-08-28T19:29:04.668 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:04.669 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:29:04.669 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:04.669 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:29:04.669 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:04.669 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:04.669 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:04.669 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:04.669 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: Deploying daemon mds.l on smithi122 2024-08-28T19:29:04.669 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:04 smithi122 ceph-mon[22174]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:04.671 DEBUG:teuthology.orchestra.run.smithi059:mds.k> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.k.service 2024-08-28T19:29:04.713 DEBUG:teuthology.orchestra.run.smithi122:mds.c> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.c.service 2024-08-28T19:29:04.717 DEBUG:teuthology.orchestra.run.smithi122:mds.f> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.f.service 2024-08-28T19:29:04.760 DEBUG:teuthology.orchestra.run.smithi122:mds.i> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.i.service 2024-08-28T19:29:04.803 DEBUG:teuthology.orchestra.run.smithi122:mds.l> sudo journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.l.service 2024-08-28T19:29:04.847 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-28T19:29:04.847 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:04.871 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: Deploying daemon mds.l on smithi122 2024-08-28T19:29:04.872 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:04 smithi033 ceph-mon[18549]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:29:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-08-28T19:29:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:29:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:29:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:05.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: Deploying daemon mds.l on smithi122 2024-08-28T19:29:05.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:04 smithi059 ceph-mon[22052]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:05.100 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:05.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.584+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/171369810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41081c0 msgr2=0x7f4ca41085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:05.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.584+0000 7f4ca9ed9640 1 --2- 172.21.15.33:0/171369810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41081c0 0x7f4ca41085d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009900 tx=0x7f4c9802a410 comp rx=0 tx=0).stop 2024-08-28T19:29:05.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.584+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/171369810 shutdown_connections 2024-08-28T19:29:05.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.584+0000 7f4ca9ed9640 1 --2- 172.21.15.33:0/171369810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca4108b10 0x7f4ca410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:05.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.584+0000 7f4ca9ed9640 1 --2- 172.21.15.33:0/171369810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41081c0 0x7f4ca41085d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:05.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.584+0000 7f4ca9ed9640 1 --2- 172.21.15.33:0/171369810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ca4102880 0x7f4ca4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:05.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.584+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/171369810 >> 172.21.15.33:0/171369810 conn(0x7f4ca4079510 msgr2=0x7f4ca4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:05.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.584+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/171369810 shutdown_connections 2024-08-28T19:29:05.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.584+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/171369810 wait complete. 2024-08-28T19:29:05.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.585+0000 7f4ca9ed9640 1 Processor -- start 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.585+0000 7f4ca9ed9640 1 -- start start 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.585+0000 7f4ca9ed9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ca4102880 0x7f4ca40ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.585+0000 7f4ca9ed9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41081c0 0x7f4ca40ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.585+0000 7f4ca9ed9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca4108b10 0x7f4ca40ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca9ed9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4112780 con 0x7f4ca41081c0 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca9ed9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4112600 con 0x7f4ca4108b10 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca9ed9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4112900 con 0x7f4ca4102880 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41081c0 0x7f4ca40ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41081c0 0x7f4ca40ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43624/0 (socket says 172.21.15.33:43624) 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca2ffd640 1 -- 172.21.15.33:0/2074296758 learned_addr learned my addr 172.21.15.33:0/2074296758 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca3fff640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca4108b10 0x7f4ca40ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca37fe640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ca4102880 0x7f4ca40ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:05.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca2ffd640 1 -- 172.21.15.33:0/2074296758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ca4102880 msgr2=0x7f4ca40ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca2ffd640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ca4102880 0x7f4ca40ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca2ffd640 1 -- 172.21.15.33:0/2074296758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca4108b10 msgr2=0x7f4ca40ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca2ffd640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca4108b10 0x7f4ca40ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca2ffd640 1 -- 172.21.15.33:0/2074296758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca41a8580 con 0x7f4ca41081c0 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca3fff640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca4108b10 0x7f4ca40ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca2ffd640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41081c0 0x7f4ca40ff950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4c98006010 tx=0x7f4c98004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca0ff9640 1 -- 172.21.15.33:0/2074296758 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9803f030 con 0x7f4ca41081c0 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca0ff9640 1 -- 172.21.15.33:0/2074296758 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c98003aa0 con 0x7f4ca41081c0 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca0ff9640 1 -- 172.21.15.33:0/2074296758 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98035070 con 0x7f4ca41081c0 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.586+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/2074296758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca41a8810 con 0x7f4ca41081c0 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.587+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/2074296758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca41a8ca0 con 0x7f4ca41081c0 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.588+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/2074296758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca4103b00 con 0x7f4ca41081c0 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.589+0000 7f4ca0ff9640 1 -- 172.21.15.33:0/2074296758 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f4c98042030 con 0x7f4ca41081c0 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.590+0000 7f4ca0ff9640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c8c0b4c00 0x7f4c8c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:05.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.590+0000 7f4ca37fe640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c8c0b4c00 0x7f4c8c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:05.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.590+0000 7f4ca0ff9640 1 -- 172.21.15.33:0/2074296758 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f4c98105270 con 0x7f4ca41081c0 2024-08-28T19:29:05.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.591+0000 7f4ca37fe640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c8c0b4c00 0x7f4c8c0b7110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4100e60 tx=0x7f4c9400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:05.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.595+0000 7f4ca0ff9640 1 -- 172.21.15.33:0/2074296758 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4c980cc080 con 0x7f4ca41081c0 2024-08-28T19:29:05.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.820+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/2074296758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ca4100710 con 0x7f4ca41081c0 2024-08-28T19:29:05.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.820+0000 7f4ca0ff9640 1 -- 172.21.15.33:0/2074296758 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f4ca4100710 con 0x7f4ca41081c0 2024-08-28T19:29:05.823 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:05.823 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":1,"btime":"2024-08-28T19:21:33:380247+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-28T19:29:05.823 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 1 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/2074296758 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c8c0b4c00 msgr2=0x7f4c8c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c8c0b4c00 0x7f4c8c0b7110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4100e60 tx=0x7f4c9400b410 comp rx=0 tx=0).stop 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/2074296758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41081c0 msgr2=0x7f4ca40ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41081c0 0x7f4ca40ff950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4c98006010 tx=0x7f4c98004060 comp rx=0 tx=0).stop 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/2074296758 shutdown_connections 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca4108b10 0x7f4ca40ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41081c0 0x7f4ca40ff950 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c8c0b4c00 0x7f4c8c0b7110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 --2- 172.21.15.33:0/2074296758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ca4102880 0x7f4ca40ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/2074296758 >> 172.21.15.33:0/2074296758 conn(0x7f4ca4079510 msgr2=0x7f4ca4101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/2074296758 shutdown_connections 2024-08-28T19:29:05.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:05.823+0000 7f4ca9ed9640 1 -- 172.21.15.33:0/2074296758 wait complete. 2024-08-28T19:29:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2074296758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6832/2139914522,v1:172.21.15.122:6833/2139914522] up:boot 2024-08-28T19:29:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: fsmap 1 up:standby 2024-08-28T19:29:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T19:29:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:06.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:06.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:07.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:07.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2074296758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:07.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6832/2139914522,v1:172.21.15.122:6833/2139914522] up:boot 2024-08-28T19:29:07.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: fsmap 1 up:standby 2024-08-28T19:29:07.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T19:29:07.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:07.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:07.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:07.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:07.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:07.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2074296758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6832/2139914522,v1:172.21.15.122:6833/2139914522] up:boot 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: fsmap 1 up:standby 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:07.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:08.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:07 smithi059 ceph-mon[22052]: Deploying daemon mds.k on smithi059 2024-08-28T19:29:08.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:07 smithi122 ceph-mon[22174]: Deploying daemon mds.k on smithi059 2024-08-28T19:29:08.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:07 smithi033 ceph-mon[18549]: Deploying daemon mds.k on smithi059 2024-08-28T19:29:08.599 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:29:08.766 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:29:08 smithi059 systemd[1]: Starting Ceph mds.k for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:29:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:08.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:08 smithi033 ceph-mon[18549]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:09.021 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:08 smithi059 ceph-mon[22052]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:09.021 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:29:08 smithi059 podman[52227]: 2024-08-28 19:29:08.748969057 +0000 UTC m=+0.016027645 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:29:09.021 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:29:08 smithi059 podman[52227]: 2024-08-28 19:29:08.861445518 +0000 UTC m=+0.128504091 container create a4377b1f53eb50585f8ac069a17b1717a7ada0aafbd66cf0ee2e9d304e85d655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-28T19:29:09.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:08 smithi122 ceph-mon[22174]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:09.283 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:29:09 smithi059 podman[52227]: 2024-08-28 19:29:09.105785444 +0000 UTC m=+0.372844025 container init a4377b1f53eb50585f8ac069a17b1717a7ada0aafbd66cf0ee2e9d304e85d655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-28T19:29:09.283 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:29:09 smithi059 podman[52227]: 2024-08-28 19:29:09.108585872 +0000 UTC m=+0.375644451 container start a4377b1f53eb50585f8ac069a17b1717a7ada0aafbd66cf0ee2e9d304e85d655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-28T19:29:09.283 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:29:09 smithi059 ceph-mds[52246]: -- 172.21.15.59:0/4076325208 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5622e5081860 con 0x5622e9227180 2024-08-28T19:29:09.283 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:29:09 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k[52242]: starting mds.k at 2024-08-28T19:29:09.283 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:29:09 smithi059 bash[52227]: a4377b1f53eb50585f8ac069a17b1717a7ada0aafbd66cf0ee2e9d304e85d655 2024-08-28T19:29:09.283 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:29:09 smithi059 systemd[1]: Started Ceph mds.k for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 -- 172.21.15.33:0/2637576649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6998102800 msgr2=0x7f6998102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 --2- 172.21.15.33:0/2637576649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6998102800 0x7f6998102c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f698c009900 tx=0x7f698c02a410 comp rx=0 tx=0).stop 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 -- 172.21.15.33:0/2637576649 shutdown_connections 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 --2- 172.21.15.33:0/2637576649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6998108a90 0x7f699810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 --2- 172.21.15.33:0/2637576649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6998108140 0x7f6998108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 --2- 172.21.15.33:0/2637576649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6998102800 0x7f6998102c10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 -- 172.21.15.33:0/2637576649 >> 172.21.15.33:0/2637576649 conn(0x7f69980794d0 msgr2=0x7f69980798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 -- 172.21.15.33:0/2637576649 shutdown_connections 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 -- 172.21.15.33:0/2637576649 wait complete. 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 Processor -- start 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.338+0000 7f699f0d2640 1 -- start start 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699f0d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6998102800 0x7f699819b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699f0d2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6998108140 0x7f699819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699f0d2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6998108a90 0x7f699819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699f0d2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6998112710 con 0x7f6998102800 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699f0d2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6998112590 con 0x7f6998108140 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699f0d2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6998112890 con 0x7f6998108a90 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699ce6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6998102800 0x7f699819b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699ce6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6998102800 0x7f699819b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57046/0 (socket says 172.21.15.33:57046) 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699ce6e640 1 -- 172.21.15.33:0/221763244 learned_addr learned my addr 172.21.15.33:0/221763244 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699d66f640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6998108a90 0x7f699819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f6997fff640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6998108140 0x7f699819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699ce6e640 1 -- 172.21.15.33:0/221763244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6998108a90 msgr2=0x7f699819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699ce6e640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6998108a90 0x7f699819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699ce6e640 1 -- 172.21.15.33:0/221763244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6998108140 msgr2=0x7f699819b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699ce6e640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6998108140 0x7f699819b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699ce6e640 1 -- 172.21.15.33:0/221763244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69981a6290 con 0x7f6998102800 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.339+0000 7f699d66f640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6998108a90 0x7f699819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.340+0000 7f699ce6e640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6998102800 0x7f699819b000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f698c005940 tx=0x7f698c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.340+0000 7f6995ffb640 1 -- 172.21.15.33:0/221763244 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c03f030 con 0x7f6998102800 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.340+0000 7f699f0d2640 1 -- 172.21.15.33:0/221763244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69981a6520 con 0x7f6998102800 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.340+0000 7f6995ffb640 1 -- 172.21.15.33:0/221763244 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f698c003aa0 con 0x7f6998102800 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.340+0000 7f6995ffb640 1 -- 172.21.15.33:0/221763244 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c035070 con 0x7f6998102800 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.340+0000 7f699f0d2640 1 -- 172.21.15.33:0/221763244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69981a6a50 con 0x7f6998102800 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.341+0000 7f699f0d2640 1 -- 172.21.15.33:0/221763244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6998102c10 con 0x7f6998102800 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.344+0000 7f6995ffb640 1 -- 172.21.15.33:0/221763244 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f698c042030 con 0x7f6998102800 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.344+0000 7f6995ffb640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69880b4bb0 0x7f69880b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.344+0000 7f6995ffb640 1 -- 172.21.15.33:0/221763244 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f698c105250 con 0x7f6998102800 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.344+0000 7f6997fff640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69880b4bb0 0x7f69880b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.345+0000 7f6997fff640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69880b4bb0 0x7f69880b70c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f69981009f0 tx=0x7f698400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:09.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.349+0000 7f6995ffb640 1 -- 172.21.15.33:0/221763244 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f698c0cc060 con 0x7f6998102800 2024-08-28T19:29:09.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.582+0000 7f699f0d2640 1 -- 172.21.15.33:0/221763244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f699810a8c0 con 0x7f6998102800 2024-08-28T19:29:09.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.583+0000 7f6995ffb640 1 -- 172.21.15.33:0/221763244 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f698c0d0820 con 0x7f6998102800 2024-08-28T19:29:09.585 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:09.585 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":2,"btime":"2024-08-28T19:29:06:612025+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-28T19:29:09.585 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 2 2024-08-28T19:29:09.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.585+0000 7f699f0d2640 1 -- 172.21.15.33:0/221763244 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69880b4bb0 msgr2=0x7f69880b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:09.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.585+0000 7f699f0d2640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69880b4bb0 0x7f69880b70c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f69981009f0 tx=0x7f698400b410 comp rx=0 tx=0).stop 2024-08-28T19:29:09.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.585+0000 7f699f0d2640 1 -- 172.21.15.33:0/221763244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6998102800 msgr2=0x7f699819b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.585+0000 7f699f0d2640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6998102800 0x7f699819b000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f698c005940 tx=0x7f698c004270 comp rx=0 tx=0).stop 2024-08-28T19:29:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.585+0000 7f699f0d2640 1 -- 172.21.15.33:0/221763244 shutdown_connections 2024-08-28T19:29:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.585+0000 7f699f0d2640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69880b4bb0 0x7f69880b70c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.585+0000 7f699f0d2640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6998108a90 0x7f699819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.585+0000 7f699f0d2640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6998108140 0x7f699819b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.585+0000 7f699f0d2640 1 --2- 172.21.15.33:0/221763244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6998102800 0x7f699819b000 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.585+0000 7f699f0d2640 1 -- 172.21.15.33:0/221763244 >> 172.21.15.33:0/221763244 conn(0x7f69980794d0 msgr2=0x7f69981011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.586+0000 7f699f0d2640 1 -- 172.21.15.33:0/221763244 shutdown_connections 2024-08-28T19:29:09.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:09.586+0000 7f699f0d2640 1 -- 172.21.15.33:0/221763244 wait complete. 2024-08-28T19:29:10.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:10.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:10.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:10.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:10.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:10.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:10.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: Deploying daemon mds.j on smithi033 2024-08-28T19:29:10.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/221763244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:10.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.59:6832/1923629681,v1:172.21.15.59:6833/1923629681] up:boot 2024-08-28T19:29:10.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: fsmap 2 up:standby 2024-08-28T19:29:10.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:10 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-28T19:29:10.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:10.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:10.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:10.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:10.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:10.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:10.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: Deploying daemon mds.j on smithi033 2024-08-28T19:29:10.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/221763244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:10.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.59:6832/1923629681,v1:172.21.15.59:6833/1923629681] up:boot 2024-08-28T19:29:10.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: fsmap 2 up:standby 2024-08-28T19:29:10.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:10 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-28T19:29:10.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:10.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:10.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:10.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:10.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:10.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:10.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: Deploying daemon mds.j on smithi033 2024-08-28T19:29:10.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/221763244' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:10.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.59:6832/1923629681,v1:172.21.15.59:6833/1923629681] up:boot 2024-08-28T19:29:10.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: fsmap 2 up:standby 2024-08-28T19:29:10.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:10 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-28T19:29:11.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:11 smithi033 ceph-mon[18549]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:11.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:11 smithi059 ceph-mon[22052]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:11.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:11 smithi122 ceph-mon[22174]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:12.380 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:29:12 smithi033 systemd[1]: Starting Ceph mds.j for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:29:12.775 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:29:12 smithi033 podman[62970]: 2024-08-28 19:29:12.40382478 +0000 UTC m=+0.015887957 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:29:12.775 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:29:12 smithi033 podman[62970]: 2024-08-28 19:29:12.522527423 +0000 UTC m=+0.134590642 container create 0ee44fa640aeae23f1dd0f7cd3f1df99aa996130c8727d8b9d98c2fb18079abe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-j, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-08-28T19:29:12.776 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:29:12 smithi033 podman[62970]: 2024-08-28 19:29:12.775054385 +0000 UTC m=+0.387117559 container init 0ee44fa640aeae23f1dd0f7cd3f1df99aa996130c8727d8b9d98c2fb18079abe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-j, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:29:13.130 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:29:12 smithi033 podman[62970]: 2024-08-28 19:29:12.777929313 +0000 UTC m=+0.389992488 container start 0ee44fa640aeae23f1dd0f7cd3f1df99aa996130c8727d8b9d98c2fb18079abe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-28T19:29:13.130 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:29:12 smithi033 ceph-mds[62989]: -- 172.21.15.33:0/2502632951 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e58c10d860 con 0x55e5902b3600 2024-08-28T19:29:13.130 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:29:12 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-j[62985]: starting mds.j at 2024-08-28T19:29:13.130 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:29:12 smithi033 bash[62970]: 0ee44fa640aeae23f1dd0f7cd3f1df99aa996130c8727d8b9d98c2fb18079abe 2024-08-28T19:29:13.130 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:29:12 smithi033 systemd[1]: Started Ceph mds.j for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:29:13.161 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:29:13.521 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:13 smithi033 ceph-mon[18549]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:13.521 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:13.521 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:13.521 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:13.521 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:13.522 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:13.522 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:13 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:13.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:13 smithi059 ceph-mon[22052]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:13 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:13 smithi122 ceph-mon[22174]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:13.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:13 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:14.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:14 smithi033 ceph-mon[18549]: Deploying daemon mds.d on smithi033 2024-08-28T19:29:14.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:14 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.33:6834/3694119808,v1:172.21.15.33:6835/3694119808] up:boot 2024-08-28T19:29:14.525 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:14 smithi033 ceph-mon[18549]: fsmap 3 up:standby 2024-08-28T19:29:14.526 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:14 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-28T19:29:14.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:14 smithi059 ceph-mon[22052]: Deploying daemon mds.d on smithi033 2024-08-28T19:29:14.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:14 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.33:6834/3694119808,v1:172.21.15.33:6835/3694119808] up:boot 2024-08-28T19:29:14.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:14 smithi059 ceph-mon[22052]: fsmap 3 up:standby 2024-08-28T19:29:14.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:14 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-28T19:29:14.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:14 smithi122 ceph-mon[22174]: Deploying daemon mds.d on smithi033 2024-08-28T19:29:14.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:14 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.33:6834/3694119808,v1:172.21.15.33:6835/3694119808] up:boot 2024-08-28T19:29:14.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:14 smithi122 ceph-mon[22174]: fsmap 3 up:standby 2024-08-28T19:29:14.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:14 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-28T19:29:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:15.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.300+0000 7ff408f9d640 1 -- 172.21.15.33:0/4153273351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff404109240 msgr2=0x7ff404109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:15.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.300+0000 7ff408f9d640 1 --2- 172.21.15.33:0/4153273351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff404109240 0x7ff404109650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009900 tx=0x7ff3f802a3f0 comp rx=0 tx=0).stop 2024-08-28T19:29:15.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.300+0000 7ff408f9d640 1 -- 172.21.15.33:0/4153273351 shutdown_connections 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.300+0000 7ff408f9d640 1 --2- 172.21.15.33:0/4153273351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff404109b90 0x7ff4041103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.300+0000 7ff408f9d640 1 --2- 172.21.15.33:0/4153273351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff404109240 0x7ff404109650 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.300+0000 7ff408f9d640 1 --2- 172.21.15.33:0/4153273351 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff404103900 0x7ff404103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.300+0000 7ff408f9d640 1 -- 172.21.15.33:0/4153273351 >> 172.21.15.33:0/4153273351 conn(0x7ff40407b5f0 msgr2=0x7ff40407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.300+0000 7ff408f9d640 1 -- 172.21.15.33:0/4153273351 shutdown_connections 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.300+0000 7ff408f9d640 1 -- 172.21.15.33:0/4153273351 wait complete. 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.300+0000 7ff408f9d640 1 Processor -- start 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff408f9d640 1 -- start start 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff408f9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff404103900 0x7ff40419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff408f9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff404109240 0x7ff40419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff408f9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff404109b90 0x7ff40419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:15.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff408f9d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff404113850 con 0x7ff404109b90 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff408f9d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff4041136d0 con 0x7ff404109240 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff408f9d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff4041139d0 con 0x7ff404103900 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff402d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff404109b90 0x7ff40419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff402d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff404109b90 0x7ff40419faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57074/0 (socket says 172.21.15.33:57074) 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff402d9d640 1 -- 172.21.15.33:0/600402855 learned_addr learned my addr 172.21.15.33:0/600402855 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff401d9b640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff404109240 0x7ff40419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff40259c640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff404103900 0x7ff40419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff402d9d640 1 -- 172.21.15.33:0/600402855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff404103900 msgr2=0x7ff40419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff402d9d640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff404103900 0x7ff40419a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff402d9d640 1 -- 172.21.15.33:0/600402855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff404109240 msgr2=0x7ff40419a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff402d9d640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff404109240 0x7ff40419a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff402d9d640 1 -- 172.21.15.33:0/600402855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4041a0110 con 0x7ff404109b90 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.301+0000 7ff402d9d640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff404109b90 0x7ff40419faa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00cce0 tx=0x7ff3fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:15.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.302+0000 7ff3f37fe640 1 -- 172.21.15.33:0/600402855 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00f450 con 0x7ff404109b90 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.302+0000 7ff408f9d640 1 -- 172.21.15.33:0/600402855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4041a0400 con 0x7ff404109b90 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.302+0000 7ff3f37fe640 1 -- 172.21.15.33:0/600402855 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3fc00faa0 con 0x7ff404109b90 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.302+0000 7ff3f37fe640 1 -- 172.21.15.33:0/600402855 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc018b70 con 0x7ff404109b90 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.302+0000 7ff408f9d640 1 -- 172.21.15.33:0/600402855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4041a6c20 con 0x7ff404109b90 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.303+0000 7ff408f9d640 1 -- 172.21.15.33:0/600402855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff404104b80 con 0x7ff404109b90 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.305+0000 7ff3f37fe640 1 -- 172.21.15.33:0/600402855 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7ff3fc018d10 con 0x7ff404109b90 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.306+0000 7ff3f37fe640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3ec0b4bb0 0x7ff3ec0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.306+0000 7ff40259c640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3ec0b4bb0 0x7ff3ec0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.306+0000 7ff3f37fe640 1 -- 172.21.15.33:0/600402855 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7ff3fc0e5310 con 0x7ff404109b90 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.307+0000 7ff40259c640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3ec0b4bb0 0x7ff3ec0b70c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4005d00 tx=0x7ff3f4005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:15.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.309+0000 7ff3f37fe640 1 -- 172.21.15.33:0/600402855 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff3fc014030 con 0x7ff404109b90 2024-08-28T19:29:15.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:15 smithi033 ceph-mon[18549]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:15.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:15 smithi059 ceph-mon[22052]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:15.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:15 smithi122 ceph-mon[22174]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:15.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.548+0000 7ff408f9d640 1 -- 172.21.15.33:0/600402855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff404103d10 con 0x7ff404109b90 2024-08-28T19:29:15.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.549+0000 7ff3f37fe640 1 -- 172.21.15.33:0/600402855 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7ff404103d10 con 0x7ff404109b90 2024-08-28T19:29:15.550 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:15.550 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":4,"btime":"2024-08-28T19:29:13:258566+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-28T19:29:15.550 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 4 2024-08-28T19:29:15.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 -- 172.21.15.33:0/600402855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3ec0b4bb0 msgr2=0x7ff3ec0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:15.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3ec0b4bb0 0x7ff3ec0b70c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4005d00 tx=0x7ff3f4005c50 comp rx=0 tx=0).stop 2024-08-28T19:29:15.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 -- 172.21.15.33:0/600402855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff404109b90 msgr2=0x7ff40419faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:15.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff404109b90 0x7ff40419faa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00cce0 tx=0x7ff3fc00a620 comp rx=0 tx=0).stop 2024-08-28T19:29:15.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 -- 172.21.15.33:0/600402855 shutdown_connections 2024-08-28T19:29:15.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff404109b90 0x7ff40419faa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:15.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff404109240 0x7ff40419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:15.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3ec0b4bb0 0x7ff3ec0b70c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:15.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 --2- 172.21.15.33:0/600402855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff404103900 0x7ff40419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:15.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 -- 172.21.15.33:0/600402855 >> 172.21.15.33:0/600402855 conn(0x7ff40407b5f0 msgr2=0x7ff404105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:15.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 -- 172.21.15.33:0/600402855 shutdown_connections 2024-08-28T19:29:15.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:15.551+0000 7ff408f9d640 1 -- 172.21.15.33:0/600402855 wait complete. 2024-08-28T19:29:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:16 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/600402855' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:16.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:16 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:16.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:16 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/600402855' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:16.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:16.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:16.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:16.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:16.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:16.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:16 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:16 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/600402855' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:16 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:17.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:17 smithi059 ceph-mon[22052]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:17.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:17 smithi059 ceph-mon[22052]: Deploying daemon mds.e on smithi059 2024-08-28T19:29:17.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:17 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.33:6836/1498510399,v1:172.21.15.33:6837/1498510399] up:boot 2024-08-28T19:29:17.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:17 smithi059 ceph-mon[22052]: fsmap 4 up:standby 2024-08-28T19:29:17.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:17 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-28T19:29:17.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:17 smithi122 ceph-mon[22174]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:17.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:17 smithi122 ceph-mon[22174]: Deploying daemon mds.e on smithi059 2024-08-28T19:29:17.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:17 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.33:6836/1498510399,v1:172.21.15.33:6837/1498510399] up:boot 2024-08-28T19:29:17.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:17 smithi122 ceph-mon[22174]: fsmap 4 up:standby 2024-08-28T19:29:17.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:17 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-28T19:29:17.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:17 smithi033 ceph-mon[18549]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:17.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:17 smithi033 ceph-mon[18549]: Deploying daemon mds.e on smithi059 2024-08-28T19:29:17.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:17 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.33:6836/1498510399,v1:172.21.15.33:6837/1498510399] up:boot 2024-08-28T19:29:17.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:17 smithi033 ceph-mon[18549]: fsmap 4 up:standby 2024-08-28T19:29:17.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:17 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-28T19:29:18.264 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:29:18 smithi059 systemd[1]: Starting Ceph mds.e for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:29:18.533 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:29:18 smithi059 podman[52524]: 2024-08-28 19:29:18.166235192 +0000 UTC m=+0.016192033 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:29:18.533 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:29:18 smithi059 podman[52524]: 2024-08-28 19:29:18.450242353 +0000 UTC m=+0.300199220 container create 265c8af5c929f09c02984d53dc0a8efc741bf264b3cb4b6e6fde22174ed33eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-28T19:29:18.647 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:29:18.922 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:19.033 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:29:18 smithi059 podman[52524]: 2024-08-28 19:29:18.677617809 +0000 UTC m=+0.527574636 container init 265c8af5c929f09c02984d53dc0a8efc741bf264b3cb4b6e6fde22174ed33eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:29:19.033 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:29:18 smithi059 podman[52524]: 2024-08-28 19:29:18.680300026 +0000 UTC m=+0.530256851 container start 265c8af5c929f09c02984d53dc0a8efc741bf264b3cb4b6e6fde22174ed33eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-28T19:29:19.033 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:29:18 smithi059 ceph-mds[52543]: -- 172.21.15.59:0/127051377 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a27ea45860 con 0x55a282beba80 2024-08-28T19:29:19.033 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:29:18 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e[52539]: starting mds.e at 2024-08-28T19:29:19.034 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:29:18 smithi059 bash[52524]: 265c8af5c929f09c02984d53dc0a8efc741bf264b3cb4b6e6fde22174ed33eaa 2024-08-28T19:29:19.034 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:29:18 smithi059 systemd[1]: Started Ceph mds.e for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:29:19.304 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:19 smithi033 ceph-mon[18549]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:19.304 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:19 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:19.304 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:19 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:19.304 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:19 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:19.304 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:19 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:19.304 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:19 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:19.304 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:19 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:19.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.396+0000 7fdc91622640 1 -- 172.21.15.33:0/3312585530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc8c1023f0 msgr2=0x7fdc8c102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.396+0000 7fdc91622640 1 --2- 172.21.15.33:0/3312585530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc8c1023f0 0x7fdc8c102800 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009900 tx=0x7fdc7c02a480 comp rx=0 tx=0).stop 2024-08-28T19:29:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.396+0000 7fdc91622640 1 -- 172.21.15.33:0/3312585530 shutdown_connections 2024-08-28T19:29:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.396+0000 7fdc91622640 1 --2- 172.21.15.33:0/3312585530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc8c10ffa0 0x7fdc8c1123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.396+0000 7fdc91622640 1 --2- 172.21.15.33:0/3312585530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c102d40 0x7fdc8c10fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.396+0000 7fdc91622640 1 --2- 172.21.15.33:0/3312585530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc8c1023f0 0x7fdc8c102800 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.396+0000 7fdc91622640 1 -- 172.21.15.33:0/3312585530 >> 172.21.15.33:0/3312585530 conn(0x7fdc8c0794d0 msgr2=0x7fdc8c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.397+0000 7fdc91622640 1 -- 172.21.15.33:0/3312585530 shutdown_connections 2024-08-28T19:29:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.397+0000 7fdc91622640 1 -- 172.21.15.33:0/3312585530 wait complete. 2024-08-28T19:29:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.397+0000 7fdc91622640 1 Processor -- start 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.397+0000 7fdc91622640 1 -- start start 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc91622640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c1023f0 0x7fdc8c19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc91622640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc8c102d40 0x7fdc8c19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc91622640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc8c10ffa0 0x7fdc8c1a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc91622640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c115a10 con 0x7fdc8c102d40 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc91622640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c115890 con 0x7fdc8c1023f0 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc91622640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c115b90 con 0x7fdc8c10ffa0 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc8c102d40 0x7fdc8c19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc8c102d40 0x7fdc8c19c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49996/0 (socket says 172.21.15.33:49996) 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc83fff640 1 -- 172.21.15.33:0/2678961175 learned_addr learned my addr 172.21.15.33:0/2678961175 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc8b7fe640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc8c10ffa0 0x7fdc8c1a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc8affd640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c1023f0 0x7fdc8c19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc83fff640 1 -- 172.21.15.33:0/2678961175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc8c10ffa0 msgr2=0x7fdc8c1a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc83fff640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc8c10ffa0 0x7fdc8c1a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc83fff640 1 -- 172.21.15.33:0/2678961175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c1023f0 msgr2=0x7fdc8c19c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc83fff640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c1023f0 0x7fdc8c19c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc83fff640 1 -- 172.21.15.33:0/2678961175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c1a2350 con 0x7fdc8c102d40 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.398+0000 7fdc83fff640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc8c102d40 0x7fdc8c19c980 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400e9f0 tx=0x7fdc7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.399+0000 7fdc88ff9640 1 -- 172.21.15.33:0/2678961175 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400cd80 con 0x7fdc8c102d40 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.399+0000 7fdc88ff9640 1 -- 172.21.15.33:0/2678961175 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc740108e0 con 0x7fdc8c102d40 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.399+0000 7fdc91622640 1 -- 172.21.15.33:0/2678961175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8c1a2640 con 0x7fdc8c102d40 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.399+0000 7fdc88ff9640 1 -- 172.21.15.33:0/2678961175 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74018980 con 0x7fdc8c102d40 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.399+0000 7fdc91622640 1 -- 172.21.15.33:0/2678961175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8c1a8da0 con 0x7fdc8c102d40 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.400+0000 7fdc91622640 1 -- 172.21.15.33:0/2678961175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc8c102800 con 0x7fdc8c102d40 2024-08-28T19:29:19.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.401+0000 7fdc88ff9640 1 -- 172.21.15.33:0/2678961175 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fdc74010430 con 0x7fdc8c102d40 2024-08-28T19:29:19.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.402+0000 7fdc88ff9640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc780b4b80 0x7fdc780b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:19.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.402+0000 7fdc8affd640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc780b4b80 0x7fdc780b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:19.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.402+0000 7fdc88ff9640 1 -- 172.21.15.33:0/2678961175 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fdc740e5230 con 0x7fdc8c102d40 2024-08-28T19:29:19.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.403+0000 7fdc8affd640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc780b4b80 0x7fdc780b7090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c031440 tx=0x7fdc7c005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:19.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.407+0000 7fdc88ff9640 1 -- 172.21.15.33:0/2678961175 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdc740ac730 con 0x7fdc8c102d40 2024-08-28T19:29:19.499 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:19 smithi122 ceph-mon[22174]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:19.499 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:19 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:19.499 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:19 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:19.499 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:19 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:19.499 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:19 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:19.499 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:19 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:19.499 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:19 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:19.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.651+0000 7fdc91622640 1 -- 172.21.15.33:0/2678961175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc8c1a9080 con 0x7fdc8c102d40 2024-08-28T19:29:19.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.652+0000 7fdc88ff9640 1 -- 172.21.15.33:0/2678961175 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7fdc740ac030 con 0x7fdc8c102d40 2024-08-28T19:29:19.653 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:19.653 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":6,"btime":"2024-08-28T19:29:19:282529+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-28T19:29:19.653 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 6 2024-08-28T19:29:19.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.654+0000 7fdc91622640 1 -- 172.21.15.33:0/2678961175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc780b4b80 msgr2=0x7fdc780b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:19.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.654+0000 7fdc91622640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc780b4b80 0x7fdc780b7090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c031440 tx=0x7fdc7c005d50 comp rx=0 tx=0).stop 2024-08-28T19:29:19.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.654+0000 7fdc91622640 1 -- 172.21.15.33:0/2678961175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc8c102d40 msgr2=0x7fdc8c19c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:19.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.654+0000 7fdc91622640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc8c102d40 0x7fdc8c19c980 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400e9f0 tx=0x7fdc7400eeb0 comp rx=0 tx=0).stop 2024-08-28T19:29:19.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.654+0000 7fdc91622640 1 -- 172.21.15.33:0/2678961175 shutdown_connections 2024-08-28T19:29:19.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.654+0000 7fdc91622640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc780b4b80 0x7fdc780b7090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:19.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.654+0000 7fdc91622640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc8c10ffa0 0x7fdc8c1a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:19.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.654+0000 7fdc91622640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc8c102d40 0x7fdc8c19c980 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:19.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.654+0000 7fdc91622640 1 --2- 172.21.15.33:0/2678961175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c1023f0 0x7fdc8c19c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:19.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.655+0000 7fdc91622640 1 -- 172.21.15.33:0/2678961175 >> 172.21.15.33:0/2678961175 conn(0x7fdc8c0794d0 msgr2=0x7fdc8c108a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:19.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.655+0000 7fdc91622640 1 -- 172.21.15.33:0/2678961175 shutdown_connections 2024-08-28T19:29:19.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:19.655+0000 7fdc91622640 1 -- 172.21.15.33:0/2678961175 wait complete. 2024-08-28T19:29:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:19 smithi059 ceph-mon[22052]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:19 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:19 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:19 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:19 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:19 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:19 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:20.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:20 smithi033 ceph-mon[18549]: Deploying daemon mds.f on smithi122 2024-08-28T19:29:20.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:20 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.59:6834/2308401306,v1:172.21.15.59:6835/2308401306] up:boot 2024-08-28T19:29:20.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:20 smithi033 ceph-mon[18549]: fsmap 5 up:standby 2024-08-28T19:29:20.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:20 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-28T19:29:20.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:20 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2678961175' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:20.533 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:20 smithi122 ceph-mon[22174]: Deploying daemon mds.f on smithi122 2024-08-28T19:29:20.533 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:20 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.59:6834/2308401306,v1:172.21.15.59:6835/2308401306] up:boot 2024-08-28T19:29:20.533 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:20 smithi122 ceph-mon[22174]: fsmap 5 up:standby 2024-08-28T19:29:20.533 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:20 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-28T19:29:20.533 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:20 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2678961175' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:20 smithi059 ceph-mon[22052]: Deploying daemon mds.f on smithi122 2024-08-28T19:29:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:20 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.59:6834/2308401306,v1:172.21.15.59:6835/2308401306] up:boot 2024-08-28T19:29:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:20 smithi059 ceph-mon[22052]: fsmap 5 up:standby 2024-08-28T19:29:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:20 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-28T19:29:20.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:20 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2678961175' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:20.793 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:29:20 smithi122 systemd[1]: Starting Ceph mds.f for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:29:21.200 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:29:20 smithi122 podman[53495]: 2024-08-28 19:29:20.818585506 +0000 UTC m=+0.015875367 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:29:21.200 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:29:20 smithi122 podman[53495]: 2024-08-28 19:29:20.94697042 +0000 UTC m=+0.144260265 container create 3acba08b0a75d32d7209f7ad0d10a07419e26285dd4a810915b98524505a8c5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-28T19:29:21.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:21 smithi122 ceph-mon[22174]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:21.543 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:29:21 smithi122 podman[53495]: 2024-08-28 19:29:21.19972008 +0000 UTC m=+0.397009925 container init 3acba08b0a75d32d7209f7ad0d10a07419e26285dd4a810915b98524505a8c5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, io.buildah.version=1.37.1) 2024-08-28T19:29:21.544 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:29:21 smithi122 podman[53495]: 2024-08-28 19:29:21.202672519 +0000 UTC m=+0.399962367 container start 3acba08b0a75d32d7209f7ad0d10a07419e26285dd4a810915b98524505a8c5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-08-28T19:29:21.544 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:29:21 smithi122 ceph-mds[53515]: -- 172.21.15.122:0/3957385796 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649f6235860 con 0x5649fa3db180 2024-08-28T19:29:21.544 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:29:21 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f[53511]: starting mds.f at 2024-08-28T19:29:21.544 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:29:21 smithi122 bash[53495]: 3acba08b0a75d32d7209f7ad0d10a07419e26285dd4a810915b98524505a8c5a 2024-08-28T19:29:21.544 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:29:21 smithi122 systemd[1]: Started Ceph mds.f for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:29:21.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:21 smithi033 ceph-mon[18549]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:21 smithi059 ceph-mon[22052]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:22.413 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:29:22.485 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:22 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] up:boot 2024-08-28T19:29:22.485 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:22 smithi122 ceph-mon[22174]: fsmap 6 up:standby 2024-08-28T19:29:22.485 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T19:29:22.485 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:22.486 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:22.486 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:22.486 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:22.486 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:22.486 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:22 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:22.486 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:22 smithi122 ceph-mon[22174]: Deploying daemon mds.c on smithi122 2024-08-28T19:29:22.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:22 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] up:boot 2024-08-28T19:29:22.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:22 smithi033 ceph-mon[18549]: fsmap 6 up:standby 2024-08-28T19:29:22.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T19:29:22.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:22.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:22.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:22.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:22.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:22.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:22 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:22.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:22 smithi033 ceph-mon[18549]: Deploying daemon mds.c on smithi122 2024-08-28T19:29:22.679 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:22 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] up:boot 2024-08-28T19:29:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:22 smithi059 ceph-mon[22052]: fsmap 6 up:standby 2024-08-28T19:29:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T19:29:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:22 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:22.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:22 smithi059 ceph-mon[22052]: Deploying daemon mds.c on smithi122 2024-08-28T19:29:23.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.161+0000 7fd06199d640 1 -- 172.21.15.33:0/872906802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd05c1047d0 msgr2=0x7fd05c104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:23.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.161+0000 7fd06199d640 1 --2- 172.21.15.33:0/872906802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd05c1047d0 0x7fd05c104be0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009900 tx=0x7fd04c02a410 comp rx=0 tx=0).stop 2024-08-28T19:29:23.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.161+0000 7fd06199d640 1 -- 172.21.15.33:0/872906802 shutdown_connections 2024-08-28T19:29:23.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.161+0000 7fd06199d640 1 --2- 172.21.15.33:0/872906802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd05c10dc00 0x7fd05c1100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:23.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.161+0000 7fd06199d640 1 --2- 172.21.15.33:0/872906802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c105120 0x7fd05c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:23.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.161+0000 7fd06199d640 1 --2- 172.21.15.33:0/872906802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd05c1047d0 0x7fd05c104be0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.161+0000 7fd06199d640 1 -- 172.21.15.33:0/872906802 >> 172.21.15.33:0/872906802 conn(0x7fd05c079500 msgr2=0x7fd05c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.161+0000 7fd06199d640 1 -- 172.21.15.33:0/872906802 shutdown_connections 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.161+0000 7fd06199d640 1 -- 172.21.15.33:0/872906802 wait complete. 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.162+0000 7fd06199d640 1 Processor -- start 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.162+0000 7fd06199d640 1 -- start start 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.162+0000 7fd06199d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c1047d0 0x7fd05c102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.162+0000 7fd06199d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd05c105120 0x7fd05c102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.162+0000 7fd06199d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd05c10dc00 0x7fd05c102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.162+0000 7fd06199d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c113860 con 0x7fd05c105120 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.162+0000 7fd06199d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c1136e0 con 0x7fd05c1047d0 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.162+0000 7fd06199d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c1139e0 con 0x7fd05c10dc00 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd05c105120 0x7fd05c102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:23.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd05c10dc00 0x7fd05c102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd05c105120 0x7fd05c102a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50000/0 (socket says 172.21.15.33:50000) 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05a7fc640 1 -- 172.21.15.33:0/1702893468 learned_addr learned my addr 172.21.15.33:0/1702893468 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05affd640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c1047d0 0x7fd05c102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05a7fc640 1 -- 172.21.15.33:0/1702893468 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd05c10dc00 msgr2=0x7fd05c102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05a7fc640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd05c10dc00 0x7fd05c102f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05a7fc640 1 -- 172.21.15.33:0/1702893468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c1047d0 msgr2=0x7fd05c102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05a7fc640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c1047d0 0x7fd05c102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05a7fc640 1 -- 172.21.15.33:0/1702893468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c1a8530 con 0x7fd05c105120 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd05a7fc640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd05c105120 0x7fd05c102a50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd05000e9f0 tx=0x7fd05000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd06099b640 1 -- 172.21.15.33:0/1702893468 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05000ccc0 con 0x7fd05c105120 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd06099b640 1 -- 172.21.15.33:0/1702893468 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0500108e0 con 0x7fd05c105120 2024-08-28T19:29:23.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd06199d640 1 -- 172.21.15.33:0/1702893468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05c1a8820 con 0x7fd05c105120 2024-08-28T19:29:23.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd06099b640 1 -- 172.21.15.33:0/1702893468 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050018860 con 0x7fd05c105120 2024-08-28T19:29:23.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.163+0000 7fd06199d640 1 -- 172.21.15.33:0/1702893468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05c1a8db0 con 0x7fd05c105120 2024-08-28T19:29:23.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.164+0000 7fd06199d640 1 -- 172.21.15.33:0/1702893468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05c06bf90 con 0x7fd05c105120 2024-08-28T19:29:23.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.166+0000 7fd06099b640 1 -- 172.21.15.33:0/1702893468 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fd050010430 con 0x7fd05c105120 2024-08-28T19:29:23.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.167+0000 7fd06099b640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0440b4c00 0x7fd0440b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:23.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.167+0000 7fd05affd640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0440b4c00 0x7fd0440b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:23.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.167+0000 7fd06099b640 1 -- 172.21.15.33:0/1702893468 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fd0500e5570 con 0x7fd05c105120 2024-08-28T19:29:23.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.167+0000 7fd05affd640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0440b4c00 0x7fd0440b7110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009230 tx=0x7fd04c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:23.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.170+0000 7fd06099b640 1 -- 172.21.15.33:0/1702893468 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd0500aca70 con 0x7fd05c105120 2024-08-28T19:29:23.293 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:29:23 smithi122 systemd[1]: Starting Ceph mds.c for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:29:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.390+0000 7fd06199d640 1 -- 172.21.15.33:0/1702893468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd05c103810 con 0x7fd05c105120 2024-08-28T19:29:23.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.391+0000 7fd06099b640 1 -- 172.21.15.33:0/1702893468 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5563 (secure 0 0 0) 0x7fd0500ac370 con 0x7fd05c105120 2024-08-28T19:29:23.392 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:23.393 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"btime":"2024-08-28T19:29:21:294986+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-08-28T19:29:23.393 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-08-28T19:29:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 -- 172.21.15.33:0/1702893468 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0440b4c00 msgr2=0x7fd0440b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0440b4c00 0x7fd0440b7110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009230 tx=0x7fd04c031400 comp rx=0 tx=0).stop 2024-08-28T19:29:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 -- 172.21.15.33:0/1702893468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd05c105120 msgr2=0x7fd05c102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:23.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd05c105120 0x7fd05c102a50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd05000e9f0 tx=0x7fd05000eeb0 comp rx=0 tx=0).stop 2024-08-28T19:29:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 -- 172.21.15.33:0/1702893468 shutdown_connections 2024-08-28T19:29:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0440b4c00 0x7fd0440b7110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd05c10dc00 0x7fd05c102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd05c105120 0x7fd05c102a50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 --2- 172.21.15.33:0/1702893468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05c1047d0 0x7fd05c102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 -- 172.21.15.33:0/1702893468 >> 172.21.15.33:0/1702893468 conn(0x7fd05c079500 msgr2=0x7fd05c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 -- 172.21.15.33:0/1702893468 shutdown_connections 2024-08-28T19:29:23.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:23.393+0000 7fd06199d640 1 -- 172.21.15.33:0/1702893468 wait complete. 2024-08-28T19:29:23.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:23 smithi033 ceph-mon[18549]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:23.692 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:23 smithi122 ceph-mon[22174]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:23.692 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:29:23 smithi122 podman[53796]: 2024-08-28 19:29:23.313562497 +0000 UTC m=+0.015606010 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:29:23.692 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:29:23 smithi122 podman[53796]: 2024-08-28 19:29:23.430189332 +0000 UTC m=+0.132232830 container create 36b99b71560e414b7964e3e41c92f88cfe9e5709c22853e27e6e5ed7d83367cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, ceph=True, org.label-schema.vendor=CentOS) 2024-08-28T19:29:23.692 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:29:23 smithi122 podman[53796]: 2024-08-28 19:29:23.691957025 +0000 UTC m=+0.394000531 container init 36b99b71560e414b7964e3e41c92f88cfe9e5709c22853e27e6e5ed7d83367cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-28T19:29:23.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:23 smithi059 ceph-mon[22052]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:24.043 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:29:23 smithi122 podman[53796]: 2024-08-28 19:29:23.694986769 +0000 UTC m=+0.397030268 container start 36b99b71560e414b7964e3e41c92f88cfe9e5709c22853e27e6e5ed7d83367cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-08-28T19:29:24.044 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:29:23 smithi122 ceph-mds[53815]: -- 172.21.15.122:0/197088673 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5644945ff860 con 0x5644987a5180 2024-08-28T19:29:24.044 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:29:23 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c[53811]: starting mds.c at 2024-08-28T19:29:24.044 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:29:23 smithi122 bash[53796]: 36b99b71560e414b7964e3e41c92f88cfe9e5709c22853e27e6e5ed7d83367cc 2024-08-28T19:29:24.044 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:29:23 smithi122 systemd[1]: Started Ceph mds.c for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:29:24.607 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:24 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1702893468' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:24.607 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:24 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:24.607 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:24 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:24.607 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:24 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:24.607 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:24 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:24.607 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:24 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:24.607 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:24 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:24.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:24 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1702893468' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:24.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:24 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:24.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:24 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:24.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:24 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:24.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:24 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:24.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:24 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:24.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:24 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:24 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1702893468' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:24.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:24 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:24.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:24 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:24.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:24 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:24.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:24 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:24.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:24 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:24.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:24 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:25 smithi033 ceph-mon[18549]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:25 smithi033 ceph-mon[18549]: Deploying daemon mds.h on smithi059 2024-08-28T19:29:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:25 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] up:boot 2024-08-28T19:29:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:25 smithi033 ceph-mon[18549]: fsmap 7 up:standby 2024-08-28T19:29:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:25 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T19:29:25.772 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:25 smithi059 ceph-mon[22052]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:25.772 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:25 smithi059 ceph-mon[22052]: Deploying daemon mds.h on smithi059 2024-08-28T19:29:25.772 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:25 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] up:boot 2024-08-28T19:29:25.772 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:25 smithi059 ceph-mon[22052]: fsmap 7 up:standby 2024-08-28T19:29:25.772 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:25 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T19:29:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:25 smithi122 ceph-mon[22174]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:25 smithi122 ceph-mon[22174]: Deploying daemon mds.h on smithi059 2024-08-28T19:29:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:25 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] up:boot 2024-08-28T19:29:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:25 smithi122 ceph-mon[22174]: fsmap 7 up:standby 2024-08-28T19:29:25.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:25 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T19:29:26.033 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:29:25 smithi059 systemd[1]: Starting Ceph mds.h for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:29:26.224 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:29:26.425 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:29:26 smithi059 podman[52827]: 2024-08-28 19:29:26.073407506 +0000 UTC m=+0.015616778 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:29:26.425 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:29:26 smithi059 podman[52827]: 2024-08-28 19:29:26.18000738 +0000 UTC m=+0.122216642 container create 9175ca488cbea004a65c58083a22bb6a190861240e84458cb32c5152d5d0d51a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:29:26.425 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:29:26 smithi059 podman[52827]: 2024-08-28 19:29:26.424606698 +0000 UTC m=+0.366815967 container init 9175ca488cbea004a65c58083a22bb6a190861240e84458cb32c5152d5d0d51a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-28T19:29:26.492 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:26.783 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:29:26 smithi059 podman[52827]: 2024-08-28 19:29:26.427621361 +0000 UTC m=+0.369830624 container start 9175ca488cbea004a65c58083a22bb6a190861240e84458cb32c5152d5d0d51a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-28T19:29:26.783 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:29:26 smithi059 ceph-mds[52847]: -- 172.21.15.59:0/3321451168 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4ec24b860 con 0x55e4f03f1a80 2024-08-28T19:29:26.783 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:29:26 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h[52843]: starting mds.h at 2024-08-28T19:29:26.783 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:29:26 smithi059 bash[52827]: 9175ca488cbea004a65c58083a22bb6a190861240e84458cb32c5152d5d0d51a 2024-08-28T19:29:26.783 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:29:26 smithi059 systemd[1]: Started Ceph mds.h for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:29:27.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.020+0000 7f39db1df640 1 -- 172.21.15.33:0/2988623799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39d4102d70 msgr2=0x7f39d410fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:27.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.020+0000 7f39db1df640 1 --2- 172.21.15.33:0/2988623799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39d4102d70 0x7f39d410fa90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009900 tx=0x7f39c002a480 comp rx=0 tx=0).stop 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.021+0000 7f39db1df640 1 -- 172.21.15.33:0/2988623799 shutdown_connections 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.021+0000 7f39db1df640 1 --2- 172.21.15.33:0/2988623799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d410ffd0 0x7f39d41123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.021+0000 7f39db1df640 1 --2- 172.21.15.33:0/2988623799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39d4102d70 0x7f39d410fa90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.021+0000 7f39db1df640 1 --2- 172.21.15.33:0/2988623799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39d4102420 0x7f39d4102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.021+0000 7f39db1df640 1 -- 172.21.15.33:0/2988623799 >> 172.21.15.33:0/2988623799 conn(0x7f39d4079470 msgr2=0x7f39d4079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.021+0000 7f39db1df640 1 -- 172.21.15.33:0/2988623799 shutdown_connections 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.021+0000 7f39db1df640 1 -- 172.21.15.33:0/2988623799 wait complete. 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.021+0000 7f39db1df640 1 Processor -- start 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.021+0000 7f39db1df640 1 -- start start 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39db1df640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39d4102420 0x7f39d419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:27.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39db1df640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d4102d70 0x7f39d419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39db1df640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39d410ffd0 0x7f39d41a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39db1df640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f39d4115ac0 con 0x7f39d410ffd0 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39db1df640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39d4115940 con 0x7f39d4102d70 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39db1df640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f39d4115c40 con 0x7f39d4102420 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d977c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39d410ffd0 0x7f39d41a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d977c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39d410ffd0 0x7f39d41a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50016/0 (socket says 172.21.15.33:50016) 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d977c640 1 -- 172.21.15.33:0/2783832996 learned_addr learned my addr 172.21.15.33:0/2783832996 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d3fff640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d4102d70 0x7f39d419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d8f7b640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39d4102420 0x7f39d419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d977c640 1 -- 172.21.15.33:0/2783832996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39d4102420 msgr2=0x7f39d419c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:27.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d977c640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39d4102420 0x7f39d419c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d977c640 1 -- 172.21.15.33:0/2783832996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d4102d70 msgr2=0x7f39d419cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d977c640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d4102d70 0x7f39d419cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d977c640 1 -- 172.21.15.33:0/2783832996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d41a2480 con 0x7f39d410ffd0 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d977c640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39d410ffd0 0x7f39d41a1d50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00eaa0 tx=0x7f39cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d1ffb640 1 -- 172.21.15.33:0/2783832996 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00cdb0 con 0x7f39d410ffd0 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d1ffb640 1 -- 172.21.15.33:0/2783832996 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39cc005020 con 0x7f39d410ffd0 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39db1df640 1 -- 172.21.15.33:0/2783832996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d41a2770 con 0x7f39d410ffd0 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.022+0000 7f39d1ffb640 1 -- 172.21.15.33:0/2783832996 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc0116d0 con 0x7f39d410ffd0 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.023+0000 7f39db1df640 1 -- 172.21.15.33:0/2783832996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d41a8ed0 con 0x7f39d410ffd0 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.024+0000 7f39db1df640 1 -- 172.21.15.33:0/2783832996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d4102830 con 0x7f39d410ffd0 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.025+0000 7f39d1ffb640 1 -- 172.21.15.33:0/2783832996 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f39cc0051d0 con 0x7f39d410ffd0 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.026+0000 7f39d1ffb640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f39c40b4b80 0x7f39c40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:27.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.026+0000 7f39d8f7b640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f39c40b4b80 0x7f39c40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:27.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.026+0000 7f39d1ffb640 1 -- 172.21.15.33:0/2783832996 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f39cc0e5270 con 0x7f39d410ffd0 2024-08-28T19:29:27.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.026+0000 7f39d8f7b640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f39c40b4b80 0x7f39c40b7090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009bd0 tx=0x7f39c8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:27.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.029+0000 7f39d1ffb640 1 -- 172.21.15.33:0/2783832996 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f39cc016030 con 0x7f39d410ffd0 2024-08-28T19:29:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.251+0000 7f39db1df640 1 -- 172.21.15.33:0/2783832996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39d419d640 con 0x7f39d410ffd0 2024-08-28T19:29:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.252+0000 7f39d1ffb640 1 -- 172.21.15.33:0/2783832996 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7f39d419d640 con 0x7f39d410ffd0 2024-08-28T19:29:27.253 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:27.253 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"btime":"2024-08-28T19:29:24:369406+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-28T19:29:27.253 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-08-28T19:29:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 -- 172.21.15.33:0/2783832996 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f39c40b4b80 msgr2=0x7f39c40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f39c40b4b80 0x7f39c40b7090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009bd0 tx=0x7f39c8005f90 comp rx=0 tx=0).stop 2024-08-28T19:29:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 -- 172.21.15.33:0/2783832996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39d410ffd0 msgr2=0x7f39d41a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39d410ffd0 0x7f39d41a1d50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00eaa0 tx=0x7f39cc00ef60 comp rx=0 tx=0).stop 2024-08-28T19:29:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 -- 172.21.15.33:0/2783832996 shutdown_connections 2024-08-28T19:29:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39d410ffd0 0x7f39d41a1d50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d4102d70 0x7f39d419cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:27.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f39c40b4b80 0x7f39c40b7090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:27.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 --2- 172.21.15.33:0/2783832996 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f39d4102420 0x7f39d419c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:27.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 -- 172.21.15.33:0/2783832996 >> 172.21.15.33:0/2783832996 conn(0x7f39d4079470 msgr2=0x7f39d4109b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:27.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 -- 172.21.15.33:0/2783832996 shutdown_connections 2024-08-28T19:29:27.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:27.255+0000 7f39db1df640 1 -- 172.21.15.33:0/2783832996 wait complete. 2024-08-28T19:29:27.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:27 smithi033 ceph-mon[18549]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:27 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2783832996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:27 smithi059 ceph-mon[22052]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:27 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2783832996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:27 smithi122 ceph-mon[22174]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:27 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2783832996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:28 smithi059 ceph-mon[22052]: Deploying daemon mds.i on smithi122 2024-08-28T19:29:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:28 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] up:boot 2024-08-28T19:29:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:28 smithi059 ceph-mon[22052]: fsmap 8 up:standby 2024-08-28T19:29:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:28 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T19:29:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:28 smithi122 ceph-mon[22174]: Deploying daemon mds.i on smithi122 2024-08-28T19:29:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:28 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] up:boot 2024-08-28T19:29:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:28 smithi122 ceph-mon[22174]: fsmap 8 up:standby 2024-08-28T19:29:28.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:28 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T19:29:28.794 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:29:28 smithi122 systemd[1]: Starting Ceph mds.i for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:29:28.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:28 smithi033 ceph-mon[18549]: Deploying daemon mds.i on smithi122 2024-08-28T19:29:28.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:28 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] up:boot 2024-08-28T19:29:28.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:28 smithi033 ceph-mon[18549]: fsmap 8 up:standby 2024-08-28T19:29:28.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:28 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T19:29:29.091 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:29:28 smithi122 podman[54097]: 2024-08-28 19:29:28.719546166 +0000 UTC m=+0.015990821 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:29:29.091 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:29:28 smithi122 podman[54097]: 2024-08-28 19:29:28.837831315 +0000 UTC m=+0.134275970 container create 7a9af04faa1aa60ae64f58561c839d0543a18a4c8dda00f57937b82fd692e9f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-28T19:29:29.092 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:29:29 smithi122 podman[54097]: 2024-08-28 19:29:29.090897178 +0000 UTC m=+0.387341835 container init 7a9af04faa1aa60ae64f58561c839d0543a18a4c8dda00f57937b82fd692e9f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:29:29.406 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:29:29 smithi122 podman[54097]: 2024-08-28 19:29:29.093916703 +0000 UTC m=+0.390361362 container start 7a9af04faa1aa60ae64f58561c839d0543a18a4c8dda00f57937b82fd692e9f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:29:29.406 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:29:29 smithi122 ceph-mds[54116]: -- 172.21.15.122:0/3642526925 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bdeef3dc20 con 0x55bdf30e3180 2024-08-28T19:29:29.406 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:29:29 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i[54112]: starting mds.i at 2024-08-28T19:29:29.406 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:29:29 smithi122 bash[54097]: 7a9af04faa1aa60ae64f58561c839d0543a18a4c8dda00f57937b82fd692e9f0 2024-08-28T19:29:29.406 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:29:29 smithi122 systemd[1]: Started Ceph mds.i for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:29:29.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:29 smithi033 ceph-mon[18549]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:29.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:29.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:29.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:29.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:29.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:29.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:29 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:29 smithi059 ceph-mon[22052]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:29 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:29 smithi122 ceph-mon[22174]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:29.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:29 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:30.069 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:29:30.345 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:30.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:30 smithi033 ceph-mon[18549]: Deploying daemon mds.g on smithi033 2024-08-28T19:29:30.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:30 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] up:boot 2024-08-28T19:29:30.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:30 smithi033 ceph-mon[18549]: fsmap 9 up:standby 2024-08-28T19:29:30.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:30 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T19:29:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:30 smithi059 ceph-mon[22052]: Deploying daemon mds.g on smithi033 2024-08-28T19:29:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:30 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] up:boot 2024-08-28T19:29:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:30 smithi059 ceph-mon[22052]: fsmap 9 up:standby 2024-08-28T19:29:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:30 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T19:29:30.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:30 smithi122 ceph-mon[22174]: Deploying daemon mds.g on smithi033 2024-08-28T19:29:30.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:30 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] up:boot 2024-08-28T19:29:30.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:30 smithi122 ceph-mon[22174]: fsmap 9 up:standby 2024-08-28T19:29:30.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:30 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T19:29:31.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.318+0000 7f7989496640 1 -- 172.21.15.33:0/333626651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7984109ba0 msgr2=0x7f79841103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:31.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.318+0000 7f7989496640 1 --2- 172.21.15.33:0/333626651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7984109ba0 0x7f79841103d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f797c009ca0 tx=0x7f797c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:29:31.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.318+0000 7f7989496640 1 -- 172.21.15.33:0/333626651 shutdown_connections 2024-08-28T19:29:31.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.318+0000 7f7989496640 1 --2- 172.21.15.33:0/333626651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7984109ba0 0x7f79841103d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:31.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.318+0000 7f7989496640 1 --2- 172.21.15.33:0/333626651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7984109250 0x7f7984109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:31.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.318+0000 7f7989496640 1 --2- 172.21.15.33:0/333626651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7984103960 0x7f7984103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:31.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.318+0000 7f7989496640 1 -- 172.21.15.33:0/333626651 >> 172.21.15.33:0/333626651 conn(0x7f798407b6b0 msgr2=0x7f798407bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:31.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.318+0000 7f7989496640 1 -- 172.21.15.33:0/333626651 shutdown_connections 2024-08-28T19:29:31.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.318+0000 7f7989496640 1 -- 172.21.15.33:0/333626651 wait complete. 2024-08-28T19:29:31.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.319+0000 7f7989496640 1 Processor -- start 2024-08-28T19:29:31.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.319+0000 7f7989496640 1 -- start start 2024-08-28T19:29:31.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f7989496640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7984103960 0x7f798419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:31.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f7989496640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7984109250 0x7f798419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:31.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f7989496640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7984109ba0 0x7f798419fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:31.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f7989496640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f79841138c0 con 0x7f7984109ba0 2024-08-28T19:29:31.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f7989496640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7984113740 con 0x7f7984109250 2024-08-28T19:29:31.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f7989496640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7984113a40 con 0x7f7984103960 2024-08-28T19:29:31.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f79837fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7984109ba0 0x7f798419fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:31.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f79837fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7984109ba0 0x7f798419fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44498/0 (socket says 172.21.15.33:44498) 2024-08-28T19:29:31.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f79837fe640 1 -- 172.21.15.33:0/2837377819 learned_addr learned my addr 172.21.15.33:0/2837377819 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:31.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f7982ffd640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7984103960 0x7f798419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:31.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f79827fc640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7984109250 0x7f798419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:31.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f79837fe640 1 -- 172.21.15.33:0/2837377819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7984103960 msgr2=0x7f798419a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:31.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f79837fe640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7984103960 0x7f798419a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:31.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f79837fe640 1 -- 172.21.15.33:0/2837377819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7984109250 msgr2=0x7f798419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:31.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f79837fe640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7984109250 0x7f798419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f79837fe640 1 -- 172.21.15.33:0/2837377819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79841a0100 con 0x7f7984109ba0 2024-08-28T19:29:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.320+0000 7f79837fe640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7984109ba0 0x7f798419fa90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f797c005cc0 tx=0x7f797c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.321+0000 7f797bfff640 1 -- 172.21.15.33:0/2837377819 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c003cf0 con 0x7f7984109ba0 2024-08-28T19:29:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.321+0000 7f7989496640 1 -- 172.21.15.33:0/2837377819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79841a0390 con 0x7f7984109ba0 2024-08-28T19:29:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.321+0000 7f797bfff640 1 -- 172.21.15.33:0/2837377819 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f797c0044f0 con 0x7f7984109ba0 2024-08-28T19:29:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.321+0000 7f797bfff640 1 -- 172.21.15.33:0/2837377819 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c02fc30 con 0x7f7984109ba0 2024-08-28T19:29:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.321+0000 7f7989496640 1 -- 172.21.15.33:0/2837377819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79841a6c10 con 0x7f7984109ba0 2024-08-28T19:29:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.322+0000 7f7989496640 1 -- 172.21.15.33:0/2837377819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7984103d70 con 0x7f7984109ba0 2024-08-28T19:29:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.323+0000 7f797bfff640 1 -- 172.21.15.33:0/2837377819 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f797c004040 con 0x7f7984109ba0 2024-08-28T19:29:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.324+0000 7f797bfff640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79700b4bb0 0x7f79700b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.324+0000 7f7982ffd640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79700b4bb0 0x7f79700b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:31.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.324+0000 7f797bfff640 1 -- 172.21.15.33:0/2837377819 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f797c106270 con 0x7f7984109ba0 2024-08-28T19:29:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.325+0000 7f7982ffd640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79700b4bb0 0x7f79700b70c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f796c009990 tx=0x7f796c009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.329+0000 7f797bfff640 1 -- 172.21.15.33:0/2837377819 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f797c0cd770 con 0x7f7984109ba0 2024-08-28T19:29:31.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.568+0000 7f7989496640 1 -- 172.21.15.33:0/2837377819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f798410b9a0 con 0x7f7984109ba0 2024-08-28T19:29:31.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.568+0000 7f797bfff640 1 -- 172.21.15.33:0/2837377819 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8046 (secure 0 0 0) 0x7f797c0cd070 con 0x7f7984109ba0 2024-08-28T19:29:31.570 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:31.570 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":10,"btime":"2024-08-28T19:29:29:394211+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24658,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-28T19:29:31.570 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 10 2024-08-28T19:29:31.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 -- 172.21.15.33:0/2837377819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79700b4bb0 msgr2=0x7f79700b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79700b4bb0 0x7f79700b70c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f796c009990 tx=0x7f796c009110 comp rx=0 tx=0).stop 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 -- 172.21.15.33:0/2837377819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7984109ba0 msgr2=0x7f798419fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7984109ba0 0x7f798419fa90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f797c005cc0 tx=0x7f797c02f470 comp rx=0 tx=0).stop 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 -- 172.21.15.33:0/2837377819 shutdown_connections 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7984109ba0 0x7f798419fa90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7984109250 0x7f798419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79700b4bb0 0x7f79700b70c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 --2- 172.21.15.33:0/2837377819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7984103960 0x7f798419a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 -- 172.21.15.33:0/2837377819 >> 172.21.15.33:0/2837377819 conn(0x7f798407b6b0 msgr2=0x7f79841072a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 -- 172.21.15.33:0/2837377819 shutdown_connections 2024-08-28T19:29:31.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:31.571+0000 7f7989496640 1 -- 172.21.15.33:0/2837377819 wait complete. 2024-08-28T19:29:31.582 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:31 smithi033 ceph-mon[18549]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:31 smithi059 ceph-mon[22052]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:31 smithi122 ceph-mon[22174]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:32.380 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:29:32 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-g[64169]: starting mds.g at 2024-08-28T19:29:32.749 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:32 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2837377819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:32.750 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:29:32 smithi033 bash[64140]: 207c1d2d2c394be853155abb8020d9285e91211933fdd1dfdf7f6b44a5afea3f 2024-08-28T19:29:32.750 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:29:32 smithi033 systemd[1]: Started Ceph mds.g for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:29:32.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:32 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2837377819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:32.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:32 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2837377819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:33 smithi059 ceph-mon[22052]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:33 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.33:6838/854752752,v1:172.21.15.33:6839/854752752] up:boot 2024-08-28T19:29:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:33 smithi059 ceph-mon[22052]: fsmap 10 up:standby 2024-08-28T19:29:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T19:29:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:33.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:33.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:33.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:33.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:33 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:33 smithi122 ceph-mon[22174]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:33 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.33:6838/854752752,v1:172.21.15.33:6839/854752752] up:boot 2024-08-28T19:29:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:33 smithi122 ceph-mon[22174]: fsmap 10 up:standby 2024-08-28T19:29:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T19:29:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:33.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:33 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:33 smithi033 ceph-mon[18549]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:33 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.33:6838/854752752,v1:172.21.15.33:6839/854752752] up:boot 2024-08-28T19:29:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:33 smithi033 ceph-mon[18549]: fsmap 10 up:standby 2024-08-28T19:29:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T19:29:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:33.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:33.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:33.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:33.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:33 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:34.498 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:34 smithi033 ceph-mon[18549]: Deploying daemon mds.a on smithi033 2024-08-28T19:29:34.540 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:29:34.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:34 smithi059 ceph-mon[22052]: Deploying daemon mds.a on smithi033 2024-08-28T19:29:34.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:34 smithi122 ceph-mon[22174]: Deploying daemon mds.a on smithi033 2024-08-28T19:29:34.880 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:29:34 smithi033 systemd[1]: Starting Ceph mds.a for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:29:35.299 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:29:34 smithi033 podman[64477]: 2024-08-28 19:29:34.804797424 +0000 UTC m=+0.016399276 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:29:35.300 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:29:34 smithi033 podman[64477]: 2024-08-28 19:29:34.921785889 +0000 UTC m=+0.133387783 container create 326feb1f85e51a5be4b0057877123952f6e13691650387e73fdc6e9889844f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-28T19:29:35.300 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:29:35 smithi033 podman[64477]: 2024-08-28 19:29:35.29946196 +0000 UTC m=+0.511063812 container init 326feb1f85e51a5be4b0057877123952f6e13691650387e73fdc6e9889844f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-28T19:29:35.448 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:35.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:35 smithi033 ceph-mon[18549]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:35.570 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:29:35 smithi033 podman[64477]: 2024-08-28 19:29:35.302516866 +0000 UTC m=+0.514118717 container start 326feb1f85e51a5be4b0057877123952f6e13691650387e73fdc6e9889844f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:29:35.570 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:29:35 smithi033 ceph-mds[64521]: -- 172.21.15.33:0/3293883795 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5555ac7ff860 con 0x5555b09a5600 2024-08-28T19:29:35.571 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:29:35 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a[64517]: starting mds.a at 2024-08-28T19:29:35.571 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:29:35 smithi033 bash[64477]: 326feb1f85e51a5be4b0057877123952f6e13691650387e73fdc6e9889844f68 2024-08-28T19:29:35.571 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:29:35 smithi033 systemd[1]: Started Ceph mds.a for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:29:35.696 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:35 smithi059 ceph-mon[22052]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:35 smithi122 ceph-mon[22174]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.936+0000 7fc70f3d9640 1 -- 172.21.15.33:0/2054398853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc708101b90 msgr2=0x7fc708101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.936+0000 7fc70f3d9640 1 --2- 172.21.15.33:0/2054398853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc708101b90 0x7fc708101fa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009900 tx=0x7fc6f802a480 comp rx=0 tx=0).stop 2024-08-28T19:29:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.936+0000 7fc70f3d9640 1 -- 172.21.15.33:0/2054398853 shutdown_connections 2024-08-28T19:29:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.936+0000 7fc70f3d9640 1 --2- 172.21.15.33:0/2054398853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc7081026e0 0x7fc708112360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.936+0000 7fc70f3d9640 1 --2- 172.21.15.33:0/2054398853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc708101b90 0x7fc708101fa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.936+0000 7fc70f3d9640 1 --2- 172.21.15.33:0/2054398853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081044b0 0x7fc7081048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.936+0000 7fc70f3d9640 1 -- 172.21.15.33:0/2054398853 >> 172.21.15.33:0/2054398853 conn(0x7fc708079c60 msgr2=0x7fc70807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.936+0000 7fc70f3d9640 1 -- 172.21.15.33:0/2054398853 shutdown_connections 2024-08-28T19:29:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.936+0000 7fc70f3d9640 1 -- 172.21.15.33:0/2054398853 wait complete. 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70f3d9640 1 Processor -- start 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70f3d9640 1 -- start start 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70f3d9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc708101b90 0x7fc70819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70f3d9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7081026e0 0x7fc70819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70f3d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081044b0 0x7fc7081a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70f3d9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc708115b20 con 0x7fc7081026e0 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70f3d9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc7081159a0 con 0x7fc7081044b0 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70f3d9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc708115ca0 con 0x7fc708101b90 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70c974640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7081026e0 0x7fc70819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70c974640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7081026e0 0x7fc70819ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44564/0 (socket says 172.21.15.33:44564) 2024-08-28T19:29:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70c974640 1 -- 172.21.15.33:0/4137155523 learned_addr learned my addr 172.21.15.33:0/4137155523 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70d175640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc708101b90 0x7fc70819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70d976640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081044b0 0x7fc7081a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70c974640 1 -- 172.21.15.33:0/4137155523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc708101b90 msgr2=0x7fc70819c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70c974640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc708101b90 0x7fc70819c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70c974640 1 -- 172.21.15.33:0/4137155523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081044b0 msgr2=0x7fc7081a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70c974640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081044b0 0x7fc7081a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.937+0000 7fc70c974640 1 -- 172.21.15.33:0/4137155523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7081a2440 con 0x7fc7081026e0 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.938+0000 7fc70c974640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7081026e0 0x7fc70819ca70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8005ab0 tx=0x7fc6f8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.938+0000 7fc6fe7fc640 1 -- 172.21.15.33:0/4137155523 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f803f070 con 0x7fc7081026e0 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.938+0000 7fc70f3d9640 1 -- 172.21.15.33:0/4137155523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7081a26d0 con 0x7fc7081026e0 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.938+0000 7fc6fe7fc640 1 -- 172.21.15.33:0/4137155523 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6f8031d60 con 0x7fc7081026e0 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.938+0000 7fc6fe7fc640 1 -- 172.21.15.33:0/4137155523 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8035030 con 0x7fc7081026e0 2024-08-28T19:29:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.938+0000 7fc70f3d9640 1 -- 172.21.15.33:0/4137155523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7081a8e90 con 0x7fc7081026e0 2024-08-28T19:29:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.939+0000 7fc70f3d9640 1 -- 172.21.15.33:0/4137155523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc708102ba0 con 0x7fc7081026e0 2024-08-28T19:29:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.941+0000 7fc6fe7fc640 1 -- 172.21.15.33:0/4137155523 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fc6f8042070 con 0x7fc7081026e0 2024-08-28T19:29:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.941+0000 7fc6fe7fc640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6f40b4b80 0x7fc6f40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.942+0000 7fc70d175640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6f40b4b80 0x7fc6f40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.942+0000 7fc6fe7fc640 1 -- 172.21.15.33:0/4137155523 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fc6f8105bd0 con 0x7fc7081026e0 2024-08-28T19:29:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.942+0000 7fc70d175640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6f40b4b80 0x7fc6f40b7090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc704005d00 tx=0x7fc70400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:35.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:35.945+0000 7fc6fe7fc640 1 -- 172.21.15.33:0/4137155523 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc6f80cca80 con 0x7fc7081026e0 2024-08-28T19:29:36.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.166+0000 7fc70f3d9640 1 -- 172.21.15.33:0/4137155523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7081a9060 con 0x7fc7081026e0 2024-08-28T19:29:36.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.167+0000 7fc6fe7fc640 1 -- 172.21.15.33:0/4137155523 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9695 (secure 0 0 0) 0x7fc6f80d1240 con 0x7fc7081026e0 2024-08-28T19:29:36.169 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:36.169 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":12,"btime":"2024-08-28T19:29:35:428628+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14799,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14805,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24658,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-28T19:29:36.169 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 12 2024-08-28T19:29:36.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 -- 172.21.15.33:0/4137155523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6f40b4b80 msgr2=0x7fc6f40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:36.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6f40b4b80 0x7fc6f40b7090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc704005d00 tx=0x7fc70400b410 comp rx=0 tx=0).stop 2024-08-28T19:29:36.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 -- 172.21.15.33:0/4137155523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7081026e0 msgr2=0x7fc70819ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:36.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7081026e0 0x7fc70819ca70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8005ab0 tx=0x7fc6f8003cd0 comp rx=0 tx=0).stop 2024-08-28T19:29:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 -- 172.21.15.33:0/4137155523 shutdown_connections 2024-08-28T19:29:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081044b0 0x7fc7081a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7081026e0 0x7fc70819ca70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6f40b4b80 0x7fc6f40b7090 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 --2- 172.21.15.33:0/4137155523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc708101b90 0x7fc70819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 -- 172.21.15.33:0/4137155523 >> 172.21.15.33:0/4137155523 conn(0x7fc708079c60 msgr2=0x7fc708100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 -- 172.21.15.33:0/4137155523 shutdown_connections 2024-08-28T19:29:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:36.169+0000 7fc70f3d9640 1 -- 172.21.15.33:0/4137155523 wait complete. 2024-08-28T19:29:36.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.33:6840/4138539893,v1:172.21.15.33:6841/4138539893] up:boot 2024-08-28T19:29:36.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: fsmap 11 up:standby 2024-08-28T19:29:36.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-28T19:29:36.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:36.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:36.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:36.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:36.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:36.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:36.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: Deploying daemon mds.b on smithi059 2024-08-28T19:29:36.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:36 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4137155523' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:36.750 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.33:6840/4138539893,v1:172.21.15.33:6841/4138539893] up:boot 2024-08-28T19:29:36.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: fsmap 11 up:standby 2024-08-28T19:29:36.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-28T19:29:36.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:36.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:36.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:36.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:36.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:36.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:36.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: Deploying daemon mds.b on smithi059 2024-08-28T19:29:36.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:36 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4137155523' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:36.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.33:6840/4138539893,v1:172.21.15.33:6841/4138539893] up:boot 2024-08-28T19:29:36.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: fsmap 11 up:standby 2024-08-28T19:29:36.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-28T19:29:36.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:36.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:36.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:36.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-28T19:29:36.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-28T19:29:36.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:36.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: Deploying daemon mds.b on smithi059 2024-08-28T19:29:36.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:36 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4137155523' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:37.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:37 smithi059 ceph-mon[22052]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:37.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:37 smithi122 ceph-mon[22174]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:37.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:37 smithi033 ceph-mon[18549]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:37.934 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:29:37 smithi059 systemd[1]: Starting Ceph mds.b for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:29:38.209 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:29:37 smithi059 podman[53140]: 2024-08-28 19:29:37.835979459 +0000 UTC m=+0.016149348 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:29:38.209 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:29:37 smithi059 podman[53140]: 2024-08-28 19:29:37.96141472 +0000 UTC m=+0.141584595 container create 74546f5e36ea93393af37225163ee35592f29b9795d468acc15fb74d242142ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:29:38.209 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:29:38 smithi059 podman[53140]: 2024-08-28 19:29:38.172477248 +0000 UTC m=+0.352647142 container init 74546f5e36ea93393af37225163ee35592f29b9795d468acc15fb74d242142ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-28T19:29:38.209 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:29:38 smithi059 podman[53140]: 2024-08-28 19:29:38.175218574 +0000 UTC m=+0.355388451 container start 74546f5e36ea93393af37225163ee35592f29b9795d468acc15fb74d242142ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-08-28T19:29:38.533 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:29:38 smithi059 ceph-mds[53159]: -- 172.21.15.59:0/2053524059 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563eb9249860 con 0x563ebd3ef180 2024-08-28T19:29:38.533 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:29:38 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b[53155]: starting mds.b at 2024-08-28T19:29:38.533 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:29:38 smithi059 bash[53140]: 74546f5e36ea93393af37225163ee35592f29b9795d468acc15fb74d242142ac 2024-08-28T19:29:38.533 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:29:38 smithi059 systemd[1]: Started Ceph mds.b for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:29:39.096 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:29:39.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:39 smithi059 ceph-mon[22052]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:39.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:29:39.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:39 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] up:boot 2024-08-28T19:29:39.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:39 smithi059 ceph-mon[22052]: fsmap 12 up:standby 2024-08-28T19:29:39.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:39 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T19:29:39.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:39 smithi122 ceph-mon[22174]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:39.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:29:39.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:39 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] up:boot 2024-08-28T19:29:39.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:39 smithi122 ceph-mon[22174]: fsmap 12 up:standby 2024-08-28T19:29:39.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:39 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T19:29:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:39 smithi033 ceph-mon[18549]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:29:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:39 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] up:boot 2024-08-28T19:29:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:39 smithi033 ceph-mon[18549]: fsmap 12 up:standby 2024-08-28T19:29:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:39 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T19:29:39.705 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:40.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.194+0000 7f193b0c8640 1 -- 172.21.15.33:0/884806228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1934103930 msgr2=0x7f1934103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:40.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.194+0000 7f193b0c8640 1 --2- 172.21.15.33:0/884806228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1934103930 0x7f1934103d40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1930009900 tx=0x7f193002a410 comp rx=0 tx=0).stop 2024-08-28T19:29:40.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.194+0000 7f193b0c8640 1 -- 172.21.15.33:0/884806228 shutdown_connections 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.194+0000 7f193b0c8640 1 --2- 172.21.15.33:0/884806228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1934109bc0 0x7f19341103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.194+0000 7f193b0c8640 1 --2- 172.21.15.33:0/884806228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1934109270 0x7f1934109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.194+0000 7f193b0c8640 1 --2- 172.21.15.33:0/884806228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1934103930 0x7f1934103d40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.194+0000 7f193b0c8640 1 -- 172.21.15.33:0/884806228 >> 172.21.15.33:0/884806228 conn(0x7f19340ff3a0 msgr2=0x7f19341017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.194+0000 7f193b0c8640 1 -- 172.21.15.33:0/884806228 shutdown_connections 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.194+0000 7f193b0c8640 1 -- 172.21.15.33:0/884806228 wait complete. 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f193b0c8640 1 Processor -- start 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f193b0c8640 1 -- start start 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f193b0c8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1934103930 0x7f193419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f193b0c8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1934109270 0x7f193419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f193b0c8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1934109bc0 0x7f193419fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f193b0c8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1934113880 con 0x7f1934109270 2024-08-28T19:29:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f193b0c8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1934113700 con 0x7f1934103930 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f193b0c8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1934113a00 con 0x7f1934109bc0 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f192bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1934109270 0x7f193419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f192bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1934109270 0x7f193419a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37756/0 (socket says 172.21.15.33:37756) 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f192bfff640 1 -- 172.21.15.33:0/3648305805 learned_addr learned my addr 172.21.15.33:0/3648305805 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f1938e64640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1934103930 0x7f193419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.195+0000 7f1939665640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1934109bc0 0x7f193419fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f192bfff640 1 -- 172.21.15.33:0/3648305805 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1934109bc0 msgr2=0x7f193419fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f192bfff640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1934109bc0 0x7f193419fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f192bfff640 1 -- 172.21.15.33:0/3648305805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1934103930 msgr2=0x7f193419a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f192bfff640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1934103930 0x7f193419a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f192bfff640 1 -- 172.21.15.33:0/3648305805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19341a01c0 con 0x7f1934109270 2024-08-28T19:29:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f192bfff640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1934109270 0x7f193419a7f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f192400d950 tx=0x7f192400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f1929ffb640 1 -- 172.21.15.33:0/3648305805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924017070 con 0x7f1934109270 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f193b0c8640 1 -- 172.21.15.33:0/3648305805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19341a04b0 con 0x7f1934109270 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f1929ffb640 1 -- 172.21.15.33:0/3648305805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1924009c30 con 0x7f1934109270 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f1929ffb640 1 -- 172.21.15.33:0/3648305805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19240047a0 con 0x7f1934109270 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.196+0000 7f193b0c8640 1 -- 172.21.15.33:0/3648305805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19341a6c10 con 0x7f1934109270 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.197+0000 7f193b0c8640 1 -- 172.21.15.33:0/3648305805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1934103d40 con 0x7f1934109270 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.199+0000 7f1929ffb640 1 -- 172.21.15.33:0/3648305805 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f1924004020 con 0x7f1934109270 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.199+0000 7f1929ffb640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f191c0b4b80 0x7f191c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.199+0000 7f1938e64640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f191c0b4b80 0x7f191c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.200+0000 7f1929ffb640 1 -- 172.21.15.33:0/3648305805 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f19240e4e50 con 0x7f1934109270 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.200+0000 7f1938e64640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f191c0b4b80 0x7f191c0b7090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1930031440 tx=0x7f1930009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.203+0000 7f1929ffb640 1 -- 172.21.15.33:0/3648305805 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1924020020 con 0x7f1934109270 2024-08-28T19:29:40.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.460+0000 7f193b0c8640 1 -- 172.21.15.33:0/3648305805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f193419b380 con 0x7f1934109270 2024-08-28T19:29:40.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.461+0000 7f1929ffb640 1 -- 172.21.15.33:0/3648305805 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10521 (secure 0 0 0) 0x7f19240ac350 con 0x7f1934109270 2024-08-28T19:29:40.462 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:40.462 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":13,"btime":"2024-08-28T19:29:38:488842+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14799,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14805,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24658,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-28T19:29:40.462 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2024-08-28T19:29:40.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 -- 172.21.15.33:0/3648305805 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f191c0b4b80 msgr2=0x7f191c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:40.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f191c0b4b80 0x7f191c0b7090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1930031440 tx=0x7f1930009560 comp rx=0 tx=0).stop 2024-08-28T19:29:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 -- 172.21.15.33:0/3648305805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1934109270 msgr2=0x7f193419a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1934109270 0x7f193419a7f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f192400d950 tx=0x7f192400de10 comp rx=0 tx=0).stop 2024-08-28T19:29:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 -- 172.21.15.33:0/3648305805 shutdown_connections 2024-08-28T19:29:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f191c0b4b80 0x7f191c0b7090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1934109bc0 0x7f193419fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1934109270 0x7f193419a7f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 --2- 172.21.15.33:0/3648305805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1934103930 0x7f193419a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 -- 172.21.15.33:0/3648305805 >> 172.21.15.33:0/3648305805 conn(0x7f19340ff3a0 msgr2=0x7f19341017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 -- 172.21.15.33:0/3648305805 shutdown_connections 2024-08-28T19:29:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:40.463+0000 7f193b0c8640 1 -- 172.21.15.33:0/3648305805 wait complete. 2024-08-28T19:29:41.091 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:40 smithi033 ceph-mon[18549]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:41.091 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.091 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.091 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.091 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.091 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:40 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3648305805' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:41.091 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.091 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:40 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.119 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-28T19:29:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:40 smithi059 ceph-mon[22052]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:40 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3648305805' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.284 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:40 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:40 smithi122 ceph-mon[22174]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:41.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:40 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3648305805' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:29:41.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:40 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:41.380 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:42.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.009+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/2524204706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b081023f0 msgr2=0x7f1b08102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:42.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.009+0000 7f1b0dc6a640 1 --2- 172.21.15.33:0/2524204706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b081023f0 0x7f1b08102800 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009900 tx=0x7f1af002a480 comp rx=0 tx=0).stop 2024-08-28T19:29:42.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.010+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/2524204706 shutdown_connections 2024-08-28T19:29:42.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.010+0000 7f1b0dc6a640 1 --2- 172.21.15.33:0/2524204706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b0810ffa0 0x7f1b081123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.010+0000 7f1b0dc6a640 1 --2- 172.21.15.33:0/2524204706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08102d40 0x7f1b0810fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.010+0000 7f1b0dc6a640 1 --2- 172.21.15.33:0/2524204706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b081023f0 0x7f1b08102800 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.010+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/2524204706 >> 172.21.15.33:0/2524204706 conn(0x7f1b08079510 msgr2=0x7f1b08079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.010+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/2524204706 shutdown_connections 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.010+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/2524204706 wait complete. 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b0dc6a640 1 Processor -- start 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b0dc6a640 1 -- start start 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b0dc6a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b081023f0 0x7f1b0819c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b0dc6a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08102d40 0x7f1b0819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b0dc6a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b0810ffa0 0x7f1b081a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b0dc6a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1b08115a90 con 0x7f1b081023f0 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b0dc6a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b08115910 con 0x7f1b08102d40 2024-08-28T19:29:42.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b0dc6a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1b08115c10 con 0x7f1b0810ffa0 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b077fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b081023f0 0x7f1b0819c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b077fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b081023f0 0x7f1b0819c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37764/0 (socket says 172.21.15.33:37764) 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.011+0000 7f1b077fe640 1 -- 172.21.15.33:0/4024624601 learned_addr learned my addr 172.21.15.33:0/4024624601 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b06ffd640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08102d40 0x7f1b0819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b07fff640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b0810ffa0 0x7f1b081a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b077fe640 1 -- 172.21.15.33:0/4024624601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b0810ffa0 msgr2=0x7f1b081a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b077fe640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b0810ffa0 0x7f1b081a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b077fe640 1 -- 172.21.15.33:0/4024624601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08102d40 msgr2=0x7f1b0819ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b077fe640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08102d40 0x7f1b0819ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b077fe640 1 -- 172.21.15.33:0/4024624601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b081a2310 con 0x7f1b081023f0 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b07fff640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b0810ffa0 0x7f1b081a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:29:42.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b077fe640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b081023f0 0x7f1b0819c460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1af0006010 tx=0x7f1af00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b04ff9640 1 -- 172.21.15.33:0/4024624601 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af003f030 con 0x7f1b081023f0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/4024624601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b081a25a0 con 0x7f1b081023f0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b04ff9640 1 -- 172.21.15.33:0/4024624601 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1af0003800 con 0x7f1b081023f0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b04ff9640 1 -- 172.21.15.33:0/4024624601 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0035070 con 0x7f1b081023f0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.012+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/4024624601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b081a2ad0 con 0x7f1b081023f0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.013+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/4024624601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0806c000 con 0x7f1b081023f0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.015+0000 7f1b04ff9640 1 -- 172.21.15.33:0/4024624601 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f1af0003cb0 con 0x7f1b081023f0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.016+0000 7f1b04ff9640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1af40b4bb0 0x7f1af40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.016+0000 7f1b06ffd640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1af40b4bb0 0x7f1af40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.016+0000 7f1b04ff9640 1 -- 172.21.15.33:0/4024624601 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f1af0105a30 con 0x7f1b081023f0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.016+0000 7f1b06ffd640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1af40b4bb0 0x7f1af40b70c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1b08110a10 tx=0x7f1af800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:42.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.019+0000 7f1b04ff9640 1 -- 172.21.15.33:0/4024624601 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1b081a2ad0 con 0x7f1b081023f0 2024-08-28T19:29:42.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.218+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/4024624601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1b08102800 con 0x7f1b081023f0 2024-08-28T19:29:42.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.218+0000 7f1b04ff9640 1 -- 172.21.15.33:0/4024624601 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7f1af00cce90 con 0x7f1b081023f0 2024-08-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-08-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-08-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-08-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/4024624601 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1af40b4bb0 msgr2=0x7f1af40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1af40b4bb0 0x7f1af40b70c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1b08110a10 tx=0x7f1af800a2d0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/4024624601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b081023f0 msgr2=0x7f1b0819c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b081023f0 0x7f1b0819c460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1af0006010 tx=0x7f1af00042f0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/4024624601 shutdown_connections 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1af40b4bb0 0x7f1af40b70c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b0810ffa0 0x7f1b081a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b08102d40 0x7f1b0819ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 --2- 172.21.15.33:0/4024624601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b081023f0 0x7f1b0819c460 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/4024624601 >> 172.21.15.33:0/4024624601 conn(0x7f1b08079510 msgr2=0x7f1b08109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/4024624601 shutdown_connections 2024-08-28T19:29:42.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:42.221+0000 7f1b0dc6a640 1 -- 172.21.15.33:0/4024624601 wait complete. 2024-08-28T19:29:42.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:42 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:42.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:42 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:42.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:42 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:29:42.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:42 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:42.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:42 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:29:42.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:42 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:42.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:42 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:42.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:42 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:29:42.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:42 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:42.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:42 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:29:42.373 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:42 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:42.373 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:42 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:42.374 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:42 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:29:42.374 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:42 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:42.374 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:42 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:29:43.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:43 smithi033 ceph-mon[18549]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:43.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:43 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4024624601' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-28T19:29:43.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:43 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:43 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:43 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:43 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.525 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-28T19:29:43.525 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-28T19:29:43.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:43 smithi059 ceph-mon[22052]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:43.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:43 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4024624601' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-28T19:29:43.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:43 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:43 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:43 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:43 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:43 smithi122 ceph-mon[22174]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:43.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:43 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4024624601' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-28T19:29:43.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:43 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:43 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:43 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:43 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:43.800 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:44.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3344857466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d681023a0 msgr2=0x7f0d681027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 --2- 172.21.15.33:0/3344857466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d681023a0 0x7f0d681027b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009900 tx=0x7f0d6402a480 comp rx=0 tx=0).stop 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3344857466 shutdown_connections 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 --2- 172.21.15.33:0/3344857466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d6810ff50 0x7f0d68112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 --2- 172.21.15.33:0/3344857466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68102cf0 0x7f0d6810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 --2- 172.21.15.33:0/3344857466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d681023a0 0x7f0d681027b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3344857466 >> 172.21.15.33:0/3344857466 conn(0x7f0d680794c0 msgr2=0x7f0d680798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3344857466 shutdown_connections 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3344857466 wait complete. 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 Processor -- start 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.353+0000 7f0d6fba9640 1 -- start start 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6fba9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d681023a0 0x7f0d6819c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6fba9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68102cf0 0x7f0d6819c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6fba9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d6810ff50 0x7f0d681a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6fba9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0d68115a40 con 0x7f0d6810ff50 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6fba9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681158c0 con 0x7f0d681023a0 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6fba9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0d68115bc0 con 0x7f0d68102cf0 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6e146640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d6810ff50 0x7f0d681a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6e146640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d6810ff50 0x7f0d681a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37786/0 (socket says 172.21.15.33:37786) 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6e146640 1 -- 172.21.15.33:0/3115604201 learned_addr learned my addr 172.21.15.33:0/3115604201 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6d945640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d681023a0 0x7f0d6819c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6d144640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68102cf0 0x7f0d6819c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6e146640 1 -- 172.21.15.33:0/3115604201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68102cf0 msgr2=0x7f0d6819c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:44.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6e146640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68102cf0 0x7f0d6819c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6e146640 1 -- 172.21.15.33:0/3115604201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d681023a0 msgr2=0x7f0d6819c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6e146640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d681023a0 0x7f0d6819c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6e146640 1 -- 172.21.15.33:0/3115604201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d681a2300 con 0x7f0d6810ff50 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.354+0000 7f0d6e146640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d6810ff50 0x7f0d681a1c90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000cce0 tx=0x7f0d6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.355+0000 7f0d5effd640 1 -- 172.21.15.33:0/3115604201 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000f450 con 0x7f0d6810ff50 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.355+0000 7f0d5effd640 1 -- 172.21.15.33:0/3115604201 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d6000faa0 con 0x7f0d6810ff50 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.355+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3115604201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d681a25f0 con 0x7f0d6810ff50 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.355+0000 7f0d5effd640 1 -- 172.21.15.33:0/3115604201 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60018b70 con 0x7f0d6810ff50 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.355+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3115604201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d681a8e10 con 0x7f0d6810ff50 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.356+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3115604201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d6806bfe0 con 0x7f0d6810ff50 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.357+0000 7f0d5effd640 1 -- 172.21.15.33:0/3115604201 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f0d60018d10 con 0x7f0d6810ff50 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.358+0000 7f0d5effd640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d540b4bb0 0x7f0d540b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.358+0000 7f0d6d945640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d540b4bb0 0x7f0d540b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:44.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.358+0000 7f0d5effd640 1 -- 172.21.15.33:0/3115604201 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f0d600e52c0 con 0x7f0d6810ff50 2024-08-28T19:29:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.359+0000 7f0d6d945640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d540b4bb0 0x7f0d540b70c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d64031440 tx=0x7f0d64009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.361+0000 7f0d5effd640 1 -- 172.21.15.33:0/3115604201 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0d60014030 con 0x7f0d6810ff50 2024-08-28T19:29:44.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:44.548+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3115604201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0d6819d580 con 0x7f0d6810ff50 2024-08-28T19:29:45.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.074+0000 7f0d5effd640 1 -- 172.21.15.33:0/3115604201 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7f0d600ac7b0 con 0x7f0d6810ff50 2024-08-28T19:29:45.076 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.076+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3115604201 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d540b4bb0 msgr2=0x7f0d540b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.076+0000 7f0d6fba9640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d540b4bb0 0x7f0d540b70c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d64031440 tx=0x7f0d64009560 comp rx=0 tx=0).stop 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.076+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3115604201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d6810ff50 msgr2=0x7f0d681a1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.076+0000 7f0d6fba9640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d6810ff50 0x7f0d681a1c90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000cce0 tx=0x7f0d6000a620 comp rx=0 tx=0).stop 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.076+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3115604201 shutdown_connections 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.076+0000 7f0d6fba9640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d6810ff50 0x7f0d681a1c90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.076+0000 7f0d6fba9640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d540b4bb0 0x7f0d540b70c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.076+0000 7f0d6fba9640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68102cf0 0x7f0d6819c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.076+0000 7f0d6fba9640 1 --2- 172.21.15.33:0/3115604201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d681023a0 0x7f0d6819c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.076+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3115604201 >> 172.21.15.33:0/3115604201 conn(0x7f0d680794c0 msgr2=0x7f0d681089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.077+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3115604201 shutdown_connections 2024-08-28T19:29:45.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:45.077+0000 7f0d6fba9640 1 -- 172.21.15.33:0/3115604201 wait complete. 2024-08-28T19:29:45.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:44 smithi033 ceph-mon[18549]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:45.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:45.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:45.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:45.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:29:45.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:45.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:44 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3115604201' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-28T19:29:45.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:44 smithi059 ceph-mon[22052]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:45.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:45.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:45.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:45.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:29:45.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:45.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:44 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3115604201' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-28T19:29:45.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:44 smithi122 ceph-mon[22174]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:45.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:45.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:45.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:29:45.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:29:45.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:29:45.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:44 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3115604201' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-28T19:29:45.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-28T19:29:46.059 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:46.337 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:46 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3115604201' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-28T19:29:46.337 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:46 smithi033 ceph-mon[18549]: osdmap e70: 12 total, 12 up, 12 in 2024-08-28T19:29:46.417 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:46 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3115604201' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-28T19:29:46.418 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:46 smithi059 ceph-mon[22052]: osdmap e70: 12 total, 12 up, 12 in 2024-08-28T19:29:46.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:46 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3115604201' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-28T19:29:46.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:46 smithi122 ceph-mon[22174]: osdmap e70: 12 total, 12 up, 12 in 2024-08-28T19:29:46.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.589+0000 7fda78d69640 1 -- 172.21.15.33:0/1780683883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda74108ab0 msgr2=0x7fda7410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:46.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.589+0000 7fda78d69640 1 --2- 172.21.15.33:0/1780683883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda74108ab0 0x7fda7410f2e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009ca0 tx=0x7fda6c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:29:46.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.590+0000 7fda78d69640 1 -- 172.21.15.33:0/1780683883 shutdown_connections 2024-08-28T19:29:46.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.590+0000 7fda78d69640 1 --2- 172.21.15.33:0/1780683883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda74108ab0 0x7fda7410f2e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.590+0000 7fda78d69640 1 --2- 172.21.15.33:0/1780683883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda74108160 0x7fda74108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.590+0000 7fda78d69640 1 --2- 172.21.15.33:0/1780683883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda74102820 0x7fda74102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.590+0000 7fda78d69640 1 -- 172.21.15.33:0/1780683883 >> 172.21.15.33:0/1780683883 conn(0x7fda740794e0 msgr2=0x7fda740798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.590+0000 7fda78d69640 1 -- 172.21.15.33:0/1780683883 shutdown_connections 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.590+0000 7fda78d69640 1 -- 172.21.15.33:0/1780683883 wait complete. 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.591+0000 7fda78d69640 1 Processor -- start 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.591+0000 7fda78d69640 1 -- start start 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.591+0000 7fda78d69640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda74102820 0x7fda74113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.591+0000 7fda78d69640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda74108160 0x7fda74113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.591+0000 7fda78d69640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda74108ab0 0x7fda74113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.591+0000 7fda78d69640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fda74112790 con 0x7fda74102820 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.591+0000 7fda78d69640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda74112610 con 0x7fda74108160 2024-08-28T19:29:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.591+0000 7fda78d69640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fda74112910 con 0x7fda74108ab0 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.591+0000 7fda7259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda74102820 0x7fda74113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda7259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda74102820 0x7fda74113000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37796/0 (socket says 172.21.15.33:37796) 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda7259c640 1 -- 172.21.15.33:0/1833265861 learned_addr learned my addr 172.21.15.33:0/1833265861 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda72d9d640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda74108ab0 0x7fda74113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda69d9b640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda74108160 0x7fda74113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda7259c640 1 -- 172.21.15.33:0/1833265861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda74108ab0 msgr2=0x7fda74113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda7259c640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda74108ab0 0x7fda74113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda7259c640 1 -- 172.21.15.33:0/1833265861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda74108160 msgr2=0x7fda74113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda7259c640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda74108160 0x7fda74113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda7259c640 1 -- 172.21.15.33:0/1833265861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda741a8570 con 0x7fda74102820 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda69d9b640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda74108160 0x7fda74113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda7259c640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda74102820 0x7fda74113000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda6400b4a0 tx=0x7fda6400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda6bfff640 1 -- 172.21.15.33:0/1833265861 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64014070 con 0x7fda74102820 2024-08-28T19:29:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda78d69640 1 -- 172.21.15.33:0/1833265861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda741a8860 con 0x7fda74102820 2024-08-28T19:29:46.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda6bfff640 1 -- 172.21.15.33:0/1833265861 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda64010ac0 con 0x7fda74102820 2024-08-28T19:29:46.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda6bfff640 1 -- 172.21.15.33:0/1833265861 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64017c30 con 0x7fda74102820 2024-08-28T19:29:46.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.592+0000 7fda78d69640 1 -- 172.21.15.33:0/1833265861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda741a8da0 con 0x7fda74102820 2024-08-28T19:29:46.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.593+0000 7fda78d69640 1 -- 172.21.15.33:0/1833265861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda74103aa0 con 0x7fda74102820 2024-08-28T19:29:46.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.596+0000 7fda6bfff640 1 -- 172.21.15.33:0/1833265861 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fda64017070 con 0x7fda74102820 2024-08-28T19:29:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.597+0000 7fda6bfff640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fda600b4b80 0x7fda600b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.597+0000 7fda69d9b640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fda600b4b80 0x7fda600b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.597+0000 7fda6bfff640 1 -- 172.21.15.33:0/1833265861 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7712+0+0 (secure 0 0 0) 0x7fda640e45e0 con 0x7fda74102820 2024-08-28T19:29:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.597+0000 7fda69d9b640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fda600b4b80 0x7fda600b7090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0058c0 tx=0x7fda5c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:46.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.600+0000 7fda6bfff640 1 -- 172.21.15.33:0/1833265861 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fda640ab8f0 con 0x7fda74102820 2024-08-28T19:29:46.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:46.788+0000 7fda78d69640 1 -- 172.21.15.33:0/1833265861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fda741a91a0 con 0x7fda74102820 2024-08-28T19:29:47.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.090+0000 7fda6bfff640 1 -- 172.21.15.33:0/1833265861 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v72) ==== 171+0+0 (secure 0 0 0) 0x7fda640ab1f0 con 0x7fda74102820 2024-08-28T19:29:47.092 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-08-28T19:29:47.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 -- 172.21.15.33:0/1833265861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fda600b4b80 msgr2=0x7fda600b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:47.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fda600b4b80 0x7fda600b7090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0058c0 tx=0x7fda5c005850 comp rx=0 tx=0).stop 2024-08-28T19:29:47.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 -- 172.21.15.33:0/1833265861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda74102820 msgr2=0x7fda74113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:47.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda74102820 0x7fda74113000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda6400b4a0 tx=0x7fda6400b960 comp rx=0 tx=0).stop 2024-08-28T19:29:47.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 -- 172.21.15.33:0/1833265861 shutdown_connections 2024-08-28T19:29:47.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fda600b4b80 0x7fda600b7090 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:47.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda74108ab0 0x7fda74113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:47.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda74108160 0x7fda74113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:47.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 --2- 172.21.15.33:0/1833265861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda74102820 0x7fda74113000 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:47.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 -- 172.21.15.33:0/1833265861 >> 172.21.15.33:0/1833265861 conn(0x7fda740794e0 msgr2=0x7fda741052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:47.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 -- 172.21.15.33:0/1833265861 shutdown_connections 2024-08-28T19:29:47.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:47.093+0000 7fda78d69640 1 -- 172.21.15.33:0/1833265861 wait complete. 2024-08-28T19:29:47.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:47 smithi059 ceph-mon[22052]: pgmap v248: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:47.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:47 smithi059 ceph-mon[22052]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T19:29:47.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:47 smithi059 ceph-mon[22052]: osdmap e71: 12 total, 12 up, 12 in 2024-08-28T19:29:47.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:47 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1833265861' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-28T19:29:47.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:47 smithi033 ceph-mon[18549]: pgmap v248: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:47.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:47 smithi033 ceph-mon[18549]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T19:29:47.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:47 smithi033 ceph-mon[18549]: osdmap e71: 12 total, 12 up, 12 in 2024-08-28T19:29:47.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:47 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1833265861' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-28T19:29:47.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:47 smithi122 ceph-mon[22174]: pgmap v248: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:47.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:47 smithi122 ceph-mon[22174]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T19:29:47.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:47 smithi122 ceph-mon[22174]: osdmap e71: 12 total, 12 up, 12 in 2024-08-28T19:29:47.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:47 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1833265861' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-28T19:29:47.788 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-28T19:29:48.044 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:48.383 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:48 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1833265861' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-28T19:29:48.383 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:48 smithi033 ceph-mon[18549]: osdmap e72: 12 total, 12 up, 12 in 2024-08-28T19:29:48.396 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:48 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1833265861' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-28T19:29:48.396 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:48 smithi122 ceph-mon[22174]: osdmap e72: 12 total, 12 up, 12 in 2024-08-28T19:29:48.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.519+0000 7f9522729640 1 -- 172.21.15.33:0/615182199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f951c108140 msgr2=0x7f951c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:48.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.519+0000 7f9522729640 1 --2- 172.21.15.33:0/615182199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f951c108140 0x7f951c108550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9510009900 tx=0x7f951002a410 comp rx=0 tx=0).stop 2024-08-28T19:29:48.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.519+0000 7f9522729640 1 -- 172.21.15.33:0/615182199 shutdown_connections 2024-08-28T19:29:48.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.519+0000 7f9522729640 1 --2- 172.21.15.33:0/615182199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c108a90 0x7f951c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.519+0000 7f9522729640 1 --2- 172.21.15.33:0/615182199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f951c108140 0x7f951c108550 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.519+0000 7f9522729640 1 --2- 172.21.15.33:0/615182199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f951c102800 0x7f951c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.519+0000 7f9522729640 1 -- 172.21.15.33:0/615182199 >> 172.21.15.33:0/615182199 conn(0x7f951c0794d0 msgr2=0x7f951c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.519+0000 7f9522729640 1 -- 172.21.15.33:0/615182199 shutdown_connections 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.519+0000 7f9522729640 1 -- 172.21.15.33:0/615182199 wait complete. 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.519+0000 7f9522729640 1 Processor -- start 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9522729640 1 -- start start 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9522729640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c102800 0x7f951c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9522729640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f951c108140 0x7f951c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9522729640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f951c108a90 0x7f951c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9522729640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f951c113820 con 0x7f951c108a90 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9522729640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f951c1136a0 con 0x7f951c102800 2024-08-28T19:29:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9522729640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f951c1139a0 con 0x7f951c108140 2024-08-28T19:29:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9520cc6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f951c108a90 0x7f951c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9520cc6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f951c108a90 0x7f951c19fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41738/0 (socket says 172.21.15.33:41738) 2024-08-28T19:29:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9520cc6640 1 -- 172.21.15.33:0/226708855 learned_addr learned my addr 172.21.15.33:0/226708855 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f951bfff640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c102800 0x7f951c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f951b7fe640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f951c108140 0x7f951c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9520cc6640 1 -- 172.21.15.33:0/226708855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f951c108140 msgr2=0x7f951c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9520cc6640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f951c108140 0x7f951c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9520cc6640 1 -- 172.21.15.33:0/226708855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c102800 msgr2=0x7f951c19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9520cc6640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c102800 0x7f951c19a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.520+0000 7f9520cc6640 1 -- 172.21.15.33:0/226708855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951c1a02a0 con 0x7f951c108a90 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.521+0000 7f9520cc6640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f951c108a90 0x7f951c19fb70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f951400eaa0 tx=0x7f951400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.521+0000 7f95197fa640 1 -- 172.21.15.33:0/226708855 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951400cdb0 con 0x7f951c108a90 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.521+0000 7f9522729640 1 -- 172.21.15.33:0/226708855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951c1a0590 con 0x7f951c108a90 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.521+0000 7f95197fa640 1 -- 172.21.15.33:0/226708855 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9514005020 con 0x7f951c108a90 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.521+0000 7f95197fa640 1 -- 172.21.15.33:0/226708855 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95140116d0 con 0x7f951c108a90 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.521+0000 7f9522729640 1 -- 172.21.15.33:0/226708855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f951c1a6cf0 con 0x7f951c108a90 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.522+0000 7f9522729640 1 -- 172.21.15.33:0/226708855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f951c102c10 con 0x7f951c108a90 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.524+0000 7f95197fa640 1 -- 172.21.15.33:0/226708855 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f95140051d0 con 0x7f951c108a90 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.524+0000 7f95197fa640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4b80 0x7f95040b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.525+0000 7f951bfff640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4b80 0x7f95040b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.525+0000 7f95197fa640 1 -- 172.21.15.33:0/226708855 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8094+0+0 (secure 0 0 0) 0x7f95140e55b0 con 0x7f951c108a90 2024-08-28T19:29:48.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.525+0000 7f951bfff640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4b80 0x7f95040b7090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f950c0058c0 tx=0x7f950c00a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:48.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.528+0000 7f95197fa640 1 -- 172.21.15.33:0/226708855 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9514016030 con 0x7f951c108a90 2024-08-28T19:29:48.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:48 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1833265861' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-28T19:29:48.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:48 smithi059 ceph-mon[22052]: osdmap e72: 12 total, 12 up, 12 in 2024-08-28T19:29:48.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:48.753+0000 7f9522729640 1 -- 172.21.15.33:0/226708855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f951c19b460 con 0x7f951c108a90 2024-08-28T19:29:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.098+0000 7f95197fa640 1 -- 172.21.15.33:0/226708855 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f951c19b460 con 0x7f951c108a90 2024-08-28T19:29:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 2 and data pool 3 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.101+0000 7f9522729640 1 -- 172.21.15.33:0/226708855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4b80 msgr2=0x7f95040b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.101+0000 7f9522729640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4b80 0x7f95040b7090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f950c0058c0 tx=0x7f950c00a250 comp rx=0 tx=0).stop 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.101+0000 7f9522729640 1 -- 172.21.15.33:0/226708855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f951c108a90 msgr2=0x7f951c19fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.101+0000 7f9522729640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f951c108a90 0x7f951c19fb70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f951400eaa0 tx=0x7f951400ef60 comp rx=0 tx=0).stop 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.102+0000 7f9522729640 1 -- 172.21.15.33:0/226708855 shutdown_connections 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.102+0000 7f9522729640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f951c108a90 0x7f951c19fb70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.102+0000 7f9522729640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4b80 0x7f95040b7090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.102+0000 7f9522729640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f951c108140 0x7f951c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.102+0000 7f9522729640 1 --2- 172.21.15.33:0/226708855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c102800 0x7f951c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.102+0000 7f9522729640 1 -- 172.21.15.33:0/226708855 >> 172.21.15.33:0/226708855 conn(0x7f951c0794d0 msgr2=0x7f951c104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.102+0000 7f9522729640 1 -- 172.21.15.33:0/226708855 shutdown_connections 2024-08-28T19:29:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:49.102+0000 7f9522729640 1 -- 172.21.15.33:0/226708855 wait complete. 2024-08-28T19:29:49.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:49 smithi122 ceph-mon[22174]: pgmap v251: 97 pgs: 11 creating+peering, 67 unknown, 19 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:49.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:49 smithi122 ceph-mon[22174]: osdmap e73: 12 total, 12 up, 12 in 2024-08-28T19:29:49.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:49 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/226708855' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-28T19:29:49.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:49 smithi122 ceph-mon[22174]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-28T19:29:49.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:49 smithi033 ceph-mon[18549]: pgmap v251: 97 pgs: 11 creating+peering, 67 unknown, 19 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:49.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:49 smithi033 ceph-mon[18549]: osdmap e73: 12 total, 12 up, 12 in 2024-08-28T19:29:49.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:49 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/226708855' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-28T19:29:49.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:49 smithi033 ceph-mon[18549]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-28T19:29:49.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:49 smithi059 ceph-mon[22052]: pgmap v251: 97 pgs: 11 creating+peering, 67 unknown, 19 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:29:49.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:49 smithi059 ceph-mon[22052]: osdmap e73: 12 total, 12 up, 12 in 2024-08-28T19:29:49.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:49 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/226708855' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-28T19:29:49.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:49 smithi059 ceph-mon[22052]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-28T19:29:49.793 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:29:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i[54112]: 2024-08-28T19:29:49.404+0000 7f74beafe640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-28T19:29:49.869 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-28T19:29:49.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-28T19:29:50.124 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:50.365 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:50 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/226708855' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-28T19:29:50.366 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:50 smithi033 ceph-mon[18549]: osdmap e74: 12 total, 12 up, 12 in 2024-08-28T19:29:50.366 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:50 smithi033 ceph-mon[18549]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-28T19:29:50.366 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:50 smithi033 ceph-mon[18549]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-28T19:29:50.366 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:50 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] up:active 2024-08-28T19:29:50.366 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:50 smithi033 ceph-mon[18549]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:29:50.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:50 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/226708855' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-28T19:29:50.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:50 smithi059 ceph-mon[22052]: osdmap e74: 12 total, 12 up, 12 in 2024-08-28T19:29:50.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:50 smithi059 ceph-mon[22052]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-28T19:29:50.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:50 smithi059 ceph-mon[22052]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-28T19:29:50.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:50 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] up:active 2024-08-28T19:29:50.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:50 smithi059 ceph-mon[22052]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:29:50.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:50 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/226708855' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-28T19:29:50.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:50 smithi122 ceph-mon[22174]: osdmap e74: 12 total, 12 up, 12 in 2024-08-28T19:29:50.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:50 smithi122 ceph-mon[22174]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-28T19:29:50.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:50 smithi122 ceph-mon[22174]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-28T19:29:50.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:50 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] up:active 2024-08-28T19:29:50.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:50 smithi122 ceph-mon[22174]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:29:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.635+0000 7f246feeb640 1 -- 172.21.15.33:0/1551740357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2468102880 msgr2=0x7f2468102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.635+0000 7f246feeb640 1 --2- 172.21.15.33:0/1551740357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2468102880 0x7f2468102c90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2464009900 tx=0x7f246402a410 comp rx=0 tx=0).stop 2024-08-28T19:29:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.635+0000 7f246feeb640 1 -- 172.21.15.33:0/1551740357 shutdown_connections 2024-08-28T19:29:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.635+0000 7f246feeb640 1 --2- 172.21.15.33:0/1551740357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2468108b10 0x7f246810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.635+0000 7f246feeb640 1 --2- 172.21.15.33:0/1551740357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24681081c0 0x7f24681085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.635+0000 7f246feeb640 1 --2- 172.21.15.33:0/1551740357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2468102880 0x7f2468102c90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.635+0000 7f246feeb640 1 -- 172.21.15.33:0/1551740357 >> 172.21.15.33:0/1551740357 conn(0x7f2468079510 msgr2=0x7f2468079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.635+0000 7f246feeb640 1 -- 172.21.15.33:0/1551740357 shutdown_connections 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.635+0000 7f246feeb640 1 -- 172.21.15.33:0/1551740357 wait complete. 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246feeb640 1 Processor -- start 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246feeb640 1 -- start start 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246feeb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2468102880 0x7f246819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246feeb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24681081c0 0x7f246819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246feeb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2468108b10 0x7f246819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246feeb640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f24681127e0 con 0x7f24681081c0 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246feeb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2468112660 con 0x7f2468102880 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246feeb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2468112960 con 0x7f2468108b10 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246d486640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24681081c0 0x7f246819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246d486640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24681081c0 0x7f246819a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41766/0 (socket says 172.21.15.33:41766) 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246d486640 1 -- 172.21.15.33:0/2415454454 learned_addr learned my addr 172.21.15.33:0/2415454454 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246dc87640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2468102880 0x7f246819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246e488640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2468108b10 0x7f246819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246d486640 1 -- 172.21.15.33:0/2415454454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2468108b10 msgr2=0x7f246819fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246d486640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2468108b10 0x7f246819fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246d486640 1 -- 172.21.15.33:0/2415454454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2468102880 msgr2=0x7f246819a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246d486640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2468102880 0x7f246819a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.636+0000 7f246d486640 1 -- 172.21.15.33:0/2415454454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24681a0310 con 0x7f24681081c0 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.637+0000 7f246d486640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24681081c0 0x7f246819a940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f245800c970 tx=0x7f245800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.637+0000 7f245effd640 1 -- 172.21.15.33:0/2415454454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2458007bb0 con 0x7f24681081c0 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.637+0000 7f245effd640 1 -- 172.21.15.33:0/2415454454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2458007d50 con 0x7f24681081c0 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.637+0000 7f245effd640 1 -- 172.21.15.33:0/2415454454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245800f450 con 0x7f24681081c0 2024-08-28T19:29:50.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.637+0000 7f246feeb640 1 -- 172.21.15.33:0/2415454454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24681a0600 con 0x7f24681081c0 2024-08-28T19:29:50.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.637+0000 7f246feeb640 1 -- 172.21.15.33:0/2415454454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24681a6d60 con 0x7f24681081c0 2024-08-28T19:29:50.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.638+0000 7f246feeb640 1 -- 172.21.15.33:0/2415454454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2468103b00 con 0x7f24681081c0 2024-08-28T19:29:50.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.641+0000 7f245effd640 1 -- 172.21.15.33:0/2415454454 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f2458004eb0 con 0x7f24681081c0 2024-08-28T19:29:50.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.642+0000 7f245effd640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24540b4c00 0x7f24540b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:50.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.642+0000 7f246dc87640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24540b4c00 0x7f24540b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:50.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.642+0000 7f245effd640 1 -- 172.21.15.33:0/2415454454 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f24580e5180 con 0x7f24681081c0 2024-08-28T19:29:50.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.642+0000 7f246dc87640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24540b4c00 0x7f24540b7110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2464031440 tx=0x7f2464005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:50.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.645+0000 7f245effd640 1 -- 172.21.15.33:0/2415454454 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2458014030 con 0x7f24681081c0 2024-08-28T19:29:50.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:50.842+0000 7f246feeb640 1 -- 172.21.15.33:0/2415454454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f246819b4d0 con 0x7f24681081c0 2024-08-28T19:29:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.226+0000 7f245effd640 1 -- 172.21.15.33:0/2415454454 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v75) ==== 157+0+0 (secure 0 0 0) 0x7f246819b4d0 con 0x7f24681081c0 2024-08-28T19:29:51.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 -- 172.21.15.33:0/2415454454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24540b4c00 msgr2=0x7f24540b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:51.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24540b4c00 0x7f24540b7110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2464031440 tx=0x7f2464005e80 comp rx=0 tx=0).stop 2024-08-28T19:29:51.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 -- 172.21.15.33:0/2415454454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24681081c0 msgr2=0x7f246819a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:51.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24681081c0 0x7f246819a940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f245800c970 tx=0x7f245800ce30 comp rx=0 tx=0).stop 2024-08-28T19:29:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 -- 172.21.15.33:0/2415454454 shutdown_connections 2024-08-28T19:29:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24540b4c00 0x7f24540b7110 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2468108b10 0x7f246819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24681081c0 0x7f246819a940 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 --2- 172.21.15.33:0/2415454454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2468102880 0x7f246819a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 -- 172.21.15.33:0/2415454454 >> 172.21.15.33:0/2415454454 conn(0x7f2468079510 msgr2=0x7f2468101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 -- 172.21.15.33:0/2415454454 shutdown_connections 2024-08-28T19:29:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:51.229+0000 7f246feeb640 1 -- 172.21.15.33:0/2415454454 wait complete. 2024-08-28T19:29:51.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:51 smithi033 ceph-mon[18549]: pgmap v254: 97 pgs: 17 creating+peering, 28 unknown, 52 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-28T19:29:51.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:51 smithi033 ceph-mon[18549]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-28T19:29:51.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:51 smithi033 ceph-mon[18549]: Cluster is now healthy 2024-08-28T19:29:51.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:51 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2415454454' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-28T19:29:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:51 smithi059 ceph-mon[22052]: pgmap v254: 97 pgs: 17 creating+peering, 28 unknown, 52 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-28T19:29:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:51 smithi059 ceph-mon[22052]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-28T19:29:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:51 smithi059 ceph-mon[22052]: Cluster is now healthy 2024-08-28T19:29:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:51 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2415454454' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-28T19:29:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:51 smithi122 ceph-mon[22174]: pgmap v254: 97 pgs: 17 creating+peering, 28 unknown, 52 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-28T19:29:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:51 smithi122 ceph-mon[22174]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-28T19:29:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:51 smithi122 ceph-mon[22174]: Cluster is now healthy 2024-08-28T19:29:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:51 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2415454454' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-28T19:29:51.818 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-28T19:29:52.074 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:52.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:52 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2415454454' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-28T19:29:52.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:52 smithi033 ceph-mon[18549]: osdmap e75: 12 total, 12 up, 12 in 2024-08-28T19:29:52.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:52 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2415454454' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-28T19:29:52.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:52 smithi059 ceph-mon[22052]: osdmap e75: 12 total, 12 up, 12 in 2024-08-28T19:29:52.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:52 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2415454454' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-28T19:29:52.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:52 smithi122 ceph-mon[22174]: osdmap e75: 12 total, 12 up, 12 in 2024-08-28T19:29:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.596+0000 7fa105be0640 1 -- 172.21.15.33:0/2986671689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa100108240 msgr2=0x7fa10010ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.596+0000 7fa105be0640 1 --2- 172.21.15.33:0/2986671689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa100108240 0x7fa10010ea70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009ca0 tx=0x7fa0f802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:29:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.596+0000 7fa105be0640 1 -- 172.21.15.33:0/2986671689 shutdown_connections 2024-08-28T19:29:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.596+0000 7fa105be0640 1 --2- 172.21.15.33:0/2986671689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa100108240 0x7fa10010ea70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.596+0000 7fa105be0640 1 --2- 172.21.15.33:0/2986671689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1001078f0 0x7fa100107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.596+0000 7fa105be0640 1 --2- 172.21.15.33:0/2986671689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa100101fc0 0x7fa1001023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.596+0000 7fa105be0640 1 -- 172.21.15.33:0/2986671689 >> 172.21.15.33:0/2986671689 conn(0x7fa100079d70 msgr2=0x7fa10007a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.596+0000 7fa105be0640 1 -- 172.21.15.33:0/2986671689 shutdown_connections 2024-08-28T19:29:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.596+0000 7fa105be0640 1 -- 172.21.15.33:0/2986671689 wait complete. 2024-08-28T19:29:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.596+0000 7fa105be0640 1 Processor -- start 2024-08-28T19:29:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa105be0640 1 -- start start 2024-08-28T19:29:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa105be0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa100101fc0 0x7fa10019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa105be0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1001078f0 0x7fa10019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa105be0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa100108240 0x7fa10019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa105be0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa100112780 con 0x7fa100101fc0 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa105be0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa100112600 con 0x7fa1001078f0 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa105be0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa100112900 con 0x7fa100108240 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa0ff7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa100101fc0 0x7fa10019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa0ff7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa100101fc0 0x7fa10019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41786/0 (socket says 172.21.15.33:41786) 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa0ff7fe640 1 -- 172.21.15.33:0/2751767599 learned_addr learned my addr 172.21.15.33:0/2751767599 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa0fffff640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa100108240 0x7fa10019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa0feffd640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1001078f0 0x7fa10019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa0ff7fe640 1 -- 172.21.15.33:0/2751767599 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa100108240 msgr2=0x7fa10019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa0ff7fe640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa100108240 0x7fa10019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa0ff7fe640 1 -- 172.21.15.33:0/2751767599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1001078f0 msgr2=0x7fa10019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa0ff7fe640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1001078f0 0x7fa10019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.597+0000 7fa0ff7fe640 1 -- 172.21.15.33:0/2751767599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1001a0130 con 0x7fa100101fc0 2024-08-28T19:29:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.598+0000 7fa0ff7fe640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa100101fc0 0x7fa10019a1c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000d770 tx=0x7fa0f000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.598+0000 7fa0fcff9640 1 -- 172.21.15.33:0/2751767599 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0017070 con 0x7fa100101fc0 2024-08-28T19:29:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.598+0000 7fa0fcff9640 1 -- 172.21.15.33:0/2751767599 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0f00054d0 con 0x7fa100101fc0 2024-08-28T19:29:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.598+0000 7fa0fcff9640 1 -- 172.21.15.33:0/2751767599 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0004c30 con 0x7fa100101fc0 2024-08-28T19:29:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.598+0000 7fa105be0640 1 -- 172.21.15.33:0/2751767599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1001a0420 con 0x7fa100101fc0 2024-08-28T19:29:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.598+0000 7fa105be0640 1 -- 172.21.15.33:0/2751767599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1000fec80 con 0x7fa100101fc0 2024-08-28T19:29:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.599+0000 7fa105be0640 1 -- 172.21.15.33:0/2751767599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa100103210 con 0x7fa100101fc0 2024-08-28T19:29:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.601+0000 7fa0fcff9640 1 -- 172.21.15.33:0/2751767599 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fa0f0004dd0 con 0x7fa100101fc0 2024-08-28T19:29:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.601+0000 7fa0fcff9640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0e80b4c00 0x7fa0e80b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.602+0000 7fa0fcff9640 1 -- 172.21.15.33:0/2751767599 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8492+0+0 (secure 0 0 0) 0x7fa0f00e5050 con 0x7fa100101fc0 2024-08-28T19:29:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.602+0000 7fa0feffd640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0e80b4c00 0x7fa0e80b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:52.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.602+0000 7fa0feffd640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0e80b4c00 0x7fa0e80b7110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa10006ada0 tx=0x7fa0f400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:52.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.605+0000 7fa0fcff9640 1 -- 172.21.15.33:0/2751767599 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa0f00abab0 con 0x7fa100101fc0 2024-08-28T19:29:52.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:52.790+0000 7fa105be0640 1 -- 172.21.15.33:0/2751767599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa1001023d0 con 0x7fa100101fc0 2024-08-28T19:29:53.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:53 smithi059 ceph-mon[22052]: pgmap v256: 97 pgs: 17 creating+peering, 13 unknown, 67 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 221 B/s wr, 4 op/s 2024-08-28T19:29:53.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:53 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2751767599' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-28T19:29:53.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:53 smithi122 ceph-mon[22174]: pgmap v256: 97 pgs: 17 creating+peering, 13 unknown, 67 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 221 B/s wr, 4 op/s 2024-08-28T19:29:53.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:53 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2751767599' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-28T19:29:53.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:53 smithi033 ceph-mon[18549]: pgmap v256: 97 pgs: 17 creating+peering, 13 unknown, 67 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 221 B/s wr, 4 op/s 2024-08-28T19:29:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:53 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2751767599' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-28T19:29:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.243+0000 7fa0fcff9640 1 -- 172.21.15.33:0/2751767599 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v77) ==== 228+0+0 (secure 0 0 0) 0x7fa1001023d0 con 0x7fa100101fc0 2024-08-28T19:29:54.245 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data_ec' created 2024-08-28T19:29:54.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.246+0000 7fa105be0640 1 -- 172.21.15.33:0/2751767599 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0e80b4c00 msgr2=0x7fa0e80b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.246+0000 7fa105be0640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0e80b4c00 0x7fa0e80b7110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa10006ada0 tx=0x7fa0f400b410 comp rx=0 tx=0).stop 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.246+0000 7fa105be0640 1 -- 172.21.15.33:0/2751767599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa100101fc0 msgr2=0x7fa10019a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.246+0000 7fa105be0640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa100101fc0 0x7fa10019a1c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000d770 tx=0x7fa0f000dc30 comp rx=0 tx=0).stop 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.246+0000 7fa105be0640 1 -- 172.21.15.33:0/2751767599 shutdown_connections 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.246+0000 7fa105be0640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0e80b4c00 0x7fa0e80b7110 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa10006ada0 tx=0x7fa0f400b410 comp rx=0 tx=0).stop 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.246+0000 7fa105be0640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa100108240 0x7fa10019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.246+0000 7fa105be0640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1001078f0 0x7fa10019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.246+0000 7fa105be0640 1 --2- 172.21.15.33:0/2751767599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa100101fc0 0x7fa10019a1c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.246+0000 7fa105be0640 1 -- 172.21.15.33:0/2751767599 >> 172.21.15.33:0/2751767599 conn(0x7fa100079d70 msgr2=0x7fa100100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.247+0000 7fa105be0640 1 -- 172.21.15.33:0/2751767599 shutdown_connections 2024-08-28T19:29:54.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:54.247+0000 7fa105be0640 1 -- 172.21.15.33:0/2751767599 wait complete. 2024-08-28T19:29:54.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:54 smithi059 ceph-mon[22052]: osdmap e76: 12 total, 12 up, 12 in 2024-08-28T19:29:54.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:54 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2751767599' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-28T19:29:54.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:54 smithi059 ceph-mon[22052]: osdmap e77: 12 total, 12 up, 12 in 2024-08-28T19:29:54.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:54 smithi122 ceph-mon[22174]: osdmap e76: 12 total, 12 up, 12 in 2024-08-28T19:29:54.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:54 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2751767599' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-28T19:29:54.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:54 smithi122 ceph-mon[22174]: osdmap e77: 12 total, 12 up, 12 in 2024-08-28T19:29:54.578 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:54 smithi033 ceph-mon[18549]: osdmap e76: 12 total, 12 up, 12 in 2024-08-28T19:29:54.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:54 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2751767599' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-28T19:29:54.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:54 smithi033 ceph-mon[18549]: osdmap e77: 12 total, 12 up, 12 in 2024-08-28T19:29:54.931 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-28T19:29:55.192 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:55.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:55 smithi059 ceph-mon[22052]: pgmap v258: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-08-28T19:29:55.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:55 smithi059 ceph-mon[22052]: osdmap e78: 12 total, 12 up, 12 in 2024-08-28T19:29:55.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:55 smithi122 ceph-mon[22174]: pgmap v258: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-08-28T19:29:55.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:55 smithi122 ceph-mon[22174]: osdmap e78: 12 total, 12 up, 12 in 2024-08-28T19:29:55.565 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:55 smithi033 ceph-mon[18549]: pgmap v258: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-08-28T19:29:55.565 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:55 smithi033 ceph-mon[18549]: osdmap e78: 12 total, 12 up, 12 in 2024-08-28T19:29:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 -- 172.21.15.33:0/4250083852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0234103900 msgr2=0x7f0234103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 --2- 172.21.15.33:0/4250083852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0234103900 0x7f0234103d10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0224009900 tx=0x7f022402a410 comp rx=0 tx=0).stop 2024-08-28T19:29:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 -- 172.21.15.33:0/4250083852 shutdown_connections 2024-08-28T19:29:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 --2- 172.21.15.33:0/4250083852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0234109b90 0x7f02341103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:55.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 --2- 172.21.15.33:0/4250083852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0234109240 0x7f0234109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:55.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 --2- 172.21.15.33:0/4250083852 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0234103900 0x7f0234103d10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:55.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 -- 172.21.15.33:0/4250083852 >> 172.21.15.33:0/4250083852 conn(0x7f023407b5f0 msgr2=0x7f023407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:55.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 -- 172.21.15.33:0/4250083852 shutdown_connections 2024-08-28T19:29:55.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 -- 172.21.15.33:0/4250083852 wait complete. 2024-08-28T19:29:55.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 Processor -- start 2024-08-28T19:29:55.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.795+0000 7f023a6d3640 1 -- start start 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f023a6d3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0234103900 0x7f023419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f023a6d3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0234109240 0x7f023419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f023a6d3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0234109b90 0x7f023419fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f023a6d3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f02341138e0 con 0x7f0234109b90 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f023a6d3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0234113760 con 0x7f0234103900 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f023a6d3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0234113a60 con 0x7f0234109240 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0238c70640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0234109b90 0x7f023419fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0238c70640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0234109b90 0x7f023419fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41816/0 (socket says 172.21.15.33:41816) 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0238c70640 1 -- 172.21.15.33:0/2318320164 learned_addr learned my addr 172.21.15.33:0/2318320164 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f022bfff640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0234109240 0x7f023419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0233fff640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0234103900 0x7f023419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0238c70640 1 -- 172.21.15.33:0/2318320164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0234109240 msgr2=0x7f023419a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0238c70640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0234109240 0x7f023419a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0238c70640 1 -- 172.21.15.33:0/2318320164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0234103900 msgr2=0x7f023419a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0238c70640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0234103900 0x7f023419a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0238c70640 1 -- 172.21.15.33:0/2318320164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02341a0180 con 0x7f0234109b90 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0233fff640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0234103900 0x7f023419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.796+0000 7f0238c70640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0234109b90 0x7f023419fb10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f022c00cce0 tx=0x7f022c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.797+0000 7f0231ffb640 1 -- 172.21.15.33:0/2318320164 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c00f450 con 0x7f0234109b90 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.797+0000 7f023a6d3640 1 -- 172.21.15.33:0/2318320164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02341a0470 con 0x7f0234109b90 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.797+0000 7f0231ffb640 1 -- 172.21.15.33:0/2318320164 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f022c00faa0 con 0x7f0234109b90 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.797+0000 7f0231ffb640 1 -- 172.21.15.33:0/2318320164 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c018a80 con 0x7f0234109b90 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.797+0000 7f023a6d3640 1 -- 172.21.15.33:0/2318320164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02341a6c90 con 0x7f0234109b90 2024-08-28T19:29:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.798+0000 7f023a6d3640 1 -- 172.21.15.33:0/2318320164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0234103d10 con 0x7f0234109b90 2024-08-28T19:29:55.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.799+0000 7f0231ffb640 1 -- 172.21.15.33:0/2318320164 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f022c00fc50 con 0x7f0234109b90 2024-08-28T19:29:55.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.800+0000 7f0231ffb640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02200b4bb0 0x7f02200b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:55.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.800+0000 7f0233fff640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02200b4bb0 0x7f02200b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:55.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.800+0000 7f0231ffb640 1 -- 172.21.15.33:0/2318320164 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8985+0+0 (secure 0 0 0) 0x7f022c0e5da0 con 0x7f0234109b90 2024-08-28T19:29:55.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.801+0000 7f0233fff640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02200b4bb0 0x7f02200b70c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0224000c00 tx=0x7f0224031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:55.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.803+0000 7f0231ffb640 1 -- 172.21.15.33:0/2318320164 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f022c014030 con 0x7f0234109b90 2024-08-28T19:29:55.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:55.990+0000 7f023a6d3640 1 -- 172.21.15.33:0/2318320164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f023419b400 con 0x7f0234109b90 2024-08-28T19:29:56.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.247+0000 7f0231ffb640 1 -- 172.21.15.33:0/2318320164 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v79) ==== 169+0+0 (secure 0 0 0) 0x7f023419b400 con 0x7f0234109b90 2024-08-28T19:29:56.249 INFO:teuthology.orchestra.run.smithi033.stderr:set pool 4 allow_ec_overwrites to true 2024-08-28T19:29:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 -- 172.21.15.33:0/2318320164 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02200b4bb0 msgr2=0x7f02200b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02200b4bb0 0x7f02200b70c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0224000c00 tx=0x7f0224031400 comp rx=0 tx=0).stop 2024-08-28T19:29:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 -- 172.21.15.33:0/2318320164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0234109b90 msgr2=0x7f023419fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0234109b90 0x7f023419fb10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f022c00cce0 tx=0x7f022c00a620 comp rx=0 tx=0).stop 2024-08-28T19:29:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 -- 172.21.15.33:0/2318320164 shutdown_connections 2024-08-28T19:29:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0234109b90 0x7f023419fb10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02200b4bb0 0x7f02200b70c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0234109240 0x7f023419a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 --2- 172.21.15.33:0/2318320164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0234103900 0x7f023419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 -- 172.21.15.33:0/2318320164 >> 172.21.15.33:0/2318320164 conn(0x7f023407b5f0 msgr2=0x7f02341072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 -- 172.21.15.33:0/2318320164 shutdown_connections 2024-08-28T19:29:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:56.250+0000 7f023a6d3640 1 -- 172.21.15.33:0/2318320164 wait complete. 2024-08-28T19:29:56.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:56 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2318320164' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-28T19:29:56.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:56 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2318320164' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-28T19:29:56.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:56 smithi059 ceph-mon[22052]: osdmap e79: 12 total, 12 up, 12 in 2024-08-28T19:29:56.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:56 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2318320164' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-28T19:29:56.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:56 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2318320164' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-28T19:29:56.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:56 smithi122 ceph-mon[22174]: osdmap e79: 12 total, 12 up, 12 in 2024-08-28T19:29:56.589 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:56 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2318320164' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-28T19:29:56.589 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:56 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2318320164' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-28T19:29:56.589 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:56 smithi033 ceph-mon[18549]: osdmap e79: 12 total, 12 up, 12 in 2024-08-28T19:29:56.940 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-28T19:29:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:57.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:57 smithi059 ceph-mon[22052]: pgmap v261: 129 pgs: 8 creating+peering, 24 unknown, 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s wr, 9 op/s 2024-08-28T19:29:57.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:57 smithi059 ceph-mon[22052]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T19:29:57.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:57 smithi122 ceph-mon[22174]: pgmap v261: 129 pgs: 8 creating+peering, 24 unknown, 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s wr, 9 op/s 2024-08-28T19:29:57.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:57 smithi122 ceph-mon[22174]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T19:29:57.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:57 smithi033 ceph-mon[18549]: pgmap v261: 129 pgs: 8 creating+peering, 24 unknown, 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s wr, 9 op/s 2024-08-28T19:29:57.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:57 smithi033 ceph-mon[18549]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-28T19:29:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.921+0000 7faaef672640 1 -- 172.21.15.33:0/3305033328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faae8108a90 msgr2=0x7faae810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.921+0000 7faaef672640 1 --2- 172.21.15.33:0/3305033328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faae8108a90 0x7faae810f2c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faae0009900 tx=0x7faae002a410 comp rx=0 tx=0).stop 2024-08-28T19:29:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.921+0000 7faaef672640 1 -- 172.21.15.33:0/3305033328 shutdown_connections 2024-08-28T19:29:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.921+0000 7faaef672640 1 --2- 172.21.15.33:0/3305033328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faae8108a90 0x7faae810f2c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.921+0000 7faaef672640 1 --2- 172.21.15.33:0/3305033328 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae8108140 0x7faae8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.921+0000 7faaef672640 1 --2- 172.21.15.33:0/3305033328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faae8102800 0x7faae8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.921+0000 7faaef672640 1 -- 172.21.15.33:0/3305033328 >> 172.21.15.33:0/3305033328 conn(0x7faae80794d0 msgr2=0x7faae80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.921+0000 7faaef672640 1 -- 172.21.15.33:0/3305033328 shutdown_connections 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.921+0000 7faaef672640 1 -- 172.21.15.33:0/3305033328 wait complete. 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.921+0000 7faaef672640 1 Processor -- start 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaef672640 1 -- start start 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaef672640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faae8102800 0x7faae819b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaef672640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faae8108140 0x7faae819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaef672640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae8108a90 0x7faae819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaef672640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faae81126f0 con 0x7faae8108140 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaef672640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faae8112570 con 0x7faae8102800 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaef672640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faae8112870 con 0x7faae8108a90 2024-08-28T19:29:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaecc0d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faae8108140 0x7faae819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaecc0d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faae8108140 0x7faae819b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41830/0 (socket says 172.21.15.33:41830) 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaecc0d640 1 -- 172.21.15.33:0/766875840 learned_addr learned my addr 172.21.15.33:0/766875840 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaed40e640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faae8102800 0x7faae819b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaedc0f640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae8108a90 0x7faae819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaecc0d640 1 -- 172.21.15.33:0/766875840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae8108a90 msgr2=0x7faae819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaecc0d640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae8108a90 0x7faae819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaecc0d640 1 -- 172.21.15.33:0/766875840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faae8102800 msgr2=0x7faae819b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaecc0d640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faae8102800 0x7faae819b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaecc0d640 1 -- 172.21.15.33:0/766875840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae81a6290 con 0x7faae8108140 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.922+0000 7faaecc0d640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faae8108140 0x7faae819b540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faadc00c970 tx=0x7faadc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.923+0000 7faae67fc640 1 -- 172.21.15.33:0/766875840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc007bb0 con 0x7faae8108140 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.923+0000 7faaef672640 1 -- 172.21.15.33:0/766875840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae81a6580 con 0x7faae8108140 2024-08-28T19:29:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.923+0000 7faae67fc640 1 -- 172.21.15.33:0/766875840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faadc007d50 con 0x7faae8108140 2024-08-28T19:29:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.923+0000 7faae67fc640 1 -- 172.21.15.33:0/766875840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc00f450 con 0x7faae8108140 2024-08-28T19:29:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.923+0000 7faaef672640 1 -- 172.21.15.33:0/766875840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae81a6b10 con 0x7faae8108140 2024-08-28T19:29:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.924+0000 7faaef672640 1 -- 172.21.15.33:0/766875840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae8102c10 con 0x7faae8108140 2024-08-28T19:29:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.925+0000 7faae67fc640 1 -- 172.21.15.33:0/766875840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7faadc004e80 con 0x7faae8108140 2024-08-28T19:29:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.926+0000 7faae67fc640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faad00b4bb0 0x7faad00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.927+0000 7faaed40e640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faad00b4bb0 0x7faad00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.927+0000 7faae67fc640 1 -- 172.21.15.33:0/766875840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8985+0+0 (secure 0 0 0) 0x7faadc0e55d0 con 0x7faae8108140 2024-08-28T19:29:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.927+0000 7faaed40e640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faad00b4bb0 0x7faad00b70c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faad8005c40 tx=0x7faad800a590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:57.930+0000 7faae67fc640 1 -- 172.21.15.33:0/766875840 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faadc014030 con 0x7faae8108140 2024-08-28T19:29:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.155+0000 7faaef672640 1 -- 172.21.15.33:0/766875840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7faae806b010 con 0x7faae8108140 2024-08-28T19:29:58.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.287+0000 7faae67fc640 1 -- 172.21.15.33:0/766875840 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7faadc0ac3b0 con 0x7faae8108140 2024-08-28T19:29:58.289 INFO:teuthology.orchestra.run.smithi033.stderr:added data pool 4 to fsmap 2024-08-28T19:29:58.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 -- 172.21.15.33:0/766875840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faad00b4bb0 msgr2=0x7faad00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:58.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faad00b4bb0 0x7faad00b70c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faad8005c40 tx=0x7faad800a590 comp rx=0 tx=0).stop 2024-08-28T19:29:58.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 -- 172.21.15.33:0/766875840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faae8108140 msgr2=0x7faae819b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:58.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faae8108140 0x7faae819b540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faadc00c970 tx=0x7faadc00ce30 comp rx=0 tx=0).stop 2024-08-28T19:29:58.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 -- 172.21.15.33:0/766875840 shutdown_connections 2024-08-28T19:29:58.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faad00b4bb0 0x7faad00b70c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:58.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faae8108a90 0x7faae819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:58.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faae8108140 0x7faae819b540 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:58.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 --2- 172.21.15.33:0/766875840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faae8102800 0x7faae819b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:58.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 -- 172.21.15.33:0/766875840 >> 172.21.15.33:0/766875840 conn(0x7faae80794d0 msgr2=0x7faae8104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:58.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 -- 172.21.15.33:0/766875840 shutdown_connections 2024-08-28T19:29:58.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:58.289+0000 7faaef672640 1 -- 172.21.15.33:0/766875840 wait complete. 2024-08-28T19:29:58.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:58 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/766875840' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-28T19:29:58.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:58 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/766875840' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-28T19:29:58.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:58 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/766875840' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-28T19:29:58.990 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:29:59.248 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:29:59.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:59 smithi122 ceph-mon[22174]: pgmap v263: 129 pgs: 8 creating+peering, 11 unknown, 110 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 0 op/s 2024-08-28T19:29:59.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:59 smithi122 ceph-mon[22174]: osdmap e80: 12 total, 12 up, 12 in 2024-08-28T19:29:59.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:59 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/766875840' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-28T19:29:59.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:29:59 smithi122 ceph-mon[22174]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:29:59.558 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:59 smithi033 ceph-mon[18549]: pgmap v263: 129 pgs: 8 creating+peering, 11 unknown, 110 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 0 op/s 2024-08-28T19:29:59.558 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:59 smithi033 ceph-mon[18549]: osdmap e80: 12 total, 12 up, 12 in 2024-08-28T19:29:59.558 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:59 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/766875840' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-28T19:29:59.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:29:59 smithi033 ceph-mon[18549]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:29:59.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.752+0000 7f7182312640 1 -- 172.21.15.33:0/2002596253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f717c108220 msgr2=0x7f717c108630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:59.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.752+0000 7f7182312640 1 --2- 172.21.15.33:0/2002596253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f717c108220 0x7f717c108630 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7170009900 tx=0x7f717002a410 comp rx=0 tx=0).stop 2024-08-28T19:29:59.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.752+0000 7f7182312640 1 -- 172.21.15.33:0/2002596253 shutdown_connections 2024-08-28T19:29:59.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.752+0000 7f7182312640 1 --2- 172.21.15.33:0/2002596253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717c108b70 0x7f717c10f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:59.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.752+0000 7f7182312640 1 --2- 172.21.15.33:0/2002596253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f717c108220 0x7f717c108630 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.752+0000 7f7182312640 1 --2- 172.21.15.33:0/2002596253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717c1028e0 0x7f717c102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.752+0000 7f7182312640 1 -- 172.21.15.33:0/2002596253 >> 172.21.15.33:0/2002596253 conn(0x7f717c0794f0 msgr2=0x7f717c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.752+0000 7f7182312640 1 -- 172.21.15.33:0/2002596253 shutdown_connections 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.752+0000 7f7182312640 1 -- 172.21.15.33:0/2002596253 wait complete. 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f7182312640 1 Processor -- start 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f7182312640 1 -- start start 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f7182312640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717c1028e0 0x7f717c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f7182312640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f717c108220 0x7f717c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f7182312640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717c108b70 0x7f717c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f7182312640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f717c112720 con 0x7f717c108220 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f7182312640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f717c1125a0 con 0x7f717c108b70 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f7182312640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f717c1128a0 con 0x7f717c1028e0 2024-08-28T19:29:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f717c108220 0x7f717c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f717b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f717c108220 0x7f717c19a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41986/0 (socket says 172.21.15.33:41986) 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f717b7fe640 1 -- 172.21.15.33:0/2222858452 learned_addr learned my addr 172.21.15.33:0/2222858452 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.753+0000 7f717bfff640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717c1028e0 0x7f717c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f71808af640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717c108b70 0x7f717c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f717b7fe640 1 -- 172.21.15.33:0/2222858452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717c1028e0 msgr2=0x7f717c19a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f717b7fe640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717c1028e0 0x7f717c19a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f717b7fe640 1 -- 172.21.15.33:0/2222858452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717c108b70 msgr2=0x7f717c19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f717b7fe640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717c108b70 0x7f717c19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f717b7fe640 1 -- 172.21.15.33:0/2222858452 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c1a0170 con 0x7f717c108220 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f71808af640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717c108b70 0x7f717c19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f717bfff640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717c1028e0 0x7f717c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:29:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f717b7fe640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f717c108220 0x7f717c19a7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7170032fd0 tx=0x7f7170004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f71797fa640 1 -- 172.21.15.33:0/2222858452 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717003f030 con 0x7f717c108220 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f7182312640 1 -- 172.21.15.33:0/2222858452 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717c1a0400 con 0x7f717c108220 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f71797fa640 1 -- 172.21.15.33:0/2222858452 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7170004490 con 0x7f717c108220 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f71797fa640 1 -- 172.21.15.33:0/2222858452 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170035070 con 0x7f717c108220 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.754+0000 7f7182312640 1 -- 172.21.15.33:0/2222858452 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717c1a6bc0 con 0x7f717c108220 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.755+0000 7f7182312640 1 -- 172.21.15.33:0/2222858452 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717c103b60 con 0x7f717c108220 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.757+0000 7f71797fa640 1 -- 172.21.15.33:0/2222858452 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f7170042030 con 0x7f717c108220 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.757+0000 7f71797fa640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71640b4b80 0x7f71640b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.758+0000 7f71797fa640 1 -- 172.21.15.33:0/2222858452 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f7170105ea0 con 0x7f717c108220 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.758+0000 7f717bfff640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71640b4b80 0x7f71640b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.758+0000 7f717bfff640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71640b4b80 0x7f71640b7090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f716c0058c0 tx=0x7f716c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:29:59.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.761+0000 7f71797fa640 1 -- 172.21.15.33:0/2222858452 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f71700cccc0 con 0x7f717c108220 2024-08-28T19:29:59.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:59 smithi059 ceph-mon[22052]: pgmap v263: 129 pgs: 8 creating+peering, 11 unknown, 110 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 0 op/s 2024-08-28T19:29:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:59 smithi059 ceph-mon[22052]: osdmap e80: 12 total, 12 up, 12 in 2024-08-28T19:29:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:59 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/766875840' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-28T19:29:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:29:59 smithi059 ceph-mon[22052]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:29:59.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.983+0000 7f7182312640 1 -- 172.21.15.33:0/2222858452 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f717c102cf0 con 0x7f717c108220 2024-08-28T19:29:59.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.984+0000 7f71797fa640 1 -- 172.21.15.33:0/2222858452 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11839 (secure 0 0 0) 0x7f717c102cf0 con 0x7f717c108220 2024-08-28T19:29:59.986 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:29:59.986 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"btime":"2024-08-28T19:29:58:278908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14799,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14805,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:29:58.157880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24658,"qdb_cluster":[24658]},"id":1}]} 2024-08-28T19:29:59.986 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-08-28T19:29:59.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 -- 172.21.15.33:0/2222858452 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71640b4b80 msgr2=0x7f71640b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:59.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71640b4b80 0x7f71640b7090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f716c0058c0 tx=0x7f716c005850 comp rx=0 tx=0).stop 2024-08-28T19:29:59.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 -- 172.21.15.33:0/2222858452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f717c108220 msgr2=0x7f717c19a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:29:59.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f717c108220 0x7f717c19a7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7170032fd0 tx=0x7f7170004270 comp rx=0 tx=0).stop 2024-08-28T19:29:59.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 -- 172.21.15.33:0/2222858452 shutdown_connections 2024-08-28T19:29:59.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717c108b70 0x7f717c19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:59.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f717c108220 0x7f717c19a7a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:59.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71640b4b80 0x7f71640b7090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:59.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 --2- 172.21.15.33:0/2222858452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f717c1028e0 0x7f717c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:29:59.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 -- 172.21.15.33:0/2222858452 >> 172.21.15.33:0/2222858452 conn(0x7f717c0794f0 msgr2=0x7f717c1018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:29:59.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 -- 172.21.15.33:0/2222858452 shutdown_connections 2024-08-28T19:29:59.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:29:59.987+0000 7f7182312640 1 -- 172.21.15.33:0/2222858452 wait complete. 2024-08-28T19:30:00.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:00 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2222858452' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:30:00.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:00 smithi033 ceph-mon[18549]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-08-28T19:30:00.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:00 smithi033 ceph-mon[18549]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-08-28T19:30:00.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:00 smithi033 ceph-mon[18549]: application not enabled on pool 'cephfs_data_ec' 2024-08-28T19:30:00.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:00 smithi033 ceph-mon[18549]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-08-28T19:30:00.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:30:00.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:00 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2222858452' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:30:00.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:00 smithi059 ceph-mon[22052]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-08-28T19:30:00.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:00 smithi059 ceph-mon[22052]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-08-28T19:30:00.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:00 smithi059 ceph-mon[22052]: application not enabled on pool 'cephfs_data_ec' 2024-08-28T19:30:00.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:00 smithi059 ceph-mon[22052]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-08-28T19:30:00.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:00 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2222858452' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:30:00.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:00 smithi122 ceph-mon[22174]: Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled 2024-08-28T19:30:00.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:00 smithi122 ceph-mon[22174]: [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-08-28T19:30:00.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:00 smithi122 ceph-mon[22174]: application not enabled on pool 'cephfs_data_ec' 2024-08-28T19:30:00.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:00 smithi122 ceph-mon[22174]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-08-28T19:30:00.921 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.463+0000 7ff69bfbb640 1 -- 172.21.15.33:0/1045438113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff69410db90 msgr2=0x7ff6941100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.463+0000 7ff69bfbb640 1 --2- 172.21.15.33:0/1045438113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff69410db90 0x7ff6941100a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009ca0 tx=0x7ff68c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.463+0000 7ff69bfbb640 1 -- 172.21.15.33:0/1045438113 shutdown_connections 2024-08-28T19:30:01.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.463+0000 7ff69bfbb640 1 --2- 172.21.15.33:0/1045438113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff69410db90 0x7ff6941100a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:01.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.463+0000 7ff69bfbb640 1 --2- 172.21.15.33:0/1045438113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff694105010 0x7ff69410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:01.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.463+0000 7ff69bfbb640 1 --2- 172.21.15.33:0/1045438113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6941045e0 0x7ff6941049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:01.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.463+0000 7ff69bfbb640 1 -- 172.21.15.33:0/1045438113 >> 172.21.15.33:0/1045438113 conn(0x7ff6940794d0 msgr2=0x7ff6940798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:01.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.463+0000 7ff69bfbb640 1 -- 172.21.15.33:0/1045438113 shutdown_connections 2024-08-28T19:30:01.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.463+0000 7ff69bfbb640 1 -- 172.21.15.33:0/1045438113 wait complete. 2024-08-28T19:30:01.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff69bfbb640 1 Processor -- start 2024-08-28T19:30:01.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff69bfbb640 1 -- start start 2024-08-28T19:30:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff69bfbb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6941045e0 0x7ff69419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff69bfbb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff694105010 0x7ff69419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff69bfbb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff69410db90 0x7ff69419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff69bfbb640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff694113830 con 0x7ff6941045e0 2024-08-28T19:30:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff69bfbb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff6941136b0 con 0x7ff694105010 2024-08-28T19:30:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff69bfbb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff6941139b0 con 0x7ff69410db90 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff699d57640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6941045e0 0x7ff69419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff699d57640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6941045e0 0x7ff69419a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41996/0 (socket says 172.21.15.33:41996) 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff699d57640 1 -- 172.21.15.33:0/827776283 learned_addr learned my addr 172.21.15.33:0/827776283 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff699556640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff694105010 0x7ff69419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff69a558640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff69410db90 0x7ff69419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff699d57640 1 -- 172.21.15.33:0/827776283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff69410db90 msgr2=0x7ff69419faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff699d57640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff69410db90 0x7ff69419faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff699d57640 1 -- 172.21.15.33:0/827776283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff694105010 msgr2=0x7ff69419a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff699d57640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff694105010 0x7ff69419a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff699d57640 1 -- 172.21.15.33:0/827776283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6941a01d0 con 0x7ff6941045e0 2024-08-28T19:30:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.464+0000 7ff69a558640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff69410db90 0x7ff69419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:01.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.465+0000 7ff699d57640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6941045e0 0x7ff69419a260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff69000c970 tx=0x7ff69000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:01.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.465+0000 7ff686ffd640 1 -- 172.21.15.33:0/827776283 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690004220 con 0x7ff6941045e0 2024-08-28T19:30:01.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.465+0000 7ff69bfbb640 1 -- 172.21.15.33:0/827776283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6941a04c0 con 0x7ff6941045e0 2024-08-28T19:30:01.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.465+0000 7ff686ffd640 1 -- 172.21.15.33:0/827776283 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6900043c0 con 0x7ff6941045e0 2024-08-28T19:30:01.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.465+0000 7ff686ffd640 1 -- 172.21.15.33:0/827776283 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69000f450 con 0x7ff6941045e0 2024-08-28T19:30:01.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.465+0000 7ff69bfbb640 1 -- 172.21.15.33:0/827776283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6941a6c20 con 0x7ff6941045e0 2024-08-28T19:30:01.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.466+0000 7ff69bfbb640 1 -- 172.21.15.33:0/827776283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6941049f0 con 0x7ff6941045e0 2024-08-28T19:30:01.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.468+0000 7ff686ffd640 1 -- 172.21.15.33:0/827776283 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7ff690003610 con 0x7ff6941045e0 2024-08-28T19:30:01.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.468+0000 7ff686ffd640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6800b4b80 0x7ff6800b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:01.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.468+0000 7ff699556640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6800b4b80 0x7ff6800b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:01.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.469+0000 7ff686ffd640 1 -- 172.21.15.33:0/827776283 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7ff6900e5250 con 0x7ff6941045e0 2024-08-28T19:30:01.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.469+0000 7ff699556640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6800b4b80 0x7ff6800b7090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff69410f810 tx=0x7ff68800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:01.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.473+0000 7ff686ffd640 1 -- 172.21.15.33:0/827776283 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff690014030 con 0x7ff6941045e0 2024-08-28T19:30:01.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:01 smithi033 ceph-mon[18549]: pgmap v265: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:01.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:01 smithi033 ceph-mon[18549]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-28T19:30:01.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:01 smithi033 ceph-mon[18549]: Cluster is now healthy 2024-08-28T19:30:01.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.658+0000 7ff69bfbb640 1 -- 172.21.15.33:0/827776283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff69419b390 con 0x7ff6941045e0 2024-08-28T19:30:01.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.659+0000 7ff686ffd640 1 -- 172.21.15.33:0/827776283 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24471 (secure 0 0 0) 0x7ff6900ac070 con 0x7ff6941045e0 2024-08-28T19:30:01.661 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:01.661 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:29:58.157698+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:30:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 -- 172.21.15.33:0/827776283 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6800b4b80 msgr2=0x7ff6800b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6800b4b80 0x7ff6800b7090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff69410f810 tx=0x7ff68800b390 comp rx=0 tx=0).stop 2024-08-28T19:30:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 -- 172.21.15.33:0/827776283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6941045e0 msgr2=0x7ff69419a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6941045e0 0x7ff69419a260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff69000c970 tx=0x7ff69000ce30 comp rx=0 tx=0).stop 2024-08-28T19:30:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 -- 172.21.15.33:0/827776283 shutdown_connections 2024-08-28T19:30:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6800b4b80 0x7ff6800b7090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff69410db90 0x7ff69419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff694105010 0x7ff69419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 --2- 172.21.15.33:0/827776283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6941045e0 0x7ff69419a260 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 -- 172.21.15.33:0/827776283 >> 172.21.15.33:0/827776283 conn(0x7ff6940794d0 msgr2=0x7ff694107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 -- 172.21.15.33:0/827776283 shutdown_connections 2024-08-28T19:30:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:01.662+0000 7ff69bfbb640 1 -- 172.21.15.33:0/827776283 wait complete. 2024-08-28T19:30:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:01 smithi059 ceph-mon[22052]: pgmap v265: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:01 smithi059 ceph-mon[22052]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-28T19:30:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:01 smithi059 ceph-mon[22052]: Cluster is now healthy 2024-08-28T19:30:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:01 smithi122 ceph-mon[22174]: pgmap v265: 129 pgs: 1 creating+peering, 128 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:01 smithi122 ceph-mon[22174]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-28T19:30:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:01 smithi122 ceph-mon[22174]: Cluster is now healthy 2024-08-28T19:30:02.386 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:30:02.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:02 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/827776283' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:02.643 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:02.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:02 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/827776283' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:02 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/827776283' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:03.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.113+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/2707644624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c78105930 msgr2=0x7f0c7810f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:03.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.113+0000 7f0c7d6f0640 1 --2- 172.21.15.33:0/2707644624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c78105930 0x7f0c7810f380 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009ca0 tx=0x7f0c7002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:03.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.113+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/2707644624 shutdown_connections 2024-08-28T19:30:03.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.113+0000 7f0c7d6f0640 1 --2- 172.21.15.33:0/2707644624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c78105930 0x7f0c7810f380 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:03.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.113+0000 7f0c7d6f0640 1 --2- 172.21.15.33:0/2707644624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c78104fe0 0x7f0c781053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:03.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.113+0000 7f0c7d6f0640 1 --2- 172.21.15.33:0/2707644624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c78103010 0x7f0c78103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:03.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.113+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/2707644624 >> 172.21.15.33:0/2707644624 conn(0x7f0c78079c60 msgr2=0x7f0c7807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:03.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.113+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/2707644624 shutdown_connections 2024-08-28T19:30:03.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.113+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/2707644624 wait complete. 2024-08-28T19:30:03.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c7d6f0640 1 Processor -- start 2024-08-28T19:30:03.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c7d6f0640 1 -- start start 2024-08-28T19:30:03.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c7d6f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c78103010 0x7f0c781a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c7d6f0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c78104fe0 0x7f0c781a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c7d6f0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c78105930 0x7f0c781a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c7d6f0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0c78113930 con 0x7f0c78105930 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c7d6f0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0c781137b0 con 0x7f0c78103010 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c7d6f0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0c78113ab0 con 0x7f0c78104fe0 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c777fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c78105930 0x7f0c781a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c777fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c78105930 0x7f0c781a20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42024/0 (socket says 172.21.15.33:42024) 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c777fe640 1 -- 172.21.15.33:0/3092174013 learned_addr learned my addr 172.21.15.33:0/3092174013 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c76ffd640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c78103010 0x7f0c781a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.114+0000 7f0c6ffff640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c78104fe0 0x7f0c781a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:03.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c777fe640 1 -- 172.21.15.33:0/3092174013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c78104fe0 msgr2=0x7f0c781a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:03.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c777fe640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c78104fe0 0x7f0c781a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:03.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c777fe640 1 -- 172.21.15.33:0/3092174013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c78103010 msgr2=0x7f0c781a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:03.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c777fe640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c78103010 0x7f0c781a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:03.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c777fe640 1 -- 172.21.15.33:0/3092174013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c781ac950 con 0x7f0c78105930 2024-08-28T19:30:03.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c777fe640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c78105930 0x7f0c781a20b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005cc0 tx=0x7f0c7002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:03.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c74ff9640 1 -- 172.21.15.33:0/3092174013 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70003bf0 con 0x7f0c78105930 2024-08-28T19:30:03.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c74ff9640 1 -- 172.21.15.33:0/3092174013 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c70003d90 con 0x7f0c78105930 2024-08-28T19:30:03.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c74ff9640 1 -- 172.21.15.33:0/3092174013 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7002fb20 con 0x7f0c78105930 2024-08-28T19:30:03.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/3092174013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c781acbe0 con 0x7f0c78105930 2024-08-28T19:30:03.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.115+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/3092174013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c781ad120 con 0x7f0c78105930 2024-08-28T19:30:03.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.116+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/3092174013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c78103420 con 0x7f0c78105930 2024-08-28T19:30:03.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.117+0000 7f0c74ff9640 1 -- 172.21.15.33:0/3092174013 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f0c70004580 con 0x7f0c78105930 2024-08-28T19:30:03.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.118+0000 7f0c74ff9640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c640b4b80 0x7f0c640b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:03.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.118+0000 7f0c76ffd640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c640b4b80 0x7f0c640b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:03.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.118+0000 7f0c74ff9640 1 -- 172.21.15.33:0/3092174013 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f0c70106800 con 0x7f0c78105930 2024-08-28T19:30:03.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.119+0000 7f0c76ffd640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c640b4b80 0x7f0c640b7090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0c7810f3b0 tx=0x7f0c6800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:03.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.123+0000 7f0c74ff9640 1 -- 172.21.15.33:0/3092174013 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0c700cd5c0 con 0x7f0c78105930 2024-08-28T19:30:03.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.313+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/3092174013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c781ad450 con 0x7f0c78105930 2024-08-28T19:30:03.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.314+0000 7f0c74ff9640 1 -- 172.21.15.33:0/3092174013 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24471 (secure 0 0 0) 0x7f0c700ccec0 con 0x7f0c78105930 2024-08-28T19:30:03.316 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:03.317 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:29:58.157698+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:30:03.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/3092174013 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c640b4b80 msgr2=0x7f0c640b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:03.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c640b4b80 0x7f0c640b7090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0c7810f3b0 tx=0x7f0c6800b410 comp rx=0 tx=0).stop 2024-08-28T19:30:03.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/3092174013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c78105930 msgr2=0x7f0c781a20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:03.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c78105930 0x7f0c781a20b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0c70005cc0 tx=0x7f0c7002f380 comp rx=0 tx=0).stop 2024-08-28T19:30:03.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/3092174013 shutdown_connections 2024-08-28T19:30:03.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c78105930 0x7f0c781a20b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:03.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c640b4b80 0x7f0c640b7090 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:03.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c78104fe0 0x7f0c781a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:03.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 --2- 172.21.15.33:0/3092174013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c78103010 0x7f0c781a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:03.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/3092174013 >> 172.21.15.33:0/3092174013 conn(0x7f0c78079c60 msgr2=0x7f0c78106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:03.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/3092174013 shutdown_connections 2024-08-28T19:30:03.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:03.316+0000 7f0c7d6f0640 1 -- 172.21.15.33:0/3092174013 wait complete. 2024-08-28T19:30:03.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:03 smithi033 ceph-mon[18549]: pgmap v266: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:03.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:03 smithi059 ceph-mon[22052]: pgmap v266: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:03 smithi122 ceph-mon[22174]: pgmap v266: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:04.019 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:30:04.277 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:04.566 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:04 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3092174013' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:04.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:04 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3092174013' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:04.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:04 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3092174013' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:04.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.773+0000 7f3e852a7640 1 -- 172.21.15.33:0/197327187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e80101fe0 msgr2=0x7f3e801023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:04.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.773+0000 7f3e852a7640 1 --2- 172.21.15.33:0/197327187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e80101fe0 0x7f3e801023f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000aa10 tx=0x7f3e7002b720 comp rx=0 tx=0).stop 2024-08-28T19:30:04.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.773+0000 7f3e852a7640 1 -- 172.21.15.33:0/197327187 shutdown_connections 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.773+0000 7f3e852a7640 1 --2- 172.21.15.33:0/197327187 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e80108270 0x7f3e8010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.773+0000 7f3e852a7640 1 --2- 172.21.15.33:0/197327187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e80107920 0x7f3e80107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.773+0000 7f3e852a7640 1 --2- 172.21.15.33:0/197327187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e80101fe0 0x7f3e801023f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.773+0000 7f3e852a7640 1 -- 172.21.15.33:0/197327187 >> 172.21.15.33:0/197327187 conn(0x7f3e80079d30 msgr2=0x7f3e8007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.773+0000 7f3e852a7640 1 -- 172.21.15.33:0/197327187 shutdown_connections 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.773+0000 7f3e852a7640 1 -- 172.21.15.33:0/197327187 wait complete. 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e852a7640 1 Processor -- start 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e852a7640 1 -- start start 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e852a7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e80101fe0 0x7f3e801980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e852a7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e80107920 0x7f3e80198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:04.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e852a7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e80108270 0x7f3e8019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e852a7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e801116b0 con 0x7f3e80108270 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e852a7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e80111530 con 0x7f3e80101fe0 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e852a7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e80111830 con 0x7f3e80107920 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e7f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e80108270 0x7f3e8019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e7f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e80108270 0x7f3e8019d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42032/0 (socket says 172.21.15.33:42032) 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e7f7fe640 1 -- 172.21.15.33:0/3053157649 learned_addr learned my addr 172.21.15.33:0/3053157649 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e7effd640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e80101fe0 0x7f3e801980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.774+0000 7f3e7e7fc640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e80107920 0x7f3e80198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e7f7fe640 1 -- 172.21.15.33:0/3053157649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e80107920 msgr2=0x7f3e80198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e7f7fe640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e80107920 0x7f3e80198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e7f7fe640 1 -- 172.21.15.33:0/3053157649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e80101fe0 msgr2=0x7f3e801980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e7f7fe640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e80101fe0 0x7f3e801980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e7f7fe640 1 -- 172.21.15.33:0/3053157649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8019df50 con 0x7f3e80108270 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e7e7fc640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e80107920 0x7f3e80198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e7f7fe640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e80108270 0x7f3e8019d8e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800cce0 tx=0x7f3e7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e67fff640 1 -- 172.21.15.33:0/3053157649 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7800f450 con 0x7f3e80108270 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e67fff640 1 -- 172.21.15.33:0/3053157649 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e7800faa0 con 0x7f3e80108270 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e67fff640 1 -- 172.21.15.33:0/3053157649 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78018b70 con 0x7f3e80108270 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e852a7640 1 -- 172.21.15.33:0/3053157649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8019e240 con 0x7f3e80108270 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.775+0000 7f3e852a7640 1 -- 172.21.15.33:0/3053157649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e801a4a60 con 0x7f3e80108270 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.776+0000 7f3e852a7640 1 -- 172.21.15.33:0/3053157649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e801023f0 con 0x7f3e80108270 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.778+0000 7f3e67fff640 1 -- 172.21.15.33:0/3053157649 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f3e78018d10 con 0x7f3e80108270 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.778+0000 7f3e67fff640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e680b4c30 0x7f3e680b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.779+0000 7f3e7effd640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e680b4c30 0x7f3e680b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.779+0000 7f3e67fff640 1 -- 172.21.15.33:0/3053157649 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f3e780e58d0 con 0x7f3e80108270 2024-08-28T19:30:04.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.779+0000 7f3e7effd640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e680b4c30 0x7f3e680b7140 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e70030550 tx=0x7f3e70005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:04.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:04.782+0000 7f3e67fff640 1 -- 172.21.15.33:0/3053157649 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3e78014030 con 0x7f3e80108270 2024-08-28T19:30:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.006+0000 7f3e852a7640 1 -- 172.21.15.33:0/3053157649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e801991d0 con 0x7f3e80108270 2024-08-28T19:30:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.007+0000 7f3e67fff640 1 -- 172.21.15.33:0/3053157649 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11839 (secure 0 0 0) 0x7f3e801991d0 con 0x7f3e80108270 2024-08-28T19:30:05.009 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:05.009 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"btime":"2024-08-28T19:29:58:278908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14799,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14805,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24620,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:29:58.157880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24658,"qdb_cluster":[24658]},"id":1}]} 2024-08-28T19:30:05.010 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2024-08-28T19:30:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 -- 172.21.15.33:0/3053157649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e680b4c30 msgr2=0x7f3e680b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e680b4c30 0x7f3e680b7140 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e70030550 tx=0x7f3e70005e80 comp rx=0 tx=0).stop 2024-08-28T19:30:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 -- 172.21.15.33:0/3053157649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e80108270 msgr2=0x7f3e8019d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e80108270 0x7f3e8019d8e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800cce0 tx=0x7f3e7800a620 comp rx=0 tx=0).stop 2024-08-28T19:30:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 -- 172.21.15.33:0/3053157649 shutdown_connections 2024-08-28T19:30:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e80108270 0x7f3e8019d8e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e680b4c30 0x7f3e680b7140 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e80107920 0x7f3e80198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 --2- 172.21.15.33:0/3053157649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e80101fe0 0x7f3e801980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 -- 172.21.15.33:0/3053157649 >> 172.21.15.33:0/3053157649 conn(0x7f3e80079d30 msgr2=0x7f3e80105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 -- 172.21.15.33:0/3053157649 shutdown_connections 2024-08-28T19:30:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:05.009+0000 7f3e852a7640 1 -- 172.21.15.33:0/3053157649 wait complete. 2024-08-28T19:30:05.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:05 smithi033 ceph-mon[18549]: pgmap v267: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:05.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:05 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3053157649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:30:05.654 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:30:05.684 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:05 smithi059 ceph-mon[22052]: pgmap v267: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:05.684 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:05 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3053157649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:30:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:05 smithi122 ceph-mon[22174]: pgmap v267: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:05 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3053157649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:30:05.908 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.415+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/412181511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b4108140 msgr2=0x7fa3b4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.415+0000 7fa3bb7b9640 1 --2- 172.21.15.33:0/412181511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b4108140 0x7fa3b4108550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009900 tx=0x7fa3a402a410 comp rx=0 tx=0).stop 2024-08-28T19:30:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.415+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/412181511 shutdown_connections 2024-08-28T19:30:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.415+0000 7fa3bb7b9640 1 --2- 172.21.15.33:0/412181511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4108a90 0x7fa3b410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.415+0000 7fa3bb7b9640 1 --2- 172.21.15.33:0/412181511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b4108140 0x7fa3b4108550 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:06.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.415+0000 7fa3bb7b9640 1 --2- 172.21.15.33:0/412181511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b4102800 0x7fa3b4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.415+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/412181511 >> 172.21.15.33:0/412181511 conn(0x7fa3b40794d0 msgr2=0x7fa3b40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.415+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/412181511 shutdown_connections 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.415+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/412181511 wait complete. 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3bb7b9640 1 Processor -- start 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3bb7b9640 1 -- start start 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3bb7b9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b4102800 0x7fa3b419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3bb7b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4108140 0x7fa3b419b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3bb7b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b4108a90 0x7fa3b419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3bb7b9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b41126c0 con 0x7fa3b4102800 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3bb7b9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b4112540 con 0x7fa3b4108a90 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3bb7b9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b4112840 con 0x7fa3b4108140 2024-08-28T19:30:06.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3b9555640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b4102800 0x7fa3b419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3b9555640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b4102800 0x7fa3b419b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42050/0 (socket says 172.21.15.33:42050) 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3b9d56640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b4108a90 0x7fa3b419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3b9555640 1 -- 172.21.15.33:0/1811437087 learned_addr learned my addr 172.21.15.33:0/1811437087 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3b8d54640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4108140 0x7fa3b419b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3b9555640 1 -- 172.21.15.33:0/1811437087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4108140 msgr2=0x7fa3b419b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3b9555640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4108140 0x7fa3b419b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3b9555640 1 -- 172.21.15.33:0/1811437087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b4108a90 msgr2=0x7fa3b419bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3b9555640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b4108a90 0x7fa3b419bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.416+0000 7fa3b9555640 1 -- 172.21.15.33:0/1811437087 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b41a62d0 con 0x7fa3b4102800 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.417+0000 7fa3b9555640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b4102800 0x7fa3b419b0d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c920 tx=0x7fa3b000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.417+0000 7fa3aa7fc640 1 -- 172.21.15.33:0/1811437087 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0007c70 con 0x7fa3b4102800 2024-08-28T19:30:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.417+0000 7fa3aa7fc640 1 -- 172.21.15.33:0/1811437087 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3b0007e10 con 0x7fa3b4102800 2024-08-28T19:30:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.417+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/1811437087 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b41a65c0 con 0x7fa3b4102800 2024-08-28T19:30:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.417+0000 7fa3aa7fc640 1 -- 172.21.15.33:0/1811437087 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0018820 con 0x7fa3b4102800 2024-08-28T19:30:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.417+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/1811437087 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b41a6b20 con 0x7fa3b4102800 2024-08-28T19:30:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.418+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/1811437087 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b4102c10 con 0x7fa3b4102800 2024-08-28T19:30:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.420+0000 7fa3aa7fc640 1 -- 172.21.15.33:0/1811437087 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fa3b000f450 con 0x7fa3b4102800 2024-08-28T19:30:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.421+0000 7fa3aa7fc640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3a00b4c30 0x7fa3a00b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.421+0000 7fa3b8d54640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3a00b4c30 0x7fa3a00b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.422+0000 7fa3aa7fc640 1 -- 172.21.15.33:0/1811437087 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7fa3b00e5730 con 0x7fa3b4102800 2024-08-28T19:30:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.422+0000 7fa3b8d54640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3a00b4c30 0x7fa3a00b7140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4000c00 tx=0x7fa3a4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.424+0000 7fa3aa7fc640 1 -- 172.21.15.33:0/1811437087 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa3b0014030 con 0x7fa3b4102800 2024-08-28T19:30:06.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.614+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/1811437087 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3b406b010 con 0x7fa3b4102800 2024-08-28T19:30:06.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.615+0000 7fa3aa7fc640 1 -- 172.21.15.33:0/1811437087 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24471 (secure 0 0 0) 0x7fa3b00ac660 con 0x7fa3b4102800 2024-08-28T19:30:06.618 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:06.618 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:29:58.157698+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:30:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.618+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/1811437087 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3a00b4c30 msgr2=0x7fa3a00b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.618+0000 7fa3bb7b9640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3a00b4c30 0x7fa3a00b7140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4000c00 tx=0x7fa3a4031400 comp rx=0 tx=0).stop 2024-08-28T19:30:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.618+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/1811437087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b4102800 msgr2=0x7fa3b419b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.618+0000 7fa3bb7b9640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b4102800 0x7fa3b419b0d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c920 tx=0x7fa3b000cde0 comp rx=0 tx=0).stop 2024-08-28T19:30:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.618+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/1811437087 shutdown_connections 2024-08-28T19:30:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.618+0000 7fa3bb7b9640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b4108a90 0x7fa3b419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.618+0000 7fa3bb7b9640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3a00b4c30 0x7fa3a00b7140 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.618+0000 7fa3bb7b9640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3b4108140 0x7fa3b419b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.618+0000 7fa3bb7b9640 1 --2- 172.21.15.33:0/1811437087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b4102800 0x7fa3b419b0d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.618+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/1811437087 >> 172.21.15.33:0/1811437087 conn(0x7fa3b40794d0 msgr2=0x7fa3b41050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:06.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.619+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/1811437087 shutdown_connections 2024-08-28T19:30:06.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:06.619+0000 7fa3bb7b9640 1 -- 172.21.15.33:0/1811437087 wait complete. 2024-08-28T19:30:07.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-28T19:29:48.755873+0000', 'modified': '2024-08-28T19:29:58.157880+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24658}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24658': {'gid': 24658, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.122:6839/2515249026', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 2515249026}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 2515249026}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24658, 'qdb_cluster': [24658]} 2024-08-28T19:30:07.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-28T19:30:07.316 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-28T19:30:07.575 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:07.596 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:07 smithi122 ceph-mon[22174]: pgmap v268: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:07.596 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:07 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1811437087' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:07.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:07 smithi033 ceph-mon[18549]: pgmap v268: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:07.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:07 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1811437087' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:07.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:07 smithi059 ceph-mon[22052]: pgmap v268: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:07.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:07 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1811437087' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.078+0000 7f871e4c5640 1 -- 172.21.15.33:0/1568965288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8718102840 msgr2=0x7f8718102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.078+0000 7f871e4c5640 1 --2- 172.21.15.33:0/1568965288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8718102840 0x7f8718102c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8708009900 tx=0x7f870802a410 comp rx=0 tx=0).stop 2024-08-28T19:30:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.078+0000 7f871e4c5640 1 -- 172.21.15.33:0/1568965288 shutdown_connections 2024-08-28T19:30:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.078+0000 7f871e4c5640 1 --2- 172.21.15.33:0/1568965288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8718108ad0 0x7f871810f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.078+0000 7f871e4c5640 1 --2- 172.21.15.33:0/1568965288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718108180 0x7f8718108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.078+0000 7f871e4c5640 1 --2- 172.21.15.33:0/1568965288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8718102840 0x7f8718102c50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.078+0000 7f871e4c5640 1 -- 172.21.15.33:0/1568965288 >> 172.21.15.33:0/1568965288 conn(0x7f87180794f0 msgr2=0x7f8718079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.078+0000 7f871e4c5640 1 -- 172.21.15.33:0/1568965288 shutdown_connections 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.078+0000 7f871e4c5640 1 -- 172.21.15.33:0/1568965288 wait complete. 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.079+0000 7f871e4c5640 1 Processor -- start 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.079+0000 7f871e4c5640 1 -- start start 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f871e4c5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8718102840 0x7f8718199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f871e4c5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8718108180 0x7f87181997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f871e4c5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718108ad0 0x7f871819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f871e4c5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f87181127a0 con 0x7f8718108180 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f871e4c5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8718112620 con 0x7f8718108ad0 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f871e4c5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8718112920 con 0x7f8718102840 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f87177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8718108180 0x7f87181997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f87177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8718108180 0x7f87181997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42060/0 (socket says 172.21.15.33:42060) 2024-08-28T19:30:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f87177fe640 1 -- 172.21.15.33:0/478693108 learned_addr learned my addr 172.21.15.33:0/478693108 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f871ca62640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718108ad0 0x7f871819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f8717fff640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8718102840 0x7f8718199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f87177fe640 1 -- 172.21.15.33:0/478693108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8718102840 msgr2=0x7f8718199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f87177fe640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8718102840 0x7f8718199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f87177fe640 1 -- 172.21.15.33:0/478693108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718108ad0 msgr2=0x7f871819ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f87177fe640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718108ad0 0x7f871819ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f87177fe640 1 -- 172.21.15.33:0/478693108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871819f180 con 0x7f8718108180 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f871ca62640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718108ad0 0x7f871819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.080+0000 7f87177fe640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8718108180 0x7f87181997b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f870c00c970 tx=0x7f870c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.081+0000 7f87157fa640 1 -- 172.21.15.33:0/478693108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c007bb0 con 0x7f8718108180 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.081+0000 7f871e4c5640 1 -- 172.21.15.33:0/478693108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871819f470 con 0x7f8718108180 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.081+0000 7f87157fa640 1 -- 172.21.15.33:0/478693108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f870c007d50 con 0x7f8718108180 2024-08-28T19:30:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.081+0000 7f87157fa640 1 -- 172.21.15.33:0/478693108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c00f450 con 0x7f8718108180 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.081+0000 7f871e4c5640 1 -- 172.21.15.33:0/478693108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87181a5bd0 con 0x7f8718108180 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.083+0000 7f8724a3a740 1 Processor -- start 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.083+0000 7f8724a3a740 1 -- start start 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.083+0000 7f87157fa640 1 -- 172.21.15.33:0/478693108 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f870c004eb0 con 0x7f8718108180 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.083+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec60f60 0x5598cf0067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.083+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec380a0 0x5598cf006cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.083+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 0x5598cf007230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f8724a3a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5598cef7d3f0 con 0x5598cec60f60 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f8724a3a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5598cef6c980 con 0x5598cec380a0 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f8724a3a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5598cef70930 con 0x5598cec40280 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f871ca62640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec60f60 0x5598cf0067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f871ca62640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec60f60 0x5598cf0067b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42072/0 (socket says 172.21.15.33:42072) 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f871ca62640 1 -- 172.21.15.33:0/17510639 learned_addr learned my addr 172.21.15.33:0/17510639 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f87177fe640 1 --2- 172.21.15.33:0/17510639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 0x5598cf007230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f8717fff640 1 --2- 172.21.15.33:0/17510639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec380a0 0x5598cf006cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f871ca62640 1 -- 172.21.15.33:0/17510639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 msgr2=0x5598cf007230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f871ca62640 1 --2- 172.21.15.33:0/17510639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 0x5598cf007230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f871ca62640 1 -- 172.21.15.33:0/17510639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec380a0 msgr2=0x5598cf006cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f871ca62640 1 --2- 172.21.15.33:0/17510639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec380a0 0x5598cf006cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f871ca62640 1 -- 172.21.15.33:0/17510639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ceccc540 con 0x5598cec60f60 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f871ca62640 1 --2- 172.21.15.33:0/17510639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec60f60 0x5598cf0067b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f871000ae80 tx=0x7f871000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f308a51f2d026363 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f86fe7fc640 1 -- 172.21.15.33:0/17510639 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710003b70 con 0x5598cec60f60 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f86fe7fc640 1 -- 172.21.15.33:0/17510639 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8710003d10 con 0x5598cec60f60 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f86fe7fc640 1 -- 172.21.15.33:0/17510639 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710010a00 con 0x5598cec60f60 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.084+0000 7f87157fa640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87000b4b80 0x7f87000b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.085+0000 7f8717fff640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87000b4b80 0x7f87000b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.085+0000 7f87157fa640 1 -- 172.21.15.33:0/478693108 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f870c0e51a0 con 0x7f8718108180 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.085+0000 7f8717fff640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87000b4b80 0x7f87000b7090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8708031440 tx=0x7f8708009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.085+0000 7f8724a3a740 1 -- 172.21.15.33:0/17510639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec60f60 msgr2=0x5598cf0067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.085+0000 7f8724a3a740 1 --2- 172.21.15.33:0/17510639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec60f60 0x5598cf0067b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f871000ae80 tx=0x7f871000e720 comp rx=0 tx=0).stop 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.085+0000 7f8724a3a740 1 -- 172.21.15.33:0/17510639 shutdown_connections 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.085+0000 7f8724a3a740 1 --2- 172.21.15.33:0/17510639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 0x5598cf007230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.085+0000 7f8724a3a740 1 --2- 172.21.15.33:0/17510639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec380a0 0x5598cf006cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.085+0000 7f8724a3a740 1 --2- 172.21.15.33:0/17510639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec60f60 0x5598cf0067b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.085+0000 7f8724a3a740 1 -- 172.21.15.33:0/17510639 >> 172.21.15.33:0/17510639 conn(0x5598cec55350 msgr2=0x5598cf0046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.086+0000 7f8724a3a740 1 -- 172.21.15.33:0/17510639 shutdown_connections 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.086+0000 7f8724a3a740 1 -- 172.21.15.33:0/17510639 wait complete. 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.086+0000 7f8724a3a740 1 -- start start 2024-08-28T19:30:08.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.086+0000 7f8724a3a740 1 Processor -- start 2024-08-28T19:30:08.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.086+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf011e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.086+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 0x5598cf012340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.086+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec60f60 0x5598cf0128a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8724a3a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5598cedcf5f0 con 0x5598cec380a0 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8724a3a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5598ceef3600 con 0x5598cec60f60 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8724a3a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5598cf0171a0 con 0x5598cec40280 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8724a3a740 10 client.0 _ll_register_callbacks cb 0x5598cef19af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8717fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf011e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8717fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf011e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42084/0 (socket says 172.21.15.33:42084) 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8717fff640 1 -- 172.21.15.33:0/2674496115 learned_addr learned my addr 172.21.15.33:0/2674496115 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f871ca62640 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec60f60 0x5598cf0128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f87177fe640 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 0x5598cf012340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8717fff640 1 -- 172.21.15.33:0/2674496115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 msgr2=0x5598cf012340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8717fff640 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 0x5598cf012340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8717fff640 1 -- 172.21.15.33:0/2674496115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec60f60 msgr2=0x5598cf0128a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8717fff640 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec60f60 0x5598cf0128a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8717fff640 1 -- 172.21.15.33:0/2674496115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598cef2c7b0 con 0x5598cec380a0 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f87177fe640 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 0x5598cf012340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f871ca62640 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec60f60 0x5598cf0128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f8717fff640 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf011e00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8708009900 tx=0x7f8708009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d7b763df33e762 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f86f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.087+0000 7f86f77fe640 1 -- 172.21.15.33:0/2674496115 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870804c030 con 0x5598cec380a0 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f8724a3a740 1 -- 172.21.15.33:0/2674496115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8710003d10 con 0x5598cec380a0 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f86f77fe640 1 -- 172.21.15.33:0/2674496115 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f8708004450 con 0x5598cec380a0 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f86f77fe640 1 -- 172.21.15.33:0/2674496115 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8708035040 con 0x5598cec380a0 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f8724a3a740 10 client.14910 fetch_fsmap learned FSMap version 16 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f8724a3a740 1 -- 172.21.15.33:0/2674496115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x5598cf022ea0 con 0x5598cec380a0 2024-08-28T19:30:08.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f86f77fe640 1 -- 172.21.15.33:0/2674496115 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8710003d10 con 0x5598cec380a0 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f86f77fe640 1 -- 172.21.15.33:0/2674496115 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f87080487e0 con 0x5598cec380a0 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f8724a3a740 10 client.14910 fetch_fsmap finished waiting for FSMap version 16 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f8724a3a740 10 client.14910 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f8724a3a740 20 client.14910 populate_metadata read hostname 'smithi033' 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f8724a3a740 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598cec1f8e0 0x5598cf026940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f8724a3a740 4 client.14910 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f8724a3a740 1 -- 172.21.15.33:0/2674496115 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598cef7f340 con 0x5598cec1f8e0 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.088+0000 7f87177fe640 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598cec1f8e0 0x5598cf026940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.089+0000 7f86f77fe640 10 client.14910 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.089+0000 7f87177fe640 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598cec1f8e0 0x5598cf026940 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1819797200ad9ea server_cookie=7091caaaa4db907f in_seq=0 out_seq=0 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f86f77fe640 1 -- 172.21.15.33:0/2674496115 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598cef7f340 con 0x5598cec1f8e0 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f86f77fe640 10 client.14910 handle_command_reply: tid=0 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 client.14910 shutdown 2024-08-28T19:30:08.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 -- 172.21.15.33:0/2674496115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 msgr2=0x5598cf011e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf011e00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8708009900 tx=0x7f8708009260 comp rx=0 tx=0).stop 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 -- 172.21.15.33:0/2674496115 shutdown_connections 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec60f60 0x5598cf0128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec40280 0x5598cf012340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598cec1f8e0 0x5598cf026940 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 --2- 172.21.15.33:0/2674496115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf011e00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 -- 172.21.15.33:0/2674496115 >> 172.21.15.33:0/2674496115 conn(0x5598cec55350 msgr2=0x5598cf009990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f86f77fe640 0 client.14910 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 -- 172.21.15.33:0/2674496115 shutdown_connections 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 1 -- 172.21.15.33:0/2674496115 wait complete. 2024-08-28T19:30:08.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.090+0000 7f8724a3a740 20 client.14910 trim_cache size 0 max 16384 2024-08-28T19:30:08.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.108+0000 7f8724a3a740 1 Processor -- start 2024-08-28T19:30:08.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8724a3a740 1 -- start start 2024-08-28T19:30:08.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf024310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec40280 0x5598cf010680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec60f60 0x5598cf010bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8724a3a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5598cf024c80 con 0x5598cec380a0 2024-08-28T19:30:08.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8724a3a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5598cf025350 con 0x5598cec40280 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8724a3a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5598cf025a20 con 0x5598cec60f60 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8717fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf024310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8717fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf024310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42098/0 (socket says 172.21.15.33:42098) 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8717fff640 1 -- 172.21.15.33:0/370932699 learned_addr learned my addr 172.21.15.33:0/370932699 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8717fff640 1 -- 172.21.15.33:0/370932699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec60f60 msgr2=0x5598cf010bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8717fff640 1 --2- 172.21.15.33:0/370932699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec60f60 0x5598cf010bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8717fff640 1 -- 172.21.15.33:0/370932699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec40280 msgr2=0x5598cf010680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f87177fe640 1 --2- 172.21.15.33:0/370932699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec40280 0x5598cf010680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8717fff640 1 --2- 172.21.15.33:0/370932699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec40280 0x5598cf010680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8717fff640 1 -- 172.21.15.33:0/370932699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598cec1fb10 con 0x5598cec380a0 2024-08-28T19:30:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.109+0000 7f8717fff640 1 --2- 172.21.15.33:0/370932699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf024310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8708048da0 tx=0x7f870802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566b3fbc5c9f413b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.110+0000 7f86fdffb640 1 -- 172.21.15.33:0/370932699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708062070 con 0x5598cec380a0 2024-08-28T19:30:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.110+0000 7f86fdffb640 1 -- 172.21.15.33:0/370932699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87080035f0 con 0x5598cec380a0 2024-08-28T19:30:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.110+0000 7f86fdffb640 1 -- 172.21.15.33:0/370932699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870804c040 con 0x5598cec380a0 2024-08-28T19:30:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.110+0000 7f8724a3a740 1 -- 172.21.15.33:0/370932699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 msgr2=0x5598cf024310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.110+0000 7f8724a3a740 1 --2- 172.21.15.33:0/370932699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf024310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8708048da0 tx=0x7f870802a410 comp rx=0 tx=0).stop 2024-08-28T19:30:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.110+0000 7f8724a3a740 1 -- 172.21.15.33:0/370932699 shutdown_connections 2024-08-28T19:30:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.110+0000 7f8724a3a740 1 --2- 172.21.15.33:0/370932699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec60f60 0x5598cf010bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.110+0000 7f8724a3a740 1 --2- 172.21.15.33:0/370932699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec40280 0x5598cf010680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.110+0000 7f8724a3a740 1 --2- 172.21.15.33:0/370932699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec380a0 0x5598cf024310 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.110+0000 7f8724a3a740 1 -- 172.21.15.33:0/370932699 >> 172.21.15.33:0/370932699 conn(0x5598cec55350 msgr2=0x5598cf004090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.111+0000 7f8724a3a740 1 -- 172.21.15.33:0/370932699 shutdown_connections 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.111+0000 7f8724a3a740 1 -- 172.21.15.33:0/370932699 wait complete. 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.111+0000 7f8724a3a740 1 -- start start 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.111+0000 7f8724a3a740 1 Processor -- start 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.111+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec380a0 0x5598cf00eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.111+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec40280 0x5598cf00f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.111+0000 7f8724a3a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec60f60 0x5598cf02eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.111+0000 7f8724a3a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5598cf0267c0 con 0x5598cec40280 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.111+0000 7f8724a3a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5598cf0260f0 con 0x5598cec380a0 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.111+0000 7f8724a3a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5598cf026e90 con 0x5598cec60f60 2024-08-28T19:30:08.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f8724a3a740 10 client.0 _ll_register_callbacks cb 0x7f8708031620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f87177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec40280 0x5598cf00f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f87177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec40280 0x5598cf00f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42110/0 (socket says 172.21.15.33:42110) 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f87177fe640 1 -- 172.21.15.33:0/3736880075 learned_addr learned my addr 172.21.15.33:0/3736880075 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f8717fff640 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec380a0 0x5598cf00eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f871ca62640 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec60f60 0x5598cf02eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f87177fe640 1 -- 172.21.15.33:0/3736880075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec60f60 msgr2=0x5598cf02eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f87177fe640 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec60f60 0x5598cf02eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f87177fe640 1 -- 172.21.15.33:0/3736880075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec380a0 msgr2=0x5598cf00eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f87177fe640 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec380a0 0x5598cf00eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f87177fe640 1 -- 172.21.15.33:0/3736880075 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598cf02f530 con 0x5598cec40280 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f871ca62640 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec60f60 0x5598cf02eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f87177fe640 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec40280 0x5598cf00f460 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f870c0a8b30 tx=0x7f870c0a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1510905b10a8a290 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:08.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f86f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f86f77fe640 1 -- 172.21.15.33:0/3736880075 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c01d040 con 0x5598cec40280 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f86f77fe640 1 -- 172.21.15.33:0/3736880075 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f870c005560 con 0x5598cec40280 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f8724a3a740 1 -- 172.21.15.33:0/3736880075 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87080035f0 con 0x5598cec40280 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f86f77fe640 1 -- 172.21.15.33:0/3736880075 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f870c0abfc0 con 0x5598cec40280 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f8724a3a740 10 client.14916 fetch_fsmap learned FSMap version 16 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.112+0000 7f8724a3a740 1 -- 172.21.15.33:0/3736880075 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x5598cf016a50 con 0x5598cec40280 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f86f77fe640 1 -- 172.21.15.33:0/3736880075 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87080035f0 con 0x5598cec40280 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f86f77fe640 1 -- 172.21.15.33:0/3736880075 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f870c0051a0 con 0x5598cec40280 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f8724a3a740 10 client.14916 fetch_fsmap finished waiting for FSMap version 16 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f8724a3a740 10 client.14916 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f8724a3a740 20 client.14916 populate_metadata read hostname 'smithi033' 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f8724a3a740 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598cebf4c90 0x5598cf0975f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:08.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f8724a3a740 4 client.14916 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f8724a3a740 1 -- 172.21.15.33:0/3736880075 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "status"}) -- 0x5598cef7ade0 con 0x5598cebf4c90 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f8717fff640 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598cebf4c90 0x5598cf0975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f8717fff640 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598cebf4c90 0x5598cf0975f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f751c80c57104ae server_cookie=367ae918a4cfa5c3 in_seq=0 out_seq=0 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.113+0000 7f86f77fe640 10 client.14916 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f86f77fe640 1 -- 172.21.15.33:0/3736880075 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5598cef7ade0 con 0x5598cebf4c90 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f86f77fe640 10 client.14916 handle_command_reply: tid=0 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 client.14916 shutdown 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 -- 172.21.15.33:0/3736880075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec40280 msgr2=0x5598cf00f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec40280 0x5598cf00f460 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f870c0a8b30 tx=0x7f870c0a7040 comp rx=0 tx=0).stop 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 -- 172.21.15.33:0/3736880075 shutdown_connections 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5598cec60f60 0x5598cf02eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598cebf4c90 0x5598cf0975f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5598cec40280 0x5598cf00f460 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 --2- 172.21.15.33:0/3736880075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598cec380a0 0x5598cf00eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 -- 172.21.15.33:0/3736880075 >> 172.21.15.33:0/3736880075 conn(0x5598cec55350 msgr2=0x5598cf010280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:08.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f86f77fe640 0 client.14916 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:30:08.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 -- 172.21.15.33:0/3736880075 shutdown_connections 2024-08-28T19:30:08.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 1 -- 172.21.15.33:0/3736880075 wait complete. 2024-08-28T19:30:08.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.114+0000 7f8724a3a740 20 client.14916 trim_cache size 0 max 16384 2024-08-28T19:30:08.121 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:30:08.121 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:30:08.121 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-08-28T19:30:08.121 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24658, 2024-08-28T19:30:08.122 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:30:08.122 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:30:08.122 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:30:08.122 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 19.013753645000001, 2024-08-28T19:30:08.122 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 16, 2024-08-28T19:30:08.122 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 80, 2024-08-28T19:30:08.122 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 80, 2024-08-28T19:30:08.122 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 38.986095720999998 2024-08-28T19:30:08.122 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 -- 172.21.15.33:0/478693108 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87000b4b80 msgr2=0x7f87000b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87000b4b80 0x7f87000b7090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8708031440 tx=0x7f8708009680 comp rx=0 tx=0).stop 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 -- 172.21.15.33:0/478693108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8718108180 msgr2=0x7f87181997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8718108180 0x7f87181997b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f870c00c970 tx=0x7f870c00ce30 comp rx=0 tx=0).stop 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 -- 172.21.15.33:0/478693108 shutdown_connections 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718108ad0 0x7f871819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8718108180 0x7f87181997b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87000b4b80 0x7f87000b7090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 --2- 172.21.15.33:0/478693108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8718102840 0x7f8718199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 -- 172.21.15.33:0/478693108 >> 172.21.15.33:0/478693108 conn(0x7f87180794f0 msgr2=0x7f8718106330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 -- 172.21.15.33:0/478693108 shutdown_connections 2024-08-28T19:30:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:08.115+0000 7f871e4c5640 1 -- 172.21.15.33:0/478693108 wait complete. 2024-08-28T19:30:08.846 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-28T19:30:08.846 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-28T19:30:08.847 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-28T19:30:09.100 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:09.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:09 smithi033 ceph-mon[18549]: pgmap v269: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:09.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.603+0000 7f86c1613640 1 -- 172.21.15.33:0/330762895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86bc109260 msgr2=0x7f86bc109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:09.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.603+0000 7f86c1613640 1 --2- 172.21.15.33:0/330762895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86bc109260 0x7f86bc109670 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009900 tx=0x7f86a402a410 comp rx=0 tx=0).stop 2024-08-28T19:30:09.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.603+0000 7f86c1613640 1 -- 172.21.15.33:0/330762895 shutdown_connections 2024-08-28T19:30:09.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.603+0000 7f86c1613640 1 --2- 172.21.15.33:0/330762895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc109bb0 0x7f86bc1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.603+0000 7f86c1613640 1 --2- 172.21.15.33:0/330762895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86bc109260 0x7f86bc109670 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.603+0000 7f86c1613640 1 --2- 172.21.15.33:0/330762895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86bc103920 0x7f86bc103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.603+0000 7f86c1613640 1 -- 172.21.15.33:0/330762895 >> 172.21.15.33:0/330762895 conn(0x7f86bc0ff3b0 msgr2=0x7f86bc101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.603+0000 7f86c1613640 1 -- 172.21.15.33:0/330762895 shutdown_connections 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.603+0000 7f86c1613640 1 -- 172.21.15.33:0/330762895 wait complete. 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86c1613640 1 Processor -- start 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86c1613640 1 -- start start 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86c1613640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86bc103920 0x7f86bc19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86c1613640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86bc109260 0x7f86bc19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86c1613640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc109bb0 0x7f86bc19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:09.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86c1613640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc113870 con 0x7f86bc109260 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86c1613640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc1136f0 con 0x7f86bc109bb0 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86c1613640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc1139f0 con 0x7f86bc103920 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86ba7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86bc109260 0x7f86bc19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86ba7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86bc109260 0x7f86bc19a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58332/0 (socket says 172.21.15.33:58332) 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.604+0000 7f86ba7fc640 1 -- 172.21.15.33:0/2771507450 learned_addr learned my addr 172.21.15.33:0/2771507450 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86baffd640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86bc103920 0x7f86bc19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86bb7fe640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc109bb0 0x7f86bc19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86ba7fc640 1 -- 172.21.15.33:0/2771507450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86bc103920 msgr2=0x7f86bc19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86ba7fc640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86bc103920 0x7f86bc19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86ba7fc640 1 -- 172.21.15.33:0/2771507450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc109bb0 msgr2=0x7f86bc19fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86ba7fc640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc109bb0 0x7f86bc19fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:09.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86ba7fc640 1 -- 172.21.15.33:0/2771507450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc1a0270 con 0x7f86bc109260 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86bb7fe640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc109bb0 0x7f86bc19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86ba7fc640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86bc109260 0x7f86bc19a8a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f86a4006010 tx=0x7f86a4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86b3fff640 1 -- 172.21.15.33:0/2771507450 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a403f030 con 0x7f86bc109260 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86c1613640 1 -- 172.21.15.33:0/2771507450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86bc1a0500 con 0x7f86bc109260 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86b3fff640 1 -- 172.21.15.33:0/2771507450 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86a4003aa0 con 0x7f86bc109260 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86c1613640 1 -- 172.21.15.33:0/2771507450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86bc1a6cc0 con 0x7f86bc109260 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.605+0000 7f86b3fff640 1 -- 172.21.15.33:0/2771507450 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4035070 con 0x7f86bc109260 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.606+0000 7f86c1613640 1 -- 172.21.15.33:0/2771507450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86bc104ba0 con 0x7f86bc109260 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.608+0000 7f86b3fff640 1 -- 172.21.15.33:0/2771507450 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f86a4042030 con 0x7f86bc109260 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.609+0000 7f86b3fff640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86a80b4b80 0x7f86a80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:09.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.609+0000 7f86baffd640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86a80b4b80 0x7f86a80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:09.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.609+0000 7f86b3fff640 1 -- 172.21.15.33:0/2771507450 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f86a4105dc0 con 0x7f86bc109260 2024-08-28T19:30:09.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.609+0000 7f86baffd640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86a80b4b80 0x7f86a80b7090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009bd0 tx=0x7f86ac005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:09.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.612+0000 7f86b3fff640 1 -- 172.21.15.33:0/2771507450 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f86a40ccbe0 con 0x7f86bc109260 2024-08-28T19:30:09.782 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:09 smithi122 ceph-mon[22174]: pgmap v269: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:09 smithi059 ceph-mon[22052]: pgmap v269: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:09.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.835+0000 7f86c1613640 1 -- 172.21.15.33:0/2771507450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f86bc103d30 con 0x7f86bc109260 2024-08-28T19:30:09.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.835+0000 7f86b3fff640 1 -- 172.21.15.33:0/2771507450 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7f86bc103d30 con 0x7f86bc109260 2024-08-28T19:30:09.837 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-28T19:30:09.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 -- 172.21.15.33:0/2771507450 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86a80b4b80 msgr2=0x7f86a80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:09.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86a80b4b80 0x7f86a80b7090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009bd0 tx=0x7f86ac005f90 comp rx=0 tx=0).stop 2024-08-28T19:30:09.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 -- 172.21.15.33:0/2771507450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86bc109260 msgr2=0x7f86bc19a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:09.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86bc109260 0x7f86bc19a8a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f86a4006010 tx=0x7f86a4004060 comp rx=0 tx=0).stop 2024-08-28T19:30:09.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 -- 172.21.15.33:0/2771507450 shutdown_connections 2024-08-28T19:30:09.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc109bb0 0x7f86bc19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:09.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86bc109260 0x7f86bc19a8a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:09.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86a80b4b80 0x7f86a80b7090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:09.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 --2- 172.21.15.33:0/2771507450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f86bc103920 0x7f86bc19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:09.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 -- 172.21.15.33:0/2771507450 >> 172.21.15.33:0/2771507450 conn(0x7f86bc0ff3b0 msgr2=0x7f86bc1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:09.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 -- 172.21.15.33:0/2771507450 shutdown_connections 2024-08-28T19:30:09.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:09.838+0000 7f86c1613640 1 -- 172.21.15.33:0/2771507450 wait complete. 2024-08-28T19:30:10.613 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:10 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2771507450' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-28T19:30:10.643 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-28T19:30:10.643 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-28T19:30:10.644 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-08-28T19:30:10.644 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-28T19:30:10.644 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-28T19:30:10.644 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-28T19:30:10.644 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-28T19:30:10.644 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-28T19:30:10.644 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-28T19:30:10.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:10.645 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-08-28T19:30:10.661 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-08-28T19:30:10.662 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-08-28T19:30:10.663 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-28T19:30:10.663 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-08-28T19:30:10.663 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-08-28T19:30:10.663 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-28T19:30:10.663 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42319sec preferred_lft 42319sec 2024-08-28T19:30:10.663 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ece5:e6c5:1ad7:1682/64 scope link noprefixroute 2024-08-28T19:30:10.663 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-28T19:30:10.663 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-28T19:30:10.663 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-08-28T19:30:10.663 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-08-28T19:30:10.664 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-28T19:30:10.664 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T19:30:10.664 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-28T19:30:10.664 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-08-28T19:30:10.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-08-28T19:30:10.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-08-28T19:30:10.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-28T19:30:10.665 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-28T19:30:10.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:30:10.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:10 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2771507450' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-28T19:30:10.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:10 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2771507450' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-28T19:30:10.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:30:10.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:10.859 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-28T19:30:10.884 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-08-28T19:30:10.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:10.885 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-08-28T19:30:10.953 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-08-28T19:30:10.954 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-28T19:30:10.954 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-28T19:30:10.954 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-28T19:30:10.954 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-28T19:30:10.954 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T19:30:10.954 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-28T19:30:10.954 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-28T19:30:10.954 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-28T19:30:10.955 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-28T19:30:10.955 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-28T19:30:11.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:30:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:30:11.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:11.229 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-08-28T19:30:11.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:11.245 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-08-28T19:30:11.300 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T19:30:11.300 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-28T19:30:11.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-28T19:30:11.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-28T19:30:11.300 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-28T19:30:11.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:30:11.396 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:11 smithi033 ceph-mon[18549]: pgmap v270: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:11.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:30:11.418 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-28T19:30:11.418 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T19:30:11.418 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-28T19:30:11.418 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-28T19:30:11.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-28T19:30:11.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-28T19:30:11.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-28T19:30:11.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-28T19:30:11.419 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-28T19:30:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:30:11.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:30:11.546 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T19:30:11.546 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-28T19:30:11.546 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-08-28T19:30:11.546 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-08-28T19:30:11.546 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-28T19:30:11.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:30:11.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:30:11.622 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-28T19:30:11.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-28T19:30:11.623 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-28T19:30:11.638 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-28T19:30:11.638 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-28T19:30:11.638 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-28T19:30:11.693 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-28T19:30:11.759 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-08-28T19:30:11.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:11 smithi059 ceph-mon[22052]: pgmap v270: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:11.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:11 smithi122 ceph-mon[22174]: pgmap v270: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:11.815 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-08-28T19:30:11.815 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-08-28T19:30:11.815 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-08-28T19:30:11.815 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-08-28T19:30:11.815 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-08-28T19:30:11.816 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysusers.service 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/bd7bd3d37fec98605f0141d0ef2c39caba4fad43eb2a50951f83b65a33c4f248/merged 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/d144a66d5310c58fb554f3b13bc0ecebb16229c48ef692a4f3425baf35c18421/merged 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-08-28T19:30:11.817 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/011c9b87c3e66c5b6da768cde1f134a7577efc9a239b33f4693c46da86959e45/merged 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/abc8a04bee239d5e070912f74af7dbdecb40d8d9df3d01419e270cc54c8b25c7/merged 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/86782d7ffa39084d62d1166fd4d7ee7452281fcbe6777456c11b4a5aa6fab5e0/merged 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/a5b4b2cd6603af4ddf457ccd5646a05c93170bfae95ea5174f98a0762838596a/merged 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/b511e9a36c0b8fe165ecb206389a7301e0a41a2933a11d18bb4e15855accd4d3/merged 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ae34ffae32c6078b1ef166396e661a211707d7bb50d9b8ab8aff921147b50570/merged 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/9b187174d46934d2a1e388c854bec64a87b11d99fd3779338d4ed1f7ca0bac1c/merged 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f2200be0f6874f1fb668394ba033ffc1d8f9b62f7e34f2e1f7d24a500437b372/merged 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-28T19:30:11.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:11.819 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-28T19:30:11.870 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-28T19:30:11.870 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-28T19:30:11.913 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2024-08-28T19:30:11.937 DEBUG:teuthology.orchestra.run.smithi033:> cat /proc/self/mounts | awk '{print $2}' 2024-08-28T19:30:11.993 INFO:teuthology.orchestra.run.smithi033.stdout:/proc 2024-08-28T19:30:11.993 INFO:teuthology.orchestra.run.smithi033.stdout:/sys 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/dev 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/security 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/shm 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/pts 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/run 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/cgroup 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/pstore 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/bpf 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/ 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/selinux 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-08-28T19:30:11.994 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/mqueue 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/dev/hugepages 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/debug 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/tracing 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysusers.service 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/kernel/config 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/sys/fs/fuse/connections 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-sysctl.service 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/nfs/rpc_pipefs 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/1000 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/ceph 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay 2024-08-28T19:30:11.995 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/bd7bd3d37fec98605f0141d0ef2c39caba4fad43eb2a50951f83b65a33c4f248/merged 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/d144a66d5310c58fb554f3b13bc0ecebb16229c48ef692a4f3425baf35c18421/merged 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/run/user/0 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/proc/sys/fs/binfmt_misc 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/011c9b87c3e66c5b6da768cde1f134a7577efc9a239b33f4693c46da86959e45/merged 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/abc8a04bee239d5e070912f74af7dbdecb40d8d9df3d01419e270cc54c8b25c7/merged 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/86782d7ffa39084d62d1166fd4d7ee7452281fcbe6777456c11b4a5aa6fab5e0/merged 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/a5b4b2cd6603af4ddf457ccd5646a05c93170bfae95ea5174f98a0762838596a/merged 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/b511e9a36c0b8fe165ecb206389a7301e0a41a2933a11d18bb4e15855accd4d3/merged 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/ae34ffae32c6078b1ef166396e661a211707d7bb50d9b8ab8aff921147b50570/merged 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/9b187174d46934d2a1e388c854bec64a87b11d99fd3779338d4ed1f7ca0bac1c/merged 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/var/lib/containers/storage/overlay/f2200be0f6874f1fb668394ba033ffc1d8f9b62f7e34f2e1f7d24a500437b372/merged 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns 2024-08-28T19:30:11.996 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-28T19:30:11.997 INFO:teuthology.orchestra.run.smithi033.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-28T19:30:11.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:11.997 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2024-08-28T19:30:12.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:2024-08-28T19:30:12.020+0000 7fe06f96d480 -1 init, newargv = 0x7fe054054370 newargc=15 2024-08-28T19:30:12.021 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:ceph-fuse[67749]: starting ceph client 2024-08-28T19:30:12.028 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:ceph-fuse[67749]: starting fuse 2024-08-28T19:30:12.036 INFO:teuthology.orchestra.run.smithi033.stdout:121 2024-08-28T19:30:12.036 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2024-08-28T19:30:12.036 DEBUG:teuthology.orchestra.run.smithi033:> sudo stdin-killer -- python3 -c ' 2024-08-28T19:30:12.036 DEBUG:teuthology.orchestra.run.smithi033:> import glob 2024-08-28T19:30:12.036 DEBUG:teuthology.orchestra.run.smithi033:> import re 2024-08-28T19:30:12.036 DEBUG:teuthology.orchestra.run.smithi033:> import os 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> import subprocess 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> def _find_admin_socket(client_name): 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> files = glob.glob(asok_path) 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> # Given a non-glob path, it better be there 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> if "*" not in asok_path: 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> assert(len(files) == 1) 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> return files[0] 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> for f in files: 2024-08-28T19:30:12.037 DEBUG:teuthology.orchestra.run.smithi033:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-28T19:30:12.038 DEBUG:teuthology.orchestra.run.smithi033:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-28T19:30:12.038 DEBUG:teuthology.orchestra.run.smithi033:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-28T19:30:12.038 DEBUG:teuthology.orchestra.run.smithi033:> contents = proc_f.read() 2024-08-28T19:30:12.038 DEBUG:teuthology.orchestra.run.smithi033:> if mountpoint in contents: 2024-08-28T19:30:12.038 DEBUG:teuthology.orchestra.run.smithi033:> return f 2024-08-28T19:30:12.038 DEBUG:teuthology.orchestra.run.smithi033:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-28T19:30:12.038 DEBUG:teuthology.orchestra.run.smithi033:> 2024-08-28T19:30:12.038 DEBUG:teuthology.orchestra.run.smithi033:> print(_find_admin_socket("client.admin")) 2024-08-28T19:30:12.038 DEBUG:teuthology.orchestra.run.smithi033:> ' 2024-08-28T19:30:12.157 INFO:teuthology.orchestra.run.smithi033.stdout:/var/run/ceph/ceph-client.admin.67749.asok 2024-08-28T19:30:12.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:30:12.167 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.67749.asok 2024-08-28T19:30:12.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:12.167 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.67749.asok status 2024-08-28T19:30:12.312 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:30:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": { 2024-08-28T19:30:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_sha1": "d19e6118f7015f0047264006cb0c873528eb3ae6", 2024-08-28T19:30:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-28T19:30:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "entity_id": "admin", 2024-08-28T19:30:12.312 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": "smithi033", 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "pid": "67749", 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "root": "/" 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_count": 0, 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_pinned_count": 0, 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 14928, 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "inst": { 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "name": { 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "client", 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "num": 14928 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:30:12.313 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 702960059 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "192.168.0.1:0", 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 702960059 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "inst_str": "client.14928 192.168.0.1:0/702960059", 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "addr_str": "192.168.0.1:0/702960059", 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "inode_count": 1, 2024-08-28T19:30:12.314 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_epoch": 16, 2024-08-28T19:30:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch": 80, 2024-08-28T19:30:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch_barrier": 0, 2024-08-28T19:30:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "blocklisted": false, 2024-08-28T19:30:12.315 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs" 2024-08-28T19:30:12.315 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:30:12.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:12.321 DEBUG:teuthology.orchestra.run.smithi033:> stat --file-system '--printf=%T 2024-08-28T19:30:12.322 DEBUG:teuthology.orchestra.run.smithi033:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-28T19:30:12.337 INFO:teuthology.orchestra.run.smithi033.stdout:fuseblk 2024-08-28T19:30:12.337 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-28T19:30:12.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:12.337 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-28T19:30:12.402 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-28T19:30:12.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-28T19:30:12.515 INFO:teuthology.orchestra.run.smithi033.stdout:# file: . 2024-08-28T19:30:12.515 INFO:teuthology.orchestra.run.smithi033.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-28T19:30:12.515 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:12.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:30:12.521 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:30:12.521 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-28T19:30:12.538 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-28T19:30:12.840 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.370+0000 7f29a4161640 1 -- 172.21.15.33:0/3621002095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f299c102880 msgr2=0x7f299c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.370+0000 7f29a4161640 1 --2- 172.21.15.33:0/3621002095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f299c102880 0x7f299c102c90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2998009900 tx=0x7f299802a410 comp rx=0 tx=0).stop 2024-08-28T19:30:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.370+0000 7f29a4161640 1 -- 172.21.15.33:0/3621002095 shutdown_connections 2024-08-28T19:30:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.370+0000 7f29a4161640 1 --2- 172.21.15.33:0/3621002095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c108ac0 0x7f299c10f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.370+0000 7f29a4161640 1 --2- 172.21.15.33:0/3621002095 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f299c108170 0x7f299c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.370+0000 7f29a4161640 1 --2- 172.21.15.33:0/3621002095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f299c102880 0x7f299c102c90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.370+0000 7f29a4161640 1 -- 172.21.15.33:0/3621002095 >> 172.21.15.33:0/3621002095 conn(0x7f299c079500 msgr2=0x7f299c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.371+0000 7f29a4161640 1 -- 172.21.15.33:0/3621002095 shutdown_connections 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.371+0000 7f29a4161640 1 -- 172.21.15.33:0/3621002095 wait complete. 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.371+0000 7f29a4161640 1 Processor -- start 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.371+0000 7f29a4161640 1 -- start start 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.371+0000 7f29a4161640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f299c102880 0x7f299c19b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a4161640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c108170 0x7f299c19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a4161640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f299c108ac0 0x7f299c19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a4161640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f299c112740 con 0x7f299c108ac0 2024-08-28T19:30:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a4161640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f299c1125c0 con 0x7f299c108170 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a4161640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f299c1128c0 con 0x7f299c102880 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a26fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f299c108ac0 0x7f299c19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a26fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f299c108ac0 0x7f299c19ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58344/0 (socket says 172.21.15.33:58344) 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a26fe640 1 -- 172.21.15.33:0/3519605500 learned_addr learned my addr 172.21.15.33:0/3519605500 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a16fc640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c108170 0x7f299c19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a1efd640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f299c102880 0x7f299c19b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a26fe640 1 -- 172.21.15.33:0/3519605500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f299c102880 msgr2=0x7f299c19b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a26fe640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f299c102880 0x7f299c19b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a26fe640 1 -- 172.21.15.33:0/3519605500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c108170 msgr2=0x7f299c19b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a26fe640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c108170 0x7f299c19b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a26fe640 1 -- 172.21.15.33:0/3519605500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c1a6320 con 0x7f299c108ac0 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a1efd640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f299c102880 0x7f299c19b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:30:13.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a26fe640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f299c108ac0 0x7f299c19ba90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f299400eaa0 tx=0x7f299400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f2992ffd640 1 -- 172.21.15.33:0/3519605500 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299400cdb0 con 0x7f299c108ac0 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f29a4161640 1 -- 172.21.15.33:0/3519605500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c1a6610 con 0x7f299c108ac0 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f2992ffd640 1 -- 172.21.15.33:0/3519605500 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2994005020 con 0x7f299c108ac0 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.372+0000 7f2992ffd640 1 -- 172.21.15.33:0/3519605500 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29940116d0 con 0x7f299c108ac0 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.373+0000 7f29a4161640 1 -- 172.21.15.33:0/3519605500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c1a6b50 con 0x7f299c108ac0 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.373+0000 7f29a4161640 1 -- 172.21.15.33:0/3519605500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c103ab0 con 0x7f299c108ac0 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.375+0000 7f2992ffd640 1 -- 172.21.15.33:0/3519605500 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f29940051d0 con 0x7f299c108ac0 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.376+0000 7f2992ffd640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29880b4b80 0x7f29880b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.376+0000 7f29a1efd640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29880b4b80 0x7f29880b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.376+0000 7f2992ffd640 1 -- 172.21.15.33:0/3519605500 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f29940e5ab0 con 0x7f299c108ac0 2024-08-28T19:30:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.376+0000 7f29a1efd640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29880b4b80 0x7f29880b7090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2998000c00 tx=0x7f2998031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:13.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.379+0000 7f2992ffd640 1 -- 172.21.15.33:0/3519605500 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2994016030 con 0x7f299c108ac0 2024-08-28T19:30:13.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.579+0000 7f29a4161640 1 -- 172.21.15.33:0/3519605500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f299c102c90 con 0x7f299c108ac0 2024-08-28T19:30:13.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:13 smithi033 ceph-mon[18549]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.580+0000 7f2992ffd640 1 -- 172.21.15.33:0/3519605500 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v80) ==== 81+0+877 (secure 0 0 0) 0x7f299c102c90 con 0x7f299c108ac0 2024-08-28T19:30:13.581 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2991102711 2024-08-29T19:23:25.613755+0000 2024-08-28T19:30:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/422613927 2024-08-29T19:23:25.613755+0000 2024-08-28T19:30:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/3998463883 2024-08-29T19:21:57.279024+0000 2024-08-28T19:30:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/269585061 2024-08-29T19:21:57.279024+0000 2024-08-28T19:30:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/3998463883 2024-08-29T19:21:57.279024+0000 2024-08-28T19:30:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1610535564 2024-08-29T19:21:57.279024+0000 2024-08-28T19:30:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1410887649 2024-08-29T19:22:21.786187+0000 2024-08-28T19:30:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/456937089 2024-08-29T19:22:21.786187+0000 2024-08-28T19:30:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/402597277 2024-08-29T19:22:21.786187+0000 2024-08-28T19:30:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/500247 2024-08-29T19:22:21.786187+0000 2024-08-28T19:30:13.582 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1410887649 2024-08-29T19:22:21.786187+0000 2024-08-28T19:30:13.583 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/4021316048 2024-08-29T19:21:57.279024+0000 2024-08-28T19:30:13.583 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/855163195 2024-08-29T19:23:25.613755+0000 2024-08-28T19:30:13.583 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/855163195 2024-08-29T19:23:25.613755+0000 2024-08-28T19:30:13.583 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/458032239 2024-08-29T19:23:25.613755+0000 2024-08-28T19:30:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:listed 15 entries 2024-08-28T19:30:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 -- 172.21.15.33:0/3519605500 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29880b4b80 msgr2=0x7f29880b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29880b4b80 0x7f29880b7090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2998000c00 tx=0x7f2998031400 comp rx=0 tx=0).stop 2024-08-28T19:30:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 -- 172.21.15.33:0/3519605500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f299c108ac0 msgr2=0x7f299c19ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f299c108ac0 0x7f299c19ba90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f299400eaa0 tx=0x7f299400ef60 comp rx=0 tx=0).stop 2024-08-28T19:30:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 -- 172.21.15.33:0/3519605500 shutdown_connections 2024-08-28T19:30:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f299c108ac0 0x7f299c19ba90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c108170 0x7f299c19b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:13.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29880b4b80 0x7f29880b7090 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 --2- 172.21.15.33:0/3519605500 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f299c102880 0x7f299c19b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 -- 172.21.15.33:0/3519605500 >> 172.21.15.33:0/3519605500 conn(0x7f299c079500 msgr2=0x7f299c101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 -- 172.21.15.33:0/3519605500 shutdown_connections 2024-08-28T19:30:13.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:13.582+0000 7f29a4161640 1 -- 172.21.15.33:0/3519605500 wait complete. 2024-08-28T19:30:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:13 smithi059 ceph-mon[22052]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:13.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:13 smithi122 ceph-mon[22174]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:30:14.357 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:30:14.357 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-28T19:30:14.375 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-28T19:30:14.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:14 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3519605500' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T19:30:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:14.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:14 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3519605500' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T19:30:14.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:14 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3519605500' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T19:30:15.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.130+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1367899703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4108170 msgr2=0x7fabe4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.130+0000 7fabe9ad7640 1 --2- 172.21.15.33:0/1367899703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4108170 0x7fabe4108580 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009900 tx=0x7fabd802a410 comp rx=0 tx=0).stop 2024-08-28T19:30:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.130+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1367899703 shutdown_connections 2024-08-28T19:30:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.130+0000 7fabe9ad7640 1 --2- 172.21.15.33:0/1367899703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabe4108ac0 0x7fabe410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.130+0000 7fabe9ad7640 1 --2- 172.21.15.33:0/1367899703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4108170 0x7fabe4108580 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.130+0000 7fabe9ad7640 1 --2- 172.21.15.33:0/1367899703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe4102880 0x7fabe4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:15.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.130+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1367899703 >> 172.21.15.33:0/1367899703 conn(0x7fabe4079530 msgr2=0x7fabe4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:15.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.130+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1367899703 shutdown_connections 2024-08-28T19:30:15.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.130+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1367899703 wait complete. 2024-08-28T19:30:15.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe9ad7640 1 Processor -- start 2024-08-28T19:30:15.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe9ad7640 1 -- start start 2024-08-28T19:30:15.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe9ad7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabe4102880 0x7fabe40ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:15.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe9ad7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe4108170 0x7fabe40ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:15.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe9ad7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4108ac0 0x7fabe40ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe9ad7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fabe4112750 con 0x7fabe4108ac0 2024-08-28T19:30:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe9ad7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fabe41125d0 con 0x7fabe4108170 2024-08-28T19:30:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe9ad7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fabe41128d0 con 0x7fabe4102880 2024-08-28T19:30:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4108ac0 0x7fabe40ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4108ac0 0x7fabe40ffe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58358/0 (socket says 172.21.15.33:58358) 2024-08-28T19:30:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.131+0000 7fabe3fff640 1 -- 172.21.15.33:0/1178945543 learned_addr learned my addr 172.21.15.33:0/1178945543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe37fe640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabe4102880 0x7fabe40ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe2ffd640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe4108170 0x7fabe40ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe3fff640 1 -- 172.21.15.33:0/1178945543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabe4102880 msgr2=0x7fabe40ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe3fff640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabe4102880 0x7fabe40ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe3fff640 1 -- 172.21.15.33:0/1178945543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe4108170 msgr2=0x7fabe40ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe3fff640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe4108170 0x7fabe40ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe3fff640 1 -- 172.21.15.33:0/1178945543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe41a8510 con 0x7fabe4108ac0 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe37fe640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabe4102880 0x7fabe40ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe3fff640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4108ac0 0x7fabe40ffe90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00cad0 tx=0x7fabdc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe0ff9640 1 -- 172.21.15.33:0/1178945543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00ae20 con 0x7fabe4108ac0 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1178945543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe41a8800 con 0x7fabe4108ac0 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe0ff9640 1 -- 172.21.15.33:0/1178945543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabdc005020 con 0x7fabe4108ac0 2024-08-28T19:30:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe0ff9640 1 -- 172.21.15.33:0/1178945543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00f6b0 con 0x7fabe4108ac0 2024-08-28T19:30:15.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.132+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1178945543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe41a8d40 con 0x7fabe4108ac0 2024-08-28T19:30:15.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.133+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1178945543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe4102c90 con 0x7fabe4108ac0 2024-08-28T19:30:15.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.135+0000 7fabe0ff9640 1 -- 172.21.15.33:0/1178945543 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fabdc0051d0 con 0x7fabe4108ac0 2024-08-28T19:30:15.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.135+0000 7fabe0ff9640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fabcc0b4b80 0x7fabcc0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:15.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.136+0000 7fabe37fe640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fabcc0b4b80 0x7fabcc0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:15.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.136+0000 7fabe0ff9640 1 -- 172.21.15.33:0/1178945543 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7fabdc0e5970 con 0x7fabe4108ac0 2024-08-28T19:30:15.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.136+0000 7fabe37fe640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fabcc0b4b80 0x7fabcc0b7090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fabd4005fd0 tx=0x7fabd4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:15.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.139+0000 7fabe0ff9640 1 -- 172.21.15.33:0/1178945543 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fabdc014030 con 0x7fabe4108ac0 2024-08-28T19:30:15.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.336+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1178945543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fabe4100710 con 0x7fabe4108ac0 2024-08-28T19:30:15.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.337+0000 7fabe0ff9640 1 -- 172.21.15.33:0/1178945543 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v80) ==== 81+0+877 (secure 0 0 0) 0x7fabdc0ac790 con 0x7fabe4108ac0 2024-08-28T19:30:15.338 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2991102711 2024-08-29T19:23:25.613755+0000 2024-08-28T19:30:15.338 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/422613927 2024-08-29T19:23:25.613755+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/3998463883 2024-08-29T19:21:57.279024+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/269585061 2024-08-29T19:21:57.279024+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/3998463883 2024-08-29T19:21:57.279024+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1610535564 2024-08-29T19:21:57.279024+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1410887649 2024-08-29T19:22:21.786187+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/456937089 2024-08-29T19:22:21.786187+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/402597277 2024-08-29T19:22:21.786187+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/500247 2024-08-29T19:22:21.786187+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1410887649 2024-08-29T19:22:21.786187+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/4021316048 2024-08-29T19:21:57.279024+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/855163195 2024-08-29T19:23:25.613755+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/855163195 2024-08-29T19:23:25.613755+0000 2024-08-28T19:30:15.339 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/458032239 2024-08-29T19:23:25.613755+0000 2024-08-28T19:30:15.340 INFO:teuthology.orchestra.run.smithi033.stderr:listed 15 entries 2024-08-28T19:30:15.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1178945543 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fabcc0b4b80 msgr2=0x7fabcc0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:15.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fabcc0b4b80 0x7fabcc0b7090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fabd4005fd0 tx=0x7fabd4005850 comp rx=0 tx=0).stop 2024-08-28T19:30:15.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1178945543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4108ac0 msgr2=0x7fabe40ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:15.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4108ac0 0x7fabe40ffe90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00cad0 tx=0x7fabdc00cf90 comp rx=0 tx=0).stop 2024-08-28T19:30:15.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1178945543 shutdown_connections 2024-08-28T19:30:15.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabe4108ac0 0x7fabe40ffe90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:15.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe4108170 0x7fabe40ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:15.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fabcc0b4b80 0x7fabcc0b7090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:15.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 --2- 172.21.15.33:0/1178945543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabe4102880 0x7fabe40ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:15.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1178945543 >> 172.21.15.33:0/1178945543 conn(0x7fabe4079530 msgr2=0x7fabe4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:15.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1178945543 shutdown_connections 2024-08-28T19:30:15.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:15.340+0000 7fabe9ad7640 1 -- 172.21.15.33:0/1178945543 wait complete. 2024-08-28T19:30:15.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:15 smithi033 ceph-mon[18549]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-28T19:30:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:15 smithi059 ceph-mon[22052]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-28T19:30:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:15 smithi122 ceph-mon[22174]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-28T19:30:16.078 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi033.front.sepia.ceph.com... 2024-08-28T19:30:16.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:16.079 DEBUG:teuthology.orchestra.run.smithi033:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-28T19:30:16.106 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi033.stderr:ceph-fuse[67749]: fuse finished with error 0 and tester_r 0 2024-08-28T19:30:16.109 INFO:teuthology.orchestra.run:waiting for 300 2024-08-28T19:30:16.202 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-08-28T19:30:16.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:30:16.202 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-28T19:30:16.237 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:30:16.537 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:16.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:16 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1178945543' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T19:30:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:16 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1178945543' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T19:30:16.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:16 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1178945543' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T19:30:17.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.012+0000 7f1d8912e640 1 -- 172.21.15.33:0/2780229713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d841069c0 msgr2=0x7f1d84110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:17.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.013+0000 7f1d8912e640 1 --2- 172.21.15.33:0/2780229713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d841069c0 0x7f1d84110450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009ca0 tx=0x7f1d7c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:17.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.013+0000 7f1d8912e640 1 -- 172.21.15.33:0/2780229713 shutdown_connections 2024-08-28T19:30:17.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.013+0000 7f1d8912e640 1 --2- 172.21.15.33:0/2780229713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d841069c0 0x7f1d84110450 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:17.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.013+0000 7f1d8912e640 1 --2- 172.21.15.33:0/2780229713 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d84106070 0x7f1d84106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:17.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.013+0000 7f1d8912e640 1 --2- 172.21.15.33:0/2780229713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d84101e80 0x7f1d84102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:17.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.013+0000 7f1d8912e640 1 -- 172.21.15.33:0/2780229713 >> 172.21.15.33:0/2780229713 conn(0x7f1d84079d30 msgr2=0x7f1d8407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:17.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.013+0000 7f1d8912e640 1 -- 172.21.15.33:0/2780229713 shutdown_connections 2024-08-28T19:30:17.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.013+0000 7f1d8912e640 1 -- 172.21.15.33:0/2780229713 wait complete. 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.013+0000 7f1d8912e640 1 Processor -- start 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d8912e640 1 -- start start 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d8912e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d84101e80 0x7f1d8419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d8912e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d84106070 0x7f1d8419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d8912e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d841069c0 0x7f1d8419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d8912e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1d841138e0 con 0x7f1d84101e80 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d8912e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1d84113760 con 0x7f1d84106070 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d8912e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1d84113a60 con 0x7f1d841069c0 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d82d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d84101e80 0x7f1d8419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d82d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d84101e80 0x7f1d8419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58380/0 (socket says 172.21.15.33:58380) 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d82d9d640 1 -- 172.21.15.33:0/2941268069 learned_addr learned my addr 172.21.15.33:0/2941268069 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d8259c640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d84106070 0x7f1d8419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:17.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d8359e640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d841069c0 0x7f1d8419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d82d9d640 1 -- 172.21.15.33:0/2941268069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d841069c0 msgr2=0x7f1d8419fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d82d9d640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d841069c0 0x7f1d8419fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d82d9d640 1 -- 172.21.15.33:0/2941268069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d84106070 msgr2=0x7f1d8419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d82d9d640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d84106070 0x7f1d8419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.014+0000 7f1d82d9d640 1 -- 172.21.15.33:0/2941268069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d841a01a0 con 0x7f1d84101e80 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.015+0000 7f1d82d9d640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d84101e80 0x7f1d8419a230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400d950 tx=0x7f1d7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.015+0000 7f1d6bfff640 1 -- 172.21.15.33:0/2941268069 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74017020 con 0x7f1d84101e80 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.015+0000 7f1d8912e640 1 -- 172.21.15.33:0/2941268069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d841a0490 con 0x7f1d84101e80 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.015+0000 7f1d6bfff640 1 -- 172.21.15.33:0/2941268069 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d74009c30 con 0x7f1d84101e80 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.015+0000 7f1d6bfff640 1 -- 172.21.15.33:0/2941268069 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400f6b0 con 0x7f1d84101e80 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.015+0000 7f1d8912e640 1 -- 172.21.15.33:0/2941268069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d841a6bf0 con 0x7f1d84101e80 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.016+0000 7f1d8912e640 1 -- 172.21.15.33:0/2941268069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d8406b590 con 0x7f1d84101e80 2024-08-28T19:30:17.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.019+0000 7f1d6bfff640 1 -- 172.21.15.33:0/2941268069 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f1d7401a020 con 0x7f1d84101e80 2024-08-28T19:30:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.019+0000 7f1d6bfff640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1d6c0b4b80 0x7f1d6c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.019+0000 7f1d6bfff640 1 -- 172.21.15.33:0/2941268069 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f1d740e53f0 con 0x7f1d84101e80 2024-08-28T19:30:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.019+0000 7f1d8259c640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1d6c0b4b80 0x7f1d6c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.020+0000 7f1d8259c640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1d6c0b4b80 0x7f1d6c0b7090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1d84109f90 tx=0x7f1d7800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.022+0000 7f1d6bfff640 1 -- 172.21.15.33:0/2941268069 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1d74009de0 con 0x7f1d84101e80 2024-08-28T19:30:17.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.208+0000 7f1d8912e640 1 -- 172.21.15.33:0/2941268069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d8402e430 con 0x7f1d84101e80 2024-08-28T19:30:17.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.210+0000 7f1d6bfff640 1 -- 172.21.15.33:0/2941268069 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24471 (secure 0 0 0) 0x7f1d740ac210 con 0x7f1d84101e80 2024-08-28T19:30:17.211 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:17.211 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:29:58.157698+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:30:17.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 -- 172.21.15.33:0/2941268069 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1d6c0b4b80 msgr2=0x7f1d6c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:17.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1d6c0b4b80 0x7f1d6c0b7090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1d84109f90 tx=0x7f1d7800b390 comp rx=0 tx=0).stop 2024-08-28T19:30:17.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 -- 172.21.15.33:0/2941268069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d84101e80 msgr2=0x7f1d8419a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:17.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d84101e80 0x7f1d8419a230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400d950 tx=0x7f1d7400de10 comp rx=0 tx=0).stop 2024-08-28T19:30:17.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 -- 172.21.15.33:0/2941268069 shutdown_connections 2024-08-28T19:30:17.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1d6c0b4b80 0x7f1d6c0b7090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:17.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d841069c0 0x7f1d8419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:17.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d84106070 0x7f1d8419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:17.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 --2- 172.21.15.33:0/2941268069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d84101e80 0x7f1d8419a230 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:17.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 -- 172.21.15.33:0/2941268069 >> 172.21.15.33:0/2941268069 conn(0x7f1d84079d30 msgr2=0x7f1d84107260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:17.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 -- 172.21.15.33:0/2941268069 shutdown_connections 2024-08-28T19:30:17.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:17.213+0000 7f1d8912e640 1 -- 172.21.15.33:0/2941268069 wait complete. 2024-08-28T19:30:17.603 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:17 smithi033 ceph-mon[18549]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-28T19:30:17.604 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:17 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2941268069' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:17.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:17 smithi059 ceph-mon[22052]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-28T19:30:17.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:17 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2941268069' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:17 smithi122 ceph-mon[22174]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-28T19:30:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:17 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2941268069' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:17.952 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:30:18.209 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:18.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.716+0000 7f6a461c1640 1 -- 172.21.15.33:0/3621731801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a40103900 msgr2=0x7f6a40103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:18.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.716+0000 7f6a461c1640 1 --2- 172.21.15.33:0/3621731801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a40103900 0x7f6a40103d10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009900 tx=0x7f6a3002a410 comp rx=0 tx=0).stop 2024-08-28T19:30:18.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.716+0000 7f6a461c1640 1 -- 172.21.15.33:0/3621731801 shutdown_connections 2024-08-28T19:30:18.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.716+0000 7f6a461c1640 1 --2- 172.21.15.33:0/3621731801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a40109b90 0x7f6a401103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:18.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.716+0000 7f6a461c1640 1 --2- 172.21.15.33:0/3621731801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a40109240 0x7f6a40109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:18.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.716+0000 7f6a461c1640 1 --2- 172.21.15.33:0/3621731801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a40103900 0x7f6a40103d10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:18.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.716+0000 7f6a461c1640 1 -- 172.21.15.33:0/3621731801 >> 172.21.15.33:0/3621731801 conn(0x7f6a4007b5f0 msgr2=0x7f6a4007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:18.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.716+0000 7f6a461c1640 1 -- 172.21.15.33:0/3621731801 shutdown_connections 2024-08-28T19:30:18.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.716+0000 7f6a461c1640 1 -- 172.21.15.33:0/3621731801 wait complete. 2024-08-28T19:30:18.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.716+0000 7f6a461c1640 1 Processor -- start 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a461c1640 1 -- start start 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a461c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a40103900 0x7f6a4019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a461c1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a40109240 0x7f6a4019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a461c1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a40109b90 0x7f6a4019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a461c1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40113870 con 0x7f6a40109b90 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a461c1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401136f0 con 0x7f6a40103900 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a461c1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401139f0 con 0x7f6a40109240 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a3ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a40109b90 0x7f6a4019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a3ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a40109b90 0x7f6a4019fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46788/0 (socket says 172.21.15.33:46788) 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a3ffff640 1 -- 172.21.15.33:0/3956845453 learned_addr learned my addr 172.21.15.33:0/3956845453 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:18.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a3f7fe640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a40103900 0x7f6a4019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a3effd640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a40109240 0x7f6a4019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a3ffff640 1 -- 172.21.15.33:0/3956845453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a40109240 msgr2=0x7f6a4019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a3ffff640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a40109240 0x7f6a4019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a3ffff640 1 -- 172.21.15.33:0/3956845453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a40103900 msgr2=0x7f6a4019a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a3ffff640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a40103900 0x7f6a4019a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.717+0000 7f6a3ffff640 1 -- 172.21.15.33:0/3956845453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a401a01b0 con 0x7f6a40109b90 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.718+0000 7f6a3ffff640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a40109b90 0x7f6a4019fa80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800eaa0 tx=0x7f6a3800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.718+0000 7f6a3cff9640 1 -- 172.21.15.33:0/3956845453 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800cdb0 con 0x7f6a40109b90 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.718+0000 7f6a461c1640 1 -- 172.21.15.33:0/3956845453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a401a04a0 con 0x7f6a40109b90 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.718+0000 7f6a3cff9640 1 -- 172.21.15.33:0/3956845453 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a38005020 con 0x7f6a40109b90 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.718+0000 7f6a3cff9640 1 -- 172.21.15.33:0/3956845453 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a380116d0 con 0x7f6a40109b90 2024-08-28T19:30:18.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.718+0000 7f6a461c1640 1 -- 172.21.15.33:0/3956845453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a401a6c00 con 0x7f6a40109b90 2024-08-28T19:30:18.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.719+0000 7f6a461c1640 1 -- 172.21.15.33:0/3956845453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a40103d10 con 0x7f6a40109b90 2024-08-28T19:30:18.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.720+0000 7f6a3cff9640 1 -- 172.21.15.33:0/3956845453 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f6a380054a0 con 0x7f6a40109b90 2024-08-28T19:30:18.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.721+0000 7f6a3cff9640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6a280b4b80 0x7f6a280b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:18.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.721+0000 7f6a3f7fe640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6a280b4b80 0x7f6a280b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:18.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.721+0000 7f6a3cff9640 1 -- 172.21.15.33:0/3956845453 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f6a380e5a40 con 0x7f6a40109b90 2024-08-28T19:30:18.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.722+0000 7f6a3f7fe640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6a280b4b80 0x7f6a280b7090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a30031440 tx=0x7f6a30009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:18.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.724+0000 7f6a3cff9640 1 -- 172.21.15.33:0/3956845453 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6a38016030 con 0x7f6a40109b90 2024-08-28T19:30:18.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.913+0000 7f6a461c1640 1 -- 172.21.15.33:0/3956845453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a4019b370 con 0x7f6a40109b90 2024-08-28T19:30:18.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.915+0000 7f6a3cff9640 1 -- 172.21.15.33:0/3956845453 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24471 (secure 0 0 0) 0x7f6a4019b370 con 0x7f6a40109b90 2024-08-28T19:30:18.916 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:18.917 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:29:58.157698+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:30:18.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 -- 172.21.15.33:0/3956845453 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6a280b4b80 msgr2=0x7f6a280b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:18.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6a280b4b80 0x7f6a280b7090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a30031440 tx=0x7f6a30009560 comp rx=0 tx=0).stop 2024-08-28T19:30:18.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 -- 172.21.15.33:0/3956845453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a40109b90 msgr2=0x7f6a4019fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:18.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a40109b90 0x7f6a4019fa80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800eaa0 tx=0x7f6a3800ef60 comp rx=0 tx=0).stop 2024-08-28T19:30:18.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 -- 172.21.15.33:0/3956845453 shutdown_connections 2024-08-28T19:30:18.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a40109b90 0x7f6a4019fa80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:18.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6a280b4b80 0x7f6a280b7090 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:18.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6a40109240 0x7f6a4019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:18.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 --2- 172.21.15.33:0/3956845453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a40103900 0x7f6a4019a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:18.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 -- 172.21.15.33:0/3956845453 >> 172.21.15.33:0/3956845453 conn(0x7f6a4007b5f0 msgr2=0x7f6a40107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:18.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 -- 172.21.15.33:0/3956845453 shutdown_connections 2024-08-28T19:30:18.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:18.917+0000 7f6a461c1640 1 -- 172.21.15.33:0/3956845453 wait complete. 2024-08-28T19:30:19.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:19 smithi033 ceph-mon[18549]: pgmap v274: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:19.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:19 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3956845453' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:19.738 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-28T19:30:19.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:19 smithi059 ceph-mon[22052]: pgmap v274: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:19 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3956845453' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:19 smithi122 ceph-mon[22174]: pgmap v274: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:19 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3956845453' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:19.996 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:20.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.513+0000 7f83bc819640 1 -- 172.21.15.33:0/2037697461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b8106070 msgr2=0x7f83b8106480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.513+0000 7f83bc819640 1 --2- 172.21.15.33:0/2037697461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b8106070 0x7f83b8106480 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009900 tx=0x7f83a802a410 comp rx=0 tx=0).stop 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.513+0000 7f83bc819640 1 -- 172.21.15.33:0/2037697461 shutdown_connections 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.513+0000 7f83bc819640 1 --2- 172.21.15.33:0/2037697461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83b81069c0 0x7f83b8110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.513+0000 7f83bc819640 1 --2- 172.21.15.33:0/2037697461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b8106070 0x7f83b8106480 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.513+0000 7f83bc819640 1 --2- 172.21.15.33:0/2037697461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b8101d90 0x7f83b81021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.513+0000 7f83bc819640 1 -- 172.21.15.33:0/2037697461 >> 172.21.15.33:0/2037697461 conn(0x7f83b8077a60 msgr2=0x7f83b8077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.513+0000 7f83bc819640 1 -- 172.21.15.33:0/2037697461 shutdown_connections 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.513+0000 7f83bc819640 1 -- 172.21.15.33:0/2037697461 wait complete. 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83bc819640 1 Processor -- start 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83bc819640 1 -- start start 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83bc819640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b8101d90 0x7f83b819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83bc819640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b8106070 0x7f83b819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83bc819640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83b81069c0 0x7f83b819faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83bc819640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81138a0 con 0x7f83b8101d90 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83bc819640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8113720 con 0x7f83b8106070 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83bc819640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8113a20 con 0x7f83b81069c0 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83b659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b8101d90 0x7f83b819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83b659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b8101d90 0x7f83b819a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46820/0 (socket says 172.21.15.33:46820) 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.514+0000 7f83b659c640 1 -- 172.21.15.33:0/2145020348 learned_addr learned my addr 172.21.15.33:0/2145020348 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83b5d9b640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b8106070 0x7f83b819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83b6d9d640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83b81069c0 0x7f83b819faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83b659c640 1 -- 172.21.15.33:0/2145020348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83b81069c0 msgr2=0x7f83b819faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83b659c640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83b81069c0 0x7f83b819faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83b659c640 1 -- 172.21.15.33:0/2145020348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b8106070 msgr2=0x7f83b819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83b659c640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b8106070 0x7f83b819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:20.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83b659c640 1 -- 172.21.15.33:0/2145020348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b81a0220 con 0x7f83b8101d90 2024-08-28T19:30:20.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83b659c640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b8101d90 0x7f83b819a2b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f83a000d950 tx=0x7f83a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:20.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83af7fe640 1 -- 172.21.15.33:0/2145020348 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0017070 con 0x7f83b8101d90 2024-08-28T19:30:20.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83af7fe640 1 -- 172.21.15.33:0/2145020348 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a0009c30 con 0x7f83b8101d90 2024-08-28T19:30:20.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83bc819640 1 -- 172.21.15.33:0/2145020348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b81a0510 con 0x7f83b8101d90 2024-08-28T19:30:20.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83af7fe640 1 -- 172.21.15.33:0/2145020348 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a000f620 con 0x7f83b8101d90 2024-08-28T19:30:20.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.515+0000 7f83bc819640 1 -- 172.21.15.33:0/2145020348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b81a6c70 con 0x7f83b8101d90 2024-08-28T19:30:20.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.517+0000 7f83bc819640 1 -- 172.21.15.33:0/2145020348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b81021a0 con 0x7f83b8101d90 2024-08-28T19:30:20.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.518+0000 7f83af7fe640 1 -- 172.21.15.33:0/2145020348 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f83a0010460 con 0x7f83b8101d90 2024-08-28T19:30:20.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.519+0000 7f83af7fe640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83a40b4b80 0x7f83a40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:20.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.519+0000 7f83b5d9b640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83a40b4b80 0x7f83a40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:20.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.519+0000 7f83af7fe640 1 -- 172.21.15.33:0/2145020348 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f83a00e5160 con 0x7f83b8101d90 2024-08-28T19:30:20.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.520+0000 7f83b5d9b640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83a40b4b80 0x7f83a40b7090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009230 tx=0x7f83a8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:20.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.524+0000 7f83af7fe640 1 -- 172.21.15.33:0/2145020348 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f83a00abf20 con 0x7f83b8101d90 2024-08-28T19:30:20.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:20.750+0000 7f83bc819640 1 -- 172.21.15.33:0/2145020348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f83b802e430 con 0x7f83b8101d90 2024-08-28T19:30:21.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.347+0000 7f83af7fe640 1 -- 172.21.15.33:0/2145020348 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f83a0009de0 con 0x7f83b8101d90 2024-08-28T19:30:21.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 -- 172.21.15.33:0/2145020348 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83a40b4b80 msgr2=0x7f83a40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:21.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83a40b4b80 0x7f83a40b7090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009230 tx=0x7f83a8031400 comp rx=0 tx=0).stop 2024-08-28T19:30:21.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 -- 172.21.15.33:0/2145020348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b8101d90 msgr2=0x7f83b819a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:21.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b8101d90 0x7f83b819a2b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f83a000d950 tx=0x7f83a000de10 comp rx=0 tx=0).stop 2024-08-28T19:30:21.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 -- 172.21.15.33:0/2145020348 shutdown_connections 2024-08-28T19:30:21.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83a40b4b80 0x7f83a40b7090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:21.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f83b81069c0 0x7f83b819faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:21.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b8106070 0x7f83b819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:21.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 --2- 172.21.15.33:0/2145020348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b8101d90 0x7f83b819a2b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:21.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 -- 172.21.15.33:0/2145020348 >> 172.21.15.33:0/2145020348 conn(0x7f83b8077a60 msgr2=0x7f83b81072a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:21.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 -- 172.21.15.33:0/2145020348 shutdown_connections 2024-08-28T19:30:21.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:21.349+0000 7f83bc819640 1 -- 172.21.15.33:0/2145020348 wait complete. 2024-08-28T19:30:21.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:21 smithi033 ceph-mon[18549]: pgmap v275: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:21.632 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:21 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2145020348' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-28T19:30:21.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:21 smithi059 ceph-mon[22052]: pgmap v275: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:21 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2145020348' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-28T19:30:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:21 smithi122 ceph-mon[22174]: pgmap v275: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:21 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2145020348' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-28T19:30:22.193 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-08-28T19:30:22.193 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-08-28T19:30:22.455 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:22.576 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:22 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2145020348' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-28T19:30:22.576 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:22 smithi033 ceph-mon[18549]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:30:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:22 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2145020348' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-28T19:30:22.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:22 smithi059 ceph-mon[22052]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:30:22.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:22 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2145020348' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-28T19:30:22.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:22 smithi122 ceph-mon[22174]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:30:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.932+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/1619501439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b8102ce0 msgr2=0x7fe2b810fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.932+0000 7fe2bf7dc640 1 --2- 172.21.15.33:0/1619501439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b8102ce0 0x7fe2b810fa00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009900 tx=0x7fe2a802a480 comp rx=0 tx=0).stop 2024-08-28T19:30:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.932+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/1619501439 shutdown_connections 2024-08-28T19:30:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.932+0000 7fe2bf7dc640 1 --2- 172.21.15.33:0/1619501439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2b810ff40 0x7fe2b8112360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.932+0000 7fe2bf7dc640 1 --2- 172.21.15.33:0/1619501439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b8102ce0 0x7fe2b810fa00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.932+0000 7fe2bf7dc640 1 --2- 172.21.15.33:0/1619501439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2b8102390 0x7fe2b81027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.932+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/1619501439 >> 172.21.15.33:0/1619501439 conn(0x7fe2b80794e0 msgr2=0x7fe2b80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.932+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/1619501439 shutdown_connections 2024-08-28T19:30:22.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.932+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/1619501439 wait complete. 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.932+0000 7fe2bf7dc640 1 Processor -- start 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bf7dc640 1 -- start start 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bf7dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b8102390 0x7fe2b819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bf7dc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2b8102ce0 0x7fe2b819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bf7dc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2b810ff40 0x7fe2b81a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bf7dc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b8115a30 con 0x7fe2b8102390 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bf7dc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81158b0 con 0x7fe2b810ff40 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bf7dc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b8115bb0 con 0x7fe2b8102ce0 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bd578640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b8102390 0x7fe2b819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bd578640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b8102390 0x7fe2b819c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46844/0 (socket says 172.21.15.33:46844) 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bd578640 1 -- 172.21.15.33:0/214113369 learned_addr learned my addr 172.21.15.33:0/214113369 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bdd79640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2b810ff40 0x7fe2b81a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bcd77640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2b8102ce0 0x7fe2b819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bd578640 1 -- 172.21.15.33:0/214113369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2b8102ce0 msgr2=0x7fe2b819ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bd578640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2b8102ce0 0x7fe2b819ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bd578640 1 -- 172.21.15.33:0/214113369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2b810ff40 msgr2=0x7fe2b81a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bd578640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2b810ff40 0x7fe2b81a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bd578640 1 -- 172.21.15.33:0/214113369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b81a2330 con 0x7fe2b8102390 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bcd77640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2b8102ce0 0x7fe2b819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.933+0000 7fe2bd578640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b8102390 0x7fe2b819c480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400c890 tx=0x7fe2b400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.934+0000 7fe2ae7fc640 1 -- 172.21.15.33:0/214113369 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4004220 con 0x7fe2b8102390 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.934+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/214113369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b81a2620 con 0x7fe2b8102390 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.934+0000 7fe2ae7fc640 1 -- 172.21.15.33:0/214113369 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2b40043c0 con 0x7fe2b8102390 2024-08-28T19:30:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.934+0000 7fe2ae7fc640 1 -- 172.21.15.33:0/214113369 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4004a00 con 0x7fe2b8102390 2024-08-28T19:30:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.934+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/214113369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b81a8e40 con 0x7fe2b8102390 2024-08-28T19:30:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.935+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/214113369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b806bfe0 con 0x7fe2b8102390 2024-08-28T19:30:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.937+0000 7fe2ae7fc640 1 -- 172.21.15.33:0/214113369 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fe2b40079b0 con 0x7fe2b8102390 2024-08-28T19:30:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.938+0000 7fe2ae7fc640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe2a40b4bb0 0x7fe2a40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.938+0000 7fe2bcd77640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe2a40b4bb0 0x7fe2a40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.938+0000 7fe2ae7fc640 1 -- 172.21.15.33:0/214113369 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7fe2b40e5690 con 0x7fe2b8102390 2024-08-28T19:30:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.938+0000 7fe2bcd77640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe2a40b4bb0 0x7fe2a40b70c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8031440 tx=0x7fe2a8005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:22.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:22.941+0000 7fe2ae7fc640 1 -- 172.21.15.33:0/214113369 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe2b4014030 con 0x7fe2b8102390 2024-08-28T19:30:23.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.167+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/214113369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fe2b81a9070 con 0x7fe2b8102390 2024-08-28T19:30:23.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.360+0000 7fe2ae7fc640 1 -- 172.21.15.33:0/214113369 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fe2b40ac450 con 0x7fe2b8102390 2024-08-28T19:30:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/214113369 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe2a40b4bb0 msgr2=0x7fe2a40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe2a40b4bb0 0x7fe2a40b70c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8031440 tx=0x7fe2a8005d50 comp rx=0 tx=0).stop 2024-08-28T19:30:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/214113369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b8102390 msgr2=0x7fe2b819c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b8102390 0x7fe2b819c480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400c890 tx=0x7fe2b400cd50 comp rx=0 tx=0).stop 2024-08-28T19:30:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/214113369 shutdown_connections 2024-08-28T19:30:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2b810ff40 0x7fe2b81a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe2a40b4bb0 0x7fe2a40b70c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe2b8102ce0 0x7fe2b819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 --2- 172.21.15.33:0/214113369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2b8102390 0x7fe2b819c480 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/214113369 >> 172.21.15.33:0/214113369 conn(0x7fe2b80794e0 msgr2=0x7fe2b8109b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/214113369 shutdown_connections 2024-08-28T19:30:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:23.363+0000 7fe2bf7dc640 1 -- 172.21.15.33:0/214113369 wait complete. 2024-08-28T19:30:23.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:23 smithi033 ceph-mon[18549]: pgmap v276: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:23.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:23 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/214113369' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-28T19:30:23.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:23 smithi059 ceph-mon[22052]: pgmap v276: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:23.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:23 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/214113369' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-28T19:30:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:23 smithi122 ceph-mon[22174]: pgmap v276: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:23 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/214113369' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-28T19:30:24.185 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-28T19:30:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:24.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:24 smithi033 ceph-mon[18549]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-28T19:30:24.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:24 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/214113369' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-28T19:30:24.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:24 smithi033 ceph-mon[18549]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-28T19:30:24.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:24 smithi033 ceph-mon[18549]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:30:24.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:24 smithi033 ceph-mon[18549]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-28T19:30:24.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:24 smithi033 ceph-mon[18549]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-28T19:30:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:24 smithi059 ceph-mon[22052]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-28T19:30:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:24 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/214113369' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-28T19:30:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:24 smithi059 ceph-mon[22052]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-28T19:30:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:24 smithi059 ceph-mon[22052]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:30:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:24 smithi059 ceph-mon[22052]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-28T19:30:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:24 smithi059 ceph-mon[22052]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-28T19:30:24.793 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:30:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i[54112]: 2024-08-28T19:30:24.406+0000 7f74beafe640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-28T19:30:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:24 smithi122 ceph-mon[22174]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-28T19:30:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:24 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/214113369' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-28T19:30:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:24 smithi122 ceph-mon[22174]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-28T19:30:24.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:24 smithi122 ceph-mon[22174]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-28T19:30:24.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:24 smithi122 ceph-mon[22174]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-28T19:30:24.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:24 smithi122 ceph-mon[22174]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-28T19:30:24.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.957+0000 7faedd394640 1 -- 172.21.15.33:0/3318323748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faed8109bb0 msgr2=0x7faed81103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:24.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.957+0000 7faedd394640 1 --2- 172.21.15.33:0/3318323748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faed8109bb0 0x7faed81103e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faed0009ca0 tx=0x7faed002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:24.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.957+0000 7faedd394640 1 -- 172.21.15.33:0/3318323748 shutdown_connections 2024-08-28T19:30:24.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.957+0000 7faedd394640 1 --2- 172.21.15.33:0/3318323748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faed8109bb0 0x7faed81103e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:24.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.957+0000 7faedd394640 1 --2- 172.21.15.33:0/3318323748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed8109260 0x7faed8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.957+0000 7faedd394640 1 --2- 172.21.15.33:0/3318323748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faed8103920 0x7faed8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.957+0000 7faedd394640 1 -- 172.21.15.33:0/3318323748 >> 172.21.15.33:0/3318323748 conn(0x7faed80ff3b0 msgr2=0x7faed8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.957+0000 7faedd394640 1 -- 172.21.15.33:0/3318323748 shutdown_connections 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.957+0000 7faedd394640 1 -- 172.21.15.33:0/3318323748 wait complete. 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.957+0000 7faedd394640 1 Processor -- start 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faedd394640 1 -- start start 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faedd394640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faed8103920 0x7faed819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faedd394640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faed8109260 0x7faed819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faedd394640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed8109bb0 0x7faed819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faedd394640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faed8113870 con 0x7faed8109260 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faedd394640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faed81136f0 con 0x7faed8109bb0 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faedd394640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faed81139f0 con 0x7faed8103920 2024-08-28T19:30:24.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed67fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faed8109260 0x7faed819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed67fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faed8109260 0x7faed819a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46862/0 (socket says 172.21.15.33:46862) 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed67fc640 1 -- 172.21.15.33:0/3720620568 learned_addr learned my addr 172.21.15.33:0/3720620568 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed77fe640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed8109bb0 0x7faed819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed6ffd640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faed8103920 0x7faed819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed67fc640 1 -- 172.21.15.33:0/3720620568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faed8103920 msgr2=0x7faed819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed67fc640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faed8103920 0x7faed819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed67fc640 1 -- 172.21.15.33:0/3720620568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed8109bb0 msgr2=0x7faed819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed67fc640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed8109bb0 0x7faed819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed67fc640 1 -- 172.21.15.33:0/3720620568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed81a0210 con 0x7faed8109260 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed77fe640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed8109bb0 0x7faed819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.958+0000 7faed67fc640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faed8109260 0x7faed819a840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faecc00d950 tx=0x7faecc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.959+0000 7faebffff640 1 -- 172.21.15.33:0/3720620568 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc017070 con 0x7faed8109260 2024-08-28T19:30:24.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.959+0000 7faedd394640 1 -- 172.21.15.33:0/3720620568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed81a0500 con 0x7faed8109260 2024-08-28T19:30:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.959+0000 7faebffff640 1 -- 172.21.15.33:0/3720620568 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faecc009c30 con 0x7faed8109260 2024-08-28T19:30:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.959+0000 7faebffff640 1 -- 172.21.15.33:0/3720620568 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc0047a0 con 0x7faed8109260 2024-08-28T19:30:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.959+0000 7faedd394640 1 -- 172.21.15.33:0/3720620568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed81a6c60 con 0x7faed8109260 2024-08-28T19:30:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.960+0000 7faedd394640 1 -- 172.21.15.33:0/3720620568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed8104ba0 con 0x7faed8109260 2024-08-28T19:30:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.961+0000 7faebffff640 1 -- 172.21.15.33:0/3720620568 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7faecc004020 con 0x7faed8109260 2024-08-28T19:30:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.962+0000 7faebffff640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faec00b4b80 0x7faec00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.962+0000 7faed6ffd640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faec00b4b80 0x7faec00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.962+0000 7faebffff640 1 -- 172.21.15.33:0/3720620568 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7faecc0e5580 con 0x7faed8109260 2024-08-28T19:30:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.962+0000 7faed6ffd640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faec00b4b80 0x7faec00b7090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faec8005fd0 tx=0x7faec8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:24.965+0000 7faebffff640 1 -- 172.21.15.33:0/3720620568 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faecc020020 con 0x7faed8109260 2024-08-28T19:30:25.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.188+0000 7faedd394640 1 -- 172.21.15.33:0/3720620568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7faed8103d30 con 0x7faed8109260 2024-08-28T19:30:25.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.381+0000 7faebffff640 1 -- 172.21.15.33:0/3720620568 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7faed8103d30 con 0x7faed8109260 2024-08-28T19:30:25.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 -- 172.21.15.33:0/3720620568 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faec00b4b80 msgr2=0x7faec00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:25.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faec00b4b80 0x7faec00b7090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faec8005fd0 tx=0x7faec8005850 comp rx=0 tx=0).stop 2024-08-28T19:30:25.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 -- 172.21.15.33:0/3720620568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faed8109260 msgr2=0x7faed819a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:25.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faed8109260 0x7faed819a840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faecc00d950 tx=0x7faecc00de10 comp rx=0 tx=0).stop 2024-08-28T19:30:25.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 -- 172.21.15.33:0/3720620568 shutdown_connections 2024-08-28T19:30:25.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed8109bb0 0x7faed819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:25.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faed8109260 0x7faed819a840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:25.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faec00b4b80 0x7faec00b7090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:25.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 --2- 172.21.15.33:0/3720620568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faed8103920 0x7faed819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:25.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 -- 172.21.15.33:0/3720620568 >> 172.21.15.33:0/3720620568 conn(0x7faed80ff3b0 msgr2=0x7faed8106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:25.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 -- 172.21.15.33:0/3720620568 shutdown_connections 2024-08-28T19:30:25.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:25.383+0000 7faedd394640 1 -- 172.21.15.33:0/3720620568 wait complete. 2024-08-28T19:30:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:25 smithi033 ceph-mon[18549]: pgmap v277: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:25 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] up:active 2024-08-28T19:30:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:25 smithi033 ceph-mon[18549]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-28T19:30:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:25 smithi033 ceph-mon[18549]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-28T19:30:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:25 smithi033 ceph-mon[18549]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-28T19:30:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:25 smithi033 ceph-mon[18549]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-28T19:30:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:25 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3720620568' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-28T19:30:25.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:25 smithi059 ceph-mon[22052]: pgmap v277: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:25 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] up:active 2024-08-28T19:30:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:25 smithi059 ceph-mon[22052]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-28T19:30:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:25 smithi059 ceph-mon[22052]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-28T19:30:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:25 smithi059 ceph-mon[22052]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-28T19:30:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:25 smithi059 ceph-mon[22052]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-28T19:30:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:25 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3720620568' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-28T19:30:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:25 smithi122 ceph-mon[22174]: pgmap v277: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-28T19:30:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:25 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] up:active 2024-08-28T19:30:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:25 smithi122 ceph-mon[22174]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-28T19:30:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:25 smithi122 ceph-mon[22174]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-28T19:30:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:25 smithi122 ceph-mon[22174]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-28T19:30:25.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:25 smithi122 ceph-mon[22174]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-28T19:30:25.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:25 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3720620568' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-28T19:30:26.175 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-28T19:30:26.438 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:26.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3720620568' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-28T19:30:26.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] up:active 2024-08-28T19:30:26.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-28T19:30:26.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-28T19:30:26.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-08-28T19:30:26.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-08-28T19:30:26.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-08-28T19:30:26.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-08-28T19:30:26.559 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]} : dispatch 2024-08-28T19:30:26.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-08-28T19:30:26.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2024-08-28T19:30:26.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-08-28T19:30:26.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]} : dispatch 2024-08-28T19:30:26.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]} : dispatch 2024-08-28T19:30:26.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]} : dispatch 2024-08-28T19:30:26.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]} : dispatch 2024-08-28T19:30:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3720620568' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-28T19:30:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] up:active 2024-08-28T19:30:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-28T19:30:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-28T19:30:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-08-28T19:30:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-08-28T19:30:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-08-28T19:30:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-08-28T19:30:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]} : dispatch 2024-08-28T19:30:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-08-28T19:30:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2024-08-28T19:30:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-08-28T19:30:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]} : dispatch 2024-08-28T19:30:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]} : dispatch 2024-08-28T19:30:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]} : dispatch 2024-08-28T19:30:26.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]} : dispatch 2024-08-28T19:30:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3720620568' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-28T19:30:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] up:active 2024-08-28T19:30:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-28T19:30:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]} : dispatch 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]} : dispatch 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]} : dispatch 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]} : dispatch 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]} : dispatch 2024-08-28T19:30:26.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]} : dispatch 2024-08-28T19:30:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.969+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1953500880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c81047c0 msgr2=0x7ff8c8104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.969+0000 7ff8ce75e640 1 --2- 172.21.15.33:0/1953500880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c81047c0 0x7ff8c8104bd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009900 tx=0x7ff8b802a410 comp rx=0 tx=0).stop 2024-08-28T19:30:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.969+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1953500880 shutdown_connections 2024-08-28T19:30:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.969+0000 7ff8ce75e640 1 --2- 172.21.15.33:0/1953500880 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c810dbf0 0x7ff8c81100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.969+0000 7ff8ce75e640 1 --2- 172.21.15.33:0/1953500880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c8105110 0x7ff8c810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.969+0000 7ff8ce75e640 1 --2- 172.21.15.33:0/1953500880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c81047c0 0x7ff8c8104bd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.969+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1953500880 >> 172.21.15.33:0/1953500880 conn(0x7ff8c8079470 msgr2=0x7ff8c8079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.969+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1953500880 shutdown_connections 2024-08-28T19:30:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.969+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1953500880 wait complete. 2024-08-28T19:30:26.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8ce75e640 1 Processor -- start 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8ce75e640 1 -- start start 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8ce75e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c81047c0 0x7ff8c819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8ce75e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8105110 0x7ff8c819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8ce75e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c810dbf0 0x7ff8c81a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8ce75e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c8113850 con 0x7ff8c8105110 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8ce75e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c81136d0 con 0x7ff8c81047c0 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8ce75e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c81139d0 con 0x7ff8c810dbf0 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8105110 0x7ff8c819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8105110 0x7ff8c819c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46882/0 (socket says 172.21.15.33:46882) 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.970+0000 7ff8bffff640 1 -- 172.21.15.33:0/1232365655 learned_addr learned my addr 172.21.15.33:0/1232365655 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8c7fff640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c81047c0 0x7ff8c819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8cccfb640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c810dbf0 0x7ff8c81a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8bffff640 1 -- 172.21.15.33:0/1232365655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c810dbf0 msgr2=0x7ff8c81a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8bffff640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c810dbf0 0x7ff8c81a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8bffff640 1 -- 172.21.15.33:0/1232365655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c81047c0 msgr2=0x7ff8c819c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8bffff640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c81047c0 0x7ff8c819c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8bffff640 1 -- 172.21.15.33:0/1232365655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c81a23b0 con 0x7ff8c8105110 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8c7fff640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c81047c0 0x7ff8c819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8cccfb640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c810dbf0 0x7ff8c81a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8bffff640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8105110 0x7ff8c819c9e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000d740 tx=0x7ff8b000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8c5ffb640 1 -- 172.21.15.33:0/1232365655 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0017070 con 0x7ff8c8105110 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1232365655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c81a26a0 con 0x7ff8c8105110 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8c5ffb640 1 -- 172.21.15.33:0/1232365655 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8b000de50 con 0x7ff8c8105110 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8c5ffb640 1 -- 172.21.15.33:0/1232365655 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000f620 con 0x7ff8c8105110 2024-08-28T19:30:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.971+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1232365655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c81a8e00 con 0x7ff8c8105110 2024-08-28T19:30:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.972+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1232365655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c806bf90 con 0x7ff8c8105110 2024-08-28T19:30:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.974+0000 7ff8c5ffb640 1 -- 172.21.15.33:0/1232365655 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7ff8b001a070 con 0x7ff8c8105110 2024-08-28T19:30:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.975+0000 7ff8c5ffb640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8b40b4b80 0x7ff8b40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.975+0000 7ff8c7fff640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8b40b4b80 0x7ff8b40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.975+0000 7ff8c5ffb640 1 -- 172.21.15.33:0/1232365655 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 9307+0+0 (secure 0 0 0) 0x7ff8b00e5060 con 0x7ff8c8105110 2024-08-28T19:30:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.975+0000 7ff8c7fff640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8b40b4b80 0x7ff8b40b7090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8031440 tx=0x7ff8b8009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:26.978+0000 7ff8c5ffb640 1 -- 172.21.15.33:0/1232365655 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff8b00abd60 con 0x7ff8c8105110 2024-08-28T19:30:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.198+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1232365655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff8c819d570 con 0x7ff8c8105110 2024-08-28T19:30:27.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.410+0000 7ff8c5ffb640 1 -- 172.21.15.33:0/1232365655 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7ff8b00b42a0 con 0x7ff8c8105110 2024-08-28T19:30:27.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1232365655 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8b40b4b80 msgr2=0x7ff8b40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:27.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8b40b4b80 0x7ff8b40b7090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8031440 tx=0x7ff8b8009680 comp rx=0 tx=0).stop 2024-08-28T19:30:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1232365655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8105110 msgr2=0x7ff8c819c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8105110 0x7ff8c819c9e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000d740 tx=0x7ff8b000dc00 comp rx=0 tx=0).stop 2024-08-28T19:30:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1232365655 shutdown_connections 2024-08-28T19:30:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8b40b4b80 0x7ff8b40b7090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8c810dbf0 0x7ff8c81a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8c8105110 0x7ff8c819c9e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 --2- 172.21.15.33:0/1232365655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c81047c0 0x7ff8c819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1232365655 >> 172.21.15.33:0/1232365655 conn(0x7ff8c8079470 msgr2=0x7ff8c8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.412+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1232365655 shutdown_connections 2024-08-28T19:30:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:27.413+0000 7ff8ce75e640 1 -- 172.21.15.33:0/1232365655 wait complete. 2024-08-28T19:30:27.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: pgmap v278: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 1 op/s 2024-08-28T19:30:27.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-08-28T19:30:27.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-28T19:30:27.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-08-28T19:30:27.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-08-28T19:30:27.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-08-28T19:30:27.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-08-28T19:30:27.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]': finished 2024-08-28T19:30:27.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-08-28T19:30:27.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-08-28T19:30:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-08-28T19:30:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] up:active 2024-08-28T19:30:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-28T19:30:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-28T19:30:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: Cluster is now healthy 2024-08-28T19:30:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-08-28T19:30:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: osdmap e81: 12 total, 12 up, 12 in 2024-08-28T19:30:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-28T19:30:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-08-28T19:30:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:27 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1232365655' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-28T19:30:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: pgmap v278: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 1 op/s 2024-08-28T19:30:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-08-28T19:30:27.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-28T19:30:27.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-08-28T19:30:27.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-08-28T19:30:27.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-08-28T19:30:27.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-08-28T19:30:27.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]': finished 2024-08-28T19:30:27.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-08-28T19:30:27.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-08-28T19:30:27.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-08-28T19:30:27.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] up:active 2024-08-28T19:30:27.785 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-28T19:30:27.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-28T19:30:27.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: Cluster is now healthy 2024-08-28T19:30:27.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-08-28T19:30:27.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: osdmap e81: 12 total, 12 up, 12 in 2024-08-28T19:30:27.786 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-28T19:30:27.787 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-08-28T19:30:27.787 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:27 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1232365655' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-28T19:30:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: pgmap v278: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 1 op/s 2024-08-28T19:30:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-08-28T19:30:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-08-28T19:30:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-08-28T19:30:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-08-28T19:30:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-08-28T19:30:27.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-08-28T19:30:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 8]}]': finished 2024-08-28T19:30:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-08-28T19:30:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-08-28T19:30:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-08-28T19:30:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] up:active 2024-08-28T19:30:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-28T19:30:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-28T19:30:27.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: Cluster is now healthy 2024-08-28T19:30:27.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-08-28T19:30:27.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: osdmap e81: 12 total, 12 up, 12 in 2024-08-28T19:30:27.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-28T19:30:27.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-08-28T19:30:27.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:27 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1232365655' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-28T19:30:28.263 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-08-28T19:30:28.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-28T19:30:28.520 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:28.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:28 smithi033 ceph-mon[18549]: osdmap e82: 12 total, 12 up, 12 in 2024-08-28T19:30:28.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:28 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1232365655' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-28T19:30:28.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:28 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] up:active 2024-08-28T19:30:28.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:28 smithi033 ceph-mon[18549]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-28T19:30:28.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:28 smithi033 ceph-mon[18549]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-28T19:30:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:28 smithi059 ceph-mon[22052]: osdmap e82: 12 total, 12 up, 12 in 2024-08-28T19:30:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:28 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1232365655' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-28T19:30:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:28 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] up:active 2024-08-28T19:30:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:28 smithi059 ceph-mon[22052]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-28T19:30:28.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:28 smithi059 ceph-mon[22052]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-28T19:30:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:28 smithi122 ceph-mon[22174]: osdmap e82: 12 total, 12 up, 12 in 2024-08-28T19:30:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:28 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1232365655' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-28T19:30:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:28 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] up:active 2024-08-28T19:30:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:28 smithi122 ceph-mon[22174]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-28T19:30:28.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:28 smithi122 ceph-mon[22174]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-28T19:30:29.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.029+0000 7fe38c2d4640 1 -- 172.21.15.33:0/2820886589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe384103950 msgr2=0x7fe384103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:29.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.029+0000 7fe38c2d4640 1 --2- 172.21.15.33:0/2820886589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe384103950 0x7fe384103d60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe380009900 tx=0x7fe38002a410 comp rx=0 tx=0).stop 2024-08-28T19:30:29.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.030+0000 7fe38c2d4640 1 -- 172.21.15.33:0/2820886589 shutdown_connections 2024-08-28T19:30:29.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.030+0000 7fe38c2d4640 1 --2- 172.21.15.33:0/2820886589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe384109be0 0x7fe384110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.030+0000 7fe38c2d4640 1 --2- 172.21.15.33:0/2820886589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe384109290 0x7fe3841096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.030+0000 7fe38c2d4640 1 --2- 172.21.15.33:0/2820886589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe384103950 0x7fe384103d60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.030+0000 7fe38c2d4640 1 -- 172.21.15.33:0/2820886589 >> 172.21.15.33:0/2820886589 conn(0x7fe3840ff3a0 msgr2=0x7fe3841017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:29.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.030+0000 7fe38c2d4640 1 -- 172.21.15.33:0/2820886589 shutdown_connections 2024-08-28T19:30:29.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.030+0000 7fe38c2d4640 1 -- 172.21.15.33:0/2820886589 wait complete. 2024-08-28T19:30:29.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.030+0000 7fe38c2d4640 1 Processor -- start 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.030+0000 7fe38c2d4640 1 -- start start 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38c2d4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe384103950 0x7fe38419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38c2d4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe384109290 0x7fe38419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38c2d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe384109be0 0x7fe38419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38c2d4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe3841138a0 con 0x7fe384103950 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38c2d4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe384113720 con 0x7fe384109290 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38c2d4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe384113a20 con 0x7fe384109be0 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a070640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe384103950 0x7fe38419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a070640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe384103950 0x7fe38419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57258/0 (socket says 172.21.15.33:57258) 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a070640 1 -- 172.21.15.33:0/3104794555 learned_addr learned my addr 172.21.15.33:0/3104794555 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a871640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe384109be0 0x7fe38419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:29.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38986f640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe384109290 0x7fe38419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a070640 1 -- 172.21.15.33:0/3104794555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe384109be0 msgr2=0x7fe38419fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a070640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe384109be0 0x7fe38419fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a070640 1 -- 172.21.15.33:0/3104794555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe384109290 msgr2=0x7fe38419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a070640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe384109290 0x7fe38419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a070640 1 -- 172.21.15.33:0/3104794555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3841a01e0 con 0x7fe384103950 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38986f640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe384109290 0x7fe38419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a871640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe384109be0 0x7fe38419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe38a070640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe384103950 0x7fe38419a270 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe380005940 tx=0x7fe3800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.031+0000 7fe37b7fe640 1 -- 172.21.15.33:0/3104794555 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38003f030 con 0x7fe384103950 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.032+0000 7fe38c2d4640 1 -- 172.21.15.33:0/3104794555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3841a0470 con 0x7fe384103950 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.032+0000 7fe37b7fe640 1 -- 172.21.15.33:0/3104794555 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe380003cb0 con 0x7fe384103950 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.032+0000 7fe37b7fe640 1 -- 172.21.15.33:0/3104794555 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe380035070 con 0x7fe384103950 2024-08-28T19:30:29.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.032+0000 7fe38c2d4640 1 -- 172.21.15.33:0/3104794555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3841a6c30 con 0x7fe384103950 2024-08-28T19:30:29.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.033+0000 7fe38c2d4640 1 -- 172.21.15.33:0/3104794555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe384103d60 con 0x7fe384103950 2024-08-28T19:30:29.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.034+0000 7fe37b7fe640 1 -- 172.21.15.33:0/3104794555 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fe380042030 con 0x7fe384103950 2024-08-28T19:30:29.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.035+0000 7fe37b7fe640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe3700b4b80 0x7fe3700b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:29.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.035+0000 7fe38986f640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe3700b4b80 0x7fe3700b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:29.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.035+0000 7fe37b7fe640 1 -- 172.21.15.33:0/3104794555 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fe380105fc0 con 0x7fe384103950 2024-08-28T19:30:29.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.035+0000 7fe38986f640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe3700b4b80 0x7fe3700b7090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe374005d00 tx=0x7fe374005ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:29.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.039+0000 7fe37b7fe640 1 -- 172.21.15.33:0/3104794555 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe3800ccc60 con 0x7fe384103950 2024-08-28T19:30:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.249+0000 7fe38c2d4640 1 -- 172.21.15.33:0/3104794555 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe3840635a0 con 0x7fe3700b4b80 2024-08-28T19:30:29.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.280+0000 7fe37b7fe640 1 -- 172.21.15.33:0/3104794555 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe3840635a0 con 0x7fe3700b4b80 2024-08-28T19:30:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 -- 172.21.15.33:0/3104794555 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe3700b4b80 msgr2=0x7fe3700b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe3700b4b80 0x7fe3700b7090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe374005d00 tx=0x7fe374005ed0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 -- 172.21.15.33:0/3104794555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe384103950 msgr2=0x7fe38419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe384103950 0x7fe38419a270 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe380005940 tx=0x7fe3800042f0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 -- 172.21.15.33:0/3104794555 shutdown_connections 2024-08-28T19:30:29.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe3700b4b80 0x7fe3700b7090 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe384109be0 0x7fe38419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe384109290 0x7fe38419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 --2- 172.21.15.33:0/3104794555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe384103950 0x7fe38419a270 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:29.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 -- 172.21.15.33:0/3104794555 >> 172.21.15.33:0/3104794555 conn(0x7fe3840ff3a0 msgr2=0x7fe3841017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:29.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 -- 172.21.15.33:0/3104794555 shutdown_connections 2024-08-28T19:30:29.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:29.282+0000 7fe38c2d4640 1 -- 172.21.15.33:0/3104794555 wait complete. 2024-08-28T19:30:29.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:29 smithi033 ceph-mon[18549]: pgmap v281: 129 pgs: 2 activating, 1 peering, 126 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-08-28T19:30:29.599 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:30:29 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:30:29.255+0000 7feb0c183640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T19:30:29.599 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:30:29 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:30:29.255+0000 7feb0c183640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T19:30:29.599 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:30:29 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:30:29.255+0000 7feb0c183640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T19:30:29.599 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:30:29 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:30:29.255+0000 7feb0c183640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T19:30:29.600 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:30:29 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:30:29.255+0000 7feb0c183640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T19:30:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:29 smithi059 ceph-mon[22052]: pgmap v281: 129 pgs: 2 activating, 1 peering, 126 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-08-28T19:30:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:29 smithi122 ceph-mon[22174]: pgmap v281: 129 pgs: 2 activating, 1 peering, 126 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-08-28T19:30:30.075 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-28T19:30:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:30.729 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:30 smithi033 ceph-mon[18549]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:30.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:30 smithi059 ceph-mon[22052]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:30.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:30 smithi122 ceph-mon[22174]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:30.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.825+0000 7f2ba0147640 1 -- 172.21.15.33:0/764969847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b98108b40 msgr2=0x7f2b9810f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.825+0000 7f2ba0147640 1 --2- 172.21.15.33:0/764969847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b98108b40 0x7f2b9810f370 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009ca0 tx=0x7f2b9002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.825+0000 7f2ba0147640 1 -- 172.21.15.33:0/764969847 shutdown_connections 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.825+0000 7f2ba0147640 1 --2- 172.21.15.33:0/764969847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b98108b40 0x7f2b9810f370 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.825+0000 7f2ba0147640 1 --2- 172.21.15.33:0/764969847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b981081f0 0x7f2b98108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.825+0000 7f2ba0147640 1 --2- 172.21.15.33:0/764969847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b981028b0 0x7f2b98102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.825+0000 7f2ba0147640 1 -- 172.21.15.33:0/764969847 >> 172.21.15.33:0/764969847 conn(0x7f2b98079470 msgr2=0x7f2b98079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.825+0000 7f2ba0147640 1 -- 172.21.15.33:0/764969847 shutdown_connections 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.825+0000 7f2ba0147640 1 -- 172.21.15.33:0/764969847 wait complete. 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.825+0000 7f2ba0147640 1 Processor -- start 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2ba0147640 1 -- start start 2024-08-28T19:30:30.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2ba0147640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b981028b0 0x7f2b9819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2ba0147640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b981081f0 0x7f2b9819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2ba0147640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b98108b40 0x7f2b9819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2ba0147640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98113920 con 0x7f2b98108b40 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2ba0147640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2b981137a0 con 0x7f2b981028b0 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2ba0147640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98113aa0 con 0x7f2b981081f0 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9e6e4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b98108b40 0x7f2b9819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9e6e4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b98108b40 0x7f2b9819fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57284/0 (socket says 172.21.15.33:57284) 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9e6e4640 1 -- 172.21.15.33:0/2499296615 learned_addr learned my addr 172.21.15.33:0/2499296615 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9dee3640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b981028b0 0x7f2b9819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9d6e2640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b981081f0 0x7f2b9819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9e6e4640 1 -- 172.21.15.33:0/2499296615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b981081f0 msgr2=0x7f2b9819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9e6e4640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b981081f0 0x7f2b9819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:30.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9e6e4640 1 -- 172.21.15.33:0/2499296615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b981028b0 msgr2=0x7f2b9819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9e6e4640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b981028b0 0x7f2b9819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9e6e4640 1 -- 172.21.15.33:0/2499296615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b981a00e0 con 0x7f2b98108b40 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.826+0000 7f2b9e6e4640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b98108b40 0x7f2b9819fa70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2b90005cc0 tx=0x7f2b9002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.827+0000 7f2b8effd640 1 -- 172.21.15.33:0/2499296615 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90003cf0 con 0x7f2b98108b40 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.827+0000 7f2b8effd640 1 -- 172.21.15.33:0/2499296615 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b900044f0 con 0x7f2b98108b40 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.827+0000 7f2b8effd640 1 -- 172.21.15.33:0/2499296615 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9002fc30 con 0x7f2b98108b40 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.827+0000 7f2ba0147640 1 -- 172.21.15.33:0/2499296615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b981a0370 con 0x7f2b98108b40 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.827+0000 7f2ba0147640 1 -- 172.21.15.33:0/2499296615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b981a6bf0 con 0x7f2b98108b40 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.828+0000 7f2ba0147640 1 -- 172.21.15.33:0/2499296615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b98102cc0 con 0x7f2b98108b40 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.829+0000 7f2b8effd640 1 -- 172.21.15.33:0/2499296615 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f2b900046a0 con 0x7f2b98108b40 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.830+0000 7f2b8effd640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2b840b4cc0 0x7f2b840b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.830+0000 7f2b9dee3640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2b840b4cc0 0x7f2b840b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:30.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.830+0000 7f2b8effd640 1 -- 172.21.15.33:0/2499296615 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f2b90106b60 con 0x7f2b98108b40 2024-08-28T19:30:30.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.830+0000 7f2b9dee3640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2b840b4cc0 0x7f2b840b71d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400abe0 tx=0x7f2b9400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:30.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:30.834+0000 7f2b8effd640 1 -- 172.21.15.33:0/2499296615 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2b900cd700 con 0x7f2b98108b40 2024-08-28T19:30:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.047+0000 7f2ba0147640 1 -- 172.21.15.33:0/2499296615 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2b980635a0 con 0x7f2b840b4cc0 2024-08-28T19:30:31.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.075+0000 7f2b8effd640 1 -- 172.21.15.33:0/2499296615 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2b980635a0 con 0x7f2b840b4cc0 2024-08-28T19:30:31.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 -- 172.21.15.33:0/2499296615 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2b840b4cc0 msgr2=0x7f2b840b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:31.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2b840b4cc0 0x7f2b840b71d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400abe0 tx=0x7f2b9400a2d0 comp rx=0 tx=0).stop 2024-08-28T19:30:31.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 -- 172.21.15.33:0/2499296615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b98108b40 msgr2=0x7f2b9819fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:31.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b98108b40 0x7f2b9819fa70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2b90005cc0 tx=0x7f2b9002f470 comp rx=0 tx=0).stop 2024-08-28T19:30:31.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 -- 172.21.15.33:0/2499296615 shutdown_connections 2024-08-28T19:30:31.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b98108b40 0x7f2b9819fa70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:31.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2b840b4cc0 0x7f2b840b71d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2b981081f0 0x7f2b9819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 --2- 172.21.15.33:0/2499296615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b981028b0 0x7f2b9819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 -- 172.21.15.33:0/2499296615 >> 172.21.15.33:0/2499296615 conn(0x7f2b98079470 msgr2=0x7f2b981061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 -- 172.21.15.33:0/2499296615 shutdown_connections 2024-08-28T19:30:31.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:31.077+0000 7f2ba0147640 1 -- 172.21.15.33:0/2499296615 wait complete. 2024-08-28T19:30:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:31 smithi059 ceph-mon[22052]: pgmap v282: 129 pgs: 2 activating, 1 peering, 126 active+clean; 586 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.9 KiB/s wr, 23 op/s 2024-08-28T19:30:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:31 smithi059 ceph-mon[22052]: mgrmap e21: x(active, since 7m), standbys: y, z 2024-08-28T19:30:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:31 smithi122 ceph-mon[22174]: pgmap v282: 129 pgs: 2 activating, 1 peering, 126 active+clean; 586 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.9 KiB/s wr, 23 op/s 2024-08-28T19:30:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:31 smithi122 ceph-mon[22174]: mgrmap e21: x(active, since 7m), standbys: y, z 2024-08-28T19:30:31.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:31 smithi033 ceph-mon[18549]: pgmap v282: 129 pgs: 2 activating, 1 peering, 126 active+clean; 586 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 5.9 KiB/s wr, 23 op/s 2024-08-28T19:30:31.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:31 smithi033 ceph-mon[18549]: mgrmap e21: x(active, since 7m), standbys: y, z 2024-08-28T19:30:31.883 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-28T19:30:32.139 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:32.556 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:32 smithi033 ceph-mon[18549]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.651+0000 7f8fba79d640 1 -- 172.21.15.33:0/555944793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb410d9b0 msgr2=0x7f8fb410fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.651+0000 7f8fba79d640 1 --2- 172.21.15.33:0/555944793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb410d9b0 0x7f8fb410fec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fac009ca0 tx=0x7f8fac02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.651+0000 7f8fba79d640 1 -- 172.21.15.33:0/555944793 shutdown_connections 2024-08-28T19:30:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.651+0000 7f8fba79d640 1 --2- 172.21.15.33:0/555944793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb410d9b0 0x7f8fb410fec0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.651+0000 7f8fba79d640 1 --2- 172.21.15.33:0/555944793 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb4104e30 0x7f8fb410d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.651+0000 7f8fba79d640 1 --2- 172.21.15.33:0/555944793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4104400 0x7f8fb4104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.651+0000 7f8fba79d640 1 -- 172.21.15.33:0/555944793 >> 172.21.15.33:0/555944793 conn(0x7f8fb40fe070 msgr2=0x7f8fb41004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.652+0000 7f8fba79d640 1 -- 172.21.15.33:0/555944793 shutdown_connections 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.652+0000 7f8fba79d640 1 -- 172.21.15.33:0/555944793 wait complete. 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.652+0000 7f8fba79d640 1 Processor -- start 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.652+0000 7f8fba79d640 1 -- start start 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.652+0000 7f8fba79d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4104400 0x7f8fb4102310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.652+0000 7f8fba79d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb4104e30 0x7f8fb4102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.652+0000 7f8fba79d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb410d9b0 0x7f8fb4102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.652+0000 7f8fba79d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4113660 con 0x7f8fb410d9b0 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fba79d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41134e0 con 0x7f8fb4104400 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fba79d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41137e0 con 0x7f8fb4104e30 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb9f9c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb410d9b0 0x7f8fb4102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb9f9c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb410d9b0 0x7f8fb4102d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57298/0 (socket says 172.21.15.33:57298) 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb9f9c640 1 -- 172.21.15.33:0/413643801 learned_addr learned my addr 172.21.15.33:0/413643801 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb8f9a640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb4104e30 0x7f8fb4102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb979b640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4104400 0x7f8fb4102310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb9f9c640 1 -- 172.21.15.33:0/413643801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb4104e30 msgr2=0x7f8fb4102850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb9f9c640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb4104e30 0x7f8fb4102850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb9f9c640 1 -- 172.21.15.33:0/413643801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4104400 msgr2=0x7f8fb4102310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb9f9c640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4104400 0x7f8fb4102310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb9f9c640 1 -- 172.21.15.33:0/413643801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb41a82a0 con 0x7f8fb410d9b0 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fb9f9c640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb410d9b0 0x7f8fb4102d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8fac005cc0 tx=0x7f8fac02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8faa7fc640 1 -- 172.21.15.33:0/413643801 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac003cf0 con 0x7f8fb410d9b0 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8faa7fc640 1 -- 172.21.15.33:0/413643801 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fac0044f0 con 0x7f8fb410d9b0 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fba79d640 1 -- 172.21.15.33:0/413643801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb41a8530 con 0x7f8fb410d9b0 2024-08-28T19:30:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8faa7fc640 1 -- 172.21.15.33:0/413643801 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac02fd10 con 0x7f8fb410d9b0 2024-08-28T19:30:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.653+0000 7f8fba79d640 1 -- 172.21.15.33:0/413643801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb41a8a70 con 0x7f8fb410d9b0 2024-08-28T19:30:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.654+0000 7f8fba79d640 1 -- 172.21.15.33:0/413643801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb4104810 con 0x7f8fb410d9b0 2024-08-28T19:30:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.657+0000 7f8faa7fc640 1 -- 172.21.15.33:0/413643801 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f8fac004040 con 0x7f8fb410d9b0 2024-08-28T19:30:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.657+0000 7f8faa7fc640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fa00b4c10 0x7f8fa00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.657+0000 7f8fb979b640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fa00b4c10 0x7f8fa00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.657+0000 7f8faa7fc640 1 -- 172.21.15.33:0/413643801 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f8fac106f70 con 0x7f8fb410d9b0 2024-08-28T19:30:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.658+0000 7f8fb979b640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fa00b4c10 0x7f8fa00b7120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0005e10 tx=0x7f8fb0005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.661+0000 7f8faa7fc640 1 -- 172.21.15.33:0/413643801 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8fac0cdb10 con 0x7f8fb410d9b0 2024-08-28T19:30:32.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:32 smithi059 ceph-mon[22052]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:32.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:32 smithi122 ceph-mon[22174]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:32.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.874+0000 7f8fba79d640 1 -- 172.21.15.33:0/413643801 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f8fb4107bf0 con 0x7f8fa00b4c10 2024-08-28T19:30:32.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.880+0000 7f8faa7fc640 1 -- 172.21.15.33:0/413643801 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8fb4107bf0 con 0x7f8fa00b4c10 2024-08-28T19:30:32.882 INFO:teuthology.orchestra.run.smithi033.stdout:/volumes/qa/sv_0/cb855457-2b29-415e-8e02-c8e3a33ab84b 2024-08-28T19:30:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 -- 172.21.15.33:0/413643801 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fa00b4c10 msgr2=0x7f8fa00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fa00b4c10 0x7f8fa00b7120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0005e10 tx=0x7f8fb0005da0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 -- 172.21.15.33:0/413643801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb410d9b0 msgr2=0x7f8fb4102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb410d9b0 0x7f8fb4102d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8fac005cc0 tx=0x7f8fac02f470 comp rx=0 tx=0).stop 2024-08-28T19:30:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 -- 172.21.15.33:0/413643801 shutdown_connections 2024-08-28T19:30:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb410d9b0 0x7f8fb4102d90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fa00b4c10 0x7f8fa00b7120 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fb4104e30 0x7f8fb4102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 --2- 172.21.15.33:0/413643801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4104400 0x7f8fb4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 -- 172.21.15.33:0/413643801 >> 172.21.15.33:0/413643801 conn(0x7f8fb40fe070 msgr2=0x7f8fb41074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 -- 172.21.15.33:0/413643801 shutdown_connections 2024-08-28T19:30:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:32.883+0000 7f8fba79d640 1 -- 172.21.15.33:0/413643801 wait complete. 2024-08-28T19:30:33.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:33 smithi033 ceph-mon[18549]: pgmap v283: 129 pgs: 2 activating, 127 active+clean; 587 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6.0 KiB/s wr, 25 op/s 2024-08-28T19:30:33.709 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-28T19:30:33.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:33 smithi059 ceph-mon[22052]: pgmap v283: 129 pgs: 2 activating, 127 active+clean; 587 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6.0 KiB/s wr, 25 op/s 2024-08-28T19:30:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:33 smithi122 ceph-mon[22174]: pgmap v283: 129 pgs: 2 activating, 127 active+clean; 587 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 6.0 KiB/s wr, 25 op/s 2024-08-28T19:30:33.960 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:34.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.469+0000 7efdd0f35640 1 -- 172.21.15.33:0/3949277725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdcc102870 msgr2=0x7efdcc102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:34.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.469+0000 7efdd0f35640 1 --2- 172.21.15.33:0/3949277725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdcc102870 0x7efdcc102c80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009900 tx=0x7efdbc02a410 comp rx=0 tx=0).stop 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.470+0000 7efdd0f35640 1 -- 172.21.15.33:0/3949277725 shutdown_connections 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.470+0000 7efdd0f35640 1 --2- 172.21.15.33:0/3949277725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdcc108ab0 0x7efdcc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.470+0000 7efdd0f35640 1 --2- 172.21.15.33:0/3949277725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc108160 0x7efdcc108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.470+0000 7efdd0f35640 1 --2- 172.21.15.33:0/3949277725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdcc102870 0x7efdcc102c80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.470+0000 7efdd0f35640 1 -- 172.21.15.33:0/3949277725 >> 172.21.15.33:0/3949277725 conn(0x7efdcc079470 msgr2=0x7efdcc079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.470+0000 7efdd0f35640 1 -- 172.21.15.33:0/3949277725 shutdown_connections 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.470+0000 7efdd0f35640 1 -- 172.21.15.33:0/3949277725 wait complete. 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.470+0000 7efdd0f35640 1 Processor -- start 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdd0f35640 1 -- start start 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdd0f35640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc102870 0x7efdcc0ff440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdd0f35640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdcc108160 0x7efdcc0ff980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdd0f35640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdcc108ab0 0x7efdcc0ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdd0f35640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc112780 con 0x7efdcc108160 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdd0f35640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc112600 con 0x7efdcc108ab0 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdd0f35640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc112900 con 0x7efdcc102870 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdc9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdcc108160 0x7efdcc0ff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdc9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdcc108160 0x7efdcc0ff980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57326/0 (socket says 172.21.15.33:57326) 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdc9d9b640 1 -- 172.21.15.33:0/3322276559 learned_addr learned my addr 172.21.15.33:0/3322276559 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdca59c640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc102870 0x7efdcc0ff440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdcad9d640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdcc108ab0 0x7efdcc0ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdc9d9b640 1 -- 172.21.15.33:0/3322276559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc102870 msgr2=0x7efdcc0ff440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdc9d9b640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc102870 0x7efdcc0ff440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdc9d9b640 1 -- 172.21.15.33:0/3322276559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdcc108ab0 msgr2=0x7efdcc0ffec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdc9d9b640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdcc108ab0 0x7efdcc0ffec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:34.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdc9d9b640 1 -- 172.21.15.33:0/3322276559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc1a8540 con 0x7efdcc108160 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.471+0000 7efdc9d9b640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdcc108160 0x7efdcc0ff980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efdc000d750 tx=0x7efdc000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.472+0000 7efdbb7fe640 1 -- 172.21.15.33:0/3322276559 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0017070 con 0x7efdcc108160 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.472+0000 7efdbb7fe640 1 -- 172.21.15.33:0/3322276559 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdc00054d0 con 0x7efdcc108160 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.472+0000 7efdd0f35640 1 -- 172.21.15.33:0/3322276559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdcc1a8830 con 0x7efdcc108160 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.472+0000 7efdbb7fe640 1 -- 172.21.15.33:0/3322276559 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0004c30 con 0x7efdcc108160 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.472+0000 7efdd0f35640 1 -- 172.21.15.33:0/3322276559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdcc1a8d20 con 0x7efdcc108160 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.473+0000 7efdd0f35640 1 -- 172.21.15.33:0/3322276559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdcc103aa0 con 0x7efdcc108160 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.474+0000 7efdbb7fe640 1 -- 172.21.15.33:0/3322276559 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7efdc0004dd0 con 0x7efdcc108160 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.475+0000 7efdbb7fe640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efdb40b4c10 0x7efdb40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.475+0000 7efdca59c640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efdb40b4c10 0x7efdb40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.475+0000 7efdbb7fe640 1 -- 172.21.15.33:0/3322276559 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7efdc00e5160 con 0x7efdcc108160 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.475+0000 7efdca59c640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efdb40b4c10 0x7efdb40b7120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efdbc000c00 tx=0x7efdbc031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:34.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.479+0000 7efdbb7fe640 1 -- 172.21.15.33:0/3322276559 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efdc00ab650 con 0x7efdcc108160 2024-08-28T19:30:34.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:34 smithi033 ceph-mon[18549]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:34.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.692+0000 7efdd0f35640 1 -- 172.21.15.33:0/3322276559 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7efdcc0635a0 con 0x7efdb40b4c10 2024-08-28T19:30:34.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.719+0000 7efdbb7fe640 1 -- 172.21.15.33:0/3322276559 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efdcc0635a0 con 0x7efdb40b4c10 2024-08-28T19:30:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 -- 172.21.15.33:0/3322276559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efdb40b4c10 msgr2=0x7efdb40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efdb40b4c10 0x7efdb40b7120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efdbc000c00 tx=0x7efdbc031400 comp rx=0 tx=0).stop 2024-08-28T19:30:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 -- 172.21.15.33:0/3322276559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdcc108160 msgr2=0x7efdcc0ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdcc108160 0x7efdcc0ff980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efdc000d750 tx=0x7efdc000dc10 comp rx=0 tx=0).stop 2024-08-28T19:30:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 -- 172.21.15.33:0/3322276559 shutdown_connections 2024-08-28T19:30:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdcc108ab0 0x7efdcc0ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdcc108160 0x7efdcc0ff980 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efdb40b4c10 0x7efdb40b7120 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 --2- 172.21.15.33:0/3322276559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efdcc102870 0x7efdcc0ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 -- 172.21.15.33:0/3322276559 >> 172.21.15.33:0/3322276559 conn(0x7efdcc079470 msgr2=0x7efdcc1018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 -- 172.21.15.33:0/3322276559 shutdown_connections 2024-08-28T19:30:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:34.721+0000 7efdd0f35640 1 -- 172.21.15.33:0/3322276559 wait complete. 2024-08-28T19:30:34.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:34 smithi059 ceph-mon[22052]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:34.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:34 smithi122 ceph-mon[22174]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:35.478 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-28T19:30:35.736 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:35.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:35 smithi059 ceph-mon[22052]: pgmap v284: 129 pgs: 129 active+clean; 607 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 30 op/s 2024-08-28T19:30:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:35 smithi122 ceph-mon[22174]: pgmap v284: 129 pgs: 129 active+clean; 607 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 30 op/s 2024-08-28T19:30:35.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:35 smithi033 ceph-mon[18549]: pgmap v284: 129 pgs: 129 active+clean; 607 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 30 op/s 2024-08-28T19:30:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.254+0000 7f74f2cc2640 1 -- 172.21.15.33:0/1593844518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74ec105050 msgr2=0x7f74ec10d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.254+0000 7f74f2cc2640 1 --2- 172.21.15.33:0/1593844518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74ec105050 0x7f74ec10d690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009900 tx=0x7f74d402a410 comp rx=0 tx=0).stop 2024-08-28T19:30:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.254+0000 7f74f2cc2640 1 -- 172.21.15.33:0/1593844518 shutdown_connections 2024-08-28T19:30:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.254+0000 7f74f2cc2640 1 --2- 172.21.15.33:0/1593844518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ec10dbd0 0x7f74ec1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.254+0000 7f74f2cc2640 1 --2- 172.21.15.33:0/1593844518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74ec105050 0x7f74ec10d690 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.254+0000 7f74f2cc2640 1 --2- 172.21.15.33:0/1593844518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74ec104620 0x7f74ec104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.254+0000 7f74f2cc2640 1 -- 172.21.15.33:0/1593844518 >> 172.21.15.33:0/1593844518 conn(0x7f74ec0794c0 msgr2=0x7f74ec0798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.254+0000 7f74f2cc2640 1 -- 172.21.15.33:0/1593844518 shutdown_connections 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.254+0000 7f74f2cc2640 1 -- 172.21.15.33:0/1593844518 wait complete. 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f2cc2640 1 Processor -- start 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f2cc2640 1 -- start start 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f2cc2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74ec104620 0x7f74ec19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f2cc2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ec105050 0x7f74ec19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f2cc2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74ec10dbd0 0x7f74ec19fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f2cc2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec1137d0 con 0x7f74ec10dbd0 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f2cc2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec113650 con 0x7f74ec104620 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f2cc2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec113950 con 0x7f74ec105050 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f125f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74ec10dbd0 0x7f74ec19fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f125f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74ec10dbd0 0x7f74ec19fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57340/0 (socket says 172.21.15.33:57340) 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f125f640 1 -- 172.21.15.33:0/3713661194 learned_addr learned my addr 172.21.15.33:0/3713661194 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.255+0000 7f74f0a5e640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74ec104620 0x7f74ec19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74ebfff640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ec105050 0x7f74ec19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74f125f640 1 -- 172.21.15.33:0/3713661194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ec105050 msgr2=0x7f74ec19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74f125f640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ec105050 0x7f74ec19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74f125f640 1 -- 172.21.15.33:0/3713661194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74ec104620 msgr2=0x7f74ec19a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74f125f640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74ec104620 0x7f74ec19a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74f125f640 1 -- 172.21.15.33:0/3713661194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ec1a0190 con 0x7f74ec10dbd0 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74f0a5e640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74ec104620 0x7f74ec19a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74f125f640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74ec10dbd0 0x7f74ec19fa60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f74e400d750 tx=0x7f74e400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74e9ffb640 1 -- 172.21.15.33:0/3713661194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4017070 con 0x7f74ec10dbd0 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74f2cc2640 1 -- 172.21.15.33:0/3713661194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74ec1a0480 con 0x7f74ec10dbd0 2024-08-28T19:30:36.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74e9ffb640 1 -- 172.21.15.33:0/3713661194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74e40054d0 con 0x7f74ec10dbd0 2024-08-28T19:30:36.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74e9ffb640 1 -- 172.21.15.33:0/3713661194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4004c60 con 0x7f74ec10dbd0 2024-08-28T19:30:36.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.256+0000 7f74f2cc2640 1 -- 172.21.15.33:0/3713661194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74ec1a6be0 con 0x7f74ec10dbd0 2024-08-28T19:30:36.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.257+0000 7f74f2cc2640 1 -- 172.21.15.33:0/3713661194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74ec06bf80 con 0x7f74ec10dbd0 2024-08-28T19:30:36.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.260+0000 7f74e9ffb640 1 -- 172.21.15.33:0/3713661194 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f74e4009bd0 con 0x7f74ec10dbd0 2024-08-28T19:30:36.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.260+0000 7f74e9ffb640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74d80b4c10 0x7f74d80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:36.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.261+0000 7f74f0a5e640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74d80b4c10 0x7f74d80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:36.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.261+0000 7f74e9ffb640 1 -- 172.21.15.33:0/3713661194 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f74e40e5530 con 0x7f74ec10dbd0 2024-08-28T19:30:36.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.261+0000 7f74f0a5e640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74d80b4c10 0x7f74d80b7120 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f74ec06c680 tx=0x7f74dc009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:36.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.264+0000 7f74e9ffb640 1 -- 172.21.15.33:0/3713661194 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f74e40ac0d0 con 0x7f74ec10dbd0 2024-08-28T19:30:36.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.483+0000 7f74f2cc2640 1 -- 172.21.15.33:0/3713661194 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f74ec0635a0 con 0x7f74d80b4c10 2024-08-28T19:30:36.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.488+0000 7f74e9ffb640 1 -- 172.21.15.33:0/3713661194 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f74ec0635a0 con 0x7f74d80b4c10 2024-08-28T19:30:36.489 INFO:teuthology.orchestra.run.smithi033.stdout:/volumes/qa/sv_1/b41436e7-7e7e-4409-8a1d-1ca40de42fe2 2024-08-28T19:30:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 -- 172.21.15.33:0/3713661194 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74d80b4c10 msgr2=0x7f74d80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74d80b4c10 0x7f74d80b7120 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f74ec06c680 tx=0x7f74dc009500 comp rx=0 tx=0).stop 2024-08-28T19:30:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 -- 172.21.15.33:0/3713661194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74ec10dbd0 msgr2=0x7f74ec19fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74ec10dbd0 0x7f74ec19fa60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f74e400d750 tx=0x7f74e400dc10 comp rx=0 tx=0).stop 2024-08-28T19:30:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 -- 172.21.15.33:0/3713661194 shutdown_connections 2024-08-28T19:30:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74ec10dbd0 0x7f74ec19fa60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74d80b4c10 0x7f74d80b7120 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74ec105050 0x7f74ec19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 --2- 172.21.15.33:0/3713661194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74ec104620 0x7f74ec19a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 -- 172.21.15.33:0/3713661194 >> 172.21.15.33:0/3713661194 conn(0x7f74ec0794c0 msgr2=0x7f74ec100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 -- 172.21.15.33:0/3713661194 shutdown_connections 2024-08-28T19:30:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:36.490+0000 7f74f2cc2640 1 -- 172.21.15.33:0/3713661194 wait complete. 2024-08-28T19:30:36.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:36 smithi059 ceph-mon[22052]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:36.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:36 smithi122 ceph-mon[22174]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:36.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:36 smithi033 ceph-mon[18549]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:37.485 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:30:37.741 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:37.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:37 smithi059 ceph-mon[22052]: pgmap v285: 129 pgs: 129 active+clean; 608 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.5 KiB/s wr, 27 op/s 2024-08-28T19:30:37.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:37 smithi059 ceph-mon[22052]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:37 smithi122 ceph-mon[22174]: pgmap v285: 129 pgs: 129 active+clean; 608 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.5 KiB/s wr, 27 op/s 2024-08-28T19:30:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:37 smithi122 ceph-mon[22174]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:37.862 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:37 smithi033 ceph-mon[18549]: pgmap v285: 129 pgs: 129 active+clean; 608 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.5 KiB/s wr, 27 op/s 2024-08-28T19:30:37.862 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:37 smithi033 ceph-mon[18549]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:30:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.268+0000 7f307f7f2640 1 -- 172.21.15.33:0/798608789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f307810dbd0 msgr2=0x7f30781100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.268+0000 7f307f7f2640 1 --2- 172.21.15.33:0/798608789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f307810dbd0 0x7f30781100c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3070009ca0 tx=0x7f307002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.268+0000 7f307f7f2640 1 -- 172.21.15.33:0/798608789 shutdown_connections 2024-08-28T19:30:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.268+0000 7f307f7f2640 1 --2- 172.21.15.33:0/798608789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f307810dbd0 0x7f30781100c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.268+0000 7f307f7f2640 1 --2- 172.21.15.33:0/798608789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30781050c0 0x7f307810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.268+0000 7f307f7f2640 1 --2- 172.21.15.33:0/798608789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3078104770 0x7f3078104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.268+0000 7f307f7f2640 1 -- 172.21.15.33:0/798608789 >> 172.21.15.33:0/798608789 conn(0x7f30780794e0 msgr2=0x7f30780798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.268+0000 7f307f7f2640 1 -- 172.21.15.33:0/798608789 shutdown_connections 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.268+0000 7f307f7f2640 1 -- 172.21.15.33:0/798608789 wait complete. 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307f7f2640 1 Processor -- start 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307f7f2640 1 -- start start 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307f7f2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3078104770 0x7f307819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307f7f2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30781050c0 0x7f307819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307f7f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f307810dbd0 0x7f307819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307f7f2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3078113830 con 0x7f307810dbd0 2024-08-28T19:30:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307f7f2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30781136b0 con 0x7f30781050c0 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307f7f2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f30781139b0 con 0x7f3078104770 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307dd8f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f307810dbd0 0x7f307819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307dd8f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f307810dbd0 0x7f307819fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57364/0 (socket says 172.21.15.33:57364) 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307dd8f640 1 -- 172.21.15.33:0/3884625406 learned_addr learned my addr 172.21.15.33:0/3884625406 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307cd8d640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30781050c0 0x7f307819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307d58e640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3078104770 0x7f307819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307dd8f640 1 -- 172.21.15.33:0/3884625406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3078104770 msgr2=0x7f307819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307dd8f640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3078104770 0x7f307819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307dd8f640 1 -- 172.21.15.33:0/3884625406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30781050c0 msgr2=0x7f307819a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307dd8f640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30781050c0 0x7f307819a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307dd8f640 1 -- 172.21.15.33:0/3884625406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30781a01f0 con 0x7f307810dbd0 2024-08-28T19:30:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.269+0000 7f307d58e640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3078104770 0x7f307819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.270+0000 7f307dd8f640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f307810dbd0 0x7f307819fac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3070005cc0 tx=0x7f307002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.270+0000 7f306e7fc640 1 -- 172.21.15.33:0/3884625406 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070003bf0 con 0x7f307810dbd0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.270+0000 7f306e7fc640 1 -- 172.21.15.33:0/3884625406 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3070003d90 con 0x7f307810dbd0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.270+0000 7f307f7f2640 1 -- 172.21.15.33:0/3884625406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30781a0480 con 0x7f307810dbd0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.270+0000 7f306e7fc640 1 -- 172.21.15.33:0/3884625406 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307002fbc0 con 0x7f307810dbd0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.270+0000 7f307f7f2640 1 -- 172.21.15.33:0/3884625406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30781a6c40 con 0x7f307810dbd0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.271+0000 7f307f7f2640 1 -- 172.21.15.33:0/3884625406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307806bfe0 con 0x7f307810dbd0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.272+0000 7f306e7fc640 1 -- 172.21.15.33:0/3884625406 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f307002fd60 con 0x7f307810dbd0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.273+0000 7f306e7fc640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30640b4c90 0x7f30640b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.273+0000 7f307d58e640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30640b4c90 0x7f30640b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.273+0000 7f306e7fc640 1 -- 172.21.15.33:0/3884625406 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f3070106db0 con 0x7f307810dbd0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.274+0000 7f307d58e640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30640b4c90 0x7f30640b71a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3074005d00 tx=0x7f3074005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:38.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.276+0000 7f306e7fc640 1 -- 172.21.15.33:0/3884625406 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f30700cd950 con 0x7f307810dbd0 2024-08-28T19:30:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.500+0000 7f307f7f2640 1 -- 172.21.15.33:0/3884625406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3078104b80 con 0x7f307810dbd0 2024-08-28T19:30:38.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.501+0000 7f306e7fc640 1 -- 172.21.15.33:0/3884625406 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7f3078104b80 con 0x7f307810dbd0 2024-08-28T19:30:38.503 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:38.503 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-08-28T19:30:27:414857+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:30:27.414831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24658,24653,24643,24631,24620]},"id":1}]} 2024-08-28T19:30:38.503 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.503+0000 7f307f7f2640 1 -- 172.21.15.33:0/3884625406 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30640b4c90 msgr2=0x7f30640b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30640b4c90 0x7f30640b71a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3074005d00 tx=0x7f3074005c70 comp rx=0 tx=0).stop 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 -- 172.21.15.33:0/3884625406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f307810dbd0 msgr2=0x7f307819fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f307810dbd0 0x7f307819fac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3070005cc0 tx=0x7f307002f380 comp rx=0 tx=0).stop 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 -- 172.21.15.33:0/3884625406 shutdown_connections 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f307810dbd0 0x7f307819fac0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30781050c0 0x7f307819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30640b4c90 0x7f30640b71a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 --2- 172.21.15.33:0/3884625406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3078104770 0x7f307819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 -- 172.21.15.33:0/3884625406 >> 172.21.15.33:0/3884625406 conn(0x7f30780794e0 msgr2=0x7f30780ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 -- 172.21.15.33:0/3884625406 shutdown_connections 2024-08-28T19:30:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:38.504+0000 7f307f7f2640 1 -- 172.21.15.33:0/3884625406 wait complete. 2024-08-28T19:30:39.274 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:30:39.535 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:39.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:39 smithi033 ceph-mon[18549]: pgmap v286: 129 pgs: 129 active+clean; 626 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 25 op/s 2024-08-28T19:30:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:39 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3884625406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:30:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:39 smithi059 ceph-mon[22052]: pgmap v286: 129 pgs: 129 active+clean; 626 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 25 op/s 2024-08-28T19:30:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:39 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3884625406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:30:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:39 smithi122 ceph-mon[22174]: pgmap v286: 129 pgs: 129 active+clean; 626 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 25 op/s 2024-08-28T19:30:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:39 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3884625406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.017+0000 7fdbfda2d640 1 -- 172.21.15.33:0/3882888135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf8103900 msgr2=0x7fdbf8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.017+0000 7fdbfda2d640 1 --2- 172.21.15.33:0/3882888135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf8103900 0x7fdbf8103d10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009ca0 tx=0x7fdbe802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.017+0000 7fdbfda2d640 1 -- 172.21.15.33:0/3882888135 shutdown_connections 2024-08-28T19:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.017+0000 7fdbfda2d640 1 --2- 172.21.15.33:0/3882888135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf8109b90 0x7fdbf81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.017+0000 7fdbfda2d640 1 --2- 172.21.15.33:0/3882888135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf8109240 0x7fdbf8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.017+0000 7fdbfda2d640 1 --2- 172.21.15.33:0/3882888135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf8103900 0x7fdbf8103d10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.017+0000 7fdbfda2d640 1 -- 172.21.15.33:0/3882888135 >> 172.21.15.33:0/3882888135 conn(0x7fdbf807b5f0 msgr2=0x7fdbf807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.018+0000 7fdbfda2d640 1 -- 172.21.15.33:0/3882888135 shutdown_connections 2024-08-28T19:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.018+0000 7fdbfda2d640 1 -- 172.21.15.33:0/3882888135 wait complete. 2024-08-28T19:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.018+0000 7fdbfda2d640 1 Processor -- start 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.018+0000 7fdbfda2d640 1 -- start start 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbfda2d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf8103900 0x7fdbf80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbfda2d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf8109240 0x7fdbf80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbfda2d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf8109b90 0x7fdbf8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbfda2d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8113850 con 0x7fdbf8109240 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbfda2d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81136d0 con 0x7fdbf8103900 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbfda2d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81139d0 con 0x7fdbf8109b90 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf67fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf8109240 0x7fdbf80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf67fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf8109240 0x7fdbf80759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41872/0 (socket says 172.21.15.33:41872) 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf67fc640 1 -- 172.21.15.33:0/58262755 learned_addr learned my addr 172.21.15.33:0/58262755 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf6ffd640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf8103900 0x7fdbf80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf77fe640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf8109b90 0x7fdbf8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf67fc640 1 -- 172.21.15.33:0/58262755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf8109b90 msgr2=0x7fdbf8075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf67fc640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf8109b90 0x7fdbf8075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf67fc640 1 -- 172.21.15.33:0/58262755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf8103900 msgr2=0x7fdbf80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf67fc640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf8103900 0x7fdbf80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf67fc640 1 -- 172.21.15.33:0/58262755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf81a84d0 con 0x7fdbf8109240 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.019+0000 7fdbf67fc640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf8109240 0x7fdbf80759f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000d750 tx=0x7fdbe000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.020+0000 7fdbfca2b640 1 -- 172.21.15.33:0/58262755 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0017070 con 0x7fdbf8109240 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.020+0000 7fdbfda2d640 1 -- 172.21.15.33:0/58262755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf81a87c0 con 0x7fdbf8109240 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.020+0000 7fdbfca2b640 1 -- 172.21.15.33:0/58262755 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbe00054d0 con 0x7fdbf8109240 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.020+0000 7fdbfca2b640 1 -- 172.21.15.33:0/58262755 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0004c30 con 0x7fdbf8109240 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.020+0000 7fdbfda2d640 1 -- 172.21.15.33:0/58262755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf81a8d00 con 0x7fdbf8109240 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.021+0000 7fdbfda2d640 1 -- 172.21.15.33:0/58262755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbf8103d10 con 0x7fdbf8109240 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.022+0000 7fdbfca2b640 1 -- 172.21.15.33:0/58262755 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fdbe0004dd0 con 0x7fdbf8109240 2024-08-28T19:30:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.023+0000 7fdbfca2b640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdbe40b4c10 0x7fdbe40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.024+0000 7fdbf6ffd640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdbe40b4c10 0x7fdbe40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.024+0000 7fdbfca2b640 1 -- 172.21.15.33:0/58262755 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fdbe00e5520 con 0x7fdbf8109240 2024-08-28T19:30:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.024+0000 7fdbf6ffd640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdbe40b4c10 0x7fdbe40b7120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005e30 tx=0x7fdbe8009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.027+0000 7fdbfca2b640 1 -- 172.21.15.33:0/58262755 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdbe00aba70 con 0x7fdbf8109240 2024-08-28T19:30:40.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.215+0000 7fdbfda2d640 1 -- 172.21.15.33:0/58262755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbf80767b0 con 0x7fdbf8109240 2024-08-28T19:30:40.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.217+0000 7fdbfca2b640 1 -- 172.21.15.33:0/58262755 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24941 (secure 0 0 0) 0x7fdbe00b0230 con 0x7fdbf8109240 2024-08-28T19:30:40.218 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:40.218 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":82,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:30:27.393474+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.219+0000 7fdbfda2d640 1 -- 172.21.15.33:0/58262755 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdbe40b4c10 msgr2=0x7fdbe40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.219+0000 7fdbfda2d640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdbe40b4c10 0x7fdbe40b7120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005e30 tx=0x7fdbe8009360 comp rx=0 tx=0).stop 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.219+0000 7fdbfda2d640 1 -- 172.21.15.33:0/58262755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf8109240 msgr2=0x7fdbf80759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.219+0000 7fdbfda2d640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf8109240 0x7fdbf80759f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000d750 tx=0x7fdbe000dc10 comp rx=0 tx=0).stop 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.220+0000 7fdbfda2d640 1 -- 172.21.15.33:0/58262755 shutdown_connections 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.220+0000 7fdbfda2d640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdbe40b4c10 0x7fdbe40b7120 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.220+0000 7fdbfda2d640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdbf8109b90 0x7fdbf8075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.220+0000 7fdbfda2d640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf8109240 0x7fdbf80759f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.220+0000 7fdbfda2d640 1 --2- 172.21.15.33:0/58262755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf8103900 0x7fdbf80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.220+0000 7fdbfda2d640 1 -- 172.21.15.33:0/58262755 >> 172.21.15.33:0/58262755 conn(0x7fdbf807b5f0 msgr2=0x7fdbf8107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.220+0000 7fdbfda2d640 1 -- 172.21.15.33:0/58262755 shutdown_connections 2024-08-28T19:30:40.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:40.220+0000 7fdbfda2d640 1 -- 172.21.15.33:0/58262755 wait complete. 2024-08-28T19:30:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:40 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/58262755' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:40 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/58262755' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:40.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:40 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/58262755' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:41.082 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-28T19:30:41.082 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T19:30:41.339 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:41 smithi059 ceph-mon[22052]: pgmap v287: 129 pgs: 129 active+clean; 626 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.6 KiB/s wr, 17 op/s 2024-08-28T19:30:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:41 smithi122 ceph-mon[22174]: pgmap v287: 129 pgs: 129 active+clean; 626 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.6 KiB/s wr, 17 op/s 2024-08-28T19:30:41.864 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:41 smithi033 ceph-mon[18549]: pgmap v287: 129 pgs: 129 active+clean; 626 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.6 KiB/s wr, 17 op/s 2024-08-28T19:30:41.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.952+0000 7f70d7256640 1 -- 172.21.15.33:0/3555145017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d0108ad0 msgr2=0x7f70d010f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:41.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.952+0000 7f70d7256640 1 --2- 172.21.15.33:0/3555145017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d0108ad0 0x7f70d010f300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009ca0 tx=0x7f70c802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:41.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.952+0000 7f70d7256640 1 -- 172.21.15.33:0/3555145017 shutdown_connections 2024-08-28T19:30:41.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.952+0000 7f70d7256640 1 --2- 172.21.15.33:0/3555145017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d0108ad0 0x7f70d010f300 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:41.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.952+0000 7f70d7256640 1 --2- 172.21.15.33:0/3555145017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d0108180 0x7f70d0108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:41.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.952+0000 7f70d7256640 1 --2- 172.21.15.33:0/3555145017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0102840 0x7f70d0102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:41.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.952+0000 7f70d7256640 1 -- 172.21.15.33:0/3555145017 >> 172.21.15.33:0/3555145017 conn(0x7f70d00794f0 msgr2=0x7f70d0079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.952+0000 7f70d7256640 1 -- 172.21.15.33:0/3555145017 shutdown_connections 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.952+0000 7f70d7256640 1 -- 172.21.15.33:0/3555145017 wait complete. 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d7256640 1 Processor -- start 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d7256640 1 -- start start 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d7256640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d0102840 0x7f70d019afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d7256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d0108180 0x7f70d019b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d7256640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0108ad0 0x7f70d019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d7256640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0112780 con 0x7f70d0102840 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d7256640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0112600 con 0x7f70d0108ad0 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d7256640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f70d0112900 con 0x7f70d0108180 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d4ff2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d0102840 0x7f70d019afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d4ff2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d0102840 0x7f70d019afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41886/0 (socket says 172.21.15.33:41886) 2024-08-28T19:30:41.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70d4ff2640 1 -- 172.21.15.33:0/2143039636 learned_addr learned my addr 172.21.15.33:0/2143039636 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.953+0000 7f70cffff640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d0108180 0x7f70d019b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70d57f3640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0108ad0 0x7f70d019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70d4ff2640 1 -- 172.21.15.33:0/2143039636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d0108180 msgr2=0x7f70d019b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70d4ff2640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d0108180 0x7f70d019b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70d4ff2640 1 -- 172.21.15.33:0/2143039636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0108ad0 msgr2=0x7f70d019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70d4ff2640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0108ad0 0x7f70d019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70d4ff2640 1 -- 172.21.15.33:0/2143039636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d01a62c0 con 0x7f70d0102840 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70d4ff2640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d0102840 0x7f70d019afb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f70c000d950 tx=0x7f70c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70cdffb640 1 -- 172.21.15.33:0/2143039636 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0017070 con 0x7f70d0102840 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70cdffb640 1 -- 172.21.15.33:0/2143039636 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70c0009c30 con 0x7f70d0102840 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70d7256640 1 -- 172.21.15.33:0/2143039636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d01a65b0 con 0x7f70d0102840 2024-08-28T19:30:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70cdffb640 1 -- 172.21.15.33:0/2143039636 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c000f620 con 0x7f70d0102840 2024-08-28T19:30:41.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.954+0000 7f70d7256640 1 -- 172.21.15.33:0/2143039636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d01a6af0 con 0x7f70d0102840 2024-08-28T19:30:41.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.955+0000 7f70d7256640 1 -- 172.21.15.33:0/2143039636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d0102c50 con 0x7f70d0102840 2024-08-28T19:30:41.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.957+0000 7f70cdffb640 1 -- 172.21.15.33:0/2143039636 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f70c0010460 con 0x7f70d0102840 2024-08-28T19:30:41.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.958+0000 7f70cdffb640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70b80b4c10 0x7f70b80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:41.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.958+0000 7f70cffff640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70b80b4c10 0x7f70b80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:41.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.958+0000 7f70cdffb640 1 -- 172.21.15.33:0/2143039636 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f70c00e53b0 con 0x7f70d0102840 2024-08-28T19:30:41.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.958+0000 7f70cffff640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70b80b4c10 0x7f70b80b7120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f70d0107c80 tx=0x7f70c400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:41.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:41.962+0000 7f70cdffb640 1 -- 172.21.15.33:0/2143039636 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f70c00abf50 con 0x7f70d0102840 2024-08-28T19:30:42.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.144+0000 7f70d7256640 1 -- 172.21.15.33:0/2143039636 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70d00635a0 con 0x7f70b80b4c10 2024-08-28T19:30:42.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.151+0000 7f70cdffb640 1 -- 172.21.15.33:0/2143039636 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340621 (secure 0 0 0) 0x7f70d00635a0 con 0x7f70b80b4c10 2024-08-28T19:30:42.155 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:42.157 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-28T19:30:42.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 -- 172.21.15.33:0/2143039636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70b80b4c10 msgr2=0x7f70b80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:42.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70b80b4c10 0x7f70b80b7120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f70d0107c80 tx=0x7f70c400b390 comp rx=0 tx=0).stop 2024-08-28T19:30:42.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 -- 172.21.15.33:0/2143039636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d0102840 msgr2=0x7f70d019afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d0102840 0x7f70d019afb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f70c000d950 tx=0x7f70c000de10 comp rx=0 tx=0).stop 2024-08-28T19:30:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 -- 172.21.15.33:0/2143039636 shutdown_connections 2024-08-28T19:30:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0108ad0 0x7f70d019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70b80b4c10 0x7f70b80b7120 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d0108180 0x7f70d019b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 --2- 172.21.15.33:0/2143039636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d0102840 0x7f70d019afb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 -- 172.21.15.33:0/2143039636 >> 172.21.15.33:0/2143039636 conn(0x7f70d00794f0 msgr2=0x7f70d0106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 -- 172.21.15.33:0/2143039636 shutdown_connections 2024-08-28T19:30:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:42.154+0000 7f70d7256640 1 -- 172.21.15.33:0/2143039636 wait complete. 2024-08-28T19:30:42.838 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-08-28T19:30:41.729972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641147,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":233,"num_read_kb":201,"num_write":357,"num_write_kb":2268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364616,"kb_used_data":11192,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577208,"statfs":{"total":1151940427776,"available":1151567060992,"internally_reserved":0,"allocated":11460608,"data_stored":7614515,"data_compressed":392145,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41103,"num_objects":6,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":118,"num_read_kb":101,"num_write":33,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003906"},"pg_stats":[{"pgid":"2.1f","version":"81'13","reported_seq":60,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:36.444837+0000","last_change":"2024-08-28T19:29:46.098343+0000","last_active":"2024-08-28T19:30:36.444837+0000","last_peered":"2024-08-28T19:30:36.444837+0000","last_clean":"2024-08-28T19:30:36.444837+0000","last_became_active":"2024-08-28T19:29:46.097974+0000","last_became_peered":"2024-08-28T19:29:46.097974+0000","last_unstale":"2024-08-28T19:30:36.444837+0000","last_undegraded":"2024-08-28T19:30:36.444837+0000","last_fullsized":"2024-08-28T19:30:36.444837+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:03:11.466154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549015+0000","last_change":"2024-08-28T19:29:48.123521+0000","last_active":"2024-08-28T19:30:27.549015+0000","last_peered":"2024-08-28T19:30:27.549015+0000","last_clean":"2024-08-28T19:30:27.549015+0000","last_became_active":"2024-08-28T19:29:48.122998+0000","last_became_peered":"2024-08-28T19:29:48.122998+0000","last_unstale":"2024-08-28T19:30:27.549015+0000","last_undegraded":"2024-08-28T19:30:27.549015+0000","last_fullsized":"2024-08-28T19:30:27.549015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:33:48.413468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398981+0000","last_change":"2024-08-28T19:29:55.268086+0000","last_active":"2024-08-28T19:30:27.398981+0000","last_peered":"2024-08-28T19:30:27.398981+0000","last_clean":"2024-08-28T19:30:27.398981+0000","last_became_active":"2024-08-28T19:29:55.267411+0000","last_became_peered":"2024-08-28T19:29:55.267411+0000","last_unstale":"2024-08-28T19:30:27.398981+0000","last_undegraded":"2024-08-28T19:30:27.398981+0000","last_fullsized":"2024-08-28T19:30:27.398981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:32:16.277295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549135+0000","last_change":"2024-08-28T19:29:46.188552+0000","last_active":"2024-08-28T19:30:27.549135+0000","last_peered":"2024-08-28T19:30:27.549135+0000","last_clean":"2024-08-28T19:30:27.549135+0000","last_became_active":"2024-08-28T19:29:46.188118+0000","last_became_peered":"2024-08-28T19:29:46.188118+0000","last_unstale":"2024-08-28T19:30:27.549135+0000","last_undegraded":"2024-08-28T19:30:27.549135+0000","last_fullsized":"2024-08-28T19:30:27.549135+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:55:43.774037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402122+0000","last_change":"2024-08-28T19:29:48.118765+0000","last_active":"2024-08-28T19:30:27.402122+0000","last_peered":"2024-08-28T19:30:27.402122+0000","last_clean":"2024-08-28T19:30:27.402122+0000","last_became_active":"2024-08-28T19:29:48.118111+0000","last_became_peered":"2024-08-28T19:29:48.118111+0000","last_unstale":"2024-08-28T19:30:27.402122+0000","last_undegraded":"2024-08-28T19:30:27.402122+0000","last_fullsized":"2024-08-28T19:30:27.402122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:00:51.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401192+0000","last_change":"2024-08-28T19:29:55.262222+0000","last_active":"2024-08-28T19:30:27.401192+0000","last_peered":"2024-08-28T19:30:27.401192+0000","last_clean":"2024-08-28T19:30:27.401192+0000","last_became_active":"2024-08-28T19:29:55.260906+0000","last_became_peered":"2024-08-28T19:29:55.260906+0000","last_unstale":"2024-08-28T19:30:27.401192+0000","last_undegraded":"2024-08-28T19:30:27.401192+0000","last_fullsized":"2024-08-28T19:30:27.401192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:22:30.523609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.421805+0000","last_change":"2024-08-28T19:29:46.101077+0000","last_active":"2024-08-28T19:30:27.421805+0000","last_peered":"2024-08-28T19:30:27.421805+0000","last_clean":"2024-08-28T19:30:27.421805+0000","last_became_active":"2024-08-28T19:29:46.100630+0000","last_became_peered":"2024-08-28T19:29:46.100630+0000","last_unstale":"2024-08-28T19:30:27.421805+0000","last_undegraded":"2024-08-28T19:30:27.421805+0000","last_fullsized":"2024-08-28T19:30:27.421805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:59:11.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549826+0000","last_change":"2024-08-28T19:29:48.129460+0000","last_active":"2024-08-28T19:30:27.549826+0000","last_peered":"2024-08-28T19:30:27.549826+0000","last_clean":"2024-08-28T19:30:27.549826+0000","last_became_active":"2024-08-28T19:29:48.129068+0000","last_became_peered":"2024-08-28T19:29:48.129068+0000","last_unstale":"2024-08-28T19:30:27.549826+0000","last_undegraded":"2024-08-28T19:30:27.549826+0000","last_fullsized":"2024-08-28T19:30:27.549826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:08:40.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402313+0000","last_change":"2024-08-28T19:29:55.262943+0000","last_active":"2024-08-28T19:30:27.402313+0000","last_peered":"2024-08-28T19:30:27.402313+0000","last_clean":"2024-08-28T19:30:27.402313+0000","last_became_active":"2024-08-28T19:29:55.262424+0000","last_became_peered":"2024-08-28T19:29:55.262424+0000","last_unstale":"2024-08-28T19:30:27.402313+0000","last_undegraded":"2024-08-28T19:30:27.402313+0000","last_fullsized":"2024-08-28T19:30:27.402313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:19:40.618651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406164+0000","last_change":"2024-08-28T19:29:46.102571+0000","last_active":"2024-08-28T19:30:27.406164+0000","last_peered":"2024-08-28T19:30:27.406164+0000","last_clean":"2024-08-28T19:30:27.406164+0000","last_became_active":"2024-08-28T19:29:46.102081+0000","last_became_peered":"2024-08-28T19:29:46.102081+0000","last_unstale":"2024-08-28T19:30:27.406164+0000","last_undegraded":"2024-08-28T19:30:27.406164+0000","last_fullsized":"2024-08-28T19:30:27.406164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:46:38.266122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550530+0000","last_change":"2024-08-28T19:30:27.550413+0000","last_active":"2024-08-28T19:30:27.550530+0000","last_peered":"2024-08-28T19:30:27.550530+0000","last_clean":"2024-08-28T19:30:27.550530+0000","last_became_active":"2024-08-28T19:30:27.550002+0000","last_became_peered":"2024-08-28T19:30:27.550002+0000","last_unstale":"2024-08-28T19:30:27.550530+0000","last_undegraded":"2024-08-28T19:30:27.550530+0000","last_fullsized":"2024-08-28T19:30:27.550530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:17.519332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401862+0000","last_change":"2024-08-28T19:29:55.261930+0000","last_active":"2024-08-28T19:30:27.401862+0000","last_peered":"2024-08-28T19:30:27.401862+0000","last_clean":"2024-08-28T19:30:27.401862+0000","last_became_active":"2024-08-28T19:29:55.261208+0000","last_became_peered":"2024-08-28T19:29:55.261208+0000","last_unstale":"2024-08-28T19:30:27.401862+0000","last_undegraded":"2024-08-28T19:30:27.401862+0000","last_fullsized":"2024-08-28T19:30:27.401862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.804993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427036+0000","last_change":"2024-08-28T19:29:48.133820+0000","last_active":"2024-08-28T19:30:27.427036+0000","last_peered":"2024-08-28T19:30:27.427036+0000","last_clean":"2024-08-28T19:30:27.427036+0000","last_became_active":"2024-08-28T19:29:48.132536+0000","last_became_peered":"2024-08-28T19:29:48.132536+0000","last_unstale":"2024-08-28T19:30:27.427036+0000","last_undegraded":"2024-08-28T19:30:27.427036+0000","last_fullsized":"2024-08-28T19:30:27.427036+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:15:39.779698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405110+0000","last_change":"2024-08-28T19:29:46.101206+0000","last_active":"2024-08-28T19:30:27.405110+0000","last_peered":"2024-08-28T19:30:27.405110+0000","last_clean":"2024-08-28T19:30:27.405110+0000","last_became_active":"2024-08-28T19:29:46.100801+0000","last_became_peered":"2024-08-28T19:29:46.100801+0000","last_unstale":"2024-08-28T19:30:27.405110+0000","last_undegraded":"2024-08-28T19:30:27.405110+0000","last_fullsized":"2024-08-28T19:30:27.405110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:43:33.156203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401551+0000","last_change":"2024-08-28T19:29:55.572774+0000","last_active":"2024-08-28T19:30:27.401551+0000","last_peered":"2024-08-28T19:30:27.401551+0000","last_clean":"2024-08-28T19:30:27.401551+0000","last_became_active":"2024-08-28T19:29:55.571703+0000","last_became_peered":"2024-08-28T19:29:55.571703+0000","last_unstale":"2024-08-28T19:30:27.401551+0000","last_undegraded":"2024-08-28T19:30:27.401551+0000","last_fullsized":"2024-08-28T19:30:27.401551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:56:52.695007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548462+0000","last_change":"2024-08-28T19:29:48.127683+0000","last_active":"2024-08-28T19:30:27.548462+0000","last_peered":"2024-08-28T19:30:27.548462+0000","last_clean":"2024-08-28T19:30:27.548462+0000","last_became_active":"2024-08-28T19:29:48.127139+0000","last_became_peered":"2024-08-28T19:29:48.127139+0000","last_unstale":"2024-08-28T19:30:27.548462+0000","last_undegraded":"2024-08-28T19:30:27.548462+0000","last_fullsized":"2024-08-28T19:30:27.548462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:38:16.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399374+0000","last_change":"2024-08-28T19:29:46.103233+0000","last_active":"2024-08-28T19:30:27.399374+0000","last_peered":"2024-08-28T19:30:27.399374+0000","last_clean":"2024-08-28T19:30:27.399374+0000","last_became_active":"2024-08-28T19:29:46.102515+0000","last_became_peered":"2024-08-28T19:29:46.102515+0000","last_unstale":"2024-08-28T19:30:27.399374+0000","last_undegraded":"2024-08-28T19:30:27.399374+0000","last_fullsized":"2024-08-28T19:30:27.399374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:49:35.905893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401876+0000","last_change":"2024-08-28T19:29:55.264291+0000","last_active":"2024-08-28T19:30:27.401876+0000","last_peered":"2024-08-28T19:30:27.401876+0000","last_clean":"2024-08-28T19:30:27.401876+0000","last_became_active":"2024-08-28T19:29:55.263692+0000","last_became_peered":"2024-08-28T19:29:55.263692+0000","last_unstale":"2024-08-28T19:30:27.401876+0000","last_undegraded":"2024-08-28T19:30:27.401876+0000","last_fullsized":"2024-08-28T19:30:27.401876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:47:01.795320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398110+0000","last_change":"2024-08-28T19:29:48.115470+0000","last_active":"2024-08-28T19:30:27.398110+0000","last_peered":"2024-08-28T19:30:27.398110+0000","last_clean":"2024-08-28T19:30:27.398110+0000","last_became_active":"2024-08-28T19:29:48.115076+0000","last_became_peered":"2024-08-28T19:29:48.115076+0000","last_unstale":"2024-08-28T19:30:27.398110+0000","last_undegraded":"2024-08-28T19:30:27.398110+0000","last_fullsized":"2024-08-28T19:30:27.398110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:32.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548923+0000","last_change":"2024-08-28T19:29:46.099970+0000","last_active":"2024-08-28T19:30:27.548923+0000","last_peered":"2024-08-28T19:30:27.548923+0000","last_clean":"2024-08-28T19:30:27.548923+0000","last_became_active":"2024-08-28T19:29:46.099661+0000","last_became_peered":"2024-08-28T19:29:46.099661+0000","last_unstale":"2024-08-28T19:30:27.548923+0000","last_undegraded":"2024-08-28T19:30:27.548923+0000","last_fullsized":"2024-08-28T19:30:27.548923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:27.430026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401786+0000","last_change":"2024-08-28T19:29:55.265983+0000","last_active":"2024-08-28T19:30:27.401786+0000","last_peered":"2024-08-28T19:30:27.401786+0000","last_clean":"2024-08-28T19:30:27.401786+0000","last_became_active":"2024-08-28T19:29:55.265464+0000","last_became_peered":"2024-08-28T19:29:55.265464+0000","last_unstale":"2024-08-28T19:30:27.401786+0000","last_undegraded":"2024-08-28T19:30:27.401786+0000","last_fullsized":"2024-08-28T19:30:27.401786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:21:42.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404711+0000","last_change":"2024-08-28T19:29:48.119545+0000","last_active":"2024-08-28T19:30:27.404711+0000","last_peered":"2024-08-28T19:30:27.404711+0000","last_clean":"2024-08-28T19:30:27.404711+0000","last_became_active":"2024-08-28T19:29:48.119128+0000","last_became_peered":"2024-08-28T19:29:48.119128+0000","last_unstale":"2024-08-28T19:30:27.404711+0000","last_undegraded":"2024-08-28T19:30:27.404711+0000","last_fullsized":"2024-08-28T19:30:27.404711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:05:31.535016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549131+0000","last_change":"2024-08-28T19:29:46.188962+0000","last_active":"2024-08-28T19:30:27.549131+0000","last_peered":"2024-08-28T19:30:27.549131+0000","last_clean":"2024-08-28T19:30:27.549131+0000","last_became_active":"2024-08-28T19:29:46.188510+0000","last_became_peered":"2024-08-28T19:29:46.188510+0000","last_unstale":"2024-08-28T19:30:27.549131+0000","last_undegraded":"2024-08-28T19:30:27.549131+0000","last_fullsized":"2024-08-28T19:30:27.549131+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:08.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402457+0000","last_change":"2024-08-28T19:29:55.573320+0000","last_active":"2024-08-28T19:30:27.402457+0000","last_peered":"2024-08-28T19:30:27.402457+0000","last_clean":"2024-08-28T19:30:27.402457+0000","last_became_active":"2024-08-28T19:29:55.572858+0000","last_became_peered":"2024-08-28T19:29:55.572858+0000","last_unstale":"2024-08-28T19:30:27.402457+0000","last_undegraded":"2024-08-28T19:30:27.402457+0000","last_fullsized":"2024-08-28T19:30:27.402457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:09:34.676911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405023+0000","last_change":"2024-08-28T19:30:27.404918+0000","last_active":"2024-08-28T19:30:27.405023+0000","last_peered":"2024-08-28T19:30:27.405023+0000","last_clean":"2024-08-28T19:30:27.405023+0000","last_became_active":"2024-08-28T19:30:27.404495+0000","last_became_peered":"2024-08-28T19:30:27.404495+0000","last_unstale":"2024-08-28T19:30:27.405023+0000","last_undegraded":"2024-08-28T19:30:27.405023+0000","last_fullsized":"2024-08-28T19:30:27.405023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:10:12.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402080+0000","last_change":"2024-08-28T19:29:46.110683+0000","last_active":"2024-08-28T19:30:27.402080+0000","last_peered":"2024-08-28T19:30:27.402080+0000","last_clean":"2024-08-28T19:30:27.402080+0000","last_became_active":"2024-08-28T19:29:46.110324+0000","last_became_peered":"2024-08-28T19:29:46.110324+0000","last_unstale":"2024-08-28T19:30:27.402080+0000","last_undegraded":"2024-08-28T19:30:27.402080+0000","last_fullsized":"2024-08-28T19:30:27.402080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:15:47.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398964+0000","last_change":"2024-08-28T19:29:55.271035+0000","last_active":"2024-08-28T19:30:27.398964+0000","last_peered":"2024-08-28T19:30:27.398964+0000","last_clean":"2024-08-28T19:30:27.398964+0000","last_became_active":"2024-08-28T19:29:55.268465+0000","last_became_peered":"2024-08-28T19:29:55.268465+0000","last_unstale":"2024-08-28T19:30:27.398964+0000","last_undegraded":"2024-08-28T19:30:27.398964+0000","last_fullsized":"2024-08-28T19:30:27.398964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:16:17.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548938+0000","last_change":"2024-08-28T19:29:48.127225+0000","last_active":"2024-08-28T19:30:27.548938+0000","last_peered":"2024-08-28T19:30:27.548938+0000","last_clean":"2024-08-28T19:30:27.548938+0000","last_became_active":"2024-08-28T19:29:48.126775+0000","last_became_peered":"2024-08-28T19:29:48.126775+0000","last_unstale":"2024-08-28T19:30:27.548938+0000","last_undegraded":"2024-08-28T19:30:27.548938+0000","last_fullsized":"2024-08-28T19:30:27.548938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:49:39.353082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:35.113977+0000","last_change":"2024-08-28T19:29:46.098076+0000","last_active":"2024-08-28T19:30:35.113977+0000","last_peered":"2024-08-28T19:30:35.113977+0000","last_clean":"2024-08-28T19:30:35.113977+0000","last_became_active":"2024-08-28T19:29:46.097726+0000","last_became_peered":"2024-08-28T19:29:46.097726+0000","last_unstale":"2024-08-28T19:30:35.113977+0000","last_undegraded":"2024-08-28T19:30:35.113977+0000","last_fullsized":"2024-08-28T19:30:35.113977+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.624125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548224+0000","last_change":"2024-08-28T19:29:55.571830+0000","last_active":"2024-08-28T19:30:27.548224+0000","last_peered":"2024-08-28T19:30:27.548224+0000","last_clean":"2024-08-28T19:30:27.548224+0000","last_became_active":"2024-08-28T19:29:55.571318+0000","last_became_peered":"2024-08-28T19:29:55.571318+0000","last_unstale":"2024-08-28T19:30:27.548224+0000","last_undegraded":"2024-08-28T19:30:27.548224+0000","last_fullsized":"2024-08-28T19:30:27.548224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:41:03.397478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397059+0000","last_change":"2024-08-28T19:29:48.124998+0000","last_active":"2024-08-28T19:30:27.397059+0000","last_peered":"2024-08-28T19:30:27.397059+0000","last_clean":"2024-08-28T19:30:27.397059+0000","last_became_active":"2024-08-28T19:29:48.124600+0000","last_became_peered":"2024-08-28T19:29:48.124600+0000","last_unstale":"2024-08-28T19:30:27.397059+0000","last_undegraded":"2024-08-28T19:30:27.397059+0000","last_fullsized":"2024-08-28T19:30:27.397059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:50:59.459372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406363+0000","last_change":"2024-08-28T19:29:46.189455+0000","last_active":"2024-08-28T19:30:27.406363+0000","last_peered":"2024-08-28T19:30:27.406363+0000","last_clean":"2024-08-28T19:30:27.406363+0000","last_became_active":"2024-08-28T19:29:46.188640+0000","last_became_peered":"2024-08-28T19:29:46.188640+0000","last_unstale":"2024-08-28T19:30:27.406363+0000","last_undegraded":"2024-08-28T19:30:27.406363+0000","last_fullsized":"2024-08-28T19:30:27.406363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:05:32.561725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398095+0000","last_change":"2024-08-28T19:29:55.269726+0000","last_active":"2024-08-28T19:30:27.398095+0000","last_peered":"2024-08-28T19:30:27.398095+0000","last_clean":"2024-08-28T19:30:27.398095+0000","last_became_active":"2024-08-28T19:29:55.269261+0000","last_became_peered":"2024-08-28T19:29:55.269261+0000","last_unstale":"2024-08-28T19:30:27.398095+0000","last_undegraded":"2024-08-28T19:30:27.398095+0000","last_fullsized":"2024-08-28T19:30:27.398095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:05.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398331+0000","last_change":"2024-08-28T19:29:48.125251+0000","last_active":"2024-08-28T19:30:27.398331+0000","last_peered":"2024-08-28T19:30:27.398331+0000","last_clean":"2024-08-28T19:30:27.398331+0000","last_became_active":"2024-08-28T19:29:48.124818+0000","last_became_peered":"2024-08-28T19:29:48.124818+0000","last_unstale":"2024-08-28T19:30:27.398331+0000","last_undegraded":"2024-08-28T19:30:27.398331+0000","last_fullsized":"2024-08-28T19:30:27.398331+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:47:05.217199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401993+0000","last_change":"2024-08-28T19:29:46.189747+0000","last_active":"2024-08-28T19:30:27.401993+0000","last_peered":"2024-08-28T19:30:27.401993+0000","last_clean":"2024-08-28T19:30:27.401993+0000","last_became_active":"2024-08-28T19:29:46.189356+0000","last_became_peered":"2024-08-28T19:29:46.189356+0000","last_unstale":"2024-08-28T19:30:27.401993+0000","last_undegraded":"2024-08-28T19:30:27.401993+0000","last_fullsized":"2024-08-28T19:30:27.401993+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.629054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405026+0000","last_change":"2024-08-28T19:29:55.572746+0000","last_active":"2024-08-28T19:30:27.405026+0000","last_peered":"2024-08-28T19:30:27.405026+0000","last_clean":"2024-08-28T19:30:27.405026+0000","last_became_active":"2024-08-28T19:29:55.572246+0000","last_became_peered":"2024-08-28T19:29:55.572246+0000","last_unstale":"2024-08-28T19:30:27.405026+0000","last_undegraded":"2024-08-28T19:30:27.405026+0000","last_fullsized":"2024-08-28T19:30:27.405026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:48:23.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398559+0000","last_change":"2024-08-28T19:29:48.127579+0000","last_active":"2024-08-28T19:30:27.398559+0000","last_peered":"2024-08-28T19:30:27.398559+0000","last_clean":"2024-08-28T19:30:27.398559+0000","last_became_active":"2024-08-28T19:29:48.126978+0000","last_became_peered":"2024-08-28T19:29:48.126978+0000","last_unstale":"2024-08-28T19:30:27.398559+0000","last_undegraded":"2024-08-28T19:30:27.398559+0000","last_fullsized":"2024-08-28T19:30:27.398559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:27.657714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:38.448220+0000","last_change":"2024-08-28T19:29:46.102374+0000","last_active":"2024-08-28T19:30:38.448220+0000","last_peered":"2024-08-28T19:30:38.448220+0000","last_clean":"2024-08-28T19:30:38.448220+0000","last_became_active":"2024-08-28T19:29:46.101619+0000","last_became_peered":"2024-08-28T19:29:46.101619+0000","last_unstale":"2024-08-28T19:30:38.448220+0000","last_undegraded":"2024-08-28T19:30:38.448220+0000","last_fullsized":"2024-08-28T19:30:38.448220+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:46:21.353063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396841+0000","last_change":"2024-08-28T19:29:55.265403+0000","last_active":"2024-08-28T19:30:27.396841+0000","last_peered":"2024-08-28T19:30:27.396841+0000","last_clean":"2024-08-28T19:30:27.396841+0000","last_became_active":"2024-08-28T19:29:55.264979+0000","last_became_peered":"2024-08-28T19:29:55.264979+0000","last_unstale":"2024-08-28T19:30:27.396841+0000","last_undegraded":"2024-08-28T19:30:27.396841+0000","last_fullsized":"2024-08-28T19:30:27.396841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:18:18.623218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405723+0000","last_change":"2024-08-28T19:29:48.117437+0000","last_active":"2024-08-28T19:30:27.405723+0000","last_peered":"2024-08-28T19:30:27.405723+0000","last_clean":"2024-08-28T19:30:27.405723+0000","last_became_active":"2024-08-28T19:29:48.116379+0000","last_became_peered":"2024-08-28T19:29:48.116379+0000","last_unstale":"2024-08-28T19:30:27.405723+0000","last_undegraded":"2024-08-28T19:30:27.405723+0000","last_fullsized":"2024-08-28T19:30:27.405723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:23.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:36.445241+0000","last_change":"2024-08-28T19:29:46.188551+0000","last_active":"2024-08-28T19:30:36.445241+0000","last_peered":"2024-08-28T19:30:36.445241+0000","last_clean":"2024-08-28T19:30:36.445241+0000","last_became_active":"2024-08-28T19:29:46.188050+0000","last_became_peered":"2024-08-28T19:29:46.188050+0000","last_unstale":"2024-08-28T19:30:36.445241+0000","last_undegraded":"2024-08-28T19:30:36.445241+0000","last_fullsized":"2024-08-28T19:30:36.445241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:07:21.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396915+0000","last_change":"2024-08-28T19:29:55.572013+0000","last_active":"2024-08-28T19:30:27.396915+0000","last_peered":"2024-08-28T19:30:27.396915+0000","last_clean":"2024-08-28T19:30:27.396915+0000","last_became_active":"2024-08-28T19:29:55.571503+0000","last_became_peered":"2024-08-28T19:29:55.571503+0000","last_unstale":"2024-08-28T19:30:27.396915+0000","last_undegraded":"2024-08-28T19:30:27.396915+0000","last_fullsized":"2024-08-28T19:30:27.396915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:40:21.669321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396418+0000","last_change":"2024-08-28T19:29:48.124646+0000","last_active":"2024-08-28T19:30:27.396418+0000","last_peered":"2024-08-28T19:30:27.396418+0000","last_clean":"2024-08-28T19:30:27.396418+0000","last_became_active":"2024-08-28T19:29:48.123062+0000","last_became_peered":"2024-08-28T19:29:48.123062+0000","last_unstale":"2024-08-28T19:30:27.396418+0000","last_undegraded":"2024-08-28T19:30:27.396418+0000","last_fullsized":"2024-08-28T19:30:27.396418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:16:03.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426530+0000","last_change":"2024-08-28T19:29:46.105979+0000","last_active":"2024-08-28T19:30:27.426530+0000","last_peered":"2024-08-28T19:30:27.426530+0000","last_clean":"2024-08-28T19:30:27.426530+0000","last_became_active":"2024-08-28T19:29:46.105558+0000","last_became_peered":"2024-08-28T19:29:46.105558+0000","last_unstale":"2024-08-28T19:30:27.426530+0000","last_undegraded":"2024-08-28T19:30:27.426530+0000","last_fullsized":"2024-08-28T19:30:27.426530+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:47.639236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.403694+0000","last_change":"2024-08-28T19:29:55.574025+0000","last_active":"2024-08-28T19:30:27.403694+0000","last_peered":"2024-08-28T19:30:27.403694+0000","last_clean":"2024-08-28T19:30:27.403694+0000","last_became_active":"2024-08-28T19:29:55.573380+0000","last_became_peered":"2024-08-28T19:29:55.573380+0000","last_unstale":"2024-08-28T19:30:27.403694+0000","last_undegraded":"2024-08-28T19:30:27.403694+0000","last_fullsized":"2024-08-28T19:30:27.403694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:19:05.287692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548592+0000","last_change":"2024-08-28T19:29:48.118606+0000","last_active":"2024-08-28T19:30:27.548592+0000","last_peered":"2024-08-28T19:30:27.548592+0000","last_clean":"2024-08-28T19:30:27.548592+0000","last_became_active":"2024-08-28T19:29:48.117534+0000","last_became_peered":"2024-08-28T19:29:48.117534+0000","last_unstale":"2024-08-28T19:30:27.548592+0000","last_undegraded":"2024-08-28T19:30:27.548592+0000","last_fullsized":"2024-08-28T19:30:27.548592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:34.253859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.422305+0000","last_change":"2024-08-28T19:29:46.100420+0000","last_active":"2024-08-28T19:30:27.422305+0000","last_peered":"2024-08-28T19:30:27.422305+0000","last_clean":"2024-08-28T19:30:27.422305+0000","last_became_active":"2024-08-28T19:29:46.099990+0000","last_became_peered":"2024-08-28T19:29:46.099990+0000","last_unstale":"2024-08-28T19:30:27.422305+0000","last_undegraded":"2024-08-28T19:30:27.422305+0000","last_fullsized":"2024-08-28T19:30:27.422305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:42:12.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426944+0000","last_change":"2024-08-28T19:28:32.822169+0000","last_active":"2024-08-28T19:30:27.426944+0000","last_peered":"2024-08-28T19:30:27.426944+0000","last_clean":"2024-08-28T19:30:27.426944+0000","last_became_active":"2024-08-28T19:28:32.816300+0000","last_became_peered":"2024-08-28T19:28:32.816300+0000","last_unstale":"2024-08-28T19:30:27.426944+0000","last_undegraded":"2024-08-28T19:30:27.426944+0000","last_fullsized":"2024-08-28T19:30:27.426944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_clean_scrub_stamp":"2024-08-28T19:25:14.491568+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:41:37.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427270+0000","last_change":"2024-08-28T19:29:55.265437+0000","last_active":"2024-08-28T19:30:27.427270+0000","last_peered":"2024-08-28T19:30:27.427270+0000","last_clean":"2024-08-28T19:30:27.427270+0000","last_became_active":"2024-08-28T19:29:55.264818+0000","last_became_peered":"2024-08-28T19:29:55.264818+0000","last_unstale":"2024-08-28T19:30:27.427270+0000","last_undegraded":"2024-08-28T19:30:27.427270+0000","last_fullsized":"2024-08-28T19:30:27.427270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:28:18.684362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427338+0000","last_change":"2024-08-28T19:29:48.135800+0000","last_active":"2024-08-28T19:30:27.427338+0000","last_peered":"2024-08-28T19:30:27.427338+0000","last_clean":"2024-08-28T19:30:27.427338+0000","last_became_active":"2024-08-28T19:29:48.135258+0000","last_became_peered":"2024-08-28T19:29:48.135258+0000","last_unstale":"2024-08-28T19:30:27.427338+0000","last_undegraded":"2024-08-28T19:30:27.427338+0000","last_fullsized":"2024-08-28T19:30:27.427338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:55.183190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:37.442717+0000","last_change":"2024-08-28T19:29:46.189298+0000","last_active":"2024-08-28T19:30:37.442717+0000","last_peered":"2024-08-28T19:30:37.442717+0000","last_clean":"2024-08-28T19:30:37.442717+0000","last_became_active":"2024-08-28T19:29:46.188813+0000","last_became_peered":"2024-08-28T19:29:46.188813+0000","last_unstale":"2024-08-28T19:30:37.442717+0000","last_undegraded":"2024-08-28T19:30:37.442717+0000","last_fullsized":"2024-08-28T19:30:37.442717+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:14:00.961682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548910+0000","last_change":"2024-08-28T19:29:55.269495+0000","last_active":"2024-08-28T19:30:27.548910+0000","last_peered":"2024-08-28T19:30:27.548910+0000","last_clean":"2024-08-28T19:30:27.548910+0000","last_became_active":"2024-08-28T19:29:55.268916+0000","last_became_peered":"2024-08-28T19:29:55.268916+0000","last_unstale":"2024-08-28T19:30:27.548910+0000","last_undegraded":"2024-08-28T19:30:27.548910+0000","last_fullsized":"2024-08-28T19:30:27.548910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:26:53.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426791+0000","last_change":"2024-08-28T19:29:48.127588+0000","last_active":"2024-08-28T19:30:27.426791+0000","last_peered":"2024-08-28T19:30:27.426791+0000","last_clean":"2024-08-28T19:30:27.426791+0000","last_became_active":"2024-08-28T19:29:48.127200+0000","last_became_peered":"2024-08-28T19:29:48.127200+0000","last_unstale":"2024-08-28T19:30:27.426791+0000","last_undegraded":"2024-08-28T19:30:27.426791+0000","last_fullsized":"2024-08-28T19:30:27.426791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:30:30.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404909+0000","last_change":"2024-08-28T19:29:46.101010+0000","last_active":"2024-08-28T19:30:27.404909+0000","last_peered":"2024-08-28T19:30:27.404909+0000","last_clean":"2024-08-28T19:30:27.404909+0000","last_became_active":"2024-08-28T19:29:46.100082+0000","last_became_peered":"2024-08-28T19:29:46.100082+0000","last_unstale":"2024-08-28T19:30:27.404909+0000","last_undegraded":"2024-08-28T19:30:27.404909+0000","last_fullsized":"2024-08-28T19:30:27.404909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:18:51.074343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.551852+0000","last_change":"2024-08-28T19:30:27.551743+0000","last_active":"2024-08-28T19:30:27.551852+0000","last_peered":"2024-08-28T19:30:27.551852+0000","last_clean":"2024-08-28T19:30:27.551852+0000","last_became_active":"2024-08-28T19:30:27.551249+0000","last_became_peered":"2024-08-28T19:30:27.551249+0000","last_unstale":"2024-08-28T19:30:27.551852+0000","last_undegraded":"2024-08-28T19:30:27.551852+0000","last_fullsized":"2024-08-28T19:30:27.551852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:35.043553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426736+0000","last_change":"2024-08-28T19:29:48.132429+0000","last_active":"2024-08-28T19:30:27.426736+0000","last_peered":"2024-08-28T19:30:27.426736+0000","last_clean":"2024-08-28T19:30:27.426736+0000","last_became_active":"2024-08-28T19:29:48.132020+0000","last_became_peered":"2024-08-28T19:29:48.132020+0000","last_unstale":"2024-08-28T19:30:27.426736+0000","last_undegraded":"2024-08-28T19:30:27.426736+0000","last_fullsized":"2024-08-28T19:30:27.426736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:45:11.992083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397065+0000","last_change":"2024-08-28T19:29:46.097245+0000","last_active":"2024-08-28T19:30:27.397065+0000","last_peered":"2024-08-28T19:30:27.397065+0000","last_clean":"2024-08-28T19:30:27.397065+0000","last_became_active":"2024-08-28T19:29:46.096867+0000","last_became_peered":"2024-08-28T19:29:46.096867+0000","last_unstale":"2024-08-28T19:30:27.397065+0000","last_undegraded":"2024-08-28T19:30:27.397065+0000","last_fullsized":"2024-08-28T19:30:27.397065+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:22:14.888597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405312+0000","last_change":"2024-08-28T19:29:55.265006+0000","last_active":"2024-08-28T19:30:27.405312+0000","last_peered":"2024-08-28T19:30:27.405312+0000","last_clean":"2024-08-28T19:30:27.405312+0000","last_became_active":"2024-08-28T19:29:55.264321+0000","last_became_peered":"2024-08-28T19:29:55.264321+0000","last_unstale":"2024-08-28T19:30:27.405312+0000","last_undegraded":"2024-08-28T19:30:27.405312+0000","last_fullsized":"2024-08-28T19:30:27.405312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:53:27.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398520+0000","last_change":"2024-08-28T19:29:48.120916+0000","last_active":"2024-08-28T19:30:27.398520+0000","last_peered":"2024-08-28T19:30:27.398520+0000","last_clean":"2024-08-28T19:30:27.398520+0000","last_became_active":"2024-08-28T19:29:48.120473+0000","last_became_peered":"2024-08-28T19:29:48.120473+0000","last_unstale":"2024-08-28T19:30:27.398520+0000","last_undegraded":"2024-08-28T19:30:27.398520+0000","last_fullsized":"2024-08-28T19:30:27.398520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:15.067237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405342+0000","last_change":"2024-08-28T19:29:46.103164+0000","last_active":"2024-08-28T19:30:27.405342+0000","last_peered":"2024-08-28T19:30:27.405342+0000","last_clean":"2024-08-28T19:30:27.405342+0000","last_became_active":"2024-08-28T19:29:46.101772+0000","last_became_peered":"2024-08-28T19:29:46.101772+0000","last_unstale":"2024-08-28T19:30:27.405342+0000","last_undegraded":"2024-08-28T19:30:27.405342+0000","last_fullsized":"2024-08-28T19:30:27.405342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:46:29.533552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550981+0000","last_change":"2024-08-28T19:30:27.550861+0000","last_active":"2024-08-28T19:30:27.550981+0000","last_peered":"2024-08-28T19:30:27.550981+0000","last_clean":"2024-08-28T19:30:27.550981+0000","last_became_active":"2024-08-28T19:30:27.550131+0000","last_became_peered":"2024-08-28T19:30:27.550131+0000","last_unstale":"2024-08-28T19:30:27.550981+0000","last_undegraded":"2024-08-28T19:30:27.550981+0000","last_fullsized":"2024-08-28T19:30:27.550981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:37:16.004222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.551596+0000","last_change":"2024-08-28T19:30:27.551445+0000","last_active":"2024-08-28T19:30:27.551596+0000","last_peered":"2024-08-28T19:30:27.551596+0000","last_clean":"2024-08-28T19:30:27.551596+0000","last_became_active":"2024-08-28T19:30:27.550927+0000","last_became_peered":"2024-08-28T19:30:27.550927+0000","last_unstale":"2024-08-28T19:30:27.551596+0000","last_undegraded":"2024-08-28T19:30:27.551596+0000","last_fullsized":"2024-08-28T19:30:27.551596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:52:56.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405028+0000","last_change":"2024-08-28T19:29:46.190191+0000","last_active":"2024-08-28T19:30:27.405028+0000","last_peered":"2024-08-28T19:30:27.405028+0000","last_clean":"2024-08-28T19:30:27.405028+0000","last_became_active":"2024-08-28T19:29:46.188143+0000","last_became_peered":"2024-08-28T19:29:46.188143+0000","last_unstale":"2024-08-28T19:30:27.405028+0000","last_undegraded":"2024-08-28T19:30:27.405028+0000","last_fullsized":"2024-08-28T19:30:27.405028+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:58:11.854449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397058+0000","last_change":"2024-08-28T19:29:55.266777+0000","last_active":"2024-08-28T19:30:27.397058+0000","last_peered":"2024-08-28T19:30:27.397058+0000","last_clean":"2024-08-28T19:30:27.397058+0000","last_became_active":"2024-08-28T19:29:55.266296+0000","last_became_peered":"2024-08-28T19:29:55.266296+0000","last_unstale":"2024-08-28T19:30:27.397058+0000","last_undegraded":"2024-08-28T19:30:27.397058+0000","last_fullsized":"2024-08-28T19:30:27.397058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:28:20.279522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426781+0000","last_change":"2024-08-28T19:29:48.129070+0000","last_active":"2024-08-28T19:30:27.426781+0000","last_peered":"2024-08-28T19:30:27.426781+0000","last_clean":"2024-08-28T19:30:27.426781+0000","last_became_active":"2024-08-28T19:29:48.128701+0000","last_became_peered":"2024-08-28T19:29:48.128701+0000","last_unstale":"2024-08-28T19:30:27.426781+0000","last_undegraded":"2024-08-28T19:30:27.426781+0000","last_fullsized":"2024-08-28T19:30:27.426781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:29:29.375379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:37.447212+0000","last_change":"2024-08-28T19:29:46.098281+0000","last_active":"2024-08-28T19:30:37.447212+0000","last_peered":"2024-08-28T19:30:37.447212+0000","last_clean":"2024-08-28T19:30:37.447212+0000","last_became_active":"2024-08-28T19:29:46.097870+0000","last_became_peered":"2024-08-28T19:29:46.097870+0000","last_unstale":"2024-08-28T19:30:37.447212+0000","last_undegraded":"2024-08-28T19:30:37.447212+0000","last_fullsized":"2024-08-28T19:30:37.447212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:24:09.693310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401852+0000","last_change":"2024-08-28T19:29:55.264883+0000","last_active":"2024-08-28T19:30:27.401852+0000","last_peered":"2024-08-28T19:30:27.401852+0000","last_clean":"2024-08-28T19:30:27.401852+0000","last_became_active":"2024-08-28T19:29:55.264392+0000","last_became_peered":"2024-08-28T19:29:55.264392+0000","last_unstale":"2024-08-28T19:30:27.401852+0000","last_undegraded":"2024-08-28T19:30:27.401852+0000","last_fullsized":"2024-08-28T19:30:27.401852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:34.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427027+0000","last_change":"2024-08-28T19:29:48.135499+0000","last_active":"2024-08-28T19:30:27.427027+0000","last_peered":"2024-08-28T19:30:27.427027+0000","last_clean":"2024-08-28T19:30:27.427027+0000","last_became_active":"2024-08-28T19:29:48.134934+0000","last_became_peered":"2024-08-28T19:29:48.134934+0000","last_unstale":"2024-08-28T19:30:27.427027+0000","last_undegraded":"2024-08-28T19:30:27.427027+0000","last_fullsized":"2024-08-28T19:30:27.427027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:57:01.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405099+0000","last_change":"2024-08-28T19:29:46.104680+0000","last_active":"2024-08-28T19:30:27.405099+0000","last_peered":"2024-08-28T19:30:27.405099+0000","last_clean":"2024-08-28T19:30:27.405099+0000","last_became_active":"2024-08-28T19:29:46.104290+0000","last_became_peered":"2024-08-28T19:29:46.104290+0000","last_unstale":"2024-08-28T19:30:27.405099+0000","last_undegraded":"2024-08-28T19:30:27.405099+0000","last_fullsized":"2024-08-28T19:30:27.405099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:39.789935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398105+0000","last_change":"2024-08-28T19:29:55.264676+0000","last_active":"2024-08-28T19:30:27.398105+0000","last_peered":"2024-08-28T19:30:27.398105+0000","last_clean":"2024-08-28T19:30:27.398105+0000","last_became_active":"2024-08-28T19:29:55.264206+0000","last_became_peered":"2024-08-28T19:29:55.264206+0000","last_unstale":"2024-08-28T19:30:27.398105+0000","last_undegraded":"2024-08-28T19:30:27.398105+0000","last_fullsized":"2024-08-28T19:30:27.398105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:58:15.776366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396618+0000","last_change":"2024-08-28T19:29:48.125092+0000","last_active":"2024-08-28T19:30:27.396618+0000","last_peered":"2024-08-28T19:30:27.396618+0000","last_clean":"2024-08-28T19:30:27.396618+0000","last_became_active":"2024-08-28T19:29:48.124711+0000","last_became_peered":"2024-08-28T19:29:48.124711+0000","last_unstale":"2024-08-28T19:30:27.396618+0000","last_undegraded":"2024-08-28T19:30:27.396618+0000","last_fullsized":"2024-08-28T19:30:27.396618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:17:27.806368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.422015+0000","last_change":"2024-08-28T19:29:46.100546+0000","last_active":"2024-08-28T19:30:27.422015+0000","last_peered":"2024-08-28T19:30:27.422015+0000","last_clean":"2024-08-28T19:30:27.422015+0000","last_became_active":"2024-08-28T19:29:46.100043+0000","last_became_peered":"2024-08-28T19:29:46.100043+0000","last_unstale":"2024-08-28T19:30:27.422015+0000","last_undegraded":"2024-08-28T19:30:27.422015+0000","last_fullsized":"2024-08-28T19:30:27.422015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:41:32.488258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404480+0000","last_change":"2024-08-28T19:29:55.265497+0000","last_active":"2024-08-28T19:30:27.404480+0000","last_peered":"2024-08-28T19:30:27.404480+0000","last_clean":"2024-08-28T19:30:27.404480+0000","last_became_active":"2024-08-28T19:29:55.264499+0000","last_became_peered":"2024-08-28T19:29:55.264499+0000","last_unstale":"2024-08-28T19:30:27.404480+0000","last_undegraded":"2024-08-28T19:30:27.404480+0000","last_fullsized":"2024-08-28T19:30:27.404480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:04:15.192307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405999+0000","last_change":"2024-08-28T19:29:48.133948+0000","last_active":"2024-08-28T19:30:27.405999+0000","last_peered":"2024-08-28T19:30:27.405999+0000","last_clean":"2024-08-28T19:30:27.405999+0000","last_became_active":"2024-08-28T19:29:48.133517+0000","last_became_peered":"2024-08-28T19:29:48.133517+0000","last_unstale":"2024-08-28T19:30:27.405999+0000","last_undegraded":"2024-08-28T19:30:27.405999+0000","last_fullsized":"2024-08-28T19:30:27.405999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:43:20.049931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'27","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:37.443883+0000","last_change":"2024-08-28T19:29:46.104744+0000","last_active":"2024-08-28T19:30:37.443883+0000","last_peered":"2024-08-28T19:30:37.443883+0000","last_clean":"2024-08-28T19:30:37.443883+0000","last_became_active":"2024-08-28T19:29:46.104278+0000","last_became_peered":"2024-08-28T19:29:46.104278+0000","last_unstale":"2024-08-28T19:30:37.443883+0000","last_undegraded":"2024-08-28T19:30:37.443883+0000","last_fullsized":"2024-08-28T19:30:37.443883+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:36.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43341,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":56,"num_write":29,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401456+0000","last_change":"2024-08-28T19:29:55.264892+0000","last_active":"2024-08-28T19:30:27.401456+0000","last_peered":"2024-08-28T19:30:27.401456+0000","last_clean":"2024-08-28T19:30:27.401456+0000","last_became_active":"2024-08-28T19:29:55.264466+0000","last_became_peered":"2024-08-28T19:29:55.264466+0000","last_unstale":"2024-08-28T19:30:27.401456+0000","last_undegraded":"2024-08-28T19:30:27.401456+0000","last_fullsized":"2024-08-28T19:30:27.401456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:34:51.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549875+0000","last_change":"2024-08-28T19:29:48.121692+0000","last_active":"2024-08-28T19:30:27.549875+0000","last_peered":"2024-08-28T19:30:27.549875+0000","last_clean":"2024-08-28T19:30:27.549875+0000","last_became_active":"2024-08-28T19:29:48.121274+0000","last_became_peered":"2024-08-28T19:29:48.121274+0000","last_unstale":"2024-08-28T19:30:27.549875+0000","last_undegraded":"2024-08-28T19:30:27.549875+0000","last_fullsized":"2024-08-28T19:30:27.549875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:00:36.227609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404771+0000","last_change":"2024-08-28T19:29:46.188981+0000","last_active":"2024-08-28T19:30:27.404771+0000","last_peered":"2024-08-28T19:30:27.404771+0000","last_clean":"2024-08-28T19:30:27.404771+0000","last_became_active":"2024-08-28T19:29:46.188496+0000","last_became_peered":"2024-08-28T19:29:46.188496+0000","last_unstale":"2024-08-28T19:30:27.404771+0000","last_undegraded":"2024-08-28T19:30:27.404771+0000","last_fullsized":"2024-08-28T19:30:27.404771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.689602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.552176+0000","last_change":"2024-08-28T19:30:27.552006+0000","last_active":"2024-08-28T19:30:27.552176+0000","last_peered":"2024-08-28T19:30:27.552176+0000","last_clean":"2024-08-28T19:30:27.552176+0000","last_became_active":"2024-08-28T19:30:27.551356+0000","last_became_peered":"2024-08-28T19:30:27.551356+0000","last_unstale":"2024-08-28T19:30:27.552176+0000","last_undegraded":"2024-08-28T19:30:27.552176+0000","last_fullsized":"2024-08-28T19:30:27.552176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:56:09.242401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402115+0000","last_change":"2024-08-28T19:29:48.116964+0000","last_active":"2024-08-28T19:30:27.402115+0000","last_peered":"2024-08-28T19:30:27.402115+0000","last_clean":"2024-08-28T19:30:27.402115+0000","last_became_active":"2024-08-28T19:29:48.116588+0000","last_became_peered":"2024-08-28T19:29:48.116588+0000","last_unstale":"2024-08-28T19:30:27.402115+0000","last_undegraded":"2024-08-28T19:30:27.402115+0000","last_fullsized":"2024-08-28T19:30:27.402115+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:52:02.486724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427086+0000","last_change":"2024-08-28T19:29:46.104132+0000","last_active":"2024-08-28T19:30:27.427086+0000","last_peered":"2024-08-28T19:30:27.427086+0000","last_clean":"2024-08-28T19:30:27.427086+0000","last_became_active":"2024-08-28T19:29:46.103725+0000","last_became_peered":"2024-08-28T19:29:46.103725+0000","last_unstale":"2024-08-28T19:30:27.427086+0000","last_undegraded":"2024-08-28T19:30:27.427086+0000","last_fullsized":"2024-08-28T19:30:27.427086+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:50:12.859989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400571+0000","last_change":"2024-08-28T19:29:55.265494+0000","last_active":"2024-08-28T19:30:27.400571+0000","last_peered":"2024-08-28T19:30:27.400571+0000","last_clean":"2024-08-28T19:30:27.400571+0000","last_became_active":"2024-08-28T19:29:55.265087+0000","last_became_peered":"2024-08-28T19:29:55.265087+0000","last_unstale":"2024-08-28T19:30:27.400571+0000","last_undegraded":"2024-08-28T19:30:27.400571+0000","last_fullsized":"2024-08-28T19:30:27.400571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:51:18.676889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550159+0000","last_change":"2024-08-28T19:29:48.127419+0000","last_active":"2024-08-28T19:30:27.550159+0000","last_peered":"2024-08-28T19:30:27.550159+0000","last_clean":"2024-08-28T19:30:27.550159+0000","last_became_active":"2024-08-28T19:29:48.126997+0000","last_became_peered":"2024-08-28T19:29:48.126997+0000","last_unstale":"2024-08-28T19:30:27.550159+0000","last_undegraded":"2024-08-28T19:30:27.550159+0000","last_fullsized":"2024-08-28T19:30:27.550159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:26:08.208724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:37.441917+0000","last_change":"2024-08-28T19:29:46.103451+0000","last_active":"2024-08-28T19:30:37.441917+0000","last_peered":"2024-08-28T19:30:37.441917+0000","last_clean":"2024-08-28T19:30:37.441917+0000","last_became_active":"2024-08-28T19:29:46.102991+0000","last_became_peered":"2024-08-28T19:29:46.102991+0000","last_unstale":"2024-08-28T19:30:37.441917+0000","last_undegraded":"2024-08-28T19:30:37.441917+0000","last_fullsized":"2024-08-28T19:30:37.441917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:55:58.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548556+0000","last_change":"2024-08-28T19:29:55.269310+0000","last_active":"2024-08-28T19:30:27.548556+0000","last_peered":"2024-08-28T19:30:27.548556+0000","last_clean":"2024-08-28T19:30:27.548556+0000","last_became_active":"2024-08-28T19:29:55.268893+0000","last_became_peered":"2024-08-28T19:29:55.268893+0000","last_unstale":"2024-08-28T19:30:27.548556+0000","last_undegraded":"2024-08-28T19:30:27.548556+0000","last_fullsized":"2024-08-28T19:30:27.548556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:26:11.598773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400992+0000","last_change":"2024-08-28T19:29:55.261757+0000","last_active":"2024-08-28T19:30:27.400992+0000","last_peered":"2024-08-28T19:30:27.400992+0000","last_clean":"2024-08-28T19:30:27.400992+0000","last_became_active":"2024-08-28T19:29:55.261339+0000","last_became_peered":"2024-08-28T19:29:55.261339+0000","last_unstale":"2024-08-28T19:30:27.400992+0000","last_undegraded":"2024-08-28T19:30:27.400992+0000","last_fullsized":"2024-08-28T19:30:27.400992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:25:06.223029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401567+0000","last_change":"2024-08-28T19:29:48.123097+0000","last_active":"2024-08-28T19:30:27.401567+0000","last_peered":"2024-08-28T19:30:27.401567+0000","last_clean":"2024-08-28T19:30:27.401567+0000","last_became_active":"2024-08-28T19:29:48.122718+0000","last_became_peered":"2024-08-28T19:29:48.122718+0000","last_unstale":"2024-08-28T19:30:27.401567+0000","last_undegraded":"2024-08-28T19:30:27.401567+0000","last_fullsized":"2024-08-28T19:30:27.401567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:19.530985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406031+0000","last_change":"2024-08-28T19:29:46.105516+0000","last_active":"2024-08-28T19:30:27.406031+0000","last_peered":"2024-08-28T19:30:27.406031+0000","last_clean":"2024-08-28T19:30:27.406031+0000","last_became_active":"2024-08-28T19:29:46.105030+0000","last_became_peered":"2024-08-28T19:29:46.105030+0000","last_unstale":"2024-08-28T19:30:27.406031+0000","last_undegraded":"2024-08-28T19:30:27.406031+0000","last_fullsized":"2024-08-28T19:30:27.406031+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:47:02.032933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398485+0000","last_change":"2024-08-28T19:29:55.269759+0000","last_active":"2024-08-28T19:30:27.398485+0000","last_peered":"2024-08-28T19:30:27.398485+0000","last_clean":"2024-08-28T19:30:27.398485+0000","last_became_active":"2024-08-28T19:29:55.269275+0000","last_became_peered":"2024-08-28T19:29:55.269275+0000","last_unstale":"2024-08-28T19:30:27.398485+0000","last_undegraded":"2024-08-28T19:30:27.398485+0000","last_fullsized":"2024-08-28T19:30:27.398485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:45.870468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548611+0000","last_change":"2024-08-28T19:29:48.117400+0000","last_active":"2024-08-28T19:30:27.548611+0000","last_peered":"2024-08-28T19:30:27.548611+0000","last_clean":"2024-08-28T19:30:27.548611+0000","last_became_active":"2024-08-28T19:29:48.116987+0000","last_became_peered":"2024-08-28T19:29:48.116987+0000","last_unstale":"2024-08-28T19:30:27.548611+0000","last_undegraded":"2024-08-28T19:30:27.548611+0000","last_fullsized":"2024-08-28T19:30:27.548611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:43.822088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396426+0000","last_change":"2024-08-28T19:29:46.096103+0000","last_active":"2024-08-28T19:30:27.396426+0000","last_peered":"2024-08-28T19:30:27.396426+0000","last_clean":"2024-08-28T19:30:27.396426+0000","last_became_active":"2024-08-28T19:29:46.095812+0000","last_became_peered":"2024-08-28T19:29:46.095812+0000","last_unstale":"2024-08-28T19:30:27.396426+0000","last_undegraded":"2024-08-28T19:30:27.396426+0000","last_fullsized":"2024-08-28T19:30:27.396426+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:29.266636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398448+0000","last_change":"2024-08-28T19:29:46.106227+0000","last_active":"2024-08-28T19:30:27.398448+0000","last_peered":"2024-08-28T19:30:27.398448+0000","last_clean":"2024-08-28T19:30:27.398448+0000","last_became_active":"2024-08-28T19:29:46.105777+0000","last_became_peered":"2024-08-28T19:29:46.105777+0000","last_unstale":"2024-08-28T19:30:27.398448+0000","last_undegraded":"2024-08-28T19:30:27.398448+0000","last_fullsized":"2024-08-28T19:30:27.398448+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:26:14.815646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406013+0000","last_change":"2024-08-28T19:29:48.111051+0000","last_active":"2024-08-28T19:30:27.406013+0000","last_peered":"2024-08-28T19:30:27.406013+0000","last_clean":"2024-08-28T19:30:27.406013+0000","last_became_active":"2024-08-28T19:29:48.110421+0000","last_became_peered":"2024-08-28T19:29:48.110421+0000","last_unstale":"2024-08-28T19:30:27.406013+0000","last_undegraded":"2024-08-28T19:30:27.406013+0000","last_fullsized":"2024-08-28T19:30:27.406013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:19:47.765977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.408956+0000","last_change":"2024-08-28T19:30:27.408829+0000","last_active":"2024-08-28T19:30:27.408956+0000","last_peered":"2024-08-28T19:30:27.408956+0000","last_clean":"2024-08-28T19:30:27.408956+0000","last_became_active":"2024-08-28T19:30:27.408298+0000","last_became_peered":"2024-08-28T19:30:27.408298+0000","last_unstale":"2024-08-28T19:30:27.408956+0000","last_undegraded":"2024-08-28T19:30:27.408956+0000","last_fullsized":"2024-08-28T19:30:27.408956+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:38:58.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:36.441035+0000","last_change":"2024-08-28T19:29:46.102607+0000","last_active":"2024-08-28T19:30:36.441035+0000","last_peered":"2024-08-28T19:30:36.441035+0000","last_clean":"2024-08-28T19:30:36.441035+0000","last_became_active":"2024-08-28T19:29:46.102150+0000","last_became_peered":"2024-08-28T19:29:46.102150+0000","last_unstale":"2024-08-28T19:30:36.441035+0000","last_undegraded":"2024-08-28T19:30:36.441035+0000","last_fullsized":"2024-08-28T19:30:36.441035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:44.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405319+0000","last_change":"2024-08-28T19:29:48.121598+0000","last_active":"2024-08-28T19:30:27.405319+0000","last_peered":"2024-08-28T19:30:27.405319+0000","last_clean":"2024-08-28T19:30:27.405319+0000","last_became_active":"2024-08-28T19:29:48.121189+0000","last_became_peered":"2024-08-28T19:29:48.121189+0000","last_unstale":"2024-08-28T19:30:27.405319+0000","last_undegraded":"2024-08-28T19:30:27.405319+0000","last_fullsized":"2024-08-28T19:30:27.405319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:19:35.496859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399556+0000","last_change":"2024-08-28T19:29:55.269648+0000","last_active":"2024-08-28T19:30:27.399556+0000","last_peered":"2024-08-28T19:30:27.399556+0000","last_clean":"2024-08-28T19:30:27.399556+0000","last_became_active":"2024-08-28T19:29:55.269182+0000","last_became_peered":"2024-08-28T19:29:55.269182+0000","last_unstale":"2024-08-28T19:30:27.399556+0000","last_undegraded":"2024-08-28T19:30:27.399556+0000","last_fullsized":"2024-08-28T19:30:27.399556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:09:47.581907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397999+0000","last_change":"2024-08-28T19:29:48.117143+0000","last_active":"2024-08-28T19:30:27.397999+0000","last_peered":"2024-08-28T19:30:27.397999+0000","last_clean":"2024-08-28T19:30:27.397999+0000","last_became_active":"2024-08-28T19:29:48.116756+0000","last_became_peered":"2024-08-28T19:29:48.116756+0000","last_unstale":"2024-08-28T19:30:27.397999+0000","last_undegraded":"2024-08-28T19:30:27.397999+0000","last_fullsized":"2024-08-28T19:30:27.397999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:03:30.736872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.407341+0000","last_change":"2024-08-28T19:30:27.407218+0000","last_active":"2024-08-28T19:30:27.407341+0000","last_peered":"2024-08-28T19:30:27.407341+0000","last_clean":"2024-08-28T19:30:27.407341+0000","last_became_active":"2024-08-28T19:30:27.406769+0000","last_became_peered":"2024-08-28T19:30:27.406769+0000","last_unstale":"2024-08-28T19:30:27.407341+0000","last_undegraded":"2024-08-28T19:30:27.407341+0000","last_fullsized":"2024-08-28T19:30:27.407341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:59.946922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399195+0000","last_change":"2024-08-28T19:29:48.123969+0000","last_active":"2024-08-28T19:30:27.399195+0000","last_peered":"2024-08-28T19:30:27.399195+0000","last_clean":"2024-08-28T19:30:27.399195+0000","last_became_active":"2024-08-28T19:29:48.122534+0000","last_became_peered":"2024-08-28T19:29:48.122534+0000","last_unstale":"2024-08-28T19:30:27.399195+0000","last_undegraded":"2024-08-28T19:30:27.399195+0000","last_fullsized":"2024-08-28T19:30:27.399195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:33:56.739763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401200+0000","last_change":"2024-08-28T19:29:48.108976+0000","last_active":"2024-08-28T19:30:27.401200+0000","last_peered":"2024-08-28T19:30:27.401200+0000","last_clean":"2024-08-28T19:30:27.401200+0000","last_became_active":"2024-08-28T19:29:48.108631+0000","last_became_peered":"2024-08-28T19:29:48.108631+0000","last_unstale":"2024-08-28T19:30:27.401200+0000","last_undegraded":"2024-08-28T19:30:27.401200+0000","last_fullsized":"2024-08-28T19:30:27.401200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:08:59.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396988+0000","last_change":"2024-08-28T19:29:48.109875+0000","last_active":"2024-08-28T19:30:27.396988+0000","last_peered":"2024-08-28T19:30:27.396988+0000","last_clean":"2024-08-28T19:30:27.396988+0000","last_became_active":"2024-08-28T19:29:48.109486+0000","last_became_peered":"2024-08-28T19:29:48.109486+0000","last_unstale":"2024-08-28T19:30:27.396988+0000","last_undegraded":"2024-08-28T19:30:27.396988+0000","last_fullsized":"2024-08-28T19:30:27.396988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:02:28.365203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398509+0000","last_change":"2024-08-28T19:29:48.117237+0000","last_active":"2024-08-28T19:30:27.398509+0000","last_peered":"2024-08-28T19:30:27.398509+0000","last_clean":"2024-08-28T19:30:27.398509+0000","last_became_active":"2024-08-28T19:29:48.116799+0000","last_became_peered":"2024-08-28T19:29:48.116799+0000","last_unstale":"2024-08-28T19:30:27.398509+0000","last_undegraded":"2024-08-28T19:30:27.398509+0000","last_fullsized":"2024-08-28T19:30:27.398509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:48:12.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400269+0000","last_change":"2024-08-28T19:29:48.120522+0000","last_active":"2024-08-28T19:30:27.400269+0000","last_peered":"2024-08-28T19:30:27.400269+0000","last_clean":"2024-08-28T19:30:27.400269+0000","last_became_active":"2024-08-28T19:29:48.120150+0000","last_became_peered":"2024-08-28T19:29:48.120150+0000","last_unstale":"2024-08-28T19:30:27.400269+0000","last_undegraded":"2024-08-28T19:30:27.400269+0000","last_fullsized":"2024-08-28T19:30:27.400269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:01:00.210596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548881+0000","last_change":"2024-08-28T19:29:48.128451+0000","last_active":"2024-08-28T19:30:27.548881+0000","last_peered":"2024-08-28T19:30:27.548881+0000","last_clean":"2024-08-28T19:30:27.548881+0000","last_became_active":"2024-08-28T19:29:48.127898+0000","last_became_peered":"2024-08-28T19:29:48.127898+0000","last_unstale":"2024-08-28T19:30:27.548881+0000","last_undegraded":"2024-08-28T19:30:27.548881+0000","last_fullsized":"2024-08-28T19:30:27.548881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:48.663999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405596+0000","last_change":"2024-08-28T19:29:48.110788+0000","last_active":"2024-08-28T19:30:27.405596+0000","last_peered":"2024-08-28T19:30:27.405596+0000","last_clean":"2024-08-28T19:30:27.405596+0000","last_became_active":"2024-08-28T19:29:48.110355+0000","last_became_peered":"2024-08-28T19:29:48.110355+0000","last_unstale":"2024-08-28T19:30:27.405596+0000","last_undegraded":"2024-08-28T19:30:27.405596+0000","last_fullsized":"2024-08-28T19:30:27.405596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:57:25.345283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548733+0000","last_change":"2024-08-28T19:29:48.129667+0000","last_active":"2024-08-28T19:30:27.548733+0000","last_peered":"2024-08-28T19:30:27.548733+0000","last_clean":"2024-08-28T19:30:27.548733+0000","last_became_active":"2024-08-28T19:29:48.128237+0000","last_became_peered":"2024-08-28T19:29:48.128237+0000","last_unstale":"2024-08-28T19:30:27.548733+0000","last_undegraded":"2024-08-28T19:30:27.548733+0000","last_fullsized":"2024-08-28T19:30:27.548733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:23:35.920353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549184+0000","last_change":"2024-08-28T19:29:48.136070+0000","last_active":"2024-08-28T19:30:27.549184+0000","last_peered":"2024-08-28T19:30:27.549184+0000","last_clean":"2024-08-28T19:30:27.549184+0000","last_became_active":"2024-08-28T19:29:48.135515+0000","last_became_peered":"2024-08-28T19:29:48.135515+0000","last_unstale":"2024-08-28T19:30:27.549184+0000","last_undegraded":"2024-08-28T19:30:27.549184+0000","last_fullsized":"2024-08-28T19:30:27.549184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:25:29.267753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396768+0000","last_change":"2024-08-28T19:29:48.128614+0000","last_active":"2024-08-28T19:30:27.396768+0000","last_peered":"2024-08-28T19:30:27.396768+0000","last_clean":"2024-08-28T19:30:27.396768+0000","last_became_active":"2024-08-28T19:29:48.128231+0000","last_became_peered":"2024-08-28T19:29:48.128231+0000","last_unstale":"2024-08-28T19:30:27.396768+0000","last_undegraded":"2024-08-28T19:30:27.396768+0000","last_fullsized":"2024-08-28T19:30:27.396768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:11:08.541435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398204+0000","last_change":"2024-08-28T19:29:48.114930+0000","last_active":"2024-08-28T19:30:27.398204+0000","last_peered":"2024-08-28T19:30:27.398204+0000","last_clean":"2024-08-28T19:30:27.398204+0000","last_became_active":"2024-08-28T19:29:48.114389+0000","last_became_peered":"2024-08-28T19:29:48.114389+0000","last_unstale":"2024-08-28T19:30:27.398204+0000","last_undegraded":"2024-08-28T19:30:27.398204+0000","last_fullsized":"2024-08-28T19:30:27.398204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:51.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400101+0000","last_change":"2024-08-28T19:29:48.125031+0000","last_active":"2024-08-28T19:30:27.400101+0000","last_peered":"2024-08-28T19:30:27.400101+0000","last_clean":"2024-08-28T19:30:27.400101+0000","last_became_active":"2024-08-28T19:29:48.124417+0000","last_became_peered":"2024-08-28T19:29:48.124417+0000","last_unstale":"2024-08-28T19:30:27.400101+0000","last_undegraded":"2024-08-28T19:30:27.400101+0000","last_fullsized":"2024-08-28T19:30:27.400101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:33:33.931496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401136+0000","last_change":"2024-08-28T19:29:48.127815+0000","last_active":"2024-08-28T19:30:27.401136+0000","last_peered":"2024-08-28T19:30:27.401136+0000","last_clean":"2024-08-28T19:30:27.401136+0000","last_became_active":"2024-08-28T19:29:48.127455+0000","last_became_peered":"2024-08-28T19:29:48.127455+0000","last_unstale":"2024-08-28T19:30:27.401136+0000","last_undegraded":"2024-08-28T19:30:27.401136+0000","last_fullsized":"2024-08-28T19:30:27.401136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:47:23.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398765+0000","last_change":"2024-08-28T19:29:48.122105+0000","last_active":"2024-08-28T19:30:27.398765+0000","last_peered":"2024-08-28T19:30:27.398765+0000","last_clean":"2024-08-28T19:30:27.398765+0000","last_became_active":"2024-08-28T19:29:48.121546+0000","last_became_peered":"2024-08-28T19:29:48.121546+0000","last_unstale":"2024-08-28T19:30:27.398765+0000","last_undegraded":"2024-08-28T19:30:27.398765+0000","last_fullsized":"2024-08-28T19:30:27.398765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:21:00.428052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548837+0000","last_change":"2024-08-28T19:29:48.136198+0000","last_active":"2024-08-28T19:30:27.548837+0000","last_peered":"2024-08-28T19:30:27.548837+0000","last_clean":"2024-08-28T19:30:27.548837+0000","last_became_active":"2024-08-28T19:29:48.135796+0000","last_became_peered":"2024-08-28T19:29:48.135796+0000","last_unstale":"2024-08-28T19:30:27.548837+0000","last_undegraded":"2024-08-28T19:30:27.548837+0000","last_fullsized":"2024-08-28T19:30:27.548837+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:05.033399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400902+0000","last_change":"2024-08-28T19:29:48.121245+0000","last_active":"2024-08-28T19:30:27.400902+0000","last_peered":"2024-08-28T19:30:27.400902+0000","last_clean":"2024-08-28T19:30:27.400902+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:30:27.400902+0000","last_undegraded":"2024-08-28T19:30:27.400902+0000","last_fullsized":"2024-08-28T19:30:27.400902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:39.936209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400752+0000","last_change":"2024-08-28T19:29:48.119198+0000","last_active":"2024-08-28T19:30:27.400752+0000","last_peered":"2024-08-28T19:30:27.400752+0000","last_clean":"2024-08-28T19:30:27.400752+0000","last_became_active":"2024-08-28T19:29:48.118744+0000","last_became_peered":"2024-08-28T19:29:48.118744+0000","last_unstale":"2024-08-28T19:30:27.400752+0000","last_undegraded":"2024-08-28T19:30:27.400752+0000","last_fullsized":"2024-08-28T19:30:27.400752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:15:35.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.403903+0000","last_change":"2024-08-28T19:30:27.403790+0000","last_active":"2024-08-28T19:30:27.403903+0000","last_peered":"2024-08-28T19:30:27.403903+0000","last_clean":"2024-08-28T19:30:27.403903+0000","last_became_active":"2024-08-28T19:30:27.403279+0000","last_became_peered":"2024-08-28T19:30:27.403279+0000","last_unstale":"2024-08-28T19:30:27.403903+0000","last_undegraded":"2024-08-28T19:30:27.403903+0000","last_fullsized":"2024-08-28T19:30:27.403903+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:31:54.137839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405819+0000","last_change":"2024-08-28T19:30:27.405173+0000","last_active":"2024-08-28T19:30:27.405819+0000","last_peered":"2024-08-28T19:30:27.405819+0000","last_clean":"2024-08-28T19:30:27.405819+0000","last_became_active":"2024-08-28T19:30:27.404752+0000","last_became_peered":"2024-08-28T19:30:27.404752+0000","last_unstale":"2024-08-28T19:30:27.405819+0000","last_undegraded":"2024-08-28T19:30:27.405819+0000","last_fullsized":"2024-08-28T19:30:27.405819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:16.544309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427239+0000","last_change":"2024-08-28T19:29:48.136738+0000","last_active":"2024-08-28T19:30:27.427239+0000","last_peered":"2024-08-28T19:30:27.427239+0000","last_clean":"2024-08-28T19:30:27.427239+0000","last_became_active":"2024-08-28T19:29:48.136046+0000","last_became_peered":"2024-08-28T19:29:48.136046+0000","last_unstale":"2024-08-28T19:30:27.427239+0000","last_undegraded":"2024-08-28T19:30:27.427239+0000","last_fullsized":"2024-08-28T19:30:27.427239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:43:32.905933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398789+0000","last_change":"2024-08-28T19:29:48.127432+0000","last_active":"2024-08-28T19:30:27.398789+0000","last_peered":"2024-08-28T19:30:27.398789+0000","last_clean":"2024-08-28T19:30:27.398789+0000","last_became_active":"2024-08-28T19:29:48.126067+0000","last_became_peered":"2024-08-28T19:29:48.126067+0000","last_unstale":"2024-08-28T19:30:27.398789+0000","last_undegraded":"2024-08-28T19:30:27.398789+0000","last_fullsized":"2024-08-28T19:30:27.398789+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:30:05.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550430+0000","last_change":"2024-08-28T19:29:48.121154+0000","last_active":"2024-08-28T19:30:27.550430+0000","last_peered":"2024-08-28T19:30:27.550430+0000","last_clean":"2024-08-28T19:30:27.550430+0000","last_became_active":"2024-08-28T19:29:48.120709+0000","last_became_peered":"2024-08-28T19:29:48.120709+0000","last_unstale":"2024-08-28T19:30:27.550430+0000","last_undegraded":"2024-08-28T19:30:27.550430+0000","last_fullsized":"2024-08-28T19:30:27.550430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:52.716814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548374+0000","last_change":"2024-08-28T19:29:48.127124+0000","last_active":"2024-08-28T19:30:27.548374+0000","last_peered":"2024-08-28T19:30:27.548374+0000","last_clean":"2024-08-28T19:30:27.548374+0000","last_became_active":"2024-08-28T19:29:48.126761+0000","last_became_peered":"2024-08-28T19:29:48.126761+0000","last_unstale":"2024-08-28T19:30:27.548374+0000","last_undegraded":"2024-08-28T19:30:27.548374+0000","last_fullsized":"2024-08-28T19:30:27.548374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:05:31.150472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426567+0000","last_change":"2024-08-28T19:29:48.132285+0000","last_active":"2024-08-28T19:30:27.426567+0000","last_peered":"2024-08-28T19:30:27.426567+0000","last_clean":"2024-08-28T19:30:27.426567+0000","last_became_active":"2024-08-28T19:29:48.131688+0000","last_became_peered":"2024-08-28T19:29:48.131688+0000","last_unstale":"2024-08-28T19:30:27.426567+0000","last_undegraded":"2024-08-28T19:30:27.426567+0000","last_fullsized":"2024-08-28T19:30:27.426567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:23:08.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398390+0000","last_change":"2024-08-28T19:29:48.126384+0000","last_active":"2024-08-28T19:30:27.398390+0000","last_peered":"2024-08-28T19:30:27.398390+0000","last_clean":"2024-08-28T19:30:27.398390+0000","last_became_active":"2024-08-28T19:29:48.125412+0000","last_became_peered":"2024-08-28T19:29:48.125412+0000","last_unstale":"2024-08-28T19:30:27.398390+0000","last_undegraded":"2024-08-28T19:30:27.398390+0000","last_fullsized":"2024-08-28T19:30:27.398390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:47:42.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404921+0000","last_change":"2024-08-28T19:29:48.114032+0000","last_active":"2024-08-28T19:30:27.404921+0000","last_peered":"2024-08-28T19:30:27.404921+0000","last_clean":"2024-08-28T19:30:27.404921+0000","last_became_active":"2024-08-28T19:29:48.113625+0000","last_became_peered":"2024-08-28T19:29:48.113625+0000","last_unstale":"2024-08-28T19:30:27.404921+0000","last_undegraded":"2024-08-28T19:30:27.404921+0000","last_fullsized":"2024-08-28T19:30:27.404921+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:07:08.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402005+0000","last_change":"2024-08-28T19:29:48.124046+0000","last_active":"2024-08-28T19:30:27.402005+0000","last_peered":"2024-08-28T19:30:27.402005+0000","last_clean":"2024-08-28T19:30:27.402005+0000","last_became_active":"2024-08-28T19:29:48.123647+0000","last_became_peered":"2024-08-28T19:29:48.123647+0000","last_unstale":"2024-08-28T19:30:27.402005+0000","last_undegraded":"2024-08-28T19:30:27.402005+0000","last_fullsized":"2024-08-28T19:30:27.402005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:59.262454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400906+0000","last_change":"2024-08-28T19:29:48.121258+0000","last_active":"2024-08-28T19:30:27.400906+0000","last_peered":"2024-08-28T19:30:27.400906+0000","last_clean":"2024-08-28T19:30:27.400906+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:30:27.400906+0000","last_undegraded":"2024-08-28T19:30:27.400906+0000","last_fullsized":"2024-08-28T19:30:27.400906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:37:05.610466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401108+0000","last_change":"2024-08-28T19:29:48.125071+0000","last_active":"2024-08-28T19:30:27.401108+0000","last_peered":"2024-08-28T19:30:27.401108+0000","last_clean":"2024-08-28T19:30:27.401108+0000","last_became_active":"2024-08-28T19:29:48.124706+0000","last_became_peered":"2024-08-28T19:29:48.124706+0000","last_unstale":"2024-08-28T19:30:27.401108+0000","last_undegraded":"2024-08-28T19:30:27.401108+0000","last_fullsized":"2024-08-28T19:30:27.401108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:39:06.460682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398708+0000","last_change":"2024-08-28T19:29:48.121905+0000","last_active":"2024-08-28T19:30:27.398708+0000","last_peered":"2024-08-28T19:30:27.398708+0000","last_clean":"2024-08-28T19:30:27.398708+0000","last_became_active":"2024-08-28T19:29:48.121045+0000","last_became_peered":"2024-08-28T19:29:48.121045+0000","last_unstale":"2024-08-28T19:30:27.398708+0000","last_undegraded":"2024-08-28T19:30:27.398708+0000","last_fullsized":"2024-08-28T19:30:27.398708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:56:58.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50545,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":152,"num_read_kb":132,"num_write":232,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":151635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246047,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":477263,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939675,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":1107420,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103201,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":480898,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299431,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":477180,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495658,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1073677,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659184,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":913408,"data_stored":472306,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855413,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":995328,"data_stored":1068868,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018937,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":476771,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215166,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":472014,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":517288,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542216,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":516677,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705740,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":474153,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":45093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":45704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":45468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T19:30:42.844 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T19:30:43.097 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:43.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.606+0000 7f5ad9955640 1 -- 172.21.15.33:0/3629739826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad4109240 msgr2=0x7f5ad4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:43.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.606+0000 7f5ad9955640 1 --2- 172.21.15.33:0/3629739826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad4109240 0x7f5ad4109650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009900 tx=0x7f5ac402a410 comp rx=0 tx=0).stop 2024-08-28T19:30:43.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.606+0000 7f5ad9955640 1 -- 172.21.15.33:0/3629739826 shutdown_connections 2024-08-28T19:30:43.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.606+0000 7f5ad9955640 1 --2- 172.21.15.33:0/3629739826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad4109b90 0x7f5ad41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:43.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.606+0000 7f5ad9955640 1 --2- 172.21.15.33:0/3629739826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad4109240 0x7f5ad4109650 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:43.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.606+0000 7f5ad9955640 1 --2- 172.21.15.33:0/3629739826 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ad4103900 0x7f5ad4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:43.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.606+0000 7f5ad9955640 1 -- 172.21.15.33:0/3629739826 >> 172.21.15.33:0/3629739826 conn(0x7f5ad407b5f0 msgr2=0x7f5ad407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:43.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.606+0000 7f5ad9955640 1 -- 172.21.15.33:0/3629739826 shutdown_connections 2024-08-28T19:30:43.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.606+0000 7f5ad9955640 1 -- 172.21.15.33:0/3629739826 wait complete. 2024-08-28T19:30:43.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.607+0000 7f5ad9955640 1 Processor -- start 2024-08-28T19:30:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.607+0000 7f5ad9955640 1 -- start start 2024-08-28T19:30:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.607+0000 7f5ad9955640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad4103900 0x7f5ad419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.607+0000 7f5ad9955640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ad4109240 0x7f5ad419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.607+0000 7f5ad9955640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad4109b90 0x7f5ad419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.607+0000 7f5ad9955640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad4113870 con 0x7f5ad4109b90 2024-08-28T19:30:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.607+0000 7f5ad9955640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad41136f0 con 0x7f5ad4103900 2024-08-28T19:30:43.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.607+0000 7f5ad9955640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad41139f0 con 0x7f5ad4109240 2024-08-28T19:30:43.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.607+0000 7f5ad37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad4109b90 0x7f5ad419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:43.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad4109b90 0x7f5ad419faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41896/0 (socket says 172.21.15.33:41896) 2024-08-28T19:30:43.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad37fe640 1 -- 172.21.15.33:0/2523812791 learned_addr learned my addr 172.21.15.33:0/2523812791 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:43.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad2ffd640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad4103900 0x7f5ad419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:43.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad37fe640 1 -- 172.21.15.33:0/2523812791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ad4109240 msgr2=0x7f5ad419a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:43.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad27fc640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ad4109240 0x7f5ad419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:43.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad37fe640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ad4109240 0x7f5ad419a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:43.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad37fe640 1 -- 172.21.15.33:0/2523812791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad4103900 msgr2=0x7f5ad419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:43.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad37fe640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad4103900 0x7f5ad419a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:43.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad37fe640 1 -- 172.21.15.33:0/2523812791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad41a01d0 con 0x7f5ad4109b90 2024-08-28T19:30:43.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad2ffd640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad4103900 0x7f5ad419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:43.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad37fe640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad4109b90 0x7f5ad419faa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00eaa0 tx=0x7f5acc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:43.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad8953640 1 -- 172.21.15.33:0/2523812791 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00cdb0 con 0x7f5ad4109b90 2024-08-28T19:30:43.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad8953640 1 -- 172.21.15.33:0/2523812791 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5acc005020 con 0x7f5ad4109b90 2024-08-28T19:30:43.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad9955640 1 -- 172.21.15.33:0/2523812791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad41a04c0 con 0x7f5ad4109b90 2024-08-28T19:30:43.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad8953640 1 -- 172.21.15.33:0/2523812791 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0116d0 con 0x7f5ad4109b90 2024-08-28T19:30:43.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.608+0000 7f5ad9955640 1 -- 172.21.15.33:0/2523812791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad41a6c20 con 0x7f5ad4109b90 2024-08-28T19:30:43.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.609+0000 7f5ad9955640 1 -- 172.21.15.33:0/2523812791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad4103d10 con 0x7f5ad4109b90 2024-08-28T19:30:43.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.612+0000 7f5ad8953640 1 -- 172.21.15.33:0/2523812791 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f5acc0051d0 con 0x7f5ad4109b90 2024-08-28T19:30:43.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.612+0000 7f5ad8953640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ac00b4c90 0x7f5ac00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:43.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.613+0000 7f5ad2ffd640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ac00b4c90 0x7f5ac00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:43.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.613+0000 7f5ad8953640 1 -- 172.21.15.33:0/2523812791 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f5acc0e5d40 con 0x7f5ad4109b90 2024-08-28T19:30:43.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.613+0000 7f5ad2ffd640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ac00b4c90 0x7f5ac00b71a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009930 tx=0x7f5abc008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:43.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.616+0000 7f5ad8953640 1 -- 172.21.15.33:0/2523812791 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5acc016030 con 0x7f5ad4109b90 2024-08-28T19:30:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:43 smithi059 ceph-mon[22052]: pgmap v288: 129 pgs: 129 active+clean; 626 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-08-28T19:30:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:43 smithi059 ceph-mon[22052]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:30:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:43 smithi122 ceph-mon[22174]: pgmap v288: 129 pgs: 129 active+clean; 626 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-08-28T19:30:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:43 smithi122 ceph-mon[22174]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:30:43.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.795+0000 7f5ad9955640 1 -- 172.21.15.33:0/2523812791 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ad40635a0 con 0x7f5ac00b4c90 2024-08-28T19:30:43.797 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:43 smithi033 ceph-mon[18549]: pgmap v288: 129 pgs: 129 active+clean; 626 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-08-28T19:30:43.797 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:43 smithi033 ceph-mon[18549]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:30:43.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.803+0000 7f5ad8953640 1 -- 172.21.15.33:0/2523812791 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340622 (secure 0 0 0) 0x7f5ad40635a0 con 0x7f5ac00b4c90 2024-08-28T19:30:43.808 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-28T19:30:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.806+0000 7f5ad9955640 1 -- 172.21.15.33:0/2523812791 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ac00b4c90 msgr2=0x7f5ac00b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.806+0000 7f5ad9955640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ac00b4c90 0x7f5ac00b71a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009930 tx=0x7f5abc008040 comp rx=0 tx=0).stop 2024-08-28T19:30:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.806+0000 7f5ad9955640 1 -- 172.21.15.33:0/2523812791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad4109b90 msgr2=0x7f5ad419faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.806+0000 7f5ad9955640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad4109b90 0x7f5ad419faa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00eaa0 tx=0x7f5acc00ef60 comp rx=0 tx=0).stop 2024-08-28T19:30:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.807+0000 7f5ad9955640 1 -- 172.21.15.33:0/2523812791 shutdown_connections 2024-08-28T19:30:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.807+0000 7f5ad9955640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad4109b90 0x7f5ad419faa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.807+0000 7f5ad9955640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ac00b4c90 0x7f5ac00b71a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:43.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.807+0000 7f5ad9955640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ad4109240 0x7f5ad419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:43.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.807+0000 7f5ad9955640 1 --2- 172.21.15.33:0/2523812791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ad4103900 0x7f5ad419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:43.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.807+0000 7f5ad9955640 1 -- 172.21.15.33:0/2523812791 >> 172.21.15.33:0/2523812791 conn(0x7f5ad407b5f0 msgr2=0x7f5ad41072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:43.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.807+0000 7f5ad9955640 1 -- 172.21.15.33:0/2523812791 shutdown_connections 2024-08-28T19:30:43.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:43.807+0000 7f5ad9955640 1 -- 172.21.15.33:0/2523812791 wait complete. 2024-08-28T19:30:44.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:44 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:30:44.740 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-08-28T19:30:43.730421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654475,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":274,"num_read_kb":240,"num_write":367,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364652,"kb_used_data":11228,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577172,"statfs":{"total":1151940427776,"available":1151567024128,"internally_reserved":0,"allocated":11497472,"data_stored":7654499,"data_compressed":392145,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53843,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":131,"num_write":35,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003719"},"pg_stats":[{"pgid":"2.1f","version":"81'13","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:41.451169+0000","last_change":"2024-08-28T19:29:46.098343+0000","last_active":"2024-08-28T19:30:41.451169+0000","last_peered":"2024-08-28T19:30:41.451169+0000","last_clean":"2024-08-28T19:30:41.451169+0000","last_became_active":"2024-08-28T19:29:46.097974+0000","last_became_peered":"2024-08-28T19:29:46.097974+0000","last_unstale":"2024-08-28T19:30:41.451169+0000","last_undegraded":"2024-08-28T19:30:41.451169+0000","last_fullsized":"2024-08-28T19:30:41.451169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:03:11.466154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549015+0000","last_change":"2024-08-28T19:29:48.123521+0000","last_active":"2024-08-28T19:30:27.549015+0000","last_peered":"2024-08-28T19:30:27.549015+0000","last_clean":"2024-08-28T19:30:27.549015+0000","last_became_active":"2024-08-28T19:29:48.122998+0000","last_became_peered":"2024-08-28T19:29:48.122998+0000","last_unstale":"2024-08-28T19:30:27.549015+0000","last_undegraded":"2024-08-28T19:30:27.549015+0000","last_fullsized":"2024-08-28T19:30:27.549015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:33:48.413468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398981+0000","last_change":"2024-08-28T19:29:55.268086+0000","last_active":"2024-08-28T19:30:27.398981+0000","last_peered":"2024-08-28T19:30:27.398981+0000","last_clean":"2024-08-28T19:30:27.398981+0000","last_became_active":"2024-08-28T19:29:55.267411+0000","last_became_peered":"2024-08-28T19:29:55.267411+0000","last_unstale":"2024-08-28T19:30:27.398981+0000","last_undegraded":"2024-08-28T19:30:27.398981+0000","last_fullsized":"2024-08-28T19:30:27.398981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:32:16.277295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549135+0000","last_change":"2024-08-28T19:29:46.188552+0000","last_active":"2024-08-28T19:30:27.549135+0000","last_peered":"2024-08-28T19:30:27.549135+0000","last_clean":"2024-08-28T19:30:27.549135+0000","last_became_active":"2024-08-28T19:29:46.188118+0000","last_became_peered":"2024-08-28T19:29:46.188118+0000","last_unstale":"2024-08-28T19:30:27.549135+0000","last_undegraded":"2024-08-28T19:30:27.549135+0000","last_fullsized":"2024-08-28T19:30:27.549135+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:55:43.774037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402122+0000","last_change":"2024-08-28T19:29:48.118765+0000","last_active":"2024-08-28T19:30:27.402122+0000","last_peered":"2024-08-28T19:30:27.402122+0000","last_clean":"2024-08-28T19:30:27.402122+0000","last_became_active":"2024-08-28T19:29:48.118111+0000","last_became_peered":"2024-08-28T19:29:48.118111+0000","last_unstale":"2024-08-28T19:30:27.402122+0000","last_undegraded":"2024-08-28T19:30:27.402122+0000","last_fullsized":"2024-08-28T19:30:27.402122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:00:51.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401192+0000","last_change":"2024-08-28T19:29:55.262222+0000","last_active":"2024-08-28T19:30:27.401192+0000","last_peered":"2024-08-28T19:30:27.401192+0000","last_clean":"2024-08-28T19:30:27.401192+0000","last_became_active":"2024-08-28T19:29:55.260906+0000","last_became_peered":"2024-08-28T19:29:55.260906+0000","last_unstale":"2024-08-28T19:30:27.401192+0000","last_undegraded":"2024-08-28T19:30:27.401192+0000","last_fullsized":"2024-08-28T19:30:27.401192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:22:30.523609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.421805+0000","last_change":"2024-08-28T19:29:46.101077+0000","last_active":"2024-08-28T19:30:27.421805+0000","last_peered":"2024-08-28T19:30:27.421805+0000","last_clean":"2024-08-28T19:30:27.421805+0000","last_became_active":"2024-08-28T19:29:46.100630+0000","last_became_peered":"2024-08-28T19:29:46.100630+0000","last_unstale":"2024-08-28T19:30:27.421805+0000","last_undegraded":"2024-08-28T19:30:27.421805+0000","last_fullsized":"2024-08-28T19:30:27.421805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:59:11.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549826+0000","last_change":"2024-08-28T19:29:48.129460+0000","last_active":"2024-08-28T19:30:27.549826+0000","last_peered":"2024-08-28T19:30:27.549826+0000","last_clean":"2024-08-28T19:30:27.549826+0000","last_became_active":"2024-08-28T19:29:48.129068+0000","last_became_peered":"2024-08-28T19:29:48.129068+0000","last_unstale":"2024-08-28T19:30:27.549826+0000","last_undegraded":"2024-08-28T19:30:27.549826+0000","last_fullsized":"2024-08-28T19:30:27.549826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:08:40.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402313+0000","last_change":"2024-08-28T19:29:55.262943+0000","last_active":"2024-08-28T19:30:27.402313+0000","last_peered":"2024-08-28T19:30:27.402313+0000","last_clean":"2024-08-28T19:30:27.402313+0000","last_became_active":"2024-08-28T19:29:55.262424+0000","last_became_peered":"2024-08-28T19:29:55.262424+0000","last_unstale":"2024-08-28T19:30:27.402313+0000","last_undegraded":"2024-08-28T19:30:27.402313+0000","last_fullsized":"2024-08-28T19:30:27.402313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:19:40.618651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406164+0000","last_change":"2024-08-28T19:29:46.102571+0000","last_active":"2024-08-28T19:30:27.406164+0000","last_peered":"2024-08-28T19:30:27.406164+0000","last_clean":"2024-08-28T19:30:27.406164+0000","last_became_active":"2024-08-28T19:29:46.102081+0000","last_became_peered":"2024-08-28T19:29:46.102081+0000","last_unstale":"2024-08-28T19:30:27.406164+0000","last_undegraded":"2024-08-28T19:30:27.406164+0000","last_fullsized":"2024-08-28T19:30:27.406164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:46:38.266122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550530+0000","last_change":"2024-08-28T19:30:27.550413+0000","last_active":"2024-08-28T19:30:27.550530+0000","last_peered":"2024-08-28T19:30:27.550530+0000","last_clean":"2024-08-28T19:30:27.550530+0000","last_became_active":"2024-08-28T19:30:27.550002+0000","last_became_peered":"2024-08-28T19:30:27.550002+0000","last_unstale":"2024-08-28T19:30:27.550530+0000","last_undegraded":"2024-08-28T19:30:27.550530+0000","last_fullsized":"2024-08-28T19:30:27.550530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:17.519332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401862+0000","last_change":"2024-08-28T19:29:55.261930+0000","last_active":"2024-08-28T19:30:27.401862+0000","last_peered":"2024-08-28T19:30:27.401862+0000","last_clean":"2024-08-28T19:30:27.401862+0000","last_became_active":"2024-08-28T19:29:55.261208+0000","last_became_peered":"2024-08-28T19:29:55.261208+0000","last_unstale":"2024-08-28T19:30:27.401862+0000","last_undegraded":"2024-08-28T19:30:27.401862+0000","last_fullsized":"2024-08-28T19:30:27.401862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.804993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427036+0000","last_change":"2024-08-28T19:29:48.133820+0000","last_active":"2024-08-28T19:30:27.427036+0000","last_peered":"2024-08-28T19:30:27.427036+0000","last_clean":"2024-08-28T19:30:27.427036+0000","last_became_active":"2024-08-28T19:29:48.132536+0000","last_became_peered":"2024-08-28T19:29:48.132536+0000","last_unstale":"2024-08-28T19:30:27.427036+0000","last_undegraded":"2024-08-28T19:30:27.427036+0000","last_fullsized":"2024-08-28T19:30:27.427036+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:15:39.779698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405110+0000","last_change":"2024-08-28T19:29:46.101206+0000","last_active":"2024-08-28T19:30:27.405110+0000","last_peered":"2024-08-28T19:30:27.405110+0000","last_clean":"2024-08-28T19:30:27.405110+0000","last_became_active":"2024-08-28T19:29:46.100801+0000","last_became_peered":"2024-08-28T19:29:46.100801+0000","last_unstale":"2024-08-28T19:30:27.405110+0000","last_undegraded":"2024-08-28T19:30:27.405110+0000","last_fullsized":"2024-08-28T19:30:27.405110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:43:33.156203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401551+0000","last_change":"2024-08-28T19:29:55.572774+0000","last_active":"2024-08-28T19:30:27.401551+0000","last_peered":"2024-08-28T19:30:27.401551+0000","last_clean":"2024-08-28T19:30:27.401551+0000","last_became_active":"2024-08-28T19:29:55.571703+0000","last_became_peered":"2024-08-28T19:29:55.571703+0000","last_unstale":"2024-08-28T19:30:27.401551+0000","last_undegraded":"2024-08-28T19:30:27.401551+0000","last_fullsized":"2024-08-28T19:30:27.401551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:56:52.695007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548462+0000","last_change":"2024-08-28T19:29:48.127683+0000","last_active":"2024-08-28T19:30:27.548462+0000","last_peered":"2024-08-28T19:30:27.548462+0000","last_clean":"2024-08-28T19:30:27.548462+0000","last_became_active":"2024-08-28T19:29:48.127139+0000","last_became_peered":"2024-08-28T19:29:48.127139+0000","last_unstale":"2024-08-28T19:30:27.548462+0000","last_undegraded":"2024-08-28T19:30:27.548462+0000","last_fullsized":"2024-08-28T19:30:27.548462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:38:16.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399374+0000","last_change":"2024-08-28T19:29:46.103233+0000","last_active":"2024-08-28T19:30:27.399374+0000","last_peered":"2024-08-28T19:30:27.399374+0000","last_clean":"2024-08-28T19:30:27.399374+0000","last_became_active":"2024-08-28T19:29:46.102515+0000","last_became_peered":"2024-08-28T19:29:46.102515+0000","last_unstale":"2024-08-28T19:30:27.399374+0000","last_undegraded":"2024-08-28T19:30:27.399374+0000","last_fullsized":"2024-08-28T19:30:27.399374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:49:35.905893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401876+0000","last_change":"2024-08-28T19:29:55.264291+0000","last_active":"2024-08-28T19:30:27.401876+0000","last_peered":"2024-08-28T19:30:27.401876+0000","last_clean":"2024-08-28T19:30:27.401876+0000","last_became_active":"2024-08-28T19:29:55.263692+0000","last_became_peered":"2024-08-28T19:29:55.263692+0000","last_unstale":"2024-08-28T19:30:27.401876+0000","last_undegraded":"2024-08-28T19:30:27.401876+0000","last_fullsized":"2024-08-28T19:30:27.401876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:47:01.795320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398110+0000","last_change":"2024-08-28T19:29:48.115470+0000","last_active":"2024-08-28T19:30:27.398110+0000","last_peered":"2024-08-28T19:30:27.398110+0000","last_clean":"2024-08-28T19:30:27.398110+0000","last_became_active":"2024-08-28T19:29:48.115076+0000","last_became_peered":"2024-08-28T19:29:48.115076+0000","last_unstale":"2024-08-28T19:30:27.398110+0000","last_undegraded":"2024-08-28T19:30:27.398110+0000","last_fullsized":"2024-08-28T19:30:27.398110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:32.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548923+0000","last_change":"2024-08-28T19:29:46.099970+0000","last_active":"2024-08-28T19:30:27.548923+0000","last_peered":"2024-08-28T19:30:27.548923+0000","last_clean":"2024-08-28T19:30:27.548923+0000","last_became_active":"2024-08-28T19:29:46.099661+0000","last_became_peered":"2024-08-28T19:29:46.099661+0000","last_unstale":"2024-08-28T19:30:27.548923+0000","last_undegraded":"2024-08-28T19:30:27.548923+0000","last_fullsized":"2024-08-28T19:30:27.548923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:27.430026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401786+0000","last_change":"2024-08-28T19:29:55.265983+0000","last_active":"2024-08-28T19:30:27.401786+0000","last_peered":"2024-08-28T19:30:27.401786+0000","last_clean":"2024-08-28T19:30:27.401786+0000","last_became_active":"2024-08-28T19:29:55.265464+0000","last_became_peered":"2024-08-28T19:29:55.265464+0000","last_unstale":"2024-08-28T19:30:27.401786+0000","last_undegraded":"2024-08-28T19:30:27.401786+0000","last_fullsized":"2024-08-28T19:30:27.401786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:21:42.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404711+0000","last_change":"2024-08-28T19:29:48.119545+0000","last_active":"2024-08-28T19:30:27.404711+0000","last_peered":"2024-08-28T19:30:27.404711+0000","last_clean":"2024-08-28T19:30:27.404711+0000","last_became_active":"2024-08-28T19:29:48.119128+0000","last_became_peered":"2024-08-28T19:29:48.119128+0000","last_unstale":"2024-08-28T19:30:27.404711+0000","last_undegraded":"2024-08-28T19:30:27.404711+0000","last_fullsized":"2024-08-28T19:30:27.404711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:05:31.535016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549131+0000","last_change":"2024-08-28T19:29:46.188962+0000","last_active":"2024-08-28T19:30:27.549131+0000","last_peered":"2024-08-28T19:30:27.549131+0000","last_clean":"2024-08-28T19:30:27.549131+0000","last_became_active":"2024-08-28T19:29:46.188510+0000","last_became_peered":"2024-08-28T19:29:46.188510+0000","last_unstale":"2024-08-28T19:30:27.549131+0000","last_undegraded":"2024-08-28T19:30:27.549131+0000","last_fullsized":"2024-08-28T19:30:27.549131+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:08.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402457+0000","last_change":"2024-08-28T19:29:55.573320+0000","last_active":"2024-08-28T19:30:27.402457+0000","last_peered":"2024-08-28T19:30:27.402457+0000","last_clean":"2024-08-28T19:30:27.402457+0000","last_became_active":"2024-08-28T19:29:55.572858+0000","last_became_peered":"2024-08-28T19:29:55.572858+0000","last_unstale":"2024-08-28T19:30:27.402457+0000","last_undegraded":"2024-08-28T19:30:27.402457+0000","last_fullsized":"2024-08-28T19:30:27.402457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:09:34.676911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405023+0000","last_change":"2024-08-28T19:30:27.404918+0000","last_active":"2024-08-28T19:30:27.405023+0000","last_peered":"2024-08-28T19:30:27.405023+0000","last_clean":"2024-08-28T19:30:27.405023+0000","last_became_active":"2024-08-28T19:30:27.404495+0000","last_became_peered":"2024-08-28T19:30:27.404495+0000","last_unstale":"2024-08-28T19:30:27.405023+0000","last_undegraded":"2024-08-28T19:30:27.405023+0000","last_fullsized":"2024-08-28T19:30:27.405023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:10:12.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402080+0000","last_change":"2024-08-28T19:29:46.110683+0000","last_active":"2024-08-28T19:30:27.402080+0000","last_peered":"2024-08-28T19:30:27.402080+0000","last_clean":"2024-08-28T19:30:27.402080+0000","last_became_active":"2024-08-28T19:29:46.110324+0000","last_became_peered":"2024-08-28T19:29:46.110324+0000","last_unstale":"2024-08-28T19:30:27.402080+0000","last_undegraded":"2024-08-28T19:30:27.402080+0000","last_fullsized":"2024-08-28T19:30:27.402080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:15:47.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398964+0000","last_change":"2024-08-28T19:29:55.271035+0000","last_active":"2024-08-28T19:30:27.398964+0000","last_peered":"2024-08-28T19:30:27.398964+0000","last_clean":"2024-08-28T19:30:27.398964+0000","last_became_active":"2024-08-28T19:29:55.268465+0000","last_became_peered":"2024-08-28T19:29:55.268465+0000","last_unstale":"2024-08-28T19:30:27.398964+0000","last_undegraded":"2024-08-28T19:30:27.398964+0000","last_fullsized":"2024-08-28T19:30:27.398964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:16:17.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548938+0000","last_change":"2024-08-28T19:29:48.127225+0000","last_active":"2024-08-28T19:30:27.548938+0000","last_peered":"2024-08-28T19:30:27.548938+0000","last_clean":"2024-08-28T19:30:27.548938+0000","last_became_active":"2024-08-28T19:29:48.126775+0000","last_became_peered":"2024-08-28T19:29:48.126775+0000","last_unstale":"2024-08-28T19:30:27.548938+0000","last_undegraded":"2024-08-28T19:30:27.548938+0000","last_fullsized":"2024-08-28T19:30:27.548938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:49:39.353082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:40.115047+0000","last_change":"2024-08-28T19:29:46.098076+0000","last_active":"2024-08-28T19:30:40.115047+0000","last_peered":"2024-08-28T19:30:40.115047+0000","last_clean":"2024-08-28T19:30:40.115047+0000","last_became_active":"2024-08-28T19:29:46.097726+0000","last_became_peered":"2024-08-28T19:29:46.097726+0000","last_unstale":"2024-08-28T19:30:40.115047+0000","last_undegraded":"2024-08-28T19:30:40.115047+0000","last_fullsized":"2024-08-28T19:30:40.115047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.624125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548224+0000","last_change":"2024-08-28T19:29:55.571830+0000","last_active":"2024-08-28T19:30:27.548224+0000","last_peered":"2024-08-28T19:30:27.548224+0000","last_clean":"2024-08-28T19:30:27.548224+0000","last_became_active":"2024-08-28T19:29:55.571318+0000","last_became_peered":"2024-08-28T19:29:55.571318+0000","last_unstale":"2024-08-28T19:30:27.548224+0000","last_undegraded":"2024-08-28T19:30:27.548224+0000","last_fullsized":"2024-08-28T19:30:27.548224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:41:03.397478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397059+0000","last_change":"2024-08-28T19:29:48.124998+0000","last_active":"2024-08-28T19:30:27.397059+0000","last_peered":"2024-08-28T19:30:27.397059+0000","last_clean":"2024-08-28T19:30:27.397059+0000","last_became_active":"2024-08-28T19:29:48.124600+0000","last_became_peered":"2024-08-28T19:29:48.124600+0000","last_unstale":"2024-08-28T19:30:27.397059+0000","last_undegraded":"2024-08-28T19:30:27.397059+0000","last_fullsized":"2024-08-28T19:30:27.397059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:50:59.459372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406363+0000","last_change":"2024-08-28T19:29:46.189455+0000","last_active":"2024-08-28T19:30:27.406363+0000","last_peered":"2024-08-28T19:30:27.406363+0000","last_clean":"2024-08-28T19:30:27.406363+0000","last_became_active":"2024-08-28T19:29:46.188640+0000","last_became_peered":"2024-08-28T19:29:46.188640+0000","last_unstale":"2024-08-28T19:30:27.406363+0000","last_undegraded":"2024-08-28T19:30:27.406363+0000","last_fullsized":"2024-08-28T19:30:27.406363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:05:32.561725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398095+0000","last_change":"2024-08-28T19:29:55.269726+0000","last_active":"2024-08-28T19:30:27.398095+0000","last_peered":"2024-08-28T19:30:27.398095+0000","last_clean":"2024-08-28T19:30:27.398095+0000","last_became_active":"2024-08-28T19:29:55.269261+0000","last_became_peered":"2024-08-28T19:29:55.269261+0000","last_unstale":"2024-08-28T19:30:27.398095+0000","last_undegraded":"2024-08-28T19:30:27.398095+0000","last_fullsized":"2024-08-28T19:30:27.398095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:05.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398331+0000","last_change":"2024-08-28T19:29:48.125251+0000","last_active":"2024-08-28T19:30:27.398331+0000","last_peered":"2024-08-28T19:30:27.398331+0000","last_clean":"2024-08-28T19:30:27.398331+0000","last_became_active":"2024-08-28T19:29:48.124818+0000","last_became_peered":"2024-08-28T19:29:48.124818+0000","last_unstale":"2024-08-28T19:30:27.398331+0000","last_undegraded":"2024-08-28T19:30:27.398331+0000","last_fullsized":"2024-08-28T19:30:27.398331+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:47:05.217199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401993+0000","last_change":"2024-08-28T19:29:46.189747+0000","last_active":"2024-08-28T19:30:27.401993+0000","last_peered":"2024-08-28T19:30:27.401993+0000","last_clean":"2024-08-28T19:30:27.401993+0000","last_became_active":"2024-08-28T19:29:46.189356+0000","last_became_peered":"2024-08-28T19:29:46.189356+0000","last_unstale":"2024-08-28T19:30:27.401993+0000","last_undegraded":"2024-08-28T19:30:27.401993+0000","last_fullsized":"2024-08-28T19:30:27.401993+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.629054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405026+0000","last_change":"2024-08-28T19:29:55.572746+0000","last_active":"2024-08-28T19:30:27.405026+0000","last_peered":"2024-08-28T19:30:27.405026+0000","last_clean":"2024-08-28T19:30:27.405026+0000","last_became_active":"2024-08-28T19:29:55.572246+0000","last_became_peered":"2024-08-28T19:29:55.572246+0000","last_unstale":"2024-08-28T19:30:27.405026+0000","last_undegraded":"2024-08-28T19:30:27.405026+0000","last_fullsized":"2024-08-28T19:30:27.405026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:48:23.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398559+0000","last_change":"2024-08-28T19:29:48.127579+0000","last_active":"2024-08-28T19:30:27.398559+0000","last_peered":"2024-08-28T19:30:27.398559+0000","last_clean":"2024-08-28T19:30:27.398559+0000","last_became_active":"2024-08-28T19:29:48.126978+0000","last_became_peered":"2024-08-28T19:29:48.126978+0000","last_unstale":"2024-08-28T19:30:27.398559+0000","last_undegraded":"2024-08-28T19:30:27.398559+0000","last_fullsized":"2024-08-28T19:30:27.398559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:27.657714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:38.448220+0000","last_change":"2024-08-28T19:29:46.102374+0000","last_active":"2024-08-28T19:30:38.448220+0000","last_peered":"2024-08-28T19:30:38.448220+0000","last_clean":"2024-08-28T19:30:38.448220+0000","last_became_active":"2024-08-28T19:29:46.101619+0000","last_became_peered":"2024-08-28T19:29:46.101619+0000","last_unstale":"2024-08-28T19:30:38.448220+0000","last_undegraded":"2024-08-28T19:30:38.448220+0000","last_fullsized":"2024-08-28T19:30:38.448220+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:46:21.353063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396841+0000","last_change":"2024-08-28T19:29:55.265403+0000","last_active":"2024-08-28T19:30:27.396841+0000","last_peered":"2024-08-28T19:30:27.396841+0000","last_clean":"2024-08-28T19:30:27.396841+0000","last_became_active":"2024-08-28T19:29:55.264979+0000","last_became_peered":"2024-08-28T19:29:55.264979+0000","last_unstale":"2024-08-28T19:30:27.396841+0000","last_undegraded":"2024-08-28T19:30:27.396841+0000","last_fullsized":"2024-08-28T19:30:27.396841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:18:18.623218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405723+0000","last_change":"2024-08-28T19:29:48.117437+0000","last_active":"2024-08-28T19:30:27.405723+0000","last_peered":"2024-08-28T19:30:27.405723+0000","last_clean":"2024-08-28T19:30:27.405723+0000","last_became_active":"2024-08-28T19:29:48.116379+0000","last_became_peered":"2024-08-28T19:29:48.116379+0000","last_unstale":"2024-08-28T19:30:27.405723+0000","last_undegraded":"2024-08-28T19:30:27.405723+0000","last_fullsized":"2024-08-28T19:30:27.405723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:23.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:41.451537+0000","last_change":"2024-08-28T19:29:46.188551+0000","last_active":"2024-08-28T19:30:41.451537+0000","last_peered":"2024-08-28T19:30:41.451537+0000","last_clean":"2024-08-28T19:30:41.451537+0000","last_became_active":"2024-08-28T19:29:46.188050+0000","last_became_peered":"2024-08-28T19:29:46.188050+0000","last_unstale":"2024-08-28T19:30:41.451537+0000","last_undegraded":"2024-08-28T19:30:41.451537+0000","last_fullsized":"2024-08-28T19:30:41.451537+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:07:21.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396915+0000","last_change":"2024-08-28T19:29:55.572013+0000","last_active":"2024-08-28T19:30:27.396915+0000","last_peered":"2024-08-28T19:30:27.396915+0000","last_clean":"2024-08-28T19:30:27.396915+0000","last_became_active":"2024-08-28T19:29:55.571503+0000","last_became_peered":"2024-08-28T19:29:55.571503+0000","last_unstale":"2024-08-28T19:30:27.396915+0000","last_undegraded":"2024-08-28T19:30:27.396915+0000","last_fullsized":"2024-08-28T19:30:27.396915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:40:21.669321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396418+0000","last_change":"2024-08-28T19:29:48.124646+0000","last_active":"2024-08-28T19:30:27.396418+0000","last_peered":"2024-08-28T19:30:27.396418+0000","last_clean":"2024-08-28T19:30:27.396418+0000","last_became_active":"2024-08-28T19:29:48.123062+0000","last_became_peered":"2024-08-28T19:29:48.123062+0000","last_unstale":"2024-08-28T19:30:27.396418+0000","last_undegraded":"2024-08-28T19:30:27.396418+0000","last_fullsized":"2024-08-28T19:30:27.396418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:16:03.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426530+0000","last_change":"2024-08-28T19:29:46.105979+0000","last_active":"2024-08-28T19:30:27.426530+0000","last_peered":"2024-08-28T19:30:27.426530+0000","last_clean":"2024-08-28T19:30:27.426530+0000","last_became_active":"2024-08-28T19:29:46.105558+0000","last_became_peered":"2024-08-28T19:29:46.105558+0000","last_unstale":"2024-08-28T19:30:27.426530+0000","last_undegraded":"2024-08-28T19:30:27.426530+0000","last_fullsized":"2024-08-28T19:30:27.426530+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:47.639236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.403694+0000","last_change":"2024-08-28T19:29:55.574025+0000","last_active":"2024-08-28T19:30:27.403694+0000","last_peered":"2024-08-28T19:30:27.403694+0000","last_clean":"2024-08-28T19:30:27.403694+0000","last_became_active":"2024-08-28T19:29:55.573380+0000","last_became_peered":"2024-08-28T19:29:55.573380+0000","last_unstale":"2024-08-28T19:30:27.403694+0000","last_undegraded":"2024-08-28T19:30:27.403694+0000","last_fullsized":"2024-08-28T19:30:27.403694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:19:05.287692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548592+0000","last_change":"2024-08-28T19:29:48.118606+0000","last_active":"2024-08-28T19:30:27.548592+0000","last_peered":"2024-08-28T19:30:27.548592+0000","last_clean":"2024-08-28T19:30:27.548592+0000","last_became_active":"2024-08-28T19:29:48.117534+0000","last_became_peered":"2024-08-28T19:29:48.117534+0000","last_unstale":"2024-08-28T19:30:27.548592+0000","last_undegraded":"2024-08-28T19:30:27.548592+0000","last_fullsized":"2024-08-28T19:30:27.548592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:34.253859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.422305+0000","last_change":"2024-08-28T19:29:46.100420+0000","last_active":"2024-08-28T19:30:27.422305+0000","last_peered":"2024-08-28T19:30:27.422305+0000","last_clean":"2024-08-28T19:30:27.422305+0000","last_became_active":"2024-08-28T19:29:46.099990+0000","last_became_peered":"2024-08-28T19:29:46.099990+0000","last_unstale":"2024-08-28T19:30:27.422305+0000","last_undegraded":"2024-08-28T19:30:27.422305+0000","last_fullsized":"2024-08-28T19:30:27.422305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:42:12.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426944+0000","last_change":"2024-08-28T19:28:32.822169+0000","last_active":"2024-08-28T19:30:27.426944+0000","last_peered":"2024-08-28T19:30:27.426944+0000","last_clean":"2024-08-28T19:30:27.426944+0000","last_became_active":"2024-08-28T19:28:32.816300+0000","last_became_peered":"2024-08-28T19:28:32.816300+0000","last_unstale":"2024-08-28T19:30:27.426944+0000","last_undegraded":"2024-08-28T19:30:27.426944+0000","last_fullsized":"2024-08-28T19:30:27.426944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_clean_scrub_stamp":"2024-08-28T19:25:14.491568+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:41:37.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427270+0000","last_change":"2024-08-28T19:29:55.265437+0000","last_active":"2024-08-28T19:30:27.427270+0000","last_peered":"2024-08-28T19:30:27.427270+0000","last_clean":"2024-08-28T19:30:27.427270+0000","last_became_active":"2024-08-28T19:29:55.264818+0000","last_became_peered":"2024-08-28T19:29:55.264818+0000","last_unstale":"2024-08-28T19:30:27.427270+0000","last_undegraded":"2024-08-28T19:30:27.427270+0000","last_fullsized":"2024-08-28T19:30:27.427270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:28:18.684362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427338+0000","last_change":"2024-08-28T19:29:48.135800+0000","last_active":"2024-08-28T19:30:27.427338+0000","last_peered":"2024-08-28T19:30:27.427338+0000","last_clean":"2024-08-28T19:30:27.427338+0000","last_became_active":"2024-08-28T19:29:48.135258+0000","last_became_peered":"2024-08-28T19:29:48.135258+0000","last_unstale":"2024-08-28T19:30:27.427338+0000","last_undegraded":"2024-08-28T19:30:27.427338+0000","last_fullsized":"2024-08-28T19:30:27.427338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:55.183190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:42.451273+0000","last_change":"2024-08-28T19:29:46.189298+0000","last_active":"2024-08-28T19:30:42.451273+0000","last_peered":"2024-08-28T19:30:42.451273+0000","last_clean":"2024-08-28T19:30:42.451273+0000","last_became_active":"2024-08-28T19:29:46.188813+0000","last_became_peered":"2024-08-28T19:29:46.188813+0000","last_unstale":"2024-08-28T19:30:42.451273+0000","last_undegraded":"2024-08-28T19:30:42.451273+0000","last_fullsized":"2024-08-28T19:30:42.451273+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:14:00.961682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548910+0000","last_change":"2024-08-28T19:29:55.269495+0000","last_active":"2024-08-28T19:30:27.548910+0000","last_peered":"2024-08-28T19:30:27.548910+0000","last_clean":"2024-08-28T19:30:27.548910+0000","last_became_active":"2024-08-28T19:29:55.268916+0000","last_became_peered":"2024-08-28T19:29:55.268916+0000","last_unstale":"2024-08-28T19:30:27.548910+0000","last_undegraded":"2024-08-28T19:30:27.548910+0000","last_fullsized":"2024-08-28T19:30:27.548910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:26:53.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426791+0000","last_change":"2024-08-28T19:29:48.127588+0000","last_active":"2024-08-28T19:30:27.426791+0000","last_peered":"2024-08-28T19:30:27.426791+0000","last_clean":"2024-08-28T19:30:27.426791+0000","last_became_active":"2024-08-28T19:29:48.127200+0000","last_became_peered":"2024-08-28T19:29:48.127200+0000","last_unstale":"2024-08-28T19:30:27.426791+0000","last_undegraded":"2024-08-28T19:30:27.426791+0000","last_fullsized":"2024-08-28T19:30:27.426791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:30:30.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404909+0000","last_change":"2024-08-28T19:29:46.101010+0000","last_active":"2024-08-28T19:30:27.404909+0000","last_peered":"2024-08-28T19:30:27.404909+0000","last_clean":"2024-08-28T19:30:27.404909+0000","last_became_active":"2024-08-28T19:29:46.100082+0000","last_became_peered":"2024-08-28T19:29:46.100082+0000","last_unstale":"2024-08-28T19:30:27.404909+0000","last_undegraded":"2024-08-28T19:30:27.404909+0000","last_fullsized":"2024-08-28T19:30:27.404909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:18:51.074343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.551852+0000","last_change":"2024-08-28T19:30:27.551743+0000","last_active":"2024-08-28T19:30:27.551852+0000","last_peered":"2024-08-28T19:30:27.551852+0000","last_clean":"2024-08-28T19:30:27.551852+0000","last_became_active":"2024-08-28T19:30:27.551249+0000","last_became_peered":"2024-08-28T19:30:27.551249+0000","last_unstale":"2024-08-28T19:30:27.551852+0000","last_undegraded":"2024-08-28T19:30:27.551852+0000","last_fullsized":"2024-08-28T19:30:27.551852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:35.043553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426736+0000","last_change":"2024-08-28T19:29:48.132429+0000","last_active":"2024-08-28T19:30:27.426736+0000","last_peered":"2024-08-28T19:30:27.426736+0000","last_clean":"2024-08-28T19:30:27.426736+0000","last_became_active":"2024-08-28T19:29:48.132020+0000","last_became_peered":"2024-08-28T19:29:48.132020+0000","last_unstale":"2024-08-28T19:30:27.426736+0000","last_undegraded":"2024-08-28T19:30:27.426736+0000","last_fullsized":"2024-08-28T19:30:27.426736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:45:11.992083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397065+0000","last_change":"2024-08-28T19:29:46.097245+0000","last_active":"2024-08-28T19:30:27.397065+0000","last_peered":"2024-08-28T19:30:27.397065+0000","last_clean":"2024-08-28T19:30:27.397065+0000","last_became_active":"2024-08-28T19:29:46.096867+0000","last_became_peered":"2024-08-28T19:29:46.096867+0000","last_unstale":"2024-08-28T19:30:27.397065+0000","last_undegraded":"2024-08-28T19:30:27.397065+0000","last_fullsized":"2024-08-28T19:30:27.397065+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:22:14.888597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405312+0000","last_change":"2024-08-28T19:29:55.265006+0000","last_active":"2024-08-28T19:30:27.405312+0000","last_peered":"2024-08-28T19:30:27.405312+0000","last_clean":"2024-08-28T19:30:27.405312+0000","last_became_active":"2024-08-28T19:29:55.264321+0000","last_became_peered":"2024-08-28T19:29:55.264321+0000","last_unstale":"2024-08-28T19:30:27.405312+0000","last_undegraded":"2024-08-28T19:30:27.405312+0000","last_fullsized":"2024-08-28T19:30:27.405312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:53:27.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398520+0000","last_change":"2024-08-28T19:29:48.120916+0000","last_active":"2024-08-28T19:30:27.398520+0000","last_peered":"2024-08-28T19:30:27.398520+0000","last_clean":"2024-08-28T19:30:27.398520+0000","last_became_active":"2024-08-28T19:29:48.120473+0000","last_became_peered":"2024-08-28T19:29:48.120473+0000","last_unstale":"2024-08-28T19:30:27.398520+0000","last_undegraded":"2024-08-28T19:30:27.398520+0000","last_fullsized":"2024-08-28T19:30:27.398520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:15.067237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405342+0000","last_change":"2024-08-28T19:29:46.103164+0000","last_active":"2024-08-28T19:30:27.405342+0000","last_peered":"2024-08-28T19:30:27.405342+0000","last_clean":"2024-08-28T19:30:27.405342+0000","last_became_active":"2024-08-28T19:29:46.101772+0000","last_became_peered":"2024-08-28T19:29:46.101772+0000","last_unstale":"2024-08-28T19:30:27.405342+0000","last_undegraded":"2024-08-28T19:30:27.405342+0000","last_fullsized":"2024-08-28T19:30:27.405342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:46:29.533552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550981+0000","last_change":"2024-08-28T19:30:27.550861+0000","last_active":"2024-08-28T19:30:27.550981+0000","last_peered":"2024-08-28T19:30:27.550981+0000","last_clean":"2024-08-28T19:30:27.550981+0000","last_became_active":"2024-08-28T19:30:27.550131+0000","last_became_peered":"2024-08-28T19:30:27.550131+0000","last_unstale":"2024-08-28T19:30:27.550981+0000","last_undegraded":"2024-08-28T19:30:27.550981+0000","last_fullsized":"2024-08-28T19:30:27.550981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:37:16.004222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.551596+0000","last_change":"2024-08-28T19:30:27.551445+0000","last_active":"2024-08-28T19:30:27.551596+0000","last_peered":"2024-08-28T19:30:27.551596+0000","last_clean":"2024-08-28T19:30:27.551596+0000","last_became_active":"2024-08-28T19:30:27.550927+0000","last_became_peered":"2024-08-28T19:30:27.550927+0000","last_unstale":"2024-08-28T19:30:27.551596+0000","last_undegraded":"2024-08-28T19:30:27.551596+0000","last_fullsized":"2024-08-28T19:30:27.551596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:52:56.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405028+0000","last_change":"2024-08-28T19:29:46.190191+0000","last_active":"2024-08-28T19:30:27.405028+0000","last_peered":"2024-08-28T19:30:27.405028+0000","last_clean":"2024-08-28T19:30:27.405028+0000","last_became_active":"2024-08-28T19:29:46.188143+0000","last_became_peered":"2024-08-28T19:29:46.188143+0000","last_unstale":"2024-08-28T19:30:27.405028+0000","last_undegraded":"2024-08-28T19:30:27.405028+0000","last_fullsized":"2024-08-28T19:30:27.405028+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:58:11.854449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397058+0000","last_change":"2024-08-28T19:29:55.266777+0000","last_active":"2024-08-28T19:30:27.397058+0000","last_peered":"2024-08-28T19:30:27.397058+0000","last_clean":"2024-08-28T19:30:27.397058+0000","last_became_active":"2024-08-28T19:29:55.266296+0000","last_became_peered":"2024-08-28T19:29:55.266296+0000","last_unstale":"2024-08-28T19:30:27.397058+0000","last_undegraded":"2024-08-28T19:30:27.397058+0000","last_fullsized":"2024-08-28T19:30:27.397058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:28:20.279522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426781+0000","last_change":"2024-08-28T19:29:48.129070+0000","last_active":"2024-08-28T19:30:27.426781+0000","last_peered":"2024-08-28T19:30:27.426781+0000","last_clean":"2024-08-28T19:30:27.426781+0000","last_became_active":"2024-08-28T19:29:48.128701+0000","last_became_peered":"2024-08-28T19:29:48.128701+0000","last_unstale":"2024-08-28T19:30:27.426781+0000","last_undegraded":"2024-08-28T19:30:27.426781+0000","last_fullsized":"2024-08-28T19:30:27.426781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:29:29.375379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:37.447212+0000","last_change":"2024-08-28T19:29:46.098281+0000","last_active":"2024-08-28T19:30:37.447212+0000","last_peered":"2024-08-28T19:30:37.447212+0000","last_clean":"2024-08-28T19:30:37.447212+0000","last_became_active":"2024-08-28T19:29:46.097870+0000","last_became_peered":"2024-08-28T19:29:46.097870+0000","last_unstale":"2024-08-28T19:30:37.447212+0000","last_undegraded":"2024-08-28T19:30:37.447212+0000","last_fullsized":"2024-08-28T19:30:37.447212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:24:09.693310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401852+0000","last_change":"2024-08-28T19:29:55.264883+0000","last_active":"2024-08-28T19:30:27.401852+0000","last_peered":"2024-08-28T19:30:27.401852+0000","last_clean":"2024-08-28T19:30:27.401852+0000","last_became_active":"2024-08-28T19:29:55.264392+0000","last_became_peered":"2024-08-28T19:29:55.264392+0000","last_unstale":"2024-08-28T19:30:27.401852+0000","last_undegraded":"2024-08-28T19:30:27.401852+0000","last_fullsized":"2024-08-28T19:30:27.401852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:34.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427027+0000","last_change":"2024-08-28T19:29:48.135499+0000","last_active":"2024-08-28T19:30:27.427027+0000","last_peered":"2024-08-28T19:30:27.427027+0000","last_clean":"2024-08-28T19:30:27.427027+0000","last_became_active":"2024-08-28T19:29:48.134934+0000","last_became_peered":"2024-08-28T19:29:48.134934+0000","last_unstale":"2024-08-28T19:30:27.427027+0000","last_undegraded":"2024-08-28T19:30:27.427027+0000","last_fullsized":"2024-08-28T19:30:27.427027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:57:01.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405099+0000","last_change":"2024-08-28T19:29:46.104680+0000","last_active":"2024-08-28T19:30:27.405099+0000","last_peered":"2024-08-28T19:30:27.405099+0000","last_clean":"2024-08-28T19:30:27.405099+0000","last_became_active":"2024-08-28T19:29:46.104290+0000","last_became_peered":"2024-08-28T19:29:46.104290+0000","last_unstale":"2024-08-28T19:30:27.405099+0000","last_undegraded":"2024-08-28T19:30:27.405099+0000","last_fullsized":"2024-08-28T19:30:27.405099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:39.789935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398105+0000","last_change":"2024-08-28T19:29:55.264676+0000","last_active":"2024-08-28T19:30:27.398105+0000","last_peered":"2024-08-28T19:30:27.398105+0000","last_clean":"2024-08-28T19:30:27.398105+0000","last_became_active":"2024-08-28T19:29:55.264206+0000","last_became_peered":"2024-08-28T19:29:55.264206+0000","last_unstale":"2024-08-28T19:30:27.398105+0000","last_undegraded":"2024-08-28T19:30:27.398105+0000","last_fullsized":"2024-08-28T19:30:27.398105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:58:15.776366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396618+0000","last_change":"2024-08-28T19:29:48.125092+0000","last_active":"2024-08-28T19:30:27.396618+0000","last_peered":"2024-08-28T19:30:27.396618+0000","last_clean":"2024-08-28T19:30:27.396618+0000","last_became_active":"2024-08-28T19:29:48.124711+0000","last_became_peered":"2024-08-28T19:29:48.124711+0000","last_unstale":"2024-08-28T19:30:27.396618+0000","last_undegraded":"2024-08-28T19:30:27.396618+0000","last_fullsized":"2024-08-28T19:30:27.396618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:17:27.806368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.422015+0000","last_change":"2024-08-28T19:29:46.100546+0000","last_active":"2024-08-28T19:30:27.422015+0000","last_peered":"2024-08-28T19:30:27.422015+0000","last_clean":"2024-08-28T19:30:27.422015+0000","last_became_active":"2024-08-28T19:29:46.100043+0000","last_became_peered":"2024-08-28T19:29:46.100043+0000","last_unstale":"2024-08-28T19:30:27.422015+0000","last_undegraded":"2024-08-28T19:30:27.422015+0000","last_fullsized":"2024-08-28T19:30:27.422015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:41:32.488258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404480+0000","last_change":"2024-08-28T19:29:55.265497+0000","last_active":"2024-08-28T19:30:27.404480+0000","last_peered":"2024-08-28T19:30:27.404480+0000","last_clean":"2024-08-28T19:30:27.404480+0000","last_became_active":"2024-08-28T19:29:55.264499+0000","last_became_peered":"2024-08-28T19:29:55.264499+0000","last_unstale":"2024-08-28T19:30:27.404480+0000","last_undegraded":"2024-08-28T19:30:27.404480+0000","last_fullsized":"2024-08-28T19:30:27.404480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:04:15.192307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405999+0000","last_change":"2024-08-28T19:29:48.133948+0000","last_active":"2024-08-28T19:30:27.405999+0000","last_peered":"2024-08-28T19:30:27.405999+0000","last_clean":"2024-08-28T19:30:27.405999+0000","last_became_active":"2024-08-28T19:29:48.133517+0000","last_became_peered":"2024-08-28T19:29:48.133517+0000","last_unstale":"2024-08-28T19:30:27.405999+0000","last_undegraded":"2024-08-28T19:30:27.405999+0000","last_fullsized":"2024-08-28T19:30:27.405999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:43:20.049931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:42.451385+0000","last_change":"2024-08-28T19:29:46.104744+0000","last_active":"2024-08-28T19:30:42.451385+0000","last_peered":"2024-08-28T19:30:42.451385+0000","last_clean":"2024-08-28T19:30:42.451385+0000","last_became_active":"2024-08-28T19:29:46.104278+0000","last_became_peered":"2024-08-28T19:29:46.104278+0000","last_unstale":"2024-08-28T19:30:42.451385+0000","last_undegraded":"2024-08-28T19:30:42.451385+0000","last_fullsized":"2024-08-28T19:30:42.451385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:36.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56669,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":75,"num_write":33,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401456+0000","last_change":"2024-08-28T19:29:55.264892+0000","last_active":"2024-08-28T19:30:27.401456+0000","last_peered":"2024-08-28T19:30:27.401456+0000","last_clean":"2024-08-28T19:30:27.401456+0000","last_became_active":"2024-08-28T19:29:55.264466+0000","last_became_peered":"2024-08-28T19:29:55.264466+0000","last_unstale":"2024-08-28T19:30:27.401456+0000","last_undegraded":"2024-08-28T19:30:27.401456+0000","last_fullsized":"2024-08-28T19:30:27.401456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:34:51.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549875+0000","last_change":"2024-08-28T19:29:48.121692+0000","last_active":"2024-08-28T19:30:27.549875+0000","last_peered":"2024-08-28T19:30:27.549875+0000","last_clean":"2024-08-28T19:30:27.549875+0000","last_became_active":"2024-08-28T19:29:48.121274+0000","last_became_peered":"2024-08-28T19:29:48.121274+0000","last_unstale":"2024-08-28T19:30:27.549875+0000","last_undegraded":"2024-08-28T19:30:27.549875+0000","last_fullsized":"2024-08-28T19:30:27.549875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:00:36.227609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404771+0000","last_change":"2024-08-28T19:29:46.188981+0000","last_active":"2024-08-28T19:30:27.404771+0000","last_peered":"2024-08-28T19:30:27.404771+0000","last_clean":"2024-08-28T19:30:27.404771+0000","last_became_active":"2024-08-28T19:29:46.188496+0000","last_became_peered":"2024-08-28T19:29:46.188496+0000","last_unstale":"2024-08-28T19:30:27.404771+0000","last_undegraded":"2024-08-28T19:30:27.404771+0000","last_fullsized":"2024-08-28T19:30:27.404771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.689602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.552176+0000","last_change":"2024-08-28T19:30:27.552006+0000","last_active":"2024-08-28T19:30:27.552176+0000","last_peered":"2024-08-28T19:30:27.552176+0000","last_clean":"2024-08-28T19:30:27.552176+0000","last_became_active":"2024-08-28T19:30:27.551356+0000","last_became_peered":"2024-08-28T19:30:27.551356+0000","last_unstale":"2024-08-28T19:30:27.552176+0000","last_undegraded":"2024-08-28T19:30:27.552176+0000","last_fullsized":"2024-08-28T19:30:27.552176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:56:09.242401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402115+0000","last_change":"2024-08-28T19:29:48.116964+0000","last_active":"2024-08-28T19:30:27.402115+0000","last_peered":"2024-08-28T19:30:27.402115+0000","last_clean":"2024-08-28T19:30:27.402115+0000","last_became_active":"2024-08-28T19:29:48.116588+0000","last_became_peered":"2024-08-28T19:29:48.116588+0000","last_unstale":"2024-08-28T19:30:27.402115+0000","last_undegraded":"2024-08-28T19:30:27.402115+0000","last_fullsized":"2024-08-28T19:30:27.402115+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:52:02.486724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427086+0000","last_change":"2024-08-28T19:29:46.104132+0000","last_active":"2024-08-28T19:30:27.427086+0000","last_peered":"2024-08-28T19:30:27.427086+0000","last_clean":"2024-08-28T19:30:27.427086+0000","last_became_active":"2024-08-28T19:29:46.103725+0000","last_became_peered":"2024-08-28T19:29:46.103725+0000","last_unstale":"2024-08-28T19:30:27.427086+0000","last_undegraded":"2024-08-28T19:30:27.427086+0000","last_fullsized":"2024-08-28T19:30:27.427086+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:50:12.859989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400571+0000","last_change":"2024-08-28T19:29:55.265494+0000","last_active":"2024-08-28T19:30:27.400571+0000","last_peered":"2024-08-28T19:30:27.400571+0000","last_clean":"2024-08-28T19:30:27.400571+0000","last_became_active":"2024-08-28T19:29:55.265087+0000","last_became_peered":"2024-08-28T19:29:55.265087+0000","last_unstale":"2024-08-28T19:30:27.400571+0000","last_undegraded":"2024-08-28T19:30:27.400571+0000","last_fullsized":"2024-08-28T19:30:27.400571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:51:18.676889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550159+0000","last_change":"2024-08-28T19:29:48.127419+0000","last_active":"2024-08-28T19:30:27.550159+0000","last_peered":"2024-08-28T19:30:27.550159+0000","last_clean":"2024-08-28T19:30:27.550159+0000","last_became_active":"2024-08-28T19:29:48.126997+0000","last_became_peered":"2024-08-28T19:29:48.126997+0000","last_unstale":"2024-08-28T19:30:27.550159+0000","last_undegraded":"2024-08-28T19:30:27.550159+0000","last_fullsized":"2024-08-28T19:30:27.550159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:26:08.208724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:42.450596+0000","last_change":"2024-08-28T19:29:46.103451+0000","last_active":"2024-08-28T19:30:42.450596+0000","last_peered":"2024-08-28T19:30:42.450596+0000","last_clean":"2024-08-28T19:30:42.450596+0000","last_became_active":"2024-08-28T19:29:46.102991+0000","last_became_peered":"2024-08-28T19:29:46.102991+0000","last_unstale":"2024-08-28T19:30:42.450596+0000","last_undegraded":"2024-08-28T19:30:42.450596+0000","last_fullsized":"2024-08-28T19:30:42.450596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:55:58.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548556+0000","last_change":"2024-08-28T19:29:55.269310+0000","last_active":"2024-08-28T19:30:27.548556+0000","last_peered":"2024-08-28T19:30:27.548556+0000","last_clean":"2024-08-28T19:30:27.548556+0000","last_became_active":"2024-08-28T19:29:55.268893+0000","last_became_peered":"2024-08-28T19:29:55.268893+0000","last_unstale":"2024-08-28T19:30:27.548556+0000","last_undegraded":"2024-08-28T19:30:27.548556+0000","last_fullsized":"2024-08-28T19:30:27.548556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:26:11.598773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400992+0000","last_change":"2024-08-28T19:29:55.261757+0000","last_active":"2024-08-28T19:30:27.400992+0000","last_peered":"2024-08-28T19:30:27.400992+0000","last_clean":"2024-08-28T19:30:27.400992+0000","last_became_active":"2024-08-28T19:29:55.261339+0000","last_became_peered":"2024-08-28T19:29:55.261339+0000","last_unstale":"2024-08-28T19:30:27.400992+0000","last_undegraded":"2024-08-28T19:30:27.400992+0000","last_fullsized":"2024-08-28T19:30:27.400992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:25:06.223029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401567+0000","last_change":"2024-08-28T19:29:48.123097+0000","last_active":"2024-08-28T19:30:27.401567+0000","last_peered":"2024-08-28T19:30:27.401567+0000","last_clean":"2024-08-28T19:30:27.401567+0000","last_became_active":"2024-08-28T19:29:48.122718+0000","last_became_peered":"2024-08-28T19:29:48.122718+0000","last_unstale":"2024-08-28T19:30:27.401567+0000","last_undegraded":"2024-08-28T19:30:27.401567+0000","last_fullsized":"2024-08-28T19:30:27.401567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:19.530985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406031+0000","last_change":"2024-08-28T19:29:46.105516+0000","last_active":"2024-08-28T19:30:27.406031+0000","last_peered":"2024-08-28T19:30:27.406031+0000","last_clean":"2024-08-28T19:30:27.406031+0000","last_became_active":"2024-08-28T19:29:46.105030+0000","last_became_peered":"2024-08-28T19:29:46.105030+0000","last_unstale":"2024-08-28T19:30:27.406031+0000","last_undegraded":"2024-08-28T19:30:27.406031+0000","last_fullsized":"2024-08-28T19:30:27.406031+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:47:02.032933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398485+0000","last_change":"2024-08-28T19:29:55.269759+0000","last_active":"2024-08-28T19:30:27.398485+0000","last_peered":"2024-08-28T19:30:27.398485+0000","last_clean":"2024-08-28T19:30:27.398485+0000","last_became_active":"2024-08-28T19:29:55.269275+0000","last_became_peered":"2024-08-28T19:29:55.269275+0000","last_unstale":"2024-08-28T19:30:27.398485+0000","last_undegraded":"2024-08-28T19:30:27.398485+0000","last_fullsized":"2024-08-28T19:30:27.398485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:45.870468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548611+0000","last_change":"2024-08-28T19:29:48.117400+0000","last_active":"2024-08-28T19:30:27.548611+0000","last_peered":"2024-08-28T19:30:27.548611+0000","last_clean":"2024-08-28T19:30:27.548611+0000","last_became_active":"2024-08-28T19:29:48.116987+0000","last_became_peered":"2024-08-28T19:29:48.116987+0000","last_unstale":"2024-08-28T19:30:27.548611+0000","last_undegraded":"2024-08-28T19:30:27.548611+0000","last_fullsized":"2024-08-28T19:30:27.548611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:43.822088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396426+0000","last_change":"2024-08-28T19:29:46.096103+0000","last_active":"2024-08-28T19:30:27.396426+0000","last_peered":"2024-08-28T19:30:27.396426+0000","last_clean":"2024-08-28T19:30:27.396426+0000","last_became_active":"2024-08-28T19:29:46.095812+0000","last_became_peered":"2024-08-28T19:29:46.095812+0000","last_unstale":"2024-08-28T19:30:27.396426+0000","last_undegraded":"2024-08-28T19:30:27.396426+0000","last_fullsized":"2024-08-28T19:30:27.396426+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:29.266636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398448+0000","last_change":"2024-08-28T19:29:46.106227+0000","last_active":"2024-08-28T19:30:27.398448+0000","last_peered":"2024-08-28T19:30:27.398448+0000","last_clean":"2024-08-28T19:30:27.398448+0000","last_became_active":"2024-08-28T19:29:46.105777+0000","last_became_peered":"2024-08-28T19:29:46.105777+0000","last_unstale":"2024-08-28T19:30:27.398448+0000","last_undegraded":"2024-08-28T19:30:27.398448+0000","last_fullsized":"2024-08-28T19:30:27.398448+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:26:14.815646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406013+0000","last_change":"2024-08-28T19:29:48.111051+0000","last_active":"2024-08-28T19:30:27.406013+0000","last_peered":"2024-08-28T19:30:27.406013+0000","last_clean":"2024-08-28T19:30:27.406013+0000","last_became_active":"2024-08-28T19:29:48.110421+0000","last_became_peered":"2024-08-28T19:29:48.110421+0000","last_unstale":"2024-08-28T19:30:27.406013+0000","last_undegraded":"2024-08-28T19:30:27.406013+0000","last_fullsized":"2024-08-28T19:30:27.406013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:19:47.765977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.408956+0000","last_change":"2024-08-28T19:30:27.408829+0000","last_active":"2024-08-28T19:30:27.408956+0000","last_peered":"2024-08-28T19:30:27.408956+0000","last_clean":"2024-08-28T19:30:27.408956+0000","last_became_active":"2024-08-28T19:30:27.408298+0000","last_became_peered":"2024-08-28T19:30:27.408298+0000","last_unstale":"2024-08-28T19:30:27.408956+0000","last_undegraded":"2024-08-28T19:30:27.408956+0000","last_fullsized":"2024-08-28T19:30:27.408956+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:38:58.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:41.449694+0000","last_change":"2024-08-28T19:29:46.102607+0000","last_active":"2024-08-28T19:30:41.449694+0000","last_peered":"2024-08-28T19:30:41.449694+0000","last_clean":"2024-08-28T19:30:41.449694+0000","last_became_active":"2024-08-28T19:29:46.102150+0000","last_became_peered":"2024-08-28T19:29:46.102150+0000","last_unstale":"2024-08-28T19:30:41.449694+0000","last_undegraded":"2024-08-28T19:30:41.449694+0000","last_fullsized":"2024-08-28T19:30:41.449694+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:44.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405319+0000","last_change":"2024-08-28T19:29:48.121598+0000","last_active":"2024-08-28T19:30:27.405319+0000","last_peered":"2024-08-28T19:30:27.405319+0000","last_clean":"2024-08-28T19:30:27.405319+0000","last_became_active":"2024-08-28T19:29:48.121189+0000","last_became_peered":"2024-08-28T19:29:48.121189+0000","last_unstale":"2024-08-28T19:30:27.405319+0000","last_undegraded":"2024-08-28T19:30:27.405319+0000","last_fullsized":"2024-08-28T19:30:27.405319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:19:35.496859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399556+0000","last_change":"2024-08-28T19:29:55.269648+0000","last_active":"2024-08-28T19:30:27.399556+0000","last_peered":"2024-08-28T19:30:27.399556+0000","last_clean":"2024-08-28T19:30:27.399556+0000","last_became_active":"2024-08-28T19:29:55.269182+0000","last_became_peered":"2024-08-28T19:29:55.269182+0000","last_unstale":"2024-08-28T19:30:27.399556+0000","last_undegraded":"2024-08-28T19:30:27.399556+0000","last_fullsized":"2024-08-28T19:30:27.399556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:09:47.581907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397999+0000","last_change":"2024-08-28T19:29:48.117143+0000","last_active":"2024-08-28T19:30:27.397999+0000","last_peered":"2024-08-28T19:30:27.397999+0000","last_clean":"2024-08-28T19:30:27.397999+0000","last_became_active":"2024-08-28T19:29:48.116756+0000","last_became_peered":"2024-08-28T19:29:48.116756+0000","last_unstale":"2024-08-28T19:30:27.397999+0000","last_undegraded":"2024-08-28T19:30:27.397999+0000","last_fullsized":"2024-08-28T19:30:27.397999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:03:30.736872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.407341+0000","last_change":"2024-08-28T19:30:27.407218+0000","last_active":"2024-08-28T19:30:27.407341+0000","last_peered":"2024-08-28T19:30:27.407341+0000","last_clean":"2024-08-28T19:30:27.407341+0000","last_became_active":"2024-08-28T19:30:27.406769+0000","last_became_peered":"2024-08-28T19:30:27.406769+0000","last_unstale":"2024-08-28T19:30:27.407341+0000","last_undegraded":"2024-08-28T19:30:27.407341+0000","last_fullsized":"2024-08-28T19:30:27.407341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:59.946922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399195+0000","last_change":"2024-08-28T19:29:48.123969+0000","last_active":"2024-08-28T19:30:27.399195+0000","last_peered":"2024-08-28T19:30:27.399195+0000","last_clean":"2024-08-28T19:30:27.399195+0000","last_became_active":"2024-08-28T19:29:48.122534+0000","last_became_peered":"2024-08-28T19:29:48.122534+0000","last_unstale":"2024-08-28T19:30:27.399195+0000","last_undegraded":"2024-08-28T19:30:27.399195+0000","last_fullsized":"2024-08-28T19:30:27.399195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:33:56.739763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401200+0000","last_change":"2024-08-28T19:29:48.108976+0000","last_active":"2024-08-28T19:30:27.401200+0000","last_peered":"2024-08-28T19:30:27.401200+0000","last_clean":"2024-08-28T19:30:27.401200+0000","last_became_active":"2024-08-28T19:29:48.108631+0000","last_became_peered":"2024-08-28T19:29:48.108631+0000","last_unstale":"2024-08-28T19:30:27.401200+0000","last_undegraded":"2024-08-28T19:30:27.401200+0000","last_fullsized":"2024-08-28T19:30:27.401200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:08:59.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396988+0000","last_change":"2024-08-28T19:29:48.109875+0000","last_active":"2024-08-28T19:30:27.396988+0000","last_peered":"2024-08-28T19:30:27.396988+0000","last_clean":"2024-08-28T19:30:27.396988+0000","last_became_active":"2024-08-28T19:29:48.109486+0000","last_became_peered":"2024-08-28T19:29:48.109486+0000","last_unstale":"2024-08-28T19:30:27.396988+0000","last_undegraded":"2024-08-28T19:30:27.396988+0000","last_fullsized":"2024-08-28T19:30:27.396988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:02:28.365203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398509+0000","last_change":"2024-08-28T19:29:48.117237+0000","last_active":"2024-08-28T19:30:27.398509+0000","last_peered":"2024-08-28T19:30:27.398509+0000","last_clean":"2024-08-28T19:30:27.398509+0000","last_became_active":"2024-08-28T19:29:48.116799+0000","last_became_peered":"2024-08-28T19:29:48.116799+0000","last_unstale":"2024-08-28T19:30:27.398509+0000","last_undegraded":"2024-08-28T19:30:27.398509+0000","last_fullsized":"2024-08-28T19:30:27.398509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:48:12.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400269+0000","last_change":"2024-08-28T19:29:48.120522+0000","last_active":"2024-08-28T19:30:27.400269+0000","last_peered":"2024-08-28T19:30:27.400269+0000","last_clean":"2024-08-28T19:30:27.400269+0000","last_became_active":"2024-08-28T19:29:48.120150+0000","last_became_peered":"2024-08-28T19:29:48.120150+0000","last_unstale":"2024-08-28T19:30:27.400269+0000","last_undegraded":"2024-08-28T19:30:27.400269+0000","last_fullsized":"2024-08-28T19:30:27.400269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:01:00.210596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548881+0000","last_change":"2024-08-28T19:29:48.128451+0000","last_active":"2024-08-28T19:30:27.548881+0000","last_peered":"2024-08-28T19:30:27.548881+0000","last_clean":"2024-08-28T19:30:27.548881+0000","last_became_active":"2024-08-28T19:29:48.127898+0000","last_became_peered":"2024-08-28T19:29:48.127898+0000","last_unstale":"2024-08-28T19:30:27.548881+0000","last_undegraded":"2024-08-28T19:30:27.548881+0000","last_fullsized":"2024-08-28T19:30:27.548881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:48.663999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405596+0000","last_change":"2024-08-28T19:29:48.110788+0000","last_active":"2024-08-28T19:30:27.405596+0000","last_peered":"2024-08-28T19:30:27.405596+0000","last_clean":"2024-08-28T19:30:27.405596+0000","last_became_active":"2024-08-28T19:29:48.110355+0000","last_became_peered":"2024-08-28T19:29:48.110355+0000","last_unstale":"2024-08-28T19:30:27.405596+0000","last_undegraded":"2024-08-28T19:30:27.405596+0000","last_fullsized":"2024-08-28T19:30:27.405596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:57:25.345283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548733+0000","last_change":"2024-08-28T19:29:48.129667+0000","last_active":"2024-08-28T19:30:27.548733+0000","last_peered":"2024-08-28T19:30:27.548733+0000","last_clean":"2024-08-28T19:30:27.548733+0000","last_became_active":"2024-08-28T19:29:48.128237+0000","last_became_peered":"2024-08-28T19:29:48.128237+0000","last_unstale":"2024-08-28T19:30:27.548733+0000","last_undegraded":"2024-08-28T19:30:27.548733+0000","last_fullsized":"2024-08-28T19:30:27.548733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:23:35.920353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549184+0000","last_change":"2024-08-28T19:29:48.136070+0000","last_active":"2024-08-28T19:30:27.549184+0000","last_peered":"2024-08-28T19:30:27.549184+0000","last_clean":"2024-08-28T19:30:27.549184+0000","last_became_active":"2024-08-28T19:29:48.135515+0000","last_became_peered":"2024-08-28T19:29:48.135515+0000","last_unstale":"2024-08-28T19:30:27.549184+0000","last_undegraded":"2024-08-28T19:30:27.549184+0000","last_fullsized":"2024-08-28T19:30:27.549184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:25:29.267753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396768+0000","last_change":"2024-08-28T19:29:48.128614+0000","last_active":"2024-08-28T19:30:27.396768+0000","last_peered":"2024-08-28T19:30:27.396768+0000","last_clean":"2024-08-28T19:30:27.396768+0000","last_became_active":"2024-08-28T19:29:48.128231+0000","last_became_peered":"2024-08-28T19:29:48.128231+0000","last_unstale":"2024-08-28T19:30:27.396768+0000","last_undegraded":"2024-08-28T19:30:27.396768+0000","last_fullsized":"2024-08-28T19:30:27.396768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:11:08.541435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398204+0000","last_change":"2024-08-28T19:29:48.114930+0000","last_active":"2024-08-28T19:30:27.398204+0000","last_peered":"2024-08-28T19:30:27.398204+0000","last_clean":"2024-08-28T19:30:27.398204+0000","last_became_active":"2024-08-28T19:29:48.114389+0000","last_became_peered":"2024-08-28T19:29:48.114389+0000","last_unstale":"2024-08-28T19:30:27.398204+0000","last_undegraded":"2024-08-28T19:30:27.398204+0000","last_fullsized":"2024-08-28T19:30:27.398204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:51.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400101+0000","last_change":"2024-08-28T19:29:48.125031+0000","last_active":"2024-08-28T19:30:27.400101+0000","last_peered":"2024-08-28T19:30:27.400101+0000","last_clean":"2024-08-28T19:30:27.400101+0000","last_became_active":"2024-08-28T19:29:48.124417+0000","last_became_peered":"2024-08-28T19:29:48.124417+0000","last_unstale":"2024-08-28T19:30:27.400101+0000","last_undegraded":"2024-08-28T19:30:27.400101+0000","last_fullsized":"2024-08-28T19:30:27.400101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:33:33.931496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401136+0000","last_change":"2024-08-28T19:29:48.127815+0000","last_active":"2024-08-28T19:30:27.401136+0000","last_peered":"2024-08-28T19:30:27.401136+0000","last_clean":"2024-08-28T19:30:27.401136+0000","last_became_active":"2024-08-28T19:29:48.127455+0000","last_became_peered":"2024-08-28T19:29:48.127455+0000","last_unstale":"2024-08-28T19:30:27.401136+0000","last_undegraded":"2024-08-28T19:30:27.401136+0000","last_fullsized":"2024-08-28T19:30:27.401136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:47:23.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398765+0000","last_change":"2024-08-28T19:29:48.122105+0000","last_active":"2024-08-28T19:30:27.398765+0000","last_peered":"2024-08-28T19:30:27.398765+0000","last_clean":"2024-08-28T19:30:27.398765+0000","last_became_active":"2024-08-28T19:29:48.121546+0000","last_became_peered":"2024-08-28T19:29:48.121546+0000","last_unstale":"2024-08-28T19:30:27.398765+0000","last_undegraded":"2024-08-28T19:30:27.398765+0000","last_fullsized":"2024-08-28T19:30:27.398765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:21:00.428052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548837+0000","last_change":"2024-08-28T19:29:48.136198+0000","last_active":"2024-08-28T19:30:27.548837+0000","last_peered":"2024-08-28T19:30:27.548837+0000","last_clean":"2024-08-28T19:30:27.548837+0000","last_became_active":"2024-08-28T19:29:48.135796+0000","last_became_peered":"2024-08-28T19:29:48.135796+0000","last_unstale":"2024-08-28T19:30:27.548837+0000","last_undegraded":"2024-08-28T19:30:27.548837+0000","last_fullsized":"2024-08-28T19:30:27.548837+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:05.033399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400902+0000","last_change":"2024-08-28T19:29:48.121245+0000","last_active":"2024-08-28T19:30:27.400902+0000","last_peered":"2024-08-28T19:30:27.400902+0000","last_clean":"2024-08-28T19:30:27.400902+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:30:27.400902+0000","last_undegraded":"2024-08-28T19:30:27.400902+0000","last_fullsized":"2024-08-28T19:30:27.400902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:39.936209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400752+0000","last_change":"2024-08-28T19:29:48.119198+0000","last_active":"2024-08-28T19:30:27.400752+0000","last_peered":"2024-08-28T19:30:27.400752+0000","last_clean":"2024-08-28T19:30:27.400752+0000","last_became_active":"2024-08-28T19:29:48.118744+0000","last_became_peered":"2024-08-28T19:29:48.118744+0000","last_unstale":"2024-08-28T19:30:27.400752+0000","last_undegraded":"2024-08-28T19:30:27.400752+0000","last_fullsized":"2024-08-28T19:30:27.400752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:15:35.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.403903+0000","last_change":"2024-08-28T19:30:27.403790+0000","last_active":"2024-08-28T19:30:27.403903+0000","last_peered":"2024-08-28T19:30:27.403903+0000","last_clean":"2024-08-28T19:30:27.403903+0000","last_became_active":"2024-08-28T19:30:27.403279+0000","last_became_peered":"2024-08-28T19:30:27.403279+0000","last_unstale":"2024-08-28T19:30:27.403903+0000","last_undegraded":"2024-08-28T19:30:27.403903+0000","last_fullsized":"2024-08-28T19:30:27.403903+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:31:54.137839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405819+0000","last_change":"2024-08-28T19:30:27.405173+0000","last_active":"2024-08-28T19:30:27.405819+0000","last_peered":"2024-08-28T19:30:27.405819+0000","last_clean":"2024-08-28T19:30:27.405819+0000","last_became_active":"2024-08-28T19:30:27.404752+0000","last_became_peered":"2024-08-28T19:30:27.404752+0000","last_unstale":"2024-08-28T19:30:27.405819+0000","last_undegraded":"2024-08-28T19:30:27.405819+0000","last_fullsized":"2024-08-28T19:30:27.405819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:16.544309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427239+0000","last_change":"2024-08-28T19:29:48.136738+0000","last_active":"2024-08-28T19:30:27.427239+0000","last_peered":"2024-08-28T19:30:27.427239+0000","last_clean":"2024-08-28T19:30:27.427239+0000","last_became_active":"2024-08-28T19:29:48.136046+0000","last_became_peered":"2024-08-28T19:29:48.136046+0000","last_unstale":"2024-08-28T19:30:27.427239+0000","last_undegraded":"2024-08-28T19:30:27.427239+0000","last_fullsized":"2024-08-28T19:30:27.427239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:43:32.905933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398789+0000","last_change":"2024-08-28T19:29:48.127432+0000","last_active":"2024-08-28T19:30:27.398789+0000","last_peered":"2024-08-28T19:30:27.398789+0000","last_clean":"2024-08-28T19:30:27.398789+0000","last_became_active":"2024-08-28T19:29:48.126067+0000","last_became_peered":"2024-08-28T19:29:48.126067+0000","last_unstale":"2024-08-28T19:30:27.398789+0000","last_undegraded":"2024-08-28T19:30:27.398789+0000","last_fullsized":"2024-08-28T19:30:27.398789+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:30:05.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550430+0000","last_change":"2024-08-28T19:29:48.121154+0000","last_active":"2024-08-28T19:30:27.550430+0000","last_peered":"2024-08-28T19:30:27.550430+0000","last_clean":"2024-08-28T19:30:27.550430+0000","last_became_active":"2024-08-28T19:29:48.120709+0000","last_became_peered":"2024-08-28T19:29:48.120709+0000","last_unstale":"2024-08-28T19:30:27.550430+0000","last_undegraded":"2024-08-28T19:30:27.550430+0000","last_fullsized":"2024-08-28T19:30:27.550430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:52.716814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548374+0000","last_change":"2024-08-28T19:29:48.127124+0000","last_active":"2024-08-28T19:30:27.548374+0000","last_peered":"2024-08-28T19:30:27.548374+0000","last_clean":"2024-08-28T19:30:27.548374+0000","last_became_active":"2024-08-28T19:29:48.126761+0000","last_became_peered":"2024-08-28T19:29:48.126761+0000","last_unstale":"2024-08-28T19:30:27.548374+0000","last_undegraded":"2024-08-28T19:30:27.548374+0000","last_fullsized":"2024-08-28T19:30:27.548374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:05:31.150472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426567+0000","last_change":"2024-08-28T19:29:48.132285+0000","last_active":"2024-08-28T19:30:27.426567+0000","last_peered":"2024-08-28T19:30:27.426567+0000","last_clean":"2024-08-28T19:30:27.426567+0000","last_became_active":"2024-08-28T19:29:48.131688+0000","last_became_peered":"2024-08-28T19:29:48.131688+0000","last_unstale":"2024-08-28T19:30:27.426567+0000","last_undegraded":"2024-08-28T19:30:27.426567+0000","last_fullsized":"2024-08-28T19:30:27.426567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:23:08.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398390+0000","last_change":"2024-08-28T19:29:48.126384+0000","last_active":"2024-08-28T19:30:27.398390+0000","last_peered":"2024-08-28T19:30:27.398390+0000","last_clean":"2024-08-28T19:30:27.398390+0000","last_became_active":"2024-08-28T19:29:48.125412+0000","last_became_peered":"2024-08-28T19:29:48.125412+0000","last_unstale":"2024-08-28T19:30:27.398390+0000","last_undegraded":"2024-08-28T19:30:27.398390+0000","last_fullsized":"2024-08-28T19:30:27.398390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:47:42.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404921+0000","last_change":"2024-08-28T19:29:48.114032+0000","last_active":"2024-08-28T19:30:27.404921+0000","last_peered":"2024-08-28T19:30:27.404921+0000","last_clean":"2024-08-28T19:30:27.404921+0000","last_became_active":"2024-08-28T19:29:48.113625+0000","last_became_peered":"2024-08-28T19:29:48.113625+0000","last_unstale":"2024-08-28T19:30:27.404921+0000","last_undegraded":"2024-08-28T19:30:27.404921+0000","last_fullsized":"2024-08-28T19:30:27.404921+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:07:08.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402005+0000","last_change":"2024-08-28T19:29:48.124046+0000","last_active":"2024-08-28T19:30:27.402005+0000","last_peered":"2024-08-28T19:30:27.402005+0000","last_clean":"2024-08-28T19:30:27.402005+0000","last_became_active":"2024-08-28T19:29:48.123647+0000","last_became_peered":"2024-08-28T19:29:48.123647+0000","last_unstale":"2024-08-28T19:30:27.402005+0000","last_undegraded":"2024-08-28T19:30:27.402005+0000","last_fullsized":"2024-08-28T19:30:27.402005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:59.262454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400906+0000","last_change":"2024-08-28T19:29:48.121258+0000","last_active":"2024-08-28T19:30:27.400906+0000","last_peered":"2024-08-28T19:30:27.400906+0000","last_clean":"2024-08-28T19:30:27.400906+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:30:27.400906+0000","last_undegraded":"2024-08-28T19:30:27.400906+0000","last_fullsized":"2024-08-28T19:30:27.400906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:37:05.610466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401108+0000","last_change":"2024-08-28T19:29:48.125071+0000","last_active":"2024-08-28T19:30:27.401108+0000","last_peered":"2024-08-28T19:30:27.401108+0000","last_clean":"2024-08-28T19:30:27.401108+0000","last_became_active":"2024-08-28T19:29:48.124706+0000","last_became_peered":"2024-08-28T19:29:48.124706+0000","last_unstale":"2024-08-28T19:30:27.401108+0000","last_undegraded":"2024-08-28T19:30:27.401108+0000","last_fullsized":"2024-08-28T19:30:27.401108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:39:06.460682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398708+0000","last_change":"2024-08-28T19:29:48.121905+0000","last_active":"2024-08-28T19:30:27.398708+0000","last_peered":"2024-08-28T19:30:27.398708+0000","last_clean":"2024-08-28T19:30:27.398708+0000","last_became_active":"2024-08-28T19:29:48.121045+0000","last_became_peered":"2024-08-28T19:29:48.121045+0000","last_unstale":"2024-08-28T19:30:27.398708+0000","last_undegraded":"2024-08-28T19:30:27.398708+0000","last_fullsized":"2024-08-28T19:30:27.398708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:56:58.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63873,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":193,"num_read_kb":171,"num_write":242,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":191619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246047,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":477263,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939676,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1120748,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103202,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":480898,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299431,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":477180,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495658,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1073677,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659185,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":913408,"data_stored":472306,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":995328,"data_stored":1068868,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018937,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":476771,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215166,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":472014,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":530616,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542217,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":530005,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705741,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":474153,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":58421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T19:30:44.745 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-28T19:30:44.746 INFO:tasks.cephadm:Setting up client nodes... 2024-08-28T19:30:44.746 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-28T19:30:44.774 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:44 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:30:44.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:44 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:30:45.659 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:45.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:45 smithi059 ceph-mon[22052]: pgmap v289: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 KiB/s wr, 15 op/s 2024-08-28T19:30:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:45 smithi059 ceph-mon[22052]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:30:45.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:45 smithi033 ceph-mon[18549]: pgmap v289: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 KiB/s wr, 15 op/s 2024-08-28T19:30:45.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:45 smithi033 ceph-mon[18549]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:30:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:45 smithi122 ceph-mon[22174]: pgmap v289: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 KiB/s wr, 15 op/s 2024-08-28T19:30:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:45 smithi122 ceph-mon[22174]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:30:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.243+0000 7f1491506640 1 -- 172.21.15.33:0/3514683665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f148c102820 msgr2=0x7f148c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.243+0000 7f1491506640 1 --2- 172.21.15.33:0/3514683665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f148c102820 0x7f148c102c30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f147c009900 tx=0x7f147c02a410 comp rx=0 tx=0).stop 2024-08-28T19:30:46.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.243+0000 7f1491506640 1 -- 172.21.15.33:0/3514683665 shutdown_connections 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.243+0000 7f1491506640 1 --2- 172.21.15.33:0/3514683665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f148c108bc0 0x7f148c10f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.243+0000 7f1491506640 1 --2- 172.21.15.33:0/3514683665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f148c108270 0x7f148c108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.243+0000 7f1491506640 1 --2- 172.21.15.33:0/3514683665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f148c102820 0x7f148c102c30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.243+0000 7f1491506640 1 -- 172.21.15.33:0/3514683665 >> 172.21.15.33:0/3514683665 conn(0x7f148c0794c0 msgr2=0x7f148c0798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.243+0000 7f1491506640 1 -- 172.21.15.33:0/3514683665 shutdown_connections 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.243+0000 7f1491506640 1 -- 172.21.15.33:0/3514683665 wait complete. 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f1491506640 1 Processor -- start 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f1491506640 1 -- start start 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f1491506640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f148c102820 0x7f148c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f1491506640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f148c108270 0x7f148c19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f1491506640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f148c108bc0 0x7f148c19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f1491506640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f148c112880 con 0x7f148c108270 2024-08-28T19:30:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f1491506640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f148c112700 con 0x7f148c108bc0 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f1491506640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f148c112a00 con 0x7f148c102820 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f148a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f148c108270 0x7f148c19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f148a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f148c108270 0x7f148c19a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41910/0 (socket says 172.21.15.33:41910) 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f148a7fc640 1 -- 172.21.15.33:0/3973612196 learned_addr learned my addr 172.21.15.33:0/3973612196 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.244+0000 7f148b7fe640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f148c108bc0 0x7f148c19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f148affd640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f148c102820 0x7f148c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f148a7fc640 1 -- 172.21.15.33:0/3973612196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f148c102820 msgr2=0x7f148c19a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f148a7fc640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f148c102820 0x7f148c19a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f148a7fc640 1 -- 172.21.15.33:0/3973612196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f148c108bc0 msgr2=0x7f148c19fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f148a7fc640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f148c108bc0 0x7f148c19fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f148a7fc640 1 -- 172.21.15.33:0/3973612196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c1a02d0 con 0x7f148c108270 2024-08-28T19:30:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f148affd640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f148c102820 0x7f148c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f148a7fc640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f148c108270 0x7f148c19a900 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f148000d740 tx=0x7f148000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f1473fff640 1 -- 172.21.15.33:0/3973612196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480017070 con 0x7f148c108270 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f1491506640 1 -- 172.21.15.33:0/3973612196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148c1a05c0 con 0x7f148c108270 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f1473fff640 1 -- 172.21.15.33:0/3973612196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f148000de50 con 0x7f148c108270 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f1473fff640 1 -- 172.21.15.33:0/3973612196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148000f620 con 0x7f148c108270 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.245+0000 7f1491506640 1 -- 172.21.15.33:0/3973612196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148c1a6d20 con 0x7f148c108270 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.246+0000 7f1491506640 1 -- 172.21.15.33:0/3973612196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f148c103aa0 con 0x7f148c108270 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.248+0000 7f1473fff640 1 -- 172.21.15.33:0/3973612196 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f148001a070 con 0x7f148c108270 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.248+0000 7f1473fff640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14740b4c10 0x7f14740b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.249+0000 7f148affd640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14740b4c10 0x7f14740b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.249+0000 7f1473fff640 1 -- 172.21.15.33:0/3973612196 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f14800e51a0 con 0x7f148c108270 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.249+0000 7f148affd640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14740b4c10 0x7f14740b7120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f147c031440 tx=0x7f147c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.252+0000 7f1473fff640 1 -- 172.21.15.33:0/3973612196 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f14800abce0 con 0x7f148c108270 2024-08-28T19:30:46.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.528+0000 7f1491506640 1 -- 172.21.15.33:0/3973612196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f148c10b9a0 con 0x7f148c108270 2024-08-28T19:30:46.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.534+0000 7f1473fff640 1 -- 172.21.15.33:0/3973612196 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f14800b4220 con 0x7f148c108270 2024-08-28T19:30:46.536 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-08-28T19:30:46.536 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDmes9mTh2nHxAARSjMzx4BKJLkJy490WxO3Q== 2024-08-28T19:30:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 -- 172.21.15.33:0/3973612196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14740b4c10 msgr2=0x7f14740b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14740b4c10 0x7f14740b7120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f147c031440 tx=0x7f147c009680 comp rx=0 tx=0).stop 2024-08-28T19:30:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 -- 172.21.15.33:0/3973612196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f148c108270 msgr2=0x7f148c19a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f148c108270 0x7f148c19a900 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f148000d740 tx=0x7f148000dc00 comp rx=0 tx=0).stop 2024-08-28T19:30:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 -- 172.21.15.33:0/3973612196 shutdown_connections 2024-08-28T19:30:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f148c108bc0 0x7f148c19fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f148c108270 0x7f148c19a900 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14740b4c10 0x7f14740b7120 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 --2- 172.21.15.33:0/3973612196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f148c102820 0x7f148c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 -- 172.21.15.33:0/3973612196 >> 172.21.15.33:0/3973612196 conn(0x7f148c0794c0 msgr2=0x7f148c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 -- 172.21.15.33:0/3973612196 shutdown_connections 2024-08-28T19:30:46.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:46.537+0000 7f1491506640 1 -- 172.21.15.33:0/3973612196 wait complete. 2024-08-28T19:30:46.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:46 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:46 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:46 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:46 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:46 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:46 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:46 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:46 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:46 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:46 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:46 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:46.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:46 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:47.244 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:30:47.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-28T19:30:47.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-28T19:30:47.281 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph config log 1 --format=json 2024-08-28T19:30:47.570 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:47 smithi059 ceph-mon[22052]: pgmap v290: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-08-28T19:30:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:47 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3973612196' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-28T19:30:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:47 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3973612196' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-28T19:30:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:30:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:30:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:47 smithi122 ceph-mon[22174]: pgmap v290: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-08-28T19:30:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:47 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3973612196' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-28T19:30:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:47 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3973612196' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-28T19:30:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:47.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:30:47.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:30:47.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:47.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:47 smithi033 ceph-mon[18549]: pgmap v290: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-08-28T19:30:47.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:47 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3973612196' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-28T19:30:47.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:47 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3973612196' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-28T19:30:47.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:47.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:47.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:30:47.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:30:47.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:30:48.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 -- 172.21.15.33:0/3808838107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f018c1069d0 msgr2=0x7f018c110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:48.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 --2- 172.21.15.33:0/3808838107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f018c1069d0 0x7f018c110420 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0184009ca0 tx=0x7f018402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:48.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 -- 172.21.15.33:0/3808838107 shutdown_connections 2024-08-28T19:30:48.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 --2- 172.21.15.33:0/3808838107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f018c1069d0 0x7f018c110420 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:48.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 --2- 172.21.15.33:0/3808838107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f018c106080 0x7f018c106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 --2- 172.21.15.33:0/3808838107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f018c101da0 0x7f018c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 -- 172.21.15.33:0/3808838107 >> 172.21.15.33:0/3808838107 conn(0x7f018c079be0 msgr2=0x7f018c079ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 -- 172.21.15.33:0/3808838107 shutdown_connections 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 -- 172.21.15.33:0/3808838107 wait complete. 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 Processor -- start 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.070+0000 7f0192f50640 1 -- start start 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f0192f50640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f018c101da0 0x7f018c19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f0192f50640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f018c106080 0x7f018c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f0192f50640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f018c1069d0 0x7f018c19f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f0192f50640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f018c113870 con 0x7f018c106080 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f0192f50640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f018c1136f0 con 0x7f018c1069d0 2024-08-28T19:30:48.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f0192f50640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f018c1139f0 con 0x7f018c101da0 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f018bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f018c106080 0x7f018c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f018bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f018c106080 0x7f018c19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41932/0 (socket says 172.21.15.33:41932) 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f018bfff640 1 -- 172.21.15.33:0/2112292547 learned_addr learned my addr 172.21.15.33:0/2112292547 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f0190cec640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f018c101da0 0x7f018c19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f01914ed640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f018c1069d0 0x7f018c19f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f018bfff640 1 -- 172.21.15.33:0/2112292547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f018c101da0 msgr2=0x7f018c19a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f018bfff640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f018c101da0 0x7f018c19a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f018bfff640 1 -- 172.21.15.33:0/2112292547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f018c1069d0 msgr2=0x7f018c19f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f018bfff640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f018c1069d0 0x7f018c19f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f018bfff640 1 -- 172.21.15.33:0/2112292547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c1a0110 con 0x7f018c106080 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.071+0000 7f018bfff640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f018c106080 0x7f018c19a740 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f017800c970 tx=0x7f017800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.072+0000 7f0189ffb640 1 -- 172.21.15.33:0/2112292547 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178007bb0 con 0x7f018c106080 2024-08-28T19:30:48.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.072+0000 7f0189ffb640 1 -- 172.21.15.33:0/2112292547 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0178007d50 con 0x7f018c106080 2024-08-28T19:30:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.072+0000 7f0192f50640 1 -- 172.21.15.33:0/2112292547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018c1a0400 con 0x7f018c106080 2024-08-28T19:30:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.072+0000 7f0189ffb640 1 -- 172.21.15.33:0/2112292547 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017800f450 con 0x7f018c106080 2024-08-28T19:30:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.072+0000 7f0192f50640 1 -- 172.21.15.33:0/2112292547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018c1a6b60 con 0x7f018c106080 2024-08-28T19:30:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.073+0000 7f0192f50640 1 -- 172.21.15.33:0/2112292547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018c1021b0 con 0x7f018c106080 2024-08-28T19:30:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.074+0000 7f0189ffb640 1 -- 172.21.15.33:0/2112292547 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f0178004f20 con 0x7f018c106080 2024-08-28T19:30:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.075+0000 7f0189ffb640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f017c0b4c10 0x7f017c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.076+0000 7f0190cec640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f017c0b4c10 0x7f017c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.076+0000 7f0189ffb640 1 -- 172.21.15.33:0/2112292547 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f01780e5750 con 0x7f018c106080 2024-08-28T19:30:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.076+0000 7f0190cec640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f017c0b4c10 0x7f017c0b7120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f018000bbe0 tx=0x7f018000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:48.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.079+0000 7f0189ffb640 1 -- 172.21.15.33:0/2112292547 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0178014030 con 0x7f018c106080 2024-08-28T19:30:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.265+0000 7f0192f50640 1 -- 172.21.15.33:0/2112292547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f018c19b2d0 con 0x7f018c106080 2024-08-28T19:30:48.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.266+0000 7f0189ffb640 1 -- 172.21.15.33:0/2112292547 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v54) ==== 86+0+133 (secure 0 0 0) 0x7f018c19b2d0 con 0x7f018c106080 2024-08-28T19:30:48.268 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.268+0000 7f0192f50640 1 -- 172.21.15.33:0/2112292547 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f017c0b4c10 msgr2=0x7f017c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.268+0000 7f0192f50640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f017c0b4c10 0x7f017c0b7120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f018000bbe0 tx=0x7f018000b390 comp rx=0 tx=0).stop 2024-08-28T19:30:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.268+0000 7f0192f50640 1 -- 172.21.15.33:0/2112292547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f018c106080 msgr2=0x7f018c19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.268+0000 7f0192f50640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f018c106080 0x7f018c19a740 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f017800c970 tx=0x7f017800ce30 comp rx=0 tx=0).stop 2024-08-28T19:30:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.268+0000 7f0192f50640 1 -- 172.21.15.33:0/2112292547 shutdown_connections 2024-08-28T19:30:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.268+0000 7f0192f50640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f018c1069d0 0x7f018c19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.268+0000 7f0192f50640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f018c106080 0x7f018c19a740 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.268+0000 7f0192f50640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f017c0b4c10 0x7f017c0b7120 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.268+0000 7f0192f50640 1 --2- 172.21.15.33:0/2112292547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f018c101da0 0x7f018c19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.268+0000 7f0192f50640 1 -- 172.21.15.33:0/2112292547 >> 172.21.15.33:0/2112292547 conn(0x7f018c079be0 msgr2=0x7f018c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.269+0000 7f0192f50640 1 -- 172.21.15.33:0/2112292547 shutdown_connections 2024-08-28T19:30:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:48.269+0000 7f0192f50640 1 -- 172.21.15.33:0/2112292547 wait complete. 2024-08-28T19:30:48.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:48 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2112292547' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-28T19:30:48.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:48 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2112292547' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-28T19:30:48.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:48 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2112292547' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-28T19:30:49.112 INFO:teuthology.orchestra.run.smithi033.stdout:[{"version":54,"timestamp":"2024-08-28T19:29:38.339378+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-28T19:30:49.113 INFO:tasks.ceph_manager:config epoch is 54 2024-08-28T19:30:49.113 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-28T19:30:49.113 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-28T19:30:49.113 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph mgr dump --format=json 2024-08-28T19:30:49.373 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:49.646 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:49 smithi033 ceph-mon[18549]: pgmap v291: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-28T19:30:49.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:49 smithi059 ceph-mon[22052]: pgmap v291: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-28T19:30:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:49 smithi122 ceph-mon[22174]: pgmap v291: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-28T19:30:49.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.878+0000 7f2a4397b640 1 -- 172.21.15.33:0/3311271649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3c102880 msgr2=0x7f2a3c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:49.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.878+0000 7f2a4397b640 1 --2- 172.21.15.33:0/3311271649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3c102880 0x7f2a3c102c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009900 tx=0x7f2a3002a410 comp rx=0 tx=0).stop 2024-08-28T19:30:49.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.878+0000 7f2a4397b640 1 -- 172.21.15.33:0/3311271649 shutdown_connections 2024-08-28T19:30:49.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.878+0000 7f2a4397b640 1 --2- 172.21.15.33:0/3311271649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a3c108b10 0x7f2a3c10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.878+0000 7f2a4397b640 1 --2- 172.21.15.33:0/3311271649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a3c1081c0 0x7f2a3c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.878+0000 7f2a4397b640 1 --2- 172.21.15.33:0/3311271649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3c102880 0x7f2a3c102c90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.878+0000 7f2a4397b640 1 -- 172.21.15.33:0/3311271649 >> 172.21.15.33:0/3311271649 conn(0x7f2a3c079510 msgr2=0x7f2a3c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.878+0000 7f2a4397b640 1 -- 172.21.15.33:0/3311271649 shutdown_connections 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.878+0000 7f2a4397b640 1 -- 172.21.15.33:0/3311271649 wait complete. 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a4397b640 1 Processor -- start 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a4397b640 1 -- start start 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a4397b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3c102880 0x7f2a3c19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a4397b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a3c1081c0 0x7f2a3c19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a4397b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a3c108b10 0x7f2a3c19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a4397b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c113930 con 0x7f2a3c102880 2024-08-28T19:30:49.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a4397b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c1137b0 con 0x7f2a3c108b10 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a4397b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c113ab0 con 0x7f2a3c1081c0 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a41717640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3c102880 0x7f2a3c19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a41717640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3c102880 0x7f2a3c19a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43692/0 (socket says 172.21.15.33:43692) 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a41717640 1 -- 172.21.15.33:0/2042488894 learned_addr learned my addr 172.21.15.33:0/2042488894 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a41f18640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a3c108b10 0x7f2a3c19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a40f16640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a3c1081c0 0x7f2a3c19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a41717640 1 -- 172.21.15.33:0/2042488894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a3c1081c0 msgr2=0x7f2a3c19a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a41717640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a3c1081c0 0x7f2a3c19a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a41717640 1 -- 172.21.15.33:0/2042488894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a3c108b10 msgr2=0x7f2a3c19fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a41717640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a3c108b10 0x7f2a3c19fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a41717640 1 -- 172.21.15.33:0/2042488894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c1a0270 con 0x7f2a3c102880 2024-08-28T19:30:49.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.879+0000 7f2a41f18640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a3c108b10 0x7f2a3c19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.880+0000 7f2a41717640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3c102880 0x7f2a3c19a300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2a30005940 tx=0x7f2a300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.880+0000 7f2a2e7fc640 1 -- 172.21.15.33:0/2042488894 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3003f030 con 0x7f2a3c102880 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.880+0000 7f2a4397b640 1 -- 172.21.15.33:0/2042488894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3c1a0500 con 0x7f2a3c102880 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.880+0000 7f2a2e7fc640 1 -- 172.21.15.33:0/2042488894 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a30003cb0 con 0x7f2a3c102880 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.880+0000 7f2a2e7fc640 1 -- 172.21.15.33:0/2042488894 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30035070 con 0x7f2a3c102880 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.880+0000 7f2a4397b640 1 -- 172.21.15.33:0/2042488894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a3c1a6cc0 con 0x7f2a3c102880 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.881+0000 7f2a4397b640 1 -- 172.21.15.33:0/2042488894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3c103b00 con 0x7f2a3c102880 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.882+0000 7f2a2e7fc640 1 -- 172.21.15.33:0/2042488894 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f2a30042030 con 0x7f2a3c102880 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.883+0000 7f2a2e7fc640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a280b4c10 0x7f2a280b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.883+0000 7f2a40f16640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a280b4c10 0x7f2a280b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.883+0000 7f2a2e7fc640 1 -- 172.21.15.33:0/2042488894 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f2a30106370 con 0x7f2a3c102880 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.884+0000 7f2a40f16640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a280b4c10 0x7f2a280b7120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2a38005fd0 tx=0x7f2a38005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:49.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:49.886+0000 7f2a2e7fc640 1 -- 172.21.15.33:0/2042488894 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2a300ccf10 con 0x7f2a3c102880 2024-08-28T19:30:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.119+0000 7f2a4397b640 1 -- 172.21.15.33:0/2042488894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2a3c10a910 con 0x7f2a3c102880 2024-08-28T19:30:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.125+0000 7f2a2e7fc640 1 -- 172.21.15.33:0/2042488894 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+293206 (secure 0 0 0) 0x7f2a300cc810 con 0x7f2a3c102880 2024-08-28T19:30:50.131 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 -- 172.21.15.33:0/2042488894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a280b4c10 msgr2=0x7f2a280b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a280b4c10 0x7f2a280b7120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2a38005fd0 tx=0x7f2a38005850 comp rx=0 tx=0).stop 2024-08-28T19:30:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 -- 172.21.15.33:0/2042488894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3c102880 msgr2=0x7f2a3c19a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3c102880 0x7f2a3c19a300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2a30005940 tx=0x7f2a300042f0 comp rx=0 tx=0).stop 2024-08-28T19:30:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 -- 172.21.15.33:0/2042488894 shutdown_connections 2024-08-28T19:30:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a3c108b10 0x7f2a3c19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2a280b4c10 0x7f2a280b7120 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2a3c1081c0 0x7f2a3c19a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 --2- 172.21.15.33:0/2042488894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a3c102880 0x7f2a3c19a300 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 -- 172.21.15.33:0/2042488894 >> 172.21.15.33:0/2042488894 conn(0x7f2a3c079510 msgr2=0x7f2a3c106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 -- 172.21.15.33:0/2042488894 shutdown_connections 2024-08-28T19:30:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:50.128+0000 7f2a4397b640 1 -- 172.21.15.33:0/2042488894 wait complete. 2024-08-28T19:30:50.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:50 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2042488894' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-28T19:30:50.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:50 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2042488894' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-28T19:30:50.856 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":21,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3015249273},{"type":"v1","addr":"172.21.15.33:6801","nonce":3015249273}]},"active_addr":"172.21.15.33:6801/3015249273","active_change":"2024-08-28T19:23:25.613878+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24140,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24142,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.33:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1786980145}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":168987308}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":2460370459}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":2856994647}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":141958899}]}]} 2024-08-28T19:30:50.863 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-28T19:30:50.864 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-28T19:30:50.864 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:30:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:50 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2042488894' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-28T19:30:51.124 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:51.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.648+0000 7f7055ebc640 1 -- 172.21.15.33:0/1007834127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f705010dbf0 msgr2=0x7f70501100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:51.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.648+0000 7f7055ebc640 1 --2- 172.21.15.33:0/1007834127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f705010dbf0 0x7f70501100e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7048009ca0 tx=0x7f704802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.648+0000 7f7055ebc640 1 -- 172.21.15.33:0/1007834127 shutdown_connections 2024-08-28T19:30:51.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.648+0000 7f7055ebc640 1 --2- 172.21.15.33:0/1007834127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f705010dbf0 0x7f70501100e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.648+0000 7f7055ebc640 1 --2- 172.21.15.33:0/1007834127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70501050e0 0x7f705010d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.648+0000 7f7055ebc640 1 --2- 172.21.15.33:0/1007834127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7050104790 0x7f7050104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.648+0000 7f7055ebc640 1 -- 172.21.15.33:0/1007834127 >> 172.21.15.33:0/1007834127 conn(0x7f7050079580 msgr2=0x7f7050079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.648+0000 7f7055ebc640 1 -- 172.21.15.33:0/1007834127 shutdown_connections 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.648+0000 7f7055ebc640 1 -- 172.21.15.33:0/1007834127 wait complete. 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f7055ebc640 1 Processor -- start 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f7055ebc640 1 -- start start 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f7055ebc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7050104790 0x7f705019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f7055ebc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70501050e0 0x7f705019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f7055ebc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f705010dbf0 0x7f705019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f7055ebc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7050113870 con 0x7f7050104790 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f7055ebc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70501136f0 con 0x7f70501050e0 2024-08-28T19:30:51.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f7055ebc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f70501139f0 con 0x7f705010dbf0 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f704f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7050104790 0x7f705019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f704f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7050104790 0x7f705019a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43706/0 (socket says 172.21.15.33:43706) 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.649+0000 7f704f7fe640 1 -- 172.21.15.33:0/3639838360 learned_addr learned my addr 172.21.15.33:0/3639838360 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f704f7fe640 1 -- 172.21.15.33:0/3639838360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f705010dbf0 msgr2=0x7f705019fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f704f7fe640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f705010dbf0 0x7f705019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f7046ffd640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70501050e0 0x7f705019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f704f7fe640 1 -- 172.21.15.33:0/3639838360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70501050e0 msgr2=0x7f705019a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f704f7fe640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70501050e0 0x7f705019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f704f7fe640 1 -- 172.21.15.33:0/3639838360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70501a0290 con 0x7f7050104790 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f704f7fe640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7050104790 0x7f705019a320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f704000d950 tx=0x7f704000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f704d7fa640 1 -- 172.21.15.33:0/3639838360 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040017070 con 0x7f7050104790 2024-08-28T19:30:51.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f704d7fa640 1 -- 172.21.15.33:0/3639838360 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7040009c30 con 0x7f7050104790 2024-08-28T19:30:51.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f7055ebc640 1 -- 172.21.15.33:0/3639838360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70501a0580 con 0x7f7050104790 2024-08-28T19:30:51.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f704d7fa640 1 -- 172.21.15.33:0/3639838360 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704000f620 con 0x7f7050104790 2024-08-28T19:30:51.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.650+0000 7f7055ebc640 1 -- 172.21.15.33:0/3639838360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70501a6ce0 con 0x7f7050104790 2024-08-28T19:30:51.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.651+0000 7f7055ebc640 1 -- 172.21.15.33:0/3639838360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7050104ba0 con 0x7f7050104790 2024-08-28T19:30:51.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.653+0000 7f704d7fa640 1 -- 172.21.15.33:0/3639838360 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f704001a070 con 0x7f7050104790 2024-08-28T19:30:51.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.653+0000 7f704d7fa640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f703c0b4c10 0x7f703c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:51.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.654+0000 7f7046ffd640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f703c0b4c10 0x7f703c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:51.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.654+0000 7f704d7fa640 1 -- 172.21.15.33:0/3639838360 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f70400e5290 con 0x7f7050104790 2024-08-28T19:30:51.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.654+0000 7f7046ffd640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f703c0b4c10 0x7f703c0b7120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f705010f890 tx=0x7f7038005be0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:51.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.657+0000 7f704d7fa640 1 -- 172.21.15.33:0/3639838360 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7040009de0 con 0x7f7050104790 2024-08-28T19:30:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:51 smithi122 ceph-mon[22174]: pgmap v292: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-08-28T19:30:51.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.844+0000 7f7055ebc640 1 -- 172.21.15.33:0/3639838360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70501a7060 con 0x7f7050104790 2024-08-28T19:30:51.846 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:51 smithi033 ceph-mon[18549]: pgmap v292: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-08-28T19:30:51.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.845+0000 7f704d7fa640 1 -- 172.21.15.33:0/3639838360 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24941 (secure 0 0 0) 0x7f70400abdd0 con 0x7f7050104790 2024-08-28T19:30:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:51.848 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":82,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:30:27.393474+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:30:51.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.847+0000 7f7055ebc640 1 -- 172.21.15.33:0/3639838360 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f703c0b4c10 msgr2=0x7f703c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.847+0000 7f7055ebc640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f703c0b4c10 0x7f703c0b7120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f705010f890 tx=0x7f7038005be0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.847+0000 7f7055ebc640 1 -- 172.21.15.33:0/3639838360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7050104790 msgr2=0x7f705019a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.847+0000 7f7055ebc640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7050104790 0x7f705019a320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f704000d950 tx=0x7f704000de10 comp rx=0 tx=0).stop 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.847+0000 7f7055ebc640 1 -- 172.21.15.33:0/3639838360 shutdown_connections 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.847+0000 7f7055ebc640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f703c0b4c10 0x7f703c0b7120 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.847+0000 7f7055ebc640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f705010dbf0 0x7f705019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.847+0000 7f7055ebc640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70501050e0 0x7f705019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.847+0000 7f7055ebc640 1 --2- 172.21.15.33:0/3639838360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7050104790 0x7f705019a320 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.848+0000 7f7055ebc640 1 -- 172.21.15.33:0/3639838360 >> 172.21.15.33:0/3639838360 conn(0x7f7050079580 msgr2=0x7f70500ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.848+0000 7f7055ebc640 1 -- 172.21.15.33:0/3639838360 shutdown_connections 2024-08-28T19:30:51.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:51.848+0000 7f7055ebc640 1 -- 172.21.15.33:0/3639838360 wait complete. 2024-08-28T19:30:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:51 smithi059 ceph-mon[22052]: pgmap v292: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-08-28T19:30:52.525 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-28T19:30:52.525 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:30:52.781 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:52.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:52 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3639838360' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:52.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:52 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3639838360' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:53.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:52 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3639838360' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 -- 172.21.15.33:0/2174108718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff934109b90 msgr2=0x7ff9341103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 --2- 172.21.15.33:0/2174108718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff934109b90 0x7ff9341103c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009900 tx=0x7ff92c02a410 comp rx=0 tx=0).stop 2024-08-28T19:30:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 -- 172.21.15.33:0/2174108718 shutdown_connections 2024-08-28T19:30:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 --2- 172.21.15.33:0/2174108718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff934109b90 0x7ff9341103c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 --2- 172.21.15.33:0/2174108718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff934109240 0x7ff934109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 --2- 172.21.15.33:0/2174108718 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff934103900 0x7ff934103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 -- 172.21.15.33:0/2174108718 >> 172.21.15.33:0/2174108718 conn(0x7ff93407b5f0 msgr2=0x7ff93407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 -- 172.21.15.33:0/2174108718 shutdown_connections 2024-08-28T19:30:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 -- 172.21.15.33:0/2174108718 wait complete. 2024-08-28T19:30:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 Processor -- start 2024-08-28T19:30:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.279+0000 7ff93c629640 1 -- start start 2024-08-28T19:30:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93c629640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff934103900 0x7ff93419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93c629640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff934109240 0x7ff93419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93c629640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff934109b90 0x7ff93419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93c629640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff9341138b0 con 0x7ff934109b90 2024-08-28T19:30:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93c629640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff934113730 con 0x7ff934103900 2024-08-28T19:30:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93c629640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff934113a30 con 0x7ff934109240 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93abc6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff934109b90 0x7ff93419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93abc6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff934109b90 0x7ff93419fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43714/0 (socket says 172.21.15.33:43714) 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93abc6640 1 -- 172.21.15.33:0/3287935564 learned_addr learned my addr 172.21.15.33:0/3287935564 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff939bc4640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff934109240 0x7ff93419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93a3c5640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff934103900 0x7ff93419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93abc6640 1 -- 172.21.15.33:0/3287935564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff934109240 msgr2=0x7ff93419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93abc6640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff934109240 0x7ff93419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93abc6640 1 -- 172.21.15.33:0/3287935564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff934103900 msgr2=0x7ff93419a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93abc6640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff934103900 0x7ff93419a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.280+0000 7ff93abc6640 1 -- 172.21.15.33:0/3287935564 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9341a0130 con 0x7ff934109b90 2024-08-28T19:30:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.281+0000 7ff93abc6640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff934109b90 0x7ff93419fac0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009a20 tx=0x7ff92c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:53.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.281+0000 7ff9337fe640 1 -- 172.21.15.33:0/3287935564 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c03f030 con 0x7ff934109b90 2024-08-28T19:30:53.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.281+0000 7ff9337fe640 1 -- 172.21.15.33:0/3287935564 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff92c003aa0 con 0x7ff934109b90 2024-08-28T19:30:53.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.281+0000 7ff93c629640 1 -- 172.21.15.33:0/3287935564 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9341a03c0 con 0x7ff934109b90 2024-08-28T19:30:53.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.281+0000 7ff9337fe640 1 -- 172.21.15.33:0/3287935564 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c035070 con 0x7ff934109b90 2024-08-28T19:30:53.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.281+0000 7ff93c629640 1 -- 172.21.15.33:0/3287935564 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9341a6c40 con 0x7ff934109b90 2024-08-28T19:30:53.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.282+0000 7ff93c629640 1 -- 172.21.15.33:0/3287935564 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff934103d10 con 0x7ff934109b90 2024-08-28T19:30:53.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.284+0000 7ff9337fe640 1 -- 172.21.15.33:0/3287935564 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7ff92c042030 con 0x7ff934109b90 2024-08-28T19:30:53.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.284+0000 7ff9337fe640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff91c0b4c40 0x7ff91c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:53.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.284+0000 7ff93a3c5640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff91c0b4c40 0x7ff91c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:53.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.284+0000 7ff9337fe640 1 -- 172.21.15.33:0/3287935564 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7ff92c106170 con 0x7ff934109b90 2024-08-28T19:30:53.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.285+0000 7ff93a3c5640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff91c0b4c40 0x7ff91c0b7150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff92400a400 tx=0x7ff92400d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:53.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.288+0000 7ff9337fe640 1 -- 172.21.15.33:0/3287935564 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff92c0ccd10 con 0x7ff934109b90 2024-08-28T19:30:53.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.475+0000 7ff93c629640 1 -- 172.21.15.33:0/3287935564 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff93410b9c0 con 0x7ff934109b90 2024-08-28T19:30:53.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.476+0000 7ff9337fe640 1 -- 172.21.15.33:0/3287935564 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+24941 (secure 0 0 0) 0x7ff92c0cc610 con 0x7ff934109b90 2024-08-28T19:30:53.479 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:30:53.479 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":82,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:30:27.393474+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 -- 172.21.15.33:0/3287935564 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff91c0b4c40 msgr2=0x7ff91c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff91c0b4c40 0x7ff91c0b7150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff92400a400 tx=0x7ff92400d040 comp rx=0 tx=0).stop 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 -- 172.21.15.33:0/3287935564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff934109b90 msgr2=0x7ff93419fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff934109b90 0x7ff93419fac0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009a20 tx=0x7ff92c004270 comp rx=0 tx=0).stop 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 -- 172.21.15.33:0/3287935564 shutdown_connections 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff934109b90 0x7ff93419fac0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff91c0b4c40 0x7ff91c0b7150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff934109240 0x7ff93419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 --2- 172.21.15.33:0/3287935564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff934103900 0x7ff93419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 -- 172.21.15.33:0/3287935564 >> 172.21.15.33:0/3287935564 conn(0x7ff93407b5f0 msgr2=0x7ff934107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:53.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 -- 172.21.15.33:0/3287935564 shutdown_connections 2024-08-28T19:30:53.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:53.479+0000 7ff93c629640 1 -- 172.21.15.33:0/3287935564 wait complete. 2024-08-28T19:30:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:53 smithi122 ceph-mon[22174]: pgmap v293: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-08-28T19:30:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:53 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3287935564' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:53.854 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:53 smithi033 ceph-mon[18549]: pgmap v293: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-08-28T19:30:53.854 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:53 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3287935564' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:54.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:53 smithi059 ceph-mon[22052]: pgmap v293: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-08-28T19:30:54.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:53 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3287935564' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:30:54.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-28T19:30:54.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-28T19:30:54.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-28T19:30:54.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-28T19:30:54.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-28T19:30:54.214 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-28T19:30:54.214 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-28T19:30:54.215 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-28T19:30:54.215 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-28T19:30:54.216 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-28T19:30:54.216 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-28T19:30:54.217 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-28T19:30:54.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:54 smithi033 ceph-mon[18549]: pgmap v294: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-28T19:30:55.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:54 smithi059 ceph-mon[22052]: pgmap v294: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-28T19:30:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:54 smithi122 ceph-mon[22174]: pgmap v294: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-28T19:30:55.047 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.053 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.056 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.061 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.065 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.066 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:55.100 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:30:56.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:56 smithi033 ceph-mon[18549]: pgmap v295: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-28T19:30:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.890+0000 7f0cb19fc640 1 -- 172.21.15.33:0/1486334003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cac102820 msgr2=0x7f0cac102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.890+0000 7f0cb19fc640 1 --2- 172.21.15.33:0/1486334003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cac102820 0x7f0cac102c30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009900 tx=0x7f0c9c02a410 comp rx=0 tx=0).stop 2024-08-28T19:30:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.891+0000 7f0cb19fc640 1 -- 172.21.15.33:0/1486334003 shutdown_connections 2024-08-28T19:30:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.891+0000 7f0cb19fc640 1 --2- 172.21.15.33:0/1486334003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cac108ab0 0x7f0cac10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.891+0000 7f0cb19fc640 1 --2- 172.21.15.33:0/1486334003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cac108160 0x7f0cac108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.891+0000 7f0cb19fc640 1 --2- 172.21.15.33:0/1486334003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cac102820 0x7f0cac102c30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.891+0000 7f0cb19fc640 1 -- 172.21.15.33:0/1486334003 >> 172.21.15.33:0/1486334003 conn(0x7f0cac0794e0 msgr2=0x7f0cac0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.891+0000 7f0cb19fc640 1 -- 172.21.15.33:0/1486334003 shutdown_connections 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.891+0000 7f0cb19fc640 1 -- 172.21.15.33:0/1486334003 wait complete. 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.891+0000 7f0cb19fc640 1 Processor -- start 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.891+0000 7f0cb19fc640 1 -- start start 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cb19fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cac102820 0x7f0cac199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cb19fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cac108160 0x7f0cac1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cb19fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cac108ab0 0x7f0cac19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cb19fc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac112710 con 0x7f0cac108ab0 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cb19fc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac112590 con 0x7f0cac108160 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cb19fc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac112890 con 0x7f0cac102820 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cac108ab0 0x7f0cac19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cac108ab0 0x7f0cac19e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43730/0 (socket says 172.21.15.33:43730) 2024-08-28T19:30:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cab7fe640 1 -- 172.21.15.33:0/472843891 learned_addr learned my addr 172.21.15.33:0/472843891 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0ca27fc640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cac108160 0x7f0cac1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0caaffd640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cac102820 0x7f0cac199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cab7fe640 1 -- 172.21.15.33:0/472843891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cac102820 msgr2=0x7f0cac199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cab7fe640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cac102820 0x7f0cac199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cab7fe640 1 -- 172.21.15.33:0/472843891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cac108160 msgr2=0x7f0cac1996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cab7fe640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cac108160 0x7f0cac1996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.892+0000 7f0cab7fe640 1 -- 172.21.15.33:0/472843891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac19f090 con 0x7f0cac108ab0 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.893+0000 7f0cab7fe640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cac108ab0 0x7f0cac19e960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009fd0 tx=0x7f0ca400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.893+0000 7f0cb09fa640 1 -- 172.21.15.33:0/472843891 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4017070 con 0x7f0cac108ab0 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.893+0000 7f0cb09fa640 1 -- 172.21.15.33:0/472843891 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ca4003e20 con 0x7f0cac108ab0 2024-08-28T19:30:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.893+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac19f380 con 0x7f0cac108ab0 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.893+0000 7f0cb09fa640 1 -- 172.21.15.33:0/472843891 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4010460 con 0x7f0cac108ab0 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.893+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac1a5ae0 con 0x7f0cac108ab0 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.894+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0cac0638f0 con 0x7f0cac108ab0 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.896+0000 7f0cb09fa640 1 -- 172.21.15.33:0/472843891 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f0ca4003970 con 0x7f0cac108ab0 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.896+0000 7f0cb09fa640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c980b4c10 0x7f0c980b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.897+0000 7f0caaffd640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c980b4c10 0x7f0c980b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.897+0000 7f0cb09fa640 1 -- 172.21.15.33:0/472843891 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f0ca40e58e0 con 0x7f0cac108ab0 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.897+0000 7f0cb09fa640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] conn(0x7f0c980bffa0 0x7f0c980c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.897+0000 7f0cb09fa640 1 -- 172.21.15.33:0/472843891 --> [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c980c2b60 con 0x7f0c980bffa0 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.897+0000 7f0cb09fa640 1 -- 172.21.15.33:0/472843891 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f0ca40e5d30 con 0x7f0cac108ab0 2024-08-28T19:30:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.897+0000 7f0caaffd640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c980b4c10 0x7f0c980b7120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c031440 tx=0x7f0c9c005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:56.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.897+0000 7f0ca27fc640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] conn(0x7f0c980bffa0 0x7f0c980c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:56.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.898+0000 7f0ca27fc640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] conn(0x7f0c980bffa0 0x7f0c980c2490 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:56.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.899+0000 7f0cb09fa640 1 -- 172.21.15.33:0/472843891 <== osd.10 v2:172.21.15.59:6824/3281579619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c980c2b60 con 0x7f0c980bffa0 2024-08-28T19:30:56.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.912+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 --> [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0cac063d70 con 0x7f0c980bffa0 2024-08-28T19:30:56.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.913+0000 7f0cb09fa640 1 -- 172.21.15.33:0/472843891 <== osd.10 v2:172.21.15.59:6824/3281579619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0cac063d70 con 0x7f0c980bffa0 2024-08-28T19:30:56.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.913+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 >> [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] conn(0x7f0c980bffa0 msgr2=0x7f0c980c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.913+0000 7f0cb19fc640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] conn(0x7f0c980bffa0 0x7f0c980c2490 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.913+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c980b4c10 msgr2=0x7f0c980b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.913+0000 7f0cb19fc640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c980b4c10 0x7f0c980b7120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c031440 tx=0x7f0c9c005d50 comp rx=0 tx=0).stop 2024-08-28T19:30:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.913+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cac108ab0 msgr2=0x7f0cac19e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.914+0000 7f0cb19fc640 1 --2- 172.21.15.33:0/472843891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cac108ab0 0x7f0cac19e960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009fd0 tx=0x7f0ca400b260 comp rx=0 tx=0).stop 2024-08-28T19:30:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.914+0000 7f0cab7fe640 1 -- 172.21.15.33:0/472843891 reap_dead start 2024-08-28T19:30:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.914+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 shutdown_connections 2024-08-28T19:30:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.914+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 >> 172.21.15.33:0/472843891 conn(0x7f0cac0794e0 msgr2=0x7f0cac101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.914+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 shutdown_connections 2024-08-28T19:30:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:56.914+0000 7f0cb19fc640 1 -- 172.21.15.33:0/472843891 wait complete. 2024-08-28T19:30:57.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:56 smithi122 ceph-mon[22174]: pgmap v295: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-28T19:30:57.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.209+0000 7fa263a94640 1 -- 172.21.15.33:0/3114314836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c108140 msgr2=0x7fa25c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.209+0000 7fa263a94640 1 --2- 172.21.15.33:0/3114314836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c108140 0x7fa25c108550 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa250009900 tx=0x7fa25002a410 comp rx=0 tx=0).stop 2024-08-28T19:30:57.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.209+0000 7fa263a94640 1 -- 172.21.15.33:0/3114314836 shutdown_connections 2024-08-28T19:30:57.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.209+0000 7fa263a94640 1 --2- 172.21.15.33:0/3114314836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa25c108a90 0x7fa25c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.209+0000 7fa263a94640 1 --2- 172.21.15.33:0/3114314836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c108140 0x7fa25c108550 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.210+0000 7fa263a94640 1 --2- 172.21.15.33:0/3114314836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa25c102800 0x7fa25c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.210+0000 7fa263a94640 1 -- 172.21.15.33:0/3114314836 >> 172.21.15.33:0/3114314836 conn(0x7fa25c0794d0 msgr2=0x7fa25c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:57.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.210+0000 7fa263a94640 1 -- 172.21.15.33:0/3114314836 shutdown_connections 2024-08-28T19:30:57.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.210+0000 7fa263a94640 1 -- 172.21.15.33:0/3114314836 wait complete. 2024-08-28T19:30:57.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.211+0000 7fa263a94640 1 Processor -- start 2024-08-28T19:30:57.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.211+0000 7fa263a94640 1 -- start start 2024-08-28T19:30:57.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa263a94640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c102800 0x7fa25c10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:57.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa263a94640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa25c108140 0x7fa25c110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa263a94640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa25c108a90 0x7fa25c1107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa263a94640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c113820 con 0x7fa25c102800 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa263a94640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1136a0 con 0x7fa25c108140 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa263a94640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1139a0 con 0x7fa25c108a90 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa261830640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c102800 0x7fa25c10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa261830640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c102800 0x7fa25c10fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43766/0 (socket says 172.21.15.33:43766) 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa261830640 1 -- 172.21.15.33:0/1322730295 learned_addr learned my addr 172.21.15.33:0/1322730295 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa26102f640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa25c108140 0x7fa25c110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa262031640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa25c108a90 0x7fa25c1107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa261830640 1 -- 172.21.15.33:0/1322730295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa25c108a90 msgr2=0x7fa25c1107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa261830640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa25c108a90 0x7fa25c1107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa261830640 1 -- 172.21.15.33:0/1322730295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa25c108140 msgr2=0x7fa25c110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa261830640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa25c108140 0x7fa25c110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa261830640 1 -- 172.21.15.33:0/1322730295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c1a8490 con 0x7fa25c102800 2024-08-28T19:30:57.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.212+0000 7fa26102f640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa25c108140 0x7fa25c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:30:57.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.213+0000 7fa261830640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c102800 0x7fa25c10fd50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa25800d950 tx=0x7fa25800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:57.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.213+0000 7fa24effd640 1 -- 172.21.15.33:0/1322730295 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258017070 con 0x7fa25c102800 2024-08-28T19:30:57.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.213+0000 7fa24effd640 1 -- 172.21.15.33:0/1322730295 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa258009c30 con 0x7fa25c102800 2024-08-28T19:30:57.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.213+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25c1a8780 con 0x7fa25c102800 2024-08-28T19:30:57.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.213+0000 7fa24effd640 1 -- 172.21.15.33:0/1322730295 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25800f620 con 0x7fa25c102800 2024-08-28T19:30:57.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.214+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25c1a8c40 con 0x7fa25c102800 2024-08-28T19:30:57.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.215+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa25c0638f0 con 0x7fa25c102800 2024-08-28T19:30:57.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.216+0000 7fa24effd640 1 -- 172.21.15.33:0/1322730295 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa258010460 con 0x7fa25c102800 2024-08-28T19:30:57.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.217+0000 7fa24effd640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa2480b4c10 0x7fa2480b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:57.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.217+0000 7fa26102f640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa2480b4c10 0x7fa2480b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:57.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.217+0000 7fa24effd640 1 -- 172.21.15.33:0/1322730295 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fa2580e5300 con 0x7fa25c102800 2024-08-28T19:30:57.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.217+0000 7fa24effd640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] conn(0x7fa2480bffa0 0x7fa2480c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:57.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.217+0000 7fa24effd640 1 -- 172.21.15.33:0/1322730295 --> [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2480c2b60 con 0x7fa2480bffa0 2024-08-28T19:30:57.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.217+0000 7fa24effd640 1 -- 172.21.15.33:0/1322730295 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fa2580ec050 con 0x7fa25c102800 2024-08-28T19:30:57.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.218+0000 7fa26102f640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa2480b4c10 0x7fa2480b7120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa250031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:57.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.218+0000 7fa262031640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] conn(0x7fa2480bffa0 0x7fa2480c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:57.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.218+0000 7fa262031640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] conn(0x7fa2480bffa0 0x7fa2480c2490 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:57.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.219+0000 7fa24effd640 1 -- 172.21.15.33:0/1322730295 <== osd.5 v2:172.21.15.122:6808/1476880697 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2480c2b60 con 0x7fa2480bffa0 2024-08-28T19:30:57.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.233+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 --> [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa25c063d70 con 0x7fa2480bffa0 2024-08-28T19:30:57.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa24effd640 1 -- 172.21.15.33:0/1322730295 <== osd.5 v2:172.21.15.122:6808/1476880697 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa25c063d70 con 0x7fa2480bffa0 2024-08-28T19:30:57.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 >> [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] conn(0x7fa2480bffa0 msgr2=0x7fa2480c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa263a94640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] conn(0x7fa2480bffa0 0x7fa2480c2490 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa2480b4c10 msgr2=0x7fa2480b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa263a94640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa2480b4c10 0x7fa2480b7120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa250031400 comp rx=0 tx=0).stop 2024-08-28T19:30:57.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c102800 msgr2=0x7fa25c10fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa263a94640 1 --2- 172.21.15.33:0/1322730295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa25c102800 0x7fa25c10fd50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa25800d950 tx=0x7fa25800de10 comp rx=0 tx=0).stop 2024-08-28T19:30:57.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa262031640 1 -- 172.21.15.33:0/1322730295 reap_dead start 2024-08-28T19:30:57.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 shutdown_connections 2024-08-28T19:30:57.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 >> 172.21.15.33:0/1322730295 conn(0x7fa25c0794d0 msgr2=0x7fa25c105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:57.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 shutdown_connections 2024-08-28T19:30:57.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.234+0000 7fa263a94640 1 -- 172.21.15.33:0/1322730295 wait complete. 2024-08-28T19:30:57.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:56 smithi059 ceph-mon[22052]: pgmap v295: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-28T19:30:57.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.428+0000 7f1498c29640 1 -- 172.21.15.33:0/2308871493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1494108150 msgr2=0x7f1494108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.428+0000 7f1498c29640 1 --2- 172.21.15.33:0/2308871493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1494108150 0x7f1494108560 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f147c009900 tx=0x7f147c02a410 comp rx=0 tx=0).stop 2024-08-28T19:30:57.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.428+0000 7f1498c29640 1 -- 172.21.15.33:0/2308871493 shutdown_connections 2024-08-28T19:30:57.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.428+0000 7f1498c29640 1 --2- 172.21.15.33:0/2308871493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1494108aa0 0x7f149410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.428+0000 7f1498c29640 1 --2- 172.21.15.33:0/2308871493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1494108150 0x7f1494108560 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.428+0000 7f1498c29640 1 --2- 172.21.15.33:0/2308871493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1494102ee0 0x7f14941032f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.428+0000 7f1498c29640 1 -- 172.21.15.33:0/2308871493 >> 172.21.15.33:0/2308871493 conn(0x7f1494077a00 msgr2=0x7f1494077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.428+0000 7f1498c29640 1 -- 172.21.15.33:0/2308871493 shutdown_connections 2024-08-28T19:30:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.428+0000 7f1498c29640 1 -- 172.21.15.33:0/2308871493 wait complete. 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f1498c29640 1 Processor -- start 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f1498c29640 1 -- start start 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f1498c29640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1494102ee0 0x7f149419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f1498c29640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1494108150 0x7f149419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f1498c29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1494108aa0 0x7f149419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f1498c29640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1494112730 con 0x7f1494102ee0 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f1498c29640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f14941125b0 con 0x7f1494108150 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f1498c29640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f14941128b0 con 0x7f1494108aa0 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f149259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1494102ee0 0x7f149419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f149259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1494102ee0 0x7f149419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43776/0 (socket says 172.21.15.33:43776) 2024-08-28T19:30:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.429+0000 7f149259c640 1 -- 172.21.15.33:0/2380220282 learned_addr learned my addr 172.21.15.33:0/2380220282 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f148bfff640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1494108150 0x7f149419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f149259c640 1 -- 172.21.15.33:0/2380220282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1494108aa0 msgr2=0x7f149419fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f149259c640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1494108aa0 0x7f149419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f149259c640 1 -- 172.21.15.33:0/2380220282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1494108150 msgr2=0x7f149419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f149259c640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1494108150 0x7f149419a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f149259c640 1 -- 172.21.15.33:0/2380220282 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14941a01a0 con 0x7f1494102ee0 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f149259c640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1494102ee0 0x7f149419a230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f148400d950 tx=0x7f148400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f148b7fe640 1 -- 172.21.15.33:0/2380220282 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1484017030 con 0x7f1494102ee0 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f148b7fe640 1 -- 172.21.15.33:0/2380220282 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1484004020 con 0x7f1494102ee0 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14941a0490 con 0x7f1494102ee0 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f148b7fe640 1 -- 172.21.15.33:0/2380220282 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14840047a0 con 0x7f1494102ee0 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.430+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14941a6bf0 con 0x7f1494102ee0 2024-08-28T19:30:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.431+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14940638b0 con 0x7f1494102ee0 2024-08-28T19:30:57.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.433+0000 7f148b7fe640 1 -- 172.21.15.33:0/2380220282 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f1484009a30 con 0x7f1494102ee0 2024-08-28T19:30:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.434+0000 7f148b7fe640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14800b4c10 0x7f14800b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.434+0000 7f148bfff640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14800b4c10 0x7f14800b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.434+0000 7f148b7fe640 1 -- 172.21.15.33:0/2380220282 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f14840e59a0 con 0x7f1494102ee0 2024-08-28T19:30:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.434+0000 7f148b7fe640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] conn(0x7f14800bffa0 0x7f14800c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.434+0000 7f148b7fe640 1 -- 172.21.15.33:0/2380220282 --> [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14800c2b60 con 0x7f14800bffa0 2024-08-28T19:30:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.434+0000 7f148b7fe640 1 -- 172.21.15.33:0/2380220282 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f14840e5d50 con 0x7f1494102ee0 2024-08-28T19:30:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.434+0000 7f148bfff640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14800b4c10 0x7f14800b7120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f147c006010 tx=0x7f147c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:57.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.434+0000 7f1492d9d640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] conn(0x7f14800bffa0 0x7f14800c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:57.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.435+0000 7f1492d9d640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] conn(0x7f14800bffa0 0x7f14800c2490 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:57.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.436+0000 7f148b7fe640 1 -- 172.21.15.33:0/2380220282 <== osd.2 v2:172.21.15.122:6800/1716397894 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14800c2b60 con 0x7f14800bffa0 2024-08-28T19:30:57.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.449+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 --> [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1494063d60 con 0x7f14800bffa0 2024-08-28T19:30:57.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f148b7fe640 1 -- 172.21.15.33:0/2380220282 <== osd.2 v2:172.21.15.122:6800/1716397894 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1494063d60 con 0x7f14800bffa0 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 >> [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] conn(0x7f14800bffa0 msgr2=0x7f14800c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1498c29640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] conn(0x7f14800bffa0 0x7f14800c2490 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14800b4c10 msgr2=0x7f14800b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1498c29640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f14800b4c10 0x7f14800b7120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f147c006010 tx=0x7f147c000bc0 comp rx=0 tx=0).stop 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1494102ee0 msgr2=0x7f149419a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1498c29640 1 --2- 172.21.15.33:0/2380220282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1494102ee0 0x7f149419a230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f148400d950 tx=0x7f148400de10 comp rx=0 tx=0).stop 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1492d9d640 1 -- 172.21.15.33:0/2380220282 reap_dead start 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 shutdown_connections 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 >> 172.21.15.33:0/2380220282 conn(0x7f1494077a00 msgr2=0x7f1494101000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 shutdown_connections 2024-08-28T19:30:57.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.450+0000 7f1498c29640 1 -- 172.21.15.33:0/2380220282 wait complete. 2024-08-28T19:30:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.107+0000 7fca50700640 1 -- 172.21.15.33:0/1962145182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca481047d0 msgr2=0x7fca48104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.107+0000 7fca50700640 1 --2- 172.21.15.33:0/1962145182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca481047d0 0x7fca48104be0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fca44009900 tx=0x7fca4402a410 comp rx=0 tx=0).stop 2024-08-28T19:30:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.108+0000 7fca50700640 1 -- 172.21.15.33:0/1962145182 shutdown_connections 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.108+0000 7fca50700640 1 --2- 172.21.15.33:0/1962145182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4810dc30 0x7fca48110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.108+0000 7fca50700640 1 --2- 172.21.15.33:0/1962145182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca48105120 0x7fca4810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.108+0000 7fca50700640 1 --2- 172.21.15.33:0/1962145182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca481047d0 0x7fca48104be0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.108+0000 7fca50700640 1 -- 172.21.15.33:0/1962145182 >> 172.21.15.33:0/1962145182 conn(0x7fca48079510 msgr2=0x7fca48079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.108+0000 7fca50700640 1 -- 172.21.15.33:0/1962145182 shutdown_connections 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.108+0000 7fca50700640 1 -- 172.21.15.33:0/1962145182 wait complete. 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.108+0000 7fca50700640 1 Processor -- start 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.108+0000 7fca50700640 1 -- start start 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca50700640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca481047d0 0x7fca4819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca50700640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca48105120 0x7fca4819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca50700640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4810dc30 0x7fca4819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:58.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca50700640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca48113890 con 0x7fca481047d0 2024-08-28T19:30:58.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca50700640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fca48113710 con 0x7fca4810dc30 2024-08-28T19:30:58.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca50700640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca48113a10 con 0x7fca48105120 2024-08-28T19:30:58.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4e49c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca481047d0 0x7fca4819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:58.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4e49c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca481047d0 0x7fca4819a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43752/0 (socket says 172.21.15.33:43752) 2024-08-28T19:30:58.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4e49c640 1 -- 172.21.15.33:0/3783920605 learned_addr learned my addr 172.21.15.33:0/3783920605 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:58.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4ec9d640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4810dc30 0x7fca4819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4dc9b640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca48105120 0x7fca4819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4e49c640 1 -- 172.21.15.33:0/3783920605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca48105120 msgr2=0x7fca4819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4e49c640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca48105120 0x7fca4819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4e49c640 1 -- 172.21.15.33:0/3783920605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4810dc30 msgr2=0x7fca4819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4e49c640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4810dc30 0x7fca4819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4e49c640 1 -- 172.21.15.33:0/3783920605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca481a0290 con 0x7fca481047d0 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4ec9d640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4810dc30 0x7fca4819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4dc9b640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca48105120 0x7fca4819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca4e49c640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca481047d0 0x7fca4819a320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fca44005940 tx=0x7fca440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca3f7fe640 1 -- 172.21.15.33:0/3783920605 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4403f030 con 0x7fca481047d0 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca481a0520 con 0x7fca481047d0 2024-08-28T19:30:58.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca3f7fe640 1 -- 172.21.15.33:0/3783920605 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca44003cb0 con 0x7fca481047d0 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.109+0000 7fca3f7fe640 1 -- 172.21.15.33:0/3783920605 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44035070 con 0x7fca481047d0 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.110+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca481a6ce0 con 0x7fca481047d0 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.110+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca48063870 con 0x7fca481047d0 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.112+0000 7fca3f7fe640 1 -- 172.21.15.33:0/3783920605 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fca44042030 con 0x7fca481047d0 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.113+0000 7fca3f7fe640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca340b4c10 0x7fca340b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.113+0000 7fca4dc9b640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca340b4c10 0x7fca340b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.113+0000 7fca3f7fe640 1 -- 172.21.15.33:0/3783920605 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fca441063b0 con 0x7fca481047d0 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.113+0000 7fca3f7fe640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] conn(0x7fca340bffa0 0x7fca340c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.113+0000 7fca3f7fe640 1 -- 172.21.15.33:0/3783920605 --> [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca340c2b60 con 0x7fca340bffa0 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.113+0000 7fca3f7fe640 1 -- 172.21.15.33:0/3783920605 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fca44106800 con 0x7fca481047d0 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.113+0000 7fca4dc9b640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca340b4c10 0x7fca340b7120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fca4810f4d0 tx=0x7fca38005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:58.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.113+0000 7fca4ec9d640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] conn(0x7fca340bffa0 0x7fca340c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.114+0000 7fca4ec9d640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] conn(0x7fca340bffa0 0x7fca340c2490 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.115+0000 7fca3f7fe640 1 -- 172.21.15.33:0/3783920605 <== osd.11 v2:172.21.15.122:6824/2920209132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca340c2b60 con 0x7fca340bffa0 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.129+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 --> [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca48063cf0 con 0x7fca340bffa0 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.129+0000 7fca3f7fe640 1 -- 172.21.15.33:0/3783920605 <== osd.11 v2:172.21.15.122:6824/2920209132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca48063cf0 con 0x7fca340bffa0 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.129+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 >> [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] conn(0x7fca340bffa0 msgr2=0x7fca340c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.129+0000 7fca50700640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] conn(0x7fca340bffa0 0x7fca340c2490 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.129+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca340b4c10 msgr2=0x7fca340b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.129+0000 7fca50700640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca340b4c10 0x7fca340b7120 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fca4810f4d0 tx=0x7fca38005e50 comp rx=0 tx=0).stop 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.130+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca481047d0 msgr2=0x7fca4819a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.130+0000 7fca50700640 1 --2- 172.21.15.33:0/3783920605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca481047d0 0x7fca4819a320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fca44005940 tx=0x7fca440042f0 comp rx=0 tx=0).stop 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.130+0000 7fca4ec9d640 1 -- 172.21.15.33:0/3783920605 reap_dead start 2024-08-28T19:30:58.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.130+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 shutdown_connections 2024-08-28T19:30:58.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.130+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 >> 172.21.15.33:0/3783920605 conn(0x7fca48079510 msgr2=0x7fca480ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:58.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.130+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 shutdown_connections 2024-08-28T19:30:58.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:57.130+0000 7fca50700640 1 -- 172.21.15.33:0/3783920605 wait complete. 2024-08-28T19:30:58.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:30:58 smithi033 ceph-mon[18549]: pgmap v296: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-08-28T19:30:58.945 INFO:teuthology.orchestra.run.smithi033.stdout:292057776156 2024-08-28T19:30:58.946 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-28T19:30:59.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:30:58 smithi122 ceph-mon[22174]: pgmap v296: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-08-28T19:30:59.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:30:58 smithi059 ceph-mon[22052]: pgmap v296: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.321+0000 7fa717667640 1 -- 172.21.15.33:0/211534284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa710109ba0 msgr2=0x7fa7101103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.321+0000 7fa717667640 1 --2- 172.21.15.33:0/211534284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa710109ba0 0x7fa7101103d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa708009ca0 tx=0x7fa70802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.321+0000 7fa717667640 1 -- 172.21.15.33:0/211534284 shutdown_connections 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.321+0000 7fa717667640 1 --2- 172.21.15.33:0/211534284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa710109ba0 0x7fa7101103d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.321+0000 7fa717667640 1 --2- 172.21.15.33:0/211534284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa710109250 0x7fa710109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.321+0000 7fa717667640 1 --2- 172.21.15.33:0/211534284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa710103960 0x7fa710103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.321+0000 7fa717667640 1 -- 172.21.15.33:0/211534284 >> 172.21.15.33:0/211534284 conn(0x7fa71007b6b0 msgr2=0x7fa71007bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.321+0000 7fa717667640 1 -- 172.21.15.33:0/211534284 shutdown_connections 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.321+0000 7fa717667640 1 -- 172.21.15.33:0/211534284 wait complete. 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa717667640 1 Processor -- start 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa717667640 1 -- start start 2024-08-28T19:30:59.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa717667640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa710103960 0x7fa71019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa717667640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa710109250 0x7fa71019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa717667640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa710109ba0 0x7fa71019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa717667640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa710113860 con 0x7fa710103960 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa717667640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101136e0 con 0x7fa710109250 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa717667640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa7101139e0 con 0x7fa710109ba0 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa715403640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa710103960 0x7fa71019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa715403640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa710103960 0x7fa71019a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43144/0 (socket says 172.21.15.33:43144) 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa715403640 1 -- 172.21.15.33:0/656926037 learned_addr learned my addr 172.21.15.33:0/656926037 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.322+0000 7fa714c02640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa710109250 0x7fa71019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.323+0000 7fa715c04640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa710109ba0 0x7fa71019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.323+0000 7fa715403640 1 -- 172.21.15.33:0/656926037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa710109ba0 msgr2=0x7fa71019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:59.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.323+0000 7fa715403640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa710109ba0 0x7fa71019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.323+0000 7fa715403640 1 -- 172.21.15.33:0/656926037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa710109250 msgr2=0x7fa71019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.323+0000 7fa715403640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa710109250 0x7fa71019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.323+0000 7fa715403640 1 -- 172.21.15.33:0/656926037 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7101a01a0 con 0x7fa710103960 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.323+0000 7fa715403640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa710103960 0x7fa71019a230 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa70000e9f0 tx=0x7fa70000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.323+0000 7fa7067fc640 1 -- 172.21.15.33:0/656926037 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70000cd80 con 0x7fa710103960 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.323+0000 7fa7067fc640 1 -- 172.21.15.33:0/656926037 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7000054d0 con 0x7fa710103960 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.323+0000 7fa7067fc640 1 -- 172.21.15.33:0/656926037 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700010690 con 0x7fa710103960 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.324+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7101a0490 con 0x7fa710103960 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.324+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7101a6bf0 con 0x7fa710103960 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.324+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7100638b0 con 0x7fa710103960 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.326+0000 7fa7067fc640 1 -- 172.21.15.33:0/656926037 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa700004e30 con 0x7fa710103960 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.327+0000 7fa7067fc640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6fc0b4c90 0x7fa6fc0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.327+0000 7fa714c02640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6fc0b4c90 0x7fa6fc0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:59.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.327+0000 7fa7067fc640 1 -- 172.21.15.33:0/656926037 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fa7000e5ff0 con 0x7fa710103960 2024-08-28T19:30:59.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.327+0000 7fa7067fc640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] conn(0x7fa6fc0c0020 0x7fa6fc0c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:30:59.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.328+0000 7fa7067fc640 1 -- 172.21.15.33:0/656926037 --> [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa700025ea0 con 0x7fa6fc0c0020 2024-08-28T19:30:59.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.328+0000 7fa7067fc640 1 -- 172.21.15.33:0/656926037 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fa7000e63a0 con 0x7fa710103960 2024-08-28T19:30:59.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.328+0000 7fa714c02640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6fc0b4c90 0x7fa6fc0b71a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa710106d10 tx=0x7fa70c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:59.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.328+0000 7fa715c04640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] conn(0x7fa6fc0c0020 0x7fa6fc0c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:30:59.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.328+0000 7fa715c04640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] conn(0x7fa6fc0c0020 0x7fa6fc0c2510 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:30:59.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.329+0000 7fa7067fc640 1 -- 172.21.15.33:0/656926037 <== osd.1 v2:172.21.15.59:6800/4789314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa700025ea0 con 0x7fa6fc0c0020 2024-08-28T19:30:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.343+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 --> [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa710063d30 con 0x7fa6fc0c0020 2024-08-28T19:30:59.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.344+0000 7fa7067fc640 1 -- 172.21.15.33:0/656926037 <== osd.1 v2:172.21.15.59:6800/4789314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa710063d30 con 0x7fa6fc0c0020 2024-08-28T19:30:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.344+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 >> [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] conn(0x7fa6fc0c0020 msgr2=0x7fa6fc0c2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.344+0000 7fa717667640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] conn(0x7fa6fc0c0020 0x7fa6fc0c2510 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:30:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.345+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6fc0b4c90 msgr2=0x7fa6fc0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.345+0000 7fa717667640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6fc0b4c90 0x7fa6fc0b71a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa710106d10 tx=0x7fa70c005f90 comp rx=0 tx=0).stop 2024-08-28T19:30:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.345+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa710103960 msgr2=0x7fa71019a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:30:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.345+0000 7fa717667640 1 --2- 172.21.15.33:0/656926037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa710103960 0x7fa71019a230 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa70000e9f0 tx=0x7fa70000edf0 comp rx=0 tx=0).stop 2024-08-28T19:30:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.345+0000 7fa715c04640 1 -- 172.21.15.33:0/656926037 reap_dead start 2024-08-28T19:30:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.345+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 shutdown_connections 2024-08-28T19:30:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.345+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 >> 172.21.15.33:0/656926037 conn(0x7fa71007b6b0 msgr2=0x7fa710105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:30:59.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.345+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 shutdown_connections 2024-08-28T19:30:59.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.345+0000 7fa717667640 1 -- 172.21.15.33:0/656926037 wait complete. 2024-08-28T19:31:00.039 INFO:teuthology.orchestra.run.smithi033.stdout:270582939679 2024-08-28T19:31:00.040 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-28T19:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.218+0000 7fa0209d6640 1 -- 172.21.15.33:0/3485121170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c102800 msgr2=0x7fa01c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.218+0000 7fa0209d6640 1 --2- 172.21.15.33:0/3485121170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c102800 0x7fa01c102c10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009900 tx=0x7fa00c02a410 comp rx=0 tx=0).stop 2024-08-28T19:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.218+0000 7fa0209d6640 1 -- 172.21.15.33:0/3485121170 shutdown_connections 2024-08-28T19:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.218+0000 7fa0209d6640 1 --2- 172.21.15.33:0/3485121170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c108a90 0x7fa01c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.218+0000 7fa0209d6640 1 --2- 172.21.15.33:0/3485121170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa01c108140 0x7fa01c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.218+0000 7fa0209d6640 1 --2- 172.21.15.33:0/3485121170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c102800 0x7fa01c102c10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.218+0000 7fa0209d6640 1 -- 172.21.15.33:0/3485121170 >> 172.21.15.33:0/3485121170 conn(0x7fa01c0794d0 msgr2=0x7fa01c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.218+0000 7fa0209d6640 1 -- 172.21.15.33:0/3485121170 shutdown_connections 2024-08-28T19:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.219+0000 7fa0209d6640 1 -- 172.21.15.33:0/3485121170 wait complete. 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.220+0000 7fa0209d6640 1 Processor -- start 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.220+0000 7fa0209d6640 1 -- start start 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.220+0000 7fa0209d6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c102800 0x7fa01c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.220+0000 7fa0209d6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c108140 0x7fa01c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa0209d6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa01c108a90 0x7fa01c19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa0209d6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c113860 con 0x7fa01c108140 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa0209d6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c1136e0 con 0x7fa01c102800 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa0209d6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c1139e0 con 0x7fa01c108a90 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa019d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c108140 0x7fa01c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa019d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c108140 0x7fa01c19a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43126/0 (socket says 172.21.15.33:43126) 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa019d9b640 1 -- 172.21.15.33:0/2078993219 learned_addr learned my addr 172.21.15.33:0/2078993219 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa01a59c640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c102800 0x7fa01c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa01ad9d640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa01c108a90 0x7fa01c19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa019d9b640 1 -- 172.21.15.33:0/2078993219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa01c108a90 msgr2=0x7fa01c19fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa019d9b640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa01c108a90 0x7fa01c19fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa019d9b640 1 -- 172.21.15.33:0/2078993219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c102800 msgr2=0x7fa01c19a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa019d9b640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c102800 0x7fa01c19a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa019d9b640 1 -- 172.21.15.33:0/2078993219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01c1a01c0 con 0x7fa01c108140 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.221+0000 7fa019d9b640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c108140 0x7fa01c19a7f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa01000b450 tx=0x7fa01000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.222+0000 7fa00b7fe640 1 -- 172.21.15.33:0/2078993219 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa010015020 con 0x7fa01c108140 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.222+0000 7fa00b7fe640 1 -- 172.21.15.33:0/2078993219 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa010011d40 con 0x7fa01c108140 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.222+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01c1a04b0 con 0x7fa01c108140 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.222+0000 7fa00b7fe640 1 -- 172.21.15.33:0/2078993219 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01000f340 con 0x7fa01c108140 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.222+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa01c1a6c10 con 0x7fa01c108140 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.223+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa01c0638b0 con 0x7fa01c108140 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.225+0000 7fa00b7fe640 1 -- 172.21.15.33:0/2078993219 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa010018020 con 0x7fa01c108140 2024-08-28T19:31:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.226+0000 7fa00b7fe640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0040b4c10 0x7fa0040b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.226+0000 7fa00b7fe640 1 -- 172.21.15.33:0/2078993219 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fa0100e57b0 con 0x7fa01c108140 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.226+0000 7fa01a59c640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0040b4c10 0x7fa0040b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.227+0000 7fa00b7fe640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] conn(0x7fa0040bffa0 0x7fa0040c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.227+0000 7fa00b7fe640 1 -- 172.21.15.33:0/2078993219 --> [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa010021e70 con 0x7fa0040bffa0 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.227+0000 7fa00b7fe640 1 -- 172.21.15.33:0/2078993219 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fa0100e5c00 con 0x7fa01c108140 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.227+0000 7fa01ad9d640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] conn(0x7fa0040bffa0 0x7fa0040c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.227+0000 7fa01a59c640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0040b4c10 0x7fa0040b7120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa00c031440 tx=0x7fa00c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.227+0000 7fa01ad9d640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] conn(0x7fa0040bffa0 0x7fa0040c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.228+0000 7fa00b7fe640 1 -- 172.21.15.33:0/2078993219 <== osd.3 v2:172.21.15.33:6810/3029290427 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa010021e70 con 0x7fa0040bffa0 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.242+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 --> [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa01c063cb0 con 0x7fa0040bffa0 2024-08-28T19:31:00.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.243+0000 7fa00b7fe640 1 -- 172.21.15.33:0/2078993219 <== osd.3 v2:172.21.15.33:6810/3029290427 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa01c063cb0 con 0x7fa0040bffa0 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.243+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] conn(0x7fa0040bffa0 msgr2=0x7fa0040c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.243+0000 7fa0209d6640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] conn(0x7fa0040bffa0 0x7fa0040c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.243+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0040b4c10 msgr2=0x7fa0040b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.243+0000 7fa0209d6640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0040b4c10 0x7fa0040b7120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa00c031440 tx=0x7fa00c009560 comp rx=0 tx=0).stop 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.244+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c108140 msgr2=0x7fa01c19a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.244+0000 7fa0209d6640 1 --2- 172.21.15.33:0/2078993219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c108140 0x7fa01c19a7f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa01000b450 tx=0x7fa01000b910 comp rx=0 tx=0).stop 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.244+0000 7fa01ad9d640 1 -- 172.21.15.33:0/2078993219 reap_dead start 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.244+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 shutdown_connections 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.244+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 >> 172.21.15.33:0/2078993219 conn(0x7fa01c0794d0 msgr2=0x7fa01c101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.244+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 shutdown_connections 2024-08-28T19:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:30:59.244+0000 7fa0209d6640 1 -- 172.21.15.33:0/2078993219 wait complete. 2024-08-28T19:31:00.762 INFO:teuthology.orchestra.run.smithi033.stdout:103079215171 2024-08-28T19:31:00.762 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-28T19:31:00.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:00 smithi033 ceph-mon[18549]: pgmap v297: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-28T19:31:01.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:00 smithi059 ceph-mon[22052]: pgmap v297: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-28T19:31:01.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:00 smithi122 ceph-mon[22174]: pgmap v297: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-28T19:31:01.526 INFO:teuthology.orchestra.run.smithi033.stdout:77309411399 2024-08-28T19:31:01.526 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-28T19:31:01.952 INFO:teuthology.orchestra.run.smithi033.stdout:150323855417 2024-08-28T19:31:01.953 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-28T19:31:02.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.984+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/3228626121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b8103920 msgr2=0x7fc2b8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.984+0000 7fc2bc8ea640 1 --2- 172.21.15.33:0/3228626121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b8103920 0x7fc2b8103d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009900 tx=0x7fc2a802a410 comp rx=0 tx=0).stop 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.984+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/3228626121 shutdown_connections 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.984+0000 7fc2bc8ea640 1 --2- 172.21.15.33:0/3228626121 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2b8109bb0 0x7fc2b81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.984+0000 7fc2bc8ea640 1 --2- 172.21.15.33:0/3228626121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b8109260 0x7fc2b8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.984+0000 7fc2bc8ea640 1 --2- 172.21.15.33:0/3228626121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b8103920 0x7fc2b8103d30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.984+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/3228626121 >> 172.21.15.33:0/3228626121 conn(0x7fc2b80ff3b0 msgr2=0x7fc2b8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.984+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/3228626121 shutdown_connections 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.984+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/3228626121 wait complete. 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.985+0000 7fc2bc8ea640 1 Processor -- start 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.985+0000 7fc2bc8ea640 1 -- start start 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2bc8ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b8103920 0x7fc2b819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2bc8ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2b8109260 0x7fc2b819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:02.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2bc8ea640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b8109bb0 0x7fc2b819fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:02.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2bc8ea640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b8113870 con 0x7fc2b8109bb0 2024-08-28T19:31:02.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2bc8ea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b81136f0 con 0x7fc2b8103920 2024-08-28T19:31:02.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2bc8ea640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b81139f0 con 0x7fc2b8109260 2024-08-28T19:31:02.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2b6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b8109bb0 0x7fc2b819fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:02.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2b6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b8109bb0 0x7fc2b819fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43170/0 (socket says 172.21.15.33:43170) 2024-08-28T19:31:02.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2b6d9d640 1 -- 172.21.15.33:0/201534460 learned_addr learned my addr 172.21.15.33:0/201534460 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:02.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2b659c640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b8103920 0x7fc2b819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:02.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2b5d9b640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2b8109260 0x7fc2b819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2b6d9d640 1 -- 172.21.15.33:0/201534460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2b8109260 msgr2=0x7fc2b819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2b6d9d640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2b8109260 0x7fc2b819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2b6d9d640 1 -- 172.21.15.33:0/201534460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b8103920 msgr2=0x7fc2b819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2b6d9d640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b8103920 0x7fc2b819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.986+0000 7fc2b6d9d640 1 -- 172.21.15.33:0/201534460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b81a0070 con 0x7fc2b8109bb0 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.987+0000 7fc2b6d9d640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b8109bb0 0x7fc2b819fa00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000cce0 tx=0x7fc2b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.987+0000 7fc2af7fe640 1 -- 172.21.15.33:0/201534460 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b000f450 con 0x7fc2b8109bb0 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.987+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b81a0360 con 0x7fc2b8109bb0 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.987+0000 7fc2af7fe640 1 -- 172.21.15.33:0/201534460 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b000faa0 con 0x7fc2b8109bb0 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.987+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b81a6b80 con 0x7fc2b8109bb0 2024-08-28T19:31:02.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.987+0000 7fc2af7fe640 1 -- 172.21.15.33:0/201534460 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0018a80 con 0x7fc2b8109bb0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.988+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2b80638f0 con 0x7fc2b8109bb0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.990+0000 7fc2af7fe640 1 -- 172.21.15.33:0/201534460 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fc2b000fc50 con 0x7fc2b8109bb0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.990+0000 7fc2af7fe640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc2a40b4c40 0x7fc2a40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.990+0000 7fc2b659c640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc2a40b4c40 0x7fc2a40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.990+0000 7fc2af7fe640 1 -- 172.21.15.33:0/201534460 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fc2b00e6170 con 0x7fc2b8109bb0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.991+0000 7fc2af7fe640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] conn(0x7fc2a40bffd0 0x7fc2a40c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.991+0000 7fc2af7fe640 1 -- 172.21.15.33:0/201534460 --> [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2a40c2b90 con 0x7fc2a40bffd0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.991+0000 7fc2af7fe640 1 -- 172.21.15.33:0/201534460 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fc2b00e65c0 con 0x7fc2b8109bb0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.991+0000 7fc2b5d9b640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] conn(0x7fc2a40bffd0 0x7fc2a40c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.991+0000 7fc2b659c640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc2a40b4c40 0x7fc2a40b7150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8031440 tx=0x7fc2a8005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.991+0000 7fc2b5d9b640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] conn(0x7fc2a40bffd0 0x7fc2a40c24c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:00.992+0000 7fc2af7fe640 1 -- 172.21.15.33:0/201534460 <== osd.9 v2:172.21.15.33:6826/3701959961 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2a40c2b90 con 0x7fc2a40bffd0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.006+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 --> [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc2b8063d70 con 0x7fc2a40bffd0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.006+0000 7fc2af7fe640 1 -- 172.21.15.33:0/201534460 <== osd.9 v2:172.21.15.33:6826/3701959961 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc2b8063d70 con 0x7fc2a40bffd0 2024-08-28T19:31:02.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.006+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] conn(0x7fc2a40bffd0 msgr2=0x7fc2a40c24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.006+0000 7fc2bc8ea640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] conn(0x7fc2a40bffd0 0x7fc2a40c24c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.006+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc2a40b4c40 msgr2=0x7fc2a40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.006+0000 7fc2bc8ea640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc2a40b4c40 0x7fc2a40b7150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8031440 tx=0x7fc2a8005e80 comp rx=0 tx=0).stop 2024-08-28T19:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.006+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b8109bb0 msgr2=0x7fc2b819fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.006+0000 7fc2bc8ea640 1 --2- 172.21.15.33:0/201534460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b8109bb0 0x7fc2b819fa00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000cce0 tx=0x7fc2b000a620 comp rx=0 tx=0).stop 2024-08-28T19:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.006+0000 7fc2b6d9d640 1 -- 172.21.15.33:0/201534460 reap_dead start 2024-08-28T19:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.007+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 shutdown_connections 2024-08-28T19:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.007+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 >> 172.21.15.33:0/201534460 conn(0x7fc2b80ff3b0 msgr2=0x7fc2b8108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.007+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 shutdown_connections 2024-08-28T19:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:01.007+0000 7fc2bc8ea640 1 -- 172.21.15.33:0/201534460 wait complete. 2024-08-28T19:31:02.707 INFO:teuthology.orchestra.run.smithi033.stdout:249108103206 2024-08-28T19:31:02.708 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-28T19:31:02.974 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:02 smithi033 ceph-mon[18549]: pgmap v298: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-28T19:31:02.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.972+0000 7fe7c0910640 1 -- 172.21.15.33:0/3951254569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7bc1081c0 msgr2=0x7fe7bc1085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:02.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.972+0000 7fe7c0910640 1 --2- 172.21.15.33:0/3951254569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7bc1081c0 0x7fe7bc1085d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009900 tx=0x7fe7a402a410 comp rx=0 tx=0).stop 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.972+0000 7fe7c0910640 1 -- 172.21.15.33:0/3951254569 shutdown_connections 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.972+0000 7fe7c0910640 1 --2- 172.21.15.33:0/3951254569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7bc108b10 0x7fe7bc10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.972+0000 7fe7c0910640 1 --2- 172.21.15.33:0/3951254569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7bc1081c0 0x7fe7bc1085d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.972+0000 7fe7c0910640 1 --2- 172.21.15.33:0/3951254569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc102880 0x7fe7bc102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.972+0000 7fe7c0910640 1 -- 172.21.15.33:0/3951254569 >> 172.21.15.33:0/3951254569 conn(0x7fe7bc079510 msgr2=0x7fe7bc079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.972+0000 7fe7c0910640 1 -- 172.21.15.33:0/3951254569 shutdown_connections 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.972+0000 7fe7c0910640 1 -- 172.21.15.33:0/3951254569 wait complete. 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.973+0000 7fe7c0910640 1 Processor -- start 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.973+0000 7fe7c0910640 1 -- start start 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7c0910640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7bc102880 0x7fe7bc19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7c0910640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7bc1081c0 0x7fe7bc19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7c0910640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc108b10 0x7fe7bc19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7c0910640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc112780 con 0x7fe7bc1081c0 2024-08-28T19:31:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7c0910640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc112600 con 0x7fe7bc108b10 2024-08-28T19:31:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7c0910640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc112900 con 0x7fe7bc102880 2024-08-28T19:31:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7b9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7bc1081c0 0x7fe7bc19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7b9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7bc1081c0 0x7fe7bc19a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43188/0 (socket says 172.21.15.33:43188) 2024-08-28T19:31:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7b9d9b640 1 -- 172.21.15.33:0/3471575426 learned_addr learned my addr 172.21.15.33:0/3471575426 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7ba59c640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7bc102880 0x7fe7bc19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7bad9d640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc108b10 0x7fe7bc19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7b9d9b640 1 -- 172.21.15.33:0/3471575426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7bc102880 msgr2=0x7fe7bc19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7b9d9b640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe7bc102880 0x7fe7bc19a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7b9d9b640 1 -- 172.21.15.33:0/3471575426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc108b10 msgr2=0x7fe7bc19fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7b9d9b640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc108b10 0x7fe7bc19fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7b9d9b640 1 -- 172.21.15.33:0/3471575426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7bc1a01d0 con 0x7fe7bc1081c0 2024-08-28T19:31:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.974+0000 7fe7bad9d640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc108b10 0x7fe7bc19fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:02.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.975+0000 7fe7b9d9b640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7bc1081c0 0x7fe7bc19a8c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe7a402a930 tx=0x7fe7a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:02.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.975+0000 7fe7b37fe640 1 -- 172.21.15.33:0/3471575426 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a403f030 con 0x7fe7bc1081c0 2024-08-28T19:31:02.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.975+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7bc1a0460 con 0x7fe7bc1081c0 2024-08-28T19:31:02.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.975+0000 7fe7b37fe640 1 -- 172.21.15.33:0/3471575426 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7a4003aa0 con 0x7fe7bc1081c0 2024-08-28T19:31:02.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.975+0000 7fe7b37fe640 1 -- 172.21.15.33:0/3471575426 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4035070 con 0x7fe7bc1081c0 2024-08-28T19:31:02.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.975+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7bc1a0940 con 0x7fe7bc1081c0 2024-08-28T19:31:02.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.976+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7bc101790 con 0x7fe7bc1081c0 2024-08-28T19:31:02.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.977+0000 7fe7b37fe640 1 -- 172.21.15.33:0/3471575426 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fe7a4042030 con 0x7fe7bc1081c0 2024-08-28T19:31:03.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.978+0000 7fe7b37fe640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7a80b4c40 0x7fe7a80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:03.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.978+0000 7fe7ba59c640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7a80b4c40 0x7fe7a80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:03.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.978+0000 7fe7b37fe640 1 -- 172.21.15.33:0/3471575426 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fe7a4106290 con 0x7fe7bc1081c0 2024-08-28T19:31:03.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.978+0000 7fe7b37fe640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] conn(0x7fe7a80bffd0 0x7fe7a80c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:03.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.978+0000 7fe7b37fe640 1 -- 172.21.15.33:0/3471575426 --> [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7a80c2b90 con 0x7fe7a80bffd0 2024-08-28T19:31:03.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.978+0000 7fe7b37fe640 1 -- 172.21.15.33:0/3471575426 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fe7a41066e0 con 0x7fe7bc1081c0 2024-08-28T19:31:03.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.979+0000 7fe7ba59c640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7a80b4c40 0x7fe7a80b7150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac005d00 tx=0x7fe7ac00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:03.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.979+0000 7fe7bad9d640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] conn(0x7fe7a80bffd0 0x7fe7a80c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:03.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.979+0000 7fe7bad9d640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] conn(0x7fe7a80bffd0 0x7fe7a80c24c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:03.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.980+0000 7fe7b37fe640 1 -- 172.21.15.33:0/3471575426 <== osd.4 v2:172.21.15.59:6808/1846789245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7a80c2b90 con 0x7fe7a80bffd0 2024-08-28T19:31:03.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.996+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 --> [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe7bc06b130 con 0x7fe7a80bffd0 2024-08-28T19:31:03.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.996+0000 7fe7b37fe640 1 -- 172.21.15.33:0/3471575426 <== osd.4 v2:172.21.15.59:6808/1846789245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe7bc06b130 con 0x7fe7a80bffd0 2024-08-28T19:31:03.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 >> [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] conn(0x7fe7a80bffd0 msgr2=0x7fe7a80c24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:03.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7c0910640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] conn(0x7fe7a80bffd0 0x7fe7a80c24c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:03.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7a80b4c40 msgr2=0x7fe7a80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:03.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7c0910640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7a80b4c40 0x7fe7a80b7150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac005d00 tx=0x7fe7ac00b410 comp rx=0 tx=0).stop 2024-08-28T19:31:03.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7bc1081c0 msgr2=0x7fe7bc19a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:03.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7c0910640 1 --2- 172.21.15.33:0/3471575426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7bc1081c0 0x7fe7bc19a8c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe7a402a930 tx=0x7fe7a4004270 comp rx=0 tx=0).stop 2024-08-28T19:31:03.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7bad9d640 1 -- 172.21.15.33:0/3471575426 reap_dead start 2024-08-28T19:31:03.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 shutdown_connections 2024-08-28T19:31:03.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 >> 172.21.15.33:0/3471575426 conn(0x7fe7bc079510 msgr2=0x7fe7bc06bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:03.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 shutdown_connections 2024-08-28T19:31:03.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:02.997+0000 7fe7c0910640 1 -- 172.21.15.33:0/3471575426 wait complete. 2024-08-28T19:31:03.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:02 smithi059 ceph-mon[22052]: pgmap v298: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-28T19:31:03.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:02 smithi122 ceph-mon[22174]: pgmap v298: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-28T19:31:04.239 INFO:teuthology.orchestra.run.smithi033.stdout:60129542221 2024-08-28T19:31:04.240 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-28T19:31:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.677+0000 7f7f0e51e640 1 -- 172.21.15.33:0/1972385486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f08103900 msgr2=0x7f7f08103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.677+0000 7f7f0e51e640 1 --2- 172.21.15.33:0/1972385486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f08103900 0x7f7f08103d10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009900 tx=0x7f7ef802a410 comp rx=0 tx=0).stop 2024-08-28T19:31:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.677+0000 7f7f0e51e640 1 -- 172.21.15.33:0/1972385486 shutdown_connections 2024-08-28T19:31:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.677+0000 7f7f0e51e640 1 --2- 172.21.15.33:0/1972385486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f08109b90 0x7f7f081103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.677+0000 7f7f0e51e640 1 --2- 172.21.15.33:0/1972385486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f08109240 0x7f7f08109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.677+0000 7f7f0e51e640 1 --2- 172.21.15.33:0/1972385486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f08103900 0x7f7f08103d10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.677+0000 7f7f0e51e640 1 -- 172.21.15.33:0/1972385486 >> 172.21.15.33:0/1972385486 conn(0x7f7f0807b5f0 msgr2=0x7f7f0807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.677+0000 7f7f0e51e640 1 -- 172.21.15.33:0/1972385486 shutdown_connections 2024-08-28T19:31:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.677+0000 7f7f0e51e640 1 -- 172.21.15.33:0/1972385486 wait complete. 2024-08-28T19:31:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.678+0000 7f7f0e51e640 1 Processor -- start 2024-08-28T19:31:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.678+0000 7f7f0e51e640 1 -- start start 2024-08-28T19:31:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.678+0000 7f7f0e51e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f08103900 0x7f7f080754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.678+0000 7f7f0e51e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f08109240 0x7f7f080759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.678+0000 7f7f0e51e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f08109b90 0x7f7f08075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.678+0000 7f7f0e51e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7f08113850 con 0x7f7f08103900 2024-08-28T19:31:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.678+0000 7f7f0e51e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081136d0 con 0x7f7f08109240 2024-08-28T19:31:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.678+0000 7f7f0e51e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f081139d0 con 0x7f7f08109b90 2024-08-28T19:31:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.678+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f08103900 0x7f7f080754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f08103900 0x7f7f080754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43208/0 (socket says 172.21.15.33:43208) 2024-08-28T19:31:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f07fff640 1 -- 172.21.15.33:0/2952835621 learned_addr learned my addr 172.21.15.33:0/2952835621 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f077fe640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f08109240 0x7f7f080759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f0cabb640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f08109b90 0x7f7f08075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f07fff640 1 -- 172.21.15.33:0/2952835621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f08109b90 msgr2=0x7f7f08075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f07fff640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f08109b90 0x7f7f08075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f07fff640 1 -- 172.21.15.33:0/2952835621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f08109240 msgr2=0x7f7f080759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f07fff640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f08109240 0x7f7f080759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f07fff640 1 -- 172.21.15.33:0/2952835621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f081a8580 con 0x7f7f08103900 2024-08-28T19:31:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f0cabb640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f08109b90 0x7f7f08075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:31:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f07fff640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f08103900 0x7f7f080754b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8005940 tx=0x7f7ef80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f057fa640 1 -- 172.21.15.33:0/2952835621 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef803f030 con 0x7f7f08103900 2024-08-28T19:31:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f057fa640 1 -- 172.21.15.33:0/2952835621 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ef8003cb0 con 0x7f7f08103900 2024-08-28T19:31:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f057fa640 1 -- 172.21.15.33:0/2952835621 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8035070 con 0x7f7f08103900 2024-08-28T19:31:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f081a8810 con 0x7f7f08103900 2024-08-28T19:31:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.679+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f081a8d40 con 0x7f7f08103900 2024-08-28T19:31:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.680+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f080638b0 con 0x7f7f08103900 2024-08-28T19:31:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.682+0000 7f7f057fa640 1 -- 172.21.15.33:0/2952835621 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f7ef8042030 con 0x7f7f08103900 2024-08-28T19:31:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.683+0000 7f7f057fa640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7ef00b4c90 0x7f7ef00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.683+0000 7f7f077fe640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7ef00b4c90 0x7f7ef00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.683+0000 7f7f057fa640 1 -- 172.21.15.33:0/2952835621 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f7ef8106380 con 0x7f7f08103900 2024-08-28T19:31:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.683+0000 7f7f057fa640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] conn(0x7f7ef00bfef0 0x7f7ef00c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:04.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.683+0000 7f7f057fa640 1 -- 172.21.15.33:0/2952835621 --> [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ef8032970 con 0x7f7ef00bfef0 2024-08-28T19:31:04.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.683+0000 7f7f057fa640 1 -- 172.21.15.33:0/2952835621 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f7ef8106730 con 0x7f7f08103900 2024-08-28T19:31:04.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.683+0000 7f7f077fe640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7ef00b4c90 0x7f7ef00b71a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f08108fa0 tx=0x7f7efc00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:04.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.683+0000 7f7f0cabb640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] conn(0x7f7ef00bfef0 0x7f7ef00c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:04.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.684+0000 7f7f0cabb640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] conn(0x7f7ef00bfef0 0x7f7ef00c23e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:04.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.684+0000 7f7f057fa640 1 -- 172.21.15.33:0/2952835621 <== osd.0 v2:172.21.15.33:6802/758428304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ef8032970 con 0x7f7ef00bfef0 2024-08-28T19:31:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.698+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 --> [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f08063cb0 con 0x7f7ef00bfef0 2024-08-28T19:31:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.698+0000 7f7f057fa640 1 -- 172.21.15.33:0/2952835621 <== osd.0 v2:172.21.15.33:6802/758428304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7f08063cb0 con 0x7f7ef00bfef0 2024-08-28T19:31:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] conn(0x7f7ef00bfef0 msgr2=0x7f7ef00c23e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0e51e640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] conn(0x7f7ef00bfef0 0x7f7ef00c23e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7ef00b4c90 msgr2=0x7f7ef00b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0e51e640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7ef00b4c90 0x7f7ef00b71a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f08108fa0 tx=0x7f7efc00b410 comp rx=0 tx=0).stop 2024-08-28T19:31:04.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f08103900 msgr2=0x7f7f080754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:04.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0e51e640 1 --2- 172.21.15.33:0/2952835621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f08103900 0x7f7f080754b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8005940 tx=0x7f7ef80042f0 comp rx=0 tx=0).stop 2024-08-28T19:31:04.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0cabb640 1 -- 172.21.15.33:0/2952835621 reap_dead start 2024-08-28T19:31:04.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 shutdown_connections 2024-08-28T19:31:04.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 >> 172.21.15.33:0/2952835621 conn(0x7f7f0807b5f0 msgr2=0x7f7f08107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:04.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 shutdown_connections 2024-08-28T19:31:04.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:03.699+0000 7f7f0e51e640 1 -- 172.21.15.33:0/2952835621 wait complete. 2024-08-28T19:31:05.085 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:04 smithi059 ceph-mon[22052]: pgmap v299: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-28T19:31:05.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:04 smithi033 ceph-mon[18549]: pgmap v299: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-28T19:31:05.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:04 smithi122 ceph-mon[22174]: pgmap v299: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-28T19:31:05.312 INFO:teuthology.orchestra.run.smithi033.stdout:38654705746 2024-08-28T19:31:05.312 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-28T19:31:06.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.038+0000 7f40d7b02640 1 -- 172.21.15.33:0/293565741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d010dbc0 msgr2=0x7f40d01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.038+0000 7f40d7b02640 1 --2- 172.21.15.33:0/293565741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d010dbc0 0x7f40d01100a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009ca0 tx=0x7f40c802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.038+0000 7f40d7b02640 1 -- 172.21.15.33:0/293565741 shutdown_connections 2024-08-28T19:31:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.038+0000 7f40d7b02640 1 --2- 172.21.15.33:0/293565741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d010dbc0 0x7f40d01100a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.038+0000 7f40d7b02640 1 --2- 172.21.15.33:0/293565741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40d0105040 0x7f40d010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.038+0000 7f40d7b02640 1 --2- 172.21.15.33:0/293565741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d0104610 0x7f40d0104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.038+0000 7f40d7b02640 1 -- 172.21.15.33:0/293565741 >> 172.21.15.33:0/293565741 conn(0x7f40d00794d0 msgr2=0x7f40d00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.039+0000 7f40d7b02640 1 -- 172.21.15.33:0/293565741 shutdown_connections 2024-08-28T19:31:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.039+0000 7f40d7b02640 1 -- 172.21.15.33:0/293565741 wait complete. 2024-08-28T19:31:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.039+0000 7f40d7b02640 1 Processor -- start 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.039+0000 7f40d7b02640 1 -- start start 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.039+0000 7f40d7b02640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40d0104610 0x7f40d019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d7b02640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d0105040 0x7f40d019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d7b02640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d010dbc0 0x7f40d019fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d7b02640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f40d0113810 con 0x7f40d0105040 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d7b02640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f40d0113690 con 0x7f40d010dbc0 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d7b02640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f40d0113990 con 0x7f40d0104610 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d509d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d0105040 0x7f40d019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d509d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d0105040 0x7f40d019a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43232/0 (socket says 172.21.15.33:43232) 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d509d640 1 -- 172.21.15.33:0/3870878003 learned_addr learned my addr 172.21.15.33:0/3870878003 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d589e640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40d0104610 0x7f40d019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d609f640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d010dbc0 0x7f40d019fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d509d640 1 -- 172.21.15.33:0/3870878003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40d0104610 msgr2=0x7f40d019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d509d640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40d0104610 0x7f40d019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d509d640 1 -- 172.21.15.33:0/3870878003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d010dbc0 msgr2=0x7f40d019fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d509d640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d010dbc0 0x7f40d019fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d509d640 1 -- 172.21.15.33:0/3870878003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d01a0090 con 0x7f40d0105040 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d609f640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d010dbc0 0x7f40d019fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d509d640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d0105040 0x7f40d019a780 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f40c000c8c0 tx=0x7f40c000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40c6ffd640 1 -- 172.21.15.33:0/3870878003 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0007bb0 con 0x7f40d0105040 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d01a0380 con 0x7f40d0105040 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40c6ffd640 1 -- 172.21.15.33:0/3870878003 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40c0007d50 con 0x7f40d0105040 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.040+0000 7f40c6ffd640 1 -- 172.21.15.33:0/3870878003 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c00186a0 con 0x7f40d0105040 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.041+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d01a6ba0 con 0x7f40d0105040 2024-08-28T19:31:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.041+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f40d0063870 con 0x7f40d0105040 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.043+0000 7f40c6ffd640 1 -- 172.21.15.33:0/3870878003 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f40c000f450 con 0x7f40d0105040 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.044+0000 7f40c6ffd640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40bc0b4c40 0x7f40bc0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.044+0000 7f40d589e640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40bc0b4c40 0x7f40bc0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.044+0000 7f40c6ffd640 1 -- 172.21.15.33:0/3870878003 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f40c00e5ca0 con 0x7f40d0105040 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.044+0000 7f40c6ffd640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] conn(0x7f40bc0bffd0 0x7f40bc0c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.044+0000 7f40c6ffd640 1 -- 172.21.15.33:0/3870878003 --> [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40c001ee50 con 0x7f40bc0bffd0 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.044+0000 7f40c6ffd640 1 -- 172.21.15.33:0/3870878003 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f40c00e60f0 con 0x7f40d0105040 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.044+0000 7f40d609f640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] conn(0x7f40bc0bffd0 0x7f40bc0c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.044+0000 7f40d589e640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40bc0b4c40 0x7f40bc0b7150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00abe0 tx=0x7f40cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.045+0000 7f40d609f640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] conn(0x7f40bc0bffd0 0x7f40bc0c24c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.045+0000 7f40c6ffd640 1 -- 172.21.15.33:0/3870878003 <== osd.6 v2:172.21.15.33:6818/1759127784 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f40c001ee50 con 0x7f40bc0bffd0 2024-08-28T19:31:06.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.060+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 --> [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f40d0063cf0 con 0x7f40bc0bffd0 2024-08-28T19:31:06.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.060+0000 7f40c6ffd640 1 -- 172.21.15.33:0/3870878003 <== osd.6 v2:172.21.15.33:6818/1759127784 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f40d0063cf0 con 0x7f40bc0bffd0 2024-08-28T19:31:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.060+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] conn(0x7f40bc0bffd0 msgr2=0x7f40bc0c24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.060+0000 7f40d7b02640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] conn(0x7f40bc0bffd0 0x7f40bc0c24c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.061+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40bc0b4c40 msgr2=0x7f40bc0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.061+0000 7f40d7b02640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40bc0b4c40 0x7f40bc0b7150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00abe0 tx=0x7f40cc00a2d0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.061+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d0105040 msgr2=0x7f40d019a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.061+0000 7f40d7b02640 1 --2- 172.21.15.33:0/3870878003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40d0105040 0x7f40d019a780 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f40c000c8c0 tx=0x7f40c000ccc0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.061+0000 7f40d609f640 1 -- 172.21.15.33:0/3870878003 reap_dead start 2024-08-28T19:31:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.061+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 shutdown_connections 2024-08-28T19:31:06.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.061+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 >> 172.21.15.33:0/3870878003 conn(0x7f40d00794d0 msgr2=0x7f40d01055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:06.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.061+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 shutdown_connections 2024-08-28T19:31:06.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.061+0000 7f40d7b02640 1 -- 172.21.15.33:0/3870878003 wait complete. 2024-08-28T19:31:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.541+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/3534228143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e4104800 msgr2=0x7fb5e4104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.541+0000 7fb5e8fc8640 1 --2- 172.21.15.33:0/3534228143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e4104800 0x7fb5e4104c10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009900 tx=0x7fb5d402a410 comp rx=0 tx=0).stop 2024-08-28T19:31:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.541+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/3534228143 shutdown_connections 2024-08-28T19:31:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.541+0000 7fb5e8fc8640 1 --2- 172.21.15.33:0/3534228143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e410dc60 0x7fb5e4110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.541+0000 7fb5e8fc8640 1 --2- 172.21.15.33:0/3534228143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e4105150 0x7fb5e410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.541+0000 7fb5e8fc8640 1 --2- 172.21.15.33:0/3534228143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e4104800 0x7fb5e4104c10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.541+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/3534228143 >> 172.21.15.33:0/3534228143 conn(0x7fb5e4079470 msgr2=0x7fb5e4079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.541+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/3534228143 shutdown_connections 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.541+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/3534228143 wait complete. 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.542+0000 7fb5e8fc8640 1 Processor -- start 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.542+0000 7fb5e8fc8640 1 -- start start 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.542+0000 7fb5e8fc8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e4104800 0x7fb5e419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.542+0000 7fb5e8fc8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e4105150 0x7fb5e419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.542+0000 7fb5e8fc8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e410dc60 0x7fb5e419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.542+0000 7fb5e8fc8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e41138e0 con 0x7fb5e410dc60 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.542+0000 7fb5e8fc8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4113760 con 0x7fb5e4104800 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.542+0000 7fb5e8fc8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4113a60 con 0x7fb5e4105150 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e410dc60 0x7fb5e419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e410dc60 0x7fb5e419fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43256/0 (socket says 172.21.15.33:43256) 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e2d9d640 1 -- 172.21.15.33:0/790680145 learned_addr learned my addr 172.21.15.33:0/790680145 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5d9d9b640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e4105150 0x7fb5e419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e259c640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e4104800 0x7fb5e419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e2d9d640 1 -- 172.21.15.33:0/790680145 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e4105150 msgr2=0x7fb5e419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e2d9d640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb5e4105150 0x7fb5e419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e2d9d640 1 -- 172.21.15.33:0/790680145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e4104800 msgr2=0x7fb5e419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e2d9d640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5e4104800 0x7fb5e419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e2d9d640 1 -- 172.21.15.33:0/790680145 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e41a0260 con 0x7fb5e410dc60 2024-08-28T19:31:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e2d9d640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e410dc60 0x7fb5e419fb30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00cad0 tx=0x7fb5dc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5dbfff640 1 -- 172.21.15.33:0/790680145 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00ae20 con 0x7fb5e410dc60 2024-08-28T19:31:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e41a0550 con 0x7fb5e410dc60 2024-08-28T19:31:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5dbfff640 1 -- 172.21.15.33:0/790680145 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5dc005020 con 0x7fb5e410dc60 2024-08-28T19:31:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.543+0000 7fb5dbfff640 1 -- 172.21.15.33:0/790680145 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00f6b0 con 0x7fb5e410dc60 2024-08-28T19:31:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.544+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e41a6cb0 con 0x7fb5e410dc60 2024-08-28T19:31:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.544+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5e4108120 con 0x7fb5e410dc60 2024-08-28T19:31:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.546+0000 7fb5dbfff640 1 -- 172.21.15.33:0/790680145 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fb5dc0051d0 con 0x7fb5e410dc60 2024-08-28T19:31:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.547+0000 7fb5dbfff640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb5d00b4c10 0x7fb5d00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.547+0000 7fb5e259c640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb5d00b4c10 0x7fb5d00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.547+0000 7fb5dbfff640 1 -- 172.21.15.33:0/790680145 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fb5dc0e5b90 con 0x7fb5e410dc60 2024-08-28T19:31:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.547+0000 7fb5dbfff640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] conn(0x7fb5d00bffa0 0x7fb5d00c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.547+0000 7fb5dbfff640 1 -- 172.21.15.33:0/790680145 --> [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5dc016ec0 con 0x7fb5d00bffa0 2024-08-28T19:31:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.547+0000 7fb5dbfff640 1 -- 172.21.15.33:0/790680145 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fb5dc0e5f40 con 0x7fb5e410dc60 2024-08-28T19:31:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.547+0000 7fb5e259c640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb5d00b4c10 0x7fb5d00b7120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4031440 tx=0x7fb5d4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.547+0000 7fb5d9d9b640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] conn(0x7fb5d00bffa0 0x7fb5d00c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.548+0000 7fb5d9d9b640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] conn(0x7fb5d00bffa0 0x7fb5d00c2490 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:06.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.549+0000 7fb5dbfff640 1 -- 172.21.15.33:0/790680145 <== osd.8 v2:172.21.15.122:6816/3673274503 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5dc016ec0 con 0x7fb5d00bffa0 2024-08-28T19:31:06.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.562+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 --> [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5e406c000 con 0x7fb5d00bffa0 2024-08-28T19:31:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.563+0000 7fb5dbfff640 1 -- 172.21.15.33:0/790680145 <== osd.8 v2:172.21.15.122:6816/3673274503 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb5e406c000 con 0x7fb5d00bffa0 2024-08-28T19:31:06.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.563+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 >> [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] conn(0x7fb5d00bffa0 msgr2=0x7fb5d00c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.563+0000 7fb5e8fc8640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] conn(0x7fb5d00bffa0 0x7fb5d00c2490 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:06.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.563+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb5d00b4c10 msgr2=0x7fb5d00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.563+0000 7fb5e8fc8640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb5d00b4c10 0x7fb5d00b7120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4031440 tx=0x7fb5d4009560 comp rx=0 tx=0).stop 2024-08-28T19:31:06.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.563+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e410dc60 msgr2=0x7fb5e419fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:06.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.563+0000 7fb5e8fc8640 1 --2- 172.21.15.33:0/790680145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5e410dc60 0x7fb5e419fb30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00cad0 tx=0x7fb5dc00cf90 comp rx=0 tx=0).stop 2024-08-28T19:31:06.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.563+0000 7fb5e2d9d640 1 -- 172.21.15.33:0/790680145 reap_dead start 2024-08-28T19:31:06.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.563+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 shutdown_connections 2024-08-28T19:31:06.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.563+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 >> 172.21.15.33:0/790680145 conn(0x7fb5e4079470 msgr2=0x7fb5e4107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:06.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.564+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 shutdown_connections 2024-08-28T19:31:06.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:06.564+0000 7fb5e8fc8640 1 -- 172.21.15.33:0/790680145 wait complete. 2024-08-28T19:31:07.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.020+0000 7f71c2a1f640 1 -- 172.21.15.33:0/257144302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71bc1081c0 msgr2=0x7f71bc1085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.020+0000 7f71c2a1f640 1 --2- 172.21.15.33:0/257144302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71bc1081c0 0x7f71bc1085d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009900 tx=0x7f71b002a410 comp rx=0 tx=0).stop 2024-08-28T19:31:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.020+0000 7f71c2a1f640 1 -- 172.21.15.33:0/257144302 shutdown_connections 2024-08-28T19:31:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.020+0000 7f71c2a1f640 1 --2- 172.21.15.33:0/257144302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71bc108b10 0x7f71bc10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.020+0000 7f71c2a1f640 1 --2- 172.21.15.33:0/257144302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71bc1081c0 0x7f71bc1085d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.020+0000 7f71c2a1f640 1 --2- 172.21.15.33:0/257144302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc102880 0x7f71bc102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.021+0000 7f71c2a1f640 1 -- 172.21.15.33:0/257144302 >> 172.21.15.33:0/257144302 conn(0x7f71bc079510 msgr2=0x7f71bc079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.021+0000 7f71c2a1f640 1 -- 172.21.15.33:0/257144302 shutdown_connections 2024-08-28T19:31:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.021+0000 7f71c2a1f640 1 -- 172.21.15.33:0/257144302 wait complete. 2024-08-28T19:31:07.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.021+0000 7f71c2a1f640 1 Processor -- start 2024-08-28T19:31:07.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.021+0000 7f71c2a1f640 1 -- start start 2024-08-28T19:31:07.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71c2a1f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71bc102880 0x7f71bc19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:07.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71c2a1f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71bc1081c0 0x7f71bc19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71c2a1f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc108b10 0x7f71bc19fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71c2a1f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1138c0 con 0x7f71bc1081c0 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71c2a1f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc113740 con 0x7f71bc108b10 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71c2a1f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc113a40 con 0x7f71bc102880 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71bb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71bc1081c0 0x7f71bc19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71bb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71bc1081c0 0x7f71bc19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43262/0 (socket says 172.21.15.33:43262) 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71bb7fe640 1 -- 172.21.15.33:0/2974909782 learned_addr learned my addr 172.21.15.33:0/2974909782 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71bbfff640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71bc102880 0x7f71bc19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71c0fbc640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc108b10 0x7f71bc19fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71bb7fe640 1 -- 172.21.15.33:0/2974909782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71bc102880 msgr2=0x7f71bc19a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71bb7fe640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f71bc102880 0x7f71bc19a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71bb7fe640 1 -- 172.21.15.33:0/2974909782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc108b10 msgr2=0x7f71bc19fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71bb7fe640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc108b10 0x7f71bc19fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71bb7fe640 1 -- 172.21.15.33:0/2974909782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71bc1a0240 con 0x7f71bc1081c0 2024-08-28T19:31:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.022+0000 7f71bb7fe640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71bc1081c0 0x7f71bc19a870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71b002a930 tx=0x7f71b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.023+0000 7f71b97fa640 1 -- 172.21.15.33:0/2974909782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b003f030 con 0x7f71bc1081c0 2024-08-28T19:31:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.023+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71bc1a04d0 con 0x7f71bc1081c0 2024-08-28T19:31:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.023+0000 7f71b97fa640 1 -- 172.21.15.33:0/2974909782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71b0003aa0 con 0x7f71bc1081c0 2024-08-28T19:31:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.023+0000 7f71b97fa640 1 -- 172.21.15.33:0/2974909782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0035070 con 0x7f71bc1081c0 2024-08-28T19:31:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.023+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71bc1a6c90 con 0x7f71bc1081c0 2024-08-28T19:31:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.023+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71bc063830 con 0x7f71bc1081c0 2024-08-28T19:31:07.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.025+0000 7f71b97fa640 1 -- 172.21.15.33:0/2974909782 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f71b0042030 con 0x7f71bc1081c0 2024-08-28T19:31:07.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.026+0000 7f71b97fa640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71a40b4c10 0x7f71a40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:07.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.026+0000 7f71bbfff640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71a40b4c10 0x7f71a40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:07.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.026+0000 7f71b97fa640 1 -- 172.21.15.33:0/2974909782 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f71b01062c0 con 0x7f71bc1081c0 2024-08-28T19:31:07.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.026+0000 7f71b97fa640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] conn(0x7f71a40bffa0 0x7f71a40c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:07.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.026+0000 7f71b97fa640 1 -- 172.21.15.33:0/2974909782 --> [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71b0036e90 con 0x7f71a40bffa0 2024-08-28T19:31:07.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.026+0000 7f71b97fa640 1 -- 172.21.15.33:0/2974909782 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f71b0106670 con 0x7f71bc1081c0 2024-08-28T19:31:07.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.027+0000 7f71bbfff640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71a40b4c10 0x7f71a40b7120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00bbe0 tx=0x7f71ac00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:07.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.027+0000 7f71c0fbc640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] conn(0x7f71a40bffa0 0x7f71a40c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:07.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.027+0000 7f71c0fbc640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] conn(0x7f71a40bffa0 0x7f71a40c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:07.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.028+0000 7f71b97fa640 1 -- 172.21.15.33:0/2974909782 <== osd.7 v2:172.21.15.59:6816/4018917656 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71b0036e90 con 0x7f71a40bffa0 2024-08-28T19:31:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.042+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 --> [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f71bc063c60 con 0x7f71a40bffa0 2024-08-28T19:31:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.042+0000 7f71b97fa640 1 -- 172.21.15.33:0/2974909782 <== osd.7 v2:172.21.15.59:6816/4018917656 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f71bc063c60 con 0x7f71a40bffa0 2024-08-28T19:31:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 >> [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] conn(0x7f71a40bffa0 msgr2=0x7f71a40c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c2a1f640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] conn(0x7f71a40bffa0 0x7f71a40c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71a40b4c10 msgr2=0x7f71a40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c2a1f640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f71a40b4c10 0x7f71a40b7120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00bbe0 tx=0x7f71ac00b390 comp rx=0 tx=0).stop 2024-08-28T19:31:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71bc1081c0 msgr2=0x7f71bc19a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c2a1f640 1 --2- 172.21.15.33:0/2974909782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71bc1081c0 0x7f71bc19a870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71b002a930 tx=0x7f71b0004270 comp rx=0 tx=0).stop 2024-08-28T19:31:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c0fbc640 1 -- 172.21.15.33:0/2974909782 reap_dead start 2024-08-28T19:31:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 shutdown_connections 2024-08-28T19:31:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 >> 172.21.15.33:0/2974909782 conn(0x7f71bc079510 msgr2=0x7f71bc1041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 shutdown_connections 2024-08-28T19:31:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:07.043+0000 7f71c2a1f640 1 -- 172.21.15.33:0/2974909782 wait complete. 2024-08-28T19:31:07.054 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:06 smithi033 ceph-mon[18549]: pgmap v300: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-08-28T19:31:07.095 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:06 smithi122 ceph-mon[22174]: pgmap v300: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-08-28T19:31:07.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:06 smithi059 ceph-mon[22052]: pgmap v300: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-08-28T19:31:07.426 INFO:teuthology.orchestra.run.smithi033.stdout:128849018942 2024-08-28T19:31:07.426 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-28T19:31:08.153 INFO:teuthology.orchestra.run.smithi033.stdout:197568495664 2024-08-28T19:31:08.154 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-28T19:31:08.668 INFO:teuthology.orchestra.run.smithi033.stdout:223338299437 2024-08-28T19:31:08.668 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-28T19:31:09.104 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:08 smithi033 ceph-mon[18549]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:31:09.115 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:09.119 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:09.171 INFO:teuthology.orchestra.run.smithi033.stdout:176093659190 2024-08-28T19:31:09.172 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-28T19:31:09.188 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:09.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:08 smithi059 ceph-mon[22052]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:31:09.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:08 smithi122 ceph-mon[22174]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:31:09.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.987+0000 7f847984f640 1 -- 172.21.15.33:0/3057777185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8474108aa0 msgr2=0x7f847410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:09.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.987+0000 7f847984f640 1 --2- 172.21.15.33:0/3057777185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8474108aa0 0x7f847410f2d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f846c009ca0 tx=0x7f846c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:09.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.987+0000 7f847984f640 1 -- 172.21.15.33:0/3057777185 shutdown_connections 2024-08-28T19:31:09.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.987+0000 7f847984f640 1 --2- 172.21.15.33:0/3057777185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8474108aa0 0x7f847410f2d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:09.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.987+0000 7f847984f640 1 --2- 172.21.15.33:0/3057777185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8474108150 0x7f8474108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.987+0000 7f847984f640 1 --2- 172.21.15.33:0/3057777185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8474102860 0x7f8474102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.987+0000 7f847984f640 1 -- 172.21.15.33:0/3057777185 >> 172.21.15.33:0/3057777185 conn(0x7f84740794c0 msgr2=0x7f84740798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.987+0000 7f847984f640 1 -- 172.21.15.33:0/3057777185 shutdown_connections 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.987+0000 7f847984f640 1 -- 172.21.15.33:0/3057777185 wait complete. 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.988+0000 7f847984f640 1 Processor -- start 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.988+0000 7f847984f640 1 -- start start 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.988+0000 7f847984f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8474102860 0x7f847419af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.988+0000 7f847984f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8474108150 0x7f847419b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.988+0000 7f847984f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8474108aa0 0x7f847419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.988+0000 7f847984f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8474112750 con 0x7f8474102860 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.988+0000 7f847984f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f84741125d0 con 0x7f8474108aa0 2024-08-28T19:31:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.988+0000 7f847984f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f84741128d0 con 0x7f8474108150 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.988+0000 7f8472ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8474102860 0x7f847419af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f8472ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8474102860 0x7f847419af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52290/0 (socket says 172.21.15.33:52290) 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f8472ffd640 1 -- 172.21.15.33:0/3352943703 learned_addr learned my addr 172.21.15.33:0/3352943703 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f846bfff640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8474108150 0x7f847419b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f84737fe640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8474108aa0 0x7f847419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f8472ffd640 1 -- 172.21.15.33:0/3352943703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8474108150 msgr2=0x7f847419b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f8472ffd640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8474108150 0x7f847419b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f8472ffd640 1 -- 172.21.15.33:0/3352943703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8474108aa0 msgr2=0x7f847419b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f8472ffd640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8474108aa0 0x7f847419b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f8472ffd640 1 -- 172.21.15.33:0/3352943703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84741a6270 con 0x7f8474102860 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f8472ffd640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8474102860 0x7f847419af60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f846400e9f0 tx=0x7f846400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f847884d640 1 -- 172.21.15.33:0/3352943703 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846400cd80 con 0x7f8474102860 2024-08-28T19:31:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f847884d640 1 -- 172.21.15.33:0/3352943703 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84640108e0 con 0x7f8474102860 2024-08-28T19:31:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f847984f640 1 -- 172.21.15.33:0/3352943703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84741a6560 con 0x7f8474102860 2024-08-28T19:31:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f847884d640 1 -- 172.21.15.33:0/3352943703 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464018980 con 0x7f8474102860 2024-08-28T19:31:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.989+0000 7f847984f640 1 -- 172.21.15.33:0/3352943703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84741a6aa0 con 0x7f8474102860 2024-08-28T19:31:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.991+0000 7f847984f640 1 -- 172.21.15.33:0/3352943703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8474102c70 con 0x7f8474102860 2024-08-28T19:31:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.993+0000 7f847884d640 1 -- 172.21.15.33:0/3352943703 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f8464010430 con 0x7f8474102860 2024-08-28T19:31:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.994+0000 7f847884d640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f84600b4c10 0x7f84600b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.994+0000 7f847884d640 1 -- 172.21.15.33:0/3352943703 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f84640e5fe0 con 0x7f8474102860 2024-08-28T19:31:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.994+0000 7f846bfff640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f84600b4c10 0x7f84600b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.994+0000 7f846bfff640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f84600b4c10 0x7f84600b7120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8474105c10 tx=0x7f845c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:10.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.997+0000 7f847884d640 1 -- 172.21.15.33:0/3352943703 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f84640acb80 con 0x7f8474102860 2024-08-28T19:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3756983635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d38102800 msgr2=0x7f7d38102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 --2- 172.21.15.33:0/3756983635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d38102800 0x7f7d38102c10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009900 tx=0x7f7d3402a410 comp rx=0 tx=0).stop 2024-08-28T19:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3756983635 shutdown_connections 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 --2- 172.21.15.33:0/3756983635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d38108a90 0x7f7d3810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 --2- 172.21.15.33:0/3756983635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d38108140 0x7f7d38108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 --2- 172.21.15.33:0/3756983635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d38102800 0x7f7d38102c10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3756983635 >> 172.21.15.33:0/3756983635 conn(0x7f7d380794d0 msgr2=0x7f7d380798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3756983635 shutdown_connections 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3756983635 wait complete. 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 Processor -- start 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.863+0000 7f7d3fd77640 1 -- start start 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3fd77640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d38102800 0x7f7d38103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3fd77640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d38108140 0x7f7d38104530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3fd77640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d38108a90 0x7f7d38104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3fd77640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38112710 con 0x7f7d38108140 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3fd77640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38112590 con 0x7f7d38108a90 2024-08-28T19:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3fd77640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38112890 con 0x7f7d38102800 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3d312640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d38108140 0x7f7d38104530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3d312640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d38108140 0x7f7d38104530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52264/0 (socket says 172.21.15.33:52264) 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3d312640 1 -- 172.21.15.33:0/3637802027 learned_addr learned my addr 172.21.15.33:0/3637802027 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3e314640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d38108a90 0x7f7d38104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3db13640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d38102800 0x7f7d38103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3d312640 1 -- 172.21.15.33:0/3637802027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d38102800 msgr2=0x7f7d38103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3d312640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d38102800 0x7f7d38103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3d312640 1 -- 172.21.15.33:0/3637802027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d38108a90 msgr2=0x7f7d38104a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3d312640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d38108a90 0x7f7d38104a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3d312640 1 -- 172.21.15.33:0/3637802027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d381a8530 con 0x7f7d38108140 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.864+0000 7f7d3d312640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d38108140 0x7f7d38104530 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800e9f0 tx=0x7f7d2800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.865+0000 7f7d2effd640 1 -- 172.21.15.33:0/3637802027 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800ccc0 con 0x7f7d38108140 2024-08-28T19:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.865+0000 7f7d2effd640 1 -- 172.21.15.33:0/3637802027 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d280054d0 con 0x7f7d38108140 2024-08-28T19:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.865+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3637802027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d381a8820 con 0x7f7d38108140 2024-08-28T19:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.865+0000 7f7d2effd640 1 -- 172.21.15.33:0/3637802027 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28010430 con 0x7f7d38108140 2024-08-28T19:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.865+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3637802027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d381a8d10 con 0x7f7d38108140 2024-08-28T19:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.866+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3637802027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d38102c10 con 0x7f7d38108140 2024-08-28T19:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.867+0000 7f7d2effd640 1 -- 172.21.15.33:0/3637802027 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f7d280046c0 con 0x7f7d38108140 2024-08-28T19:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.868+0000 7f7d2effd640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d240b4c10 0x7f7d240b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.868+0000 7f7d3db13640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d240b4c10 0x7f7d240b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:10.108 INFO:teuthology.orchestra.run.smithi033.stdout:150323855420 2024-08-28T19:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.868+0000 7f7d2effd640 1 -- 172.21.15.33:0/3637802027 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f7d280e5b40 con 0x7f7d38108140 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.868+0000 7f7d3db13640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d240b4c10 0x7f7d240b7120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7d34000c00 tx=0x7f7d34031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:09.872+0000 7f7d2effd640 1 -- 172.21.15.33:0/3637802027 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7d280ac6e0 con 0x7f7d38108140 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.063+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3637802027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7d381a90e0 con 0x7f7d38108140 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.064+0000 7f7d2effd640 1 -- 172.21.15.33:0/3637802027 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7d280abfe0 con 0x7f7d38108140 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3637802027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d240b4c10 msgr2=0x7f7d240b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d240b4c10 0x7f7d240b7120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7d34000c00 tx=0x7f7d34031400 comp rx=0 tx=0).stop 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3637802027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d38108140 msgr2=0x7f7d38104530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d38108140 0x7f7d38104530 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800e9f0 tx=0x7f7d2800eeb0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3637802027 shutdown_connections 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d38108a90 0x7f7d38104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d38108140 0x7f7d38104530 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d240b4c10 0x7f7d240b7120 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 --2- 172.21.15.33:0/3637802027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d38102800 0x7f7d38103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3637802027 >> 172.21.15.33:0/3637802027 conn(0x7f7d380794d0 msgr2=0x7f7d38101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:10.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3637802027 shutdown_connections 2024-08-28T19:31:10.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.066+0000 7f7d3fd77640 1 -- 172.21.15.33:0/3637802027 wait complete. 2024-08-28T19:31:10.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.187+0000 7f847984f640 1 -- 172.21.15.33:0/3352943703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f847410a300 con 0x7f8474102860 2024-08-28T19:31:10.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.187+0000 7f847884d640 1 -- 172.21.15.33:0/3352943703 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84640ac480 con 0x7f8474102860 2024-08-28T19:31:10.188 INFO:teuthology.orchestra.run.smithi033.stdout:77309411402 2024-08-28T19:31:10.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.189+0000 7f847984f640 1 -- 172.21.15.33:0/3352943703 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f84600b4c10 msgr2=0x7f84600b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:10.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.189+0000 7f847984f640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f84600b4c10 0x7f84600b7120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8474105c10 tx=0x7f845c00b410 comp rx=0 tx=0).stop 2024-08-28T19:31:10.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.189+0000 7f847984f640 1 -- 172.21.15.33:0/3352943703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8474102860 msgr2=0x7f847419af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:10.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.189+0000 7f847984f640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8474102860 0x7f847419af60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f846400e9f0 tx=0x7f846400eeb0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.189+0000 7f847984f640 1 -- 172.21.15.33:0/3352943703 shutdown_connections 2024-08-28T19:31:10.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.189+0000 7f847984f640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8474108aa0 0x7f847419b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.189+0000 7f847984f640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f84600b4c10 0x7f84600b7120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.189+0000 7f847984f640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8474108150 0x7f847419b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.189+0000 7f847984f640 1 --2- 172.21.15.33:0/3352943703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8474102860 0x7f847419af60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.189+0000 7f847984f640 1 -- 172.21.15.33:0/3352943703 >> 172.21.15.33:0/3352943703 conn(0x7f84740794c0 msgr2=0x7f8474106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:10.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.190+0000 7f847984f640 1 -- 172.21.15.33:0/3352943703 shutdown_connections 2024-08-28T19:31:10.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.190+0000 7f847984f640 1 -- 172.21.15.33:0/3352943703 wait complete. 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.827+0000 7fb05cfde640 1 -- 172.21.15.33:0/1761664596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb058102860 msgr2=0x7fb058102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.827+0000 7fb05cfde640 1 --2- 172.21.15.33:0/1761664596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb058102860 0x7fb058102c70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb048009900 tx=0x7fb04802a410 comp rx=0 tx=0).stop 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.827+0000 7fb05cfde640 1 -- 172.21.15.33:0/1761664596 shutdown_connections 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.827+0000 7fb05cfde640 1 --2- 172.21.15.33:0/1761664596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb058108aa0 0x7fb05810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.827+0000 7fb05cfde640 1 --2- 172.21.15.33:0/1761664596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb058108150 0x7fb058108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.827+0000 7fb05cfde640 1 --2- 172.21.15.33:0/1761664596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb058102860 0x7fb058102c70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.827+0000 7fb05cfde640 1 -- 172.21.15.33:0/1761664596 >> 172.21.15.33:0/1761664596 conn(0x7fb0580794c0 msgr2=0x7fb0580798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.827+0000 7fb05cfde640 1 -- 172.21.15.33:0/1761664596 shutdown_connections 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.828+0000 7fb05cfde640 1 -- 172.21.15.33:0/1761664596 wait complete. 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.828+0000 7fb05cfde640 1 Processor -- start 2024-08-28T19:31:10.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.828+0000 7fb05cfde640 1 -- start start 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05cfde640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb058102860 0x7fb05819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05cfde640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb058108150 0x7fb05819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05cfde640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb058108aa0 0x7fb05819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05cfde640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb058112750 con 0x7fb058102860 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05cfde640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581125d0 con 0x7fb058108150 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05cfde640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb0581128d0 con 0x7fb058108aa0 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb058102860 0x7fb05819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb058102860 0x7fb05819b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52308/0 (socket says 172.21.15.33:52308) 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05659c640 1 -- 172.21.15.33:0/1798074867 learned_addr learned my addr 172.21.15.33:0/1798074867 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb056d9d640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb058108aa0 0x7fb05819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb04dd9b640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb058108150 0x7fb05819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:10.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05659c640 1 -- 172.21.15.33:0/1798074867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb058108aa0 msgr2=0x7fb05819bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05659c640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb058108aa0 0x7fb05819bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05659c640 1 -- 172.21.15.33:0/1798074867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb058108150 msgr2=0x7fb05819b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05659c640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb058108150 0x7fb05819b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.829+0000 7fb05659c640 1 -- 172.21.15.33:0/1798074867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0581a6360 con 0x7fb058102860 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.830+0000 7fb05659c640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb058102860 0x7fb05819b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb048005940 tx=0x7fb0480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.830+0000 7fb04ffff640 1 -- 172.21.15.33:0/1798074867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04803f030 con 0x7fb058102860 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.830+0000 7fb05cfde640 1 -- 172.21.15.33:0/1798074867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0581a65f0 con 0x7fb058102860 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.830+0000 7fb04ffff640 1 -- 172.21.15.33:0/1798074867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb048003cb0 con 0x7fb058102860 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.830+0000 7fb04ffff640 1 -- 172.21.15.33:0/1798074867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb048035070 con 0x7fb058102860 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.830+0000 7fb05cfde640 1 -- 172.21.15.33:0/1798074867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0581a6b20 con 0x7fb058102860 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.831+0000 7fb05cfde640 1 -- 172.21.15.33:0/1798074867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb058102c70 con 0x7fb058102860 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.832+0000 7fb04ffff640 1 -- 172.21.15.33:0/1798074867 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fb048042030 con 0x7fb058102860 2024-08-28T19:31:10.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.834+0000 7fb04ffff640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0440b4c10 0x7fb0440b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.834+0000 7fb04dd9b640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0440b4c10 0x7fb0440b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.834+0000 7fb04ffff640 1 -- 172.21.15.33:0/1798074867 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fb048106200 con 0x7fb058102860 2024-08-28T19:31:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.834+0000 7fb04dd9b640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0440b4c10 0x7fb0440b7120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb058079910 tx=0x7fb04000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:10.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:10.837+0000 7fb04ffff640 1 -- 172.21.15.33:0/1798074867 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb0480cc6f0 con 0x7fb058102860 2024-08-28T19:31:11.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.031+0000 7fb05cfde640 1 -- 172.21.15.33:0/1798074867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb05810a290 con 0x7fb058102860 2024-08-28T19:31:11.033 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:10 smithi033 ceph-mon[18549]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:31:11.033 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:10 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3637802027' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-28T19:31:11.033 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:10 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3352943703' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-28T19:31:11.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.032+0000 7fb04ffff640 1 -- 172.21.15.33:0/1798074867 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb0480d0eb0 con 0x7fb058102860 2024-08-28T19:31:11.033 INFO:teuthology.orchestra.run.smithi033.stdout:128849018944 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 -- 172.21.15.33:0/1798074867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0440b4c10 msgr2=0x7fb0440b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0440b4c10 0x7fb0440b7120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb058079910 tx=0x7fb04000b390 comp rx=0 tx=0).stop 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 -- 172.21.15.33:0/1798074867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb058102860 msgr2=0x7fb05819b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb058102860 0x7fb05819b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb048005940 tx=0x7fb0480042f0 comp rx=0 tx=0).stop 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 -- 172.21.15.33:0/1798074867 shutdown_connections 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0440b4c10 0x7fb0440b7120 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb058108aa0 0x7fb05819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb058108150 0x7fb05819b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 --2- 172.21.15.33:0/1798074867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb058102860 0x7fb05819b0a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 -- 172.21.15.33:0/1798074867 >> 172.21.15.33:0/1798074867 conn(0x7fb0580794c0 msgr2=0x7fb058106340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 -- 172.21.15.33:0/1798074867 shutdown_connections 2024-08-28T19:31:11.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.034+0000 7fb05cfde640 1 -- 172.21.15.33:0/1798074867 wait complete. 2024-08-28T19:31:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:10 smithi059 ceph-mon[22052]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:31:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:10 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3637802027' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-28T19:31:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:10 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3352943703' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-28T19:31:11.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:10 smithi122 ceph-mon[22174]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:31:11.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:10 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3637802027' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-28T19:31:11.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:10 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3352943703' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-28T19:31:11.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.945+0000 7fed0d136640 1 -- 172.21.15.33:0/3107409222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed08102880 msgr2=0x7fed08102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:11.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.945+0000 7fed0d136640 1 --2- 172.21.15.33:0/3107409222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed08102880 0x7fed08102c90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009900 tx=0x7fecf802a410 comp rx=0 tx=0).stop 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.945+0000 7fed0d136640 1 -- 172.21.15.33:0/3107409222 shutdown_connections 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.945+0000 7fed0d136640 1 --2- 172.21.15.33:0/3107409222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed08108ac0 0x7fed0810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.945+0000 7fed0d136640 1 --2- 172.21.15.33:0/3107409222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed08108170 0x7fed08108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.945+0000 7fed0d136640 1 --2- 172.21.15.33:0/3107409222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed08102880 0x7fed08102c90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.945+0000 7fed0d136640 1 -- 172.21.15.33:0/3107409222 >> 172.21.15.33:0/3107409222 conn(0x7fed08079550 msgr2=0x7fed08079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.945+0000 7fed0d136640 1 -- 172.21.15.33:0/3107409222 shutdown_connections 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.945+0000 7fed0d136640 1 -- 172.21.15.33:0/3107409222 wait complete. 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.946+0000 7fed0d136640 1 Processor -- start 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.946+0000 7fed0d136640 1 -- start start 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0d136640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed08102880 0x7fed0819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0d136640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed08108170 0x7fed0819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0d136640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed08108ac0 0x7fed0819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0d136640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fed08112790 con 0x7fed08108170 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0d136640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fed08112610 con 0x7fed08108ac0 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0d136640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fed08112910 con 0x7fed08102880 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed08108170 0x7fed0819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed08108170 0x7fed0819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52352/0 (socket says 172.21.15.33:52352) 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0659c640 1 -- 172.21.15.33:0/2917799443 learned_addr learned my addr 172.21.15.33:0/2917799443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed06d9d640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed08102880 0x7fed0819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0759e640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed08108ac0 0x7fed0819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0659c640 1 -- 172.21.15.33:0/2917799443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed08102880 msgr2=0x7fed0819b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0659c640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed08102880 0x7fed0819b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0659c640 1 -- 172.21.15.33:0/2917799443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed08108ac0 msgr2=0x7fed0819bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0659c640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed08108ac0 0x7fed0819bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0659c640 1 -- 172.21.15.33:0/2917799443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed081a63b0 con 0x7fed08108170 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.947+0000 7fed0659c640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed08108170 0x7fed0819b5e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00d740 tx=0x7fecfc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.948+0000 7feceffff640 1 -- 172.21.15.33:0/2917799443 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc017070 con 0x7fed08108170 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.948+0000 7fed0d136640 1 -- 172.21.15.33:0/2917799443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed081a66a0 con 0x7fed08108170 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.948+0000 7feceffff640 1 -- 172.21.15.33:0/2917799443 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecfc00de50 con 0x7fed08108170 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.948+0000 7feceffff640 1 -- 172.21.15.33:0/2917799443 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc00f620 con 0x7fed08108170 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.948+0000 7fed0d136640 1 -- 172.21.15.33:0/2917799443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed081a6be0 con 0x7fed08108170 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.949+0000 7fed0d136640 1 -- 172.21.15.33:0/2917799443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed08102c90 con 0x7fed08108170 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.951+0000 7feceffff640 1 -- 172.21.15.33:0/2917799443 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fecfc01a070 con 0x7fed08108170 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.951+0000 7feceffff640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fecf00b4c10 0x7fecf00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.951+0000 7fed06d9d640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fecf00b4c10 0x7fecf00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.951+0000 7feceffff640 1 -- 172.21.15.33:0/2917799443 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fecfc0e50b0 con 0x7fed08108170 2024-08-28T19:31:11.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.952+0000 7fed06d9d640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fecf00b4c10 0x7fecf00b7120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fecf8000c00 tx=0x7fecf8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:11.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.955+0000 7feceffff640 1 -- 172.21.15.33:0/2917799443 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fecfc0ab600 con 0x7fed08108170 2024-08-28T19:31:12.042 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:11 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1798074867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-28T19:31:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.844+0000 7f1560845640 1 -- 172.21.15.33:0/3594521687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f155c108ad0 msgr2=0x7f155c10f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.844+0000 7f1560845640 1 --2- 172.21.15.33:0/3594521687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f155c108ad0 0x7f155c10f300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1554009ca0 tx=0x7f155402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.844+0000 7f1560845640 1 -- 172.21.15.33:0/3594521687 shutdown_connections 2024-08-28T19:31:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.844+0000 7f1560845640 1 --2- 172.21.15.33:0/3594521687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f155c108ad0 0x7f155c10f300 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.844+0000 7f1560845640 1 --2- 172.21.15.33:0/3594521687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f155c108180 0x7f155c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.844+0000 7f1560845640 1 --2- 172.21.15.33:0/3594521687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c102840 0x7f155c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.844+0000 7f1560845640 1 -- 172.21.15.33:0/3594521687 >> 172.21.15.33:0/3594521687 conn(0x7f155c0794f0 msgr2=0x7f155c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.844+0000 7f1560845640 1 -- 172.21.15.33:0/3594521687 shutdown_connections 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.844+0000 7f1560845640 1 -- 172.21.15.33:0/3594521687 wait complete. 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f1560845640 1 Processor -- start 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f1560845640 1 -- start start 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f1560845640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c102840 0x7f155c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f1560845640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f155c108180 0x7f155c199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f1560845640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f155c108ad0 0x7f155c19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f1560845640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f155c112780 con 0x7f155c108ad0 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f1560845640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f155c112600 con 0x7f155c108180 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f1560845640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f155c112900 con 0x7f155c102840 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f155ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f155c108ad0 0x7f155c19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f155ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f155c108ad0 0x7f155c19e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52338/0 (socket says 172.21.15.33:52338) 2024-08-28T19:31:12.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f155ad9d640 1 -- 172.21.15.33:0/1853719254 learned_addr learned my addr 172.21.15.33:0/1853719254 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:12.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f1559d9b640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f155c108180 0x7f155c199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:12.099 INFO:teuthology.orchestra.run.smithi033.stdout:103079215173 2024-08-28T19:31:12.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f155a59c640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c102840 0x7f155c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:12.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f155ad9d640 1 -- 172.21.15.33:0/1853719254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c102840 msgr2=0x7f155c1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:12.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f155ad9d640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c102840 0x7f155c1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f155ad9d640 1 -- 172.21.15.33:0/1853719254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f155c108180 msgr2=0x7f155c199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.845+0000 7f155ad9d640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f155c108180 0x7f155c199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.846+0000 7f155ad9d640 1 -- 172.21.15.33:0/1853719254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c19f120 con 0x7f155c108ad0 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.846+0000 7f1559d9b640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f155c108180 0x7f155c199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.846+0000 7f155ad9d640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f155c108ad0 0x7f155c19e9f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1554005cc0 tx=0x7f155402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.846+0000 7f154b7fe640 1 -- 172.21.15.33:0/1853719254 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1554003bf0 con 0x7f155c108ad0 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.846+0000 7f1560845640 1 -- 172.21.15.33:0/1853719254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155c19f3b0 con 0x7f155c108ad0 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.846+0000 7f154b7fe640 1 -- 172.21.15.33:0/1853719254 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1554003d90 con 0x7f155c108ad0 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.846+0000 7f1560845640 1 -- 172.21.15.33:0/1853719254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f155c1a5b70 con 0x7f155c108ad0 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.846+0000 7f154b7fe640 1 -- 172.21.15.33:0/1853719254 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155402fbc0 con 0x7f155c108ad0 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.847+0000 7f1560845640 1 -- 172.21.15.33:0/1853719254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f155c102c50 con 0x7f155c108ad0 2024-08-28T19:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.849+0000 7f154b7fe640 1 -- 172.21.15.33:0/1853719254 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f155402fd60 con 0x7f155c108ad0 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.849+0000 7f154b7fe640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15440b4c10 0x7f15440b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.849+0000 7f155a59c640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15440b4c10 0x7f15440b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.849+0000 7f154b7fe640 1 -- 172.21.15.33:0/1853719254 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f1554106fa0 con 0x7f155c108ad0 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.850+0000 7f155a59c640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15440b4c10 0x7f15440b7120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f154c0058c0 tx=0x7f154c00a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:11.852+0000 7f154b7fe640 1 -- 172.21.15.33:0/1853719254 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1554083130 con 0x7f155c108ad0 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.041+0000 7f1560845640 1 -- 172.21.15.33:0/1853719254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f155c10a330 con 0x7f155c108ad0 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.041+0000 7f154b7fe640 1 -- 172.21.15.33:0/1853719254 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f15540cdb40 con 0x7f155c108ad0 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 -- 172.21.15.33:0/1853719254 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15440b4c10 msgr2=0x7f15440b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15440b4c10 0x7f15440b7120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f154c0058c0 tx=0x7f154c00a4c0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 -- 172.21.15.33:0/1853719254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f155c108ad0 msgr2=0x7f155c19e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f155c108ad0 0x7f155c19e9f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1554005cc0 tx=0x7f155402f380 comp rx=0 tx=0).stop 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 -- 172.21.15.33:0/1853719254 shutdown_connections 2024-08-28T19:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f155c108ad0 0x7f155c19e9f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f155c108180 0x7f155c199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15440b4c10 0x7f15440b7120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 --2- 172.21.15.33:0/1853719254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f155c102840 0x7f155c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 -- 172.21.15.33:0/1853719254 >> 172.21.15.33:0/1853719254 conn(0x7f155c0794f0 msgr2=0x7f155c106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:12.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 -- 172.21.15.33:0/1853719254 shutdown_connections 2024-08-28T19:31:12.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.044+0000 7f1560845640 1 -- 172.21.15.33:0/1853719254 wait complete. 2024-08-28T19:31:12.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.156+0000 7fed0d136640 1 -- 172.21.15.33:0/2917799443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fed0802e430 con 0x7fed08108170 2024-08-28T19:31:12.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.156+0000 7feceffff640 1 -- 172.21.15.33:0/2917799443 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fecfc0b4190 con 0x7fed08108170 2024-08-28T19:31:12.157 INFO:teuthology.orchestra.run.smithi033.stdout:292057776158 2024-08-28T19:31:12.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.158+0000 7fed0d136640 1 -- 172.21.15.33:0/2917799443 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fecf00b4c10 msgr2=0x7fecf00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:12.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.158+0000 7fed0d136640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fecf00b4c10 0x7fecf00b7120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fecf8000c00 tx=0x7fecf8031400 comp rx=0 tx=0).stop 2024-08-28T19:31:12.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.158+0000 7fed0d136640 1 -- 172.21.15.33:0/2917799443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed08108170 msgr2=0x7fed0819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:12.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.158+0000 7fed0d136640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed08108170 0x7fed0819b5e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00d740 tx=0x7fecfc00dc00 comp rx=0 tx=0).stop 2024-08-28T19:31:12.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.158+0000 7fed0d136640 1 -- 172.21.15.33:0/2917799443 shutdown_connections 2024-08-28T19:31:12.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.158+0000 7fed0d136640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed08108ac0 0x7fed0819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.158+0000 7fed0d136640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed08108170 0x7fed0819b5e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.158+0000 7fed0d136640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fecf00b4c10 0x7fecf00b7120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.158+0000 7fed0d136640 1 --2- 172.21.15.33:0/2917799443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fed08102880 0x7fed0819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:12.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.158+0000 7fed0d136640 1 -- 172.21.15.33:0/2917799443 >> 172.21.15.33:0/2917799443 conn(0x7fed08079550 msgr2=0x7fed08106280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:12.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.159+0000 7fed0d136640 1 -- 172.21.15.33:0/2917799443 shutdown_connections 2024-08-28T19:31:12.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:12.159+0000 7fed0d136640 1 -- 172.21.15.33:0/2917799443 wait complete. 2024-08-28T19:31:12.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:11 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1798074867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-28T19:31:12.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:11 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1798074867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-28T19:31:13.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:12 smithi033 ceph-mon[18549]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:31:13.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:12 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1853719254' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-28T19:31:13.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:12 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2917799443' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-28T19:31:13.213 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855417 got 150323855420 for osd.5 2024-08-28T19:31:13.214 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:13.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:12 smithi059 ceph-mon[22052]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:31:13.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:12 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1853719254' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-28T19:31:13.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:12 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2917799443' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-28T19:31:13.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:12 smithi122 ceph-mon[22174]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:31:13.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:12 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1853719254' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-28T19:31:13.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:12 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2917799443' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-28T19:31:13.674 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215171 got 103079215173 for osd.3 2024-08-28T19:31:13.674 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:14.078 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018942 got 128849018944 for osd.4 2024-08-28T19:31:14.078 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:14.731 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776156 got 292057776158 for osd.11 2024-08-28T19:31:14.731 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:15.077 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:14 smithi033 ceph-mon[18549]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-08-28T19:31:15.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.183+0000 7f80a1e07640 1 -- 172.21.15.33:0/3349323118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f809c103920 msgr2=0x7f809c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:15.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.183+0000 7f80a1e07640 1 --2- 172.21.15.33:0/3349323118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f809c103920 0x7f809c103d30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f808c009900 tx=0x7f808c02a3f0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.183+0000 7f80a1e07640 1 -- 172.21.15.33:0/3349323118 shutdown_connections 2024-08-28T19:31:15.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.183+0000 7f80a1e07640 1 --2- 172.21.15.33:0/3349323118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f809c109bb0 0x7f809c1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.184+0000 7f80a1e07640 1 --2- 172.21.15.33:0/3349323118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f809c109260 0x7f809c109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.184+0000 7f80a1e07640 1 --2- 172.21.15.33:0/3349323118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f809c103920 0x7f809c103d30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.184+0000 7f80a1e07640 1 -- 172.21.15.33:0/3349323118 >> 172.21.15.33:0/3349323118 conn(0x7f809c0ff370 msgr2=0x7f809c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:15.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.184+0000 7f80a1e07640 1 -- 172.21.15.33:0/3349323118 shutdown_connections 2024-08-28T19:31:15.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.184+0000 7f80a1e07640 1 -- 172.21.15.33:0/3349323118 wait complete. 2024-08-28T19:31:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.184+0000 7f80a1e07640 1 Processor -- start 2024-08-28T19:31:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f80a1e07640 1 -- start start 2024-08-28T19:31:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f80a1e07640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f809c103920 0x7f809c19a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f80a1e07640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f809c109260 0x7f809c19a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f80a1e07640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f809c109bb0 0x7f809c19fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f80a1e07640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f809c113870 con 0x7f809c103920 2024-08-28T19:31:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f80a1e07640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1136f0 con 0x7f809c109bb0 2024-08-28T19:31:15.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f80a1e07640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1139f0 con 0x7f809c109260 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f809b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f809c103920 0x7f809c19a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f809b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f809c103920 0x7f809c19a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52374/0 (socket says 172.21.15.33:52374) 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f809b7fe640 1 -- 172.21.15.33:0/907153021 learned_addr learned my addr 172.21.15.33:0/907153021 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f809bfff640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f809c109bb0 0x7f809c19fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.185+0000 7f809affd640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f809c109260 0x7f809c19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f809b7fe640 1 -- 172.21.15.33:0/907153021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f809c109260 msgr2=0x7f809c19a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f809b7fe640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f809c109260 0x7f809c19a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f809b7fe640 1 -- 172.21.15.33:0/907153021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f809c109bb0 msgr2=0x7f809c19fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f809b7fe640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f809c109bb0 0x7f809c19fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f809b7fe640 1 -- 172.21.15.33:0/907153021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c1a0070 con 0x7f809c103920 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f809bfff640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f809c109bb0 0x7f809c19fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:15.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f809b7fe640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f809c103920 0x7f809c19a1c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f808c006010 tx=0x7f808c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:15.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f8098ff9640 1 -- 172.21.15.33:0/907153021 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c03f030 con 0x7f809c103920 2024-08-28T19:31:15.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f80a1e07640 1 -- 172.21.15.33:0/907153021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c1a0300 con 0x7f809c103920 2024-08-28T19:31:15.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f8098ff9640 1 -- 172.21.15.33:0/907153021 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f808c003800 con 0x7f809c103920 2024-08-28T19:31:15.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f80a1e07640 1 -- 172.21.15.33:0/907153021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c1a0830 con 0x7f809c103920 2024-08-28T19:31:15.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.186+0000 7f8098ff9640 1 -- 172.21.15.33:0/907153021 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c035070 con 0x7f809c103920 2024-08-28T19:31:15.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.188+0000 7f80a1e07640 1 -- 172.21.15.33:0/907153021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809c103d30 con 0x7f809c103920 2024-08-28T19:31:15.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.190+0000 7f8098ff9640 1 -- 172.21.15.33:0/907153021 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f808c003cb0 con 0x7f809c103920 2024-08-28T19:31:15.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.191+0000 7f8098ff9640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80840b4c40 0x7f80840b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:15.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.191+0000 7f809affd640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80840b4c40 0x7f80840b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:15.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.191+0000 7f8098ff9640 1 -- 172.21.15.33:0/907153021 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f808c106230 con 0x7f809c103920 2024-08-28T19:31:15.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.192+0000 7f809affd640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80840b4c40 0x7f80840b7150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8090005e10 tx=0x7f8090005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:15.193 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:15.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.196+0000 7f8098ff9640 1 -- 172.21.15.33:0/907153021 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f809c1a0830 con 0x7f809c103920 2024-08-28T19:31:15.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:14 smithi059 ceph-mon[22052]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-08-28T19:31:15.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:14 smithi122 ceph-mon[22174]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-08-28T19:31:15.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.393+0000 7f80a1e07640 1 -- 172.21.15.33:0/907153021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f809c10b9e0 con 0x7f809c103920 2024-08-28T19:31:15.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.393+0000 7f8098ff9640 1 -- 172.21.15.33:0/907153021 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f808c0ccd70 con 0x7f809c103920 2024-08-28T19:31:15.394 INFO:teuthology.orchestra.run.smithi033.stdout:270582939683 2024-08-28T19:31:15.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.395+0000 7f80a1e07640 1 -- 172.21.15.33:0/907153021 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80840b4c40 msgr2=0x7f80840b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:15.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.395+0000 7f80a1e07640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80840b4c40 0x7f80840b7150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8090005e10 tx=0x7f8090005da0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.395+0000 7f80a1e07640 1 -- 172.21.15.33:0/907153021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f809c103920 msgr2=0x7f809c19a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:15.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.395+0000 7f80a1e07640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f809c103920 0x7f809c19a1c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f808c006010 tx=0x7f808c0042f0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.395+0000 7f80a1e07640 1 -- 172.21.15.33:0/907153021 shutdown_connections 2024-08-28T19:31:15.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.395+0000 7f80a1e07640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f809c109bb0 0x7f809c19fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.395+0000 7f80a1e07640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80840b4c40 0x7f80840b7150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.395+0000 7f80a1e07640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f809c109260 0x7f809c19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.395+0000 7f80a1e07640 1 --2- 172.21.15.33:0/907153021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f809c103920 0x7f809c19a1c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:15.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.395+0000 7f80a1e07640 1 -- 172.21.15.33:0/907153021 >> 172.21.15.33:0/907153021 conn(0x7f809c0ff370 msgr2=0x7f809c101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:15.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.396+0000 7f80a1e07640 1 -- 172.21.15.33:0/907153021 shutdown_connections 2024-08-28T19:31:15.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:15.396+0000 7f80a1e07640 1 -- 172.21.15.33:0/907153021 wait complete. 2024-08-28T19:31:15.650 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411399 got 77309411402 for osd.2 2024-08-28T19:31:15.650 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:16.042 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:15 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/907153021' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-28T19:31:16.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.138+0000 7fa7a2164640 1 -- 172.21.15.33:0/2891067725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c104f60 msgr2=0x7fa79c105370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:16.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.138+0000 7fa7a2164640 1 --2- 172.21.15.33:0/2891067725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c104f60 0x7fa79c105370 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa790009900 tx=0x7fa79002a410 comp rx=0 tx=0).stop 2024-08-28T19:31:16.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.138+0000 7fa7a2164640 1 -- 172.21.15.33:0/2891067725 shutdown_connections 2024-08-28T19:31:16.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.138+0000 7fa7a2164640 1 --2- 172.21.15.33:0/2891067725 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa79c1058b0 0x7fa79c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.138+0000 7fa7a2164640 1 --2- 172.21.15.33:0/2891067725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c104f60 0x7fa79c105370 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.138+0000 7fa7a2164640 1 --2- 172.21.15.33:0/2891067725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79c102f50 0x7fa79c103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.138+0000 7fa7a2164640 1 -- 172.21.15.33:0/2891067725 >> 172.21.15.33:0/2891067725 conn(0x7fa79c079d30 msgr2=0x7fa79c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.138+0000 7fa7a2164640 1 -- 172.21.15.33:0/2891067725 shutdown_connections 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.138+0000 7fa7a2164640 1 -- 172.21.15.33:0/2891067725 wait complete. 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.139+0000 7fa7a2164640 1 Processor -- start 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.139+0000 7fa7a2164640 1 -- start start 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.139+0000 7fa7a2164640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102f50 0x7fa79c0feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.139+0000 7fa7a2164640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa79c104f60 0x7fa79c0ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.139+0000 7fa7a2164640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79c1058b0 0x7fa79c0ff610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.139+0000 7fa7a2164640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c112780 con 0x7fa79c102f50 2024-08-28T19:31:16.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.139+0000 7fa7a2164640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c112600 con 0x7fa79c1058b0 2024-08-28T19:31:16.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.139+0000 7fa7a2164640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c112900 con 0x7fa79c104f60 2024-08-28T19:31:16.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102f50 0x7fa79c0feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:16.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102f50 0x7fa79c0feb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52386/0 (socket says 172.21.15.33:52386) 2024-08-28T19:31:16.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79b7fe640 1 -- 172.21.15.33:0/2749280504 learned_addr learned my addr 172.21.15.33:0/2749280504 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:16.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79bfff640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79c1058b0 0x7fa79c0ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:16.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79affd640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa79c104f60 0x7fa79c0ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:16.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79b7fe640 1 -- 172.21.15.33:0/2749280504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa79c104f60 msgr2=0x7fa79c0ff0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:16.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79b7fe640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa79c104f60 0x7fa79c0ff0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:16.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79b7fe640 1 -- 172.21.15.33:0/2749280504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79c1058b0 msgr2=0x7fa79c0ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:16.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79b7fe640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79c1058b0 0x7fa79c0ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:16.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79b7fe640 1 -- 172.21.15.33:0/2749280504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c1a8680 con 0x7fa79c102f50 2024-08-28T19:31:16.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa79b7fe640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102f50 0x7fa79c0feb90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00d950 tx=0x7fa78c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:16.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa798ff9640 1 -- 172.21.15.33:0/2749280504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c017030 con 0x7fa79c102f50 2024-08-28T19:31:16.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa798ff9640 1 -- 172.21.15.33:0/2749280504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa78c004020 con 0x7fa79c102f50 2024-08-28T19:31:16.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa7a2164640 1 -- 172.21.15.33:0/2749280504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79c1a8970 con 0x7fa79c102f50 2024-08-28T19:31:16.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa798ff9640 1 -- 172.21.15.33:0/2749280504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0047a0 con 0x7fa79c102f50 2024-08-28T19:31:16.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.140+0000 7fa7a2164640 1 -- 172.21.15.33:0/2749280504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79c1a8e80 con 0x7fa79c102f50 2024-08-28T19:31:16.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.142+0000 7fa7a2164640 1 -- 172.21.15.33:0/2749280504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79c103cd0 con 0x7fa79c102f50 2024-08-28T19:31:16.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.143+0000 7fa798ff9640 1 -- 172.21.15.33:0/2749280504 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa78c009a30 con 0x7fa79c102f50 2024-08-28T19:31:16.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.144+0000 7fa798ff9640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7840b4c10 0x7fa7840b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:16.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.144+0000 7fa79affd640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7840b4c10 0x7fa7840b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:16.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.144+0000 7fa798ff9640 1 -- 172.21.15.33:0/2749280504 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fa78c0e5840 con 0x7fa79c102f50 2024-08-28T19:31:16.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.145+0000 7fa79affd640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7840b4c10 0x7fa7840b7120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa790009230 tx=0x7fa790031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:16.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.147+0000 7fa798ff9640 1 -- 172.21.15.33:0/2749280504 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa78c0ac3e0 con 0x7fa79c102f50 2024-08-28T19:31:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:16.158 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:16.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:15 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/907153021' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-28T19:31:16.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:15 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/907153021' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-28T19:31:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.355+0000 7fa7a2164640 1 -- 172.21.15.33:0/2749280504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fa79c10b360 con 0x7fa79c102f50 2024-08-28T19:31:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.355+0000 7fa798ff9640 1 -- 172.21.15.33:0/2749280504 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa78c0abce0 con 0x7fa79c102f50 2024-08-28T19:31:16.356 INFO:teuthology.orchestra.run.smithi033.stdout:249108103209 2024-08-28T19:31:16.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.357+0000 7fa7a2164640 1 -- 172.21.15.33:0/2749280504 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7840b4c10 msgr2=0x7fa7840b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:16.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.357+0000 7fa7a2164640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7840b4c10 0x7fa7840b7120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa790009230 tx=0x7fa790031400 comp rx=0 tx=0).stop 2024-08-28T19:31:16.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.357+0000 7fa7a2164640 1 -- 172.21.15.33:0/2749280504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102f50 msgr2=0x7fa79c0feb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:16.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.357+0000 7fa7a2164640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102f50 0x7fa79c0feb90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00d950 tx=0x7fa78c00de10 comp rx=0 tx=0).stop 2024-08-28T19:31:16.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.357+0000 7fa7a2164640 1 -- 172.21.15.33:0/2749280504 shutdown_connections 2024-08-28T19:31:16.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.357+0000 7fa7a2164640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa79c1058b0 0x7fa79c0ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:16.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.357+0000 7fa7a2164640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7840b4c10 0x7fa7840b7120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:16.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.357+0000 7fa7a2164640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa79c104f60 0x7fa79c0ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:16.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.357+0000 7fa7a2164640 1 --2- 172.21.15.33:0/2749280504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102f50 0x7fa79c0feb90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:16.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.357+0000 7fa7a2164640 1 -- 172.21.15.33:0/2749280504 >> 172.21.15.33:0/2749280504 conn(0x7fa79c079d30 msgr2=0x7fa79c101110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:16.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.358+0000 7fa7a2164640 1 -- 172.21.15.33:0/2749280504 shutdown_connections 2024-08-28T19:31:16.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:16.358+0000 7fa7a2164640 1 -- 172.21.15.33:0/2749280504 wait complete. 2024-08-28T19:31:16.604 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939679 got 270582939683 for osd.10 2024-08-28T19:31:16.604 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:17.128 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:16 smithi033 ceph-mon[18549]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:31:17.128 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:16 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2749280504' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-28T19:31:17.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:16 smithi059 ceph-mon[22052]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:31:17.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:16 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2749280504' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-28T19:31:17.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:16 smithi122 ceph-mon[22174]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:31:17.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:16 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2749280504' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-28T19:31:17.701 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103206 got 249108103209 for osd.9 2024-08-28T19:31:17.701 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:18.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 -- 172.21.15.33:0/633516773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d4108170 msgr2=0x7f30d4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 --2- 172.21.15.33:0/633516773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d4108170 0x7f30d4108580 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f30c8009900 tx=0x7f30c802a410 comp rx=0 tx=0).stop 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 -- 172.21.15.33:0/633516773 shutdown_connections 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 --2- 172.21.15.33:0/633516773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d4108ac0 0x7f30d410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 --2- 172.21.15.33:0/633516773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d4108170 0x7f30d4108580 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 --2- 172.21.15.33:0/633516773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d4102880 0x7f30d4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 -- 172.21.15.33:0/633516773 >> 172.21.15.33:0/633516773 conn(0x7f30d4079500 msgr2=0x7f30d4079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 -- 172.21.15.33:0/633516773 shutdown_connections 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 -- 172.21.15.33:0/633516773 wait complete. 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 Processor -- start 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.040+0000 7f30daaca640 1 -- start start 2024-08-28T19:31:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30daaca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d4102880 0x7f30d419b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30daaca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d4108170 0x7f30d419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30daaca640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d4108ac0 0x7f30d419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30daaca640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41126f0 con 0x7f30d4108170 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30daaca640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4112570 con 0x7f30d4102880 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30daaca640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4112870 con 0x7f30d4108ac0 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d4108170 0x7f30d419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d4108170 0x7f30d419b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52400/0 (socket says 172.21.15.33:52400) 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d3fff640 1 -- 172.21.15.33:0/2243138790 learned_addr learned my addr 172.21.15.33:0/2243138790 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d8866640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d4102880 0x7f30d419b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d9067640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d4108ac0 0x7f30d419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d3fff640 1 -- 172.21.15.33:0/2243138790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d4108ac0 msgr2=0x7f30d419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d3fff640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d4108ac0 0x7f30d419ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d3fff640 1 -- 172.21.15.33:0/2243138790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d4102880 msgr2=0x7f30d419b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d3fff640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d4102880 0x7f30d419b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d3fff640 1 -- 172.21.15.33:0/2243138790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d41a6200 con 0x7f30d4108170 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d9067640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d4108ac0 0x7f30d419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.041+0000 7f30d3fff640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d4108170 0x7f30d419b540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f30c8006010 tx=0x7f30c8004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.042+0000 7f30d1ffb640 1 -- 172.21.15.33:0/2243138790 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c803f030 con 0x7f30d4108170 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.042+0000 7f30d1ffb640 1 -- 172.21.15.33:0/2243138790 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30c8004490 con 0x7f30d4108170 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.042+0000 7f30daaca640 1 -- 172.21.15.33:0/2243138790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d41a6490 con 0x7f30d4108170 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.042+0000 7f30d1ffb640 1 -- 172.21.15.33:0/2243138790 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c8035070 con 0x7f30d4108170 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.042+0000 7f30daaca640 1 -- 172.21.15.33:0/2243138790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d41a69c0 con 0x7f30d4108170 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.043+0000 7f30daaca640 1 -- 172.21.15.33:0/2243138790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d4103ab0 con 0x7f30d4108170 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.045+0000 7f30d1ffb640 1 -- 172.21.15.33:0/2243138790 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f30c8042030 con 0x7f30d4108170 2024-08-28T19:31:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.046+0000 7f30d1ffb640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30bc0b4cc0 0x7f30bc0b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.046+0000 7f30d8866640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30bc0b4cc0 0x7f30bc0b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.046+0000 7f30d1ffb640 1 -- 172.21.15.33:0/2243138790 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f30c8105f70 con 0x7f30d4108170 2024-08-28T19:31:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.046+0000 7f30d8866640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30bc0b4cc0 0x7f30bc0b71d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f30d406c440 tx=0x7f30c400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:18.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.049+0000 7f30d1ffb640 1 -- 172.21.15.33:0/2243138790 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f30c80ccb10 con 0x7f30d4108170 2024-08-28T19:31:18.054 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.237+0000 7f30daaca640 1 -- 172.21.15.33:0/2243138790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f30d4102c90 con 0x7f30d4108170 2024-08-28T19:31:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.238+0000 7f30d1ffb640 1 -- 172.21.15.33:0/2243138790 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f30c80cc410 con 0x7f30d4108170 2024-08-28T19:31:18.239 INFO:teuthology.orchestra.run.smithi033.stdout:223338299439 2024-08-28T19:31:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 -- 172.21.15.33:0/2243138790 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30bc0b4cc0 msgr2=0x7f30bc0b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30bc0b4cc0 0x7f30bc0b71d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f30d406c440 tx=0x7f30c400a2d0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 -- 172.21.15.33:0/2243138790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d4108170 msgr2=0x7f30d419b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d4108170 0x7f30d419b540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f30c8006010 tx=0x7f30c8004060 comp rx=0 tx=0).stop 2024-08-28T19:31:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 -- 172.21.15.33:0/2243138790 shutdown_connections 2024-08-28T19:31:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30bc0b4cc0 0x7f30bc0b71d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30d4108ac0 0x7f30d419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30d4108170 0x7f30d419b540 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 --2- 172.21.15.33:0/2243138790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d4102880 0x7f30d419b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 -- 172.21.15.33:0/2243138790 >> 172.21.15.33:0/2243138790 conn(0x7f30d4079500 msgr2=0x7f30d4105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 -- 172.21.15.33:0/2243138790 shutdown_connections 2024-08-28T19:31:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.240+0000 7f30daaca640 1 -- 172.21.15.33:0/2243138790 wait complete. 2024-08-28T19:31:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.271+0000 7f3879ee5640 1 -- 172.21.15.33:0/3333342610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3874108ac0 msgr2=0x7f387410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.271+0000 7f3879ee5640 1 --2- 172.21.15.33:0/3333342610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3874108ac0 0x7f387410f2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f386c009ca0 tx=0x7f386c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.271+0000 7f3879ee5640 1 -- 172.21.15.33:0/3333342610 shutdown_connections 2024-08-28T19:31:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.271+0000 7f3879ee5640 1 --2- 172.21.15.33:0/3333342610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3874108ac0 0x7f387410f2f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.271+0000 7f3879ee5640 1 --2- 172.21.15.33:0/3333342610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3874108170 0x7f3874108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.271+0000 7f3879ee5640 1 --2- 172.21.15.33:0/3333342610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3874102880 0x7f3874102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.271+0000 7f3879ee5640 1 -- 172.21.15.33:0/3333342610 >> 172.21.15.33:0/3333342610 conn(0x7f3874079500 msgr2=0x7f3874079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.271+0000 7f3879ee5640 1 -- 172.21.15.33:0/3333342610 shutdown_connections 2024-08-28T19:31:18.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.271+0000 7f3879ee5640 1 -- 172.21.15.33:0/3333342610 wait complete. 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3879ee5640 1 Processor -- start 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3879ee5640 1 -- start start 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3879ee5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3874102880 0x7f387419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3879ee5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3874108170 0x7f387419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3879ee5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3874108ac0 0x7f387419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3879ee5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3874112740 con 0x7f3874108ac0 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3879ee5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38741125c0 con 0x7f3874102880 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3879ee5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f38741128c0 con 0x7f3874108170 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3873fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3874108ac0 0x7f387419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3873fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3874108ac0 0x7f387419fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52416/0 (socket says 172.21.15.33:52416) 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.272+0000 7f3873fff640 1 -- 172.21.15.33:0/508971832 learned_addr learned my addr 172.21.15.33:0/508971832 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:18.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f38737fe640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3874102880 0x7f387419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f3872ffd640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3874108170 0x7f387419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f3873fff640 1 -- 172.21.15.33:0/508971832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3874108170 msgr2=0x7f387419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f3873fff640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3874108170 0x7f387419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f3873fff640 1 -- 172.21.15.33:0/508971832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3874102880 msgr2=0x7f387419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f3873fff640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3874102880 0x7f387419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f3873fff640 1 -- 172.21.15.33:0/508971832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38741a0170 con 0x7f3874108ac0 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f3873fff640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3874108ac0 0x7f387419fa40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f386c0098d0 tx=0x7f386c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f3870ff9640 1 -- 172.21.15.33:0/508971832 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c003b70 con 0x7f3874108ac0 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f3879ee5640 1 -- 172.21.15.33:0/508971832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38741a0400 con 0x7f3874108ac0 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.273+0000 7f3870ff9640 1 -- 172.21.15.33:0/508971832 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f386c003d10 con 0x7f3874108ac0 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.274+0000 7f3870ff9640 1 -- 172.21.15.33:0/508971832 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c004600 con 0x7f3874108ac0 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.274+0000 7f3879ee5640 1 -- 172.21.15.33:0/508971832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3874104d90 con 0x7f3874108ac0 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.275+0000 7f3879ee5640 1 -- 172.21.15.33:0/508971832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3874102c90 con 0x7f3874108ac0 2024-08-28T19:31:18.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.276+0000 7f3870ff9640 1 -- 172.21.15.33:0/508971832 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f386c040820 con 0x7f3874108ac0 2024-08-28T19:31:18.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.277+0000 7f3870ff9640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f385c0b4c90 0x7f385c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:18.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.277+0000 7f3870ff9640 1 -- 172.21.15.33:0/508971832 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f386c10aec0 con 0x7f3874108ac0 2024-08-28T19:31:18.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.277+0000 7f38737fe640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f385c0b4c90 0x7f385c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:18.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.277+0000 7f38737fe640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f385c0b4c90 0x7f385c0b71a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3864009b60 tx=0x7f3864005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:18.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.281+0000 7f3870ff9640 1 -- 172.21.15.33:0/508971832 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f386c0d1a60 con 0x7f3874108ac0 2024-08-28T19:31:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.467+0000 7f3879ee5640 1 -- 172.21.15.33:0/508971832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3874105040 con 0x7f3874108ac0 2024-08-28T19:31:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.467+0000 7f3870ff9640 1 -- 172.21.15.33:0/508971832 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f386c0d1360 con 0x7f3874108ac0 2024-08-28T19:31:18.468 INFO:teuthology.orchestra.run.smithi033.stdout:60129542225 2024-08-28T19:31:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 -- 172.21.15.33:0/508971832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f385c0b4c90 msgr2=0x7f385c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f385c0b4c90 0x7f385c0b71a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3864009b60 tx=0x7f3864005f90 comp rx=0 tx=0).stop 2024-08-28T19:31:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 -- 172.21.15.33:0/508971832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3874108ac0 msgr2=0x7f387419fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3874108ac0 0x7f387419fa40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f386c0098d0 tx=0x7f386c0317b0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 -- 172.21.15.33:0/508971832 shutdown_connections 2024-08-28T19:31:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3874108ac0 0x7f387419fa40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f385c0b4c90 0x7f385c0b71a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3874108170 0x7f387419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 --2- 172.21.15.33:0/508971832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3874102880 0x7f387419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 -- 172.21.15.33:0/508971832 >> 172.21.15.33:0/508971832 conn(0x7f3874079500 msgr2=0x7f38741008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 -- 172.21.15.33:0/508971832 shutdown_connections 2024-08-28T19:31:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:18.469+0000 7f3879ee5640 1 -- 172.21.15.33:0/508971832 wait complete. 2024-08-28T19:31:19.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:18 smithi033 ceph-mon[18549]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-08-28T19:31:19.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:18 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2243138790' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-28T19:31:19.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:18 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/508971832' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-28T19:31:19.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:18 smithi059 ceph-mon[22052]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-08-28T19:31:19.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:18 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2243138790' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-28T19:31:19.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:18 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/508971832' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-28T19:31:19.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:18 smithi122 ceph-mon[22174]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-08-28T19:31:19.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:18 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2243138790' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-28T19:31:19.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:18 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/508971832' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-28T19:31:19.371 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542221 got 60129542225 for osd.1 2024-08-28T19:31:19.371 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:19.848 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299437 got 223338299439 for osd.8 2024-08-28T19:31:19.848 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:20.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.771+0000 7f40e6465640 1 -- 172.21.15.33:0/1788169566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e0108140 msgr2=0x7f40e0108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.771+0000 7f40e6465640 1 --2- 172.21.15.33:0/1788169566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e0108140 0x7f40e0108550 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009900 tx=0x7f40d402a3f0 comp rx=0 tx=0).stop 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.771+0000 7f40e6465640 1 -- 172.21.15.33:0/1788169566 shutdown_connections 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.771+0000 7f40e6465640 1 --2- 172.21.15.33:0/1788169566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40e0108a90 0x7f40e010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.771+0000 7f40e6465640 1 --2- 172.21.15.33:0/1788169566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e0108140 0x7f40e0108550 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.771+0000 7f40e6465640 1 --2- 172.21.15.33:0/1788169566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e0102800 0x7f40e0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.771+0000 7f40e6465640 1 -- 172.21.15.33:0/1788169566 >> 172.21.15.33:0/1788169566 conn(0x7f40e00794d0 msgr2=0x7f40e00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.771+0000 7f40e6465640 1 -- 172.21.15.33:0/1788169566 shutdown_connections 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.771+0000 7f40e6465640 1 -- 172.21.15.33:0/1788169566 wait complete. 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.772+0000 7f40e6465640 1 Processor -- start 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.772+0000 7f40e6465640 1 -- start start 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.772+0000 7f40e6465640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e0102800 0x7f40e019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:20.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.772+0000 7f40e6465640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40e0108140 0x7f40e019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e6465640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e0108a90 0x7f40e019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e6465640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f40e0113820 con 0x7f40e0108a90 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e6465640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01136a0 con 0x7f40e0108140 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e6465640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01139a0 con 0x7f40e0102800 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e4a02640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e0108a90 0x7f40e019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e4a02640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e0108a90 0x7f40e019fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57254/0 (socket says 172.21.15.33:57254) 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e4a02640 1 -- 172.21.15.33:0/502325523 learned_addr learned my addr 172.21.15.33:0/502325523 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40df7fe640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40e0108140 0x7f40e019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40dffff640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e0102800 0x7f40e019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e4a02640 1 -- 172.21.15.33:0/502325523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e0102800 msgr2=0x7f40e019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e4a02640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e0102800 0x7f40e019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e4a02640 1 -- 172.21.15.33:0/502325523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40e0108140 msgr2=0x7f40e019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:20.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e4a02640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40e0108140 0x7f40e019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e4a02640 1 -- 172.21.15.33:0/502325523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e01a00a0 con 0x7f40e0108a90 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40df7fe640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40e0108140 0x7f40e019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e4a02640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e0108a90 0x7f40e019fa30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f40d800cce0 tx=0x7f40d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40dd7fa640 1 -- 172.21.15.33:0/502325523 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d800f450 con 0x7f40e0108a90 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e6465640 1 -- 172.21.15.33:0/502325523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e01a0390 con 0x7f40e0108a90 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40dd7fa640 1 -- 172.21.15.33:0/502325523 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40d800faa0 con 0x7f40e0108a90 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40dd7fa640 1 -- 172.21.15.33:0/502325523 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8018b70 con 0x7f40e0108a90 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.773+0000 7f40e6465640 1 -- 172.21.15.33:0/502325523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e01a6bb0 con 0x7f40e0108a90 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.774+0000 7f40e6465640 1 -- 172.21.15.33:0/502325523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e0102c10 con 0x7f40e0108a90 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.776+0000 7f40dd7fa640 1 -- 172.21.15.33:0/502325523 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f40d8018d10 con 0x7f40e0108a90 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.777+0000 7f40dd7fa640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40c80b4c40 0x7f40c80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.777+0000 7f40dffff640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40c80b4c40 0x7f40c80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.777+0000 7f40dd7fa640 1 -- 172.21.15.33:0/502325523 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f40d80e5db0 con 0x7f40e0108a90 2024-08-28T19:31:20.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.778+0000 7f40dffff640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40c80b4c40 0x7f40c80b7150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f40d0005fd0 tx=0x7f40d0005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:20.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.781+0000 7f40dd7fa640 1 -- 172.21.15.33:0/502325523 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f40d8014030 con 0x7f40e0108a90 2024-08-28T19:31:20.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:20 smithi033 ceph-mon[18549]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:31:20.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.969+0000 7f40e6465640 1 -- 172.21.15.33:0/502325523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f40e019b320 con 0x7f40e0108a90 2024-08-28T19:31:20.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.970+0000 7f40dd7fa640 1 -- 172.21.15.33:0/502325523 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f40e019b320 con 0x7f40e0108a90 2024-08-28T19:31:20.971 INFO:teuthology.orchestra.run.smithi033.stdout:176093659193 2024-08-28T19:31:20.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 -- 172.21.15.33:0/502325523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40c80b4c40 msgr2=0x7f40c80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:20.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40c80b4c40 0x7f40c80b7150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f40d0005fd0 tx=0x7f40d0005850 comp rx=0 tx=0).stop 2024-08-28T19:31:20.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 -- 172.21.15.33:0/502325523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e0108a90 msgr2=0x7f40e019fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e0108a90 0x7f40e019fa30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f40d800cce0 tx=0x7f40d800a620 comp rx=0 tx=0).stop 2024-08-28T19:31:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 -- 172.21.15.33:0/502325523 shutdown_connections 2024-08-28T19:31:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e0108a90 0x7f40e019fa30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40e0108140 0x7f40e019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40c80b4c40 0x7f40c80b7150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 --2- 172.21.15.33:0/502325523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f40e0102800 0x7f40e019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 -- 172.21.15.33:0/502325523 >> 172.21.15.33:0/502325523 conn(0x7f40e00794d0 msgr2=0x7f40e0104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 -- 172.21.15.33:0/502325523 shutdown_connections 2024-08-28T19:31:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:20.972+0000 7f40e6465640 1 -- 172.21.15.33:0/502325523 wait complete. 2024-08-28T19:31:21.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.056+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2725155626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c01039d0 msgr2=0x7f15c0103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:21.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.056+0000 7f15c5a6f640 1 --2- 172.21.15.33:0/2725155626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c01039d0 0x7f15c0103de0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009900 tx=0x7f15b402a3f0 comp rx=0 tx=0).stop 2024-08-28T19:31:21.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.056+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2725155626 shutdown_connections 2024-08-28T19:31:21.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.056+0000 7f15c5a6f640 1 --2- 172.21.15.33:0/2725155626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c0109c60 0x7f15c0110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:21.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.056+0000 7f15c5a6f640 1 --2- 172.21.15.33:0/2725155626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15c0109310 0x7f15c0109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:21.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.056+0000 7f15c5a6f640 1 --2- 172.21.15.33:0/2725155626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c01039d0 0x7f15c0103de0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:21.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.056+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2725155626 >> 172.21.15.33:0/2725155626 conn(0x7f15c007b670 msgr2=0x7f15c007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.056+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2725155626 shutdown_connections 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.056+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2725155626 wait complete. 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.056+0000 7f15c5a6f640 1 Processor -- start 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15c5a6f640 1 -- start start 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15c5a6f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15c01039d0 0x7f15c019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15c5a6f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c0109310 0x7f15c019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15c5a6f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c0109c60 0x7f15c019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15c5a6f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f15c0113880 con 0x7f15c0109c60 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15c5a6f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f15c0113700 con 0x7f15c0109310 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15c5a6f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f15c0113a00 con 0x7f15c01039d0 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c0109c60 0x7f15c019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c0109c60 0x7f15c019fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57270/0 (socket says 172.21.15.33:57270) 2024-08-28T19:31:21.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15bffff640 1 -- 172.21.15.33:0/2800591038 learned_addr learned my addr 172.21.15.33:0/2800591038 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15beffd640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c0109310 0x7f15c019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15bf7fe640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15c01039d0 0x7f15c019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15bffff640 1 -- 172.21.15.33:0/2800591038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15c01039d0 msgr2=0x7f15c019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15bffff640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15c01039d0 0x7f15c019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15bffff640 1 -- 172.21.15.33:0/2800591038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c0109310 msgr2=0x7f15c019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15bffff640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c0109310 0x7f15c019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.057+0000 7f15bffff640 1 -- 172.21.15.33:0/2800591038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c01a00e0 con 0x7f15c0109c60 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.058+0000 7f15bffff640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c0109c60 0x7f15c019fa70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f15b800cce0 tx=0x7f15b800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.058+0000 7f15bcff9640 1 -- 172.21.15.33:0/2800591038 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b800f450 con 0x7f15c0109c60 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.058+0000 7f15bcff9640 1 -- 172.21.15.33:0/2800591038 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15b800faa0 con 0x7f15c0109c60 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.058+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2800591038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c01a03d0 con 0x7f15c0109c60 2024-08-28T19:31:21.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.058+0000 7f15bcff9640 1 -- 172.21.15.33:0/2800591038 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8018b70 con 0x7f15c0109c60 2024-08-28T19:31:21.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.058+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2800591038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c01a6bf0 con 0x7f15c0109c60 2024-08-28T19:31:21.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.059+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2800591038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c0103de0 con 0x7f15c0109c60 2024-08-28T19:31:21.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.061+0000 7f15bcff9640 1 -- 172.21.15.33:0/2800591038 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f15b8018d10 con 0x7f15c0109c60 2024-08-28T19:31:21.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.062+0000 7f15bcff9640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15a80b4c40 0x7f15a80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:21.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.062+0000 7f15bf7fe640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15a80b4c40 0x7f15a80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:21.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.062+0000 7f15bcff9640 1 -- 172.21.15.33:0/2800591038 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7f15b80e5be0 con 0x7f15c0109c60 2024-08-28T19:31:21.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.063+0000 7f15bf7fe640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15a80b4c40 0x7f15a80b7150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15b4031440 tx=0x7f15b4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:21.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.066+0000 7f15bcff9640 1 -- 172.21.15.33:0/2800591038 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f15b8014030 con 0x7f15c0109c60 2024-08-28T19:31:21.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.252+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2800591038 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f15c019b360 con 0x7f15c0109c60 2024-08-28T19:31:21.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.252+0000 7f15bcff9640 1 -- 172.21.15.33:0/2800591038 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f15c019b360 con 0x7f15c0109c60 2024-08-28T19:31:21.253 INFO:teuthology.orchestra.run.smithi033.stdout:38654705749 2024-08-28T19:31:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.254+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2800591038 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15a80b4c40 msgr2=0x7f15a80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.254+0000 7f15c5a6f640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15a80b4c40 0x7f15a80b7150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15b4031440 tx=0x7f15b4009560 comp rx=0 tx=0).stop 2024-08-28T19:31:21.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.254+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2800591038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c0109c60 msgr2=0x7f15c019fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.254+0000 7f15c5a6f640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c0109c60 0x7f15c019fa70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f15b800cce0 tx=0x7f15b800a620 comp rx=0 tx=0).stop 2024-08-28T19:31:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.254+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2800591038 shutdown_connections 2024-08-28T19:31:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.254+0000 7f15c5a6f640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c0109c60 0x7f15c019fa70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.254+0000 7f15c5a6f640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c0109310 0x7f15c019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.254+0000 7f15c5a6f640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15a80b4c40 0x7f15a80b7150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.254+0000 7f15c5a6f640 1 --2- 172.21.15.33:0/2800591038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f15c01039d0 0x7f15c019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.254+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2800591038 >> 172.21.15.33:0/2800591038 conn(0x7f15c007b670 msgr2=0x7f15c01073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.255+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2800591038 shutdown_connections 2024-08-28T19:31:21.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:21.255+0000 7f15c5a6f640 1 -- 172.21.15.33:0/2800591038 wait complete. 2024-08-28T19:31:21.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:20 smithi059 ceph-mon[22052]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:31:21.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:20 smithi122 ceph-mon[22174]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:31:21.971 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:21 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/502325523' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-28T19:31:21.971 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:21 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2800591038' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-28T19:31:22.003 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705746 got 38654705749 for osd.0 2024-08-28T19:31:22.003 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:22.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.186+0000 7feebc884640 1 -- 172.21.15.33:0/337383712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feeb8103690 msgr2=0x7feeb810f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:22.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.186+0000 7feebc884640 1 --2- 172.21.15.33:0/337383712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feeb8103690 0x7feeb810f240 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009ca0 tx=0x7feeb002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.186+0000 7feebc884640 1 -- 172.21.15.33:0/337383712 shutdown_connections 2024-08-28T19:31:22.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.186+0000 7feebc884640 1 --2- 172.21.15.33:0/337383712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feeb8103690 0x7feeb810f240 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.186+0000 7feebc884640 1 --2- 172.21.15.33:0/337383712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feeb8102d40 0x7feeb8103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.186+0000 7feebc884640 1 --2- 172.21.15.33:0/337383712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb81073d0 0x7feeb81077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.186+0000 7feebc884640 1 -- 172.21.15.33:0/337383712 >> 172.21.15.33:0/337383712 conn(0x7feeb8079be0 msgr2=0x7feeb8079ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.187+0000 7feebc884640 1 -- 172.21.15.33:0/337383712 shutdown_connections 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.187+0000 7feebc884640 1 -- 172.21.15.33:0/337383712 wait complete. 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.187+0000 7feebc884640 1 Processor -- start 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.187+0000 7feebc884640 1 -- start start 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feebc884640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb8102d40 0x7feeb819b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feebc884640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feeb8103690 0x7feeb819b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feebc884640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feeb81073d0 0x7feeb819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feebc884640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7feeb8112780 con 0x7feeb81073d0 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feebc884640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feeb8112600 con 0x7feeb8102d40 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feebc884640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feeb8112900 con 0x7feeb8103690 2024-08-28T19:31:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feeb6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feeb81073d0 0x7feeb819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feeb6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feeb81073d0 0x7feeb819bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57290/0 (socket says 172.21.15.33:57290) 2024-08-28T19:31:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feeb6d9d640 1 -- 172.21.15.33:0/3454589089 learned_addr learned my addr 172.21.15.33:0/3454589089 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feeb659c640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb8102d40 0x7feeb819b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feeaffff640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feeb8103690 0x7feeb819b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feeb6d9d640 1 -- 172.21.15.33:0/3454589089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feeb8103690 msgr2=0x7feeb819b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feeb6d9d640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feeb8103690 0x7feeb819b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feeb6d9d640 1 -- 172.21.15.33:0/3454589089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb8102d40 msgr2=0x7feeb819b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feeb6d9d640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb8102d40 0x7feeb819b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.188+0000 7feeb6d9d640 1 -- 172.21.15.33:0/3454589089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb81a62c0 con 0x7feeb81073d0 2024-08-28T19:31:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.189+0000 7feeb6d9d640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feeb81073d0 0x7feeb819bab0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7feeb00098d0 tx=0x7feeb00317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:22.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.189+0000 7feeaf7fe640 1 -- 172.21.15.33:0/3454589089 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0003b70 con 0x7feeb81073d0 2024-08-28T19:31:22.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.189+0000 7feeaf7fe640 1 -- 172.21.15.33:0/3454589089 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeb0003d10 con 0x7feeb81073d0 2024-08-28T19:31:22.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.189+0000 7feebc884640 1 -- 172.21.15.33:0/3454589089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb81a6550 con 0x7feeb81073d0 2024-08-28T19:31:22.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.189+0000 7feeaf7fe640 1 -- 172.21.15.33:0/3454589089 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb002fa20 con 0x7feeb81073d0 2024-08-28T19:31:22.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.189+0000 7feebc884640 1 -- 172.21.15.33:0/3454589089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb81a6ae0 con 0x7feeb81073d0 2024-08-28T19:31:22.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.190+0000 7feebc884640 1 -- 172.21.15.33:0/3454589089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb8103150 con 0x7feeb81073d0 2024-08-28T19:31:22.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.192+0000 7feeaf7fe640 1 -- 172.21.15.33:0/3454589089 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7feeb002fbc0 con 0x7feeb81073d0 2024-08-28T19:31:22.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.192+0000 7feeaf7fe640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feea40b4cc0 0x7feea40b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:22.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.193+0000 7feeaf7fe640 1 -- 172.21.15.33:0/3454589089 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7feeb0106ad0 con 0x7feeb81073d0 2024-08-28T19:31:22.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.193+0000 7feeb659c640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feea40b4cc0 0x7feea40b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:22.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.193+0000 7feeb659c640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feea40b4cc0 0x7feea40b71d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feeb8102790 tx=0x7feea8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:22.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.196+0000 7feeaf7fe640 1 -- 172.21.15.33:0/3454589089 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7feeb00cd670 con 0x7feeb81073d0 2024-08-28T19:31:22.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:21 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/502325523' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-28T19:31:22.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:21 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2800591038' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-28T19:31:22.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:21 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/502325523' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-28T19:31:22.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:21 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2800591038' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-28T19:31:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.385+0000 7feebc884640 1 -- 172.21.15.33:0/3454589089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7feeb810a2e0 con 0x7feeb81073d0 2024-08-28T19:31:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.385+0000 7feeaf7fe640 1 -- 172.21.15.33:0/3454589089 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feeb00ccf70 con 0x7feeb81073d0 2024-08-28T19:31:22.386 INFO:teuthology.orchestra.run.smithi033.stdout:197568495667 2024-08-28T19:31:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 -- 172.21.15.33:0/3454589089 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feea40b4cc0 msgr2=0x7feea40b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feea40b4cc0 0x7feea40b71d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feeb8102790 tx=0x7feea8005f90 comp rx=0 tx=0).stop 2024-08-28T19:31:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 -- 172.21.15.33:0/3454589089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feeb81073d0 msgr2=0x7feeb819bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feeb81073d0 0x7feeb819bab0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7feeb00098d0 tx=0x7feeb00317b0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 -- 172.21.15.33:0/3454589089 shutdown_connections 2024-08-28T19:31:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feeb81073d0 0x7feeb819bab0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feea40b4cc0 0x7feea40b71d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feeb8103690 0x7feeb819b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 --2- 172.21.15.33:0/3454589089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb8102d40 0x7feeb819b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 -- 172.21.15.33:0/3454589089 >> 172.21.15.33:0/3454589089 conn(0x7feeb8079be0 msgr2=0x7feeb8103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 -- 172.21.15.33:0/3454589089 shutdown_connections 2024-08-28T19:31:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:22.387+0000 7feebc884640 1 -- 172.21.15.33:0/3454589089 wait complete. 2024-08-28T19:31:22.753 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659190 got 176093659193 for osd.6 2024-08-28T19:31:22.753 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:23.012 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:22 smithi033 ceph-mon[18549]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-08-28T19:31:23.013 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:22 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3454589089' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-28T19:31:23.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:22 smithi059 ceph-mon[22052]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-08-28T19:31:23.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:22 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3454589089' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-28T19:31:23.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:22 smithi122 ceph-mon[22174]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-08-28T19:31:23.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:22 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3454589089' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-28T19:31:23.475 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495664 got 197568495667 for osd.7 2024-08-28T19:31:23.475 DEBUG:teuthology.parallel:result is None 2024-08-28T19:31:23.475 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-28T19:31:23.476 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T19:31:23.741 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.249+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1847276463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2b0109b90 msgr2=0x7fd2b01103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.249+0000 7fd2b4fce640 1 --2- 172.21.15.33:0/1847276463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2b0109b90 0x7fd2b01103c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009ca0 tx=0x7fd2a802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.249+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1847276463 shutdown_connections 2024-08-28T19:31:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.249+0000 7fd2b4fce640 1 --2- 172.21.15.33:0/1847276463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2b0109b90 0x7fd2b01103c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.249+0000 7fd2b4fce640 1 --2- 172.21.15.33:0/1847276463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2b0109240 0x7fd2b0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.249+0000 7fd2b4fce640 1 --2- 172.21.15.33:0/1847276463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b0103900 0x7fd2b0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.249+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1847276463 >> 172.21.15.33:0/1847276463 conn(0x7fd2b007b5f0 msgr2=0x7fd2b007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.249+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1847276463 shutdown_connections 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.249+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1847276463 wait complete. 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.250+0000 7fd2b4fce640 1 Processor -- start 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.250+0000 7fd2b4fce640 1 -- start start 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.250+0000 7fd2b4fce640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b0103900 0x7fd2b019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.250+0000 7fd2b4fce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2b0109240 0x7fd2b019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.250+0000 7fd2b4fce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2b0109b90 0x7fd2b019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.250+0000 7fd2b4fce640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b01138d0 con 0x7fd2b0109240 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2b4fce640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b0113750 con 0x7fd2b0109b90 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2b4fce640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b0113a50 con 0x7fd2b0103900 2024-08-28T19:31:24.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2add9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2b0109240 0x7fd2b019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2add9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2b0109240 0x7fd2b019a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57300/0 (socket says 172.21.15.33:57300) 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2add9b640 1 -- 172.21.15.33:0/1019591829 learned_addr learned my addr 172.21.15.33:0/1019591829 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2aed9d640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2b0109b90 0x7fd2b019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2ae59c640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b0103900 0x7fd2b019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2add9b640 1 -- 172.21.15.33:0/1019591829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b0103900 msgr2=0x7fd2b019a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2add9b640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b0103900 0x7fd2b019a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2add9b640 1 -- 172.21.15.33:0/1019591829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2b0109b90 msgr2=0x7fd2b019fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2add9b640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2b0109b90 0x7fd2b019fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2add9b640 1 -- 172.21.15.33:0/1019591829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b01a0210 con 0x7fd2b0109240 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2add9b640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2b0109240 0x7fd2b019a840 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c970 tx=0x7fd2a400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd29f7fe640 1 -- 172.21.15.33:0/1019591829 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4004220 con 0x7fd2b0109240 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd29f7fe640 1 -- 172.21.15.33:0/1019591829 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2a40043c0 con 0x7fd2b0109240 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1019591829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b01a0500 con 0x7fd2b0109240 2024-08-28T19:31:24.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd29f7fe640 1 -- 172.21.15.33:0/1019591829 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400f450 con 0x7fd2b0109240 2024-08-28T19:31:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.251+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1019591829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b01a6c60 con 0x7fd2b0109240 2024-08-28T19:31:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.253+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1019591829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b0103d10 con 0x7fd2b0109240 2024-08-28T19:31:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.254+0000 7fd29f7fe640 1 -- 172.21.15.33:0/1019591829 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fd2a40079b0 con 0x7fd2b0109240 2024-08-28T19:31:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.255+0000 7fd29f7fe640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2980b4c10 0x7fd2980b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.255+0000 7fd2ae59c640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2980b4c10 0x7fd2980b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.255+0000 7fd29f7fe640 1 -- 172.21.15.33:0/1019591829 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fd2a40e5610 con 0x7fd2b0109240 2024-08-28T19:31:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.256+0000 7fd2ae59c640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2980b4c10 0x7fd2980b7120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009890 tx=0x7fd2a0008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:24.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.260+0000 7fd29f7fe640 1 -- 172.21.15.33:0/1019591829 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd2a4014030 con 0x7fd2b0109240 2024-08-28T19:31:24.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.443+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1019591829 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2b00635a0 con 0x7fd2980b4c10 2024-08-28T19:31:24.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.449+0000 7fd29f7fe640 1 -- 172.21.15.33:0/1019591829 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340623 (secure 0 0 0) 0x7fd2b00635a0 con 0x7fd2980b4c10 2024-08-28T19:31:24.454 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:31:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-28T19:31:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1019591829 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2980b4c10 msgr2=0x7fd2980b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2980b4c10 0x7fd2980b7120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009890 tx=0x7fd2a0008040 comp rx=0 tx=0).stop 2024-08-28T19:31:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1019591829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2b0109240 msgr2=0x7fd2b019a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2b0109240 0x7fd2b019a840 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c970 tx=0x7fd2a400ce30 comp rx=0 tx=0).stop 2024-08-28T19:31:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1019591829 shutdown_connections 2024-08-28T19:31:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2b0109b90 0x7fd2b019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2b0109240 0x7fd2b019a840 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2980b4c10 0x7fd2980b7120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 --2- 172.21.15.33:0/1019591829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2b0103900 0x7fd2b019a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1019591829 >> 172.21.15.33:0/1019591829 conn(0x7fd2b007b5f0 msgr2=0x7fd2b0107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1019591829 shutdown_connections 2024-08-28T19:31:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:24.453+0000 7fd2b4fce640 1 -- 172.21.15.33:0/1019591829 wait complete. 2024-08-28T19:31:25.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:24 smithi033 ceph-mon[18549]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:31:25.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:24 smithi033 ceph-mon[18549]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:31:25.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:24 smithi059 ceph-mon[22052]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:31:25.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:24 smithi059 ceph-mon[22052]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:31:25.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:24 smithi122 ceph-mon[22174]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:31:25.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:24 smithi122 ceph-mon[22174]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:31:25.367 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-08-28T19:31:23.743177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659878,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":670,"num_read_kb":443,"num_write":372,"num_write_kb":2292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364664,"kb_used_data":11240,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577160,"statfs":{"total":1151940427776,"available":1151567011840,"internally_reserved":0,"allocated":11509760,"data_stored":7670708,"data_compressed":392145,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":74,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003799"},"pg_stats":[{"pgid":"2.1f","version":"81'13","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:20.504807+0000","last_change":"2024-08-28T19:29:46.098343+0000","last_active":"2024-08-28T19:31:20.504807+0000","last_peered":"2024-08-28T19:31:20.504807+0000","last_clean":"2024-08-28T19:31:20.504807+0000","last_became_active":"2024-08-28T19:29:46.097974+0000","last_became_peered":"2024-08-28T19:29:46.097974+0000","last_unstale":"2024-08-28T19:31:20.504807+0000","last_undegraded":"2024-08-28T19:31:20.504807+0000","last_fullsized":"2024-08-28T19:31:20.504807+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:03:11.466154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549015+0000","last_change":"2024-08-28T19:29:48.123521+0000","last_active":"2024-08-28T19:30:27.549015+0000","last_peered":"2024-08-28T19:30:27.549015+0000","last_clean":"2024-08-28T19:30:27.549015+0000","last_became_active":"2024-08-28T19:29:48.122998+0000","last_became_peered":"2024-08-28T19:29:48.122998+0000","last_unstale":"2024-08-28T19:30:27.549015+0000","last_undegraded":"2024-08-28T19:30:27.549015+0000","last_fullsized":"2024-08-28T19:30:27.549015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:33:48.413468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398981+0000","last_change":"2024-08-28T19:29:55.268086+0000","last_active":"2024-08-28T19:30:27.398981+0000","last_peered":"2024-08-28T19:30:27.398981+0000","last_clean":"2024-08-28T19:30:27.398981+0000","last_became_active":"2024-08-28T19:29:55.267411+0000","last_became_peered":"2024-08-28T19:29:55.267411+0000","last_unstale":"2024-08-28T19:30:27.398981+0000","last_undegraded":"2024-08-28T19:30:27.398981+0000","last_fullsized":"2024-08-28T19:30:27.398981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:32:16.277295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549135+0000","last_change":"2024-08-28T19:29:46.188552+0000","last_active":"2024-08-28T19:30:27.549135+0000","last_peered":"2024-08-28T19:30:27.549135+0000","last_clean":"2024-08-28T19:30:27.549135+0000","last_became_active":"2024-08-28T19:29:46.188118+0000","last_became_peered":"2024-08-28T19:29:46.188118+0000","last_unstale":"2024-08-28T19:30:27.549135+0000","last_undegraded":"2024-08-28T19:30:27.549135+0000","last_fullsized":"2024-08-28T19:30:27.549135+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:55:43.774037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402122+0000","last_change":"2024-08-28T19:29:48.118765+0000","last_active":"2024-08-28T19:30:27.402122+0000","last_peered":"2024-08-28T19:30:27.402122+0000","last_clean":"2024-08-28T19:30:27.402122+0000","last_became_active":"2024-08-28T19:29:48.118111+0000","last_became_peered":"2024-08-28T19:29:48.118111+0000","last_unstale":"2024-08-28T19:30:27.402122+0000","last_undegraded":"2024-08-28T19:30:27.402122+0000","last_fullsized":"2024-08-28T19:30:27.402122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:00:51.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401192+0000","last_change":"2024-08-28T19:29:55.262222+0000","last_active":"2024-08-28T19:30:27.401192+0000","last_peered":"2024-08-28T19:30:27.401192+0000","last_clean":"2024-08-28T19:30:27.401192+0000","last_became_active":"2024-08-28T19:29:55.260906+0000","last_became_peered":"2024-08-28T19:29:55.260906+0000","last_unstale":"2024-08-28T19:30:27.401192+0000","last_undegraded":"2024-08-28T19:30:27.401192+0000","last_fullsized":"2024-08-28T19:30:27.401192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:22:30.523609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.421805+0000","last_change":"2024-08-28T19:29:46.101077+0000","last_active":"2024-08-28T19:30:27.421805+0000","last_peered":"2024-08-28T19:30:27.421805+0000","last_clean":"2024-08-28T19:30:27.421805+0000","last_became_active":"2024-08-28T19:29:46.100630+0000","last_became_peered":"2024-08-28T19:29:46.100630+0000","last_unstale":"2024-08-28T19:30:27.421805+0000","last_undegraded":"2024-08-28T19:30:27.421805+0000","last_fullsized":"2024-08-28T19:30:27.421805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:59:11.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549826+0000","last_change":"2024-08-28T19:29:48.129460+0000","last_active":"2024-08-28T19:30:27.549826+0000","last_peered":"2024-08-28T19:30:27.549826+0000","last_clean":"2024-08-28T19:30:27.549826+0000","last_became_active":"2024-08-28T19:29:48.129068+0000","last_became_peered":"2024-08-28T19:29:48.129068+0000","last_unstale":"2024-08-28T19:30:27.549826+0000","last_undegraded":"2024-08-28T19:30:27.549826+0000","last_fullsized":"2024-08-28T19:30:27.549826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:08:40.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402313+0000","last_change":"2024-08-28T19:29:55.262943+0000","last_active":"2024-08-28T19:30:27.402313+0000","last_peered":"2024-08-28T19:30:27.402313+0000","last_clean":"2024-08-28T19:30:27.402313+0000","last_became_active":"2024-08-28T19:29:55.262424+0000","last_became_peered":"2024-08-28T19:29:55.262424+0000","last_unstale":"2024-08-28T19:30:27.402313+0000","last_undegraded":"2024-08-28T19:30:27.402313+0000","last_fullsized":"2024-08-28T19:30:27.402313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:19:40.618651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406164+0000","last_change":"2024-08-28T19:29:46.102571+0000","last_active":"2024-08-28T19:30:27.406164+0000","last_peered":"2024-08-28T19:30:27.406164+0000","last_clean":"2024-08-28T19:30:27.406164+0000","last_became_active":"2024-08-28T19:29:46.102081+0000","last_became_peered":"2024-08-28T19:29:46.102081+0000","last_unstale":"2024-08-28T19:30:27.406164+0000","last_undegraded":"2024-08-28T19:30:27.406164+0000","last_fullsized":"2024-08-28T19:30:27.406164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:46:38.266122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550530+0000","last_change":"2024-08-28T19:30:27.550413+0000","last_active":"2024-08-28T19:30:27.550530+0000","last_peered":"2024-08-28T19:30:27.550530+0000","last_clean":"2024-08-28T19:30:27.550530+0000","last_became_active":"2024-08-28T19:30:27.550002+0000","last_became_peered":"2024-08-28T19:30:27.550002+0000","last_unstale":"2024-08-28T19:30:27.550530+0000","last_undegraded":"2024-08-28T19:30:27.550530+0000","last_fullsized":"2024-08-28T19:30:27.550530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:17.519332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401862+0000","last_change":"2024-08-28T19:29:55.261930+0000","last_active":"2024-08-28T19:30:27.401862+0000","last_peered":"2024-08-28T19:30:27.401862+0000","last_clean":"2024-08-28T19:30:27.401862+0000","last_became_active":"2024-08-28T19:29:55.261208+0000","last_became_peered":"2024-08-28T19:29:55.261208+0000","last_unstale":"2024-08-28T19:30:27.401862+0000","last_undegraded":"2024-08-28T19:30:27.401862+0000","last_fullsized":"2024-08-28T19:30:27.401862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.804993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427036+0000","last_change":"2024-08-28T19:29:48.133820+0000","last_active":"2024-08-28T19:30:27.427036+0000","last_peered":"2024-08-28T19:30:27.427036+0000","last_clean":"2024-08-28T19:30:27.427036+0000","last_became_active":"2024-08-28T19:29:48.132536+0000","last_became_peered":"2024-08-28T19:29:48.132536+0000","last_unstale":"2024-08-28T19:30:27.427036+0000","last_undegraded":"2024-08-28T19:30:27.427036+0000","last_fullsized":"2024-08-28T19:30:27.427036+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:15:39.779698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405110+0000","last_change":"2024-08-28T19:29:46.101206+0000","last_active":"2024-08-28T19:30:27.405110+0000","last_peered":"2024-08-28T19:30:27.405110+0000","last_clean":"2024-08-28T19:30:27.405110+0000","last_became_active":"2024-08-28T19:29:46.100801+0000","last_became_peered":"2024-08-28T19:29:46.100801+0000","last_unstale":"2024-08-28T19:30:27.405110+0000","last_undegraded":"2024-08-28T19:30:27.405110+0000","last_fullsized":"2024-08-28T19:30:27.405110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:43:33.156203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401551+0000","last_change":"2024-08-28T19:29:55.572774+0000","last_active":"2024-08-28T19:30:27.401551+0000","last_peered":"2024-08-28T19:30:27.401551+0000","last_clean":"2024-08-28T19:30:27.401551+0000","last_became_active":"2024-08-28T19:29:55.571703+0000","last_became_peered":"2024-08-28T19:29:55.571703+0000","last_unstale":"2024-08-28T19:30:27.401551+0000","last_undegraded":"2024-08-28T19:30:27.401551+0000","last_fullsized":"2024-08-28T19:30:27.401551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:56:52.695007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548462+0000","last_change":"2024-08-28T19:29:48.127683+0000","last_active":"2024-08-28T19:30:27.548462+0000","last_peered":"2024-08-28T19:30:27.548462+0000","last_clean":"2024-08-28T19:30:27.548462+0000","last_became_active":"2024-08-28T19:29:48.127139+0000","last_became_peered":"2024-08-28T19:29:48.127139+0000","last_unstale":"2024-08-28T19:30:27.548462+0000","last_undegraded":"2024-08-28T19:30:27.548462+0000","last_fullsized":"2024-08-28T19:30:27.548462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:38:16.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399374+0000","last_change":"2024-08-28T19:29:46.103233+0000","last_active":"2024-08-28T19:30:27.399374+0000","last_peered":"2024-08-28T19:30:27.399374+0000","last_clean":"2024-08-28T19:30:27.399374+0000","last_became_active":"2024-08-28T19:29:46.102515+0000","last_became_peered":"2024-08-28T19:29:46.102515+0000","last_unstale":"2024-08-28T19:30:27.399374+0000","last_undegraded":"2024-08-28T19:30:27.399374+0000","last_fullsized":"2024-08-28T19:30:27.399374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:49:35.905893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401876+0000","last_change":"2024-08-28T19:29:55.264291+0000","last_active":"2024-08-28T19:30:27.401876+0000","last_peered":"2024-08-28T19:30:27.401876+0000","last_clean":"2024-08-28T19:30:27.401876+0000","last_became_active":"2024-08-28T19:29:55.263692+0000","last_became_peered":"2024-08-28T19:29:55.263692+0000","last_unstale":"2024-08-28T19:30:27.401876+0000","last_undegraded":"2024-08-28T19:30:27.401876+0000","last_fullsized":"2024-08-28T19:30:27.401876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:47:01.795320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398110+0000","last_change":"2024-08-28T19:29:48.115470+0000","last_active":"2024-08-28T19:30:27.398110+0000","last_peered":"2024-08-28T19:30:27.398110+0000","last_clean":"2024-08-28T19:30:27.398110+0000","last_became_active":"2024-08-28T19:29:48.115076+0000","last_became_peered":"2024-08-28T19:29:48.115076+0000","last_unstale":"2024-08-28T19:30:27.398110+0000","last_undegraded":"2024-08-28T19:30:27.398110+0000","last_fullsized":"2024-08-28T19:30:27.398110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:32.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548923+0000","last_change":"2024-08-28T19:29:46.099970+0000","last_active":"2024-08-28T19:30:27.548923+0000","last_peered":"2024-08-28T19:30:27.548923+0000","last_clean":"2024-08-28T19:30:27.548923+0000","last_became_active":"2024-08-28T19:29:46.099661+0000","last_became_peered":"2024-08-28T19:29:46.099661+0000","last_unstale":"2024-08-28T19:30:27.548923+0000","last_undegraded":"2024-08-28T19:30:27.548923+0000","last_fullsized":"2024-08-28T19:30:27.548923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:27.430026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401786+0000","last_change":"2024-08-28T19:29:55.265983+0000","last_active":"2024-08-28T19:30:27.401786+0000","last_peered":"2024-08-28T19:30:27.401786+0000","last_clean":"2024-08-28T19:30:27.401786+0000","last_became_active":"2024-08-28T19:29:55.265464+0000","last_became_peered":"2024-08-28T19:29:55.265464+0000","last_unstale":"2024-08-28T19:30:27.401786+0000","last_undegraded":"2024-08-28T19:30:27.401786+0000","last_fullsized":"2024-08-28T19:30:27.401786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:21:42.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404711+0000","last_change":"2024-08-28T19:29:48.119545+0000","last_active":"2024-08-28T19:30:27.404711+0000","last_peered":"2024-08-28T19:30:27.404711+0000","last_clean":"2024-08-28T19:30:27.404711+0000","last_became_active":"2024-08-28T19:29:48.119128+0000","last_became_peered":"2024-08-28T19:29:48.119128+0000","last_unstale":"2024-08-28T19:30:27.404711+0000","last_undegraded":"2024-08-28T19:30:27.404711+0000","last_fullsized":"2024-08-28T19:30:27.404711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:05:31.535016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549131+0000","last_change":"2024-08-28T19:29:46.188962+0000","last_active":"2024-08-28T19:30:27.549131+0000","last_peered":"2024-08-28T19:30:27.549131+0000","last_clean":"2024-08-28T19:30:27.549131+0000","last_became_active":"2024-08-28T19:29:46.188510+0000","last_became_peered":"2024-08-28T19:29:46.188510+0000","last_unstale":"2024-08-28T19:30:27.549131+0000","last_undegraded":"2024-08-28T19:30:27.549131+0000","last_fullsized":"2024-08-28T19:30:27.549131+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:08.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402457+0000","last_change":"2024-08-28T19:29:55.573320+0000","last_active":"2024-08-28T19:30:27.402457+0000","last_peered":"2024-08-28T19:30:27.402457+0000","last_clean":"2024-08-28T19:30:27.402457+0000","last_became_active":"2024-08-28T19:29:55.572858+0000","last_became_peered":"2024-08-28T19:29:55.572858+0000","last_unstale":"2024-08-28T19:30:27.402457+0000","last_undegraded":"2024-08-28T19:30:27.402457+0000","last_fullsized":"2024-08-28T19:30:27.402457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:09:34.676911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405023+0000","last_change":"2024-08-28T19:30:27.404918+0000","last_active":"2024-08-28T19:30:27.405023+0000","last_peered":"2024-08-28T19:30:27.405023+0000","last_clean":"2024-08-28T19:30:27.405023+0000","last_became_active":"2024-08-28T19:30:27.404495+0000","last_became_peered":"2024-08-28T19:30:27.404495+0000","last_unstale":"2024-08-28T19:30:27.405023+0000","last_undegraded":"2024-08-28T19:30:27.405023+0000","last_fullsized":"2024-08-28T19:30:27.405023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:10:12.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402080+0000","last_change":"2024-08-28T19:29:46.110683+0000","last_active":"2024-08-28T19:30:27.402080+0000","last_peered":"2024-08-28T19:30:27.402080+0000","last_clean":"2024-08-28T19:30:27.402080+0000","last_became_active":"2024-08-28T19:29:46.110324+0000","last_became_peered":"2024-08-28T19:29:46.110324+0000","last_unstale":"2024-08-28T19:30:27.402080+0000","last_undegraded":"2024-08-28T19:30:27.402080+0000","last_fullsized":"2024-08-28T19:30:27.402080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:15:47.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398964+0000","last_change":"2024-08-28T19:29:55.271035+0000","last_active":"2024-08-28T19:30:27.398964+0000","last_peered":"2024-08-28T19:30:27.398964+0000","last_clean":"2024-08-28T19:30:27.398964+0000","last_became_active":"2024-08-28T19:29:55.268465+0000","last_became_peered":"2024-08-28T19:29:55.268465+0000","last_unstale":"2024-08-28T19:30:27.398964+0000","last_undegraded":"2024-08-28T19:30:27.398964+0000","last_fullsized":"2024-08-28T19:30:27.398964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:16:17.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548938+0000","last_change":"2024-08-28T19:29:48.127225+0000","last_active":"2024-08-28T19:30:27.548938+0000","last_peered":"2024-08-28T19:30:27.548938+0000","last_clean":"2024-08-28T19:30:27.548938+0000","last_became_active":"2024-08-28T19:29:48.126775+0000","last_became_peered":"2024-08-28T19:29:48.126775+0000","last_unstale":"2024-08-28T19:30:27.548938+0000","last_undegraded":"2024-08-28T19:30:27.548938+0000","last_fullsized":"2024-08-28T19:30:27.548938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:49:39.353082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'15","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:41.115254+0000","last_change":"2024-08-28T19:29:46.098076+0000","last_active":"2024-08-28T19:30:41.115254+0000","last_peered":"2024-08-28T19:30:41.115254+0000","last_clean":"2024-08-28T19:30:41.115254+0000","last_became_active":"2024-08-28T19:29:46.097726+0000","last_became_peered":"2024-08-28T19:29:46.097726+0000","last_unstale":"2024-08-28T19:30:41.115254+0000","last_undegraded":"2024-08-28T19:30:41.115254+0000","last_fullsized":"2024-08-28T19:30:41.115254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.624125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548224+0000","last_change":"2024-08-28T19:29:55.571830+0000","last_active":"2024-08-28T19:30:27.548224+0000","last_peered":"2024-08-28T19:30:27.548224+0000","last_clean":"2024-08-28T19:30:27.548224+0000","last_became_active":"2024-08-28T19:29:55.571318+0000","last_became_peered":"2024-08-28T19:29:55.571318+0000","last_unstale":"2024-08-28T19:30:27.548224+0000","last_undegraded":"2024-08-28T19:30:27.548224+0000","last_fullsized":"2024-08-28T19:30:27.548224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:41:03.397478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397059+0000","last_change":"2024-08-28T19:29:48.124998+0000","last_active":"2024-08-28T19:30:27.397059+0000","last_peered":"2024-08-28T19:30:27.397059+0000","last_clean":"2024-08-28T19:30:27.397059+0000","last_became_active":"2024-08-28T19:29:48.124600+0000","last_became_peered":"2024-08-28T19:29:48.124600+0000","last_unstale":"2024-08-28T19:30:27.397059+0000","last_undegraded":"2024-08-28T19:30:27.397059+0000","last_fullsized":"2024-08-28T19:30:27.397059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:50:59.459372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406363+0000","last_change":"2024-08-28T19:29:46.189455+0000","last_active":"2024-08-28T19:30:27.406363+0000","last_peered":"2024-08-28T19:30:27.406363+0000","last_clean":"2024-08-28T19:30:27.406363+0000","last_became_active":"2024-08-28T19:29:46.188640+0000","last_became_peered":"2024-08-28T19:29:46.188640+0000","last_unstale":"2024-08-28T19:30:27.406363+0000","last_undegraded":"2024-08-28T19:30:27.406363+0000","last_fullsized":"2024-08-28T19:30:27.406363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:05:32.561725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398095+0000","last_change":"2024-08-28T19:29:55.269726+0000","last_active":"2024-08-28T19:30:27.398095+0000","last_peered":"2024-08-28T19:30:27.398095+0000","last_clean":"2024-08-28T19:30:27.398095+0000","last_became_active":"2024-08-28T19:29:55.269261+0000","last_became_peered":"2024-08-28T19:29:55.269261+0000","last_unstale":"2024-08-28T19:30:27.398095+0000","last_undegraded":"2024-08-28T19:30:27.398095+0000","last_fullsized":"2024-08-28T19:30:27.398095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:05.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398331+0000","last_change":"2024-08-28T19:29:48.125251+0000","last_active":"2024-08-28T19:30:27.398331+0000","last_peered":"2024-08-28T19:30:27.398331+0000","last_clean":"2024-08-28T19:30:27.398331+0000","last_became_active":"2024-08-28T19:29:48.124818+0000","last_became_peered":"2024-08-28T19:29:48.124818+0000","last_unstale":"2024-08-28T19:30:27.398331+0000","last_undegraded":"2024-08-28T19:30:27.398331+0000","last_fullsized":"2024-08-28T19:30:27.398331+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:47:05.217199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401993+0000","last_change":"2024-08-28T19:29:46.189747+0000","last_active":"2024-08-28T19:30:27.401993+0000","last_peered":"2024-08-28T19:30:27.401993+0000","last_clean":"2024-08-28T19:30:27.401993+0000","last_became_active":"2024-08-28T19:29:46.189356+0000","last_became_peered":"2024-08-28T19:29:46.189356+0000","last_unstale":"2024-08-28T19:30:27.401993+0000","last_undegraded":"2024-08-28T19:30:27.401993+0000","last_fullsized":"2024-08-28T19:30:27.401993+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.629054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405026+0000","last_change":"2024-08-28T19:29:55.572746+0000","last_active":"2024-08-28T19:30:27.405026+0000","last_peered":"2024-08-28T19:30:27.405026+0000","last_clean":"2024-08-28T19:30:27.405026+0000","last_became_active":"2024-08-28T19:29:55.572246+0000","last_became_peered":"2024-08-28T19:29:55.572246+0000","last_unstale":"2024-08-28T19:30:27.405026+0000","last_undegraded":"2024-08-28T19:30:27.405026+0000","last_fullsized":"2024-08-28T19:30:27.405026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:48:23.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398559+0000","last_change":"2024-08-28T19:29:48.127579+0000","last_active":"2024-08-28T19:30:27.398559+0000","last_peered":"2024-08-28T19:30:27.398559+0000","last_clean":"2024-08-28T19:30:27.398559+0000","last_became_active":"2024-08-28T19:29:48.126978+0000","last_became_peered":"2024-08-28T19:29:48.126978+0000","last_unstale":"2024-08-28T19:30:27.398559+0000","last_undegraded":"2024-08-28T19:30:27.398559+0000","last_fullsized":"2024-08-28T19:30:27.398559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:27.657714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:18.502502+0000","last_change":"2024-08-28T19:29:46.102374+0000","last_active":"2024-08-28T19:31:18.502502+0000","last_peered":"2024-08-28T19:31:18.502502+0000","last_clean":"2024-08-28T19:31:18.502502+0000","last_became_active":"2024-08-28T19:29:46.101619+0000","last_became_peered":"2024-08-28T19:29:46.101619+0000","last_unstale":"2024-08-28T19:31:18.502502+0000","last_undegraded":"2024-08-28T19:31:18.502502+0000","last_fullsized":"2024-08-28T19:31:18.502502+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:46:21.353063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396841+0000","last_change":"2024-08-28T19:29:55.265403+0000","last_active":"2024-08-28T19:30:27.396841+0000","last_peered":"2024-08-28T19:30:27.396841+0000","last_clean":"2024-08-28T19:30:27.396841+0000","last_became_active":"2024-08-28T19:29:55.264979+0000","last_became_peered":"2024-08-28T19:29:55.264979+0000","last_unstale":"2024-08-28T19:30:27.396841+0000","last_undegraded":"2024-08-28T19:30:27.396841+0000","last_fullsized":"2024-08-28T19:30:27.396841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:18:18.623218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405723+0000","last_change":"2024-08-28T19:29:48.117437+0000","last_active":"2024-08-28T19:30:27.405723+0000","last_peered":"2024-08-28T19:30:27.405723+0000","last_clean":"2024-08-28T19:30:27.405723+0000","last_became_active":"2024-08-28T19:29:48.116379+0000","last_became_peered":"2024-08-28T19:29:48.116379+0000","last_unstale":"2024-08-28T19:30:27.405723+0000","last_undegraded":"2024-08-28T19:30:27.405723+0000","last_fullsized":"2024-08-28T19:30:27.405723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:23.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:21.506301+0000","last_change":"2024-08-28T19:29:46.188551+0000","last_active":"2024-08-28T19:31:21.506301+0000","last_peered":"2024-08-28T19:31:21.506301+0000","last_clean":"2024-08-28T19:31:21.506301+0000","last_became_active":"2024-08-28T19:29:46.188050+0000","last_became_peered":"2024-08-28T19:29:46.188050+0000","last_unstale":"2024-08-28T19:31:21.506301+0000","last_undegraded":"2024-08-28T19:31:21.506301+0000","last_fullsized":"2024-08-28T19:31:21.506301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:07:21.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396915+0000","last_change":"2024-08-28T19:29:55.572013+0000","last_active":"2024-08-28T19:30:27.396915+0000","last_peered":"2024-08-28T19:30:27.396915+0000","last_clean":"2024-08-28T19:30:27.396915+0000","last_became_active":"2024-08-28T19:29:55.571503+0000","last_became_peered":"2024-08-28T19:29:55.571503+0000","last_unstale":"2024-08-28T19:30:27.396915+0000","last_undegraded":"2024-08-28T19:30:27.396915+0000","last_fullsized":"2024-08-28T19:30:27.396915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:40:21.669321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396418+0000","last_change":"2024-08-28T19:29:48.124646+0000","last_active":"2024-08-28T19:30:27.396418+0000","last_peered":"2024-08-28T19:30:27.396418+0000","last_clean":"2024-08-28T19:30:27.396418+0000","last_became_active":"2024-08-28T19:29:48.123062+0000","last_became_peered":"2024-08-28T19:29:48.123062+0000","last_unstale":"2024-08-28T19:30:27.396418+0000","last_undegraded":"2024-08-28T19:30:27.396418+0000","last_fullsized":"2024-08-28T19:30:27.396418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:16:03.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426530+0000","last_change":"2024-08-28T19:29:46.105979+0000","last_active":"2024-08-28T19:30:27.426530+0000","last_peered":"2024-08-28T19:30:27.426530+0000","last_clean":"2024-08-28T19:30:27.426530+0000","last_became_active":"2024-08-28T19:29:46.105558+0000","last_became_peered":"2024-08-28T19:29:46.105558+0000","last_unstale":"2024-08-28T19:30:27.426530+0000","last_undegraded":"2024-08-28T19:30:27.426530+0000","last_fullsized":"2024-08-28T19:30:27.426530+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:47.639236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.403694+0000","last_change":"2024-08-28T19:29:55.574025+0000","last_active":"2024-08-28T19:30:27.403694+0000","last_peered":"2024-08-28T19:30:27.403694+0000","last_clean":"2024-08-28T19:30:27.403694+0000","last_became_active":"2024-08-28T19:29:55.573380+0000","last_became_peered":"2024-08-28T19:29:55.573380+0000","last_unstale":"2024-08-28T19:30:27.403694+0000","last_undegraded":"2024-08-28T19:30:27.403694+0000","last_fullsized":"2024-08-28T19:30:27.403694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:19:05.287692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548592+0000","last_change":"2024-08-28T19:29:48.118606+0000","last_active":"2024-08-28T19:30:27.548592+0000","last_peered":"2024-08-28T19:30:27.548592+0000","last_clean":"2024-08-28T19:30:27.548592+0000","last_became_active":"2024-08-28T19:29:48.117534+0000","last_became_peered":"2024-08-28T19:29:48.117534+0000","last_unstale":"2024-08-28T19:30:27.548592+0000","last_undegraded":"2024-08-28T19:30:27.548592+0000","last_fullsized":"2024-08-28T19:30:27.548592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:34.253859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.422305+0000","last_change":"2024-08-28T19:29:46.100420+0000","last_active":"2024-08-28T19:30:27.422305+0000","last_peered":"2024-08-28T19:30:27.422305+0000","last_clean":"2024-08-28T19:30:27.422305+0000","last_became_active":"2024-08-28T19:29:46.099990+0000","last_became_peered":"2024-08-28T19:29:46.099990+0000","last_unstale":"2024-08-28T19:30:27.422305+0000","last_undegraded":"2024-08-28T19:30:27.422305+0000","last_fullsized":"2024-08-28T19:30:27.422305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:42:12.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427003+0000","last_change":"2024-08-28T19:28:32.822169+0000","last_active":"2024-08-28T19:30:27.427003+0000","last_peered":"2024-08-28T19:30:27.427003+0000","last_clean":"2024-08-28T19:30:27.427003+0000","last_became_active":"2024-08-28T19:28:32.816300+0000","last_became_peered":"2024-08-28T19:28:32.816300+0000","last_unstale":"2024-08-28T19:30:27.427003+0000","last_undegraded":"2024-08-28T19:30:27.427003+0000","last_fullsized":"2024-08-28T19:30:27.427003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_clean_scrub_stamp":"2024-08-28T19:25:14.491568+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:41:37.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427270+0000","last_change":"2024-08-28T19:29:55.265437+0000","last_active":"2024-08-28T19:30:27.427270+0000","last_peered":"2024-08-28T19:30:27.427270+0000","last_clean":"2024-08-28T19:30:27.427270+0000","last_became_active":"2024-08-28T19:29:55.264818+0000","last_became_peered":"2024-08-28T19:29:55.264818+0000","last_unstale":"2024-08-28T19:30:27.427270+0000","last_undegraded":"2024-08-28T19:30:27.427270+0000","last_fullsized":"2024-08-28T19:30:27.427270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:28:18.684362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427338+0000","last_change":"2024-08-28T19:29:48.135800+0000","last_active":"2024-08-28T19:30:27.427338+0000","last_peered":"2024-08-28T19:30:27.427338+0000","last_clean":"2024-08-28T19:30:27.427338+0000","last_became_active":"2024-08-28T19:29:48.135258+0000","last_became_peered":"2024-08-28T19:29:48.135258+0000","last_unstale":"2024-08-28T19:30:27.427338+0000","last_undegraded":"2024-08-28T19:30:27.427338+0000","last_fullsized":"2024-08-28T19:30:27.427338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:55.183190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:22.509555+0000","last_change":"2024-08-28T19:29:46.189298+0000","last_active":"2024-08-28T19:31:22.509555+0000","last_peered":"2024-08-28T19:31:22.509555+0000","last_clean":"2024-08-28T19:31:22.509555+0000","last_became_active":"2024-08-28T19:29:46.188813+0000","last_became_peered":"2024-08-28T19:29:46.188813+0000","last_unstale":"2024-08-28T19:31:22.509555+0000","last_undegraded":"2024-08-28T19:31:22.509555+0000","last_fullsized":"2024-08-28T19:31:22.509555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:14:00.961682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548910+0000","last_change":"2024-08-28T19:29:55.269495+0000","last_active":"2024-08-28T19:30:27.548910+0000","last_peered":"2024-08-28T19:30:27.548910+0000","last_clean":"2024-08-28T19:30:27.548910+0000","last_became_active":"2024-08-28T19:29:55.268916+0000","last_became_peered":"2024-08-28T19:29:55.268916+0000","last_unstale":"2024-08-28T19:30:27.548910+0000","last_undegraded":"2024-08-28T19:30:27.548910+0000","last_fullsized":"2024-08-28T19:30:27.548910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:26:53.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426791+0000","last_change":"2024-08-28T19:29:48.127588+0000","last_active":"2024-08-28T19:30:27.426791+0000","last_peered":"2024-08-28T19:30:27.426791+0000","last_clean":"2024-08-28T19:30:27.426791+0000","last_became_active":"2024-08-28T19:29:48.127200+0000","last_became_peered":"2024-08-28T19:29:48.127200+0000","last_unstale":"2024-08-28T19:30:27.426791+0000","last_undegraded":"2024-08-28T19:30:27.426791+0000","last_fullsized":"2024-08-28T19:30:27.426791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:30:30.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404909+0000","last_change":"2024-08-28T19:29:46.101010+0000","last_active":"2024-08-28T19:30:27.404909+0000","last_peered":"2024-08-28T19:30:27.404909+0000","last_clean":"2024-08-28T19:30:27.404909+0000","last_became_active":"2024-08-28T19:29:46.100082+0000","last_became_peered":"2024-08-28T19:29:46.100082+0000","last_unstale":"2024-08-28T19:30:27.404909+0000","last_undegraded":"2024-08-28T19:30:27.404909+0000","last_fullsized":"2024-08-28T19:30:27.404909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:18:51.074343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.551852+0000","last_change":"2024-08-28T19:30:27.551743+0000","last_active":"2024-08-28T19:30:27.551852+0000","last_peered":"2024-08-28T19:30:27.551852+0000","last_clean":"2024-08-28T19:30:27.551852+0000","last_became_active":"2024-08-28T19:30:27.551249+0000","last_became_peered":"2024-08-28T19:30:27.551249+0000","last_unstale":"2024-08-28T19:30:27.551852+0000","last_undegraded":"2024-08-28T19:30:27.551852+0000","last_fullsized":"2024-08-28T19:30:27.551852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:35.043553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426736+0000","last_change":"2024-08-28T19:29:48.132429+0000","last_active":"2024-08-28T19:30:27.426736+0000","last_peered":"2024-08-28T19:30:27.426736+0000","last_clean":"2024-08-28T19:30:27.426736+0000","last_became_active":"2024-08-28T19:29:48.132020+0000","last_became_peered":"2024-08-28T19:29:48.132020+0000","last_unstale":"2024-08-28T19:30:27.426736+0000","last_undegraded":"2024-08-28T19:30:27.426736+0000","last_fullsized":"2024-08-28T19:30:27.426736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:45:11.992083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397065+0000","last_change":"2024-08-28T19:29:46.097245+0000","last_active":"2024-08-28T19:30:27.397065+0000","last_peered":"2024-08-28T19:30:27.397065+0000","last_clean":"2024-08-28T19:30:27.397065+0000","last_became_active":"2024-08-28T19:29:46.096867+0000","last_became_peered":"2024-08-28T19:29:46.096867+0000","last_unstale":"2024-08-28T19:30:27.397065+0000","last_undegraded":"2024-08-28T19:30:27.397065+0000","last_fullsized":"2024-08-28T19:30:27.397065+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:22:14.888597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405312+0000","last_change":"2024-08-28T19:29:55.265006+0000","last_active":"2024-08-28T19:30:27.405312+0000","last_peered":"2024-08-28T19:30:27.405312+0000","last_clean":"2024-08-28T19:30:27.405312+0000","last_became_active":"2024-08-28T19:29:55.264321+0000","last_became_peered":"2024-08-28T19:29:55.264321+0000","last_unstale":"2024-08-28T19:30:27.405312+0000","last_undegraded":"2024-08-28T19:30:27.405312+0000","last_fullsized":"2024-08-28T19:30:27.405312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:53:27.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398520+0000","last_change":"2024-08-28T19:29:48.120916+0000","last_active":"2024-08-28T19:30:27.398520+0000","last_peered":"2024-08-28T19:30:27.398520+0000","last_clean":"2024-08-28T19:30:27.398520+0000","last_became_active":"2024-08-28T19:29:48.120473+0000","last_became_peered":"2024-08-28T19:29:48.120473+0000","last_unstale":"2024-08-28T19:30:27.398520+0000","last_undegraded":"2024-08-28T19:30:27.398520+0000","last_fullsized":"2024-08-28T19:30:27.398520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:15.067237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405342+0000","last_change":"2024-08-28T19:29:46.103164+0000","last_active":"2024-08-28T19:30:27.405342+0000","last_peered":"2024-08-28T19:30:27.405342+0000","last_clean":"2024-08-28T19:30:27.405342+0000","last_became_active":"2024-08-28T19:29:46.101772+0000","last_became_peered":"2024-08-28T19:29:46.101772+0000","last_unstale":"2024-08-28T19:30:27.405342+0000","last_undegraded":"2024-08-28T19:30:27.405342+0000","last_fullsized":"2024-08-28T19:30:27.405342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:46:29.533552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550981+0000","last_change":"2024-08-28T19:30:27.550861+0000","last_active":"2024-08-28T19:30:27.550981+0000","last_peered":"2024-08-28T19:30:27.550981+0000","last_clean":"2024-08-28T19:30:27.550981+0000","last_became_active":"2024-08-28T19:30:27.550131+0000","last_became_peered":"2024-08-28T19:30:27.550131+0000","last_unstale":"2024-08-28T19:30:27.550981+0000","last_undegraded":"2024-08-28T19:30:27.550981+0000","last_fullsized":"2024-08-28T19:30:27.550981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:37:16.004222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.551596+0000","last_change":"2024-08-28T19:30:27.551445+0000","last_active":"2024-08-28T19:30:27.551596+0000","last_peered":"2024-08-28T19:30:27.551596+0000","last_clean":"2024-08-28T19:30:27.551596+0000","last_became_active":"2024-08-28T19:30:27.550927+0000","last_became_peered":"2024-08-28T19:30:27.550927+0000","last_unstale":"2024-08-28T19:30:27.551596+0000","last_undegraded":"2024-08-28T19:30:27.551596+0000","last_fullsized":"2024-08-28T19:30:27.551596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:52:56.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405028+0000","last_change":"2024-08-28T19:29:46.190191+0000","last_active":"2024-08-28T19:30:27.405028+0000","last_peered":"2024-08-28T19:30:27.405028+0000","last_clean":"2024-08-28T19:30:27.405028+0000","last_became_active":"2024-08-28T19:29:46.188143+0000","last_became_peered":"2024-08-28T19:29:46.188143+0000","last_unstale":"2024-08-28T19:30:27.405028+0000","last_undegraded":"2024-08-28T19:30:27.405028+0000","last_fullsized":"2024-08-28T19:30:27.405028+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:58:11.854449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397058+0000","last_change":"2024-08-28T19:29:55.266777+0000","last_active":"2024-08-28T19:30:27.397058+0000","last_peered":"2024-08-28T19:30:27.397058+0000","last_clean":"2024-08-28T19:30:27.397058+0000","last_became_active":"2024-08-28T19:29:55.266296+0000","last_became_peered":"2024-08-28T19:29:55.266296+0000","last_unstale":"2024-08-28T19:30:27.397058+0000","last_undegraded":"2024-08-28T19:30:27.397058+0000","last_fullsized":"2024-08-28T19:30:27.397058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:28:20.279522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426781+0000","last_change":"2024-08-28T19:29:48.129070+0000","last_active":"2024-08-28T19:30:27.426781+0000","last_peered":"2024-08-28T19:30:27.426781+0000","last_clean":"2024-08-28T19:30:27.426781+0000","last_became_active":"2024-08-28T19:29:48.128701+0000","last_became_peered":"2024-08-28T19:29:48.128701+0000","last_unstale":"2024-08-28T19:30:27.426781+0000","last_undegraded":"2024-08-28T19:30:27.426781+0000","last_fullsized":"2024-08-28T19:30:27.426781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:29:29.375379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:17.501207+0000","last_change":"2024-08-28T19:29:46.098281+0000","last_active":"2024-08-28T19:31:17.501207+0000","last_peered":"2024-08-28T19:31:17.501207+0000","last_clean":"2024-08-28T19:31:17.501207+0000","last_became_active":"2024-08-28T19:29:46.097870+0000","last_became_peered":"2024-08-28T19:29:46.097870+0000","last_unstale":"2024-08-28T19:31:17.501207+0000","last_undegraded":"2024-08-28T19:31:17.501207+0000","last_fullsized":"2024-08-28T19:31:17.501207+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:24:09.693310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401852+0000","last_change":"2024-08-28T19:29:55.264883+0000","last_active":"2024-08-28T19:30:27.401852+0000","last_peered":"2024-08-28T19:30:27.401852+0000","last_clean":"2024-08-28T19:30:27.401852+0000","last_became_active":"2024-08-28T19:29:55.264392+0000","last_became_peered":"2024-08-28T19:29:55.264392+0000","last_unstale":"2024-08-28T19:30:27.401852+0000","last_undegraded":"2024-08-28T19:30:27.401852+0000","last_fullsized":"2024-08-28T19:30:27.401852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:34.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427027+0000","last_change":"2024-08-28T19:29:48.135499+0000","last_active":"2024-08-28T19:30:27.427027+0000","last_peered":"2024-08-28T19:30:27.427027+0000","last_clean":"2024-08-28T19:30:27.427027+0000","last_became_active":"2024-08-28T19:29:48.134934+0000","last_became_peered":"2024-08-28T19:29:48.134934+0000","last_unstale":"2024-08-28T19:30:27.427027+0000","last_undegraded":"2024-08-28T19:30:27.427027+0000","last_fullsized":"2024-08-28T19:30:27.427027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:57:01.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405099+0000","last_change":"2024-08-28T19:29:46.104680+0000","last_active":"2024-08-28T19:30:27.405099+0000","last_peered":"2024-08-28T19:30:27.405099+0000","last_clean":"2024-08-28T19:30:27.405099+0000","last_became_active":"2024-08-28T19:29:46.104290+0000","last_became_peered":"2024-08-28T19:29:46.104290+0000","last_unstale":"2024-08-28T19:30:27.405099+0000","last_undegraded":"2024-08-28T19:30:27.405099+0000","last_fullsized":"2024-08-28T19:30:27.405099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:39.789935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398105+0000","last_change":"2024-08-28T19:29:55.264676+0000","last_active":"2024-08-28T19:30:27.398105+0000","last_peered":"2024-08-28T19:30:27.398105+0000","last_clean":"2024-08-28T19:30:27.398105+0000","last_became_active":"2024-08-28T19:29:55.264206+0000","last_became_peered":"2024-08-28T19:29:55.264206+0000","last_unstale":"2024-08-28T19:30:27.398105+0000","last_undegraded":"2024-08-28T19:30:27.398105+0000","last_fullsized":"2024-08-28T19:30:27.398105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:58:15.776366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396618+0000","last_change":"2024-08-28T19:29:48.125092+0000","last_active":"2024-08-28T19:30:27.396618+0000","last_peered":"2024-08-28T19:30:27.396618+0000","last_clean":"2024-08-28T19:30:27.396618+0000","last_became_active":"2024-08-28T19:29:48.124711+0000","last_became_peered":"2024-08-28T19:29:48.124711+0000","last_unstale":"2024-08-28T19:30:27.396618+0000","last_undegraded":"2024-08-28T19:30:27.396618+0000","last_fullsized":"2024-08-28T19:30:27.396618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:17:27.806368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.422015+0000","last_change":"2024-08-28T19:29:46.100546+0000","last_active":"2024-08-28T19:30:27.422015+0000","last_peered":"2024-08-28T19:30:27.422015+0000","last_clean":"2024-08-28T19:30:27.422015+0000","last_became_active":"2024-08-28T19:29:46.100043+0000","last_became_peered":"2024-08-28T19:29:46.100043+0000","last_unstale":"2024-08-28T19:30:27.422015+0000","last_undegraded":"2024-08-28T19:30:27.422015+0000","last_fullsized":"2024-08-28T19:30:27.422015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:41:32.488258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404480+0000","last_change":"2024-08-28T19:29:55.265497+0000","last_active":"2024-08-28T19:30:27.404480+0000","last_peered":"2024-08-28T19:30:27.404480+0000","last_clean":"2024-08-28T19:30:27.404480+0000","last_became_active":"2024-08-28T19:29:55.264499+0000","last_became_peered":"2024-08-28T19:29:55.264499+0000","last_unstale":"2024-08-28T19:30:27.404480+0000","last_undegraded":"2024-08-28T19:30:27.404480+0000","last_fullsized":"2024-08-28T19:30:27.404480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:04:15.192307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405999+0000","last_change":"2024-08-28T19:29:48.133948+0000","last_active":"2024-08-28T19:30:27.405999+0000","last_peered":"2024-08-28T19:30:27.405999+0000","last_clean":"2024-08-28T19:30:27.405999+0000","last_became_active":"2024-08-28T19:29:48.133517+0000","last_became_peered":"2024-08-28T19:29:48.133517+0000","last_unstale":"2024-08-28T19:30:27.405999+0000","last_undegraded":"2024-08-28T19:30:27.405999+0000","last_fullsized":"2024-08-28T19:30:27.405999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:43:20.049931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:21.507414+0000","last_change":"2024-08-28T19:29:46.104744+0000","last_active":"2024-08-28T19:31:21.507414+0000","last_peered":"2024-08-28T19:31:21.507414+0000","last_clean":"2024-08-28T19:31:21.507414+0000","last_became_active":"2024-08-28T19:29:46.104278+0000","last_became_peered":"2024-08-28T19:29:46.104278+0000","last_unstale":"2024-08-28T19:31:21.507414+0000","last_undegraded":"2024-08-28T19:31:21.507414+0000","last_fullsized":"2024-08-28T19:31:21.507414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:36.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62072,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":121,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401456+0000","last_change":"2024-08-28T19:29:55.264892+0000","last_active":"2024-08-28T19:30:27.401456+0000","last_peered":"2024-08-28T19:30:27.401456+0000","last_clean":"2024-08-28T19:30:27.401456+0000","last_became_active":"2024-08-28T19:29:55.264466+0000","last_became_peered":"2024-08-28T19:29:55.264466+0000","last_unstale":"2024-08-28T19:30:27.401456+0000","last_undegraded":"2024-08-28T19:30:27.401456+0000","last_fullsized":"2024-08-28T19:30:27.401456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:34:51.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549875+0000","last_change":"2024-08-28T19:29:48.121692+0000","last_active":"2024-08-28T19:30:27.549875+0000","last_peered":"2024-08-28T19:30:27.549875+0000","last_clean":"2024-08-28T19:30:27.549875+0000","last_became_active":"2024-08-28T19:29:48.121274+0000","last_became_peered":"2024-08-28T19:29:48.121274+0000","last_unstale":"2024-08-28T19:30:27.549875+0000","last_undegraded":"2024-08-28T19:30:27.549875+0000","last_fullsized":"2024-08-28T19:30:27.549875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:00:36.227609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404771+0000","last_change":"2024-08-28T19:29:46.188981+0000","last_active":"2024-08-28T19:30:27.404771+0000","last_peered":"2024-08-28T19:30:27.404771+0000","last_clean":"2024-08-28T19:30:27.404771+0000","last_became_active":"2024-08-28T19:29:46.188496+0000","last_became_peered":"2024-08-28T19:29:46.188496+0000","last_unstale":"2024-08-28T19:30:27.404771+0000","last_undegraded":"2024-08-28T19:30:27.404771+0000","last_fullsized":"2024-08-28T19:30:27.404771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.689602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.552176+0000","last_change":"2024-08-28T19:30:27.552006+0000","last_active":"2024-08-28T19:30:27.552176+0000","last_peered":"2024-08-28T19:30:27.552176+0000","last_clean":"2024-08-28T19:30:27.552176+0000","last_became_active":"2024-08-28T19:30:27.551356+0000","last_became_peered":"2024-08-28T19:30:27.551356+0000","last_unstale":"2024-08-28T19:30:27.552176+0000","last_undegraded":"2024-08-28T19:30:27.552176+0000","last_fullsized":"2024-08-28T19:30:27.552176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:56:09.242401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402115+0000","last_change":"2024-08-28T19:29:48.116964+0000","last_active":"2024-08-28T19:30:27.402115+0000","last_peered":"2024-08-28T19:30:27.402115+0000","last_clean":"2024-08-28T19:30:27.402115+0000","last_became_active":"2024-08-28T19:29:48.116588+0000","last_became_peered":"2024-08-28T19:29:48.116588+0000","last_unstale":"2024-08-28T19:30:27.402115+0000","last_undegraded":"2024-08-28T19:30:27.402115+0000","last_fullsized":"2024-08-28T19:30:27.402115+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:52:02.486724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427086+0000","last_change":"2024-08-28T19:29:46.104132+0000","last_active":"2024-08-28T19:30:27.427086+0000","last_peered":"2024-08-28T19:30:27.427086+0000","last_clean":"2024-08-28T19:30:27.427086+0000","last_became_active":"2024-08-28T19:29:46.103725+0000","last_became_peered":"2024-08-28T19:29:46.103725+0000","last_unstale":"2024-08-28T19:30:27.427086+0000","last_undegraded":"2024-08-28T19:30:27.427086+0000","last_fullsized":"2024-08-28T19:30:27.427086+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:50:12.859989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400571+0000","last_change":"2024-08-28T19:29:55.265494+0000","last_active":"2024-08-28T19:30:27.400571+0000","last_peered":"2024-08-28T19:30:27.400571+0000","last_clean":"2024-08-28T19:30:27.400571+0000","last_became_active":"2024-08-28T19:29:55.265087+0000","last_became_peered":"2024-08-28T19:29:55.265087+0000","last_unstale":"2024-08-28T19:30:27.400571+0000","last_undegraded":"2024-08-28T19:30:27.400571+0000","last_fullsized":"2024-08-28T19:30:27.400571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:51:18.676889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550159+0000","last_change":"2024-08-28T19:29:48.127419+0000","last_active":"2024-08-28T19:30:27.550159+0000","last_peered":"2024-08-28T19:30:27.550159+0000","last_clean":"2024-08-28T19:30:27.550159+0000","last_became_active":"2024-08-28T19:29:48.126997+0000","last_became_peered":"2024-08-28T19:29:48.126997+0000","last_unstale":"2024-08-28T19:30:27.550159+0000","last_undegraded":"2024-08-28T19:30:27.550159+0000","last_fullsized":"2024-08-28T19:30:27.550159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:26:08.208724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:21.507185+0000","last_change":"2024-08-28T19:29:46.103451+0000","last_active":"2024-08-28T19:31:21.507185+0000","last_peered":"2024-08-28T19:31:21.507185+0000","last_clean":"2024-08-28T19:31:21.507185+0000","last_became_active":"2024-08-28T19:29:46.102991+0000","last_became_peered":"2024-08-28T19:29:46.102991+0000","last_unstale":"2024-08-28T19:31:21.507185+0000","last_undegraded":"2024-08-28T19:31:21.507185+0000","last_fullsized":"2024-08-28T19:31:21.507185+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:55:58.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548556+0000","last_change":"2024-08-28T19:29:55.269310+0000","last_active":"2024-08-28T19:30:27.548556+0000","last_peered":"2024-08-28T19:30:27.548556+0000","last_clean":"2024-08-28T19:30:27.548556+0000","last_became_active":"2024-08-28T19:29:55.268893+0000","last_became_peered":"2024-08-28T19:29:55.268893+0000","last_unstale":"2024-08-28T19:30:27.548556+0000","last_undegraded":"2024-08-28T19:30:27.548556+0000","last_fullsized":"2024-08-28T19:30:27.548556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:26:11.598773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400992+0000","last_change":"2024-08-28T19:29:55.261757+0000","last_active":"2024-08-28T19:30:27.400992+0000","last_peered":"2024-08-28T19:30:27.400992+0000","last_clean":"2024-08-28T19:30:27.400992+0000","last_became_active":"2024-08-28T19:29:55.261339+0000","last_became_peered":"2024-08-28T19:29:55.261339+0000","last_unstale":"2024-08-28T19:30:27.400992+0000","last_undegraded":"2024-08-28T19:30:27.400992+0000","last_fullsized":"2024-08-28T19:30:27.400992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:25:06.223029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401567+0000","last_change":"2024-08-28T19:29:48.123097+0000","last_active":"2024-08-28T19:30:27.401567+0000","last_peered":"2024-08-28T19:30:27.401567+0000","last_clean":"2024-08-28T19:30:27.401567+0000","last_became_active":"2024-08-28T19:29:48.122718+0000","last_became_peered":"2024-08-28T19:29:48.122718+0000","last_unstale":"2024-08-28T19:30:27.401567+0000","last_undegraded":"2024-08-28T19:30:27.401567+0000","last_fullsized":"2024-08-28T19:30:27.401567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:19.530985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406031+0000","last_change":"2024-08-28T19:29:46.105516+0000","last_active":"2024-08-28T19:30:27.406031+0000","last_peered":"2024-08-28T19:30:27.406031+0000","last_clean":"2024-08-28T19:30:27.406031+0000","last_became_active":"2024-08-28T19:29:46.105030+0000","last_became_peered":"2024-08-28T19:29:46.105030+0000","last_unstale":"2024-08-28T19:30:27.406031+0000","last_undegraded":"2024-08-28T19:30:27.406031+0000","last_fullsized":"2024-08-28T19:30:27.406031+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:47:02.032933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398485+0000","last_change":"2024-08-28T19:29:55.269759+0000","last_active":"2024-08-28T19:30:27.398485+0000","last_peered":"2024-08-28T19:30:27.398485+0000","last_clean":"2024-08-28T19:30:27.398485+0000","last_became_active":"2024-08-28T19:29:55.269275+0000","last_became_peered":"2024-08-28T19:29:55.269275+0000","last_unstale":"2024-08-28T19:30:27.398485+0000","last_undegraded":"2024-08-28T19:30:27.398485+0000","last_fullsized":"2024-08-28T19:30:27.398485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:45.870468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548611+0000","last_change":"2024-08-28T19:29:48.117400+0000","last_active":"2024-08-28T19:30:27.548611+0000","last_peered":"2024-08-28T19:30:27.548611+0000","last_clean":"2024-08-28T19:30:27.548611+0000","last_became_active":"2024-08-28T19:29:48.116987+0000","last_became_peered":"2024-08-28T19:29:48.116987+0000","last_unstale":"2024-08-28T19:30:27.548611+0000","last_undegraded":"2024-08-28T19:30:27.548611+0000","last_fullsized":"2024-08-28T19:30:27.548611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:43.822088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396426+0000","last_change":"2024-08-28T19:29:46.096103+0000","last_active":"2024-08-28T19:30:27.396426+0000","last_peered":"2024-08-28T19:30:27.396426+0000","last_clean":"2024-08-28T19:30:27.396426+0000","last_became_active":"2024-08-28T19:29:46.095812+0000","last_became_peered":"2024-08-28T19:29:46.095812+0000","last_unstale":"2024-08-28T19:30:27.396426+0000","last_undegraded":"2024-08-28T19:30:27.396426+0000","last_fullsized":"2024-08-28T19:30:27.396426+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:29.266636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398448+0000","last_change":"2024-08-28T19:29:46.106227+0000","last_active":"2024-08-28T19:30:27.398448+0000","last_peered":"2024-08-28T19:30:27.398448+0000","last_clean":"2024-08-28T19:30:27.398448+0000","last_became_active":"2024-08-28T19:29:46.105777+0000","last_became_peered":"2024-08-28T19:29:46.105777+0000","last_unstale":"2024-08-28T19:30:27.398448+0000","last_undegraded":"2024-08-28T19:30:27.398448+0000","last_fullsized":"2024-08-28T19:30:27.398448+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:26:14.815646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406013+0000","last_change":"2024-08-28T19:29:48.111051+0000","last_active":"2024-08-28T19:30:27.406013+0000","last_peered":"2024-08-28T19:30:27.406013+0000","last_clean":"2024-08-28T19:30:27.406013+0000","last_became_active":"2024-08-28T19:29:48.110421+0000","last_became_peered":"2024-08-28T19:29:48.110421+0000","last_unstale":"2024-08-28T19:30:27.406013+0000","last_undegraded":"2024-08-28T19:30:27.406013+0000","last_fullsized":"2024-08-28T19:30:27.406013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:19:47.765977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.408956+0000","last_change":"2024-08-28T19:30:27.408829+0000","last_active":"2024-08-28T19:30:27.408956+0000","last_peered":"2024-08-28T19:30:27.408956+0000","last_clean":"2024-08-28T19:30:27.408956+0000","last_became_active":"2024-08-28T19:30:27.408298+0000","last_became_peered":"2024-08-28T19:30:27.408298+0000","last_unstale":"2024-08-28T19:30:27.408956+0000","last_undegraded":"2024-08-28T19:30:27.408956+0000","last_fullsized":"2024-08-28T19:30:27.408956+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:38:58.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:20.506480+0000","last_change":"2024-08-28T19:29:46.102607+0000","last_active":"2024-08-28T19:31:20.506480+0000","last_peered":"2024-08-28T19:31:20.506480+0000","last_clean":"2024-08-28T19:31:20.506480+0000","last_became_active":"2024-08-28T19:29:46.102150+0000","last_became_peered":"2024-08-28T19:29:46.102150+0000","last_unstale":"2024-08-28T19:31:20.506480+0000","last_undegraded":"2024-08-28T19:31:20.506480+0000","last_fullsized":"2024-08-28T19:31:20.506480+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:44.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405319+0000","last_change":"2024-08-28T19:29:48.121598+0000","last_active":"2024-08-28T19:30:27.405319+0000","last_peered":"2024-08-28T19:30:27.405319+0000","last_clean":"2024-08-28T19:30:27.405319+0000","last_became_active":"2024-08-28T19:29:48.121189+0000","last_became_peered":"2024-08-28T19:29:48.121189+0000","last_unstale":"2024-08-28T19:30:27.405319+0000","last_undegraded":"2024-08-28T19:30:27.405319+0000","last_fullsized":"2024-08-28T19:30:27.405319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:19:35.496859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399556+0000","last_change":"2024-08-28T19:29:55.269648+0000","last_active":"2024-08-28T19:30:27.399556+0000","last_peered":"2024-08-28T19:30:27.399556+0000","last_clean":"2024-08-28T19:30:27.399556+0000","last_became_active":"2024-08-28T19:29:55.269182+0000","last_became_peered":"2024-08-28T19:29:55.269182+0000","last_unstale":"2024-08-28T19:30:27.399556+0000","last_undegraded":"2024-08-28T19:30:27.399556+0000","last_fullsized":"2024-08-28T19:30:27.399556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:09:47.581907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397999+0000","last_change":"2024-08-28T19:29:48.117143+0000","last_active":"2024-08-28T19:30:27.397999+0000","last_peered":"2024-08-28T19:30:27.397999+0000","last_clean":"2024-08-28T19:30:27.397999+0000","last_became_active":"2024-08-28T19:29:48.116756+0000","last_became_peered":"2024-08-28T19:29:48.116756+0000","last_unstale":"2024-08-28T19:30:27.397999+0000","last_undegraded":"2024-08-28T19:30:27.397999+0000","last_fullsized":"2024-08-28T19:30:27.397999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:03:30.736872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.407341+0000","last_change":"2024-08-28T19:30:27.407218+0000","last_active":"2024-08-28T19:30:27.407341+0000","last_peered":"2024-08-28T19:30:27.407341+0000","last_clean":"2024-08-28T19:30:27.407341+0000","last_became_active":"2024-08-28T19:30:27.406769+0000","last_became_peered":"2024-08-28T19:30:27.406769+0000","last_unstale":"2024-08-28T19:30:27.407341+0000","last_undegraded":"2024-08-28T19:30:27.407341+0000","last_fullsized":"2024-08-28T19:30:27.407341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:59.946922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399195+0000","last_change":"2024-08-28T19:29:48.123969+0000","last_active":"2024-08-28T19:30:27.399195+0000","last_peered":"2024-08-28T19:30:27.399195+0000","last_clean":"2024-08-28T19:30:27.399195+0000","last_became_active":"2024-08-28T19:29:48.122534+0000","last_became_peered":"2024-08-28T19:29:48.122534+0000","last_unstale":"2024-08-28T19:30:27.399195+0000","last_undegraded":"2024-08-28T19:30:27.399195+0000","last_fullsized":"2024-08-28T19:30:27.399195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:33:56.739763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401200+0000","last_change":"2024-08-28T19:29:48.108976+0000","last_active":"2024-08-28T19:30:27.401200+0000","last_peered":"2024-08-28T19:30:27.401200+0000","last_clean":"2024-08-28T19:30:27.401200+0000","last_became_active":"2024-08-28T19:29:48.108631+0000","last_became_peered":"2024-08-28T19:29:48.108631+0000","last_unstale":"2024-08-28T19:30:27.401200+0000","last_undegraded":"2024-08-28T19:30:27.401200+0000","last_fullsized":"2024-08-28T19:30:27.401200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:08:59.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396988+0000","last_change":"2024-08-28T19:29:48.109875+0000","last_active":"2024-08-28T19:30:27.396988+0000","last_peered":"2024-08-28T19:30:27.396988+0000","last_clean":"2024-08-28T19:30:27.396988+0000","last_became_active":"2024-08-28T19:29:48.109486+0000","last_became_peered":"2024-08-28T19:29:48.109486+0000","last_unstale":"2024-08-28T19:30:27.396988+0000","last_undegraded":"2024-08-28T19:30:27.396988+0000","last_fullsized":"2024-08-28T19:30:27.396988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:02:28.365203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398509+0000","last_change":"2024-08-28T19:29:48.117237+0000","last_active":"2024-08-28T19:30:27.398509+0000","last_peered":"2024-08-28T19:30:27.398509+0000","last_clean":"2024-08-28T19:30:27.398509+0000","last_became_active":"2024-08-28T19:29:48.116799+0000","last_became_peered":"2024-08-28T19:29:48.116799+0000","last_unstale":"2024-08-28T19:30:27.398509+0000","last_undegraded":"2024-08-28T19:30:27.398509+0000","last_fullsized":"2024-08-28T19:30:27.398509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:48:12.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400269+0000","last_change":"2024-08-28T19:29:48.120522+0000","last_active":"2024-08-28T19:30:27.400269+0000","last_peered":"2024-08-28T19:30:27.400269+0000","last_clean":"2024-08-28T19:30:27.400269+0000","last_became_active":"2024-08-28T19:29:48.120150+0000","last_became_peered":"2024-08-28T19:29:48.120150+0000","last_unstale":"2024-08-28T19:30:27.400269+0000","last_undegraded":"2024-08-28T19:30:27.400269+0000","last_fullsized":"2024-08-28T19:30:27.400269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:01:00.210596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548881+0000","last_change":"2024-08-28T19:29:48.128451+0000","last_active":"2024-08-28T19:30:27.548881+0000","last_peered":"2024-08-28T19:30:27.548881+0000","last_clean":"2024-08-28T19:30:27.548881+0000","last_became_active":"2024-08-28T19:29:48.127898+0000","last_became_peered":"2024-08-28T19:29:48.127898+0000","last_unstale":"2024-08-28T19:30:27.548881+0000","last_undegraded":"2024-08-28T19:30:27.548881+0000","last_fullsized":"2024-08-28T19:30:27.548881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:48.663999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405596+0000","last_change":"2024-08-28T19:29:48.110788+0000","last_active":"2024-08-28T19:30:27.405596+0000","last_peered":"2024-08-28T19:30:27.405596+0000","last_clean":"2024-08-28T19:30:27.405596+0000","last_became_active":"2024-08-28T19:29:48.110355+0000","last_became_peered":"2024-08-28T19:29:48.110355+0000","last_unstale":"2024-08-28T19:30:27.405596+0000","last_undegraded":"2024-08-28T19:30:27.405596+0000","last_fullsized":"2024-08-28T19:30:27.405596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:57:25.345283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548733+0000","last_change":"2024-08-28T19:29:48.129667+0000","last_active":"2024-08-28T19:30:27.548733+0000","last_peered":"2024-08-28T19:30:27.548733+0000","last_clean":"2024-08-28T19:30:27.548733+0000","last_became_active":"2024-08-28T19:29:48.128237+0000","last_became_peered":"2024-08-28T19:29:48.128237+0000","last_unstale":"2024-08-28T19:30:27.548733+0000","last_undegraded":"2024-08-28T19:30:27.548733+0000","last_fullsized":"2024-08-28T19:30:27.548733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:23:35.920353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549184+0000","last_change":"2024-08-28T19:29:48.136070+0000","last_active":"2024-08-28T19:30:27.549184+0000","last_peered":"2024-08-28T19:30:27.549184+0000","last_clean":"2024-08-28T19:30:27.549184+0000","last_became_active":"2024-08-28T19:29:48.135515+0000","last_became_peered":"2024-08-28T19:29:48.135515+0000","last_unstale":"2024-08-28T19:30:27.549184+0000","last_undegraded":"2024-08-28T19:30:27.549184+0000","last_fullsized":"2024-08-28T19:30:27.549184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:25:29.267753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396768+0000","last_change":"2024-08-28T19:29:48.128614+0000","last_active":"2024-08-28T19:30:27.396768+0000","last_peered":"2024-08-28T19:30:27.396768+0000","last_clean":"2024-08-28T19:30:27.396768+0000","last_became_active":"2024-08-28T19:29:48.128231+0000","last_became_peered":"2024-08-28T19:29:48.128231+0000","last_unstale":"2024-08-28T19:30:27.396768+0000","last_undegraded":"2024-08-28T19:30:27.396768+0000","last_fullsized":"2024-08-28T19:30:27.396768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:11:08.541435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398204+0000","last_change":"2024-08-28T19:29:48.114930+0000","last_active":"2024-08-28T19:30:27.398204+0000","last_peered":"2024-08-28T19:30:27.398204+0000","last_clean":"2024-08-28T19:30:27.398204+0000","last_became_active":"2024-08-28T19:29:48.114389+0000","last_became_peered":"2024-08-28T19:29:48.114389+0000","last_unstale":"2024-08-28T19:30:27.398204+0000","last_undegraded":"2024-08-28T19:30:27.398204+0000","last_fullsized":"2024-08-28T19:30:27.398204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:51.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400101+0000","last_change":"2024-08-28T19:29:48.125031+0000","last_active":"2024-08-28T19:30:27.400101+0000","last_peered":"2024-08-28T19:30:27.400101+0000","last_clean":"2024-08-28T19:30:27.400101+0000","last_became_active":"2024-08-28T19:29:48.124417+0000","last_became_peered":"2024-08-28T19:29:48.124417+0000","last_unstale":"2024-08-28T19:30:27.400101+0000","last_undegraded":"2024-08-28T19:30:27.400101+0000","last_fullsized":"2024-08-28T19:30:27.400101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:33:33.931496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401136+0000","last_change":"2024-08-28T19:29:48.127815+0000","last_active":"2024-08-28T19:30:27.401136+0000","last_peered":"2024-08-28T19:30:27.401136+0000","last_clean":"2024-08-28T19:30:27.401136+0000","last_became_active":"2024-08-28T19:29:48.127455+0000","last_became_peered":"2024-08-28T19:29:48.127455+0000","last_unstale":"2024-08-28T19:30:27.401136+0000","last_undegraded":"2024-08-28T19:30:27.401136+0000","last_fullsized":"2024-08-28T19:30:27.401136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:47:23.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398765+0000","last_change":"2024-08-28T19:29:48.122105+0000","last_active":"2024-08-28T19:30:27.398765+0000","last_peered":"2024-08-28T19:30:27.398765+0000","last_clean":"2024-08-28T19:30:27.398765+0000","last_became_active":"2024-08-28T19:29:48.121546+0000","last_became_peered":"2024-08-28T19:29:48.121546+0000","last_unstale":"2024-08-28T19:30:27.398765+0000","last_undegraded":"2024-08-28T19:30:27.398765+0000","last_fullsized":"2024-08-28T19:30:27.398765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:21:00.428052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548837+0000","last_change":"2024-08-28T19:29:48.136198+0000","last_active":"2024-08-28T19:30:27.548837+0000","last_peered":"2024-08-28T19:30:27.548837+0000","last_clean":"2024-08-28T19:30:27.548837+0000","last_became_active":"2024-08-28T19:29:48.135796+0000","last_became_peered":"2024-08-28T19:29:48.135796+0000","last_unstale":"2024-08-28T19:30:27.548837+0000","last_undegraded":"2024-08-28T19:30:27.548837+0000","last_fullsized":"2024-08-28T19:30:27.548837+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:05.033399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400902+0000","last_change":"2024-08-28T19:29:48.121245+0000","last_active":"2024-08-28T19:30:27.400902+0000","last_peered":"2024-08-28T19:30:27.400902+0000","last_clean":"2024-08-28T19:30:27.400902+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:30:27.400902+0000","last_undegraded":"2024-08-28T19:30:27.400902+0000","last_fullsized":"2024-08-28T19:30:27.400902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:39.936209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400752+0000","last_change":"2024-08-28T19:29:48.119198+0000","last_active":"2024-08-28T19:30:27.400752+0000","last_peered":"2024-08-28T19:30:27.400752+0000","last_clean":"2024-08-28T19:30:27.400752+0000","last_became_active":"2024-08-28T19:29:48.118744+0000","last_became_peered":"2024-08-28T19:29:48.118744+0000","last_unstale":"2024-08-28T19:30:27.400752+0000","last_undegraded":"2024-08-28T19:30:27.400752+0000","last_fullsized":"2024-08-28T19:30:27.400752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:15:35.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.403903+0000","last_change":"2024-08-28T19:30:27.403790+0000","last_active":"2024-08-28T19:30:27.403903+0000","last_peered":"2024-08-28T19:30:27.403903+0000","last_clean":"2024-08-28T19:30:27.403903+0000","last_became_active":"2024-08-28T19:30:27.403279+0000","last_became_peered":"2024-08-28T19:30:27.403279+0000","last_unstale":"2024-08-28T19:30:27.403903+0000","last_undegraded":"2024-08-28T19:30:27.403903+0000","last_fullsized":"2024-08-28T19:30:27.403903+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:31:54.137839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405819+0000","last_change":"2024-08-28T19:30:27.405173+0000","last_active":"2024-08-28T19:30:27.405819+0000","last_peered":"2024-08-28T19:30:27.405819+0000","last_clean":"2024-08-28T19:30:27.405819+0000","last_became_active":"2024-08-28T19:30:27.404752+0000","last_became_peered":"2024-08-28T19:30:27.404752+0000","last_unstale":"2024-08-28T19:30:27.405819+0000","last_undegraded":"2024-08-28T19:30:27.405819+0000","last_fullsized":"2024-08-28T19:30:27.405819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:16.544309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427239+0000","last_change":"2024-08-28T19:29:48.136738+0000","last_active":"2024-08-28T19:30:27.427239+0000","last_peered":"2024-08-28T19:30:27.427239+0000","last_clean":"2024-08-28T19:30:27.427239+0000","last_became_active":"2024-08-28T19:29:48.136046+0000","last_became_peered":"2024-08-28T19:29:48.136046+0000","last_unstale":"2024-08-28T19:30:27.427239+0000","last_undegraded":"2024-08-28T19:30:27.427239+0000","last_fullsized":"2024-08-28T19:30:27.427239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:43:32.905933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398789+0000","last_change":"2024-08-28T19:29:48.127432+0000","last_active":"2024-08-28T19:30:27.398789+0000","last_peered":"2024-08-28T19:30:27.398789+0000","last_clean":"2024-08-28T19:30:27.398789+0000","last_became_active":"2024-08-28T19:29:48.126067+0000","last_became_peered":"2024-08-28T19:29:48.126067+0000","last_unstale":"2024-08-28T19:30:27.398789+0000","last_undegraded":"2024-08-28T19:30:27.398789+0000","last_fullsized":"2024-08-28T19:30:27.398789+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:30:05.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550430+0000","last_change":"2024-08-28T19:29:48.121154+0000","last_active":"2024-08-28T19:30:27.550430+0000","last_peered":"2024-08-28T19:30:27.550430+0000","last_clean":"2024-08-28T19:30:27.550430+0000","last_became_active":"2024-08-28T19:29:48.120709+0000","last_became_peered":"2024-08-28T19:29:48.120709+0000","last_unstale":"2024-08-28T19:30:27.550430+0000","last_undegraded":"2024-08-28T19:30:27.550430+0000","last_fullsized":"2024-08-28T19:30:27.550430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:52.716814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548374+0000","last_change":"2024-08-28T19:29:48.127124+0000","last_active":"2024-08-28T19:30:27.548374+0000","last_peered":"2024-08-28T19:30:27.548374+0000","last_clean":"2024-08-28T19:30:27.548374+0000","last_became_active":"2024-08-28T19:29:48.126761+0000","last_became_peered":"2024-08-28T19:29:48.126761+0000","last_unstale":"2024-08-28T19:30:27.548374+0000","last_undegraded":"2024-08-28T19:30:27.548374+0000","last_fullsized":"2024-08-28T19:30:27.548374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:05:31.150472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426567+0000","last_change":"2024-08-28T19:29:48.132285+0000","last_active":"2024-08-28T19:30:27.426567+0000","last_peered":"2024-08-28T19:30:27.426567+0000","last_clean":"2024-08-28T19:30:27.426567+0000","last_became_active":"2024-08-28T19:29:48.131688+0000","last_became_peered":"2024-08-28T19:29:48.131688+0000","last_unstale":"2024-08-28T19:30:27.426567+0000","last_undegraded":"2024-08-28T19:30:27.426567+0000","last_fullsized":"2024-08-28T19:30:27.426567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:23:08.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398390+0000","last_change":"2024-08-28T19:29:48.126384+0000","last_active":"2024-08-28T19:30:27.398390+0000","last_peered":"2024-08-28T19:30:27.398390+0000","last_clean":"2024-08-28T19:30:27.398390+0000","last_became_active":"2024-08-28T19:29:48.125412+0000","last_became_peered":"2024-08-28T19:29:48.125412+0000","last_unstale":"2024-08-28T19:30:27.398390+0000","last_undegraded":"2024-08-28T19:30:27.398390+0000","last_fullsized":"2024-08-28T19:30:27.398390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:47:42.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404921+0000","last_change":"2024-08-28T19:29:48.114032+0000","last_active":"2024-08-28T19:30:27.404921+0000","last_peered":"2024-08-28T19:30:27.404921+0000","last_clean":"2024-08-28T19:30:27.404921+0000","last_became_active":"2024-08-28T19:29:48.113625+0000","last_became_peered":"2024-08-28T19:29:48.113625+0000","last_unstale":"2024-08-28T19:30:27.404921+0000","last_undegraded":"2024-08-28T19:30:27.404921+0000","last_fullsized":"2024-08-28T19:30:27.404921+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:07:08.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402005+0000","last_change":"2024-08-28T19:29:48.124046+0000","last_active":"2024-08-28T19:30:27.402005+0000","last_peered":"2024-08-28T19:30:27.402005+0000","last_clean":"2024-08-28T19:30:27.402005+0000","last_became_active":"2024-08-28T19:29:48.123647+0000","last_became_peered":"2024-08-28T19:29:48.123647+0000","last_unstale":"2024-08-28T19:30:27.402005+0000","last_undegraded":"2024-08-28T19:30:27.402005+0000","last_fullsized":"2024-08-28T19:30:27.402005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:59.262454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400906+0000","last_change":"2024-08-28T19:29:48.121258+0000","last_active":"2024-08-28T19:30:27.400906+0000","last_peered":"2024-08-28T19:30:27.400906+0000","last_clean":"2024-08-28T19:30:27.400906+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:30:27.400906+0000","last_undegraded":"2024-08-28T19:30:27.400906+0000","last_fullsized":"2024-08-28T19:30:27.400906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:37:05.610466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401108+0000","last_change":"2024-08-28T19:29:48.125071+0000","last_active":"2024-08-28T19:30:27.401108+0000","last_peered":"2024-08-28T19:30:27.401108+0000","last_clean":"2024-08-28T19:30:27.401108+0000","last_became_active":"2024-08-28T19:29:48.124706+0000","last_became_peered":"2024-08-28T19:29:48.124706+0000","last_unstale":"2024-08-28T19:30:27.401108+0000","last_undegraded":"2024-08-28T19:30:27.401108+0000","last_fullsized":"2024-08-28T19:30:27.401108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:39:06.460682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398708+0000","last_change":"2024-08-28T19:29:48.121905+0000","last_active":"2024-08-28T19:30:27.398708+0000","last_peered":"2024-08-28T19:30:27.398708+0000","last_clean":"2024-08-28T19:30:27.398708+0000","last_became_active":"2024-08-28T19:29:48.121045+0000","last_became_peered":"2024-08-28T19:29:48.121045+0000","last_unstale":"2024-08-28T19:30:27.398708+0000","last_undegraded":"2024-08-28T19:30:27.398708+0000","last_fullsized":"2024-08-28T19:30:27.398708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:56:58.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69276,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":589,"num_read_kb":374,"num_write":247,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246047,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":477263,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939685,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1126151,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":480898,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":477180,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495667,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1073677,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659194,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":913408,"data_stored":472306,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":995328,"data_stored":1068868,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018946,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":476771,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215175,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":472014,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":536019,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542226,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":535408,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":474153,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T19:31:25.373 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T19:31:25.636 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.152+0000 7fa61ba4a640 1 -- 172.21.15.33:0/865532439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa614102420 msgr2=0x7fa614102830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.152+0000 7fa61ba4a640 1 --2- 172.21.15.33:0/865532439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa614102420 0x7fa614102830 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa610009ca0 tx=0x7fa61002a950 comp rx=0 tx=0).stop 2024-08-28T19:31:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.152+0000 7fa61ba4a640 1 -- 172.21.15.33:0/865532439 shutdown_connections 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.152+0000 7fa61ba4a640 1 --2- 172.21.15.33:0/865532439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa61410ffd0 0x7fa6141123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.152+0000 7fa61ba4a640 1 --2- 172.21.15.33:0/865532439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa614102d70 0x7fa61410fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.152+0000 7fa61ba4a640 1 --2- 172.21.15.33:0/865532439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa614102420 0x7fa614102830 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.152+0000 7fa61ba4a640 1 -- 172.21.15.33:0/865532439 >> 172.21.15.33:0/865532439 conn(0x7fa614079470 msgr2=0x7fa614079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.152+0000 7fa61ba4a640 1 -- 172.21.15.33:0/865532439 shutdown_connections 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.152+0000 7fa61ba4a640 1 -- 172.21.15.33:0/865532439 wait complete. 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa61ba4a640 1 Processor -- start 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa61ba4a640 1 -- start start 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa61ba4a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa614102420 0x7fa61419c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa61ba4a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa614102d70 0x7fa61419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa61ba4a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61410ffd0 0x7fa6141a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa61ba4a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa614115ac0 con 0x7fa61410ffd0 2024-08-28T19:31:26.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa61ba4a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa614115940 con 0x7fa614102d70 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa61ba4a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa614115c40 con 0x7fa614102420 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa619fe7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61410ffd0 0x7fa6141a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa619fe7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61410ffd0 0x7fa6141a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57322/0 (socket says 172.21.15.33:57322) 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa619fe7640 1 -- 172.21.15.33:0/3482663863 learned_addr learned my addr 172.21.15.33:0/3482663863 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa618fe5640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa614102d70 0x7fa61419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa6197e6640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa614102420 0x7fa61419c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa619fe7640 1 -- 172.21.15.33:0/3482663863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa614102420 msgr2=0x7fa61419c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa619fe7640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa614102420 0x7fa61419c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa619fe7640 1 -- 172.21.15.33:0/3482663863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa614102d70 msgr2=0x7fa61419ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa619fe7640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa614102d70 0x7fa61419ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.153+0000 7fa619fe7640 1 -- 172.21.15.33:0/3482663863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6141a23e0 con 0x7fa61410ffd0 2024-08-28T19:31:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.154+0000 7fa619fe7640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61410ffd0 0x7fa6141a1cb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa60c00c970 tx=0x7fa60c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.154+0000 7fa60a7fc640 1 -- 172.21.15.33:0/3482663863 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c007bb0 con 0x7fa61410ffd0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.154+0000 7fa60a7fc640 1 -- 172.21.15.33:0/3482663863 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa60c007d50 con 0x7fa61410ffd0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.154+0000 7fa61ba4a640 1 -- 172.21.15.33:0/3482663863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6141a26d0 con 0x7fa61410ffd0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.154+0000 7fa60a7fc640 1 -- 172.21.15.33:0/3482663863 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c004e60 con 0x7fa61410ffd0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.154+0000 7fa61ba4a640 1 -- 172.21.15.33:0/3482663863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6141a8e30 con 0x7fa61410ffd0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.155+0000 7fa61ba4a640 1 -- 172.21.15.33:0/3482663863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa614102830 con 0x7fa61410ffd0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.157+0000 7fa60a7fc640 1 -- 172.21.15.33:0/3482663863 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa60c005000 con 0x7fa61410ffd0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.157+0000 7fa60a7fc640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6000b4c10 0x7fa6000b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.157+0000 7fa6197e6640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6000b4c10 0x7fa6000b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.157+0000 7fa60a7fc640 1 -- 172.21.15.33:0/3482663863 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9307+0+0 (secure 0 0 0) 0x7fa60c0e57a0 con 0x7fa61410ffd0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.158+0000 7fa6197e6640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6000b4c10 0x7fa6000b7120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa610004ad0 tx=0x7fa610004a60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.160+0000 7fa60a7fc640 1 -- 172.21.15.33:0/3482663863 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa60c014030 con 0x7fa61410ffd0 2024-08-28T19:31:26.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.343+0000 7fa61ba4a640 1 -- 172.21.15.33:0/3482663863 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa61410a280 con 0x7fa6000b4c10 2024-08-28T19:31:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.349+0000 7fa60a7fc640 1 -- 172.21.15.33:0/3482663863 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340624 (secure 0 0 0) 0x7fa61410a280 con 0x7fa6000b4c10 2024-08-28T19:31:26.353 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:31:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-28T19:31:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 -- 172.21.15.33:0/3482663863 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6000b4c10 msgr2=0x7fa6000b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6000b4c10 0x7fa6000b7120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa610004ad0 tx=0x7fa610004a60 comp rx=0 tx=0).stop 2024-08-28T19:31:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 -- 172.21.15.33:0/3482663863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61410ffd0 msgr2=0x7fa6141a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61410ffd0 0x7fa6141a1cb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa60c00c970 tx=0x7fa60c00ce30 comp rx=0 tx=0).stop 2024-08-28T19:31:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 -- 172.21.15.33:0/3482663863 shutdown_connections 2024-08-28T19:31:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa61410ffd0 0x7fa6141a1cb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa614102d70 0x7fa61419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa6000b4c10 0x7fa6000b7120 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 --2- 172.21.15.33:0/3482663863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa614102420 0x7fa61419c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 -- 172.21.15.33:0/3482663863 >> 172.21.15.33:0/3482663863 conn(0x7fa614079470 msgr2=0x7fa614109b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:26.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 -- 172.21.15.33:0/3482663863 shutdown_connections 2024-08-28T19:31:26.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:26.352+0000 7fa61ba4a640 1 -- 172.21.15.33:0/3482663863 wait complete. 2024-08-28T19:31:27.137 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:26 smithi033 ceph-mon[18549]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-08-28T19:31:27.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:26 smithi033 ceph-mon[18549]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:31:27.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-08-28T19:31:27.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:26 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-08-28T19:31:27.139 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-08-28T19:31:25.744016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659878,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":680,"num_read_kb":443,"num_write":372,"num_write_kb":2292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364664,"kb_used_data":11240,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577160,"statfs":{"total":1151940427776,"available":1151567011840,"internally_reserved":0,"allocated":11509760,"data_stored":7670708,"data_compressed":392145,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":49,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004012"},"pg_stats":[{"pgid":"2.1f","version":"81'13","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:20.504807+0000","last_change":"2024-08-28T19:29:46.098343+0000","last_active":"2024-08-28T19:31:20.504807+0000","last_peered":"2024-08-28T19:31:20.504807+0000","last_clean":"2024-08-28T19:31:20.504807+0000","last_became_active":"2024-08-28T19:29:46.097974+0000","last_became_peered":"2024-08-28T19:29:46.097974+0000","last_unstale":"2024-08-28T19:31:20.504807+0000","last_undegraded":"2024-08-28T19:31:20.504807+0000","last_fullsized":"2024-08-28T19:31:20.504807+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:03:11.466154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549015+0000","last_change":"2024-08-28T19:29:48.123521+0000","last_active":"2024-08-28T19:30:27.549015+0000","last_peered":"2024-08-28T19:30:27.549015+0000","last_clean":"2024-08-28T19:30:27.549015+0000","last_became_active":"2024-08-28T19:29:48.122998+0000","last_became_peered":"2024-08-28T19:29:48.122998+0000","last_unstale":"2024-08-28T19:30:27.549015+0000","last_undegraded":"2024-08-28T19:30:27.549015+0000","last_fullsized":"2024-08-28T19:30:27.549015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:33:48.413468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398981+0000","last_change":"2024-08-28T19:29:55.268086+0000","last_active":"2024-08-28T19:30:27.398981+0000","last_peered":"2024-08-28T19:30:27.398981+0000","last_clean":"2024-08-28T19:30:27.398981+0000","last_became_active":"2024-08-28T19:29:55.267411+0000","last_became_peered":"2024-08-28T19:29:55.267411+0000","last_unstale":"2024-08-28T19:30:27.398981+0000","last_undegraded":"2024-08-28T19:30:27.398981+0000","last_fullsized":"2024-08-28T19:30:27.398981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:32:16.277295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549135+0000","last_change":"2024-08-28T19:29:46.188552+0000","last_active":"2024-08-28T19:30:27.549135+0000","last_peered":"2024-08-28T19:30:27.549135+0000","last_clean":"2024-08-28T19:30:27.549135+0000","last_became_active":"2024-08-28T19:29:46.188118+0000","last_became_peered":"2024-08-28T19:29:46.188118+0000","last_unstale":"2024-08-28T19:30:27.549135+0000","last_undegraded":"2024-08-28T19:30:27.549135+0000","last_fullsized":"2024-08-28T19:30:27.549135+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:55:43.774037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402122+0000","last_change":"2024-08-28T19:29:48.118765+0000","last_active":"2024-08-28T19:30:27.402122+0000","last_peered":"2024-08-28T19:30:27.402122+0000","last_clean":"2024-08-28T19:30:27.402122+0000","last_became_active":"2024-08-28T19:29:48.118111+0000","last_became_peered":"2024-08-28T19:29:48.118111+0000","last_unstale":"2024-08-28T19:30:27.402122+0000","last_undegraded":"2024-08-28T19:30:27.402122+0000","last_fullsized":"2024-08-28T19:30:27.402122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:00:51.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401192+0000","last_change":"2024-08-28T19:29:55.262222+0000","last_active":"2024-08-28T19:30:27.401192+0000","last_peered":"2024-08-28T19:30:27.401192+0000","last_clean":"2024-08-28T19:30:27.401192+0000","last_became_active":"2024-08-28T19:29:55.260906+0000","last_became_peered":"2024-08-28T19:29:55.260906+0000","last_unstale":"2024-08-28T19:30:27.401192+0000","last_undegraded":"2024-08-28T19:30:27.401192+0000","last_fullsized":"2024-08-28T19:30:27.401192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:22:30.523609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.421805+0000","last_change":"2024-08-28T19:29:46.101077+0000","last_active":"2024-08-28T19:30:27.421805+0000","last_peered":"2024-08-28T19:30:27.421805+0000","last_clean":"2024-08-28T19:30:27.421805+0000","last_became_active":"2024-08-28T19:29:46.100630+0000","last_became_peered":"2024-08-28T19:29:46.100630+0000","last_unstale":"2024-08-28T19:30:27.421805+0000","last_undegraded":"2024-08-28T19:30:27.421805+0000","last_fullsized":"2024-08-28T19:30:27.421805+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:59:11.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549826+0000","last_change":"2024-08-28T19:29:48.129460+0000","last_active":"2024-08-28T19:30:27.549826+0000","last_peered":"2024-08-28T19:30:27.549826+0000","last_clean":"2024-08-28T19:30:27.549826+0000","last_became_active":"2024-08-28T19:29:48.129068+0000","last_became_peered":"2024-08-28T19:29:48.129068+0000","last_unstale":"2024-08-28T19:30:27.549826+0000","last_undegraded":"2024-08-28T19:30:27.549826+0000","last_fullsized":"2024-08-28T19:30:27.549826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:08:40.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402313+0000","last_change":"2024-08-28T19:29:55.262943+0000","last_active":"2024-08-28T19:30:27.402313+0000","last_peered":"2024-08-28T19:30:27.402313+0000","last_clean":"2024-08-28T19:30:27.402313+0000","last_became_active":"2024-08-28T19:29:55.262424+0000","last_became_peered":"2024-08-28T19:29:55.262424+0000","last_unstale":"2024-08-28T19:30:27.402313+0000","last_undegraded":"2024-08-28T19:30:27.402313+0000","last_fullsized":"2024-08-28T19:30:27.402313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:19:40.618651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406164+0000","last_change":"2024-08-28T19:29:46.102571+0000","last_active":"2024-08-28T19:30:27.406164+0000","last_peered":"2024-08-28T19:30:27.406164+0000","last_clean":"2024-08-28T19:30:27.406164+0000","last_became_active":"2024-08-28T19:29:46.102081+0000","last_became_peered":"2024-08-28T19:29:46.102081+0000","last_unstale":"2024-08-28T19:30:27.406164+0000","last_undegraded":"2024-08-28T19:30:27.406164+0000","last_fullsized":"2024-08-28T19:30:27.406164+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:46:38.266122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550530+0000","last_change":"2024-08-28T19:30:27.550413+0000","last_active":"2024-08-28T19:30:27.550530+0000","last_peered":"2024-08-28T19:30:27.550530+0000","last_clean":"2024-08-28T19:30:27.550530+0000","last_became_active":"2024-08-28T19:30:27.550002+0000","last_became_peered":"2024-08-28T19:30:27.550002+0000","last_unstale":"2024-08-28T19:30:27.550530+0000","last_undegraded":"2024-08-28T19:30:27.550530+0000","last_fullsized":"2024-08-28T19:30:27.550530+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:17.519332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401862+0000","last_change":"2024-08-28T19:29:55.261930+0000","last_active":"2024-08-28T19:30:27.401862+0000","last_peered":"2024-08-28T19:30:27.401862+0000","last_clean":"2024-08-28T19:30:27.401862+0000","last_became_active":"2024-08-28T19:29:55.261208+0000","last_became_peered":"2024-08-28T19:29:55.261208+0000","last_unstale":"2024-08-28T19:30:27.401862+0000","last_undegraded":"2024-08-28T19:30:27.401862+0000","last_fullsized":"2024-08-28T19:30:27.401862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.804993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427036+0000","last_change":"2024-08-28T19:29:48.133820+0000","last_active":"2024-08-28T19:30:27.427036+0000","last_peered":"2024-08-28T19:30:27.427036+0000","last_clean":"2024-08-28T19:30:27.427036+0000","last_became_active":"2024-08-28T19:29:48.132536+0000","last_became_peered":"2024-08-28T19:29:48.132536+0000","last_unstale":"2024-08-28T19:30:27.427036+0000","last_undegraded":"2024-08-28T19:30:27.427036+0000","last_fullsized":"2024-08-28T19:30:27.427036+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:15:39.779698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405110+0000","last_change":"2024-08-28T19:29:46.101206+0000","last_active":"2024-08-28T19:30:27.405110+0000","last_peered":"2024-08-28T19:30:27.405110+0000","last_clean":"2024-08-28T19:30:27.405110+0000","last_became_active":"2024-08-28T19:29:46.100801+0000","last_became_peered":"2024-08-28T19:29:46.100801+0000","last_unstale":"2024-08-28T19:30:27.405110+0000","last_undegraded":"2024-08-28T19:30:27.405110+0000","last_fullsized":"2024-08-28T19:30:27.405110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:43:33.156203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401551+0000","last_change":"2024-08-28T19:29:55.572774+0000","last_active":"2024-08-28T19:30:27.401551+0000","last_peered":"2024-08-28T19:30:27.401551+0000","last_clean":"2024-08-28T19:30:27.401551+0000","last_became_active":"2024-08-28T19:29:55.571703+0000","last_became_peered":"2024-08-28T19:29:55.571703+0000","last_unstale":"2024-08-28T19:30:27.401551+0000","last_undegraded":"2024-08-28T19:30:27.401551+0000","last_fullsized":"2024-08-28T19:30:27.401551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:56:52.695007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548462+0000","last_change":"2024-08-28T19:29:48.127683+0000","last_active":"2024-08-28T19:30:27.548462+0000","last_peered":"2024-08-28T19:30:27.548462+0000","last_clean":"2024-08-28T19:30:27.548462+0000","last_became_active":"2024-08-28T19:29:48.127139+0000","last_became_peered":"2024-08-28T19:29:48.127139+0000","last_unstale":"2024-08-28T19:30:27.548462+0000","last_undegraded":"2024-08-28T19:30:27.548462+0000","last_fullsized":"2024-08-28T19:30:27.548462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:38:16.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399374+0000","last_change":"2024-08-28T19:29:46.103233+0000","last_active":"2024-08-28T19:30:27.399374+0000","last_peered":"2024-08-28T19:30:27.399374+0000","last_clean":"2024-08-28T19:30:27.399374+0000","last_became_active":"2024-08-28T19:29:46.102515+0000","last_became_peered":"2024-08-28T19:29:46.102515+0000","last_unstale":"2024-08-28T19:30:27.399374+0000","last_undegraded":"2024-08-28T19:30:27.399374+0000","last_fullsized":"2024-08-28T19:30:27.399374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:49:35.905893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401876+0000","last_change":"2024-08-28T19:29:55.264291+0000","last_active":"2024-08-28T19:30:27.401876+0000","last_peered":"2024-08-28T19:30:27.401876+0000","last_clean":"2024-08-28T19:30:27.401876+0000","last_became_active":"2024-08-28T19:29:55.263692+0000","last_became_peered":"2024-08-28T19:29:55.263692+0000","last_unstale":"2024-08-28T19:30:27.401876+0000","last_undegraded":"2024-08-28T19:30:27.401876+0000","last_fullsized":"2024-08-28T19:30:27.401876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:47:01.795320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398110+0000","last_change":"2024-08-28T19:29:48.115470+0000","last_active":"2024-08-28T19:30:27.398110+0000","last_peered":"2024-08-28T19:30:27.398110+0000","last_clean":"2024-08-28T19:30:27.398110+0000","last_became_active":"2024-08-28T19:29:48.115076+0000","last_became_peered":"2024-08-28T19:29:48.115076+0000","last_unstale":"2024-08-28T19:30:27.398110+0000","last_undegraded":"2024-08-28T19:30:27.398110+0000","last_fullsized":"2024-08-28T19:30:27.398110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:32.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548923+0000","last_change":"2024-08-28T19:29:46.099970+0000","last_active":"2024-08-28T19:30:27.548923+0000","last_peered":"2024-08-28T19:30:27.548923+0000","last_clean":"2024-08-28T19:30:27.548923+0000","last_became_active":"2024-08-28T19:29:46.099661+0000","last_became_peered":"2024-08-28T19:29:46.099661+0000","last_unstale":"2024-08-28T19:30:27.548923+0000","last_undegraded":"2024-08-28T19:30:27.548923+0000","last_fullsized":"2024-08-28T19:30:27.548923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:27.430026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401786+0000","last_change":"2024-08-28T19:29:55.265983+0000","last_active":"2024-08-28T19:30:27.401786+0000","last_peered":"2024-08-28T19:30:27.401786+0000","last_clean":"2024-08-28T19:30:27.401786+0000","last_became_active":"2024-08-28T19:29:55.265464+0000","last_became_peered":"2024-08-28T19:29:55.265464+0000","last_unstale":"2024-08-28T19:30:27.401786+0000","last_undegraded":"2024-08-28T19:30:27.401786+0000","last_fullsized":"2024-08-28T19:30:27.401786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:21:42.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404711+0000","last_change":"2024-08-28T19:29:48.119545+0000","last_active":"2024-08-28T19:30:27.404711+0000","last_peered":"2024-08-28T19:30:27.404711+0000","last_clean":"2024-08-28T19:30:27.404711+0000","last_became_active":"2024-08-28T19:29:48.119128+0000","last_became_peered":"2024-08-28T19:29:48.119128+0000","last_unstale":"2024-08-28T19:30:27.404711+0000","last_undegraded":"2024-08-28T19:30:27.404711+0000","last_fullsized":"2024-08-28T19:30:27.404711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:05:31.535016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549131+0000","last_change":"2024-08-28T19:29:46.188962+0000","last_active":"2024-08-28T19:30:27.549131+0000","last_peered":"2024-08-28T19:30:27.549131+0000","last_clean":"2024-08-28T19:30:27.549131+0000","last_became_active":"2024-08-28T19:29:46.188510+0000","last_became_peered":"2024-08-28T19:29:46.188510+0000","last_unstale":"2024-08-28T19:30:27.549131+0000","last_undegraded":"2024-08-28T19:30:27.549131+0000","last_fullsized":"2024-08-28T19:30:27.549131+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:08.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402457+0000","last_change":"2024-08-28T19:29:55.573320+0000","last_active":"2024-08-28T19:30:27.402457+0000","last_peered":"2024-08-28T19:30:27.402457+0000","last_clean":"2024-08-28T19:30:27.402457+0000","last_became_active":"2024-08-28T19:29:55.572858+0000","last_became_peered":"2024-08-28T19:29:55.572858+0000","last_unstale":"2024-08-28T19:30:27.402457+0000","last_undegraded":"2024-08-28T19:30:27.402457+0000","last_fullsized":"2024-08-28T19:30:27.402457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:09:34.676911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405023+0000","last_change":"2024-08-28T19:30:27.404918+0000","last_active":"2024-08-28T19:30:27.405023+0000","last_peered":"2024-08-28T19:30:27.405023+0000","last_clean":"2024-08-28T19:30:27.405023+0000","last_became_active":"2024-08-28T19:30:27.404495+0000","last_became_peered":"2024-08-28T19:30:27.404495+0000","last_unstale":"2024-08-28T19:30:27.405023+0000","last_undegraded":"2024-08-28T19:30:27.405023+0000","last_fullsized":"2024-08-28T19:30:27.405023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:10:12.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402080+0000","last_change":"2024-08-28T19:29:46.110683+0000","last_active":"2024-08-28T19:30:27.402080+0000","last_peered":"2024-08-28T19:30:27.402080+0000","last_clean":"2024-08-28T19:30:27.402080+0000","last_became_active":"2024-08-28T19:29:46.110324+0000","last_became_peered":"2024-08-28T19:29:46.110324+0000","last_unstale":"2024-08-28T19:30:27.402080+0000","last_undegraded":"2024-08-28T19:30:27.402080+0000","last_fullsized":"2024-08-28T19:30:27.402080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:15:47.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398964+0000","last_change":"2024-08-28T19:29:55.271035+0000","last_active":"2024-08-28T19:30:27.398964+0000","last_peered":"2024-08-28T19:30:27.398964+0000","last_clean":"2024-08-28T19:30:27.398964+0000","last_became_active":"2024-08-28T19:29:55.268465+0000","last_became_peered":"2024-08-28T19:29:55.268465+0000","last_unstale":"2024-08-28T19:30:27.398964+0000","last_undegraded":"2024-08-28T19:30:27.398964+0000","last_fullsized":"2024-08-28T19:30:27.398964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:16:17.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548938+0000","last_change":"2024-08-28T19:29:48.127225+0000","last_active":"2024-08-28T19:30:27.548938+0000","last_peered":"2024-08-28T19:30:27.548938+0000","last_clean":"2024-08-28T19:30:27.548938+0000","last_became_active":"2024-08-28T19:29:48.126775+0000","last_became_peered":"2024-08-28T19:29:48.126775+0000","last_unstale":"2024-08-28T19:30:27.548938+0000","last_undegraded":"2024-08-28T19:30:27.548938+0000","last_fullsized":"2024-08-28T19:30:27.548938+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:49:39.353082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'15","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:41.115254+0000","last_change":"2024-08-28T19:29:46.098076+0000","last_active":"2024-08-28T19:30:41.115254+0000","last_peered":"2024-08-28T19:30:41.115254+0000","last_clean":"2024-08-28T19:30:41.115254+0000","last_became_active":"2024-08-28T19:29:46.097726+0000","last_became_peered":"2024-08-28T19:29:46.097726+0000","last_unstale":"2024-08-28T19:30:41.115254+0000","last_undegraded":"2024-08-28T19:30:41.115254+0000","last_fullsized":"2024-08-28T19:30:41.115254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.624125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548224+0000","last_change":"2024-08-28T19:29:55.571830+0000","last_active":"2024-08-28T19:30:27.548224+0000","last_peered":"2024-08-28T19:30:27.548224+0000","last_clean":"2024-08-28T19:30:27.548224+0000","last_became_active":"2024-08-28T19:29:55.571318+0000","last_became_peered":"2024-08-28T19:29:55.571318+0000","last_unstale":"2024-08-28T19:30:27.548224+0000","last_undegraded":"2024-08-28T19:30:27.548224+0000","last_fullsized":"2024-08-28T19:30:27.548224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:41:03.397478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397059+0000","last_change":"2024-08-28T19:29:48.124998+0000","last_active":"2024-08-28T19:30:27.397059+0000","last_peered":"2024-08-28T19:30:27.397059+0000","last_clean":"2024-08-28T19:30:27.397059+0000","last_became_active":"2024-08-28T19:29:48.124600+0000","last_became_peered":"2024-08-28T19:29:48.124600+0000","last_unstale":"2024-08-28T19:30:27.397059+0000","last_undegraded":"2024-08-28T19:30:27.397059+0000","last_fullsized":"2024-08-28T19:30:27.397059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:50:59.459372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406363+0000","last_change":"2024-08-28T19:29:46.189455+0000","last_active":"2024-08-28T19:30:27.406363+0000","last_peered":"2024-08-28T19:30:27.406363+0000","last_clean":"2024-08-28T19:30:27.406363+0000","last_became_active":"2024-08-28T19:29:46.188640+0000","last_became_peered":"2024-08-28T19:29:46.188640+0000","last_unstale":"2024-08-28T19:30:27.406363+0000","last_undegraded":"2024-08-28T19:30:27.406363+0000","last_fullsized":"2024-08-28T19:30:27.406363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:05:32.561725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398095+0000","last_change":"2024-08-28T19:29:55.269726+0000","last_active":"2024-08-28T19:30:27.398095+0000","last_peered":"2024-08-28T19:30:27.398095+0000","last_clean":"2024-08-28T19:30:27.398095+0000","last_became_active":"2024-08-28T19:29:55.269261+0000","last_became_peered":"2024-08-28T19:29:55.269261+0000","last_unstale":"2024-08-28T19:30:27.398095+0000","last_undegraded":"2024-08-28T19:30:27.398095+0000","last_fullsized":"2024-08-28T19:30:27.398095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:05.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398331+0000","last_change":"2024-08-28T19:29:48.125251+0000","last_active":"2024-08-28T19:30:27.398331+0000","last_peered":"2024-08-28T19:30:27.398331+0000","last_clean":"2024-08-28T19:30:27.398331+0000","last_became_active":"2024-08-28T19:29:48.124818+0000","last_became_peered":"2024-08-28T19:29:48.124818+0000","last_unstale":"2024-08-28T19:30:27.398331+0000","last_undegraded":"2024-08-28T19:30:27.398331+0000","last_fullsized":"2024-08-28T19:30:27.398331+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:47:05.217199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401993+0000","last_change":"2024-08-28T19:29:46.189747+0000","last_active":"2024-08-28T19:30:27.401993+0000","last_peered":"2024-08-28T19:30:27.401993+0000","last_clean":"2024-08-28T19:30:27.401993+0000","last_became_active":"2024-08-28T19:29:46.189356+0000","last_became_peered":"2024-08-28T19:29:46.189356+0000","last_unstale":"2024-08-28T19:30:27.401993+0000","last_undegraded":"2024-08-28T19:30:27.401993+0000","last_fullsized":"2024-08-28T19:30:27.401993+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.629054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405026+0000","last_change":"2024-08-28T19:29:55.572746+0000","last_active":"2024-08-28T19:30:27.405026+0000","last_peered":"2024-08-28T19:30:27.405026+0000","last_clean":"2024-08-28T19:30:27.405026+0000","last_became_active":"2024-08-28T19:29:55.572246+0000","last_became_peered":"2024-08-28T19:29:55.572246+0000","last_unstale":"2024-08-28T19:30:27.405026+0000","last_undegraded":"2024-08-28T19:30:27.405026+0000","last_fullsized":"2024-08-28T19:30:27.405026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:48:23.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398559+0000","last_change":"2024-08-28T19:29:48.127579+0000","last_active":"2024-08-28T19:30:27.398559+0000","last_peered":"2024-08-28T19:30:27.398559+0000","last_clean":"2024-08-28T19:30:27.398559+0000","last_became_active":"2024-08-28T19:29:48.126978+0000","last_became_peered":"2024-08-28T19:29:48.126978+0000","last_unstale":"2024-08-28T19:30:27.398559+0000","last_undegraded":"2024-08-28T19:30:27.398559+0000","last_fullsized":"2024-08-28T19:30:27.398559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:27.657714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":98,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:23.509137+0000","last_change":"2024-08-28T19:29:46.102374+0000","last_active":"2024-08-28T19:31:23.509137+0000","last_peered":"2024-08-28T19:31:23.509137+0000","last_clean":"2024-08-28T19:31:23.509137+0000","last_became_active":"2024-08-28T19:29:46.101619+0000","last_became_peered":"2024-08-28T19:29:46.101619+0000","last_unstale":"2024-08-28T19:31:23.509137+0000","last_undegraded":"2024-08-28T19:31:23.509137+0000","last_fullsized":"2024-08-28T19:31:23.509137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:46:21.353063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396841+0000","last_change":"2024-08-28T19:29:55.265403+0000","last_active":"2024-08-28T19:30:27.396841+0000","last_peered":"2024-08-28T19:30:27.396841+0000","last_clean":"2024-08-28T19:30:27.396841+0000","last_became_active":"2024-08-28T19:29:55.264979+0000","last_became_peered":"2024-08-28T19:29:55.264979+0000","last_unstale":"2024-08-28T19:30:27.396841+0000","last_undegraded":"2024-08-28T19:30:27.396841+0000","last_fullsized":"2024-08-28T19:30:27.396841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:18:18.623218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405723+0000","last_change":"2024-08-28T19:29:48.117437+0000","last_active":"2024-08-28T19:30:27.405723+0000","last_peered":"2024-08-28T19:30:27.405723+0000","last_clean":"2024-08-28T19:30:27.405723+0000","last_became_active":"2024-08-28T19:29:48.116379+0000","last_became_peered":"2024-08-28T19:29:48.116379+0000","last_unstale":"2024-08-28T19:30:27.405723+0000","last_undegraded":"2024-08-28T19:30:27.405723+0000","last_fullsized":"2024-08-28T19:30:27.405723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:23.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:21.506301+0000","last_change":"2024-08-28T19:29:46.188551+0000","last_active":"2024-08-28T19:31:21.506301+0000","last_peered":"2024-08-28T19:31:21.506301+0000","last_clean":"2024-08-28T19:31:21.506301+0000","last_became_active":"2024-08-28T19:29:46.188050+0000","last_became_peered":"2024-08-28T19:29:46.188050+0000","last_unstale":"2024-08-28T19:31:21.506301+0000","last_undegraded":"2024-08-28T19:31:21.506301+0000","last_fullsized":"2024-08-28T19:31:21.506301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:07:21.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396915+0000","last_change":"2024-08-28T19:29:55.572013+0000","last_active":"2024-08-28T19:30:27.396915+0000","last_peered":"2024-08-28T19:30:27.396915+0000","last_clean":"2024-08-28T19:30:27.396915+0000","last_became_active":"2024-08-28T19:29:55.571503+0000","last_became_peered":"2024-08-28T19:29:55.571503+0000","last_unstale":"2024-08-28T19:30:27.396915+0000","last_undegraded":"2024-08-28T19:30:27.396915+0000","last_fullsized":"2024-08-28T19:30:27.396915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:40:21.669321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396418+0000","last_change":"2024-08-28T19:29:48.124646+0000","last_active":"2024-08-28T19:30:27.396418+0000","last_peered":"2024-08-28T19:30:27.396418+0000","last_clean":"2024-08-28T19:30:27.396418+0000","last_became_active":"2024-08-28T19:29:48.123062+0000","last_became_peered":"2024-08-28T19:29:48.123062+0000","last_unstale":"2024-08-28T19:30:27.396418+0000","last_undegraded":"2024-08-28T19:30:27.396418+0000","last_fullsized":"2024-08-28T19:30:27.396418+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:16:03.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426530+0000","last_change":"2024-08-28T19:29:46.105979+0000","last_active":"2024-08-28T19:30:27.426530+0000","last_peered":"2024-08-28T19:30:27.426530+0000","last_clean":"2024-08-28T19:30:27.426530+0000","last_became_active":"2024-08-28T19:29:46.105558+0000","last_became_peered":"2024-08-28T19:29:46.105558+0000","last_unstale":"2024-08-28T19:30:27.426530+0000","last_undegraded":"2024-08-28T19:30:27.426530+0000","last_fullsized":"2024-08-28T19:30:27.426530+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:47.639236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.403694+0000","last_change":"2024-08-28T19:29:55.574025+0000","last_active":"2024-08-28T19:30:27.403694+0000","last_peered":"2024-08-28T19:30:27.403694+0000","last_clean":"2024-08-28T19:30:27.403694+0000","last_became_active":"2024-08-28T19:29:55.573380+0000","last_became_peered":"2024-08-28T19:29:55.573380+0000","last_unstale":"2024-08-28T19:30:27.403694+0000","last_undegraded":"2024-08-28T19:30:27.403694+0000","last_fullsized":"2024-08-28T19:30:27.403694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:19:05.287692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548592+0000","last_change":"2024-08-28T19:29:48.118606+0000","last_active":"2024-08-28T19:30:27.548592+0000","last_peered":"2024-08-28T19:30:27.548592+0000","last_clean":"2024-08-28T19:30:27.548592+0000","last_became_active":"2024-08-28T19:29:48.117534+0000","last_became_peered":"2024-08-28T19:29:48.117534+0000","last_unstale":"2024-08-28T19:30:27.548592+0000","last_undegraded":"2024-08-28T19:30:27.548592+0000","last_fullsized":"2024-08-28T19:30:27.548592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:34.253859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.422305+0000","last_change":"2024-08-28T19:29:46.100420+0000","last_active":"2024-08-28T19:30:27.422305+0000","last_peered":"2024-08-28T19:30:27.422305+0000","last_clean":"2024-08-28T19:30:27.422305+0000","last_became_active":"2024-08-28T19:29:46.099990+0000","last_became_peered":"2024-08-28T19:29:46.099990+0000","last_unstale":"2024-08-28T19:30:27.422305+0000","last_undegraded":"2024-08-28T19:30:27.422305+0000","last_fullsized":"2024-08-28T19:30:27.422305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:42:12.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427003+0000","last_change":"2024-08-28T19:28:32.822169+0000","last_active":"2024-08-28T19:30:27.427003+0000","last_peered":"2024-08-28T19:30:27.427003+0000","last_clean":"2024-08-28T19:30:27.427003+0000","last_became_active":"2024-08-28T19:28:32.816300+0000","last_became_peered":"2024-08-28T19:28:32.816300+0000","last_unstale":"2024-08-28T19:30:27.427003+0000","last_undegraded":"2024-08-28T19:30:27.427003+0000","last_fullsized":"2024-08-28T19:30:27.427003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_clean_scrub_stamp":"2024-08-28T19:25:14.491568+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:41:37.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427270+0000","last_change":"2024-08-28T19:29:55.265437+0000","last_active":"2024-08-28T19:30:27.427270+0000","last_peered":"2024-08-28T19:30:27.427270+0000","last_clean":"2024-08-28T19:30:27.427270+0000","last_became_active":"2024-08-28T19:29:55.264818+0000","last_became_peered":"2024-08-28T19:29:55.264818+0000","last_unstale":"2024-08-28T19:30:27.427270+0000","last_undegraded":"2024-08-28T19:30:27.427270+0000","last_fullsized":"2024-08-28T19:30:27.427270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:28:18.684362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427338+0000","last_change":"2024-08-28T19:29:48.135800+0000","last_active":"2024-08-28T19:30:27.427338+0000","last_peered":"2024-08-28T19:30:27.427338+0000","last_clean":"2024-08-28T19:30:27.427338+0000","last_became_active":"2024-08-28T19:29:48.135258+0000","last_became_peered":"2024-08-28T19:29:48.135258+0000","last_unstale":"2024-08-28T19:30:27.427338+0000","last_undegraded":"2024-08-28T19:30:27.427338+0000","last_fullsized":"2024-08-28T19:30:27.427338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:55.183190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:22.509555+0000","last_change":"2024-08-28T19:29:46.189298+0000","last_active":"2024-08-28T19:31:22.509555+0000","last_peered":"2024-08-28T19:31:22.509555+0000","last_clean":"2024-08-28T19:31:22.509555+0000","last_became_active":"2024-08-28T19:29:46.188813+0000","last_became_peered":"2024-08-28T19:29:46.188813+0000","last_unstale":"2024-08-28T19:31:22.509555+0000","last_undegraded":"2024-08-28T19:31:22.509555+0000","last_fullsized":"2024-08-28T19:31:22.509555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:14:00.961682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548910+0000","last_change":"2024-08-28T19:29:55.269495+0000","last_active":"2024-08-28T19:30:27.548910+0000","last_peered":"2024-08-28T19:30:27.548910+0000","last_clean":"2024-08-28T19:30:27.548910+0000","last_became_active":"2024-08-28T19:29:55.268916+0000","last_became_peered":"2024-08-28T19:29:55.268916+0000","last_unstale":"2024-08-28T19:30:27.548910+0000","last_undegraded":"2024-08-28T19:30:27.548910+0000","last_fullsized":"2024-08-28T19:30:27.548910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:26:53.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426791+0000","last_change":"2024-08-28T19:29:48.127588+0000","last_active":"2024-08-28T19:30:27.426791+0000","last_peered":"2024-08-28T19:30:27.426791+0000","last_clean":"2024-08-28T19:30:27.426791+0000","last_became_active":"2024-08-28T19:29:48.127200+0000","last_became_peered":"2024-08-28T19:29:48.127200+0000","last_unstale":"2024-08-28T19:30:27.426791+0000","last_undegraded":"2024-08-28T19:30:27.426791+0000","last_fullsized":"2024-08-28T19:30:27.426791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:30:30.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404909+0000","last_change":"2024-08-28T19:29:46.101010+0000","last_active":"2024-08-28T19:30:27.404909+0000","last_peered":"2024-08-28T19:30:27.404909+0000","last_clean":"2024-08-28T19:30:27.404909+0000","last_became_active":"2024-08-28T19:29:46.100082+0000","last_became_peered":"2024-08-28T19:29:46.100082+0000","last_unstale":"2024-08-28T19:30:27.404909+0000","last_undegraded":"2024-08-28T19:30:27.404909+0000","last_fullsized":"2024-08-28T19:30:27.404909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:18:51.074343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.551852+0000","last_change":"2024-08-28T19:30:27.551743+0000","last_active":"2024-08-28T19:30:27.551852+0000","last_peered":"2024-08-28T19:30:27.551852+0000","last_clean":"2024-08-28T19:30:27.551852+0000","last_became_active":"2024-08-28T19:30:27.551249+0000","last_became_peered":"2024-08-28T19:30:27.551249+0000","last_unstale":"2024-08-28T19:30:27.551852+0000","last_undegraded":"2024-08-28T19:30:27.551852+0000","last_fullsized":"2024-08-28T19:30:27.551852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:35.043553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426736+0000","last_change":"2024-08-28T19:29:48.132429+0000","last_active":"2024-08-28T19:30:27.426736+0000","last_peered":"2024-08-28T19:30:27.426736+0000","last_clean":"2024-08-28T19:30:27.426736+0000","last_became_active":"2024-08-28T19:29:48.132020+0000","last_became_peered":"2024-08-28T19:29:48.132020+0000","last_unstale":"2024-08-28T19:30:27.426736+0000","last_undegraded":"2024-08-28T19:30:27.426736+0000","last_fullsized":"2024-08-28T19:30:27.426736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:45:11.992083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397065+0000","last_change":"2024-08-28T19:29:46.097245+0000","last_active":"2024-08-28T19:30:27.397065+0000","last_peered":"2024-08-28T19:30:27.397065+0000","last_clean":"2024-08-28T19:30:27.397065+0000","last_became_active":"2024-08-28T19:29:46.096867+0000","last_became_peered":"2024-08-28T19:29:46.096867+0000","last_unstale":"2024-08-28T19:30:27.397065+0000","last_undegraded":"2024-08-28T19:30:27.397065+0000","last_fullsized":"2024-08-28T19:30:27.397065+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:22:14.888597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405312+0000","last_change":"2024-08-28T19:29:55.265006+0000","last_active":"2024-08-28T19:30:27.405312+0000","last_peered":"2024-08-28T19:30:27.405312+0000","last_clean":"2024-08-28T19:30:27.405312+0000","last_became_active":"2024-08-28T19:29:55.264321+0000","last_became_peered":"2024-08-28T19:29:55.264321+0000","last_unstale":"2024-08-28T19:30:27.405312+0000","last_undegraded":"2024-08-28T19:30:27.405312+0000","last_fullsized":"2024-08-28T19:30:27.405312+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:53:27.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398520+0000","last_change":"2024-08-28T19:29:48.120916+0000","last_active":"2024-08-28T19:30:27.398520+0000","last_peered":"2024-08-28T19:30:27.398520+0000","last_clean":"2024-08-28T19:30:27.398520+0000","last_became_active":"2024-08-28T19:29:48.120473+0000","last_became_peered":"2024-08-28T19:29:48.120473+0000","last_unstale":"2024-08-28T19:30:27.398520+0000","last_undegraded":"2024-08-28T19:30:27.398520+0000","last_fullsized":"2024-08-28T19:30:27.398520+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:15.067237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405342+0000","last_change":"2024-08-28T19:29:46.103164+0000","last_active":"2024-08-28T19:30:27.405342+0000","last_peered":"2024-08-28T19:30:27.405342+0000","last_clean":"2024-08-28T19:30:27.405342+0000","last_became_active":"2024-08-28T19:29:46.101772+0000","last_became_peered":"2024-08-28T19:29:46.101772+0000","last_unstale":"2024-08-28T19:30:27.405342+0000","last_undegraded":"2024-08-28T19:30:27.405342+0000","last_fullsized":"2024-08-28T19:30:27.405342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:46:29.533552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550981+0000","last_change":"2024-08-28T19:30:27.550861+0000","last_active":"2024-08-28T19:30:27.550981+0000","last_peered":"2024-08-28T19:30:27.550981+0000","last_clean":"2024-08-28T19:30:27.550981+0000","last_became_active":"2024-08-28T19:30:27.550131+0000","last_became_peered":"2024-08-28T19:30:27.550131+0000","last_unstale":"2024-08-28T19:30:27.550981+0000","last_undegraded":"2024-08-28T19:30:27.550981+0000","last_fullsized":"2024-08-28T19:30:27.550981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:37:16.004222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.551596+0000","last_change":"2024-08-28T19:30:27.551445+0000","last_active":"2024-08-28T19:30:27.551596+0000","last_peered":"2024-08-28T19:30:27.551596+0000","last_clean":"2024-08-28T19:30:27.551596+0000","last_became_active":"2024-08-28T19:30:27.550927+0000","last_became_peered":"2024-08-28T19:30:27.550927+0000","last_unstale":"2024-08-28T19:30:27.551596+0000","last_undegraded":"2024-08-28T19:30:27.551596+0000","last_fullsized":"2024-08-28T19:30:27.551596+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:52:56.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405028+0000","last_change":"2024-08-28T19:29:46.190191+0000","last_active":"2024-08-28T19:30:27.405028+0000","last_peered":"2024-08-28T19:30:27.405028+0000","last_clean":"2024-08-28T19:30:27.405028+0000","last_became_active":"2024-08-28T19:29:46.188143+0000","last_became_peered":"2024-08-28T19:29:46.188143+0000","last_unstale":"2024-08-28T19:30:27.405028+0000","last_undegraded":"2024-08-28T19:30:27.405028+0000","last_fullsized":"2024-08-28T19:30:27.405028+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:58:11.854449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397058+0000","last_change":"2024-08-28T19:29:55.266777+0000","last_active":"2024-08-28T19:30:27.397058+0000","last_peered":"2024-08-28T19:30:27.397058+0000","last_clean":"2024-08-28T19:30:27.397058+0000","last_became_active":"2024-08-28T19:29:55.266296+0000","last_became_peered":"2024-08-28T19:29:55.266296+0000","last_unstale":"2024-08-28T19:30:27.397058+0000","last_undegraded":"2024-08-28T19:30:27.397058+0000","last_fullsized":"2024-08-28T19:30:27.397058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:28:20.279522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426781+0000","last_change":"2024-08-28T19:29:48.129070+0000","last_active":"2024-08-28T19:30:27.426781+0000","last_peered":"2024-08-28T19:30:27.426781+0000","last_clean":"2024-08-28T19:30:27.426781+0000","last_became_active":"2024-08-28T19:29:48.128701+0000","last_became_peered":"2024-08-28T19:29:48.128701+0000","last_unstale":"2024-08-28T19:30:27.426781+0000","last_undegraded":"2024-08-28T19:30:27.426781+0000","last_fullsized":"2024-08-28T19:30:27.426781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:29:29.375379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:22.508336+0000","last_change":"2024-08-28T19:29:46.098281+0000","last_active":"2024-08-28T19:31:22.508336+0000","last_peered":"2024-08-28T19:31:22.508336+0000","last_clean":"2024-08-28T19:31:22.508336+0000","last_became_active":"2024-08-28T19:29:46.097870+0000","last_became_peered":"2024-08-28T19:29:46.097870+0000","last_unstale":"2024-08-28T19:31:22.508336+0000","last_undegraded":"2024-08-28T19:31:22.508336+0000","last_fullsized":"2024-08-28T19:31:22.508336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:24:09.693310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":61,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401852+0000","last_change":"2024-08-28T19:29:55.264883+0000","last_active":"2024-08-28T19:30:27.401852+0000","last_peered":"2024-08-28T19:30:27.401852+0000","last_clean":"2024-08-28T19:30:27.401852+0000","last_became_active":"2024-08-28T19:29:55.264392+0000","last_became_peered":"2024-08-28T19:29:55.264392+0000","last_unstale":"2024-08-28T19:30:27.401852+0000","last_undegraded":"2024-08-28T19:30:27.401852+0000","last_fullsized":"2024-08-28T19:30:27.401852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:34.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427027+0000","last_change":"2024-08-28T19:29:48.135499+0000","last_active":"2024-08-28T19:30:27.427027+0000","last_peered":"2024-08-28T19:30:27.427027+0000","last_clean":"2024-08-28T19:30:27.427027+0000","last_became_active":"2024-08-28T19:29:48.134934+0000","last_became_peered":"2024-08-28T19:29:48.134934+0000","last_unstale":"2024-08-28T19:30:27.427027+0000","last_undegraded":"2024-08-28T19:30:27.427027+0000","last_fullsized":"2024-08-28T19:30:27.427027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:57:01.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405099+0000","last_change":"2024-08-28T19:29:46.104680+0000","last_active":"2024-08-28T19:30:27.405099+0000","last_peered":"2024-08-28T19:30:27.405099+0000","last_clean":"2024-08-28T19:30:27.405099+0000","last_became_active":"2024-08-28T19:29:46.104290+0000","last_became_peered":"2024-08-28T19:29:46.104290+0000","last_unstale":"2024-08-28T19:30:27.405099+0000","last_undegraded":"2024-08-28T19:30:27.405099+0000","last_fullsized":"2024-08-28T19:30:27.405099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:39.789935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398105+0000","last_change":"2024-08-28T19:29:55.264676+0000","last_active":"2024-08-28T19:30:27.398105+0000","last_peered":"2024-08-28T19:30:27.398105+0000","last_clean":"2024-08-28T19:30:27.398105+0000","last_became_active":"2024-08-28T19:29:55.264206+0000","last_became_peered":"2024-08-28T19:29:55.264206+0000","last_unstale":"2024-08-28T19:30:27.398105+0000","last_undegraded":"2024-08-28T19:30:27.398105+0000","last_fullsized":"2024-08-28T19:30:27.398105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:58:15.776366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396618+0000","last_change":"2024-08-28T19:29:48.125092+0000","last_active":"2024-08-28T19:30:27.396618+0000","last_peered":"2024-08-28T19:30:27.396618+0000","last_clean":"2024-08-28T19:30:27.396618+0000","last_became_active":"2024-08-28T19:29:48.124711+0000","last_became_peered":"2024-08-28T19:29:48.124711+0000","last_unstale":"2024-08-28T19:30:27.396618+0000","last_undegraded":"2024-08-28T19:30:27.396618+0000","last_fullsized":"2024-08-28T19:30:27.396618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:17:27.806368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.422015+0000","last_change":"2024-08-28T19:29:46.100546+0000","last_active":"2024-08-28T19:30:27.422015+0000","last_peered":"2024-08-28T19:30:27.422015+0000","last_clean":"2024-08-28T19:30:27.422015+0000","last_became_active":"2024-08-28T19:29:46.100043+0000","last_became_peered":"2024-08-28T19:29:46.100043+0000","last_unstale":"2024-08-28T19:30:27.422015+0000","last_undegraded":"2024-08-28T19:30:27.422015+0000","last_fullsized":"2024-08-28T19:30:27.422015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:41:32.488258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404480+0000","last_change":"2024-08-28T19:29:55.265497+0000","last_active":"2024-08-28T19:30:27.404480+0000","last_peered":"2024-08-28T19:30:27.404480+0000","last_clean":"2024-08-28T19:30:27.404480+0000","last_became_active":"2024-08-28T19:29:55.264499+0000","last_became_peered":"2024-08-28T19:29:55.264499+0000","last_unstale":"2024-08-28T19:30:27.404480+0000","last_undegraded":"2024-08-28T19:30:27.404480+0000","last_fullsized":"2024-08-28T19:30:27.404480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:04:15.192307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405999+0000","last_change":"2024-08-28T19:29:48.133948+0000","last_active":"2024-08-28T19:30:27.405999+0000","last_peered":"2024-08-28T19:30:27.405999+0000","last_clean":"2024-08-28T19:30:27.405999+0000","last_became_active":"2024-08-28T19:29:48.133517+0000","last_became_peered":"2024-08-28T19:29:48.133517+0000","last_unstale":"2024-08-28T19:30:27.405999+0000","last_undegraded":"2024-08-28T19:30:27.405999+0000","last_fullsized":"2024-08-28T19:30:27.405999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:43:20.049931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:21.507414+0000","last_change":"2024-08-28T19:29:46.104744+0000","last_active":"2024-08-28T19:31:21.507414+0000","last_peered":"2024-08-28T19:31:21.507414+0000","last_clean":"2024-08-28T19:31:21.507414+0000","last_became_active":"2024-08-28T19:29:46.104278+0000","last_became_peered":"2024-08-28T19:29:46.104278+0000","last_unstale":"2024-08-28T19:31:21.507414+0000","last_undegraded":"2024-08-28T19:31:21.507414+0000","last_fullsized":"2024-08-28T19:31:21.507414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:36.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62072,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":121,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401456+0000","last_change":"2024-08-28T19:29:55.264892+0000","last_active":"2024-08-28T19:30:27.401456+0000","last_peered":"2024-08-28T19:30:27.401456+0000","last_clean":"2024-08-28T19:30:27.401456+0000","last_became_active":"2024-08-28T19:29:55.264466+0000","last_became_peered":"2024-08-28T19:29:55.264466+0000","last_unstale":"2024-08-28T19:30:27.401456+0000","last_undegraded":"2024-08-28T19:30:27.401456+0000","last_fullsized":"2024-08-28T19:30:27.401456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:34:51.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549875+0000","last_change":"2024-08-28T19:29:48.121692+0000","last_active":"2024-08-28T19:30:27.549875+0000","last_peered":"2024-08-28T19:30:27.549875+0000","last_clean":"2024-08-28T19:30:27.549875+0000","last_became_active":"2024-08-28T19:29:48.121274+0000","last_became_peered":"2024-08-28T19:29:48.121274+0000","last_unstale":"2024-08-28T19:30:27.549875+0000","last_undegraded":"2024-08-28T19:30:27.549875+0000","last_fullsized":"2024-08-28T19:30:27.549875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:00:36.227609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404771+0000","last_change":"2024-08-28T19:29:46.188981+0000","last_active":"2024-08-28T19:30:27.404771+0000","last_peered":"2024-08-28T19:30:27.404771+0000","last_clean":"2024-08-28T19:30:27.404771+0000","last_became_active":"2024-08-28T19:29:46.188496+0000","last_became_peered":"2024-08-28T19:29:46.188496+0000","last_unstale":"2024-08-28T19:30:27.404771+0000","last_undegraded":"2024-08-28T19:30:27.404771+0000","last_fullsized":"2024-08-28T19:30:27.404771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.689602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.552176+0000","last_change":"2024-08-28T19:30:27.552006+0000","last_active":"2024-08-28T19:30:27.552176+0000","last_peered":"2024-08-28T19:30:27.552176+0000","last_clean":"2024-08-28T19:30:27.552176+0000","last_became_active":"2024-08-28T19:30:27.551356+0000","last_became_peered":"2024-08-28T19:30:27.551356+0000","last_unstale":"2024-08-28T19:30:27.552176+0000","last_undegraded":"2024-08-28T19:30:27.552176+0000","last_fullsized":"2024-08-28T19:30:27.552176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:56:09.242401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402115+0000","last_change":"2024-08-28T19:29:48.116964+0000","last_active":"2024-08-28T19:30:27.402115+0000","last_peered":"2024-08-28T19:30:27.402115+0000","last_clean":"2024-08-28T19:30:27.402115+0000","last_became_active":"2024-08-28T19:29:48.116588+0000","last_became_peered":"2024-08-28T19:29:48.116588+0000","last_unstale":"2024-08-28T19:30:27.402115+0000","last_undegraded":"2024-08-28T19:30:27.402115+0000","last_fullsized":"2024-08-28T19:30:27.402115+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:52:02.486724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427086+0000","last_change":"2024-08-28T19:29:46.104132+0000","last_active":"2024-08-28T19:30:27.427086+0000","last_peered":"2024-08-28T19:30:27.427086+0000","last_clean":"2024-08-28T19:30:27.427086+0000","last_became_active":"2024-08-28T19:29:46.103725+0000","last_became_peered":"2024-08-28T19:29:46.103725+0000","last_unstale":"2024-08-28T19:30:27.427086+0000","last_undegraded":"2024-08-28T19:30:27.427086+0000","last_fullsized":"2024-08-28T19:30:27.427086+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:50:12.859989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400571+0000","last_change":"2024-08-28T19:29:55.265494+0000","last_active":"2024-08-28T19:30:27.400571+0000","last_peered":"2024-08-28T19:30:27.400571+0000","last_clean":"2024-08-28T19:30:27.400571+0000","last_became_active":"2024-08-28T19:29:55.265087+0000","last_became_peered":"2024-08-28T19:29:55.265087+0000","last_unstale":"2024-08-28T19:30:27.400571+0000","last_undegraded":"2024-08-28T19:30:27.400571+0000","last_fullsized":"2024-08-28T19:30:27.400571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:51:18.676889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550159+0000","last_change":"2024-08-28T19:29:48.127419+0000","last_active":"2024-08-28T19:30:27.550159+0000","last_peered":"2024-08-28T19:30:27.550159+0000","last_clean":"2024-08-28T19:30:27.550159+0000","last_became_active":"2024-08-28T19:29:48.126997+0000","last_became_peered":"2024-08-28T19:29:48.126997+0000","last_unstale":"2024-08-28T19:30:27.550159+0000","last_undegraded":"2024-08-28T19:30:27.550159+0000","last_fullsized":"2024-08-28T19:30:27.550159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:26:08.208724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:21.507185+0000","last_change":"2024-08-28T19:29:46.103451+0000","last_active":"2024-08-28T19:31:21.507185+0000","last_peered":"2024-08-28T19:31:21.507185+0000","last_clean":"2024-08-28T19:31:21.507185+0000","last_became_active":"2024-08-28T19:29:46.102991+0000","last_became_peered":"2024-08-28T19:29:46.102991+0000","last_unstale":"2024-08-28T19:31:21.507185+0000","last_undegraded":"2024-08-28T19:31:21.507185+0000","last_fullsized":"2024-08-28T19:31:21.507185+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:55:58.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548556+0000","last_change":"2024-08-28T19:29:55.269310+0000","last_active":"2024-08-28T19:30:27.548556+0000","last_peered":"2024-08-28T19:30:27.548556+0000","last_clean":"2024-08-28T19:30:27.548556+0000","last_became_active":"2024-08-28T19:29:55.268893+0000","last_became_peered":"2024-08-28T19:29:55.268893+0000","last_unstale":"2024-08-28T19:30:27.548556+0000","last_undegraded":"2024-08-28T19:30:27.548556+0000","last_fullsized":"2024-08-28T19:30:27.548556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:26:11.598773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400992+0000","last_change":"2024-08-28T19:29:55.261757+0000","last_active":"2024-08-28T19:30:27.400992+0000","last_peered":"2024-08-28T19:30:27.400992+0000","last_clean":"2024-08-28T19:30:27.400992+0000","last_became_active":"2024-08-28T19:29:55.261339+0000","last_became_peered":"2024-08-28T19:29:55.261339+0000","last_unstale":"2024-08-28T19:30:27.400992+0000","last_undegraded":"2024-08-28T19:30:27.400992+0000","last_fullsized":"2024-08-28T19:30:27.400992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:25:06.223029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401567+0000","last_change":"2024-08-28T19:29:48.123097+0000","last_active":"2024-08-28T19:30:27.401567+0000","last_peered":"2024-08-28T19:30:27.401567+0000","last_clean":"2024-08-28T19:30:27.401567+0000","last_became_active":"2024-08-28T19:29:48.122718+0000","last_became_peered":"2024-08-28T19:29:48.122718+0000","last_unstale":"2024-08-28T19:30:27.401567+0000","last_undegraded":"2024-08-28T19:30:27.401567+0000","last_fullsized":"2024-08-28T19:30:27.401567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:19.530985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406031+0000","last_change":"2024-08-28T19:29:46.105516+0000","last_active":"2024-08-28T19:30:27.406031+0000","last_peered":"2024-08-28T19:30:27.406031+0000","last_clean":"2024-08-28T19:30:27.406031+0000","last_became_active":"2024-08-28T19:29:46.105030+0000","last_became_peered":"2024-08-28T19:29:46.105030+0000","last_unstale":"2024-08-28T19:30:27.406031+0000","last_undegraded":"2024-08-28T19:30:27.406031+0000","last_fullsized":"2024-08-28T19:30:27.406031+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:47:02.032933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398485+0000","last_change":"2024-08-28T19:29:55.269759+0000","last_active":"2024-08-28T19:30:27.398485+0000","last_peered":"2024-08-28T19:30:27.398485+0000","last_clean":"2024-08-28T19:30:27.398485+0000","last_became_active":"2024-08-28T19:29:55.269275+0000","last_became_peered":"2024-08-28T19:29:55.269275+0000","last_unstale":"2024-08-28T19:30:27.398485+0000","last_undegraded":"2024-08-28T19:30:27.398485+0000","last_fullsized":"2024-08-28T19:30:27.398485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:45.870468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548611+0000","last_change":"2024-08-28T19:29:48.117400+0000","last_active":"2024-08-28T19:30:27.548611+0000","last_peered":"2024-08-28T19:30:27.548611+0000","last_clean":"2024-08-28T19:30:27.548611+0000","last_became_active":"2024-08-28T19:29:48.116987+0000","last_became_peered":"2024-08-28T19:29:48.116987+0000","last_unstale":"2024-08-28T19:30:27.548611+0000","last_undegraded":"2024-08-28T19:30:27.548611+0000","last_fullsized":"2024-08-28T19:30:27.548611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:43.822088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396426+0000","last_change":"2024-08-28T19:29:46.096103+0000","last_active":"2024-08-28T19:30:27.396426+0000","last_peered":"2024-08-28T19:30:27.396426+0000","last_clean":"2024-08-28T19:30:27.396426+0000","last_became_active":"2024-08-28T19:29:46.095812+0000","last_became_peered":"2024-08-28T19:29:46.095812+0000","last_unstale":"2024-08-28T19:30:27.396426+0000","last_undegraded":"2024-08-28T19:30:27.396426+0000","last_fullsized":"2024-08-28T19:30:27.396426+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:29.266636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398448+0000","last_change":"2024-08-28T19:29:46.106227+0000","last_active":"2024-08-28T19:30:27.398448+0000","last_peered":"2024-08-28T19:30:27.398448+0000","last_clean":"2024-08-28T19:30:27.398448+0000","last_became_active":"2024-08-28T19:29:46.105777+0000","last_became_peered":"2024-08-28T19:29:46.105777+0000","last_unstale":"2024-08-28T19:30:27.398448+0000","last_undegraded":"2024-08-28T19:30:27.398448+0000","last_fullsized":"2024-08-28T19:30:27.398448+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:26:14.815646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.406013+0000","last_change":"2024-08-28T19:29:48.111051+0000","last_active":"2024-08-28T19:30:27.406013+0000","last_peered":"2024-08-28T19:30:27.406013+0000","last_clean":"2024-08-28T19:30:27.406013+0000","last_became_active":"2024-08-28T19:29:48.110421+0000","last_became_peered":"2024-08-28T19:29:48.110421+0000","last_unstale":"2024-08-28T19:30:27.406013+0000","last_undegraded":"2024-08-28T19:30:27.406013+0000","last_fullsized":"2024-08-28T19:30:27.406013+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:19:47.765977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.408956+0000","last_change":"2024-08-28T19:30:27.408829+0000","last_active":"2024-08-28T19:30:27.408956+0000","last_peered":"2024-08-28T19:30:27.408956+0000","last_clean":"2024-08-28T19:30:27.408956+0000","last_became_active":"2024-08-28T19:30:27.408298+0000","last_became_peered":"2024-08-28T19:30:27.408298+0000","last_unstale":"2024-08-28T19:30:27.408956+0000","last_undegraded":"2024-08-28T19:30:27.408956+0000","last_fullsized":"2024-08-28T19:30:27.408956+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:38:58.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:31:20.506480+0000","last_change":"2024-08-28T19:29:46.102607+0000","last_active":"2024-08-28T19:31:20.506480+0000","last_peered":"2024-08-28T19:31:20.506480+0000","last_clean":"2024-08-28T19:31:20.506480+0000","last_became_active":"2024-08-28T19:29:46.102150+0000","last_became_peered":"2024-08-28T19:29:46.102150+0000","last_unstale":"2024-08-28T19:31:20.506480+0000","last_undegraded":"2024-08-28T19:31:20.506480+0000","last_fullsized":"2024-08-28T19:31:20.506480+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:44.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405319+0000","last_change":"2024-08-28T19:29:48.121598+0000","last_active":"2024-08-28T19:30:27.405319+0000","last_peered":"2024-08-28T19:30:27.405319+0000","last_clean":"2024-08-28T19:30:27.405319+0000","last_became_active":"2024-08-28T19:29:48.121189+0000","last_became_peered":"2024-08-28T19:29:48.121189+0000","last_unstale":"2024-08-28T19:30:27.405319+0000","last_undegraded":"2024-08-28T19:30:27.405319+0000","last_fullsized":"2024-08-28T19:30:27.405319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:19:35.496859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399556+0000","last_change":"2024-08-28T19:29:55.269648+0000","last_active":"2024-08-28T19:30:27.399556+0000","last_peered":"2024-08-28T19:30:27.399556+0000","last_clean":"2024-08-28T19:30:27.399556+0000","last_became_active":"2024-08-28T19:29:55.269182+0000","last_became_peered":"2024-08-28T19:29:55.269182+0000","last_unstale":"2024-08-28T19:30:27.399556+0000","last_undegraded":"2024-08-28T19:30:27.399556+0000","last_fullsized":"2024-08-28T19:30:27.399556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:09:47.581907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.397999+0000","last_change":"2024-08-28T19:29:48.117143+0000","last_active":"2024-08-28T19:30:27.397999+0000","last_peered":"2024-08-28T19:30:27.397999+0000","last_clean":"2024-08-28T19:30:27.397999+0000","last_became_active":"2024-08-28T19:29:48.116756+0000","last_became_peered":"2024-08-28T19:29:48.116756+0000","last_unstale":"2024-08-28T19:30:27.397999+0000","last_undegraded":"2024-08-28T19:30:27.397999+0000","last_fullsized":"2024-08-28T19:30:27.397999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:03:30.736872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.407341+0000","last_change":"2024-08-28T19:30:27.407218+0000","last_active":"2024-08-28T19:30:27.407341+0000","last_peered":"2024-08-28T19:30:27.407341+0000","last_clean":"2024-08-28T19:30:27.407341+0000","last_became_active":"2024-08-28T19:30:27.406769+0000","last_became_peered":"2024-08-28T19:30:27.406769+0000","last_unstale":"2024-08-28T19:30:27.407341+0000","last_undegraded":"2024-08-28T19:30:27.407341+0000","last_fullsized":"2024-08-28T19:30:27.407341+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:59.946922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.399195+0000","last_change":"2024-08-28T19:29:48.123969+0000","last_active":"2024-08-28T19:30:27.399195+0000","last_peered":"2024-08-28T19:30:27.399195+0000","last_clean":"2024-08-28T19:30:27.399195+0000","last_became_active":"2024-08-28T19:29:48.122534+0000","last_became_peered":"2024-08-28T19:29:48.122534+0000","last_unstale":"2024-08-28T19:30:27.399195+0000","last_undegraded":"2024-08-28T19:30:27.399195+0000","last_fullsized":"2024-08-28T19:30:27.399195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:33:56.739763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401200+0000","last_change":"2024-08-28T19:29:48.108976+0000","last_active":"2024-08-28T19:30:27.401200+0000","last_peered":"2024-08-28T19:30:27.401200+0000","last_clean":"2024-08-28T19:30:27.401200+0000","last_became_active":"2024-08-28T19:29:48.108631+0000","last_became_peered":"2024-08-28T19:29:48.108631+0000","last_unstale":"2024-08-28T19:30:27.401200+0000","last_undegraded":"2024-08-28T19:30:27.401200+0000","last_fullsized":"2024-08-28T19:30:27.401200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:08:59.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396988+0000","last_change":"2024-08-28T19:29:48.109875+0000","last_active":"2024-08-28T19:30:27.396988+0000","last_peered":"2024-08-28T19:30:27.396988+0000","last_clean":"2024-08-28T19:30:27.396988+0000","last_became_active":"2024-08-28T19:29:48.109486+0000","last_became_peered":"2024-08-28T19:29:48.109486+0000","last_unstale":"2024-08-28T19:30:27.396988+0000","last_undegraded":"2024-08-28T19:30:27.396988+0000","last_fullsized":"2024-08-28T19:30:27.396988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:02:28.365203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398509+0000","last_change":"2024-08-28T19:29:48.117237+0000","last_active":"2024-08-28T19:30:27.398509+0000","last_peered":"2024-08-28T19:30:27.398509+0000","last_clean":"2024-08-28T19:30:27.398509+0000","last_became_active":"2024-08-28T19:29:48.116799+0000","last_became_peered":"2024-08-28T19:29:48.116799+0000","last_unstale":"2024-08-28T19:30:27.398509+0000","last_undegraded":"2024-08-28T19:30:27.398509+0000","last_fullsized":"2024-08-28T19:30:27.398509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:48:12.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400269+0000","last_change":"2024-08-28T19:29:48.120522+0000","last_active":"2024-08-28T19:30:27.400269+0000","last_peered":"2024-08-28T19:30:27.400269+0000","last_clean":"2024-08-28T19:30:27.400269+0000","last_became_active":"2024-08-28T19:29:48.120150+0000","last_became_peered":"2024-08-28T19:29:48.120150+0000","last_unstale":"2024-08-28T19:30:27.400269+0000","last_undegraded":"2024-08-28T19:30:27.400269+0000","last_fullsized":"2024-08-28T19:30:27.400269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:01:00.210596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548881+0000","last_change":"2024-08-28T19:29:48.128451+0000","last_active":"2024-08-28T19:30:27.548881+0000","last_peered":"2024-08-28T19:30:27.548881+0000","last_clean":"2024-08-28T19:30:27.548881+0000","last_became_active":"2024-08-28T19:29:48.127898+0000","last_became_peered":"2024-08-28T19:29:48.127898+0000","last_unstale":"2024-08-28T19:30:27.548881+0000","last_undegraded":"2024-08-28T19:30:27.548881+0000","last_fullsized":"2024-08-28T19:30:27.548881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:48.663999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405596+0000","last_change":"2024-08-28T19:29:48.110788+0000","last_active":"2024-08-28T19:30:27.405596+0000","last_peered":"2024-08-28T19:30:27.405596+0000","last_clean":"2024-08-28T19:30:27.405596+0000","last_became_active":"2024-08-28T19:29:48.110355+0000","last_became_peered":"2024-08-28T19:29:48.110355+0000","last_unstale":"2024-08-28T19:30:27.405596+0000","last_undegraded":"2024-08-28T19:30:27.405596+0000","last_fullsized":"2024-08-28T19:30:27.405596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:57:25.345283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548733+0000","last_change":"2024-08-28T19:29:48.129667+0000","last_active":"2024-08-28T19:30:27.548733+0000","last_peered":"2024-08-28T19:30:27.548733+0000","last_clean":"2024-08-28T19:30:27.548733+0000","last_became_active":"2024-08-28T19:29:48.128237+0000","last_became_peered":"2024-08-28T19:29:48.128237+0000","last_unstale":"2024-08-28T19:30:27.548733+0000","last_undegraded":"2024-08-28T19:30:27.548733+0000","last_fullsized":"2024-08-28T19:30:27.548733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:23:35.920353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.549184+0000","last_change":"2024-08-28T19:29:48.136070+0000","last_active":"2024-08-28T19:30:27.549184+0000","last_peered":"2024-08-28T19:30:27.549184+0000","last_clean":"2024-08-28T19:30:27.549184+0000","last_became_active":"2024-08-28T19:29:48.135515+0000","last_became_peered":"2024-08-28T19:29:48.135515+0000","last_unstale":"2024-08-28T19:30:27.549184+0000","last_undegraded":"2024-08-28T19:30:27.549184+0000","last_fullsized":"2024-08-28T19:30:27.549184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:25:29.267753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.396768+0000","last_change":"2024-08-28T19:29:48.128614+0000","last_active":"2024-08-28T19:30:27.396768+0000","last_peered":"2024-08-28T19:30:27.396768+0000","last_clean":"2024-08-28T19:30:27.396768+0000","last_became_active":"2024-08-28T19:29:48.128231+0000","last_became_peered":"2024-08-28T19:29:48.128231+0000","last_unstale":"2024-08-28T19:30:27.396768+0000","last_undegraded":"2024-08-28T19:30:27.396768+0000","last_fullsized":"2024-08-28T19:30:27.396768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:11:08.541435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398204+0000","last_change":"2024-08-28T19:29:48.114930+0000","last_active":"2024-08-28T19:30:27.398204+0000","last_peered":"2024-08-28T19:30:27.398204+0000","last_clean":"2024-08-28T19:30:27.398204+0000","last_became_active":"2024-08-28T19:29:48.114389+0000","last_became_peered":"2024-08-28T19:29:48.114389+0000","last_unstale":"2024-08-28T19:30:27.398204+0000","last_undegraded":"2024-08-28T19:30:27.398204+0000","last_fullsized":"2024-08-28T19:30:27.398204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:51.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400101+0000","last_change":"2024-08-28T19:29:48.125031+0000","last_active":"2024-08-28T19:30:27.400101+0000","last_peered":"2024-08-28T19:30:27.400101+0000","last_clean":"2024-08-28T19:30:27.400101+0000","last_became_active":"2024-08-28T19:29:48.124417+0000","last_became_peered":"2024-08-28T19:29:48.124417+0000","last_unstale":"2024-08-28T19:30:27.400101+0000","last_undegraded":"2024-08-28T19:30:27.400101+0000","last_fullsized":"2024-08-28T19:30:27.400101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:33:33.931496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401136+0000","last_change":"2024-08-28T19:29:48.127815+0000","last_active":"2024-08-28T19:30:27.401136+0000","last_peered":"2024-08-28T19:30:27.401136+0000","last_clean":"2024-08-28T19:30:27.401136+0000","last_became_active":"2024-08-28T19:29:48.127455+0000","last_became_peered":"2024-08-28T19:29:48.127455+0000","last_unstale":"2024-08-28T19:30:27.401136+0000","last_undegraded":"2024-08-28T19:30:27.401136+0000","last_fullsized":"2024-08-28T19:30:27.401136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:47:23.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398765+0000","last_change":"2024-08-28T19:29:48.122105+0000","last_active":"2024-08-28T19:30:27.398765+0000","last_peered":"2024-08-28T19:30:27.398765+0000","last_clean":"2024-08-28T19:30:27.398765+0000","last_became_active":"2024-08-28T19:29:48.121546+0000","last_became_peered":"2024-08-28T19:29:48.121546+0000","last_unstale":"2024-08-28T19:30:27.398765+0000","last_undegraded":"2024-08-28T19:30:27.398765+0000","last_fullsized":"2024-08-28T19:30:27.398765+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:21:00.428052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548837+0000","last_change":"2024-08-28T19:29:48.136198+0000","last_active":"2024-08-28T19:30:27.548837+0000","last_peered":"2024-08-28T19:30:27.548837+0000","last_clean":"2024-08-28T19:30:27.548837+0000","last_became_active":"2024-08-28T19:29:48.135796+0000","last_became_peered":"2024-08-28T19:29:48.135796+0000","last_unstale":"2024-08-28T19:30:27.548837+0000","last_undegraded":"2024-08-28T19:30:27.548837+0000","last_fullsized":"2024-08-28T19:30:27.548837+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:05.033399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400902+0000","last_change":"2024-08-28T19:29:48.121245+0000","last_active":"2024-08-28T19:30:27.400902+0000","last_peered":"2024-08-28T19:30:27.400902+0000","last_clean":"2024-08-28T19:30:27.400902+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:30:27.400902+0000","last_undegraded":"2024-08-28T19:30:27.400902+0000","last_fullsized":"2024-08-28T19:30:27.400902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:39.936209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400752+0000","last_change":"2024-08-28T19:29:48.119198+0000","last_active":"2024-08-28T19:30:27.400752+0000","last_peered":"2024-08-28T19:30:27.400752+0000","last_clean":"2024-08-28T19:30:27.400752+0000","last_became_active":"2024-08-28T19:29:48.118744+0000","last_became_peered":"2024-08-28T19:29:48.118744+0000","last_unstale":"2024-08-28T19:30:27.400752+0000","last_undegraded":"2024-08-28T19:30:27.400752+0000","last_fullsized":"2024-08-28T19:30:27.400752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:15:35.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.403903+0000","last_change":"2024-08-28T19:30:27.403790+0000","last_active":"2024-08-28T19:30:27.403903+0000","last_peered":"2024-08-28T19:30:27.403903+0000","last_clean":"2024-08-28T19:30:27.403903+0000","last_became_active":"2024-08-28T19:30:27.403279+0000","last_became_peered":"2024-08-28T19:30:27.403279+0000","last_unstale":"2024-08-28T19:30:27.403903+0000","last_undegraded":"2024-08-28T19:30:27.403903+0000","last_fullsized":"2024-08-28T19:30:27.403903+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:31:54.137839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.405819+0000","last_change":"2024-08-28T19:30:27.405173+0000","last_active":"2024-08-28T19:30:27.405819+0000","last_peered":"2024-08-28T19:30:27.405819+0000","last_clean":"2024-08-28T19:30:27.405819+0000","last_became_active":"2024-08-28T19:30:27.404752+0000","last_became_peered":"2024-08-28T19:30:27.404752+0000","last_unstale":"2024-08-28T19:30:27.405819+0000","last_undegraded":"2024-08-28T19:30:27.405819+0000","last_fullsized":"2024-08-28T19:30:27.405819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:16.544309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.427239+0000","last_change":"2024-08-28T19:29:48.136738+0000","last_active":"2024-08-28T19:30:27.427239+0000","last_peered":"2024-08-28T19:30:27.427239+0000","last_clean":"2024-08-28T19:30:27.427239+0000","last_became_active":"2024-08-28T19:29:48.136046+0000","last_became_peered":"2024-08-28T19:29:48.136046+0000","last_unstale":"2024-08-28T19:30:27.427239+0000","last_undegraded":"2024-08-28T19:30:27.427239+0000","last_fullsized":"2024-08-28T19:30:27.427239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:43:32.905933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398789+0000","last_change":"2024-08-28T19:29:48.127432+0000","last_active":"2024-08-28T19:30:27.398789+0000","last_peered":"2024-08-28T19:30:27.398789+0000","last_clean":"2024-08-28T19:30:27.398789+0000","last_became_active":"2024-08-28T19:29:48.126067+0000","last_became_peered":"2024-08-28T19:29:48.126067+0000","last_unstale":"2024-08-28T19:30:27.398789+0000","last_undegraded":"2024-08-28T19:30:27.398789+0000","last_fullsized":"2024-08-28T19:30:27.398789+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:30:05.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.550430+0000","last_change":"2024-08-28T19:29:48.121154+0000","last_active":"2024-08-28T19:30:27.550430+0000","last_peered":"2024-08-28T19:30:27.550430+0000","last_clean":"2024-08-28T19:30:27.550430+0000","last_became_active":"2024-08-28T19:29:48.120709+0000","last_became_peered":"2024-08-28T19:29:48.120709+0000","last_unstale":"2024-08-28T19:30:27.550430+0000","last_undegraded":"2024-08-28T19:30:27.550430+0000","last_fullsized":"2024-08-28T19:30:27.550430+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:52.716814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.548374+0000","last_change":"2024-08-28T19:29:48.127124+0000","last_active":"2024-08-28T19:30:27.548374+0000","last_peered":"2024-08-28T19:30:27.548374+0000","last_clean":"2024-08-28T19:30:27.548374+0000","last_became_active":"2024-08-28T19:29:48.126761+0000","last_became_peered":"2024-08-28T19:29:48.126761+0000","last_unstale":"2024-08-28T19:30:27.548374+0000","last_undegraded":"2024-08-28T19:30:27.548374+0000","last_fullsized":"2024-08-28T19:30:27.548374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:05:31.150472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.426567+0000","last_change":"2024-08-28T19:29:48.132285+0000","last_active":"2024-08-28T19:30:27.426567+0000","last_peered":"2024-08-28T19:30:27.426567+0000","last_clean":"2024-08-28T19:30:27.426567+0000","last_became_active":"2024-08-28T19:29:48.131688+0000","last_became_peered":"2024-08-28T19:29:48.131688+0000","last_unstale":"2024-08-28T19:30:27.426567+0000","last_undegraded":"2024-08-28T19:30:27.426567+0000","last_fullsized":"2024-08-28T19:30:27.426567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:23:08.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398390+0000","last_change":"2024-08-28T19:29:48.126384+0000","last_active":"2024-08-28T19:30:27.398390+0000","last_peered":"2024-08-28T19:30:27.398390+0000","last_clean":"2024-08-28T19:30:27.398390+0000","last_became_active":"2024-08-28T19:29:48.125412+0000","last_became_peered":"2024-08-28T19:29:48.125412+0000","last_unstale":"2024-08-28T19:30:27.398390+0000","last_undegraded":"2024-08-28T19:30:27.398390+0000","last_fullsized":"2024-08-28T19:30:27.398390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:47:42.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.404921+0000","last_change":"2024-08-28T19:29:48.114032+0000","last_active":"2024-08-28T19:30:27.404921+0000","last_peered":"2024-08-28T19:30:27.404921+0000","last_clean":"2024-08-28T19:30:27.404921+0000","last_became_active":"2024-08-28T19:29:48.113625+0000","last_became_peered":"2024-08-28T19:29:48.113625+0000","last_unstale":"2024-08-28T19:30:27.404921+0000","last_undegraded":"2024-08-28T19:30:27.404921+0000","last_fullsized":"2024-08-28T19:30:27.404921+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:07:08.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.402005+0000","last_change":"2024-08-28T19:29:48.124046+0000","last_active":"2024-08-28T19:30:27.402005+0000","last_peered":"2024-08-28T19:30:27.402005+0000","last_clean":"2024-08-28T19:30:27.402005+0000","last_became_active":"2024-08-28T19:29:48.123647+0000","last_became_peered":"2024-08-28T19:29:48.123647+0000","last_unstale":"2024-08-28T19:30:27.402005+0000","last_undegraded":"2024-08-28T19:30:27.402005+0000","last_fullsized":"2024-08-28T19:30:27.402005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:59.262454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.400906+0000","last_change":"2024-08-28T19:29:48.121258+0000","last_active":"2024-08-28T19:30:27.400906+0000","last_peered":"2024-08-28T19:30:27.400906+0000","last_clean":"2024-08-28T19:30:27.400906+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:30:27.400906+0000","last_undegraded":"2024-08-28T19:30:27.400906+0000","last_fullsized":"2024-08-28T19:30:27.400906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:37:05.610466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.401108+0000","last_change":"2024-08-28T19:29:48.125071+0000","last_active":"2024-08-28T19:30:27.401108+0000","last_peered":"2024-08-28T19:30:27.401108+0000","last_clean":"2024-08-28T19:30:27.401108+0000","last_became_active":"2024-08-28T19:29:48.124706+0000","last_became_peered":"2024-08-28T19:29:48.124706+0000","last_unstale":"2024-08-28T19:30:27.401108+0000","last_undegraded":"2024-08-28T19:30:27.401108+0000","last_fullsized":"2024-08-28T19:30:27.401108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:39:06.460682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-08-28T19:30:27.398708+0000","last_change":"2024-08-28T19:29:48.121905+0000","last_active":"2024-08-28T19:30:27.398708+0000","last_peered":"2024-08-28T19:30:27.398708+0000","last_clean":"2024-08-28T19:30:27.398708+0000","last_became_active":"2024-08-28T19:29:48.121045+0000","last_became_peered":"2024-08-28T19:29:48.121045+0000","last_unstale":"2024-08-28T19:30:27.398708+0000","last_undegraded":"2024-08-28T19:30:27.398708+0000","last_fullsized":"2024-08-28T19:30:27.398708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:56:58.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69276,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":599,"num_read_kb":374,"num_write":247,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246047,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":477263,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939685,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1126151,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":480898,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":477180,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495668,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":1073677,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659194,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":913408,"data_stored":472306,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":995328,"data_stored":1068868,"data_compressed":59561,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":476771,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":472014,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":536019,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542226,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":535408,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705750,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":474153,"data_compressed":23718,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T19:31:27.144 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-28T19:31:27.144 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-28T19:31:27.144 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-28T19:31:27.145 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-28T19:31:27.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:26 smithi059 ceph-mon[22052]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-08-28T19:31:27.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:26 smithi059 ceph-mon[22052]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:31:27.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-08-28T19:31:27.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:26 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-08-28T19:31:27.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:26 smithi122 ceph-mon[22174]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-08-28T19:31:27.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:26 smithi122 ceph-mon[22174]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:31:27.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-08-28T19:31:27.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:26 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-08-28T19:31:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:27.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.930+0000 7f3146572640 1 -- 172.21.15.33:0/644858381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3140102800 msgr2=0x7f3140102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:27.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.930+0000 7f3146572640 1 --2- 172.21.15.33:0/644858381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3140102800 0x7f3140102c10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3130009900 tx=0x7f313002a410 comp rx=0 tx=0).stop 2024-08-28T19:31:27.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.930+0000 7f3146572640 1 -- 172.21.15.33:0/644858381 shutdown_connections 2024-08-28T19:31:27.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.930+0000 7f3146572640 1 --2- 172.21.15.33:0/644858381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3140108a90 0x7f314010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:27.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.930+0000 7f3146572640 1 --2- 172.21.15.33:0/644858381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3140108140 0x7f3140108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:27.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.930+0000 7f3146572640 1 --2- 172.21.15.33:0/644858381 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3140102800 0x7f3140102c10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:27.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.930+0000 7f3146572640 1 -- 172.21.15.33:0/644858381 >> 172.21.15.33:0/644858381 conn(0x7f31400794d0 msgr2=0x7f31400798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:27.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.930+0000 7f3146572640 1 -- 172.21.15.33:0/644858381 shutdown_connections 2024-08-28T19:31:27.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.930+0000 7f3146572640 1 -- 172.21.15.33:0/644858381 wait complete. 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3146572640 1 Processor -- start 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3146572640 1 -- start start 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3146572640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3140102800 0x7f314019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3146572640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3140108140 0x7f314019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3146572640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3140108a90 0x7f314019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3146572640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f31401126f0 con 0x7f3140108140 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3146572640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3140112570 con 0x7f3140108a90 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3146572640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3140112870 con 0x7f3140102800 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3137fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3140108140 0x7f314019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3137fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3140108140 0x7f314019a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57350/0 (socket says 172.21.15.33:57350) 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.931+0000 7f3137fff640 1 -- 172.21.15.33:0/2078003719 learned_addr learned my addr 172.21.15.33:0/2078003719 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f3144b0f640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3140108a90 0x7f314019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f313ffff640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3140102800 0x7f314019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f3137fff640 1 -- 172.21.15.33:0/2078003719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3140102800 msgr2=0x7f314019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f3137fff640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3140102800 0x7f314019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f3137fff640 1 -- 172.21.15.33:0/2078003719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3140108a90 msgr2=0x7f314019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f3137fff640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3140108a90 0x7f314019fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f3137fff640 1 -- 172.21.15.33:0/2078003719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31401a0120 con 0x7f3140108140 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f3137fff640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3140108140 0x7f314019a810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f312800c970 tx=0x7f312800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f313dffb640 1 -- 172.21.15.33:0/2078003719 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128014070 con 0x7f3140108140 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f313dffb640 1 -- 172.21.15.33:0/2078003719 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3128004440 con 0x7f3140108140 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f3146572640 1 -- 172.21.15.33:0/2078003719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31401a0410 con 0x7f3140108140 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f313dffb640 1 -- 172.21.15.33:0/2078003719 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128003e50 con 0x7f3140108140 2024-08-28T19:31:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.932+0000 7f3146572640 1 -- 172.21.15.33:0/2078003719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3140103ed0 con 0x7f3140108140 2024-08-28T19:31:27.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.933+0000 7f3146572640 1 -- 172.21.15.33:0/2078003719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3140103a80 con 0x7f3140108140 2024-08-28T19:31:27.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.936+0000 7f313dffb640 1 -- 172.21.15.33:0/2078003719 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f3128017070 con 0x7f3140108140 2024-08-28T19:31:27.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.936+0000 7f313dffb640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f312c0b4de0 0x7f312c0b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:27.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.937+0000 7f313ffff640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f312c0b4de0 0x7f312c0b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:27.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.937+0000 7f313dffb640 1 -- 172.21.15.33:0/2078003719 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f31280e5b50 con 0x7f3140108140 2024-08-28T19:31:27.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.937+0000 7f313ffff640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f312c0b4de0 0x7f312c0b72f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3130031440 tx=0x7f3130005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:27.940+0000 7f313dffb640 1 -- 172.21.15.33:0/2078003719 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f312801e030 con 0x7f3140108140 2024-08-28T19:31:28.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-08-28T19:31:28.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:27 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-08-28T19:31:28.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:27 smithi033 ceph-mon[18549]: osdmap e83: 12 total, 12 up, 12 in 2024-08-28T19:31:28.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.169+0000 7f3146572640 1 -- 172.21.15.33:0/2078003719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3140102c10 con 0x7f3140108140 2024-08-28T19:31:28.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.169+0000 7f313dffb640 1 -- 172.21.15.33:0/2078003719 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+180 (secure 0 0 0) 0x7f31280ac650 con 0x7f3140108140 2024-08-28T19:31:28.170 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:31:28.170 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 1 pg peering","count":1},"muted":false}},"mutes":[]} 2024-08-28T19:31:28.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.171+0000 7f3146572640 1 -- 172.21.15.33:0/2078003719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f312c0b4de0 msgr2=0x7f312c0b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:28.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.171+0000 7f3146572640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f312c0b4de0 0x7f312c0b72f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3130031440 tx=0x7f3130005d50 comp rx=0 tx=0).stop 2024-08-28T19:31:28.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.171+0000 7f3146572640 1 -- 172.21.15.33:0/2078003719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3140108140 msgr2=0x7f314019a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:28.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.171+0000 7f3146572640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3140108140 0x7f314019a810 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f312800c970 tx=0x7f312800ce30 comp rx=0 tx=0).stop 2024-08-28T19:31:28.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.172+0000 7f3146572640 1 -- 172.21.15.33:0/2078003719 shutdown_connections 2024-08-28T19:31:28.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.172+0000 7f3146572640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3140108a90 0x7f314019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:28.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.172+0000 7f3146572640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3140108140 0x7f314019a810 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:28.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.172+0000 7f3146572640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f312c0b4de0 0x7f312c0b72f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:28.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.172+0000 7f3146572640 1 --2- 172.21.15.33:0/2078003719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3140102800 0x7f314019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:28.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.172+0000 7f3146572640 1 -- 172.21.15.33:0/2078003719 >> 172.21.15.33:0/2078003719 conn(0x7f31400794d0 msgr2=0x7f31401017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:28.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.172+0000 7f3146572640 1 -- 172.21.15.33:0/2078003719 shutdown_connections 2024-08-28T19:31:28.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:28.172+0000 7f3146572640 1 -- 172.21.15.33:0/2078003719 wait complete. 2024-08-28T19:31:28.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-08-28T19:31:28.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:27 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-08-28T19:31:28.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:27 smithi059 ceph-mon[22052]: osdmap e83: 12 total, 12 up, 12 in 2024-08-28T19:31:28.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-08-28T19:31:28.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:27 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-08-28T19:31:28.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:27 smithi122 ceph-mon[22174]: osdmap e83: 12 total, 12 up, 12 in 2024-08-28T19:31:29.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:28 smithi059 ceph-mon[22052]: pgmap v312: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-08-28T19:31:29.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:28 smithi059 ceph-mon[22052]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-28T19:31:29.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:28 smithi059 ceph-mon[22052]: osdmap e84: 12 total, 12 up, 12 in 2024-08-28T19:31:29.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:28 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2078003719' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T19:31:29.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:28 smithi122 ceph-mon[22174]: pgmap v312: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-08-28T19:31:29.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:28 smithi122 ceph-mon[22174]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-28T19:31:29.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:28 smithi122 ceph-mon[22174]: osdmap e84: 12 total, 12 up, 12 in 2024-08-28T19:31:29.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:28 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2078003719' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T19:31:29.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:28 smithi033 ceph-mon[18549]: pgmap v312: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-08-28T19:31:29.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:28 smithi033 ceph-mon[18549]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-28T19:31:29.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:28 smithi033 ceph-mon[18549]: osdmap e84: 12 total, 12 up, 12 in 2024-08-28T19:31:29.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:28 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2078003719' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T19:31:31.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:30 smithi059 ceph-mon[22052]: pgmap v314: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-08-28T19:31:31.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:30 smithi122 ceph-mon[22174]: pgmap v314: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-08-28T19:31:31.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:30 smithi033 ceph-mon[18549]: pgmap v314: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-08-28T19:31:31.983 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-28T19:31:32.253 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:32.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.803+0000 7f70de297640 1 -- 172.21.15.33:0/3450614209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d8108170 msgr2=0x7f70d8108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:32.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.803+0000 7f70de297640 1 --2- 172.21.15.33:0/3450614209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d8108170 0x7f70d8108580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009900 tx=0x7f70cc02a410 comp rx=0 tx=0).stop 2024-08-28T19:31:32.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.803+0000 7f70de297640 1 -- 172.21.15.33:0/3450614209 shutdown_connections 2024-08-28T19:31:32.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.803+0000 7f70de297640 1 --2- 172.21.15.33:0/3450614209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d8108ac0 0x7f70d810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:32.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.803+0000 7f70de297640 1 --2- 172.21.15.33:0/3450614209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d8108170 0x7f70d8108580 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:32.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.803+0000 7f70de297640 1 --2- 172.21.15.33:0/3450614209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d8102880 0x7f70d8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:32.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.803+0000 7f70de297640 1 -- 172.21.15.33:0/3450614209 >> 172.21.15.33:0/3450614209 conn(0x7f70d8079500 msgr2=0x7f70d8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:32.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.803+0000 7f70de297640 1 -- 172.21.15.33:0/3450614209 shutdown_connections 2024-08-28T19:31:32.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.803+0000 7f70de297640 1 -- 172.21.15.33:0/3450614209 wait complete. 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70de297640 1 Processor -- start 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70de297640 1 -- start start 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70de297640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d8102880 0x7f70d8104eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70de297640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d8108170 0x7f70d81053f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70de297640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d8108ac0 0x7f70d8105930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70de297640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8112710 con 0x7f70d8108170 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70de297640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8112590 con 0x7f70d8108ac0 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70de297640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8112890 con 0x7f70d8102880 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70d77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d8108170 0x7f70d81053f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70d77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d8108170 0x7f70d81053f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38402/0 (socket says 172.21.15.33:38402) 2024-08-28T19:31:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.804+0000 7f70d77fe640 1 -- 172.21.15.33:0/4070316366 learned_addr learned my addr 172.21.15.33:0/4070316366 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70d7fff640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d8102880 0x7f70d8104eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70dc834640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d8108ac0 0x7f70d8105930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70d77fe640 1 -- 172.21.15.33:0/4070316366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d8102880 msgr2=0x7f70d8104eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70d77fe640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d8102880 0x7f70d8104eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70d77fe640 1 -- 172.21.15.33:0/4070316366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d8108ac0 msgr2=0x7f70d8105930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70d77fe640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d8108ac0 0x7f70d8105930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70d77fe640 1 -- 172.21.15.33:0/4070316366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d81a84e0 con 0x7f70d8108170 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70d77fe640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d8108170 0x7f70d81053f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f70cc031a90 tx=0x7f70cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70d57fa640 1 -- 172.21.15.33:0/4070316366 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc03f030 con 0x7f70d8108170 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70d57fa640 1 -- 172.21.15.33:0/4070316366 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70cc003cb0 con 0x7f70d8108170 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70de297640 1 -- 172.21.15.33:0/4070316366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d81a8770 con 0x7f70d8108170 2024-08-28T19:31:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70d57fa640 1 -- 172.21.15.33:0/4070316366 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc035070 con 0x7f70d8108170 2024-08-28T19:31:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.805+0000 7f70de297640 1 -- 172.21.15.33:0/4070316366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d81a8ca0 con 0x7f70d8108170 2024-08-28T19:31:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.806+0000 7f70de297640 1 -- 172.21.15.33:0/4070316366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d8103ab0 con 0x7f70d8108170 2024-08-28T19:31:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.808+0000 7f70d57fa640 1 -- 172.21.15.33:0/4070316366 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f70cc042030 con 0x7f70d8108170 2024-08-28T19:31:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.809+0000 7f70d57fa640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70c00b4c90 0x7f70c00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.809+0000 7f70d7fff640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70c00b4c90 0x7f70c00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.809+0000 7f70d57fa640 1 -- 172.21.15.33:0/4070316366 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f70cc106180 con 0x7f70d8108170 2024-08-28T19:31:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.809+0000 7f70d7fff640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70c00b4c90 0x7f70c00b71a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70c8005fd0 tx=0x7f70c8005e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:32.812+0000 7f70d57fa640 1 -- 172.21.15.33:0/4070316366 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f70cc0ccce0 con 0x7f70d8108170 2024-08-28T19:31:33.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.039+0000 7f70de297640 1 -- 172.21.15.33:0/4070316366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f70d810b8f0 con 0x7f70d8108170 2024-08-28T19:31:33.041 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:32 smithi033 ceph-mon[18549]: pgmap v315: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-28T19:31:33.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.040+0000 7f70d57fa640 1 -- 172.21.15.33:0/4070316366 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+180 (secure 0 0 0) 0x7f70cc0d5220 con 0x7f70d8108170 2024-08-28T19:31:33.041 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:31:33.042 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 1 pg peering","count":1},"muted":false}},"mutes":[]} 2024-08-28T19:31:33.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.042+0000 7f70de297640 1 -- 172.21.15.33:0/4070316366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70c00b4c90 msgr2=0x7f70c00b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:33.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.042+0000 7f70de297640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70c00b4c90 0x7f70c00b71a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70c8005fd0 tx=0x7f70c8005e40 comp rx=0 tx=0).stop 2024-08-28T19:31:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.042+0000 7f70de297640 1 -- 172.21.15.33:0/4070316366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d8108170 msgr2=0x7f70d81053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.042+0000 7f70de297640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d8108170 0x7f70d81053f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f70cc031a90 tx=0x7f70cc004270 comp rx=0 tx=0).stop 2024-08-28T19:31:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.043+0000 7f70de297640 1 -- 172.21.15.33:0/4070316366 shutdown_connections 2024-08-28T19:31:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.043+0000 7f70de297640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d8108ac0 0x7f70d8105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.043+0000 7f70de297640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d8108170 0x7f70d81053f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.043+0000 7f70de297640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f70c00b4c90 0x7f70c00b71a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.043+0000 7f70de297640 1 --2- 172.21.15.33:0/4070316366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f70d8102880 0x7f70d8104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.043+0000 7f70de297640 1 -- 172.21.15.33:0/4070316366 >> 172.21.15.33:0/4070316366 conn(0x7f70d8079500 msgr2=0x7f70d806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.043+0000 7f70de297640 1 -- 172.21.15.33:0/4070316366 shutdown_connections 2024-08-28T19:31:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:33.043+0000 7f70de297640 1 -- 172.21.15.33:0/4070316366 wait complete. 2024-08-28T19:31:33.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:32 smithi059 ceph-mon[22052]: pgmap v315: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-28T19:31:33.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:32 smithi122 ceph-mon[22174]: pgmap v315: 129 pgs: 1 peering, 128 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-28T19:31:34.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:33 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4070316366' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T19:31:34.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:33 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4070316366' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T19:31:34.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:33 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4070316366' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T19:31:35.184 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:34 smithi059 ceph-mon[22052]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 13 B/s, 1 objects/s recovering 2024-08-28T19:31:35.184 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:34 smithi059 ceph-mon[22052]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-28T19:31:35.184 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:34 smithi059 ceph-mon[22052]: Cluster is now healthy 2024-08-28T19:31:35.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:34 smithi122 ceph-mon[22174]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 13 B/s, 1 objects/s recovering 2024-08-28T19:31:35.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:34 smithi122 ceph-mon[22174]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-28T19:31:35.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:34 smithi122 ceph-mon[22174]: Cluster is now healthy 2024-08-28T19:31:35.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:34 smithi033 ceph-mon[18549]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 13 B/s, 1 objects/s recovering 2024-08-28T19:31:35.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:34 smithi033 ceph-mon[18549]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-28T19:31:35.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:34 smithi033 ceph-mon[18549]: Cluster is now healthy 2024-08-28T19:31:36.746 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-28T19:31:37.007 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:37.128 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:36 smithi033 ceph-mon[18549]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 12 B/s, 1 objects/s recovering 2024-08-28T19:31:37.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:36 smithi059 ceph-mon[22052]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 12 B/s, 1 objects/s recovering 2024-08-28T19:31:37.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:36 smithi122 ceph-mon[22174]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 11 op/s; 12 B/s, 1 objects/s recovering 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.563+0000 7fe6556be640 1 -- 172.21.15.33:0/1838284167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe650103950 msgr2=0x7fe650103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.563+0000 7fe6556be640 1 --2- 172.21.15.33:0/1838284167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe650103950 0x7fe650103d60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe640009900 tx=0x7fe64002a410 comp rx=0 tx=0).stop 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.563+0000 7fe6556be640 1 -- 172.21.15.33:0/1838284167 shutdown_connections 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.563+0000 7fe6556be640 1 --2- 172.21.15.33:0/1838284167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe650109be0 0x7fe650110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.563+0000 7fe6556be640 1 --2- 172.21.15.33:0/1838284167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe650109290 0x7fe6501096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.563+0000 7fe6556be640 1 --2- 172.21.15.33:0/1838284167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe650103950 0x7fe650103d60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.563+0000 7fe6556be640 1 -- 172.21.15.33:0/1838284167 >> 172.21.15.33:0/1838284167 conn(0x7fe6500ff3a0 msgr2=0x7fe6501017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.563+0000 7fe6556be640 1 -- 172.21.15.33:0/1838284167 shutdown_connections 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.563+0000 7fe6556be640 1 -- 172.21.15.33:0/1838284167 wait complete. 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.564+0000 7fe6556be640 1 Processor -- start 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.564+0000 7fe6556be640 1 -- start start 2024-08-28T19:31:37.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.564+0000 7fe6556be640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe650103950 0x7fe65019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.564+0000 7fe6556be640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe650109290 0x7fe65019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.564+0000 7fe6556be640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe650109be0 0x7fe65019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.564+0000 7fe6556be640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe6501138a0 con 0x7fe650109be0 2024-08-28T19:31:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.564+0000 7fe6556be640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe650113720 con 0x7fe650109290 2024-08-28T19:31:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.564+0000 7fe6556be640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe650113a20 con 0x7fe650103950 2024-08-28T19:31:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe650109be0 0x7fe65019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe650109be0 0x7fe65019fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38430/0 (socket says 172.21.15.33:38430) 2024-08-28T19:31:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64f7fe640 1 -- 172.21.15.33:0/3824351894 learned_addr learned my addr 172.21.15.33:0/3824351894 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64effd640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe650103950 0x7fe65019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:37.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64e7fc640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe650109290 0x7fe65019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64f7fe640 1 -- 172.21.15.33:0/3824351894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe650103950 msgr2=0x7fe65019a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64f7fe640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe650103950 0x7fe65019a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64f7fe640 1 -- 172.21.15.33:0/3824351894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe650109290 msgr2=0x7fe65019a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64f7fe640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe650109290 0x7fe65019a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64f7fe640 1 -- 172.21.15.33:0/3824351894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6501a0280 con 0x7fe650109be0 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64effd640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe650103950 0x7fe65019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe64f7fe640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe650109be0 0x7fe65019fb50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe64800eb10 tx=0x7fe64800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe637fff640 1 -- 172.21.15.33:0/3824351894 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648004b20 con 0x7fe650109be0 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe637fff640 1 -- 172.21.15.33:0/3824351894 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe648004cc0 con 0x7fe650109be0 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe6556be640 1 -- 172.21.15.33:0/3824351894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6501a0570 con 0x7fe650109be0 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.565+0000 7fe637fff640 1 -- 172.21.15.33:0/3824351894 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648010670 con 0x7fe650109be0 2024-08-28T19:31:37.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.566+0000 7fe6556be640 1 -- 172.21.15.33:0/3824351894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6501a6cd0 con 0x7fe650109be0 2024-08-28T19:31:37.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.567+0000 7fe6556be640 1 -- 172.21.15.33:0/3824351894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe650103d60 con 0x7fe650109be0 2024-08-28T19:31:37.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.568+0000 7fe637fff640 1 -- 172.21.15.33:0/3824351894 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fe648005020 con 0x7fe650109be0 2024-08-28T19:31:37.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.569+0000 7fe637fff640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe6380b4c10 0x7fe6380b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:37.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.569+0000 7fe64effd640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe6380b4c10 0x7fe6380b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:37.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.569+0000 7fe637fff640 1 -- 172.21.15.33:0/3824351894 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe6480e5e10 con 0x7fe650109be0 2024-08-28T19:31:37.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.570+0000 7fe64effd640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe6380b4c10 0x7fe6380b7120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe640031440 tx=0x7fe640009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:37.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.574+0000 7fe637fff640 1 -- 172.21.15.33:0/3824351894 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe6480e9030 con 0x7fe650109be0 2024-08-28T19:31:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.798+0000 7fe6556be640 1 -- 172.21.15.33:0/3824351894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe65002e430 con 0x7fe650109be0 2024-08-28T19:31:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.799+0000 7fe637fff640 1 -- 172.21.15.33:0/3824351894 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe6480ac910 con 0x7fe650109be0 2024-08-28T19:31:37.800 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:31:37.800 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-28T19:31:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 -- 172.21.15.33:0/3824351894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe6380b4c10 msgr2=0x7fe6380b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe6380b4c10 0x7fe6380b7120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe640031440 tx=0x7fe640009680 comp rx=0 tx=0).stop 2024-08-28T19:31:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 -- 172.21.15.33:0/3824351894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe650109be0 msgr2=0x7fe65019fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe650109be0 0x7fe65019fb50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe64800eb10 tx=0x7fe64800c2d0 comp rx=0 tx=0).stop 2024-08-28T19:31:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 -- 172.21.15.33:0/3824351894 shutdown_connections 2024-08-28T19:31:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe650109be0 0x7fe65019fb50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe650109290 0x7fe65019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe6380b4c10 0x7fe6380b7120 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 --2- 172.21.15.33:0/3824351894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe650103950 0x7fe65019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 -- 172.21.15.33:0/3824351894 >> 172.21.15.33:0/3824351894 conn(0x7fe6500ff3a0 msgr2=0x7fe6501017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 -- 172.21.15.33:0/3824351894 shutdown_connections 2024-08-28T19:31:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:37.801+0000 7fe6556be640 1 -- 172.21.15.33:0/3824351894 wait complete. 2024-08-28T19:31:38.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:37 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3824351894' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T19:31:38.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:37 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3824351894' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T19:31:38.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:37 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3824351894' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-28T19:31:38.629 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-28T19:31:38.629 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:31:38.888 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:39.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:38 smithi059 ceph-mon[22052]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2024-08-28T19:31:39.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:38 smithi122 ceph-mon[22174]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2024-08-28T19:31:39.316 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:38 smithi033 ceph-mon[18549]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2024-08-28T19:31:39.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.406+0000 7fdc4be36640 1 -- 172.21.15.33:0/1174532568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44108af0 msgr2=0x7fdc4410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:39.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.406+0000 7fdc4be36640 1 --2- 172.21.15.33:0/1174532568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44108af0 0x7fdc4410f320 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009ca0 tx=0x7fdc3c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:39.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.406+0000 7fdc4be36640 1 -- 172.21.15.33:0/1174532568 shutdown_connections 2024-08-28T19:31:39.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.406+0000 7fdc4be36640 1 --2- 172.21.15.33:0/1174532568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44108af0 0x7fdc4410f320 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:39.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.406+0000 7fdc4be36640 1 --2- 172.21.15.33:0/1174532568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc441081a0 0x7fdc441085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:39.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.406+0000 7fdc4be36640 1 --2- 172.21.15.33:0/1174532568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc44102f30 0x7fdc44103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.406+0000 7fdc4be36640 1 -- 172.21.15.33:0/1174532568 >> 172.21.15.33:0/1174532568 conn(0x7fdc44079d30 msgr2=0x7fdc4407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.406+0000 7fdc4be36640 1 -- 172.21.15.33:0/1174532568 shutdown_connections 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.406+0000 7fdc4be36640 1 -- 172.21.15.33:0/1174532568 wait complete. 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4be36640 1 Processor -- start 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4be36640 1 -- start start 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4be36640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc44102f30 0x7fdc4419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4be36640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc441081a0 0x7fdc4419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4be36640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44108af0 0x7fdc441a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4be36640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdc44112810 con 0x7fdc44108af0 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4be36640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdc44112690 con 0x7fdc44102f30 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4be36640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdc44112990 con 0x7fdc441081a0 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4a3d3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44108af0 0x7fdc441a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4a3d3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44108af0 0x7fdc441a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45004/0 (socket says 172.21.15.33:45004) 2024-08-28T19:31:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.407+0000 7fdc4a3d3640 1 -- 172.21.15.33:0/4114893391 learned_addr learned my addr 172.21.15.33:0/4114893391 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc49bd2640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc44102f30 0x7fdc4419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc493d1640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc441081a0 0x7fdc4419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc4a3d3640 1 -- 172.21.15.33:0/4114893391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc441081a0 msgr2=0x7fdc4419ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc4a3d3640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc441081a0 0x7fdc4419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc4a3d3640 1 -- 172.21.15.33:0/4114893391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc44102f30 msgr2=0x7fdc4419c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc4a3d3640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc44102f30 0x7fdc4419c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc4a3d3640 1 -- 172.21.15.33:0/4114893391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc441a2440 con 0x7fdc44108af0 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc49bd2640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc44102f30 0x7fdc4419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc4a3d3640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44108af0 0x7fdc441a1d10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c005cc0 tx=0x7fdc3c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc3affd640 1 -- 172.21.15.33:0/4114893391 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c003bf0 con 0x7fdc44108af0 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc4be36640 1 -- 172.21.15.33:0/4114893391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc441a26d0 con 0x7fdc44108af0 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc3affd640 1 -- 172.21.15.33:0/4114893391 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc3c003d90 con 0x7fdc44108af0 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc3affd640 1 -- 172.21.15.33:0/4114893391 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c02fbc0 con 0x7fdc44108af0 2024-08-28T19:31:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.408+0000 7fdc4be36640 1 -- 172.21.15.33:0/4114893391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc441a8e90 con 0x7fdc44108af0 2024-08-28T19:31:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.409+0000 7fdc4be36640 1 -- 172.21.15.33:0/4114893391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc44103cb0 con 0x7fdc44108af0 2024-08-28T19:31:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.411+0000 7fdc3affd640 1 -- 172.21.15.33:0/4114893391 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fdc3c02fd60 con 0x7fdc44108af0 2024-08-28T19:31:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.411+0000 7fdc3affd640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc300b4c10 0x7fdc300b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.412+0000 7fdc49bd2640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc300b4c10 0x7fdc300b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.412+0000 7fdc3affd640 1 -- 172.21.15.33:0/4114893391 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fdc3c106ef0 con 0x7fdc44108af0 2024-08-28T19:31:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.412+0000 7fdc49bd2640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc300b4c10 0x7fdc300b7120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdc40006fd0 tx=0x7fdc40008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.415+0000 7fdc3affd640 1 -- 172.21.15.33:0/4114893391 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdc3c138130 con 0x7fdc44108af0 2024-08-28T19:31:39.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.643+0000 7fdc4be36640 1 -- 172.21.15.33:0/4114893391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc44103340 con 0x7fdc44108af0 2024-08-28T19:31:39.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.643+0000 7fdc3affd640 1 -- 172.21.15.33:0/4114893391 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7fdc44103340 con 0x7fdc44108af0 2024-08-28T19:31:39.645 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:31:39.645 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-08-28T19:30:27:414857+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:30:27.414831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24658,24653,24643,24631,24620]},"id":1}]} 2024-08-28T19:31:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-08-28T19:31:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 -- 172.21.15.33:0/4114893391 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc300b4c10 msgr2=0x7fdc300b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc300b4c10 0x7fdc300b7120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdc40006fd0 tx=0x7fdc40008040 comp rx=0 tx=0).stop 2024-08-28T19:31:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 -- 172.21.15.33:0/4114893391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44108af0 msgr2=0x7fdc441a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44108af0 0x7fdc441a1d10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c005cc0 tx=0x7fdc3c02f380 comp rx=0 tx=0).stop 2024-08-28T19:31:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 -- 172.21.15.33:0/4114893391 shutdown_connections 2024-08-28T19:31:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44108af0 0x7fdc441a1d10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdc300b4c10 0x7fdc300b7120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdc441081a0 0x7fdc4419ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 --2- 172.21.15.33:0/4114893391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc44102f30 0x7fdc4419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 -- 172.21.15.33:0/4114893391 >> 172.21.15.33:0/4114893391 conn(0x7fdc44079d30 msgr2=0x7fdc44106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 -- 172.21.15.33:0/4114893391 shutdown_connections 2024-08-28T19:31:39.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:39.646+0000 7fdc4be36640 1 -- 172.21.15.33:0/4114893391 wait complete. 2024-08-28T19:31:40.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:39 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4114893391' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:31:40.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:39 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4114893391' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:31:40.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:39 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4114893391' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:31:40.646 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:31:40.902 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:41.193 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:40 smithi033 ceph-mon[18549]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-08-28T19:31:41.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:40 smithi059 ceph-mon[22052]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-08-28T19:31:41.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:40 smithi122 ceph-mon[22174]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-08-28T19:31:41.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.415+0000 7fc1ca533640 1 -- 172.21.15.33:0/51347348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c4108140 msgr2=0x7fc1c4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:41.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.415+0000 7fc1ca533640 1 --2- 172.21.15.33:0/51347348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c4108140 0x7fc1c4108550 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009900 tx=0x7fc1ac02a410 comp rx=0 tx=0).stop 2024-08-28T19:31:41.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.415+0000 7fc1ca533640 1 -- 172.21.15.33:0/51347348 shutdown_connections 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.415+0000 7fc1ca533640 1 --2- 172.21.15.33:0/51347348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c4108a90 0x7fc1c410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.415+0000 7fc1ca533640 1 --2- 172.21.15.33:0/51347348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c4108140 0x7fc1c4108550 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.415+0000 7fc1ca533640 1 --2- 172.21.15.33:0/51347348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1c4102800 0x7fc1c4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.415+0000 7fc1ca533640 1 -- 172.21.15.33:0/51347348 >> 172.21.15.33:0/51347348 conn(0x7fc1c40794d0 msgr2=0x7fc1c40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.415+0000 7fc1ca533640 1 -- 172.21.15.33:0/51347348 shutdown_connections 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.415+0000 7fc1ca533640 1 -- 172.21.15.33:0/51347348 wait complete. 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.415+0000 7fc1ca533640 1 Processor -- start 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1ca533640 1 -- start start 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1ca533640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c4102800 0x7fc1c419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1ca533640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c4108140 0x7fc1c419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:41.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1ca533640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1c4108a90 0x7fc1c419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1ca533640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c4113840 con 0x7fc1c4108140 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1ca533640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41136c0 con 0x7fc1c4102800 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1ca533640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41139c0 con 0x7fc1c4108a90 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1bbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c4108140 0x7fc1c419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1bbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c4108140 0x7fc1c419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45022/0 (socket says 172.21.15.33:45022) 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1bbfff640 1 -- 172.21.15.33:0/3594447768 learned_addr learned my addr 172.21.15.33:0/3594447768 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1c8ad0640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1c4108a90 0x7fc1c419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1bbfff640 1 -- 172.21.15.33:0/3594447768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1c4108a90 msgr2=0x7fc1c419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1bbfff640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1c4108a90 0x7fc1c419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1c3fff640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c4102800 0x7fc1c419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:41.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1bbfff640 1 -- 172.21.15.33:0/3594447768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c4102800 msgr2=0x7fc1c419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:41.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1bbfff640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c4102800 0x7fc1c419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:41.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1bbfff640 1 -- 172.21.15.33:0/3594447768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c41a02e0 con 0x7fc1c4108140 2024-08-28T19:31:41.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1c8ad0640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1c4108a90 0x7fc1c419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:41.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.416+0000 7fc1c3fff640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c4102800 0x7fc1c419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:31:41.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.417+0000 7fc1bbfff640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c4108140 0x7fc1c419a910 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac031a90 tx=0x7fc1ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:41.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.417+0000 7fc1c1ffb640 1 -- 172.21.15.33:0/3594447768 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac03f030 con 0x7fc1c4108140 2024-08-28T19:31:41.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.417+0000 7fc1ca533640 1 -- 172.21.15.33:0/3594447768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c41a0570 con 0x7fc1c4108140 2024-08-28T19:31:41.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.417+0000 7fc1c1ffb640 1 -- 172.21.15.33:0/3594447768 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1ac003cb0 con 0x7fc1c4108140 2024-08-28T19:31:41.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.417+0000 7fc1c1ffb640 1 -- 172.21.15.33:0/3594447768 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac035070 con 0x7fc1c4108140 2024-08-28T19:31:41.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.417+0000 7fc1ca533640 1 -- 172.21.15.33:0/3594447768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c41a6d30 con 0x7fc1c4108140 2024-08-28T19:31:41.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.418+0000 7fc1ca533640 1 -- 172.21.15.33:0/3594447768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c4102c10 con 0x7fc1c4108140 2024-08-28T19:31:41.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.420+0000 7fc1c1ffb640 1 -- 172.21.15.33:0/3594447768 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fc1ac042030 con 0x7fc1c4108140 2024-08-28T19:31:41.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.421+0000 7fc1c1ffb640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc1b00b4c10 0x7fc1b00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:41.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.421+0000 7fc1c3fff640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc1b00b4c10 0x7fc1b00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:41.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.421+0000 7fc1c1ffb640 1 -- 172.21.15.33:0/3594447768 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc1ac105ed0 con 0x7fc1c4108140 2024-08-28T19:31:41.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.422+0000 7fc1c3fff640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc1b00b4c10 0x7fc1b00b7120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40058c0 tx=0x7fc1b4005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:41.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.424+0000 7fc1c1ffb640 1 -- 172.21.15.33:0/3594447768 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc1ac0cca30 con 0x7fc1c4108140 2024-08-28T19:31:41.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.647+0000 7fc1ca533640 1 -- 172.21.15.33:0/3594447768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1c410a880 con 0x7fc1c4108140 2024-08-28T19:31:41.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.648+0000 7fc1c1ffb640 1 -- 172.21.15.33:0/3594447768 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7fc1ac0cc330 con 0x7fc1c4108140 2024-08-28T19:31:41.650 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:31:41.650 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-08-28T19:30:27:414857+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:30:27.414831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24658,24653,24643,24631,24620]},"id":1}]} 2024-08-28T19:31:41.651 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-08-28T19:31:41.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 -- 172.21.15.33:0/3594447768 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc1b00b4c10 msgr2=0x7fc1b00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:41.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc1b00b4c10 0x7fc1b00b7120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40058c0 tx=0x7fc1b4005d30 comp rx=0 tx=0).stop 2024-08-28T19:31:41.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 -- 172.21.15.33:0/3594447768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c4108140 msgr2=0x7fc1c419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:41.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c4108140 0x7fc1c419a910 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac031a90 tx=0x7fc1ac004270 comp rx=0 tx=0).stop 2024-08-28T19:31:41.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 -- 172.21.15.33:0/3594447768 shutdown_connections 2024-08-28T19:31:41.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc1b00b4c10 0x7fc1b00b7120 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:41.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc1c4108a90 0x7fc1c419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:41.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c4108140 0x7fc1c419a910 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:41.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 --2- 172.21.15.33:0/3594447768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1c4102800 0x7fc1c419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:41.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 -- 172.21.15.33:0/3594447768 >> 172.21.15.33:0/3594447768 conn(0x7fc1c40794d0 msgr2=0x7fc1c41050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:41.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.650+0000 7fc1ca533640 1 -- 172.21.15.33:0/3594447768 shutdown_connections 2024-08-28T19:31:41.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:41.651+0000 7fc1ca533640 1 -- 172.21.15.33:0/3594447768 wait complete. 2024-08-28T19:31:42.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:41 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3594447768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:31:42.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:41 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3594447768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:31:42.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:41 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3594447768' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:31:42.493 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:31:42.752 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:43.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:42 smithi033 ceph-mon[18549]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2024-08-28T19:31:43.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:42 smithi059 ceph-mon[22052]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2024-08-28T19:31:43.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:42 smithi122 ceph-mon[22174]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.283+0000 7f4cc5115640 1 -- 172.21.15.33:0/721281160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc0108a90 msgr2=0x7f4cc010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.283+0000 7f4cc5115640 1 --2- 172.21.15.33:0/721281160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc0108a90 0x7f4cc010f2c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009ca0 tx=0x7f4cb802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.283+0000 7f4cc5115640 1 -- 172.21.15.33:0/721281160 shutdown_connections 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.283+0000 7f4cc5115640 1 --2- 172.21.15.33:0/721281160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc0108a90 0x7f4cc010f2c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.283+0000 7f4cc5115640 1 --2- 172.21.15.33:0/721281160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cc0108140 0x7f4cc0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.283+0000 7f4cc5115640 1 --2- 172.21.15.33:0/721281160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc0102800 0x7f4cc0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.283+0000 7f4cc5115640 1 -- 172.21.15.33:0/721281160 >> 172.21.15.33:0/721281160 conn(0x7f4cc00794d0 msgr2=0x7f4cc00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.283+0000 7f4cc5115640 1 -- 172.21.15.33:0/721281160 shutdown_connections 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.283+0000 7f4cc5115640 1 -- 172.21.15.33:0/721281160 wait complete. 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.284+0000 7f4cc5115640 1 Processor -- start 2024-08-28T19:31:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.284+0000 7f4cc5115640 1 -- start start 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cc5115640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc0102800 0x7f4cc01990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cc5115640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cc0108140 0x7f4cc0199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cc5115640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc0108a90 0x7f4cc019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cc5115640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc01126f0 con 0x7f4cc0102800 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cc5115640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc0112570 con 0x7f4cc0108a90 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cc5115640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc0112870 con 0x7f4cc0108140 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc0102800 0x7f4cc01990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc0102800 0x7f4cc01990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45036/0 (socket says 172.21.15.33:45036) 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbed9d640 1 -- 172.21.15.33:0/1635041182 learned_addr learned my addr 172.21.15.33:0/1635041182 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbe59c640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cc0108140 0x7f4cc0199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbf59e640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc0108a90 0x7f4cc019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbed9d640 1 -- 172.21.15.33:0/1635041182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cc0108140 msgr2=0x7f4cc0199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbed9d640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cc0108140 0x7f4cc0199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbed9d640 1 -- 172.21.15.33:0/1635041182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc0108a90 msgr2=0x7f4cc019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbed9d640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc0108a90 0x7f4cc019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbed9d640 1 -- 172.21.15.33:0/1635041182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc019f050 con 0x7f4cc0102800 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbf59e640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc0108a90 0x7f4cc019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.285+0000 7f4cbed9d640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc0102800 0x7f4cc01990e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000e9f0 tx=0x7f4cb000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.286+0000 7f4cb7fff640 1 -- 172.21.15.33:0/1635041182 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb000cd80 con 0x7f4cc0102800 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.286+0000 7f4cc5115640 1 -- 172.21.15.33:0/1635041182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc019f340 con 0x7f4cc0102800 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.286+0000 7f4cb7fff640 1 -- 172.21.15.33:0/1635041182 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb00108e0 con 0x7f4cc0102800 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.286+0000 7f4cb7fff640 1 -- 172.21.15.33:0/1635041182 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0018980 con 0x7f4cc0102800 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.286+0000 7f4cc5115640 1 -- 172.21.15.33:0/1635041182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc01a5aa0 con 0x7f4cc0102800 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.287+0000 7f4cc5115640 1 -- 172.21.15.33:0/1635041182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc0102c10 con 0x7f4cc0102800 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.288+0000 7f4cb7fff640 1 -- 172.21.15.33:0/1635041182 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f4cb0010430 con 0x7f4cc0102800 2024-08-28T19:31:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.289+0000 7f4cb7fff640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4cac0b4c10 0x7f4cac0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:43.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.289+0000 7f4cbe59c640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4cac0b4c10 0x7f4cac0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:43.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.289+0000 7f4cb7fff640 1 -- 172.21.15.33:0/1635041182 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4cb00e6110 con 0x7f4cc0102800 2024-08-28T19:31:43.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.290+0000 7f4cbe59c640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4cac0b4c10 0x7f4cac0b7120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8005fd0 tx=0x7f4ca8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:43.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.292+0000 7f4cb7fff640 1 -- 172.21.15.33:0/1635041182 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4cb00acc10 con 0x7f4cc0102800 2024-08-28T19:31:43.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.481+0000 7f4cc5115640 1 -- 172.21.15.33:0/1635041182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cc019a210 con 0x7f4cc0102800 2024-08-28T19:31:43.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.482+0000 7f4cb7fff640 1 -- 172.21.15.33:0/1635041182 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25092 (secure 0 0 0) 0x7f4cb00ac510 con 0x7f4cc0102800 2024-08-28T19:31:43.485 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:31:43.485 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:31:27.886529+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:31:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 -- 172.21.15.33:0/1635041182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4cac0b4c10 msgr2=0x7f4cac0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4cac0b4c10 0x7f4cac0b7120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8005fd0 tx=0x7f4ca8005850 comp rx=0 tx=0).stop 2024-08-28T19:31:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 -- 172.21.15.33:0/1635041182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc0102800 msgr2=0x7f4cc01990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc0102800 0x7f4cc01990e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000e9f0 tx=0x7f4cb000eeb0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 -- 172.21.15.33:0/1635041182 shutdown_connections 2024-08-28T19:31:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cc0108a90 0x7f4cc019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4cac0b4c10 0x7f4cac0b7120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4cc0108140 0x7f4cc0199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 --2- 172.21.15.33:0/1635041182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cc0102800 0x7f4cc01990e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 -- 172.21.15.33:0/1635041182 >> 172.21.15.33:0/1635041182 conn(0x7f4cc00794d0 msgr2=0x7f4cc0104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:43.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 -- 172.21.15.33:0/1635041182 shutdown_connections 2024-08-28T19:31:43.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:43.485+0000 7f4cc5115640 1 -- 172.21.15.33:0/1635041182 wait complete. 2024-08-28T19:31:44.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:43 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1635041182' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:31:44.206 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:31:44.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:43 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1635041182' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:31:44.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:43 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1635041182' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:31:44.463 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.005+0000 7ff049796640 1 -- 172.21.15.33:0/2031834446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff044109240 msgr2=0x7ff044109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.005+0000 7ff049796640 1 --2- 172.21.15.33:0/2031834446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff044109240 0x7ff044109650 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff038009900 tx=0x7ff03802a410 comp rx=0 tx=0).stop 2024-08-28T19:31:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.005+0000 7ff049796640 1 -- 172.21.15.33:0/2031834446 shutdown_connections 2024-08-28T19:31:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.005+0000 7ff049796640 1 --2- 172.21.15.33:0/2031834446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff044109b90 0x7ff0441103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.005+0000 7ff049796640 1 --2- 172.21.15.33:0/2031834446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff044109240 0x7ff044109650 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.005+0000 7ff049796640 1 --2- 172.21.15.33:0/2031834446 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff044103900 0x7ff044103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.005+0000 7ff049796640 1 -- 172.21.15.33:0/2031834446 >> 172.21.15.33:0/2031834446 conn(0x7ff04407b5f0 msgr2=0x7ff04407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.005+0000 7ff049796640 1 -- 172.21.15.33:0/2031834446 shutdown_connections 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.005+0000 7ff049796640 1 -- 172.21.15.33:0/2031834446 wait complete. 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.005+0000 7ff049796640 1 Processor -- start 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff049796640 1 -- start start 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff049796640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff044103900 0x7ff04419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff049796640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff044109240 0x7ff04419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff049796640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff044109b90 0x7ff04419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff049796640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff0441138a0 con 0x7ff044103900 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff049796640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff044113720 con 0x7ff044109b90 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff049796640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff044113a20 con 0x7ff044109240 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff042ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff044103900 0x7ff04419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff042ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff044103900 0x7ff04419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45048/0 (socket says 172.21.15.33:45048) 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff042ffd640 1 -- 172.21.15.33:0/4139402692 learned_addr learned my addr 172.21.15.33:0/4139402692 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff0427fc640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff044109240 0x7ff04419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff0437fe640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff044109b90 0x7ff04419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff042ffd640 1 -- 172.21.15.33:0/4139402692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff044109240 msgr2=0x7ff04419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff042ffd640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff044109240 0x7ff04419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff042ffd640 1 -- 172.21.15.33:0/4139402692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff044109b90 msgr2=0x7ff04419fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff042ffd640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff044109b90 0x7ff04419fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff042ffd640 1 -- 172.21.15.33:0/4139402692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0441a01a0 con 0x7ff044103900 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.006+0000 7ff0437fe640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff044109b90 0x7ff04419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.007+0000 7ff042ffd640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff044103900 0x7ff04419a230 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff03400d770 tx=0x7ff03400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.007+0000 7ff02bfff640 1 -- 172.21.15.33:0/4139402692 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034017070 con 0x7ff044103900 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.007+0000 7ff02bfff640 1 -- 172.21.15.33:0/4139402692 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0340054d0 con 0x7ff044103900 2024-08-28T19:31:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.007+0000 7ff049796640 1 -- 172.21.15.33:0/4139402692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0441a0490 con 0x7ff044103900 2024-08-28T19:31:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.007+0000 7ff02bfff640 1 -- 172.21.15.33:0/4139402692 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034004c30 con 0x7ff044103900 2024-08-28T19:31:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.007+0000 7ff049796640 1 -- 172.21.15.33:0/4139402692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0441a6bf0 con 0x7ff044103900 2024-08-28T19:31:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.008+0000 7ff049796640 1 -- 172.21.15.33:0/4139402692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff044103d10 con 0x7ff044103900 2024-08-28T19:31:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.009+0000 7ff02bfff640 1 -- 172.21.15.33:0/4139402692 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7ff034004e10 con 0x7ff044103900 2024-08-28T19:31:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.010+0000 7ff02bfff640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff02c0b4c10 0x7ff02c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.010+0000 7ff0427fc640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff02c0b4c10 0x7ff02c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.010+0000 7ff02bfff640 1 -- 172.21.15.33:0/4139402692 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff0340e5310 con 0x7ff044103900 2024-08-28T19:31:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.011+0000 7ff0427fc640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff02c0b4c10 0x7ff02c0b7120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff03802aa00 tx=0x7ff038005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.015+0000 7ff02bfff640 1 -- 172.21.15.33:0/4139402692 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff0340abe10 con 0x7ff044103900 2024-08-28T19:31:45.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.237+0000 7ff049796640 1 -- 172.21.15.33:0/4139402692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff04419b360 con 0x7ff044103900 2024-08-28T19:31:45.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.238+0000 7ff02bfff640 1 -- 172.21.15.33:0/4139402692 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7ff0340ab710 con 0x7ff044103900 2024-08-28T19:31:45.240 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:31:45.240 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-08-28T19:30:27:414857+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:30:27.414831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24658,24653,24643,24631,24620]},"id":1}]} 2024-08-28T19:31:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-08-28T19:31:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 -- 172.21.15.33:0/4139402692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff02c0b4c10 msgr2=0x7ff02c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff02c0b4c10 0x7ff02c0b7120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff03802aa00 tx=0x7ff038005a20 comp rx=0 tx=0).stop 2024-08-28T19:31:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 -- 172.21.15.33:0/4139402692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff044103900 msgr2=0x7ff04419a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff044103900 0x7ff04419a230 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff03400d770 tx=0x7ff03400dc30 comp rx=0 tx=0).stop 2024-08-28T19:31:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 -- 172.21.15.33:0/4139402692 shutdown_connections 2024-08-28T19:31:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff044109b90 0x7ff04419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:45.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff02c0b4c10 0x7ff02c0b7120 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:45.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff044109240 0x7ff04419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:45.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 --2- 172.21.15.33:0/4139402692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff044103900 0x7ff04419a230 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:45.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 -- 172.21.15.33:0/4139402692 >> 172.21.15.33:0/4139402692 conn(0x7ff04407b5f0 msgr2=0x7ff0441052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:45.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 -- 172.21.15.33:0/4139402692 shutdown_connections 2024-08-28T19:31:45.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:45.240+0000 7ff049796640 1 -- 172.21.15.33:0/4139402692 wait complete. 2024-08-28T19:31:45.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:45 smithi059 ceph-mon[22052]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-28T19:31:45.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:45 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4139402692' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:31:45.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:45 smithi122 ceph-mon[22174]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-28T19:31:45.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:45 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4139402692' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:31:45.616 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:45 smithi033 ceph-mon[18549]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-28T19:31:45.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:45 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4139402692' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:31:46.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-28T19:29:48.755873+0000', 'modified': '2024-08-28T19:30:27.414831+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24658, 'mds_1': 24653, 'mds_2': 24643, 'mds_3': 24631, 'mds_4': 24620}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14799': {'gid': 14799, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.33:6839/854752752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6838', 'nonce': 854752752}, {'type': 'v1', 'addr': '172.21.15.33:6839', 'nonce': 854752752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14805': {'gid': 14805, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.33:6841/4138539893', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6840', 'nonce': 4138539893}, {'type': 'v1', 'addr': '172.21.15.33:6841', 'nonce': 4138539893}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24572': {'gid': 24572, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6833/1923629681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1923629681}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1923629681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24593': {'gid': 24593, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6835/2308401306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 2308401306}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2308401306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24595': {'gid': 24595, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/2139914522', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 2139914522}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 2139914522}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24620': {'gid': 24620, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.59:6837/4143114753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6836', 'nonce': 4143114753}, {'type': 'v1', 'addr': '172.21.15.59:6837', 'nonce': 4143114753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.122:6835/364668654', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 364668654}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 364668654}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.122:6837/3665976487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 3665976487}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 3665976487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.59:6839/2455612621', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6838', 'nonce': 2455612621}, {'type': 'v1', 'addr': '172.21.15.59:6839', 'nonce': 2455612621}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24658': {'gid': 24658, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.122:6839/2515249026', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 2515249026}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 2515249026}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24658, 'qdb_cluster': [24658, 24653, 24643, 24631, 24620]} 2024-08-28T19:31:46.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-28T19:31:46.048 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-28T19:31:46.306 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:46.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.803+0000 7fc54ce53640 1 -- 172.21.15.33:0/1934810590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc548102880 msgr2=0x7fc548102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:46.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.803+0000 7fc54ce53640 1 --2- 172.21.15.33:0/1934810590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc548102880 0x7fc548102c90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc538009900 tx=0x7fc53802a410 comp rx=0 tx=0).stop 2024-08-28T19:31:46.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.803+0000 7fc54ce53640 1 -- 172.21.15.33:0/1934810590 shutdown_connections 2024-08-28T19:31:46.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.803+0000 7fc54ce53640 1 --2- 172.21.15.33:0/1934810590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc548108b10 0x7fc54810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.803+0000 7fc54ce53640 1 --2- 172.21.15.33:0/1934810590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5481081c0 0x7fc5481085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.803+0000 7fc54ce53640 1 --2- 172.21.15.33:0/1934810590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc548102880 0x7fc548102c90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.803+0000 7fc54ce53640 1 -- 172.21.15.33:0/1934810590 >> 172.21.15.33:0/1934810590 conn(0x7fc548079510 msgr2=0x7fc548079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:46.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.803+0000 7fc54ce53640 1 -- 172.21.15.33:0/1934810590 shutdown_connections 2024-08-28T19:31:46.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.803+0000 7fc54ce53640 1 -- 172.21.15.33:0/1934810590 wait complete. 2024-08-28T19:31:46.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.804+0000 7fc54ce53640 1 Processor -- start 2024-08-28T19:31:46.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.804+0000 7fc54ce53640 1 -- start start 2024-08-28T19:31:46.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54ce53640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc548102880 0x7fc54819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54ce53640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5481081c0 0x7fc54819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54ce53640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc548108b10 0x7fc54819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54ce53640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc5481138f0 con 0x7fc548102880 2024-08-28T19:31:46.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54ce53640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc548113770 con 0x7fc548108b10 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54ce53640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc548113a70 con 0x7fc5481081c0 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc548102880 0x7fc54819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc548102880 0x7fc54819a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45060/0 (socket says 172.21.15.33:45060) 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54659c640 1 -- 172.21.15.33:0/1618141350 learned_addr learned my addr 172.21.15.33:0/1618141350 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc545d9b640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5481081c0 0x7fc54819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc546d9d640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc548108b10 0x7fc54819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54659c640 1 -- 172.21.15.33:0/1618141350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5481081c0 msgr2=0x7fc54819a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54659c640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5481081c0 0x7fc54819a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54659c640 1 -- 172.21.15.33:0/1618141350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc548108b10 msgr2=0x7fc54819fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54659c640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc548108b10 0x7fc54819fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54659c640 1 -- 172.21.15.33:0/1618141350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5481a0270 con 0x7fc548102880 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc546d9d640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc548108b10 0x7fc54819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:31:46.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.805+0000 7fc54659c640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc548102880 0x7fc54819a300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc538005940 tx=0x7fc5380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:46.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.806+0000 7fc5377fe640 1 -- 172.21.15.33:0/1618141350 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53803f030 con 0x7fc548102880 2024-08-28T19:31:46.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.806+0000 7fc5377fe640 1 -- 172.21.15.33:0/1618141350 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc538003cb0 con 0x7fc548102880 2024-08-28T19:31:46.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.806+0000 7fc54ce53640 1 -- 172.21.15.33:0/1618141350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5481a0500 con 0x7fc548102880 2024-08-28T19:31:46.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.806+0000 7fc5377fe640 1 -- 172.21.15.33:0/1618141350 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538035070 con 0x7fc548102880 2024-08-28T19:31:46.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.806+0000 7fc54ce53640 1 -- 172.21.15.33:0/1618141350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5481a6cc0 con 0x7fc548102880 2024-08-28T19:31:46.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.808+0000 7fc5377fe640 1 -- 172.21.15.33:0/1618141350 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fc538042030 con 0x7fc548102880 2024-08-28T19:31:46.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.808+0000 7fc5533c8740 1 Processor -- start 2024-08-28T19:31:46.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc5533c8740 1 -- start start 2024-08-28T19:31:46.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c7859f60 0x5618c7c03bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c78310a0 0x5618c7c04100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7839280 0x5618c7c04640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc5533c8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5618c7b763f0 con 0x5618c78310a0 2024-08-28T19:31:46.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc5533c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5618c7b65980 con 0x5618c7839280 2024-08-28T19:31:46.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc5533c8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5618c7b69930 con 0x5618c7859f60 2024-08-28T19:31:46.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc54659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c78310a0 0x5618c7c04100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc54659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c78310a0 0x5618c7c04100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45064/0 (socket says 172.21.15.33:45064) 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc54659c640 1 -- 172.21.15.33:0/3094265920 learned_addr learned my addr 172.21.15.33:0/3094265920 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc546d9d640 1 --2- 172.21.15.33:0/3094265920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c7859f60 0x5618c7c03bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc545d9b640 1 --2- 172.21.15.33:0/3094265920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7839280 0x5618c7c04640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc54659c640 1 -- 172.21.15.33:0/3094265920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c7859f60 msgr2=0x5618c7c03bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc54659c640 1 --2- 172.21.15.33:0/3094265920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c7859f60 0x5618c7c03bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc54659c640 1 -- 172.21.15.33:0/3094265920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7839280 msgr2=0x5618c7c04640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc54659c640 1 --2- 172.21.15.33:0/3094265920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7839280 0x5618c7c04640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc5377fe640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5300b4c10 0x7fc5300b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.809+0000 7fc54659c640 1 -- 172.21.15.33:0/3094265920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c78c5540 con 0x5618c78310a0 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.810+0000 7fc546d9d640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5300b4c10 0x7fc5300b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.810+0000 7fc54659c640 1 --2- 172.21.15.33:0/3094265920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c78310a0 0x5618c7c04100 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5381034f0 tx=0x7fc5380c8be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e30138253e3d907 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:46.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.810+0000 7fc5377fe640 1 -- 172.21.15.33:0/1618141350 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc538106070 con 0x7fc548102880 2024-08-28T19:31:46.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.810+0000 7fc534ff9640 1 -- 172.21.15.33:0/3094265920 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538049020 con 0x5618c78310a0 2024-08-28T19:31:46.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.810+0000 7fc534ff9640 1 -- 172.21.15.33:0/3094265920 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5380d3530 con 0x5618c78310a0 2024-08-28T19:31:46.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.810+0000 7fc534ff9640 1 -- 172.21.15.33:0/3094265920 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5380cbe20 con 0x5618c78310a0 2024-08-28T19:31:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc5533c8740 1 -- 172.21.15.33:0/3094265920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c78310a0 msgr2=0x5618c7c04100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc546d9d640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5300b4c10 0x7fc5300b7120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc540005fd0 tx=0x7fc540009700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc5533c8740 1 --2- 172.21.15.33:0/3094265920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c78310a0 0x5618c7c04100 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5381034f0 tx=0x7fc5380c8be0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc5533c8740 1 -- 172.21.15.33:0/3094265920 shutdown_connections 2024-08-28T19:31:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc5533c8740 1 --2- 172.21.15.33:0/3094265920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7839280 0x5618c7c04640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc5533c8740 1 --2- 172.21.15.33:0/3094265920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c78310a0 0x5618c7c04100 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc5533c8740 1 --2- 172.21.15.33:0/3094265920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c7859f60 0x5618c7c03bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc5533c8740 1 -- 172.21.15.33:0/3094265920 >> 172.21.15.33:0/3094265920 conn(0x5618c784e350 msgr2=0x5618c7c01ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:46.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc5533c8740 1 -- 172.21.15.33:0/3094265920 shutdown_connections 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc5533c8740 1 -- 172.21.15.33:0/3094265920 wait complete. 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.811+0000 7fc5533c8740 1 -- start start 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc5533c8740 1 Processor -- start 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 0x5618c7c0f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c0f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 0x5618c7c1b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc5533c8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5618c79c85f0 con 0x5618c7839280 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc5533c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5618c7aec600 con 0x5618c7859f60 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc5533c8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5618c7c12160 con 0x5618c78310a0 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc5533c8740 10 client.0 _ll_register_callbacks cb 0x5618c7b12af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc545d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c0f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc545d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c0f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45076/0 (socket says 172.21.15.33:45076) 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc545d9b640 1 -- 172.21.15.33:0/2420326532 learned_addr learned my addr 172.21.15.33:0/2420326532 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:46.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc54659c640 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 0x5618c7c0f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc546d9d640 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 0x5618c7c1b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc545d9b640 1 -- 172.21.15.33:0/2420326532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 msgr2=0x5618c7c0f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc545d9b640 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 0x5618c7c0f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc545d9b640 1 -- 172.21.15.33:0/2420326532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 msgr2=0x5618c7c1b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.812+0000 7fc545d9b640 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 0x5618c7c1b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.813+0000 7fc545d9b640 1 -- 172.21.15.33:0/2420326532 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c7b257b0 con 0x5618c7839280 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.813+0000 7fc545d9b640 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c0f7f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00b990 tx=0x7fc53c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737bddf144627b03 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.813+0000 7fc52dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.813+0000 7fc52dffb640 1 -- 172.21.15.33:0/2420326532 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c005020 con 0x5618c7839280 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.813+0000 7fc52dffb640 1 -- 172.21.15.33:0/2420326532 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc53c0051c0 con 0x5618c7839280 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.813+0000 7fc5533c8740 1 -- 172.21.15.33:0/2420326532 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5618c7b78340 con 0x5618c7839280 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.813+0000 7fc52dffb640 1 -- 172.21.15.33:0/2420326532 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc53c0053c0 con 0x5618c7839280 2024-08-28T19:31:46.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.813+0000 7fc5533c8740 10 client.15276 fetch_fsmap learned FSMap version 27 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.813+0000 7fc5533c8740 1 -- 172.21.15.33:0/2420326532 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5618c7c1de40 con 0x5618c7839280 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.813+0000 7fc52dffb640 1 -- 172.21.15.33:0/2420326532 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5618c7b78340 con 0x5618c7839280 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.814+0000 7fc52dffb640 1 -- 172.21.15.33:0/2420326532 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fc53c01b590 con 0x5618c7839280 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.814+0000 7fc5533c8740 10 client.15276 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.814+0000 7fc5533c8740 10 client.15276 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.814+0000 7fc5533c8740 20 client.15276 populate_metadata read hostname 'smithi033' 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.814+0000 7fc5533c8740 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5618c78188e0 0x5618c7c218f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.814+0000 7fc5533c8740 4 client.15276 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.814+0000 7fc5533c8740 1 -- 172.21.15.33:0/2420326532 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618c7b73de0 con 0x5618c78188e0 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.814+0000 7fc54659c640 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5618c78188e0 0x5618c7c218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.815+0000 7fc54659c640 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5618c78188e0 0x5618c7c218f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=85f65993490e7272 server_cookie=cc21de4fd6909501 in_seq=0 out_seq=0 2024-08-28T19:31:46.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.815+0000 7fc52dffb640 10 client.15276 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:31:46.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.815+0000 7fc52dffb640 1 -- 172.21.15.33:0/2420326532 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618c7b73de0 con 0x5618c78188e0 2024-08-28T19:31:46.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.815+0000 7fc52dffb640 10 client.15276 handle_command_reply: tid=0 2024-08-28T19:31:46.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 client.15276 shutdown 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 -- 172.21.15.33:0/2420326532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 msgr2=0x5618c7c0f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c0f7f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00b990 tx=0x7fc53c00be50 comp rx=0 tx=0).stop 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 -- 172.21.15.33:0/2420326532 shutdown_connections 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5618c78188e0 0x5618c7c218f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 0x5618c7c1b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c0f7f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc52dffb640 0 client.15276 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 --2- 172.21.15.33:0/2420326532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 0x5618c7c0f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 -- 172.21.15.33:0/2420326532 >> 172.21.15.33:0/2420326532 conn(0x5618c784e350 msgr2=0x5618c7c06d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 -- 172.21.15.33:0/2420326532 shutdown_connections 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 1 -- 172.21.15.33:0/2420326532 wait complete. 2024-08-28T19:31:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.816+0000 7fc5533c8740 20 client.15276 trim_cache size 0 max 16384 2024-08-28T19:31:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc5533c8740 1 Processor -- start 2024-08-28T19:31:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc5533c8740 1 -- start start 2024-08-28T19:31:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c78310a0 0x5618c7c1b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c7839280 0x5618c7c1b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7859f60 0x5618c7c0f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc5533c8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5618c7c1fc30 con 0x5618c7859f60 2024-08-28T19:31:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc5533c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5618c7c20300 con 0x5618c78310a0 2024-08-28T19:31:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc5533c8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5618c7c209d0 con 0x5618c7839280 2024-08-28T19:31:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc546d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7859f60 0x5618c7c0f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc546d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7859f60 0x5618c7c0f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45080/0 (socket says 172.21.15.33:45080) 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.834+0000 7fc546d9d640 1 -- 172.21.15.33:0/1540580839 learned_addr learned my addr 172.21.15.33:0/1540580839 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc545d9b640 1 --2- 172.21.15.33:0/1540580839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c7839280 0x5618c7c1b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc54659c640 1 --2- 172.21.15.33:0/1540580839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c78310a0 0x5618c7c1b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc546d9d640 1 -- 172.21.15.33:0/1540580839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c7839280 msgr2=0x5618c7c1b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc546d9d640 1 --2- 172.21.15.33:0/1540580839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c7839280 0x5618c7c1b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc546d9d640 1 -- 172.21.15.33:0/1540580839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c78310a0 msgr2=0x5618c7c1b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc546d9d640 1 --2- 172.21.15.33:0/1540580839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c78310a0 0x5618c7c1b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc546d9d640 1 -- 172.21.15.33:0/1540580839 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c7c119f0 con 0x5618c7859f60 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc546d9d640 1 --2- 172.21.15.33:0/1540580839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7859f60 0x5618c7c0f060 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc5400106c0 tx=0x7fc540015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9136537cc6a69c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc52ffff640 1 -- 172.21.15.33:0/1540580839 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc540010d70 con 0x5618c7859f60 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc52ffff640 1 -- 172.21.15.33:0/1540580839 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc540005020 con 0x5618c7859f60 2024-08-28T19:31:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.835+0000 7fc52ffff640 1 -- 172.21.15.33:0/1540580839 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc540027650 con 0x5618c7859f60 2024-08-28T19:31:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 -- 172.21.15.33:0/1540580839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7859f60 msgr2=0x5618c7c0f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 --2- 172.21.15.33:0/1540580839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7859f60 0x5618c7c0f060 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc5400106c0 tx=0x7fc540015000 comp rx=0 tx=0).stop 2024-08-28T19:31:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 -- 172.21.15.33:0/1540580839 shutdown_connections 2024-08-28T19:31:46.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 --2- 172.21.15.33:0/1540580839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7859f60 0x5618c7c0f060 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 --2- 172.21.15.33:0/1540580839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c7839280 0x5618c7c1b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 --2- 172.21.15.33:0/1540580839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c78310a0 0x5618c7c1b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 -- 172.21.15.33:0/1540580839 >> 172.21.15.33:0/1540580839 conn(0x5618c784e350 msgr2=0x5618c7c0a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 -- 172.21.15.33:0/1540580839 shutdown_connections 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 -- 172.21.15.33:0/1540580839 wait complete. 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 -- start start 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.836+0000 7fc5533c8740 1 Processor -- start 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 0x5618c7c2a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c238a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc5533c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 0x5618c7c23e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc5533c8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5618c7c21770 con 0x5618c7839280 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc5533c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5618c7c210a0 con 0x5618c7859f60 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc5533c8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5618c7c21e40 con 0x5618c78310a0 2024-08-28T19:31:46.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc5533c8740 10 client.0 _ll_register_callbacks cb 0x7fc53c0045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc545d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc545d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c238a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45090/0 (socket says 172.21.15.33:45090) 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc545d9b640 1 -- 172.21.15.33:0/3022687234 learned_addr learned my addr 172.21.15.33:0/3022687234 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc54659c640 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 0x5618c7c2a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc546d9d640 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 0x5618c7c23e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc545d9b640 1 -- 172.21.15.33:0/3022687234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 msgr2=0x5618c7c2a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc545d9b640 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 0x5618c7c2a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc545d9b640 1 -- 172.21.15.33:0/3022687234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 msgr2=0x5618c7c23e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc545d9b640 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 0x5618c7c23e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc545d9b640 1 -- 172.21.15.33:0/3022687234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c7c24590 con 0x5618c7839280 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc546d9d640 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 0x5618c7c23e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc54659c640 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 0x5618c7c2a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:46.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc545d9b640 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c238a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc53c01ba00 tx=0x7fc53c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fab54bd142185e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.837+0000 7fc52dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc52dffb640 1 -- 172.21.15.33:0/3022687234 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c02d070 con 0x5618c7839280 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc52dffb640 1 -- 172.21.15.33:0/3022687234 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc53c005620 con 0x5618c7839280 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc5533c8740 1 -- 172.21.15.33:0/3022687234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc540005020 con 0x5618c7839280 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc52dffb640 1 -- 172.21.15.33:0/3022687234 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc53c039050 con 0x5618c7839280 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc5533c8740 10 client.15282 fetch_fsmap learned FSMap version 27 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc5533c8740 1 -- 172.21.15.33:0/3022687234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5618c7c8cdc0 con 0x5618c7839280 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc52dffb640 1 -- 172.21.15.33:0/3022687234 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc540005020 con 0x5618c7839280 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc52dffb640 1 -- 172.21.15.33:0/3022687234 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fc53c032740 con 0x5618c7839280 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc5533c8740 10 client.15282 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc5533c8740 10 client.15282 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-28T19:31:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc5533c8740 20 client.15282 populate_metadata read hostname 'smithi033' 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc5533c8740 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5618c77edc90 0x5618c7c90610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc5533c8740 4 client.15282 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.838+0000 7fc5533c8740 1 -- 172.21.15.33:0/3022687234 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "status"}) -- 0x5618c7b71520 con 0x5618c77edc90 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc54659c640 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5618c77edc90 0x5618c7c90610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc54659c640 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5618c77edc90 0x5618c7c90610 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=31d18cdd21a88548 server_cookie=b317e4dbff07807d in_seq=0 out_seq=0 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc52dffb640 10 client.15282 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc52dffb640 1 -- 172.21.15.33:0/3022687234 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5618c7b71520 con 0x5618c77edc90 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc52dffb640 10 client.15282 handle_command_reply: tid=0 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc5533c8740 1 client.15282 shutdown 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc5533c8740 1 -- 172.21.15.33:0/3022687234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 msgr2=0x5618c7c238a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc5533c8740 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c238a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc53c01ba00 tx=0x7fc53c004470 comp rx=0 tx=0).stop 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc5533c8740 1 -- 172.21.15.33:0/3022687234 shutdown_connections 2024-08-28T19:31:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc5533c8740 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5618c77edc90 0x5618c7c90610 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc5533c8740 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618c7859f60 0x5618c7c23e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc5533c8740 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5618c7839280 0x5618c7c238a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc5533c8740 1 --2- 172.21.15.33:0/3022687234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5618c78310a0 0x5618c7c2a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc5533c8740 1 -- 172.21.15.33:0/3022687234 >> 172.21.15.33:0/3022687234 conn(0x5618c784e350 msgr2=0x5618c7c0a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.839+0000 7fc52dffb640 0 client.15282 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc5533c8740 1 -- 172.21.15.33:0/3022687234 shutdown_connections 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc5533c8740 1 -- 172.21.15.33:0/3022687234 wait complete. 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc5533c8740 20 client.15282 trim_cache size 0 max 16384 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:31:46.847 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 4, 2024-08-28T19:31:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24620, 2024-08-28T19:31:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:31:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:31:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:31:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 80.437304759, 2024-08-28T19:31:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 27, 2024-08-28T19:31:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:31:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 82, 2024-08-28T19:31:46.848 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 140.37721765200001 2024-08-28T19:31:46.848 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:31:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 -- 172.21.15.33:0/1618141350 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5300b4c10 msgr2=0x7fc5300b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5300b4c10 0x7fc5300b7120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc540005fd0 tx=0x7fc540009700 comp rx=0 tx=0).stop 2024-08-28T19:31:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 -- 172.21.15.33:0/1618141350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc548102880 msgr2=0x7fc54819a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc548102880 0x7fc54819a300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc538005940 tx=0x7fc5380042f0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 -- 172.21.15.33:0/1618141350 shutdown_connections 2024-08-28T19:31:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc548108b10 0x7fc54819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5300b4c10 0x7fc5300b7120 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5481081c0 0x7fc54819a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 --2- 172.21.15.33:0/1618141350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc548102880 0x7fc54819a300 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 -- 172.21.15.33:0/1618141350 >> 172.21.15.33:0/1618141350 conn(0x7fc548079510 msgr2=0x7fc548106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:46.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 -- 172.21.15.33:0/1618141350 shutdown_connections 2024-08-28T19:31:46.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:46.840+0000 7fc54ce53640 1 -- 172.21.15.33:0/1618141350 wait complete. 2024-08-28T19:31:47.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:47 smithi059 ceph-mon[22052]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:31:47.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:47 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:31:47.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:47 smithi122 ceph-mon[22174]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:31:47.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:47 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:31:47.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:47 smithi033 ceph-mon[18549]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:31:47.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:47 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:31:47.759 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.f status 2024-08-28T19:31:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:49.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.188+0000 7fe89fa36640 1 -- 172.21.15.33:0/1755141567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe898109bc0 msgr2=0x7fe8981103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:49.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.188+0000 7fe89fa36640 1 --2- 172.21.15.33:0/1755141567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe898109bc0 0x7fe8981103f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe890009ca0 tx=0x7fe89002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.188+0000 7fe89fa36640 1 -- 172.21.15.33:0/1755141567 shutdown_connections 2024-08-28T19:31:49.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.188+0000 7fe89fa36640 1 --2- 172.21.15.33:0/1755141567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe898109bc0 0x7fe8981103f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.188+0000 7fe89fa36640 1 --2- 172.21.15.33:0/1755141567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe898109270 0x7fe898109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.188+0000 7fe89fa36640 1 --2- 172.21.15.33:0/1755141567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe898103930 0x7fe898103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.188+0000 7fe89fa36640 1 -- 172.21.15.33:0/1755141567 >> 172.21.15.33:0/1755141567 conn(0x7fe8980ff3a0 msgr2=0x7fe8981017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.188+0000 7fe89fa36640 1 -- 172.21.15.33:0/1755141567 shutdown_connections 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.189+0000 7fe89fa36640 1 -- 172.21.15.33:0/1755141567 wait complete. 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.189+0000 7fe89fa36640 1 Processor -- start 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.189+0000 7fe89fa36640 1 -- start start 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.189+0000 7fe89fa36640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe898103930 0x7fe8980754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.189+0000 7fe89fa36640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe898109270 0x7fe8980759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.189+0000 7fe89fa36640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe898109bc0 0x7fe898075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.189+0000 7fe89fa36640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe898113880 con 0x7fe898109bc0 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.189+0000 7fe89fa36640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe898113700 con 0x7fe898103930 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.189+0000 7fe89fa36640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe898113a00 con 0x7fe898109270 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89dfd3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe898109bc0 0x7fe898075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89dfd3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe898109bc0 0x7fe898075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58392/0 (socket says 172.21.15.33:58392) 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89dfd3640 1 -- 172.21.15.33:0/2270783783 learned_addr learned my addr 172.21.15.33:0/2270783783 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe898109270 0x7fe8980759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe898103930 0x7fe8980754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89dfd3640 1 -- 172.21.15.33:0/2270783783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe898109270 msgr2=0x7fe8980759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89dfd3640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe898109270 0x7fe8980759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89dfd3640 1 -- 172.21.15.33:0/2270783783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe898103930 msgr2=0x7fe8980754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89dfd3640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe898103930 0x7fe8980754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89dfd3640 1 -- 172.21.15.33:0/2270783783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8981a84f0 con 0x7fe898109bc0 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe89dfd3640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe898109bc0 0x7fe898075f30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe8900098d0 tx=0x7fe8900317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.190+0000 7fe88a7fc640 1 -- 172.21.15.33:0/2270783783 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890003b70 con 0x7fe898109bc0 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.191+0000 7fe89fa36640 1 -- 172.21.15.33:0/2270783783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8981a8780 con 0x7fe898109bc0 2024-08-28T19:31:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.191+0000 7fe88a7fc640 1 -- 172.21.15.33:0/2270783783 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe890003d10 con 0x7fe898109bc0 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.191+0000 7fe88a7fc640 1 -- 172.21.15.33:0/2270783783 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89002fa20 con 0x7fe898109bc0 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.191+0000 7fe89fa36640 1 -- 172.21.15.33:0/2270783783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8981a8d10 con 0x7fe898109bc0 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.194+0000 7fe8a5fab740 1 Processor -- start 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.194+0000 7fe88a7fc640 1 -- 172.21.15.33:0/2270783783 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fe89002fc00 con 0x7fe898109bc0 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.194+0000 7fe8a5fab740 1 -- start start 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 0x56273e9d77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e6090a0 0x56273e9d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e611280 0x56273e9d8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56273e94e3f0 con 0x56273e6090a0 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56273e93d980 con 0x56273e611280 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56273e941930 con 0x56273e631f60 2024-08-28T19:31:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89d7d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e6090a0 0x56273e9d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89d7d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e6090a0 0x56273e9d7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58408/0 (socket says 172.21.15.33:58408) 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89d7d2640 1 -- 172.21.15.33:0/2143498824 learned_addr learned my addr 172.21.15.33:0/2143498824 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/2143498824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 0x56273e9d77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/2143498824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e611280 0x56273e9d8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89d7d2640 1 -- 172.21.15.33:0/2143498824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 msgr2=0x56273e9d77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/2143498824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 0x56273e9d77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89d7d2640 1 -- 172.21.15.33:0/2143498824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e611280 msgr2=0x56273e9d8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/2143498824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e611280 0x56273e9d8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89d7d2640 1 -- 172.21.15.33:0/2143498824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273e69d540 con 0x56273e6090a0 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/2143498824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 0x56273e9d77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/2143498824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e6090a0 0x56273e9d7cf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe88c004650 tx=0x7fe88c00bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d1d998fb028a49 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.195+0000 7fe88a7fc640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8840b4c10 0x7fe8840b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.196+0000 7fe8837fe640 1 -- 172.21.15.33:0/2143498824 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c003bd0 con 0x56273e6090a0 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.196+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8840b4c10 0x7fe8840b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.196+0000 7fe8837fe640 1 -- 172.21.15.33:0/2143498824 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe88c015070 con 0x56273e6090a0 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.196+0000 7fe88a7fc640 1 -- 172.21.15.33:0/2270783783 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe890106bf0 con 0x7fe898109bc0 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.196+0000 7fe8837fe640 1 -- 172.21.15.33:0/2143498824 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c004d80 con 0x56273e6090a0 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2143498824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e6090a0 msgr2=0x56273e9d7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8840b4c10 0x7fe8840b7120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe898102c50 tx=0x7fe8940046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/2143498824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e6090a0 0x56273e9d7cf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe88c004650 tx=0x7fe88c00bba0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2143498824 shutdown_connections 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/2143498824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e611280 0x56273e9d8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/2143498824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e6090a0 0x56273e9d7cf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/2143498824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 0x56273e9d77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2143498824 >> 172.21.15.33:0/2143498824 conn(0x56273e626350 msgr2=0x56273e9d56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2143498824 shutdown_connections 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2143498824 wait complete. 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 -- start start 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.197+0000 7fe8a5fab740 1 Processor -- start 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e6090a0 0x56273e9e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9e3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 0x56273e9e3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56273e7a05f0 con 0x56273e611280 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56273e8c4600 con 0x56273e6090a0 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56273e9e6030 con 0x56273e631f60 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe8a5fab740 10 client.0 _ll_register_callbacks cb 0x56273e8eaaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89cfd1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89cfd1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9e3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58424/0 (socket says 172.21.15.33:58424) 2024-08-28T19:31:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89cfd1640 1 -- 172.21.15.33:0/523894885 learned_addr learned my addr 172.21.15.33:0/523894885 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e6090a0 0x56273e9e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89dfd3640 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 0x56273e9e3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89cfd1640 1 -- 172.21.15.33:0/523894885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 msgr2=0x56273e9e3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 0x56273e9e3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89cfd1640 1 -- 172.21.15.33:0/523894885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e6090a0 msgr2=0x56273e9e2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e6090a0 0x56273e9e2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89cfd1640 1 -- 172.21.15.33:0/523894885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273e8fd7b0 con 0x56273e611280 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.198+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e6090a0 0x56273e9e2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9e3300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe894009fd0 tx=0x7fe894005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320b385d35169883 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe880ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe880ff9640 1 -- 172.21.15.33:0/523894885 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89402e060 con 0x56273e611280 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe880ff9640 1 -- 172.21.15.33:0/523894885 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe89401fc60 con 0x56273e611280 2024-08-28T19:31:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe8a5fab740 1 -- 172.21.15.33:0/523894885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe88c015070 con 0x56273e611280 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe880ff9640 1 -- 172.21.15.33:0/523894885 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe894035050 con 0x56273e611280 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe8a5fab740 10 client.15294 fetch_fsmap learned FSMap version 27 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe8a5fab740 1 -- 172.21.15.33:0/523894885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56273e9f1d10 con 0x56273e611280 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe880ff9640 1 -- 172.21.15.33:0/523894885 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe88c015070 con 0x56273e611280 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe880ff9640 1 -- 172.21.15.33:0/523894885 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fe8940283b0 con 0x56273e611280 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.199+0000 7fe8a5fab740 10 client.15294 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.200+0000 7fe8a5fab740 10 client.15294 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.200+0000 7fe8a5fab740 20 client.15294 populate_metadata read hostname 'smithi033' 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.200+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56273e5f08e0 0x56273e9f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.200+0000 7fe8a5fab740 4 client.15294 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.200+0000 7fe8a5fab740 1 -- 172.21.15.33:0/523894885 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56273e950340 con 0x56273e5f08e0 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.200+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56273e5f08e0 0x56273e9f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.200+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56273e5f08e0 0x56273e9f57b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6fd6d759444ec756 server_cookie=988674ffe4bf39ff in_seq=0 out_seq=0 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.200+0000 7fe880ff9640 10 client.15294 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe880ff9640 1 -- 172.21.15.33:0/523894885 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56273e950340 con 0x56273e5f08e0 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe880ff9640 10 client.15294 handle_command_reply: tid=0 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 client.15294 shutdown 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 -- 172.21.15.33:0/523894885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 msgr2=0x56273e9e3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9e3300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe894009fd0 tx=0x7fe894005f90 comp rx=0 tx=0).stop 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 -- 172.21.15.33:0/523894885 shutdown_connections 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56273e5f08e0 0x56273e9f57b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe880ff9640 0 client.15294 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e631f60 0x56273e9e3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9e3300 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/523894885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e6090a0 0x56273e9e2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 -- 172.21.15.33:0/523894885 >> 172.21.15.33:0/523894885 conn(0x56273e626350 msgr2=0x56273e9d91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 -- 172.21.15.33:0/523894885 shutdown_connections 2024-08-28T19:31:49.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.201+0000 7fe8a5fab740 1 -- 172.21.15.33:0/523894885 wait complete. 2024-08-28T19:31:49.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.202+0000 7fe8a5fab740 20 client.15294 trim_cache size 0 max 16384 2024-08-28T19:31:49.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe8a5fab740 1 Processor -- start 2024-08-28T19:31:49.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe8a5fab740 1 -- start start 2024-08-28T19:31:49.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e5f08e0 0x56273e9dc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 0x56273e9f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9ddf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56273e9f3af0 con 0x56273e611280 2024-08-28T19:31:49.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56273e9f41c0 con 0x56273e5f08e0 2024-08-28T19:31:49.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56273e9f4890 con 0x56273e6090a0 2024-08-28T19:31:49.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe89dfd3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9ddf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe89dfd3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9ddf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58436/0 (socket says 172.21.15.33:58436) 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe89dfd3640 1 -- 172.21.15.33:0/4006225755 learned_addr learned my addr 172.21.15.33:0/4006225755 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.227+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/4006225755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 0x56273e9f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.228+0000 7fe89dfd3640 1 -- 172.21.15.33:0/4006225755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 msgr2=0x56273e9f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.228+0000 7fe89dfd3640 1 --2- 172.21.15.33:0/4006225755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 0x56273e9f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.228+0000 7fe89dfd3640 1 -- 172.21.15.33:0/4006225755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e5f08e0 msgr2=0x56273e9dc8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.228+0000 7fe89dfd3640 1 --2- 172.21.15.33:0/4006225755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e5f08e0 0x56273e9dc8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.228+0000 7fe89dfd3640 1 -- 172.21.15.33:0/4006225755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273e9e12c0 con 0x56273e611280 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.228+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/4006225755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 0x56273e9f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.228+0000 7fe89dfd3640 1 --2- 172.21.15.33:0/4006225755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9ddf00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe890104160 tx=0x7fe8900cca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c32dd476df154cf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.228+0000 7fe882ffd640 1 -- 172.21.15.33:0/4006225755 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900cd050 con 0x56273e611280 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.228+0000 7fe882ffd640 1 -- 172.21.15.33:0/4006225755 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe890036030 con 0x56273e611280 2024-08-28T19:31:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.228+0000 7fe882ffd640 1 -- 172.21.15.33:0/4006225755 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900d5ee0 con 0x56273e611280 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.229+0000 7fe8a5fab740 1 -- 172.21.15.33:0/4006225755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 msgr2=0x56273e9ddf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.229+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/4006225755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9ddf00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe890104160 tx=0x7fe8900cca60 comp rx=0 tx=0).stop 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.229+0000 7fe8a5fab740 1 -- 172.21.15.33:0/4006225755 shutdown_connections 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.229+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/4006225755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e611280 0x56273e9ddf00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.229+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/4006225755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 0x56273e9f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.229+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/4006225755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e5f08e0 0x56273e9dc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.229+0000 7fe8a5fab740 1 -- 172.21.15.33:0/4006225755 >> 172.21.15.33:0/4006225755 conn(0x56273e626350 msgr2=0x56273e9d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.229+0000 7fe8a5fab740 1 -- 172.21.15.33:0/4006225755 shutdown_connections 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.229+0000 7fe8a5fab740 1 -- 172.21.15.33:0/4006225755 wait complete. 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.230+0000 7fe8a5fab740 1 -- start start 2024-08-28T19:31:49.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.230+0000 7fe8a5fab740 1 Processor -- start 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.230+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e5f08e0 0x56273e9f8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.230+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 0x56273e9f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.230+0000 7fe8a5fab740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e611280 0x56273e9f9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.230+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56273e9f5630 con 0x56273e5f08e0 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.230+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56273e9f4f60 con 0x56273e611280 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.230+0000 7fe8a5fab740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56273e9f5d00 con 0x56273e6090a0 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.230+0000 7fe8a5fab740 10 client.0 _ll_register_callbacks cb 0x7fe8940218e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89d7d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e5f08e0 0x56273e9f8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89cfd1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 0x56273e9f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89d7d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e5f08e0 0x56273e9f8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58442/0 (socket says 172.21.15.33:58442) 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89d7d2640 1 -- 172.21.15.33:0/2798450580 learned_addr learned my addr 172.21.15.33:0/2798450580 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:49.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89dfd3640 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e611280 0x56273e9f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89cfd1640 1 -- 172.21.15.33:0/2798450580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e611280 msgr2=0x56273e9f9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e611280 0x56273e9f9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89cfd1640 1 -- 172.21.15.33:0/2798450580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e5f08e0 msgr2=0x56273e9f8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e5f08e0 0x56273e9f8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89cfd1640 1 -- 172.21.15.33:0/2798450580 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273ea5edd0 con 0x56273e6090a0 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e5f08e0 0x56273e9f8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe89cfd1640 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 0x56273e9f90c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe8940096d0 tx=0x7fe89401f7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df81a039f0797484 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe880ff9640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.231+0000 7fe880ff9640 1 -- 172.21.15.33:0/2798450580 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89401fe60 con 0x56273e6090a0 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe880ff9640 1 -- 172.21.15.33:0/2798450580 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe894005040 con 0x56273e6090a0 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2798450580 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe890036030 con 0x56273e6090a0 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe880ff9640 1 -- 172.21.15.33:0/2798450580 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe894028570 con 0x56273e6090a0 2024-08-28T19:31:49.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe8a5fab740 10 client.25030 fetch_fsmap learned FSMap version 27 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2798450580 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56273ea60030 con 0x56273e6090a0 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe880ff9640 1 -- 172.21.15.33:0/2798450580 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe890036030 con 0x56273e6090a0 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe880ff9640 1 -- 172.21.15.33:0/2798450580 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fe894004be0 con 0x56273e6090a0 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe8a5fab740 10 client.25030 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe8a5fab740 10 client.25030 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe8a5fab740 20 client.25030 populate_metadata read hostname 'smithi033' 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56273e631f60 0x56273ea63950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe8a5fab740 4 client.25030 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.232+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2798450580 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "status"}) -- 0x56273e94bde0 con 0x56273e631f60 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.233+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56273e631f60 0x56273ea63950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.233+0000 7fe880ff9640 10 client.25030 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:31:49.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.233+0000 7fe89d7d2640 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56273e631f60 0x56273ea63950 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7e19436b60d04fd server_cookie=c957bfe71a940cca in_seq=0 out_seq=0 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.233+0000 7fe880ff9640 1 -- 172.21.15.33:0/2798450580 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56273e94bde0 con 0x56273e631f60 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.233+0000 7fe880ff9640 10 client.25030 handle_command_reply: tid=0 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.233+0000 7fe8a5fab740 1 client.25030 shutdown 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2798450580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 msgr2=0x56273e9f90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 0x56273e9f90c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe8940096d0 tx=0x7fe89401f7a0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2798450580 shutdown_connections 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56273e631f60 0x56273ea63950 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56273e611280 0x56273e9f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56273e6090a0 0x56273e9f90c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 1 --2- 172.21.15.33:0/2798450580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56273e5f08e0 0x56273e9f8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2798450580 >> 172.21.15.33:0/2798450580 conn(0x56273e626350 msgr2=0x56273e9ddf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe880ff9640 0 client.25030 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:31:49.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2798450580 shutdown_connections 2024-08-28T19:31:49.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 1 -- 172.21.15.33:0/2798450580 wait complete. 2024-08-28T19:31:49.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.234+0000 7fe8a5fab740 20 client.25030 trim_cache size 0 max 16384 2024-08-28T19:31:49.241 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:31:49.241 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:31:49.241 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 3, 2024-08-28T19:31:49.241 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24631, 2024-08-28T19:31:49.241 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:31:49.241 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:31:49.241 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:31:49.241 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 83.845435252000001, 2024-08-28T19:31:49.242 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 27, 2024-08-28T19:31:49.242 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:31:49.242 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 82, 2024-08-28T19:31:49.242 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 147.996130325 2024-08-28T19:31:49.242 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:31:49.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 -- 172.21.15.33:0/2270783783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8840b4c10 msgr2=0x7fe8840b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8840b4c10 0x7fe8840b7120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe898102c50 tx=0x7fe8940046c0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 -- 172.21.15.33:0/2270783783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe898109bc0 msgr2=0x7fe898075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe898109bc0 0x7fe898075f30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe8900098d0 tx=0x7fe8900317b0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 -- 172.21.15.33:0/2270783783 shutdown_connections 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe898109bc0 0x7fe898075f30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8840b4c10 0x7fe8840b7120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe898109270 0x7fe8980759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 --2- 172.21.15.33:0/2270783783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe898103930 0x7fe8980754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 -- 172.21.15.33:0/2270783783 >> 172.21.15.33:0/2270783783 conn(0x7fe8980ff3a0 msgr2=0x7fe898108880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 -- 172.21.15.33:0/2270783783 shutdown_connections 2024-08-28T19:31:49.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:49.235+0000 7fe89fa36640 1 -- 172.21.15.33:0/2270783783 wait complete. 2024-08-28T19:31:49.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:49 smithi033 ceph-mon[18549]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:31:49.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:49 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:49 smithi059 ceph-mon[22052]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:31:49.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:49 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:49 smithi122 ceph-mon[22174]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:31:49.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:49.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:49 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:50.063 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-28T19:31:50.344 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.876+0000 7f840d693640 1 -- 172.21.15.33:0/3939076013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8408108b10 msgr2=0x7f840810f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.876+0000 7f840d693640 1 --2- 172.21.15.33:0/3939076013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8408108b10 0x7f840810f340 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8400009ca0 tx=0x7f840002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.876+0000 7f840d693640 1 -- 172.21.15.33:0/3939076013 shutdown_connections 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.876+0000 7f840d693640 1 --2- 172.21.15.33:0/3939076013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8408108b10 0x7f840810f340 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.876+0000 7f840d693640 1 --2- 172.21.15.33:0/3939076013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84081081c0 0x7f84081085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.876+0000 7f840d693640 1 --2- 172.21.15.33:0/3939076013 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8408102880 0x7f8408102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.876+0000 7f840d693640 1 -- 172.21.15.33:0/3939076013 >> 172.21.15.33:0/3939076013 conn(0x7f8408079510 msgr2=0x7f8408079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.876+0000 7f840d693640 1 -- 172.21.15.33:0/3939076013 shutdown_connections 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.876+0000 7f840d693640 1 -- 172.21.15.33:0/3939076013 wait complete. 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.876+0000 7f840d693640 1 Processor -- start 2024-08-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f840d693640 1 -- start start 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f840d693640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8408102880 0x7f840810fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f840d693640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84081081c0 0x7f8408110360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f840d693640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8408108b10 0x7f84081108a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f840d693640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f84081138f0 con 0x7f84081081c0 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f840d693640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8408113770 con 0x7f8408102880 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f840d693640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8408113a70 con 0x7f8408108b10 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f84067fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84081081c0 0x7f8408110360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f84067fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84081081c0 0x7f8408110360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58464/0 (socket says 172.21.15.33:58464) 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f84067fc640 1 -- 172.21.15.33:0/1330392020 learned_addr learned my addr 172.21.15.33:0/1330392020 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f8406ffd640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8408102880 0x7f840810fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.877+0000 7f84077fe640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8408108b10 0x7f84081108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f84067fc640 1 -- 172.21.15.33:0/1330392020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8408108b10 msgr2=0x7f84081108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f84067fc640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8408108b10 0x7f84081108a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f84067fc640 1 -- 172.21.15.33:0/1330392020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8408102880 msgr2=0x7f840810fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f84067fc640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8408102880 0x7f840810fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f84067fc640 1 -- 172.21.15.33:0/1330392020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84081a8520 con 0x7f84081081c0 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f84067fc640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84081081c0 0x7f8408110360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00d740 tx=0x7f83fc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f83effff640 1 -- 172.21.15.33:0/1330392020 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc017070 con 0x7f84081081c0 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f83effff640 1 -- 172.21.15.33:0/1330392020 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83fc00de50 con 0x7f84081081c0 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f840d693640 1 -- 172.21.15.33:0/1330392020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84081a8810 con 0x7f84081081c0 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f83effff640 1 -- 172.21.15.33:0/1330392020 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00f620 con 0x7f84081081c0 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.878+0000 7f840d693640 1 -- 172.21.15.33:0/1330392020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84081a8d50 con 0x7f84081081c0 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f8413c08740 1 Processor -- start 2024-08-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f8413c08740 1 -- start start 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f83effff640 1 -- 172.21.15.33:0/1330392020 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f83fc01a070 con 0x7f84081081c0 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f8413c08740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 0x55df2b0b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f8413c08740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acea0a0 0x55df2b0b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f8413c08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f8413c08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55df2b02f3f0 con 0x55df2acf2280 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f8413c08740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55df2b01e980 con 0x55df2ad12f60 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f8413c08740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55df2b022930 con 0x55df2acea0a0 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f84067fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f84067fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58470/0 (socket says 172.21.15.33:58470) 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acea0a0 0x55df2b0b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.881+0000 7f84067fc640 1 -- 172.21.15.33:0/356924930 learned_addr learned my addr 172.21.15.33:0/356924930 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f84077fe640 1 --2- 172.21.15.33:0/356924930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 0x55df2b0b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f8406ffd640 1 -- 172.21.15.33:0/356924930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 msgr2=0x55df2b0b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f8406ffd640 1 --2- 172.21.15.33:0/356924930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 0x55df2b0b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f8406ffd640 1 -- 172.21.15.33:0/356924930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 msgr2=0x55df2b0b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f8406ffd640 1 --2- 172.21.15.33:0/356924930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f83effff640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83f00b4c10 0x7f83f00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f8406ffd640 1 -- 172.21.15.33:0/356924930 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df2ad7e540 con 0x55df2acea0a0 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f84067fc640 1 --2- 172.21.15.33:0/356924930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f84077fe640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83f00b4c10 0x7f83f00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f83effff640 1 -- 172.21.15.33:0/1330392020 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f83fc0e5130 con 0x7f84081081c0 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f8406ffd640 1 --2- 172.21.15.33:0/356924930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acea0a0 0x55df2b0b8cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83f8005fd0 tx=0x7f83f800bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11362416ae1e454f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f83ed7fa640 1 -- 172.21.15.33:0/356924930 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8003bd0 con 0x55df2acea0a0 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f83ed7fa640 1 -- 172.21.15.33:0/356924930 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83f8015070 con 0x55df2acea0a0 2024-08-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.882+0000 7f83ed7fa640 1 -- 172.21.15.33:0/356924930 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8004d60 con 0x55df2acea0a0 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.883+0000 7f8413c08740 1 -- 172.21.15.33:0/356924930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acea0a0 msgr2=0x55df2b0b8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.883+0000 7f84077fe640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83f00b4c10 0x7f83f00b7120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f840002f500 tx=0x7f840002f370 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.883+0000 7f8413c08740 1 --2- 172.21.15.33:0/356924930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acea0a0 0x55df2b0b8cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83f8005fd0 tx=0x7f83f800bb20 comp rx=0 tx=0).stop 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.883+0000 7f8413c08740 1 -- 172.21.15.33:0/356924930 shutdown_connections 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.883+0000 7f8413c08740 1 --2- 172.21.15.33:0/356924930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.883+0000 7f8413c08740 1 --2- 172.21.15.33:0/356924930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acea0a0 0x55df2b0b8cf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.883+0000 7f8413c08740 1 --2- 172.21.15.33:0/356924930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 0x55df2b0b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.883+0000 7f8413c08740 1 -- 172.21.15.33:0/356924930 >> 172.21.15.33:0/356924930 conn(0x55df2ad07350 msgr2=0x55df2b0b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.883+0000 7f8413c08740 1 -- 172.21.15.33:0/356924930 shutdown_connections 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.883+0000 7f8413c08740 1 -- 172.21.15.33:0/356924930 wait complete. 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f8413c08740 1 -- start start 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f8413c08740 1 Processor -- start 2024-08-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f8413c08740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2acea0a0 0x55df2b0c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f8413c08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f8413c08740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2ad12f60 0x55df2b0d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f8413c08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55df2ae815f0 con 0x55df2acf2280 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f8413c08740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55df2afa5600 con 0x55df2acea0a0 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f8413c08740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55df2b0c6f90 con 0x55df2ad12f60 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f8413c08740 10 client.0 _ll_register_callbacks cb 0x55df2afcbaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f84067fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f84067fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58478/0 (socket says 172.21.15.33:58478) 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f84067fc640 1 -- 172.21.15.33:0/4196318499 learned_addr learned my addr 172.21.15.33:0/4196318499 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.884+0000 7f84077fe640 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2ad12f60 0x55df2b0d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f8406ffd640 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2acea0a0 0x55df2b0c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f84067fc640 1 -- 172.21.15.33:0/4196318499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2ad12f60 msgr2=0x55df2b0d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f84067fc640 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2ad12f60 0x55df2b0d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f84067fc640 1 -- 172.21.15.33:0/4196318499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2acea0a0 msgr2=0x55df2b0c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f84067fc640 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2acea0a0 0x55df2b0c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f84067fc640 1 -- 172.21.15.33:0/4196318499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df2afde7b0 con 0x55df2acf2280 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f84067fc640 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0c43d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0e2bf0 tx=0x7f83fc010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7746e7cfc3a446 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f83eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f83eaff5640 1 -- 172.21.15.33:0/4196318499 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc021030 con 0x55df2acf2280 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f83eaff5640 1 -- 172.21.15.33:0/4196318499 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f83fc0e8d90 con 0x55df2acf2280 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f8413c08740 1 -- 172.21.15.33:0/4196318499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83f8015070 con 0x55df2acf2280 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f83eaff5640 1 -- 172.21.15.33:0/4196318499 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f83fc0ab410 con 0x55df2acf2280 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f8413c08740 10 client.15312 fetch_fsmap learned FSMap version 27 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f8413c08740 1 -- 172.21.15.33:0/4196318499 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55df2b0d2d20 con 0x55df2acf2280 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f83eaff5640 1 -- 172.21.15.33:0/4196318499 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83f8015070 con 0x55df2acf2280 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.885+0000 7f83eaff5640 1 -- 172.21.15.33:0/4196318499 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f83fc0ce0e0 con 0x55df2acf2280 2024-08-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.886+0000 7f8413c08740 10 client.15312 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.886+0000 7f8413c08740 10 client.15312 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.886+0000 7f8413c08740 20 client.15312 populate_metadata read hostname 'smithi033' 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.886+0000 7f8413c08740 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55df2acd18e0 0x55df2b0d6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.886+0000 7f8413c08740 4 client.15312 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.886+0000 7f8413c08740 1 -- 172.21.15.33:0/4196318499 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df2b031340 con 0x55df2acd18e0 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.886+0000 7f8406ffd640 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55df2acd18e0 0x55df2b0d6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.886+0000 7f83eaff5640 10 client.15312 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.886+0000 7f8406ffd640 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55df2acd18e0 0x55df2b0d6750 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=709659327b1c5bd4 server_cookie=d1c6b9f3549cc28e in_seq=0 out_seq=0 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f83eaff5640 1 -- 172.21.15.33:0/4196318499 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df2b031340 con 0x55df2acd18e0 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f83eaff5640 10 client.15312 handle_command_reply: tid=0 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 client.15312 shutdown 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 -- 172.21.15.33:0/4196318499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 msgr2=0x55df2b0c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0c43d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0e2bf0 tx=0x7f83fc010c70 comp rx=0 tx=0).stop 2024-08-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 -- 172.21.15.33:0/4196318499 shutdown_connections 2024-08-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2ad12f60 0x55df2b0d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55df2acd18e0 0x55df2b0d6750 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0c43d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f83eaff5640 0 client.15312 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 --2- 172.21.15.33:0/4196318499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2acea0a0 0x55df2b0c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 -- 172.21.15.33:0/4196318499 >> 172.21.15.33:0/4196318499 conn(0x55df2ad07350 msgr2=0x55df2b0bb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 -- 172.21.15.33:0/4196318499 shutdown_connections 2024-08-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.887+0000 7f8413c08740 1 -- 172.21.15.33:0/4196318499 wait complete. 2024-08-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.888+0000 7f8413c08740 20 client.15312 trim_cache size 0 max 16384 2024-08-28T19:31:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.907+0000 7f8413c08740 1 Processor -- start 2024-08-28T19:31:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.907+0000 7f8413c08740 1 -- start start 2024-08-28T19:31:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f8413c08740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2acea0a0 0x55df2b0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f8413c08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f8413c08740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2ad12f60 0x55df2b0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f8413c08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55df2b0d4a90 con 0x55df2acf2280 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f8413c08740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55df2b0d5160 con 0x55df2acea0a0 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f8413c08740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55df2b0d5830 con 0x55df2ad12f60 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f84067fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f84067fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58482/0 (socket says 172.21.15.33:58482) 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f84067fc640 1 -- 172.21.15.33:0/2487247072 learned_addr learned my addr 172.21.15.33:0/2487247072 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f84077fe640 1 --2- 172.21.15.33:0/2487247072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2ad12f60 0x55df2b0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f8406ffd640 1 --2- 172.21.15.33:0/2487247072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2acea0a0 0x55df2b0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f84067fc640 1 -- 172.21.15.33:0/2487247072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2ad12f60 msgr2=0x55df2b0b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f84067fc640 1 --2- 172.21.15.33:0/2487247072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2ad12f60 0x55df2b0b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f84067fc640 1 -- 172.21.15.33:0/2487247072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2acea0a0 msgr2=0x55df2b0d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f84067fc640 1 --2- 172.21.15.33:0/2487247072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2acea0a0 0x55df2b0d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f84067fc640 1 -- 172.21.15.33:0/2487247072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df2b0c2390 con 0x55df2acf2280 2024-08-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f84067fc640 1 --2- 172.21.15.33:0/2487247072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b5cf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0ab5d0 tx=0x7f83fc0a7ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a527852cf8821d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.908+0000 7f83ecff9640 1 -- 172.21.15.33:0/2487247072 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc021030 con 0x55df2acf2280 2024-08-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f83ecff9640 1 -- 172.21.15.33:0/2487247072 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83fc0b4040 con 0x55df2acf2280 2024-08-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f83ecff9640 1 -- 172.21.15.33:0/2487247072 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0aadb0 con 0x55df2acf2280 2024-08-28T19:31:50.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f8413c08740 1 -- 172.21.15.33:0/2487247072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 msgr2=0x55df2b0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:50.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f8413c08740 1 --2- 172.21.15.33:0/2487247072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b5cf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f83fc0ab5d0 tx=0x7f83fc0a7ae0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f8413c08740 1 -- 172.21.15.33:0/2487247072 shutdown_connections 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f8413c08740 1 --2- 172.21.15.33:0/2487247072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2ad12f60 0x55df2b0b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f8413c08740 1 --2- 172.21.15.33:0/2487247072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acf2280 0x55df2b0b5cf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f8413c08740 1 --2- 172.21.15.33:0/2487247072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2acea0a0 0x55df2b0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f8413c08740 1 -- 172.21.15.33:0/2487247072 >> 172.21.15.33:0/2487247072 conn(0x55df2ad07350 msgr2=0x55df2b0c2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f8413c08740 1 -- 172.21.15.33:0/2487247072 shutdown_connections 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.909+0000 7f8413c08740 1 -- 172.21.15.33:0/2487247072 wait complete. 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8413c08740 1 -- start start 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8413c08740 1 Processor -- start 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8413c08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acea0a0 0x55df2b0dee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8413c08740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acf2280 0x55df2b0df410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8413c08740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 0x55df2b0d84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8413c08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55df2b0d65d0 con 0x55df2acea0a0 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8413c08740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55df2b0d5f00 con 0x55df2ad12f60 2024-08-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8413c08740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55df2b0d6ca0 con 0x55df2acf2280 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8413c08740 10 client.0 _ll_register_callbacks cb 0x7f83fc009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acea0a0 0x55df2b0dee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acea0a0 0x55df2b0dee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58490/0 (socket says 172.21.15.33:58490) 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f8406ffd640 1 -- 172.21.15.33:0/1516128531 learned_addr learned my addr 172.21.15.33:0/1516128531 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.910+0000 7f84067fc640 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acf2280 0x55df2b0df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f84077fe640 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 0x55df2b0d84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f8406ffd640 1 -- 172.21.15.33:0/1516128531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acf2280 msgr2=0x55df2b0df410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f8406ffd640 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acf2280 0x55df2b0df410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f8406ffd640 1 -- 172.21.15.33:0/1516128531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 msgr2=0x55df2b0d84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f8406ffd640 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 0x55df2b0d84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f8406ffd640 1 -- 172.21.15.33:0/1516128531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df2b0d8c50 con 0x55df2acea0a0 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f84077fe640 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 0x55df2b0d84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f8406ffd640 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acea0a0 0x55df2b0dee30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f83f80039c0 tx=0x7f83f800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a526d9469e6c9879 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f83eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f83eaff5640 1 -- 172.21.15.33:0/1516128531 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8031060 con 0x55df2acea0a0 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f83eaff5640 1 -- 172.21.15.33:0/1516128531 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f83f802c460 con 0x55df2acea0a0 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f8413c08740 1 -- 172.21.15.33:0/1516128531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83fc0b4040 con 0x55df2acea0a0 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f83eaff5640 1 -- 172.21.15.33:0/1516128531 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f83f8038050 con 0x55df2acea0a0 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f8413c08740 10 client.15318 fetch_fsmap learned FSMap version 27 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.911+0000 7f8413c08740 1 -- 172.21.15.33:0/1516128531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55df2b0de690 con 0x55df2acea0a0 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f83eaff5640 1 -- 172.21.15.33:0/1516128531 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83fc0b4040 con 0x55df2acea0a0 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f83eaff5640 1 -- 172.21.15.33:0/1516128531 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f83f8019420 con 0x55df2acea0a0 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f8413c08740 10 client.15318 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f8413c08740 10 client.15318 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f8413c08740 20 client.15318 populate_metadata read hostname 'smithi033' 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f8413c08740 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55df2aca6c90 0x55df2b144df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f8413c08740 4 client.15318 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f8413c08740 1 -- 172.21.15.33:0/1516128531 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "status"}) -- 0x55df2b02cde0 con 0x55df2aca6c90 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f84067fc640 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55df2aca6c90 0x55df2b144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f84067fc640 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55df2aca6c90 0x55df2b144df0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1483568ea3424762 server_cookie=958c2a7ff4462df1 in_seq=0 out_seq=0 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.912+0000 7f83eaff5640 10 client.15318 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f83eaff5640 1 -- 172.21.15.33:0/1516128531 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55df2b02cde0 con 0x55df2aca6c90 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f83eaff5640 10 client.15318 handle_command_reply: tid=0 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 client.15318 shutdown 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 -- 172.21.15.33:0/1516128531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acea0a0 msgr2=0x55df2b0dee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acea0a0 0x55df2b0dee30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f83f80039c0 tx=0x7f83f800bd70 comp rx=0 tx=0).stop 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 -- 172.21.15.33:0/1516128531 shutdown_connections 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df2ad12f60 0x55df2b0d84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55df2acf2280 0x55df2b0df410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55df2aca6c90 0x55df2b144df0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 --2- 172.21.15.33:0/1516128531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55df2acea0a0 0x55df2b0dee30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f83eaff5640 0 client.15318 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 -- 172.21.15.33:0/1516128531 >> 172.21.15.33:0/1516128531 conn(0x55df2ad07350 msgr2=0x55df2b0c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 -- 172.21.15.33:0/1516128531 shutdown_connections 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 1 -- 172.21.15.33:0/1516128531 wait complete. 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f8413c08740 20 client.15318 trim_cache size 0 max 16384 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 2, 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24643, 2024-08-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 86.532204716999999, 2024-08-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 27, 2024-08-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 82, 2024-08-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 147.183391556 2024-08-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f840d693640 1 -- 172.21.15.33:0/1330392020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83f00b4c10 msgr2=0x7f83f00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f840d693640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83f00b4c10 0x7f83f00b7120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f840002f500 tx=0x7f840002f370 comp rx=0 tx=0).stop 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f840d693640 1 -- 172.21.15.33:0/1330392020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84081081c0 msgr2=0x7f8408110360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.913+0000 7f840d693640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84081081c0 0x7f8408110360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00d740 tx=0x7f83fc00dc00 comp rx=0 tx=0).stop 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.914+0000 7f840d693640 1 -- 172.21.15.33:0/1330392020 shutdown_connections 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.914+0000 7f840d693640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f83f00b4c10 0x7f83f00b7120 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.914+0000 7f840d693640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8408108b10 0x7f84081108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.914+0000 7f840d693640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84081081c0 0x7f8408110360 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.914+0000 7f840d693640 1 --2- 172.21.15.33:0/1330392020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8408102880 0x7f840810fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.914+0000 7f840d693640 1 -- 172.21.15.33:0/1330392020 >> 172.21.15.33:0/1330392020 conn(0x7f8408079510 msgr2=0x7f8408106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.914+0000 7f840d693640 1 -- 172.21.15.33:0/1330392020 shutdown_connections 2024-08-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:50.914+0000 7f840d693640 1 -- 172.21.15.33:0/1330392020 wait complete. 2024-08-28T19:31:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:51 smithi059 ceph-mon[22052]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:31:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:31:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:31:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:51 smithi122 ceph-mon[22174]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:31:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:31:51.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:31:51.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:51.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:51 smithi033 ceph-mon[18549]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:31:51.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:51.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:51.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:31:51.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:31:51.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:31:51.744 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-28T19:31:52.002 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.574+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3077933235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b8102880 msgr2=0x7ff8b8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.574+0000 7ff8bf6ee640 1 --2- 172.21.15.33:0/3077933235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b8102880 0x7ff8b8102c90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009900 tx=0x7ff8b402a3f0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.574+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3077933235 shutdown_connections 2024-08-28T19:31:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.574+0000 7ff8bf6ee640 1 --2- 172.21.15.33:0/3077933235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b8108ac0 0x7ff8b810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.574+0000 7ff8bf6ee640 1 --2- 172.21.15.33:0/3077933235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8b8108170 0x7ff8b8108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.574+0000 7ff8bf6ee640 1 --2- 172.21.15.33:0/3077933235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b8102880 0x7ff8b8102c90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.574+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3077933235 >> 172.21.15.33:0/3077933235 conn(0x7ff8b8079530 msgr2=0x7ff8b8079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.574+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3077933235 shutdown_connections 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.574+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3077933235 wait complete. 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bf6ee640 1 Processor -- start 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bf6ee640 1 -- start start 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bf6ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b8102880 0x7ff8b819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bf6ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b8108170 0x7ff8b819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bf6ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8b8108ac0 0x7ff8b819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bf6ee640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b8113870 con 0x7ff8b8102880 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bf6ee640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b81136f0 con 0x7ff8b8108170 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bf6ee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b81139f0 con 0x7ff8b8108ac0 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bd48a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b8102880 0x7ff8b819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bd48a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b8102880 0x7ff8b819a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58502/0 (socket says 172.21.15.33:58502) 2024-08-28T19:31:52.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bd48a640 1 -- 172.21.15.33:0/3039370935 learned_addr learned my addr 172.21.15.33:0/3039370935 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bcc89640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b8108170 0x7ff8b819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.575+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8b8108ac0 0x7ff8b819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8bd48a640 1 -- 172.21.15.33:0/3039370935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8b8108ac0 msgr2=0x7ff8b819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8bd48a640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8b8108ac0 0x7ff8b819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8bd48a640 1 -- 172.21.15.33:0/3039370935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b8108170 msgr2=0x7ff8b819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8bd48a640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b8108170 0x7ff8b819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8bd48a640 1 -- 172.21.15.33:0/3039370935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b81a00d0 con 0x7ff8b8102880 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8bd48a640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b8102880 0x7ff8b819a220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4005940 tx=0x7ff8b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8ae7fc640 1 -- 172.21.15.33:0/3039370935 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b403f030 con 0x7ff8b8102880 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8ae7fc640 1 -- 172.21.15.33:0/3039370935 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8b4003cb0 con 0x7ff8b8102880 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8ae7fc640 1 -- 172.21.15.33:0/3039370935 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4035070 con 0x7ff8b8102880 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3039370935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b81a0360 con 0x7ff8b8102880 2024-08-28T19:31:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.576+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3039370935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b81a0840 con 0x7ff8b8102880 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.579+0000 7ff8c5c63740 1 Processor -- start 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.579+0000 7ff8c5c63740 1 -- start start 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e0a76223f0 con 0x55e0a72dd0a0 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0a7611980 con 0x55e0a7305f60 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e0a7615930 con 0x55e0a72e5280 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8ae7fc640 1 -- 172.21.15.33:0/3039370935 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7ff8b4042030 con 0x7ff8b8102880 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bd48a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bdc8b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bcc89640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bdc8b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:48246/0 (socket says 172.21.15.33:48246) 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bcc89640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76ac230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:49852/0 (socket says 172.21.15.33:49852) 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/1961500186 learned_addr learned my addr 172.21.15.33:0/1961500186 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/1961500186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 msgr2=0x55e0a76ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/1961500186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/1961500186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 msgr2=0x55e0a76abcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/1961500186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76abcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/1961500186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0a7371540 con 0x55e0a7305f60 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bd48a640 1 --2- 172.21.15.33:0/1961500186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76abcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.580+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/1961500186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76ab7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0010370 tx=0x7ff8b0010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0abae266bc1d3a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.581+0000 7ff8ae7fc640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8a40b4c40 0x7ff8a40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.581+0000 7ff8a37fe640 1 -- 172.21.15.33:0/1961500186 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0016070 con 0x55e0a7305f60 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.581+0000 7ff8a37fe640 1 -- 172.21.15.33:0/1961500186 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8b0004d20 con 0x55e0a7305f60 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.581+0000 7ff8a37fe640 1 -- 172.21.15.33:0/1961500186 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0005350 con 0x55e0a7305f60 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.581+0000 7ff8bd48a640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8a40b4c40 0x7ff8a40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.581+0000 7ff8ae7fc640 1 -- 172.21.15.33:0/3039370935 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff8b4105bf0 con 0x7ff8b8102880 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.582+0000 7ff8c5c63740 1 -- 172.21.15.33:0/1961500186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 msgr2=0x55e0a76ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.582+0000 7ff8bd48a640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8a40b4c40 0x7ff8a40b7150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55e0a76aa430 tx=0x7ff8b4109740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.582+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/1961500186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76ab7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0010370 tx=0x7ff8b0010830 comp rx=0 tx=0).stop 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.582+0000 7ff8c5c63740 1 -- 172.21.15.33:0/1961500186 shutdown_connections 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.582+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/1961500186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.582+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/1961500186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76abcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.582+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/1961500186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76ab7b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.582+0000 7ff8c5c63740 1 -- 172.21.15.33:0/1961500186 >> 172.21.15.33:0/1961500186 conn(0x55e0a72fa350 msgr2=0x55e0a76a96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:52.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.583+0000 7ff8c5c63740 1 -- 172.21.15.33:0/1961500186 shutdown_connections 2024-08-28T19:31:52.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.583+0000 7ff8c5c63740 1 -- 172.21.15.33:0/1961500186 wait complete. 2024-08-28T19:31:52.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.583+0000 7ff8c5c63740 1 -- start start 2024-08-28T19:31:52.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.583+0000 7ff8c5c63740 1 Processor -- start 2024-08-28T19:31:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e0a74745f0 con 0x55e0a72dd0a0 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0a7598600 con 0x55e0a7305f60 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e0a76b9f90 con 0x55e0a72e5280 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8c5c63740 10 client.0 _ll_register_callbacks cb 0x55e0a75beaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8bdc8b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8bdc8b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58528/0 (socket says 172.21.15.33:58528) 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/3446028814 learned_addr learned my addr 172.21.15.33:0/3446028814 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8bcc89640 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/3446028814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 msgr2=0x55e0a76b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76b7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/3446028814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 msgr2=0x55e0a76c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.584+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/3446028814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0a75d17b0 con 0x55e0a72dd0a0 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76b6ec0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0005cc0 tx=0x7ff8b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c345a9d51811833 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/3446028814 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0016040 con 0x55e0a72dd0a0 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/3446028814 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff8b0012a50 con 0x55e0a72dd0a0 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8c5c63740 1 -- 172.21.15.33:0/3446028814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8b0004d20 con 0x55e0a72dd0a0 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/3446028814 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8b0031050 con 0x55e0a72dd0a0 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8c5c63740 10 client.15330 fetch_fsmap learned FSMap version 27 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8c5c63740 1 -- 172.21.15.33:0/3446028814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e0a76c5ca0 con 0x55e0a72dd0a0 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/3446028814 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8b0004d20 con 0x55e0a72dd0a0 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/3446028814 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7ff8b000f040 con 0x55e0a72dd0a0 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8c5c63740 10 client.15330 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8c5c63740 10 client.15330 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8c5c63740 20 client.15330 populate_metadata read hostname 'smithi033' 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e0a72c48e0 0x55e0a76c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8c5c63740 4 client.15330 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.585+0000 7ff8c5c63740 1 -- 172.21.15.33:0/3446028814 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0a7624340 con 0x55e0a72c48e0 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.586+0000 7ff8bcc89640 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e0a72c48e0 0x55e0a76c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.586+0000 7ff8a0ff9640 10 client.15330 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.586+0000 7ff8bcc89640 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e0a72c48e0 0x55e0a76c92e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=681972431cd64bb server_cookie=ce5a23b5c657971e in_seq=0 out_seq=0 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/3446028814 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0a7624340 con 0x55e0a72c48e0 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8a0ff9640 10 client.15330 handle_command_reply: tid=0 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8c5c63740 1 client.15330 shutdown 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8c5c63740 1 -- 172.21.15.33:0/3446028814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 msgr2=0x55e0a76b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76b6ec0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0005cc0 tx=0x7ff8b0009bb0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8c5c63740 1 -- 172.21.15.33:0/3446028814 shutdown_connections 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e0a72c48e0 0x55e0a76c92e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8a0ff9640 0 client.15330 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/3446028814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76b6ec0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.587+0000 7ff8c5c63740 1 -- 172.21.15.33:0/3446028814 >> 172.21.15.33:0/3446028814 conn(0x55e0a72fa350 msgr2=0x55e0a76ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.588+0000 7ff8c5c63740 1 -- 172.21.15.33:0/3446028814 shutdown_connections 2024-08-28T19:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.588+0000 7ff8c5c63740 1 -- 172.21.15.33:0/3446028814 wait complete. 2024-08-28T19:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.588+0000 7ff8c5c63740 20 client.15330 trim_cache size 0 max 16384 2024-08-28T19:31:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8c5c63740 1 Processor -- start 2024-08-28T19:31:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8c5c63740 1 -- start start 2024-08-28T19:31:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76b2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e0a76c7620 con 0x55e0a72dd0a0 2024-08-28T19:31:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0a76c7cf0 con 0x55e0a7305f60 2024-08-28T19:31:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e0a76c83c0 con 0x55e0a72e5280 2024-08-28T19:31:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8bdc8b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8bdc8b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58544/0 (socket says 172.21.15.33:58544) 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.606+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/2638343360 learned_addr learned my addr 172.21.15.33:0/2638343360 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.607+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/2638343360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.607+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/2638343360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 msgr2=0x55e0a76b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.607+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/2638343360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.607+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/2638343360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 msgr2=0x55e0a76b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.607+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/2638343360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.607+0000 7ff8bdc8b640 1 -- 172.21.15.33:0/2638343360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0a76b8180 con 0x55e0a72dd0a0 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.607+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/2638343360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76c31f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009ac0 tx=0x7ff8b001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec07a4162344339 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.607+0000 7ff8a2ffd640 1 -- 172.21.15.33:0/2638343360 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0016070 con 0x55e0a72dd0a0 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.607+0000 7ff8a2ffd640 1 -- 172.21.15.33:0/2638343360 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8b0010d30 con 0x55e0a72dd0a0 2024-08-28T19:31:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.607+0000 7ff8a2ffd640 1 -- 172.21.15.33:0/2638343360 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b001ab40 con 0x55e0a72dd0a0 2024-08-28T19:31:52.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 -- 172.21.15.33:0/2638343360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 msgr2=0x55e0a76c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:52.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/2638343360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76c31f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009ac0 tx=0x7ff8b001f040 comp rx=0 tx=0).stop 2024-08-28T19:31:52.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 -- 172.21.15.33:0/2638343360 shutdown_connections 2024-08-28T19:31:52.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/2638343360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a7305f60 0x55e0a76b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/2638343360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a72e5280 0x55e0a76b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/2638343360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72dd0a0 0x55e0a76c31f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 -- 172.21.15.33:0/2638343360 >> 172.21.15.33:0/2638343360 conn(0x55e0a72fa350 msgr2=0x55e0a76a4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 -- 172.21.15.33:0/2638343360 shutdown_connections 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 -- 172.21.15.33:0/2638343360 wait complete. 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 -- start start 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.608+0000 7ff8c5c63740 1 Processor -- start 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a72dd0a0 0x55e0a76d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72e5280 0x55e0a76d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8c5c63740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a7305f60 0x55e0a76cac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e0a76c9160 con 0x55e0a72e5280 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0a76c8a90 con 0x55e0a72dd0a0 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8c5c63740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e0a76c9830 con 0x55e0a7305f60 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8c5c63740 10 client.0 _ll_register_callbacks cb 0x7ff8b0009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bcc89640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72e5280 0x55e0a76d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bcc89640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72e5280 0x55e0a76d1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58550/0 (socket says 172.21.15.33:58550) 2024-08-28T19:31:52.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bcc89640 1 -- 172.21.15.33:0/4273068008 learned_addr learned my addr 172.21.15.33:0/4273068008 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a7305f60 0x55e0a76cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a72dd0a0 0x55e0a76d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bcc89640 1 -- 172.21.15.33:0/4273068008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a7305f60 msgr2=0x55e0a76cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bcc89640 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a7305f60 0x55e0a76cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bcc89640 1 -- 172.21.15.33:0/4273068008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a72dd0a0 msgr2=0x55e0a76d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bcc89640 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a72dd0a0 0x55e0a76d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bcc89640 1 -- 172.21.15.33:0/4273068008 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0a76cb3d0 con 0x55e0a72e5280 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8bcc89640 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72e5280 0x55e0a76d1dc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8000c00 tx=0x7ff8a8010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3adbc27379d358 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.609+0000 7ff8a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/4273068008 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a802a060 con 0x55e0a72e5280 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/4273068008 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff8a800fa10 con 0x55e0a72e5280 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8c5c63740 1 -- 172.21.15.33:0/4273068008 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8b0010d30 con 0x55e0a72e5280 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/4273068008 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8a8031050 con 0x55e0a72e5280 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8c5c63740 10 client.15336 fetch_fsmap learned FSMap version 27 2024-08-28T19:31:52.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8c5c63740 1 -- 172.21.15.33:0/4273068008 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e0a76d0e70 con 0x55e0a72e5280 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/4273068008 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8b0010d30 con 0x55e0a72e5280 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/4273068008 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7ff8a80243d0 con 0x55e0a72e5280 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8c5c63740 10 client.15336 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8c5c63740 10 client.15336 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8c5c63740 20 client.15336 populate_metadata read hostname 'smithi033' 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e0a7299c90 0x55e0a7737a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8c5c63740 4 client.15336 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.610+0000 7ff8c5c63740 1 -- 172.21.15.33:0/4273068008 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "status"}) -- 0x55e0a761fde0 con 0x55e0a7299c90 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.611+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e0a7299c90 0x55e0a7737a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.611+0000 7ff8bdc8b640 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e0a7299c90 0x55e0a7737a90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c8414e954e2ed7e server_cookie=50a6cd672b546e19 in_seq=0 out_seq=0 2024-08-28T19:31:52.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.611+0000 7ff8a0ff9640 10 client.15336 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:31:52.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8a0ff9640 1 -- 172.21.15.33:0/4273068008 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e0a761fde0 con 0x55e0a7299c90 2024-08-28T19:31:52.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8a0ff9640 10 client.15336 handle_command_reply: tid=0 2024-08-28T19:31:52.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 client.15336 shutdown 2024-08-28T19:31:52.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 -- 172.21.15.33:0/4273068008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72e5280 msgr2=0x55e0a76d1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72e5280 0x55e0a76d1dc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8000c00 tx=0x7ff8a8010af0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 -- 172.21.15.33:0/4273068008 shutdown_connections 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e0a7299c90 0x55e0a7737a90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0a7305f60 0x55e0a76cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0a72e5280 0x55e0a76d1dc0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8a0ff9640 0 client.15336 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 --2- 172.21.15.33:0/4273068008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0a72dd0a0 0x55e0a76d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 -- 172.21.15.33:0/4273068008 >> 172.21.15.33:0/4273068008 conn(0x55e0a72fa350 msgr2=0x55e0a76a4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 -- 172.21.15.33:0/4273068008 shutdown_connections 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 1 -- 172.21.15.33:0/4273068008 wait complete. 2024-08-28T19:31:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.612+0000 7ff8c5c63740 20 client.15336 trim_cache size 0 max 16384 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 1, 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24653, 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 89.245487746999999, 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 27, 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 82, 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 134.40160057599999 2024-08-28T19:31:52.619 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:31:52.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3039370935 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8a40b4c40 msgr2=0x7ff8a40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:52.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8a40b4c40 0x7ff8a40b7150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55e0a76aa430 tx=0x7ff8b4109740 comp rx=0 tx=0).stop 2024-08-28T19:31:52.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3039370935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b8102880 msgr2=0x7ff8b819a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:52.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b8102880 0x7ff8b819a220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4005940 tx=0x7ff8b40042f0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3039370935 shutdown_connections 2024-08-28T19:31:52.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff8a40b4c40 0x7ff8a40b7150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8b8108ac0 0x7ff8b819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b8108170 0x7ff8b819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 --2- 172.21.15.33:0/3039370935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8b8102880 0x7ff8b819a220 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3039370935 >> 172.21.15.33:0/3039370935 conn(0x7ff8b8079530 msgr2=0x7ff8b8106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3039370935 shutdown_connections 2024-08-28T19:31:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:52.613+0000 7ff8bf6ee640 1 -- 172.21.15.33:0/3039370935 wait complete. 2024-08-28T19:31:53.409 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:53 smithi033 ceph-mon[18549]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:31:53.410 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-28T19:31:53.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:53 smithi059 ceph-mon[22052]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:31:53.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:53 smithi122 ceph-mon[22174]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:31:53.663 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.178+0000 7f42f691d640 1 -- 172.21.15.33:0/3720436152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f0105120 msgr2=0x7f42f010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.178+0000 7f42f691d640 1 --2- 172.21.15.33:0/3720436152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f0105120 0x7f42f010d670 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009900 tx=0x7f42e402a410 comp rx=0 tx=0).stop 2024-08-28T19:31:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.178+0000 7f42f691d640 1 -- 172.21.15.33:0/3720436152 shutdown_connections 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.178+0000 7f42f691d640 1 --2- 172.21.15.33:0/3720436152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f010dc30 0x7f42f0110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.178+0000 7f42f691d640 1 --2- 172.21.15.33:0/3720436152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f0105120 0x7f42f010d670 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.178+0000 7f42f691d640 1 --2- 172.21.15.33:0/3720436152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f01047d0 0x7f42f0104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.178+0000 7f42f691d640 1 -- 172.21.15.33:0/3720436152 >> 172.21.15.33:0/3720436152 conn(0x7f42f0079510 msgr2=0x7f42f0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.178+0000 7f42f691d640 1 -- 172.21.15.33:0/3720436152 shutdown_connections 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.179+0000 7f42f691d640 1 -- 172.21.15.33:0/3720436152 wait complete. 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.179+0000 7f42f691d640 1 Processor -- start 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.179+0000 7f42f691d640 1 -- start start 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42f691d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f01047d0 0x7f42f019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42f691d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f0105120 0x7f42f019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42f691d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f010dc30 0x7f42f019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42f691d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f42f01138d0 con 0x7f42f01047d0 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42f691d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0113750 con 0x7f42f0105120 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42f691d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0113a50 con 0x7f42f010dc30 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f01047d0 0x7f42f019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f01047d0 0x7f42f019a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58566/0 (socket says 172.21.15.33:58566) 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42effff640 1 -- 172.21.15.33:0/2825204425 learned_addr learned my addr 172.21.15.33:0/2825204425 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f0105120 0x7f42f019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42f4eba640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f010dc30 0x7f42f019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42effff640 1 -- 172.21.15.33:0/2825204425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f010dc30 msgr2=0x7f42f019fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42effff640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f010dc30 0x7f42f019fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42effff640 1 -- 172.21.15.33:0/2825204425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f0105120 msgr2=0x7f42f019a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42effff640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f0105120 0x7f42f019a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42effff640 1 -- 172.21.15.33:0/2825204425 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f01a02b0 con 0x7f42f01047d0 2024-08-28T19:31:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42f4eba640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f010dc30 0x7f42f019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.180+0000 7f42effff640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f01047d0 0x7f42f019a340 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f42e000d950 tx=0x7f42e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.181+0000 7f42ed7fa640 1 -- 172.21.15.33:0/2825204425 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0017070 con 0x7f42f01047d0 2024-08-28T19:31:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.181+0000 7f42ed7fa640 1 -- 172.21.15.33:0/2825204425 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e0009c30 con 0x7f42f01047d0 2024-08-28T19:31:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.181+0000 7f42f691d640 1 -- 172.21.15.33:0/2825204425 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f01a05a0 con 0x7f42f01047d0 2024-08-28T19:31:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.181+0000 7f42ed7fa640 1 -- 172.21.15.33:0/2825204425 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e000f620 con 0x7f42f01047d0 2024-08-28T19:31:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.181+0000 7f42f691d640 1 -- 172.21.15.33:0/2825204425 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f01a6d00 con 0x7f42f01047d0 2024-08-28T19:31:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.183+0000 7f42fce92740 1 Processor -- start 2024-08-28T19:31:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.183+0000 7f42fce92740 1 -- start start 2024-08-28T19:31:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.183+0000 7f42ed7fa640 1 -- 172.21.15.33:0/2825204425 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f42e0010460 con 0x7f42f01047d0 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.183+0000 7f42fce92740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42fce92740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 0x5648a5a51cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42fce92740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a52230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42fce92740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5648a59c83f0 con 0x5648a568b280 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42fce92740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5648a59b7980 con 0x5648a56830a0 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42fce92740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5648a59bb930 con 0x5648a56abf60 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a52230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a52230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58568/0 (socket says 172.21.15.33:58568) 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ef7fe640 1 -- 172.21.15.33:0/490198125 learned_addr learned my addr 172.21.15.33:0/490198125 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42f4eba640 1 --2- 172.21.15.33:0/490198125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42effff640 1 --2- 172.21.15.33:0/490198125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 0x5648a5a51cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ef7fe640 1 -- 172.21.15.33:0/490198125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 msgr2=0x5648a5a517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/490198125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ef7fe640 1 -- 172.21.15.33:0/490198125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 msgr2=0x5648a5a51cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/490198125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 0x5648a5a51cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ef7fe640 1 -- 172.21.15.33:0/490198125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a5717540 con 0x5648a568b280 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42f4eba640 1 --2- 172.21.15.33:0/490198125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ed7fa640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42d80b4c10 0x7f42d80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42f4eba640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42d80b4c10 0x7f42d80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/490198125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a52230 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009900 tx=0x7f42e4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16028082a47c4573 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.184+0000 7f42ed7fa640 1 -- 172.21.15.33:0/2825204425 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f42e00e53f0 con 0x7f42f01047d0 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.185+0000 7f42d67fc640 1 -- 172.21.15.33:0/490198125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4040070 con 0x5648a568b280 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.185+0000 7f42d67fc640 1 -- 172.21.15.33:0/490198125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e4005db0 con 0x5648a568b280 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.185+0000 7f42d67fc640 1 -- 172.21.15.33:0/490198125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4035040 con 0x5648a568b280 2024-08-28T19:31:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.185+0000 7f42fce92740 1 -- 172.21.15.33:0/490198125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 msgr2=0x5648a5a52230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.185+0000 7f42fce92740 1 --2- 172.21.15.33:0/490198125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a52230 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009900 tx=0x7f42e4000bc0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.185+0000 7f42f4eba640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42d80b4c10 0x7f42d80b7120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f42e800a4c0 tx=0x7f42e80096f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.186+0000 7f42fce92740 1 -- 172.21.15.33:0/490198125 shutdown_connections 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.186+0000 7f42fce92740 1 --2- 172.21.15.33:0/490198125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a52230 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.186+0000 7f42fce92740 1 --2- 172.21.15.33:0/490198125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 0x5648a5a51cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.186+0000 7f42fce92740 1 --2- 172.21.15.33:0/490198125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.186+0000 7f42fce92740 1 -- 172.21.15.33:0/490198125 >> 172.21.15.33:0/490198125 conn(0x5648a56a0350 msgr2=0x5648a5a4f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.186+0000 7f42fce92740 1 -- 172.21.15.33:0/490198125 shutdown_connections 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.186+0000 7f42fce92740 1 -- 172.21.15.33:0/490198125 wait complete. 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.186+0000 7f42fce92740 1 -- start start 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.186+0000 7f42fce92740 1 Processor -- start 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42fce92740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a5ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42fce92740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a568b280 0x5648a5a5d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42fce92740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a69250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42fce92740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5648a581a5f0 con 0x5648a56830a0 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42fce92740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5648a593e600 con 0x5648a568b280 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42fce92740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5648a5a5ff30 con 0x5648a56abf60 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42fce92740 10 client.0 _ll_register_callbacks cb 0x5648a5964af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a5ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a5ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58584/0 (socket says 172.21.15.33:58584) 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42effff640 1 -- 172.21.15.33:0/1339971708 learned_addr learned my addr 172.21.15.33:0/1339971708 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a568b280 0x5648a5a5d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42f4eba640 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a69250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42effff640 1 -- 172.21.15.33:0/1339971708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 msgr2=0x5648a5a69250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42effff640 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a69250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42effff640 1 -- 172.21.15.33:0/1339971708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a568b280 msgr2=0x5648a5a5d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42effff640 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a568b280 0x5648a5a5d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42effff640 1 -- 172.21.15.33:0/1339971708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648a59777b0 con 0x5648a56830a0 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42f4eba640 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a69250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42effff640 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a5ce90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f42e00ab550 tx=0x7f42e00a7110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a955127f7c5be0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1339971708 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0020030 con 0x5648a56830a0 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1339971708 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f42e00e5150 con 0x5648a56830a0 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.187+0000 7f42fce92740 1 -- 172.21.15.33:0/1339971708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42e4005db0 con 0x5648a56830a0 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1339971708 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f42e00aafc0 con 0x5648a56830a0 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42fce92740 10 client.15348 fetch_fsmap learned FSMap version 27 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42fce92740 1 -- 172.21.15.33:0/1339971708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5648a5a6bca0 con 0x5648a56830a0 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1339971708 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e4005db0 con 0x5648a56830a0 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1339971708 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f42e00acb80 con 0x5648a56830a0 2024-08-28T19:31:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42fce92740 10 client.15348 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42fce92740 10 client.15348 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42fce92740 20 client.15348 populate_metadata read hostname 'smithi033' 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42fce92740 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5648a566a8e0 0x5648a5a6f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42fce92740 4 client.15348 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42fce92740 1 -- 172.21.15.33:0/1339971708 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648a59ca340 con 0x5648a566a8e0 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.188+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5648a566a8e0 0x5648a5a6f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.189+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5648a566a8e0 0x5648a5a6f6f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef47ae29d8db9db8 server_cookie=7f22f8e3257a26eb in_seq=0 out_seq=0 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.189+0000 7f42cf7fe640 10 client.15348 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1339971708 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648a59ca340 con 0x5648a566a8e0 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42cf7fe640 10 client.15348 handle_command_reply: tid=0 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 client.15348 shutdown 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 -- 172.21.15.33:0/1339971708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 msgr2=0x5648a5a5ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a5ce90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f42e00ab550 tx=0x7f42e00a7110 comp rx=0 tx=0).stop 2024-08-28T19:31:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 -- 172.21.15.33:0/1339971708 shutdown_connections 2024-08-28T19:31:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a69250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a568b280 0x5648a5a5d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5648a566a8e0 0x5648a5a6f6f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 --2- 172.21.15.33:0/1339971708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a5ce90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 -- 172.21.15.33:0/1339971708 >> 172.21.15.33:0/1339971708 conn(0x5648a56a0350 msgr2=0x5648a5a54940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42cf7fe640 0 client.15348 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:31:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 -- 172.21.15.33:0/1339971708 shutdown_connections 2024-08-28T19:31:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 1 -- 172.21.15.33:0/1339971708 wait complete. 2024-08-28T19:31:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.190+0000 7f42fce92740 20 client.15348 trim_cache size 0 max 16384 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.209+0000 7f42fce92740 1 Processor -- start 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.209+0000 7f42fce92740 1 -- start start 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.209+0000 7f42fce92740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.209+0000 7f42fce92740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a568b280 0x5648a5a4ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.209+0000 7f42fce92740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56abf60 0x5648a5a4f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.209+0000 7f42fce92740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5648a5a6da30 con 0x5648a56830a0 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.209+0000 7f42fce92740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5648a5a6e100 con 0x5648a56abf60 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.209+0000 7f42fce92740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5648a5a6e7d0 con 0x5648a568b280 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a691c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58596/0 (socket says 172.21.15.33:58596) 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42effff640 1 -- 172.21.15.33:0/858915430 learned_addr learned my addr 172.21.15.33:0/858915430 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42f4eba640 1 --2- 172.21.15.33:0/858915430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56abf60 0x5648a5a4f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/858915430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a568b280 0x5648a5a4ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42effff640 1 -- 172.21.15.33:0/858915430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a568b280 msgr2=0x5648a5a4ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:54.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42effff640 1 --2- 172.21.15.33:0/858915430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a568b280 0x5648a5a4ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42effff640 1 -- 172.21.15.33:0/858915430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56abf60 msgr2=0x5648a5a4f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:54.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42effff640 1 --2- 172.21.15.33:0/858915430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56abf60 0x5648a5a4f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42effff640 1 -- 172.21.15.33:0/858915430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648a566ab10 con 0x5648a56830a0 2024-08-28T19:31:54.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42effff640 1 --2- 172.21.15.33:0/858915430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a691c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42e00b4b90 tx=0x7f42e00a7d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2241a4eafe5e935e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:54.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42d5ffb640 1 -- 172.21.15.33:0/858915430 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0020070 con 0x5648a56830a0 2024-08-28T19:31:54.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42d5ffb640 1 -- 172.21.15.33:0/858915430 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e00ab360 con 0x5648a56830a0 2024-08-28T19:31:54.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.210+0000 7f42d5ffb640 1 -- 172.21.15.33:0/858915430 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00acb80 con 0x5648a56830a0 2024-08-28T19:31:54.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.211+0000 7f42fce92740 1 -- 172.21.15.33:0/858915430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 msgr2=0x5648a5a691c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.211+0000 7f42fce92740 1 --2- 172.21.15.33:0/858915430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a691c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42e00b4b90 tx=0x7f42e00a7d60 comp rx=0 tx=0).stop 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.211+0000 7f42fce92740 1 -- 172.21.15.33:0/858915430 shutdown_connections 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.211+0000 7f42fce92740 1 --2- 172.21.15.33:0/858915430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56abf60 0x5648a5a4f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.211+0000 7f42fce92740 1 --2- 172.21.15.33:0/858915430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a568b280 0x5648a5a4ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.211+0000 7f42fce92740 1 --2- 172.21.15.33:0/858915430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a56830a0 0x5648a5a691c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.211+0000 7f42fce92740 1 -- 172.21.15.33:0/858915430 >> 172.21.15.33:0/858915430 conn(0x5648a56a0350 msgr2=0x5648a5a5b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.211+0000 7f42fce92740 1 -- 172.21.15.33:0/858915430 shutdown_connections 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.211+0000 7f42fce92740 1 -- 172.21.15.33:0/858915430 wait complete. 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42fce92740 1 -- start start 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42fce92740 1 Processor -- start 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42fce92740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 0x5648a5a77bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42fce92740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a781b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42fce92740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a71080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42fce92740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5648a5a6f570 con 0x5648a568b280 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42fce92740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5648a5a6eea0 con 0x5648a56830a0 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42fce92740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5648a5a6fc40 con 0x5648a56abf60 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42fce92740 10 client.0 _ll_register_callbacks cb 0x7f42e000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42ef7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a781b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58608/0 (socket says 172.21.15.33:58608) 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42ef7fe640 1 -- 172.21.15.33:0/1433192557 learned_addr learned my addr 172.21.15.33:0/1433192557 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.212+0000 7f42effff640 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 0x5648a5a77bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42f4eba640 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a71080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42ef7fe640 1 -- 172.21.15.33:0/1433192557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 msgr2=0x5648a5a71080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a71080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42ef7fe640 1 -- 172.21.15.33:0/1433192557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 msgr2=0x5648a5a77bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 0x5648a5a77bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42ef7fe640 1 -- 172.21.15.33:0/1433192557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648a5a717c0 con 0x5648a568b280 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42effff640 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 0x5648a5a77bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42ef7fe640 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a781b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009900 tx=0x7f42e402abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59eb2bcd556634bc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1433192557 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4035040 con 0x5648a568b280 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42fce92740 1 -- 172.21.15.33:0/1433192557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42e00ab360 con 0x5648a568b280 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1433192557 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f42e40314a0 con 0x5648a568b280 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1433192557 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f42e405b050 con 0x5648a568b280 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42fce92740 10 client.15354 fetch_fsmap learned FSMap version 27 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.213+0000 7f42fce92740 1 -- 172.21.15.33:0/1433192557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5648a5a771a0 con 0x5648a568b280 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.214+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1433192557 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42e00ab360 con 0x5648a568b280 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.214+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1433192557 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f42e4003680 con 0x5648a568b280 2024-08-28T19:31:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.214+0000 7f42fce92740 10 client.15354 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.214+0000 7f42fce92740 10 client.15354 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.214+0000 7f42fce92740 20 client.15354 populate_metadata read hostname 'smithi033' 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.214+0000 7f42fce92740 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5648a563fc90 0x5648a5ae1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.214+0000 7f42fce92740 4 client.15354 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.214+0000 7f42fce92740 1 -- 172.21.15.33:0/1433192557 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "status"}) -- 0x5648a59c5de0 con 0x5648a563fc90 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.214+0000 7f42effff640 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5648a563fc90 0x5648a5ae1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42cf7fe640 10 client.15354 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42effff640 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5648a563fc90 0x5648a5ae1da0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ec2020fab253704 server_cookie=905a2d4cdf41dedf in_seq=0 out_seq=0 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42cf7fe640 1 -- 172.21.15.33:0/1433192557 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5648a59c5de0 con 0x5648a563fc90 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42cf7fe640 10 client.15354 handle_command_reply: tid=0 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 client.15354 shutdown 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 -- 172.21.15.33:0/1433192557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 msgr2=0x5648a5a781b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a781b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009900 tx=0x7f42e402abc0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 -- 172.21.15.33:0/1433192557 shutdown_connections 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5648a56abf60 0x5648a5a71080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5648a563fc90 0x5648a5ae1da0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a568b280 0x5648a5a781b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42cf7fe640 0 client.15354 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 --2- 172.21.15.33:0/1433192557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648a56830a0 0x5648a5a77bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 -- 172.21.15.33:0/1433192557 >> 172.21.15.33:0/1433192557 conn(0x5648a56a0350 msgr2=0x5648a5a5b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 -- 172.21.15.33:0/1433192557 shutdown_connections 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 1 -- 172.21.15.33:0/1433192557 wait complete. 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.215+0000 7f42fce92740 20 client.15354 trim_cache size 0 max 16384 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:31:54.222 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24658, 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 125.1149147, 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 27, 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 82, 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 145.08725709999999 2024-08-28T19:31:54.223 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 -- 172.21.15.33:0/2825204425 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42d80b4c10 msgr2=0x7f42d80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42d80b4c10 0x7f42d80b7120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f42e800a4c0 tx=0x7f42e80096f0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 -- 172.21.15.33:0/2825204425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f01047d0 msgr2=0x7f42f019a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f01047d0 0x7f42f019a340 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f42e000d950 tx=0x7f42e000de10 comp rx=0 tx=0).stop 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 -- 172.21.15.33:0/2825204425 shutdown_connections 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42d80b4c10 0x7f42d80b7120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42f010dc30 0x7f42f019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f0105120 0x7f42f019a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 --2- 172.21.15.33:0/2825204425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f01047d0 0x7f42f019a340 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 -- 172.21.15.33:0/2825204425 >> 172.21.15.33:0/2825204425 conn(0x7f42f0079510 msgr2=0x7f42f0100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:54.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 -- 172.21.15.33:0/2825204425 shutdown_connections 2024-08-28T19:31:54.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:54.216+0000 7f42f691d640 1 -- 172.21.15.33:0/2825204425 wait complete. 2024-08-28T19:31:54.928 INFO:tasks.cephadm:Setup complete, yielding 2024-08-28T19:31:54.929 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-28T19:31:54.937 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-08-28T19:31:54.937 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch status' 2024-08-28T19:31:55.190 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:55.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:55 smithi059 ceph-mon[22052]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:31:55.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:55 smithi122 ceph-mon[22174]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:31:55.612 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:55 smithi033 ceph-mon[18549]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:31:55.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.702+0000 7fe038bc0640 1 -- 172.21.15.33:0/2555820136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe034108b10 msgr2=0x7fe03410f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:55.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.702+0000 7fe038bc0640 1 --2- 172.21.15.33:0/2555820136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe034108b10 0x7fe03410f340 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009ca0 tx=0x7fe02c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.702+0000 7fe038bc0640 1 -- 172.21.15.33:0/2555820136 shutdown_connections 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.702+0000 7fe038bc0640 1 --2- 172.21.15.33:0/2555820136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe034108b10 0x7fe03410f340 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.702+0000 7fe038bc0640 1 --2- 172.21.15.33:0/2555820136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0341081c0 0x7fe0341085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.702+0000 7fe038bc0640 1 --2- 172.21.15.33:0/2555820136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe034102880 0x7fe034102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.702+0000 7fe038bc0640 1 -- 172.21.15.33:0/2555820136 >> 172.21.15.33:0/2555820136 conn(0x7fe034079510 msgr2=0x7fe034079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.702+0000 7fe038bc0640 1 -- 172.21.15.33:0/2555820136 shutdown_connections 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.702+0000 7fe038bc0640 1 -- 172.21.15.33:0/2555820136 wait complete. 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.703+0000 7fe038bc0640 1 Processor -- start 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.703+0000 7fe038bc0640 1 -- start start 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.703+0000 7fe038bc0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe034102880 0x7fe03419b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.703+0000 7fe038bc0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0341081c0 0x7fe03419b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.703+0000 7fe038bc0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe034108b10 0x7fe03419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.703+0000 7fe038bc0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe0341127c0 con 0x7fe034108b10 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.703+0000 7fe038bc0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe034112640 con 0x7fe0341081c0 2024-08-28T19:31:55.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.703+0000 7fe038bc0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe034112940 con 0x7fe034102880 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe032d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe034108b10 0x7fe03419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe032d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe034108b10 0x7fe03419bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58626/0 (socket says 172.21.15.33:58626) 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe032d9d640 1 -- 172.21.15.33:0/2245401146 learned_addr learned my addr 172.21.15.33:0/2245401146 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe03259c640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe034102880 0x7fe03419b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe029d9b640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0341081c0 0x7fe03419b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe032d9d640 1 -- 172.21.15.33:0/2245401146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe034102880 msgr2=0x7fe03419b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe032d9d640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe034102880 0x7fe03419b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe032d9d640 1 -- 172.21.15.33:0/2245401146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0341081c0 msgr2=0x7fe03419b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe032d9d640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0341081c0 0x7fe03419b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe032d9d640 1 -- 172.21.15.33:0/2245401146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0341a6250 con 0x7fe034108b10 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe032d9d640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe034108b10 0x7fe03419bad0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe02c005cc0 tx=0x7fe02c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe02bfff640 1 -- 172.21.15.33:0/2245401146 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c003bf0 con 0x7fe034108b10 2024-08-28T19:31:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe038bc0640 1 -- 172.21.15.33:0/2245401146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0341a64e0 con 0x7fe034108b10 2024-08-28T19:31:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe02bfff640 1 -- 172.21.15.33:0/2245401146 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe02c003d90 con 0x7fe034108b10 2024-08-28T19:31:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.704+0000 7fe02bfff640 1 -- 172.21.15.33:0/2245401146 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c02fb20 con 0x7fe034108b10 2024-08-28T19:31:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.705+0000 7fe038bc0640 1 -- 172.21.15.33:0/2245401146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0341a6a20 con 0x7fe034108b10 2024-08-28T19:31:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.705+0000 7fe038bc0640 1 -- 172.21.15.33:0/2245401146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe034103b00 con 0x7fe034108b10 2024-08-28T19:31:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.707+0000 7fe02bfff640 1 -- 172.21.15.33:0/2245401146 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fe02c004580 con 0x7fe034108b10 2024-08-28T19:31:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.708+0000 7fe02bfff640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0200b4c40 0x7fe0200b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.708+0000 7fe03259c640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0200b4c40 0x7fe0200b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.709+0000 7fe02bfff640 1 -- 172.21.15.33:0/2245401146 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe02c106c10 con 0x7fe034108b10 2024-08-28T19:31:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.709+0000 7fe03259c640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0200b4c40 0x7fe0200b7150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe03406c460 tx=0x7fe02400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:55.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.712+0000 7fe02bfff640 1 -- 172.21.15.33:0/2245401146 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe02c0cd770 con 0x7fe034108b10 2024-08-28T19:31:55.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.917+0000 7fe038bc0640 1 -- 172.21.15.33:0/2245401146 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fe0340635a0 con 0x7fe0200b4c40 2024-08-28T19:31:55.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.918+0000 7fe02bfff640 1 -- 172.21.15.33:0/2245401146 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fe0340635a0 con 0x7fe0200b4c40 2024-08-28T19:31:55.920 INFO:teuthology.orchestra.run.smithi033.stdout:Backend: cephadm 2024-08-28T19:31:55.920 INFO:teuthology.orchestra.run.smithi033.stdout:Available: Yes 2024-08-28T19:31:55.920 INFO:teuthology.orchestra.run.smithi033.stdout:Paused: No 2024-08-28T19:31:55.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.920+0000 7fe038bc0640 1 -- 172.21.15.33:0/2245401146 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0200b4c40 msgr2=0x7fe0200b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.920+0000 7fe038bc0640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0200b4c40 0x7fe0200b7150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe03406c460 tx=0x7fe02400a2d0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.920+0000 7fe038bc0640 1 -- 172.21.15.33:0/2245401146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe034108b10 msgr2=0x7fe03419bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.920+0000 7fe038bc0640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe034108b10 0x7fe03419bad0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe02c005cc0 tx=0x7fe02c02f380 comp rx=0 tx=0).stop 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.921+0000 7fe038bc0640 1 -- 172.21.15.33:0/2245401146 shutdown_connections 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.921+0000 7fe038bc0640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe034108b10 0x7fe03419bad0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.921+0000 7fe038bc0640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0341081c0 0x7fe03419b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.921+0000 7fe038bc0640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0200b4c40 0x7fe0200b7150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.921+0000 7fe038bc0640 1 --2- 172.21.15.33:0/2245401146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe034102880 0x7fe03419b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.921+0000 7fe038bc0640 1 -- 172.21.15.33:0/2245401146 >> 172.21.15.33:0/2245401146 conn(0x7fe034079510 msgr2=0x7fe0341061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.921+0000 7fe038bc0640 1 -- 172.21.15.33:0/2245401146 shutdown_connections 2024-08-28T19:31:55.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:55.921+0000 7fe038bc0640 1 -- 172.21.15.33:0/2245401146 wait complete. 2024-08-28T19:31:56.680 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:57.338 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:57 smithi033 ceph-mon[18549]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:31:57.338 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:57 smithi033 ceph-mon[18549]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:31:57.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.428+0000 7f4b04a78640 1 -- 172.21.15.33:0/2005592930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b00109b90 msgr2=0x7f4b001103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.428+0000 7f4b04a78640 1 --2- 172.21.15.33:0/2005592930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b00109b90 0x7f4b001103c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009ca0 tx=0x7f4af802a8e0 comp rx=0 tx=0).stop 2024-08-28T19:31:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.428+0000 7f4b04a78640 1 -- 172.21.15.33:0/2005592930 shutdown_connections 2024-08-28T19:31:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.429+0000 7f4b04a78640 1 --2- 172.21.15.33:0/2005592930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b00109b90 0x7f4b001103c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.429+0000 7f4b04a78640 1 --2- 172.21.15.33:0/2005592930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b00109240 0x7f4b00109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.429+0000 7f4b04a78640 1 --2- 172.21.15.33:0/2005592930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b00103900 0x7f4b00103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.429+0000 7f4b04a78640 1 -- 172.21.15.33:0/2005592930 >> 172.21.15.33:0/2005592930 conn(0x7f4b0007b5f0 msgr2=0x7f4b0007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.429+0000 7f4b04a78640 1 -- 172.21.15.33:0/2005592930 shutdown_connections 2024-08-28T19:31:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.429+0000 7f4b04a78640 1 -- 172.21.15.33:0/2005592930 wait complete. 2024-08-28T19:31:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.429+0000 7f4b04a78640 1 Processor -- start 2024-08-28T19:31:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4b04a78640 1 -- start start 2024-08-28T19:31:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4b04a78640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b00103900 0x7f4b0019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4b04a78640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b00109240 0x7f4b0019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4b04a78640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b00109b90 0x7f4b001a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4b04a78640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4b00075c90 con 0x7f4b00103900 2024-08-28T19:31:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4b04a78640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4b00075b10 con 0x7f4b00109b90 2024-08-28T19:31:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4b04a78640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4b00075e10 con 0x7f4b00109240 2024-08-28T19:31:57.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4afe59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b00103900 0x7f4b0019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4afe59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b00103900 0x7f4b0019c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58634/0 (socket says 172.21.15.33:58634) 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4afe59c640 1 -- 172.21.15.33:0/3764693849 learned_addr learned my addr 172.21.15.33:0/3764693849 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4af5d9b640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b00109240 0x7f4b0019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4afed9d640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b00109b90 0x7f4b001a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4afe59c640 1 -- 172.21.15.33:0/3764693849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b00109240 msgr2=0x7f4b0019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4afe59c640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b00109240 0x7f4b0019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4afe59c640 1 -- 172.21.15.33:0/3764693849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b00109b90 msgr2=0x7f4b001a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4afe59c640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b00109b90 0x7f4b001a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.430+0000 7f4afe59c640 1 -- 172.21.15.33:0/3764693849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b001a24a0 con 0x7f4b00103900 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.431+0000 7f4afe59c640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b00103900 0x7f4b0019c540 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4af000d770 tx=0x7f4af000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.431+0000 7f4af7fff640 1 -- 172.21.15.33:0/3764693849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0017070 con 0x7f4b00103900 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.431+0000 7f4b04a78640 1 -- 172.21.15.33:0/3764693849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b001a2790 con 0x7f4b00103900 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.431+0000 7f4af7fff640 1 -- 172.21.15.33:0/3764693849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4af0009820 con 0x7f4b00103900 2024-08-28T19:31:57.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.431+0000 7f4af7fff640 1 -- 172.21.15.33:0/3764693849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0004bc0 con 0x7f4b00103900 2024-08-28T19:31:57.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.431+0000 7f4b04a78640 1 -- 172.21.15.33:0/3764693849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b001a8ef0 con 0x7f4b00103900 2024-08-28T19:31:57.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.432+0000 7f4b04a78640 1 -- 172.21.15.33:0/3764693849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b00103d10 con 0x7f4b00103900 2024-08-28T19:31:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.434+0000 7f4af7fff640 1 -- 172.21.15.33:0/3764693849 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f4af00099d0 con 0x7f4b00103900 2024-08-28T19:31:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.434+0000 7f4af7fff640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4aec0b4c10 0x7f4aec0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.435+0000 7f4af5d9b640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4aec0b4c10 0x7f4aec0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:57.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.435+0000 7f4af7fff640 1 -- 172.21.15.33:0/3764693849 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4af00e55a0 con 0x7f4b00103900 2024-08-28T19:31:57.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.435+0000 7f4af5d9b640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4aec0b4c10 0x7f4aec0b7120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b00106db0 tx=0x7f4ae8009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:57.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.438+0000 7f4af7fff640 1 -- 172.21.15.33:0/3764693849 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4af00ac100 con 0x7f4b00103900 2024-08-28T19:31:57.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:57 smithi122 ceph-mon[22174]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:31:57.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:57 smithi122 ceph-mon[22174]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:31:57.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.630+0000 7f4b04a78640 1 -- 172.21.15.33:0/3764693849 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4b001023e0 con 0x7f4aec0b4c10 2024-08-28T19:31:57.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.643+0000 7f4af7fff640 1 -- 172.21.15.33:0/3764693849 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f4b001023e0 con 0x7f4aec0b4c10 2024-08-28T19:31:57.645 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-28T19:31:57.645 INFO:teuthology.orchestra.run.smithi033.stdout:mds.a smithi033 running (2m) 7s ago 2m 88.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 326feb1f85e5 2024-08-28T19:31:57.645 INFO:teuthology.orchestra.run.smithi033.stdout:mds.b smithi059 running (2m) 9s ago 2m 87.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 74546f5e36ea 2024-08-28T19:31:57.645 INFO:teuthology.orchestra.run.smithi033.stdout:mds.c smithi122 running (2m) 8s ago 2m 89.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 36b99b71560e 2024-08-28T19:31:57.645 INFO:teuthology.orchestra.run.smithi033.stdout:mds.d smithi033 running (2m) 7s ago 2m 82.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 b390429d60dd 2024-08-28T19:31:57.645 INFO:teuthology.orchestra.run.smithi033.stdout:mds.e smithi059 running (2m) 9s ago 2m 88.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 265c8af5c929 2024-08-28T19:31:57.645 INFO:teuthology.orchestra.run.smithi033.stdout:mds.f smithi122 running (2m) 8s ago 2m 87.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 3acba08b0a75 2024-08-28T19:31:57.645 INFO:teuthology.orchestra.run.smithi033.stdout:mds.g smithi033 running (2m) 7s ago 2m 88.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 207c1d2d2c39 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mds.h smithi059 running (2m) 9s ago 2m 87.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 9175ca488cbe 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mds.i smithi122 running (2m) 8s ago 2m 94.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 7a9af04faa1a 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mds.j smithi033 running (2m) 7s ago 2m 81.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 0ee44fa640ae 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mds.k smithi059 running (2m) 9s ago 2m 86.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 a4377b1f53eb 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mds.l smithi122 running (2m) 8s ago 2m 86.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 b88c84cba989 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi033 *:9283,8765 running (10m) 7s ago 10m 586M - 19.3.0-4560-gd19e6118 79f4cde5e369 bb24acc153bb 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi059 *:8443,8765 running (8m) 9s ago 8m 526M - 19.3.0-4560-gd19e6118 79f4cde5e369 9ffbb7fe24ac 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.z smithi122 *:8443,8765 running (8m) 8s ago 8m 523M - 19.3.0-4560-gd19e6118 79f4cde5e369 9fcb43ec1ad2 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (10m) 7s ago 10m 125M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 35ddce2b1800 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi059 running (8m) 9s ago 8m 108M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 2a861e19a774 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi122 running (8m) 8s ago 8m 110M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 a3d815d81d0f 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (7m) 7s ago 7m 115M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 a19dd24f046c 2024-08-28T19:31:57.646 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi059 running (7m) 9s ago 7m 123M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 acd1b7d7de38 2024-08-28T19:31:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi122 running (6m) 8s ago 6m 115M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 97edf6428321 2024-08-28T19:31:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (6m) 7s ago 6m 111M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 256fae48bfee 2024-08-28T19:31:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi059 running (6m) 9s ago 6m 111M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 64334947cfac 2024-08-28T19:31:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi122 running (5m) 8s ago 5m 124M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 10c9bb67e4ed 2024-08-28T19:31:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi033 running (5m) 7s ago 5m 121M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 de71e0a6d850 2024-08-28T19:31:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi059 running (4m) 9s ago 4m 113M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 1cf608bfa46b 2024-08-28T19:31:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:osd.8 smithi122 running (4m) 8s ago 4m 120M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 ee95fd10e180 2024-08-28T19:31:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:osd.9 smithi033 running (4m) 7s ago 4m 110M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 7085be2043e1 2024-08-28T19:31:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:osd.10 smithi059 running (3m) 9s ago 3m 125M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 8d2911b3d484 2024-08-28T19:31:57.647 INFO:teuthology.orchestra.run.smithi033.stdout:osd.11 smithi122 running (3m) 8s ago 3m 119M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 def772704a4b 2024-08-28T19:31:57.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 -- 172.21.15.33:0/3764693849 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4aec0b4c10 msgr2=0x7f4aec0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:57.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4aec0b4c10 0x7f4aec0b7120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b00106db0 tx=0x7f4ae8009110 comp rx=0 tx=0).stop 2024-08-28T19:31:57.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 -- 172.21.15.33:0/3764693849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b00103900 msgr2=0x7f4b0019c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:57.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b00103900 0x7f4b0019c540 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4af000d770 tx=0x7f4af000db70 comp rx=0 tx=0).stop 2024-08-28T19:31:57.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 -- 172.21.15.33:0/3764693849 shutdown_connections 2024-08-28T19:31:57.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b00109b90 0x7f4b001a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:57.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4aec0b4c10 0x7f4aec0b7120 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:57.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b00109240 0x7f4b0019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:57.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 --2- 172.21.15.33:0/3764693849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b00103900 0x7f4b0019c540 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:57.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 -- 172.21.15.33:0/3764693849 >> 172.21.15.33:0/3764693849 conn(0x7f4b0007b5f0 msgr2=0x7f4b00107bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:57.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 -- 172.21.15.33:0/3764693849 shutdown_connections 2024-08-28T19:31:57.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:57.645+0000 7f4b04a78640 1 -- 172.21.15.33:0/3764693849 wait complete. 2024-08-28T19:31:57.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:57 smithi059 ceph-mon[22052]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:31:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:57 smithi059 ceph-mon[22052]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:31:58.402 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-28T19:31:58.660 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:31:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.163+0000 7f6980fe0640 1 -- 172.21.15.33:0/2285463014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c103900 msgr2=0x7f697c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.163+0000 7f6980fe0640 1 --2- 172.21.15.33:0/2285463014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c103900 0x7f697c103d10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f696c009900 tx=0x7f696c02a410 comp rx=0 tx=0).stop 2024-08-28T19:31:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.163+0000 7f6980fe0640 1 -- 172.21.15.33:0/2285463014 shutdown_connections 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.163+0000 7f6980fe0640 1 --2- 172.21.15.33:0/2285463014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c109b90 0x7f697c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.163+0000 7f6980fe0640 1 --2- 172.21.15.33:0/2285463014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697c109240 0x7f697c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.163+0000 7f6980fe0640 1 --2- 172.21.15.33:0/2285463014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c103900 0x7f697c103d10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.163+0000 7f6980fe0640 1 -- 172.21.15.33:0/2285463014 >> 172.21.15.33:0/2285463014 conn(0x7f697c07b5f0 msgr2=0x7f697c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.163+0000 7f6980fe0640 1 -- 172.21.15.33:0/2285463014 shutdown_connections 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.163+0000 7f6980fe0640 1 -- 172.21.15.33:0/2285463014 wait complete. 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6980fe0640 1 Processor -- start 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6980fe0640 1 -- start start 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6980fe0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697c103900 0x7f697c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6980fe0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c109240 0x7f697c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6980fe0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c109b90 0x7f697c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6980fe0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f697c113850 con 0x7f697c109240 2024-08-28T19:31:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6980fe0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f697c1136d0 con 0x7f697c109b90 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6980fe0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f697c1139d0 con 0x7f697c103900 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6979d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c109240 0x7f697c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6979d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c109240 0x7f697c19a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60258/0 (socket says 172.21.15.33:60258) 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f6979d9b640 1 -- 172.21.15.33:0/3847186396 learned_addr learned my addr 172.21.15.33:0/3847186396 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f697ad9d640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c109b90 0x7f697c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.164+0000 7f697a59c640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697c103900 0x7f697c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f6979d9b640 1 -- 172.21.15.33:0/3847186396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697c103900 msgr2=0x7f697c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f6979d9b640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697c103900 0x7f697c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f6979d9b640 1 -- 172.21.15.33:0/3847186396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c109b90 msgr2=0x7f697c19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f6979d9b640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c109b90 0x7f697c19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f6979d9b640 1 -- 172.21.15.33:0/3847186396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c1a00f0 con 0x7f697c109240 2024-08-28T19:31:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f6979d9b640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c109240 0x7f697c19a7e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f697000c8c0 tx=0x7f697000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f696b7fe640 1 -- 172.21.15.33:0/3847186396 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970007bb0 con 0x7f697c109240 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f6980fe0640 1 -- 172.21.15.33:0/3847186396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697c1a03e0 con 0x7f697c109240 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f696b7fe640 1 -- 172.21.15.33:0/3847186396 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6970007d50 con 0x7f697c109240 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f696b7fe640 1 -- 172.21.15.33:0/3847186396 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69700187c0 con 0x7f697c109240 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.165+0000 7f6980fe0640 1 -- 172.21.15.33:0/3847186396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f697c1a6c00 con 0x7f697c109240 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.166+0000 7f6980fe0640 1 -- 172.21.15.33:0/3847186396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697c103d10 con 0x7f697c109240 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.168+0000 7f696b7fe640 1 -- 172.21.15.33:0/3847186396 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f697000fa20 con 0x7f697c109240 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.168+0000 7f696b7fe640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69640b4bb0 0x7f69640b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.169+0000 7f696b7fe640 1 -- 172.21.15.33:0/3847186396 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f69700e58b0 con 0x7f697c109240 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.169+0000 7f697a59c640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69640b4bb0 0x7f69640b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.169+0000 7f697a59c640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69640b4bb0 0x7f69640b70c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f696c031440 tx=0x7f696c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:31:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.172+0000 7f696b7fe640 1 -- 172.21.15.33:0/3847186396 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6970014030 con 0x7f697c109240 2024-08-28T19:31:59.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.365+0000 7f6980fe0640 1 -- 172.21.15.33:0/3847186396 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f697c0635a0 con 0x7f69640b4bb0 2024-08-28T19:31:59.367 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:59 smithi033 ceph-mon[18549]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:31:59.367 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:59 smithi033 ceph-mon[18549]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-08-28T19:31:59.367 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:31:59 smithi033 ceph-mon[18549]: mgrmap e22: x(active, since 8m), standbys: y, z 2024-08-28T19:31:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.371+0000 7f696b7fe640 1 -- 172.21.15.33:0/3847186396 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f697c0635a0 con 0x7f69640b4bb0 2024-08-28T19:31:59.373 INFO:teuthology.orchestra.run.smithi033.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-28T19:31:59.373 INFO:teuthology.orchestra.run.smithi033.stdout:mds.all 12/12 10s ago 2m smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi122=c;smithi122=f;smithi122=i;smithi122=l;count:12 2024-08-28T19:31:59.373 INFO:teuthology.orchestra.run.smithi033.stdout:mgr 3/3 10s ago 8m smithi033=x;smithi059=y;smithi122=z;count:3 2024-08-28T19:31:59.373 INFO:teuthology.orchestra.run.smithi033.stdout:mon 3/3 10s ago 9m smithi033:172.21.15.33=a;smithi059:172.21.15.59=b;smithi122:172.21.15.122=c;count:3 2024-08-28T19:31:59.373 INFO:teuthology.orchestra.run.smithi033.stdout:osd 12 10s ago - 2024-08-28T19:31:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 -- 172.21.15.33:0/3847186396 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69640b4bb0 msgr2=0x7f69640b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69640b4bb0 0x7f69640b70c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f696c031440 tx=0x7f696c009560 comp rx=0 tx=0).stop 2024-08-28T19:31:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 -- 172.21.15.33:0/3847186396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c109240 msgr2=0x7f697c19a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:31:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c109240 0x7f697c19a7e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f697000c8c0 tx=0x7f697000cd80 comp rx=0 tx=0).stop 2024-08-28T19:31:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 -- 172.21.15.33:0/3847186396 shutdown_connections 2024-08-28T19:31:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c109b90 0x7f697c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c109240 0x7f697c19a7e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69640b4bb0 0x7f69640b70c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 --2- 172.21.15.33:0/3847186396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f697c103900 0x7f697c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:31:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 -- 172.21.15.33:0/3847186396 >> 172.21.15.33:0/3847186396 conn(0x7f697c07b5f0 msgr2=0x7f697c1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:31:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 -- 172.21.15.33:0/3847186396 shutdown_connections 2024-08-28T19:31:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:31:59.373+0000 7f6980fe0640 1 -- 172.21.15.33:0/3847186396 wait complete. 2024-08-28T19:31:59.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:59 smithi122 ceph-mon[22174]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:31:59.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:59 smithi122 ceph-mon[22174]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-08-28T19:31:59.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:31:59 smithi122 ceph-mon[22174]: mgrmap e22: x(active, since 8m), standbys: y, z 2024-08-28T19:31:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:59 smithi059 ceph-mon[22052]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:31:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:59 smithi059 ceph-mon[22052]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-08-28T19:31:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:31:59 smithi059 ceph-mon[22052]: mgrmap e22: x(active, since 8m), standbys: y, z 2024-08-28T19:32:00.066 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-28T19:32:00.321 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:00.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:00 smithi033 ceph-mon[18549]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:00.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:00 smithi059 ceph-mon[22052]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:00.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:00 smithi122 ceph-mon[22174]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.805+0000 7fbd44fb3640 1 -- 172.21.15.33:0/1267862643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd4010fee0 msgr2=0x7fbd40112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.805+0000 7fbd44fb3640 1 --2- 172.21.15.33:0/1267862643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd4010fee0 0x7fbd40112300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbd38009ca0 tx=0x7fbd3802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.806+0000 7fbd44fb3640 1 -- 172.21.15.33:0/1267862643 shutdown_connections 2024-08-28T19:32:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.806+0000 7fbd44fb3640 1 --2- 172.21.15.33:0/1267862643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd4010fee0 0x7fbd40112300 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.806+0000 7fbd44fb3640 1 --2- 172.21.15.33:0/1267862643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd40075e20 0x7fbd4010f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.806+0000 7fbd44fb3640 1 --2- 172.21.15.33:0/1267862643 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd400754d0 0x7fbd400758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.806+0000 7fbd44fb3640 1 -- 172.21.15.33:0/1267862643 >> 172.21.15.33:0/1267862643 conn(0x7fbd4007b5f0 msgr2=0x7fbd4007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.806+0000 7fbd44fb3640 1 -- 172.21.15.33:0/1267862643 shutdown_connections 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.806+0000 7fbd44fb3640 1 -- 172.21.15.33:0/1267862643 wait complete. 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.806+0000 7fbd44fb3640 1 Processor -- start 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.806+0000 7fbd44fb3640 1 -- start start 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd44fb3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd400754d0 0x7fbd4019c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd44fb3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd40075e20 0x7fbd4019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd44fb3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd4010fee0 0x7fbd401a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd44fb3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbd40115a20 con 0x7fbd40075e20 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd44fb3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbd401158a0 con 0x7fbd400754d0 2024-08-28T19:32:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd44fb3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbd40115ba0 con 0x7fbd4010fee0 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd40075e20 0x7fbd4019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd40075e20 0x7fbd4019c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60278/0 (socket says 172.21.15.33:60278) 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3dd9b640 1 -- 172.21.15.33:0/611145668 learned_addr learned my addr 172.21.15.33:0/611145668 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3ed9d640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd4010fee0 0x7fbd401a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3e59c640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd400754d0 0x7fbd4019c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3dd9b640 1 -- 172.21.15.33:0/611145668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd4010fee0 msgr2=0x7fbd401a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3dd9b640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd4010fee0 0x7fbd401a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3dd9b640 1 -- 172.21.15.33:0/611145668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd400754d0 msgr2=0x7fbd4019c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3dd9b640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd400754d0 0x7fbd4019c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3dd9b640 1 -- 172.21.15.33:0/611145668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd401a2220 con 0x7fbd40075e20 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.807+0000 7fbd3dd9b640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd40075e20 0x7fbd4019c910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400c970 tx=0x7fbd3400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.808+0000 7fbd2f7fe640 1 -- 172.21.15.33:0/611145668 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34007bb0 con 0x7fbd40075e20 2024-08-28T19:32:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.808+0000 7fbd44fb3640 1 -- 172.21.15.33:0/611145668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd401a2510 con 0x7fbd40075e20 2024-08-28T19:32:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.808+0000 7fbd2f7fe640 1 -- 172.21.15.33:0/611145668 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd34007d50 con 0x7fbd40075e20 2024-08-28T19:32:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.808+0000 7fbd2f7fe640 1 -- 172.21.15.33:0/611145668 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3400f450 con 0x7fbd40075e20 2024-08-28T19:32:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.808+0000 7fbd44fb3640 1 -- 172.21.15.33:0/611145668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd401a8d30 con 0x7fbd40075e20 2024-08-28T19:32:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.809+0000 7fbd44fb3640 1 -- 172.21.15.33:0/611145668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd400758e0 con 0x7fbd40075e20 2024-08-28T19:32:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.811+0000 7fbd2f7fe640 1 -- 172.21.15.33:0/611145668 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fbd34004eb0 con 0x7fbd40075e20 2024-08-28T19:32:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.812+0000 7fbd2f7fe640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbd280b4bb0 0x7fbd280b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.812+0000 7fbd3e59c640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbd280b4bb0 0x7fbd280b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.812+0000 7fbd2f7fe640 1 -- 172.21.15.33:0/611145668 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fbd340e5790 con 0x7fbd40075e20 2024-08-28T19:32:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.812+0000 7fbd3e59c640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbd280b4bb0 0x7fbd280b70c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbd30005e10 tx=0x7fbd30005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:00.815+0000 7fbd2f7fe640 1 -- 172.21.15.33:0/611145668 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbd34014030 con 0x7fbd40075e20 2024-08-28T19:32:01.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.009+0000 7fbd44fb3640 1 -- 172.21.15.33:0/611145668 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fbd40101d00 con 0x7fbd280b4bb0 2024-08-28T19:32:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.010+0000 7fbd2f7fe640 1 -- 172.21.15.33:0/611145668 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fbd40101d00 con 0x7fbd280b4bb0 2024-08-28T19:32:01.012 INFO:teuthology.orchestra.run.smithi033.stdout:HOST ADDR LABELS STATUS 2024-08-28T19:32:01.012 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 172.21.15.33 2024-08-28T19:32:01.012 INFO:teuthology.orchestra.run.smithi033.stdout:smithi059 172.21.15.59 2024-08-28T19:32:01.012 INFO:teuthology.orchestra.run.smithi033.stdout:smithi122 172.21.15.122 2024-08-28T19:32:01.012 INFO:teuthology.orchestra.run.smithi033.stdout:3 hosts in cluster 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 -- 172.21.15.33:0/611145668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbd280b4bb0 msgr2=0x7fbd280b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbd280b4bb0 0x7fbd280b70c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbd30005e10 tx=0x7fbd30005da0 comp rx=0 tx=0).stop 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 -- 172.21.15.33:0/611145668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd40075e20 msgr2=0x7fbd4019c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd40075e20 0x7fbd4019c910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400c970 tx=0x7fbd3400ce30 comp rx=0 tx=0).stop 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 -- 172.21.15.33:0/611145668 shutdown_connections 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbd280b4bb0 0x7fbd280b70c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd4010fee0 0x7fbd401a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd40075e20 0x7fbd4019c910 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 --2- 172.21.15.33:0/611145668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd400754d0 0x7fbd4019c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 -- 172.21.15.33:0/611145668 >> 172.21.15.33:0/611145668 conn(0x7fbd4007b5f0 msgr2=0x7fbd401015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 -- 172.21.15.33:0/611145668 shutdown_connections 2024-08-28T19:32:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:01.013+0000 7fbd44fb3640 1 -- 172.21.15.33:0/611145668 wait complete. 2024-08-28T19:32:01.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:01 smithi033 ceph-mon[18549]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-28T19:32:01.717 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-28T19:32:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:01 smithi059 ceph-mon[22052]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-28T19:32:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:01 smithi122 ceph-mon[22174]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-28T19:32:01.973 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:02.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:02 smithi033 ceph-mon[18549]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.505+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/2461182797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d58109b90 msgr2=0x7f8d581103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.505+0000 7f8d5cb1f640 1 --2- 172.21.15.33:0/2461182797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d58109b90 0x7f8d581103c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009ca0 tx=0x7f8d5002a8e0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.506+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/2461182797 shutdown_connections 2024-08-28T19:32:02.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.506+0000 7f8d5cb1f640 1 --2- 172.21.15.33:0/2461182797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d58109b90 0x7f8d581103c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.506+0000 7f8d5cb1f640 1 --2- 172.21.15.33:0/2461182797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d58109240 0x7f8d58109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.506+0000 7f8d5cb1f640 1 --2- 172.21.15.33:0/2461182797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d58103900 0x7f8d58103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.506+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/2461182797 >> 172.21.15.33:0/2461182797 conn(0x7f8d5807b5f0 msgr2=0x7f8d5807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.506+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/2461182797 shutdown_connections 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.506+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/2461182797 wait complete. 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.506+0000 7f8d5cb1f640 1 Processor -- start 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.506+0000 7f8d5cb1f640 1 -- start start 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d5cb1f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d58103900 0x7f8d5819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d5cb1f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d58109240 0x7f8d5819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d5cb1f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d58109b90 0x7f8d5819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d5cb1f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8d58113890 con 0x7f8d58109240 2024-08-28T19:32:02.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d5cb1f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8d58113710 con 0x7f8d58103900 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d5cb1f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8d58113a10 con 0x7f8d58109b90 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d55d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d58109240 0x7f8d5819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d55d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d58109240 0x7f8d5819a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60284/0 (socket says 172.21.15.33:60284) 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d55d9b640 1 -- 172.21.15.33:0/1663067444 learned_addr learned my addr 172.21.15.33:0/1663067444 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d56d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d58109b90 0x7f8d5819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d5659c640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d58103900 0x7f8d5819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d55d9b640 1 -- 172.21.15.33:0/1663067444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d58109b90 msgr2=0x7f8d5819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d55d9b640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d58109b90 0x7f8d5819fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d55d9b640 1 -- 172.21.15.33:0/1663067444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d58103900 msgr2=0x7f8d5819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d55d9b640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d58103900 0x7f8d5819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d55d9b640 1 -- 172.21.15.33:0/1663067444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d581a01f0 con 0x7f8d58109240 2024-08-28T19:32:02.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.507+0000 7f8d55d9b640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d58109240 0x7f8d5819a820 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c006fd0 tx=0x7f8d4c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.508+0000 7f8d477fe640 1 -- 172.21.15.33:0/1663067444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c011830 con 0x7f8d58109240 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.508+0000 7f8d477fe640 1 -- 172.21.15.33:0/1663067444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d4c016070 con 0x7f8d58109240 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.508+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/1663067444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d581a04e0 con 0x7f8d58109240 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.508+0000 7f8d477fe640 1 -- 172.21.15.33:0/1663067444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c010e00 con 0x7f8d58109240 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.508+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/1663067444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d581a6c40 con 0x7f8d58109240 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.509+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/1663067444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d58103d10 con 0x7f8d58109240 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.510+0000 7f8d477fe640 1 -- 172.21.15.33:0/1663067444 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f8d4c01b460 con 0x7f8d58109240 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.511+0000 7f8d477fe640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d400b4c00 0x7f8d400b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.511+0000 7f8d5659c640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d400b4c00 0x7f8d400b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.511+0000 7f8d477fe640 1 -- 172.21.15.33:0/1663067444 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8d4c0e4a80 con 0x7f8d58109240 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.511+0000 7f8d5659c640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d400b4c00 0x7f8d400b7110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800bbe0 tx=0x7f8d4800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:02.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.515+0000 7f8d477fe640 1 -- 172.21.15.33:0/1663067444 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d4c0e6e20 con 0x7f8d58109240 2024-08-28T19:32:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.711+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/1663067444 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f8d580635a0 con 0x7f8d400b4c00 2024-08-28T19:32:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.713+0000 7f8d477fe640 1 -- 172.21.15.33:0/1663067444 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f8d580635a0 con 0x7f8d400b4c00 2024-08-28T19:32:02.715 INFO:teuthology.orchestra.run.smithi033.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-28T19:32:02.715 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-28T19:32:02.715 INFO:teuthology.orchestra.run.smithi033.stdout:smithi059 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009L400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-28T19:32:02.715 INFO:teuthology.orchestra.run.smithi033.stdout:smithi122 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010U400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-28T19:32:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/1663067444 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d400b4c00 msgr2=0x7f8d400b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d400b4c00 0x7f8d400b7110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800bbe0 tx=0x7f8d4800b390 comp rx=0 tx=0).stop 2024-08-28T19:32:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/1663067444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d58109240 msgr2=0x7f8d5819a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d58109240 0x7f8d5819a820 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c006fd0 tx=0x7f8d4c00b8e0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/1663067444 shutdown_connections 2024-08-28T19:32:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d400b4c00 0x7f8d400b7110 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d58109b90 0x7f8d5819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d58109240 0x7f8d5819a820 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 --2- 172.21.15.33:0/1663067444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d58103900 0x7f8d5819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/1663067444 >> 172.21.15.33:0/1663067444 conn(0x7f8d5807b5f0 msgr2=0x7f8d581072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/1663067444 shutdown_connections 2024-08-28T19:32:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:02.716+0000 7f8d5cb1f640 1 -- 172.21.15.33:0/1663067444 wait complete. 2024-08-28T19:32:02.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:02 smithi059 ceph-mon[22052]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:02 smithi122 ceph-mon[22174]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:03.396 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:03 smithi033 ceph-mon[18549]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-28T19:32:03.425 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-28T19:32:03.433 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-08-28T19:32:03.433 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-28T19:32:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:03.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:03 smithi059 ceph-mon[22052]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-28T19:32:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:03 smithi122 ceph-mon[22174]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-28T19:32:04.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.191+0000 7fd31a99c640 1 -- 172.21.15.33:0/1006565521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd314109240 msgr2=0x7fd314109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:04.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.191+0000 7fd31a99c640 1 --2- 172.21.15.33:0/1006565521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd314109240 0x7fd314109650 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd308009900 tx=0x7fd30802a410 comp rx=0 tx=0).stop 2024-08-28T19:32:04.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.191+0000 7fd31a99c640 1 -- 172.21.15.33:0/1006565521 shutdown_connections 2024-08-28T19:32:04.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.191+0000 7fd31a99c640 1 --2- 172.21.15.33:0/1006565521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd314109b90 0x7fd3141103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.191+0000 7fd31a99c640 1 --2- 172.21.15.33:0/1006565521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd314109240 0x7fd314109650 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.191+0000 7fd31a99c640 1 --2- 172.21.15.33:0/1006565521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd314103900 0x7fd314103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.191+0000 7fd31a99c640 1 -- 172.21.15.33:0/1006565521 >> 172.21.15.33:0/1006565521 conn(0x7fd31407b5f0 msgr2=0x7fd31407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.191+0000 7fd31a99c640 1 -- 172.21.15.33:0/1006565521 shutdown_connections 2024-08-28T19:32:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.192+0000 7fd31a99c640 1 -- 172.21.15.33:0/1006565521 wait complete. 2024-08-28T19:32:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.192+0000 7fd31a99c640 1 Processor -- start 2024-08-28T19:32:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.192+0000 7fd31a99c640 1 -- start start 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd31a99c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd314103900 0x7fd31419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd31a99c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd314109240 0x7fd31419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd31a99c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd314109b90 0x7fd31419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd31a99c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd3141138f0 con 0x7fd314109240 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd31a99c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd314113770 con 0x7fd314109b90 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd31a99c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd314113a70 con 0x7fd314103900 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd318f39640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd314109b90 0x7fd31419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd313fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd314103900 0x7fd31419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd3137fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd314109240 0x7fd31419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd318f39640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd314109b90 0x7fd31419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:58290/0 (socket says 172.21.15.33:58290) 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd318f39640 1 -- 172.21.15.33:0/632231727 learned_addr learned my addr 172.21.15.33:0/632231727 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:04.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd313fff640 1 -- 172.21.15.33:0/632231727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd314109b90 msgr2=0x7fd31419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd313fff640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd314109b90 0x7fd31419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd313fff640 1 -- 172.21.15.33:0/632231727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd314109240 msgr2=0x7fd31419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd313fff640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd314109240 0x7fd31419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.193+0000 7fd313fff640 1 -- 172.21.15.33:0/632231727 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3141a03d0 con 0x7fd314103900 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.194+0000 7fd3137fe640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd314109240 0x7fd31419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.194+0000 7fd313fff640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd314103900 0x7fd31419a460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd30400b3f0 tx=0x7fd30400b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.194+0000 7fd3117fa640 1 -- 172.21.15.33:0/632231727 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd304015020 con 0x7fd314103900 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.194+0000 7fd31a99c640 1 -- 172.21.15.33:0/632231727 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3141a06c0 con 0x7fd314103900 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.194+0000 7fd31a99c640 1 -- 172.21.15.33:0/632231727 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd314075390 con 0x7fd314103900 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.194+0000 7fd3117fa640 1 -- 172.21.15.33:0/632231727 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd304011ce0 con 0x7fd314103900 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.194+0000 7fd3117fa640 1 -- 172.21.15.33:0/632231727 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30401ad30 con 0x7fd314103900 2024-08-28T19:32:04.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.195+0000 7fd31a99c640 1 -- 172.21.15.33:0/632231727 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd300005290 con 0x7fd314103900 2024-08-28T19:32:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.197+0000 7fd3117fa640 1 -- 172.21.15.33:0/632231727 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fd304018020 con 0x7fd314103900 2024-08-28T19:32:04.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.198+0000 7fd3117fa640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2fc0b4b80 0x7fd2fc0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:04.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.198+0000 7fd3137fe640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2fc0b4b80 0x7fd2fc0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:04.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.198+0000 7fd3117fa640 1 -- 172.21.15.33:0/632231727 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd3040e50c0 con 0x7fd314103900 2024-08-28T19:32:04.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.198+0000 7fd3137fe640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2fc0b4b80 0x7fd2fc0b7090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd308009230 tx=0x7fd308031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:04.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.201+0000 7fd3117fa640 1 -- 172.21.15.33:0/632231727 <== mon.1 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd30401f020 con 0x7fd314103900 2024-08-28T19:32:04.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:04 smithi033 ceph-mon[18549]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.426+0000 7fd31a99c640 1 -- 172.21.15.33:0/632231727 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd300005850 con 0x7fd314103900 2024-08-28T19:32:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.427+0000 7fd3117fa640 1 -- 172.21.15.33:0/632231727 <== mon.1 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3130 (secure 0 0 0) 0x7fd3040abd20 con 0x7fd314103900 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:e27 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:btime 2024-08-28T19:30:27:414857+0000 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 27 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-08-28T19:29:48.755873+0000 2024-08-28T19:32:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-08-28T19:30:27.414831+0000 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 300 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 5 2024-08-28T19:32:04.430 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1,2,3,4 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24658,1=24653,2=24643,3=24631,4=24620} 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3,4] 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 0 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:qdb_cluster leader: 24658 members: 24658,24653,24643,24631,24620 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.i{0:24658} state up:active seq 6 addr [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.431 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.l{0:24595} state up:standby-replay seq 1 addr [v2:172.21.15.122:6832/2139914522,v1:172.21.15.122:6833/2139914522] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b{1:24653} state up:active seq 13 addr [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.e{1:24593} state up:standby-replay seq 1 addr [v2:172.21.15.59:6834/2308401306,v1:172.21.15.59:6835/2308401306] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c{2:24643} state up:active seq 17 addr [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.k{2:24572} state up:standby-replay seq 1 addr [v2:172.21.15.59:6832/1923629681,v1:172.21.15.59:6833/1923629681] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.f{3:24631} state up:active seq 18 addr [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a{3:14805} state up:standby-replay seq 1 addr [v2:172.21.15.33:6840/4138539893,v1:172.21.15.33:6841/4138539893] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.h{4:24620} state up:active seq 16 addr [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.g{4:14799} state up:standby-replay seq 1 addr [v2:172.21.15.33:6838/854752752,v1:172.21.15.33:6839/854752752] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-08-28T19:32:04.432 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:04.433 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.j{-1:14733} state up:standby seq 1 addr [v2:172.21.15.33:6834/3694119808,v1:172.21.15.33:6835/3694119808] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.433 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d{-1:14745} state up:standby seq 1 addr [v2:172.21.15.33:6836/1498510399,v1:172.21.15.33:6837/1498510399] compat {c=[1],r=[1],i=[1fff]}] 2024-08-28T19:32:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-08-28T19:32:04.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 -- 172.21.15.33:0/632231727 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2fc0b4b80 msgr2=0x7fd2fc0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2fc0b4b80 0x7fd2fc0b7090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd308009230 tx=0x7fd308031400 comp rx=0 tx=0).stop 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 -- 172.21.15.33:0/632231727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd314103900 msgr2=0x7fd31419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd314103900 0x7fd31419a460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd30400b3f0 tx=0x7fd30400b8b0 comp rx=0 tx=0).stop 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 -- 172.21.15.33:0/632231727 shutdown_connections 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd314109b90 0x7fd31419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd314109240 0x7fd31419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2fc0b4b80 0x7fd2fc0b7090 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 --2- 172.21.15.33:0/632231727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd314103900 0x7fd31419a460 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 -- 172.21.15.33:0/632231727 >> 172.21.15.33:0/632231727 conn(0x7fd31407b5f0 msgr2=0x7fd314107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 -- 172.21.15.33:0/632231727 shutdown_connections 2024-08-28T19:32:04.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:04.430+0000 7fd31a99c640 1 -- 172.21.15.33:0/632231727 wait complete. 2024-08-28T19:32:04.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:04 smithi059 ceph-mon[22052]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:04.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:04 smithi122 ceph-mon[22174]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:05.210 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-28T19:32:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:05.582 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:05 smithi033 ceph-mon[18549]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-08-28T19:32:05.582 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:05 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/632231727' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-28T19:32:05.684 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:05 smithi059 ceph-mon[22052]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-08-28T19:32:05.684 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:05 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/632231727' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-28T19:32:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:05 smithi122 ceph-mon[22174]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-08-28T19:32:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:05 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/632231727' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-28T19:32:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 -- 172.21.15.33:0/4042972316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8a0109240 msgr2=0x7fb8a0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 --2- 172.21.15.33:0/4042972316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8a0109240 0x7fb8a0109650 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb890009900 tx=0x7fb89002a410 comp rx=0 tx=0).stop 2024-08-28T19:32:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 -- 172.21.15.33:0/4042972316 shutdown_connections 2024-08-28T19:32:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 --2- 172.21.15.33:0/4042972316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8a0109b90 0x7fb8a01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 --2- 172.21.15.33:0/4042972316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8a0109240 0x7fb8a0109650 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 --2- 172.21.15.33:0/4042972316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8a0103900 0x7fb8a0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 -- 172.21.15.33:0/4042972316 >> 172.21.15.33:0/4042972316 conn(0x7fb8a007b5f0 msgr2=0x7fb8a007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 -- 172.21.15.33:0/4042972316 shutdown_connections 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 -- 172.21.15.33:0/4042972316 wait complete. 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 Processor -- start 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.976+0000 7fb8a763b640 1 -- start start 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a763b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8a0103900 0x7fb8a019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a763b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8a0109240 0x7fb8a019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a763b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8a0109b90 0x7fb8a019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a763b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a0113850 con 0x7fb8a0109b90 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a763b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a01136d0 con 0x7fb8a0103900 2024-08-28T19:32:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a763b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a01139d0 con 0x7fb8a0109240 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a53d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8a0103900 0x7fb8a019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a5bd8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8a0109b90 0x7fb8a019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a53d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8a0103900 0x7fb8a019a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:58310/0 (socket says 172.21.15.33:58310) 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a5bd8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8a0109b90 0x7fb8a019fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60324/0 (socket says 172.21.15.33:60324) 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a53d7640 1 -- 172.21.15.33:0/2459128951 learned_addr learned my addr 172.21.15.33:0/2459128951 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a4bd6640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8a0109240 0x7fb8a019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a53d7640 1 -- 172.21.15.33:0/2459128951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8a0109240 msgr2=0x7fb8a019a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a53d7640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8a0109240 0x7fb8a019a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a53d7640 1 -- 172.21.15.33:0/2459128951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8a0109b90 msgr2=0x7fb8a019fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a53d7640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8a0109b90 0x7fb8a019fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a53d7640 1 -- 172.21.15.33:0/2459128951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a01a0190 con 0x7fb8a0103900 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.977+0000 7fb8a5bd8640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8a0109b90 0x7fb8a019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:32:05.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.978+0000 7fb8a53d7640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8a0103900 0x7fb8a019a220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00e9f0 tx=0x7fb89c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.978+0000 7fb8967fc640 1 -- 172.21.15.33:0/2459128951 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00cd80 con 0x7fb8a0103900 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.978+0000 7fb8a763b640 1 -- 172.21.15.33:0/2459128951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a01a0480 con 0x7fb8a0103900 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.978+0000 7fb8967fc640 1 -- 172.21.15.33:0/2459128951 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb89c0108e0 con 0x7fb8a0103900 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.978+0000 7fb8967fc640 1 -- 172.21.15.33:0/2459128951 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c018980 con 0x7fb8a0103900 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.978+0000 7fb8a763b640 1 -- 172.21.15.33:0/2459128951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a01a6be0 con 0x7fb8a0103900 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.979+0000 7fb8a763b640 1 -- 172.21.15.33:0/2459128951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a0103d10 con 0x7fb8a0103900 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.980+0000 7fb8967fc640 1 -- 172.21.15.33:0/2459128951 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fb89c010430 con 0x7fb8a0103900 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.981+0000 7fb8967fc640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb88c0b4b80 0x7fb88c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.981+0000 7fb8a4bd6640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb88c0b4b80 0x7fb88c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.981+0000 7fb8967fc640 1 -- 172.21.15.33:0/2459128951 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fb89c0e59c0 con 0x7fb8a0103900 2024-08-28T19:32:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.982+0000 7fb8a4bd6640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb88c0b4b80 0x7fb88c0b7090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb890009230 tx=0x7fb890031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:05.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:05.986+0000 7fb8967fc640 1 -- 172.21.15.33:0/2459128951 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb89c0e7e20 con 0x7fb8a0103900 2024-08-28T19:32:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.171+0000 7fb8a763b640 1 -- 172.21.15.33:0/2459128951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fb8a002e430 con 0x7fb8a0103900 2024-08-28T19:32:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.172+0000 7fb8967fc640 1 -- 172.21.15.33:0/2459128951 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+6011 (secure 0 0 0) 0x7fb89c0ac680 con 0x7fb8a0103900 2024-08-28T19:32:06.174 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 84 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-08-28T19:21:33.380476+0000 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-08-28T19:31:27.886529+0000 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:crush_version 27 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:full_ratio 0.95 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:backfillfull_ratio 0.9 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:nearfull_ratio 0.85 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:require_min_compat_client luminous 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:min_compat_client luminous 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:require_osd_release squid 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:stretch_mode_enabled false 2024-08-28T19:32:06.175 INFO:teuthology.orchestra.run.smithi033.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:max_osd 12 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 up in weight 1 up_from 9 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6802/758428304,v1:172.21.15.33:6803/758428304] [v2:172.21.15.33:6804/758428304,v1:172.21.15.33:6805/758428304] exists,up 28b050d5-5123-449b-a514-0404c1520c85 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 up in weight 1 up_from 14 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6800/4789314,v1:172.21.15.59:6801/4789314] [v2:172.21.15.59:6802/4789314,v1:172.21.15.59:6803/4789314] exists,up f5a49e77-f9e9-4419-a08f-d61a8b5d08bb 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/1716397894,v1:172.21.15.122:6801/1716397894] [v2:172.21.15.122:6802/1716397894,v1:172.21.15.122:6803/1716397894] exists,up f65f62b9-a463-4efc-b62d-ee08a3ae7a29 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 up in weight 1 up_from 24 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6810/3029290427,v1:172.21.15.33:6811/3029290427] [v2:172.21.15.33:6812/3029290427,v1:172.21.15.33:6813/3029290427] exists,up 8d8d82b3-299e-4ee6-ba28-19aeb3d9def4 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 up in weight 1 up_from 30 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6808/1846789245,v1:172.21.15.59:6809/1846789245] [v2:172.21.15.59:6810/1846789245,v1:172.21.15.59:6811/1846789245] exists,up b2a493d3-6deb-48d7-9e3c-984bc4ef7837 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 up in weight 1 up_from 35 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6808/1476880697,v1:172.21.15.122:6809/1476880697] [v2:172.21.15.122:6810/1476880697,v1:172.21.15.122:6811/1476880697] exists,up 8b68288c-6c14-46db-9a5a-eff806c6bc02 2024-08-28T19:32:06.176 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 up in weight 1 up_from 41 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6818/1759127784,v1:172.21.15.33:6819/1759127784] [v2:172.21.15.33:6820/1759127784,v1:172.21.15.33:6821/1759127784] exists,up 35915467-02f3-452e-905a-6587abdb8224 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 up in weight 1 up_from 46 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6816/4018917656,v1:172.21.15.59:6817/4018917656] [v2:172.21.15.59:6818/4018917656,v1:172.21.15.59:6819/4018917656] exists,up b817ce35-db7a-4d3d-828b-c10ac52c6681 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:osd.8 up in weight 1 up_from 52 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6816/3673274503,v1:172.21.15.122:6817/3673274503] [v2:172.21.15.122:6818/3673274503,v1:172.21.15.122:6819/3673274503] exists,up 6fda6eb9-377c-426e-8dc6-5a16f4b0556b 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:osd.9 up in weight 1 up_from 58 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6826/3701959961,v1:172.21.15.33:6827/3701959961] [v2:172.21.15.33:6828/3701959961,v1:172.21.15.33:6829/3701959961] exists,up 3410400b-dc26-4823-b1d3-b1811bae8b73 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:osd.10 up in weight 1 up_from 63 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6824/3281579619,v1:172.21.15.59:6825/3281579619] [v2:172.21.15.59:6826/3281579619,v1:172.21.15.59:6827/3281579619] exists,up e6d6159a-9538-4ae7-8950-46356be55137 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:osd.11 up in weight 1 up_from 68 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6824/2920209132,v1:172.21.15.122:6825/2920209132] [v2:172.21.15.122:6826/2920209132,v1:172.21.15.122:6827/2920209132] exists,up 539ae544-528f-4eb7-bca0-dc8adebffbf5 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.8 [2,11] 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.10 [8,11] 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.6 [3,6] 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.11 [5,9] 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.1d [4,7] 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.21 [4,8] 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.33 [5,9] 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.34 [4,9] 2024-08-28T19:32:06.177 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.9 [5,8] 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.b [9,8] 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.13 [9,10] 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 4.1c [9,8] 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/2991102711 expires 2024-08-29T19:23:25.613755+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/422613927 expires 2024-08-29T19:23:25.613755+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6800/3998463883 expires 2024-08-29T19:21:57.279024+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/269585061 expires 2024-08-29T19:21:57.279024+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6801/3998463883 expires 2024-08-29T19:21:57.279024+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/1610535564 expires 2024-08-29T19:21:57.279024+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6801/1410887649 expires 2024-08-29T19:22:21.786187+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/456937089 expires 2024-08-29T19:22:21.786187+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/402597277 expires 2024-08-29T19:22:21.786187+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/500247 expires 2024-08-29T19:22:21.786187+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6800/1410887649 expires 2024-08-29T19:22:21.786187+0000 2024-08-28T19:32:06.178 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/4021316048 expires 2024-08-29T19:21:57.279024+0000 2024-08-28T19:32:06.179 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6800/855163195 expires 2024-08-29T19:23:25.613755+0000 2024-08-28T19:32:06.179 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6801/855163195 expires 2024-08-29T19:23:25.613755+0000 2024-08-28T19:32:06.179 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/458032239 expires 2024-08-29T19:23:25.613755+0000 2024-08-28T19:32:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 -- 172.21.15.33:0/2459128951 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb88c0b4b80 msgr2=0x7fb88c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb88c0b4b80 0x7fb88c0b7090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb890009230 tx=0x7fb890031400 comp rx=0 tx=0).stop 2024-08-28T19:32:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 -- 172.21.15.33:0/2459128951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8a0103900 msgr2=0x7fb8a019a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8a0103900 0x7fb8a019a220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00e9f0 tx=0x7fb89c00eeb0 comp rx=0 tx=0).stop 2024-08-28T19:32:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 -- 172.21.15.33:0/2459128951 shutdown_connections 2024-08-28T19:32:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8a0109b90 0x7fb8a019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb88c0b4b80 0x7fb88c0b7090 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8a0109240 0x7fb8a019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 --2- 172.21.15.33:0/2459128951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8a0103900 0x7fb8a019a220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 -- 172.21.15.33:0/2459128951 >> 172.21.15.33:0/2459128951 conn(0x7fb8a007b5f0 msgr2=0x7fb8a0107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 -- 172.21.15.33:0/2459128951 shutdown_connections 2024-08-28T19:32:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:06.175+0000 7fb8a763b640 1 -- 172.21.15.33:0/2459128951 wait complete. 2024-08-28T19:32:06.548 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:06 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2459128951' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-28T19:32:06.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:06 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2459128951' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-28T19:32:06.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:06 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2459128951' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-28T19:32:06.889 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-28T19:32:06.900 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:32:07.159 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:07.537 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:07 smithi033 ceph-mon[18549]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-28T19:32:07.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.628+0000 7fe992551640 1 -- 172.21.15.33:0/233453498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe98c105120 msgr2=0x7fe98c10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:07.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.628+0000 7fe992551640 1 --2- 172.21.15.33:0/233453498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe98c105120 0x7fe98c10d670 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe980009900 tx=0x7fe98002a410 comp rx=0 tx=0).stop 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.628+0000 7fe992551640 1 -- 172.21.15.33:0/233453498 shutdown_connections 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.628+0000 7fe992551640 1 --2- 172.21.15.33:0/233453498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98c10dc00 0x7fe98c1100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.628+0000 7fe992551640 1 --2- 172.21.15.33:0/233453498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe98c105120 0x7fe98c10d670 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.628+0000 7fe992551640 1 --2- 172.21.15.33:0/233453498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c1047d0 0x7fe98c104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.628+0000 7fe992551640 1 -- 172.21.15.33:0/233453498 >> 172.21.15.33:0/233453498 conn(0x7fe98c079500 msgr2=0x7fe98c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.628+0000 7fe992551640 1 -- 172.21.15.33:0/233453498 shutdown_connections 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.628+0000 7fe992551640 1 -- 172.21.15.33:0/233453498 wait complete. 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.629+0000 7fe992551640 1 Processor -- start 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.629+0000 7fe992551640 1 -- start start 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.629+0000 7fe992551640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98c1047d0 0x7fe98c19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.629+0000 7fe992551640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe98c105120 0x7fe98c19c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.629+0000 7fe992551640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c10dc00 0x7fe98c1a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.629+0000 7fe992551640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c113840 con 0x7fe98c105120 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.629+0000 7fe992551640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c1136c0 con 0x7fe98c10dc00 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.629+0000 7fe992551640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c1139c0 con 0x7fe98c1047d0 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe98c105120 0x7fe98c19c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe98c105120 0x7fe98c19c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60328/0 (socket says 172.21.15.33:60328) 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98b7fe640 1 -- 172.21.15.33:0/1757161796 learned_addr learned my addr 172.21.15.33:0/1757161796 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe990aee640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c10dc00 0x7fe98c1a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98bfff640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98c1047d0 0x7fe98c19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98b7fe640 1 -- 172.21.15.33:0/1757161796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98c1047d0 msgr2=0x7fe98c19c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98b7fe640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98c1047d0 0x7fe98c19c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98b7fe640 1 -- 172.21.15.33:0/1757161796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c10dc00 msgr2=0x7fe98c1a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:07.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98b7fe640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c10dc00 0x7fe98c1a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98b7fe640 1 -- 172.21.15.33:0/1757161796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c1a23a0 con 0x7fe98c105120 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98bfff640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98c1047d0 0x7fe98c19c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe98b7fe640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe98c105120 0x7fe98c19c9d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe98002a930 tx=0x7fe980004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe9897fa640 1 -- 172.21.15.33:0/1757161796 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98003f030 con 0x7fe98c105120 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe9897fa640 1 -- 172.21.15.33:0/1757161796 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe980003aa0 con 0x7fe98c105120 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe9897fa640 1 -- 172.21.15.33:0/1757161796 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe980035070 con 0x7fe98c105120 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe992551640 1 -- 172.21.15.33:0/1757161796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98c1a2630 con 0x7fe98c105120 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.630+0000 7fe992551640 1 -- 172.21.15.33:0/1757161796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98c1a8df0 con 0x7fe98c105120 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.631+0000 7fe992551640 1 -- 172.21.15.33:0/1757161796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe98c06bf90 con 0x7fe98c105120 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.633+0000 7fe9897fa640 1 -- 172.21.15.33:0/1757161796 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fe980042030 con 0x7fe98c105120 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.634+0000 7fe9897fa640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe9740b4c00 0x7fe9740b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.634+0000 7fe98bfff640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe9740b4c00 0x7fe9740b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.634+0000 7fe9897fa640 1 -- 172.21.15.33:0/1757161796 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe980106130 con 0x7fe98c105120 2024-08-28T19:32:07.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.634+0000 7fe98bfff640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe9740b4c00 0x7fe9740b7110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe98c06c690 tx=0x7fe97c005e70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:07.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.637+0000 7fe9897fa640 1 -- 172.21.15.33:0/1757161796 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe9800ccd90 con 0x7fe98c105120 2024-08-28T19:32:07.694 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:07 smithi122 ceph-mon[22174]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-28T19:32:07.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:07 smithi059 ceph-mon[22052]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-28T19:32:07.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.859+0000 7fe992551640 1 -- 172.21.15.33:0/1757161796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe98c19d560 con 0x7fe98c105120 2024-08-28T19:32:07.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.860+0000 7fe9897fa640 1 -- 172.21.15.33:0/1757161796 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7fe9800cc690 con 0x7fe98c105120 2024-08-28T19:32:07.861 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:07.861 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-08-28T19:30:27:414857+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:30:27.414831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24658,24653,24643,24631,24620]},"id":1}]} 2024-08-28T19:32:07.861 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.862+0000 7fe992551640 1 -- 172.21.15.33:0/1757161796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe9740b4c00 msgr2=0x7fe9740b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.862+0000 7fe992551640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe9740b4c00 0x7fe9740b7110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe98c06c690 tx=0x7fe97c005e70 comp rx=0 tx=0).stop 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.862+0000 7fe992551640 1 -- 172.21.15.33:0/1757161796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe98c105120 msgr2=0x7fe98c19c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.862+0000 7fe992551640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe98c105120 0x7fe98c19c9d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe98002a930 tx=0x7fe980004270 comp rx=0 tx=0).stop 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.862+0000 7fe992551640 1 -- 172.21.15.33:0/1757161796 shutdown_connections 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.862+0000 7fe992551640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe98c10dc00 0x7fe98c1a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.862+0000 7fe992551640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe98c105120 0x7fe98c19c9d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.862+0000 7fe992551640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe9740b4c00 0x7fe9740b7110 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.862+0000 7fe992551640 1 --2- 172.21.15.33:0/1757161796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe98c1047d0 0x7fe98c19c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.862+0000 7fe992551640 1 -- 172.21.15.33:0/1757161796 >> 172.21.15.33:0/1757161796 conn(0x7fe98c079500 msgr2=0x7fe98c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.863+0000 7fe992551640 1 -- 172.21.15.33:0/1757161796 shutdown_connections 2024-08-28T19:32:07.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:07.863+0000 7fe992551640 1 -- 172.21.15.33:0/1757161796 wait complete. 2024-08-28T19:32:08.593 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:08 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1757161796' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:08.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:32:08.710 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:08 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1757161796' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:08.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:08 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1757161796' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:08.877 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:09.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.361+0000 7f5099fa0640 1 -- 172.21.15.33:0/2796759573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5094107f50 msgr2=0x7f5094108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:09.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.361+0000 7f5099fa0640 1 --2- 172.21.15.33:0/2796759573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5094107f50 0x7f5094108360 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f507c009900 tx=0x7f507c02a410 comp rx=0 tx=0).stop 2024-08-28T19:32:09.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.361+0000 7f5099fa0640 1 -- 172.21.15.33:0/2796759573 shutdown_connections 2024-08-28T19:32:09.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.361+0000 7f5099fa0640 1 --2- 172.21.15.33:0/2796759573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50941088a0 0x7f509410f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:09.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.361+0000 7f5099fa0640 1 --2- 172.21.15.33:0/2796759573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5094107f50 0x7f5094108360 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:09.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.361+0000 7f5099fa0640 1 --2- 172.21.15.33:0/2796759573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5094102610 0x7f5094102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.361+0000 7f5099fa0640 1 -- 172.21.15.33:0/2796759573 >> 172.21.15.33:0/2796759573 conn(0x7f50940fe060 msgr2=0x7f50941004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.361+0000 7f5099fa0640 1 -- 172.21.15.33:0/2796759573 shutdown_connections 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.361+0000 7f5099fa0640 1 -- 172.21.15.33:0/2796759573 wait complete. 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5099fa0640 1 Processor -- start 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5099fa0640 1 -- start start 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5099fa0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5094102610 0x7f509419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5099fa0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5094107f50 0x7f509419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5099fa0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50941088a0 0x7f509419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5099fa0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5094112530 con 0x7f5094107f50 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5099fa0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f50941123b0 con 0x7f50941088a0 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5099fa0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f50941126b0 con 0x7f5094102610 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5093fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5094107f50 0x7f509419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5093fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5094107f50 0x7f509419b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56442/0 (socket says 172.21.15.33:56442) 2024-08-28T19:32:09.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5093fff640 1 -- 172.21.15.33:0/3656424491 learned_addr learned my addr 172.21.15.33:0/3656424491 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5098f9e640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5094102610 0x7f509419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f509979f640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50941088a0 0x7f509419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5093fff640 1 -- 172.21.15.33:0/3656424491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5094102610 msgr2=0x7f509419aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5093fff640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5094102610 0x7f509419aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5093fff640 1 -- 172.21.15.33:0/3656424491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50941088a0 msgr2=0x7f509419b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5093fff640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50941088a0 0x7f509419b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5093fff640 1 -- 172.21.15.33:0/3656424491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50941a60a0 con 0x7f5094107f50 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f509979f640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50941088a0 0x7f509419b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.362+0000 7f5098f9e640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5094102610 0x7f509419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.363+0000 7f5093fff640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5094107f50 0x7f509419b3e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f507c006010 tx=0x7f507c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.363+0000 7f5091ffb640 1 -- 172.21.15.33:0/3656424491 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c03f030 con 0x7f5094107f50 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.363+0000 7f5099fa0640 1 -- 172.21.15.33:0/3656424491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50941a6330 con 0x7f5094107f50 2024-08-28T19:32:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.363+0000 7f5091ffb640 1 -- 172.21.15.33:0/3656424491 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f507c003aa0 con 0x7f5094107f50 2024-08-28T19:32:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.363+0000 7f5091ffb640 1 -- 172.21.15.33:0/3656424491 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c035070 con 0x7f5094107f50 2024-08-28T19:32:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.363+0000 7f5099fa0640 1 -- 172.21.15.33:0/3656424491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50941a6860 con 0x7f5094107f50 2024-08-28T19:32:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.364+0000 7f5099fa0640 1 -- 172.21.15.33:0/3656424491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5094102a20 con 0x7f5094107f50 2024-08-28T19:32:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.366+0000 7f5091ffb640 1 -- 172.21.15.33:0/3656424491 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f507c042030 con 0x7f5094107f50 2024-08-28T19:32:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.366+0000 7f5091ffb640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f50800b4bb0 0x7f50800b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.367+0000 7f5091ffb640 1 -- 172.21.15.33:0/3656424491 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f507c105f00 con 0x7f5094107f50 2024-08-28T19:32:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.367+0000 7f5098f9e640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f50800b4bb0 0x7f50800b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.367+0000 7f5098f9e640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f50800b4bb0 0x7f50800b70c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f509406b760 tx=0x7f5084009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.370+0000 7f5091ffb640 1 -- 172.21.15.33:0/3656424491 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f507c0ccb60 con 0x7f5094107f50 2024-08-28T19:32:09.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.596+0000 7f5099fa0640 1 -- 172.21.15.33:0/3656424491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f509406b010 con 0x7f5094107f50 2024-08-28T19:32:09.597 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:09 smithi033 ceph-mon[18549]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-28T19:32:09.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.597+0000 7f5091ffb640 1 -- 172.21.15.33:0/3656424491 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11974 (secure 0 0 0) 0x7f507c0cc460 con 0x7f5094107f50 2024-08-28T19:32:09.598 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:09.598 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":27,"btime":"2024-08-28T19:30:27:414857+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:30:27.414831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24658,24653,24643,24631,24620]},"id":1}]} 2024-08-28T19:32:09.598 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 27 2024-08-28T19:32:09.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 -- 172.21.15.33:0/3656424491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f50800b4bb0 msgr2=0x7f50800b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:09.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f50800b4bb0 0x7f50800b70c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f509406b760 tx=0x7f5084009500 comp rx=0 tx=0).stop 2024-08-28T19:32:09.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 -- 172.21.15.33:0/3656424491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5094107f50 msgr2=0x7f509419b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:09.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5094107f50 0x7f509419b3e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f507c006010 tx=0x7f507c004060 comp rx=0 tx=0).stop 2024-08-28T19:32:09.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 -- 172.21.15.33:0/3656424491 shutdown_connections 2024-08-28T19:32:09.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50941088a0 0x7f509419b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:09.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5094107f50 0x7f509419b3e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:09.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f50800b4bb0 0x7f50800b70c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:09.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 --2- 172.21.15.33:0/3656424491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5094102610 0x7f509419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:09.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 -- 172.21.15.33:0/3656424491 >> 172.21.15.33:0/3656424491 conn(0x7f50940fe060 msgr2=0x7f5094100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:09.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.599+0000 7f5099fa0640 1 -- 172.21.15.33:0/3656424491 shutdown_connections 2024-08-28T19:32:09.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:09.600+0000 7f5099fa0640 1 -- 172.21.15.33:0/3656424491 wait complete. 2024-08-28T19:32:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:09 smithi059 ceph-mon[22052]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-28T19:32:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:09 smithi122 ceph-mon[22174]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-28T19:32:10.310 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:32:10.571 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:10.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:10 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3656424491' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:10.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:10 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3656424491' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:10.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:10 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3656424491' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:11.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.237+0000 7f42cb62c640 1 -- 172.21.15.33:0/3567001091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c4108af0 msgr2=0x7f42c410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.237+0000 7f42cb62c640 1 --2- 172.21.15.33:0/3567001091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c4108af0 0x7f42c410f320 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009ca0 tx=0x7f42bc02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.237+0000 7f42cb62c640 1 -- 172.21.15.33:0/3567001091 shutdown_connections 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.237+0000 7f42cb62c640 1 --2- 172.21.15.33:0/3567001091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c4108af0 0x7f42c410f320 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.237+0000 7f42cb62c640 1 --2- 172.21.15.33:0/3567001091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c41081a0 0x7f42c41085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.237+0000 7f42cb62c640 1 --2- 172.21.15.33:0/3567001091 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c4102f30 0x7f42c4103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.237+0000 7f42cb62c640 1 -- 172.21.15.33:0/3567001091 >> 172.21.15.33:0/3567001091 conn(0x7f42c4079d30 msgr2=0x7f42c407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.237+0000 7f42cb62c640 1 -- 172.21.15.33:0/3567001091 shutdown_connections 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.237+0000 7f42cb62c640 1 -- 172.21.15.33:0/3567001091 wait complete. 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.238+0000 7f42cb62c640 1 Processor -- start 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.238+0000 7f42cb62c640 1 -- start start 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.238+0000 7f42cb62c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c4102f30 0x7f42c4198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:11.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.238+0000 7f42cb62c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c41081a0 0x7f42c4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.238+0000 7f42cb62c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c4108af0 0x7f42c4199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.238+0000 7f42cb62c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41127a0 con 0x7f42c41081a0 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.238+0000 7f42cb62c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4112620 con 0x7f42c4108af0 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.238+0000 7f42cb62c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4112920 con 0x7f42c4102f30 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.238+0000 7f42c8bc7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c41081a0 0x7f42c4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42c8bc7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c41081a0 0x7f42c4199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56452/0 (socket says 172.21.15.33:56452) 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42c8bc7640 1 -- 172.21.15.33:0/694563845 learned_addr learned my addr 172.21.15.33:0/694563845 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42c93c8640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c4102f30 0x7f42c4198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42c9bc9640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c4108af0 0x7f42c4199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42c8bc7640 1 -- 172.21.15.33:0/694563845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c4102f30 msgr2=0x7f42c4198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42c8bc7640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c4102f30 0x7f42c4198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42c8bc7640 1 -- 172.21.15.33:0/694563845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c4108af0 msgr2=0x7f42c4199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42c8bc7640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c4108af0 0x7f42c4199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42c8bc7640 1 -- 172.21.15.33:0/694563845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c41a8460 con 0x7f42c41081a0 2024-08-28T19:32:11.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42c8bc7640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c41081a0 0x7f42c4199320 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f42b400c8c0 tx=0x7f42b400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42ba7fc640 1 -- 172.21.15.33:0/694563845 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4007bb0 con 0x7f42c41081a0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42cb62c640 1 -- 172.21.15.33:0/694563845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c41a86f0 con 0x7f42c41081a0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42ba7fc640 1 -- 172.21.15.33:0/694563845 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42b4007d50 con 0x7f42c41081a0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42ba7fc640 1 -- 172.21.15.33:0/694563845 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b40187c0 con 0x7f42c41081a0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.239+0000 7f42cb62c640 1 -- 172.21.15.33:0/694563845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c41a8c80 con 0x7f42c41081a0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.240+0000 7f42cb62c640 1 -- 172.21.15.33:0/694563845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c4103340 con 0x7f42c41081a0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.242+0000 7f42ba7fc640 1 -- 172.21.15.33:0/694563845 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f42b400fa20 con 0x7f42c41081a0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.243+0000 7f42ba7fc640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42b00b4b80 0x7f42b00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.243+0000 7f42c93c8640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42b00b4b80 0x7f42b00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.243+0000 7f42ba7fc640 1 -- 172.21.15.33:0/694563845 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f42b40e5800 con 0x7f42c41081a0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.243+0000 7f42c93c8640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42b00b4b80 0x7f42b00b7090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f42c0005fd0 tx=0x7f42c0005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:11.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.247+0000 7f42ba7fc640 1 -- 172.21.15.33:0/694563845 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f42b4014030 con 0x7f42c41081a0 2024-08-28T19:32:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.435+0000 7f42cb62c640 1 -- 172.21.15.33:0/694563845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42c4101fc0 con 0x7f42c41081a0 2024-08-28T19:32:11.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.437+0000 7f42ba7fc640 1 -- 172.21.15.33:0/694563845 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25092 (secure 0 0 0) 0x7f42b40ac4c0 con 0x7f42c41081a0 2024-08-28T19:32:11.438 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:11.438 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:31:27.886529+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:32:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 -- 172.21.15.33:0/694563845 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42b00b4b80 msgr2=0x7f42b00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42b00b4b80 0x7f42b00b7090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f42c0005fd0 tx=0x7f42c0005850 comp rx=0 tx=0).stop 2024-08-28T19:32:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 -- 172.21.15.33:0/694563845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c41081a0 msgr2=0x7f42c4199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c41081a0 0x7f42c4199320 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f42b400c8c0 tx=0x7f42b400cd80 comp rx=0 tx=0).stop 2024-08-28T19:32:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 -- 172.21.15.33:0/694563845 shutdown_connections 2024-08-28T19:32:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c4108af0 0x7f42c4199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42c41081a0 0x7f42c4199320 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42b00b4b80 0x7f42b00b7090 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 --2- 172.21.15.33:0/694563845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c4102f30 0x7f42c4198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 -- 172.21.15.33:0/694563845 >> 172.21.15.33:0/694563845 conn(0x7f42c4079d30 msgr2=0x7f42c4106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 -- 172.21.15.33:0/694563845 shutdown_connections 2024-08-28T19:32:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:11.439+0000 7f42cb62c640 1 -- 172.21.15.33:0/694563845 wait complete. 2024-08-28T19:32:11.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:11 smithi033 ceph-mon[18549]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-28T19:32:11.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:11 smithi059 ceph-mon[22052]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-28T19:32:11.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:11 smithi122 ceph-mon[22174]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-28T19:32:12.118 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-28T19:29:48.755873+0000', 'modified': '2024-08-28T19:30:27.414831+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24658, 'mds_1': 24653, 'mds_2': 24643, 'mds_3': 24631, 'mds_4': 24620}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14799': {'gid': 14799, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.33:6839/854752752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6838', 'nonce': 854752752}, {'type': 'v1', 'addr': '172.21.15.33:6839', 'nonce': 854752752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14805': {'gid': 14805, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.33:6841/4138539893', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6840', 'nonce': 4138539893}, {'type': 'v1', 'addr': '172.21.15.33:6841', 'nonce': 4138539893}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24572': {'gid': 24572, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6833/1923629681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1923629681}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1923629681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24593': {'gid': 24593, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6835/2308401306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 2308401306}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2308401306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24595': {'gid': 24595, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/2139914522', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 2139914522}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 2139914522}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24620': {'gid': 24620, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.59:6837/4143114753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6836', 'nonce': 4143114753}, {'type': 'v1', 'addr': '172.21.15.59:6837', 'nonce': 4143114753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.122:6835/364668654', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 364668654}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 364668654}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.122:6837/3665976487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 3665976487}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 3665976487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.59:6839/2455612621', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6838', 'nonce': 2455612621}, {'type': 'v1', 'addr': '172.21.15.59:6839', 'nonce': 2455612621}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24658': {'gid': 24658, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.122:6839/2515249026', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 2515249026}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 2515249026}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24658, 'qdb_cluster': [24658, 24653, 24643, 24631, 24620]} 2024-08-28T19:32:12.118 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-28T19:32:12.118 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-28T19:32:12.374 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:12.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:12 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/694563845' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:12.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:12 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/694563845' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:12.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:12 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/694563845' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:12.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.889+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/4028745503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98108170 msgr2=0x7f5e98108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:12.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.889+0000 7f5e9ea6b640 1 --2- 172.21.15.33:0/4028745503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98108170 0x7f5e98108580 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009900 tx=0x7f5e8402a410 comp rx=0 tx=0).stop 2024-08-28T19:32:12.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.889+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/4028745503 shutdown_connections 2024-08-28T19:32:12.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.889+0000 7f5e9ea6b640 1 --2- 172.21.15.33:0/4028745503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98108ac0 0x7f5e9810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.889+0000 7f5e9ea6b640 1 --2- 172.21.15.33:0/4028745503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98108170 0x7f5e98108580 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.889+0000 7f5e9ea6b640 1 --2- 172.21.15.33:0/4028745503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e98102880 0x7f5e98102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.889+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/4028745503 >> 172.21.15.33:0/4028745503 conn(0x7f5e98079500 msgr2=0x7f5e98079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.889+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/4028745503 shutdown_connections 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.889+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/4028745503 wait complete. 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.890+0000 7f5e9ea6b640 1 Processor -- start 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.890+0000 7f5e9ea6b640 1 -- start start 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.890+0000 7f5e9ea6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98102880 0x7f5e98199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.890+0000 7f5e9ea6b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98108170 0x7f5e981996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.890+0000 7f5e9ea6b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e98108ac0 0x7f5e9819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.890+0000 7f5e9ea6b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5e981126f0 con 0x7f5e98102880 2024-08-28T19:32:12.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.890+0000 7f5e9ea6b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e98112570 con 0x7f5e98108170 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.890+0000 7f5e9ea6b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5e98112870 con 0x7f5e98108ac0 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9c807640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98102880 0x7f5e98199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9c807640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98102880 0x7f5e98199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56470/0 (socket says 172.21.15.33:56470) 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9c807640 1 -- 172.21.15.33:0/1602927004 learned_addr learned my addr 172.21.15.33:0/1602927004 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9d008640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e98108ac0 0x7f5e9819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e97fff640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98108170 0x7f5e981996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9c807640 1 -- 172.21.15.33:0/1602927004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e98108ac0 msgr2=0x7f5e9819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9c807640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e98108ac0 0x7f5e9819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9c807640 1 -- 172.21.15.33:0/1602927004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98108170 msgr2=0x7f5e981996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9c807640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98108170 0x7f5e981996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9c807640 1 -- 172.21.15.33:0/1602927004 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9819f070 con 0x7f5e98102880 2024-08-28T19:32:12.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9c807640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98102880 0x7f5e98199100 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00d950 tx=0x7f5e8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e95ffb640 1 -- 172.21.15.33:0/1602927004 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c017070 con 0x7f5e98102880 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e95ffb640 1 -- 172.21.15.33:0/1602927004 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e8c009c30 con 0x7f5e98102880 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/1602927004 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9819f360 con 0x7f5e98102880 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.891+0000 7f5e95ffb640 1 -- 172.21.15.33:0/1602927004 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00f620 con 0x7f5e98102880 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.892+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/1602927004 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e981a5ac0 con 0x7f5e98102880 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.894+0000 7f5ea4fe0740 1 Processor -- start 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.894+0000 7f5ea4fe0740 1 -- start start 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.894+0000 7f5e95ffb640 1 -- 172.21.15.33:0/1602927004 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f5e8c010460 con 0x7f5e98102880 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.894+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630bef60 0x557b634647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.894+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 0x557b63464cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.894+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63465230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.894+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557b633db3f0 con 0x557b6309e280 2024-08-28T19:32:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.894+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557b633ca980 con 0x557b630960a0 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.894+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557b633ce930 con 0x557b630bef60 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e97fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63465230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e9d008640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630bef60 0x557b634647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e97fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63465230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56484/0 (socket says 172.21.15.33:56484) 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e97fff640 1 -- 172.21.15.33:0/144568704 learned_addr learned my addr 172.21.15.33:0/144568704 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e9c807640 1 --2- 172.21.15.33:0/144568704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 0x557b63464cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e97fff640 1 -- 172.21.15.33:0/144568704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630bef60 msgr2=0x557b634647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e97fff640 1 --2- 172.21.15.33:0/144568704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630bef60 0x557b634647b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e97fff640 1 -- 172.21.15.33:0/144568704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 msgr2=0x557b63464cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e97fff640 1 --2- 172.21.15.33:0/144568704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 0x557b63464cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e97fff640 1 -- 172.21.15.33:0/144568704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6312a540 con 0x557b6309e280 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e9c807640 1 --2- 172.21.15.33:0/144568704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 0x557b63464cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e95ffb640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e880b4b80 0x7f5e880b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e97fff640 1 --2- 172.21.15.33:0/144568704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63465230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e9806b420 tx=0x7f5e84032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519bb723c5bbb6b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e9d008640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e880b4b80 0x7f5e880b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e82ffd640 1 -- 172.21.15.33:0/144568704 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8403f070 con 0x557b6309e280 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e95ffb640 1 -- 172.21.15.33:0/1602927004 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5e8c0e5260 con 0x7f5e98102880 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e82ffd640 1 -- 172.21.15.33:0/144568704 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e840316a0 con 0x557b6309e280 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.895+0000 7f5e82ffd640 1 -- 172.21.15.33:0/144568704 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84035070 con 0x557b6309e280 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.896+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/144568704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 msgr2=0x557b63465230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.896+0000 7f5e9d008640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e880b4b80 0x7f5e880b7090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000af10 tx=0x7f5e9000a4d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.896+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/144568704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63465230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e9806b420 tx=0x7f5e84032ce0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.896+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/144568704 shutdown_connections 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.896+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/144568704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63465230 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.896+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/144568704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 0x557b63464cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.896+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/144568704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630bef60 0x557b634647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.896+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/144568704 >> 172.21.15.33:0/144568704 conn(0x557b630b3350 msgr2=0x557b634626a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.896+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/144568704 shutdown_connections 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.896+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/144568704 wait complete. 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.897+0000 7f5ea4fe0740 1 -- start start 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.897+0000 7f5ea4fe0740 1 Processor -- start 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.897+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 0x557b63471fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63472510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630bef60 0x557b63472a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557b6322d5f0 con 0x557b6309e280 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557b63351600 con 0x557b630960a0 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557b63475090 con 0x557b630bef60 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5ea4fe0740 10 client.0 _ll_register_callbacks cb 0x557b63377af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e97fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63472510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e97fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63472510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56488/0 (socket says 172.21.15.33:56488) 2024-08-28T19:32:12.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e97fff640 1 -- 172.21.15.33:0/3455698839 learned_addr learned my addr 172.21.15.33:0/3455698839 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e9d008640 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630bef60 0x557b63472a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e9c807640 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 0x557b63471fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e97fff640 1 -- 172.21.15.33:0/3455698839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630bef60 msgr2=0x557b63472a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e97fff640 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630bef60 0x557b63472a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e97fff640 1 -- 172.21.15.33:0/3455698839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 msgr2=0x557b63471fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e97fff640 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 0x557b63471fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e97fff640 1 -- 172.21.15.33:0/3455698839 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b6338a7b0 con 0x557b6309e280 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e97fff640 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63472510 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5e84006010 tx=0x7f5e84005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605fe086eb9d657a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.898+0000 7f5e77fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5e77fff640 1 -- 172.21.15.33:0/3455698839 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8403f040 con 0x557b6309e280 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5e77fff640 1 -- 172.21.15.33:0/3455698839 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5e84004440 con 0x557b6309e280 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/3455698839 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e840316a0 con 0x557b6309e280 2024-08-28T19:32:12.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5e77fff640 1 -- 172.21.15.33:0/3455698839 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e84054050 con 0x557b6309e280 2024-08-28T19:32:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5ea4fe0740 10 client.15426 fetch_fsmap learned FSMap version 27 2024-08-28T19:32:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/3455698839 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557b63480d30 con 0x557b6309e280 2024-08-28T19:32:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5e77fff640 1 -- 172.21.15.33:0/3455698839 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e840316a0 con 0x557b6309e280 2024-08-28T19:32:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5e77fff640 1 -- 172.21.15.33:0/3455698839 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f5e8403b730 con 0x557b6309e280 2024-08-28T19:32:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5ea4fe0740 10 client.15426 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:32:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5ea4fe0740 10 client.15426 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-28T19:32:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.899+0000 7f5ea4fe0740 20 client.15426 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.900+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x557b6307d8e0 0x557b63484250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.900+0000 7f5ea4fe0740 4 client.15426 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:12.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.900+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/3455698839 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b633dd340 con 0x557b6307d8e0 2024-08-28T19:32:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.900+0000 7f5e9c807640 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x557b6307d8e0 0x557b63484250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.900+0000 7f5e9c807640 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x557b6307d8e0 0x557b63484250 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=28871b3ad9fd7b47 server_cookie=c07a6b83c86ab46f in_seq=0 out_seq=0 2024-08-28T19:32:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.900+0000 7f5e77fff640 10 client.15426 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:32:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5e77fff640 1 -- 172.21.15.33:0/3455698839 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b633dd340 con 0x557b6307d8e0 2024-08-28T19:32:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5e77fff640 10 client.15426 handle_command_reply: tid=0 2024-08-28T19:32:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 client.15426 shutdown 2024-08-28T19:32:12.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/3455698839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 msgr2=0x557b63472510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63472510 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5e84006010 tx=0x7f5e84005e60 comp rx=0 tx=0).stop 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/3455698839 shutdown_connections 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x557b6307d8e0 0x557b63484250 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630bef60 0x557b63472a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b6309e280 0x557b63472510 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5e77fff640 0 client.15426 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/3455698839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630960a0 0x557b63471fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/3455698839 >> 172.21.15.33:0/3455698839 conn(0x557b630b3350 msgr2=0x557b634661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/3455698839 shutdown_connections 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.901+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/3455698839 wait complete. 2024-08-28T19:32:12.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.902+0000 7f5ea4fe0740 20 client.15426 trim_cache size 0 max 16384 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5ea4fe0740 1 Processor -- start 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5ea4fe0740 1 -- start start 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630960a0 0x557b6346c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b6309e280 0x557b6348c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630bef60 0x557b6348ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557b63482590 con 0x557b630bef60 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557b63482c60 con 0x557b6309e280 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557b63483330 con 0x557b630960a0 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5e9d008640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630bef60 0x557b6348ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5e9d008640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630bef60 0x557b6348ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56504/0 (socket says 172.21.15.33:56504) 2024-08-28T19:32:12.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5e9d008640 1 -- 172.21.15.33:0/1302995757 learned_addr learned my addr 172.21.15.33:0/1302995757 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5e9c807640 1 --2- 172.21.15.33:0/1302995757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630960a0 0x557b6346c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.920+0000 7f5e97fff640 1 --2- 172.21.15.33:0/1302995757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b6309e280 0x557b6348c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.921+0000 7f5e9d008640 1 -- 172.21.15.33:0/1302995757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630960a0 msgr2=0x557b6346c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.921+0000 7f5e9d008640 1 --2- 172.21.15.33:0/1302995757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630960a0 0x557b6346c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.921+0000 7f5e9d008640 1 -- 172.21.15.33:0/1302995757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b6309e280 msgr2=0x557b6348c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.921+0000 7f5e9d008640 1 --2- 172.21.15.33:0/1302995757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b6309e280 0x557b6348c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.921+0000 7f5e9d008640 1 -- 172.21.15.33:0/1302995757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b634704d0 con 0x557b630bef60 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.921+0000 7f5e9d008640 1 --2- 172.21.15.33:0/1302995757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630bef60 0x557b6348ce60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5e9001b8f0 tx=0x7f5e90015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b13895932f098ed server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.921+0000 7f5e827fc640 1 -- 172.21.15.33:0/1302995757 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90027460 con 0x557b630bef60 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.921+0000 7f5e827fc640 1 -- 172.21.15.33:0/1302995757 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e9002c070 con 0x557b630bef60 2024-08-28T19:32:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.921+0000 7f5e827fc640 1 -- 172.21.15.33:0/1302995757 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000f8d0 con 0x557b630bef60 2024-08-28T19:32:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.922+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/1302995757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630bef60 msgr2=0x557b6348ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.922+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/1302995757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630bef60 0x557b6348ce60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5e9001b8f0 tx=0x7f5e90015000 comp rx=0 tx=0).stop 2024-08-28T19:32:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.922+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/1302995757 shutdown_connections 2024-08-28T19:32:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.922+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/1302995757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630bef60 0x557b6348ce60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.922+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/1302995757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b6309e280 0x557b6348c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.922+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/1302995757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b630960a0 0x557b6346c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.922+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/1302995757 >> 172.21.15.33:0/1302995757 conn(0x557b630b3350 msgr2=0x557b6346a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.922+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/1302995757 shutdown_connections 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.922+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/1302995757 wait complete. 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.922+0000 7f5ea4fe0740 1 -- start start 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5ea4fe0740 1 Processor -- start 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630960a0 0x557b6346c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b6309e280 0x557b63469cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5ea4fe0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630bef60 0x557b6346a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557b634840d0 con 0x557b630960a0 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557b63483a00 con 0x557b630bef60 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5ea4fe0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557b634847a0 con 0x557b6309e280 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e9c807640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630960a0 0x557b6346c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5ea4fe0740 10 client.0 _ll_register_callbacks cb 0x7f5e8402aab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e9c807640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630960a0 0x557b6346c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56510/0 (socket says 172.21.15.33:56510) 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e9c807640 1 -- 172.21.15.33:0/495409458 learned_addr learned my addr 172.21.15.33:0/495409458 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e97fff640 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b6309e280 0x557b63469cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e9d008640 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630bef60 0x557b6346a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e9c807640 1 -- 172.21.15.33:0/495409458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b6309e280 msgr2=0x557b63469cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e9c807640 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b6309e280 0x557b63469cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e9c807640 1 -- 172.21.15.33:0/495409458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630bef60 msgr2=0x557b6346a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e9c807640 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630bef60 0x557b6346a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e9c807640 1 -- 172.21.15.33:0/495409458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b634f0740 con 0x557b630960a0 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e97fff640 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b6309e280 0x557b63469cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.923+0000 7f5e9d008640 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630bef60 0x557b6346a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.924+0000 7f5e9c807640 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630960a0 0x557b6346c7e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0a8a90 tx=0x7f5e8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5e52cc2da6061f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:12.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.924+0000 7f5e77fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.924+0000 7f5e77fff640 1 -- 172.21.15.33:0/495409458 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c020040 con 0x557b630960a0 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.924+0000 7f5e77fff640 1 -- 172.21.15.33:0/495409458 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5e8c0aaa80 con 0x557b630960a0 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.924+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/495409458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e9002c070 con 0x557b630960a0 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.924+0000 7f5e77fff640 1 -- 172.21.15.33:0/495409458 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e8c0abf20 con 0x557b630960a0 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.924+0000 7f5ea4fe0740 10 client.15432 fetch_fsmap learned FSMap version 27 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.924+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/495409458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557b634f1890 con 0x557b630960a0 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.924+0000 7f5e77fff640 1 -- 172.21.15.33:0/495409458 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e9002c070 con 0x557b630960a0 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.924+0000 7f5e77fff640 1 -- 172.21.15.33:0/495409458 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f5e8c0a7190 con 0x557b630960a0 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.925+0000 7f5ea4fe0740 10 client.15432 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.925+0000 7f5ea4fe0740 10 client.15432 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.925+0000 7f5ea4fe0740 20 client.15432 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.925+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x557b63052c90 0x557b634f5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.925+0000 7f5ea4fe0740 4 client.15432 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.925+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/495409458 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "status"}) -- 0x557b633d8de0 con 0x557b63052c90 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.925+0000 7f5e97fff640 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x557b63052c90 0x557b634f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.925+0000 7f5e97fff640 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x557b63052c90 0x557b634f5100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=46c375e279d615c server_cookie=beb57abc7e46c0cc in_seq=0 out_seq=0 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.925+0000 7f5e77fff640 10 client.15432 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5e77fff640 1 -- 172.21.15.33:0/495409458 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557b633d8de0 con 0x557b63052c90 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5e77fff640 10 client.15432 handle_command_reply: tid=0 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 client.15432 shutdown 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/495409458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630960a0 msgr2=0x557b6346c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630960a0 0x557b6346c7e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0a8a90 tx=0x7f5e8c005880 comp rx=0 tx=0).stop 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/495409458 shutdown_connections 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x557b63052c90 0x557b634f5100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b630bef60 0x557b6346a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557b6309e280 0x557b63469cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 --2- 172.21.15.33:0/495409458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557b630960a0 0x557b6346c7e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/495409458 >> 172.21.15.33:0/495409458 conn(0x557b630b3350 msgr2=0x557b63473290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5e77fff640 0 client.15432 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/495409458 shutdown_connections 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 1 -- 172.21.15.33:0/495409458 wait complete. 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.926+0000 7f5ea4fe0740 20 client.15432 trim_cache size 0 max 16384 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 4, 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24620, 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:32:12.932 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:32:12.933 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:32:12.933 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 106.52267203700001, 2024-08-28T19:32:12.933 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 27, 2024-08-28T19:32:12.933 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:32:12.933 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 82, 2024-08-28T19:32:12.933 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 166.462585246 2024-08-28T19:32:12.933 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/1602927004 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e880b4b80 msgr2=0x7f5e880b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e880b4b80 0x7f5e880b7090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000af10 tx=0x7f5e9000a4d0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/1602927004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98102880 msgr2=0x7f5e98199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98102880 0x7f5e98199100 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00d950 tx=0x7f5e8c00de10 comp rx=0 tx=0).stop 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/1602927004 shutdown_connections 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e880b4b80 0x7f5e880b7090 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e98108ac0 0x7f5e9819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98108170 0x7f5e981996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 --2- 172.21.15.33:0/1602927004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98102880 0x7f5e98199100 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/1602927004 >> 172.21.15.33:0/1602927004 conn(0x7f5e98079500 msgr2=0x7f5e981041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/1602927004 shutdown_connections 2024-08-28T19:32:12.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:12.927+0000 7f5e9ea6b640 1 -- 172.21.15.33:0/1602927004 wait complete. 2024-08-28T19:32:13.604 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:13 smithi033 ceph-mon[18549]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:32:13.632 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.f status 2024-08-28T19:32:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:13 smithi059 ceph-mon[22052]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:32:13.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:13 smithi122 ceph-mon[22174]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:32:13.884 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.400+0000 7f31dc034640 1 -- 172.21.15.33:0/2697895477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d41050a0 msgr2=0x7f31d410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.400+0000 7f31dc034640 1 --2- 172.21.15.33:0/2697895477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d41050a0 0x7f31d410d5f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009900 tx=0x7f31c402a3f0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.400+0000 7f31dc034640 1 -- 172.21.15.33:0/2697895477 shutdown_connections 2024-08-28T19:32:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.400+0000 7f31dc034640 1 --2- 172.21.15.33:0/2697895477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d410dbb0 0x7f31d41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.400+0000 7f31dc034640 1 --2- 172.21.15.33:0/2697895477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d41050a0 0x7f31d410d5f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.400+0000 7f31dc034640 1 --2- 172.21.15.33:0/2697895477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31d4104750 0x7f31d4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.400+0000 7f31dc034640 1 -- 172.21.15.33:0/2697895477 >> 172.21.15.33:0/2697895477 conn(0x7f31d40794d0 msgr2=0x7f31d40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.400+0000 7f31dc034640 1 -- 172.21.15.33:0/2697895477 shutdown_connections 2024-08-28T19:32:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.401+0000 7f31dc034640 1 -- 172.21.15.33:0/2697895477 wait complete. 2024-08-28T19:32:14.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.401+0000 7f31dc034640 1 Processor -- start 2024-08-28T19:32:14.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.401+0000 7f31dc034640 1 -- start start 2024-08-28T19:32:14.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31dc034640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d4104750 0x7f31d419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31dc034640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31d41050a0 0x7f31d419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31dc034640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d410dbb0 0x7f31d419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31dc034640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f31d41138c0 con 0x7f31d410dbb0 2024-08-28T19:32:14.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31dc034640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f31d4113740 con 0x7f31d4104750 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31dc034640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f31d4113a40 con 0x7f31d41050a0 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31da5d1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d410dbb0 0x7f31d419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31da5d1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d410dbb0 0x7f31d419fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56530/0 (socket says 172.21.15.33:56530) 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31da5d1640 1 -- 172.21.15.33:0/4037896086 learned_addr learned my addr 172.21.15.33:0/4037896086 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d4104750 0x7f31d419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31d95cf640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31d41050a0 0x7f31d419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31da5d1640 1 -- 172.21.15.33:0/4037896086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31d41050a0 msgr2=0x7f31d419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31da5d1640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31d41050a0 0x7f31d419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31da5d1640 1 -- 172.21.15.33:0/4037896086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d4104750 msgr2=0x7f31d419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31da5d1640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d4104750 0x7f31d419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31da5d1640 1 -- 172.21.15.33:0/4037896086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d41a01a0 con 0x7f31d410dbb0 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31d95cf640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31d41050a0 0x7f31d419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d4104750 0x7f31d419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:14.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31da5d1640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d410dbb0 0x7f31d419fb30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00cce0 tx=0x7f31cc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:14.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31caffd640 1 -- 172.21.15.33:0/4037896086 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00f450 con 0x7f31d410dbb0 2024-08-28T19:32:14.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31dc034640 1 -- 172.21.15.33:0/4037896086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d41a0490 con 0x7f31d410dbb0 2024-08-28T19:32:14.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31caffd640 1 -- 172.21.15.33:0/4037896086 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31cc00faa0 con 0x7f31d410dbb0 2024-08-28T19:32:14.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.402+0000 7f31caffd640 1 -- 172.21.15.33:0/4037896086 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc018b70 con 0x7f31d410dbb0 2024-08-28T19:32:14.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.403+0000 7f31dc034640 1 -- 172.21.15.33:0/4037896086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d41a6cb0 con 0x7f31d410dbb0 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.405+0000 7f31e25a9740 1 Processor -- start 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.405+0000 7f31caffd640 1 -- 172.21.15.33:0/4037896086 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f31cc018d10 con 0x7f31d410dbb0 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.405+0000 7f31e25a9740 1 -- start start 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48628f60 0x560c489ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c486000a0 0x560c489cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48608280 0x560c489cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31e25a9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560c489453f0 con 0x560c48608280 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31e25a9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560c48934980 con 0x560c486000a0 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31e25a9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560c48938930 con 0x560c48628f60 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31d95cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48608280 0x560c489cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31d95cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48608280 0x560c489cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56544/0 (socket says 172.21.15.33:56544) 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31d95cf640 1 -- 172.21.15.33:0/1660680859 learned_addr learned my addr 172.21.15.33:0/1660680859 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31d95cf640 1 --2- 172.21.15.33:0/1660680859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48628f60 0x560c489ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/1660680859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c486000a0 0x560c489cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31caffd640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31c00b4bb0 0x7f31c00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31d95cf640 1 -- 172.21.15.33:0/1660680859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48628f60 msgr2=0x560c489ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31d95cf640 1 --2- 172.21.15.33:0/1660680859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48628f60 0x560c489ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31d95cf640 1 -- 172.21.15.33:0/1660680859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c486000a0 msgr2=0x560c489cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31d95cf640 1 --2- 172.21.15.33:0/1660680859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c486000a0 0x560c489cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31d95cf640 1 -- 172.21.15.33:0/1660680859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c48694540 con 0x560c48608280 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31da5d1640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31c00b4bb0 0x7f31c00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.406+0000 7f31caffd640 1 -- 172.21.15.33:0/4037896086 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f31cc0e5ae0 con 0x7f31d410dbb0 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.407+0000 7f31d95cf640 1 --2- 172.21.15.33:0/1660680859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48608280 0x560c489cf230 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f31c4004650 tx=0x7f31c4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da256fe337173284 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.407+0000 7f31bffff640 1 -- 172.21.15.33:0/1660680859 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4045070 con 0x560c48608280 2024-08-28T19:32:14.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.407+0000 7f31bffff640 1 -- 172.21.15.33:0/1660680859 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31c40314a0 con 0x560c48608280 2024-08-28T19:32:14.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.407+0000 7f31da5d1640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31c00b4bb0 0x7f31c00b70c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00ab20 tx=0x7f31cc0782a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:14.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.407+0000 7f31bffff640 1 -- 172.21.15.33:0/1660680859 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4035040 con 0x560c48608280 2024-08-28T19:32:14.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 -- 172.21.15.33:0/1660680859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48608280 msgr2=0x560c489cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:14.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 --2- 172.21.15.33:0/1660680859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48608280 0x560c489cf230 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f31c4004650 tx=0x7f31c4031400 comp rx=0 tx=0).stop 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 -- 172.21.15.33:0/1660680859 shutdown_connections 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 --2- 172.21.15.33:0/1660680859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48608280 0x560c489cf230 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 --2- 172.21.15.33:0/1660680859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c486000a0 0x560c489cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 --2- 172.21.15.33:0/1660680859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48628f60 0x560c489ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 -- 172.21.15.33:0/1660680859 >> 172.21.15.33:0/1660680859 conn(0x560c4861d350 msgr2=0x560c489cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 -- 172.21.15.33:0/1660680859 shutdown_connections 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 -- 172.21.15.33:0/1660680859 wait complete. 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 -- start start 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.408+0000 7f31e25a9740 1 Processor -- start 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c486000a0 0x560c489d9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 0x560c489da370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48628f60 0x560c489e6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31e25a9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560c487975f0 con 0x560c486000a0 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31e25a9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560c488bb600 con 0x560c48608280 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31e25a9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560c489dcf30 con 0x560c48628f60 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31e25a9740 10 client.0 _ll_register_callbacks cb 0x560c488e1af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31d95cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c486000a0 0x560c489d9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31d95cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c486000a0 0x560c489d9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56554/0 (socket says 172.21.15.33:56554) 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31d95cf640 1 -- 172.21.15.33:0/2707984575 learned_addr learned my addr 172.21.15.33:0/2707984575 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 0x560c489da370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31d95cf640 1 -- 172.21.15.33:0/2707984575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48628f60 msgr2=0x560c489e6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31d95cf640 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48628f60 0x560c489e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31d95cf640 1 -- 172.21.15.33:0/2707984575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 msgr2=0x560c489da370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31d95cf640 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 0x560c489da370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31d95cf640 1 -- 172.21.15.33:0/2707984575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c488f47b0 con 0x560c486000a0 2024-08-28T19:32:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.409+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 0x560c489da370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.410+0000 7f31d95cf640 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c486000a0 0x560c489d9e30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009900 tx=0x7f31c4005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc249b651e513c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.410+0000 7f31bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.410+0000 7f31bd7fa640 1 -- 172.21.15.33:0/2707984575 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c404f020 con 0x560c486000a0 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.410+0000 7f31bd7fa640 1 -- 172.21.15.33:0/2707984575 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f31c4003cd0 con 0x560c486000a0 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.410+0000 7f31e25a9740 1 -- 172.21.15.33:0/2707984575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31c40314a0 con 0x560c486000a0 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.410+0000 7f31bd7fa640 1 -- 172.21.15.33:0/2707984575 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f31c405a050 con 0x560c486000a0 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.410+0000 7f31e25a9740 10 client.15444 fetch_fsmap learned FSMap version 27 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.410+0000 7f31e25a9740 1 -- 172.21.15.33:0/2707984575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560c489e8c00 con 0x560c486000a0 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.410+0000 7f31bd7fa640 1 -- 172.21.15.33:0/2707984575 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31c40314a0 con 0x560c486000a0 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.411+0000 7f31bd7fa640 1 -- 172.21.15.33:0/2707984575 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f31c403a040 con 0x560c486000a0 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.411+0000 7f31e25a9740 10 client.15444 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.411+0000 7f31e25a9740 10 client.15444 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.411+0000 7f31e25a9740 20 client.15444 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.411+0000 7f31e25a9740 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560c485e78e0 0x560c489ec170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.411+0000 7f31e25a9740 4 client.15444 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.411+0000 7f31e25a9740 1 -- 172.21.15.33:0/2707984575 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c48947340 con 0x560c485e78e0 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.411+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560c485e78e0 0x560c489ec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.411+0000 7f31bd7fa640 10 client.15444 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.411+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560c485e78e0 0x560c489ec170 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ac0d1741eeb23cc0 server_cookie=4cc3619f2b6fea4c in_seq=0 out_seq=0 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31bd7fa640 1 -- 172.21.15.33:0/2707984575 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c48947340 con 0x560c485e78e0 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31bd7fa640 10 client.15444 handle_command_reply: tid=0 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31e25a9740 1 client.15444 shutdown 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31e25a9740 1 -- 172.21.15.33:0/2707984575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c486000a0 msgr2=0x560c489d9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31e25a9740 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c486000a0 0x560c489d9e30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f31c4009900 tx=0x7f31c4005a20 comp rx=0 tx=0).stop 2024-08-28T19:32:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31e25a9740 1 -- 172.21.15.33:0/2707984575 shutdown_connections 2024-08-28T19:32:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31e25a9740 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560c485e78e0 0x560c489ec170 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31e25a9740 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48628f60 0x560c489e6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31e25a9740 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 0x560c489da370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31e25a9740 1 --2- 172.21.15.33:0/2707984575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c486000a0 0x560c489d9e30 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31bd7fa640 0 client.15444 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:32:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.412+0000 7f31e25a9740 1 -- 172.21.15.33:0/2707984575 >> 172.21.15.33:0/2707984575 conn(0x560c4861d350 msgr2=0x560c489d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.413+0000 7f31e25a9740 1 -- 172.21.15.33:0/2707984575 shutdown_connections 2024-08-28T19:32:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.413+0000 7f31e25a9740 1 -- 172.21.15.33:0/2707984575 wait complete. 2024-08-28T19:32:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.413+0000 7f31e25a9740 20 client.15444 trim_cache size 0 max 16384 2024-08-28T19:32:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31e25a9740 1 Processor -- start 2024-08-28T19:32:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31e25a9740 1 -- start start 2024-08-28T19:32:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c486000a0 0x560c489ead00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 0x560c489e6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31e25a9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560c489ea4b0 con 0x560c48628f60 2024-08-28T19:32:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31e25a9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560c489eab80 con 0x560c48608280 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31e25a9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560c489eb250 con 0x560c486000a0 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31d95cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31d95cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56562/0 (socket says 172.21.15.33:56562) 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.431+0000 7f31d95cf640 1 -- 172.21.15.33:0/2105385618 learned_addr learned my addr 172.21.15.33:0/2105385618 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/2105385618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 0x560c489e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31d95cf640 1 --2- 172.21.15.33:0/2105385618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c486000a0 0x560c489ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31d95cf640 1 -- 172.21.15.33:0/2105385618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c486000a0 msgr2=0x560c489ead00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31d95cf640 1 --2- 172.21.15.33:0/2105385618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c486000a0 0x560c489ead00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31d95cf640 1 -- 172.21.15.33:0/2105385618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 msgr2=0x560c489e6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31d95cf640 1 --2- 172.21.15.33:0/2105385618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 0x560c489e6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31d95cf640 1 -- 172.21.15.33:0/2105385618 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c489d0aa0 con 0x560c48628f60 2024-08-28T19:32:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/2105385618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 0x560c489e6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31d95cf640 1 --2- 172.21.15.33:0/2105385618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489cbcf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f31c402a9b0 tx=0x7f31c40036b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb95aef771d09b5c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31bf7fe640 1 -- 172.21.15.33:0/2105385618 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c404f040 con 0x560c48628f60 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31bf7fe640 1 -- 172.21.15.33:0/2105385618 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31c4042070 con 0x560c48628f60 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.432+0000 7f31bf7fe640 1 -- 172.21.15.33:0/2105385618 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4035070 con 0x560c48628f60 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 -- 172.21.15.33:0/2105385618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 msgr2=0x560c489cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 --2- 172.21.15.33:0/2105385618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489cbcf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f31c402a9b0 tx=0x7f31c40036b0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 -- 172.21.15.33:0/2105385618 shutdown_connections 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 --2- 172.21.15.33:0/2105385618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489cbcf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 --2- 172.21.15.33:0/2105385618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c48608280 0x560c489e6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 --2- 172.21.15.33:0/2105385618 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c486000a0 0x560c489ead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 -- 172.21.15.33:0/2105385618 >> 172.21.15.33:0/2105385618 conn(0x560c4861d350 msgr2=0x560c489d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 -- 172.21.15.33:0/2105385618 shutdown_connections 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 -- 172.21.15.33:0/2105385618 wait complete. 2024-08-28T19:32:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 -- start start 2024-08-28T19:32:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.433+0000 7f31e25a9740 1 Processor -- start 2024-08-28T19:32:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c486000a0 0x560c489f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48608280 0x560c489f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31e25a9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31e25a9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560c489ebff0 con 0x560c48628f60 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31e25a9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560c489eb920 con 0x560c486000a0 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31e25a9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560c489ec6c0 con 0x560c48608280 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31e25a9740 10 client.0 _ll_register_callbacks cb 0x7f31c4003810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31d95cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31d95cf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489d6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56568/0 (socket says 172.21.15.33:56568) 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31d95cf640 1 -- 172.21.15.33:0/3698972950 learned_addr learned my addr 172.21.15.33:0/3698972950 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48608280 0x560c489f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31d95cf640 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c486000a0 0x560c489f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31d95cf640 1 -- 172.21.15.33:0/3698972950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48608280 msgr2=0x560c489f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31d95cf640 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48608280 0x560c489f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31d95cf640 1 -- 172.21.15.33:0/3698972950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c486000a0 msgr2=0x560c489f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31d95cf640 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c486000a0 0x560c489f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.434+0000 7f31d95cf640 1 -- 172.21.15.33:0/3698972950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c489d71a0 con 0x560c48628f60 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31d95cf640 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489d6a10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x560c489f2460 tx=0x7f31c4057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c30f00fd13a470 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31bd7fa640 1 -- 172.21.15.33:0/3698972950 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4035070 con 0x560c48628f60 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31bd7fa640 1 -- 172.21.15.33:0/3698972950 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f31c403cb30 con 0x560c48628f60 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31e25a9740 1 -- 172.21.15.33:0/3698972950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31c4042070 con 0x560c48628f60 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31bd7fa640 1 -- 172.21.15.33:0/3698972950 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f31c404f040 con 0x560c48628f60 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31e25a9740 10 client.15450 fetch_fsmap learned FSMap version 27 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31e25a9740 1 -- 172.21.15.33:0/3698972950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560c489f1eb0 con 0x560c48628f60 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31bd7fa640 1 -- 172.21.15.33:0/3698972950 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31c4042070 con 0x560c48628f60 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31bd7fa640 1 -- 172.21.15.33:0/3698972950 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f31c403a070 con 0x560c48628f60 2024-08-28T19:32:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31e25a9740 10 client.15450 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31e25a9740 10 client.15450 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31e25a9740 20 client.15450 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31e25a9740 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560c485bcc90 0x560c48a5e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31e25a9740 4 client.15450 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.435+0000 7f31e25a9740 1 -- 172.21.15.33:0/3698972950 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "status"}) -- 0x560c48942de0 con 0x560c485bcc90 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.436+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560c485bcc90 0x560c48a5e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.436+0000 7f31bd7fa640 10 client.15450 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.436+0000 7f31d9dd0640 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560c485bcc90 0x560c48a5e900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a95bde7277659f82 server_cookie=82b8477415d75529 in_seq=0 out_seq=0 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.436+0000 7f31bd7fa640 1 -- 172.21.15.33:0/3698972950 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560c48942de0 con 0x560c485bcc90 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.436+0000 7f31bd7fa640 10 client.15450 handle_command_reply: tid=0 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.436+0000 7f31e25a9740 1 client.15450 shutdown 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 1 -- 172.21.15.33:0/3698972950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 msgr2=0x560c489d6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489d6a10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x560c489f2460 tx=0x7f31c4057040 comp rx=0 tx=0).stop 2024-08-28T19:32:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 1 -- 172.21.15.33:0/3698972950 shutdown_connections 2024-08-28T19:32:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560c485bcc90 0x560c48a5e900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560c48628f60 0x560c489d6a10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560c48608280 0x560c489f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31bd7fa640 0 client.15450 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:32:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 1 --2- 172.21.15.33:0/3698972950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c486000a0 0x560c489f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 1 -- 172.21.15.33:0/3698972950 >> 172.21.15.33:0/3698972950 conn(0x560c4861d350 msgr2=0x560c489db2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 1 -- 172.21.15.33:0/3698972950 shutdown_connections 2024-08-28T19:32:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 1 -- 172.21.15.33:0/3698972950 wait complete. 2024-08-28T19:32:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31e25a9740 20 client.15450 trim_cache size 0 max 16384 2024-08-28T19:32:14.443 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 3, 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24631, 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 109.04746862499999, 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 27, 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 82, 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 173.19816510199999 2024-08-28T19:32:14.444 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31dc034640 1 -- 172.21.15.33:0/4037896086 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31c00b4bb0 msgr2=0x7f31c00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31dc034640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31c00b4bb0 0x7f31c00b70c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00ab20 tx=0x7f31cc0782a0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31dc034640 1 -- 172.21.15.33:0/4037896086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d410dbb0 msgr2=0x7f31d419fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31dc034640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d410dbb0 0x7f31d419fb30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00cce0 tx=0x7f31cc00a620 comp rx=0 tx=0).stop 2024-08-28T19:32:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31dc034640 1 -- 172.21.15.33:0/4037896086 shutdown_connections 2024-08-28T19:32:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31dc034640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d410dbb0 0x7f31d419fb30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31dc034640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31c00b4bb0 0x7f31c00b70c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31dc034640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31d41050a0 0x7f31d419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31dc034640 1 --2- 172.21.15.33:0/4037896086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d4104750 0x7f31d419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.437+0000 7f31dc034640 1 -- 172.21.15.33:0/4037896086 >> 172.21.15.33:0/4037896086 conn(0x7f31d40794d0 msgr2=0x7f31d4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.438+0000 7f31dc034640 1 -- 172.21.15.33:0/4037896086 shutdown_connections 2024-08-28T19:32:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:14.438+0000 7f31dc034640 1 -- 172.21.15.33:0/4037896086 wait complete. 2024-08-28T19:32:15.127 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-28T19:32:15.385 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:15.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:15 smithi033 ceph-mon[18549]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:32:15.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:15 smithi059 ceph-mon[22052]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:32:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:15 smithi122 ceph-mon[22174]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:32:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.849+0000 7efc3aedc640 1 -- 172.21.15.33:0/91246990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc34103900 msgr2=0x7efc34103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.849+0000 7efc3aedc640 1 --2- 172.21.15.33:0/91246990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc34103900 0x7efc34103d10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efc28009900 tx=0x7efc2802a410 comp rx=0 tx=0).stop 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.849+0000 7efc3aedc640 1 -- 172.21.15.33:0/91246990 shutdown_connections 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.849+0000 7efc3aedc640 1 --2- 172.21.15.33:0/91246990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34109b90 0x7efc341103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.849+0000 7efc3aedc640 1 --2- 172.21.15.33:0/91246990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc34109240 0x7efc34109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.849+0000 7efc3aedc640 1 --2- 172.21.15.33:0/91246990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc34103900 0x7efc34103d10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.849+0000 7efc3aedc640 1 -- 172.21.15.33:0/91246990 >> 172.21.15.33:0/91246990 conn(0x7efc3407b5f0 msgr2=0x7efc3407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.849+0000 7efc3aedc640 1 -- 172.21.15.33:0/91246990 shutdown_connections 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.849+0000 7efc3aedc640 1 -- 172.21.15.33:0/91246990 wait complete. 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc3aedc640 1 Processor -- start 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc3aedc640 1 -- start start 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc3aedc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34103900 0x7efc3419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc3aedc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc34109240 0x7efc3419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc3aedc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc34109b90 0x7efc3419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc3aedc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efc34113890 con 0x7efc34109240 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc3aedc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efc34113710 con 0x7efc34103900 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc3aedc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efc34113a10 con 0x7efc34109b90 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc33fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc34109240 0x7efc3419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc33fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc34109240 0x7efc3419a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56584/0 (socket says 172.21.15.33:56584) 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.850+0000 7efc33fff640 1 -- 172.21.15.33:0/3125464436 learned_addr learned my addr 172.21.15.33:0/3125464436 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc38c78640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34103900 0x7efc3419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc33fff640 1 -- 172.21.15.33:0/3125464436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc34109b90 msgr2=0x7efc3419fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc39479640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc34109b90 0x7efc3419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc33fff640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc34109b90 0x7efc3419fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc33fff640 1 -- 172.21.15.33:0/3125464436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34103900 msgr2=0x7efc3419a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc33fff640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34103900 0x7efc3419a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc33fff640 1 -- 172.21.15.33:0/3125464436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc341a0270 con 0x7efc34109240 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc38c78640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34103900 0x7efc3419a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc33fff640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc34109240 0x7efc3419a8a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efc20006fd0 tx=0x7efc2000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc31ffb640 1 -- 172.21.15.33:0/3125464436 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20011830 con 0x7efc34109240 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc31ffb640 1 -- 172.21.15.33:0/3125464436 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc20016070 con 0x7efc34109240 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc3aedc640 1 -- 172.21.15.33:0/3125464436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc341a0560 con 0x7efc34109240 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc31ffb640 1 -- 172.21.15.33:0/3125464436 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20010e00 con 0x7efc34109240 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.851+0000 7efc3aedc640 1 -- 172.21.15.33:0/3125464436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc341a6cc0 con 0x7efc34109240 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc31ffb640 1 -- 172.21.15.33:0/3125464436 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7efc2001b460 con 0x7efc34109240 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc41451740 1 Processor -- start 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc41451740 1 -- start start 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc41451740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612badf60 0x560612f537b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc41451740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f53cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc41451740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f54230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc41451740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560612eca3f0 con 0x560612b850a0 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc41451740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560612eb9980 con 0x560612b8d280 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc41451740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560612ebd930 con 0x560612badf60 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc38c78640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f53cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc38c78640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f53cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56600/0 (socket says 172.21.15.33:56600) 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.854+0000 7efc38c78640 1 -- 172.21.15.33:0/4023468775 learned_addr learned my addr 172.21.15.33:0/4023468775 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc39479640 1 --2- 172.21.15.33:0/4023468775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612badf60 0x560612f537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc33fff640 1 --2- 172.21.15.33:0/4023468775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f54230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc31ffb640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc240b4c00 0x7efc240b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc39479640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc240b4c00 0x7efc240b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc38c78640 1 -- 172.21.15.33:0/4023468775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612badf60 msgr2=0x560612f537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc38c78640 1 --2- 172.21.15.33:0/4023468775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612badf60 0x560612f537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc38c78640 1 -- 172.21.15.33:0/4023468775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 msgr2=0x560612f54230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc38c78640 1 --2- 172.21.15.33:0/4023468775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f54230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc38c78640 1 -- 172.21.15.33:0/4023468775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560612c19540 con 0x560612b850a0 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc31ffb640 1 -- 172.21.15.33:0/3125464436 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7efc200e4ba0 con 0x7efc34109240 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc38c78640 1 --2- 172.21.15.33:0/4023468775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f53cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efc28032ce0 tx=0x7efc28032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c216ac43b52f70 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc39479640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc240b4c00 0x7efc240b7110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efc2c005fd0 tx=0x7efc2c004ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc1effd640 1 -- 172.21.15.33:0/4023468775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2803f070 con 0x560612b850a0 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc1effd640 1 -- 172.21.15.33:0/4023468775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc280316a0 con 0x560612b850a0 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.855+0000 7efc1effd640 1 -- 172.21.15.33:0/4023468775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28035070 con 0x560612b850a0 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.856+0000 7efc41451740 1 -- 172.21.15.33:0/4023468775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 msgr2=0x560612f53cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.856+0000 7efc41451740 1 --2- 172.21.15.33:0/4023468775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f53cf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efc28032ce0 tx=0x7efc28032d10 comp rx=0 tx=0).stop 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.856+0000 7efc41451740 1 -- 172.21.15.33:0/4023468775 shutdown_connections 2024-08-28T19:32:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.856+0000 7efc41451740 1 --2- 172.21.15.33:0/4023468775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f54230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.856+0000 7efc41451740 1 --2- 172.21.15.33:0/4023468775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f53cf0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.856+0000 7efc41451740 1 --2- 172.21.15.33:0/4023468775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612badf60 0x560612f537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.856+0000 7efc41451740 1 -- 172.21.15.33:0/4023468775 >> 172.21.15.33:0/4023468775 conn(0x560612ba2350 msgr2=0x560612f516a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.856+0000 7efc41451740 1 -- 172.21.15.33:0/4023468775 shutdown_connections 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.856+0000 7efc41451740 1 -- 172.21.15.33:0/4023468775 wait complete. 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.857+0000 7efc41451740 1 -- start start 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.857+0000 7efc41451740 1 Processor -- start 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.857+0000 7efc41451740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612b850a0 0x560612f63250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.857+0000 7efc41451740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f63790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.857+0000 7efc41451740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f6f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.857+0000 7efc41451740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560612d1c5f0 con 0x560612badf60 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.857+0000 7efc41451740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560612e40600 con 0x560612b8d280 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.857+0000 7efc41451740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560612f66290 con 0x560612b850a0 2024-08-28T19:32:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc41451740 10 client.0 _ll_register_callbacks cb 0x560612e66af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc39479640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f6f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc39479640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f6f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56602/0 (socket says 172.21.15.33:56602) 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc39479640 1 -- 172.21.15.33:0/1688552221 learned_addr learned my addr 172.21.15.33:0/1688552221 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc33fff640 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f63790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc38c78640 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612b850a0 0x560612f63250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc39479640 1 -- 172.21.15.33:0/1688552221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612b850a0 msgr2=0x560612f63250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc39479640 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612b850a0 0x560612f63250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc39479640 1 -- 172.21.15.33:0/1688552221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 msgr2=0x560612f63790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc39479640 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f63790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc39479640 1 -- 172.21.15.33:0/1688552221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560612e797b0 con 0x560612badf60 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc39479640 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f6f5f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efc2c011870 tx=0x7efc2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d609a797cf90a5fa server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc13fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc13fff640 1 -- 172.21.15.33:0/1688552221 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c019070 con 0x560612badf60 2024-08-28T19:32:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc13fff640 1 -- 172.21.15.33:0/1688552221 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7efc2c003970 con 0x560612badf60 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.858+0000 7efc41451740 1 -- 172.21.15.33:0/1688552221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc280316a0 con 0x560612badf60 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc13fff640 1 -- 172.21.15.33:0/1688552221 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efc2c003b70 con 0x560612badf60 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc41451740 10 client.15462 fetch_fsmap learned FSMap version 27 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc41451740 1 -- 172.21.15.33:0/1688552221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560612f72010 con 0x560612badf60 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc13fff640 1 -- 172.21.15.33:0/1688552221 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc280316a0 con 0x560612badf60 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc13fff640 1 -- 172.21.15.33:0/1688552221 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7efc2c01f070 con 0x560612badf60 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc41451740 10 client.15462 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc41451740 10 client.15462 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc41451740 20 client.15462 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc41451740 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560612b6c8e0 0x560612f75bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc41451740 4 client.15462 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc41451740 1 -- 172.21.15.33:0/1688552221 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560612ecc340 con 0x560612b6c8e0 2024-08-28T19:32:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.859+0000 7efc38c78640 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560612b6c8e0 0x560612f75bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.860+0000 7efc38c78640 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560612b6c8e0 0x560612f75bc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25e2fbea9a867b72 server_cookie=e5040b8dc5187c73 in_seq=0 out_seq=0 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.860+0000 7efc13fff640 10 client.15462 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc13fff640 1 -- 172.21.15.33:0/1688552221 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560612ecc340 con 0x560612b6c8e0 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc13fff640 10 client.15462 handle_command_reply: tid=0 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 client.15462 shutdown 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 -- 172.21.15.33:0/1688552221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 msgr2=0x560612f6f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f6f5f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efc2c011870 tx=0x7efc2c004a40 comp rx=0 tx=0).stop 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 -- 172.21.15.33:0/1688552221 shutdown_connections 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560612b6c8e0 0x560612f75bc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f6f5f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f63790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc13fff640 0 client.15462 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 --2- 172.21.15.33:0/1688552221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612b850a0 0x560612f63250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 -- 172.21.15.33:0/1688552221 >> 172.21.15.33:0/1688552221 conn(0x560612ba2350 msgr2=0x560612f551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 -- 172.21.15.33:0/1688552221 shutdown_connections 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 1 -- 172.21.15.33:0/1688552221 wait complete. 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.861+0000 7efc41451740 20 client.15462 trim_cache size 0 max 16384 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.879+0000 7efc41451740 1 Processor -- start 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.879+0000 7efc41451740 1 -- start start 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc41451740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f62740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc41451740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f5e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc41451740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612badf60 0x560612f5e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc41451740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560612f73f00 con 0x560612b850a0 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc41451740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560612f745d0 con 0x560612b8d280 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc41451740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560612f74ca0 con 0x560612badf60 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc38c78640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f62740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc38c78640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f62740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56604/0 (socket says 172.21.15.33:56604) 2024-08-28T19:32:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc38c78640 1 -- 172.21.15.33:0/3560021345 learned_addr learned my addr 172.21.15.33:0/3560021345 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc38c78640 1 -- 172.21.15.33:0/3560021345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612badf60 msgr2=0x560612f5e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc38c78640 1 --2- 172.21.15.33:0/3560021345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612badf60 0x560612f5e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc38c78640 1 -- 172.21.15.33:0/3560021345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 msgr2=0x560612f5e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc38c78640 1 --2- 172.21.15.33:0/3560021345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f5e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc38c78640 1 -- 172.21.15.33:0/3560021345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560612f545f0 con 0x560612b850a0 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc38c78640 1 --2- 172.21.15.33:0/3560021345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f62740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x560612f52430 tx=0x7efc2802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ac09784c95cb67 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.880+0000 7efc1e7fc640 1 -- 172.21.15.33:0/3560021345 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2803f050 con 0x560612b850a0 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc1e7fc640 1 -- 172.21.15.33:0/3560021345 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc28005410 con 0x560612b850a0 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc1e7fc640 1 -- 172.21.15.33:0/3560021345 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28035040 con 0x560612b850a0 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc41451740 1 -- 172.21.15.33:0/3560021345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 msgr2=0x560612f62740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc41451740 1 --2- 172.21.15.33:0/3560021345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f62740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x560612f52430 tx=0x7efc2802a410 comp rx=0 tx=0).stop 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc41451740 1 -- 172.21.15.33:0/3560021345 shutdown_connections 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc41451740 1 --2- 172.21.15.33:0/3560021345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612badf60 0x560612f5e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc41451740 1 --2- 172.21.15.33:0/3560021345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b8d280 0x560612f5e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc41451740 1 --2- 172.21.15.33:0/3560021345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612b850a0 0x560612f62740 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc41451740 1 -- 172.21.15.33:0/3560021345 >> 172.21.15.33:0/3560021345 conn(0x560612ba2350 msgr2=0x560612f631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc41451740 1 -- 172.21.15.33:0/3560021345 shutdown_connections 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.881+0000 7efc41451740 1 -- 172.21.15.33:0/3560021345 wait complete. 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.882+0000 7efc41451740 1 -- start start 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.882+0000 7efc41451740 1 Processor -- start 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.882+0000 7efc41451740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b850a0 0x560612f79f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.882+0000 7efc41451740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612b8d280 0x560612f7a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.882+0000 7efc41451740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f7a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.882+0000 7efc41451740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560612f75a40 con 0x560612badf60 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.882+0000 7efc41451740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560612f75370 con 0x560612b850a0 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.882+0000 7efc41451740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560612f76110 con 0x560612b8d280 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.882+0000 7efc41451740 10 client.0 _ll_register_callbacks cb 0x7efc2c0131c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.882+0000 7efc39479640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f7a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc39479640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f7a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56612/0 (socket says 172.21.15.33:56612) 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc39479640 1 -- 172.21.15.33:0/2670536321 learned_addr learned my addr 172.21.15.33:0/2670536321 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc38c78640 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b850a0 0x560612f79f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc33fff640 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612b8d280 0x560612f7a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc39479640 1 -- 172.21.15.33:0/2670536321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612b8d280 msgr2=0x560612f7a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc39479640 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612b8d280 0x560612f7a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc39479640 1 -- 172.21.15.33:0/2670536321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b850a0 msgr2=0x560612f79f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc39479640 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b850a0 0x560612f79f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc39479640 1 -- 172.21.15.33:0/2670536321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560612fe0140 con 0x560612badf60 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc39479640 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f7a990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00f7c0 tx=0x7efc2c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3374d589a9470b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc13fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc13fff640 1 -- 172.21.15.33:0/2670536321 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c019040 con 0x560612badf60 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc13fff640 1 -- 172.21.15.33:0/2670536321 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7efc2c025030 con 0x560612badf60 2024-08-28T19:32:15.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc41451740 1 -- 172.21.15.33:0/2670536321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc28005410 con 0x560612badf60 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc13fff640 1 -- 172.21.15.33:0/2670536321 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efc2c003970 con 0x560612badf60 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc41451740 10 client.15468 fetch_fsmap learned FSMap version 27 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.883+0000 7efc41451740 1 -- 172.21.15.33:0/2670536321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560612fe13c0 con 0x560612badf60 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.884+0000 7efc13fff640 1 -- 172.21.15.33:0/2670536321 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc28005410 con 0x560612badf60 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.884+0000 7efc13fff640 1 -- 172.21.15.33:0/2670536321 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7efc2c01f070 con 0x560612badf60 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.884+0000 7efc41451740 10 client.15468 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.884+0000 7efc41451740 10 client.15468 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.884+0000 7efc41451740 20 client.15468 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.884+0000 7efc41451740 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560612b41c90 0x560612fe4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.884+0000 7efc41451740 4 client.15468 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.884+0000 7efc41451740 1 -- 172.21.15.33:0/2670536321 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "status"}) -- 0x560612ec7de0 con 0x560612b41c90 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.884+0000 7efc38c78640 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560612b41c90 0x560612fe4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc38c78640 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560612b41c90 0x560612fe4c00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1828a6d5c920164b server_cookie=ed7a0fa69b4e7f5b in_seq=0 out_seq=0 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc13fff640 10 client.15468 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:32:15.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc13fff640 1 -- 172.21.15.33:0/2670536321 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560612ec7de0 con 0x560612b41c90 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc13fff640 10 client.15468 handle_command_reply: tid=0 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 client.15468 shutdown 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 -- 172.21.15.33:0/2670536321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 msgr2=0x560612f7a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f7a990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00f7c0 tx=0x7efc2c004040 comp rx=0 tx=0).stop 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 -- 172.21.15.33:0/2670536321 shutdown_connections 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560612b41c90 0x560612fe4c00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560612badf60 0x560612f7a990 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560612b8d280 0x560612f7a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 --2- 172.21.15.33:0/2670536321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560612b850a0 0x560612f79f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 -- 172.21.15.33:0/2670536321 >> 172.21.15.33:0/2670536321 conn(0x560612ba2350 msgr2=0x560612f631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc13fff640 0 client.15468 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 -- 172.21.15.33:0/2670536321 shutdown_connections 2024-08-28T19:32:15.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 1 -- 172.21.15.33:0/2670536321 wait complete. 2024-08-28T19:32:15.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.885+0000 7efc41451740 20 client.15468 trim_cache size 0 max 16384 2024-08-28T19:32:15.969 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:15.969 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:32:15.969 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 2, 2024-08-28T19:32:15.969 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24643, 2024-08-28T19:32:15.969 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:32:15.969 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:32:15.969 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:32:15.969 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 111.50335597199999, 2024-08-28T19:32:15.969 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 27, 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 82, 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 172.15454142900001 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 -- 172.21.15.33:0/3125464436 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc240b4c00 msgr2=0x7efc240b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc240b4c00 0x7efc240b7110 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efc2c005fd0 tx=0x7efc2c004ab0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 -- 172.21.15.33:0/3125464436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc34109240 msgr2=0x7efc3419a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc34109240 0x7efc3419a8a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efc20006fd0 tx=0x7efc2000b8e0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 -- 172.21.15.33:0/3125464436 shutdown_connections 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc240b4c00 0x7efc240b7110 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc34109b90 0x7efc3419fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc34109240 0x7efc3419a8a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 --2- 172.21.15.33:0/3125464436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc34103900 0x7efc3419a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:15.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 -- 172.21.15.33:0/3125464436 >> 172.21.15.33:0/3125464436 conn(0x7efc3407b5f0 msgr2=0x7efc34107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:15.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 -- 172.21.15.33:0/3125464436 shutdown_connections 2024-08-28T19:32:15.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:15.886+0000 7efc3aedc640 1 -- 172.21.15.33:0/3125464436 wait complete. 2024-08-28T19:32:16.704 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-28T19:32:16.959 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.484+0000 7fceddf84640 1 -- 172.21.15.33:0/1641650298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fced8108a90 msgr2=0x7fced810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.484+0000 7fceddf84640 1 --2- 172.21.15.33:0/1641650298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fced8108a90 0x7fced810f2c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fced0009ca0 tx=0x7fced002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.484+0000 7fceddf84640 1 -- 172.21.15.33:0/1641650298 shutdown_connections 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.484+0000 7fceddf84640 1 --2- 172.21.15.33:0/1641650298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fced8108a90 0x7fced810f2c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.484+0000 7fceddf84640 1 --2- 172.21.15.33:0/1641650298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced8108140 0x7fced8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.484+0000 7fceddf84640 1 --2- 172.21.15.33:0/1641650298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fced8102800 0x7fced8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.484+0000 7fceddf84640 1 -- 172.21.15.33:0/1641650298 >> 172.21.15.33:0/1641650298 conn(0x7fced80794d0 msgr2=0x7fced80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.484+0000 7fceddf84640 1 -- 172.21.15.33:0/1641650298 shutdown_connections 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.484+0000 7fceddf84640 1 -- 172.21.15.33:0/1641650298 wait complete. 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fceddf84640 1 Processor -- start 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fceddf84640 1 -- start start 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fceddf84640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fced8102800 0x7fced819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fceddf84640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced8108140 0x7fced819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fceddf84640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fced8108a90 0x7fced819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fceddf84640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fced8113820 con 0x7fced8102800 2024-08-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fceddf84640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fced81136a0 con 0x7fced8108140 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fceddf84640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fced81139a0 con 0x7fced8108a90 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fced77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fced8102800 0x7fced819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fced77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fced8102800 0x7fced819a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56638/0 (socket says 172.21.15.33:56638) 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.485+0000 7fced77fe640 1 -- 172.21.15.33:0/3856470665 learned_addr learned my addr 172.21.15.33:0/3856470665 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fceceffd640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced8108140 0x7fced819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced7fff640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fced8108a90 0x7fced819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced77fe640 1 -- 172.21.15.33:0/3856470665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fced8108a90 msgr2=0x7fced819f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced77fe640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fced8108a90 0x7fced819f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced77fe640 1 -- 172.21.15.33:0/3856470665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced8108140 msgr2=0x7fced819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced77fe640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced8108140 0x7fced819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced77fe640 1 -- 172.21.15.33:0/3856470665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced81a0040 con 0x7fced8102800 2024-08-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced7fff640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fced8108a90 0x7fced819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fceceffd640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced8108140 0x7fced819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced77fe640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fced8102800 0x7fced819a190 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcec800c920 tx=0x7fcec800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced57fa640 1 -- 172.21.15.33:0/3856470665 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8007c70 con 0x7fced8102800 2024-08-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fceddf84640 1 -- 172.21.15.33:0/3856470665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced81a0330 con 0x7fced8102800 2024-08-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced57fa640 1 -- 172.21.15.33:0/3856470665 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec8007e10 con 0x7fced8102800 2024-08-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fced57fa640 1 -- 172.21.15.33:0/3856470665 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8018820 con 0x7fced8102800 2024-08-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.486+0000 7fceddf84640 1 -- 172.21.15.33:0/3856470665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced81a6b50 con 0x7fced8102800 2024-08-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.489+0000 7fcee44f9740 1 Processor -- start 2024-08-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.489+0000 7fcee44f9740 1 -- start start 2024-08-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.489+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d288f60 0x558c5d62e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.489+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d62ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.489+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d268280 0x558c5d62f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.489+0000 7fcee44f9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558c5d5a53f0 con 0x558c5d2600a0 2024-08-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.489+0000 7fcee44f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558c5d594980 con 0x558c5d268280 2024-08-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.489+0000 7fcee44f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c5d598930 con 0x558c5d288f60 2024-08-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.489+0000 7fced57fa640 1 -- 172.21.15.33:0/3856470665 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fcec800f450 con 0x7fced8102800 2024-08-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fced77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d62ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fced7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d288f60 0x558c5d62e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fced77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d62ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56646/0 (socket says 172.21.15.33:56646) 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fced77fe640 1 -- 172.21.15.33:0/3972788896 learned_addr learned my addr 172.21.15.33:0/3972788896 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fceceffd640 1 --2- 172.21.15.33:0/3972788896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d268280 0x558c5d62f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fced77fe640 1 -- 172.21.15.33:0/3972788896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d288f60 msgr2=0x558c5d62e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fced77fe640 1 --2- 172.21.15.33:0/3972788896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d288f60 0x558c5d62e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fced77fe640 1 -- 172.21.15.33:0/3972788896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d268280 msgr2=0x558c5d62f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fced77fe640 1 --2- 172.21.15.33:0/3972788896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d268280 0x558c5d62f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fced77fe640 1 -- 172.21.15.33:0/3972788896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c5d2f4540 con 0x558c5d2600a0 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fced77fe640 1 --2- 172.21.15.33:0/3972788896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d62ecf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcec80ebcf0 tx=0x7fcec80ebde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633786f8981fdb59 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.490+0000 7fcecdffb640 1 -- 172.21.15.33:0/3972788896 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80ed7c0 con 0x558c5d2600a0 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.491+0000 7fcecdffb640 1 -- 172.21.15.33:0/3972788896 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec80f2070 con 0x558c5d2600a0 2024-08-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.491+0000 7fcecdffb640 1 -- 172.21.15.33:0/3972788896 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80eed50 con 0x558c5d2600a0 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.491+0000 7fced57fa640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcec40b4bb0 0x7fcec40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.491+0000 7fced7fff640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcec40b4bb0 0x7fcec40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.491+0000 7fced57fa640 1 -- 172.21.15.33:0/3856470665 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcec80e5800 con 0x7fced8102800 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.491+0000 7fcee44f9740 1 -- 172.21.15.33:0/3972788896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 msgr2=0x558c5d62ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.491+0000 7fced7fff640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcec40b4bb0 0x7fcec40b70c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fced0004af0 tx=0x7fced0005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.491+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3972788896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d62ecf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcec80ebcf0 tx=0x7fcec80ebde0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.492+0000 7fcee44f9740 1 -- 172.21.15.33:0/3972788896 shutdown_connections 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.492+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3972788896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d268280 0x558c5d62f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.492+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3972788896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d62ecf0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.492+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3972788896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d288f60 0x558c5d62e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.492+0000 7fcee44f9740 1 -- 172.21.15.33:0/3972788896 >> 172.21.15.33:0/3972788896 conn(0x558c5d27d350 msgr2=0x558c5d62c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.492+0000 7fcee44f9740 1 -- 172.21.15.33:0/3972788896 shutdown_connections 2024-08-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.492+0000 7fcee44f9740 1 -- 172.21.15.33:0/3972788896 wait complete. 2024-08-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.492+0000 7fcee44f9740 1 -- start start 2024-08-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.492+0000 7fcee44f9740 1 Processor -- start 2024-08-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d63e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d268280 0x558c5d63e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d288f60 0x558c5d64a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fcee44f9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558c5d3f75f0 con 0x558c5d2600a0 2024-08-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fcee44f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558c5d51b600 con 0x558c5d268280 2024-08-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fcee44f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c5d6412f0 con 0x558c5d288f60 2024-08-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fcee44f9740 10 client.0 _ll_register_callbacks cb 0x558c5d541af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fced77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d63e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fced77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d63e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56650/0 (socket says 172.21.15.33:56650) 2024-08-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fced77fe640 1 -- 172.21.15.33:0/3142352293 learned_addr learned my addr 172.21.15.33:0/3142352293 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fced7fff640 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d288f60 0x558c5d64a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fceceffd640 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d268280 0x558c5d63e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fced77fe640 1 -- 172.21.15.33:0/3142352293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d288f60 msgr2=0x558c5d64a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fced77fe640 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d288f60 0x558c5d64a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fced77fe640 1 -- 172.21.15.33:0/3142352293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d268280 msgr2=0x558c5d63e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fced77fe640 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d268280 0x558c5d63e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fced77fe640 1 -- 172.21.15.33:0/3142352293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c5d5547b0 con 0x558c5d2600a0 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fced77fe640 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d63e280 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcec80a7e40 tx=0x7fcec80076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3feea7cd1adb6ec8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fceb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fceb6ffd640 1 -- 172.21.15.33:0/3142352293 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80a7c80 con 0x558c5d2600a0 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fceb6ffd640 1 -- 172.21.15.33:0/3142352293 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcec800fa90 con 0x558c5d2600a0 2024-08-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.493+0000 7fcee44f9740 1 -- 172.21.15.33:0/3142352293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec80f2070 con 0x558c5d2600a0 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fceb6ffd640 1 -- 172.21.15.33:0/3142352293 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcec80ab530 con 0x558c5d2600a0 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fcee44f9740 10 client.15480 fetch_fsmap learned FSMap version 27 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fcee44f9740 1 -- 172.21.15.33:0/3142352293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558c5d64d040 con 0x558c5d2600a0 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fceb6ffd640 1 -- 172.21.15.33:0/3142352293 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec80f2070 con 0x558c5d2600a0 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fceb6ffd640 1 -- 172.21.15.33:0/3142352293 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fcec80930e0 con 0x558c5d2600a0 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fcee44f9740 10 client.15480 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fcee44f9740 10 client.15480 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fcee44f9740 20 client.15480 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x558c5d2478e0 0x558c5d6504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fcee44f9740 4 client.15480 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.494+0000 7fcee44f9740 1 -- 172.21.15.33:0/3142352293 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c5d5a7340 con 0x558c5d2478e0 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.495+0000 7fceceffd640 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x558c5d2478e0 0x558c5d6504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.495+0000 7fceceffd640 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x558c5d2478e0 0x558c5d6504e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=842aaa69898b921c server_cookie=22667f71e4d891e4 in_seq=0 out_seq=0 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.495+0000 7fceb6ffd640 10 client.15480 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fceb6ffd640 1 -- 172.21.15.33:0/3142352293 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c5d5a7340 con 0x558c5d2478e0 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fceb6ffd640 10 client.15480 handle_command_reply: tid=0 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 client.15480 shutdown 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 -- 172.21.15.33:0/3142352293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 msgr2=0x558c5d63e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d63e280 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcec80a7e40 tx=0x7fcec80076c0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 -- 172.21.15.33:0/3142352293 shutdown_connections 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x558c5d2478e0 0x558c5d6504e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d288f60 0x558c5d64a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d268280 0x558c5d63e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fceb6ffd640 0 client.15480 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3142352293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d2600a0 0x558c5d63e280 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 -- 172.21.15.33:0/3142352293 >> 172.21.15.33:0/3142352293 conn(0x558c5d27d350 msgr2=0x558c5d6301a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 -- 172.21.15.33:0/3142352293 shutdown_connections 2024-08-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 1 -- 172.21.15.33:0/3142352293 wait complete. 2024-08-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.496+0000 7fcee44f9740 20 client.15480 trim_cache size 0 max 16384 2024-08-28T19:32:17.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.514+0000 7fcee44f9740 1 Processor -- start 2024-08-28T19:32:17.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.514+0000 7fcee44f9740 1 -- start start 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d2600a0 0x558c5d64fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d268280 0x558c5d64a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d288f60 0x558c5d63e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fcee44f9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558c5d64e820 con 0x558c5d268280 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fcee44f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558c5d64eef0 con 0x558c5d288f60 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fcee44f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c5d64f5c0 con 0x558c5d2600a0 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fceceffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d268280 0x558c5d64a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fceceffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d268280 0x558c5d64a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56652/0 (socket says 172.21.15.33:56652) 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fceceffd640 1 -- 172.21.15.33:0/3678384583 learned_addr learned my addr 172.21.15.33:0/3678384583 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fced7fff640 1 --2- 172.21.15.33:0/3678384583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d288f60 0x558c5d63e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fced77fe640 1 --2- 172.21.15.33:0/3678384583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d2600a0 0x558c5d64fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fceceffd640 1 -- 172.21.15.33:0/3678384583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d2600a0 msgr2=0x558c5d64fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fceceffd640 1 --2- 172.21.15.33:0/3678384583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d2600a0 0x558c5d64fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fceceffd640 1 -- 172.21.15.33:0/3678384583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d288f60 msgr2=0x558c5d63e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fceceffd640 1 --2- 172.21.15.33:0/3678384583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d288f60 0x558c5d63e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fceceffd640 1 -- 172.21.15.33:0/3678384583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c5d63c780 con 0x558c5d268280 2024-08-28T19:32:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.515+0000 7fceceffd640 1 --2- 172.21.15.33:0/3678384583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d268280 0x558c5d64a5c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcec0005fd0 tx=0x7fcec00094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8d164b9d326a78 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.516+0000 7fcecd7fa640 1 -- 172.21.15.33:0/3678384583 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0005020 con 0x558c5d268280 2024-08-28T19:32:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.516+0000 7fcecd7fa640 1 -- 172.21.15.33:0/3678384583 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec001f030 con 0x558c5d268280 2024-08-28T19:32:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.516+0000 7fcecd7fa640 1 -- 172.21.15.33:0/3678384583 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec00126b0 con 0x558c5d268280 2024-08-28T19:32:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.516+0000 7fcee44f9740 1 -- 172.21.15.33:0/3678384583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d268280 msgr2=0x558c5d64a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.516+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3678384583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d268280 0x558c5d64a5c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcec0005fd0 tx=0x7fcec00094a0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.517+0000 7fcee44f9740 1 -- 172.21.15.33:0/3678384583 shutdown_connections 2024-08-28T19:32:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.517+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3678384583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d288f60 0x558c5d63e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.517+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3678384583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d268280 0x558c5d64a5c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.517+0000 7fcee44f9740 1 --2- 172.21.15.33:0/3678384583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d2600a0 0x558c5d64fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.517+0000 7fcee44f9740 1 -- 172.21.15.33:0/3678384583 >> 172.21.15.33:0/3678384583 conn(0x558c5d27d350 msgr2=0x558c5d6393f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.517+0000 7fcee44f9740 1 -- 172.21.15.33:0/3678384583 shutdown_connections 2024-08-28T19:32:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.517+0000 7fcee44f9740 1 -- 172.21.15.33:0/3678384583 wait complete. 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.517+0000 7fcee44f9740 1 -- start start 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.517+0000 7fcee44f9740 1 Processor -- start 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.517+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d2600a0 0x558c5d659140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d268280 0x558c5d6545f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fcee44f9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d288f60 0x558c5d654ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fcee44f9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558c5d650360 con 0x558c5d288f60 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fcee44f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558c5d64fc90 con 0x558c5d2600a0 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fcee44f9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558c5d650a30 con 0x558c5d268280 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fcee44f9740 10 client.0 _ll_register_callbacks cb 0x7fcec80ebb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fced7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d288f60 0x558c5d654ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fced7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d288f60 0x558c5d654ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56658/0 (socket says 172.21.15.33:56658) 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fced7fff640 1 -- 172.21.15.33:0/1563672995 learned_addr learned my addr 172.21.15.33:0/1563672995 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fced77fe640 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d2600a0 0x558c5d659140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fceceffd640 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d268280 0x558c5d6545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fced7fff640 1 -- 172.21.15.33:0/1563672995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d268280 msgr2=0x558c5d6545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fced7fff640 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d268280 0x558c5d6545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fced7fff640 1 -- 172.21.15.33:0/1563672995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d2600a0 msgr2=0x558c5d659140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fced7fff640 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d2600a0 0x558c5d659140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fced7fff640 1 -- 172.21.15.33:0/1563672995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c5d6ba9b0 con 0x558c5d288f60 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fceceffd640 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d268280 0x558c5d6545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fced7fff640 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d288f60 0x558c5d654ce0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fced00316f0 tx=0x7fced0040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802dfd1f95d498a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fceb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fceb6ffd640 1 -- 172.21.15.33:0/1563672995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0056060 con 0x558c5d288f60 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fceb6ffd640 1 -- 172.21.15.33:0/1563672995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fced002fd70 con 0x558c5d288f60 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.518+0000 7fcee44f9740 1 -- 172.21.15.33:0/1563672995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec001f030 con 0x558c5d288f60 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fceb6ffd640 1 -- 172.21.15.33:0/1563672995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fced005d050 con 0x558c5d288f60 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fcee44f9740 10 client.15486 fetch_fsmap learned FSMap version 27 2024-08-28T19:32:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fcee44f9740 1 -- 172.21.15.33:0/1563672995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558c5d6bbaa0 con 0x558c5d288f60 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fceb6ffd640 1 -- 172.21.15.33:0/1563672995 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec001f030 con 0x558c5d288f60 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fceb6ffd640 1 -- 172.21.15.33:0/1563672995 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fced00484d0 con 0x558c5d288f60 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fcee44f9740 10 client.15486 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fcee44f9740 10 client.15486 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fcee44f9740 20 client.15486 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fcee44f9740 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x558c5d21cc90 0x558c5d6bf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fcee44f9740 4 client.15486 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fcee44f9740 1 -- 172.21.15.33:0/1563672995 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "status"}) -- 0x558c5d5a2de0 con 0x558c5d21cc90 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.519+0000 7fced77fe640 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x558c5d21cc90 0x558c5d6bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fceb6ffd640 10 client.15486 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fced77fe640 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x558c5d21cc90 0x558c5d6bf440 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aef37f06ac65cc06 server_cookie=6b5ab29f71a0f6f8 in_seq=0 out_seq=0 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fceb6ffd640 1 -- 172.21.15.33:0/1563672995 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558c5d5a2de0 con 0x558c5d21cc90 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fceb6ffd640 10 client.15486 handle_command_reply: tid=0 2024-08-28T19:32:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 client.15486 shutdown 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 -- 172.21.15.33:0/1563672995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d288f60 msgr2=0x558c5d654ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d288f60 0x558c5d654ce0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fced00316f0 tx=0x7fced0040000 comp rx=0 tx=0).stop 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 -- 172.21.15.33:0/1563672995 shutdown_connections 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x558c5d21cc90 0x558c5d6bf440 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558c5d288f60 0x558c5d654ce0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558c5d268280 0x558c5d6545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 --2- 172.21.15.33:0/1563672995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c5d2600a0 0x558c5d659140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 -- 172.21.15.33:0/1563672995 >> 172.21.15.33:0/1563672995 conn(0x558c5d27d350 msgr2=0x558c5d63e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fceb6ffd640 0 client.15486 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 -- 172.21.15.33:0/1563672995 shutdown_connections 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.520+0000 7fcee44f9740 1 -- 172.21.15.33:0/1563672995 wait complete. 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fcee44f9740 20 client.15486 trim_cache size 0 max 16384 2024-08-28T19:32:17.526 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 1, 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24653, 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 114.152921904, 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 27, 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 82, 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 159.30903535799999 2024-08-28T19:32:17.527 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:17.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 -- 172.21.15.33:0/3856470665 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcec40b4bb0 msgr2=0x7fcec40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:17.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcec40b4bb0 0x7fcec40b70c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fced0004af0 tx=0x7fced0005d80 comp rx=0 tx=0).stop 2024-08-28T19:32:17.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 -- 172.21.15.33:0/3856470665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fced8102800 msgr2=0x7fced819a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fced8102800 0x7fced819a190 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcec800c920 tx=0x7fcec800cde0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 -- 172.21.15.33:0/3856470665 shutdown_connections 2024-08-28T19:32:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcec40b4bb0 0x7fcec40b70c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fced8108a90 0x7fced819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced8108140 0x7fced819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 --2- 172.21.15.33:0/3856470665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fced8102800 0x7fced819a190 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 -- 172.21.15.33:0/3856470665 >> 172.21.15.33:0/3856470665 conn(0x7fced80794d0 msgr2=0x7fced8105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 -- 172.21.15.33:0/3856470665 shutdown_connections 2024-08-28T19:32:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:17.521+0000 7fceddf84640 1 -- 172.21.15.33:0/3856470665 wait complete. 2024-08-28T19:32:17.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:17 smithi033 ceph-mon[18549]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:32:17.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:17 smithi059 ceph-mon[22052]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:32:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:17 smithi122 ceph-mon[22174]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:32:18.287 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-28T19:32:18.539 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.028+0000 7f5211b59640 1 -- 172.21.15.33:0/401443944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f520c108a90 msgr2=0x7f520c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.028+0000 7f5211b59640 1 --2- 172.21.15.33:0/401443944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f520c108a90 0x7f520c10f2c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5204009ca0 tx=0x7f520402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.028+0000 7f5211b59640 1 -- 172.21.15.33:0/401443944 shutdown_connections 2024-08-28T19:32:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.028+0000 7f5211b59640 1 --2- 172.21.15.33:0/401443944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f520c108a90 0x7f520c10f2c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.028+0000 7f5211b59640 1 --2- 172.21.15.33:0/401443944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f520c108140 0x7f520c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.028+0000 7f5211b59640 1 --2- 172.21.15.33:0/401443944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c102800 0x7f520c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.028+0000 7f5211b59640 1 -- 172.21.15.33:0/401443944 >> 172.21.15.33:0/401443944 conn(0x7f520c0794d0 msgr2=0x7f520c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.028+0000 7f5211b59640 1 -- 172.21.15.33:0/401443944 shutdown_connections 2024-08-28T19:32:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.028+0000 7f5211b59640 1 -- 172.21.15.33:0/401443944 wait complete. 2024-08-28T19:32:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.028+0000 7f5211b59640 1 Processor -- start 2024-08-28T19:32:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f5211b59640 1 -- start start 2024-08-28T19:32:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f5211b59640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c102800 0x7f520c1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f5211b59640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f520c108140 0x7f520c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f5211b59640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f520c108a90 0x7f520c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f5211b59640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f520c112760 con 0x7f520c108a90 2024-08-28T19:32:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f5211b59640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f520c1125e0 con 0x7f520c102800 2024-08-28T19:32:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f5211b59640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f520c1128e0 con 0x7f520c108140 2024-08-28T19:32:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f520bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f520c108a90 0x7f520c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f520bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f520c108a90 0x7f520c19e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37240/0 (socket says 172.21.15.33:37240) 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f520bfff640 1 -- 172.21.15.33:0/1871184686 learned_addr learned my addr 172.21.15.33:0/1871184686 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f520b7fe640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c102800 0x7f520c1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f520affd640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f520c108140 0x7f520c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f520bfff640 1 -- 172.21.15.33:0/1871184686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f520c108140 msgr2=0x7f520c199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f520bfff640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f520c108140 0x7f520c199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f520bfff640 1 -- 172.21.15.33:0/1871184686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c102800 msgr2=0x7f520c1990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f520bfff640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c102800 0x7f520c1990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.029+0000 7f520bfff640 1 -- 172.21.15.33:0/1871184686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520c19ef80 con 0x7f520c108a90 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.030+0000 7f520bfff640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f520c108a90 0x7f520c19e910 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5204009430 tx=0x7f52040319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.030+0000 7f5208ff9640 1 -- 172.21.15.33:0/1871184686 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5204003b70 con 0x7f520c108a90 2024-08-28T19:32:19.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.030+0000 7f5211b59640 1 -- 172.21.15.33:0/1871184686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520c19f210 con 0x7f520c108a90 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.030+0000 7f5208ff9640 1 -- 172.21.15.33:0/1871184686 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5204003d10 con 0x7f520c108a90 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.030+0000 7f5208ff9640 1 -- 172.21.15.33:0/1871184686 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520402fa30 con 0x7f520c108a90 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.030+0000 7f5211b59640 1 -- 172.21.15.33:0/1871184686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520c1a5a90 con 0x7f520c108a90 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f5208ff9640 1 -- 172.21.15.33:0/1871184686 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f520402fbd0 con 0x7f520c108a90 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f52180ce740 1 Processor -- start 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f52180ce740 1 -- start start 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f52180ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd59524f60 0x55dd598ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f52180ce740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd594fc0a0 0x55dd598cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f52180ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f52180ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55dd598413f0 con 0x55dd59504280 2024-08-28T19:32:19.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f52180ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dd59830980 con 0x55dd59524f60 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f52180ce740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd59834930 con 0x55dd594fc0a0 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f520affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f520affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37252/0 (socket says 172.21.15.33:37252) 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.033+0000 7f520affd640 1 -- 172.21.15.33:0/2301232956 learned_addr learned my addr 172.21.15.33:0/2301232956 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f520b7fe640 1 --2- 172.21.15.33:0/2301232956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd594fc0a0 0x55dd598cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f520affd640 1 --2- 172.21.15.33:0/2301232956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd59524f60 0x55dd598ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f5208ff9640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f51f40b4bb0 0x7f51f40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f520affd640 1 -- 172.21.15.33:0/2301232956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd594fc0a0 msgr2=0x55dd598cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f520affd640 1 --2- 172.21.15.33:0/2301232956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd594fc0a0 0x55dd598cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f520affd640 1 -- 172.21.15.33:0/2301232956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd59524f60 msgr2=0x55dd598ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:19.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f520affd640 1 --2- 172.21.15.33:0/2301232956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd59524f60 0x55dd598ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f520affd640 1 -- 172.21.15.33:0/2301232956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd59590540 con 0x55dd59504280 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f520bfff640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f51f40b4bb0 0x7f51f40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f520affd640 1 --2- 172.21.15.33:0/2301232956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598cb230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f520000bfd0 tx=0x7f520000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9416131e1abd28 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f5208ff9640 1 -- 172.21.15.33:0/1871184686 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5204106860 con 0x7f520c108a90 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f51f1ffb640 1 -- 172.21.15.33:0/2301232956 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200004230 con 0x55dd59504280 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f51f1ffb640 1 -- 172.21.15.33:0/2301232956 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52000043d0 con 0x55dd59504280 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.034+0000 7f51f1ffb640 1 -- 172.21.15.33:0/2301232956 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200010810 con 0x55dd59504280 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.035+0000 7f52180ce740 1 -- 172.21.15.33:0/2301232956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 msgr2=0x55dd598cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.035+0000 7f520bfff640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f51f40b4bb0 0x7f51f40b70c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f52040c2300 tx=0x7f52040a9050 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.035+0000 7f52180ce740 1 --2- 172.21.15.33:0/2301232956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598cb230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f520000bfd0 tx=0x7f520000b9f0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.035+0000 7f52180ce740 1 -- 172.21.15.33:0/2301232956 shutdown_connections 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.035+0000 7f52180ce740 1 --2- 172.21.15.33:0/2301232956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598cb230 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.035+0000 7f52180ce740 1 --2- 172.21.15.33:0/2301232956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd594fc0a0 0x55dd598cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.035+0000 7f52180ce740 1 --2- 172.21.15.33:0/2301232956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd59524f60 0x55dd598ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.035+0000 7f52180ce740 1 -- 172.21.15.33:0/2301232956 >> 172.21.15.33:0/2301232956 conn(0x55dd59519350 msgr2=0x55dd598c86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.035+0000 7f52180ce740 1 -- 172.21.15.33:0/2301232956 shutdown_connections 2024-08-28T19:32:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.035+0000 7f52180ce740 1 -- 172.21.15.33:0/2301232956 wait complete. 2024-08-28T19:32:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f52180ce740 1 -- start start 2024-08-28T19:32:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f52180ce740 1 Processor -- start 2024-08-28T19:32:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f52180ce740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd594fc0a0 0x55dd598d8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f52180ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd59504280 0x55dd598d85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f52180ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598e4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f52180ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55dd596935f0 con 0x55dd59524f60 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f52180ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dd597b7600 con 0x55dd59504280 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f52180ce740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd598db0f0 con 0x55dd594fc0a0 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f52180ce740 10 client.0 _ll_register_callbacks cb 0x55dd597ddaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f520affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f520affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598e4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37268/0 (socket says 172.21.15.33:37268) 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f520affd640 1 -- 172.21.15.33:0/4074619926 learned_addr learned my addr 172.21.15.33:0/4074619926 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.036+0000 7f520affd640 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd594fc0a0 0x55dd598d8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f520b7fe640 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd59504280 0x55dd598d85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f520affd640 1 -- 172.21.15.33:0/4074619926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd594fc0a0 msgr2=0x55dd598d8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f520affd640 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd594fc0a0 0x55dd598d8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f520affd640 1 -- 172.21.15.33:0/4074619926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd59504280 msgr2=0x55dd598d85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f520affd640 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd59504280 0x55dd598d85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f520affd640 1 -- 172.21.15.33:0/4074619926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd597f07b0 con 0x55dd59524f60 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f520affd640 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598e4420 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5200003e40 tx=0x7f52000104b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7b1238a1e7d2e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f51eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f51eaffd640 1 -- 172.21.15.33:0/4074619926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52000035f0 con 0x55dd59524f60 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f51eaffd640 1 -- 172.21.15.33:0/4074619926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5200003790 con 0x55dd59524f60 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f52180ce740 1 -- 172.21.15.33:0/4074619926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52000043d0 con 0x55dd59524f60 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f51eaffd640 1 -- 172.21.15.33:0/4074619926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5200036050 con 0x55dd59524f60 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f52180ce740 10 client.15498 fetch_fsmap learned FSMap version 27 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f52180ce740 1 -- 172.21.15.33:0/4074619926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dd598e6e10 con 0x55dd59524f60 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.037+0000 7f51eaffd640 1 -- 172.21.15.33:0/4074619926 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52000043d0 con 0x55dd59524f60 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.038+0000 7f51eaffd640 1 -- 172.21.15.33:0/4074619926 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f520001c020 con 0x55dd59524f60 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.038+0000 7f52180ce740 10 client.15498 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.038+0000 7f52180ce740 10 client.15498 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T19:32:19.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.038+0000 7f52180ce740 20 client.15498 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.038+0000 7f52180ce740 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd594e38e0 0x55dd598ea550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.038+0000 7f52180ce740 4 client.15498 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.038+0000 7f52180ce740 1 -- 172.21.15.33:0/4074619926 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd59843340 con 0x55dd594e38e0 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.038+0000 7f520b7fe640 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd594e38e0 0x55dd598ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.038+0000 7f520b7fe640 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd594e38e0 0x55dd598ea550 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b1ded3ce70d8a92 server_cookie=3bd0ca5ca1e8d68a in_seq=0 out_seq=0 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.038+0000 7f51eaffd640 10 client.15498 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.039+0000 7f51eaffd640 1 -- 172.21.15.33:0/4074619926 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dd59843340 con 0x55dd594e38e0 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.039+0000 7f51eaffd640 10 client.15498 handle_command_reply: tid=0 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.039+0000 7f52180ce740 1 client.15498 shutdown 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.039+0000 7f52180ce740 1 -- 172.21.15.33:0/4074619926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 msgr2=0x55dd598e4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.039+0000 7f52180ce740 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598e4420 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5200003e40 tx=0x7f52000104b0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.040+0000 7f52180ce740 1 -- 172.21.15.33:0/4074619926 shutdown_connections 2024-08-28T19:32:19.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.040+0000 7f52180ce740 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd594e38e0 0x55dd598ea550 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.040+0000 7f52180ce740 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598e4420 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.040+0000 7f52180ce740 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd59504280 0x55dd598d85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.040+0000 7f52180ce740 1 --2- 172.21.15.33:0/4074619926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd594fc0a0 0x55dd598d8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.040+0000 7f51eaffd640 0 client.15498 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.040+0000 7f52180ce740 1 -- 172.21.15.33:0/4074619926 >> 172.21.15.33:0/4074619926 conn(0x55dd59519350 msgr2=0x55dd598c6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.040+0000 7f52180ce740 1 -- 172.21.15.33:0/4074619926 shutdown_connections 2024-08-28T19:32:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.040+0000 7f52180ce740 1 -- 172.21.15.33:0/4074619926 wait complete. 2024-08-28T19:32:19.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.040+0000 7f52180ce740 20 client.15498 trim_cache size 0 max 16384 2024-08-28T19:32:19.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f52180ce740 1 Processor -- start 2024-08-28T19:32:19.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f52180ce740 1 -- start start 2024-08-28T19:32:19.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f52180ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd594fc0a0 0x55dd598c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f52180ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598e4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f52180ce740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59524f60 0x55dd598d5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f52180ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55dd598e8890 con 0x55dd59504280 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f52180ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dd598e8f60 con 0x55dd594fc0a0 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f52180ce740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd598e9630 con 0x55dd59524f60 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f520b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f520b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598e4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37276/0 (socket says 172.21.15.33:37276) 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.058+0000 7f520b7fe640 1 -- 172.21.15.33:0/2019211412 learned_addr learned my addr 172.21.15.33:0/2019211412 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f520affd640 1 --2- 172.21.15.33:0/2019211412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd594fc0a0 0x55dd598c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f520b7fe640 1 -- 172.21.15.33:0/2019211412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59524f60 msgr2=0x55dd598d5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f520affd640 1 --2- 172.21.15.33:0/2019211412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59524f60 0x55dd598d5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f520b7fe640 1 --2- 172.21.15.33:0/2019211412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59524f60 0x55dd598d5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f520b7fe640 1 -- 172.21.15.33:0/2019211412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd594fc0a0 msgr2=0x55dd598c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f520b7fe640 1 --2- 172.21.15.33:0/2019211412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd594fc0a0 0x55dd598c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f520b7fe640 1 -- 172.21.15.33:0/2019211412 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd598cd5d0 con 0x55dd59504280 2024-08-28T19:32:19.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f520affd640 1 --2- 172.21.15.33:0/2019211412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59524f60 0x55dd598d5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:19.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f520b7fe640 1 --2- 172.21.15.33:0/2019211412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598e4390 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00a910 tx=0x7f51fc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcddac16875a614 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:19.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f51f17fa640 1 -- 172.21.15.33:0/2019211412 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc027020 con 0x55dd59504280 2024-08-28T19:32:19.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f51f17fa640 1 -- 172.21.15.33:0/2019211412 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51fc0047a0 con 0x55dd59504280 2024-08-28T19:32:19.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.059+0000 7f51f17fa640 1 -- 172.21.15.33:0/2019211412 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc01e830 con 0x55dd59504280 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.060+0000 7f52180ce740 1 -- 172.21.15.33:0/2019211412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 msgr2=0x55dd598e4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.060+0000 7f52180ce740 1 --2- 172.21.15.33:0/2019211412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598e4390 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00a910 tx=0x7f51fc010800 comp rx=0 tx=0).stop 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.060+0000 7f52180ce740 1 -- 172.21.15.33:0/2019211412 shutdown_connections 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.060+0000 7f52180ce740 1 --2- 172.21.15.33:0/2019211412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59524f60 0x55dd598d5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.060+0000 7f52180ce740 1 --2- 172.21.15.33:0/2019211412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59504280 0x55dd598e4390 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.060+0000 7f52180ce740 1 --2- 172.21.15.33:0/2019211412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd594fc0a0 0x55dd598c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.060+0000 7f52180ce740 1 -- 172.21.15.33:0/2019211412 >> 172.21.15.33:0/2019211412 conn(0x55dd59519350 msgr2=0x55dd598d6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.060+0000 7f52180ce740 1 -- 172.21.15.33:0/2019211412 shutdown_connections 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.060+0000 7f52180ce740 1 -- 172.21.15.33:0/2019211412 wait complete. 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.060+0000 7f52180ce740 1 -- start start 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f52180ce740 1 Processor -- start 2024-08-28T19:32:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f52180ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd594fc0a0 0x55dd598ec950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f52180ce740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59504280 0x55dd598ece90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f52180ce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f52180ce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55dd598ea3d0 con 0x55dd59524f60 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f52180ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dd598e9d00 con 0x55dd594fc0a0 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f52180ce740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd598eaaa0 con 0x55dd59504280 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f52180ce740 10 client.0 _ll_register_callbacks cb 0x7f5200003fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f520affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f520affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598ed3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37292/0 (socket says 172.21.15.33:37292) 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f520affd640 1 -- 172.21.15.33:0/4221251638 learned_addr learned my addr 172.21.15.33:0/4221251638 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f520affd640 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd594fc0a0 0x55dd598ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f520b7fe640 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59504280 0x55dd598ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f520affd640 1 -- 172.21.15.33:0/4221251638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59504280 msgr2=0x55dd598ece90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f520affd640 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59504280 0x55dd598ece90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f520affd640 1 -- 172.21.15.33:0/4221251638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd594fc0a0 msgr2=0x55dd598ec950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f520affd640 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd594fc0a0 0x55dd598ec950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.061+0000 7f520affd640 1 -- 172.21.15.33:0/4221251638 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd598f21c0 con 0x55dd59524f60 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f520affd640 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598ed3d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5200030940 tx=0x7f5200003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32de407f6f409ad5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f51eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f51eaffd640 1 -- 172.21.15.33:0/4221251638 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520003f060 con 0x55dd59524f60 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f51eaffd640 1 -- 172.21.15.33:0/4221251638 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f52000302b0 con 0x55dd59524f60 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f52180ce740 1 -- 172.21.15.33:0/4221251638 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51fc0047a0 con 0x55dd59524f60 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f51eaffd640 1 -- 172.21.15.33:0/4221251638 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5200046050 con 0x55dd59524f60 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f52180ce740 10 client.15504 fetch_fsmap learned FSMap version 27 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f52180ce740 1 -- 172.21.15.33:0/4221251638 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dd59955d30 con 0x55dd59524f60 2024-08-28T19:32:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f51eaffd640 1 -- 172.21.15.33:0/4221251638 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51fc0047a0 con 0x55dd59524f60 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f51eaffd640 1 -- 172.21.15.33:0/4221251638 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f520001c070 con 0x55dd59524f60 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f52180ce740 10 client.15504 fetch_fsmap finished waiting for FSMap version 27 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f52180ce740 10 client.15504 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f52180ce740 20 client.15504 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f52180ce740 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd594b8c90 0x55dd59959610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f52180ce740 4 client.15504 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.062+0000 7f52180ce740 1 -- 172.21.15.33:0/4221251638 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "status"}) -- 0x55dd5983ede0 con 0x55dd594b8c90 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.063+0000 7f520b7fe640 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd594b8c90 0x55dd59959610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.063+0000 7f520b7fe640 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd594b8c90 0x55dd59959610 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e565e53cf3c63813 server_cookie=d2571eb561e92936 in_seq=0 out_seq=0 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.063+0000 7f51eaffd640 10 client.15504 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f51eaffd640 1 -- 172.21.15.33:0/4221251638 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55dd5983ede0 con 0x55dd594b8c90 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f51eaffd640 10 client.15504 handle_command_reply: tid=0 2024-08-28T19:32:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 client.15504 shutdown 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 -- 172.21.15.33:0/4221251638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 msgr2=0x55dd598ed3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598ed3d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5200030940 tx=0x7f5200003f40 comp rx=0 tx=0).stop 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 -- 172.21.15.33:0/4221251638 shutdown_connections 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd594b8c90 0x55dd59959610 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd59524f60 0x55dd598ed3d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd59504280 0x55dd598ece90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f51eaffd640 0 client.15504 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 --2- 172.21.15.33:0/4221251638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd594fc0a0 0x55dd598ec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 -- 172.21.15.33:0/4221251638 >> 172.21.15.33:0/4221251638 conn(0x55dd59519350 msgr2=0x55dd598d64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 -- 172.21.15.33:0/4221251638 shutdown_connections 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 1 -- 172.21.15.33:0/4221251638 wait complete. 2024-08-28T19:32:19.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.064+0000 7f52180ce740 20 client.15504 trim_cache size 0 max 16384 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24658, 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 149.96261301800001, 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 27, 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 82, 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 169.93495557 2024-08-28T19:32:19.071 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:19.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 -- 172.21.15.33:0/1871184686 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f51f40b4bb0 msgr2=0x7f51f40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:19.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f51f40b4bb0 0x7f51f40b70c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f52040c2300 tx=0x7f52040a9050 comp rx=0 tx=0).stop 2024-08-28T19:32:19.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 -- 172.21.15.33:0/1871184686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f520c108a90 msgr2=0x7f520c19e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:19.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f520c108a90 0x7f520c19e910 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5204009430 tx=0x7f52040319f0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 -- 172.21.15.33:0/1871184686 shutdown_connections 2024-08-28T19:32:19.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f520c108a90 0x7f520c19e910 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f51f40b4bb0 0x7f51f40b70c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f520c108140 0x7f520c199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 --2- 172.21.15.33:0/1871184686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c102800 0x7f520c1990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:19.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 -- 172.21.15.33:0/1871184686 >> 172.21.15.33:0/1871184686 conn(0x7f520c0794d0 msgr2=0x7f520c104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:19.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 -- 172.21.15.33:0/1871184686 shutdown_connections 2024-08-28T19:32:19.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:19.065+0000 7f5211b59640 1 -- 172.21.15.33:0/1871184686 wait complete. 2024-08-28T19:32:19.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:19 smithi033 ceph-mon[18549]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:32:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:19 smithi059 ceph-mon[22052]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:32:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:19 smithi122 ceph-mon[22174]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:32:19.864 INFO:teuthology.run_tasks:Running task kclient... 2024-08-28T19:32:19.880 INFO:tasks.kclient:Mounting kernel clients... 2024-08-28T19:32:19.880 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-28T19:32:19.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:32:19.881 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-08-28T19:32:19.897 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-28T19:32:19.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:32:19.897 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-28T19:32:19.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:32:19.964 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-08-28T19:32:20.065 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-08-28T19:32:20.065 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-28T19:32:20.065 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-28T19:32:20.065 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-28T19:32:20.323 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.855+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2288668732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d28102820 msgr2=0x7f9d28102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.855+0000 7f9d2dc14640 1 --2- 172.21.15.33:0/2288668732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d28102820 0x7f9d28102c30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009900 tx=0x7f9d1802a410 comp rx=0 tx=0).stop 2024-08-28T19:32:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.855+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2288668732 shutdown_connections 2024-08-28T19:32:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.855+0000 7f9d2dc14640 1 --2- 172.21.15.33:0/2288668732 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d28108ab0 0x7f9d2810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.855+0000 7f9d2dc14640 1 --2- 172.21.15.33:0/2288668732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d28108160 0x7f9d28108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.855+0000 7f9d2dc14640 1 --2- 172.21.15.33:0/2288668732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d28102820 0x7f9d28102c30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.855+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2288668732 >> 172.21.15.33:0/2288668732 conn(0x7f9d28079510 msgr2=0x7f9d28079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.855+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2288668732 shutdown_connections 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.855+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2288668732 wait complete. 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.856+0000 7f9d2dc14640 1 Processor -- start 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.856+0000 7f9d2dc14640 1 -- start start 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d2dc14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d28102820 0x7f9d2819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d2dc14640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d28108160 0x7f9d2819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d2dc14640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d28108ab0 0x7f9d2819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d2dc14640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28112760 con 0x7f9d28102820 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d2dc14640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281125e0 con 0x7f9d28108160 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d2dc14640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281128e0 con 0x7f9d28108ab0 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d277fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d28102820 0x7f9d2819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d277fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d28102820 0x7f9d2819a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37304/0 (socket says 172.21.15.33:37304) 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d277fe640 1 -- 172.21.15.33:0/2328956607 learned_addr learned my addr 172.21.15.33:0/2328956607 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:20.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d26ffd640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d28108160 0x7f9d2819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d27fff640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d28108ab0 0x7f9d2819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d277fe640 1 -- 172.21.15.33:0/2328956607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d28108ab0 msgr2=0x7f9d2819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d277fe640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d28108ab0 0x7f9d2819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d277fe640 1 -- 172.21.15.33:0/2328956607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d28108160 msgr2=0x7f9d2819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d277fe640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d28108160 0x7f9d2819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d277fe640 1 -- 172.21.15.33:0/2328956607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d281a02b0 con 0x7f9d28102820 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d26ffd640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d28108160 0x7f9d2819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.857+0000 7f9d277fe640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d28102820 0x7f9d2819a340 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9d18005940 tx=0x7f9d180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.858+0000 7f9d24ff9640 1 -- 172.21.15.33:0/2328956607 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1803f030 con 0x7f9d28102820 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.858+0000 7f9d24ff9640 1 -- 172.21.15.33:0/2328956607 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d18003cb0 con 0x7f9d28102820 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.858+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2328956607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d281a0540 con 0x7f9d28102820 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.858+0000 7f9d24ff9640 1 -- 172.21.15.33:0/2328956607 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18035070 con 0x7f9d28102820 2024-08-28T19:32:20.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.858+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2328956607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d281a6d00 con 0x7f9d28102820 2024-08-28T19:32:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.859+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2328956607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d28103aa0 con 0x7f9d28102820 2024-08-28T19:32:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.860+0000 7f9d24ff9640 1 -- 172.21.15.33:0/2328956607 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f9d18042030 con 0x7f9d28102820 2024-08-28T19:32:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.861+0000 7f9d24ff9640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d100b4b80 0x7f9d100b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.861+0000 7f9d26ffd640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d100b4b80 0x7f9d100b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.861+0000 7f9d24ff9640 1 -- 172.21.15.33:0/2328956607 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9d18105ee0 con 0x7f9d28102820 2024-08-28T19:32:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.861+0000 7f9d26ffd640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d100b4b80 0x7f9d100b7090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9d280799d0 tx=0x7f9d1c00b5f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:20.866+0000 7f9d24ff9640 1 -- 172.21.15.33:0/2328956607 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9d180ccba0 con 0x7f9d28102820 2024-08-28T19:32:21.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.091+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2328956607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9d28102c30 con 0x7f9d28102820 2024-08-28T19:32:21.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.091+0000 7f9d24ff9640 1 -- 172.21.15.33:0/2328956607 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+88 (secure 0 0 0) 0x7f9d180cc4a0 con 0x7f9d28102820 2024-08-28T19:32:21.093 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-28T19:32:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2328956607 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d100b4b80 msgr2=0x7f9d100b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d100b4b80 0x7f9d100b7090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9d280799d0 tx=0x7f9d1c00b5f0 comp rx=0 tx=0).stop 2024-08-28T19:32:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2328956607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d28102820 msgr2=0x7f9d2819a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d28102820 0x7f9d2819a340 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9d18005940 tx=0x7f9d180042f0 comp rx=0 tx=0).stop 2024-08-28T19:32:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2328956607 shutdown_connections 2024-08-28T19:32:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d100b4b80 0x7f9d100b7090 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d28108ab0 0x7f9d2819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:21.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d28108160 0x7f9d2819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 --2- 172.21.15.33:0/2328956607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d28102820 0x7f9d2819a340 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2328956607 >> 172.21.15.33:0/2328956607 conn(0x7f9d28079510 msgr2=0x7f9d2806bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2328956607 shutdown_connections 2024-08-28T19:32:21.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21.094+0000 7f9d2dc14640 1 -- 172.21.15.33:0/2328956607 wait complete. 2024-08-28T19:32:21.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:21 smithi033 ceph-mon[18549]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:32:21.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:21 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2328956607' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-28T19:32:21.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:21 smithi059 ceph-mon[22052]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:32:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:21 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2328956607' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-28T19:32:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:21 smithi122 ceph-mon[22174]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:32:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:21 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2328956607' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-28T19:32:21.866 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-28T19:32:21.866 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-28T19:32:21.866 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-08-28T19:32:21.866 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-28T19:32:21.866 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-28T19:32:21.866 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-28T19:32:21.866 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-28T19:32:21.867 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-28T19:32:21.867 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-28T19:32:21.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:32:21.867 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-08-28T19:32:21.883 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-28T19:32:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-28T19:32:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-08-28T19:32:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-28T19:32:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-08-28T19:32:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-28T19:32:21.883 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-28T19:32:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-08-28T19:32:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-08-28T19:32:21.883 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42188sec preferred_lft 42188sec 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ece5:e6c5:1ad7:1682/64 scope link noprefixroute 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-08-28T19:32:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-08-28T19:32:21.885 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-28T19:32:21.885 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T19:32:21.885 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-28T19:32:21.885 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-08-28T19:32:21.885 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-08-28T19:32:21.885 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-08-28T19:32:21.885 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-28T19:32:21.885 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-28T19:32:21.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:32:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:32:22.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:32:22.026 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-28T19:32:22.051 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-08-28T19:32:22.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:32:22.052 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-08-28T19:32:22.109 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-08-28T19:32:22.109 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-28T19:32:22.109 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-28T19:32:22.109 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-28T19:32:22.109 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-28T19:32:22.110 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T19:32:22.110 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-28T19:32:22.110 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-28T19:32:22.110 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-28T19:32:22.110 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-28T19:32:22.110 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-28T19:32:22.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:32:22.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:32:22.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:32:22.236 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-08-28T19:32:22.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:32:22.251 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-08-28T19:32:22.307 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T19:32:22.307 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-28T19:32:22.307 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-28T19:32:22.307 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-28T19:32:22.307 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-28T19:32:22.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:32:22.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:32:22.424 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-28T19:32:22.424 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T19:32:22.424 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-28T19:32:22.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-28T19:32:22.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-28T19:32:22.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-28T19:32:22.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-28T19:32:22.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-28T19:32:22.425 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-28T19:32:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:32:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:32:22.539 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-28T19:32:22.539 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-08-28T19:32:22.539 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-08-28T19:32:22.539 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-08-28T19:32:22.539 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-08-28T19:32:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:32:22.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:32:22.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-28T19:32:22.617 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-28T19:32:22.631 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-28T19:32:22.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-28T19:32:22.632 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-28T19:32:22.686 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-28T19:32:22.686 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-28T19:32:22.686 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/b41436e7-7e7e-4409-8a1d-1ca40de42fe2 2024-08-28T19:32:22.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:32:22.686 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/b41436e7-7e7e-4409-8a1d-1ca40de42fe2 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-08-28T19:32:22.779 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-08-28T19:32:22.779 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync". 2024-08-28T19:32:22.914 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-08-28T19:32:22.914 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync". 2024-08-28T19:32:22.914 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.122:3300" 2024-08-28T19:32:22.914 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with new device syntax: 0@9a2fc37c-6572-11ef-bcd4-c7b262605968.cephfs=/volumes/qa/sv_1/b41436e7-7e7e-4409-8a1d-1ca40de42fe2 2024-08-28T19:32:22.914 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,name=0,key=0,mon_addr=172.21.15.33:3300/172.21.15.59:3300/172.21.15.122:3300" will pass to kernel 2024-08-28T19:32:22.915 INFO:teuthology.orchestra.run.smithi033.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-28T19:32:22.915 INFO:teuthology.orchestra.run.smithi033.stdout: You just mounted a file system that supports labels which does not 2024-08-28T19:32:22.915 INFO:teuthology.orchestra.run.smithi033.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-28T19:32:22.915 INFO:teuthology.orchestra.run.smithi033.stdout: applications will generate AVC messages and not be allowed access to 2024-08-28T19:32:22.915 INFO:teuthology.orchestra.run.smithi033.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-28T19:32:22.916 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-28T19:32:22.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:32:22.917 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-28T19:32:22.943 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-28T19:32:23.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-28T19:32:23.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:32:23.040 INFO:teuthology.orchestra.run.smithi033.stdout:client15513 2024-08-28T19:32:23.041 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:32:23.041 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-28T19:32:23.057 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-28T19:32:23.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-28T19:32:23.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:32:23.154 INFO:teuthology.orchestra.run.smithi033.stdout:client15513 2024-08-28T19:32:23.154 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-28T19:32:23.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-28T19:32:23.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:32:23.210 INFO:teuthology.orchestra.run.smithi033.stdout:client15513 2024-08-28T19:32:23.210 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968.client15513/status') 2024-08-28T19:32:23.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-28T19:32:23.268 INFO:teuthology.orchestra.run.smithi033.stdout:instance: client.15513 (3)192.168.0.1:0/3665181821 2024-08-28T19:32:23.268 INFO:teuthology.orchestra.run.smithi033.stdout:blocklisted: false 2024-08-28T19:32:23.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records in 2024-08-28T19:32:23.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records out 2024-08-28T19:32:23.268 INFO:teuthology.orchestra.run.smithi033.stderr:70 bytes copied, 2.2307e-05 s, 3.1 MB/s 2024-08-28T19:32:23.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-28T19:32:23.275 INFO:teuthology.run_tasks:Running task exec... 2024-08-28T19:32:23.285 INFO:teuthology.task.exec:Executing custom commands... 2024-08-28T19:32:23.285 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-08-28T19:32:23.285 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-08-28T19:32:23.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.396+0000 7f0221c58640 1 -- 172.21.15.33:0/3930959527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f021c10db60 msgr2=0x7f021c110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:23.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.396+0000 7f0221c58640 1 --2- 172.21.15.33:0/3930959527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f021c10db60 0x7f021c110030 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0214009ca0 tx=0x7f021402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:23.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.396+0000 7f0221c58640 1 -- 172.21.15.33:0/3930959527 shutdown_connections 2024-08-28T19:32:23.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.396+0000 7f0221c58640 1 --2- 172.21.15.33:0/3930959527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f021c10db60 0x7f021c110030 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:23.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.396+0000 7f0221c58640 1 --2- 172.21.15.33:0/3930959527 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f021c104f90 0x7f021c10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:23.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.396+0000 7f0221c58640 1 --2- 172.21.15.33:0/3930959527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f021c1045b0 0x7f021c1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:23.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.396+0000 7f0221c58640 1 -- 172.21.15.33:0/3930959527 >> 172.21.15.33:0/3930959527 conn(0x7f021c0fe160 msgr2=0x7f021c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:23.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.396+0000 7f0221c58640 1 -- 172.21.15.33:0/3930959527 shutdown_connections 2024-08-28T19:32:23.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.396+0000 7f0221c58640 1 -- 172.21.15.33:0/3930959527 wait complete. 2024-08-28T19:32:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f0221c58640 1 Processor -- start 2024-08-28T19:32:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f0221c58640 1 -- start start 2024-08-28T19:32:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f0221c58640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f021c1045b0 0x7f021c19a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f0221c58640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f021c104f90 0x7f021c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f0221c58640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f021c10db60 0x7f021c19f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f0221c58640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f021c1137d0 con 0x7f021c104f90 2024-08-28T19:32:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f0221c58640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f021c113650 con 0x7f021c1045b0 2024-08-28T19:32:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f0221c58640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f021c113950 con 0x7f021c10db60 2024-08-28T19:32:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f021affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f021c104f90 0x7f021c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:23.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f021affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f021c104f90 0x7f021c19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37330/0 (socket says 172.21.15.33:37330) 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f021affd640 1 -- 172.21.15.33:0/3533111323 learned_addr learned my addr 172.21.15.33:0/3533111323 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f021b7fe640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f021c1045b0 0x7f021c19a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.397+0000 7f021bfff640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f021c10db60 0x7f021c19f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f021affd640 1 -- 172.21.15.33:0/3533111323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f021c10db60 msgr2=0x7f021c19f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f021affd640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f021c10db60 0x7f021c19f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f021affd640 1 -- 172.21.15.33:0/3533111323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f021c1045b0 msgr2=0x7f021c19a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f021affd640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f021c1045b0 0x7f021c19a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f021affd640 1 -- 172.21.15.33:0/3533111323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021c1a0030 con 0x7f021c104f90 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f021bfff640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f021c10db60 0x7f021c19f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f021affd640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f021c104f90 0x7f021c19a730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f021000d750 tx=0x7f021000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f0218ff9640 1 -- 172.21.15.33:0/3533111323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210017070 con 0x7f021c104f90 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f0218ff9640 1 -- 172.21.15.33:0/3533111323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0210009820 con 0x7f021c104f90 2024-08-28T19:32:23.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f0221c58640 1 -- 172.21.15.33:0/3533111323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021c1a0320 con 0x7f021c104f90 2024-08-28T19:32:23.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f0218ff9640 1 -- 172.21.15.33:0/3533111323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210004c40 con 0x7f021c104f90 2024-08-28T19:32:23.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.398+0000 7f0221c58640 1 -- 172.21.15.33:0/3533111323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f021c1a6b40 con 0x7f021c104f90 2024-08-28T19:32:23.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.399+0000 7f0221c58640 1 -- 172.21.15.33:0/3533111323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f021c06bd60 con 0x7f021c104f90 2024-08-28T19:32:23.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.400+0000 7f0218ff9640 1 -- 172.21.15.33:0/3533111323 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f02100099d0 con 0x7f021c104f90 2024-08-28T19:32:23.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.401+0000 7f0218ff9640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02040b4b80 0x7f02040b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:23.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.401+0000 7f021b7fe640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02040b4b80 0x7f02040b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:23.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.401+0000 7f0218ff9640 1 -- 172.21.15.33:0/3533111323 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f02100e5400 con 0x7f021c104f90 2024-08-28T19:32:23.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.402+0000 7f021b7fe640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02040b4b80 0x7f02040b7090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f020c00abe0 tx=0x7f020c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:23.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.404+0000 7f0218ff9640 1 -- 172.21.15.33:0/3533111323 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f02100ac0c0 con 0x7f021c104f90 2024-08-28T19:32:23.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:23 smithi033 ceph-mon[18549]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:32:23.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:23.632+0000 7f0221c58640 1 -- 172.21.15.33:0/3533111323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f021c1a6d10 con 0x7f021c104f90 2024-08-28T19:32:23.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:23 smithi059 ceph-mon[22052]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:32:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:23 smithi122 ceph-mon[22174]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:32:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.369+0000 7f0218ff9640 1 -- 172.21.15.33:0/3533111323 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f02100ab9c0 con 0x7f021c104f90 2024-08-28T19:32:24.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 -- 172.21.15.33:0/3533111323 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02040b4b80 msgr2=0x7f02040b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02040b4b80 0x7f02040b7090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f020c00abe0 tx=0x7f020c00a2d0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 -- 172.21.15.33:0/3533111323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f021c104f90 msgr2=0x7f021c19a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f021c104f90 0x7f021c19a730 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f021000d750 tx=0x7f021000db50 comp rx=0 tx=0).stop 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 -- 172.21.15.33:0/3533111323 shutdown_connections 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f02040b4b80 0x7f02040b7090 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f021c10db60 0x7f021c19f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f021c104f90 0x7f021c19a730 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 --2- 172.21.15.33:0/3533111323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f021c1045b0 0x7f021c19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 -- 172.21.15.33:0/3533111323 >> 172.21.15.33:0/3533111323 conn(0x7f021c0fe160 msgr2=0x7f021c107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 -- 172.21.15.33:0/3533111323 shutdown_connections 2024-08-28T19:32:24.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.373+0000 7f0221c58640 1 -- 172.21.15.33:0/3533111323 wait complete. 2024-08-28T19:32:24.388 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-28T19:32:24.398 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-28T19:32:24.412 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-28T19:32:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.532+0000 7f0cd5f67640 1 -- 172.21.15.33:0/3746416607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cd0102730 msgr2=0x7f0cd0102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.532+0000 7f0cd5f67640 1 --2- 172.21.15.33:0/3746416607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cd0102730 0x7f0cd0102b40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009900 tx=0x7f0cc002a410 comp rx=0 tx=0).stop 2024-08-28T19:32:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.533+0000 7f0cd5f67640 1 -- 172.21.15.33:0/3746416607 shutdown_connections 2024-08-28T19:32:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.533+0000 7f0cd5f67640 1 --2- 172.21.15.33:0/3746416607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd01089b0 0x7f0cd010f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.533+0000 7f0cd5f67640 1 --2- 172.21.15.33:0/3746416607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0108060 0x7f0cd0108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.533+0000 7f0cd5f67640 1 --2- 172.21.15.33:0/3746416607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cd0102730 0x7f0cd0102b40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.533+0000 7f0cd5f67640 1 -- 172.21.15.33:0/3746416607 >> 172.21.15.33:0/3746416607 conn(0x7f0cd00fe0f0 msgr2=0x7f0cd0100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.533+0000 7f0cd5f67640 1 -- 172.21.15.33:0/3746416607 shutdown_connections 2024-08-28T19:32:24.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.533+0000 7f0cd5f67640 1 -- 172.21.15.33:0/3746416607 wait complete. 2024-08-28T19:32:24.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.533+0000 7f0cd5f67640 1 Processor -- start 2024-08-28T19:32:24.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.533+0000 7f0cd5f67640 1 -- start start 2024-08-28T19:32:24.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0cd5f67640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0102730 0x7f0cd019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0cd5f67640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd0108060 0x7f0cd019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0cd5f67640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cd01089b0 0x7f0cd019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0cd5f67640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0112680 con 0x7f0cd01089b0 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0cd5f67640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0112500 con 0x7f0cd0102730 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0cd5f67640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0112800 con 0x7f0cd0108060 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cd01089b0 0x7f0cd019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cd01089b0 0x7f0cd019fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37354/0 (socket says 172.21.15.33:37354) 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0ccffff640 1 -- 172.21.15.33:0/380301779 learned_addr learned my addr 172.21.15.33:0/380301779 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0cceffd640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd0108060 0x7f0cd019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0ccf7fe640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0102730 0x7f0cd019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0ccffff640 1 -- 172.21.15.33:0/380301779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd0108060 msgr2=0x7f0cd019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0ccffff640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd0108060 0x7f0cd019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0ccffff640 1 -- 172.21.15.33:0/380301779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0102730 msgr2=0x7f0cd019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0ccffff640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0102730 0x7f0cd019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0ccffff640 1 -- 172.21.15.33:0/380301779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd01a0160 con 0x7f0cd01089b0 2024-08-28T19:32:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.534+0000 7f0ccffff640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cd01089b0 0x7f0cd019fa60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800eaa0 tx=0x7f0cc800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.535+0000 7f0cccff9640 1 -- 172.21.15.33:0/380301779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800cdb0 con 0x7f0cd01089b0 2024-08-28T19:32:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.535+0000 7f0cccff9640 1 -- 172.21.15.33:0/380301779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc8005020 con 0x7f0cd01089b0 2024-08-28T19:32:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.535+0000 7f0cd5f67640 1 -- 172.21.15.33:0/380301779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd01a0450 con 0x7f0cd01089b0 2024-08-28T19:32:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.535+0000 7f0cccff9640 1 -- 172.21.15.33:0/380301779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80116d0 con 0x7f0cd01089b0 2024-08-28T19:32:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.535+0000 7f0cd5f67640 1 -- 172.21.15.33:0/380301779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd01a6be0 con 0x7f0cd01089b0 2024-08-28T19:32:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.536+0000 7f0cd5f67640 1 -- 172.21.15.33:0/380301779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd0102b40 con 0x7f0cd01089b0 2024-08-28T19:32:24.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.537+0000 7f0cccff9640 1 -- 172.21.15.33:0/380301779 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f0cc80051d0 con 0x7f0cd01089b0 2024-08-28T19:32:24.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.538+0000 7f0cccff9640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0cb80b4b80 0x7f0cb80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:24.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.538+0000 7f0ccf7fe640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0cb80b4b80 0x7f0cb80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:24.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.538+0000 7f0cccff9640 1 -- 172.21.15.33:0/380301779 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0cc80e5b40 con 0x7f0cd01089b0 2024-08-28T19:32:24.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.539+0000 7f0ccf7fe640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0cb80b4b80 0x7f0cb80b7090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0031440 tx=0x7f0cc0005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:24.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.541+0000 7f0cccff9640 1 -- 172.21.15.33:0/380301779 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0cc8016030 con 0x7f0cd01089b0 2024-08-28T19:32:24.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:24 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3533111323' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-28T19:32:24.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.730+0000 7f0cd5f67640 1 -- 172.21.15.33:0/380301779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0cd002e430 con 0x7f0cd01089b0 2024-08-28T19:32:24.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.731+0000 7f0cccff9640 1 -- 172.21.15.33:0/380301779 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25092 (secure 0 0 0) 0x7f0cc80ac800 con 0x7f0cd01089b0 2024-08-28T19:32:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:24.733 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:31:27.886529+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:32:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 -- 172.21.15.33:0/380301779 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0cb80b4b80 msgr2=0x7f0cb80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0cb80b4b80 0x7f0cb80b7090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0031440 tx=0x7f0cc0005d50 comp rx=0 tx=0).stop 2024-08-28T19:32:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 -- 172.21.15.33:0/380301779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cd01089b0 msgr2=0x7f0cd019fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cd01089b0 0x7f0cd019fa60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800eaa0 tx=0x7f0cc800ef60 comp rx=0 tx=0).stop 2024-08-28T19:32:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 -- 172.21.15.33:0/380301779 shutdown_connections 2024-08-28T19:32:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cd01089b0 0x7f0cd019fa60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0cb80b4b80 0x7f0cb80b7090 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0cd0108060 0x7f0cd019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 --2- 172.21.15.33:0/380301779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0102730 0x7f0cd019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 -- 172.21.15.33:0/380301779 >> 172.21.15.33:0/380301779 conn(0x7f0cd00fe0f0 msgr2=0x7f0cd006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 -- 172.21.15.33:0/380301779 shutdown_connections 2024-08-28T19:32:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.733+0000 7f0cd5f67640 1 -- 172.21.15.33:0/380301779 wait complete. 2024-08-28T19:32:24.746 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-28T19:25:14.079616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-28T19:29:44.553677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-28T19:29:46.793616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-28T19:29:53.252864+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-28T19:32:24.746 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-28T19:32:24.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:24 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3533111323' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-28T19:32:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:24 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3533111323' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-28T19:32:24.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.859+0000 7f2c95ecc640 1 -- 172.21.15.33:0/177849752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c90102730 msgr2=0x7f2c90102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:24.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.859+0000 7f2c95ecc640 1 --2- 172.21.15.33:0/177849752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c90102730 0x7f2c90102b40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009900 tx=0x7f2c8002a410 comp rx=0 tx=0).stop 2024-08-28T19:32:24.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.859+0000 7f2c95ecc640 1 -- 172.21.15.33:0/177849752 shutdown_connections 2024-08-28T19:32:24.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.859+0000 7f2c95ecc640 1 --2- 172.21.15.33:0/177849752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c901089b0 0x7f2c9010f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.859+0000 7f2c95ecc640 1 --2- 172.21.15.33:0/177849752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c90108060 0x7f2c90108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.859+0000 7f2c95ecc640 1 --2- 172.21.15.33:0/177849752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c90102730 0x7f2c90102b40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.859+0000 7f2c95ecc640 1 -- 172.21.15.33:0/177849752 >> 172.21.15.33:0/177849752 conn(0x7f2c900fe150 msgr2=0x7f2c901005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:24.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.859+0000 7f2c95ecc640 1 -- 172.21.15.33:0/177849752 shutdown_connections 2024-08-28T19:32:24.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.859+0000 7f2c95ecc640 1 -- 172.21.15.33:0/177849752 wait complete. 2024-08-28T19:32:24.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c95ecc640 1 Processor -- start 2024-08-28T19:32:24.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c95ecc640 1 -- start start 2024-08-28T19:32:24.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c95ecc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c90102730 0x7f2c9019afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:24.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c95ecc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c90108060 0x7f2c9019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:24.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c95ecc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c901089b0 0x7f2c9019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:24.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c95ecc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2c90112660 con 0x7f2c901089b0 2024-08-28T19:32:24.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c95ecc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c901124e0 con 0x7f2c90102730 2024-08-28T19:32:24.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c95ecc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2c901127e0 con 0x7f2c90108060 2024-08-28T19:32:24.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c8ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c901089b0 0x7f2c9019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:24.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c8ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c901089b0 0x7f2c9019ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37370/0 (socket says 172.21.15.33:37370) 2024-08-28T19:32:24.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c8ffff640 1 -- 172.21.15.33:0/2972633076 learned_addr learned my addr 172.21.15.33:0/2972633076 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:24.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c8f7fe640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c90102730 0x7f2c9019afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:24.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.860+0000 7f2c8effd640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c90108060 0x7f2c9019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:24.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c8ffff640 1 -- 172.21.15.33:0/2972633076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c90108060 msgr2=0x7f2c9019b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:24.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c8ffff640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c90108060 0x7f2c9019b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c8ffff640 1 -- 172.21.15.33:0/2972633076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c90102730 msgr2=0x7f2c9019afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:24.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c8ffff640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c90102730 0x7f2c9019afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:24.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c8ffff640 1 -- 172.21.15.33:0/2972633076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c901a6260 con 0x7f2c901089b0 2024-08-28T19:32:24.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c8effd640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c90108060 0x7f2c9019b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:24.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c8ffff640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c901089b0 0x7f2c9019ba50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800eb10 tx=0x7f2c8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:24.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c8cff9640 1 -- 172.21.15.33:0/2972633076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88004b20 con 0x7f2c901089b0 2024-08-28T19:32:24.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c8cff9640 1 -- 172.21.15.33:0/2972633076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c88004cc0 con 0x7f2c901089b0 2024-08-28T19:32:24.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c95ecc640 1 -- 172.21.15.33:0/2972633076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c901a6550 con 0x7f2c901089b0 2024-08-28T19:32:24.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c8cff9640 1 -- 172.21.15.33:0/2972633076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88010670 con 0x7f2c901089b0 2024-08-28T19:32:24.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.861+0000 7f2c95ecc640 1 -- 172.21.15.33:0/2972633076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c901a6aa0 con 0x7f2c901089b0 2024-08-28T19:32:24.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.862+0000 7f2c95ecc640 1 -- 172.21.15.33:0/2972633076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c90102b40 con 0x7f2c901089b0 2024-08-28T19:32:24.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.864+0000 7f2c8cff9640 1 -- 172.21.15.33:0/2972633076 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f2c88005000 con 0x7f2c901089b0 2024-08-28T19:32:24.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.864+0000 7f2c8cff9640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c780b4c00 0x7f2c780b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:24.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.864+0000 7f2c8cff9640 1 -- 172.21.15.33:0/2972633076 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2c880e5df0 con 0x7f2c901089b0 2024-08-28T19:32:24.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.864+0000 7f2c8f7fe640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c780b4c00 0x7f2c780b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:24.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.865+0000 7f2c8f7fe640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c780b4c00 0x7f2c780b7110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2c80000c00 tx=0x7f2c80031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:24.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:24.867+0000 7f2c8cff9640 1 -- 172.21.15.33:0/2972633076 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2c88056130 con 0x7f2c901089b0 2024-08-28T19:32:25.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.053+0000 7f2c95ecc640 1 -- 172.21.15.33:0/2972633076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2c9002e430 con 0x7f2c901089b0 2024-08-28T19:32:25.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.054+0000 7f2c8cff9640 1 -- 172.21.15.33:0/2972633076 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f2c880acab0 con 0x7f2c901089b0 2024-08-28T19:32:25.055 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-28T19:32:25.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 -- 172.21.15.33:0/2972633076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c780b4c00 msgr2=0x7f2c780b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c780b4c00 0x7f2c780b7110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2c80000c00 tx=0x7f2c80031400 comp rx=0 tx=0).stop 2024-08-28T19:32:25.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 -- 172.21.15.33:0/2972633076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c901089b0 msgr2=0x7f2c9019ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c901089b0 0x7f2c9019ba50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800eb10 tx=0x7f2c8800c2d0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 -- 172.21.15.33:0/2972633076 shutdown_connections 2024-08-28T19:32:25.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c901089b0 0x7f2c9019ba50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c780b4c00 0x7f2c780b7110 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c90108060 0x7f2c9019b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 --2- 172.21.15.33:0/2972633076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c90102730 0x7f2c9019afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 -- 172.21.15.33:0/2972633076 >> 172.21.15.33:0/2972633076 conn(0x7f2c900fe150 msgr2=0x7f2c90100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:25.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 -- 172.21.15.33:0/2972633076 shutdown_connections 2024-08-28T19:32:25.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.056+0000 7f2c95ecc640 1 -- 172.21.15.33:0/2972633076 wait complete. 2024-08-28T19:32:25.068 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-28T19:32:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.181+0000 7fd109c89640 1 -- 172.21.15.33:0/1838585531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd104102750 msgr2=0x7fd104102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.181+0000 7fd109c89640 1 --2- 172.21.15.33:0/1838585531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd104102750 0x7fd104102b60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009900 tx=0x7fd0f402a410 comp rx=0 tx=0).stop 2024-08-28T19:32:25.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.181+0000 7fd109c89640 1 -- 172.21.15.33:0/1838585531 shutdown_connections 2024-08-28T19:32:25.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.181+0000 7fd109c89640 1 --2- 172.21.15.33:0/1838585531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1041089d0 0x7fd10410f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.181+0000 7fd109c89640 1 --2- 172.21.15.33:0/1838585531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd104108080 0x7fd104108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.181+0000 7fd109c89640 1 --2- 172.21.15.33:0/1838585531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd104102750 0x7fd104102b60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.181+0000 7fd109c89640 1 -- 172.21.15.33:0/1838585531 >> 172.21.15.33:0/1838585531 conn(0x7fd1040fe190 msgr2=0x7fd1041005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:25.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.181+0000 7fd109c89640 1 -- 172.21.15.33:0/1838585531 shutdown_connections 2024-08-28T19:32:25.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.181+0000 7fd109c89640 1 -- 172.21.15.33:0/1838585531 wait complete. 2024-08-28T19:32:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.182+0000 7fd109c89640 1 Processor -- start 2024-08-28T19:32:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.182+0000 7fd109c89640 1 -- start start 2024-08-28T19:32:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.182+0000 7fd109c89640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd104102750 0x7fd1041990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.182+0000 7fd109c89640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd104108080 0x7fd104199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.182+0000 7fd109c89640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1041089d0 0x7fd10419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.182+0000 7fd109c89640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041126f0 con 0x7fd104108080 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.182+0000 7fd109c89640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd104112570 con 0x7fd1041089d0 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.182+0000 7fd109c89640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd104112870 con 0x7fd104102750 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd102ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd104108080 0x7fd104199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd102ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd104108080 0x7fd104199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37394/0 (socket says 172.21.15.33:37394) 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd102ffd640 1 -- 172.21.15.33:0/49758501 learned_addr learned my addr 172.21.15.33:0/49758501 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd1037fe640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd104102750 0x7fd1041990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd103fff640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1041089d0 0x7fd10419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd102ffd640 1 -- 172.21.15.33:0/49758501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd104102750 msgr2=0x7fd1041990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd102ffd640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd104102750 0x7fd1041990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd102ffd640 1 -- 172.21.15.33:0/49758501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1041089d0 msgr2=0x7fd10419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd102ffd640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1041089d0 0x7fd10419e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd102ffd640 1 -- 172.21.15.33:0/49758501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10419f020 con 0x7fd104108080 2024-08-28T19:32:25.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd102ffd640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd104108080 0x7fd104199690 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800c970 tx=0x7fd0f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:25.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd100ff9640 1 -- 172.21.15.33:0/49758501 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8007bb0 con 0x7fd104108080 2024-08-28T19:32:25.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd100ff9640 1 -- 172.21.15.33:0/49758501 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0f8007d50 con 0x7fd104108080 2024-08-28T19:32:25.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd100ff9640 1 -- 172.21.15.33:0/49758501 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800f450 con 0x7fd104108080 2024-08-28T19:32:25.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd109c89640 1 -- 172.21.15.33:0/49758501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10419f310 con 0x7fd104108080 2024-08-28T19:32:25.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.183+0000 7fd109c89640 1 -- 172.21.15.33:0/49758501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1041a5aa0 con 0x7fd104108080 2024-08-28T19:32:25.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.185+0000 7fd109c89640 1 -- 172.21.15.33:0/49758501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd104102b60 con 0x7fd104108080 2024-08-28T19:32:25.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.186+0000 7fd100ff9640 1 -- 172.21.15.33:0/49758501 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fd0f8004eb0 con 0x7fd104108080 2024-08-28T19:32:25.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.187+0000 7fd100ff9640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0ec0b4b80 0x7fd0ec0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.187+0000 7fd1037fe640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0ec0b4b80 0x7fd0ec0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.187+0000 7fd100ff9640 1 -- 172.21.15.33:0/49758501 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd0f80e5840 con 0x7fd104108080 2024-08-28T19:32:25.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.188+0000 7fd1037fe640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0ec0b4b80 0x7fd0ec0b7090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4031440 tx=0x7fd0f4005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:25.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.190+0000 7fd100ff9640 1 -- 172.21.15.33:0/49758501 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd0f8014030 con 0x7fd104108080 2024-08-28T19:32:25.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.377+0000 7fd109c89640 1 -- 172.21.15.33:0/49758501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd10402e430 con 0x7fd104108080 2024-08-28T19:32:25.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.377+0000 7fd100ff9640 1 -- 172.21.15.33:0/49758501 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7fd0f80ac4a0 con 0x7fd104108080 2024-08-28T19:32:25.378 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-28T19:32:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 -- 172.21.15.33:0/49758501 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0ec0b4b80 msgr2=0x7fd0ec0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0ec0b4b80 0x7fd0ec0b7090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4031440 tx=0x7fd0f4005d50 comp rx=0 tx=0).stop 2024-08-28T19:32:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 -- 172.21.15.33:0/49758501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd104108080 msgr2=0x7fd104199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd104108080 0x7fd104199690 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800c970 tx=0x7fd0f800ce30 comp rx=0 tx=0).stop 2024-08-28T19:32:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 -- 172.21.15.33:0/49758501 shutdown_connections 2024-08-28T19:32:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1041089d0 0x7fd10419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd104108080 0x7fd104199690 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd0ec0b4b80 0x7fd0ec0b7090 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 --2- 172.21.15.33:0/49758501 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd104102750 0x7fd1041990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 -- 172.21.15.33:0/49758501 >> 172.21.15.33:0/49758501 conn(0x7fd1040fe190 msgr2=0x7fd1041005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:25.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 -- 172.21.15.33:0/49758501 shutdown_connections 2024-08-28T19:32:25.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.380+0000 7fd109c89640 1 -- 172.21.15.33:0/49758501 wait complete. 2024-08-28T19:32:25.392 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-28T19:32:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.505+0000 7fb8b0edc640 1 -- 172.21.15.33:0/3796027951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8ac1057c0 msgr2=0x7fb8ac10f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.505+0000 7fb8b0edc640 1 --2- 172.21.15.33:0/3796027951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8ac1057c0 0x7fb8ac10f210 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009cd0 tx=0x7fb8a402a8e0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.505+0000 7fb8b0edc640 1 -- 172.21.15.33:0/3796027951 shutdown_connections 2024-08-28T19:32:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.505+0000 7fb8b0edc640 1 --2- 172.21.15.33:0/3796027951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8ac1057c0 0x7fb8ac10f210 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.505+0000 7fb8b0edc640 1 --2- 172.21.15.33:0/3796027951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac104e70 0x7fb8ac105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.505+0000 7fb8b0edc640 1 --2- 172.21.15.33:0/3796027951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac102eb0 0x7fb8ac1032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.505+0000 7fb8b0edc640 1 -- 172.21.15.33:0/3796027951 >> 172.21.15.33:0/3796027951 conn(0x7fb8ac079bb0 msgr2=0x7fb8ac079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.505+0000 7fb8b0edc640 1 -- 172.21.15.33:0/3796027951 shutdown_connections 2024-08-28T19:32:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.505+0000 7fb8b0edc640 1 -- 172.21.15.33:0/3796027951 wait complete. 2024-08-28T19:32:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.506+0000 7fb8b0edc640 1 Processor -- start 2024-08-28T19:32:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.506+0000 7fb8b0edc640 1 -- start start 2024-08-28T19:32:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.506+0000 7fb8b0edc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8ac102eb0 0x7fb8ac10fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.506+0000 7fb8b0edc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac104e70 0x7fb8ac110230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.506+0000 7fb8b0edc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac1057c0 0x7fb8ac110770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.506+0000 7fb8b0edc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac1137c0 con 0x7fb8ac102eb0 2024-08-28T19:32:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.506+0000 7fb8b0edc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac113640 con 0x7fb8ac104e70 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.506+0000 7fb8b0edc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac113940 con 0x7fb8ac1057c0 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8aa59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8ac102eb0 0x7fb8ac10fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8aa59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8ac102eb0 0x7fb8ac10fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37404/0 (socket says 172.21.15.33:37404) 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8aa59c640 1 -- 172.21.15.33:0/2049312552 learned_addr learned my addr 172.21.15.33:0/2049312552 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8a9d9b640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac104e70 0x7fb8ac110230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8aa59c640 1 -- 172.21.15.33:0/2049312552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac1057c0 msgr2=0x7fb8ac110770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8aa59c640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac1057c0 0x7fb8ac110770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8aa59c640 1 -- 172.21.15.33:0/2049312552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac104e70 msgr2=0x7fb8ac110230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8aa59c640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac104e70 0x7fb8ac110230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8aa59c640 1 -- 172.21.15.33:0/2049312552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac1a8490 con 0x7fb8ac102eb0 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8a9d9b640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac104e70 0x7fb8ac110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8aa59c640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8ac102eb0 0x7fb8ac10fcf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00e9f0 tx=0x7fb89c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb89b7fe640 1 -- 172.21.15.33:0/2049312552 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00cd80 con 0x7fb8ac102eb0 2024-08-28T19:32:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb89b7fe640 1 -- 172.21.15.33:0/2049312552 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb89c0108e0 con 0x7fb8ac102eb0 2024-08-28T19:32:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8b0edc640 1 -- 172.21.15.33:0/2049312552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ac1a8780 con 0x7fb8ac102eb0 2024-08-28T19:32:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb89b7fe640 1 -- 172.21.15.33:0/2049312552 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c018980 con 0x7fb8ac102eb0 2024-08-28T19:32:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.507+0000 7fb8b0edc640 1 -- 172.21.15.33:0/2049312552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ac1a8cd0 con 0x7fb8ac102eb0 2024-08-28T19:32:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.508+0000 7fb8b0edc640 1 -- 172.21.15.33:0/2049312552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ac1032c0 con 0x7fb8ac102eb0 2024-08-28T19:32:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.510+0000 7fb89b7fe640 1 -- 172.21.15.33:0/2049312552 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fb89c010430 con 0x7fb8ac102eb0 2024-08-28T19:32:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.511+0000 7fb89b7fe640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8940b4bb0 0x7fb8940b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.511+0000 7fb8a9d9b640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8940b4bb0 0x7fb8940b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.511+0000 7fb89b7fe640 1 -- 172.21.15.33:0/2049312552 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fb89c0e5f60 con 0x7fb8ac102eb0 2024-08-28T19:32:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.511+0000 7fb8a9d9b640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8940b4bb0 0x7fb8940b70c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac06acc0 tx=0x7fb8a0005cb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.514+0000 7fb89b7fe640 1 -- 172.21.15.33:0/2049312552 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb89c0acbc0 con 0x7fb8ac102eb0 2024-08-28T19:32:25.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:25 smithi033 ceph-mon[18549]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:32:25.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:25 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3533111323' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-28T19:32:25.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:25 smithi033 ceph-mon[18549]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-28T19:32:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:25 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/380301779' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:25.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:25 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2972633076' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T19:32:25.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.701+0000 7fb8b0edc640 1 -- 172.21.15.33:0/2049312552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb8ac02e430 con 0x7fb8ac102eb0 2024-08-28T19:32:25.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.702+0000 7fb89b7fe640 1 -- 172.21.15.33:0/2049312552 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7fb89c0b5100 con 0x7fb8ac102eb0 2024-08-28T19:32:25.702 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-28T19:32:25.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 -- 172.21.15.33:0/2049312552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8940b4bb0 msgr2=0x7fb8940b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8940b4bb0 0x7fb8940b70c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac06acc0 tx=0x7fb8a0005cb0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 -- 172.21.15.33:0/2049312552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8ac102eb0 msgr2=0x7fb8ac10fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8ac102eb0 0x7fb8ac10fcf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00e9f0 tx=0x7fb89c00eeb0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 -- 172.21.15.33:0/2049312552 shutdown_connections 2024-08-28T19:32:25.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8940b4bb0 0x7fb8940b70c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8ac1057c0 0x7fb8ac110770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8ac104e70 0x7fb8ac110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 --2- 172.21.15.33:0/2049312552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8ac102eb0 0x7fb8ac10fcf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 -- 172.21.15.33:0/2049312552 >> 172.21.15.33:0/2049312552 conn(0x7fb8ac079bb0 msgr2=0x7fb8ac108200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:25.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 -- 172.21.15.33:0/2049312552 shutdown_connections 2024-08-28T19:32:25.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.704+0000 7fb8b0edc640 1 -- 172.21.15.33:0/2049312552 wait complete. 2024-08-28T19:32:25.716 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-28T19:32:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:25 smithi059 ceph-mon[22052]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:32:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:25 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3533111323' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-28T19:32:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:25 smithi059 ceph-mon[22052]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-28T19:32:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:25 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/380301779' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:25 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2972633076' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T19:32:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:25 smithi122 ceph-mon[22174]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:32:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:25 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3533111323' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-28T19:32:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:25 smithi122 ceph-mon[22174]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-28T19:32:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:25 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/380301779' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:25 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2972633076' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T19:32:25.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.829+0000 7f373e1e4640 1 -- 172.21.15.33:0/1609829465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f373810db00 msgr2=0x7f373810ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.829+0000 7f373e1e4640 1 --2- 172.21.15.33:0/1609829465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f373810db00 0x7f373810ffe0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3730009ca0 tx=0x7f373002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.829+0000 7f373e1e4640 1 -- 172.21.15.33:0/1609829465 shutdown_connections 2024-08-28T19:32:25.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.829+0000 7f373e1e4640 1 --2- 172.21.15.33:0/1609829465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f373810db00 0x7f373810ffe0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.829+0000 7f373e1e4640 1 --2- 172.21.15.33:0/1609829465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3738105030 0x7f373810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.829+0000 7f373e1e4640 1 --2- 172.21.15.33:0/1609829465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37381046e0 0x7f3738104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.829+0000 7f373e1e4640 1 -- 172.21.15.33:0/1609829465 >> 172.21.15.33:0/1609829465 conn(0x7f37380fe150 msgr2=0x7f37381005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:25.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.829+0000 7f373e1e4640 1 -- 172.21.15.33:0/1609829465 shutdown_connections 2024-08-28T19:32:25.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.829+0000 7f373e1e4640 1 -- 172.21.15.33:0/1609829465 wait complete. 2024-08-28T19:32:25.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f373e1e4640 1 Processor -- start 2024-08-28T19:32:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f373e1e4640 1 -- start start 2024-08-28T19:32:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f373e1e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37381046e0 0x7f3738102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f373e1e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3738105030 0x7f3738102950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f373e1e4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f373810db00 0x7f3738102e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f373e1e4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3738113770 con 0x7f373810db00 2024-08-28T19:32:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f373e1e4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f37381135f0 con 0x7f3738105030 2024-08-28T19:32:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f373e1e4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f37381138f0 con 0x7f37381046e0 2024-08-28T19:32:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f3737fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f373810db00 0x7f3738102e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f3737fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f373810db00 0x7f3738102e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37410/0 (socket says 172.21.15.33:37410) 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f3737fff640 1 -- 172.21.15.33:0/3822381462 learned_addr learned my addr 172.21.15.33:0/3822381462 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f37377fe640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37381046e0 0x7f3738102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f3736ffd640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3738105030 0x7f3738102950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f3737fff640 1 -- 172.21.15.33:0/3822381462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37381046e0 msgr2=0x7f3738102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f3737fff640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37381046e0 0x7f3738102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f3737fff640 1 -- 172.21.15.33:0/3822381462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3738105030 msgr2=0x7f3738102950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.830+0000 7f3737fff640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3738105030 0x7f3738102950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.831+0000 7f3737fff640 1 -- 172.21.15.33:0/3822381462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37381a83e0 con 0x7f373810db00 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.831+0000 7f3736ffd640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3738105030 0x7f3738102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.831+0000 7f3737fff640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f373810db00 0x7f3738102e90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3730005cc0 tx=0x7f373002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.831+0000 7f3734ff9640 1 -- 172.21.15.33:0/3822381462 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730003bf0 con 0x7f373810db00 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.831+0000 7f3734ff9640 1 -- 172.21.15.33:0/3822381462 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3730003d90 con 0x7f373810db00 2024-08-28T19:32:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.831+0000 7f373e1e4640 1 -- 172.21.15.33:0/3822381462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37381a8670 con 0x7f373810db00 2024-08-28T19:32:25.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.831+0000 7f3734ff9640 1 -- 172.21.15.33:0/3822381462 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373002fbc0 con 0x7f373810db00 2024-08-28T19:32:25.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.831+0000 7f373e1e4640 1 -- 172.21.15.33:0/3822381462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37381a8c10 con 0x7f373810db00 2024-08-28T19:32:25.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.832+0000 7f373e1e4640 1 -- 172.21.15.33:0/3822381462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3738104af0 con 0x7f373810db00 2024-08-28T19:32:25.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.834+0000 7f3734ff9640 1 -- 172.21.15.33:0/3822381462 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f373002fd60 con 0x7f373810db00 2024-08-28T19:32:25.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.834+0000 7f3734ff9640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f37200b4c30 0x7f37200b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:25.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.835+0000 7f37377fe640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f37200b4c30 0x7f37200b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:25.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.835+0000 7f3734ff9640 1 -- 172.21.15.33:0/3822381462 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3730106ae0 con 0x7f373810db00 2024-08-28T19:32:25.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.835+0000 7f37377fe640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f37200b4c30 0x7f37200b7140 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3738103e60 tx=0x7f372800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:25.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:25.838+0000 7f3734ff9640 1 -- 172.21.15.33:0/3822381462 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f37300cd740 con 0x7f373810db00 2024-08-28T19:32:26.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.023+0000 7f373e1e4640 1 -- 172.21.15.33:0/3822381462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f37381a8fe0 con 0x7f373810db00 2024-08-28T19:32:26.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.023+0000 7f3734ff9640 1 -- 172.21.15.33:0/3822381462 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v84) ==== 103+0+11 (secure 0 0 0) 0x7f37300098b0 con 0x7f373810db00 2024-08-28T19:32:26.024 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-28T19:32:26.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 -- 172.21.15.33:0/3822381462 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f37200b4c30 msgr2=0x7f37200b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:26.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f37200b4c30 0x7f37200b7140 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3738103e60 tx=0x7f372800b390 comp rx=0 tx=0).stop 2024-08-28T19:32:26.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 -- 172.21.15.33:0/3822381462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f373810db00 msgr2=0x7f3738102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:26.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f373810db00 0x7f3738102e90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3730005cc0 tx=0x7f373002f380 comp rx=0 tx=0).stop 2024-08-28T19:32:26.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 -- 172.21.15.33:0/3822381462 shutdown_connections 2024-08-28T19:32:26.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f373810db00 0x7f3738102e90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:26.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3738105030 0x7f3738102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:26.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f37200b4c30 0x7f37200b7140 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:26.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 --2- 172.21.15.33:0/3822381462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f37381046e0 0x7f3738102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:26.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 -- 172.21.15.33:0/3822381462 >> 172.21.15.33:0/3822381462 conn(0x7f37380fe150 msgr2=0x7f37381075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:26.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 -- 172.21.15.33:0/3822381462 shutdown_connections 2024-08-28T19:32:26.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.026+0000 7f373e1e4640 1 -- 172.21.15.33:0/3822381462 wait complete. 2024-08-28T19:32:26.038 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-28T19:32:26.038 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:32:26.294 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:26.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:26 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/49758501' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-28T19:32:26.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:26 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2049312552' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-28T19:32:26.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:26 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3822381462' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-28T19:32:26.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:26 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/49758501' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-28T19:32:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:26 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2049312552' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-28T19:32:26.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:26 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3822381462' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-28T19:32:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:26 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/49758501' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-28T19:32:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:26 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2049312552' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-28T19:32:26.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:26 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3822381462' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-28T19:32:26.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.785+0000 7f2373806640 1 -- 172.21.15.33:0/1872019959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f236c103900 msgr2=0x7f236c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:26.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.785+0000 7f2373806640 1 --2- 172.21.15.33:0/1872019959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f236c103900 0x7f236c103d10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2368009900 tx=0x7f236802a410 comp rx=0 tx=0).stop 2024-08-28T19:32:26.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.785+0000 7f2373806640 1 -- 172.21.15.33:0/1872019959 shutdown_connections 2024-08-28T19:32:26.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.785+0000 7f2373806640 1 --2- 172.21.15.33:0/1872019959 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f236c109b90 0x7f236c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:26.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.785+0000 7f2373806640 1 --2- 172.21.15.33:0/1872019959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f236c109240 0x7f236c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:26.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.785+0000 7f2373806640 1 --2- 172.21.15.33:0/1872019959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f236c103900 0x7f236c103d10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.785+0000 7f2373806640 1 -- 172.21.15.33:0/1872019959 >> 172.21.15.33:0/1872019959 conn(0x7f236c07b5f0 msgr2=0x7f236c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.786+0000 7f2373806640 1 -- 172.21.15.33:0/1872019959 shutdown_connections 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.786+0000 7f2373806640 1 -- 172.21.15.33:0/1872019959 wait complete. 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.786+0000 7f2373806640 1 Processor -- start 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.786+0000 7f2373806640 1 -- start start 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.786+0000 7f2373806640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f236c103900 0x7f236c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2373806640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f236c109240 0x7f236c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2373806640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f236c109b90 0x7f236c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2373806640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f236c113850 con 0x7f236c109b90 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2373806640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f236c1136d0 con 0x7f236c103900 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2373806640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f236c1139d0 con 0x7f236c109240 2024-08-28T19:32:26.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2371da3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f236c109b90 0x7f236c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2371da3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f236c109b90 0x7f236c19fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37422/0 (socket says 172.21.15.33:37422) 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2371da3640 1 -- 172.21.15.33:0/304872142 learned_addr learned my addr 172.21.15.33:0/304872142 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f23715a2640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f236c103900 0x7f236c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2370da1640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f236c109240 0x7f236c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2371da3640 1 -- 172.21.15.33:0/304872142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f236c109240 msgr2=0x7f236c19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2371da3640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f236c109240 0x7f236c19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2371da3640 1 -- 172.21.15.33:0/304872142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f236c103900 msgr2=0x7f236c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2371da3640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f236c103900 0x7f236c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2371da3640 1 -- 172.21.15.33:0/304872142 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c1a01f0 con 0x7f236c109b90 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f23715a2640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f236c103900 0x7f236c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2371da3640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f236c109b90 0x7f236c19fac0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f236400cad0 tx=0x7f236400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:26.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f23627fc640 1 -- 172.21.15.33:0/304872142 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236400ae20 con 0x7f236c109b90 2024-08-28T19:32:26.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2373806640 1 -- 172.21.15.33:0/304872142 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c1a04e0 con 0x7f236c109b90 2024-08-28T19:32:26.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f23627fc640 1 -- 172.21.15.33:0/304872142 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2364005020 con 0x7f236c109b90 2024-08-28T19:32:26.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f23627fc640 1 -- 172.21.15.33:0/304872142 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236400f6b0 con 0x7f236c109b90 2024-08-28T19:32:26.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.787+0000 7f2373806640 1 -- 172.21.15.33:0/304872142 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c1a6c40 con 0x7f236c109b90 2024-08-28T19:32:26.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.788+0000 7f2373806640 1 -- 172.21.15.33:0/304872142 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c103d10 con 0x7f236c109b90 2024-08-28T19:32:26.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.791+0000 7f23627fc640 1 -- 172.21.15.33:0/304872142 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f23640051d0 con 0x7f236c109b90 2024-08-28T19:32:26.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.791+0000 7f23627fc640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23580b4b80 0x7f23580b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:26.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.792+0000 7f23715a2640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23580b4b80 0x7f23580b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:26.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.792+0000 7f23627fc640 1 -- 172.21.15.33:0/304872142 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f23640e5ad0 con 0x7f236c109b90 2024-08-28T19:32:26.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.792+0000 7f23715a2640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23580b4b80 0x7f23580b7090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2368031440 tx=0x7f2368009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:26.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:26.795+0000 7f23627fc640 1 -- 172.21.15.33:0/304872142 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2364014030 con 0x7f236c109b90 2024-08-28T19:32:27.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.019+0000 7f2373806640 1 -- 172.21.15.33:0/304872142 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f236c19b3b0 con 0x7f236c109b90 2024-08-28T19:32:27.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.020+0000 7f23627fc640 1 -- 172.21.15.33:0/304872142 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f236c19b3b0 con 0x7f236c109b90 2024-08-28T19:32:27.021 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:27.021 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:32:27.021 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:32:27.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 -- 172.21.15.33:0/304872142 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23580b4b80 msgr2=0x7f23580b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:27.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23580b4b80 0x7f23580b7090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2368031440 tx=0x7f2368009680 comp rx=0 tx=0).stop 2024-08-28T19:32:27.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 -- 172.21.15.33:0/304872142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f236c109b90 msgr2=0x7f236c19fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:27.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f236c109b90 0x7f236c19fac0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f236400cad0 tx=0x7f236400cf90 comp rx=0 tx=0).stop 2024-08-28T19:32:27.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 -- 172.21.15.33:0/304872142 shutdown_connections 2024-08-28T19:32:27.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f236c109b90 0x7f236c19fac0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:27.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23580b4b80 0x7f23580b7090 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:27.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f236c109240 0x7f236c19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:27.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 --2- 172.21.15.33:0/304872142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f236c103900 0x7f236c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:27.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 -- 172.21.15.33:0/304872142 >> 172.21.15.33:0/304872142 conn(0x7f236c07b5f0 msgr2=0x7f236c107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:27.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 -- 172.21.15.33:0/304872142 shutdown_connections 2024-08-28T19:32:27.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.023+0000 7f2373806640 1 -- 172.21.15.33:0/304872142 wait complete. 2024-08-28T19:32:27.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:27 smithi033 ceph-mon[18549]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-28T19:32:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:27 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/304872142' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:27.702 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-28T19:32:27.702 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-28T19:32:27.703 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-28T19:32:27.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:27 smithi059 ceph-mon[22052]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-28T19:32:27.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:27 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/304872142' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:27 smithi122 ceph-mon[22174]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-28T19:32:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:27 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/304872142' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.816+0000 7fcb51a51640 1 -- 172.21.15.33:0/2558632142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb4c101ee0 msgr2=0x7fcb4c1022f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.816+0000 7fcb51a51640 1 --2- 172.21.15.33:0/2558632142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb4c101ee0 0x7fcb4c1022f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009ca0 tx=0x7fcb3c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.816+0000 7fcb51a51640 1 -- 172.21.15.33:0/2558632142 shutdown_connections 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.816+0000 7fcb51a51640 1 --2- 172.21.15.33:0/2558632142 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb4c108160 0x7fcb4c10e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.816+0000 7fcb51a51640 1 --2- 172.21.15.33:0/2558632142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c107810 0x7fcb4c107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.816+0000 7fcb51a51640 1 --2- 172.21.15.33:0/2558632142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb4c101ee0 0x7fcb4c1022f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.816+0000 7fcb51a51640 1 -- 172.21.15.33:0/2558632142 >> 172.21.15.33:0/2558632142 conn(0x7fcb4c079bf0 msgr2=0x7fcb4c07a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.816+0000 7fcb51a51640 1 -- 172.21.15.33:0/2558632142 shutdown_connections 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.816+0000 7fcb51a51640 1 -- 172.21.15.33:0/2558632142 wait complete. 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.817+0000 7fcb51a51640 1 Processor -- start 2024-08-28T19:32:27.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.817+0000 7fcb51a51640 1 -- start start 2024-08-28T19:32:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.817+0000 7fcb51a51640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c101ee0 0x7fcb4c19afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.817+0000 7fcb51a51640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb4c107810 0x7fcb4c19b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.817+0000 7fcb51a51640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb4c108160 0x7fcb4c19ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.817+0000 7fcb51a51640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c111e80 con 0x7fcb4c107810 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.817+0000 7fcb51a51640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c111d00 con 0x7fcb4c101ee0 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.817+0000 7fcb51a51640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c112000 con 0x7fcb4c108160 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb4c107810 0x7fcb4c19b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb4c107810 0x7fcb4c19b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37436/0 (socket says 172.21.15.33:37436) 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4a7fc640 1 -- 172.21.15.33:0/979260058 learned_addr learned my addr 172.21.15.33:0/979260058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4affd640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c101ee0 0x7fcb4c19afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4b7fe640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb4c108160 0x7fcb4c19ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4a7fc640 1 -- 172.21.15.33:0/979260058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb4c108160 msgr2=0x7fcb4c19ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4a7fc640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb4c108160 0x7fcb4c19ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4a7fc640 1 -- 172.21.15.33:0/979260058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c101ee0 msgr2=0x7fcb4c19afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4a7fc640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c101ee0 0x7fcb4c19afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4a7fc640 1 -- 172.21.15.33:0/979260058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c1a6240 con 0x7fcb4c107810 2024-08-28T19:32:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4affd640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c101ee0 0x7fcb4c19afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:27.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb4a7fc640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb4c107810 0x7fcb4c19b4f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c970 tx=0x7fcb4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:27.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb50a4f640 1 -- 172.21.15.33:0/979260058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40007bb0 con 0x7fcb4c107810 2024-08-28T19:32:27.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb51a51640 1 -- 172.21.15.33:0/979260058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c1a6530 con 0x7fcb4c107810 2024-08-28T19:32:27.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb50a4f640 1 -- 172.21.15.33:0/979260058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb40007d50 con 0x7fcb4c107810 2024-08-28T19:32:27.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb50a4f640 1 -- 172.21.15.33:0/979260058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000f450 con 0x7fcb4c107810 2024-08-28T19:32:27.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.818+0000 7fcb51a51640 1 -- 172.21.15.33:0/979260058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c1a6b00 con 0x7fcb4c107810 2024-08-28T19:32:27.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.819+0000 7fcb51a51640 1 -- 172.21.15.33:0/979260058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4c1022f0 con 0x7fcb4c107810 2024-08-28T19:32:27.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.821+0000 7fcb50a4f640 1 -- 172.21.15.33:0/979260058 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fcb40004eb0 con 0x7fcb4c107810 2024-08-28T19:32:27.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.822+0000 7fcb50a4f640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcb340b4b80 0x7fcb340b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:27.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.822+0000 7fcb4affd640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcb340b4b80 0x7fcb340b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:27.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.822+0000 7fcb50a4f640 1 -- 172.21.15.33:0/979260058 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcb400e57e0 con 0x7fcb4c107810 2024-08-28T19:32:27.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.822+0000 7fcb4affd640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcb340b4b80 0x7fcb340b7090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c006010 tx=0x7fcb3c000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:27.825+0000 7fcb50a4f640 1 -- 172.21.15.33:0/979260058 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcb40014030 con 0x7fcb4c107810 2024-08-28T19:32:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.006+0000 7fcb51a51640 1 -- 172.21.15.33:0/979260058 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb4c101040 con 0x7fcb340b4b80 2024-08-28T19:32:28.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.012+0000 7fcb50a4f640 1 -- 172.21.15.33:0/979260058 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340764 (secure 0 0 0) 0x7fcb4c101040 con 0x7fcb340b4b80 2024-08-28T19:32:28.017 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:28.018 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-28T19:32:28.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 -- 172.21.15.33:0/979260058 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcb340b4b80 msgr2=0x7fcb340b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcb340b4b80 0x7fcb340b7090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c006010 tx=0x7fcb3c000f40 comp rx=0 tx=0).stop 2024-08-28T19:32:28.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 -- 172.21.15.33:0/979260058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb4c107810 msgr2=0x7fcb4c19b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb4c107810 0x7fcb4c19b4f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c970 tx=0x7fcb4000ce30 comp rx=0 tx=0).stop 2024-08-28T19:32:28.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 -- 172.21.15.33:0/979260058 shutdown_connections 2024-08-28T19:32:28.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcb340b4b80 0x7fcb340b7090 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcb4c108160 0x7fcb4c19ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb4c107810 0x7fcb4c19b4f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 --2- 172.21.15.33:0/979260058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb4c101ee0 0x7fcb4c19afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 -- 172.21.15.33:0/979260058 >> 172.21.15.33:0/979260058 conn(0x7fcb4c079bf0 msgr2=0x7fcb4c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:28.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 -- 172.21.15.33:0/979260058 shutdown_connections 2024-08-28T19:32:28.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.016+0000 7fcb51a51640 1 -- 172.21.15.33:0/979260058 wait complete. 2024-08-28T19:32:28.028 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-08-28T19:32:27.763324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666398,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1314,"num_read_kb":773,"num_write":388,"num_write_kb":2310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373276,"kb_used_data":11548,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568548,"statfs":{"total":1151940427776,"available":1151558193152,"internally_reserved":0,"allocated":11825152,"data_stored":7915343,"data_compressed":463917,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5989,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":78,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003360"},"pg_stats":[{"pgid":"2.1f","version":"81'13","reported_seq":174,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:25.595830+0000","last_change":"2024-08-28T19:29:46.098343+0000","last_active":"2024-08-28T19:32:25.595830+0000","last_peered":"2024-08-28T19:32:25.595830+0000","last_clean":"2024-08-28T19:32:25.595830+0000","last_became_active":"2024-08-28T19:29:46.097974+0000","last_became_peered":"2024-08-28T19:29:46.097974+0000","last_unstale":"2024-08-28T19:32:25.595830+0000","last_undegraded":"2024-08-28T19:32:25.595830+0000","last_fullsized":"2024-08-28T19:32:25.595830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:03:11.466154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125076+0000","last_change":"2024-08-28T19:29:48.123521+0000","last_active":"2024-08-28T19:31:56.125076+0000","last_peered":"2024-08-28T19:31:56.125076+0000","last_clean":"2024-08-28T19:31:56.125076+0000","last_became_active":"2024-08-28T19:29:48.122998+0000","last_became_peered":"2024-08-28T19:29:48.122998+0000","last_unstale":"2024-08-28T19:31:56.125076+0000","last_undegraded":"2024-08-28T19:31:56.125076+0000","last_fullsized":"2024-08-28T19:31:56.125076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:33:48.413468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901815+0000","last_change":"2024-08-28T19:29:55.268086+0000","last_active":"2024-08-28T19:31:27.901815+0000","last_peered":"2024-08-28T19:31:27.901815+0000","last_clean":"2024-08-28T19:31:27.901815+0000","last_became_active":"2024-08-28T19:29:55.267411+0000","last_became_peered":"2024-08-28T19:29:55.267411+0000","last_unstale":"2024-08-28T19:31:27.901815+0000","last_undegraded":"2024-08-28T19:31:27.901815+0000","last_fullsized":"2024-08-28T19:31:27.901815+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:32:16.277295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903018+0000","last_change":"2024-08-28T19:29:46.188552+0000","last_active":"2024-08-28T19:31:27.903018+0000","last_peered":"2024-08-28T19:31:27.903018+0000","last_clean":"2024-08-28T19:31:27.903018+0000","last_became_active":"2024-08-28T19:29:46.188118+0000","last_became_peered":"2024-08-28T19:29:46.188118+0000","last_unstale":"2024-08-28T19:31:27.903018+0000","last_undegraded":"2024-08-28T19:31:27.903018+0000","last_fullsized":"2024-08-28T19:31:27.903018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:55:43.774037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148138+0000","last_change":"2024-08-28T19:29:48.118765+0000","last_active":"2024-08-28T19:31:56.148138+0000","last_peered":"2024-08-28T19:31:56.148138+0000","last_clean":"2024-08-28T19:31:56.148138+0000","last_became_active":"2024-08-28T19:29:48.118111+0000","last_became_peered":"2024-08-28T19:29:48.118111+0000","last_unstale":"2024-08-28T19:31:56.148138+0000","last_undegraded":"2024-08-28T19:31:56.148138+0000","last_fullsized":"2024-08-28T19:31:56.148138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:00:51.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895580+0000","last_change":"2024-08-28T19:29:55.262222+0000","last_active":"2024-08-28T19:31:27.895580+0000","last_peered":"2024-08-28T19:31:27.895580+0000","last_clean":"2024-08-28T19:31:27.895580+0000","last_became_active":"2024-08-28T19:29:55.260906+0000","last_became_peered":"2024-08-28T19:29:55.260906+0000","last_unstale":"2024-08-28T19:31:27.895580+0000","last_undegraded":"2024-08-28T19:31:27.895580+0000","last_fullsized":"2024-08-28T19:31:27.895580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:22:30.523609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903748+0000","last_change":"2024-08-28T19:29:46.101077+0000","last_active":"2024-08-28T19:31:27.903748+0000","last_peered":"2024-08-28T19:31:27.903748+0000","last_clean":"2024-08-28T19:31:27.903748+0000","last_became_active":"2024-08-28T19:29:46.100630+0000","last_became_peered":"2024-08-28T19:29:46.100630+0000","last_unstale":"2024-08-28T19:31:27.903748+0000","last_undegraded":"2024-08-28T19:31:27.903748+0000","last_fullsized":"2024-08-28T19:31:27.903748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:59:11.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152697+0000","last_change":"2024-08-28T19:29:48.129460+0000","last_active":"2024-08-28T19:31:56.152697+0000","last_peered":"2024-08-28T19:31:56.152697+0000","last_clean":"2024-08-28T19:31:56.152697+0000","last_became_active":"2024-08-28T19:29:48.129068+0000","last_became_peered":"2024-08-28T19:29:48.129068+0000","last_unstale":"2024-08-28T19:31:56.152697+0000","last_undegraded":"2024-08-28T19:31:56.152697+0000","last_fullsized":"2024-08-28T19:31:56.152697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:08:40.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895880+0000","last_change":"2024-08-28T19:29:55.262943+0000","last_active":"2024-08-28T19:31:27.895880+0000","last_peered":"2024-08-28T19:31:27.895880+0000","last_clean":"2024-08-28T19:31:27.895880+0000","last_became_active":"2024-08-28T19:29:55.262424+0000","last_became_peered":"2024-08-28T19:29:55.262424+0000","last_unstale":"2024-08-28T19:31:27.895880+0000","last_undegraded":"2024-08-28T19:31:27.895880+0000","last_fullsized":"2024-08-28T19:31:27.895880+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:19:40.618651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903555+0000","last_change":"2024-08-28T19:29:46.102571+0000","last_active":"2024-08-28T19:31:27.903555+0000","last_peered":"2024-08-28T19:31:27.903555+0000","last_clean":"2024-08-28T19:31:27.903555+0000","last_became_active":"2024-08-28T19:29:46.102081+0000","last_became_peered":"2024-08-28T19:29:46.102081+0000","last_unstale":"2024-08-28T19:31:27.903555+0000","last_undegraded":"2024-08-28T19:31:27.903555+0000","last_fullsized":"2024-08-28T19:31:27.903555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:46:38.266122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149393+0000","last_change":"2024-08-28T19:30:27.550413+0000","last_active":"2024-08-28T19:31:56.149393+0000","last_peered":"2024-08-28T19:31:56.149393+0000","last_clean":"2024-08-28T19:31:56.149393+0000","last_became_active":"2024-08-28T19:30:27.550002+0000","last_became_peered":"2024-08-28T19:30:27.550002+0000","last_unstale":"2024-08-28T19:31:56.149393+0000","last_undegraded":"2024-08-28T19:31:56.149393+0000","last_fullsized":"2024-08-28T19:31:56.149393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:17.519332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895637+0000","last_change":"2024-08-28T19:29:55.261930+0000","last_active":"2024-08-28T19:31:27.895637+0000","last_peered":"2024-08-28T19:31:27.895637+0000","last_clean":"2024-08-28T19:31:27.895637+0000","last_became_active":"2024-08-28T19:29:55.261208+0000","last_became_peered":"2024-08-28T19:29:55.261208+0000","last_unstale":"2024-08-28T19:31:27.895637+0000","last_undegraded":"2024-08-28T19:31:27.895637+0000","last_fullsized":"2024-08-28T19:31:27.895637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.804993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152875+0000","last_change":"2024-08-28T19:29:48.133820+0000","last_active":"2024-08-28T19:31:56.152875+0000","last_peered":"2024-08-28T19:31:56.152875+0000","last_clean":"2024-08-28T19:31:56.152875+0000","last_became_active":"2024-08-28T19:29:48.132536+0000","last_became_peered":"2024-08-28T19:29:48.132536+0000","last_unstale":"2024-08-28T19:31:56.152875+0000","last_undegraded":"2024-08-28T19:31:56.152875+0000","last_fullsized":"2024-08-28T19:31:56.152875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:15:39.779698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902841+0000","last_change":"2024-08-28T19:29:46.101206+0000","last_active":"2024-08-28T19:31:27.902841+0000","last_peered":"2024-08-28T19:31:27.902841+0000","last_clean":"2024-08-28T19:31:27.902841+0000","last_became_active":"2024-08-28T19:29:46.100801+0000","last_became_peered":"2024-08-28T19:29:46.100801+0000","last_unstale":"2024-08-28T19:31:27.902841+0000","last_undegraded":"2024-08-28T19:31:27.902841+0000","last_fullsized":"2024-08-28T19:31:27.902841+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:43:33.156203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895905+0000","last_change":"2024-08-28T19:29:55.572774+0000","last_active":"2024-08-28T19:31:27.895905+0000","last_peered":"2024-08-28T19:31:27.895905+0000","last_clean":"2024-08-28T19:31:27.895905+0000","last_became_active":"2024-08-28T19:29:55.571703+0000","last_became_peered":"2024-08-28T19:29:55.571703+0000","last_unstale":"2024-08-28T19:31:27.895905+0000","last_undegraded":"2024-08-28T19:31:27.895905+0000","last_fullsized":"2024-08-28T19:31:27.895905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:56:52.695007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131019+0000","last_change":"2024-08-28T19:29:48.127683+0000","last_active":"2024-08-28T19:31:56.131019+0000","last_peered":"2024-08-28T19:31:56.131019+0000","last_clean":"2024-08-28T19:31:56.131019+0000","last_became_active":"2024-08-28T19:29:48.127139+0000","last_became_peered":"2024-08-28T19:29:48.127139+0000","last_unstale":"2024-08-28T19:31:56.131019+0000","last_undegraded":"2024-08-28T19:31:56.131019+0000","last_fullsized":"2024-08-28T19:31:56.131019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:38:16.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902182+0000","last_change":"2024-08-28T19:29:46.103233+0000","last_active":"2024-08-28T19:31:27.902182+0000","last_peered":"2024-08-28T19:31:27.902182+0000","last_clean":"2024-08-28T19:31:27.902182+0000","last_became_active":"2024-08-28T19:29:46.102515+0000","last_became_peered":"2024-08-28T19:29:46.102515+0000","last_unstale":"2024-08-28T19:31:27.902182+0000","last_undegraded":"2024-08-28T19:31:27.902182+0000","last_fullsized":"2024-08-28T19:31:27.902182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:49:35.905893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896101+0000","last_change":"2024-08-28T19:29:55.264291+0000","last_active":"2024-08-28T19:31:27.896101+0000","last_peered":"2024-08-28T19:31:27.896101+0000","last_clean":"2024-08-28T19:31:27.896101+0000","last_became_active":"2024-08-28T19:29:55.263692+0000","last_became_peered":"2024-08-28T19:29:55.263692+0000","last_unstale":"2024-08-28T19:31:27.896101+0000","last_undegraded":"2024-08-28T19:31:27.896101+0000","last_fullsized":"2024-08-28T19:31:27.896101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:47:01.795320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.147184+0000","last_change":"2024-08-28T19:29:48.115470+0000","last_active":"2024-08-28T19:31:56.147184+0000","last_peered":"2024-08-28T19:31:56.147184+0000","last_clean":"2024-08-28T19:31:56.147184+0000","last_became_active":"2024-08-28T19:29:48.115076+0000","last_became_peered":"2024-08-28T19:29:48.115076+0000","last_unstale":"2024-08-28T19:31:56.147184+0000","last_undegraded":"2024-08-28T19:31:56.147184+0000","last_fullsized":"2024-08-28T19:31:56.147184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:32.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902180+0000","last_change":"2024-08-28T19:29:46.099970+0000","last_active":"2024-08-28T19:31:27.902180+0000","last_peered":"2024-08-28T19:31:27.902180+0000","last_clean":"2024-08-28T19:31:27.902180+0000","last_became_active":"2024-08-28T19:29:46.099661+0000","last_became_peered":"2024-08-28T19:29:46.099661+0000","last_unstale":"2024-08-28T19:31:27.902180+0000","last_undegraded":"2024-08-28T19:31:27.902180+0000","last_fullsized":"2024-08-28T19:31:27.902180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:27.430026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894683+0000","last_change":"2024-08-28T19:29:55.265983+0000","last_active":"2024-08-28T19:31:27.894683+0000","last_peered":"2024-08-28T19:31:27.894683+0000","last_clean":"2024-08-28T19:31:27.894683+0000","last_became_active":"2024-08-28T19:29:55.265464+0000","last_became_peered":"2024-08-28T19:29:55.265464+0000","last_unstale":"2024-08-28T19:31:27.894683+0000","last_undegraded":"2024-08-28T19:31:27.894683+0000","last_fullsized":"2024-08-28T19:31:27.894683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:21:42.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139931+0000","last_change":"2024-08-28T19:29:48.119545+0000","last_active":"2024-08-28T19:31:56.139931+0000","last_peered":"2024-08-28T19:31:56.139931+0000","last_clean":"2024-08-28T19:31:56.139931+0000","last_became_active":"2024-08-28T19:29:48.119128+0000","last_became_peered":"2024-08-28T19:29:48.119128+0000","last_unstale":"2024-08-28T19:31:56.139931+0000","last_undegraded":"2024-08-28T19:31:56.139931+0000","last_fullsized":"2024-08-28T19:31:56.139931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:05:31.535016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.907887+0000","last_change":"2024-08-28T19:31:27.907348+0000","last_active":"2024-08-28T19:31:27.907887+0000","last_peered":"2024-08-28T19:31:27.907887+0000","last_clean":"2024-08-28T19:31:27.907887+0000","last_became_active":"2024-08-28T19:31:27.904502+0000","last_became_peered":"2024-08-28T19:31:27.904502+0000","last_unstale":"2024-08-28T19:31:27.907887+0000","last_undegraded":"2024-08-28T19:31:27.907887+0000","last_fullsized":"2024-08-28T19:31:27.907887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:16:50.269131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895761+0000","last_change":"2024-08-28T19:29:55.573320+0000","last_active":"2024-08-28T19:31:27.895761+0000","last_peered":"2024-08-28T19:31:27.895761+0000","last_clean":"2024-08-28T19:31:27.895761+0000","last_became_active":"2024-08-28T19:29:55.572858+0000","last_became_peered":"2024-08-28T19:29:55.572858+0000","last_unstale":"2024-08-28T19:31:27.895761+0000","last_undegraded":"2024-08-28T19:31:27.895761+0000","last_fullsized":"2024-08-28T19:31:27.895761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:09:34.676911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.133571+0000","last_change":"2024-08-28T19:30:27.404918+0000","last_active":"2024-08-28T19:31:56.133571+0000","last_peered":"2024-08-28T19:31:56.133571+0000","last_clean":"2024-08-28T19:31:56.133571+0000","last_became_active":"2024-08-28T19:30:27.404495+0000","last_became_peered":"2024-08-28T19:30:27.404495+0000","last_unstale":"2024-08-28T19:31:56.133571+0000","last_undegraded":"2024-08-28T19:31:56.133571+0000","last_fullsized":"2024-08-28T19:31:56.133571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:10:12.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896122+0000","last_change":"2024-08-28T19:29:46.110683+0000","last_active":"2024-08-28T19:31:27.896122+0000","last_peered":"2024-08-28T19:31:27.896122+0000","last_clean":"2024-08-28T19:31:27.896122+0000","last_became_active":"2024-08-28T19:29:46.110324+0000","last_became_peered":"2024-08-28T19:29:46.110324+0000","last_unstale":"2024-08-28T19:31:27.896122+0000","last_undegraded":"2024-08-28T19:31:27.896122+0000","last_fullsized":"2024-08-28T19:31:27.896122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:15:47.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901834+0000","last_change":"2024-08-28T19:29:55.271035+0000","last_active":"2024-08-28T19:31:27.901834+0000","last_peered":"2024-08-28T19:31:27.901834+0000","last_clean":"2024-08-28T19:31:27.901834+0000","last_became_active":"2024-08-28T19:29:55.268465+0000","last_became_peered":"2024-08-28T19:29:55.268465+0000","last_unstale":"2024-08-28T19:31:27.901834+0000","last_undegraded":"2024-08-28T19:31:27.901834+0000","last_fullsized":"2024-08-28T19:31:27.901834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:16:17.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132232+0000","last_change":"2024-08-28T19:29:48.127225+0000","last_active":"2024-08-28T19:31:56.132232+0000","last_peered":"2024-08-28T19:31:56.132232+0000","last_clean":"2024-08-28T19:31:56.132232+0000","last_became_active":"2024-08-28T19:29:48.126775+0000","last_became_peered":"2024-08-28T19:29:48.126775+0000","last_unstale":"2024-08-28T19:31:56.132232+0000","last_undegraded":"2024-08-28T19:31:56.132232+0000","last_fullsized":"2024-08-28T19:31:56.132232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:49:39.353082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'17","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:57.503018+0000","last_change":"2024-08-28T19:29:46.098076+0000","last_active":"2024-08-28T19:31:57.503018+0000","last_peered":"2024-08-28T19:31:57.503018+0000","last_clean":"2024-08-28T19:31:57.503018+0000","last_became_active":"2024-08-28T19:29:46.097726+0000","last_became_peered":"2024-08-28T19:29:46.097726+0000","last_unstale":"2024-08-28T19:31:57.503018+0000","last_undegraded":"2024-08-28T19:31:57.503018+0000","last_fullsized":"2024-08-28T19:31:57.503018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.624125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901585+0000","last_change":"2024-08-28T19:29:55.571830+0000","last_active":"2024-08-28T19:31:27.901585+0000","last_peered":"2024-08-28T19:31:27.901585+0000","last_clean":"2024-08-28T19:31:27.901585+0000","last_became_active":"2024-08-28T19:29:55.571318+0000","last_became_peered":"2024-08-28T19:29:55.571318+0000","last_unstale":"2024-08-28T19:31:27.901585+0000","last_undegraded":"2024-08-28T19:31:27.901585+0000","last_fullsized":"2024-08-28T19:31:27.901585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:41:03.397478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135204+0000","last_change":"2024-08-28T19:29:48.124998+0000","last_active":"2024-08-28T19:31:56.135204+0000","last_peered":"2024-08-28T19:31:56.135204+0000","last_clean":"2024-08-28T19:31:56.135204+0000","last_became_active":"2024-08-28T19:29:48.124600+0000","last_became_peered":"2024-08-28T19:29:48.124600+0000","last_unstale":"2024-08-28T19:31:56.135204+0000","last_undegraded":"2024-08-28T19:31:56.135204+0000","last_fullsized":"2024-08-28T19:31:56.135204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:50:59.459372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903831+0000","last_change":"2024-08-28T19:29:46.189455+0000","last_active":"2024-08-28T19:31:27.903831+0000","last_peered":"2024-08-28T19:31:27.903831+0000","last_clean":"2024-08-28T19:31:27.903831+0000","last_became_active":"2024-08-28T19:29:46.188640+0000","last_became_peered":"2024-08-28T19:29:46.188640+0000","last_unstale":"2024-08-28T19:31:27.903831+0000","last_undegraded":"2024-08-28T19:31:27.903831+0000","last_fullsized":"2024-08-28T19:31:27.903831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:05:32.561725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899291+0000","last_change":"2024-08-28T19:29:55.269726+0000","last_active":"2024-08-28T19:31:27.899291+0000","last_peered":"2024-08-28T19:31:27.899291+0000","last_clean":"2024-08-28T19:31:27.899291+0000","last_became_active":"2024-08-28T19:29:55.269261+0000","last_became_peered":"2024-08-28T19:29:55.269261+0000","last_unstale":"2024-08-28T19:31:27.899291+0000","last_undegraded":"2024-08-28T19:31:27.899291+0000","last_fullsized":"2024-08-28T19:31:27.899291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:05.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128358+0000","last_change":"2024-08-28T19:29:48.125251+0000","last_active":"2024-08-28T19:31:56.128358+0000","last_peered":"2024-08-28T19:31:56.128358+0000","last_clean":"2024-08-28T19:31:56.128358+0000","last_became_active":"2024-08-28T19:29:48.124818+0000","last_became_peered":"2024-08-28T19:29:48.124818+0000","last_unstale":"2024-08-28T19:31:56.128358+0000","last_undegraded":"2024-08-28T19:31:56.128358+0000","last_fullsized":"2024-08-28T19:31:56.128358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:47:05.217199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894972+0000","last_change":"2024-08-28T19:29:46.189747+0000","last_active":"2024-08-28T19:31:27.894972+0000","last_peered":"2024-08-28T19:31:27.894972+0000","last_clean":"2024-08-28T19:31:27.894972+0000","last_became_active":"2024-08-28T19:29:46.189356+0000","last_became_peered":"2024-08-28T19:29:46.189356+0000","last_unstale":"2024-08-28T19:31:27.894972+0000","last_undegraded":"2024-08-28T19:31:27.894972+0000","last_fullsized":"2024-08-28T19:31:27.894972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.629054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902184+0000","last_change":"2024-08-28T19:29:55.572746+0000","last_active":"2024-08-28T19:31:27.902184+0000","last_peered":"2024-08-28T19:31:27.902184+0000","last_clean":"2024-08-28T19:31:27.902184+0000","last_became_active":"2024-08-28T19:29:55.572246+0000","last_became_peered":"2024-08-28T19:29:55.572246+0000","last_unstale":"2024-08-28T19:31:27.902184+0000","last_undegraded":"2024-08-28T19:31:27.902184+0000","last_fullsized":"2024-08-28T19:31:27.902184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:48:23.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.123589+0000","last_change":"2024-08-28T19:29:48.127579+0000","last_active":"2024-08-28T19:31:56.123589+0000","last_peered":"2024-08-28T19:31:56.123589+0000","last_clean":"2024-08-28T19:31:56.123589+0000","last_became_active":"2024-08-28T19:29:48.126978+0000","last_became_peered":"2024-08-28T19:29:48.126978+0000","last_unstale":"2024-08-28T19:31:56.123589+0000","last_undegraded":"2024-08-28T19:31:56.123589+0000","last_fullsized":"2024-08-28T19:31:56.123589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:27.657714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":163,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:23.593918+0000","last_change":"2024-08-28T19:29:46.102374+0000","last_active":"2024-08-28T19:32:23.593918+0000","last_peered":"2024-08-28T19:32:23.593918+0000","last_clean":"2024-08-28T19:32:23.593918+0000","last_became_active":"2024-08-28T19:29:46.101619+0000","last_became_peered":"2024-08-28T19:29:46.101619+0000","last_unstale":"2024-08-28T19:32:23.593918+0000","last_undegraded":"2024-08-28T19:32:23.593918+0000","last_fullsized":"2024-08-28T19:32:23.593918+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:46:21.353063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006989+0000","last_change":"2024-08-28T19:29:55.265403+0000","last_active":"2024-08-28T19:31:28.006989+0000","last_peered":"2024-08-28T19:31:28.006989+0000","last_clean":"2024-08-28T19:31:28.006989+0000","last_became_active":"2024-08-28T19:29:55.264979+0000","last_became_peered":"2024-08-28T19:29:55.264979+0000","last_unstale":"2024-08-28T19:31:28.006989+0000","last_undegraded":"2024-08-28T19:31:28.006989+0000","last_fullsized":"2024-08-28T19:31:28.006989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:18:18.623218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142841+0000","last_change":"2024-08-28T19:29:48.117437+0000","last_active":"2024-08-28T19:31:56.142841+0000","last_peered":"2024-08-28T19:31:56.142841+0000","last_clean":"2024-08-28T19:31:56.142841+0000","last_became_active":"2024-08-28T19:29:48.116379+0000","last_became_peered":"2024-08-28T19:29:48.116379+0000","last_unstale":"2024-08-28T19:31:56.142841+0000","last_undegraded":"2024-08-28T19:31:56.142841+0000","last_fullsized":"2024-08-28T19:31:56.142841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:23.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'7","reported_seq":163,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:22.592395+0000","last_change":"2024-08-28T19:29:46.188551+0000","last_active":"2024-08-28T19:32:22.592395+0000","last_peered":"2024-08-28T19:32:22.592395+0000","last_clean":"2024-08-28T19:32:22.592395+0000","last_became_active":"2024-08-28T19:29:46.188050+0000","last_became_peered":"2024-08-28T19:29:46.188050+0000","last_unstale":"2024-08-28T19:32:22.592395+0000","last_undegraded":"2024-08-28T19:32:22.592395+0000","last_fullsized":"2024-08-28T19:32:22.592395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:07:21.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007135+0000","last_change":"2024-08-28T19:29:55.572013+0000","last_active":"2024-08-28T19:31:28.007135+0000","last_peered":"2024-08-28T19:31:28.007135+0000","last_clean":"2024-08-28T19:31:28.007135+0000","last_became_active":"2024-08-28T19:29:55.571503+0000","last_became_peered":"2024-08-28T19:29:55.571503+0000","last_unstale":"2024-08-28T19:31:28.007135+0000","last_undegraded":"2024-08-28T19:31:28.007135+0000","last_fullsized":"2024-08-28T19:31:28.007135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:40:21.669321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134828+0000","last_change":"2024-08-28T19:29:48.124646+0000","last_active":"2024-08-28T19:31:56.134828+0000","last_peered":"2024-08-28T19:31:56.134828+0000","last_clean":"2024-08-28T19:31:56.134828+0000","last_became_active":"2024-08-28T19:29:48.123062+0000","last_became_peered":"2024-08-28T19:29:48.123062+0000","last_unstale":"2024-08-28T19:31:56.134828+0000","last_undegraded":"2024-08-28T19:31:56.134828+0000","last_fullsized":"2024-08-28T19:31:56.134828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:16:03.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007156+0000","last_change":"2024-08-28T19:29:46.105979+0000","last_active":"2024-08-28T19:31:28.007156+0000","last_peered":"2024-08-28T19:31:28.007156+0000","last_clean":"2024-08-28T19:31:28.007156+0000","last_became_active":"2024-08-28T19:29:46.105558+0000","last_became_peered":"2024-08-28T19:29:46.105558+0000","last_unstale":"2024-08-28T19:31:28.007156+0000","last_undegraded":"2024-08-28T19:31:28.007156+0000","last_fullsized":"2024-08-28T19:31:28.007156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:47.639236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896414+0000","last_change":"2024-08-28T19:29:55.574025+0000","last_active":"2024-08-28T19:31:27.896414+0000","last_peered":"2024-08-28T19:31:27.896414+0000","last_clean":"2024-08-28T19:31:27.896414+0000","last_became_active":"2024-08-28T19:29:55.573380+0000","last_became_peered":"2024-08-28T19:29:55.573380+0000","last_unstale":"2024-08-28T19:31:27.896414+0000","last_undegraded":"2024-08-28T19:31:27.896414+0000","last_fullsized":"2024-08-28T19:31:27.896414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:19:05.287692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.138839+0000","last_change":"2024-08-28T19:29:48.118606+0000","last_active":"2024-08-28T19:31:56.138839+0000","last_peered":"2024-08-28T19:31:56.138839+0000","last_clean":"2024-08-28T19:31:56.138839+0000","last_became_active":"2024-08-28T19:29:48.117534+0000","last_became_peered":"2024-08-28T19:29:48.117534+0000","last_unstale":"2024-08-28T19:31:56.138839+0000","last_undegraded":"2024-08-28T19:31:56.138839+0000","last_fullsized":"2024-08-28T19:31:56.138839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:34.253859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896326+0000","last_change":"2024-08-28T19:29:46.100420+0000","last_active":"2024-08-28T19:31:27.896326+0000","last_peered":"2024-08-28T19:31:27.896326+0000","last_clean":"2024-08-28T19:31:27.896326+0000","last_became_active":"2024-08-28T19:29:46.099990+0000","last_became_peered":"2024-08-28T19:29:46.099990+0000","last_unstale":"2024-08-28T19:31:27.896326+0000","last_undegraded":"2024-08-28T19:31:27.896326+0000","last_fullsized":"2024-08-28T19:31:27.896326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:42:12.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":113,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007243+0000","last_change":"2024-08-28T19:28:32.822169+0000","last_active":"2024-08-28T19:31:28.007243+0000","last_peered":"2024-08-28T19:31:28.007243+0000","last_clean":"2024-08-28T19:31:28.007243+0000","last_became_active":"2024-08-28T19:28:32.816300+0000","last_became_peered":"2024-08-28T19:28:32.816300+0000","last_unstale":"2024-08-28T19:31:28.007243+0000","last_undegraded":"2024-08-28T19:31:28.007243+0000","last_fullsized":"2024-08-28T19:31:28.007243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_clean_scrub_stamp":"2024-08-28T19:25:14.491568+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:41:37.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007780+0000","last_change":"2024-08-28T19:29:55.265437+0000","last_active":"2024-08-28T19:31:28.007780+0000","last_peered":"2024-08-28T19:31:28.007780+0000","last_clean":"2024-08-28T19:31:28.007780+0000","last_became_active":"2024-08-28T19:29:55.264818+0000","last_became_peered":"2024-08-28T19:29:55.264818+0000","last_unstale":"2024-08-28T19:31:28.007780+0000","last_undegraded":"2024-08-28T19:31:28.007780+0000","last_fullsized":"2024-08-28T19:31:28.007780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:28:18.684362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152410+0000","last_change":"2024-08-28T19:29:48.135800+0000","last_active":"2024-08-28T19:31:56.152410+0000","last_peered":"2024-08-28T19:31:56.152410+0000","last_clean":"2024-08-28T19:31:56.152410+0000","last_became_active":"2024-08-28T19:29:48.135258+0000","last_became_peered":"2024-08-28T19:29:48.135258+0000","last_unstale":"2024-08-28T19:31:56.152410+0000","last_undegraded":"2024-08-28T19:31:56.152410+0000","last_fullsized":"2024-08-28T19:31:56.152410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:55.183190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:21.593173+0000","last_change":"2024-08-28T19:29:46.189298+0000","last_active":"2024-08-28T19:32:21.593173+0000","last_peered":"2024-08-28T19:32:21.593173+0000","last_clean":"2024-08-28T19:32:21.593173+0000","last_became_active":"2024-08-28T19:29:46.188813+0000","last_became_peered":"2024-08-28T19:29:46.188813+0000","last_unstale":"2024-08-28T19:32:21.593173+0000","last_undegraded":"2024-08-28T19:32:21.593173+0000","last_fullsized":"2024-08-28T19:32:21.593173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:14:00.961682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899863+0000","last_change":"2024-08-28T19:29:55.269495+0000","last_active":"2024-08-28T19:31:27.899863+0000","last_peered":"2024-08-28T19:31:27.899863+0000","last_clean":"2024-08-28T19:31:27.899863+0000","last_became_active":"2024-08-28T19:29:55.268916+0000","last_became_peered":"2024-08-28T19:29:55.268916+0000","last_unstale":"2024-08-28T19:31:27.899863+0000","last_undegraded":"2024-08-28T19:31:27.899863+0000","last_fullsized":"2024-08-28T19:31:27.899863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:26:53.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143974+0000","last_change":"2024-08-28T19:29:48.127588+0000","last_active":"2024-08-28T19:31:56.143974+0000","last_peered":"2024-08-28T19:31:56.143974+0000","last_clean":"2024-08-28T19:31:56.143974+0000","last_became_active":"2024-08-28T19:29:48.127200+0000","last_became_peered":"2024-08-28T19:29:48.127200+0000","last_unstale":"2024-08-28T19:31:56.143974+0000","last_undegraded":"2024-08-28T19:31:56.143974+0000","last_fullsized":"2024-08-28T19:31:56.143974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:30:30.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896631+0000","last_change":"2024-08-28T19:29:46.101010+0000","last_active":"2024-08-28T19:31:27.896631+0000","last_peered":"2024-08-28T19:31:27.896631+0000","last_clean":"2024-08-28T19:31:27.896631+0000","last_became_active":"2024-08-28T19:29:46.100082+0000","last_became_peered":"2024-08-28T19:29:46.100082+0000","last_unstale":"2024-08-28T19:31:27.896631+0000","last_undegraded":"2024-08-28T19:31:27.896631+0000","last_fullsized":"2024-08-28T19:31:27.896631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:18:51.074343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902334+0000","last_change":"2024-08-28T19:30:27.551743+0000","last_active":"2024-08-28T19:31:27.902334+0000","last_peered":"2024-08-28T19:31:27.902334+0000","last_clean":"2024-08-28T19:31:27.902334+0000","last_became_active":"2024-08-28T19:30:27.551249+0000","last_became_peered":"2024-08-28T19:30:27.551249+0000","last_unstale":"2024-08-28T19:31:27.902334+0000","last_undegraded":"2024-08-28T19:31:27.902334+0000","last_fullsized":"2024-08-28T19:31:27.902334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:35.043553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149263+0000","last_change":"2024-08-28T19:29:48.132429+0000","last_active":"2024-08-28T19:31:56.149263+0000","last_peered":"2024-08-28T19:31:56.149263+0000","last_clean":"2024-08-28T19:31:56.149263+0000","last_became_active":"2024-08-28T19:29:48.132020+0000","last_became_peered":"2024-08-28T19:29:48.132020+0000","last_unstale":"2024-08-28T19:31:56.149263+0000","last_undegraded":"2024-08-28T19:31:56.149263+0000","last_fullsized":"2024-08-28T19:31:56.149263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:45:11.992083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007247+0000","last_change":"2024-08-28T19:29:46.097245+0000","last_active":"2024-08-28T19:31:28.007247+0000","last_peered":"2024-08-28T19:31:28.007247+0000","last_clean":"2024-08-28T19:31:28.007247+0000","last_became_active":"2024-08-28T19:29:46.096867+0000","last_became_peered":"2024-08-28T19:29:46.096867+0000","last_unstale":"2024-08-28T19:31:28.007247+0000","last_undegraded":"2024-08-28T19:31:28.007247+0000","last_fullsized":"2024-08-28T19:31:28.007247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:22:14.888597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895601+0000","last_change":"2024-08-28T19:29:55.265006+0000","last_active":"2024-08-28T19:31:27.895601+0000","last_peered":"2024-08-28T19:31:27.895601+0000","last_clean":"2024-08-28T19:31:27.895601+0000","last_became_active":"2024-08-28T19:29:55.264321+0000","last_became_peered":"2024-08-28T19:29:55.264321+0000","last_unstale":"2024-08-28T19:31:27.895601+0000","last_undegraded":"2024-08-28T19:31:27.895601+0000","last_fullsized":"2024-08-28T19:31:27.895601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:53:27.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146436+0000","last_change":"2024-08-28T19:29:48.120916+0000","last_active":"2024-08-28T19:31:56.146436+0000","last_peered":"2024-08-28T19:31:56.146436+0000","last_clean":"2024-08-28T19:31:56.146436+0000","last_became_active":"2024-08-28T19:29:48.120473+0000","last_became_peered":"2024-08-28T19:29:48.120473+0000","last_unstale":"2024-08-28T19:31:56.146436+0000","last_undegraded":"2024-08-28T19:31:56.146436+0000","last_fullsized":"2024-08-28T19:31:56.146436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:15.067237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903218+0000","last_change":"2024-08-28T19:29:46.103164+0000","last_active":"2024-08-28T19:31:27.903218+0000","last_peered":"2024-08-28T19:31:27.903218+0000","last_clean":"2024-08-28T19:31:27.903218+0000","last_became_active":"2024-08-28T19:29:46.101772+0000","last_became_peered":"2024-08-28T19:29:46.101772+0000","last_unstale":"2024-08-28T19:31:27.903218+0000","last_undegraded":"2024-08-28T19:31:27.903218+0000","last_fullsized":"2024-08-28T19:31:27.903218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:46:29.533552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902200+0000","last_change":"2024-08-28T19:30:27.550861+0000","last_active":"2024-08-28T19:31:27.902200+0000","last_peered":"2024-08-28T19:31:27.902200+0000","last_clean":"2024-08-28T19:31:27.902200+0000","last_became_active":"2024-08-28T19:30:27.550131+0000","last_became_peered":"2024-08-28T19:30:27.550131+0000","last_unstale":"2024-08-28T19:31:27.902200+0000","last_undegraded":"2024-08-28T19:31:27.902200+0000","last_fullsized":"2024-08-28T19:31:27.902200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:37:16.004222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128073+0000","last_change":"2024-08-28T19:30:27.551445+0000","last_active":"2024-08-28T19:31:56.128073+0000","last_peered":"2024-08-28T19:31:56.128073+0000","last_clean":"2024-08-28T19:31:56.128073+0000","last_became_active":"2024-08-28T19:30:27.550927+0000","last_became_peered":"2024-08-28T19:30:27.550927+0000","last_unstale":"2024-08-28T19:31:56.128073+0000","last_undegraded":"2024-08-28T19:31:56.128073+0000","last_fullsized":"2024-08-28T19:31:56.128073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:52:56.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.920185+0000","last_change":"2024-08-28T19:31:27.920056+0000","last_active":"2024-08-28T19:31:27.920185+0000","last_peered":"2024-08-28T19:31:27.920185+0000","last_clean":"2024-08-28T19:31:27.920185+0000","last_became_active":"2024-08-28T19:31:27.904583+0000","last_became_peered":"2024-08-28T19:31:27.904583+0000","last_unstale":"2024-08-28T19:31:27.920185+0000","last_undegraded":"2024-08-28T19:31:27.920185+0000","last_fullsized":"2024-08-28T19:31:27.920185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:35:25.188307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007217+0000","last_change":"2024-08-28T19:29:55.266777+0000","last_active":"2024-08-28T19:31:28.007217+0000","last_peered":"2024-08-28T19:31:28.007217+0000","last_clean":"2024-08-28T19:31:28.007217+0000","last_became_active":"2024-08-28T19:29:55.266296+0000","last_became_peered":"2024-08-28T19:29:55.266296+0000","last_unstale":"2024-08-28T19:31:28.007217+0000","last_undegraded":"2024-08-28T19:31:28.007217+0000","last_fullsized":"2024-08-28T19:31:28.007217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:28:20.279522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150735+0000","last_change":"2024-08-28T19:29:48.129070+0000","last_active":"2024-08-28T19:31:56.150735+0000","last_peered":"2024-08-28T19:31:56.150735+0000","last_clean":"2024-08-28T19:31:56.150735+0000","last_became_active":"2024-08-28T19:29:48.128701+0000","last_became_peered":"2024-08-28T19:29:48.128701+0000","last_unstale":"2024-08-28T19:31:56.150735+0000","last_undegraded":"2024-08-28T19:31:56.150735+0000","last_fullsized":"2024-08-28T19:31:56.150735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:29:29.375379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":169,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:23.594300+0000","last_change":"2024-08-28T19:29:46.098281+0000","last_active":"2024-08-28T19:32:23.594300+0000","last_peered":"2024-08-28T19:32:23.594300+0000","last_clean":"2024-08-28T19:32:23.594300+0000","last_became_active":"2024-08-28T19:29:46.097870+0000","last_became_peered":"2024-08-28T19:29:46.097870+0000","last_unstale":"2024-08-28T19:32:23.594300+0000","last_undegraded":"2024-08-28T19:32:23.594300+0000","last_fullsized":"2024-08-28T19:32:23.594300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:24:09.693310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894981+0000","last_change":"2024-08-28T19:29:55.264883+0000","last_active":"2024-08-28T19:31:27.894981+0000","last_peered":"2024-08-28T19:31:27.894981+0000","last_clean":"2024-08-28T19:31:27.894981+0000","last_became_active":"2024-08-28T19:29:55.264392+0000","last_became_peered":"2024-08-28T19:29:55.264392+0000","last_unstale":"2024-08-28T19:31:27.894981+0000","last_undegraded":"2024-08-28T19:31:27.894981+0000","last_fullsized":"2024-08-28T19:31:27.894981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:34.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150300+0000","last_change":"2024-08-28T19:29:48.135499+0000","last_active":"2024-08-28T19:31:56.150300+0000","last_peered":"2024-08-28T19:31:56.150300+0000","last_clean":"2024-08-28T19:31:56.150300+0000","last_became_active":"2024-08-28T19:29:48.134934+0000","last_became_peered":"2024-08-28T19:29:48.134934+0000","last_unstale":"2024-08-28T19:31:56.150300+0000","last_undegraded":"2024-08-28T19:31:56.150300+0000","last_fullsized":"2024-08-28T19:31:56.150300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:57:01.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895983+0000","last_change":"2024-08-28T19:29:46.104680+0000","last_active":"2024-08-28T19:31:27.895983+0000","last_peered":"2024-08-28T19:31:27.895983+0000","last_clean":"2024-08-28T19:31:27.895983+0000","last_became_active":"2024-08-28T19:29:46.104290+0000","last_became_peered":"2024-08-28T19:29:46.104290+0000","last_unstale":"2024-08-28T19:31:27.895983+0000","last_undegraded":"2024-08-28T19:31:27.895983+0000","last_fullsized":"2024-08-28T19:31:27.895983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:39.789935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899299+0000","last_change":"2024-08-28T19:29:55.264676+0000","last_active":"2024-08-28T19:31:27.899299+0000","last_peered":"2024-08-28T19:31:27.899299+0000","last_clean":"2024-08-28T19:31:27.899299+0000","last_became_active":"2024-08-28T19:29:55.264206+0000","last_became_peered":"2024-08-28T19:29:55.264206+0000","last_unstale":"2024-08-28T19:31:27.899299+0000","last_undegraded":"2024-08-28T19:31:27.899299+0000","last_fullsized":"2024-08-28T19:31:27.899299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:58:15.776366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149998+0000","last_change":"2024-08-28T19:29:48.125092+0000","last_active":"2024-08-28T19:31:56.149998+0000","last_peered":"2024-08-28T19:31:56.149998+0000","last_clean":"2024-08-28T19:31:56.149998+0000","last_became_active":"2024-08-28T19:29:48.124711+0000","last_became_peered":"2024-08-28T19:29:48.124711+0000","last_unstale":"2024-08-28T19:31:56.149998+0000","last_undegraded":"2024-08-28T19:31:56.149998+0000","last_fullsized":"2024-08-28T19:31:56.149998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:17:27.806368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902878+0000","last_change":"2024-08-28T19:29:46.100546+0000","last_active":"2024-08-28T19:31:27.902878+0000","last_peered":"2024-08-28T19:31:27.902878+0000","last_clean":"2024-08-28T19:31:27.902878+0000","last_became_active":"2024-08-28T19:29:46.100043+0000","last_became_peered":"2024-08-28T19:29:46.100043+0000","last_unstale":"2024-08-28T19:31:27.902878+0000","last_undegraded":"2024-08-28T19:31:27.902878+0000","last_fullsized":"2024-08-28T19:31:27.902878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:41:32.488258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896351+0000","last_change":"2024-08-28T19:29:55.265497+0000","last_active":"2024-08-28T19:31:27.896351+0000","last_peered":"2024-08-28T19:31:27.896351+0000","last_clean":"2024-08-28T19:31:27.896351+0000","last_became_active":"2024-08-28T19:29:55.264499+0000","last_became_peered":"2024-08-28T19:29:55.264499+0000","last_unstale":"2024-08-28T19:31:27.896351+0000","last_undegraded":"2024-08-28T19:31:27.896351+0000","last_fullsized":"2024-08-28T19:31:27.896351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:04:15.192307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139694+0000","last_change":"2024-08-28T19:29:48.133948+0000","last_active":"2024-08-28T19:31:56.139694+0000","last_peered":"2024-08-28T19:31:56.139694+0000","last_clean":"2024-08-28T19:31:56.139694+0000","last_became_active":"2024-08-28T19:29:48.133517+0000","last_became_peered":"2024-08-28T19:29:48.133517+0000","last_unstale":"2024-08-28T19:31:56.139694+0000","last_undegraded":"2024-08-28T19:31:56.139694+0000","last_fullsized":"2024-08-28T19:31:56.139694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:43:20.049931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'40","reported_seq":332,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:26.600683+0000","last_change":"2024-08-28T19:29:46.104744+0000","last_active":"2024-08-28T19:32:26.600683+0000","last_peered":"2024-08-28T19:32:26.600683+0000","last_clean":"2024-08-28T19:32:26.600683+0000","last_became_active":"2024-08-28T19:29:46.104278+0000","last_became_peered":"2024-08-28T19:29:46.104278+0000","last_unstale":"2024-08-28T19:32:26.600683+0000","last_undegraded":"2024-08-28T19:32:26.600683+0000","last_fullsized":"2024-08-28T19:32:26.600683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:36.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68002,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":252,"num_read_kb":194,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894437+0000","last_change":"2024-08-28T19:29:55.264892+0000","last_active":"2024-08-28T19:31:27.894437+0000","last_peered":"2024-08-28T19:31:27.894437+0000","last_clean":"2024-08-28T19:31:27.894437+0000","last_became_active":"2024-08-28T19:29:55.264466+0000","last_became_peered":"2024-08-28T19:29:55.264466+0000","last_unstale":"2024-08-28T19:31:27.894437+0000","last_undegraded":"2024-08-28T19:31:27.894437+0000","last_fullsized":"2024-08-28T19:31:27.894437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:34:51.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152034+0000","last_change":"2024-08-28T19:29:48.121692+0000","last_active":"2024-08-28T19:31:56.152034+0000","last_peered":"2024-08-28T19:31:56.152034+0000","last_clean":"2024-08-28T19:31:56.152034+0000","last_became_active":"2024-08-28T19:29:48.121274+0000","last_became_peered":"2024-08-28T19:29:48.121274+0000","last_unstale":"2024-08-28T19:31:56.152034+0000","last_undegraded":"2024-08-28T19:31:56.152034+0000","last_fullsized":"2024-08-28T19:31:56.152034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:00:36.227609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896564+0000","last_change":"2024-08-28T19:29:46.188981+0000","last_active":"2024-08-28T19:31:27.896564+0000","last_peered":"2024-08-28T19:31:27.896564+0000","last_clean":"2024-08-28T19:31:27.896564+0000","last_became_active":"2024-08-28T19:29:46.188496+0000","last_became_peered":"2024-08-28T19:29:46.188496+0000","last_unstale":"2024-08-28T19:31:27.896564+0000","last_undegraded":"2024-08-28T19:31:27.896564+0000","last_fullsized":"2024-08-28T19:31:27.896564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.689602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896238+0000","last_change":"2024-08-28T19:30:27.552006+0000","last_active":"2024-08-28T19:31:27.896238+0000","last_peered":"2024-08-28T19:31:27.896238+0000","last_clean":"2024-08-28T19:31:27.896238+0000","last_became_active":"2024-08-28T19:30:27.551356+0000","last_became_peered":"2024-08-28T19:30:27.551356+0000","last_unstale":"2024-08-28T19:31:27.896238+0000","last_undegraded":"2024-08-28T19:31:27.896238+0000","last_fullsized":"2024-08-28T19:31:27.896238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:56:09.242401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144743+0000","last_change":"2024-08-28T19:29:48.116964+0000","last_active":"2024-08-28T19:31:56.144743+0000","last_peered":"2024-08-28T19:31:56.144743+0000","last_clean":"2024-08-28T19:31:56.144743+0000","last_became_active":"2024-08-28T19:29:48.116588+0000","last_became_peered":"2024-08-28T19:29:48.116588+0000","last_unstale":"2024-08-28T19:31:56.144743+0000","last_undegraded":"2024-08-28T19:31:56.144743+0000","last_fullsized":"2024-08-28T19:31:56.144743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:52:02.486724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007960+0000","last_change":"2024-08-28T19:29:46.104132+0000","last_active":"2024-08-28T19:31:28.007960+0000","last_peered":"2024-08-28T19:31:28.007960+0000","last_clean":"2024-08-28T19:31:28.007960+0000","last_became_active":"2024-08-28T19:29:46.103725+0000","last_became_peered":"2024-08-28T19:29:46.103725+0000","last_unstale":"2024-08-28T19:31:28.007960+0000","last_undegraded":"2024-08-28T19:31:28.007960+0000","last_fullsized":"2024-08-28T19:31:28.007960+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:50:12.859989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894212+0000","last_change":"2024-08-28T19:29:55.265494+0000","last_active":"2024-08-28T19:31:27.894212+0000","last_peered":"2024-08-28T19:31:27.894212+0000","last_clean":"2024-08-28T19:31:27.894212+0000","last_became_active":"2024-08-28T19:29:55.265087+0000","last_became_peered":"2024-08-28T19:29:55.265087+0000","last_unstale":"2024-08-28T19:31:27.894212+0000","last_undegraded":"2024-08-28T19:31:27.894212+0000","last_fullsized":"2024-08-28T19:31:27.894212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:51:18.676889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152669+0000","last_change":"2024-08-28T19:29:48.127419+0000","last_active":"2024-08-28T19:31:56.152669+0000","last_peered":"2024-08-28T19:31:56.152669+0000","last_clean":"2024-08-28T19:31:56.152669+0000","last_became_active":"2024-08-28T19:29:48.126997+0000","last_became_peered":"2024-08-28T19:29:48.126997+0000","last_unstale":"2024-08-28T19:31:56.152669+0000","last_undegraded":"2024-08-28T19:31:56.152669+0000","last_fullsized":"2024-08-28T19:31:56.152669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:26:08.208724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":285,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:26.599346+0000","last_change":"2024-08-28T19:29:46.103451+0000","last_active":"2024-08-28T19:32:26.599346+0000","last_peered":"2024-08-28T19:32:26.599346+0000","last_clean":"2024-08-28T19:32:26.599346+0000","last_became_active":"2024-08-28T19:29:46.102991+0000","last_became_peered":"2024-08-28T19:29:46.102991+0000","last_unstale":"2024-08-28T19:32:26.599346+0000","last_undegraded":"2024-08-28T19:32:26.599346+0000","last_fullsized":"2024-08-28T19:32:26.599346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:55:58.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901836+0000","last_change":"2024-08-28T19:29:55.269310+0000","last_active":"2024-08-28T19:31:27.901836+0000","last_peered":"2024-08-28T19:31:27.901836+0000","last_clean":"2024-08-28T19:31:27.901836+0000","last_became_active":"2024-08-28T19:29:55.268893+0000","last_became_peered":"2024-08-28T19:29:55.268893+0000","last_unstale":"2024-08-28T19:31:27.901836+0000","last_undegraded":"2024-08-28T19:31:27.901836+0000","last_fullsized":"2024-08-28T19:31:27.901836+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:26:11.598773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902085+0000","last_change":"2024-08-28T19:29:55.261757+0000","last_active":"2024-08-28T19:31:27.902085+0000","last_peered":"2024-08-28T19:31:27.902085+0000","last_clean":"2024-08-28T19:31:27.902085+0000","last_became_active":"2024-08-28T19:29:55.261339+0000","last_became_peered":"2024-08-28T19:29:55.261339+0000","last_unstale":"2024-08-28T19:31:27.902085+0000","last_undegraded":"2024-08-28T19:31:27.902085+0000","last_fullsized":"2024-08-28T19:31:27.902085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:25:06.223029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.130201+0000","last_change":"2024-08-28T19:29:48.123097+0000","last_active":"2024-08-28T19:31:56.130201+0000","last_peered":"2024-08-28T19:31:56.130201+0000","last_clean":"2024-08-28T19:31:56.130201+0000","last_became_active":"2024-08-28T19:29:48.122718+0000","last_became_peered":"2024-08-28T19:29:48.122718+0000","last_unstale":"2024-08-28T19:31:56.130201+0000","last_undegraded":"2024-08-28T19:31:56.130201+0000","last_fullsized":"2024-08-28T19:31:56.130201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:19.530985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896115+0000","last_change":"2024-08-28T19:29:46.105516+0000","last_active":"2024-08-28T19:31:27.896115+0000","last_peered":"2024-08-28T19:31:27.896115+0000","last_clean":"2024-08-28T19:31:27.896115+0000","last_became_active":"2024-08-28T19:29:46.105030+0000","last_became_peered":"2024-08-28T19:29:46.105030+0000","last_unstale":"2024-08-28T19:31:27.896115+0000","last_undegraded":"2024-08-28T19:31:27.896115+0000","last_fullsized":"2024-08-28T19:31:27.896115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:47:02.032933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899627+0000","last_change":"2024-08-28T19:29:55.269759+0000","last_active":"2024-08-28T19:31:27.899627+0000","last_peered":"2024-08-28T19:31:27.899627+0000","last_clean":"2024-08-28T19:31:27.899627+0000","last_became_active":"2024-08-28T19:29:55.269275+0000","last_became_peered":"2024-08-28T19:29:55.269275+0000","last_unstale":"2024-08-28T19:31:27.899627+0000","last_undegraded":"2024-08-28T19:31:27.899627+0000","last_fullsized":"2024-08-28T19:31:27.899627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:45.870468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131493+0000","last_change":"2024-08-28T19:29:48.117400+0000","last_active":"2024-08-28T19:31:56.131493+0000","last_peered":"2024-08-28T19:31:56.131493+0000","last_clean":"2024-08-28T19:31:56.131493+0000","last_became_active":"2024-08-28T19:29:48.116987+0000","last_became_peered":"2024-08-28T19:29:48.116987+0000","last_unstale":"2024-08-28T19:31:56.131493+0000","last_undegraded":"2024-08-28T19:31:56.131493+0000","last_fullsized":"2024-08-28T19:31:56.131493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:43.822088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006521+0000","last_change":"2024-08-28T19:29:46.096103+0000","last_active":"2024-08-28T19:31:28.006521+0000","last_peered":"2024-08-28T19:31:28.006521+0000","last_clean":"2024-08-28T19:31:28.006521+0000","last_became_active":"2024-08-28T19:29:46.095812+0000","last_became_peered":"2024-08-28T19:29:46.095812+0000","last_unstale":"2024-08-28T19:31:28.006521+0000","last_undegraded":"2024-08-28T19:31:28.006521+0000","last_fullsized":"2024-08-28T19:31:28.006521+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:29.266636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007661+0000","last_change":"2024-08-28T19:29:46.106227+0000","last_active":"2024-08-28T19:31:28.007661+0000","last_peered":"2024-08-28T19:31:28.007661+0000","last_clean":"2024-08-28T19:31:28.007661+0000","last_became_active":"2024-08-28T19:29:46.105777+0000","last_became_peered":"2024-08-28T19:29:46.105777+0000","last_unstale":"2024-08-28T19:31:28.007661+0000","last_undegraded":"2024-08-28T19:31:28.007661+0000","last_fullsized":"2024-08-28T19:31:28.007661+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:26:14.815646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144860+0000","last_change":"2024-08-28T19:29:48.111051+0000","last_active":"2024-08-28T19:31:56.144860+0000","last_peered":"2024-08-28T19:31:56.144860+0000","last_clean":"2024-08-28T19:31:56.144860+0000","last_became_active":"2024-08-28T19:29:48.110421+0000","last_became_peered":"2024-08-28T19:29:48.110421+0000","last_unstale":"2024-08-28T19:31:56.144860+0000","last_undegraded":"2024-08-28T19:31:56.144860+0000","last_fullsized":"2024-08-28T19:31:56.144860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:19:47.765977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902359+0000","last_change":"2024-08-28T19:30:27.408829+0000","last_active":"2024-08-28T19:31:27.902359+0000","last_peered":"2024-08-28T19:31:27.902359+0000","last_clean":"2024-08-28T19:31:27.902359+0000","last_became_active":"2024-08-28T19:30:27.408298+0000","last_became_peered":"2024-08-28T19:30:27.408298+0000","last_unstale":"2024-08-28T19:31:27.902359+0000","last_undegraded":"2024-08-28T19:31:27.902359+0000","last_fullsized":"2024-08-28T19:31:27.902359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:38:58.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:25.598699+0000","last_change":"2024-08-28T19:29:46.102607+0000","last_active":"2024-08-28T19:32:25.598699+0000","last_peered":"2024-08-28T19:32:25.598699+0000","last_clean":"2024-08-28T19:32:25.598699+0000","last_became_active":"2024-08-28T19:29:46.102150+0000","last_became_peered":"2024-08-28T19:29:46.102150+0000","last_unstale":"2024-08-28T19:32:25.598699+0000","last_undegraded":"2024-08-28T19:32:25.598699+0000","last_fullsized":"2024-08-28T19:32:25.598699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:44.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128134+0000","last_change":"2024-08-28T19:29:48.121598+0000","last_active":"2024-08-28T19:31:56.128134+0000","last_peered":"2024-08-28T19:31:56.128134+0000","last_clean":"2024-08-28T19:31:56.128134+0000","last_became_active":"2024-08-28T19:29:48.121189+0000","last_became_peered":"2024-08-28T19:29:48.121189+0000","last_unstale":"2024-08-28T19:31:56.128134+0000","last_undegraded":"2024-08-28T19:31:56.128134+0000","last_fullsized":"2024-08-28T19:31:56.128134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:19:35.496859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903513+0000","last_change":"2024-08-28T19:29:55.269648+0000","last_active":"2024-08-28T19:31:27.903513+0000","last_peered":"2024-08-28T19:31:27.903513+0000","last_clean":"2024-08-28T19:31:27.903513+0000","last_became_active":"2024-08-28T19:29:55.269182+0000","last_became_peered":"2024-08-28T19:29:55.269182+0000","last_unstale":"2024-08-28T19:31:27.903513+0000","last_undegraded":"2024-08-28T19:31:27.903513+0000","last_fullsized":"2024-08-28T19:31:27.903513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:09:47.581907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146872+0000","last_change":"2024-08-28T19:29:48.117143+0000","last_active":"2024-08-28T19:31:56.146872+0000","last_peered":"2024-08-28T19:31:56.146872+0000","last_clean":"2024-08-28T19:31:56.146872+0000","last_became_active":"2024-08-28T19:29:48.116756+0000","last_became_peered":"2024-08-28T19:29:48.116756+0000","last_unstale":"2024-08-28T19:31:56.146872+0000","last_undegraded":"2024-08-28T19:31:56.146872+0000","last_fullsized":"2024-08-28T19:31:56.146872+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:03:30.736872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141006+0000","last_change":"2024-08-28T19:30:27.407218+0000","last_active":"2024-08-28T19:31:56.141006+0000","last_peered":"2024-08-28T19:31:56.141006+0000","last_clean":"2024-08-28T19:31:56.141006+0000","last_became_active":"2024-08-28T19:30:27.406769+0000","last_became_peered":"2024-08-28T19:30:27.406769+0000","last_unstale":"2024-08-28T19:31:56.141006+0000","last_undegraded":"2024-08-28T19:31:56.141006+0000","last_fullsized":"2024-08-28T19:31:56.141006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:59.946922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135902+0000","last_change":"2024-08-28T19:29:48.123969+0000","last_active":"2024-08-28T19:31:56.135902+0000","last_peered":"2024-08-28T19:31:56.135902+0000","last_clean":"2024-08-28T19:31:56.135902+0000","last_became_active":"2024-08-28T19:29:48.122534+0000","last_became_peered":"2024-08-28T19:29:48.122534+0000","last_unstale":"2024-08-28T19:31:56.135902+0000","last_undegraded":"2024-08-28T19:31:56.135902+0000","last_fullsized":"2024-08-28T19:31:56.135902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:33:56.739763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132732+0000","last_change":"2024-08-28T19:29:48.108976+0000","last_active":"2024-08-28T19:31:56.132732+0000","last_peered":"2024-08-28T19:31:56.132732+0000","last_clean":"2024-08-28T19:31:56.132732+0000","last_became_active":"2024-08-28T19:29:48.108631+0000","last_became_peered":"2024-08-28T19:29:48.108631+0000","last_unstale":"2024-08-28T19:31:56.132732+0000","last_undegraded":"2024-08-28T19:31:56.132732+0000","last_fullsized":"2024-08-28T19:31:56.132732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:08:59.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131974+0000","last_change":"2024-08-28T19:29:48.109875+0000","last_active":"2024-08-28T19:31:56.131974+0000","last_peered":"2024-08-28T19:31:56.131974+0000","last_clean":"2024-08-28T19:31:56.131974+0000","last_became_active":"2024-08-28T19:29:48.109486+0000","last_became_peered":"2024-08-28T19:29:48.109486+0000","last_unstale":"2024-08-28T19:31:56.131974+0000","last_undegraded":"2024-08-28T19:31:56.131974+0000","last_fullsized":"2024-08-28T19:31:56.131974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:02:28.365203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146393+0000","last_change":"2024-08-28T19:29:48.117237+0000","last_active":"2024-08-28T19:31:56.146393+0000","last_peered":"2024-08-28T19:31:56.146393+0000","last_clean":"2024-08-28T19:31:56.146393+0000","last_became_active":"2024-08-28T19:29:48.116799+0000","last_became_peered":"2024-08-28T19:29:48.116799+0000","last_unstale":"2024-08-28T19:31:56.146393+0000","last_undegraded":"2024-08-28T19:31:56.146393+0000","last_fullsized":"2024-08-28T19:31:56.146393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:48:12.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144924+0000","last_change":"2024-08-28T19:29:48.120522+0000","last_active":"2024-08-28T19:31:56.144924+0000","last_peered":"2024-08-28T19:31:56.144924+0000","last_clean":"2024-08-28T19:31:56.144924+0000","last_became_active":"2024-08-28T19:29:48.120150+0000","last_became_peered":"2024-08-28T19:29:48.120150+0000","last_unstale":"2024-08-28T19:31:56.144924+0000","last_undegraded":"2024-08-28T19:31:56.144924+0000","last_fullsized":"2024-08-28T19:31:56.144924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:01:00.210596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.126169+0000","last_change":"2024-08-28T19:29:48.128451+0000","last_active":"2024-08-28T19:31:56.126169+0000","last_peered":"2024-08-28T19:31:56.126169+0000","last_clean":"2024-08-28T19:31:56.126169+0000","last_became_active":"2024-08-28T19:29:48.127898+0000","last_became_peered":"2024-08-28T19:29:48.127898+0000","last_unstale":"2024-08-28T19:31:56.126169+0000","last_undegraded":"2024-08-28T19:31:56.126169+0000","last_fullsized":"2024-08-28T19:31:56.126169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:48.663999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142755+0000","last_change":"2024-08-28T19:29:48.110788+0000","last_active":"2024-08-28T19:31:56.142755+0000","last_peered":"2024-08-28T19:31:56.142755+0000","last_clean":"2024-08-28T19:31:56.142755+0000","last_became_active":"2024-08-28T19:29:48.110355+0000","last_became_peered":"2024-08-28T19:29:48.110355+0000","last_unstale":"2024-08-28T19:31:56.142755+0000","last_undegraded":"2024-08-28T19:31:56.142755+0000","last_fullsized":"2024-08-28T19:31:56.142755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:57:25.345283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141195+0000","last_change":"2024-08-28T19:29:48.129667+0000","last_active":"2024-08-28T19:31:56.141195+0000","last_peered":"2024-08-28T19:31:56.141195+0000","last_clean":"2024-08-28T19:31:56.141195+0000","last_became_active":"2024-08-28T19:29:48.128237+0000","last_became_peered":"2024-08-28T19:29:48.128237+0000","last_unstale":"2024-08-28T19:31:56.141195+0000","last_undegraded":"2024-08-28T19:31:56.141195+0000","last_fullsized":"2024-08-28T19:31:56.141195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:23:35.920353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151419+0000","last_change":"2024-08-28T19:29:48.136070+0000","last_active":"2024-08-28T19:31:56.151419+0000","last_peered":"2024-08-28T19:31:56.151419+0000","last_clean":"2024-08-28T19:31:56.151419+0000","last_became_active":"2024-08-28T19:29:48.135515+0000","last_became_peered":"2024-08-28T19:29:48.135515+0000","last_unstale":"2024-08-28T19:31:56.151419+0000","last_undegraded":"2024-08-28T19:31:56.151419+0000","last_fullsized":"2024-08-28T19:31:56.151419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:25:29.267753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150677+0000","last_change":"2024-08-28T19:29:48.128614+0000","last_active":"2024-08-28T19:31:56.150677+0000","last_peered":"2024-08-28T19:31:56.150677+0000","last_clean":"2024-08-28T19:31:56.150677+0000","last_became_active":"2024-08-28T19:29:48.128231+0000","last_became_peered":"2024-08-28T19:29:48.128231+0000","last_unstale":"2024-08-28T19:31:56.150677+0000","last_undegraded":"2024-08-28T19:31:56.150677+0000","last_fullsized":"2024-08-28T19:31:56.150677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:11:08.541435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143953+0000","last_change":"2024-08-28T19:29:48.114930+0000","last_active":"2024-08-28T19:31:56.143953+0000","last_peered":"2024-08-28T19:31:56.143953+0000","last_clean":"2024-08-28T19:31:56.143953+0000","last_became_active":"2024-08-28T19:29:48.114389+0000","last_became_peered":"2024-08-28T19:29:48.114389+0000","last_unstale":"2024-08-28T19:31:56.143953+0000","last_undegraded":"2024-08-28T19:31:56.143953+0000","last_fullsized":"2024-08-28T19:31:56.143953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:51.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141213+0000","last_change":"2024-08-28T19:29:48.125031+0000","last_active":"2024-08-28T19:31:56.141213+0000","last_peered":"2024-08-28T19:31:56.141213+0000","last_clean":"2024-08-28T19:31:56.141213+0000","last_became_active":"2024-08-28T19:29:48.124417+0000","last_became_peered":"2024-08-28T19:29:48.124417+0000","last_unstale":"2024-08-28T19:31:56.141213+0000","last_undegraded":"2024-08-28T19:31:56.141213+0000","last_fullsized":"2024-08-28T19:31:56.141213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:33:33.931496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143690+0000","last_change":"2024-08-28T19:29:48.127815+0000","last_active":"2024-08-28T19:31:56.143690+0000","last_peered":"2024-08-28T19:31:56.143690+0000","last_clean":"2024-08-28T19:31:56.143690+0000","last_became_active":"2024-08-28T19:29:48.127455+0000","last_became_peered":"2024-08-28T19:29:48.127455+0000","last_unstale":"2024-08-28T19:31:56.143690+0000","last_undegraded":"2024-08-28T19:31:56.143690+0000","last_fullsized":"2024-08-28T19:31:56.143690+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:47:23.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142376+0000","last_change":"2024-08-28T19:29:48.122105+0000","last_active":"2024-08-28T19:31:56.142376+0000","last_peered":"2024-08-28T19:31:56.142376+0000","last_clean":"2024-08-28T19:31:56.142376+0000","last_became_active":"2024-08-28T19:29:48.121546+0000","last_became_peered":"2024-08-28T19:29:48.121546+0000","last_unstale":"2024-08-28T19:31:56.142376+0000","last_undegraded":"2024-08-28T19:31:56.142376+0000","last_fullsized":"2024-08-28T19:31:56.142376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:21:00.428052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151147+0000","last_change":"2024-08-28T19:29:48.136198+0000","last_active":"2024-08-28T19:31:56.151147+0000","last_peered":"2024-08-28T19:31:56.151147+0000","last_clean":"2024-08-28T19:31:56.151147+0000","last_became_active":"2024-08-28T19:29:48.135796+0000","last_became_peered":"2024-08-28T19:29:48.135796+0000","last_unstale":"2024-08-28T19:31:56.151147+0000","last_undegraded":"2024-08-28T19:31:56.151147+0000","last_fullsized":"2024-08-28T19:31:56.151147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:05.033399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134895+0000","last_change":"2024-08-28T19:29:48.121245+0000","last_active":"2024-08-28T19:31:56.134895+0000","last_peered":"2024-08-28T19:31:56.134895+0000","last_clean":"2024-08-28T19:31:56.134895+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.134895+0000","last_undegraded":"2024-08-28T19:31:56.134895+0000","last_fullsized":"2024-08-28T19:31:56.134895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:39.936209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132329+0000","last_change":"2024-08-28T19:29:48.119198+0000","last_active":"2024-08-28T19:31:56.132329+0000","last_peered":"2024-08-28T19:31:56.132329+0000","last_clean":"2024-08-28T19:31:56.132329+0000","last_became_active":"2024-08-28T19:29:48.118744+0000","last_became_peered":"2024-08-28T19:29:48.118744+0000","last_unstale":"2024-08-28T19:31:56.132329+0000","last_undegraded":"2024-08-28T19:31:56.132329+0000","last_fullsized":"2024-08-28T19:31:56.132329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:15:35.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131834+0000","last_change":"2024-08-28T19:30:27.403790+0000","last_active":"2024-08-28T19:31:56.131834+0000","last_peered":"2024-08-28T19:31:56.131834+0000","last_clean":"2024-08-28T19:31:56.131834+0000","last_became_active":"2024-08-28T19:30:27.403279+0000","last_became_peered":"2024-08-28T19:30:27.403279+0000","last_unstale":"2024-08-28T19:31:56.131834+0000","last_undegraded":"2024-08-28T19:31:56.131834+0000","last_fullsized":"2024-08-28T19:31:56.131834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:31:54.137839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128885+0000","last_change":"2024-08-28T19:30:27.405173+0000","last_active":"2024-08-28T19:31:56.128885+0000","last_peered":"2024-08-28T19:31:56.128885+0000","last_clean":"2024-08-28T19:31:56.128885+0000","last_became_active":"2024-08-28T19:30:27.404752+0000","last_became_peered":"2024-08-28T19:30:27.404752+0000","last_unstale":"2024-08-28T19:31:56.128885+0000","last_undegraded":"2024-08-28T19:31:56.128885+0000","last_fullsized":"2024-08-28T19:31:56.128885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:16.544309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152246+0000","last_change":"2024-08-28T19:29:48.136738+0000","last_active":"2024-08-28T19:31:56.152246+0000","last_peered":"2024-08-28T19:31:56.152246+0000","last_clean":"2024-08-28T19:31:56.152246+0000","last_became_active":"2024-08-28T19:29:48.136046+0000","last_became_peered":"2024-08-28T19:29:48.136046+0000","last_unstale":"2024-08-28T19:31:56.152246+0000","last_undegraded":"2024-08-28T19:31:56.152246+0000","last_fullsized":"2024-08-28T19:31:56.152246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:43:32.905933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.127788+0000","last_change":"2024-08-28T19:29:48.127432+0000","last_active":"2024-08-28T19:31:56.127788+0000","last_peered":"2024-08-28T19:31:56.127788+0000","last_clean":"2024-08-28T19:31:56.127788+0000","last_became_active":"2024-08-28T19:29:48.126067+0000","last_became_peered":"2024-08-28T19:29:48.126067+0000","last_unstale":"2024-08-28T19:31:56.127788+0000","last_undegraded":"2024-08-28T19:31:56.127788+0000","last_fullsized":"2024-08-28T19:31:56.127788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:30:05.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152540+0000","last_change":"2024-08-28T19:29:48.121154+0000","last_active":"2024-08-28T19:31:56.152540+0000","last_peered":"2024-08-28T19:31:56.152540+0000","last_clean":"2024-08-28T19:31:56.152540+0000","last_became_active":"2024-08-28T19:29:48.120709+0000","last_became_peered":"2024-08-28T19:29:48.120709+0000","last_unstale":"2024-08-28T19:31:56.152540+0000","last_undegraded":"2024-08-28T19:31:56.152540+0000","last_fullsized":"2024-08-28T19:31:56.152540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:52.716814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144107+0000","last_change":"2024-08-28T19:29:48.127124+0000","last_active":"2024-08-28T19:31:56.144107+0000","last_peered":"2024-08-28T19:31:56.144107+0000","last_clean":"2024-08-28T19:31:56.144107+0000","last_became_active":"2024-08-28T19:29:48.126761+0000","last_became_peered":"2024-08-28T19:29:48.126761+0000","last_unstale":"2024-08-28T19:31:56.144107+0000","last_undegraded":"2024-08-28T19:31:56.144107+0000","last_fullsized":"2024-08-28T19:31:56.144107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:05:31.150472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150014+0000","last_change":"2024-08-28T19:29:48.132285+0000","last_active":"2024-08-28T19:31:56.150014+0000","last_peered":"2024-08-28T19:31:56.150014+0000","last_clean":"2024-08-28T19:31:56.150014+0000","last_became_active":"2024-08-28T19:29:48.131688+0000","last_became_peered":"2024-08-28T19:29:48.131688+0000","last_unstale":"2024-08-28T19:31:56.150014+0000","last_undegraded":"2024-08-28T19:31:56.150014+0000","last_fullsized":"2024-08-28T19:31:56.150014+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:23:08.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.124596+0000","last_change":"2024-08-28T19:29:48.126384+0000","last_active":"2024-08-28T19:31:56.124596+0000","last_peered":"2024-08-28T19:31:56.124596+0000","last_clean":"2024-08-28T19:31:56.124596+0000","last_became_active":"2024-08-28T19:29:48.125412+0000","last_became_peered":"2024-08-28T19:29:48.125412+0000","last_unstale":"2024-08-28T19:31:56.124596+0000","last_undegraded":"2024-08-28T19:31:56.124596+0000","last_fullsized":"2024-08-28T19:31:56.124596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:47:42.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125963+0000","last_change":"2024-08-28T19:29:48.114032+0000","last_active":"2024-08-28T19:31:56.125963+0000","last_peered":"2024-08-28T19:31:56.125963+0000","last_clean":"2024-08-28T19:31:56.125963+0000","last_became_active":"2024-08-28T19:29:48.113625+0000","last_became_peered":"2024-08-28T19:29:48.113625+0000","last_unstale":"2024-08-28T19:31:56.125963+0000","last_undegraded":"2024-08-28T19:31:56.125963+0000","last_fullsized":"2024-08-28T19:31:56.125963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:07:08.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131499+0000","last_change":"2024-08-28T19:29:48.124046+0000","last_active":"2024-08-28T19:31:56.131499+0000","last_peered":"2024-08-28T19:31:56.131499+0000","last_clean":"2024-08-28T19:31:56.131499+0000","last_became_active":"2024-08-28T19:29:48.123647+0000","last_became_peered":"2024-08-28T19:29:48.123647+0000","last_unstale":"2024-08-28T19:31:56.131499+0000","last_undegraded":"2024-08-28T19:31:56.131499+0000","last_fullsized":"2024-08-28T19:31:56.131499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:59.262454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148165+0000","last_change":"2024-08-28T19:29:48.121258+0000","last_active":"2024-08-28T19:31:56.148165+0000","last_peered":"2024-08-28T19:31:56.148165+0000","last_clean":"2024-08-28T19:31:56.148165+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.148165+0000","last_undegraded":"2024-08-28T19:31:56.148165+0000","last_fullsized":"2024-08-28T19:31:56.148165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:37:05.610466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.129860+0000","last_change":"2024-08-28T19:29:48.125071+0000","last_active":"2024-08-28T19:31:56.129860+0000","last_peered":"2024-08-28T19:31:56.129860+0000","last_clean":"2024-08-28T19:31:56.129860+0000","last_became_active":"2024-08-28T19:29:48.124706+0000","last_became_peered":"2024-08-28T19:29:48.124706+0000","last_unstale":"2024-08-28T19:31:56.129860+0000","last_undegraded":"2024-08-28T19:31:56.129860+0000","last_fullsized":"2024-08-28T19:31:56.129860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:39:06.460682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141807+0000","last_change":"2024-08-28T19:29:48.121905+0000","last_active":"2024-08-28T19:31:56.141807+0000","last_peered":"2024-08-28T19:31:56.141807+0000","last_clean":"2024-08-28T19:31:56.141807+0000","last_became_active":"2024-08-28T19:29:48.121045+0000","last_became_peered":"2024-08-28T19:29:48.121045+0000","last_unstale":"2024-08-28T19:31:56.141807+0000","last_undegraded":"2024-08-28T19:31:56.141807+0000","last_fullsized":"2024-08-28T19:31:56.141807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:56:58.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75796,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1233,"num_read_kb":704,"num_write":263,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":222015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246047,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776174,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":496720,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939698,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":1151734,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103224,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":500102,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299453,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":496272,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495680,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1093330,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659206,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":491510,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855436,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1019904,"data_stored":1088072,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018959,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":496424,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215188,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":491218,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":555921,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":560542,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":493498,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T19:32:28.033 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-28T19:32:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 -- 172.21.15.33:0/501828553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e941089b0 msgr2=0x7f3e9410f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 --2- 172.21.15.33:0/501828553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e941089b0 0x7f3e9410f1e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009ca0 tx=0x7f3e8c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 -- 172.21.15.33:0/501828553 shutdown_connections 2024-08-28T19:32:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 --2- 172.21.15.33:0/501828553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e941089b0 0x7f3e9410f1e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 --2- 172.21.15.33:0/501828553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e94108060 0x7f3e94108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 --2- 172.21.15.33:0/501828553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e94102730 0x7f3e94102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 -- 172.21.15.33:0/501828553 >> 172.21.15.33:0/501828553 conn(0x7f3e940fe0f0 msgr2=0x7f3e94100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 -- 172.21.15.33:0/501828553 shutdown_connections 2024-08-28T19:32:28.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 -- 172.21.15.33:0/501828553 wait complete. 2024-08-28T19:32:28.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 Processor -- start 2024-08-28T19:32:28.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.182+0000 7f3e9bb37640 1 -- start start 2024-08-28T19:32:28.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e9bb37640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e94102730 0x7f3e9419af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e9bb37640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e94108060 0x7f3e9419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e9bb37640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e941089b0 0x7f3e9419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e9bb37640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e94112680 con 0x7f3e94108060 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e9bb37640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e94112500 con 0x7f3e94102730 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e9bb37640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e94112800 con 0x7f3e941089b0 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e990d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e94108060 0x7f3e9419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e990d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e94108060 0x7f3e9419b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37450/0 (socket says 172.21.15.33:37450) 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e990d2640 1 -- 172.21.15.33:0/2024218906 learned_addr learned my addr 172.21.15.33:0/2024218906 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e998d3640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e94102730 0x7f3e9419af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e9a0d4640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e941089b0 0x7f3e9419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e990d2640 1 -- 172.21.15.33:0/2024218906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e941089b0 msgr2=0x7f3e9419b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e990d2640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e941089b0 0x7f3e9419b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e990d2640 1 -- 172.21.15.33:0/2024218906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e94102730 msgr2=0x7f3e9419af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e990d2640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e94102730 0x7f3e9419af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e990d2640 1 -- 172.21.15.33:0/2024218906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e941a61f0 con 0x7f3e94108060 2024-08-28T19:32:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e9a0d4640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e941089b0 0x7f3e9419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e990d2640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e94108060 0x7f3e9419b470 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800d750 tx=0x7f3e8800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.183+0000 7f3e86ffd640 1 -- 172.21.15.33:0/2024218906 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88017070 con 0x7f3e94108060 2024-08-28T19:32:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.184+0000 7f3e86ffd640 1 -- 172.21.15.33:0/2024218906 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e880054d0 con 0x7f3e94108060 2024-08-28T19:32:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.184+0000 7f3e9bb37640 1 -- 172.21.15.33:0/2024218906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e941a64e0 con 0x7f3e94108060 2024-08-28T19:32:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.184+0000 7f3e86ffd640 1 -- 172.21.15.33:0/2024218906 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88004c30 con 0x7f3e94108060 2024-08-28T19:32:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.184+0000 7f3e9bb37640 1 -- 172.21.15.33:0/2024218906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e941a6a30 con 0x7f3e94108060 2024-08-28T19:32:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.185+0000 7f3e9bb37640 1 -- 172.21.15.33:0/2024218906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e94102b40 con 0x7f3e94108060 2024-08-28T19:32:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.186+0000 7f3e86ffd640 1 -- 172.21.15.33:0/2024218906 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f3e88004dd0 con 0x7f3e94108060 2024-08-28T19:32:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.187+0000 7f3e86ffd640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e800b4c00 0x7f3e800b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.187+0000 7f3e998d3640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e800b4c00 0x7f3e800b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.187+0000 7f3e86ffd640 1 -- 172.21.15.33:0/2024218906 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3e880e5040 con 0x7f3e94108060 2024-08-28T19:32:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.187+0000 7f3e998d3640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e800b4c00 0x7f3e800b7110 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e9406c250 tx=0x7f3e9000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.191+0000 7f3e86ffd640 1 -- 172.21.15.33:0/2024218906 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3e880abca0 con 0x7f3e94108060 2024-08-28T19:32:28.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.373+0000 7f3e9bb37640 1 -- 172.21.15.33:0/2024218906 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e940635a0 con 0x7f3e800b4c00 2024-08-28T19:32:28.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.379+0000 7f3e86ffd640 1 -- 172.21.15.33:0/2024218906 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340764 (secure 0 0 0) 0x7f3e940635a0 con 0x7f3e800b4c00 2024-08-28T19:32:28.383 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:28.385 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-28T19:32:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 -- 172.21.15.33:0/2024218906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e800b4c00 msgr2=0x7f3e800b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e800b4c00 0x7f3e800b7110 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e9406c250 tx=0x7f3e9000b390 comp rx=0 tx=0).stop 2024-08-28T19:32:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 -- 172.21.15.33:0/2024218906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e94108060 msgr2=0x7f3e9419b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e94108060 0x7f3e9419b470 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800d750 tx=0x7f3e8800dc10 comp rx=0 tx=0).stop 2024-08-28T19:32:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 -- 172.21.15.33:0/2024218906 shutdown_connections 2024-08-28T19:32:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e800b4c00 0x7f3e800b7110 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e941089b0 0x7f3e9419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e94108060 0x7f3e9419b470 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 --2- 172.21.15.33:0/2024218906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e94102730 0x7f3e9419af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 -- 172.21.15.33:0/2024218906 >> 172.21.15.33:0/2024218906 conn(0x7f3e940fe0f0 msgr2=0x7f3e9406a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 -- 172.21.15.33:0/2024218906 shutdown_connections 2024-08-28T19:32:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.382+0000 7f3e9bb37640 1 -- 172.21.15.33:0/2024218906 wait complete. 2024-08-28T19:32:28.394 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-08-28T19:32:27.763324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666398,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1314,"num_read_kb":773,"num_write":388,"num_write_kb":2310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373276,"kb_used_data":11548,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568548,"statfs":{"total":1151940427776,"available":1151558193152,"internally_reserved":0,"allocated":11825152,"data_stored":7915343,"data_compressed":463917,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5989,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":78,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003360"},"pg_stats":[{"pgid":"2.1f","version":"81'13","reported_seq":174,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:25.595830+0000","last_change":"2024-08-28T19:29:46.098343+0000","last_active":"2024-08-28T19:32:25.595830+0000","last_peered":"2024-08-28T19:32:25.595830+0000","last_clean":"2024-08-28T19:32:25.595830+0000","last_became_active":"2024-08-28T19:29:46.097974+0000","last_became_peered":"2024-08-28T19:29:46.097974+0000","last_unstale":"2024-08-28T19:32:25.595830+0000","last_undegraded":"2024-08-28T19:32:25.595830+0000","last_fullsized":"2024-08-28T19:32:25.595830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:03:11.466154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125076+0000","last_change":"2024-08-28T19:29:48.123521+0000","last_active":"2024-08-28T19:31:56.125076+0000","last_peered":"2024-08-28T19:31:56.125076+0000","last_clean":"2024-08-28T19:31:56.125076+0000","last_became_active":"2024-08-28T19:29:48.122998+0000","last_became_peered":"2024-08-28T19:29:48.122998+0000","last_unstale":"2024-08-28T19:31:56.125076+0000","last_undegraded":"2024-08-28T19:31:56.125076+0000","last_fullsized":"2024-08-28T19:31:56.125076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:33:48.413468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901815+0000","last_change":"2024-08-28T19:29:55.268086+0000","last_active":"2024-08-28T19:31:27.901815+0000","last_peered":"2024-08-28T19:31:27.901815+0000","last_clean":"2024-08-28T19:31:27.901815+0000","last_became_active":"2024-08-28T19:29:55.267411+0000","last_became_peered":"2024-08-28T19:29:55.267411+0000","last_unstale":"2024-08-28T19:31:27.901815+0000","last_undegraded":"2024-08-28T19:31:27.901815+0000","last_fullsized":"2024-08-28T19:31:27.901815+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:32:16.277295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903018+0000","last_change":"2024-08-28T19:29:46.188552+0000","last_active":"2024-08-28T19:31:27.903018+0000","last_peered":"2024-08-28T19:31:27.903018+0000","last_clean":"2024-08-28T19:31:27.903018+0000","last_became_active":"2024-08-28T19:29:46.188118+0000","last_became_peered":"2024-08-28T19:29:46.188118+0000","last_unstale":"2024-08-28T19:31:27.903018+0000","last_undegraded":"2024-08-28T19:31:27.903018+0000","last_fullsized":"2024-08-28T19:31:27.903018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:55:43.774037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148138+0000","last_change":"2024-08-28T19:29:48.118765+0000","last_active":"2024-08-28T19:31:56.148138+0000","last_peered":"2024-08-28T19:31:56.148138+0000","last_clean":"2024-08-28T19:31:56.148138+0000","last_became_active":"2024-08-28T19:29:48.118111+0000","last_became_peered":"2024-08-28T19:29:48.118111+0000","last_unstale":"2024-08-28T19:31:56.148138+0000","last_undegraded":"2024-08-28T19:31:56.148138+0000","last_fullsized":"2024-08-28T19:31:56.148138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:00:51.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895580+0000","last_change":"2024-08-28T19:29:55.262222+0000","last_active":"2024-08-28T19:31:27.895580+0000","last_peered":"2024-08-28T19:31:27.895580+0000","last_clean":"2024-08-28T19:31:27.895580+0000","last_became_active":"2024-08-28T19:29:55.260906+0000","last_became_peered":"2024-08-28T19:29:55.260906+0000","last_unstale":"2024-08-28T19:31:27.895580+0000","last_undegraded":"2024-08-28T19:31:27.895580+0000","last_fullsized":"2024-08-28T19:31:27.895580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:22:30.523609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903748+0000","last_change":"2024-08-28T19:29:46.101077+0000","last_active":"2024-08-28T19:31:27.903748+0000","last_peered":"2024-08-28T19:31:27.903748+0000","last_clean":"2024-08-28T19:31:27.903748+0000","last_became_active":"2024-08-28T19:29:46.100630+0000","last_became_peered":"2024-08-28T19:29:46.100630+0000","last_unstale":"2024-08-28T19:31:27.903748+0000","last_undegraded":"2024-08-28T19:31:27.903748+0000","last_fullsized":"2024-08-28T19:31:27.903748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:59:11.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152697+0000","last_change":"2024-08-28T19:29:48.129460+0000","last_active":"2024-08-28T19:31:56.152697+0000","last_peered":"2024-08-28T19:31:56.152697+0000","last_clean":"2024-08-28T19:31:56.152697+0000","last_became_active":"2024-08-28T19:29:48.129068+0000","last_became_peered":"2024-08-28T19:29:48.129068+0000","last_unstale":"2024-08-28T19:31:56.152697+0000","last_undegraded":"2024-08-28T19:31:56.152697+0000","last_fullsized":"2024-08-28T19:31:56.152697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:08:40.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895880+0000","last_change":"2024-08-28T19:29:55.262943+0000","last_active":"2024-08-28T19:31:27.895880+0000","last_peered":"2024-08-28T19:31:27.895880+0000","last_clean":"2024-08-28T19:31:27.895880+0000","last_became_active":"2024-08-28T19:29:55.262424+0000","last_became_peered":"2024-08-28T19:29:55.262424+0000","last_unstale":"2024-08-28T19:31:27.895880+0000","last_undegraded":"2024-08-28T19:31:27.895880+0000","last_fullsized":"2024-08-28T19:31:27.895880+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:19:40.618651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903555+0000","last_change":"2024-08-28T19:29:46.102571+0000","last_active":"2024-08-28T19:31:27.903555+0000","last_peered":"2024-08-28T19:31:27.903555+0000","last_clean":"2024-08-28T19:31:27.903555+0000","last_became_active":"2024-08-28T19:29:46.102081+0000","last_became_peered":"2024-08-28T19:29:46.102081+0000","last_unstale":"2024-08-28T19:31:27.903555+0000","last_undegraded":"2024-08-28T19:31:27.903555+0000","last_fullsized":"2024-08-28T19:31:27.903555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:46:38.266122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149393+0000","last_change":"2024-08-28T19:30:27.550413+0000","last_active":"2024-08-28T19:31:56.149393+0000","last_peered":"2024-08-28T19:31:56.149393+0000","last_clean":"2024-08-28T19:31:56.149393+0000","last_became_active":"2024-08-28T19:30:27.550002+0000","last_became_peered":"2024-08-28T19:30:27.550002+0000","last_unstale":"2024-08-28T19:31:56.149393+0000","last_undegraded":"2024-08-28T19:31:56.149393+0000","last_fullsized":"2024-08-28T19:31:56.149393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:17.519332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895637+0000","last_change":"2024-08-28T19:29:55.261930+0000","last_active":"2024-08-28T19:31:27.895637+0000","last_peered":"2024-08-28T19:31:27.895637+0000","last_clean":"2024-08-28T19:31:27.895637+0000","last_became_active":"2024-08-28T19:29:55.261208+0000","last_became_peered":"2024-08-28T19:29:55.261208+0000","last_unstale":"2024-08-28T19:31:27.895637+0000","last_undegraded":"2024-08-28T19:31:27.895637+0000","last_fullsized":"2024-08-28T19:31:27.895637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.804993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152875+0000","last_change":"2024-08-28T19:29:48.133820+0000","last_active":"2024-08-28T19:31:56.152875+0000","last_peered":"2024-08-28T19:31:56.152875+0000","last_clean":"2024-08-28T19:31:56.152875+0000","last_became_active":"2024-08-28T19:29:48.132536+0000","last_became_peered":"2024-08-28T19:29:48.132536+0000","last_unstale":"2024-08-28T19:31:56.152875+0000","last_undegraded":"2024-08-28T19:31:56.152875+0000","last_fullsized":"2024-08-28T19:31:56.152875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:15:39.779698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902841+0000","last_change":"2024-08-28T19:29:46.101206+0000","last_active":"2024-08-28T19:31:27.902841+0000","last_peered":"2024-08-28T19:31:27.902841+0000","last_clean":"2024-08-28T19:31:27.902841+0000","last_became_active":"2024-08-28T19:29:46.100801+0000","last_became_peered":"2024-08-28T19:29:46.100801+0000","last_unstale":"2024-08-28T19:31:27.902841+0000","last_undegraded":"2024-08-28T19:31:27.902841+0000","last_fullsized":"2024-08-28T19:31:27.902841+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:43:33.156203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895905+0000","last_change":"2024-08-28T19:29:55.572774+0000","last_active":"2024-08-28T19:31:27.895905+0000","last_peered":"2024-08-28T19:31:27.895905+0000","last_clean":"2024-08-28T19:31:27.895905+0000","last_became_active":"2024-08-28T19:29:55.571703+0000","last_became_peered":"2024-08-28T19:29:55.571703+0000","last_unstale":"2024-08-28T19:31:27.895905+0000","last_undegraded":"2024-08-28T19:31:27.895905+0000","last_fullsized":"2024-08-28T19:31:27.895905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:56:52.695007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131019+0000","last_change":"2024-08-28T19:29:48.127683+0000","last_active":"2024-08-28T19:31:56.131019+0000","last_peered":"2024-08-28T19:31:56.131019+0000","last_clean":"2024-08-28T19:31:56.131019+0000","last_became_active":"2024-08-28T19:29:48.127139+0000","last_became_peered":"2024-08-28T19:29:48.127139+0000","last_unstale":"2024-08-28T19:31:56.131019+0000","last_undegraded":"2024-08-28T19:31:56.131019+0000","last_fullsized":"2024-08-28T19:31:56.131019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:38:16.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902182+0000","last_change":"2024-08-28T19:29:46.103233+0000","last_active":"2024-08-28T19:31:27.902182+0000","last_peered":"2024-08-28T19:31:27.902182+0000","last_clean":"2024-08-28T19:31:27.902182+0000","last_became_active":"2024-08-28T19:29:46.102515+0000","last_became_peered":"2024-08-28T19:29:46.102515+0000","last_unstale":"2024-08-28T19:31:27.902182+0000","last_undegraded":"2024-08-28T19:31:27.902182+0000","last_fullsized":"2024-08-28T19:31:27.902182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:49:35.905893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896101+0000","last_change":"2024-08-28T19:29:55.264291+0000","last_active":"2024-08-28T19:31:27.896101+0000","last_peered":"2024-08-28T19:31:27.896101+0000","last_clean":"2024-08-28T19:31:27.896101+0000","last_became_active":"2024-08-28T19:29:55.263692+0000","last_became_peered":"2024-08-28T19:29:55.263692+0000","last_unstale":"2024-08-28T19:31:27.896101+0000","last_undegraded":"2024-08-28T19:31:27.896101+0000","last_fullsized":"2024-08-28T19:31:27.896101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:47:01.795320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.147184+0000","last_change":"2024-08-28T19:29:48.115470+0000","last_active":"2024-08-28T19:31:56.147184+0000","last_peered":"2024-08-28T19:31:56.147184+0000","last_clean":"2024-08-28T19:31:56.147184+0000","last_became_active":"2024-08-28T19:29:48.115076+0000","last_became_peered":"2024-08-28T19:29:48.115076+0000","last_unstale":"2024-08-28T19:31:56.147184+0000","last_undegraded":"2024-08-28T19:31:56.147184+0000","last_fullsized":"2024-08-28T19:31:56.147184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:32.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902180+0000","last_change":"2024-08-28T19:29:46.099970+0000","last_active":"2024-08-28T19:31:27.902180+0000","last_peered":"2024-08-28T19:31:27.902180+0000","last_clean":"2024-08-28T19:31:27.902180+0000","last_became_active":"2024-08-28T19:29:46.099661+0000","last_became_peered":"2024-08-28T19:29:46.099661+0000","last_unstale":"2024-08-28T19:31:27.902180+0000","last_undegraded":"2024-08-28T19:31:27.902180+0000","last_fullsized":"2024-08-28T19:31:27.902180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:27.430026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894683+0000","last_change":"2024-08-28T19:29:55.265983+0000","last_active":"2024-08-28T19:31:27.894683+0000","last_peered":"2024-08-28T19:31:27.894683+0000","last_clean":"2024-08-28T19:31:27.894683+0000","last_became_active":"2024-08-28T19:29:55.265464+0000","last_became_peered":"2024-08-28T19:29:55.265464+0000","last_unstale":"2024-08-28T19:31:27.894683+0000","last_undegraded":"2024-08-28T19:31:27.894683+0000","last_fullsized":"2024-08-28T19:31:27.894683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:21:42.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139931+0000","last_change":"2024-08-28T19:29:48.119545+0000","last_active":"2024-08-28T19:31:56.139931+0000","last_peered":"2024-08-28T19:31:56.139931+0000","last_clean":"2024-08-28T19:31:56.139931+0000","last_became_active":"2024-08-28T19:29:48.119128+0000","last_became_peered":"2024-08-28T19:29:48.119128+0000","last_unstale":"2024-08-28T19:31:56.139931+0000","last_undegraded":"2024-08-28T19:31:56.139931+0000","last_fullsized":"2024-08-28T19:31:56.139931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:05:31.535016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.907887+0000","last_change":"2024-08-28T19:31:27.907348+0000","last_active":"2024-08-28T19:31:27.907887+0000","last_peered":"2024-08-28T19:31:27.907887+0000","last_clean":"2024-08-28T19:31:27.907887+0000","last_became_active":"2024-08-28T19:31:27.904502+0000","last_became_peered":"2024-08-28T19:31:27.904502+0000","last_unstale":"2024-08-28T19:31:27.907887+0000","last_undegraded":"2024-08-28T19:31:27.907887+0000","last_fullsized":"2024-08-28T19:31:27.907887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:16:50.269131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895761+0000","last_change":"2024-08-28T19:29:55.573320+0000","last_active":"2024-08-28T19:31:27.895761+0000","last_peered":"2024-08-28T19:31:27.895761+0000","last_clean":"2024-08-28T19:31:27.895761+0000","last_became_active":"2024-08-28T19:29:55.572858+0000","last_became_peered":"2024-08-28T19:29:55.572858+0000","last_unstale":"2024-08-28T19:31:27.895761+0000","last_undegraded":"2024-08-28T19:31:27.895761+0000","last_fullsized":"2024-08-28T19:31:27.895761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:09:34.676911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.133571+0000","last_change":"2024-08-28T19:30:27.404918+0000","last_active":"2024-08-28T19:31:56.133571+0000","last_peered":"2024-08-28T19:31:56.133571+0000","last_clean":"2024-08-28T19:31:56.133571+0000","last_became_active":"2024-08-28T19:30:27.404495+0000","last_became_peered":"2024-08-28T19:30:27.404495+0000","last_unstale":"2024-08-28T19:31:56.133571+0000","last_undegraded":"2024-08-28T19:31:56.133571+0000","last_fullsized":"2024-08-28T19:31:56.133571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:10:12.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896122+0000","last_change":"2024-08-28T19:29:46.110683+0000","last_active":"2024-08-28T19:31:27.896122+0000","last_peered":"2024-08-28T19:31:27.896122+0000","last_clean":"2024-08-28T19:31:27.896122+0000","last_became_active":"2024-08-28T19:29:46.110324+0000","last_became_peered":"2024-08-28T19:29:46.110324+0000","last_unstale":"2024-08-28T19:31:27.896122+0000","last_undegraded":"2024-08-28T19:31:27.896122+0000","last_fullsized":"2024-08-28T19:31:27.896122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:15:47.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901834+0000","last_change":"2024-08-28T19:29:55.271035+0000","last_active":"2024-08-28T19:31:27.901834+0000","last_peered":"2024-08-28T19:31:27.901834+0000","last_clean":"2024-08-28T19:31:27.901834+0000","last_became_active":"2024-08-28T19:29:55.268465+0000","last_became_peered":"2024-08-28T19:29:55.268465+0000","last_unstale":"2024-08-28T19:31:27.901834+0000","last_undegraded":"2024-08-28T19:31:27.901834+0000","last_fullsized":"2024-08-28T19:31:27.901834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:16:17.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132232+0000","last_change":"2024-08-28T19:29:48.127225+0000","last_active":"2024-08-28T19:31:56.132232+0000","last_peered":"2024-08-28T19:31:56.132232+0000","last_clean":"2024-08-28T19:31:56.132232+0000","last_became_active":"2024-08-28T19:29:48.126775+0000","last_became_peered":"2024-08-28T19:29:48.126775+0000","last_unstale":"2024-08-28T19:31:56.132232+0000","last_undegraded":"2024-08-28T19:31:56.132232+0000","last_fullsized":"2024-08-28T19:31:56.132232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:49:39.353082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'17","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:57.503018+0000","last_change":"2024-08-28T19:29:46.098076+0000","last_active":"2024-08-28T19:31:57.503018+0000","last_peered":"2024-08-28T19:31:57.503018+0000","last_clean":"2024-08-28T19:31:57.503018+0000","last_became_active":"2024-08-28T19:29:46.097726+0000","last_became_peered":"2024-08-28T19:29:46.097726+0000","last_unstale":"2024-08-28T19:31:57.503018+0000","last_undegraded":"2024-08-28T19:31:57.503018+0000","last_fullsized":"2024-08-28T19:31:57.503018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.624125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901585+0000","last_change":"2024-08-28T19:29:55.571830+0000","last_active":"2024-08-28T19:31:27.901585+0000","last_peered":"2024-08-28T19:31:27.901585+0000","last_clean":"2024-08-28T19:31:27.901585+0000","last_became_active":"2024-08-28T19:29:55.571318+0000","last_became_peered":"2024-08-28T19:29:55.571318+0000","last_unstale":"2024-08-28T19:31:27.901585+0000","last_undegraded":"2024-08-28T19:31:27.901585+0000","last_fullsized":"2024-08-28T19:31:27.901585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:41:03.397478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135204+0000","last_change":"2024-08-28T19:29:48.124998+0000","last_active":"2024-08-28T19:31:56.135204+0000","last_peered":"2024-08-28T19:31:56.135204+0000","last_clean":"2024-08-28T19:31:56.135204+0000","last_became_active":"2024-08-28T19:29:48.124600+0000","last_became_peered":"2024-08-28T19:29:48.124600+0000","last_unstale":"2024-08-28T19:31:56.135204+0000","last_undegraded":"2024-08-28T19:31:56.135204+0000","last_fullsized":"2024-08-28T19:31:56.135204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:50:59.459372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903831+0000","last_change":"2024-08-28T19:29:46.189455+0000","last_active":"2024-08-28T19:31:27.903831+0000","last_peered":"2024-08-28T19:31:27.903831+0000","last_clean":"2024-08-28T19:31:27.903831+0000","last_became_active":"2024-08-28T19:29:46.188640+0000","last_became_peered":"2024-08-28T19:29:46.188640+0000","last_unstale":"2024-08-28T19:31:27.903831+0000","last_undegraded":"2024-08-28T19:31:27.903831+0000","last_fullsized":"2024-08-28T19:31:27.903831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:05:32.561725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899291+0000","last_change":"2024-08-28T19:29:55.269726+0000","last_active":"2024-08-28T19:31:27.899291+0000","last_peered":"2024-08-28T19:31:27.899291+0000","last_clean":"2024-08-28T19:31:27.899291+0000","last_became_active":"2024-08-28T19:29:55.269261+0000","last_became_peered":"2024-08-28T19:29:55.269261+0000","last_unstale":"2024-08-28T19:31:27.899291+0000","last_undegraded":"2024-08-28T19:31:27.899291+0000","last_fullsized":"2024-08-28T19:31:27.899291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:05.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128358+0000","last_change":"2024-08-28T19:29:48.125251+0000","last_active":"2024-08-28T19:31:56.128358+0000","last_peered":"2024-08-28T19:31:56.128358+0000","last_clean":"2024-08-28T19:31:56.128358+0000","last_became_active":"2024-08-28T19:29:48.124818+0000","last_became_peered":"2024-08-28T19:29:48.124818+0000","last_unstale":"2024-08-28T19:31:56.128358+0000","last_undegraded":"2024-08-28T19:31:56.128358+0000","last_fullsized":"2024-08-28T19:31:56.128358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:47:05.217199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894972+0000","last_change":"2024-08-28T19:29:46.189747+0000","last_active":"2024-08-28T19:31:27.894972+0000","last_peered":"2024-08-28T19:31:27.894972+0000","last_clean":"2024-08-28T19:31:27.894972+0000","last_became_active":"2024-08-28T19:29:46.189356+0000","last_became_peered":"2024-08-28T19:29:46.189356+0000","last_unstale":"2024-08-28T19:31:27.894972+0000","last_undegraded":"2024-08-28T19:31:27.894972+0000","last_fullsized":"2024-08-28T19:31:27.894972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.629054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902184+0000","last_change":"2024-08-28T19:29:55.572746+0000","last_active":"2024-08-28T19:31:27.902184+0000","last_peered":"2024-08-28T19:31:27.902184+0000","last_clean":"2024-08-28T19:31:27.902184+0000","last_became_active":"2024-08-28T19:29:55.572246+0000","last_became_peered":"2024-08-28T19:29:55.572246+0000","last_unstale":"2024-08-28T19:31:27.902184+0000","last_undegraded":"2024-08-28T19:31:27.902184+0000","last_fullsized":"2024-08-28T19:31:27.902184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:48:23.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.123589+0000","last_change":"2024-08-28T19:29:48.127579+0000","last_active":"2024-08-28T19:31:56.123589+0000","last_peered":"2024-08-28T19:31:56.123589+0000","last_clean":"2024-08-28T19:31:56.123589+0000","last_became_active":"2024-08-28T19:29:48.126978+0000","last_became_peered":"2024-08-28T19:29:48.126978+0000","last_unstale":"2024-08-28T19:31:56.123589+0000","last_undegraded":"2024-08-28T19:31:56.123589+0000","last_fullsized":"2024-08-28T19:31:56.123589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:27.657714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":163,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:23.593918+0000","last_change":"2024-08-28T19:29:46.102374+0000","last_active":"2024-08-28T19:32:23.593918+0000","last_peered":"2024-08-28T19:32:23.593918+0000","last_clean":"2024-08-28T19:32:23.593918+0000","last_became_active":"2024-08-28T19:29:46.101619+0000","last_became_peered":"2024-08-28T19:29:46.101619+0000","last_unstale":"2024-08-28T19:32:23.593918+0000","last_undegraded":"2024-08-28T19:32:23.593918+0000","last_fullsized":"2024-08-28T19:32:23.593918+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:46:21.353063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006989+0000","last_change":"2024-08-28T19:29:55.265403+0000","last_active":"2024-08-28T19:31:28.006989+0000","last_peered":"2024-08-28T19:31:28.006989+0000","last_clean":"2024-08-28T19:31:28.006989+0000","last_became_active":"2024-08-28T19:29:55.264979+0000","last_became_peered":"2024-08-28T19:29:55.264979+0000","last_unstale":"2024-08-28T19:31:28.006989+0000","last_undegraded":"2024-08-28T19:31:28.006989+0000","last_fullsized":"2024-08-28T19:31:28.006989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:18:18.623218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142841+0000","last_change":"2024-08-28T19:29:48.117437+0000","last_active":"2024-08-28T19:31:56.142841+0000","last_peered":"2024-08-28T19:31:56.142841+0000","last_clean":"2024-08-28T19:31:56.142841+0000","last_became_active":"2024-08-28T19:29:48.116379+0000","last_became_peered":"2024-08-28T19:29:48.116379+0000","last_unstale":"2024-08-28T19:31:56.142841+0000","last_undegraded":"2024-08-28T19:31:56.142841+0000","last_fullsized":"2024-08-28T19:31:56.142841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:23.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'7","reported_seq":163,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:22.592395+0000","last_change":"2024-08-28T19:29:46.188551+0000","last_active":"2024-08-28T19:32:22.592395+0000","last_peered":"2024-08-28T19:32:22.592395+0000","last_clean":"2024-08-28T19:32:22.592395+0000","last_became_active":"2024-08-28T19:29:46.188050+0000","last_became_peered":"2024-08-28T19:29:46.188050+0000","last_unstale":"2024-08-28T19:32:22.592395+0000","last_undegraded":"2024-08-28T19:32:22.592395+0000","last_fullsized":"2024-08-28T19:32:22.592395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:07:21.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007135+0000","last_change":"2024-08-28T19:29:55.572013+0000","last_active":"2024-08-28T19:31:28.007135+0000","last_peered":"2024-08-28T19:31:28.007135+0000","last_clean":"2024-08-28T19:31:28.007135+0000","last_became_active":"2024-08-28T19:29:55.571503+0000","last_became_peered":"2024-08-28T19:29:55.571503+0000","last_unstale":"2024-08-28T19:31:28.007135+0000","last_undegraded":"2024-08-28T19:31:28.007135+0000","last_fullsized":"2024-08-28T19:31:28.007135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:40:21.669321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134828+0000","last_change":"2024-08-28T19:29:48.124646+0000","last_active":"2024-08-28T19:31:56.134828+0000","last_peered":"2024-08-28T19:31:56.134828+0000","last_clean":"2024-08-28T19:31:56.134828+0000","last_became_active":"2024-08-28T19:29:48.123062+0000","last_became_peered":"2024-08-28T19:29:48.123062+0000","last_unstale":"2024-08-28T19:31:56.134828+0000","last_undegraded":"2024-08-28T19:31:56.134828+0000","last_fullsized":"2024-08-28T19:31:56.134828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:16:03.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007156+0000","last_change":"2024-08-28T19:29:46.105979+0000","last_active":"2024-08-28T19:31:28.007156+0000","last_peered":"2024-08-28T19:31:28.007156+0000","last_clean":"2024-08-28T19:31:28.007156+0000","last_became_active":"2024-08-28T19:29:46.105558+0000","last_became_peered":"2024-08-28T19:29:46.105558+0000","last_unstale":"2024-08-28T19:31:28.007156+0000","last_undegraded":"2024-08-28T19:31:28.007156+0000","last_fullsized":"2024-08-28T19:31:28.007156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:47.639236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896414+0000","last_change":"2024-08-28T19:29:55.574025+0000","last_active":"2024-08-28T19:31:27.896414+0000","last_peered":"2024-08-28T19:31:27.896414+0000","last_clean":"2024-08-28T19:31:27.896414+0000","last_became_active":"2024-08-28T19:29:55.573380+0000","last_became_peered":"2024-08-28T19:29:55.573380+0000","last_unstale":"2024-08-28T19:31:27.896414+0000","last_undegraded":"2024-08-28T19:31:27.896414+0000","last_fullsized":"2024-08-28T19:31:27.896414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:19:05.287692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.138839+0000","last_change":"2024-08-28T19:29:48.118606+0000","last_active":"2024-08-28T19:31:56.138839+0000","last_peered":"2024-08-28T19:31:56.138839+0000","last_clean":"2024-08-28T19:31:56.138839+0000","last_became_active":"2024-08-28T19:29:48.117534+0000","last_became_peered":"2024-08-28T19:29:48.117534+0000","last_unstale":"2024-08-28T19:31:56.138839+0000","last_undegraded":"2024-08-28T19:31:56.138839+0000","last_fullsized":"2024-08-28T19:31:56.138839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:34.253859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896326+0000","last_change":"2024-08-28T19:29:46.100420+0000","last_active":"2024-08-28T19:31:27.896326+0000","last_peered":"2024-08-28T19:31:27.896326+0000","last_clean":"2024-08-28T19:31:27.896326+0000","last_became_active":"2024-08-28T19:29:46.099990+0000","last_became_peered":"2024-08-28T19:29:46.099990+0000","last_unstale":"2024-08-28T19:31:27.896326+0000","last_undegraded":"2024-08-28T19:31:27.896326+0000","last_fullsized":"2024-08-28T19:31:27.896326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:42:12.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":113,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007243+0000","last_change":"2024-08-28T19:28:32.822169+0000","last_active":"2024-08-28T19:31:28.007243+0000","last_peered":"2024-08-28T19:31:28.007243+0000","last_clean":"2024-08-28T19:31:28.007243+0000","last_became_active":"2024-08-28T19:28:32.816300+0000","last_became_peered":"2024-08-28T19:28:32.816300+0000","last_unstale":"2024-08-28T19:31:28.007243+0000","last_undegraded":"2024-08-28T19:31:28.007243+0000","last_fullsized":"2024-08-28T19:31:28.007243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_clean_scrub_stamp":"2024-08-28T19:25:14.491568+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:41:37.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007780+0000","last_change":"2024-08-28T19:29:55.265437+0000","last_active":"2024-08-28T19:31:28.007780+0000","last_peered":"2024-08-28T19:31:28.007780+0000","last_clean":"2024-08-28T19:31:28.007780+0000","last_became_active":"2024-08-28T19:29:55.264818+0000","last_became_peered":"2024-08-28T19:29:55.264818+0000","last_unstale":"2024-08-28T19:31:28.007780+0000","last_undegraded":"2024-08-28T19:31:28.007780+0000","last_fullsized":"2024-08-28T19:31:28.007780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:28:18.684362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152410+0000","last_change":"2024-08-28T19:29:48.135800+0000","last_active":"2024-08-28T19:31:56.152410+0000","last_peered":"2024-08-28T19:31:56.152410+0000","last_clean":"2024-08-28T19:31:56.152410+0000","last_became_active":"2024-08-28T19:29:48.135258+0000","last_became_peered":"2024-08-28T19:29:48.135258+0000","last_unstale":"2024-08-28T19:31:56.152410+0000","last_undegraded":"2024-08-28T19:31:56.152410+0000","last_fullsized":"2024-08-28T19:31:56.152410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:55.183190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:21.593173+0000","last_change":"2024-08-28T19:29:46.189298+0000","last_active":"2024-08-28T19:32:21.593173+0000","last_peered":"2024-08-28T19:32:21.593173+0000","last_clean":"2024-08-28T19:32:21.593173+0000","last_became_active":"2024-08-28T19:29:46.188813+0000","last_became_peered":"2024-08-28T19:29:46.188813+0000","last_unstale":"2024-08-28T19:32:21.593173+0000","last_undegraded":"2024-08-28T19:32:21.593173+0000","last_fullsized":"2024-08-28T19:32:21.593173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:14:00.961682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899863+0000","last_change":"2024-08-28T19:29:55.269495+0000","last_active":"2024-08-28T19:31:27.899863+0000","last_peered":"2024-08-28T19:31:27.899863+0000","last_clean":"2024-08-28T19:31:27.899863+0000","last_became_active":"2024-08-28T19:29:55.268916+0000","last_became_peered":"2024-08-28T19:29:55.268916+0000","last_unstale":"2024-08-28T19:31:27.899863+0000","last_undegraded":"2024-08-28T19:31:27.899863+0000","last_fullsized":"2024-08-28T19:31:27.899863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:26:53.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143974+0000","last_change":"2024-08-28T19:29:48.127588+0000","last_active":"2024-08-28T19:31:56.143974+0000","last_peered":"2024-08-28T19:31:56.143974+0000","last_clean":"2024-08-28T19:31:56.143974+0000","last_became_active":"2024-08-28T19:29:48.127200+0000","last_became_peered":"2024-08-28T19:29:48.127200+0000","last_unstale":"2024-08-28T19:31:56.143974+0000","last_undegraded":"2024-08-28T19:31:56.143974+0000","last_fullsized":"2024-08-28T19:31:56.143974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:30:30.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896631+0000","last_change":"2024-08-28T19:29:46.101010+0000","last_active":"2024-08-28T19:31:27.896631+0000","last_peered":"2024-08-28T19:31:27.896631+0000","last_clean":"2024-08-28T19:31:27.896631+0000","last_became_active":"2024-08-28T19:29:46.100082+0000","last_became_peered":"2024-08-28T19:29:46.100082+0000","last_unstale":"2024-08-28T19:31:27.896631+0000","last_undegraded":"2024-08-28T19:31:27.896631+0000","last_fullsized":"2024-08-28T19:31:27.896631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:18:51.074343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902334+0000","last_change":"2024-08-28T19:30:27.551743+0000","last_active":"2024-08-28T19:31:27.902334+0000","last_peered":"2024-08-28T19:31:27.902334+0000","last_clean":"2024-08-28T19:31:27.902334+0000","last_became_active":"2024-08-28T19:30:27.551249+0000","last_became_peered":"2024-08-28T19:30:27.551249+0000","last_unstale":"2024-08-28T19:31:27.902334+0000","last_undegraded":"2024-08-28T19:31:27.902334+0000","last_fullsized":"2024-08-28T19:31:27.902334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:35.043553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149263+0000","last_change":"2024-08-28T19:29:48.132429+0000","last_active":"2024-08-28T19:31:56.149263+0000","last_peered":"2024-08-28T19:31:56.149263+0000","last_clean":"2024-08-28T19:31:56.149263+0000","last_became_active":"2024-08-28T19:29:48.132020+0000","last_became_peered":"2024-08-28T19:29:48.132020+0000","last_unstale":"2024-08-28T19:31:56.149263+0000","last_undegraded":"2024-08-28T19:31:56.149263+0000","last_fullsized":"2024-08-28T19:31:56.149263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:45:11.992083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007247+0000","last_change":"2024-08-28T19:29:46.097245+0000","last_active":"2024-08-28T19:31:28.007247+0000","last_peered":"2024-08-28T19:31:28.007247+0000","last_clean":"2024-08-28T19:31:28.007247+0000","last_became_active":"2024-08-28T19:29:46.096867+0000","last_became_peered":"2024-08-28T19:29:46.096867+0000","last_unstale":"2024-08-28T19:31:28.007247+0000","last_undegraded":"2024-08-28T19:31:28.007247+0000","last_fullsized":"2024-08-28T19:31:28.007247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:22:14.888597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895601+0000","last_change":"2024-08-28T19:29:55.265006+0000","last_active":"2024-08-28T19:31:27.895601+0000","last_peered":"2024-08-28T19:31:27.895601+0000","last_clean":"2024-08-28T19:31:27.895601+0000","last_became_active":"2024-08-28T19:29:55.264321+0000","last_became_peered":"2024-08-28T19:29:55.264321+0000","last_unstale":"2024-08-28T19:31:27.895601+0000","last_undegraded":"2024-08-28T19:31:27.895601+0000","last_fullsized":"2024-08-28T19:31:27.895601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:53:27.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146436+0000","last_change":"2024-08-28T19:29:48.120916+0000","last_active":"2024-08-28T19:31:56.146436+0000","last_peered":"2024-08-28T19:31:56.146436+0000","last_clean":"2024-08-28T19:31:56.146436+0000","last_became_active":"2024-08-28T19:29:48.120473+0000","last_became_peered":"2024-08-28T19:29:48.120473+0000","last_unstale":"2024-08-28T19:31:56.146436+0000","last_undegraded":"2024-08-28T19:31:56.146436+0000","last_fullsized":"2024-08-28T19:31:56.146436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:15.067237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903218+0000","last_change":"2024-08-28T19:29:46.103164+0000","last_active":"2024-08-28T19:31:27.903218+0000","last_peered":"2024-08-28T19:31:27.903218+0000","last_clean":"2024-08-28T19:31:27.903218+0000","last_became_active":"2024-08-28T19:29:46.101772+0000","last_became_peered":"2024-08-28T19:29:46.101772+0000","last_unstale":"2024-08-28T19:31:27.903218+0000","last_undegraded":"2024-08-28T19:31:27.903218+0000","last_fullsized":"2024-08-28T19:31:27.903218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:46:29.533552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902200+0000","last_change":"2024-08-28T19:30:27.550861+0000","last_active":"2024-08-28T19:31:27.902200+0000","last_peered":"2024-08-28T19:31:27.902200+0000","last_clean":"2024-08-28T19:31:27.902200+0000","last_became_active":"2024-08-28T19:30:27.550131+0000","last_became_peered":"2024-08-28T19:30:27.550131+0000","last_unstale":"2024-08-28T19:31:27.902200+0000","last_undegraded":"2024-08-28T19:31:27.902200+0000","last_fullsized":"2024-08-28T19:31:27.902200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:37:16.004222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128073+0000","last_change":"2024-08-28T19:30:27.551445+0000","last_active":"2024-08-28T19:31:56.128073+0000","last_peered":"2024-08-28T19:31:56.128073+0000","last_clean":"2024-08-28T19:31:56.128073+0000","last_became_active":"2024-08-28T19:30:27.550927+0000","last_became_peered":"2024-08-28T19:30:27.550927+0000","last_unstale":"2024-08-28T19:31:56.128073+0000","last_undegraded":"2024-08-28T19:31:56.128073+0000","last_fullsized":"2024-08-28T19:31:56.128073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:52:56.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.920185+0000","last_change":"2024-08-28T19:31:27.920056+0000","last_active":"2024-08-28T19:31:27.920185+0000","last_peered":"2024-08-28T19:31:27.920185+0000","last_clean":"2024-08-28T19:31:27.920185+0000","last_became_active":"2024-08-28T19:31:27.904583+0000","last_became_peered":"2024-08-28T19:31:27.904583+0000","last_unstale":"2024-08-28T19:31:27.920185+0000","last_undegraded":"2024-08-28T19:31:27.920185+0000","last_fullsized":"2024-08-28T19:31:27.920185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:35:25.188307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007217+0000","last_change":"2024-08-28T19:29:55.266777+0000","last_active":"2024-08-28T19:31:28.007217+0000","last_peered":"2024-08-28T19:31:28.007217+0000","last_clean":"2024-08-28T19:31:28.007217+0000","last_became_active":"2024-08-28T19:29:55.266296+0000","last_became_peered":"2024-08-28T19:29:55.266296+0000","last_unstale":"2024-08-28T19:31:28.007217+0000","last_undegraded":"2024-08-28T19:31:28.007217+0000","last_fullsized":"2024-08-28T19:31:28.007217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:28:20.279522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150735+0000","last_change":"2024-08-28T19:29:48.129070+0000","last_active":"2024-08-28T19:31:56.150735+0000","last_peered":"2024-08-28T19:31:56.150735+0000","last_clean":"2024-08-28T19:31:56.150735+0000","last_became_active":"2024-08-28T19:29:48.128701+0000","last_became_peered":"2024-08-28T19:29:48.128701+0000","last_unstale":"2024-08-28T19:31:56.150735+0000","last_undegraded":"2024-08-28T19:31:56.150735+0000","last_fullsized":"2024-08-28T19:31:56.150735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:29:29.375379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":169,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:23.594300+0000","last_change":"2024-08-28T19:29:46.098281+0000","last_active":"2024-08-28T19:32:23.594300+0000","last_peered":"2024-08-28T19:32:23.594300+0000","last_clean":"2024-08-28T19:32:23.594300+0000","last_became_active":"2024-08-28T19:29:46.097870+0000","last_became_peered":"2024-08-28T19:29:46.097870+0000","last_unstale":"2024-08-28T19:32:23.594300+0000","last_undegraded":"2024-08-28T19:32:23.594300+0000","last_fullsized":"2024-08-28T19:32:23.594300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:24:09.693310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894981+0000","last_change":"2024-08-28T19:29:55.264883+0000","last_active":"2024-08-28T19:31:27.894981+0000","last_peered":"2024-08-28T19:31:27.894981+0000","last_clean":"2024-08-28T19:31:27.894981+0000","last_became_active":"2024-08-28T19:29:55.264392+0000","last_became_peered":"2024-08-28T19:29:55.264392+0000","last_unstale":"2024-08-28T19:31:27.894981+0000","last_undegraded":"2024-08-28T19:31:27.894981+0000","last_fullsized":"2024-08-28T19:31:27.894981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:34.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150300+0000","last_change":"2024-08-28T19:29:48.135499+0000","last_active":"2024-08-28T19:31:56.150300+0000","last_peered":"2024-08-28T19:31:56.150300+0000","last_clean":"2024-08-28T19:31:56.150300+0000","last_became_active":"2024-08-28T19:29:48.134934+0000","last_became_peered":"2024-08-28T19:29:48.134934+0000","last_unstale":"2024-08-28T19:31:56.150300+0000","last_undegraded":"2024-08-28T19:31:56.150300+0000","last_fullsized":"2024-08-28T19:31:56.150300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:57:01.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895983+0000","last_change":"2024-08-28T19:29:46.104680+0000","last_active":"2024-08-28T19:31:27.895983+0000","last_peered":"2024-08-28T19:31:27.895983+0000","last_clean":"2024-08-28T19:31:27.895983+0000","last_became_active":"2024-08-28T19:29:46.104290+0000","last_became_peered":"2024-08-28T19:29:46.104290+0000","last_unstale":"2024-08-28T19:31:27.895983+0000","last_undegraded":"2024-08-28T19:31:27.895983+0000","last_fullsized":"2024-08-28T19:31:27.895983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:39.789935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899299+0000","last_change":"2024-08-28T19:29:55.264676+0000","last_active":"2024-08-28T19:31:27.899299+0000","last_peered":"2024-08-28T19:31:27.899299+0000","last_clean":"2024-08-28T19:31:27.899299+0000","last_became_active":"2024-08-28T19:29:55.264206+0000","last_became_peered":"2024-08-28T19:29:55.264206+0000","last_unstale":"2024-08-28T19:31:27.899299+0000","last_undegraded":"2024-08-28T19:31:27.899299+0000","last_fullsized":"2024-08-28T19:31:27.899299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:58:15.776366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149998+0000","last_change":"2024-08-28T19:29:48.125092+0000","last_active":"2024-08-28T19:31:56.149998+0000","last_peered":"2024-08-28T19:31:56.149998+0000","last_clean":"2024-08-28T19:31:56.149998+0000","last_became_active":"2024-08-28T19:29:48.124711+0000","last_became_peered":"2024-08-28T19:29:48.124711+0000","last_unstale":"2024-08-28T19:31:56.149998+0000","last_undegraded":"2024-08-28T19:31:56.149998+0000","last_fullsized":"2024-08-28T19:31:56.149998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:17:27.806368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902878+0000","last_change":"2024-08-28T19:29:46.100546+0000","last_active":"2024-08-28T19:31:27.902878+0000","last_peered":"2024-08-28T19:31:27.902878+0000","last_clean":"2024-08-28T19:31:27.902878+0000","last_became_active":"2024-08-28T19:29:46.100043+0000","last_became_peered":"2024-08-28T19:29:46.100043+0000","last_unstale":"2024-08-28T19:31:27.902878+0000","last_undegraded":"2024-08-28T19:31:27.902878+0000","last_fullsized":"2024-08-28T19:31:27.902878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:41:32.488258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896351+0000","last_change":"2024-08-28T19:29:55.265497+0000","last_active":"2024-08-28T19:31:27.896351+0000","last_peered":"2024-08-28T19:31:27.896351+0000","last_clean":"2024-08-28T19:31:27.896351+0000","last_became_active":"2024-08-28T19:29:55.264499+0000","last_became_peered":"2024-08-28T19:29:55.264499+0000","last_unstale":"2024-08-28T19:31:27.896351+0000","last_undegraded":"2024-08-28T19:31:27.896351+0000","last_fullsized":"2024-08-28T19:31:27.896351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:04:15.192307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139694+0000","last_change":"2024-08-28T19:29:48.133948+0000","last_active":"2024-08-28T19:31:56.139694+0000","last_peered":"2024-08-28T19:31:56.139694+0000","last_clean":"2024-08-28T19:31:56.139694+0000","last_became_active":"2024-08-28T19:29:48.133517+0000","last_became_peered":"2024-08-28T19:29:48.133517+0000","last_unstale":"2024-08-28T19:31:56.139694+0000","last_undegraded":"2024-08-28T19:31:56.139694+0000","last_fullsized":"2024-08-28T19:31:56.139694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:43:20.049931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'40","reported_seq":332,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:26.600683+0000","last_change":"2024-08-28T19:29:46.104744+0000","last_active":"2024-08-28T19:32:26.600683+0000","last_peered":"2024-08-28T19:32:26.600683+0000","last_clean":"2024-08-28T19:32:26.600683+0000","last_became_active":"2024-08-28T19:29:46.104278+0000","last_became_peered":"2024-08-28T19:29:46.104278+0000","last_unstale":"2024-08-28T19:32:26.600683+0000","last_undegraded":"2024-08-28T19:32:26.600683+0000","last_fullsized":"2024-08-28T19:32:26.600683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:36.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68002,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":252,"num_read_kb":194,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894437+0000","last_change":"2024-08-28T19:29:55.264892+0000","last_active":"2024-08-28T19:31:27.894437+0000","last_peered":"2024-08-28T19:31:27.894437+0000","last_clean":"2024-08-28T19:31:27.894437+0000","last_became_active":"2024-08-28T19:29:55.264466+0000","last_became_peered":"2024-08-28T19:29:55.264466+0000","last_unstale":"2024-08-28T19:31:27.894437+0000","last_undegraded":"2024-08-28T19:31:27.894437+0000","last_fullsized":"2024-08-28T19:31:27.894437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:34:51.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152034+0000","last_change":"2024-08-28T19:29:48.121692+0000","last_active":"2024-08-28T19:31:56.152034+0000","last_peered":"2024-08-28T19:31:56.152034+0000","last_clean":"2024-08-28T19:31:56.152034+0000","last_became_active":"2024-08-28T19:29:48.121274+0000","last_became_peered":"2024-08-28T19:29:48.121274+0000","last_unstale":"2024-08-28T19:31:56.152034+0000","last_undegraded":"2024-08-28T19:31:56.152034+0000","last_fullsized":"2024-08-28T19:31:56.152034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:00:36.227609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896564+0000","last_change":"2024-08-28T19:29:46.188981+0000","last_active":"2024-08-28T19:31:27.896564+0000","last_peered":"2024-08-28T19:31:27.896564+0000","last_clean":"2024-08-28T19:31:27.896564+0000","last_became_active":"2024-08-28T19:29:46.188496+0000","last_became_peered":"2024-08-28T19:29:46.188496+0000","last_unstale":"2024-08-28T19:31:27.896564+0000","last_undegraded":"2024-08-28T19:31:27.896564+0000","last_fullsized":"2024-08-28T19:31:27.896564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.689602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896238+0000","last_change":"2024-08-28T19:30:27.552006+0000","last_active":"2024-08-28T19:31:27.896238+0000","last_peered":"2024-08-28T19:31:27.896238+0000","last_clean":"2024-08-28T19:31:27.896238+0000","last_became_active":"2024-08-28T19:30:27.551356+0000","last_became_peered":"2024-08-28T19:30:27.551356+0000","last_unstale":"2024-08-28T19:31:27.896238+0000","last_undegraded":"2024-08-28T19:31:27.896238+0000","last_fullsized":"2024-08-28T19:31:27.896238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:56:09.242401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144743+0000","last_change":"2024-08-28T19:29:48.116964+0000","last_active":"2024-08-28T19:31:56.144743+0000","last_peered":"2024-08-28T19:31:56.144743+0000","last_clean":"2024-08-28T19:31:56.144743+0000","last_became_active":"2024-08-28T19:29:48.116588+0000","last_became_peered":"2024-08-28T19:29:48.116588+0000","last_unstale":"2024-08-28T19:31:56.144743+0000","last_undegraded":"2024-08-28T19:31:56.144743+0000","last_fullsized":"2024-08-28T19:31:56.144743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:52:02.486724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007960+0000","last_change":"2024-08-28T19:29:46.104132+0000","last_active":"2024-08-28T19:31:28.007960+0000","last_peered":"2024-08-28T19:31:28.007960+0000","last_clean":"2024-08-28T19:31:28.007960+0000","last_became_active":"2024-08-28T19:29:46.103725+0000","last_became_peered":"2024-08-28T19:29:46.103725+0000","last_unstale":"2024-08-28T19:31:28.007960+0000","last_undegraded":"2024-08-28T19:31:28.007960+0000","last_fullsized":"2024-08-28T19:31:28.007960+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:50:12.859989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894212+0000","last_change":"2024-08-28T19:29:55.265494+0000","last_active":"2024-08-28T19:31:27.894212+0000","last_peered":"2024-08-28T19:31:27.894212+0000","last_clean":"2024-08-28T19:31:27.894212+0000","last_became_active":"2024-08-28T19:29:55.265087+0000","last_became_peered":"2024-08-28T19:29:55.265087+0000","last_unstale":"2024-08-28T19:31:27.894212+0000","last_undegraded":"2024-08-28T19:31:27.894212+0000","last_fullsized":"2024-08-28T19:31:27.894212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:51:18.676889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152669+0000","last_change":"2024-08-28T19:29:48.127419+0000","last_active":"2024-08-28T19:31:56.152669+0000","last_peered":"2024-08-28T19:31:56.152669+0000","last_clean":"2024-08-28T19:31:56.152669+0000","last_became_active":"2024-08-28T19:29:48.126997+0000","last_became_peered":"2024-08-28T19:29:48.126997+0000","last_unstale":"2024-08-28T19:31:56.152669+0000","last_undegraded":"2024-08-28T19:31:56.152669+0000","last_fullsized":"2024-08-28T19:31:56.152669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:26:08.208724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":285,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:26.599346+0000","last_change":"2024-08-28T19:29:46.103451+0000","last_active":"2024-08-28T19:32:26.599346+0000","last_peered":"2024-08-28T19:32:26.599346+0000","last_clean":"2024-08-28T19:32:26.599346+0000","last_became_active":"2024-08-28T19:29:46.102991+0000","last_became_peered":"2024-08-28T19:29:46.102991+0000","last_unstale":"2024-08-28T19:32:26.599346+0000","last_undegraded":"2024-08-28T19:32:26.599346+0000","last_fullsized":"2024-08-28T19:32:26.599346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:55:58.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901836+0000","last_change":"2024-08-28T19:29:55.269310+0000","last_active":"2024-08-28T19:31:27.901836+0000","last_peered":"2024-08-28T19:31:27.901836+0000","last_clean":"2024-08-28T19:31:27.901836+0000","last_became_active":"2024-08-28T19:29:55.268893+0000","last_became_peered":"2024-08-28T19:29:55.268893+0000","last_unstale":"2024-08-28T19:31:27.901836+0000","last_undegraded":"2024-08-28T19:31:27.901836+0000","last_fullsized":"2024-08-28T19:31:27.901836+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:26:11.598773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902085+0000","last_change":"2024-08-28T19:29:55.261757+0000","last_active":"2024-08-28T19:31:27.902085+0000","last_peered":"2024-08-28T19:31:27.902085+0000","last_clean":"2024-08-28T19:31:27.902085+0000","last_became_active":"2024-08-28T19:29:55.261339+0000","last_became_peered":"2024-08-28T19:29:55.261339+0000","last_unstale":"2024-08-28T19:31:27.902085+0000","last_undegraded":"2024-08-28T19:31:27.902085+0000","last_fullsized":"2024-08-28T19:31:27.902085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:25:06.223029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.130201+0000","last_change":"2024-08-28T19:29:48.123097+0000","last_active":"2024-08-28T19:31:56.130201+0000","last_peered":"2024-08-28T19:31:56.130201+0000","last_clean":"2024-08-28T19:31:56.130201+0000","last_became_active":"2024-08-28T19:29:48.122718+0000","last_became_peered":"2024-08-28T19:29:48.122718+0000","last_unstale":"2024-08-28T19:31:56.130201+0000","last_undegraded":"2024-08-28T19:31:56.130201+0000","last_fullsized":"2024-08-28T19:31:56.130201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:19.530985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896115+0000","last_change":"2024-08-28T19:29:46.105516+0000","last_active":"2024-08-28T19:31:27.896115+0000","last_peered":"2024-08-28T19:31:27.896115+0000","last_clean":"2024-08-28T19:31:27.896115+0000","last_became_active":"2024-08-28T19:29:46.105030+0000","last_became_peered":"2024-08-28T19:29:46.105030+0000","last_unstale":"2024-08-28T19:31:27.896115+0000","last_undegraded":"2024-08-28T19:31:27.896115+0000","last_fullsized":"2024-08-28T19:31:27.896115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:47:02.032933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899627+0000","last_change":"2024-08-28T19:29:55.269759+0000","last_active":"2024-08-28T19:31:27.899627+0000","last_peered":"2024-08-28T19:31:27.899627+0000","last_clean":"2024-08-28T19:31:27.899627+0000","last_became_active":"2024-08-28T19:29:55.269275+0000","last_became_peered":"2024-08-28T19:29:55.269275+0000","last_unstale":"2024-08-28T19:31:27.899627+0000","last_undegraded":"2024-08-28T19:31:27.899627+0000","last_fullsized":"2024-08-28T19:31:27.899627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:45.870468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131493+0000","last_change":"2024-08-28T19:29:48.117400+0000","last_active":"2024-08-28T19:31:56.131493+0000","last_peered":"2024-08-28T19:31:56.131493+0000","last_clean":"2024-08-28T19:31:56.131493+0000","last_became_active":"2024-08-28T19:29:48.116987+0000","last_became_peered":"2024-08-28T19:29:48.116987+0000","last_unstale":"2024-08-28T19:31:56.131493+0000","last_undegraded":"2024-08-28T19:31:56.131493+0000","last_fullsized":"2024-08-28T19:31:56.131493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:43.822088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006521+0000","last_change":"2024-08-28T19:29:46.096103+0000","last_active":"2024-08-28T19:31:28.006521+0000","last_peered":"2024-08-28T19:31:28.006521+0000","last_clean":"2024-08-28T19:31:28.006521+0000","last_became_active":"2024-08-28T19:29:46.095812+0000","last_became_peered":"2024-08-28T19:29:46.095812+0000","last_unstale":"2024-08-28T19:31:28.006521+0000","last_undegraded":"2024-08-28T19:31:28.006521+0000","last_fullsized":"2024-08-28T19:31:28.006521+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:29.266636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007661+0000","last_change":"2024-08-28T19:29:46.106227+0000","last_active":"2024-08-28T19:31:28.007661+0000","last_peered":"2024-08-28T19:31:28.007661+0000","last_clean":"2024-08-28T19:31:28.007661+0000","last_became_active":"2024-08-28T19:29:46.105777+0000","last_became_peered":"2024-08-28T19:29:46.105777+0000","last_unstale":"2024-08-28T19:31:28.007661+0000","last_undegraded":"2024-08-28T19:31:28.007661+0000","last_fullsized":"2024-08-28T19:31:28.007661+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:26:14.815646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144860+0000","last_change":"2024-08-28T19:29:48.111051+0000","last_active":"2024-08-28T19:31:56.144860+0000","last_peered":"2024-08-28T19:31:56.144860+0000","last_clean":"2024-08-28T19:31:56.144860+0000","last_became_active":"2024-08-28T19:29:48.110421+0000","last_became_peered":"2024-08-28T19:29:48.110421+0000","last_unstale":"2024-08-28T19:31:56.144860+0000","last_undegraded":"2024-08-28T19:31:56.144860+0000","last_fullsized":"2024-08-28T19:31:56.144860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:19:47.765977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902359+0000","last_change":"2024-08-28T19:30:27.408829+0000","last_active":"2024-08-28T19:31:27.902359+0000","last_peered":"2024-08-28T19:31:27.902359+0000","last_clean":"2024-08-28T19:31:27.902359+0000","last_became_active":"2024-08-28T19:30:27.408298+0000","last_became_peered":"2024-08-28T19:30:27.408298+0000","last_unstale":"2024-08-28T19:31:27.902359+0000","last_undegraded":"2024-08-28T19:31:27.902359+0000","last_fullsized":"2024-08-28T19:31:27.902359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:38:58.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:25.598699+0000","last_change":"2024-08-28T19:29:46.102607+0000","last_active":"2024-08-28T19:32:25.598699+0000","last_peered":"2024-08-28T19:32:25.598699+0000","last_clean":"2024-08-28T19:32:25.598699+0000","last_became_active":"2024-08-28T19:29:46.102150+0000","last_became_peered":"2024-08-28T19:29:46.102150+0000","last_unstale":"2024-08-28T19:32:25.598699+0000","last_undegraded":"2024-08-28T19:32:25.598699+0000","last_fullsized":"2024-08-28T19:32:25.598699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:44.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128134+0000","last_change":"2024-08-28T19:29:48.121598+0000","last_active":"2024-08-28T19:31:56.128134+0000","last_peered":"2024-08-28T19:31:56.128134+0000","last_clean":"2024-08-28T19:31:56.128134+0000","last_became_active":"2024-08-28T19:29:48.121189+0000","last_became_peered":"2024-08-28T19:29:48.121189+0000","last_unstale":"2024-08-28T19:31:56.128134+0000","last_undegraded":"2024-08-28T19:31:56.128134+0000","last_fullsized":"2024-08-28T19:31:56.128134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:19:35.496859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903513+0000","last_change":"2024-08-28T19:29:55.269648+0000","last_active":"2024-08-28T19:31:27.903513+0000","last_peered":"2024-08-28T19:31:27.903513+0000","last_clean":"2024-08-28T19:31:27.903513+0000","last_became_active":"2024-08-28T19:29:55.269182+0000","last_became_peered":"2024-08-28T19:29:55.269182+0000","last_unstale":"2024-08-28T19:31:27.903513+0000","last_undegraded":"2024-08-28T19:31:27.903513+0000","last_fullsized":"2024-08-28T19:31:27.903513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:09:47.581907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146872+0000","last_change":"2024-08-28T19:29:48.117143+0000","last_active":"2024-08-28T19:31:56.146872+0000","last_peered":"2024-08-28T19:31:56.146872+0000","last_clean":"2024-08-28T19:31:56.146872+0000","last_became_active":"2024-08-28T19:29:48.116756+0000","last_became_peered":"2024-08-28T19:29:48.116756+0000","last_unstale":"2024-08-28T19:31:56.146872+0000","last_undegraded":"2024-08-28T19:31:56.146872+0000","last_fullsized":"2024-08-28T19:31:56.146872+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:03:30.736872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141006+0000","last_change":"2024-08-28T19:30:27.407218+0000","last_active":"2024-08-28T19:31:56.141006+0000","last_peered":"2024-08-28T19:31:56.141006+0000","last_clean":"2024-08-28T19:31:56.141006+0000","last_became_active":"2024-08-28T19:30:27.406769+0000","last_became_peered":"2024-08-28T19:30:27.406769+0000","last_unstale":"2024-08-28T19:31:56.141006+0000","last_undegraded":"2024-08-28T19:31:56.141006+0000","last_fullsized":"2024-08-28T19:31:56.141006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:59.946922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135902+0000","last_change":"2024-08-28T19:29:48.123969+0000","last_active":"2024-08-28T19:31:56.135902+0000","last_peered":"2024-08-28T19:31:56.135902+0000","last_clean":"2024-08-28T19:31:56.135902+0000","last_became_active":"2024-08-28T19:29:48.122534+0000","last_became_peered":"2024-08-28T19:29:48.122534+0000","last_unstale":"2024-08-28T19:31:56.135902+0000","last_undegraded":"2024-08-28T19:31:56.135902+0000","last_fullsized":"2024-08-28T19:31:56.135902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:33:56.739763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132732+0000","last_change":"2024-08-28T19:29:48.108976+0000","last_active":"2024-08-28T19:31:56.132732+0000","last_peered":"2024-08-28T19:31:56.132732+0000","last_clean":"2024-08-28T19:31:56.132732+0000","last_became_active":"2024-08-28T19:29:48.108631+0000","last_became_peered":"2024-08-28T19:29:48.108631+0000","last_unstale":"2024-08-28T19:31:56.132732+0000","last_undegraded":"2024-08-28T19:31:56.132732+0000","last_fullsized":"2024-08-28T19:31:56.132732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:08:59.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131974+0000","last_change":"2024-08-28T19:29:48.109875+0000","last_active":"2024-08-28T19:31:56.131974+0000","last_peered":"2024-08-28T19:31:56.131974+0000","last_clean":"2024-08-28T19:31:56.131974+0000","last_became_active":"2024-08-28T19:29:48.109486+0000","last_became_peered":"2024-08-28T19:29:48.109486+0000","last_unstale":"2024-08-28T19:31:56.131974+0000","last_undegraded":"2024-08-28T19:31:56.131974+0000","last_fullsized":"2024-08-28T19:31:56.131974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:02:28.365203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146393+0000","last_change":"2024-08-28T19:29:48.117237+0000","last_active":"2024-08-28T19:31:56.146393+0000","last_peered":"2024-08-28T19:31:56.146393+0000","last_clean":"2024-08-28T19:31:56.146393+0000","last_became_active":"2024-08-28T19:29:48.116799+0000","last_became_peered":"2024-08-28T19:29:48.116799+0000","last_unstale":"2024-08-28T19:31:56.146393+0000","last_undegraded":"2024-08-28T19:31:56.146393+0000","last_fullsized":"2024-08-28T19:31:56.146393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:48:12.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144924+0000","last_change":"2024-08-28T19:29:48.120522+0000","last_active":"2024-08-28T19:31:56.144924+0000","last_peered":"2024-08-28T19:31:56.144924+0000","last_clean":"2024-08-28T19:31:56.144924+0000","last_became_active":"2024-08-28T19:29:48.120150+0000","last_became_peered":"2024-08-28T19:29:48.120150+0000","last_unstale":"2024-08-28T19:31:56.144924+0000","last_undegraded":"2024-08-28T19:31:56.144924+0000","last_fullsized":"2024-08-28T19:31:56.144924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:01:00.210596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.126169+0000","last_change":"2024-08-28T19:29:48.128451+0000","last_active":"2024-08-28T19:31:56.126169+0000","last_peered":"2024-08-28T19:31:56.126169+0000","last_clean":"2024-08-28T19:31:56.126169+0000","last_became_active":"2024-08-28T19:29:48.127898+0000","last_became_peered":"2024-08-28T19:29:48.127898+0000","last_unstale":"2024-08-28T19:31:56.126169+0000","last_undegraded":"2024-08-28T19:31:56.126169+0000","last_fullsized":"2024-08-28T19:31:56.126169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:48.663999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142755+0000","last_change":"2024-08-28T19:29:48.110788+0000","last_active":"2024-08-28T19:31:56.142755+0000","last_peered":"2024-08-28T19:31:56.142755+0000","last_clean":"2024-08-28T19:31:56.142755+0000","last_became_active":"2024-08-28T19:29:48.110355+0000","last_became_peered":"2024-08-28T19:29:48.110355+0000","last_unstale":"2024-08-28T19:31:56.142755+0000","last_undegraded":"2024-08-28T19:31:56.142755+0000","last_fullsized":"2024-08-28T19:31:56.142755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:57:25.345283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141195+0000","last_change":"2024-08-28T19:29:48.129667+0000","last_active":"2024-08-28T19:31:56.141195+0000","last_peered":"2024-08-28T19:31:56.141195+0000","last_clean":"2024-08-28T19:31:56.141195+0000","last_became_active":"2024-08-28T19:29:48.128237+0000","last_became_peered":"2024-08-28T19:29:48.128237+0000","last_unstale":"2024-08-28T19:31:56.141195+0000","last_undegraded":"2024-08-28T19:31:56.141195+0000","last_fullsized":"2024-08-28T19:31:56.141195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:23:35.920353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151419+0000","last_change":"2024-08-28T19:29:48.136070+0000","last_active":"2024-08-28T19:31:56.151419+0000","last_peered":"2024-08-28T19:31:56.151419+0000","last_clean":"2024-08-28T19:31:56.151419+0000","last_became_active":"2024-08-28T19:29:48.135515+0000","last_became_peered":"2024-08-28T19:29:48.135515+0000","last_unstale":"2024-08-28T19:31:56.151419+0000","last_undegraded":"2024-08-28T19:31:56.151419+0000","last_fullsized":"2024-08-28T19:31:56.151419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:25:29.267753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150677+0000","last_change":"2024-08-28T19:29:48.128614+0000","last_active":"2024-08-28T19:31:56.150677+0000","last_peered":"2024-08-28T19:31:56.150677+0000","last_clean":"2024-08-28T19:31:56.150677+0000","last_became_active":"2024-08-28T19:29:48.128231+0000","last_became_peered":"2024-08-28T19:29:48.128231+0000","last_unstale":"2024-08-28T19:31:56.150677+0000","last_undegraded":"2024-08-28T19:31:56.150677+0000","last_fullsized":"2024-08-28T19:31:56.150677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:11:08.541435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143953+0000","last_change":"2024-08-28T19:29:48.114930+0000","last_active":"2024-08-28T19:31:56.143953+0000","last_peered":"2024-08-28T19:31:56.143953+0000","last_clean":"2024-08-28T19:31:56.143953+0000","last_became_active":"2024-08-28T19:29:48.114389+0000","last_became_peered":"2024-08-28T19:29:48.114389+0000","last_unstale":"2024-08-28T19:31:56.143953+0000","last_undegraded":"2024-08-28T19:31:56.143953+0000","last_fullsized":"2024-08-28T19:31:56.143953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:51.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141213+0000","last_change":"2024-08-28T19:29:48.125031+0000","last_active":"2024-08-28T19:31:56.141213+0000","last_peered":"2024-08-28T19:31:56.141213+0000","last_clean":"2024-08-28T19:31:56.141213+0000","last_became_active":"2024-08-28T19:29:48.124417+0000","last_became_peered":"2024-08-28T19:29:48.124417+0000","last_unstale":"2024-08-28T19:31:56.141213+0000","last_undegraded":"2024-08-28T19:31:56.141213+0000","last_fullsized":"2024-08-28T19:31:56.141213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:33:33.931496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143690+0000","last_change":"2024-08-28T19:29:48.127815+0000","last_active":"2024-08-28T19:31:56.143690+0000","last_peered":"2024-08-28T19:31:56.143690+0000","last_clean":"2024-08-28T19:31:56.143690+0000","last_became_active":"2024-08-28T19:29:48.127455+0000","last_became_peered":"2024-08-28T19:29:48.127455+0000","last_unstale":"2024-08-28T19:31:56.143690+0000","last_undegraded":"2024-08-28T19:31:56.143690+0000","last_fullsized":"2024-08-28T19:31:56.143690+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:47:23.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142376+0000","last_change":"2024-08-28T19:29:48.122105+0000","last_active":"2024-08-28T19:31:56.142376+0000","last_peered":"2024-08-28T19:31:56.142376+0000","last_clean":"2024-08-28T19:31:56.142376+0000","last_became_active":"2024-08-28T19:29:48.121546+0000","last_became_peered":"2024-08-28T19:29:48.121546+0000","last_unstale":"2024-08-28T19:31:56.142376+0000","last_undegraded":"2024-08-28T19:31:56.142376+0000","last_fullsized":"2024-08-28T19:31:56.142376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:21:00.428052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151147+0000","last_change":"2024-08-28T19:29:48.136198+0000","last_active":"2024-08-28T19:31:56.151147+0000","last_peered":"2024-08-28T19:31:56.151147+0000","last_clean":"2024-08-28T19:31:56.151147+0000","last_became_active":"2024-08-28T19:29:48.135796+0000","last_became_peered":"2024-08-28T19:29:48.135796+0000","last_unstale":"2024-08-28T19:31:56.151147+0000","last_undegraded":"2024-08-28T19:31:56.151147+0000","last_fullsized":"2024-08-28T19:31:56.151147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:05.033399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134895+0000","last_change":"2024-08-28T19:29:48.121245+0000","last_active":"2024-08-28T19:31:56.134895+0000","last_peered":"2024-08-28T19:31:56.134895+0000","last_clean":"2024-08-28T19:31:56.134895+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.134895+0000","last_undegraded":"2024-08-28T19:31:56.134895+0000","last_fullsized":"2024-08-28T19:31:56.134895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:39.936209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132329+0000","last_change":"2024-08-28T19:29:48.119198+0000","last_active":"2024-08-28T19:31:56.132329+0000","last_peered":"2024-08-28T19:31:56.132329+0000","last_clean":"2024-08-28T19:31:56.132329+0000","last_became_active":"2024-08-28T19:29:48.118744+0000","last_became_peered":"2024-08-28T19:29:48.118744+0000","last_unstale":"2024-08-28T19:31:56.132329+0000","last_undegraded":"2024-08-28T19:31:56.132329+0000","last_fullsized":"2024-08-28T19:31:56.132329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:15:35.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131834+0000","last_change":"2024-08-28T19:30:27.403790+0000","last_active":"2024-08-28T19:31:56.131834+0000","last_peered":"2024-08-28T19:31:56.131834+0000","last_clean":"2024-08-28T19:31:56.131834+0000","last_became_active":"2024-08-28T19:30:27.403279+0000","last_became_peered":"2024-08-28T19:30:27.403279+0000","last_unstale":"2024-08-28T19:31:56.131834+0000","last_undegraded":"2024-08-28T19:31:56.131834+0000","last_fullsized":"2024-08-28T19:31:56.131834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:31:54.137839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128885+0000","last_change":"2024-08-28T19:30:27.405173+0000","last_active":"2024-08-28T19:31:56.128885+0000","last_peered":"2024-08-28T19:31:56.128885+0000","last_clean":"2024-08-28T19:31:56.128885+0000","last_became_active":"2024-08-28T19:30:27.404752+0000","last_became_peered":"2024-08-28T19:30:27.404752+0000","last_unstale":"2024-08-28T19:31:56.128885+0000","last_undegraded":"2024-08-28T19:31:56.128885+0000","last_fullsized":"2024-08-28T19:31:56.128885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:16.544309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152246+0000","last_change":"2024-08-28T19:29:48.136738+0000","last_active":"2024-08-28T19:31:56.152246+0000","last_peered":"2024-08-28T19:31:56.152246+0000","last_clean":"2024-08-28T19:31:56.152246+0000","last_became_active":"2024-08-28T19:29:48.136046+0000","last_became_peered":"2024-08-28T19:29:48.136046+0000","last_unstale":"2024-08-28T19:31:56.152246+0000","last_undegraded":"2024-08-28T19:31:56.152246+0000","last_fullsized":"2024-08-28T19:31:56.152246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:43:32.905933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.127788+0000","last_change":"2024-08-28T19:29:48.127432+0000","last_active":"2024-08-28T19:31:56.127788+0000","last_peered":"2024-08-28T19:31:56.127788+0000","last_clean":"2024-08-28T19:31:56.127788+0000","last_became_active":"2024-08-28T19:29:48.126067+0000","last_became_peered":"2024-08-28T19:29:48.126067+0000","last_unstale":"2024-08-28T19:31:56.127788+0000","last_undegraded":"2024-08-28T19:31:56.127788+0000","last_fullsized":"2024-08-28T19:31:56.127788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:30:05.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152540+0000","last_change":"2024-08-28T19:29:48.121154+0000","last_active":"2024-08-28T19:31:56.152540+0000","last_peered":"2024-08-28T19:31:56.152540+0000","last_clean":"2024-08-28T19:31:56.152540+0000","last_became_active":"2024-08-28T19:29:48.120709+0000","last_became_peered":"2024-08-28T19:29:48.120709+0000","last_unstale":"2024-08-28T19:31:56.152540+0000","last_undegraded":"2024-08-28T19:31:56.152540+0000","last_fullsized":"2024-08-28T19:31:56.152540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:52.716814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144107+0000","last_change":"2024-08-28T19:29:48.127124+0000","last_active":"2024-08-28T19:31:56.144107+0000","last_peered":"2024-08-28T19:31:56.144107+0000","last_clean":"2024-08-28T19:31:56.144107+0000","last_became_active":"2024-08-28T19:29:48.126761+0000","last_became_peered":"2024-08-28T19:29:48.126761+0000","last_unstale":"2024-08-28T19:31:56.144107+0000","last_undegraded":"2024-08-28T19:31:56.144107+0000","last_fullsized":"2024-08-28T19:31:56.144107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:05:31.150472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150014+0000","last_change":"2024-08-28T19:29:48.132285+0000","last_active":"2024-08-28T19:31:56.150014+0000","last_peered":"2024-08-28T19:31:56.150014+0000","last_clean":"2024-08-28T19:31:56.150014+0000","last_became_active":"2024-08-28T19:29:48.131688+0000","last_became_peered":"2024-08-28T19:29:48.131688+0000","last_unstale":"2024-08-28T19:31:56.150014+0000","last_undegraded":"2024-08-28T19:31:56.150014+0000","last_fullsized":"2024-08-28T19:31:56.150014+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:23:08.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.124596+0000","last_change":"2024-08-28T19:29:48.126384+0000","last_active":"2024-08-28T19:31:56.124596+0000","last_peered":"2024-08-28T19:31:56.124596+0000","last_clean":"2024-08-28T19:31:56.124596+0000","last_became_active":"2024-08-28T19:29:48.125412+0000","last_became_peered":"2024-08-28T19:29:48.125412+0000","last_unstale":"2024-08-28T19:31:56.124596+0000","last_undegraded":"2024-08-28T19:31:56.124596+0000","last_fullsized":"2024-08-28T19:31:56.124596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:47:42.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125963+0000","last_change":"2024-08-28T19:29:48.114032+0000","last_active":"2024-08-28T19:31:56.125963+0000","last_peered":"2024-08-28T19:31:56.125963+0000","last_clean":"2024-08-28T19:31:56.125963+0000","last_became_active":"2024-08-28T19:29:48.113625+0000","last_became_peered":"2024-08-28T19:29:48.113625+0000","last_unstale":"2024-08-28T19:31:56.125963+0000","last_undegraded":"2024-08-28T19:31:56.125963+0000","last_fullsized":"2024-08-28T19:31:56.125963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:07:08.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131499+0000","last_change":"2024-08-28T19:29:48.124046+0000","last_active":"2024-08-28T19:31:56.131499+0000","last_peered":"2024-08-28T19:31:56.131499+0000","last_clean":"2024-08-28T19:31:56.131499+0000","last_became_active":"2024-08-28T19:29:48.123647+0000","last_became_peered":"2024-08-28T19:29:48.123647+0000","last_unstale":"2024-08-28T19:31:56.131499+0000","last_undegraded":"2024-08-28T19:31:56.131499+0000","last_fullsized":"2024-08-28T19:31:56.131499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:59.262454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148165+0000","last_change":"2024-08-28T19:29:48.121258+0000","last_active":"2024-08-28T19:31:56.148165+0000","last_peered":"2024-08-28T19:31:56.148165+0000","last_clean":"2024-08-28T19:31:56.148165+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.148165+0000","last_undegraded":"2024-08-28T19:31:56.148165+0000","last_fullsized":"2024-08-28T19:31:56.148165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:37:05.610466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.129860+0000","last_change":"2024-08-28T19:29:48.125071+0000","last_active":"2024-08-28T19:31:56.129860+0000","last_peered":"2024-08-28T19:31:56.129860+0000","last_clean":"2024-08-28T19:31:56.129860+0000","last_became_active":"2024-08-28T19:29:48.124706+0000","last_became_peered":"2024-08-28T19:29:48.124706+0000","last_unstale":"2024-08-28T19:31:56.129860+0000","last_undegraded":"2024-08-28T19:31:56.129860+0000","last_fullsized":"2024-08-28T19:31:56.129860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:39:06.460682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141807+0000","last_change":"2024-08-28T19:29:48.121905+0000","last_active":"2024-08-28T19:31:56.141807+0000","last_peered":"2024-08-28T19:31:56.141807+0000","last_clean":"2024-08-28T19:31:56.141807+0000","last_became_active":"2024-08-28T19:29:48.121045+0000","last_became_peered":"2024-08-28T19:29:48.121045+0000","last_unstale":"2024-08-28T19:31:56.141807+0000","last_undegraded":"2024-08-28T19:31:56.141807+0000","last_fullsized":"2024-08-28T19:31:56.141807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:56:58.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75796,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1233,"num_read_kb":704,"num_write":263,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":222015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246047,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776174,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":496720,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939698,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":1151734,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103224,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":500102,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299453,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":496272,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495680,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1093330,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659206,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":491510,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855436,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1019904,"data_stored":1088072,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018959,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":496424,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215188,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":491218,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":555921,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":560542,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":493498,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T19:32:28.399 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-28T19:32:28.399 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-28T19:32:28.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.545+0000 7ffbe1c25640 1 -- 172.21.15.33:0/1970897490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc102720 msgr2=0x7ffbdc102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.545+0000 7ffbe1c25640 1 --2- 172.21.15.33:0/1970897490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc102720 0x7ffbdc102b30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009900 tx=0x7ffbcc02a410 comp rx=0 tx=0).stop 2024-08-28T19:32:28.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.545+0000 7ffbe1c25640 1 -- 172.21.15.33:0/1970897490 shutdown_connections 2024-08-28T19:32:28.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.545+0000 7ffbe1c25640 1 --2- 172.21.15.33:0/1970897490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbdc1089a0 0x7ffbdc10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.545+0000 7ffbe1c25640 1 --2- 172.21.15.33:0/1970897490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbdc108050 0x7ffbdc108460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.545+0000 7ffbe1c25640 1 --2- 172.21.15.33:0/1970897490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc102720 0x7ffbdc102b30 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.545+0000 7ffbe1c25640 1 -- 172.21.15.33:0/1970897490 >> 172.21.15.33:0/1970897490 conn(0x7ffbdc0fe120 msgr2=0x7ffbdc100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:28.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.545+0000 7ffbe1c25640 1 -- 172.21.15.33:0/1970897490 shutdown_connections 2024-08-28T19:32:28.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.545+0000 7ffbe1c25640 1 -- 172.21.15.33:0/1970897490 wait complete. 2024-08-28T19:32:28.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.545+0000 7ffbe1c25640 1 Processor -- start 2024-08-28T19:32:28.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbe1c25640 1 -- start start 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbe1c25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc102720 0x7ffbdc199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbe1c25640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbdc108050 0x7ffbdc1996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbe1c25640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbdc1089a0 0x7ffbdc19e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbe1c25640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc112650 con 0x7ffbdc102720 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbe1c25640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc1124d0 con 0x7ffbdc108050 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbe1c25640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc1127d0 con 0x7ffbdc1089a0 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc102720 0x7ffbdc199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc102720 0x7ffbdc199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38892/0 (socket says 172.21.15.33:38892) 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdb7fe640 1 -- 172.21.15.33:0/931195373 learned_addr learned my addr 172.21.15.33:0/931195373 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdaffd640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbdc108050 0x7ffbdc1996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdbfff640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbdc1089a0 0x7ffbdc19e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdb7fe640 1 -- 172.21.15.33:0/931195373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbdc1089a0 msgr2=0x7ffbdc19e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdb7fe640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbdc1089a0 0x7ffbdc19e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdb7fe640 1 -- 172.21.15.33:0/931195373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbdc108050 msgr2=0x7ffbdc1996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdb7fe640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbdc108050 0x7ffbdc1996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdb7fe640 1 -- 172.21.15.33:0/931195373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc19f040 con 0x7ffbdc102720 2024-08-28T19:32:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.546+0000 7ffbdb7fe640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc102720 0x7ffbdc199110 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc005940 tx=0x7ffbcc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.547+0000 7ffbd8ff9640 1 -- 172.21.15.33:0/931195373 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc03f030 con 0x7ffbdc102720 2024-08-28T19:32:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.547+0000 7ffbd8ff9640 1 -- 172.21.15.33:0/931195373 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbcc003cb0 con 0x7ffbdc102720 2024-08-28T19:32:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.547+0000 7ffbd8ff9640 1 -- 172.21.15.33:0/931195373 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc035070 con 0x7ffbdc102720 2024-08-28T19:32:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.547+0000 7ffbe1c25640 1 -- 172.21.15.33:0/931195373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbdc19f2d0 con 0x7ffbdc102720 2024-08-28T19:32:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.547+0000 7ffbe1c25640 1 -- 172.21.15.33:0/931195373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbdc1a5ac0 con 0x7ffbdc102720 2024-08-28T19:32:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.548+0000 7ffbe1c25640 1 -- 172.21.15.33:0/931195373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbdc103990 con 0x7ffbdc102720 2024-08-28T19:32:28.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.549+0000 7ffbd8ff9640 1 -- 172.21.15.33:0/931195373 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7ffbcc042030 con 0x7ffbdc102720 2024-08-28T19:32:28.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.550+0000 7ffbd8ff9640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffbc80b4c00 0x7ffbc80b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:28.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.550+0000 7ffbd8ff9640 1 -- 172.21.15.33:0/931195373 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ffbcc106130 con 0x7ffbdc102720 2024-08-28T19:32:28.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.550+0000 7ffbdaffd640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffbc80b4c00 0x7ffbc80b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:28.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.551+0000 7ffbdaffd640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffbc80b4c00 0x7ffbc80b7110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4005fd0 tx=0x7ffbc4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.553+0000 7ffbd8ff9640 1 -- 172.21.15.33:0/931195373 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffbcc0ccdf0 con 0x7ffbdc102720 2024-08-28T19:32:28.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.736+0000 7ffbe1c25640 1 -- 172.21.15.33:0/931195373 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbdc0635a0 con 0x7ffbc80b4c00 2024-08-28T19:32:28.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.742+0000 7ffbd8ff9640 1 -- 172.21.15.33:0/931195373 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340764 (secure 0 0 0) 0x7ffbdc0635a0 con 0x7ffbc80b4c00 2024-08-28T19:32:28.746 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:28.747 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-28T19:32:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.745+0000 7ffbe1c25640 1 -- 172.21.15.33:0/931195373 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffbc80b4c00 msgr2=0x7ffbc80b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.745+0000 7ffbe1c25640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffbc80b4c00 0x7ffbc80b7110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4005fd0 tx=0x7ffbc4005850 comp rx=0 tx=0).stop 2024-08-28T19:32:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.745+0000 7ffbe1c25640 1 -- 172.21.15.33:0/931195373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc102720 msgr2=0x7ffbdc199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.745+0000 7ffbe1c25640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc102720 0x7ffbdc199110 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc005940 tx=0x7ffbcc0042f0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.746+0000 7ffbe1c25640 1 -- 172.21.15.33:0/931195373 shutdown_connections 2024-08-28T19:32:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.746+0000 7ffbe1c25640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffbc80b4c00 0x7ffbc80b7110 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.746+0000 7ffbe1c25640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffbdc1089a0 0x7ffbdc19e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.746+0000 7ffbe1c25640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbdc108050 0x7ffbdc1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.746+0000 7ffbe1c25640 1 --2- 172.21.15.33:0/931195373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc102720 0x7ffbdc199110 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:28.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.746+0000 7ffbe1c25640 1 -- 172.21.15.33:0/931195373 >> 172.21.15.33:0/931195373 conn(0x7ffbdc0fe120 msgr2=0x7ffbdc1076f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:28.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.746+0000 7ffbe1c25640 1 -- 172.21.15.33:0/931195373 shutdown_connections 2024-08-28T19:32:28.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:28.746+0000 7ffbe1c25640 1 -- 172.21.15.33:0/931195373 wait complete. 2024-08-28T19:32:28.758 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-08-28T19:32:27.763324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666398,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1314,"num_read_kb":773,"num_write":388,"num_write_kb":2310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373276,"kb_used_data":11548,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568548,"statfs":{"total":1151940427776,"available":1151558193152,"internally_reserved":0,"allocated":11825152,"data_stored":7915343,"data_compressed":463917,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5989,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":78,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003360"},"pg_stats":[{"pgid":"2.1f","version":"81'13","reported_seq":174,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:25.595830+0000","last_change":"2024-08-28T19:29:46.098343+0000","last_active":"2024-08-28T19:32:25.595830+0000","last_peered":"2024-08-28T19:32:25.595830+0000","last_clean":"2024-08-28T19:32:25.595830+0000","last_became_active":"2024-08-28T19:29:46.097974+0000","last_became_peered":"2024-08-28T19:29:46.097974+0000","last_unstale":"2024-08-28T19:32:25.595830+0000","last_undegraded":"2024-08-28T19:32:25.595830+0000","last_fullsized":"2024-08-28T19:32:25.595830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:03:11.466154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125076+0000","last_change":"2024-08-28T19:29:48.123521+0000","last_active":"2024-08-28T19:31:56.125076+0000","last_peered":"2024-08-28T19:31:56.125076+0000","last_clean":"2024-08-28T19:31:56.125076+0000","last_became_active":"2024-08-28T19:29:48.122998+0000","last_became_peered":"2024-08-28T19:29:48.122998+0000","last_unstale":"2024-08-28T19:31:56.125076+0000","last_undegraded":"2024-08-28T19:31:56.125076+0000","last_fullsized":"2024-08-28T19:31:56.125076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:33:48.413468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901815+0000","last_change":"2024-08-28T19:29:55.268086+0000","last_active":"2024-08-28T19:31:27.901815+0000","last_peered":"2024-08-28T19:31:27.901815+0000","last_clean":"2024-08-28T19:31:27.901815+0000","last_became_active":"2024-08-28T19:29:55.267411+0000","last_became_peered":"2024-08-28T19:29:55.267411+0000","last_unstale":"2024-08-28T19:31:27.901815+0000","last_undegraded":"2024-08-28T19:31:27.901815+0000","last_fullsized":"2024-08-28T19:31:27.901815+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:32:16.277295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903018+0000","last_change":"2024-08-28T19:29:46.188552+0000","last_active":"2024-08-28T19:31:27.903018+0000","last_peered":"2024-08-28T19:31:27.903018+0000","last_clean":"2024-08-28T19:31:27.903018+0000","last_became_active":"2024-08-28T19:29:46.188118+0000","last_became_peered":"2024-08-28T19:29:46.188118+0000","last_unstale":"2024-08-28T19:31:27.903018+0000","last_undegraded":"2024-08-28T19:31:27.903018+0000","last_fullsized":"2024-08-28T19:31:27.903018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:55:43.774037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148138+0000","last_change":"2024-08-28T19:29:48.118765+0000","last_active":"2024-08-28T19:31:56.148138+0000","last_peered":"2024-08-28T19:31:56.148138+0000","last_clean":"2024-08-28T19:31:56.148138+0000","last_became_active":"2024-08-28T19:29:48.118111+0000","last_became_peered":"2024-08-28T19:29:48.118111+0000","last_unstale":"2024-08-28T19:31:56.148138+0000","last_undegraded":"2024-08-28T19:31:56.148138+0000","last_fullsized":"2024-08-28T19:31:56.148138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:00:51.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895580+0000","last_change":"2024-08-28T19:29:55.262222+0000","last_active":"2024-08-28T19:31:27.895580+0000","last_peered":"2024-08-28T19:31:27.895580+0000","last_clean":"2024-08-28T19:31:27.895580+0000","last_became_active":"2024-08-28T19:29:55.260906+0000","last_became_peered":"2024-08-28T19:29:55.260906+0000","last_unstale":"2024-08-28T19:31:27.895580+0000","last_undegraded":"2024-08-28T19:31:27.895580+0000","last_fullsized":"2024-08-28T19:31:27.895580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:22:30.523609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903748+0000","last_change":"2024-08-28T19:29:46.101077+0000","last_active":"2024-08-28T19:31:27.903748+0000","last_peered":"2024-08-28T19:31:27.903748+0000","last_clean":"2024-08-28T19:31:27.903748+0000","last_became_active":"2024-08-28T19:29:46.100630+0000","last_became_peered":"2024-08-28T19:29:46.100630+0000","last_unstale":"2024-08-28T19:31:27.903748+0000","last_undegraded":"2024-08-28T19:31:27.903748+0000","last_fullsized":"2024-08-28T19:31:27.903748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:59:11.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152697+0000","last_change":"2024-08-28T19:29:48.129460+0000","last_active":"2024-08-28T19:31:56.152697+0000","last_peered":"2024-08-28T19:31:56.152697+0000","last_clean":"2024-08-28T19:31:56.152697+0000","last_became_active":"2024-08-28T19:29:48.129068+0000","last_became_peered":"2024-08-28T19:29:48.129068+0000","last_unstale":"2024-08-28T19:31:56.152697+0000","last_undegraded":"2024-08-28T19:31:56.152697+0000","last_fullsized":"2024-08-28T19:31:56.152697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:08:40.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895880+0000","last_change":"2024-08-28T19:29:55.262943+0000","last_active":"2024-08-28T19:31:27.895880+0000","last_peered":"2024-08-28T19:31:27.895880+0000","last_clean":"2024-08-28T19:31:27.895880+0000","last_became_active":"2024-08-28T19:29:55.262424+0000","last_became_peered":"2024-08-28T19:29:55.262424+0000","last_unstale":"2024-08-28T19:31:27.895880+0000","last_undegraded":"2024-08-28T19:31:27.895880+0000","last_fullsized":"2024-08-28T19:31:27.895880+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:19:40.618651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903555+0000","last_change":"2024-08-28T19:29:46.102571+0000","last_active":"2024-08-28T19:31:27.903555+0000","last_peered":"2024-08-28T19:31:27.903555+0000","last_clean":"2024-08-28T19:31:27.903555+0000","last_became_active":"2024-08-28T19:29:46.102081+0000","last_became_peered":"2024-08-28T19:29:46.102081+0000","last_unstale":"2024-08-28T19:31:27.903555+0000","last_undegraded":"2024-08-28T19:31:27.903555+0000","last_fullsized":"2024-08-28T19:31:27.903555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:46:38.266122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149393+0000","last_change":"2024-08-28T19:30:27.550413+0000","last_active":"2024-08-28T19:31:56.149393+0000","last_peered":"2024-08-28T19:31:56.149393+0000","last_clean":"2024-08-28T19:31:56.149393+0000","last_became_active":"2024-08-28T19:30:27.550002+0000","last_became_peered":"2024-08-28T19:30:27.550002+0000","last_unstale":"2024-08-28T19:31:56.149393+0000","last_undegraded":"2024-08-28T19:31:56.149393+0000","last_fullsized":"2024-08-28T19:31:56.149393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:17.519332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895637+0000","last_change":"2024-08-28T19:29:55.261930+0000","last_active":"2024-08-28T19:31:27.895637+0000","last_peered":"2024-08-28T19:31:27.895637+0000","last_clean":"2024-08-28T19:31:27.895637+0000","last_became_active":"2024-08-28T19:29:55.261208+0000","last_became_peered":"2024-08-28T19:29:55.261208+0000","last_unstale":"2024-08-28T19:31:27.895637+0000","last_undegraded":"2024-08-28T19:31:27.895637+0000","last_fullsized":"2024-08-28T19:31:27.895637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.804993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152875+0000","last_change":"2024-08-28T19:29:48.133820+0000","last_active":"2024-08-28T19:31:56.152875+0000","last_peered":"2024-08-28T19:31:56.152875+0000","last_clean":"2024-08-28T19:31:56.152875+0000","last_became_active":"2024-08-28T19:29:48.132536+0000","last_became_peered":"2024-08-28T19:29:48.132536+0000","last_unstale":"2024-08-28T19:31:56.152875+0000","last_undegraded":"2024-08-28T19:31:56.152875+0000","last_fullsized":"2024-08-28T19:31:56.152875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:15:39.779698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902841+0000","last_change":"2024-08-28T19:29:46.101206+0000","last_active":"2024-08-28T19:31:27.902841+0000","last_peered":"2024-08-28T19:31:27.902841+0000","last_clean":"2024-08-28T19:31:27.902841+0000","last_became_active":"2024-08-28T19:29:46.100801+0000","last_became_peered":"2024-08-28T19:29:46.100801+0000","last_unstale":"2024-08-28T19:31:27.902841+0000","last_undegraded":"2024-08-28T19:31:27.902841+0000","last_fullsized":"2024-08-28T19:31:27.902841+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:43:33.156203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895905+0000","last_change":"2024-08-28T19:29:55.572774+0000","last_active":"2024-08-28T19:31:27.895905+0000","last_peered":"2024-08-28T19:31:27.895905+0000","last_clean":"2024-08-28T19:31:27.895905+0000","last_became_active":"2024-08-28T19:29:55.571703+0000","last_became_peered":"2024-08-28T19:29:55.571703+0000","last_unstale":"2024-08-28T19:31:27.895905+0000","last_undegraded":"2024-08-28T19:31:27.895905+0000","last_fullsized":"2024-08-28T19:31:27.895905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:56:52.695007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131019+0000","last_change":"2024-08-28T19:29:48.127683+0000","last_active":"2024-08-28T19:31:56.131019+0000","last_peered":"2024-08-28T19:31:56.131019+0000","last_clean":"2024-08-28T19:31:56.131019+0000","last_became_active":"2024-08-28T19:29:48.127139+0000","last_became_peered":"2024-08-28T19:29:48.127139+0000","last_unstale":"2024-08-28T19:31:56.131019+0000","last_undegraded":"2024-08-28T19:31:56.131019+0000","last_fullsized":"2024-08-28T19:31:56.131019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:38:16.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902182+0000","last_change":"2024-08-28T19:29:46.103233+0000","last_active":"2024-08-28T19:31:27.902182+0000","last_peered":"2024-08-28T19:31:27.902182+0000","last_clean":"2024-08-28T19:31:27.902182+0000","last_became_active":"2024-08-28T19:29:46.102515+0000","last_became_peered":"2024-08-28T19:29:46.102515+0000","last_unstale":"2024-08-28T19:31:27.902182+0000","last_undegraded":"2024-08-28T19:31:27.902182+0000","last_fullsized":"2024-08-28T19:31:27.902182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:49:35.905893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896101+0000","last_change":"2024-08-28T19:29:55.264291+0000","last_active":"2024-08-28T19:31:27.896101+0000","last_peered":"2024-08-28T19:31:27.896101+0000","last_clean":"2024-08-28T19:31:27.896101+0000","last_became_active":"2024-08-28T19:29:55.263692+0000","last_became_peered":"2024-08-28T19:29:55.263692+0000","last_unstale":"2024-08-28T19:31:27.896101+0000","last_undegraded":"2024-08-28T19:31:27.896101+0000","last_fullsized":"2024-08-28T19:31:27.896101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:47:01.795320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.147184+0000","last_change":"2024-08-28T19:29:48.115470+0000","last_active":"2024-08-28T19:31:56.147184+0000","last_peered":"2024-08-28T19:31:56.147184+0000","last_clean":"2024-08-28T19:31:56.147184+0000","last_became_active":"2024-08-28T19:29:48.115076+0000","last_became_peered":"2024-08-28T19:29:48.115076+0000","last_unstale":"2024-08-28T19:31:56.147184+0000","last_undegraded":"2024-08-28T19:31:56.147184+0000","last_fullsized":"2024-08-28T19:31:56.147184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:32.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902180+0000","last_change":"2024-08-28T19:29:46.099970+0000","last_active":"2024-08-28T19:31:27.902180+0000","last_peered":"2024-08-28T19:31:27.902180+0000","last_clean":"2024-08-28T19:31:27.902180+0000","last_became_active":"2024-08-28T19:29:46.099661+0000","last_became_peered":"2024-08-28T19:29:46.099661+0000","last_unstale":"2024-08-28T19:31:27.902180+0000","last_undegraded":"2024-08-28T19:31:27.902180+0000","last_fullsized":"2024-08-28T19:31:27.902180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:27.430026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894683+0000","last_change":"2024-08-28T19:29:55.265983+0000","last_active":"2024-08-28T19:31:27.894683+0000","last_peered":"2024-08-28T19:31:27.894683+0000","last_clean":"2024-08-28T19:31:27.894683+0000","last_became_active":"2024-08-28T19:29:55.265464+0000","last_became_peered":"2024-08-28T19:29:55.265464+0000","last_unstale":"2024-08-28T19:31:27.894683+0000","last_undegraded":"2024-08-28T19:31:27.894683+0000","last_fullsized":"2024-08-28T19:31:27.894683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:21:42.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139931+0000","last_change":"2024-08-28T19:29:48.119545+0000","last_active":"2024-08-28T19:31:56.139931+0000","last_peered":"2024-08-28T19:31:56.139931+0000","last_clean":"2024-08-28T19:31:56.139931+0000","last_became_active":"2024-08-28T19:29:48.119128+0000","last_became_peered":"2024-08-28T19:29:48.119128+0000","last_unstale":"2024-08-28T19:31:56.139931+0000","last_undegraded":"2024-08-28T19:31:56.139931+0000","last_fullsized":"2024-08-28T19:31:56.139931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:05:31.535016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.907887+0000","last_change":"2024-08-28T19:31:27.907348+0000","last_active":"2024-08-28T19:31:27.907887+0000","last_peered":"2024-08-28T19:31:27.907887+0000","last_clean":"2024-08-28T19:31:27.907887+0000","last_became_active":"2024-08-28T19:31:27.904502+0000","last_became_peered":"2024-08-28T19:31:27.904502+0000","last_unstale":"2024-08-28T19:31:27.907887+0000","last_undegraded":"2024-08-28T19:31:27.907887+0000","last_fullsized":"2024-08-28T19:31:27.907887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:16:50.269131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895761+0000","last_change":"2024-08-28T19:29:55.573320+0000","last_active":"2024-08-28T19:31:27.895761+0000","last_peered":"2024-08-28T19:31:27.895761+0000","last_clean":"2024-08-28T19:31:27.895761+0000","last_became_active":"2024-08-28T19:29:55.572858+0000","last_became_peered":"2024-08-28T19:29:55.572858+0000","last_unstale":"2024-08-28T19:31:27.895761+0000","last_undegraded":"2024-08-28T19:31:27.895761+0000","last_fullsized":"2024-08-28T19:31:27.895761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:09:34.676911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.133571+0000","last_change":"2024-08-28T19:30:27.404918+0000","last_active":"2024-08-28T19:31:56.133571+0000","last_peered":"2024-08-28T19:31:56.133571+0000","last_clean":"2024-08-28T19:31:56.133571+0000","last_became_active":"2024-08-28T19:30:27.404495+0000","last_became_peered":"2024-08-28T19:30:27.404495+0000","last_unstale":"2024-08-28T19:31:56.133571+0000","last_undegraded":"2024-08-28T19:31:56.133571+0000","last_fullsized":"2024-08-28T19:31:56.133571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:10:12.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896122+0000","last_change":"2024-08-28T19:29:46.110683+0000","last_active":"2024-08-28T19:31:27.896122+0000","last_peered":"2024-08-28T19:31:27.896122+0000","last_clean":"2024-08-28T19:31:27.896122+0000","last_became_active":"2024-08-28T19:29:46.110324+0000","last_became_peered":"2024-08-28T19:29:46.110324+0000","last_unstale":"2024-08-28T19:31:27.896122+0000","last_undegraded":"2024-08-28T19:31:27.896122+0000","last_fullsized":"2024-08-28T19:31:27.896122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:15:47.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901834+0000","last_change":"2024-08-28T19:29:55.271035+0000","last_active":"2024-08-28T19:31:27.901834+0000","last_peered":"2024-08-28T19:31:27.901834+0000","last_clean":"2024-08-28T19:31:27.901834+0000","last_became_active":"2024-08-28T19:29:55.268465+0000","last_became_peered":"2024-08-28T19:29:55.268465+0000","last_unstale":"2024-08-28T19:31:27.901834+0000","last_undegraded":"2024-08-28T19:31:27.901834+0000","last_fullsized":"2024-08-28T19:31:27.901834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:16:17.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132232+0000","last_change":"2024-08-28T19:29:48.127225+0000","last_active":"2024-08-28T19:31:56.132232+0000","last_peered":"2024-08-28T19:31:56.132232+0000","last_clean":"2024-08-28T19:31:56.132232+0000","last_became_active":"2024-08-28T19:29:48.126775+0000","last_became_peered":"2024-08-28T19:29:48.126775+0000","last_unstale":"2024-08-28T19:31:56.132232+0000","last_undegraded":"2024-08-28T19:31:56.132232+0000","last_fullsized":"2024-08-28T19:31:56.132232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:49:39.353082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'17","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:57.503018+0000","last_change":"2024-08-28T19:29:46.098076+0000","last_active":"2024-08-28T19:31:57.503018+0000","last_peered":"2024-08-28T19:31:57.503018+0000","last_clean":"2024-08-28T19:31:57.503018+0000","last_became_active":"2024-08-28T19:29:46.097726+0000","last_became_peered":"2024-08-28T19:29:46.097726+0000","last_unstale":"2024-08-28T19:31:57.503018+0000","last_undegraded":"2024-08-28T19:31:57.503018+0000","last_fullsized":"2024-08-28T19:31:57.503018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.624125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901585+0000","last_change":"2024-08-28T19:29:55.571830+0000","last_active":"2024-08-28T19:31:27.901585+0000","last_peered":"2024-08-28T19:31:27.901585+0000","last_clean":"2024-08-28T19:31:27.901585+0000","last_became_active":"2024-08-28T19:29:55.571318+0000","last_became_peered":"2024-08-28T19:29:55.571318+0000","last_unstale":"2024-08-28T19:31:27.901585+0000","last_undegraded":"2024-08-28T19:31:27.901585+0000","last_fullsized":"2024-08-28T19:31:27.901585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:41:03.397478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135204+0000","last_change":"2024-08-28T19:29:48.124998+0000","last_active":"2024-08-28T19:31:56.135204+0000","last_peered":"2024-08-28T19:31:56.135204+0000","last_clean":"2024-08-28T19:31:56.135204+0000","last_became_active":"2024-08-28T19:29:48.124600+0000","last_became_peered":"2024-08-28T19:29:48.124600+0000","last_unstale":"2024-08-28T19:31:56.135204+0000","last_undegraded":"2024-08-28T19:31:56.135204+0000","last_fullsized":"2024-08-28T19:31:56.135204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:50:59.459372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903831+0000","last_change":"2024-08-28T19:29:46.189455+0000","last_active":"2024-08-28T19:31:27.903831+0000","last_peered":"2024-08-28T19:31:27.903831+0000","last_clean":"2024-08-28T19:31:27.903831+0000","last_became_active":"2024-08-28T19:29:46.188640+0000","last_became_peered":"2024-08-28T19:29:46.188640+0000","last_unstale":"2024-08-28T19:31:27.903831+0000","last_undegraded":"2024-08-28T19:31:27.903831+0000","last_fullsized":"2024-08-28T19:31:27.903831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:05:32.561725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899291+0000","last_change":"2024-08-28T19:29:55.269726+0000","last_active":"2024-08-28T19:31:27.899291+0000","last_peered":"2024-08-28T19:31:27.899291+0000","last_clean":"2024-08-28T19:31:27.899291+0000","last_became_active":"2024-08-28T19:29:55.269261+0000","last_became_peered":"2024-08-28T19:29:55.269261+0000","last_unstale":"2024-08-28T19:31:27.899291+0000","last_undegraded":"2024-08-28T19:31:27.899291+0000","last_fullsized":"2024-08-28T19:31:27.899291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:05.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128358+0000","last_change":"2024-08-28T19:29:48.125251+0000","last_active":"2024-08-28T19:31:56.128358+0000","last_peered":"2024-08-28T19:31:56.128358+0000","last_clean":"2024-08-28T19:31:56.128358+0000","last_became_active":"2024-08-28T19:29:48.124818+0000","last_became_peered":"2024-08-28T19:29:48.124818+0000","last_unstale":"2024-08-28T19:31:56.128358+0000","last_undegraded":"2024-08-28T19:31:56.128358+0000","last_fullsized":"2024-08-28T19:31:56.128358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:47:05.217199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894972+0000","last_change":"2024-08-28T19:29:46.189747+0000","last_active":"2024-08-28T19:31:27.894972+0000","last_peered":"2024-08-28T19:31:27.894972+0000","last_clean":"2024-08-28T19:31:27.894972+0000","last_became_active":"2024-08-28T19:29:46.189356+0000","last_became_peered":"2024-08-28T19:29:46.189356+0000","last_unstale":"2024-08-28T19:31:27.894972+0000","last_undegraded":"2024-08-28T19:31:27.894972+0000","last_fullsized":"2024-08-28T19:31:27.894972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.629054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902184+0000","last_change":"2024-08-28T19:29:55.572746+0000","last_active":"2024-08-28T19:31:27.902184+0000","last_peered":"2024-08-28T19:31:27.902184+0000","last_clean":"2024-08-28T19:31:27.902184+0000","last_became_active":"2024-08-28T19:29:55.572246+0000","last_became_peered":"2024-08-28T19:29:55.572246+0000","last_unstale":"2024-08-28T19:31:27.902184+0000","last_undegraded":"2024-08-28T19:31:27.902184+0000","last_fullsized":"2024-08-28T19:31:27.902184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:48:23.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.123589+0000","last_change":"2024-08-28T19:29:48.127579+0000","last_active":"2024-08-28T19:31:56.123589+0000","last_peered":"2024-08-28T19:31:56.123589+0000","last_clean":"2024-08-28T19:31:56.123589+0000","last_became_active":"2024-08-28T19:29:48.126978+0000","last_became_peered":"2024-08-28T19:29:48.126978+0000","last_unstale":"2024-08-28T19:31:56.123589+0000","last_undegraded":"2024-08-28T19:31:56.123589+0000","last_fullsized":"2024-08-28T19:31:56.123589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:27.657714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":163,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:23.593918+0000","last_change":"2024-08-28T19:29:46.102374+0000","last_active":"2024-08-28T19:32:23.593918+0000","last_peered":"2024-08-28T19:32:23.593918+0000","last_clean":"2024-08-28T19:32:23.593918+0000","last_became_active":"2024-08-28T19:29:46.101619+0000","last_became_peered":"2024-08-28T19:29:46.101619+0000","last_unstale":"2024-08-28T19:32:23.593918+0000","last_undegraded":"2024-08-28T19:32:23.593918+0000","last_fullsized":"2024-08-28T19:32:23.593918+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:46:21.353063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006989+0000","last_change":"2024-08-28T19:29:55.265403+0000","last_active":"2024-08-28T19:31:28.006989+0000","last_peered":"2024-08-28T19:31:28.006989+0000","last_clean":"2024-08-28T19:31:28.006989+0000","last_became_active":"2024-08-28T19:29:55.264979+0000","last_became_peered":"2024-08-28T19:29:55.264979+0000","last_unstale":"2024-08-28T19:31:28.006989+0000","last_undegraded":"2024-08-28T19:31:28.006989+0000","last_fullsized":"2024-08-28T19:31:28.006989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:18:18.623218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142841+0000","last_change":"2024-08-28T19:29:48.117437+0000","last_active":"2024-08-28T19:31:56.142841+0000","last_peered":"2024-08-28T19:31:56.142841+0000","last_clean":"2024-08-28T19:31:56.142841+0000","last_became_active":"2024-08-28T19:29:48.116379+0000","last_became_peered":"2024-08-28T19:29:48.116379+0000","last_unstale":"2024-08-28T19:31:56.142841+0000","last_undegraded":"2024-08-28T19:31:56.142841+0000","last_fullsized":"2024-08-28T19:31:56.142841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:23.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'7","reported_seq":163,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:22.592395+0000","last_change":"2024-08-28T19:29:46.188551+0000","last_active":"2024-08-28T19:32:22.592395+0000","last_peered":"2024-08-28T19:32:22.592395+0000","last_clean":"2024-08-28T19:32:22.592395+0000","last_became_active":"2024-08-28T19:29:46.188050+0000","last_became_peered":"2024-08-28T19:29:46.188050+0000","last_unstale":"2024-08-28T19:32:22.592395+0000","last_undegraded":"2024-08-28T19:32:22.592395+0000","last_fullsized":"2024-08-28T19:32:22.592395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:07:21.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007135+0000","last_change":"2024-08-28T19:29:55.572013+0000","last_active":"2024-08-28T19:31:28.007135+0000","last_peered":"2024-08-28T19:31:28.007135+0000","last_clean":"2024-08-28T19:31:28.007135+0000","last_became_active":"2024-08-28T19:29:55.571503+0000","last_became_peered":"2024-08-28T19:29:55.571503+0000","last_unstale":"2024-08-28T19:31:28.007135+0000","last_undegraded":"2024-08-28T19:31:28.007135+0000","last_fullsized":"2024-08-28T19:31:28.007135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:40:21.669321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134828+0000","last_change":"2024-08-28T19:29:48.124646+0000","last_active":"2024-08-28T19:31:56.134828+0000","last_peered":"2024-08-28T19:31:56.134828+0000","last_clean":"2024-08-28T19:31:56.134828+0000","last_became_active":"2024-08-28T19:29:48.123062+0000","last_became_peered":"2024-08-28T19:29:48.123062+0000","last_unstale":"2024-08-28T19:31:56.134828+0000","last_undegraded":"2024-08-28T19:31:56.134828+0000","last_fullsized":"2024-08-28T19:31:56.134828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:16:03.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007156+0000","last_change":"2024-08-28T19:29:46.105979+0000","last_active":"2024-08-28T19:31:28.007156+0000","last_peered":"2024-08-28T19:31:28.007156+0000","last_clean":"2024-08-28T19:31:28.007156+0000","last_became_active":"2024-08-28T19:29:46.105558+0000","last_became_peered":"2024-08-28T19:29:46.105558+0000","last_unstale":"2024-08-28T19:31:28.007156+0000","last_undegraded":"2024-08-28T19:31:28.007156+0000","last_fullsized":"2024-08-28T19:31:28.007156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:47.639236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896414+0000","last_change":"2024-08-28T19:29:55.574025+0000","last_active":"2024-08-28T19:31:27.896414+0000","last_peered":"2024-08-28T19:31:27.896414+0000","last_clean":"2024-08-28T19:31:27.896414+0000","last_became_active":"2024-08-28T19:29:55.573380+0000","last_became_peered":"2024-08-28T19:29:55.573380+0000","last_unstale":"2024-08-28T19:31:27.896414+0000","last_undegraded":"2024-08-28T19:31:27.896414+0000","last_fullsized":"2024-08-28T19:31:27.896414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:19:05.287692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.138839+0000","last_change":"2024-08-28T19:29:48.118606+0000","last_active":"2024-08-28T19:31:56.138839+0000","last_peered":"2024-08-28T19:31:56.138839+0000","last_clean":"2024-08-28T19:31:56.138839+0000","last_became_active":"2024-08-28T19:29:48.117534+0000","last_became_peered":"2024-08-28T19:29:48.117534+0000","last_unstale":"2024-08-28T19:31:56.138839+0000","last_undegraded":"2024-08-28T19:31:56.138839+0000","last_fullsized":"2024-08-28T19:31:56.138839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:34.253859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896326+0000","last_change":"2024-08-28T19:29:46.100420+0000","last_active":"2024-08-28T19:31:27.896326+0000","last_peered":"2024-08-28T19:31:27.896326+0000","last_clean":"2024-08-28T19:31:27.896326+0000","last_became_active":"2024-08-28T19:29:46.099990+0000","last_became_peered":"2024-08-28T19:29:46.099990+0000","last_unstale":"2024-08-28T19:31:27.896326+0000","last_undegraded":"2024-08-28T19:31:27.896326+0000","last_fullsized":"2024-08-28T19:31:27.896326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:42:12.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":113,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007243+0000","last_change":"2024-08-28T19:28:32.822169+0000","last_active":"2024-08-28T19:31:28.007243+0000","last_peered":"2024-08-28T19:31:28.007243+0000","last_clean":"2024-08-28T19:31:28.007243+0000","last_became_active":"2024-08-28T19:28:32.816300+0000","last_became_peered":"2024-08-28T19:28:32.816300+0000","last_unstale":"2024-08-28T19:31:28.007243+0000","last_undegraded":"2024-08-28T19:31:28.007243+0000","last_fullsized":"2024-08-28T19:31:28.007243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_clean_scrub_stamp":"2024-08-28T19:25:14.491568+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:41:37.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007780+0000","last_change":"2024-08-28T19:29:55.265437+0000","last_active":"2024-08-28T19:31:28.007780+0000","last_peered":"2024-08-28T19:31:28.007780+0000","last_clean":"2024-08-28T19:31:28.007780+0000","last_became_active":"2024-08-28T19:29:55.264818+0000","last_became_peered":"2024-08-28T19:29:55.264818+0000","last_unstale":"2024-08-28T19:31:28.007780+0000","last_undegraded":"2024-08-28T19:31:28.007780+0000","last_fullsized":"2024-08-28T19:31:28.007780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:28:18.684362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152410+0000","last_change":"2024-08-28T19:29:48.135800+0000","last_active":"2024-08-28T19:31:56.152410+0000","last_peered":"2024-08-28T19:31:56.152410+0000","last_clean":"2024-08-28T19:31:56.152410+0000","last_became_active":"2024-08-28T19:29:48.135258+0000","last_became_peered":"2024-08-28T19:29:48.135258+0000","last_unstale":"2024-08-28T19:31:56.152410+0000","last_undegraded":"2024-08-28T19:31:56.152410+0000","last_fullsized":"2024-08-28T19:31:56.152410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:55.183190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:21.593173+0000","last_change":"2024-08-28T19:29:46.189298+0000","last_active":"2024-08-28T19:32:21.593173+0000","last_peered":"2024-08-28T19:32:21.593173+0000","last_clean":"2024-08-28T19:32:21.593173+0000","last_became_active":"2024-08-28T19:29:46.188813+0000","last_became_peered":"2024-08-28T19:29:46.188813+0000","last_unstale":"2024-08-28T19:32:21.593173+0000","last_undegraded":"2024-08-28T19:32:21.593173+0000","last_fullsized":"2024-08-28T19:32:21.593173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:14:00.961682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899863+0000","last_change":"2024-08-28T19:29:55.269495+0000","last_active":"2024-08-28T19:31:27.899863+0000","last_peered":"2024-08-28T19:31:27.899863+0000","last_clean":"2024-08-28T19:31:27.899863+0000","last_became_active":"2024-08-28T19:29:55.268916+0000","last_became_peered":"2024-08-28T19:29:55.268916+0000","last_unstale":"2024-08-28T19:31:27.899863+0000","last_undegraded":"2024-08-28T19:31:27.899863+0000","last_fullsized":"2024-08-28T19:31:27.899863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:26:53.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143974+0000","last_change":"2024-08-28T19:29:48.127588+0000","last_active":"2024-08-28T19:31:56.143974+0000","last_peered":"2024-08-28T19:31:56.143974+0000","last_clean":"2024-08-28T19:31:56.143974+0000","last_became_active":"2024-08-28T19:29:48.127200+0000","last_became_peered":"2024-08-28T19:29:48.127200+0000","last_unstale":"2024-08-28T19:31:56.143974+0000","last_undegraded":"2024-08-28T19:31:56.143974+0000","last_fullsized":"2024-08-28T19:31:56.143974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:30:30.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896631+0000","last_change":"2024-08-28T19:29:46.101010+0000","last_active":"2024-08-28T19:31:27.896631+0000","last_peered":"2024-08-28T19:31:27.896631+0000","last_clean":"2024-08-28T19:31:27.896631+0000","last_became_active":"2024-08-28T19:29:46.100082+0000","last_became_peered":"2024-08-28T19:29:46.100082+0000","last_unstale":"2024-08-28T19:31:27.896631+0000","last_undegraded":"2024-08-28T19:31:27.896631+0000","last_fullsized":"2024-08-28T19:31:27.896631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:18:51.074343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902334+0000","last_change":"2024-08-28T19:30:27.551743+0000","last_active":"2024-08-28T19:31:27.902334+0000","last_peered":"2024-08-28T19:31:27.902334+0000","last_clean":"2024-08-28T19:31:27.902334+0000","last_became_active":"2024-08-28T19:30:27.551249+0000","last_became_peered":"2024-08-28T19:30:27.551249+0000","last_unstale":"2024-08-28T19:31:27.902334+0000","last_undegraded":"2024-08-28T19:31:27.902334+0000","last_fullsized":"2024-08-28T19:31:27.902334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:35.043553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149263+0000","last_change":"2024-08-28T19:29:48.132429+0000","last_active":"2024-08-28T19:31:56.149263+0000","last_peered":"2024-08-28T19:31:56.149263+0000","last_clean":"2024-08-28T19:31:56.149263+0000","last_became_active":"2024-08-28T19:29:48.132020+0000","last_became_peered":"2024-08-28T19:29:48.132020+0000","last_unstale":"2024-08-28T19:31:56.149263+0000","last_undegraded":"2024-08-28T19:31:56.149263+0000","last_fullsized":"2024-08-28T19:31:56.149263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:45:11.992083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007247+0000","last_change":"2024-08-28T19:29:46.097245+0000","last_active":"2024-08-28T19:31:28.007247+0000","last_peered":"2024-08-28T19:31:28.007247+0000","last_clean":"2024-08-28T19:31:28.007247+0000","last_became_active":"2024-08-28T19:29:46.096867+0000","last_became_peered":"2024-08-28T19:29:46.096867+0000","last_unstale":"2024-08-28T19:31:28.007247+0000","last_undegraded":"2024-08-28T19:31:28.007247+0000","last_fullsized":"2024-08-28T19:31:28.007247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:22:14.888597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895601+0000","last_change":"2024-08-28T19:29:55.265006+0000","last_active":"2024-08-28T19:31:27.895601+0000","last_peered":"2024-08-28T19:31:27.895601+0000","last_clean":"2024-08-28T19:31:27.895601+0000","last_became_active":"2024-08-28T19:29:55.264321+0000","last_became_peered":"2024-08-28T19:29:55.264321+0000","last_unstale":"2024-08-28T19:31:27.895601+0000","last_undegraded":"2024-08-28T19:31:27.895601+0000","last_fullsized":"2024-08-28T19:31:27.895601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:53:27.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146436+0000","last_change":"2024-08-28T19:29:48.120916+0000","last_active":"2024-08-28T19:31:56.146436+0000","last_peered":"2024-08-28T19:31:56.146436+0000","last_clean":"2024-08-28T19:31:56.146436+0000","last_became_active":"2024-08-28T19:29:48.120473+0000","last_became_peered":"2024-08-28T19:29:48.120473+0000","last_unstale":"2024-08-28T19:31:56.146436+0000","last_undegraded":"2024-08-28T19:31:56.146436+0000","last_fullsized":"2024-08-28T19:31:56.146436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:15.067237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903218+0000","last_change":"2024-08-28T19:29:46.103164+0000","last_active":"2024-08-28T19:31:27.903218+0000","last_peered":"2024-08-28T19:31:27.903218+0000","last_clean":"2024-08-28T19:31:27.903218+0000","last_became_active":"2024-08-28T19:29:46.101772+0000","last_became_peered":"2024-08-28T19:29:46.101772+0000","last_unstale":"2024-08-28T19:31:27.903218+0000","last_undegraded":"2024-08-28T19:31:27.903218+0000","last_fullsized":"2024-08-28T19:31:27.903218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:46:29.533552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902200+0000","last_change":"2024-08-28T19:30:27.550861+0000","last_active":"2024-08-28T19:31:27.902200+0000","last_peered":"2024-08-28T19:31:27.902200+0000","last_clean":"2024-08-28T19:31:27.902200+0000","last_became_active":"2024-08-28T19:30:27.550131+0000","last_became_peered":"2024-08-28T19:30:27.550131+0000","last_unstale":"2024-08-28T19:31:27.902200+0000","last_undegraded":"2024-08-28T19:31:27.902200+0000","last_fullsized":"2024-08-28T19:31:27.902200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:37:16.004222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128073+0000","last_change":"2024-08-28T19:30:27.551445+0000","last_active":"2024-08-28T19:31:56.128073+0000","last_peered":"2024-08-28T19:31:56.128073+0000","last_clean":"2024-08-28T19:31:56.128073+0000","last_became_active":"2024-08-28T19:30:27.550927+0000","last_became_peered":"2024-08-28T19:30:27.550927+0000","last_unstale":"2024-08-28T19:31:56.128073+0000","last_undegraded":"2024-08-28T19:31:56.128073+0000","last_fullsized":"2024-08-28T19:31:56.128073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:52:56.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.920185+0000","last_change":"2024-08-28T19:31:27.920056+0000","last_active":"2024-08-28T19:31:27.920185+0000","last_peered":"2024-08-28T19:31:27.920185+0000","last_clean":"2024-08-28T19:31:27.920185+0000","last_became_active":"2024-08-28T19:31:27.904583+0000","last_became_peered":"2024-08-28T19:31:27.904583+0000","last_unstale":"2024-08-28T19:31:27.920185+0000","last_undegraded":"2024-08-28T19:31:27.920185+0000","last_fullsized":"2024-08-28T19:31:27.920185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:35:25.188307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007217+0000","last_change":"2024-08-28T19:29:55.266777+0000","last_active":"2024-08-28T19:31:28.007217+0000","last_peered":"2024-08-28T19:31:28.007217+0000","last_clean":"2024-08-28T19:31:28.007217+0000","last_became_active":"2024-08-28T19:29:55.266296+0000","last_became_peered":"2024-08-28T19:29:55.266296+0000","last_unstale":"2024-08-28T19:31:28.007217+0000","last_undegraded":"2024-08-28T19:31:28.007217+0000","last_fullsized":"2024-08-28T19:31:28.007217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:28:20.279522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150735+0000","last_change":"2024-08-28T19:29:48.129070+0000","last_active":"2024-08-28T19:31:56.150735+0000","last_peered":"2024-08-28T19:31:56.150735+0000","last_clean":"2024-08-28T19:31:56.150735+0000","last_became_active":"2024-08-28T19:29:48.128701+0000","last_became_peered":"2024-08-28T19:29:48.128701+0000","last_unstale":"2024-08-28T19:31:56.150735+0000","last_undegraded":"2024-08-28T19:31:56.150735+0000","last_fullsized":"2024-08-28T19:31:56.150735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:29:29.375379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":169,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:23.594300+0000","last_change":"2024-08-28T19:29:46.098281+0000","last_active":"2024-08-28T19:32:23.594300+0000","last_peered":"2024-08-28T19:32:23.594300+0000","last_clean":"2024-08-28T19:32:23.594300+0000","last_became_active":"2024-08-28T19:29:46.097870+0000","last_became_peered":"2024-08-28T19:29:46.097870+0000","last_unstale":"2024-08-28T19:32:23.594300+0000","last_undegraded":"2024-08-28T19:32:23.594300+0000","last_fullsized":"2024-08-28T19:32:23.594300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:24:09.693310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894981+0000","last_change":"2024-08-28T19:29:55.264883+0000","last_active":"2024-08-28T19:31:27.894981+0000","last_peered":"2024-08-28T19:31:27.894981+0000","last_clean":"2024-08-28T19:31:27.894981+0000","last_became_active":"2024-08-28T19:29:55.264392+0000","last_became_peered":"2024-08-28T19:29:55.264392+0000","last_unstale":"2024-08-28T19:31:27.894981+0000","last_undegraded":"2024-08-28T19:31:27.894981+0000","last_fullsized":"2024-08-28T19:31:27.894981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:34.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150300+0000","last_change":"2024-08-28T19:29:48.135499+0000","last_active":"2024-08-28T19:31:56.150300+0000","last_peered":"2024-08-28T19:31:56.150300+0000","last_clean":"2024-08-28T19:31:56.150300+0000","last_became_active":"2024-08-28T19:29:48.134934+0000","last_became_peered":"2024-08-28T19:29:48.134934+0000","last_unstale":"2024-08-28T19:31:56.150300+0000","last_undegraded":"2024-08-28T19:31:56.150300+0000","last_fullsized":"2024-08-28T19:31:56.150300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:57:01.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895983+0000","last_change":"2024-08-28T19:29:46.104680+0000","last_active":"2024-08-28T19:31:27.895983+0000","last_peered":"2024-08-28T19:31:27.895983+0000","last_clean":"2024-08-28T19:31:27.895983+0000","last_became_active":"2024-08-28T19:29:46.104290+0000","last_became_peered":"2024-08-28T19:29:46.104290+0000","last_unstale":"2024-08-28T19:31:27.895983+0000","last_undegraded":"2024-08-28T19:31:27.895983+0000","last_fullsized":"2024-08-28T19:31:27.895983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:39.789935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899299+0000","last_change":"2024-08-28T19:29:55.264676+0000","last_active":"2024-08-28T19:31:27.899299+0000","last_peered":"2024-08-28T19:31:27.899299+0000","last_clean":"2024-08-28T19:31:27.899299+0000","last_became_active":"2024-08-28T19:29:55.264206+0000","last_became_peered":"2024-08-28T19:29:55.264206+0000","last_unstale":"2024-08-28T19:31:27.899299+0000","last_undegraded":"2024-08-28T19:31:27.899299+0000","last_fullsized":"2024-08-28T19:31:27.899299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:58:15.776366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149998+0000","last_change":"2024-08-28T19:29:48.125092+0000","last_active":"2024-08-28T19:31:56.149998+0000","last_peered":"2024-08-28T19:31:56.149998+0000","last_clean":"2024-08-28T19:31:56.149998+0000","last_became_active":"2024-08-28T19:29:48.124711+0000","last_became_peered":"2024-08-28T19:29:48.124711+0000","last_unstale":"2024-08-28T19:31:56.149998+0000","last_undegraded":"2024-08-28T19:31:56.149998+0000","last_fullsized":"2024-08-28T19:31:56.149998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:17:27.806368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902878+0000","last_change":"2024-08-28T19:29:46.100546+0000","last_active":"2024-08-28T19:31:27.902878+0000","last_peered":"2024-08-28T19:31:27.902878+0000","last_clean":"2024-08-28T19:31:27.902878+0000","last_became_active":"2024-08-28T19:29:46.100043+0000","last_became_peered":"2024-08-28T19:29:46.100043+0000","last_unstale":"2024-08-28T19:31:27.902878+0000","last_undegraded":"2024-08-28T19:31:27.902878+0000","last_fullsized":"2024-08-28T19:31:27.902878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:41:32.488258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896351+0000","last_change":"2024-08-28T19:29:55.265497+0000","last_active":"2024-08-28T19:31:27.896351+0000","last_peered":"2024-08-28T19:31:27.896351+0000","last_clean":"2024-08-28T19:31:27.896351+0000","last_became_active":"2024-08-28T19:29:55.264499+0000","last_became_peered":"2024-08-28T19:29:55.264499+0000","last_unstale":"2024-08-28T19:31:27.896351+0000","last_undegraded":"2024-08-28T19:31:27.896351+0000","last_fullsized":"2024-08-28T19:31:27.896351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:04:15.192307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139694+0000","last_change":"2024-08-28T19:29:48.133948+0000","last_active":"2024-08-28T19:31:56.139694+0000","last_peered":"2024-08-28T19:31:56.139694+0000","last_clean":"2024-08-28T19:31:56.139694+0000","last_became_active":"2024-08-28T19:29:48.133517+0000","last_became_peered":"2024-08-28T19:29:48.133517+0000","last_unstale":"2024-08-28T19:31:56.139694+0000","last_undegraded":"2024-08-28T19:31:56.139694+0000","last_fullsized":"2024-08-28T19:31:56.139694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:43:20.049931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'40","reported_seq":332,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:26.600683+0000","last_change":"2024-08-28T19:29:46.104744+0000","last_active":"2024-08-28T19:32:26.600683+0000","last_peered":"2024-08-28T19:32:26.600683+0000","last_clean":"2024-08-28T19:32:26.600683+0000","last_became_active":"2024-08-28T19:29:46.104278+0000","last_became_peered":"2024-08-28T19:29:46.104278+0000","last_unstale":"2024-08-28T19:32:26.600683+0000","last_undegraded":"2024-08-28T19:32:26.600683+0000","last_fullsized":"2024-08-28T19:32:26.600683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:36.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68002,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":252,"num_read_kb":194,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894437+0000","last_change":"2024-08-28T19:29:55.264892+0000","last_active":"2024-08-28T19:31:27.894437+0000","last_peered":"2024-08-28T19:31:27.894437+0000","last_clean":"2024-08-28T19:31:27.894437+0000","last_became_active":"2024-08-28T19:29:55.264466+0000","last_became_peered":"2024-08-28T19:29:55.264466+0000","last_unstale":"2024-08-28T19:31:27.894437+0000","last_undegraded":"2024-08-28T19:31:27.894437+0000","last_fullsized":"2024-08-28T19:31:27.894437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:34:51.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152034+0000","last_change":"2024-08-28T19:29:48.121692+0000","last_active":"2024-08-28T19:31:56.152034+0000","last_peered":"2024-08-28T19:31:56.152034+0000","last_clean":"2024-08-28T19:31:56.152034+0000","last_became_active":"2024-08-28T19:29:48.121274+0000","last_became_peered":"2024-08-28T19:29:48.121274+0000","last_unstale":"2024-08-28T19:31:56.152034+0000","last_undegraded":"2024-08-28T19:31:56.152034+0000","last_fullsized":"2024-08-28T19:31:56.152034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:00:36.227609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896564+0000","last_change":"2024-08-28T19:29:46.188981+0000","last_active":"2024-08-28T19:31:27.896564+0000","last_peered":"2024-08-28T19:31:27.896564+0000","last_clean":"2024-08-28T19:31:27.896564+0000","last_became_active":"2024-08-28T19:29:46.188496+0000","last_became_peered":"2024-08-28T19:29:46.188496+0000","last_unstale":"2024-08-28T19:31:27.896564+0000","last_undegraded":"2024-08-28T19:31:27.896564+0000","last_fullsized":"2024-08-28T19:31:27.896564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.689602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896238+0000","last_change":"2024-08-28T19:30:27.552006+0000","last_active":"2024-08-28T19:31:27.896238+0000","last_peered":"2024-08-28T19:31:27.896238+0000","last_clean":"2024-08-28T19:31:27.896238+0000","last_became_active":"2024-08-28T19:30:27.551356+0000","last_became_peered":"2024-08-28T19:30:27.551356+0000","last_unstale":"2024-08-28T19:31:27.896238+0000","last_undegraded":"2024-08-28T19:31:27.896238+0000","last_fullsized":"2024-08-28T19:31:27.896238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:56:09.242401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144743+0000","last_change":"2024-08-28T19:29:48.116964+0000","last_active":"2024-08-28T19:31:56.144743+0000","last_peered":"2024-08-28T19:31:56.144743+0000","last_clean":"2024-08-28T19:31:56.144743+0000","last_became_active":"2024-08-28T19:29:48.116588+0000","last_became_peered":"2024-08-28T19:29:48.116588+0000","last_unstale":"2024-08-28T19:31:56.144743+0000","last_undegraded":"2024-08-28T19:31:56.144743+0000","last_fullsized":"2024-08-28T19:31:56.144743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:52:02.486724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007960+0000","last_change":"2024-08-28T19:29:46.104132+0000","last_active":"2024-08-28T19:31:28.007960+0000","last_peered":"2024-08-28T19:31:28.007960+0000","last_clean":"2024-08-28T19:31:28.007960+0000","last_became_active":"2024-08-28T19:29:46.103725+0000","last_became_peered":"2024-08-28T19:29:46.103725+0000","last_unstale":"2024-08-28T19:31:28.007960+0000","last_undegraded":"2024-08-28T19:31:28.007960+0000","last_fullsized":"2024-08-28T19:31:28.007960+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:50:12.859989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894212+0000","last_change":"2024-08-28T19:29:55.265494+0000","last_active":"2024-08-28T19:31:27.894212+0000","last_peered":"2024-08-28T19:31:27.894212+0000","last_clean":"2024-08-28T19:31:27.894212+0000","last_became_active":"2024-08-28T19:29:55.265087+0000","last_became_peered":"2024-08-28T19:29:55.265087+0000","last_unstale":"2024-08-28T19:31:27.894212+0000","last_undegraded":"2024-08-28T19:31:27.894212+0000","last_fullsized":"2024-08-28T19:31:27.894212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:51:18.676889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152669+0000","last_change":"2024-08-28T19:29:48.127419+0000","last_active":"2024-08-28T19:31:56.152669+0000","last_peered":"2024-08-28T19:31:56.152669+0000","last_clean":"2024-08-28T19:31:56.152669+0000","last_became_active":"2024-08-28T19:29:48.126997+0000","last_became_peered":"2024-08-28T19:29:48.126997+0000","last_unstale":"2024-08-28T19:31:56.152669+0000","last_undegraded":"2024-08-28T19:31:56.152669+0000","last_fullsized":"2024-08-28T19:31:56.152669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:26:08.208724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":285,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:26.599346+0000","last_change":"2024-08-28T19:29:46.103451+0000","last_active":"2024-08-28T19:32:26.599346+0000","last_peered":"2024-08-28T19:32:26.599346+0000","last_clean":"2024-08-28T19:32:26.599346+0000","last_became_active":"2024-08-28T19:29:46.102991+0000","last_became_peered":"2024-08-28T19:29:46.102991+0000","last_unstale":"2024-08-28T19:32:26.599346+0000","last_undegraded":"2024-08-28T19:32:26.599346+0000","last_fullsized":"2024-08-28T19:32:26.599346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:55:58.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901836+0000","last_change":"2024-08-28T19:29:55.269310+0000","last_active":"2024-08-28T19:31:27.901836+0000","last_peered":"2024-08-28T19:31:27.901836+0000","last_clean":"2024-08-28T19:31:27.901836+0000","last_became_active":"2024-08-28T19:29:55.268893+0000","last_became_peered":"2024-08-28T19:29:55.268893+0000","last_unstale":"2024-08-28T19:31:27.901836+0000","last_undegraded":"2024-08-28T19:31:27.901836+0000","last_fullsized":"2024-08-28T19:31:27.901836+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:26:11.598773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902085+0000","last_change":"2024-08-28T19:29:55.261757+0000","last_active":"2024-08-28T19:31:27.902085+0000","last_peered":"2024-08-28T19:31:27.902085+0000","last_clean":"2024-08-28T19:31:27.902085+0000","last_became_active":"2024-08-28T19:29:55.261339+0000","last_became_peered":"2024-08-28T19:29:55.261339+0000","last_unstale":"2024-08-28T19:31:27.902085+0000","last_undegraded":"2024-08-28T19:31:27.902085+0000","last_fullsized":"2024-08-28T19:31:27.902085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:25:06.223029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.130201+0000","last_change":"2024-08-28T19:29:48.123097+0000","last_active":"2024-08-28T19:31:56.130201+0000","last_peered":"2024-08-28T19:31:56.130201+0000","last_clean":"2024-08-28T19:31:56.130201+0000","last_became_active":"2024-08-28T19:29:48.122718+0000","last_became_peered":"2024-08-28T19:29:48.122718+0000","last_unstale":"2024-08-28T19:31:56.130201+0000","last_undegraded":"2024-08-28T19:31:56.130201+0000","last_fullsized":"2024-08-28T19:31:56.130201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:19.530985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896115+0000","last_change":"2024-08-28T19:29:46.105516+0000","last_active":"2024-08-28T19:31:27.896115+0000","last_peered":"2024-08-28T19:31:27.896115+0000","last_clean":"2024-08-28T19:31:27.896115+0000","last_became_active":"2024-08-28T19:29:46.105030+0000","last_became_peered":"2024-08-28T19:29:46.105030+0000","last_unstale":"2024-08-28T19:31:27.896115+0000","last_undegraded":"2024-08-28T19:31:27.896115+0000","last_fullsized":"2024-08-28T19:31:27.896115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:47:02.032933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899627+0000","last_change":"2024-08-28T19:29:55.269759+0000","last_active":"2024-08-28T19:31:27.899627+0000","last_peered":"2024-08-28T19:31:27.899627+0000","last_clean":"2024-08-28T19:31:27.899627+0000","last_became_active":"2024-08-28T19:29:55.269275+0000","last_became_peered":"2024-08-28T19:29:55.269275+0000","last_unstale":"2024-08-28T19:31:27.899627+0000","last_undegraded":"2024-08-28T19:31:27.899627+0000","last_fullsized":"2024-08-28T19:31:27.899627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:45.870468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131493+0000","last_change":"2024-08-28T19:29:48.117400+0000","last_active":"2024-08-28T19:31:56.131493+0000","last_peered":"2024-08-28T19:31:56.131493+0000","last_clean":"2024-08-28T19:31:56.131493+0000","last_became_active":"2024-08-28T19:29:48.116987+0000","last_became_peered":"2024-08-28T19:29:48.116987+0000","last_unstale":"2024-08-28T19:31:56.131493+0000","last_undegraded":"2024-08-28T19:31:56.131493+0000","last_fullsized":"2024-08-28T19:31:56.131493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:43.822088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006521+0000","last_change":"2024-08-28T19:29:46.096103+0000","last_active":"2024-08-28T19:31:28.006521+0000","last_peered":"2024-08-28T19:31:28.006521+0000","last_clean":"2024-08-28T19:31:28.006521+0000","last_became_active":"2024-08-28T19:29:46.095812+0000","last_became_peered":"2024-08-28T19:29:46.095812+0000","last_unstale":"2024-08-28T19:31:28.006521+0000","last_undegraded":"2024-08-28T19:31:28.006521+0000","last_fullsized":"2024-08-28T19:31:28.006521+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:29.266636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007661+0000","last_change":"2024-08-28T19:29:46.106227+0000","last_active":"2024-08-28T19:31:28.007661+0000","last_peered":"2024-08-28T19:31:28.007661+0000","last_clean":"2024-08-28T19:31:28.007661+0000","last_became_active":"2024-08-28T19:29:46.105777+0000","last_became_peered":"2024-08-28T19:29:46.105777+0000","last_unstale":"2024-08-28T19:31:28.007661+0000","last_undegraded":"2024-08-28T19:31:28.007661+0000","last_fullsized":"2024-08-28T19:31:28.007661+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:26:14.815646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144860+0000","last_change":"2024-08-28T19:29:48.111051+0000","last_active":"2024-08-28T19:31:56.144860+0000","last_peered":"2024-08-28T19:31:56.144860+0000","last_clean":"2024-08-28T19:31:56.144860+0000","last_became_active":"2024-08-28T19:29:48.110421+0000","last_became_peered":"2024-08-28T19:29:48.110421+0000","last_unstale":"2024-08-28T19:31:56.144860+0000","last_undegraded":"2024-08-28T19:31:56.144860+0000","last_fullsized":"2024-08-28T19:31:56.144860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:19:47.765977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902359+0000","last_change":"2024-08-28T19:30:27.408829+0000","last_active":"2024-08-28T19:31:27.902359+0000","last_peered":"2024-08-28T19:31:27.902359+0000","last_clean":"2024-08-28T19:31:27.902359+0000","last_became_active":"2024-08-28T19:30:27.408298+0000","last_became_peered":"2024-08-28T19:30:27.408298+0000","last_unstale":"2024-08-28T19:31:27.902359+0000","last_undegraded":"2024-08-28T19:31:27.902359+0000","last_fullsized":"2024-08-28T19:31:27.902359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:38:58.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:25.598699+0000","last_change":"2024-08-28T19:29:46.102607+0000","last_active":"2024-08-28T19:32:25.598699+0000","last_peered":"2024-08-28T19:32:25.598699+0000","last_clean":"2024-08-28T19:32:25.598699+0000","last_became_active":"2024-08-28T19:29:46.102150+0000","last_became_peered":"2024-08-28T19:29:46.102150+0000","last_unstale":"2024-08-28T19:32:25.598699+0000","last_undegraded":"2024-08-28T19:32:25.598699+0000","last_fullsized":"2024-08-28T19:32:25.598699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:44.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128134+0000","last_change":"2024-08-28T19:29:48.121598+0000","last_active":"2024-08-28T19:31:56.128134+0000","last_peered":"2024-08-28T19:31:56.128134+0000","last_clean":"2024-08-28T19:31:56.128134+0000","last_became_active":"2024-08-28T19:29:48.121189+0000","last_became_peered":"2024-08-28T19:29:48.121189+0000","last_unstale":"2024-08-28T19:31:56.128134+0000","last_undegraded":"2024-08-28T19:31:56.128134+0000","last_fullsized":"2024-08-28T19:31:56.128134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:19:35.496859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903513+0000","last_change":"2024-08-28T19:29:55.269648+0000","last_active":"2024-08-28T19:31:27.903513+0000","last_peered":"2024-08-28T19:31:27.903513+0000","last_clean":"2024-08-28T19:31:27.903513+0000","last_became_active":"2024-08-28T19:29:55.269182+0000","last_became_peered":"2024-08-28T19:29:55.269182+0000","last_unstale":"2024-08-28T19:31:27.903513+0000","last_undegraded":"2024-08-28T19:31:27.903513+0000","last_fullsized":"2024-08-28T19:31:27.903513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:09:47.581907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146872+0000","last_change":"2024-08-28T19:29:48.117143+0000","last_active":"2024-08-28T19:31:56.146872+0000","last_peered":"2024-08-28T19:31:56.146872+0000","last_clean":"2024-08-28T19:31:56.146872+0000","last_became_active":"2024-08-28T19:29:48.116756+0000","last_became_peered":"2024-08-28T19:29:48.116756+0000","last_unstale":"2024-08-28T19:31:56.146872+0000","last_undegraded":"2024-08-28T19:31:56.146872+0000","last_fullsized":"2024-08-28T19:31:56.146872+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:03:30.736872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141006+0000","last_change":"2024-08-28T19:30:27.407218+0000","last_active":"2024-08-28T19:31:56.141006+0000","last_peered":"2024-08-28T19:31:56.141006+0000","last_clean":"2024-08-28T19:31:56.141006+0000","last_became_active":"2024-08-28T19:30:27.406769+0000","last_became_peered":"2024-08-28T19:30:27.406769+0000","last_unstale":"2024-08-28T19:31:56.141006+0000","last_undegraded":"2024-08-28T19:31:56.141006+0000","last_fullsized":"2024-08-28T19:31:56.141006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:59.946922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135902+0000","last_change":"2024-08-28T19:29:48.123969+0000","last_active":"2024-08-28T19:31:56.135902+0000","last_peered":"2024-08-28T19:31:56.135902+0000","last_clean":"2024-08-28T19:31:56.135902+0000","last_became_active":"2024-08-28T19:29:48.122534+0000","last_became_peered":"2024-08-28T19:29:48.122534+0000","last_unstale":"2024-08-28T19:31:56.135902+0000","last_undegraded":"2024-08-28T19:31:56.135902+0000","last_fullsized":"2024-08-28T19:31:56.135902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:33:56.739763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132732+0000","last_change":"2024-08-28T19:29:48.108976+0000","last_active":"2024-08-28T19:31:56.132732+0000","last_peered":"2024-08-28T19:31:56.132732+0000","last_clean":"2024-08-28T19:31:56.132732+0000","last_became_active":"2024-08-28T19:29:48.108631+0000","last_became_peered":"2024-08-28T19:29:48.108631+0000","last_unstale":"2024-08-28T19:31:56.132732+0000","last_undegraded":"2024-08-28T19:31:56.132732+0000","last_fullsized":"2024-08-28T19:31:56.132732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:08:59.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131974+0000","last_change":"2024-08-28T19:29:48.109875+0000","last_active":"2024-08-28T19:31:56.131974+0000","last_peered":"2024-08-28T19:31:56.131974+0000","last_clean":"2024-08-28T19:31:56.131974+0000","last_became_active":"2024-08-28T19:29:48.109486+0000","last_became_peered":"2024-08-28T19:29:48.109486+0000","last_unstale":"2024-08-28T19:31:56.131974+0000","last_undegraded":"2024-08-28T19:31:56.131974+0000","last_fullsized":"2024-08-28T19:31:56.131974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:02:28.365203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146393+0000","last_change":"2024-08-28T19:29:48.117237+0000","last_active":"2024-08-28T19:31:56.146393+0000","last_peered":"2024-08-28T19:31:56.146393+0000","last_clean":"2024-08-28T19:31:56.146393+0000","last_became_active":"2024-08-28T19:29:48.116799+0000","last_became_peered":"2024-08-28T19:29:48.116799+0000","last_unstale":"2024-08-28T19:31:56.146393+0000","last_undegraded":"2024-08-28T19:31:56.146393+0000","last_fullsized":"2024-08-28T19:31:56.146393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:48:12.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144924+0000","last_change":"2024-08-28T19:29:48.120522+0000","last_active":"2024-08-28T19:31:56.144924+0000","last_peered":"2024-08-28T19:31:56.144924+0000","last_clean":"2024-08-28T19:31:56.144924+0000","last_became_active":"2024-08-28T19:29:48.120150+0000","last_became_peered":"2024-08-28T19:29:48.120150+0000","last_unstale":"2024-08-28T19:31:56.144924+0000","last_undegraded":"2024-08-28T19:31:56.144924+0000","last_fullsized":"2024-08-28T19:31:56.144924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:01:00.210596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.126169+0000","last_change":"2024-08-28T19:29:48.128451+0000","last_active":"2024-08-28T19:31:56.126169+0000","last_peered":"2024-08-28T19:31:56.126169+0000","last_clean":"2024-08-28T19:31:56.126169+0000","last_became_active":"2024-08-28T19:29:48.127898+0000","last_became_peered":"2024-08-28T19:29:48.127898+0000","last_unstale":"2024-08-28T19:31:56.126169+0000","last_undegraded":"2024-08-28T19:31:56.126169+0000","last_fullsized":"2024-08-28T19:31:56.126169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:48.663999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142755+0000","last_change":"2024-08-28T19:29:48.110788+0000","last_active":"2024-08-28T19:31:56.142755+0000","last_peered":"2024-08-28T19:31:56.142755+0000","last_clean":"2024-08-28T19:31:56.142755+0000","last_became_active":"2024-08-28T19:29:48.110355+0000","last_became_peered":"2024-08-28T19:29:48.110355+0000","last_unstale":"2024-08-28T19:31:56.142755+0000","last_undegraded":"2024-08-28T19:31:56.142755+0000","last_fullsized":"2024-08-28T19:31:56.142755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:57:25.345283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141195+0000","last_change":"2024-08-28T19:29:48.129667+0000","last_active":"2024-08-28T19:31:56.141195+0000","last_peered":"2024-08-28T19:31:56.141195+0000","last_clean":"2024-08-28T19:31:56.141195+0000","last_became_active":"2024-08-28T19:29:48.128237+0000","last_became_peered":"2024-08-28T19:29:48.128237+0000","last_unstale":"2024-08-28T19:31:56.141195+0000","last_undegraded":"2024-08-28T19:31:56.141195+0000","last_fullsized":"2024-08-28T19:31:56.141195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:23:35.920353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151419+0000","last_change":"2024-08-28T19:29:48.136070+0000","last_active":"2024-08-28T19:31:56.151419+0000","last_peered":"2024-08-28T19:31:56.151419+0000","last_clean":"2024-08-28T19:31:56.151419+0000","last_became_active":"2024-08-28T19:29:48.135515+0000","last_became_peered":"2024-08-28T19:29:48.135515+0000","last_unstale":"2024-08-28T19:31:56.151419+0000","last_undegraded":"2024-08-28T19:31:56.151419+0000","last_fullsized":"2024-08-28T19:31:56.151419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:25:29.267753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150677+0000","last_change":"2024-08-28T19:29:48.128614+0000","last_active":"2024-08-28T19:31:56.150677+0000","last_peered":"2024-08-28T19:31:56.150677+0000","last_clean":"2024-08-28T19:31:56.150677+0000","last_became_active":"2024-08-28T19:29:48.128231+0000","last_became_peered":"2024-08-28T19:29:48.128231+0000","last_unstale":"2024-08-28T19:31:56.150677+0000","last_undegraded":"2024-08-28T19:31:56.150677+0000","last_fullsized":"2024-08-28T19:31:56.150677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:11:08.541435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143953+0000","last_change":"2024-08-28T19:29:48.114930+0000","last_active":"2024-08-28T19:31:56.143953+0000","last_peered":"2024-08-28T19:31:56.143953+0000","last_clean":"2024-08-28T19:31:56.143953+0000","last_became_active":"2024-08-28T19:29:48.114389+0000","last_became_peered":"2024-08-28T19:29:48.114389+0000","last_unstale":"2024-08-28T19:31:56.143953+0000","last_undegraded":"2024-08-28T19:31:56.143953+0000","last_fullsized":"2024-08-28T19:31:56.143953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:51.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141213+0000","last_change":"2024-08-28T19:29:48.125031+0000","last_active":"2024-08-28T19:31:56.141213+0000","last_peered":"2024-08-28T19:31:56.141213+0000","last_clean":"2024-08-28T19:31:56.141213+0000","last_became_active":"2024-08-28T19:29:48.124417+0000","last_became_peered":"2024-08-28T19:29:48.124417+0000","last_unstale":"2024-08-28T19:31:56.141213+0000","last_undegraded":"2024-08-28T19:31:56.141213+0000","last_fullsized":"2024-08-28T19:31:56.141213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:33:33.931496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143690+0000","last_change":"2024-08-28T19:29:48.127815+0000","last_active":"2024-08-28T19:31:56.143690+0000","last_peered":"2024-08-28T19:31:56.143690+0000","last_clean":"2024-08-28T19:31:56.143690+0000","last_became_active":"2024-08-28T19:29:48.127455+0000","last_became_peered":"2024-08-28T19:29:48.127455+0000","last_unstale":"2024-08-28T19:31:56.143690+0000","last_undegraded":"2024-08-28T19:31:56.143690+0000","last_fullsized":"2024-08-28T19:31:56.143690+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:47:23.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142376+0000","last_change":"2024-08-28T19:29:48.122105+0000","last_active":"2024-08-28T19:31:56.142376+0000","last_peered":"2024-08-28T19:31:56.142376+0000","last_clean":"2024-08-28T19:31:56.142376+0000","last_became_active":"2024-08-28T19:29:48.121546+0000","last_became_peered":"2024-08-28T19:29:48.121546+0000","last_unstale":"2024-08-28T19:31:56.142376+0000","last_undegraded":"2024-08-28T19:31:56.142376+0000","last_fullsized":"2024-08-28T19:31:56.142376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:21:00.428052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151147+0000","last_change":"2024-08-28T19:29:48.136198+0000","last_active":"2024-08-28T19:31:56.151147+0000","last_peered":"2024-08-28T19:31:56.151147+0000","last_clean":"2024-08-28T19:31:56.151147+0000","last_became_active":"2024-08-28T19:29:48.135796+0000","last_became_peered":"2024-08-28T19:29:48.135796+0000","last_unstale":"2024-08-28T19:31:56.151147+0000","last_undegraded":"2024-08-28T19:31:56.151147+0000","last_fullsized":"2024-08-28T19:31:56.151147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:05.033399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134895+0000","last_change":"2024-08-28T19:29:48.121245+0000","last_active":"2024-08-28T19:31:56.134895+0000","last_peered":"2024-08-28T19:31:56.134895+0000","last_clean":"2024-08-28T19:31:56.134895+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.134895+0000","last_undegraded":"2024-08-28T19:31:56.134895+0000","last_fullsized":"2024-08-28T19:31:56.134895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:39.936209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132329+0000","last_change":"2024-08-28T19:29:48.119198+0000","last_active":"2024-08-28T19:31:56.132329+0000","last_peered":"2024-08-28T19:31:56.132329+0000","last_clean":"2024-08-28T19:31:56.132329+0000","last_became_active":"2024-08-28T19:29:48.118744+0000","last_became_peered":"2024-08-28T19:29:48.118744+0000","last_unstale":"2024-08-28T19:31:56.132329+0000","last_undegraded":"2024-08-28T19:31:56.132329+0000","last_fullsized":"2024-08-28T19:31:56.132329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:15:35.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131834+0000","last_change":"2024-08-28T19:30:27.403790+0000","last_active":"2024-08-28T19:31:56.131834+0000","last_peered":"2024-08-28T19:31:56.131834+0000","last_clean":"2024-08-28T19:31:56.131834+0000","last_became_active":"2024-08-28T19:30:27.403279+0000","last_became_peered":"2024-08-28T19:30:27.403279+0000","last_unstale":"2024-08-28T19:31:56.131834+0000","last_undegraded":"2024-08-28T19:31:56.131834+0000","last_fullsized":"2024-08-28T19:31:56.131834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:31:54.137839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128885+0000","last_change":"2024-08-28T19:30:27.405173+0000","last_active":"2024-08-28T19:31:56.128885+0000","last_peered":"2024-08-28T19:31:56.128885+0000","last_clean":"2024-08-28T19:31:56.128885+0000","last_became_active":"2024-08-28T19:30:27.404752+0000","last_became_peered":"2024-08-28T19:30:27.404752+0000","last_unstale":"2024-08-28T19:31:56.128885+0000","last_undegraded":"2024-08-28T19:31:56.128885+0000","last_fullsized":"2024-08-28T19:31:56.128885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:16.544309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152246+0000","last_change":"2024-08-28T19:29:48.136738+0000","last_active":"2024-08-28T19:31:56.152246+0000","last_peered":"2024-08-28T19:31:56.152246+0000","last_clean":"2024-08-28T19:31:56.152246+0000","last_became_active":"2024-08-28T19:29:48.136046+0000","last_became_peered":"2024-08-28T19:29:48.136046+0000","last_unstale":"2024-08-28T19:31:56.152246+0000","last_undegraded":"2024-08-28T19:31:56.152246+0000","last_fullsized":"2024-08-28T19:31:56.152246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:43:32.905933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.127788+0000","last_change":"2024-08-28T19:29:48.127432+0000","last_active":"2024-08-28T19:31:56.127788+0000","last_peered":"2024-08-28T19:31:56.127788+0000","last_clean":"2024-08-28T19:31:56.127788+0000","last_became_active":"2024-08-28T19:29:48.126067+0000","last_became_peered":"2024-08-28T19:29:48.126067+0000","last_unstale":"2024-08-28T19:31:56.127788+0000","last_undegraded":"2024-08-28T19:31:56.127788+0000","last_fullsized":"2024-08-28T19:31:56.127788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:30:05.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152540+0000","last_change":"2024-08-28T19:29:48.121154+0000","last_active":"2024-08-28T19:31:56.152540+0000","last_peered":"2024-08-28T19:31:56.152540+0000","last_clean":"2024-08-28T19:31:56.152540+0000","last_became_active":"2024-08-28T19:29:48.120709+0000","last_became_peered":"2024-08-28T19:29:48.120709+0000","last_unstale":"2024-08-28T19:31:56.152540+0000","last_undegraded":"2024-08-28T19:31:56.152540+0000","last_fullsized":"2024-08-28T19:31:56.152540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:52.716814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144107+0000","last_change":"2024-08-28T19:29:48.127124+0000","last_active":"2024-08-28T19:31:56.144107+0000","last_peered":"2024-08-28T19:31:56.144107+0000","last_clean":"2024-08-28T19:31:56.144107+0000","last_became_active":"2024-08-28T19:29:48.126761+0000","last_became_peered":"2024-08-28T19:29:48.126761+0000","last_unstale":"2024-08-28T19:31:56.144107+0000","last_undegraded":"2024-08-28T19:31:56.144107+0000","last_fullsized":"2024-08-28T19:31:56.144107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:05:31.150472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150014+0000","last_change":"2024-08-28T19:29:48.132285+0000","last_active":"2024-08-28T19:31:56.150014+0000","last_peered":"2024-08-28T19:31:56.150014+0000","last_clean":"2024-08-28T19:31:56.150014+0000","last_became_active":"2024-08-28T19:29:48.131688+0000","last_became_peered":"2024-08-28T19:29:48.131688+0000","last_unstale":"2024-08-28T19:31:56.150014+0000","last_undegraded":"2024-08-28T19:31:56.150014+0000","last_fullsized":"2024-08-28T19:31:56.150014+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:23:08.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.124596+0000","last_change":"2024-08-28T19:29:48.126384+0000","last_active":"2024-08-28T19:31:56.124596+0000","last_peered":"2024-08-28T19:31:56.124596+0000","last_clean":"2024-08-28T19:31:56.124596+0000","last_became_active":"2024-08-28T19:29:48.125412+0000","last_became_peered":"2024-08-28T19:29:48.125412+0000","last_unstale":"2024-08-28T19:31:56.124596+0000","last_undegraded":"2024-08-28T19:31:56.124596+0000","last_fullsized":"2024-08-28T19:31:56.124596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:47:42.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125963+0000","last_change":"2024-08-28T19:29:48.114032+0000","last_active":"2024-08-28T19:31:56.125963+0000","last_peered":"2024-08-28T19:31:56.125963+0000","last_clean":"2024-08-28T19:31:56.125963+0000","last_became_active":"2024-08-28T19:29:48.113625+0000","last_became_peered":"2024-08-28T19:29:48.113625+0000","last_unstale":"2024-08-28T19:31:56.125963+0000","last_undegraded":"2024-08-28T19:31:56.125963+0000","last_fullsized":"2024-08-28T19:31:56.125963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:07:08.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131499+0000","last_change":"2024-08-28T19:29:48.124046+0000","last_active":"2024-08-28T19:31:56.131499+0000","last_peered":"2024-08-28T19:31:56.131499+0000","last_clean":"2024-08-28T19:31:56.131499+0000","last_became_active":"2024-08-28T19:29:48.123647+0000","last_became_peered":"2024-08-28T19:29:48.123647+0000","last_unstale":"2024-08-28T19:31:56.131499+0000","last_undegraded":"2024-08-28T19:31:56.131499+0000","last_fullsized":"2024-08-28T19:31:56.131499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:59.262454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148165+0000","last_change":"2024-08-28T19:29:48.121258+0000","last_active":"2024-08-28T19:31:56.148165+0000","last_peered":"2024-08-28T19:31:56.148165+0000","last_clean":"2024-08-28T19:31:56.148165+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.148165+0000","last_undegraded":"2024-08-28T19:31:56.148165+0000","last_fullsized":"2024-08-28T19:31:56.148165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:37:05.610466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.129860+0000","last_change":"2024-08-28T19:29:48.125071+0000","last_active":"2024-08-28T19:31:56.129860+0000","last_peered":"2024-08-28T19:31:56.129860+0000","last_clean":"2024-08-28T19:31:56.129860+0000","last_became_active":"2024-08-28T19:29:48.124706+0000","last_became_peered":"2024-08-28T19:29:48.124706+0000","last_unstale":"2024-08-28T19:31:56.129860+0000","last_undegraded":"2024-08-28T19:31:56.129860+0000","last_fullsized":"2024-08-28T19:31:56.129860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:39:06.460682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141807+0000","last_change":"2024-08-28T19:29:48.121905+0000","last_active":"2024-08-28T19:31:56.141807+0000","last_peered":"2024-08-28T19:31:56.141807+0000","last_clean":"2024-08-28T19:31:56.141807+0000","last_became_active":"2024-08-28T19:29:48.121045+0000","last_became_peered":"2024-08-28T19:29:48.121045+0000","last_unstale":"2024-08-28T19:31:56.141807+0000","last_undegraded":"2024-08-28T19:31:56.141807+0000","last_fullsized":"2024-08-28T19:31:56.141807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:56:58.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75796,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1233,"num_read_kb":704,"num_write":263,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":222015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246047,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776174,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":496720,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939698,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":1151734,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103224,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":500102,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299453,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":496272,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495680,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1093330,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659206,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":491510,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855436,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1019904,"data_stored":1088072,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018959,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":496424,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215188,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":491218,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":555921,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":560542,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705762,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":493498,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T19:32:28.763 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:32:29.050 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:29.437 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:29 smithi033 ceph-mon[18549]: pgmap v343: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-28T19:32:29.437 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:29 smithi033 ceph-mon[18549]: from='client.15561 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:29.437 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:29 smithi033 ceph-mon[18549]: from='client.15567 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:29.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.528+0000 7f054c256640 1 -- 172.21.15.33:0/3758058499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544103900 msgr2=0x7f0544103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:29.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.528+0000 7f054c256640 1 --2- 172.21.15.33:0/3758058499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544103900 0x7f0544103d10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0540009900 tx=0x7f054002a410 comp rx=0 tx=0).stop 2024-08-28T19:32:29.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.528+0000 7f054c256640 1 -- 172.21.15.33:0/3758058499 shutdown_connections 2024-08-28T19:32:29.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.528+0000 7f054c256640 1 --2- 172.21.15.33:0/3758058499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544109b90 0x7f05441103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.528+0000 7f054c256640 1 --2- 172.21.15.33:0/3758058499 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0544109240 0x7f0544109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.528+0000 7f054c256640 1 --2- 172.21.15.33:0/3758058499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544103900 0x7f0544103d10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.528+0000 7f054c256640 1 -- 172.21.15.33:0/3758058499 >> 172.21.15.33:0/3758058499 conn(0x7f054407b5f0 msgr2=0x7f054407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:29.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.528+0000 7f054c256640 1 -- 172.21.15.33:0/3758058499 shutdown_connections 2024-08-28T19:32:29.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.528+0000 7f054c256640 1 -- 172.21.15.33:0/3758058499 wait complete. 2024-08-28T19:32:29.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f054c256640 1 Processor -- start 2024-08-28T19:32:29.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f054c256640 1 -- start start 2024-08-28T19:32:29.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f054c256640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544103900 0x7f054419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:29.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f054c256640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0544109240 0x7f054419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:29.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f054c256640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544109b90 0x7f054419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:29.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f054c256640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0544113850 con 0x7f0544103900 2024-08-28T19:32:29.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f054c256640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f05441136d0 con 0x7f0544109b90 2024-08-28T19:32:29.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f054c256640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05441139d0 con 0x7f0544109240 2024-08-28T19:32:29.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f0549ff2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544103900 0x7f054419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f0549ff2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544103900 0x7f054419a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38908/0 (socket says 172.21.15.33:38908) 2024-08-28T19:32:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f0549ff2640 1 -- 172.21.15.33:0/3549832160 learned_addr learned my addr 172.21.15.33:0/3549832160 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f054a7f3640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544109b90 0x7f054419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.529+0000 7f05497f1640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0544109240 0x7f054419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f0549ff2640 1 -- 172.21.15.33:0/3549832160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0544109240 msgr2=0x7f054419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f0549ff2640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0544109240 0x7f054419a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f0549ff2640 1 -- 172.21.15.33:0/3549832160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544109b90 msgr2=0x7f054419fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f0549ff2640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544109b90 0x7f054419fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f0549ff2640 1 -- 172.21.15.33:0/3549832160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05441a00f0 con 0x7f0544103900 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f054a7f3640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544109b90 0x7f054419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f0549ff2640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544103900 0x7f054419a240 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0540005940 tx=0x7f05400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f053affd640 1 -- 172.21.15.33:0/3549832160 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054003f030 con 0x7f0544103900 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f053affd640 1 -- 172.21.15.33:0/3549832160 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0540003cb0 con 0x7f0544103900 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f053affd640 1 -- 172.21.15.33:0/3549832160 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540035070 con 0x7f0544103900 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f054c256640 1 -- 172.21.15.33:0/3549832160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05441a0380 con 0x7f0544103900 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.530+0000 7f054c256640 1 -- 172.21.15.33:0/3549832160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05441a0860 con 0x7f0544103900 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.531+0000 7f054c256640 1 -- 172.21.15.33:0/3549832160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0544103d10 con 0x7f0544103900 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.532+0000 7f053affd640 1 -- 172.21.15.33:0/3549832160 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f0540042030 con 0x7f0544103900 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.533+0000 7f053affd640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05300b4bb0 0x7f05300b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.533+0000 7f05497f1640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05300b4bb0 0x7f05300b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.533+0000 7f053affd640 1 -- 172.21.15.33:0/3549832160 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0540105e30 con 0x7f0544103900 2024-08-28T19:32:29.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.534+0000 7f05497f1640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05300b4bb0 0x7f05300b70c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f05441062d0 tx=0x7f0534005cc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:29.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.536+0000 7f053affd640 1 -- 172.21.15.33:0/3549832160 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f05400ccaf0 con 0x7f0544103900 2024-08-28T19:32:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.762+0000 7f054c256640 1 -- 172.21.15.33:0/3549832160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f054402e430 con 0x7f0544103900 2024-08-28T19:32:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.763+0000 7f053affd640 1 -- 172.21.15.33:0/3549832160 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f05400cc3f0 con 0x7f0544103900 2024-08-28T19:32:29.764 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:29.765 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:32:29.765 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:32:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 -- 172.21.15.33:0/3549832160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05300b4bb0 msgr2=0x7f05300b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05300b4bb0 0x7f05300b70c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f05441062d0 tx=0x7f0534005cc0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 -- 172.21.15.33:0/3549832160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544103900 msgr2=0x7f054419a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544103900 0x7f054419a240 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0540005940 tx=0x7f05400042f0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 -- 172.21.15.33:0/3549832160 shutdown_connections 2024-08-28T19:32:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544109b90 0x7f054419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05300b4bb0 0x7f05300b70c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0544109240 0x7f054419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 --2- 172.21.15.33:0/3549832160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544103900 0x7f054419a240 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:29.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 -- 172.21.15.33:0/3549832160 >> 172.21.15.33:0/3549832160 conn(0x7f054407b5f0 msgr2=0x7f05441072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:29.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 -- 172.21.15.33:0/3549832160 shutdown_connections 2024-08-28T19:32:29.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:29.766+0000 7f054c256640 1 -- 172.21.15.33:0/3549832160 wait complete. 2024-08-28T19:32:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:29 smithi059 ceph-mon[22052]: pgmap v343: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-28T19:32:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:29 smithi059 ceph-mon[22052]: from='client.15561 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:29 smithi059 ceph-mon[22052]: from='client.15567 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:29 smithi122 ceph-mon[22174]: pgmap v343: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-28T19:32:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:29 smithi122 ceph-mon[22174]: from='client.15561 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:29 smithi122 ceph-mon[22174]: from='client.15567 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:30.336 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:32:30.589 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:30.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:30 smithi033 ceph-mon[18549]: from='client.15573 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:30.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:30 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3549832160' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:30.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:30 smithi059 ceph-mon[22052]: from='client.15573 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:30.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:30 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3549832160' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:30.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:30 smithi122 ceph-mon[22174]: from='client.15573 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:30.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:30 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3549832160' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.102+0000 7ff12437c640 1 -- 172.21.15.33:0/1840229972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff11c102800 msgr2=0x7ff11c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.102+0000 7ff12437c640 1 --2- 172.21.15.33:0/1840229972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff11c102800 0x7ff11c102c10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff118009900 tx=0x7ff11802a410 comp rx=0 tx=0).stop 2024-08-28T19:32:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.102+0000 7ff12437c640 1 -- 172.21.15.33:0/1840229972 shutdown_connections 2024-08-28T19:32:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.102+0000 7ff12437c640 1 --2- 172.21.15.33:0/1840229972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11c108a90 0x7ff11c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.102+0000 7ff12437c640 1 --2- 172.21.15.33:0/1840229972 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff11c108140 0x7ff11c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.102+0000 7ff12437c640 1 --2- 172.21.15.33:0/1840229972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff11c102800 0x7ff11c102c10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.102+0000 7ff12437c640 1 -- 172.21.15.33:0/1840229972 >> 172.21.15.33:0/1840229972 conn(0x7ff11c0794d0 msgr2=0x7ff11c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.102+0000 7ff12437c640 1 -- 172.21.15.33:0/1840229972 shutdown_connections 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.102+0000 7ff12437c640 1 -- 172.21.15.33:0/1840229972 wait complete. 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff12437c640 1 Processor -- start 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff12437c640 1 -- start start 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff12437c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11c102800 0x7ff11c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff12437c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff11c108140 0x7ff11c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff12437c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff11c108a90 0x7ff11c19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff12437c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c113820 con 0x7ff11c108a90 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff12437c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c1136a0 con 0x7ff11c102800 2024-08-28T19:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff12437c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c1139a0 con 0x7ff11c108140 2024-08-28T19:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff122919640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff11c108a90 0x7ff11c19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff122919640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff11c108a90 0x7ff11c19fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38920/0 (socket says 172.21.15.33:38920) 2024-08-28T19:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.103+0000 7ff122919640 1 -- 172.21.15.33:0/1276375022 learned_addr learned my addr 172.21.15.33:0/1276375022 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff122118640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11c102800 0x7ff11c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff121917640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff11c108140 0x7ff11c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff122919640 1 -- 172.21.15.33:0/1276375022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff11c108140 msgr2=0x7ff11c19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff122919640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff11c108140 0x7ff11c19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff122919640 1 -- 172.21.15.33:0/1276375022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11c102800 msgr2=0x7ff11c19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff122919640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11c102800 0x7ff11c19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff122919640 1 -- 172.21.15.33:0/1276375022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c1a0140 con 0x7ff11c108a90 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff122118640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11c102800 0x7ff11c19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff122919640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff11c108a90 0x7ff11c19fa10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff11400eaa0 tx=0x7ff11400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff10f7fe640 1 -- 172.21.15.33:0/1276375022 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11400cdb0 con 0x7ff11c108a90 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff12437c640 1 -- 172.21.15.33:0/1276375022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c1a0430 con 0x7ff11c108a90 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff10f7fe640 1 -- 172.21.15.33:0/1276375022 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff114005020 con 0x7ff11c108a90 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff10f7fe640 1 -- 172.21.15.33:0/1276375022 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1140116d0 con 0x7ff11c108a90 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.104+0000 7ff12437c640 1 -- 172.21.15.33:0/1276375022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c1a6b90 con 0x7ff11c108a90 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.105+0000 7ff12437c640 1 -- 172.21.15.33:0/1276375022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11c102c10 con 0x7ff11c108a90 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.107+0000 7ff10f7fe640 1 -- 172.21.15.33:0/1276375022 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7ff1140051d0 con 0x7ff11c108a90 2024-08-28T19:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.108+0000 7ff10f7fe640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff1080b4b80 0x7ff1080b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.108+0000 7ff122118640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff1080b4b80 0x7ff1080b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.108+0000 7ff10f7fe640 1 -- 172.21.15.33:0/1276375022 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff1140e5c10 con 0x7ff11c108a90 2024-08-28T19:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.108+0000 7ff122118640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff1080b4b80 0x7ff1080b7090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff118031440 tx=0x7ff118009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.111+0000 7ff10f7fe640 1 -- 172.21.15.33:0/1276375022 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff114016030 con 0x7ff11c108a90 2024-08-28T19:32:31.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.301+0000 7ff12437c640 1 -- 172.21.15.33:0/1276375022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff11c19b300 con 0x7ff11c108a90 2024-08-28T19:32:31.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.302+0000 7ff10f7fe640 1 -- 172.21.15.33:0/1276375022 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25092 (secure 0 0 0) 0x7ff11c19b300 con 0x7ff11c108a90 2024-08-28T19:32:31.304 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:31.304 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:31:27.886529+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:32:31.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 -- 172.21.15.33:0/1276375022 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff1080b4b80 msgr2=0x7ff1080b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:31.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff1080b4b80 0x7ff1080b7090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff118031440 tx=0x7ff118009680 comp rx=0 tx=0).stop 2024-08-28T19:32:31.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 -- 172.21.15.33:0/1276375022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff11c108a90 msgr2=0x7ff11c19fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:31.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff11c108a90 0x7ff11c19fa10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff11400eaa0 tx=0x7ff11400ef60 comp rx=0 tx=0).stop 2024-08-28T19:32:31.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 -- 172.21.15.33:0/1276375022 shutdown_connections 2024-08-28T19:32:31.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff11c108a90 0x7ff11c19fa10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:31.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff1080b4b80 0x7ff1080b7090 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:31.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff11c108140 0x7ff11c19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:31.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 --2- 172.21.15.33:0/1276375022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff11c102800 0x7ff11c19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:31.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 -- 172.21.15.33:0/1276375022 >> 172.21.15.33:0/1276375022 conn(0x7ff11c0794d0 msgr2=0x7ff11c101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:31.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 -- 172.21.15.33:0/1276375022 shutdown_connections 2024-08-28T19:32:31.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:31.305+0000 7ff12437c640 1 -- 172.21.15.33:0/1276375022 wait complete. 2024-08-28T19:32:31.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:31 smithi033 ceph-mon[18549]: pgmap v344: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-28T19:32:31.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:31 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1276375022' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:31.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:31 smithi059 ceph-mon[22052]: pgmap v344: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-28T19:32:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:31 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1276375022' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:31 smithi122 ceph-mon[22174]: pgmap v344: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-28T19:32:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:31 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1276375022' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:32.030 DEBUG:tasks.fwd_scrub:Yielding 2024-08-28T19:32:32.031 INFO:teuthology.run_tasks:Running task exec... 2024-08-28T19:32:32.040 INFO:teuthology.task.exec:Executing custom commands... 2024-08-28T19:32:32.040 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-08-28T19:32:32.040 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-08-28T19:32:32.041 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-28T19:32:32.041 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:32:32.041 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:32:32.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.159+0000 7f82e0f92640 1 -- 172.21.15.33:0/276735064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82dc1080a0 msgr2=0x7f82dc1084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.159+0000 7f82e0f92640 1 --2- 172.21.15.33:0/276735064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82dc1080a0 0x7f82dc1084b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009900 tx=0x7f82d002a410 comp rx=0 tx=0).stop 2024-08-28T19:32:32.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.159+0000 7f82e0f92640 1 -- 172.21.15.33:0/276735064 shutdown_connections 2024-08-28T19:32:32.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.159+0000 7f82e0f92640 1 --2- 172.21.15.33:0/276735064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc1089f0 0x7f82dc10f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.159+0000 7f82e0f92640 1 --2- 172.21.15.33:0/276735064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82dc1080a0 0x7f82dc1084b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.159+0000 7f82e0f92640 1 --2- 172.21.15.33:0/276735064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82dc102770 0x7f82dc102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.159+0000 7f82e0f92640 1 -- 172.21.15.33:0/276735064 >> 172.21.15.33:0/276735064 conn(0x7f82dc0fe190 msgr2=0x7f82dc1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:32.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.159+0000 7f82e0f92640 1 -- 172.21.15.33:0/276735064 shutdown_connections 2024-08-28T19:32:32.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.159+0000 7f82e0f92640 1 -- 172.21.15.33:0/276735064 wait complete. 2024-08-28T19:32:32.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82e0f92640 1 Processor -- start 2024-08-28T19:32:32.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82e0f92640 1 -- start start 2024-08-28T19:32:32.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82e0f92640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc102770 0x7f82dc19afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82e0f92640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82dc1080a0 0x7f82dc19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82e0f92640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82dc1089f0 0x7f82dc19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82e0f92640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc112680 con 0x7f82dc1089f0 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82e0f92640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc112500 con 0x7f82dc1080a0 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82e0f92640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc112800 con 0x7f82dc102770 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82dad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82dc1089f0 0x7f82dc19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82dad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82dc1089f0 0x7f82dc19ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38928/0 (socket says 172.21.15.33:38928) 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82dad9d640 1 -- 172.21.15.33:0/850264461 learned_addr learned my addr 172.21.15.33:0/850264461 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82da59c640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc102770 0x7f82dc19afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82d9d9b640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82dc1080a0 0x7f82dc19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82dad9d640 1 -- 172.21.15.33:0/850264461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc102770 msgr2=0x7f82dc19afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82dad9d640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc102770 0x7f82dc19afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82dad9d640 1 -- 172.21.15.33:0/850264461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82dc1080a0 msgr2=0x7f82dc19b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82dad9d640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82dc1080a0 0x7f82dc19b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.160+0000 7f82dad9d640 1 -- 172.21.15.33:0/850264461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82dc1a6290 con 0x7f82dc1089f0 2024-08-28T19:32:32.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.161+0000 7f82dad9d640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82dc1089f0 0x7f82dc19ba50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f82d400eb10 tx=0x7f82d400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:32.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.161+0000 7f82cb7fe640 1 -- 172.21.15.33:0/850264461 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4004b20 con 0x7f82dc1089f0 2024-08-28T19:32:32.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.161+0000 7f82cb7fe640 1 -- 172.21.15.33:0/850264461 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82d4004cc0 con 0x7f82dc1089f0 2024-08-28T19:32:32.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.161+0000 7f82e0f92640 1 -- 172.21.15.33:0/850264461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82dc1a6580 con 0x7f82dc1089f0 2024-08-28T19:32:32.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.161+0000 7f82cb7fe640 1 -- 172.21.15.33:0/850264461 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4010670 con 0x7f82dc1089f0 2024-08-28T19:32:32.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.161+0000 7f82e0f92640 1 -- 172.21.15.33:0/850264461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82dc1a6aa0 con 0x7f82dc1089f0 2024-08-28T19:32:32.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.162+0000 7f82e0f92640 1 -- 172.21.15.33:0/850264461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82dc1039e0 con 0x7f82dc1089f0 2024-08-28T19:32:32.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.163+0000 7f82cb7fe640 1 -- 172.21.15.33:0/850264461 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f82d4005020 con 0x7f82dc1089f0 2024-08-28T19:32:32.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.164+0000 7f82cb7fe640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82c40b4b80 0x7f82c40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.164+0000 7f82da59c640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82c40b4b80 0x7f82c40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.164+0000 7f82cb7fe640 1 -- 172.21.15.33:0/850264461 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f82d40e5bc0 con 0x7f82dc1089f0 2024-08-28T19:32:32.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.165+0000 7f82da59c640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82c40b4b80 0x7f82c40b7090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f82dc06c240 tx=0x7f82cc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:32.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.169+0000 7f82cb7fe640 1 -- 172.21.15.33:0/850264461 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f82d40ac820 con 0x7f82dc1089f0 2024-08-28T19:32:32.318 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.408+0000 7f82e0f92640 1 -- 172.21.15.33:0/850264461 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f82dc0635a0 con 0x7f82c40b4b80 2024-08-28T19:32:32.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.572+0000 7f82cb7fe640 1 -- 172.21.15.33:0/850264461 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f82dc0635a0 con 0x7f82c40b4b80 2024-08-28T19:32:32.573 INFO:teuthology.orchestra.run.smithi033.stdout:Schedule set for path / 2024-08-28T19:32:32.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 -- 172.21.15.33:0/850264461 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82c40b4b80 msgr2=0x7f82c40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82c40b4b80 0x7f82c40b7090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f82dc06c240 tx=0x7f82cc00b390 comp rx=0 tx=0).stop 2024-08-28T19:32:32.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 -- 172.21.15.33:0/850264461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82dc1089f0 msgr2=0x7f82dc19ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82dc1089f0 0x7f82dc19ba50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f82d400eb10 tx=0x7f82d400c2d0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 -- 172.21.15.33:0/850264461 shutdown_connections 2024-08-28T19:32:32.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82dc1089f0 0x7f82dc19ba50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82dc1080a0 0x7f82dc19b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82c40b4b80 0x7f82c40b7090 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 --2- 172.21.15.33:0/850264461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82dc102770 0x7f82dc19afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 -- 172.21.15.33:0/850264461 >> 172.21.15.33:0/850264461 conn(0x7f82dc0fe190 msgr2=0x7f82dc1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:32.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 -- 172.21.15.33:0/850264461 shutdown_connections 2024-08-28T19:32:32.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.574+0000 7f82e0f92640 1 -- 172.21.15.33:0/850264461 wait complete. 2024-08-28T19:32:32.587 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-08-28T19:32:32.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.708+0000 7f8c24fe4640 1 -- 172.21.15.33:0/3532510481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c20109b20 msgr2=0x7f8c20110350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.708+0000 7f8c24fe4640 1 --2- 172.21.15.33:0/3532510481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c20109b20 0x7f8c20110350 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009ca0 tx=0x7f8c1802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.708+0000 7f8c24fe4640 1 -- 172.21.15.33:0/3532510481 shutdown_connections 2024-08-28T19:32:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.708+0000 7f8c24fe4640 1 --2- 172.21.15.33:0/3532510481 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c20109b20 0x7f8c20110350 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.708+0000 7f8c24fe4640 1 --2- 172.21.15.33:0/3532510481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c201091d0 0x7f8c201095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.708+0000 7f8c24fe4640 1 --2- 172.21.15.33:0/3532510481 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c201038a0 0x7f8c20103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.708+0000 7f8c24fe4640 1 -- 172.21.15.33:0/3532510481 >> 172.21.15.33:0/3532510481 conn(0x7f8c200ff2a0 msgr2=0x7f8c201016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.708+0000 7f8c24fe4640 1 -- 172.21.15.33:0/3532510481 shutdown_connections 2024-08-28T19:32:32.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.708+0000 7f8c24fe4640 1 -- 172.21.15.33:0/3532510481 wait complete. 2024-08-28T19:32:32.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.709+0000 7f8c24fe4640 1 Processor -- start 2024-08-28T19:32:32.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.709+0000 7f8c24fe4640 1 -- start start 2024-08-28T19:32:32.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.709+0000 7f8c24fe4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c201038a0 0x7f8c2019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.709+0000 7f8c24fe4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c201091d0 0x7f8c2019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.709+0000 7f8c24fe4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c20109b20 0x7f8c2019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.709+0000 7f8c24fe4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8c201137f0 con 0x7f8c201091d0 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.709+0000 7f8c24fe4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20113670 con 0x7f8c20109b20 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.709+0000 7f8c24fe4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8c20113970 con 0x7f8c201038a0 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c201091d0 0x7f8c2019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c201091d0 0x7f8c2019a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38962/0 (socket says 172.21.15.33:38962) 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1dd9b640 1 -- 172.21.15.33:0/1855639649 learned_addr learned my addr 172.21.15.33:0/1855639649 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1e59c640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c201038a0 0x7f8c2019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1ed9d640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c20109b20 0x7f8c2019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1dd9b640 1 -- 172.21.15.33:0/1855639649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c201038a0 msgr2=0x7f8c2019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1dd9b640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c201038a0 0x7f8c2019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1dd9b640 1 -- 172.21.15.33:0/1855639649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c20109b20 msgr2=0x7f8c2019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1dd9b640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c20109b20 0x7f8c2019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1dd9b640 1 -- 172.21.15.33:0/1855639649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c201a0100 con 0x7f8c201091d0 2024-08-28T19:32:32.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c1dd9b640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c201091d0 0x7f8c2019a770 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800e9f0 tx=0x7f8c0800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:32.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c177fe640 1 -- 172.21.15.33:0/1855639649 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0800ccc0 con 0x7f8c201091d0 2024-08-28T19:32:32.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c24fe4640 1 -- 172.21.15.33:0/1855639649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c201a03f0 con 0x7f8c201091d0 2024-08-28T19:32:32.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c177fe640 1 -- 172.21.15.33:0/1855639649 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c080108e0 con 0x7f8c201091d0 2024-08-28T19:32:32.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c177fe640 1 -- 172.21.15.33:0/1855639649 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c08018860 con 0x7f8c201091d0 2024-08-28T19:32:32.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.710+0000 7f8c24fe4640 1 -- 172.21.15.33:0/1855639649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c201a6b80 con 0x7f8c201091d0 2024-08-28T19:32:32.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.711+0000 7f8c24fe4640 1 -- 172.21.15.33:0/1855639649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c20103cb0 con 0x7f8c201091d0 2024-08-28T19:32:32.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.713+0000 7f8c177fe640 1 -- 172.21.15.33:0/1855639649 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f8c08010430 con 0x7f8c201091d0 2024-08-28T19:32:32.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.713+0000 7f8c177fe640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c0c0b4b80 0x7f8c0c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.714+0000 7f8c1e59c640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c0c0b4b80 0x7f8c0c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.714+0000 7f8c177fe640 1 -- 172.21.15.33:0/1855639649 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8c080e5d80 con 0x7f8c201091d0 2024-08-28T19:32:32.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.714+0000 7f8c1e59c640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c0c0b4b80 0x7f8c0c0b7090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009bd0 tx=0x7f8c10005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:32.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.717+0000 7f8c177fe640 1 -- 172.21.15.33:0/1855639649 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8c080ac3f0 con 0x7f8c201091d0 2024-08-28T19:32:32.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.849+0000 7efc4d2f8640 1 -- 172.21.15.33:0/2816831082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc48108ab0 msgr2=0x7efc4810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.849+0000 7efc4d2f8640 1 --2- 172.21.15.33:0/2816831082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc48108ab0 0x7efc4810f2e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efc40009be0 tx=0x7efc4002a6c0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.849+0000 7efc4d2f8640 1 -- 172.21.15.33:0/2816831082 shutdown_connections 2024-08-28T19:32:32.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.849+0000 7efc4d2f8640 1 --2- 172.21.15.33:0/2816831082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc48108ab0 0x7efc4810f2e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.849+0000 7efc4d2f8640 1 --2- 172.21.15.33:0/2816831082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc48108160 0x7efc48108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.849+0000 7efc4d2f8640 1 --2- 172.21.15.33:0/2816831082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc48102820 0x7efc48102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.849+0000 7efc4d2f8640 1 -- 172.21.15.33:0/2816831082 >> 172.21.15.33:0/2816831082 conn(0x7efc480794e0 msgr2=0x7efc480798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.849+0000 7efc4d2f8640 1 -- 172.21.15.33:0/2816831082 shutdown_connections 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.849+0000 7efc4d2f8640 1 -- 172.21.15.33:0/2816831082 wait complete. 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.850+0000 7efc4d2f8640 1 Processor -- start 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.850+0000 7efc4d2f8640 1 -- start start 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.850+0000 7efc4d2f8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc48102820 0x7efc4819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.850+0000 7efc4d2f8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc48108160 0x7efc4819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.850+0000 7efc4d2f8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc48108ab0 0x7efc4819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.850+0000 7efc4d2f8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efc48112730 con 0x7efc48108ab0 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.850+0000 7efc4d2f8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efc481125b0 con 0x7efc48108160 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.850+0000 7efc4d2f8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efc481128b0 con 0x7efc48102820 2024-08-28T19:32:32.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc48108ab0 0x7efc4819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc467fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc48108160 0x7efc4819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc48108ab0 0x7efc4819bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38970/0 (socket says 172.21.15.33:38970) 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc467fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc48108160 0x7efc4819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:46690/0 (socket says 172.21.15.33:46690) 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc477fe640 1 -- 172.21.15.33:0/4282848633 learned_addr learned my addr 172.21.15.33:0/4282848633 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc46ffd640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc48102820 0x7efc4819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc477fe640 1 -- 172.21.15.33:0/4282848633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc48102820 msgr2=0x7efc4819b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc477fe640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc48102820 0x7efc4819b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc477fe640 1 -- 172.21.15.33:0/4282848633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc48108160 msgr2=0x7efc4819b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc477fe640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc48108160 0x7efc4819b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc477fe640 1 -- 172.21.15.33:0/4282848633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc481a6370 con 0x7efc48108ab0 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc467fc640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc48108160 0x7efc4819b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc477fe640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc48108ab0 0x7efc4819bb60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efc40004af0 tx=0x7efc40003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc3ffff640 1 -- 172.21.15.33:0/4282848633 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40041020 con 0x7efc48108ab0 2024-08-28T19:32:32.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc3ffff640 1 -- 172.21.15.33:0/4282848633 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc40003e10 con 0x7efc48108ab0 2024-08-28T19:32:32.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc4d2f8640 1 -- 172.21.15.33:0/4282848633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc481a6600 con 0x7efc48108ab0 2024-08-28T19:32:32.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.851+0000 7efc3ffff640 1 -- 172.21.15.33:0/4282848633 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40036040 con 0x7efc48108ab0 2024-08-28T19:32:32.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.852+0000 7efc4d2f8640 1 -- 172.21.15.33:0/4282848633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc481a6ae0 con 0x7efc48108ab0 2024-08-28T19:32:32.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.854+0000 7efc3ffff640 1 -- 172.21.15.33:0/4282848633 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7efc40044020 con 0x7efc48108ab0 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.855+0000 7efc3ffff640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc340b4bb0 0x7efc340b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.855+0000 7efc46ffd640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc340b4bb0 0x7efc340b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.855+0000 7efc5386d740 1 Processor -- start 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.855+0000 7efc3ffff640 1 -- 172.21.15.33:0/4282848633 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7efc40106170 con 0x7efc48108ab0 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.855+0000 7efc5386d740 1 -- start start 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc46ffd640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc340b4bb0 0x7efc340b70c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efc4806c440 tx=0x7efc38009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc5386d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768970350 0x563768d16780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc5386d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d16cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc5386d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 0x563768d17200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc5386d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563768c8c5f0 con 0x563768947490 2024-08-28T19:32:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc5386d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563768c7bb80 con 0x56376894f670 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc5386d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563768c7fb30 con 0x563768970350 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc467fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d16cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 0x563768d17200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc467fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d16cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38982/0 (socket says 172.21.15.33:38982) 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc46ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768970350 0x563768d16780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 0x563768d17200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:46702/0 (socket says 172.21.15.33:46702) 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc477fe640 1 -- 172.21.15.33:0/4198980708 learned_addr learned my addr 172.21.15.33:0/4198980708 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc477fe640 1 -- 172.21.15.33:0/4198980708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768970350 msgr2=0x563768d16780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc477fe640 1 --2- 172.21.15.33:0/4198980708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768970350 0x563768d16780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc477fe640 1 -- 172.21.15.33:0/4198980708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 msgr2=0x563768d16cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc477fe640 1 --2- 172.21.15.33:0/4198980708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d16cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc477fe640 1 -- 172.21.15.33:0/4198980708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637689db930 con 0x56376894f670 2024-08-28T19:32:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.856+0000 7efc46ffd640 1 --2- 172.21.15.33:0/4198980708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768970350 0x563768d16780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.857+0000 7efc477fe640 1 --2- 172.21.15.33:0/4198980708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 0x563768d17200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc400c99a0 tx=0x7efc4002a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39690edf5afb694b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.857+0000 7efc3d7fa640 1 -- 172.21.15.33:0/4198980708 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc400cc730 con 0x56376894f670 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.857+0000 7efc3d7fa640 1 -- 172.21.15.33:0/4198980708 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc400c6e50 con 0x56376894f670 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.857+0000 7efc3d7fa640 1 -- 172.21.15.33:0/4198980708 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc400d55c0 con 0x56376894f670 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 -- 172.21.15.33:0/4198980708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 msgr2=0x563768d17200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 --2- 172.21.15.33:0/4198980708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 0x563768d17200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc400c99a0 tx=0x7efc4002a6c0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 -- 172.21.15.33:0/4198980708 shutdown_connections 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 --2- 172.21.15.33:0/4198980708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 0x563768d17200 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 --2- 172.21.15.33:0/4198980708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d16cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 --2- 172.21.15.33:0/4198980708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768970350 0x563768d16780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 -- 172.21.15.33:0/4198980708 >> 172.21.15.33:0/4198980708 conn(0x563768964740 msgr2=0x563768d14670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 -- 172.21.15.33:0/4198980708 shutdown_connections 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 -- 172.21.15.33:0/4198980708 wait complete. 2024-08-28T19:32:32.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 -- start start 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.858+0000 7efc5386d740 1 Processor -- start 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc5386d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d21f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc5386d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56376894f670 0x563768d22440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc5386d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 0x563768d32310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc5386d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563768ade890 con 0x563768947490 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc5386d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563768c02790 con 0x563768970350 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc5386d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563768d29130 con 0x56376894f670 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc5386d740 10 client.0 _ll_register_callbacks cb 0x563768987ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc46ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d21f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc46ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d21f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38996/0 (socket says 172.21.15.33:38996) 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc46ffd640 1 -- 172.21.15.33:0/3729421998 learned_addr learned my addr 172.21.15.33:0/3729421998 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc467fc640 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56376894f670 0x563768d22440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc477fe640 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 0x563768d32310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc46ffd640 1 -- 172.21.15.33:0/3729421998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56376894f670 msgr2=0x563768d22440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc46ffd640 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56376894f670 0x563768d22440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc46ffd640 1 -- 172.21.15.33:0/3729421998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 msgr2=0x563768d32310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc46ffd640 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 0x563768d32310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc46ffd640 1 -- 172.21.15.33:0/3729421998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563768c39f30 con 0x563768947490 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.859+0000 7efc477fe640 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 0x563768d32310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.860+0000 7efc46ffd640 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d21f00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc38003ac0 tx=0x7efc38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150601a9a6968eb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.860+0000 7efc2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.860+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3729421998 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3801fe00 con 0x563768947490 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.860+0000 7efc5386d740 1 -- 172.21.15.33:0/3729421998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc400c6e50 con 0x563768947490 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.860+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3729421998 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7efc380273e0 con 0x563768947490 2024-08-28T19:32:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.860+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3729421998 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efc3802d600 con 0x563768947490 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.860+0000 7efc5386d740 10 client.15615 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.860+0000 7efc5386d740 1 -- 172.21.15.33:0/3729421998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563768d34eb0 con 0x563768947490 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.860+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3729421998 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc400c6e50 con 0x563768947490 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.861+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3729421998 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7efc38026070 con 0x563768947490 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.861+0000 7efc5386d740 10 client.15615 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.861+0000 7efc5386d740 10 client.15615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.861+0000 7efc5386d740 20 client.15615 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.861+0000 7efc5386d740 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56376892ecd0 0x563768d38390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.861+0000 7efc5386d740 4 client.15615 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.861+0000 7efc5386d740 1 -- 172.21.15.33:0/3729421998 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563768c8e540 con 0x56376892ecd0 2024-08-28T19:32:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.861+0000 7efc467fc640 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56376892ecd0 0x563768d38390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.861+0000 7efc2e7fc640 10 client.15615 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:32.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc467fc640 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56376892ecd0 0x563768d38390 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdf8e14165390533 server_cookie=7524747684240e28 in_seq=0 out_seq=0 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3729421998 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563768c8e540 con 0x56376892ecd0 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc2e7fc640 10 client.15615 handle_command_reply: tid=0 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc5386d740 1 client.15615 shutdown 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc5386d740 1 -- 172.21.15.33:0/3729421998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 msgr2=0x563768d21f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc5386d740 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d21f00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc38003ac0 tx=0x7efc38004730 comp rx=0 tx=0).stop 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc5386d740 1 -- 172.21.15.33:0/3729421998 shutdown_connections 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc5386d740 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 0x563768d32310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc5386d740 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56376894f670 0x563768d22440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc5386d740 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56376892ecd0 0x563768d38390 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc5386d740 1 --2- 172.21.15.33:0/3729421998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d21f00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc2e7fc640 0 client.15615 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.862+0000 7efc5386d740 1 -- 172.21.15.33:0/3729421998 >> 172.21.15.33:0/3729421998 conn(0x563768964740 msgr2=0x563768d177b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:32.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.863+0000 7efc5386d740 1 -- 172.21.15.33:0/3729421998 shutdown_connections 2024-08-28T19:32:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.863+0000 7efc5386d740 1 -- 172.21.15.33:0/3729421998 wait complete. 2024-08-28T19:32:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.863+0000 7efc5386d740 20 client.15615 trim_cache size 0 max 16384 2024-08-28T19:32:32.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.880+0000 7efc5386d740 1 Processor -- start 2024-08-28T19:32:32.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.880+0000 7efc5386d740 1 -- start start 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc5386d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768947490 0x563768d1d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc5386d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 0x563768d146e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc5386d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768970350 0x563768d32250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc5386d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efc481aea00 con 0x563768970350 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc5386d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efc481b0540 con 0x56376894f670 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc5386d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efc481af0d0 con 0x563768947490 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768970350 0x563768d32250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768970350 0x563768d32250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39010/0 (socket says 172.21.15.33:39010) 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc477fe640 1 -- 172.21.15.33:0/2910252635 learned_addr learned my addr 172.21.15.33:0/2910252635 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc467fc640 1 --2- 172.21.15.33:0/2910252635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 0x563768d146e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc46ffd640 1 --2- 172.21.15.33:0/2910252635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768947490 0x563768d1d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc477fe640 1 -- 172.21.15.33:0/2910252635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768947490 msgr2=0x563768d1d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc477fe640 1 --2- 172.21.15.33:0/2910252635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768947490 0x563768d1d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc477fe640 1 -- 172.21.15.33:0/2910252635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 msgr2=0x563768d146e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc477fe640 1 --2- 172.21.15.33:0/2910252635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 0x563768d146e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.881+0000 7efc477fe640 1 -- 172.21.15.33:0/2910252635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563768d20e60 con 0x563768970350 2024-08-28T19:32:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.882+0000 7efc477fe640 1 --2- 172.21.15.33:0/2910252635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768970350 0x563768d32250 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7efc40103850 tx=0x7efc40009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8493daadfba693d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.882+0000 7efc3cff9640 1 -- 172.21.15.33:0/2910252635 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc400f3070 con 0x563768970350 2024-08-28T19:32:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.882+0000 7efc3cff9640 1 -- 172.21.15.33:0/2910252635 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc400d0fa0 con 0x563768970350 2024-08-28T19:32:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.882+0000 7efc3cff9640 1 -- 172.21.15.33:0/2910252635 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc400f3210 con 0x563768970350 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.883+0000 7efc5386d740 1 -- 172.21.15.33:0/2910252635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768970350 msgr2=0x563768d32250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.883+0000 7efc5386d740 1 --2- 172.21.15.33:0/2910252635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768970350 0x563768d32250 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7efc40103850 tx=0x7efc40009330 comp rx=0 tx=0).stop 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.883+0000 7efc5386d740 1 -- 172.21.15.33:0/2910252635 shutdown_connections 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.883+0000 7efc5386d740 1 --2- 172.21.15.33:0/2910252635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768970350 0x563768d32250 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.883+0000 7efc5386d740 1 --2- 172.21.15.33:0/2910252635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56376894f670 0x563768d146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.883+0000 7efc5386d740 1 --2- 172.21.15.33:0/2910252635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563768947490 0x563768d1d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.883+0000 7efc5386d740 1 -- 172.21.15.33:0/2910252635 >> 172.21.15.33:0/2910252635 conn(0x563768964740 msgr2=0x563768d13fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.883+0000 7efc5386d740 1 -- 172.21.15.33:0/2910252635 shutdown_connections 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.883+0000 7efc5386d740 1 -- 172.21.15.33:0/2910252635 wait complete. 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc5386d740 1 -- start start 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc5386d740 1 Processor -- start 2024-08-28T19:32:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc5386d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d2e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc5386d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56376894f670 0x563768d2acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc5386d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 0x563768d2b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc5386d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efc481afe70 con 0x563768947490 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc5386d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efc481af7a0 con 0x563768970350 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc5386d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efc481ac9e0 con 0x56376894f670 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc5386d740 10 client.0 _ll_register_callbacks cb 0x7efc38004140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc46ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d2e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc46ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d2e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39026/0 (socket says 172.21.15.33:39026) 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc46ffd640 1 -- 172.21.15.33:0/3016113953 learned_addr learned my addr 172.21.15.33:0/3016113953 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc477fe640 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 0x563768d2b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.884+0000 7efc467fc640 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56376894f670 0x563768d2acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc46ffd640 1 -- 172.21.15.33:0/3016113953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56376894f670 msgr2=0x563768d2acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc46ffd640 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56376894f670 0x563768d2acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc46ffd640 1 -- 172.21.15.33:0/3016113953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 msgr2=0x563768d2b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc46ffd640 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 0x563768d2b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc46ffd640 1 -- 172.21.15.33:0/3016113953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563768d2b740 con 0x563768947490 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc477fe640 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 0x563768d2b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc46ffd640 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d2e800 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efc38006010 tx=0x7efc38027690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795c4829cd9c1edf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3016113953 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3802d7a0 con 0x563768947490 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3016113953 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7efc3802d940 con 0x563768947490 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc5386d740 1 -- 172.21.15.33:0/3016113953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563768c89fe0 con 0x563768947490 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3016113953 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efc38046050 con 0x563768947490 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc5386d740 10 client.15621 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc5386d740 1 -- 172.21.15.33:0/3016113953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563768da3ae0 con 0x563768947490 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.885+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3016113953 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563768c89fe0 con 0x563768947490 2024-08-28T19:32:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.886+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3016113953 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7efc38026040 con 0x563768947490 2024-08-28T19:32:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.886+0000 7efc5386d740 10 client.15621 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.886+0000 7efc5386d740 10 client.15621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:32:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.886+0000 7efc5386d740 20 client.15621 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.886+0000 7efc5386d740 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563768904080 0x563768da6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.886+0000 7efc5386d740 4 client.15621 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:32:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.886+0000 7efc5386d740 1 -- 172.21.15.33:0/3016113953 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563768c87720 con 0x563768904080 2024-08-28T19:32:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.886+0000 7efc467fc640 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563768904080 0x563768da6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:32.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.886+0000 7efc2e7fc640 10 client.15621 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:32.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.886+0000 7efc467fc640 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563768904080 0x563768da6320 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5068113c7ee90f1 server_cookie=52a763a38c621b7 in_seq=0 out_seq=0 2024-08-28T19:32:32.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc2e7fc640 1 -- 172.21.15.33:0/3016113953 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563768c87720 con 0x563768904080 2024-08-28T19:32:32.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc2e7fc640 10 client.15621 handle_command_reply: tid=0 2024-08-28T19:32:32.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 client.15621 shutdown 2024-08-28T19:32:32.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 -- 172.21.15.33:0/3016113953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 msgr2=0x563768d2e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d2e800 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efc38006010 tx=0x7efc38027690 comp rx=0 tx=0).stop 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 -- 172.21.15.33:0/3016113953 shutdown_connections 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563768970350 0x563768d2b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56376894f670 0x563768d2acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563768904080 0x563768da6320 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 --2- 172.21.15.33:0/3016113953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563768947490 0x563768d2e800 secure :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efc38006010 tx=0x7efc38027690 comp rx=0 tx=0).stop 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 -- 172.21.15.33:0/3016113953 >> 172.21.15.33:0/3016113953 conn(0x563768964740 msgr2=0x563768d233b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc2e7fc640 0 client.15621 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 -- 172.21.15.33:0/3016113953 shutdown_connections 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 1 -- 172.21.15.33:0/3016113953 wait complete. 2024-08-28T19:32:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.888+0000 7efc5386d740 20 client.15621 trim_cache size 0 max 16384 2024-08-28T19:32:32.893 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:32.893 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:32:32.893 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "3b385a22-8710-4cc9-9519-872af6231c9a", 2024-08-28T19:32:32.893 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:32:32.893 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 -- 172.21.15.33:0/4282848633 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc340b4bb0 msgr2=0x7efc340b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc340b4bb0 0x7efc340b70c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efc4806c440 tx=0x7efc38009260 comp rx=0 tx=0).stop 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 -- 172.21.15.33:0/4282848633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc48108ab0 msgr2=0x7efc4819bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc48108ab0 0x7efc4819bb60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efc40004af0 tx=0x7efc40003c20 comp rx=0 tx=0).stop 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 -- 172.21.15.33:0/4282848633 shutdown_connections 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc48108ab0 0x7efc4819bb60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc48108160 0x7efc4819b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efc340b4bb0 0x7efc340b70c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 --2- 172.21.15.33:0/4282848633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efc48102820 0x7efc4819b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 -- 172.21.15.33:0/4282848633 >> 172.21.15.33:0/4282848633 conn(0x7efc480794e0 msgr2=0x7efc481050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 -- 172.21.15.33:0/4282848633 shutdown_connections 2024-08-28T19:32:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.889+0000 7efc4d2f8640 1 -- 172.21.15.33:0/4282848633 wait complete. 2024-08-28T19:32:32.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:32.948+0000 7f8c24fe4640 1 -- 172.21.15.33:0/1855639649 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f8c200635a0 con 0x7f8c0c0b4b80 2024-08-28T19:32:33.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.011+0000 7f8c177fe640 1 -- 172.21.15.33:0/1855639649 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f8c200635a0 con 0x7f8c0c0b4b80 2024-08-28T19:32:33.012 INFO:teuthology.orchestra.run.smithi033.stdout:Retention added to path / 2024-08-28T19:32:33.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 -- 172.21.15.33:0/1855639649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c0c0b4b80 msgr2=0x7f8c0c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c0c0b4b80 0x7f8c0c0b7090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009bd0 tx=0x7f8c10005f90 comp rx=0 tx=0).stop 2024-08-28T19:32:33.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 -- 172.21.15.33:0/1855639649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c201091d0 msgr2=0x7f8c2019a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c201091d0 0x7f8c2019a770 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800e9f0 tx=0x7f8c0800eeb0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 -- 172.21.15.33:0/1855639649 shutdown_connections 2024-08-28T19:32:33.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c20109b20 0x7f8c2019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c201091d0 0x7f8c2019a770 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c0c0b4b80 0x7f8c0c0b7090 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 --2- 172.21.15.33:0/1855639649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c201038a0 0x7f8c2019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 -- 172.21.15.33:0/1855639649 >> 172.21.15.33:0/1855639649 conn(0x7f8c200ff2a0 msgr2=0x7f8c20106740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:33.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 -- 172.21.15.33:0/1855639649 shutdown_connections 2024-08-28T19:32:33.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.013+0000 7f8c24fe4640 1 -- 172.21.15.33:0/1855639649 wait complete. 2024-08-28T19:32:33.026 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-28T19:32:33.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.143+0000 7f671ccdc640 1 -- 172.21.15.33:0/118619663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6718108a00 msgr2=0x7f671810f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.143+0000 7f671ccdc640 1 --2- 172.21.15.33:0/118619663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6718108a00 0x7f671810f230 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6710009ca0 tx=0x7f671002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.143+0000 7f671ccdc640 1 -- 172.21.15.33:0/118619663 shutdown_connections 2024-08-28T19:32:33.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.143+0000 7f671ccdc640 1 --2- 172.21.15.33:0/118619663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6718108a00 0x7f671810f230 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.143+0000 7f671ccdc640 1 --2- 172.21.15.33:0/118619663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67181080b0 0x7f67181084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.143+0000 7f671ccdc640 1 --2- 172.21.15.33:0/118619663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6718102780 0x7f6718102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.143+0000 7f671ccdc640 1 -- 172.21.15.33:0/118619663 >> 172.21.15.33:0/118619663 conn(0x7f67180fe180 msgr2=0x7f67181005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:33.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.143+0000 7f671ccdc640 1 -- 172.21.15.33:0/118619663 shutdown_connections 2024-08-28T19:32:33.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.143+0000 7f671ccdc640 1 -- 172.21.15.33:0/118619663 wait complete. 2024-08-28T19:32:33.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.144+0000 7f671ccdc640 1 Processor -- start 2024-08-28T19:32:33.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.144+0000 7f671ccdc640 1 -- start start 2024-08-28T19:32:33.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.144+0000 7f671ccdc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6718102780 0x7f671819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:33.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.144+0000 7f671ccdc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67181080b0 0x7f671819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.144+0000 7f671ccdc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6718108a00 0x7f671819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.144+0000 7f671ccdc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f67181126d0 con 0x7f6718108a00 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.144+0000 7f671ccdc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6718112550 con 0x7f6718102780 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.144+0000 7f671ccdc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6718112850 con 0x7f67181080b0 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6718108a00 0x7f671819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6716d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6718108a00 0x7f671819ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39040/0 (socket says 172.21.15.33:39040) 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6716d9d640 1 -- 172.21.15.33:0/3987688319 learned_addr learned my addr 172.21.15.33:0/3987688319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f671659c640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6718102780 0x7f671819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6715d9b640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67181080b0 0x7f671819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6716d9d640 1 -- 172.21.15.33:0/3987688319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67181080b0 msgr2=0x7f671819b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6716d9d640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67181080b0 0x7f671819b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6716d9d640 1 -- 172.21.15.33:0/3987688319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6718102780 msgr2=0x7f671819afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6716d9d640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6718102780 0x7f671819afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6716d9d640 1 -- 172.21.15.33:0/3987688319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67181a6250 con 0x7f6718108a00 2024-08-28T19:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6715d9b640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67181080b0 0x7f671819b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f6716d9d640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6718108a00 0x7f671819ba40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f67100098d0 tx=0x7f67100317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f67077fe640 1 -- 172.21.15.33:0/3987688319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710003b70 con 0x7f6718108a00 2024-08-28T19:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f67077fe640 1 -- 172.21.15.33:0/3987688319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6710003d10 con 0x7f6718108a00 2024-08-28T19:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f67077fe640 1 -- 172.21.15.33:0/3987688319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671002fa20 con 0x7f6718108a00 2024-08-28T19:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f671ccdc640 1 -- 172.21.15.33:0/3987688319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67181a64e0 con 0x7f6718108a00 2024-08-28T19:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.145+0000 7f671ccdc640 1 -- 172.21.15.33:0/3987688319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67181a69e0 con 0x7f6718108a00 2024-08-28T19:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.146+0000 7f671ccdc640 1 -- 172.21.15.33:0/3987688319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6718102b90 con 0x7f6718108a00 2024-08-28T19:32:33.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.149+0000 7f67077fe640 1 -- 172.21.15.33:0/3987688319 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f671002fbe0 con 0x7f6718108a00 2024-08-28T19:32:33.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.150+0000 7f67077fe640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f67000b4c00 0x7f67000b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:33.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.150+0000 7f671659c640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f67000b4c00 0x7f67000b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:33.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.150+0000 7f67077fe640 1 -- 172.21.15.33:0/3987688319 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f6710106c70 con 0x7f6718108a00 2024-08-28T19:32:33.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.150+0000 7f671659c640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f67000b4c00 0x7f67000b7110 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f671806c260 tx=0x7f6708005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.153+0000 7f67077fe640 1 -- 172.21.15.33:0/3987688319 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f67100cd930 con 0x7f6718108a00 2024-08-28T19:32:33.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.364+0000 7f671ccdc640 1 -- 172.21.15.33:0/3987688319 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f67180635a0 con 0x7f67000b4c00 2024-08-28T19:32:33.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.371+0000 7f67077fe640 1 -- 172.21.15.33:0/3987688319 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f67180635a0 con 0x7f67000b4c00 2024-08-28T19:32:33.372 INFO:teuthology.orchestra.run.smithi033.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-28T00:00:00", "created": "2024-08-28T19:32:32", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-08-28T19:32:33.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 -- 172.21.15.33:0/3987688319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f67000b4c00 msgr2=0x7f67000b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f67000b4c00 0x7f67000b7110 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f671806c260 tx=0x7f6708005f90 comp rx=0 tx=0).stop 2024-08-28T19:32:33.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 -- 172.21.15.33:0/3987688319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6718108a00 msgr2=0x7f671819ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6718108a00 0x7f671819ba40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f67100098d0 tx=0x7f67100317b0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 -- 172.21.15.33:0/3987688319 shutdown_connections 2024-08-28T19:32:33.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6718108a00 0x7f671819ba40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f67000b4c00 0x7f67000b7110 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f67181080b0 0x7f671819b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 --2- 172.21.15.33:0/3987688319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6718102780 0x7f671819afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 -- 172.21.15.33:0/3987688319 >> 172.21.15.33:0/3987688319 conn(0x7f67180fe180 msgr2=0x7f6718105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:33.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 -- 172.21.15.33:0/3987688319 shutdown_connections 2024-08-28T19:32:33.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.373+0000 7f671ccdc640 1 -- 172.21.15.33:0/3987688319 wait complete. 2024-08-28T19:32:33.385 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-28T19:32:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.498+0000 7f1b4db22640 1 -- 172.21.15.33:0/3081732776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48108080 msgr2=0x7f1b48108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.498+0000 7f1b4db22640 1 --2- 172.21.15.33:0/3081732776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48108080 0x7f1b48108490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009900 tx=0x7f1b3c02a410 comp rx=0 tx=0).stop 2024-08-28T19:32:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.498+0000 7f1b4db22640 1 -- 172.21.15.33:0/3081732776 shutdown_connections 2024-08-28T19:32:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.498+0000 7f1b4db22640 1 --2- 172.21.15.33:0/3081732776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b481089d0 0x7f1b4810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.498+0000 7f1b4db22640 1 --2- 172.21.15.33:0/3081732776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48108080 0x7f1b48108490 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.498+0000 7f1b4db22640 1 --2- 172.21.15.33:0/3081732776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b48102750 0x7f1b48102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.498+0000 7f1b4db22640 1 -- 172.21.15.33:0/3081732776 >> 172.21.15.33:0/3081732776 conn(0x7f1b4807a4e0 msgr2=0x7f1b4807a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.498+0000 7f1b4db22640 1 -- 172.21.15.33:0/3081732776 shutdown_connections 2024-08-28T19:32:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.498+0000 7f1b4db22640 1 -- 172.21.15.33:0/3081732776 wait complete. 2024-08-28T19:32:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.499+0000 7f1b4db22640 1 Processor -- start 2024-08-28T19:32:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.499+0000 7f1b4db22640 1 -- start start 2024-08-28T19:32:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.499+0000 7f1b4db22640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48102750 0x7f1b4819b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.499+0000 7f1b4db22640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b48108080 0x7f1b4819b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b4db22640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b481089d0 0x7f1b4819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b4db22640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481126b0 con 0x7f1b48102750 2024-08-28T19:32:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b4db22640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b48112530 con 0x7f1b48108080 2024-08-28T19:32:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b4db22640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1b48112830 con 0x7f1b481089d0 2024-08-28T19:32:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48102750 0x7f1b4819b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b477fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48102750 0x7f1b4819b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39066/0 (socket says 172.21.15.33:39066) 2024-08-28T19:32:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b477fe640 1 -- 172.21.15.33:0/1850396884 learned_addr learned my addr 172.21.15.33:0/1850396884 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b46ffd640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b48108080 0x7f1b4819b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b47fff640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b481089d0 0x7f1b4819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b477fe640 1 -- 172.21.15.33:0/1850396884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b481089d0 msgr2=0x7f1b4819bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b477fe640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b481089d0 0x7f1b4819bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b477fe640 1 -- 172.21.15.33:0/1850396884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b48108080 msgr2=0x7f1b4819b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b477fe640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b48108080 0x7f1b4819b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b477fe640 1 -- 172.21.15.33:0/1850396884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b481a6300 con 0x7f1b48102750 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b477fe640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48102750 0x7f1b4819b040 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800b4a0 tx=0x7f1b3800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b44ff9640 1 -- 172.21.15.33:0/1850396884 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38014070 con 0x7f1b48102750 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b44ff9640 1 -- 172.21.15.33:0/1850396884 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b38010ac0 con 0x7f1b48102750 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b4db22640 1 -- 172.21.15.33:0/1850396884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b481a65f0 con 0x7f1b48102750 2024-08-28T19:32:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b44ff9640 1 -- 172.21.15.33:0/1850396884 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38017c30 con 0x7f1b48102750 2024-08-28T19:32:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.500+0000 7f1b4db22640 1 -- 172.21.15.33:0/1850396884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b481a6b90 con 0x7f1b48102750 2024-08-28T19:32:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.501+0000 7f1b4db22640 1 -- 172.21.15.33:0/1850396884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b48102b60 con 0x7f1b48102750 2024-08-28T19:32:33.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.503+0000 7f1b44ff9640 1 -- 172.21.15.33:0/1850396884 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f1b38017070 con 0x7f1b48102750 2024-08-28T19:32:33.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.503+0000 7f1b44ff9640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b300b4b80 0x7f1b300b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:33.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.504+0000 7f1b46ffd640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b300b4b80 0x7f1b300b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:33.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.504+0000 7f1b44ff9640 1 -- 172.21.15.33:0/1850396884 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1b380e4d40 con 0x7f1b48102750 2024-08-28T19:32:33.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.504+0000 7f1b46ffd640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b300b4b80 0x7f1b300b7090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009230 tx=0x7f1b3c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:33.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.506+0000 7f1b44ff9640 1 -- 172.21.15.33:0/1850396884 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1b380ab9a0 con 0x7f1b48102750 2024-08-28T19:32:33.645 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:33 smithi033 ceph-mon[18549]: pgmap v345: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:32:33.645 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:33 smithi033 ceph-mon[18549]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:33.645 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:33 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:32:33.645 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:33 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:32:33.645 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:33 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:32:33.646 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:33 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:32:33.647 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:32:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.719+0000 7f1b4db22640 1 -- 172.21.15.33:0/1850396884 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f1b480635a0 con 0x7f1b300b4b80 2024-08-28T19:32:33.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.727+0000 7f1b44ff9640 1 -- 172.21.15.33:0/1850396884 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f1b480635a0 con 0x7f1b300b4b80 2024-08-28T19:32:33.728 INFO:teuthology.orchestra.run.smithi033.stdout:/ 1m 6m3h 2024-08-28T19:32:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 -- 172.21.15.33:0/1850396884 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b300b4b80 msgr2=0x7f1b300b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b300b4b80 0x7f1b300b7090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c009230 tx=0x7f1b3c031400 comp rx=0 tx=0).stop 2024-08-28T19:32:33.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 -- 172.21.15.33:0/1850396884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48102750 msgr2=0x7f1b4819b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:33.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48102750 0x7f1b4819b040 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800b4a0 tx=0x7f1b3800b960 comp rx=0 tx=0).stop 2024-08-28T19:32:33.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 -- 172.21.15.33:0/1850396884 shutdown_connections 2024-08-28T19:32:33.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b300b4b80 0x7f1b300b7090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b481089d0 0x7f1b4819bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b48108080 0x7f1b4819b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 --2- 172.21.15.33:0/1850396884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b48102750 0x7f1b4819b040 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:33.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 -- 172.21.15.33:0/1850396884 >> 172.21.15.33:0/1850396884 conn(0x7f1b4807a4e0 msgr2=0x7f1b48106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:33.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 -- 172.21.15.33:0/1850396884 shutdown_connections 2024-08-28T19:32:33.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:33.729+0000 7f1b4db22640 1 -- 172.21.15.33:0/1850396884 wait complete. 2024-08-28T19:32:33.741 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-08-28T19:32:33.767 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-08-28T19:32:33.777 INFO:teuthology.run_tasks:Running task quiescer... 2024-08-28T19:32:33.911 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-28T19:32:33.912 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:33 smithi122 ceph-mon[22174]: pgmap v345: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:33 smithi122 ceph-mon[22174]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:33 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:33 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:33 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:33 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:33 smithi059 ceph-mon[22052]: pgmap v345: 129 pgs: 129 active+clean; 651 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:33 smithi059 ceph-mon[22052]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:33 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:33 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:32:33.913 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:33 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:32:33.914 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:33 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:32:33.914 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:34.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.413+0000 7f34e2112640 1 -- 172.21.15.33:0/2170070543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34dc103930 msgr2=0x7f34dc103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:34.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.413+0000 7f34e2112640 1 --2- 172.21.15.33:0/2170070543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34dc103930 0x7f34dc103d40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009900 tx=0x7f34cc02a410 comp rx=0 tx=0).stop 2024-08-28T19:32:34.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.413+0000 7f34e2112640 1 -- 172.21.15.33:0/2170070543 shutdown_connections 2024-08-28T19:32:34.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.413+0000 7f34e2112640 1 --2- 172.21.15.33:0/2170070543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc109bc0 0x7f34dc1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.413+0000 7f34e2112640 1 --2- 172.21.15.33:0/2170070543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34dc109270 0x7f34dc109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.413+0000 7f34e2112640 1 --2- 172.21.15.33:0/2170070543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34dc103930 0x7f34dc103d40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.413+0000 7f34e2112640 1 -- 172.21.15.33:0/2170070543 >> 172.21.15.33:0/2170070543 conn(0x7f34dc0ff3a0 msgr2=0x7f34dc1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:34.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.413+0000 7f34e2112640 1 -- 172.21.15.33:0/2170070543 shutdown_connections 2024-08-28T19:32:34.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.413+0000 7f34e2112640 1 -- 172.21.15.33:0/2170070543 wait complete. 2024-08-28T19:32:34.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34e2112640 1 Processor -- start 2024-08-28T19:32:34.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34e2112640 1 -- start start 2024-08-28T19:32:34.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34e2112640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34dc103930 0x7f34dc19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34e2112640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc109270 0x7f34dc19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34e2112640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34dc109bc0 0x7f34dc19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34e2112640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc113880 con 0x7f34dc103930 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34e2112640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc113700 con 0x7f34dc109bc0 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34e2112640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc113a00 con 0x7f34dc109270 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34db7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34dc103930 0x7f34dc19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34db7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34dc103930 0x7f34dc19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39078/0 (socket says 172.21.15.33:39078) 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.414+0000 7f34db7fe640 1 -- 172.21.15.33:0/1208281118 learned_addr learned my addr 172.21.15.33:0/1208281118 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34d3fff640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc109270 0x7f34dc19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34dbfff640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34dc109bc0 0x7f34dc19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34db7fe640 1 -- 172.21.15.33:0/1208281118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc109270 msgr2=0x7f34dc19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34db7fe640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc109270 0x7f34dc19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34db7fe640 1 -- 172.21.15.33:0/1208281118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34dc109bc0 msgr2=0x7f34dc19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34db7fe640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34dc109bc0 0x7f34dc19fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34db7fe640 1 -- 172.21.15.33:0/1208281118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34dc1a01a0 con 0x7f34dc103930 2024-08-28T19:32:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34db7fe640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34dc103930 0x7f34dc19a230 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f34cc005940 tx=0x7f34cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34d97fa640 1 -- 172.21.15.33:0/1208281118 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc03f030 con 0x7f34dc103930 2024-08-28T19:32:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34d97fa640 1 -- 172.21.15.33:0/1208281118 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34cc003cb0 con 0x7f34dc103930 2024-08-28T19:32:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34e2112640 1 -- 172.21.15.33:0/1208281118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34dc1a0430 con 0x7f34dc103930 2024-08-28T19:32:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.415+0000 7f34d97fa640 1 -- 172.21.15.33:0/1208281118 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc035070 con 0x7f34dc103930 2024-08-28T19:32:34.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.416+0000 7f34e2112640 1 -- 172.21.15.33:0/1208281118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34dc1a6bf0 con 0x7f34dc103930 2024-08-28T19:32:34.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.419+0000 7f34e8687740 1 Processor -- start 2024-08-28T19:32:34.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.419+0000 7f34e8687740 1 -- start start 2024-08-28T19:32:34.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.419+0000 7f34d97fa640 1 -- 172.21.15.33:0/1208281118 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f34cc042030 con 0x7f34dc103930 2024-08-28T19:32:34.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.419+0000 7f34e8687740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 0x55e007a992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.419+0000 7f34e8687740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076cb1b0 0x55e007a99800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.419+0000 7f34e8687740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076d3390 0x55e007a99d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.419+0000 7f34e8687740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e007a10630 con 0x55e0076f4070 2024-08-28T19:32:34.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.419+0000 7f34e8687740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0079ffbc0 con 0x55e0076cb1b0 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.419+0000 7f34e8687740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e007a03b70 con 0x55e0076d3390 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 0x55e007a992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 0x55e007a992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39090/0 (socket says 172.21.15.33:39090) 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34dbfff640 1 -- 172.21.15.33:0/3566766538 learned_addr learned my addr 172.21.15.33:0/3566766538 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34d3fff640 1 --2- 172.21.15.33:0/3566766538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076d3390 0x55e007a99d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34db7fe640 1 --2- 172.21.15.33:0/3566766538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076cb1b0 0x55e007a99800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34dbfff640 1 -- 172.21.15.33:0/3566766538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076d3390 msgr2=0x55e007a99d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3566766538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076d3390 0x55e007a99d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34dbfff640 1 -- 172.21.15.33:0/3566766538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076cb1b0 msgr2=0x55e007a99800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3566766538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076cb1b0 0x55e007a99800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34dbfff640 1 -- 172.21.15.33:0/3566766538 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00775f650 con 0x55e0076f4070 2024-08-28T19:32:34.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3566766538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 0x55e007a992c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009f70 tx=0x7f34d4010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd95cd0d153e5020 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:34.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.420+0000 7f34d1ffb640 1 -- 172.21.15.33:0/3566766538 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4016070 con 0x55e0076f4070 2024-08-28T19:32:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.421+0000 7f34d97fa640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34c80b4c10 0x7f34c80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.421+0000 7f34d1ffb640 1 -- 172.21.15.33:0/3566766538 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34d4004d20 con 0x55e0076f4070 2024-08-28T19:32:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.421+0000 7f34d1ffb640 1 -- 172.21.15.33:0/3566766538 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d40127d0 con 0x55e0076f4070 2024-08-28T19:32:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.421+0000 7f34db7fe640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34c80b4c10 0x7f34c80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.421+0000 7f34d97fa640 1 -- 172.21.15.33:0/1208281118 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f34cc105fc0 con 0x7f34dc103930 2024-08-28T19:32:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34e8687740 1 -- 172.21.15.33:0/3566766538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 msgr2=0x55e007a992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34db7fe640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34c80b4c10 0x7f34c80b7120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55e007a97f40 tx=0x7f34cc0045a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34e8687740 1 --2- 172.21.15.33:0/3566766538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 0x55e007a992c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009f70 tx=0x7f34d4010800 comp rx=0 tx=0).stop 2024-08-28T19:32:34.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34e8687740 1 -- 172.21.15.33:0/3566766538 shutdown_connections 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34e8687740 1 --2- 172.21.15.33:0/3566766538 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076d3390 0x55e007a99d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34e8687740 1 --2- 172.21.15.33:0/3566766538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076cb1b0 0x55e007a99800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34e8687740 1 --2- 172.21.15.33:0/3566766538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 0x55e007a992c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34e8687740 1 -- 172.21.15.33:0/3566766538 >> 172.21.15.33:0/3566766538 conn(0x55e0076e8460 msgr2=0x55e007a971b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34e8687740 1 -- 172.21.15.33:0/3566766538 shutdown_connections 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34e8687740 1 -- 172.21.15.33:0/3566766538 wait complete. 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.422+0000 7f34e8687740 1 -- start start 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34e8687740 1 Processor -- start 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34e8687740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 0x55e007aa8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34e8687740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076d3390 0x55e007aa9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34e8687740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 0x55e007ab5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34e8687740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e007862700 con 0x55e0076f4070 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34e8687740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e007986700 con 0x55e0076d3390 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34e8687740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e007aabe00 con 0x55e0076cb1b0 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34e8687740 10 client.0 _ll_register_callbacks cb 0x55e0079b5dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076d3390 0x55e007aa9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076d3390 0x55e007aa9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:46820/0 (socket says 172.21.15.33:46820) 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34d3fff640 1 -- 172.21.15.33:0/1730599939 learned_addr learned my addr 172.21.15.33:0/1730599939 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34dbfff640 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 0x55e007ab5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.423+0000 7f34dbfff640 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 0x55e007aa8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34d3fff640 1 -- 172.21.15.33:0/1730599939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 msgr2=0x55e007aa8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34d3fff640 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 0x55e007aa8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34d3fff640 1 -- 172.21.15.33:0/1730599939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 msgr2=0x55e007ab5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34d3fff640 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 0x55e007ab5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34d3fff640 1 -- 172.21.15.33:0/1730599939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0079bf8b0 con 0x55e0076d3390 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34dbfff640 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 0x55e007aa8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34d3fff640 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076d3390 0x55e007aa9360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34c400bea0 tx=0x7f34c400bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=389a9388f62e7df6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34baffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34baffd640 1 -- 172.21.15.33:0/1730599939 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4005220 con 0x55e0076d3390 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34e8687740 1 -- 172.21.15.33:0/1730599939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d4004d20 con 0x55e0076d3390 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34baffd640 1 -- 172.21.15.33:0/1730599939 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f34c40053c0 con 0x55e0076d3390 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34baffd640 1 -- 172.21.15.33:0/1730599939 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34c40055c0 con 0x55e0076d3390 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34e8687740 10 client.25262 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.424+0000 7f34e8687740 1 -- 172.21.15.33:0/1730599939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e007ab7c90 con 0x55e0076d3390 2024-08-28T19:32:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.425+0000 7f34baffd640 1 -- 172.21.15.33:0/1730599939 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34d4004d20 con 0x55e0076d3390 2024-08-28T19:32:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.425+0000 7f34baffd640 1 -- 172.21.15.33:0/1730599939 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f34c4010bd0 con 0x55e0076d3390 2024-08-28T19:32:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.425+0000 7f34e8687740 10 client.25262 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.425+0000 7f34e8687740 10 client.25262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:32:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.425+0000 7f34e8687740 20 client.25262 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.425+0000 7f34e8687740 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0076b29f0 0x55e007abb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.425+0000 7f34e8687740 4 client.25262 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.425+0000 7f34e8687740 1 -- 172.21.15.33:0/1730599939 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e007a12580 con 0x55e0076b29f0 2024-08-28T19:32:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.425+0000 7f34dbfff640 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0076b29f0 0x55e007abb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.426+0000 7f34dbfff640 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0076b29f0 0x55e007abb1f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e119514f05f0a6de server_cookie=e806eba61c99d01f in_seq=0 out_seq=0 2024-08-28T19:32:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.426+0000 7f34baffd640 10 client.25262 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.426+0000 7f34baffd640 1 -- 172.21.15.33:0/1730599939 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e007a12580 con 0x55e0076b29f0 2024-08-28T19:32:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.426+0000 7f34baffd640 10 client.25262 handle_command_reply: tid=0 2024-08-28T19:32:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 client.25262 shutdown 2024-08-28T19:32:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 -- 172.21.15.33:0/1730599939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076d3390 msgr2=0x55e007aa9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076d3390 0x55e007aa9360 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34c400bea0 tx=0x7f34c400bf90 comp rx=0 tx=0).stop 2024-08-28T19:32:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 -- 172.21.15.33:0/1730599939 shutdown_connections 2024-08-28T19:32:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0076b29f0 0x55e007abb1f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076f4070 0x55e007ab5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076d3390 0x55e007aa9360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34baffd640 0 client.25262 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 --2- 172.21.15.33:0/1730599939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 0x55e007aa8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 -- 172.21.15.33:0/1730599939 >> 172.21.15.33:0/1730599939 conn(0x55e0076e8460 msgr2=0x55e007a9acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 -- 172.21.15.33:0/1730599939 shutdown_connections 2024-08-28T19:32:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 1 -- 172.21.15.33:0/1730599939 wait complete. 2024-08-28T19:32:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.427+0000 7f34e8687740 20 client.25262 trim_cache size 0 max 16384 2024-08-28T19:32:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34e8687740 1 Processor -- start 2024-08-28T19:32:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34e8687740 1 -- start start 2024-08-28T19:32:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34e8687740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076b29f0 0x55e007a921e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34e8687740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 0x55e007a971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34e8687740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076d3390 0x55e007ab5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34e8687740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc1ae8d0 con 0x55e0076d3390 2024-08-28T19:32:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34e8687740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc1b0410 con 0x55e0076b29f0 2024-08-28T19:32:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34e8687740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc1aefa0 con 0x55e0076cb1b0 2024-08-28T19:32:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076d3390 0x55e007ab5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076d3390 0x55e007ab5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39108/0 (socket says 172.21.15.33:39108) 2024-08-28T19:32:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34dbfff640 1 -- 172.21.15.33:0/3647183045 learned_addr learned my addr 172.21.15.33:0/3647183045 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3647183045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076b29f0 0x55e007a921e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.449 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.447+0000 7f34d3fff640 1 --2- 172.21.15.33:0/3647183045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 0x55e007a971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.448+0000 7f34dbfff640 1 -- 172.21.15.33:0/3647183045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 msgr2=0x55e007a971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.448+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3647183045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 0x55e007a971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.448+0000 7f34dbfff640 1 -- 172.21.15.33:0/3647183045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076b29f0 msgr2=0x55e007a921e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.448+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3647183045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076b29f0 0x55e007a921e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.448+0000 7f34dbfff640 1 -- 172.21.15.33:0/3647183045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e007aa7320 con 0x55e0076d3390 2024-08-28T19:32:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.448+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3647183045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076d3390 0x55e007ab5060 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f34d4019000 tx=0x7f34d4009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f68e3fee0ff1f3c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.448+0000 7f34d17fa640 1 -- 172.21.15.33:0/3647183045 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4016040 con 0x55e0076d3390 2024-08-28T19:32:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.448+0000 7f34d17fa640 1 -- 172.21.15.33:0/3647183045 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34d4005080 con 0x55e0076d3390 2024-08-28T19:32:34.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.448+0000 7f34d17fa640 1 -- 172.21.15.33:0/3647183045 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d40042b0 con 0x55e0076d3390 2024-08-28T19:32:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.449+0000 7f34e8687740 1 -- 172.21.15.33:0/3647183045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076d3390 msgr2=0x55e007ab5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.449+0000 7f34e8687740 1 --2- 172.21.15.33:0/3647183045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076d3390 0x55e007ab5060 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f34d4019000 tx=0x7f34d4009600 comp rx=0 tx=0).stop 2024-08-28T19:32:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.449+0000 7f34e8687740 1 -- 172.21.15.33:0/3647183045 shutdown_connections 2024-08-28T19:32:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.449+0000 7f34e8687740 1 --2- 172.21.15.33:0/3647183045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076d3390 0x55e007ab5060 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.449+0000 7f34e8687740 1 --2- 172.21.15.33:0/3647183045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076cb1b0 0x55e007a971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.449+0000 7f34e8687740 1 --2- 172.21.15.33:0/3647183045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076b29f0 0x55e007a921e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.449+0000 7f34e8687740 1 -- 172.21.15.33:0/3647183045 >> 172.21.15.33:0/3647183045 conn(0x55e0076e8460 msgr2=0x55e007a96ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:34.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.449+0000 7f34e8687740 1 -- 172.21.15.33:0/3647183045 shutdown_connections 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.449+0000 7f34e8687740 1 -- 172.21.15.33:0/3647183045 wait complete. 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.449+0000 7f34e8687740 1 -- start start 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34e8687740 1 Processor -- start 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34e8687740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076b29f0 0x55e007aad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34e8687740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076cb1b0 0x55e007aad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34e8687740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076d3390 0x55e007aadbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34e8687740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc1afd40 con 0x55e0076b29f0 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34e8687740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc1af670 con 0x55e0076cb1b0 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34e8687740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f34dc1ac8b0 con 0x55e0076d3390 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34e8687740 10 client.0 _ll_register_callbacks cb 0x7f34c400bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076b29f0 0x55e007aad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076b29f0 0x55e007aad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39124/0 (socket says 172.21.15.33:39124) 2024-08-28T19:32:34.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.450+0000 7f34dbfff640 1 -- 172.21.15.33:0/3290482065 learned_addr learned my addr 172.21.15.33:0/3290482065 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34d3fff640 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076cb1b0 0x55e007aad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076d3390 0x55e007aadbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34dbfff640 1 -- 172.21.15.33:0/3290482065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076d3390 msgr2=0x55e007aadbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076d3390 0x55e007aadbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34dbfff640 1 -- 172.21.15.33:0/3290482065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076cb1b0 msgr2=0x55e007aad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076cb1b0 0x55e007aad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34dbfff640 1 -- 172.21.15.33:0/3290482065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e007b24c60 con 0x55e0076b29f0 2024-08-28T19:32:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34dbfff640 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076b29f0 0x55e007aad140 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f34d4004c20 tx=0x7f34d4009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768951608857a93a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34baffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34baffd640 1 -- 172.21.15.33:0/3290482065 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4016070 con 0x55e0076b29f0 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34baffd640 1 -- 172.21.15.33:0/3290482065 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f34d4005430 con 0x55e0076b29f0 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34e8687740 1 -- 172.21.15.33:0/3290482065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d4005080 con 0x55e0076b29f0 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34baffd640 1 -- 172.21.15.33:0/3290482065 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34d4005630 con 0x55e0076b29f0 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34e8687740 10 client.15651 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.451+0000 7f34e8687740 1 -- 172.21.15.33:0/3290482065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e007b25ef0 con 0x55e0076b29f0 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.452+0000 7f34baffd640 1 -- 172.21.15.33:0/3290482065 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34d4005080 con 0x55e0076b29f0 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.452+0000 7f34baffd640 1 -- 172.21.15.33:0/3290482065 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f34d403f040 con 0x55e0076b29f0 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.452+0000 7f34e8687740 10 client.15651 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.452+0000 7f34e8687740 10 client.15651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.452+0000 7f34e8687740 20 client.15651 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.452+0000 7f34e8687740 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0076f4070 0x55e007b283d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.452+0000 7f34e8687740 4 client.15651 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.452+0000 7f34e8687740 1 -- 172.21.15.33:0/3290482065 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e007a0e020 con 0x55e0076f4070 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.452+0000 7f34d3fff640 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0076f4070 0x55e007b283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34baffd640 10 client.15651 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34d3fff640 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0076f4070 0x55e007b283d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3407a013711ef8ce server_cookie=4b1fa25667388429 in_seq=0 out_seq=0 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34baffd640 1 -- 172.21.15.33:0/3290482065 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55e007a0e020 con 0x55e0076f4070 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34baffd640 10 client.15651 handle_command_reply: tid=0 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 client.15651 shutdown 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 -- 172.21.15.33:0/3290482065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076b29f0 msgr2=0x55e007aad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076b29f0 0x55e007aad140 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f34d4004c20 tx=0x7f34d4009960 comp rx=0 tx=0).stop 2024-08-28T19:32:34.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 -- 172.21.15.33:0/3290482065 shutdown_connections 2024-08-28T19:32:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0076d3390 0x55e007aadbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0076cb1b0 0x55e007aad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0076f4070 0x55e007b283d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 --2- 172.21.15.33:0/3290482065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0076b29f0 0x55e007aad140 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 -- 172.21.15.33:0/3290482065 >> 172.21.15.33:0/3290482065 conn(0x55e0076e8460 msgr2=0x55e007aaa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34baffd640 0 client.15651 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 -- 172.21.15.33:0/3290482065 shutdown_connections 2024-08-28T19:32:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.453+0000 7f34e8687740 1 -- 172.21.15.33:0/3290482065 wait complete. 2024-08-28T19:32:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e8687740 20 client.15651 trim_cache size 0 max 16384 2024-08-28T19:32:34.463 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:34.464 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:32:34.464 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:32:34.464 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:32:34.464 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:32:34.464 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "3b385a22-8710-4cc9-9519-872af6231c9a", 2024-08-28T19:32:34.464 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:32:34.464 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:32:34.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:32:34.464 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:32:34.464 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:32:34.465 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:32:34.465 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:32:34.465 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:32:34.465 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:32:34.465 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:32:34.465 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:32:34.465 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:32:34.465 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:32:34.465 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e2112640 1 -- 172.21.15.33:0/1208281118 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34c80b4c10 msgr2=0x7f34c80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e2112640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34c80b4c10 0x7f34c80b7120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55e007a97f40 tx=0x7f34cc0045a0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e2112640 1 -- 172.21.15.33:0/1208281118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34dc103930 msgr2=0x7f34dc19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e2112640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34dc103930 0x7f34dc19a230 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f34cc005940 tx=0x7f34cc0042f0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e2112640 1 -- 172.21.15.33:0/1208281118 shutdown_connections 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e2112640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34dc109bc0 0x7f34dc19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e2112640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34c80b4c10 0x7f34c80b7120 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e2112640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34dc109270 0x7f34dc19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e2112640 1 --2- 172.21.15.33:0/1208281118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34dc103930 0x7f34dc19a230 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.454+0000 7f34e2112640 1 -- 172.21.15.33:0/1208281118 >> 172.21.15.33:0/1208281118 conn(0x7f34dc0ff3a0 msgr2=0x7f34dc1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.455+0000 7f34e2112640 1 -- 172.21.15.33:0/1208281118 shutdown_connections 2024-08-28T19:32:34.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:34.455+0000 7f34e2112640 1 -- 172.21.15.33:0/1208281118 wait complete. 2024-08-28T19:32:34.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:34 smithi033 ceph-mon[18549]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:34.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:34 smithi033 ceph-mon[18549]: from='client.15627 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:34.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:34 smithi059 ceph-mon[22052]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:34.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:34 smithi059 ceph-mon[22052]: from='client.15627 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:34.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:34 smithi122 ceph-mon[22174]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:34.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:34 smithi122 ceph-mon[22174]: from='client.15627 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:35.386 INFO:tasks.cephfs.filesystem:scrub status for tag:3b385a22-8710-4cc9-9519-872af6231c9a - {'path': '/', 'tag': '3b385a22-8710-4cc9-9519-872af6231c9a', 'options': 'recursive,force'} 2024-08-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.576+0000 7f454b01b640 1 -- 172.21.15.33:0/3627463038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4544104790 msgr2=0x7f4544104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.576+0000 7f454b01b640 1 --2- 172.21.15.33:0/3627463038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4544104790 0x7f4544104ba0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4534009900 tx=0x7f453402a410 comp rx=0 tx=0).stop 2024-08-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.576+0000 7f454b01b640 1 -- 172.21.15.33:0/3627463038 shutdown_connections 2024-08-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.576+0000 7f454b01b640 1 --2- 172.21.15.33:0/3627463038 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f454410dbf0 0x7f45441100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.576+0000 7f454b01b640 1 --2- 172.21.15.33:0/3627463038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45441050e0 0x7f454410d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.576+0000 7f454b01b640 1 --2- 172.21.15.33:0/3627463038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4544104790 0x7f4544104ba0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.576+0000 7f454b01b640 1 -- 172.21.15.33:0/3627463038 >> 172.21.15.33:0/3627463038 conn(0x7f4544079580 msgr2=0x7f4544079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.576+0000 7f454b01b640 1 -- 172.21.15.33:0/3627463038 shutdown_connections 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.576+0000 7f454b01b640 1 -- 172.21.15.33:0/3627463038 wait complete. 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.577+0000 7f454b01b640 1 Processor -- start 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.577+0000 7f454b01b640 1 -- start start 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.577+0000 7f454b01b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4544104790 0x7f454419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.577+0000 7f454b01b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45441050e0 0x7f454419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.577+0000 7f454b01b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f454410dbf0 0x7f454419fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.577+0000 7f454b01b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4544113870 con 0x7f45441050e0 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.577+0000 7f454b01b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45441136f0 con 0x7f4544104790 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.577+0000 7f454b01b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f45441139f0 con 0x7f454410dbf0 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4543fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45441050e0 0x7f454419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4548db7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4544104790 0x7f454419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f45495b8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f454410dbf0 0x7f454419fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4548db7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4544104790 0x7f454419a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:46864/0 (socket says 172.21.15.33:46864) 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4548db7640 1 -- 172.21.15.33:0/2086737580 learned_addr learned my addr 172.21.15.33:0/2086737580 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4543fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45441050e0 0x7f454419a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39136/0 (socket says 172.21.15.33:39136) 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4543fff640 1 -- 172.21.15.33:0/2086737580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f454410dbf0 msgr2=0x7f454419fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4543fff640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f454410dbf0 0x7f454419fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4543fff640 1 -- 172.21.15.33:0/2086737580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4544104790 msgr2=0x7f454419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4543fff640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4544104790 0x7f454419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4543fff640 1 -- 172.21.15.33:0/2086737580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45441a0150 con 0x7f45441050e0 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4543fff640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45441050e0 0x7f454419a840 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f454406aad0 tx=0x7f453800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4541ffb640 1 -- 172.21.15.33:0/2086737580 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538007bb0 con 0x7f45441050e0 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4541ffb640 1 -- 172.21.15.33:0/2086737580 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4538007d50 con 0x7f45441050e0 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f454b01b640 1 -- 172.21.15.33:0/2086737580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45441a0440 con 0x7f45441050e0 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.578+0000 7f4541ffb640 1 -- 172.21.15.33:0/2086737580 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45380186f0 con 0x7f45441050e0 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.579+0000 7f454b01b640 1 -- 172.21.15.33:0/2086737580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45441a6c60 con 0x7f45441050e0 2024-08-28T19:32:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.580+0000 7f454b01b640 1 -- 172.21.15.33:0/2086737580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4544104ba0 con 0x7f45441050e0 2024-08-28T19:32:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.581+0000 7f4541ffb640 1 -- 172.21.15.33:0/2086737580 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f453800f450 con 0x7f45441050e0 2024-08-28T19:32:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.582+0000 7f4541ffb640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f452c0b4c40 0x7f452c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.582+0000 7f4548db7640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f452c0b4c40 0x7f452c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.582+0000 7f4541ffb640 1 -- 172.21.15.33:0/2086737580 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f45380e57d0 con 0x7f45441050e0 2024-08-28T19:32:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.582+0000 7f4548db7640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f452c0b4c40 0x7f452c0b7150 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4534005f70 tx=0x7f4534009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.586+0000 7f4541ffb640 1 -- 172.21.15.33:0/2086737580 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4538014030 con 0x7f45441050e0 2024-08-28T19:32:35.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:35 smithi033 ceph-mon[18549]: from='client.15633 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:35.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:35 smithi033 ceph-mon[18549]: pgmap v346: 129 pgs: 129 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 71 KiB/s wr, 26 op/s 2024-08-28T19:32:35.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:35 smithi033 ceph-mon[18549]: mgrmap e23: x(active, since 9m), standbys: y, z 2024-08-28T19:32:35.684 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:35 smithi059 ceph-mon[22052]: from='client.15633 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:35.684 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:35 smithi059 ceph-mon[22052]: pgmap v346: 129 pgs: 129 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 71 KiB/s wr, 26 op/s 2024-08-28T19:32:35.684 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:35 smithi059 ceph-mon[22052]: mgrmap e23: x(active, since 9m), standbys: y, z 2024-08-28T19:32:35.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.768+0000 7f454b01b640 1 -- 172.21.15.33:0/2086737580 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4544100a10 con 0x7f452c0b4c40 2024-08-28T19:32:35.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.774+0000 7f4541ffb640 1 -- 172.21.15.33:0/2086737580 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340866 (secure 0 0 0) 0x7f4544100a10 con 0x7f452c0b4c40 2024-08-28T19:32:35.779 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-28T19:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 -- 172.21.15.33:0/2086737580 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f452c0b4c40 msgr2=0x7f452c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f452c0b4c40 0x7f452c0b7150 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4534005f70 tx=0x7f4534009560 comp rx=0 tx=0).stop 2024-08-28T19:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 -- 172.21.15.33:0/2086737580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45441050e0 msgr2=0x7f454419a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45441050e0 0x7f454419a840 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f454406aad0 tx=0x7f453800cdd0 comp rx=0 tx=0).stop 2024-08-28T19:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 -- 172.21.15.33:0/2086737580 shutdown_connections 2024-08-28T19:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f452c0b4c40 0x7f452c0b7150 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f454410dbf0 0x7f454419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45441050e0 0x7f454419a840 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 --2- 172.21.15.33:0/2086737580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4544104790 0x7f454419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 -- 172.21.15.33:0/2086737580 >> 172.21.15.33:0/2086737580 conn(0x7f4544079580 msgr2=0x7f45440ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 -- 172.21.15.33:0/2086737580 shutdown_connections 2024-08-28T19:32:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:35.778+0000 7f454b01b640 1 -- 172.21.15.33:0/2086737580 wait complete. 2024-08-28T19:32:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:35 smithi122 ceph-mon[22174]: from='client.15633 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:32:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:35 smithi122 ceph-mon[22174]: pgmap v346: 129 pgs: 129 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 71 KiB/s wr, 26 op/s 2024-08-28T19:32:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:35 smithi122 ceph-mon[22174]: mgrmap e23: x(active, since 9m), standbys: y, z 2024-08-28T19:32:36.567 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-08-28T19:32:35.765916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1125670,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1469,"num_read_kb":875,"num_write":468,"num_write_kb":3151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373360,"kb_used_data":11628,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568464,"statfs":{"total":1151940427776,"available":1151558107136,"internally_reserved":0,"allocated":11907072,"data_stored":8707708,"data_compressed":501297,"data_compressed_allocated":675840,"data_compressed_original":3514368,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":465261,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":130,"num_write":86,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003825"},"pg_stats":[{"pgid":"2.1f","version":"81'13","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:30.611907+0000","last_change":"2024-08-28T19:29:46.098343+0000","last_active":"2024-08-28T19:32:30.611907+0000","last_peered":"2024-08-28T19:32:30.611907+0000","last_clean":"2024-08-28T19:32:30.611907+0000","last_became_active":"2024-08-28T19:29:46.097974+0000","last_became_peered":"2024-08-28T19:29:46.097974+0000","last_unstale":"2024-08-28T19:32:30.611907+0000","last_undegraded":"2024-08-28T19:32:30.611907+0000","last_fullsized":"2024-08-28T19:32:30.611907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:03:11.466154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":126,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125076+0000","last_change":"2024-08-28T19:29:48.123521+0000","last_active":"2024-08-28T19:31:56.125076+0000","last_peered":"2024-08-28T19:31:56.125076+0000","last_clean":"2024-08-28T19:31:56.125076+0000","last_became_active":"2024-08-28T19:29:48.122998+0000","last_became_peered":"2024-08-28T19:29:48.122998+0000","last_unstale":"2024-08-28T19:31:56.125076+0000","last_undegraded":"2024-08-28T19:31:56.125076+0000","last_fullsized":"2024-08-28T19:31:56.125076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:33:48.413468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901815+0000","last_change":"2024-08-28T19:29:55.268086+0000","last_active":"2024-08-28T19:31:27.901815+0000","last_peered":"2024-08-28T19:31:27.901815+0000","last_clean":"2024-08-28T19:31:27.901815+0000","last_became_active":"2024-08-28T19:29:55.267411+0000","last_became_peered":"2024-08-28T19:29:55.267411+0000","last_unstale":"2024-08-28T19:31:27.901815+0000","last_undegraded":"2024-08-28T19:31:27.901815+0000","last_fullsized":"2024-08-28T19:31:27.901815+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:32:16.277295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903018+0000","last_change":"2024-08-28T19:29:46.188552+0000","last_active":"2024-08-28T19:31:27.903018+0000","last_peered":"2024-08-28T19:31:27.903018+0000","last_clean":"2024-08-28T19:31:27.903018+0000","last_became_active":"2024-08-28T19:29:46.188118+0000","last_became_peered":"2024-08-28T19:29:46.188118+0000","last_unstale":"2024-08-28T19:31:27.903018+0000","last_undegraded":"2024-08-28T19:31:27.903018+0000","last_fullsized":"2024-08-28T19:31:27.903018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:55:43.774037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148138+0000","last_change":"2024-08-28T19:29:48.118765+0000","last_active":"2024-08-28T19:31:56.148138+0000","last_peered":"2024-08-28T19:31:56.148138+0000","last_clean":"2024-08-28T19:31:56.148138+0000","last_became_active":"2024-08-28T19:29:48.118111+0000","last_became_peered":"2024-08-28T19:29:48.118111+0000","last_unstale":"2024-08-28T19:31:56.148138+0000","last_undegraded":"2024-08-28T19:31:56.148138+0000","last_fullsized":"2024-08-28T19:31:56.148138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:00:51.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895580+0000","last_change":"2024-08-28T19:29:55.262222+0000","last_active":"2024-08-28T19:31:27.895580+0000","last_peered":"2024-08-28T19:31:27.895580+0000","last_clean":"2024-08-28T19:31:27.895580+0000","last_became_active":"2024-08-28T19:29:55.260906+0000","last_became_peered":"2024-08-28T19:29:55.260906+0000","last_unstale":"2024-08-28T19:31:27.895580+0000","last_undegraded":"2024-08-28T19:31:27.895580+0000","last_fullsized":"2024-08-28T19:31:27.895580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:22:30.523609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903748+0000","last_change":"2024-08-28T19:29:46.101077+0000","last_active":"2024-08-28T19:31:27.903748+0000","last_peered":"2024-08-28T19:31:27.903748+0000","last_clean":"2024-08-28T19:31:27.903748+0000","last_became_active":"2024-08-28T19:29:46.100630+0000","last_became_peered":"2024-08-28T19:29:46.100630+0000","last_unstale":"2024-08-28T19:31:27.903748+0000","last_undegraded":"2024-08-28T19:31:27.903748+0000","last_fullsized":"2024-08-28T19:31:27.903748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:59:11.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152697+0000","last_change":"2024-08-28T19:29:48.129460+0000","last_active":"2024-08-28T19:31:56.152697+0000","last_peered":"2024-08-28T19:31:56.152697+0000","last_clean":"2024-08-28T19:31:56.152697+0000","last_became_active":"2024-08-28T19:29:48.129068+0000","last_became_peered":"2024-08-28T19:29:48.129068+0000","last_unstale":"2024-08-28T19:31:56.152697+0000","last_undegraded":"2024-08-28T19:31:56.152697+0000","last_fullsized":"2024-08-28T19:31:56.152697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:08:40.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895880+0000","last_change":"2024-08-28T19:29:55.262943+0000","last_active":"2024-08-28T19:31:27.895880+0000","last_peered":"2024-08-28T19:31:27.895880+0000","last_clean":"2024-08-28T19:31:27.895880+0000","last_became_active":"2024-08-28T19:29:55.262424+0000","last_became_peered":"2024-08-28T19:29:55.262424+0000","last_unstale":"2024-08-28T19:31:27.895880+0000","last_undegraded":"2024-08-28T19:31:27.895880+0000","last_fullsized":"2024-08-28T19:31:27.895880+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:19:40.618651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903555+0000","last_change":"2024-08-28T19:29:46.102571+0000","last_active":"2024-08-28T19:31:27.903555+0000","last_peered":"2024-08-28T19:31:27.903555+0000","last_clean":"2024-08-28T19:31:27.903555+0000","last_became_active":"2024-08-28T19:29:46.102081+0000","last_became_peered":"2024-08-28T19:29:46.102081+0000","last_unstale":"2024-08-28T19:31:27.903555+0000","last_undegraded":"2024-08-28T19:31:27.903555+0000","last_fullsized":"2024-08-28T19:31:27.903555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:46:38.266122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149393+0000","last_change":"2024-08-28T19:30:27.550413+0000","last_active":"2024-08-28T19:31:56.149393+0000","last_peered":"2024-08-28T19:31:56.149393+0000","last_clean":"2024-08-28T19:31:56.149393+0000","last_became_active":"2024-08-28T19:30:27.550002+0000","last_became_peered":"2024-08-28T19:30:27.550002+0000","last_unstale":"2024-08-28T19:31:56.149393+0000","last_undegraded":"2024-08-28T19:31:56.149393+0000","last_fullsized":"2024-08-28T19:31:56.149393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:17.519332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895637+0000","last_change":"2024-08-28T19:29:55.261930+0000","last_active":"2024-08-28T19:31:27.895637+0000","last_peered":"2024-08-28T19:31:27.895637+0000","last_clean":"2024-08-28T19:31:27.895637+0000","last_became_active":"2024-08-28T19:29:55.261208+0000","last_became_peered":"2024-08-28T19:29:55.261208+0000","last_unstale":"2024-08-28T19:31:27.895637+0000","last_undegraded":"2024-08-28T19:31:27.895637+0000","last_fullsized":"2024-08-28T19:31:27.895637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.804993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152875+0000","last_change":"2024-08-28T19:29:48.133820+0000","last_active":"2024-08-28T19:31:56.152875+0000","last_peered":"2024-08-28T19:31:56.152875+0000","last_clean":"2024-08-28T19:31:56.152875+0000","last_became_active":"2024-08-28T19:29:48.132536+0000","last_became_peered":"2024-08-28T19:29:48.132536+0000","last_unstale":"2024-08-28T19:31:56.152875+0000","last_undegraded":"2024-08-28T19:31:56.152875+0000","last_fullsized":"2024-08-28T19:31:56.152875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:15:39.779698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902841+0000","last_change":"2024-08-28T19:29:46.101206+0000","last_active":"2024-08-28T19:31:27.902841+0000","last_peered":"2024-08-28T19:31:27.902841+0000","last_clean":"2024-08-28T19:31:27.902841+0000","last_became_active":"2024-08-28T19:29:46.100801+0000","last_became_peered":"2024-08-28T19:29:46.100801+0000","last_unstale":"2024-08-28T19:31:27.902841+0000","last_undegraded":"2024-08-28T19:31:27.902841+0000","last_fullsized":"2024-08-28T19:31:27.902841+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:43:33.156203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895905+0000","last_change":"2024-08-28T19:29:55.572774+0000","last_active":"2024-08-28T19:31:27.895905+0000","last_peered":"2024-08-28T19:31:27.895905+0000","last_clean":"2024-08-28T19:31:27.895905+0000","last_became_active":"2024-08-28T19:29:55.571703+0000","last_became_peered":"2024-08-28T19:29:55.571703+0000","last_unstale":"2024-08-28T19:31:27.895905+0000","last_undegraded":"2024-08-28T19:31:27.895905+0000","last_fullsized":"2024-08-28T19:31:27.895905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:56:52.695007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131019+0000","last_change":"2024-08-28T19:29:48.127683+0000","last_active":"2024-08-28T19:31:56.131019+0000","last_peered":"2024-08-28T19:31:56.131019+0000","last_clean":"2024-08-28T19:31:56.131019+0000","last_became_active":"2024-08-28T19:29:48.127139+0000","last_became_peered":"2024-08-28T19:29:48.127139+0000","last_unstale":"2024-08-28T19:31:56.131019+0000","last_undegraded":"2024-08-28T19:31:56.131019+0000","last_fullsized":"2024-08-28T19:31:56.131019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:38:16.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902182+0000","last_change":"2024-08-28T19:29:46.103233+0000","last_active":"2024-08-28T19:31:27.902182+0000","last_peered":"2024-08-28T19:31:27.902182+0000","last_clean":"2024-08-28T19:31:27.902182+0000","last_became_active":"2024-08-28T19:29:46.102515+0000","last_became_peered":"2024-08-28T19:29:46.102515+0000","last_unstale":"2024-08-28T19:31:27.902182+0000","last_undegraded":"2024-08-28T19:31:27.902182+0000","last_fullsized":"2024-08-28T19:31:27.902182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:49:35.905893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896101+0000","last_change":"2024-08-28T19:29:55.264291+0000","last_active":"2024-08-28T19:31:27.896101+0000","last_peered":"2024-08-28T19:31:27.896101+0000","last_clean":"2024-08-28T19:31:27.896101+0000","last_became_active":"2024-08-28T19:29:55.263692+0000","last_became_peered":"2024-08-28T19:29:55.263692+0000","last_unstale":"2024-08-28T19:31:27.896101+0000","last_undegraded":"2024-08-28T19:31:27.896101+0000","last_fullsized":"2024-08-28T19:31:27.896101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:47:01.795320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.147184+0000","last_change":"2024-08-28T19:29:48.115470+0000","last_active":"2024-08-28T19:31:56.147184+0000","last_peered":"2024-08-28T19:31:56.147184+0000","last_clean":"2024-08-28T19:31:56.147184+0000","last_became_active":"2024-08-28T19:29:48.115076+0000","last_became_peered":"2024-08-28T19:29:48.115076+0000","last_unstale":"2024-08-28T19:31:56.147184+0000","last_undegraded":"2024-08-28T19:31:56.147184+0000","last_fullsized":"2024-08-28T19:31:56.147184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:32.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902180+0000","last_change":"2024-08-28T19:29:46.099970+0000","last_active":"2024-08-28T19:31:27.902180+0000","last_peered":"2024-08-28T19:31:27.902180+0000","last_clean":"2024-08-28T19:31:27.902180+0000","last_became_active":"2024-08-28T19:29:46.099661+0000","last_became_peered":"2024-08-28T19:29:46.099661+0000","last_unstale":"2024-08-28T19:31:27.902180+0000","last_undegraded":"2024-08-28T19:31:27.902180+0000","last_fullsized":"2024-08-28T19:31:27.902180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:27.430026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894683+0000","last_change":"2024-08-28T19:29:55.265983+0000","last_active":"2024-08-28T19:31:27.894683+0000","last_peered":"2024-08-28T19:31:27.894683+0000","last_clean":"2024-08-28T19:31:27.894683+0000","last_became_active":"2024-08-28T19:29:55.265464+0000","last_became_peered":"2024-08-28T19:29:55.265464+0000","last_unstale":"2024-08-28T19:31:27.894683+0000","last_undegraded":"2024-08-28T19:31:27.894683+0000","last_fullsized":"2024-08-28T19:31:27.894683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:21:42.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139931+0000","last_change":"2024-08-28T19:29:48.119545+0000","last_active":"2024-08-28T19:31:56.139931+0000","last_peered":"2024-08-28T19:31:56.139931+0000","last_clean":"2024-08-28T19:31:56.139931+0000","last_became_active":"2024-08-28T19:29:48.119128+0000","last_became_peered":"2024-08-28T19:29:48.119128+0000","last_unstale":"2024-08-28T19:31:56.139931+0000","last_undegraded":"2024-08-28T19:31:56.139931+0000","last_fullsized":"2024-08-28T19:31:56.139931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:05:31.535016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.907887+0000","last_change":"2024-08-28T19:31:27.907348+0000","last_active":"2024-08-28T19:31:27.907887+0000","last_peered":"2024-08-28T19:31:27.907887+0000","last_clean":"2024-08-28T19:31:27.907887+0000","last_became_active":"2024-08-28T19:31:27.904502+0000","last_became_peered":"2024-08-28T19:31:27.904502+0000","last_unstale":"2024-08-28T19:31:27.907887+0000","last_undegraded":"2024-08-28T19:31:27.907887+0000","last_fullsized":"2024-08-28T19:31:27.907887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:16:50.269131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895761+0000","last_change":"2024-08-28T19:29:55.573320+0000","last_active":"2024-08-28T19:31:27.895761+0000","last_peered":"2024-08-28T19:31:27.895761+0000","last_clean":"2024-08-28T19:31:27.895761+0000","last_became_active":"2024-08-28T19:29:55.572858+0000","last_became_peered":"2024-08-28T19:29:55.572858+0000","last_unstale":"2024-08-28T19:31:27.895761+0000","last_undegraded":"2024-08-28T19:31:27.895761+0000","last_fullsized":"2024-08-28T19:31:27.895761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:09:34.676911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.133571+0000","last_change":"2024-08-28T19:30:27.404918+0000","last_active":"2024-08-28T19:31:56.133571+0000","last_peered":"2024-08-28T19:31:56.133571+0000","last_clean":"2024-08-28T19:31:56.133571+0000","last_became_active":"2024-08-28T19:30:27.404495+0000","last_became_peered":"2024-08-28T19:30:27.404495+0000","last_unstale":"2024-08-28T19:31:56.133571+0000","last_undegraded":"2024-08-28T19:31:56.133571+0000","last_fullsized":"2024-08-28T19:31:56.133571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:10:12.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896122+0000","last_change":"2024-08-28T19:29:46.110683+0000","last_active":"2024-08-28T19:31:27.896122+0000","last_peered":"2024-08-28T19:31:27.896122+0000","last_clean":"2024-08-28T19:31:27.896122+0000","last_became_active":"2024-08-28T19:29:46.110324+0000","last_became_peered":"2024-08-28T19:29:46.110324+0000","last_unstale":"2024-08-28T19:31:27.896122+0000","last_undegraded":"2024-08-28T19:31:27.896122+0000","last_fullsized":"2024-08-28T19:31:27.896122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:15:47.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901834+0000","last_change":"2024-08-28T19:29:55.271035+0000","last_active":"2024-08-28T19:31:27.901834+0000","last_peered":"2024-08-28T19:31:27.901834+0000","last_clean":"2024-08-28T19:31:27.901834+0000","last_became_active":"2024-08-28T19:29:55.268465+0000","last_became_peered":"2024-08-28T19:29:55.268465+0000","last_unstale":"2024-08-28T19:31:27.901834+0000","last_undegraded":"2024-08-28T19:31:27.901834+0000","last_fullsized":"2024-08-28T19:31:27.901834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:16:17.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132232+0000","last_change":"2024-08-28T19:29:48.127225+0000","last_active":"2024-08-28T19:31:56.132232+0000","last_peered":"2024-08-28T19:31:56.132232+0000","last_clean":"2024-08-28T19:31:56.132232+0000","last_became_active":"2024-08-28T19:29:48.126775+0000","last_became_peered":"2024-08-28T19:29:48.126775+0000","last_unstale":"2024-08-28T19:31:56.132232+0000","last_undegraded":"2024-08-28T19:31:56.132232+0000","last_fullsized":"2024-08-28T19:31:56.132232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:49:39.353082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'48","reported_seq":110,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:32.505887+0000","last_change":"2024-08-28T19:29:46.098076+0000","last_active":"2024-08-28T19:32:32.505887+0000","last_peered":"2024-08-28T19:32:32.505887+0000","last_clean":"2024-08-28T19:32:32.505887+0000","last_became_active":"2024-08-28T19:29:46.097726+0000","last_became_peered":"2024-08-28T19:29:46.097726+0000","last_unstale":"2024-08-28T19:32:32.505887+0000","last_undegraded":"2024-08-28T19:32:32.505887+0000","last_fullsized":"2024-08-28T19:32:32.505887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.624125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":86,"num_write_kb":709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901585+0000","last_change":"2024-08-28T19:29:55.571830+0000","last_active":"2024-08-28T19:31:27.901585+0000","last_peered":"2024-08-28T19:31:27.901585+0000","last_clean":"2024-08-28T19:31:27.901585+0000","last_became_active":"2024-08-28T19:29:55.571318+0000","last_became_peered":"2024-08-28T19:29:55.571318+0000","last_unstale":"2024-08-28T19:31:27.901585+0000","last_undegraded":"2024-08-28T19:31:27.901585+0000","last_fullsized":"2024-08-28T19:31:27.901585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:41:03.397478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135204+0000","last_change":"2024-08-28T19:29:48.124998+0000","last_active":"2024-08-28T19:31:56.135204+0000","last_peered":"2024-08-28T19:31:56.135204+0000","last_clean":"2024-08-28T19:31:56.135204+0000","last_became_active":"2024-08-28T19:29:48.124600+0000","last_became_peered":"2024-08-28T19:29:48.124600+0000","last_unstale":"2024-08-28T19:31:56.135204+0000","last_undegraded":"2024-08-28T19:31:56.135204+0000","last_fullsized":"2024-08-28T19:31:56.135204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:50:59.459372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903831+0000","last_change":"2024-08-28T19:29:46.189455+0000","last_active":"2024-08-28T19:31:27.903831+0000","last_peered":"2024-08-28T19:31:27.903831+0000","last_clean":"2024-08-28T19:31:27.903831+0000","last_became_active":"2024-08-28T19:29:46.188640+0000","last_became_peered":"2024-08-28T19:29:46.188640+0000","last_unstale":"2024-08-28T19:31:27.903831+0000","last_undegraded":"2024-08-28T19:31:27.903831+0000","last_fullsized":"2024-08-28T19:31:27.903831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:05:32.561725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899291+0000","last_change":"2024-08-28T19:29:55.269726+0000","last_active":"2024-08-28T19:31:27.899291+0000","last_peered":"2024-08-28T19:31:27.899291+0000","last_clean":"2024-08-28T19:31:27.899291+0000","last_became_active":"2024-08-28T19:29:55.269261+0000","last_became_peered":"2024-08-28T19:29:55.269261+0000","last_unstale":"2024-08-28T19:31:27.899291+0000","last_undegraded":"2024-08-28T19:31:27.899291+0000","last_fullsized":"2024-08-28T19:31:27.899291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:05.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128358+0000","last_change":"2024-08-28T19:29:48.125251+0000","last_active":"2024-08-28T19:31:56.128358+0000","last_peered":"2024-08-28T19:31:56.128358+0000","last_clean":"2024-08-28T19:31:56.128358+0000","last_became_active":"2024-08-28T19:29:48.124818+0000","last_became_peered":"2024-08-28T19:29:48.124818+0000","last_unstale":"2024-08-28T19:31:56.128358+0000","last_undegraded":"2024-08-28T19:31:56.128358+0000","last_fullsized":"2024-08-28T19:31:56.128358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:47:05.217199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894972+0000","last_change":"2024-08-28T19:29:46.189747+0000","last_active":"2024-08-28T19:31:27.894972+0000","last_peered":"2024-08-28T19:31:27.894972+0000","last_clean":"2024-08-28T19:31:27.894972+0000","last_became_active":"2024-08-28T19:29:46.189356+0000","last_became_peered":"2024-08-28T19:29:46.189356+0000","last_unstale":"2024-08-28T19:31:27.894972+0000","last_undegraded":"2024-08-28T19:31:27.894972+0000","last_fullsized":"2024-08-28T19:31:27.894972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.629054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902184+0000","last_change":"2024-08-28T19:29:55.572746+0000","last_active":"2024-08-28T19:31:27.902184+0000","last_peered":"2024-08-28T19:31:27.902184+0000","last_clean":"2024-08-28T19:31:27.902184+0000","last_became_active":"2024-08-28T19:29:55.572246+0000","last_became_peered":"2024-08-28T19:29:55.572246+0000","last_unstale":"2024-08-28T19:31:27.902184+0000","last_undegraded":"2024-08-28T19:31:27.902184+0000","last_fullsized":"2024-08-28T19:31:27.902184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:48:23.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.123589+0000","last_change":"2024-08-28T19:29:48.127579+0000","last_active":"2024-08-28T19:31:56.123589+0000","last_peered":"2024-08-28T19:31:56.123589+0000","last_clean":"2024-08-28T19:31:56.123589+0000","last_became_active":"2024-08-28T19:29:48.126978+0000","last_became_peered":"2024-08-28T19:29:48.126978+0000","last_unstale":"2024-08-28T19:31:56.123589+0000","last_undegraded":"2024-08-28T19:31:56.123589+0000","last_fullsized":"2024-08-28T19:31:56.123589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:27.657714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:33.616918+0000","last_change":"2024-08-28T19:29:46.102374+0000","last_active":"2024-08-28T19:32:33.616918+0000","last_peered":"2024-08-28T19:32:33.616918+0000","last_clean":"2024-08-28T19:32:33.616918+0000","last_became_active":"2024-08-28T19:29:46.101619+0000","last_became_peered":"2024-08-28T19:29:46.101619+0000","last_unstale":"2024-08-28T19:32:33.616918+0000","last_undegraded":"2024-08-28T19:32:33.616918+0000","last_fullsized":"2024-08-28T19:32:33.616918+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:46:21.353063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006989+0000","last_change":"2024-08-28T19:29:55.265403+0000","last_active":"2024-08-28T19:31:28.006989+0000","last_peered":"2024-08-28T19:31:28.006989+0000","last_clean":"2024-08-28T19:31:28.006989+0000","last_became_active":"2024-08-28T19:29:55.264979+0000","last_became_peered":"2024-08-28T19:29:55.264979+0000","last_unstale":"2024-08-28T19:31:28.006989+0000","last_undegraded":"2024-08-28T19:31:28.006989+0000","last_fullsized":"2024-08-28T19:31:28.006989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:18:18.623218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142841+0000","last_change":"2024-08-28T19:29:48.117437+0000","last_active":"2024-08-28T19:31:56.142841+0000","last_peered":"2024-08-28T19:31:56.142841+0000","last_clean":"2024-08-28T19:31:56.142841+0000","last_became_active":"2024-08-28T19:29:48.116379+0000","last_became_peered":"2024-08-28T19:29:48.116379+0000","last_unstale":"2024-08-28T19:31:56.142841+0000","last_undegraded":"2024-08-28T19:31:56.142841+0000","last_fullsized":"2024-08-28T19:31:56.142841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:23.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'7","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:31.606354+0000","last_change":"2024-08-28T19:29:46.188551+0000","last_active":"2024-08-28T19:32:31.606354+0000","last_peered":"2024-08-28T19:32:31.606354+0000","last_clean":"2024-08-28T19:32:31.606354+0000","last_became_active":"2024-08-28T19:29:46.188050+0000","last_became_peered":"2024-08-28T19:29:46.188050+0000","last_unstale":"2024-08-28T19:32:31.606354+0000","last_undegraded":"2024-08-28T19:32:31.606354+0000","last_fullsized":"2024-08-28T19:32:31.606354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:07:21.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":127,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007135+0000","last_change":"2024-08-28T19:29:55.572013+0000","last_active":"2024-08-28T19:31:28.007135+0000","last_peered":"2024-08-28T19:31:28.007135+0000","last_clean":"2024-08-28T19:31:28.007135+0000","last_became_active":"2024-08-28T19:29:55.571503+0000","last_became_peered":"2024-08-28T19:29:55.571503+0000","last_unstale":"2024-08-28T19:31:28.007135+0000","last_undegraded":"2024-08-28T19:31:28.007135+0000","last_fullsized":"2024-08-28T19:31:28.007135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:40:21.669321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134828+0000","last_change":"2024-08-28T19:29:48.124646+0000","last_active":"2024-08-28T19:31:56.134828+0000","last_peered":"2024-08-28T19:31:56.134828+0000","last_clean":"2024-08-28T19:31:56.134828+0000","last_became_active":"2024-08-28T19:29:48.123062+0000","last_became_peered":"2024-08-28T19:29:48.123062+0000","last_unstale":"2024-08-28T19:31:56.134828+0000","last_undegraded":"2024-08-28T19:31:56.134828+0000","last_fullsized":"2024-08-28T19:31:56.134828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:16:03.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007156+0000","last_change":"2024-08-28T19:29:46.105979+0000","last_active":"2024-08-28T19:31:28.007156+0000","last_peered":"2024-08-28T19:31:28.007156+0000","last_clean":"2024-08-28T19:31:28.007156+0000","last_became_active":"2024-08-28T19:29:46.105558+0000","last_became_peered":"2024-08-28T19:29:46.105558+0000","last_unstale":"2024-08-28T19:31:28.007156+0000","last_undegraded":"2024-08-28T19:31:28.007156+0000","last_fullsized":"2024-08-28T19:31:28.007156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:47.639236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896414+0000","last_change":"2024-08-28T19:29:55.574025+0000","last_active":"2024-08-28T19:31:27.896414+0000","last_peered":"2024-08-28T19:31:27.896414+0000","last_clean":"2024-08-28T19:31:27.896414+0000","last_became_active":"2024-08-28T19:29:55.573380+0000","last_became_peered":"2024-08-28T19:29:55.573380+0000","last_unstale":"2024-08-28T19:31:27.896414+0000","last_undegraded":"2024-08-28T19:31:27.896414+0000","last_fullsized":"2024-08-28T19:31:27.896414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:19:05.287692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.138839+0000","last_change":"2024-08-28T19:29:48.118606+0000","last_active":"2024-08-28T19:31:56.138839+0000","last_peered":"2024-08-28T19:31:56.138839+0000","last_clean":"2024-08-28T19:31:56.138839+0000","last_became_active":"2024-08-28T19:29:48.117534+0000","last_became_peered":"2024-08-28T19:29:48.117534+0000","last_unstale":"2024-08-28T19:31:56.138839+0000","last_undegraded":"2024-08-28T19:31:56.138839+0000","last_fullsized":"2024-08-28T19:31:56.138839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:34.253859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896326+0000","last_change":"2024-08-28T19:29:46.100420+0000","last_active":"2024-08-28T19:31:27.896326+0000","last_peered":"2024-08-28T19:31:27.896326+0000","last_clean":"2024-08-28T19:31:27.896326+0000","last_became_active":"2024-08-28T19:29:46.099990+0000","last_became_peered":"2024-08-28T19:29:46.099990+0000","last_unstale":"2024-08-28T19:31:27.896326+0000","last_undegraded":"2024-08-28T19:31:27.896326+0000","last_fullsized":"2024-08-28T19:31:27.896326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:42:12.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":113,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007243+0000","last_change":"2024-08-28T19:28:32.822169+0000","last_active":"2024-08-28T19:31:28.007243+0000","last_peered":"2024-08-28T19:31:28.007243+0000","last_clean":"2024-08-28T19:31:28.007243+0000","last_became_active":"2024-08-28T19:28:32.816300+0000","last_became_peered":"2024-08-28T19:28:32.816300+0000","last_unstale":"2024-08-28T19:31:28.007243+0000","last_undegraded":"2024-08-28T19:31:28.007243+0000","last_fullsized":"2024-08-28T19:31:28.007243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_clean_scrub_stamp":"2024-08-28T19:25:14.491568+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:41:37.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007780+0000","last_change":"2024-08-28T19:29:55.265437+0000","last_active":"2024-08-28T19:31:28.007780+0000","last_peered":"2024-08-28T19:31:28.007780+0000","last_clean":"2024-08-28T19:31:28.007780+0000","last_became_active":"2024-08-28T19:29:55.264818+0000","last_became_peered":"2024-08-28T19:29:55.264818+0000","last_unstale":"2024-08-28T19:31:28.007780+0000","last_undegraded":"2024-08-28T19:31:28.007780+0000","last_fullsized":"2024-08-28T19:31:28.007780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:28:18.684362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152410+0000","last_change":"2024-08-28T19:29:48.135800+0000","last_active":"2024-08-28T19:31:56.152410+0000","last_peered":"2024-08-28T19:31:56.152410+0000","last_clean":"2024-08-28T19:31:56.152410+0000","last_became_active":"2024-08-28T19:29:48.135258+0000","last_became_peered":"2024-08-28T19:29:48.135258+0000","last_unstale":"2024-08-28T19:31:56.152410+0000","last_undegraded":"2024-08-28T19:31:56.152410+0000","last_fullsized":"2024-08-28T19:31:56.152410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:55.183190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":177,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:31.634769+0000","last_change":"2024-08-28T19:29:46.189298+0000","last_active":"2024-08-28T19:32:31.634769+0000","last_peered":"2024-08-28T19:32:31.634769+0000","last_clean":"2024-08-28T19:32:31.634769+0000","last_became_active":"2024-08-28T19:29:46.188813+0000","last_became_peered":"2024-08-28T19:29:46.188813+0000","last_unstale":"2024-08-28T19:32:31.634769+0000","last_undegraded":"2024-08-28T19:32:31.634769+0000","last_fullsized":"2024-08-28T19:32:31.634769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:14:00.961682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899863+0000","last_change":"2024-08-28T19:29:55.269495+0000","last_active":"2024-08-28T19:31:27.899863+0000","last_peered":"2024-08-28T19:31:27.899863+0000","last_clean":"2024-08-28T19:31:27.899863+0000","last_became_active":"2024-08-28T19:29:55.268916+0000","last_became_peered":"2024-08-28T19:29:55.268916+0000","last_unstale":"2024-08-28T19:31:27.899863+0000","last_undegraded":"2024-08-28T19:31:27.899863+0000","last_fullsized":"2024-08-28T19:31:27.899863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:26:53.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143974+0000","last_change":"2024-08-28T19:29:48.127588+0000","last_active":"2024-08-28T19:31:56.143974+0000","last_peered":"2024-08-28T19:31:56.143974+0000","last_clean":"2024-08-28T19:31:56.143974+0000","last_became_active":"2024-08-28T19:29:48.127200+0000","last_became_peered":"2024-08-28T19:29:48.127200+0000","last_unstale":"2024-08-28T19:31:56.143974+0000","last_undegraded":"2024-08-28T19:31:56.143974+0000","last_fullsized":"2024-08-28T19:31:56.143974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:30:30.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'18","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:32.466538+0000","last_change":"2024-08-28T19:29:46.101010+0000","last_active":"2024-08-28T19:32:32.466538+0000","last_peered":"2024-08-28T19:32:32.466538+0000","last_clean":"2024-08-28T19:32:32.466538+0000","last_became_active":"2024-08-28T19:29:46.100082+0000","last_became_peered":"2024-08-28T19:29:46.100082+0000","last_unstale":"2024-08-28T19:32:32.466538+0000","last_undegraded":"2024-08-28T19:32:32.466538+0000","last_fullsized":"2024-08-28T19:32:32.466538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:18:51.074343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66126,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":25,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902334+0000","last_change":"2024-08-28T19:30:27.551743+0000","last_active":"2024-08-28T19:31:27.902334+0000","last_peered":"2024-08-28T19:31:27.902334+0000","last_clean":"2024-08-28T19:31:27.902334+0000","last_became_active":"2024-08-28T19:30:27.551249+0000","last_became_peered":"2024-08-28T19:30:27.551249+0000","last_unstale":"2024-08-28T19:31:27.902334+0000","last_undegraded":"2024-08-28T19:31:27.902334+0000","last_fullsized":"2024-08-28T19:31:27.902334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:35.043553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149263+0000","last_change":"2024-08-28T19:29:48.132429+0000","last_active":"2024-08-28T19:31:56.149263+0000","last_peered":"2024-08-28T19:31:56.149263+0000","last_clean":"2024-08-28T19:31:56.149263+0000","last_became_active":"2024-08-28T19:29:48.132020+0000","last_became_peered":"2024-08-28T19:29:48.132020+0000","last_unstale":"2024-08-28T19:31:56.149263+0000","last_undegraded":"2024-08-28T19:31:56.149263+0000","last_fullsized":"2024-08-28T19:31:56.149263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:45:11.992083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007247+0000","last_change":"2024-08-28T19:29:46.097245+0000","last_active":"2024-08-28T19:31:28.007247+0000","last_peered":"2024-08-28T19:31:28.007247+0000","last_clean":"2024-08-28T19:31:28.007247+0000","last_became_active":"2024-08-28T19:29:46.096867+0000","last_became_peered":"2024-08-28T19:29:46.096867+0000","last_unstale":"2024-08-28T19:31:28.007247+0000","last_undegraded":"2024-08-28T19:31:28.007247+0000","last_fullsized":"2024-08-28T19:31:28.007247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:22:14.888597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895601+0000","last_change":"2024-08-28T19:29:55.265006+0000","last_active":"2024-08-28T19:31:27.895601+0000","last_peered":"2024-08-28T19:31:27.895601+0000","last_clean":"2024-08-28T19:31:27.895601+0000","last_became_active":"2024-08-28T19:29:55.264321+0000","last_became_peered":"2024-08-28T19:29:55.264321+0000","last_unstale":"2024-08-28T19:31:27.895601+0000","last_undegraded":"2024-08-28T19:31:27.895601+0000","last_fullsized":"2024-08-28T19:31:27.895601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:53:27.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146436+0000","last_change":"2024-08-28T19:29:48.120916+0000","last_active":"2024-08-28T19:31:56.146436+0000","last_peered":"2024-08-28T19:31:56.146436+0000","last_clean":"2024-08-28T19:31:56.146436+0000","last_became_active":"2024-08-28T19:29:48.120473+0000","last_became_peered":"2024-08-28T19:29:48.120473+0000","last_unstale":"2024-08-28T19:31:56.146436+0000","last_undegraded":"2024-08-28T19:31:56.146436+0000","last_fullsized":"2024-08-28T19:31:56.146436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:15.067237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903218+0000","last_change":"2024-08-28T19:29:46.103164+0000","last_active":"2024-08-28T19:31:27.903218+0000","last_peered":"2024-08-28T19:31:27.903218+0000","last_clean":"2024-08-28T19:31:27.903218+0000","last_became_active":"2024-08-28T19:29:46.101772+0000","last_became_peered":"2024-08-28T19:29:46.101772+0000","last_unstale":"2024-08-28T19:31:27.903218+0000","last_undegraded":"2024-08-28T19:31:27.903218+0000","last_fullsized":"2024-08-28T19:31:27.903218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:46:29.533552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902200+0000","last_change":"2024-08-28T19:30:27.550861+0000","last_active":"2024-08-28T19:31:27.902200+0000","last_peered":"2024-08-28T19:31:27.902200+0000","last_clean":"2024-08-28T19:31:27.902200+0000","last_became_active":"2024-08-28T19:30:27.550131+0000","last_became_peered":"2024-08-28T19:30:27.550131+0000","last_unstale":"2024-08-28T19:31:27.902200+0000","last_undegraded":"2024-08-28T19:31:27.902200+0000","last_fullsized":"2024-08-28T19:31:27.902200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:37:16.004222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128073+0000","last_change":"2024-08-28T19:30:27.551445+0000","last_active":"2024-08-28T19:31:56.128073+0000","last_peered":"2024-08-28T19:31:56.128073+0000","last_clean":"2024-08-28T19:31:56.128073+0000","last_became_active":"2024-08-28T19:30:27.550927+0000","last_became_peered":"2024-08-28T19:30:27.550927+0000","last_unstale":"2024-08-28T19:31:56.128073+0000","last_undegraded":"2024-08-28T19:31:56.128073+0000","last_fullsized":"2024-08-28T19:31:56.128073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:52:56.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.920185+0000","last_change":"2024-08-28T19:31:27.920056+0000","last_active":"2024-08-28T19:31:27.920185+0000","last_peered":"2024-08-28T19:31:27.920185+0000","last_clean":"2024-08-28T19:31:27.920185+0000","last_became_active":"2024-08-28T19:31:27.904583+0000","last_became_peered":"2024-08-28T19:31:27.904583+0000","last_unstale":"2024-08-28T19:31:27.920185+0000","last_undegraded":"2024-08-28T19:31:27.920185+0000","last_fullsized":"2024-08-28T19:31:27.920185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:35:25.188307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007217+0000","last_change":"2024-08-28T19:29:55.266777+0000","last_active":"2024-08-28T19:31:28.007217+0000","last_peered":"2024-08-28T19:31:28.007217+0000","last_clean":"2024-08-28T19:31:28.007217+0000","last_became_active":"2024-08-28T19:29:55.266296+0000","last_became_peered":"2024-08-28T19:29:55.266296+0000","last_unstale":"2024-08-28T19:31:28.007217+0000","last_undegraded":"2024-08-28T19:31:28.007217+0000","last_fullsized":"2024-08-28T19:31:28.007217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:28:20.279522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150735+0000","last_change":"2024-08-28T19:29:48.129070+0000","last_active":"2024-08-28T19:31:56.150735+0000","last_peered":"2024-08-28T19:31:56.150735+0000","last_clean":"2024-08-28T19:31:56.150735+0000","last_became_active":"2024-08-28T19:29:48.128701+0000","last_became_peered":"2024-08-28T19:29:48.128701+0000","last_unstale":"2024-08-28T19:31:56.150735+0000","last_undegraded":"2024-08-28T19:31:56.150735+0000","last_fullsized":"2024-08-28T19:31:56.150735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:29:29.375379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:32.608545+0000","last_change":"2024-08-28T19:29:46.098281+0000","last_active":"2024-08-28T19:32:32.608545+0000","last_peered":"2024-08-28T19:32:32.608545+0000","last_clean":"2024-08-28T19:32:32.608545+0000","last_became_active":"2024-08-28T19:29:46.097870+0000","last_became_peered":"2024-08-28T19:29:46.097870+0000","last_unstale":"2024-08-28T19:32:32.608545+0000","last_undegraded":"2024-08-28T19:32:32.608545+0000","last_fullsized":"2024-08-28T19:32:32.608545+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:24:09.693310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894981+0000","last_change":"2024-08-28T19:29:55.264883+0000","last_active":"2024-08-28T19:31:27.894981+0000","last_peered":"2024-08-28T19:31:27.894981+0000","last_clean":"2024-08-28T19:31:27.894981+0000","last_became_active":"2024-08-28T19:29:55.264392+0000","last_became_peered":"2024-08-28T19:29:55.264392+0000","last_unstale":"2024-08-28T19:31:27.894981+0000","last_undegraded":"2024-08-28T19:31:27.894981+0000","last_fullsized":"2024-08-28T19:31:27.894981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:34.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150300+0000","last_change":"2024-08-28T19:29:48.135499+0000","last_active":"2024-08-28T19:31:56.150300+0000","last_peered":"2024-08-28T19:31:56.150300+0000","last_clean":"2024-08-28T19:31:56.150300+0000","last_became_active":"2024-08-28T19:29:48.134934+0000","last_became_peered":"2024-08-28T19:29:48.134934+0000","last_unstale":"2024-08-28T19:31:56.150300+0000","last_undegraded":"2024-08-28T19:31:56.150300+0000","last_fullsized":"2024-08-28T19:31:56.150300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:57:01.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895983+0000","last_change":"2024-08-28T19:29:46.104680+0000","last_active":"2024-08-28T19:31:27.895983+0000","last_peered":"2024-08-28T19:31:27.895983+0000","last_clean":"2024-08-28T19:31:27.895983+0000","last_became_active":"2024-08-28T19:29:46.104290+0000","last_became_peered":"2024-08-28T19:29:46.104290+0000","last_unstale":"2024-08-28T19:31:27.895983+0000","last_undegraded":"2024-08-28T19:31:27.895983+0000","last_fullsized":"2024-08-28T19:31:27.895983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:39.789935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899299+0000","last_change":"2024-08-28T19:29:55.264676+0000","last_active":"2024-08-28T19:31:27.899299+0000","last_peered":"2024-08-28T19:31:27.899299+0000","last_clean":"2024-08-28T19:31:27.899299+0000","last_became_active":"2024-08-28T19:29:55.264206+0000","last_became_peered":"2024-08-28T19:29:55.264206+0000","last_unstale":"2024-08-28T19:31:27.899299+0000","last_undegraded":"2024-08-28T19:31:27.899299+0000","last_fullsized":"2024-08-28T19:31:27.899299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:58:15.776366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149998+0000","last_change":"2024-08-28T19:29:48.125092+0000","last_active":"2024-08-28T19:31:56.149998+0000","last_peered":"2024-08-28T19:31:56.149998+0000","last_clean":"2024-08-28T19:31:56.149998+0000","last_became_active":"2024-08-28T19:29:48.124711+0000","last_became_peered":"2024-08-28T19:29:48.124711+0000","last_unstale":"2024-08-28T19:31:56.149998+0000","last_undegraded":"2024-08-28T19:31:56.149998+0000","last_fullsized":"2024-08-28T19:31:56.149998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:17:27.806368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902878+0000","last_change":"2024-08-28T19:29:46.100546+0000","last_active":"2024-08-28T19:31:27.902878+0000","last_peered":"2024-08-28T19:31:27.902878+0000","last_clean":"2024-08-28T19:31:27.902878+0000","last_became_active":"2024-08-28T19:29:46.100043+0000","last_became_peered":"2024-08-28T19:29:46.100043+0000","last_unstale":"2024-08-28T19:31:27.902878+0000","last_undegraded":"2024-08-28T19:31:27.902878+0000","last_fullsized":"2024-08-28T19:31:27.902878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:41:32.488258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896351+0000","last_change":"2024-08-28T19:29:55.265497+0000","last_active":"2024-08-28T19:31:27.896351+0000","last_peered":"2024-08-28T19:31:27.896351+0000","last_clean":"2024-08-28T19:31:27.896351+0000","last_became_active":"2024-08-28T19:29:55.264499+0000","last_became_peered":"2024-08-28T19:29:55.264499+0000","last_unstale":"2024-08-28T19:31:27.896351+0000","last_undegraded":"2024-08-28T19:31:27.896351+0000","last_fullsized":"2024-08-28T19:31:27.896351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:04:15.192307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139694+0000","last_change":"2024-08-28T19:29:48.133948+0000","last_active":"2024-08-28T19:31:56.139694+0000","last_peered":"2024-08-28T19:31:56.139694+0000","last_clean":"2024-08-28T19:31:56.139694+0000","last_became_active":"2024-08-28T19:29:48.133517+0000","last_became_peered":"2024-08-28T19:29:48.133517+0000","last_unstale":"2024-08-28T19:31:56.139694+0000","last_undegraded":"2024-08-28T19:31:56.139694+0000","last_fullsized":"2024-08-28T19:31:56.139694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:43:20.049931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'40","reported_seq":342,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:31.607152+0000","last_change":"2024-08-28T19:29:46.104744+0000","last_active":"2024-08-28T19:32:31.607152+0000","last_peered":"2024-08-28T19:32:31.607152+0000","last_clean":"2024-08-28T19:32:31.607152+0000","last_became_active":"2024-08-28T19:29:46.104278+0000","last_became_peered":"2024-08-28T19:29:46.104278+0000","last_unstale":"2024-08-28T19:32:31.607152+0000","last_undegraded":"2024-08-28T19:32:31.607152+0000","last_fullsized":"2024-08-28T19:32:31.607152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:36.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68002,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":199,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894437+0000","last_change":"2024-08-28T19:29:55.264892+0000","last_active":"2024-08-28T19:31:27.894437+0000","last_peered":"2024-08-28T19:31:27.894437+0000","last_clean":"2024-08-28T19:31:27.894437+0000","last_became_active":"2024-08-28T19:29:55.264466+0000","last_became_peered":"2024-08-28T19:29:55.264466+0000","last_unstale":"2024-08-28T19:31:27.894437+0000","last_undegraded":"2024-08-28T19:31:27.894437+0000","last_fullsized":"2024-08-28T19:31:27.894437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:34:51.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152034+0000","last_change":"2024-08-28T19:29:48.121692+0000","last_active":"2024-08-28T19:31:56.152034+0000","last_peered":"2024-08-28T19:31:56.152034+0000","last_clean":"2024-08-28T19:31:56.152034+0000","last_became_active":"2024-08-28T19:29:48.121274+0000","last_became_peered":"2024-08-28T19:29:48.121274+0000","last_unstale":"2024-08-28T19:31:56.152034+0000","last_undegraded":"2024-08-28T19:31:56.152034+0000","last_fullsized":"2024-08-28T19:31:56.152034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:00:36.227609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896564+0000","last_change":"2024-08-28T19:29:46.188981+0000","last_active":"2024-08-28T19:31:27.896564+0000","last_peered":"2024-08-28T19:31:27.896564+0000","last_clean":"2024-08-28T19:31:27.896564+0000","last_became_active":"2024-08-28T19:29:46.188496+0000","last_became_peered":"2024-08-28T19:29:46.188496+0000","last_unstale":"2024-08-28T19:31:27.896564+0000","last_undegraded":"2024-08-28T19:31:27.896564+0000","last_fullsized":"2024-08-28T19:31:27.896564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.689602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896238+0000","last_change":"2024-08-28T19:30:27.552006+0000","last_active":"2024-08-28T19:31:27.896238+0000","last_peered":"2024-08-28T19:31:27.896238+0000","last_clean":"2024-08-28T19:31:27.896238+0000","last_became_active":"2024-08-28T19:30:27.551356+0000","last_became_peered":"2024-08-28T19:30:27.551356+0000","last_unstale":"2024-08-28T19:31:27.896238+0000","last_undegraded":"2024-08-28T19:31:27.896238+0000","last_fullsized":"2024-08-28T19:31:27.896238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:56:09.242401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144743+0000","last_change":"2024-08-28T19:29:48.116964+0000","last_active":"2024-08-28T19:31:56.144743+0000","last_peered":"2024-08-28T19:31:56.144743+0000","last_clean":"2024-08-28T19:31:56.144743+0000","last_became_active":"2024-08-28T19:29:48.116588+0000","last_became_peered":"2024-08-28T19:29:48.116588+0000","last_unstale":"2024-08-28T19:31:56.144743+0000","last_undegraded":"2024-08-28T19:31:56.144743+0000","last_fullsized":"2024-08-28T19:31:56.144743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:52:02.486724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007960+0000","last_change":"2024-08-28T19:29:46.104132+0000","last_active":"2024-08-28T19:31:28.007960+0000","last_peered":"2024-08-28T19:31:28.007960+0000","last_clean":"2024-08-28T19:31:28.007960+0000","last_became_active":"2024-08-28T19:29:46.103725+0000","last_became_peered":"2024-08-28T19:29:46.103725+0000","last_unstale":"2024-08-28T19:31:28.007960+0000","last_undegraded":"2024-08-28T19:31:28.007960+0000","last_fullsized":"2024-08-28T19:31:28.007960+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:50:12.859989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894212+0000","last_change":"2024-08-28T19:29:55.265494+0000","last_active":"2024-08-28T19:31:27.894212+0000","last_peered":"2024-08-28T19:31:27.894212+0000","last_clean":"2024-08-28T19:31:27.894212+0000","last_became_active":"2024-08-28T19:29:55.265087+0000","last_became_peered":"2024-08-28T19:29:55.265087+0000","last_unstale":"2024-08-28T19:31:27.894212+0000","last_undegraded":"2024-08-28T19:31:27.894212+0000","last_fullsized":"2024-08-28T19:31:27.894212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:51:18.676889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152669+0000","last_change":"2024-08-28T19:29:48.127419+0000","last_active":"2024-08-28T19:31:56.152669+0000","last_peered":"2024-08-28T19:31:56.152669+0000","last_clean":"2024-08-28T19:31:56.152669+0000","last_became_active":"2024-08-28T19:29:48.126997+0000","last_became_peered":"2024-08-28T19:29:48.126997+0000","last_unstale":"2024-08-28T19:31:56.152669+0000","last_undegraded":"2024-08-28T19:31:56.152669+0000","last_fullsized":"2024-08-28T19:31:56.152669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:26:08.208724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:31.607109+0000","last_change":"2024-08-28T19:29:46.103451+0000","last_active":"2024-08-28T19:32:31.607109+0000","last_peered":"2024-08-28T19:32:31.607109+0000","last_clean":"2024-08-28T19:32:31.607109+0000","last_became_active":"2024-08-28T19:29:46.102991+0000","last_became_peered":"2024-08-28T19:29:46.102991+0000","last_unstale":"2024-08-28T19:32:31.607109+0000","last_undegraded":"2024-08-28T19:32:31.607109+0000","last_fullsized":"2024-08-28T19:32:31.607109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:55:58.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":250,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901836+0000","last_change":"2024-08-28T19:29:55.269310+0000","last_active":"2024-08-28T19:31:27.901836+0000","last_peered":"2024-08-28T19:31:27.901836+0000","last_clean":"2024-08-28T19:31:27.901836+0000","last_became_active":"2024-08-28T19:29:55.268893+0000","last_became_peered":"2024-08-28T19:29:55.268893+0000","last_unstale":"2024-08-28T19:31:27.901836+0000","last_undegraded":"2024-08-28T19:31:27.901836+0000","last_fullsized":"2024-08-28T19:31:27.901836+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:26:11.598773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902085+0000","last_change":"2024-08-28T19:29:55.261757+0000","last_active":"2024-08-28T19:31:27.902085+0000","last_peered":"2024-08-28T19:31:27.902085+0000","last_clean":"2024-08-28T19:31:27.902085+0000","last_became_active":"2024-08-28T19:29:55.261339+0000","last_became_peered":"2024-08-28T19:29:55.261339+0000","last_unstale":"2024-08-28T19:31:27.902085+0000","last_undegraded":"2024-08-28T19:31:27.902085+0000","last_fullsized":"2024-08-28T19:31:27.902085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:25:06.223029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.130201+0000","last_change":"2024-08-28T19:29:48.123097+0000","last_active":"2024-08-28T19:31:56.130201+0000","last_peered":"2024-08-28T19:31:56.130201+0000","last_clean":"2024-08-28T19:31:56.130201+0000","last_became_active":"2024-08-28T19:29:48.122718+0000","last_became_peered":"2024-08-28T19:29:48.122718+0000","last_unstale":"2024-08-28T19:31:56.130201+0000","last_undegraded":"2024-08-28T19:31:56.130201+0000","last_fullsized":"2024-08-28T19:31:56.130201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:19.530985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896115+0000","last_change":"2024-08-28T19:29:46.105516+0000","last_active":"2024-08-28T19:31:27.896115+0000","last_peered":"2024-08-28T19:31:27.896115+0000","last_clean":"2024-08-28T19:31:27.896115+0000","last_became_active":"2024-08-28T19:29:46.105030+0000","last_became_peered":"2024-08-28T19:29:46.105030+0000","last_unstale":"2024-08-28T19:31:27.896115+0000","last_undegraded":"2024-08-28T19:31:27.896115+0000","last_fullsized":"2024-08-28T19:31:27.896115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:47:02.032933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899627+0000","last_change":"2024-08-28T19:29:55.269759+0000","last_active":"2024-08-28T19:31:27.899627+0000","last_peered":"2024-08-28T19:31:27.899627+0000","last_clean":"2024-08-28T19:31:27.899627+0000","last_became_active":"2024-08-28T19:29:55.269275+0000","last_became_peered":"2024-08-28T19:29:55.269275+0000","last_unstale":"2024-08-28T19:31:27.899627+0000","last_undegraded":"2024-08-28T19:31:27.899627+0000","last_fullsized":"2024-08-28T19:31:27.899627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:45.870468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131493+0000","last_change":"2024-08-28T19:29:48.117400+0000","last_active":"2024-08-28T19:31:56.131493+0000","last_peered":"2024-08-28T19:31:56.131493+0000","last_clean":"2024-08-28T19:31:56.131493+0000","last_became_active":"2024-08-28T19:29:48.116987+0000","last_became_peered":"2024-08-28T19:29:48.116987+0000","last_unstale":"2024-08-28T19:31:56.131493+0000","last_undegraded":"2024-08-28T19:31:56.131493+0000","last_fullsized":"2024-08-28T19:31:56.131493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:43.822088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006521+0000","last_change":"2024-08-28T19:29:46.096103+0000","last_active":"2024-08-28T19:31:28.006521+0000","last_peered":"2024-08-28T19:31:28.006521+0000","last_clean":"2024-08-28T19:31:28.006521+0000","last_became_active":"2024-08-28T19:29:46.095812+0000","last_became_peered":"2024-08-28T19:29:46.095812+0000","last_unstale":"2024-08-28T19:31:28.006521+0000","last_undegraded":"2024-08-28T19:31:28.006521+0000","last_fullsized":"2024-08-28T19:31:28.006521+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:29.266636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007661+0000","last_change":"2024-08-28T19:29:46.106227+0000","last_active":"2024-08-28T19:31:28.007661+0000","last_peered":"2024-08-28T19:31:28.007661+0000","last_clean":"2024-08-28T19:31:28.007661+0000","last_became_active":"2024-08-28T19:29:46.105777+0000","last_became_peered":"2024-08-28T19:29:46.105777+0000","last_unstale":"2024-08-28T19:31:28.007661+0000","last_undegraded":"2024-08-28T19:31:28.007661+0000","last_fullsized":"2024-08-28T19:31:28.007661+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:26:14.815646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144860+0000","last_change":"2024-08-28T19:29:48.111051+0000","last_active":"2024-08-28T19:31:56.144860+0000","last_peered":"2024-08-28T19:31:56.144860+0000","last_clean":"2024-08-28T19:31:56.144860+0000","last_became_active":"2024-08-28T19:29:48.110421+0000","last_became_peered":"2024-08-28T19:29:48.110421+0000","last_unstale":"2024-08-28T19:31:56.144860+0000","last_undegraded":"2024-08-28T19:31:56.144860+0000","last_fullsized":"2024-08-28T19:31:56.144860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:19:47.765977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902713+0000","last_change":"2024-08-28T19:30:27.408829+0000","last_active":"2024-08-28T19:31:27.902713+0000","last_peered":"2024-08-28T19:31:27.902713+0000","last_clean":"2024-08-28T19:31:27.902713+0000","last_became_active":"2024-08-28T19:30:27.408298+0000","last_became_peered":"2024-08-28T19:30:27.408298+0000","last_unstale":"2024-08-28T19:31:27.902713+0000","last_undegraded":"2024-08-28T19:31:27.902713+0000","last_fullsized":"2024-08-28T19:31:27.902713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:38:58.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":172,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:30.606139+0000","last_change":"2024-08-28T19:29:46.102607+0000","last_active":"2024-08-28T19:32:30.606139+0000","last_peered":"2024-08-28T19:32:30.606139+0000","last_clean":"2024-08-28T19:32:30.606139+0000","last_became_active":"2024-08-28T19:29:46.102150+0000","last_became_peered":"2024-08-28T19:29:46.102150+0000","last_unstale":"2024-08-28T19:32:30.606139+0000","last_undegraded":"2024-08-28T19:32:30.606139+0000","last_fullsized":"2024-08-28T19:32:30.606139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:44.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128134+0000","last_change":"2024-08-28T19:29:48.121598+0000","last_active":"2024-08-28T19:31:56.128134+0000","last_peered":"2024-08-28T19:31:56.128134+0000","last_clean":"2024-08-28T19:31:56.128134+0000","last_became_active":"2024-08-28T19:29:48.121189+0000","last_became_peered":"2024-08-28T19:29:48.121189+0000","last_unstale":"2024-08-28T19:31:56.128134+0000","last_undegraded":"2024-08-28T19:31:56.128134+0000","last_fullsized":"2024-08-28T19:31:56.128134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:19:35.496859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903566+0000","last_change":"2024-08-28T19:29:55.269648+0000","last_active":"2024-08-28T19:31:27.903566+0000","last_peered":"2024-08-28T19:31:27.903566+0000","last_clean":"2024-08-28T19:31:27.903566+0000","last_became_active":"2024-08-28T19:29:55.269182+0000","last_became_peered":"2024-08-28T19:29:55.269182+0000","last_unstale":"2024-08-28T19:31:27.903566+0000","last_undegraded":"2024-08-28T19:31:27.903566+0000","last_fullsized":"2024-08-28T19:31:27.903566+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:09:47.581907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146872+0000","last_change":"2024-08-28T19:29:48.117143+0000","last_active":"2024-08-28T19:31:56.146872+0000","last_peered":"2024-08-28T19:31:56.146872+0000","last_clean":"2024-08-28T19:31:56.146872+0000","last_became_active":"2024-08-28T19:29:48.116756+0000","last_became_peered":"2024-08-28T19:29:48.116756+0000","last_unstale":"2024-08-28T19:31:56.146872+0000","last_undegraded":"2024-08-28T19:31:56.146872+0000","last_fullsized":"2024-08-28T19:31:56.146872+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:03:30.736872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141006+0000","last_change":"2024-08-28T19:30:27.407218+0000","last_active":"2024-08-28T19:31:56.141006+0000","last_peered":"2024-08-28T19:31:56.141006+0000","last_clean":"2024-08-28T19:31:56.141006+0000","last_became_active":"2024-08-28T19:30:27.406769+0000","last_became_peered":"2024-08-28T19:30:27.406769+0000","last_unstale":"2024-08-28T19:31:56.141006+0000","last_undegraded":"2024-08-28T19:31:56.141006+0000","last_fullsized":"2024-08-28T19:31:56.141006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:59.946922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135902+0000","last_change":"2024-08-28T19:29:48.123969+0000","last_active":"2024-08-28T19:31:56.135902+0000","last_peered":"2024-08-28T19:31:56.135902+0000","last_clean":"2024-08-28T19:31:56.135902+0000","last_became_active":"2024-08-28T19:29:48.122534+0000","last_became_peered":"2024-08-28T19:29:48.122534+0000","last_unstale":"2024-08-28T19:31:56.135902+0000","last_undegraded":"2024-08-28T19:31:56.135902+0000","last_fullsized":"2024-08-28T19:31:56.135902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:33:56.739763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132732+0000","last_change":"2024-08-28T19:29:48.108976+0000","last_active":"2024-08-28T19:31:56.132732+0000","last_peered":"2024-08-28T19:31:56.132732+0000","last_clean":"2024-08-28T19:31:56.132732+0000","last_became_active":"2024-08-28T19:29:48.108631+0000","last_became_peered":"2024-08-28T19:29:48.108631+0000","last_unstale":"2024-08-28T19:31:56.132732+0000","last_undegraded":"2024-08-28T19:31:56.132732+0000","last_fullsized":"2024-08-28T19:31:56.132732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:08:59.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131974+0000","last_change":"2024-08-28T19:29:48.109875+0000","last_active":"2024-08-28T19:31:56.131974+0000","last_peered":"2024-08-28T19:31:56.131974+0000","last_clean":"2024-08-28T19:31:56.131974+0000","last_became_active":"2024-08-28T19:29:48.109486+0000","last_became_peered":"2024-08-28T19:29:48.109486+0000","last_unstale":"2024-08-28T19:31:56.131974+0000","last_undegraded":"2024-08-28T19:31:56.131974+0000","last_fullsized":"2024-08-28T19:31:56.131974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:02:28.365203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146393+0000","last_change":"2024-08-28T19:29:48.117237+0000","last_active":"2024-08-28T19:31:56.146393+0000","last_peered":"2024-08-28T19:31:56.146393+0000","last_clean":"2024-08-28T19:31:56.146393+0000","last_became_active":"2024-08-28T19:29:48.116799+0000","last_became_peered":"2024-08-28T19:29:48.116799+0000","last_unstale":"2024-08-28T19:31:56.146393+0000","last_undegraded":"2024-08-28T19:31:56.146393+0000","last_fullsized":"2024-08-28T19:31:56.146393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:48:12.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144924+0000","last_change":"2024-08-28T19:29:48.120522+0000","last_active":"2024-08-28T19:31:56.144924+0000","last_peered":"2024-08-28T19:31:56.144924+0000","last_clean":"2024-08-28T19:31:56.144924+0000","last_became_active":"2024-08-28T19:29:48.120150+0000","last_became_peered":"2024-08-28T19:29:48.120150+0000","last_unstale":"2024-08-28T19:31:56.144924+0000","last_undegraded":"2024-08-28T19:31:56.144924+0000","last_fullsized":"2024-08-28T19:31:56.144924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:01:00.210596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.126169+0000","last_change":"2024-08-28T19:29:48.128451+0000","last_active":"2024-08-28T19:31:56.126169+0000","last_peered":"2024-08-28T19:31:56.126169+0000","last_clean":"2024-08-28T19:31:56.126169+0000","last_became_active":"2024-08-28T19:29:48.127898+0000","last_became_peered":"2024-08-28T19:29:48.127898+0000","last_unstale":"2024-08-28T19:31:56.126169+0000","last_undegraded":"2024-08-28T19:31:56.126169+0000","last_fullsized":"2024-08-28T19:31:56.126169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:48.663999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142755+0000","last_change":"2024-08-28T19:29:48.110788+0000","last_active":"2024-08-28T19:31:56.142755+0000","last_peered":"2024-08-28T19:31:56.142755+0000","last_clean":"2024-08-28T19:31:56.142755+0000","last_became_active":"2024-08-28T19:29:48.110355+0000","last_became_peered":"2024-08-28T19:29:48.110355+0000","last_unstale":"2024-08-28T19:31:56.142755+0000","last_undegraded":"2024-08-28T19:31:56.142755+0000","last_fullsized":"2024-08-28T19:31:56.142755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:57:25.345283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141195+0000","last_change":"2024-08-28T19:29:48.129667+0000","last_active":"2024-08-28T19:31:56.141195+0000","last_peered":"2024-08-28T19:31:56.141195+0000","last_clean":"2024-08-28T19:31:56.141195+0000","last_became_active":"2024-08-28T19:29:48.128237+0000","last_became_peered":"2024-08-28T19:29:48.128237+0000","last_unstale":"2024-08-28T19:31:56.141195+0000","last_undegraded":"2024-08-28T19:31:56.141195+0000","last_fullsized":"2024-08-28T19:31:56.141195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:23:35.920353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151419+0000","last_change":"2024-08-28T19:29:48.136070+0000","last_active":"2024-08-28T19:31:56.151419+0000","last_peered":"2024-08-28T19:31:56.151419+0000","last_clean":"2024-08-28T19:31:56.151419+0000","last_became_active":"2024-08-28T19:29:48.135515+0000","last_became_peered":"2024-08-28T19:29:48.135515+0000","last_unstale":"2024-08-28T19:31:56.151419+0000","last_undegraded":"2024-08-28T19:31:56.151419+0000","last_fullsized":"2024-08-28T19:31:56.151419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:25:29.267753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150677+0000","last_change":"2024-08-28T19:29:48.128614+0000","last_active":"2024-08-28T19:31:56.150677+0000","last_peered":"2024-08-28T19:31:56.150677+0000","last_clean":"2024-08-28T19:31:56.150677+0000","last_became_active":"2024-08-28T19:29:48.128231+0000","last_became_peered":"2024-08-28T19:29:48.128231+0000","last_unstale":"2024-08-28T19:31:56.150677+0000","last_undegraded":"2024-08-28T19:31:56.150677+0000","last_fullsized":"2024-08-28T19:31:56.150677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:11:08.541435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143953+0000","last_change":"2024-08-28T19:29:48.114930+0000","last_active":"2024-08-28T19:31:56.143953+0000","last_peered":"2024-08-28T19:31:56.143953+0000","last_clean":"2024-08-28T19:31:56.143953+0000","last_became_active":"2024-08-28T19:29:48.114389+0000","last_became_peered":"2024-08-28T19:29:48.114389+0000","last_unstale":"2024-08-28T19:31:56.143953+0000","last_undegraded":"2024-08-28T19:31:56.143953+0000","last_fullsized":"2024-08-28T19:31:56.143953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:51.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141213+0000","last_change":"2024-08-28T19:29:48.125031+0000","last_active":"2024-08-28T19:31:56.141213+0000","last_peered":"2024-08-28T19:31:56.141213+0000","last_clean":"2024-08-28T19:31:56.141213+0000","last_became_active":"2024-08-28T19:29:48.124417+0000","last_became_peered":"2024-08-28T19:29:48.124417+0000","last_unstale":"2024-08-28T19:31:56.141213+0000","last_undegraded":"2024-08-28T19:31:56.141213+0000","last_fullsized":"2024-08-28T19:31:56.141213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:33:33.931496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143690+0000","last_change":"2024-08-28T19:29:48.127815+0000","last_active":"2024-08-28T19:31:56.143690+0000","last_peered":"2024-08-28T19:31:56.143690+0000","last_clean":"2024-08-28T19:31:56.143690+0000","last_became_active":"2024-08-28T19:29:48.127455+0000","last_became_peered":"2024-08-28T19:29:48.127455+0000","last_unstale":"2024-08-28T19:31:56.143690+0000","last_undegraded":"2024-08-28T19:31:56.143690+0000","last_fullsized":"2024-08-28T19:31:56.143690+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:47:23.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142376+0000","last_change":"2024-08-28T19:29:48.122105+0000","last_active":"2024-08-28T19:31:56.142376+0000","last_peered":"2024-08-28T19:31:56.142376+0000","last_clean":"2024-08-28T19:31:56.142376+0000","last_became_active":"2024-08-28T19:29:48.121546+0000","last_became_peered":"2024-08-28T19:29:48.121546+0000","last_unstale":"2024-08-28T19:31:56.142376+0000","last_undegraded":"2024-08-28T19:31:56.142376+0000","last_fullsized":"2024-08-28T19:31:56.142376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:21:00.428052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151147+0000","last_change":"2024-08-28T19:29:48.136198+0000","last_active":"2024-08-28T19:31:56.151147+0000","last_peered":"2024-08-28T19:31:56.151147+0000","last_clean":"2024-08-28T19:31:56.151147+0000","last_became_active":"2024-08-28T19:29:48.135796+0000","last_became_peered":"2024-08-28T19:29:48.135796+0000","last_unstale":"2024-08-28T19:31:56.151147+0000","last_undegraded":"2024-08-28T19:31:56.151147+0000","last_fullsized":"2024-08-28T19:31:56.151147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:05.033399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134895+0000","last_change":"2024-08-28T19:29:48.121245+0000","last_active":"2024-08-28T19:31:56.134895+0000","last_peered":"2024-08-28T19:31:56.134895+0000","last_clean":"2024-08-28T19:31:56.134895+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.134895+0000","last_undegraded":"2024-08-28T19:31:56.134895+0000","last_fullsized":"2024-08-28T19:31:56.134895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:39.936209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132329+0000","last_change":"2024-08-28T19:29:48.119198+0000","last_active":"2024-08-28T19:31:56.132329+0000","last_peered":"2024-08-28T19:31:56.132329+0000","last_clean":"2024-08-28T19:31:56.132329+0000","last_became_active":"2024-08-28T19:29:48.118744+0000","last_became_peered":"2024-08-28T19:29:48.118744+0000","last_unstale":"2024-08-28T19:31:56.132329+0000","last_undegraded":"2024-08-28T19:31:56.132329+0000","last_fullsized":"2024-08-28T19:31:56.132329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:15:35.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131834+0000","last_change":"2024-08-28T19:30:27.403790+0000","last_active":"2024-08-28T19:31:56.131834+0000","last_peered":"2024-08-28T19:31:56.131834+0000","last_clean":"2024-08-28T19:31:56.131834+0000","last_became_active":"2024-08-28T19:30:27.403279+0000","last_became_peered":"2024-08-28T19:30:27.403279+0000","last_unstale":"2024-08-28T19:31:56.131834+0000","last_undegraded":"2024-08-28T19:31:56.131834+0000","last_fullsized":"2024-08-28T19:31:56.131834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:31:54.137839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128885+0000","last_change":"2024-08-28T19:30:27.405173+0000","last_active":"2024-08-28T19:31:56.128885+0000","last_peered":"2024-08-28T19:31:56.128885+0000","last_clean":"2024-08-28T19:31:56.128885+0000","last_became_active":"2024-08-28T19:30:27.404752+0000","last_became_peered":"2024-08-28T19:30:27.404752+0000","last_unstale":"2024-08-28T19:31:56.128885+0000","last_undegraded":"2024-08-28T19:31:56.128885+0000","last_fullsized":"2024-08-28T19:31:56.128885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:16.544309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152246+0000","last_change":"2024-08-28T19:29:48.136738+0000","last_active":"2024-08-28T19:31:56.152246+0000","last_peered":"2024-08-28T19:31:56.152246+0000","last_clean":"2024-08-28T19:31:56.152246+0000","last_became_active":"2024-08-28T19:29:48.136046+0000","last_became_peered":"2024-08-28T19:29:48.136046+0000","last_unstale":"2024-08-28T19:31:56.152246+0000","last_undegraded":"2024-08-28T19:31:56.152246+0000","last_fullsized":"2024-08-28T19:31:56.152246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:43:32.905933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.127788+0000","last_change":"2024-08-28T19:29:48.127432+0000","last_active":"2024-08-28T19:31:56.127788+0000","last_peered":"2024-08-28T19:31:56.127788+0000","last_clean":"2024-08-28T19:31:56.127788+0000","last_became_active":"2024-08-28T19:29:48.126067+0000","last_became_peered":"2024-08-28T19:29:48.126067+0000","last_unstale":"2024-08-28T19:31:56.127788+0000","last_undegraded":"2024-08-28T19:31:56.127788+0000","last_fullsized":"2024-08-28T19:31:56.127788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:30:05.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152540+0000","last_change":"2024-08-28T19:29:48.121154+0000","last_active":"2024-08-28T19:31:56.152540+0000","last_peered":"2024-08-28T19:31:56.152540+0000","last_clean":"2024-08-28T19:31:56.152540+0000","last_became_active":"2024-08-28T19:29:48.120709+0000","last_became_peered":"2024-08-28T19:29:48.120709+0000","last_unstale":"2024-08-28T19:31:56.152540+0000","last_undegraded":"2024-08-28T19:31:56.152540+0000","last_fullsized":"2024-08-28T19:31:56.152540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:52.716814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144107+0000","last_change":"2024-08-28T19:29:48.127124+0000","last_active":"2024-08-28T19:31:56.144107+0000","last_peered":"2024-08-28T19:31:56.144107+0000","last_clean":"2024-08-28T19:31:56.144107+0000","last_became_active":"2024-08-28T19:29:48.126761+0000","last_became_peered":"2024-08-28T19:29:48.126761+0000","last_unstale":"2024-08-28T19:31:56.144107+0000","last_undegraded":"2024-08-28T19:31:56.144107+0000","last_fullsized":"2024-08-28T19:31:56.144107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:05:31.150472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150014+0000","last_change":"2024-08-28T19:29:48.132285+0000","last_active":"2024-08-28T19:31:56.150014+0000","last_peered":"2024-08-28T19:31:56.150014+0000","last_clean":"2024-08-28T19:31:56.150014+0000","last_became_active":"2024-08-28T19:29:48.131688+0000","last_became_peered":"2024-08-28T19:29:48.131688+0000","last_unstale":"2024-08-28T19:31:56.150014+0000","last_undegraded":"2024-08-28T19:31:56.150014+0000","last_fullsized":"2024-08-28T19:31:56.150014+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:23:08.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.124596+0000","last_change":"2024-08-28T19:29:48.126384+0000","last_active":"2024-08-28T19:31:56.124596+0000","last_peered":"2024-08-28T19:31:56.124596+0000","last_clean":"2024-08-28T19:31:56.124596+0000","last_became_active":"2024-08-28T19:29:48.125412+0000","last_became_peered":"2024-08-28T19:29:48.125412+0000","last_unstale":"2024-08-28T19:31:56.124596+0000","last_undegraded":"2024-08-28T19:31:56.124596+0000","last_fullsized":"2024-08-28T19:31:56.124596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:47:42.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125963+0000","last_change":"2024-08-28T19:29:48.114032+0000","last_active":"2024-08-28T19:31:56.125963+0000","last_peered":"2024-08-28T19:31:56.125963+0000","last_clean":"2024-08-28T19:31:56.125963+0000","last_became_active":"2024-08-28T19:29:48.113625+0000","last_became_peered":"2024-08-28T19:29:48.113625+0000","last_unstale":"2024-08-28T19:31:56.125963+0000","last_undegraded":"2024-08-28T19:31:56.125963+0000","last_fullsized":"2024-08-28T19:31:56.125963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:07:08.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131499+0000","last_change":"2024-08-28T19:29:48.124046+0000","last_active":"2024-08-28T19:31:56.131499+0000","last_peered":"2024-08-28T19:31:56.131499+0000","last_clean":"2024-08-28T19:31:56.131499+0000","last_became_active":"2024-08-28T19:29:48.123647+0000","last_became_peered":"2024-08-28T19:29:48.123647+0000","last_unstale":"2024-08-28T19:31:56.131499+0000","last_undegraded":"2024-08-28T19:31:56.131499+0000","last_fullsized":"2024-08-28T19:31:56.131499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:59.262454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148165+0000","last_change":"2024-08-28T19:29:48.121258+0000","last_active":"2024-08-28T19:31:56.148165+0000","last_peered":"2024-08-28T19:31:56.148165+0000","last_clean":"2024-08-28T19:31:56.148165+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.148165+0000","last_undegraded":"2024-08-28T19:31:56.148165+0000","last_fullsized":"2024-08-28T19:31:56.148165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:37:05.610466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.129860+0000","last_change":"2024-08-28T19:29:48.125071+0000","last_active":"2024-08-28T19:31:56.129860+0000","last_peered":"2024-08-28T19:31:56.129860+0000","last_clean":"2024-08-28T19:31:56.129860+0000","last_became_active":"2024-08-28T19:29:48.124706+0000","last_became_peered":"2024-08-28T19:29:48.124706+0000","last_unstale":"2024-08-28T19:31:56.129860+0000","last_undegraded":"2024-08-28T19:31:56.129860+0000","last_fullsized":"2024-08-28T19:31:56.129860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:39:06.460682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141807+0000","last_change":"2024-08-28T19:29:48.121905+0000","last_active":"2024-08-28T19:31:56.141807+0000","last_peered":"2024-08-28T19:31:56.141807+0000","last_clean":"2024-08-28T19:31:56.141807+0000","last_became_active":"2024-08-28T19:29:48.121045+0000","last_became_peered":"2024-08-28T19:29:48.121045+0000","last_unstale":"2024-08-28T19:31:56.141807+0000","last_undegraded":"2024-08-28T19:31:56.141807+0000","last_fullsized":"2024-08-28T19:31:56.141807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:56:58.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":535068,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1388,"num_read_kb":806,"num_write":343,"num_write_kb":999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1605252,"data_compressed":65670,"data_compressed_allocated":86016,"data_compressed_original":1339392,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246047,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776175,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":496720,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939699,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":1151734,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103225,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":500102,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299454,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":496272,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495682,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1093330,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659208,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":491510,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855437,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1019904,"data_stored":1088072,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018961,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":496424,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215190,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":1278210,"data_compressed":67079,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411419,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":561294,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542240,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":560542,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":493498,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":787422,"data_compressed":37380,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":68876,"data_compressed":3087,"data_compressed_allocated":4096,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19148,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":202178,"data_compressed":6055,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T19:32:36.615 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T19:32:36.869 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:37.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.368+0000 7f437071f640 1 -- 172.21.15.33:0/2671644735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4368108140 msgr2=0x7f4368108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:37.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.368+0000 7f437071f640 1 --2- 172.21.15.33:0/2671644735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4368108140 0x7f4368108550 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f435c009900 tx=0x7f435c02a410 comp rx=0 tx=0).stop 2024-08-28T19:32:37.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.368+0000 7f437071f640 1 -- 172.21.15.33:0/2671644735 shutdown_connections 2024-08-28T19:32:37.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.368+0000 7f437071f640 1 --2- 172.21.15.33:0/2671644735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4368108a90 0x7f436810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:37.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.368+0000 7f437071f640 1 --2- 172.21.15.33:0/2671644735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4368108140 0x7f4368108550 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:37.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.368+0000 7f437071f640 1 --2- 172.21.15.33:0/2671644735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4368102800 0x7f4368102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:37.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.368+0000 7f437071f640 1 -- 172.21.15.33:0/2671644735 >> 172.21.15.33:0/2671644735 conn(0x7f43680794d0 msgr2=0x7f43680798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:37.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.368+0000 7f437071f640 1 -- 172.21.15.33:0/2671644735 shutdown_connections 2024-08-28T19:32:37.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.368+0000 7f437071f640 1 -- 172.21.15.33:0/2671644735 wait complete. 2024-08-28T19:32:37.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f437071f640 1 Processor -- start 2024-08-28T19:32:37.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f437071f640 1 -- start start 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f437071f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4368102800 0x7f436819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f437071f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4368108140 0x7f436819a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f437071f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4368108a90 0x7f436819fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f437071f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f43681126c0 con 0x7f4368102800 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f437071f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4368112540 con 0x7f4368108a90 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f437071f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4368112840 con 0x7f4368108140 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436e4bb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4368102800 0x7f436819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436e4bb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4368102800 0x7f436819a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39152/0 (socket says 172.21.15.33:39152) 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436e4bb640 1 -- 172.21.15.33:0/481650395 learned_addr learned my addr 172.21.15.33:0/481650395 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436dcba640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4368108140 0x7f436819a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436ecbc640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4368108a90 0x7f436819fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:37.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436e4bb640 1 -- 172.21.15.33:0/481650395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4368108140 msgr2=0x7f436819a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436e4bb640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4368108140 0x7f436819a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436e4bb640 1 -- 172.21.15.33:0/481650395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4368108a90 msgr2=0x7f436819fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436e4bb640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4368108a90 0x7f436819fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436e4bb640 1 -- 172.21.15.33:0/481650395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43681a0190 con 0x7f4368102800 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.369+0000 7f436ecbc640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4368108a90 0x7f436819fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.370+0000 7f436e4bb640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4368102800 0x7f436819a2e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f436400d950 tx=0x7f436400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.370+0000 7f435b7fe640 1 -- 172.21.15.33:0/481650395 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364017070 con 0x7f4368102800 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.370+0000 7f437071f640 1 -- 172.21.15.33:0/481650395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43681a0480 con 0x7f4368102800 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.370+0000 7f435b7fe640 1 -- 172.21.15.33:0/481650395 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4364009c30 con 0x7f4368102800 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.370+0000 7f435b7fe640 1 -- 172.21.15.33:0/481650395 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436400f620 con 0x7f4368102800 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.370+0000 7f437071f640 1 -- 172.21.15.33:0/481650395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43681a6ca0 con 0x7f4368102800 2024-08-28T19:32:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.371+0000 7f437071f640 1 -- 172.21.15.33:0/481650395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4368102c10 con 0x7f4368102800 2024-08-28T19:32:37.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.372+0000 7f435b7fe640 1 -- 172.21.15.33:0/481650395 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f4364010460 con 0x7f4368102800 2024-08-28T19:32:37.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.373+0000 7f435b7fe640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43540b4c40 0x7f43540b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:37.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.373+0000 7f436dcba640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43540b4c40 0x7f43540b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:37.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.373+0000 7f435b7fe640 1 -- 172.21.15.33:0/481650395 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f43640e5410 con 0x7f4368102800 2024-08-28T19:32:37.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.374+0000 7f436dcba640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43540b4c40 0x7f43540b7150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f435c000c00 tx=0x7f435c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:37.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.377+0000 7f435b7fe640 1 -- 172.21.15.33:0/481650395 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f43640abf10 con 0x7f4368102800 2024-08-28T19:32:37.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.558+0000 7f437071f640 1 -- 172.21.15.33:0/481650395 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43680635a0 con 0x7f43540b4c40 2024-08-28T19:32:37.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:37 smithi033 ceph-mon[18549]: pgmap v347: 129 pgs: 129 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 71 KiB/s wr, 23 op/s 2024-08-28T19:32:37.560 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:37 smithi033 ceph-mon[18549]: from='client.15657 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:37.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.564+0000 7f435b7fe640 1 -- 172.21.15.33:0/481650395 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340866 (secure 0 0 0) 0x7f43680635a0 con 0x7f43540b4c40 2024-08-28T19:32:37.569 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:37.570 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-28T19:32:37.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 -- 172.21.15.33:0/481650395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43540b4c40 msgr2=0x7f43540b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:37.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43540b4c40 0x7f43540b7150 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f435c000c00 tx=0x7f435c031400 comp rx=0 tx=0).stop 2024-08-28T19:32:37.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 -- 172.21.15.33:0/481650395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4368102800 msgr2=0x7f436819a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:37.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4368102800 0x7f436819a2e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f436400d950 tx=0x7f436400de10 comp rx=0 tx=0).stop 2024-08-28T19:32:37.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 -- 172.21.15.33:0/481650395 shutdown_connections 2024-08-28T19:32:37.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4368108a90 0x7f436819fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:37.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43540b4c40 0x7f43540b7150 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:37.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4368108140 0x7f436819a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:37.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 --2- 172.21.15.33:0/481650395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4368102800 0x7f436819a2e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:37.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 -- 172.21.15.33:0/481650395 >> 172.21.15.33:0/481650395 conn(0x7f43680794d0 msgr2=0x7f436806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:37.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 -- 172.21.15.33:0/481650395 shutdown_connections 2024-08-28T19:32:37.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:37.567+0000 7f437071f640 1 -- 172.21.15.33:0/481650395 wait complete. 2024-08-28T19:32:37.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:37 smithi059 ceph-mon[22052]: pgmap v347: 129 pgs: 129 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 71 KiB/s wr, 23 op/s 2024-08-28T19:32:37.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:37 smithi059 ceph-mon[22052]: from='client.15657 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:37 smithi122 ceph-mon[22174]: pgmap v347: 129 pgs: 129 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 71 KiB/s wr, 23 op/s 2024-08-28T19:32:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:37 smithi122 ceph-mon[22174]: from='client.15657 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:38.365 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-08-28T19:32:35.765916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1125670,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1469,"num_read_kb":875,"num_write":468,"num_write_kb":3151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373360,"kb_used_data":11628,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124568464,"statfs":{"total":1151940427776,"available":1151558107136,"internally_reserved":0,"allocated":11907072,"data_stored":8707708,"data_compressed":501297,"data_compressed_allocated":675840,"data_compressed_original":3514368,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":465261,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":130,"num_write":86,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003825"},"pg_stats":[{"pgid":"2.1f","version":"81'13","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:30.611907+0000","last_change":"2024-08-28T19:29:46.098343+0000","last_active":"2024-08-28T19:32:30.611907+0000","last_peered":"2024-08-28T19:32:30.611907+0000","last_clean":"2024-08-28T19:32:30.611907+0000","last_became_active":"2024-08-28T19:29:46.097974+0000","last_became_peered":"2024-08-28T19:29:46.097974+0000","last_unstale":"2024-08-28T19:32:30.611907+0000","last_undegraded":"2024-08-28T19:32:30.611907+0000","last_fullsized":"2024-08-28T19:32:30.611907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:03:11.466154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":126,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125076+0000","last_change":"2024-08-28T19:29:48.123521+0000","last_active":"2024-08-28T19:31:56.125076+0000","last_peered":"2024-08-28T19:31:56.125076+0000","last_clean":"2024-08-28T19:31:56.125076+0000","last_became_active":"2024-08-28T19:29:48.122998+0000","last_became_peered":"2024-08-28T19:29:48.122998+0000","last_unstale":"2024-08-28T19:31:56.125076+0000","last_undegraded":"2024-08-28T19:31:56.125076+0000","last_fullsized":"2024-08-28T19:31:56.125076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:33:48.413468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901815+0000","last_change":"2024-08-28T19:29:55.268086+0000","last_active":"2024-08-28T19:31:27.901815+0000","last_peered":"2024-08-28T19:31:27.901815+0000","last_clean":"2024-08-28T19:31:27.901815+0000","last_became_active":"2024-08-28T19:29:55.267411+0000","last_became_peered":"2024-08-28T19:29:55.267411+0000","last_unstale":"2024-08-28T19:31:27.901815+0000","last_undegraded":"2024-08-28T19:31:27.901815+0000","last_fullsized":"2024-08-28T19:31:27.901815+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:32:16.277295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903018+0000","last_change":"2024-08-28T19:29:46.188552+0000","last_active":"2024-08-28T19:31:27.903018+0000","last_peered":"2024-08-28T19:31:27.903018+0000","last_clean":"2024-08-28T19:31:27.903018+0000","last_became_active":"2024-08-28T19:29:46.188118+0000","last_became_peered":"2024-08-28T19:29:46.188118+0000","last_unstale":"2024-08-28T19:31:27.903018+0000","last_undegraded":"2024-08-28T19:31:27.903018+0000","last_fullsized":"2024-08-28T19:31:27.903018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:55:43.774037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148138+0000","last_change":"2024-08-28T19:29:48.118765+0000","last_active":"2024-08-28T19:31:56.148138+0000","last_peered":"2024-08-28T19:31:56.148138+0000","last_clean":"2024-08-28T19:31:56.148138+0000","last_became_active":"2024-08-28T19:29:48.118111+0000","last_became_peered":"2024-08-28T19:29:48.118111+0000","last_unstale":"2024-08-28T19:31:56.148138+0000","last_undegraded":"2024-08-28T19:31:56.148138+0000","last_fullsized":"2024-08-28T19:31:56.148138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:00:51.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895580+0000","last_change":"2024-08-28T19:29:55.262222+0000","last_active":"2024-08-28T19:31:27.895580+0000","last_peered":"2024-08-28T19:31:27.895580+0000","last_clean":"2024-08-28T19:31:27.895580+0000","last_became_active":"2024-08-28T19:29:55.260906+0000","last_became_peered":"2024-08-28T19:29:55.260906+0000","last_unstale":"2024-08-28T19:31:27.895580+0000","last_undegraded":"2024-08-28T19:31:27.895580+0000","last_fullsized":"2024-08-28T19:31:27.895580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:22:30.523609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903748+0000","last_change":"2024-08-28T19:29:46.101077+0000","last_active":"2024-08-28T19:31:27.903748+0000","last_peered":"2024-08-28T19:31:27.903748+0000","last_clean":"2024-08-28T19:31:27.903748+0000","last_became_active":"2024-08-28T19:29:46.100630+0000","last_became_peered":"2024-08-28T19:29:46.100630+0000","last_unstale":"2024-08-28T19:31:27.903748+0000","last_undegraded":"2024-08-28T19:31:27.903748+0000","last_fullsized":"2024-08-28T19:31:27.903748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:59:11.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152697+0000","last_change":"2024-08-28T19:29:48.129460+0000","last_active":"2024-08-28T19:31:56.152697+0000","last_peered":"2024-08-28T19:31:56.152697+0000","last_clean":"2024-08-28T19:31:56.152697+0000","last_became_active":"2024-08-28T19:29:48.129068+0000","last_became_peered":"2024-08-28T19:29:48.129068+0000","last_unstale":"2024-08-28T19:31:56.152697+0000","last_undegraded":"2024-08-28T19:31:56.152697+0000","last_fullsized":"2024-08-28T19:31:56.152697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:08:40.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895880+0000","last_change":"2024-08-28T19:29:55.262943+0000","last_active":"2024-08-28T19:31:27.895880+0000","last_peered":"2024-08-28T19:31:27.895880+0000","last_clean":"2024-08-28T19:31:27.895880+0000","last_became_active":"2024-08-28T19:29:55.262424+0000","last_became_peered":"2024-08-28T19:29:55.262424+0000","last_unstale":"2024-08-28T19:31:27.895880+0000","last_undegraded":"2024-08-28T19:31:27.895880+0000","last_fullsized":"2024-08-28T19:31:27.895880+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:19:40.618651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903555+0000","last_change":"2024-08-28T19:29:46.102571+0000","last_active":"2024-08-28T19:31:27.903555+0000","last_peered":"2024-08-28T19:31:27.903555+0000","last_clean":"2024-08-28T19:31:27.903555+0000","last_became_active":"2024-08-28T19:29:46.102081+0000","last_became_peered":"2024-08-28T19:29:46.102081+0000","last_unstale":"2024-08-28T19:31:27.903555+0000","last_undegraded":"2024-08-28T19:31:27.903555+0000","last_fullsized":"2024-08-28T19:31:27.903555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:46:38.266122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149393+0000","last_change":"2024-08-28T19:30:27.550413+0000","last_active":"2024-08-28T19:31:56.149393+0000","last_peered":"2024-08-28T19:31:56.149393+0000","last_clean":"2024-08-28T19:31:56.149393+0000","last_became_active":"2024-08-28T19:30:27.550002+0000","last_became_peered":"2024-08-28T19:30:27.550002+0000","last_unstale":"2024-08-28T19:31:56.149393+0000","last_undegraded":"2024-08-28T19:31:56.149393+0000","last_fullsized":"2024-08-28T19:31:56.149393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:17.519332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895637+0000","last_change":"2024-08-28T19:29:55.261930+0000","last_active":"2024-08-28T19:31:27.895637+0000","last_peered":"2024-08-28T19:31:27.895637+0000","last_clean":"2024-08-28T19:31:27.895637+0000","last_became_active":"2024-08-28T19:29:55.261208+0000","last_became_peered":"2024-08-28T19:29:55.261208+0000","last_unstale":"2024-08-28T19:31:27.895637+0000","last_undegraded":"2024-08-28T19:31:27.895637+0000","last_fullsized":"2024-08-28T19:31:27.895637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.804993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152875+0000","last_change":"2024-08-28T19:29:48.133820+0000","last_active":"2024-08-28T19:31:56.152875+0000","last_peered":"2024-08-28T19:31:56.152875+0000","last_clean":"2024-08-28T19:31:56.152875+0000","last_became_active":"2024-08-28T19:29:48.132536+0000","last_became_peered":"2024-08-28T19:29:48.132536+0000","last_unstale":"2024-08-28T19:31:56.152875+0000","last_undegraded":"2024-08-28T19:31:56.152875+0000","last_fullsized":"2024-08-28T19:31:56.152875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:15:39.779698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902841+0000","last_change":"2024-08-28T19:29:46.101206+0000","last_active":"2024-08-28T19:31:27.902841+0000","last_peered":"2024-08-28T19:31:27.902841+0000","last_clean":"2024-08-28T19:31:27.902841+0000","last_became_active":"2024-08-28T19:29:46.100801+0000","last_became_peered":"2024-08-28T19:29:46.100801+0000","last_unstale":"2024-08-28T19:31:27.902841+0000","last_undegraded":"2024-08-28T19:31:27.902841+0000","last_fullsized":"2024-08-28T19:31:27.902841+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:43:33.156203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895905+0000","last_change":"2024-08-28T19:29:55.572774+0000","last_active":"2024-08-28T19:31:27.895905+0000","last_peered":"2024-08-28T19:31:27.895905+0000","last_clean":"2024-08-28T19:31:27.895905+0000","last_became_active":"2024-08-28T19:29:55.571703+0000","last_became_peered":"2024-08-28T19:29:55.571703+0000","last_unstale":"2024-08-28T19:31:27.895905+0000","last_undegraded":"2024-08-28T19:31:27.895905+0000","last_fullsized":"2024-08-28T19:31:27.895905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:56:52.695007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131019+0000","last_change":"2024-08-28T19:29:48.127683+0000","last_active":"2024-08-28T19:31:56.131019+0000","last_peered":"2024-08-28T19:31:56.131019+0000","last_clean":"2024-08-28T19:31:56.131019+0000","last_became_active":"2024-08-28T19:29:48.127139+0000","last_became_peered":"2024-08-28T19:29:48.127139+0000","last_unstale":"2024-08-28T19:31:56.131019+0000","last_undegraded":"2024-08-28T19:31:56.131019+0000","last_fullsized":"2024-08-28T19:31:56.131019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:38:16.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902182+0000","last_change":"2024-08-28T19:29:46.103233+0000","last_active":"2024-08-28T19:31:27.902182+0000","last_peered":"2024-08-28T19:31:27.902182+0000","last_clean":"2024-08-28T19:31:27.902182+0000","last_became_active":"2024-08-28T19:29:46.102515+0000","last_became_peered":"2024-08-28T19:29:46.102515+0000","last_unstale":"2024-08-28T19:31:27.902182+0000","last_undegraded":"2024-08-28T19:31:27.902182+0000","last_fullsized":"2024-08-28T19:31:27.902182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:49:35.905893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896101+0000","last_change":"2024-08-28T19:29:55.264291+0000","last_active":"2024-08-28T19:31:27.896101+0000","last_peered":"2024-08-28T19:31:27.896101+0000","last_clean":"2024-08-28T19:31:27.896101+0000","last_became_active":"2024-08-28T19:29:55.263692+0000","last_became_peered":"2024-08-28T19:29:55.263692+0000","last_unstale":"2024-08-28T19:31:27.896101+0000","last_undegraded":"2024-08-28T19:31:27.896101+0000","last_fullsized":"2024-08-28T19:31:27.896101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:47:01.795320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.147184+0000","last_change":"2024-08-28T19:29:48.115470+0000","last_active":"2024-08-28T19:31:56.147184+0000","last_peered":"2024-08-28T19:31:56.147184+0000","last_clean":"2024-08-28T19:31:56.147184+0000","last_became_active":"2024-08-28T19:29:48.115076+0000","last_became_peered":"2024-08-28T19:29:48.115076+0000","last_unstale":"2024-08-28T19:31:56.147184+0000","last_undegraded":"2024-08-28T19:31:56.147184+0000","last_fullsized":"2024-08-28T19:31:56.147184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:32.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902180+0000","last_change":"2024-08-28T19:29:46.099970+0000","last_active":"2024-08-28T19:31:27.902180+0000","last_peered":"2024-08-28T19:31:27.902180+0000","last_clean":"2024-08-28T19:31:27.902180+0000","last_became_active":"2024-08-28T19:29:46.099661+0000","last_became_peered":"2024-08-28T19:29:46.099661+0000","last_unstale":"2024-08-28T19:31:27.902180+0000","last_undegraded":"2024-08-28T19:31:27.902180+0000","last_fullsized":"2024-08-28T19:31:27.902180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:27.430026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894683+0000","last_change":"2024-08-28T19:29:55.265983+0000","last_active":"2024-08-28T19:31:27.894683+0000","last_peered":"2024-08-28T19:31:27.894683+0000","last_clean":"2024-08-28T19:31:27.894683+0000","last_became_active":"2024-08-28T19:29:55.265464+0000","last_became_peered":"2024-08-28T19:29:55.265464+0000","last_unstale":"2024-08-28T19:31:27.894683+0000","last_undegraded":"2024-08-28T19:31:27.894683+0000","last_fullsized":"2024-08-28T19:31:27.894683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:21:42.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139931+0000","last_change":"2024-08-28T19:29:48.119545+0000","last_active":"2024-08-28T19:31:56.139931+0000","last_peered":"2024-08-28T19:31:56.139931+0000","last_clean":"2024-08-28T19:31:56.139931+0000","last_became_active":"2024-08-28T19:29:48.119128+0000","last_became_peered":"2024-08-28T19:29:48.119128+0000","last_unstale":"2024-08-28T19:31:56.139931+0000","last_undegraded":"2024-08-28T19:31:56.139931+0000","last_fullsized":"2024-08-28T19:31:56.139931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:05:31.535016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.907887+0000","last_change":"2024-08-28T19:31:27.907348+0000","last_active":"2024-08-28T19:31:27.907887+0000","last_peered":"2024-08-28T19:31:27.907887+0000","last_clean":"2024-08-28T19:31:27.907887+0000","last_became_active":"2024-08-28T19:31:27.904502+0000","last_became_peered":"2024-08-28T19:31:27.904502+0000","last_unstale":"2024-08-28T19:31:27.907887+0000","last_undegraded":"2024-08-28T19:31:27.907887+0000","last_fullsized":"2024-08-28T19:31:27.907887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:16:50.269131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895761+0000","last_change":"2024-08-28T19:29:55.573320+0000","last_active":"2024-08-28T19:31:27.895761+0000","last_peered":"2024-08-28T19:31:27.895761+0000","last_clean":"2024-08-28T19:31:27.895761+0000","last_became_active":"2024-08-28T19:29:55.572858+0000","last_became_peered":"2024-08-28T19:29:55.572858+0000","last_unstale":"2024-08-28T19:31:27.895761+0000","last_undegraded":"2024-08-28T19:31:27.895761+0000","last_fullsized":"2024-08-28T19:31:27.895761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:09:34.676911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.133571+0000","last_change":"2024-08-28T19:30:27.404918+0000","last_active":"2024-08-28T19:31:56.133571+0000","last_peered":"2024-08-28T19:31:56.133571+0000","last_clean":"2024-08-28T19:31:56.133571+0000","last_became_active":"2024-08-28T19:30:27.404495+0000","last_became_peered":"2024-08-28T19:30:27.404495+0000","last_unstale":"2024-08-28T19:31:56.133571+0000","last_undegraded":"2024-08-28T19:31:56.133571+0000","last_fullsized":"2024-08-28T19:31:56.133571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:10:12.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896122+0000","last_change":"2024-08-28T19:29:46.110683+0000","last_active":"2024-08-28T19:31:27.896122+0000","last_peered":"2024-08-28T19:31:27.896122+0000","last_clean":"2024-08-28T19:31:27.896122+0000","last_became_active":"2024-08-28T19:29:46.110324+0000","last_became_peered":"2024-08-28T19:29:46.110324+0000","last_unstale":"2024-08-28T19:31:27.896122+0000","last_undegraded":"2024-08-28T19:31:27.896122+0000","last_fullsized":"2024-08-28T19:31:27.896122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:15:47.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901834+0000","last_change":"2024-08-28T19:29:55.271035+0000","last_active":"2024-08-28T19:31:27.901834+0000","last_peered":"2024-08-28T19:31:27.901834+0000","last_clean":"2024-08-28T19:31:27.901834+0000","last_became_active":"2024-08-28T19:29:55.268465+0000","last_became_peered":"2024-08-28T19:29:55.268465+0000","last_unstale":"2024-08-28T19:31:27.901834+0000","last_undegraded":"2024-08-28T19:31:27.901834+0000","last_fullsized":"2024-08-28T19:31:27.901834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:16:17.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132232+0000","last_change":"2024-08-28T19:29:48.127225+0000","last_active":"2024-08-28T19:31:56.132232+0000","last_peered":"2024-08-28T19:31:56.132232+0000","last_clean":"2024-08-28T19:31:56.132232+0000","last_became_active":"2024-08-28T19:29:48.126775+0000","last_became_peered":"2024-08-28T19:29:48.126775+0000","last_unstale":"2024-08-28T19:31:56.132232+0000","last_undegraded":"2024-08-28T19:31:56.132232+0000","last_fullsized":"2024-08-28T19:31:56.132232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:49:39.353082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'48","reported_seq":110,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:32.505887+0000","last_change":"2024-08-28T19:29:46.098076+0000","last_active":"2024-08-28T19:32:32.505887+0000","last_peered":"2024-08-28T19:32:32.505887+0000","last_clean":"2024-08-28T19:32:32.505887+0000","last_became_active":"2024-08-28T19:29:46.097726+0000","last_became_peered":"2024-08-28T19:29:46.097726+0000","last_unstale":"2024-08-28T19:32:32.505887+0000","last_undegraded":"2024-08-28T19:32:32.505887+0000","last_fullsized":"2024-08-28T19:32:32.505887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.624125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":67,"num_write":86,"num_write_kb":709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901585+0000","last_change":"2024-08-28T19:29:55.571830+0000","last_active":"2024-08-28T19:31:27.901585+0000","last_peered":"2024-08-28T19:31:27.901585+0000","last_clean":"2024-08-28T19:31:27.901585+0000","last_became_active":"2024-08-28T19:29:55.571318+0000","last_became_peered":"2024-08-28T19:29:55.571318+0000","last_unstale":"2024-08-28T19:31:27.901585+0000","last_undegraded":"2024-08-28T19:31:27.901585+0000","last_fullsized":"2024-08-28T19:31:27.901585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:41:03.397478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135204+0000","last_change":"2024-08-28T19:29:48.124998+0000","last_active":"2024-08-28T19:31:56.135204+0000","last_peered":"2024-08-28T19:31:56.135204+0000","last_clean":"2024-08-28T19:31:56.135204+0000","last_became_active":"2024-08-28T19:29:48.124600+0000","last_became_peered":"2024-08-28T19:29:48.124600+0000","last_unstale":"2024-08-28T19:31:56.135204+0000","last_undegraded":"2024-08-28T19:31:56.135204+0000","last_fullsized":"2024-08-28T19:31:56.135204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:50:59.459372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903831+0000","last_change":"2024-08-28T19:29:46.189455+0000","last_active":"2024-08-28T19:31:27.903831+0000","last_peered":"2024-08-28T19:31:27.903831+0000","last_clean":"2024-08-28T19:31:27.903831+0000","last_became_active":"2024-08-28T19:29:46.188640+0000","last_became_peered":"2024-08-28T19:29:46.188640+0000","last_unstale":"2024-08-28T19:31:27.903831+0000","last_undegraded":"2024-08-28T19:31:27.903831+0000","last_fullsized":"2024-08-28T19:31:27.903831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:05:32.561725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899291+0000","last_change":"2024-08-28T19:29:55.269726+0000","last_active":"2024-08-28T19:31:27.899291+0000","last_peered":"2024-08-28T19:31:27.899291+0000","last_clean":"2024-08-28T19:31:27.899291+0000","last_became_active":"2024-08-28T19:29:55.269261+0000","last_became_peered":"2024-08-28T19:29:55.269261+0000","last_unstale":"2024-08-28T19:31:27.899291+0000","last_undegraded":"2024-08-28T19:31:27.899291+0000","last_fullsized":"2024-08-28T19:31:27.899291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:05.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128358+0000","last_change":"2024-08-28T19:29:48.125251+0000","last_active":"2024-08-28T19:31:56.128358+0000","last_peered":"2024-08-28T19:31:56.128358+0000","last_clean":"2024-08-28T19:31:56.128358+0000","last_became_active":"2024-08-28T19:29:48.124818+0000","last_became_peered":"2024-08-28T19:29:48.124818+0000","last_unstale":"2024-08-28T19:31:56.128358+0000","last_undegraded":"2024-08-28T19:31:56.128358+0000","last_fullsized":"2024-08-28T19:31:56.128358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:47:05.217199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894972+0000","last_change":"2024-08-28T19:29:46.189747+0000","last_active":"2024-08-28T19:31:27.894972+0000","last_peered":"2024-08-28T19:31:27.894972+0000","last_clean":"2024-08-28T19:31:27.894972+0000","last_became_active":"2024-08-28T19:29:46.189356+0000","last_became_peered":"2024-08-28T19:29:46.189356+0000","last_unstale":"2024-08-28T19:31:27.894972+0000","last_undegraded":"2024-08-28T19:31:27.894972+0000","last_fullsized":"2024-08-28T19:31:27.894972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.629054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902184+0000","last_change":"2024-08-28T19:29:55.572746+0000","last_active":"2024-08-28T19:31:27.902184+0000","last_peered":"2024-08-28T19:31:27.902184+0000","last_clean":"2024-08-28T19:31:27.902184+0000","last_became_active":"2024-08-28T19:29:55.572246+0000","last_became_peered":"2024-08-28T19:29:55.572246+0000","last_unstale":"2024-08-28T19:31:27.902184+0000","last_undegraded":"2024-08-28T19:31:27.902184+0000","last_fullsized":"2024-08-28T19:31:27.902184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:48:23.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.123589+0000","last_change":"2024-08-28T19:29:48.127579+0000","last_active":"2024-08-28T19:31:56.123589+0000","last_peered":"2024-08-28T19:31:56.123589+0000","last_clean":"2024-08-28T19:31:56.123589+0000","last_became_active":"2024-08-28T19:29:48.126978+0000","last_became_peered":"2024-08-28T19:29:48.126978+0000","last_unstale":"2024-08-28T19:31:56.123589+0000","last_undegraded":"2024-08-28T19:31:56.123589+0000","last_fullsized":"2024-08-28T19:31:56.123589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:27.657714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:33.616918+0000","last_change":"2024-08-28T19:29:46.102374+0000","last_active":"2024-08-28T19:32:33.616918+0000","last_peered":"2024-08-28T19:32:33.616918+0000","last_clean":"2024-08-28T19:32:33.616918+0000","last_became_active":"2024-08-28T19:29:46.101619+0000","last_became_peered":"2024-08-28T19:29:46.101619+0000","last_unstale":"2024-08-28T19:32:33.616918+0000","last_undegraded":"2024-08-28T19:32:33.616918+0000","last_fullsized":"2024-08-28T19:32:33.616918+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:46:21.353063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006989+0000","last_change":"2024-08-28T19:29:55.265403+0000","last_active":"2024-08-28T19:31:28.006989+0000","last_peered":"2024-08-28T19:31:28.006989+0000","last_clean":"2024-08-28T19:31:28.006989+0000","last_became_active":"2024-08-28T19:29:55.264979+0000","last_became_peered":"2024-08-28T19:29:55.264979+0000","last_unstale":"2024-08-28T19:31:28.006989+0000","last_undegraded":"2024-08-28T19:31:28.006989+0000","last_fullsized":"2024-08-28T19:31:28.006989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:18:18.623218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142841+0000","last_change":"2024-08-28T19:29:48.117437+0000","last_active":"2024-08-28T19:31:56.142841+0000","last_peered":"2024-08-28T19:31:56.142841+0000","last_clean":"2024-08-28T19:31:56.142841+0000","last_became_active":"2024-08-28T19:29:48.116379+0000","last_became_peered":"2024-08-28T19:29:48.116379+0000","last_unstale":"2024-08-28T19:31:56.142841+0000","last_undegraded":"2024-08-28T19:31:56.142841+0000","last_fullsized":"2024-08-28T19:31:56.142841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:23.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'7","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:31.606354+0000","last_change":"2024-08-28T19:29:46.188551+0000","last_active":"2024-08-28T19:32:31.606354+0000","last_peered":"2024-08-28T19:32:31.606354+0000","last_clean":"2024-08-28T19:32:31.606354+0000","last_became_active":"2024-08-28T19:29:46.188050+0000","last_became_peered":"2024-08-28T19:29:46.188050+0000","last_unstale":"2024-08-28T19:32:31.606354+0000","last_undegraded":"2024-08-28T19:32:31.606354+0000","last_fullsized":"2024-08-28T19:32:31.606354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:07:21.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":127,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007135+0000","last_change":"2024-08-28T19:29:55.572013+0000","last_active":"2024-08-28T19:31:28.007135+0000","last_peered":"2024-08-28T19:31:28.007135+0000","last_clean":"2024-08-28T19:31:28.007135+0000","last_became_active":"2024-08-28T19:29:55.571503+0000","last_became_peered":"2024-08-28T19:29:55.571503+0000","last_unstale":"2024-08-28T19:31:28.007135+0000","last_undegraded":"2024-08-28T19:31:28.007135+0000","last_fullsized":"2024-08-28T19:31:28.007135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:40:21.669321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134828+0000","last_change":"2024-08-28T19:29:48.124646+0000","last_active":"2024-08-28T19:31:56.134828+0000","last_peered":"2024-08-28T19:31:56.134828+0000","last_clean":"2024-08-28T19:31:56.134828+0000","last_became_active":"2024-08-28T19:29:48.123062+0000","last_became_peered":"2024-08-28T19:29:48.123062+0000","last_unstale":"2024-08-28T19:31:56.134828+0000","last_undegraded":"2024-08-28T19:31:56.134828+0000","last_fullsized":"2024-08-28T19:31:56.134828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:16:03.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007156+0000","last_change":"2024-08-28T19:29:46.105979+0000","last_active":"2024-08-28T19:31:28.007156+0000","last_peered":"2024-08-28T19:31:28.007156+0000","last_clean":"2024-08-28T19:31:28.007156+0000","last_became_active":"2024-08-28T19:29:46.105558+0000","last_became_peered":"2024-08-28T19:29:46.105558+0000","last_unstale":"2024-08-28T19:31:28.007156+0000","last_undegraded":"2024-08-28T19:31:28.007156+0000","last_fullsized":"2024-08-28T19:31:28.007156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:47.639236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896414+0000","last_change":"2024-08-28T19:29:55.574025+0000","last_active":"2024-08-28T19:31:27.896414+0000","last_peered":"2024-08-28T19:31:27.896414+0000","last_clean":"2024-08-28T19:31:27.896414+0000","last_became_active":"2024-08-28T19:29:55.573380+0000","last_became_peered":"2024-08-28T19:29:55.573380+0000","last_unstale":"2024-08-28T19:31:27.896414+0000","last_undegraded":"2024-08-28T19:31:27.896414+0000","last_fullsized":"2024-08-28T19:31:27.896414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:19:05.287692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.138839+0000","last_change":"2024-08-28T19:29:48.118606+0000","last_active":"2024-08-28T19:31:56.138839+0000","last_peered":"2024-08-28T19:31:56.138839+0000","last_clean":"2024-08-28T19:31:56.138839+0000","last_became_active":"2024-08-28T19:29:48.117534+0000","last_became_peered":"2024-08-28T19:29:48.117534+0000","last_unstale":"2024-08-28T19:31:56.138839+0000","last_undegraded":"2024-08-28T19:31:56.138839+0000","last_fullsized":"2024-08-28T19:31:56.138839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:34.253859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896326+0000","last_change":"2024-08-28T19:29:46.100420+0000","last_active":"2024-08-28T19:31:27.896326+0000","last_peered":"2024-08-28T19:31:27.896326+0000","last_clean":"2024-08-28T19:31:27.896326+0000","last_became_active":"2024-08-28T19:29:46.099990+0000","last_became_peered":"2024-08-28T19:29:46.099990+0000","last_unstale":"2024-08-28T19:31:27.896326+0000","last_undegraded":"2024-08-28T19:31:27.896326+0000","last_fullsized":"2024-08-28T19:31:27.896326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:42:12.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":113,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007243+0000","last_change":"2024-08-28T19:28:32.822169+0000","last_active":"2024-08-28T19:31:28.007243+0000","last_peered":"2024-08-28T19:31:28.007243+0000","last_clean":"2024-08-28T19:31:28.007243+0000","last_became_active":"2024-08-28T19:28:32.816300+0000","last_became_peered":"2024-08-28T19:28:32.816300+0000","last_unstale":"2024-08-28T19:31:28.007243+0000","last_undegraded":"2024-08-28T19:31:28.007243+0000","last_fullsized":"2024-08-28T19:31:28.007243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_clean_scrub_stamp":"2024-08-28T19:25:14.491568+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:41:37.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007780+0000","last_change":"2024-08-28T19:29:55.265437+0000","last_active":"2024-08-28T19:31:28.007780+0000","last_peered":"2024-08-28T19:31:28.007780+0000","last_clean":"2024-08-28T19:31:28.007780+0000","last_became_active":"2024-08-28T19:29:55.264818+0000","last_became_peered":"2024-08-28T19:29:55.264818+0000","last_unstale":"2024-08-28T19:31:28.007780+0000","last_undegraded":"2024-08-28T19:31:28.007780+0000","last_fullsized":"2024-08-28T19:31:28.007780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:28:18.684362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152410+0000","last_change":"2024-08-28T19:29:48.135800+0000","last_active":"2024-08-28T19:31:56.152410+0000","last_peered":"2024-08-28T19:31:56.152410+0000","last_clean":"2024-08-28T19:31:56.152410+0000","last_became_active":"2024-08-28T19:29:48.135258+0000","last_became_peered":"2024-08-28T19:29:48.135258+0000","last_unstale":"2024-08-28T19:31:56.152410+0000","last_undegraded":"2024-08-28T19:31:56.152410+0000","last_fullsized":"2024-08-28T19:31:56.152410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:55.183190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":177,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:31.634769+0000","last_change":"2024-08-28T19:29:46.189298+0000","last_active":"2024-08-28T19:32:31.634769+0000","last_peered":"2024-08-28T19:32:31.634769+0000","last_clean":"2024-08-28T19:32:31.634769+0000","last_became_active":"2024-08-28T19:29:46.188813+0000","last_became_peered":"2024-08-28T19:29:46.188813+0000","last_unstale":"2024-08-28T19:32:31.634769+0000","last_undegraded":"2024-08-28T19:32:31.634769+0000","last_fullsized":"2024-08-28T19:32:31.634769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:14:00.961682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899863+0000","last_change":"2024-08-28T19:29:55.269495+0000","last_active":"2024-08-28T19:31:27.899863+0000","last_peered":"2024-08-28T19:31:27.899863+0000","last_clean":"2024-08-28T19:31:27.899863+0000","last_became_active":"2024-08-28T19:29:55.268916+0000","last_became_peered":"2024-08-28T19:29:55.268916+0000","last_unstale":"2024-08-28T19:31:27.899863+0000","last_undegraded":"2024-08-28T19:31:27.899863+0000","last_fullsized":"2024-08-28T19:31:27.899863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:26:53.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143974+0000","last_change":"2024-08-28T19:29:48.127588+0000","last_active":"2024-08-28T19:31:56.143974+0000","last_peered":"2024-08-28T19:31:56.143974+0000","last_clean":"2024-08-28T19:31:56.143974+0000","last_became_active":"2024-08-28T19:29:48.127200+0000","last_became_peered":"2024-08-28T19:29:48.127200+0000","last_unstale":"2024-08-28T19:31:56.143974+0000","last_undegraded":"2024-08-28T19:31:56.143974+0000","last_fullsized":"2024-08-28T19:31:56.143974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:30:30.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'18","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:32.466538+0000","last_change":"2024-08-28T19:29:46.101010+0000","last_active":"2024-08-28T19:32:32.466538+0000","last_peered":"2024-08-28T19:32:32.466538+0000","last_clean":"2024-08-28T19:32:32.466538+0000","last_became_active":"2024-08-28T19:29:46.100082+0000","last_became_peered":"2024-08-28T19:29:46.100082+0000","last_unstale":"2024-08-28T19:32:32.466538+0000","last_undegraded":"2024-08-28T19:32:32.466538+0000","last_fullsized":"2024-08-28T19:32:32.466538+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:18:51.074343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66126,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":25,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902334+0000","last_change":"2024-08-28T19:30:27.551743+0000","last_active":"2024-08-28T19:31:27.902334+0000","last_peered":"2024-08-28T19:31:27.902334+0000","last_clean":"2024-08-28T19:31:27.902334+0000","last_became_active":"2024-08-28T19:30:27.551249+0000","last_became_peered":"2024-08-28T19:30:27.551249+0000","last_unstale":"2024-08-28T19:31:27.902334+0000","last_undegraded":"2024-08-28T19:31:27.902334+0000","last_fullsized":"2024-08-28T19:31:27.902334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:35.043553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149263+0000","last_change":"2024-08-28T19:29:48.132429+0000","last_active":"2024-08-28T19:31:56.149263+0000","last_peered":"2024-08-28T19:31:56.149263+0000","last_clean":"2024-08-28T19:31:56.149263+0000","last_became_active":"2024-08-28T19:29:48.132020+0000","last_became_peered":"2024-08-28T19:29:48.132020+0000","last_unstale":"2024-08-28T19:31:56.149263+0000","last_undegraded":"2024-08-28T19:31:56.149263+0000","last_fullsized":"2024-08-28T19:31:56.149263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:45:11.992083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007247+0000","last_change":"2024-08-28T19:29:46.097245+0000","last_active":"2024-08-28T19:31:28.007247+0000","last_peered":"2024-08-28T19:31:28.007247+0000","last_clean":"2024-08-28T19:31:28.007247+0000","last_became_active":"2024-08-28T19:29:46.096867+0000","last_became_peered":"2024-08-28T19:29:46.096867+0000","last_unstale":"2024-08-28T19:31:28.007247+0000","last_undegraded":"2024-08-28T19:31:28.007247+0000","last_fullsized":"2024-08-28T19:31:28.007247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:22:14.888597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895601+0000","last_change":"2024-08-28T19:29:55.265006+0000","last_active":"2024-08-28T19:31:27.895601+0000","last_peered":"2024-08-28T19:31:27.895601+0000","last_clean":"2024-08-28T19:31:27.895601+0000","last_became_active":"2024-08-28T19:29:55.264321+0000","last_became_peered":"2024-08-28T19:29:55.264321+0000","last_unstale":"2024-08-28T19:31:27.895601+0000","last_undegraded":"2024-08-28T19:31:27.895601+0000","last_fullsized":"2024-08-28T19:31:27.895601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:53:27.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146436+0000","last_change":"2024-08-28T19:29:48.120916+0000","last_active":"2024-08-28T19:31:56.146436+0000","last_peered":"2024-08-28T19:31:56.146436+0000","last_clean":"2024-08-28T19:31:56.146436+0000","last_became_active":"2024-08-28T19:29:48.120473+0000","last_became_peered":"2024-08-28T19:29:48.120473+0000","last_unstale":"2024-08-28T19:31:56.146436+0000","last_undegraded":"2024-08-28T19:31:56.146436+0000","last_fullsized":"2024-08-28T19:31:56.146436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:15.067237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903218+0000","last_change":"2024-08-28T19:29:46.103164+0000","last_active":"2024-08-28T19:31:27.903218+0000","last_peered":"2024-08-28T19:31:27.903218+0000","last_clean":"2024-08-28T19:31:27.903218+0000","last_became_active":"2024-08-28T19:29:46.101772+0000","last_became_peered":"2024-08-28T19:29:46.101772+0000","last_unstale":"2024-08-28T19:31:27.903218+0000","last_undegraded":"2024-08-28T19:31:27.903218+0000","last_fullsized":"2024-08-28T19:31:27.903218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:46:29.533552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902200+0000","last_change":"2024-08-28T19:30:27.550861+0000","last_active":"2024-08-28T19:31:27.902200+0000","last_peered":"2024-08-28T19:31:27.902200+0000","last_clean":"2024-08-28T19:31:27.902200+0000","last_became_active":"2024-08-28T19:30:27.550131+0000","last_became_peered":"2024-08-28T19:30:27.550131+0000","last_unstale":"2024-08-28T19:31:27.902200+0000","last_undegraded":"2024-08-28T19:31:27.902200+0000","last_fullsized":"2024-08-28T19:31:27.902200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:37:16.004222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128073+0000","last_change":"2024-08-28T19:30:27.551445+0000","last_active":"2024-08-28T19:31:56.128073+0000","last_peered":"2024-08-28T19:31:56.128073+0000","last_clean":"2024-08-28T19:31:56.128073+0000","last_became_active":"2024-08-28T19:30:27.550927+0000","last_became_peered":"2024-08-28T19:30:27.550927+0000","last_unstale":"2024-08-28T19:31:56.128073+0000","last_undegraded":"2024-08-28T19:31:56.128073+0000","last_fullsized":"2024-08-28T19:31:56.128073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:52:56.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.920185+0000","last_change":"2024-08-28T19:31:27.920056+0000","last_active":"2024-08-28T19:31:27.920185+0000","last_peered":"2024-08-28T19:31:27.920185+0000","last_clean":"2024-08-28T19:31:27.920185+0000","last_became_active":"2024-08-28T19:31:27.904583+0000","last_became_peered":"2024-08-28T19:31:27.904583+0000","last_unstale":"2024-08-28T19:31:27.920185+0000","last_undegraded":"2024-08-28T19:31:27.920185+0000","last_fullsized":"2024-08-28T19:31:27.920185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:35:25.188307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007217+0000","last_change":"2024-08-28T19:29:55.266777+0000","last_active":"2024-08-28T19:31:28.007217+0000","last_peered":"2024-08-28T19:31:28.007217+0000","last_clean":"2024-08-28T19:31:28.007217+0000","last_became_active":"2024-08-28T19:29:55.266296+0000","last_became_peered":"2024-08-28T19:29:55.266296+0000","last_unstale":"2024-08-28T19:31:28.007217+0000","last_undegraded":"2024-08-28T19:31:28.007217+0000","last_fullsized":"2024-08-28T19:31:28.007217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:28:20.279522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150735+0000","last_change":"2024-08-28T19:29:48.129070+0000","last_active":"2024-08-28T19:31:56.150735+0000","last_peered":"2024-08-28T19:31:56.150735+0000","last_clean":"2024-08-28T19:31:56.150735+0000","last_became_active":"2024-08-28T19:29:48.128701+0000","last_became_peered":"2024-08-28T19:29:48.128701+0000","last_unstale":"2024-08-28T19:31:56.150735+0000","last_undegraded":"2024-08-28T19:31:56.150735+0000","last_fullsized":"2024-08-28T19:31:56.150735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:29:29.375379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:32.608545+0000","last_change":"2024-08-28T19:29:46.098281+0000","last_active":"2024-08-28T19:32:32.608545+0000","last_peered":"2024-08-28T19:32:32.608545+0000","last_clean":"2024-08-28T19:32:32.608545+0000","last_became_active":"2024-08-28T19:29:46.097870+0000","last_became_peered":"2024-08-28T19:29:46.097870+0000","last_unstale":"2024-08-28T19:32:32.608545+0000","last_undegraded":"2024-08-28T19:32:32.608545+0000","last_fullsized":"2024-08-28T19:32:32.608545+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:24:09.693310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894981+0000","last_change":"2024-08-28T19:29:55.264883+0000","last_active":"2024-08-28T19:31:27.894981+0000","last_peered":"2024-08-28T19:31:27.894981+0000","last_clean":"2024-08-28T19:31:27.894981+0000","last_became_active":"2024-08-28T19:29:55.264392+0000","last_became_peered":"2024-08-28T19:29:55.264392+0000","last_unstale":"2024-08-28T19:31:27.894981+0000","last_undegraded":"2024-08-28T19:31:27.894981+0000","last_fullsized":"2024-08-28T19:31:27.894981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:34.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150300+0000","last_change":"2024-08-28T19:29:48.135499+0000","last_active":"2024-08-28T19:31:56.150300+0000","last_peered":"2024-08-28T19:31:56.150300+0000","last_clean":"2024-08-28T19:31:56.150300+0000","last_became_active":"2024-08-28T19:29:48.134934+0000","last_became_peered":"2024-08-28T19:29:48.134934+0000","last_unstale":"2024-08-28T19:31:56.150300+0000","last_undegraded":"2024-08-28T19:31:56.150300+0000","last_fullsized":"2024-08-28T19:31:56.150300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:57:01.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895983+0000","last_change":"2024-08-28T19:29:46.104680+0000","last_active":"2024-08-28T19:31:27.895983+0000","last_peered":"2024-08-28T19:31:27.895983+0000","last_clean":"2024-08-28T19:31:27.895983+0000","last_became_active":"2024-08-28T19:29:46.104290+0000","last_became_peered":"2024-08-28T19:29:46.104290+0000","last_unstale":"2024-08-28T19:31:27.895983+0000","last_undegraded":"2024-08-28T19:31:27.895983+0000","last_fullsized":"2024-08-28T19:31:27.895983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:39.789935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899299+0000","last_change":"2024-08-28T19:29:55.264676+0000","last_active":"2024-08-28T19:31:27.899299+0000","last_peered":"2024-08-28T19:31:27.899299+0000","last_clean":"2024-08-28T19:31:27.899299+0000","last_became_active":"2024-08-28T19:29:55.264206+0000","last_became_peered":"2024-08-28T19:29:55.264206+0000","last_unstale":"2024-08-28T19:31:27.899299+0000","last_undegraded":"2024-08-28T19:31:27.899299+0000","last_fullsized":"2024-08-28T19:31:27.899299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:58:15.776366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149998+0000","last_change":"2024-08-28T19:29:48.125092+0000","last_active":"2024-08-28T19:31:56.149998+0000","last_peered":"2024-08-28T19:31:56.149998+0000","last_clean":"2024-08-28T19:31:56.149998+0000","last_became_active":"2024-08-28T19:29:48.124711+0000","last_became_peered":"2024-08-28T19:29:48.124711+0000","last_unstale":"2024-08-28T19:31:56.149998+0000","last_undegraded":"2024-08-28T19:31:56.149998+0000","last_fullsized":"2024-08-28T19:31:56.149998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:17:27.806368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902878+0000","last_change":"2024-08-28T19:29:46.100546+0000","last_active":"2024-08-28T19:31:27.902878+0000","last_peered":"2024-08-28T19:31:27.902878+0000","last_clean":"2024-08-28T19:31:27.902878+0000","last_became_active":"2024-08-28T19:29:46.100043+0000","last_became_peered":"2024-08-28T19:29:46.100043+0000","last_unstale":"2024-08-28T19:31:27.902878+0000","last_undegraded":"2024-08-28T19:31:27.902878+0000","last_fullsized":"2024-08-28T19:31:27.902878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:41:32.488258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896351+0000","last_change":"2024-08-28T19:29:55.265497+0000","last_active":"2024-08-28T19:31:27.896351+0000","last_peered":"2024-08-28T19:31:27.896351+0000","last_clean":"2024-08-28T19:31:27.896351+0000","last_became_active":"2024-08-28T19:29:55.264499+0000","last_became_peered":"2024-08-28T19:29:55.264499+0000","last_unstale":"2024-08-28T19:31:27.896351+0000","last_undegraded":"2024-08-28T19:31:27.896351+0000","last_fullsized":"2024-08-28T19:31:27.896351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:04:15.192307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139694+0000","last_change":"2024-08-28T19:29:48.133948+0000","last_active":"2024-08-28T19:31:56.139694+0000","last_peered":"2024-08-28T19:31:56.139694+0000","last_clean":"2024-08-28T19:31:56.139694+0000","last_became_active":"2024-08-28T19:29:48.133517+0000","last_became_peered":"2024-08-28T19:29:48.133517+0000","last_unstale":"2024-08-28T19:31:56.139694+0000","last_undegraded":"2024-08-28T19:31:56.139694+0000","last_fullsized":"2024-08-28T19:31:56.139694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:43:20.049931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'40","reported_seq":342,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:31.607152+0000","last_change":"2024-08-28T19:29:46.104744+0000","last_active":"2024-08-28T19:32:31.607152+0000","last_peered":"2024-08-28T19:32:31.607152+0000","last_clean":"2024-08-28T19:32:31.607152+0000","last_became_active":"2024-08-28T19:29:46.104278+0000","last_became_peered":"2024-08-28T19:29:46.104278+0000","last_unstale":"2024-08-28T19:32:31.607152+0000","last_undegraded":"2024-08-28T19:32:31.607152+0000","last_fullsized":"2024-08-28T19:32:31.607152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:36.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68002,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":199,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894437+0000","last_change":"2024-08-28T19:29:55.264892+0000","last_active":"2024-08-28T19:31:27.894437+0000","last_peered":"2024-08-28T19:31:27.894437+0000","last_clean":"2024-08-28T19:31:27.894437+0000","last_became_active":"2024-08-28T19:29:55.264466+0000","last_became_peered":"2024-08-28T19:29:55.264466+0000","last_unstale":"2024-08-28T19:31:27.894437+0000","last_undegraded":"2024-08-28T19:31:27.894437+0000","last_fullsized":"2024-08-28T19:31:27.894437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:34:51.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152034+0000","last_change":"2024-08-28T19:29:48.121692+0000","last_active":"2024-08-28T19:31:56.152034+0000","last_peered":"2024-08-28T19:31:56.152034+0000","last_clean":"2024-08-28T19:31:56.152034+0000","last_became_active":"2024-08-28T19:29:48.121274+0000","last_became_peered":"2024-08-28T19:29:48.121274+0000","last_unstale":"2024-08-28T19:31:56.152034+0000","last_undegraded":"2024-08-28T19:31:56.152034+0000","last_fullsized":"2024-08-28T19:31:56.152034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:00:36.227609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896564+0000","last_change":"2024-08-28T19:29:46.188981+0000","last_active":"2024-08-28T19:31:27.896564+0000","last_peered":"2024-08-28T19:31:27.896564+0000","last_clean":"2024-08-28T19:31:27.896564+0000","last_became_active":"2024-08-28T19:29:46.188496+0000","last_became_peered":"2024-08-28T19:29:46.188496+0000","last_unstale":"2024-08-28T19:31:27.896564+0000","last_undegraded":"2024-08-28T19:31:27.896564+0000","last_fullsized":"2024-08-28T19:31:27.896564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.689602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896238+0000","last_change":"2024-08-28T19:30:27.552006+0000","last_active":"2024-08-28T19:31:27.896238+0000","last_peered":"2024-08-28T19:31:27.896238+0000","last_clean":"2024-08-28T19:31:27.896238+0000","last_became_active":"2024-08-28T19:30:27.551356+0000","last_became_peered":"2024-08-28T19:30:27.551356+0000","last_unstale":"2024-08-28T19:31:27.896238+0000","last_undegraded":"2024-08-28T19:31:27.896238+0000","last_fullsized":"2024-08-28T19:31:27.896238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:56:09.242401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144743+0000","last_change":"2024-08-28T19:29:48.116964+0000","last_active":"2024-08-28T19:31:56.144743+0000","last_peered":"2024-08-28T19:31:56.144743+0000","last_clean":"2024-08-28T19:31:56.144743+0000","last_became_active":"2024-08-28T19:29:48.116588+0000","last_became_peered":"2024-08-28T19:29:48.116588+0000","last_unstale":"2024-08-28T19:31:56.144743+0000","last_undegraded":"2024-08-28T19:31:56.144743+0000","last_fullsized":"2024-08-28T19:31:56.144743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:52:02.486724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007960+0000","last_change":"2024-08-28T19:29:46.104132+0000","last_active":"2024-08-28T19:31:28.007960+0000","last_peered":"2024-08-28T19:31:28.007960+0000","last_clean":"2024-08-28T19:31:28.007960+0000","last_became_active":"2024-08-28T19:29:46.103725+0000","last_became_peered":"2024-08-28T19:29:46.103725+0000","last_unstale":"2024-08-28T19:31:28.007960+0000","last_undegraded":"2024-08-28T19:31:28.007960+0000","last_fullsized":"2024-08-28T19:31:28.007960+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:50:12.859989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894212+0000","last_change":"2024-08-28T19:29:55.265494+0000","last_active":"2024-08-28T19:31:27.894212+0000","last_peered":"2024-08-28T19:31:27.894212+0000","last_clean":"2024-08-28T19:31:27.894212+0000","last_became_active":"2024-08-28T19:29:55.265087+0000","last_became_peered":"2024-08-28T19:29:55.265087+0000","last_unstale":"2024-08-28T19:31:27.894212+0000","last_undegraded":"2024-08-28T19:31:27.894212+0000","last_fullsized":"2024-08-28T19:31:27.894212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:51:18.676889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152669+0000","last_change":"2024-08-28T19:29:48.127419+0000","last_active":"2024-08-28T19:31:56.152669+0000","last_peered":"2024-08-28T19:31:56.152669+0000","last_clean":"2024-08-28T19:31:56.152669+0000","last_became_active":"2024-08-28T19:29:48.126997+0000","last_became_peered":"2024-08-28T19:29:48.126997+0000","last_unstale":"2024-08-28T19:31:56.152669+0000","last_undegraded":"2024-08-28T19:31:56.152669+0000","last_fullsized":"2024-08-28T19:31:56.152669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:26:08.208724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:31.607109+0000","last_change":"2024-08-28T19:29:46.103451+0000","last_active":"2024-08-28T19:32:31.607109+0000","last_peered":"2024-08-28T19:32:31.607109+0000","last_clean":"2024-08-28T19:32:31.607109+0000","last_became_active":"2024-08-28T19:29:46.102991+0000","last_became_peered":"2024-08-28T19:29:46.102991+0000","last_unstale":"2024-08-28T19:32:31.607109+0000","last_undegraded":"2024-08-28T19:32:31.607109+0000","last_fullsized":"2024-08-28T19:32:31.607109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:55:58.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":250,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901836+0000","last_change":"2024-08-28T19:29:55.269310+0000","last_active":"2024-08-28T19:31:27.901836+0000","last_peered":"2024-08-28T19:31:27.901836+0000","last_clean":"2024-08-28T19:31:27.901836+0000","last_became_active":"2024-08-28T19:29:55.268893+0000","last_became_peered":"2024-08-28T19:29:55.268893+0000","last_unstale":"2024-08-28T19:31:27.901836+0000","last_undegraded":"2024-08-28T19:31:27.901836+0000","last_fullsized":"2024-08-28T19:31:27.901836+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:26:11.598773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902085+0000","last_change":"2024-08-28T19:29:55.261757+0000","last_active":"2024-08-28T19:31:27.902085+0000","last_peered":"2024-08-28T19:31:27.902085+0000","last_clean":"2024-08-28T19:31:27.902085+0000","last_became_active":"2024-08-28T19:29:55.261339+0000","last_became_peered":"2024-08-28T19:29:55.261339+0000","last_unstale":"2024-08-28T19:31:27.902085+0000","last_undegraded":"2024-08-28T19:31:27.902085+0000","last_fullsized":"2024-08-28T19:31:27.902085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:25:06.223029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.130201+0000","last_change":"2024-08-28T19:29:48.123097+0000","last_active":"2024-08-28T19:31:56.130201+0000","last_peered":"2024-08-28T19:31:56.130201+0000","last_clean":"2024-08-28T19:31:56.130201+0000","last_became_active":"2024-08-28T19:29:48.122718+0000","last_became_peered":"2024-08-28T19:29:48.122718+0000","last_unstale":"2024-08-28T19:31:56.130201+0000","last_undegraded":"2024-08-28T19:31:56.130201+0000","last_fullsized":"2024-08-28T19:31:56.130201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:19.530985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896115+0000","last_change":"2024-08-28T19:29:46.105516+0000","last_active":"2024-08-28T19:31:27.896115+0000","last_peered":"2024-08-28T19:31:27.896115+0000","last_clean":"2024-08-28T19:31:27.896115+0000","last_became_active":"2024-08-28T19:29:46.105030+0000","last_became_peered":"2024-08-28T19:29:46.105030+0000","last_unstale":"2024-08-28T19:31:27.896115+0000","last_undegraded":"2024-08-28T19:31:27.896115+0000","last_fullsized":"2024-08-28T19:31:27.896115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:47:02.032933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899627+0000","last_change":"2024-08-28T19:29:55.269759+0000","last_active":"2024-08-28T19:31:27.899627+0000","last_peered":"2024-08-28T19:31:27.899627+0000","last_clean":"2024-08-28T19:31:27.899627+0000","last_became_active":"2024-08-28T19:29:55.269275+0000","last_became_peered":"2024-08-28T19:29:55.269275+0000","last_unstale":"2024-08-28T19:31:27.899627+0000","last_undegraded":"2024-08-28T19:31:27.899627+0000","last_fullsized":"2024-08-28T19:31:27.899627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:45.870468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131493+0000","last_change":"2024-08-28T19:29:48.117400+0000","last_active":"2024-08-28T19:31:56.131493+0000","last_peered":"2024-08-28T19:31:56.131493+0000","last_clean":"2024-08-28T19:31:56.131493+0000","last_became_active":"2024-08-28T19:29:48.116987+0000","last_became_peered":"2024-08-28T19:29:48.116987+0000","last_unstale":"2024-08-28T19:31:56.131493+0000","last_undegraded":"2024-08-28T19:31:56.131493+0000","last_fullsized":"2024-08-28T19:31:56.131493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:43.822088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006521+0000","last_change":"2024-08-28T19:29:46.096103+0000","last_active":"2024-08-28T19:31:28.006521+0000","last_peered":"2024-08-28T19:31:28.006521+0000","last_clean":"2024-08-28T19:31:28.006521+0000","last_became_active":"2024-08-28T19:29:46.095812+0000","last_became_peered":"2024-08-28T19:29:46.095812+0000","last_unstale":"2024-08-28T19:31:28.006521+0000","last_undegraded":"2024-08-28T19:31:28.006521+0000","last_fullsized":"2024-08-28T19:31:28.006521+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:29.266636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007661+0000","last_change":"2024-08-28T19:29:46.106227+0000","last_active":"2024-08-28T19:31:28.007661+0000","last_peered":"2024-08-28T19:31:28.007661+0000","last_clean":"2024-08-28T19:31:28.007661+0000","last_became_active":"2024-08-28T19:29:46.105777+0000","last_became_peered":"2024-08-28T19:29:46.105777+0000","last_unstale":"2024-08-28T19:31:28.007661+0000","last_undegraded":"2024-08-28T19:31:28.007661+0000","last_fullsized":"2024-08-28T19:31:28.007661+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:26:14.815646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144860+0000","last_change":"2024-08-28T19:29:48.111051+0000","last_active":"2024-08-28T19:31:56.144860+0000","last_peered":"2024-08-28T19:31:56.144860+0000","last_clean":"2024-08-28T19:31:56.144860+0000","last_became_active":"2024-08-28T19:29:48.110421+0000","last_became_peered":"2024-08-28T19:29:48.110421+0000","last_unstale":"2024-08-28T19:31:56.144860+0000","last_undegraded":"2024-08-28T19:31:56.144860+0000","last_fullsized":"2024-08-28T19:31:56.144860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:19:47.765977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902713+0000","last_change":"2024-08-28T19:30:27.408829+0000","last_active":"2024-08-28T19:31:27.902713+0000","last_peered":"2024-08-28T19:31:27.902713+0000","last_clean":"2024-08-28T19:31:27.902713+0000","last_became_active":"2024-08-28T19:30:27.408298+0000","last_became_peered":"2024-08-28T19:30:27.408298+0000","last_unstale":"2024-08-28T19:31:27.902713+0000","last_undegraded":"2024-08-28T19:31:27.902713+0000","last_fullsized":"2024-08-28T19:31:27.902713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:38:58.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":172,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:30.606139+0000","last_change":"2024-08-28T19:29:46.102607+0000","last_active":"2024-08-28T19:32:30.606139+0000","last_peered":"2024-08-28T19:32:30.606139+0000","last_clean":"2024-08-28T19:32:30.606139+0000","last_became_active":"2024-08-28T19:29:46.102150+0000","last_became_peered":"2024-08-28T19:29:46.102150+0000","last_unstale":"2024-08-28T19:32:30.606139+0000","last_undegraded":"2024-08-28T19:32:30.606139+0000","last_fullsized":"2024-08-28T19:32:30.606139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:44.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128134+0000","last_change":"2024-08-28T19:29:48.121598+0000","last_active":"2024-08-28T19:31:56.128134+0000","last_peered":"2024-08-28T19:31:56.128134+0000","last_clean":"2024-08-28T19:31:56.128134+0000","last_became_active":"2024-08-28T19:29:48.121189+0000","last_became_peered":"2024-08-28T19:29:48.121189+0000","last_unstale":"2024-08-28T19:31:56.128134+0000","last_undegraded":"2024-08-28T19:31:56.128134+0000","last_fullsized":"2024-08-28T19:31:56.128134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:19:35.496859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903566+0000","last_change":"2024-08-28T19:29:55.269648+0000","last_active":"2024-08-28T19:31:27.903566+0000","last_peered":"2024-08-28T19:31:27.903566+0000","last_clean":"2024-08-28T19:31:27.903566+0000","last_became_active":"2024-08-28T19:29:55.269182+0000","last_became_peered":"2024-08-28T19:29:55.269182+0000","last_unstale":"2024-08-28T19:31:27.903566+0000","last_undegraded":"2024-08-28T19:31:27.903566+0000","last_fullsized":"2024-08-28T19:31:27.903566+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:09:47.581907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146872+0000","last_change":"2024-08-28T19:29:48.117143+0000","last_active":"2024-08-28T19:31:56.146872+0000","last_peered":"2024-08-28T19:31:56.146872+0000","last_clean":"2024-08-28T19:31:56.146872+0000","last_became_active":"2024-08-28T19:29:48.116756+0000","last_became_peered":"2024-08-28T19:29:48.116756+0000","last_unstale":"2024-08-28T19:31:56.146872+0000","last_undegraded":"2024-08-28T19:31:56.146872+0000","last_fullsized":"2024-08-28T19:31:56.146872+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:03:30.736872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141006+0000","last_change":"2024-08-28T19:30:27.407218+0000","last_active":"2024-08-28T19:31:56.141006+0000","last_peered":"2024-08-28T19:31:56.141006+0000","last_clean":"2024-08-28T19:31:56.141006+0000","last_became_active":"2024-08-28T19:30:27.406769+0000","last_became_peered":"2024-08-28T19:30:27.406769+0000","last_unstale":"2024-08-28T19:31:56.141006+0000","last_undegraded":"2024-08-28T19:31:56.141006+0000","last_fullsized":"2024-08-28T19:31:56.141006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:59.946922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135902+0000","last_change":"2024-08-28T19:29:48.123969+0000","last_active":"2024-08-28T19:31:56.135902+0000","last_peered":"2024-08-28T19:31:56.135902+0000","last_clean":"2024-08-28T19:31:56.135902+0000","last_became_active":"2024-08-28T19:29:48.122534+0000","last_became_peered":"2024-08-28T19:29:48.122534+0000","last_unstale":"2024-08-28T19:31:56.135902+0000","last_undegraded":"2024-08-28T19:31:56.135902+0000","last_fullsized":"2024-08-28T19:31:56.135902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:33:56.739763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132732+0000","last_change":"2024-08-28T19:29:48.108976+0000","last_active":"2024-08-28T19:31:56.132732+0000","last_peered":"2024-08-28T19:31:56.132732+0000","last_clean":"2024-08-28T19:31:56.132732+0000","last_became_active":"2024-08-28T19:29:48.108631+0000","last_became_peered":"2024-08-28T19:29:48.108631+0000","last_unstale":"2024-08-28T19:31:56.132732+0000","last_undegraded":"2024-08-28T19:31:56.132732+0000","last_fullsized":"2024-08-28T19:31:56.132732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:08:59.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131974+0000","last_change":"2024-08-28T19:29:48.109875+0000","last_active":"2024-08-28T19:31:56.131974+0000","last_peered":"2024-08-28T19:31:56.131974+0000","last_clean":"2024-08-28T19:31:56.131974+0000","last_became_active":"2024-08-28T19:29:48.109486+0000","last_became_peered":"2024-08-28T19:29:48.109486+0000","last_unstale":"2024-08-28T19:31:56.131974+0000","last_undegraded":"2024-08-28T19:31:56.131974+0000","last_fullsized":"2024-08-28T19:31:56.131974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:02:28.365203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146393+0000","last_change":"2024-08-28T19:29:48.117237+0000","last_active":"2024-08-28T19:31:56.146393+0000","last_peered":"2024-08-28T19:31:56.146393+0000","last_clean":"2024-08-28T19:31:56.146393+0000","last_became_active":"2024-08-28T19:29:48.116799+0000","last_became_peered":"2024-08-28T19:29:48.116799+0000","last_unstale":"2024-08-28T19:31:56.146393+0000","last_undegraded":"2024-08-28T19:31:56.146393+0000","last_fullsized":"2024-08-28T19:31:56.146393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:48:12.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144924+0000","last_change":"2024-08-28T19:29:48.120522+0000","last_active":"2024-08-28T19:31:56.144924+0000","last_peered":"2024-08-28T19:31:56.144924+0000","last_clean":"2024-08-28T19:31:56.144924+0000","last_became_active":"2024-08-28T19:29:48.120150+0000","last_became_peered":"2024-08-28T19:29:48.120150+0000","last_unstale":"2024-08-28T19:31:56.144924+0000","last_undegraded":"2024-08-28T19:31:56.144924+0000","last_fullsized":"2024-08-28T19:31:56.144924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:01:00.210596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.126169+0000","last_change":"2024-08-28T19:29:48.128451+0000","last_active":"2024-08-28T19:31:56.126169+0000","last_peered":"2024-08-28T19:31:56.126169+0000","last_clean":"2024-08-28T19:31:56.126169+0000","last_became_active":"2024-08-28T19:29:48.127898+0000","last_became_peered":"2024-08-28T19:29:48.127898+0000","last_unstale":"2024-08-28T19:31:56.126169+0000","last_undegraded":"2024-08-28T19:31:56.126169+0000","last_fullsized":"2024-08-28T19:31:56.126169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:48.663999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142755+0000","last_change":"2024-08-28T19:29:48.110788+0000","last_active":"2024-08-28T19:31:56.142755+0000","last_peered":"2024-08-28T19:31:56.142755+0000","last_clean":"2024-08-28T19:31:56.142755+0000","last_became_active":"2024-08-28T19:29:48.110355+0000","last_became_peered":"2024-08-28T19:29:48.110355+0000","last_unstale":"2024-08-28T19:31:56.142755+0000","last_undegraded":"2024-08-28T19:31:56.142755+0000","last_fullsized":"2024-08-28T19:31:56.142755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:57:25.345283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141195+0000","last_change":"2024-08-28T19:29:48.129667+0000","last_active":"2024-08-28T19:31:56.141195+0000","last_peered":"2024-08-28T19:31:56.141195+0000","last_clean":"2024-08-28T19:31:56.141195+0000","last_became_active":"2024-08-28T19:29:48.128237+0000","last_became_peered":"2024-08-28T19:29:48.128237+0000","last_unstale":"2024-08-28T19:31:56.141195+0000","last_undegraded":"2024-08-28T19:31:56.141195+0000","last_fullsized":"2024-08-28T19:31:56.141195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:23:35.920353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151419+0000","last_change":"2024-08-28T19:29:48.136070+0000","last_active":"2024-08-28T19:31:56.151419+0000","last_peered":"2024-08-28T19:31:56.151419+0000","last_clean":"2024-08-28T19:31:56.151419+0000","last_became_active":"2024-08-28T19:29:48.135515+0000","last_became_peered":"2024-08-28T19:29:48.135515+0000","last_unstale":"2024-08-28T19:31:56.151419+0000","last_undegraded":"2024-08-28T19:31:56.151419+0000","last_fullsized":"2024-08-28T19:31:56.151419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:25:29.267753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150677+0000","last_change":"2024-08-28T19:29:48.128614+0000","last_active":"2024-08-28T19:31:56.150677+0000","last_peered":"2024-08-28T19:31:56.150677+0000","last_clean":"2024-08-28T19:31:56.150677+0000","last_became_active":"2024-08-28T19:29:48.128231+0000","last_became_peered":"2024-08-28T19:29:48.128231+0000","last_unstale":"2024-08-28T19:31:56.150677+0000","last_undegraded":"2024-08-28T19:31:56.150677+0000","last_fullsized":"2024-08-28T19:31:56.150677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:11:08.541435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143953+0000","last_change":"2024-08-28T19:29:48.114930+0000","last_active":"2024-08-28T19:31:56.143953+0000","last_peered":"2024-08-28T19:31:56.143953+0000","last_clean":"2024-08-28T19:31:56.143953+0000","last_became_active":"2024-08-28T19:29:48.114389+0000","last_became_peered":"2024-08-28T19:29:48.114389+0000","last_unstale":"2024-08-28T19:31:56.143953+0000","last_undegraded":"2024-08-28T19:31:56.143953+0000","last_fullsized":"2024-08-28T19:31:56.143953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:51.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141213+0000","last_change":"2024-08-28T19:29:48.125031+0000","last_active":"2024-08-28T19:31:56.141213+0000","last_peered":"2024-08-28T19:31:56.141213+0000","last_clean":"2024-08-28T19:31:56.141213+0000","last_became_active":"2024-08-28T19:29:48.124417+0000","last_became_peered":"2024-08-28T19:29:48.124417+0000","last_unstale":"2024-08-28T19:31:56.141213+0000","last_undegraded":"2024-08-28T19:31:56.141213+0000","last_fullsized":"2024-08-28T19:31:56.141213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:33:33.931496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143690+0000","last_change":"2024-08-28T19:29:48.127815+0000","last_active":"2024-08-28T19:31:56.143690+0000","last_peered":"2024-08-28T19:31:56.143690+0000","last_clean":"2024-08-28T19:31:56.143690+0000","last_became_active":"2024-08-28T19:29:48.127455+0000","last_became_peered":"2024-08-28T19:29:48.127455+0000","last_unstale":"2024-08-28T19:31:56.143690+0000","last_undegraded":"2024-08-28T19:31:56.143690+0000","last_fullsized":"2024-08-28T19:31:56.143690+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:47:23.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142376+0000","last_change":"2024-08-28T19:29:48.122105+0000","last_active":"2024-08-28T19:31:56.142376+0000","last_peered":"2024-08-28T19:31:56.142376+0000","last_clean":"2024-08-28T19:31:56.142376+0000","last_became_active":"2024-08-28T19:29:48.121546+0000","last_became_peered":"2024-08-28T19:29:48.121546+0000","last_unstale":"2024-08-28T19:31:56.142376+0000","last_undegraded":"2024-08-28T19:31:56.142376+0000","last_fullsized":"2024-08-28T19:31:56.142376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:21:00.428052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151147+0000","last_change":"2024-08-28T19:29:48.136198+0000","last_active":"2024-08-28T19:31:56.151147+0000","last_peered":"2024-08-28T19:31:56.151147+0000","last_clean":"2024-08-28T19:31:56.151147+0000","last_became_active":"2024-08-28T19:29:48.135796+0000","last_became_peered":"2024-08-28T19:29:48.135796+0000","last_unstale":"2024-08-28T19:31:56.151147+0000","last_undegraded":"2024-08-28T19:31:56.151147+0000","last_fullsized":"2024-08-28T19:31:56.151147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:05.033399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134895+0000","last_change":"2024-08-28T19:29:48.121245+0000","last_active":"2024-08-28T19:31:56.134895+0000","last_peered":"2024-08-28T19:31:56.134895+0000","last_clean":"2024-08-28T19:31:56.134895+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.134895+0000","last_undegraded":"2024-08-28T19:31:56.134895+0000","last_fullsized":"2024-08-28T19:31:56.134895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:39.936209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132329+0000","last_change":"2024-08-28T19:29:48.119198+0000","last_active":"2024-08-28T19:31:56.132329+0000","last_peered":"2024-08-28T19:31:56.132329+0000","last_clean":"2024-08-28T19:31:56.132329+0000","last_became_active":"2024-08-28T19:29:48.118744+0000","last_became_peered":"2024-08-28T19:29:48.118744+0000","last_unstale":"2024-08-28T19:31:56.132329+0000","last_undegraded":"2024-08-28T19:31:56.132329+0000","last_fullsized":"2024-08-28T19:31:56.132329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:15:35.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131834+0000","last_change":"2024-08-28T19:30:27.403790+0000","last_active":"2024-08-28T19:31:56.131834+0000","last_peered":"2024-08-28T19:31:56.131834+0000","last_clean":"2024-08-28T19:31:56.131834+0000","last_became_active":"2024-08-28T19:30:27.403279+0000","last_became_peered":"2024-08-28T19:30:27.403279+0000","last_unstale":"2024-08-28T19:31:56.131834+0000","last_undegraded":"2024-08-28T19:31:56.131834+0000","last_fullsized":"2024-08-28T19:31:56.131834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:31:54.137839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128885+0000","last_change":"2024-08-28T19:30:27.405173+0000","last_active":"2024-08-28T19:31:56.128885+0000","last_peered":"2024-08-28T19:31:56.128885+0000","last_clean":"2024-08-28T19:31:56.128885+0000","last_became_active":"2024-08-28T19:30:27.404752+0000","last_became_peered":"2024-08-28T19:30:27.404752+0000","last_unstale":"2024-08-28T19:31:56.128885+0000","last_undegraded":"2024-08-28T19:31:56.128885+0000","last_fullsized":"2024-08-28T19:31:56.128885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:16.544309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152246+0000","last_change":"2024-08-28T19:29:48.136738+0000","last_active":"2024-08-28T19:31:56.152246+0000","last_peered":"2024-08-28T19:31:56.152246+0000","last_clean":"2024-08-28T19:31:56.152246+0000","last_became_active":"2024-08-28T19:29:48.136046+0000","last_became_peered":"2024-08-28T19:29:48.136046+0000","last_unstale":"2024-08-28T19:31:56.152246+0000","last_undegraded":"2024-08-28T19:31:56.152246+0000","last_fullsized":"2024-08-28T19:31:56.152246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:43:32.905933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.127788+0000","last_change":"2024-08-28T19:29:48.127432+0000","last_active":"2024-08-28T19:31:56.127788+0000","last_peered":"2024-08-28T19:31:56.127788+0000","last_clean":"2024-08-28T19:31:56.127788+0000","last_became_active":"2024-08-28T19:29:48.126067+0000","last_became_peered":"2024-08-28T19:29:48.126067+0000","last_unstale":"2024-08-28T19:31:56.127788+0000","last_undegraded":"2024-08-28T19:31:56.127788+0000","last_fullsized":"2024-08-28T19:31:56.127788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:30:05.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152540+0000","last_change":"2024-08-28T19:29:48.121154+0000","last_active":"2024-08-28T19:31:56.152540+0000","last_peered":"2024-08-28T19:31:56.152540+0000","last_clean":"2024-08-28T19:31:56.152540+0000","last_became_active":"2024-08-28T19:29:48.120709+0000","last_became_peered":"2024-08-28T19:29:48.120709+0000","last_unstale":"2024-08-28T19:31:56.152540+0000","last_undegraded":"2024-08-28T19:31:56.152540+0000","last_fullsized":"2024-08-28T19:31:56.152540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:52.716814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144107+0000","last_change":"2024-08-28T19:29:48.127124+0000","last_active":"2024-08-28T19:31:56.144107+0000","last_peered":"2024-08-28T19:31:56.144107+0000","last_clean":"2024-08-28T19:31:56.144107+0000","last_became_active":"2024-08-28T19:29:48.126761+0000","last_became_peered":"2024-08-28T19:29:48.126761+0000","last_unstale":"2024-08-28T19:31:56.144107+0000","last_undegraded":"2024-08-28T19:31:56.144107+0000","last_fullsized":"2024-08-28T19:31:56.144107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:05:31.150472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150014+0000","last_change":"2024-08-28T19:29:48.132285+0000","last_active":"2024-08-28T19:31:56.150014+0000","last_peered":"2024-08-28T19:31:56.150014+0000","last_clean":"2024-08-28T19:31:56.150014+0000","last_became_active":"2024-08-28T19:29:48.131688+0000","last_became_peered":"2024-08-28T19:29:48.131688+0000","last_unstale":"2024-08-28T19:31:56.150014+0000","last_undegraded":"2024-08-28T19:31:56.150014+0000","last_fullsized":"2024-08-28T19:31:56.150014+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:23:08.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.124596+0000","last_change":"2024-08-28T19:29:48.126384+0000","last_active":"2024-08-28T19:31:56.124596+0000","last_peered":"2024-08-28T19:31:56.124596+0000","last_clean":"2024-08-28T19:31:56.124596+0000","last_became_active":"2024-08-28T19:29:48.125412+0000","last_became_peered":"2024-08-28T19:29:48.125412+0000","last_unstale":"2024-08-28T19:31:56.124596+0000","last_undegraded":"2024-08-28T19:31:56.124596+0000","last_fullsized":"2024-08-28T19:31:56.124596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:47:42.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125963+0000","last_change":"2024-08-28T19:29:48.114032+0000","last_active":"2024-08-28T19:31:56.125963+0000","last_peered":"2024-08-28T19:31:56.125963+0000","last_clean":"2024-08-28T19:31:56.125963+0000","last_became_active":"2024-08-28T19:29:48.113625+0000","last_became_peered":"2024-08-28T19:29:48.113625+0000","last_unstale":"2024-08-28T19:31:56.125963+0000","last_undegraded":"2024-08-28T19:31:56.125963+0000","last_fullsized":"2024-08-28T19:31:56.125963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:07:08.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131499+0000","last_change":"2024-08-28T19:29:48.124046+0000","last_active":"2024-08-28T19:31:56.131499+0000","last_peered":"2024-08-28T19:31:56.131499+0000","last_clean":"2024-08-28T19:31:56.131499+0000","last_became_active":"2024-08-28T19:29:48.123647+0000","last_became_peered":"2024-08-28T19:29:48.123647+0000","last_unstale":"2024-08-28T19:31:56.131499+0000","last_undegraded":"2024-08-28T19:31:56.131499+0000","last_fullsized":"2024-08-28T19:31:56.131499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:59.262454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148165+0000","last_change":"2024-08-28T19:29:48.121258+0000","last_active":"2024-08-28T19:31:56.148165+0000","last_peered":"2024-08-28T19:31:56.148165+0000","last_clean":"2024-08-28T19:31:56.148165+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.148165+0000","last_undegraded":"2024-08-28T19:31:56.148165+0000","last_fullsized":"2024-08-28T19:31:56.148165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:37:05.610466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.129860+0000","last_change":"2024-08-28T19:29:48.125071+0000","last_active":"2024-08-28T19:31:56.129860+0000","last_peered":"2024-08-28T19:31:56.129860+0000","last_clean":"2024-08-28T19:31:56.129860+0000","last_became_active":"2024-08-28T19:29:48.124706+0000","last_became_peered":"2024-08-28T19:29:48.124706+0000","last_unstale":"2024-08-28T19:31:56.129860+0000","last_undegraded":"2024-08-28T19:31:56.129860+0000","last_fullsized":"2024-08-28T19:31:56.129860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:39:06.460682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141807+0000","last_change":"2024-08-28T19:29:48.121905+0000","last_active":"2024-08-28T19:31:56.141807+0000","last_peered":"2024-08-28T19:31:56.141807+0000","last_clean":"2024-08-28T19:31:56.141807+0000","last_became_active":"2024-08-28T19:29:48.121045+0000","last_became_peered":"2024-08-28T19:29:48.121045+0000","last_unstale":"2024-08-28T19:31:56.141807+0000","last_undegraded":"2024-08-28T19:31:56.141807+0000","last_fullsized":"2024-08-28T19:31:56.141807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:56:58.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":535068,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1388,"num_read_kb":806,"num_write":343,"num_write_kb":999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1605252,"data_compressed":65670,"data_compressed_allocated":86016,"data_compressed_original":1339392,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246047,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776175,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":496720,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939699,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":1151734,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103225,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":500102,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299454,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":496272,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495682,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1093330,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659208,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":491510,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855437,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1019904,"data_stored":1088072,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018961,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":496424,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215190,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":1278210,"data_compressed":67079,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411419,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":561294,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542240,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":560542,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":493498,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":787422,"data_compressed":37380,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":68876,"data_compressed":3087,"data_compressed_allocated":4096,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19148,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":202178,"data_compressed":6055,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T19:32:38.370 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-28T19:32:38.371 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-28T19:32:38.630 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.142+0000 7f1b6fa06640 1 -- 172.21.15.33:0/3341902781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b68103940 msgr2=0x7f1b68103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.142+0000 7f1b6fa06640 1 --2- 172.21.15.33:0/3341902781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b68103940 0x7f1b68103d50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009860 tx=0x7f1b6402a340 comp rx=0 tx=0).stop 2024-08-28T19:32:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.142+0000 7f1b6fa06640 1 -- 172.21.15.33:0/3341902781 shutdown_connections 2024-08-28T19:32:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.142+0000 7f1b6fa06640 1 --2- 172.21.15.33:0/3341902781 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b68109bd0 0x7f1b68110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.142+0000 7f1b6fa06640 1 --2- 172.21.15.33:0/3341902781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b68109280 0x7f1b68109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.142+0000 7f1b6fa06640 1 --2- 172.21.15.33:0/3341902781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b68103940 0x7f1b68103d50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.142+0000 7f1b6fa06640 1 -- 172.21.15.33:0/3341902781 >> 172.21.15.33:0/3341902781 conn(0x7f1b680ff3d0 msgr2=0x7f1b68101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.142+0000 7f1b6fa06640 1 -- 172.21.15.33:0/3341902781 shutdown_connections 2024-08-28T19:32:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.142+0000 7f1b6fa06640 1 -- 172.21.15.33:0/3341902781 wait complete. 2024-08-28T19:32:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.143+0000 7f1b6fa06640 1 Processor -- start 2024-08-28T19:32:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.143+0000 7f1b6fa06640 1 -- start start 2024-08-28T19:32:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.143+0000 7f1b6fa06640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b68103940 0x7f1b6819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6fa06640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b68109280 0x7f1b6819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6fa06640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b68109bd0 0x7f1b6819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6fa06640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68113890 con 0x7f1b68109bd0 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6fa06640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68113710 con 0x7f1b68103940 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6fa06640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68113a10 con 0x7f1b68109280 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6dfa3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b68109bd0 0x7f1b6819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6dfa3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b68109bd0 0x7f1b6819fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47368/0 (socket says 172.21.15.33:47368) 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6dfa3640 1 -- 172.21.15.33:0/2203166496 learned_addr learned my addr 172.21.15.33:0/2203166496 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6d7a2640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b68103940 0x7f1b6819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6cfa1640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b68109280 0x7f1b6819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6dfa3640 1 -- 172.21.15.33:0/2203166496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b68109280 msgr2=0x7f1b6819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6dfa3640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b68109280 0x7f1b6819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6dfa3640 1 -- 172.21.15.33:0/2203166496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b68103940 msgr2=0x7f1b6819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6dfa3640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b68103940 0x7f1b6819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6dfa3640 1 -- 172.21.15.33:0/2203166496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b681a0210 con 0x7f1b68109bd0 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6d7a2640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b68103940 0x7f1b6819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6cfa1640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b68109280 0x7f1b6819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6dfa3640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b68109bd0 0x7f1b6819fae0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000efc0 tx=0x7f1b6000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b5e7fc640 1 -- 172.21.15.33:0/2203166496 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60003970 con 0x7f1b68109bd0 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6fa06640 1 -- 172.21.15.33:0/2203166496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b681a0500 con 0x7f1b68109bd0 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b5e7fc640 1 -- 172.21.15.33:0/2203166496 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b60004020 con 0x7f1b68109bd0 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b5e7fc640 1 -- 172.21.15.33:0/2203166496 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6000b940 con 0x7f1b68109bd0 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.144+0000 7f1b6fa06640 1 -- 172.21.15.33:0/2203166496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b681a6c60 con 0x7f1b68109bd0 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.145+0000 7f1b6fa06640 1 -- 172.21.15.33:0/2203166496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b68103d50 con 0x7f1b68109bd0 2024-08-28T19:32:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.147+0000 7f1b5e7fc640 1 -- 172.21.15.33:0/2203166496 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f1b6001d020 con 0x7f1b68109bd0 2024-08-28T19:32:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.147+0000 7f1b5e7fc640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b540b4c10 0x7f1b540b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.148+0000 7f1b6d7a2640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b540b4c10 0x7f1b540b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.148+0000 7f1b5e7fc640 1 -- 172.21.15.33:0/2203166496 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1b600e5de0 con 0x7f1b68109bd0 2024-08-28T19:32:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.148+0000 7f1b6d7a2640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b540b4c10 0x7f1b540b7120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1b640303f0 tx=0x7f1b64030340 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.151+0000 7f1b5e7fc640 1 -- 172.21.15.33:0/2203166496 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1b600ac940 con 0x7f1b68109bd0 2024-08-28T19:32:39.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.331+0000 7f1b6fa06640 1 -- 172.21.15.33:0/2203166496 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b680635a0 con 0x7f1b540b4c10 2024-08-28T19:32:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.337+0000 7f1b5e7fc640 1 -- 172.21.15.33:0/2203166496 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340913 (secure 0 0 0) 0x7f1b680635a0 con 0x7f1b540b4c10 2024-08-28T19:32:39.344 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-08-28T19:32:39.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 -- 172.21.15.33:0/2203166496 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b540b4c10 msgr2=0x7f1b540b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b540b4c10 0x7f1b540b7120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1b640303f0 tx=0x7f1b64030340 comp rx=0 tx=0).stop 2024-08-28T19:32:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 -- 172.21.15.33:0/2203166496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b68109bd0 msgr2=0x7f1b6819fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b68109bd0 0x7f1b6819fae0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000efc0 tx=0x7f1b6000c800 comp rx=0 tx=0).stop 2024-08-28T19:32:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 -- 172.21.15.33:0/2203166496 shutdown_connections 2024-08-28T19:32:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b68109bd0 0x7f1b6819fae0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1b540b4c10 0x7f1b540b7120 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1b68109280 0x7f1b6819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 --2- 172.21.15.33:0/2203166496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b68103940 0x7f1b6819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 -- 172.21.15.33:0/2203166496 >> 172.21.15.33:0/2203166496 conn(0x7f1b680ff3d0 msgr2=0x7f1b681017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 -- 172.21.15.33:0/2203166496 shutdown_connections 2024-08-28T19:32:39.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:39.341+0000 7f1b6fa06640 1 -- 172.21.15.33:0/2203166496 wait complete. 2024-08-28T19:32:39.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:39 smithi033 ceph-mon[18549]: from='client.15663 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:39 smithi033 ceph-mon[18549]: pgmap v348: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-08-28T19:32:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:39 smithi059 ceph-mon[22052]: from='client.15663 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:39 smithi059 ceph-mon[22052]: pgmap v348: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-08-28T19:32:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:39 smithi122 ceph-mon[22174]: from='client.15663 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:39 smithi122 ceph-mon[22174]: pgmap v348: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-08-28T19:32:40.172 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-08-28T19:32:37.766404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1453390,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1750,"num_read_kb":1124,"num_write":612,"num_write_kb":4398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377680,"kb_used_data":11780,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564144,"statfs":{"total":1151940427776,"available":1151553683456,"internally_reserved":0,"allocated":12062720,"data_stored":10281692,"data_compressed":576057,"data_compressed_allocated":774144,"data_compressed_original":5038080,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":792673,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":378,"num_write":229,"num_write_kb":2097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003573"},"pg_stats":[{"pgid":"2.1f","version":"81'13","reported_seq":185,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:35.618929+0000","last_change":"2024-08-28T19:29:46.098343+0000","last_active":"2024-08-28T19:32:35.618929+0000","last_peered":"2024-08-28T19:32:35.618929+0000","last_clean":"2024-08-28T19:32:35.618929+0000","last_became_active":"2024-08-28T19:29:46.097974+0000","last_became_peered":"2024-08-28T19:29:46.097974+0000","last_unstale":"2024-08-28T19:32:35.618929+0000","last_undegraded":"2024-08-28T19:32:35.618929+0000","last_fullsized":"2024-08-28T19:32:35.618929+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:03:11.466154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125076+0000","last_change":"2024-08-28T19:29:48.123521+0000","last_active":"2024-08-28T19:31:56.125076+0000","last_peered":"2024-08-28T19:31:56.125076+0000","last_clean":"2024-08-28T19:31:56.125076+0000","last_became_active":"2024-08-28T19:29:48.122998+0000","last_became_peered":"2024-08-28T19:29:48.122998+0000","last_unstale":"2024-08-28T19:31:56.125076+0000","last_undegraded":"2024-08-28T19:31:56.125076+0000","last_fullsized":"2024-08-28T19:31:56.125076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:33:48.413468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901815+0000","last_change":"2024-08-28T19:29:55.268086+0000","last_active":"2024-08-28T19:31:27.901815+0000","last_peered":"2024-08-28T19:31:27.901815+0000","last_clean":"2024-08-28T19:31:27.901815+0000","last_became_active":"2024-08-28T19:29:55.267411+0000","last_became_peered":"2024-08-28T19:29:55.267411+0000","last_unstale":"2024-08-28T19:31:27.901815+0000","last_undegraded":"2024-08-28T19:31:27.901815+0000","last_fullsized":"2024-08-28T19:31:27.901815+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:32:16.277295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903018+0000","last_change":"2024-08-28T19:29:46.188552+0000","last_active":"2024-08-28T19:31:27.903018+0000","last_peered":"2024-08-28T19:31:27.903018+0000","last_clean":"2024-08-28T19:31:27.903018+0000","last_became_active":"2024-08-28T19:29:46.188118+0000","last_became_peered":"2024-08-28T19:29:46.188118+0000","last_unstale":"2024-08-28T19:31:27.903018+0000","last_undegraded":"2024-08-28T19:31:27.903018+0000","last_fullsized":"2024-08-28T19:31:27.903018+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:55:43.774037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148138+0000","last_change":"2024-08-28T19:29:48.118765+0000","last_active":"2024-08-28T19:31:56.148138+0000","last_peered":"2024-08-28T19:31:56.148138+0000","last_clean":"2024-08-28T19:31:56.148138+0000","last_became_active":"2024-08-28T19:29:48.118111+0000","last_became_peered":"2024-08-28T19:29:48.118111+0000","last_unstale":"2024-08-28T19:31:56.148138+0000","last_undegraded":"2024-08-28T19:31:56.148138+0000","last_fullsized":"2024-08-28T19:31:56.148138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:00:51.600315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895580+0000","last_change":"2024-08-28T19:29:55.262222+0000","last_active":"2024-08-28T19:31:27.895580+0000","last_peered":"2024-08-28T19:31:27.895580+0000","last_clean":"2024-08-28T19:31:27.895580+0000","last_became_active":"2024-08-28T19:29:55.260906+0000","last_became_peered":"2024-08-28T19:29:55.260906+0000","last_unstale":"2024-08-28T19:31:27.895580+0000","last_undegraded":"2024-08-28T19:31:27.895580+0000","last_fullsized":"2024-08-28T19:31:27.895580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:22:30.523609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903748+0000","last_change":"2024-08-28T19:29:46.101077+0000","last_active":"2024-08-28T19:31:27.903748+0000","last_peered":"2024-08-28T19:31:27.903748+0000","last_clean":"2024-08-28T19:31:27.903748+0000","last_became_active":"2024-08-28T19:29:46.100630+0000","last_became_peered":"2024-08-28T19:29:46.100630+0000","last_unstale":"2024-08-28T19:31:27.903748+0000","last_undegraded":"2024-08-28T19:31:27.903748+0000","last_fullsized":"2024-08-28T19:31:27.903748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:59:11.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152697+0000","last_change":"2024-08-28T19:29:48.129460+0000","last_active":"2024-08-28T19:31:56.152697+0000","last_peered":"2024-08-28T19:31:56.152697+0000","last_clean":"2024-08-28T19:31:56.152697+0000","last_became_active":"2024-08-28T19:29:48.129068+0000","last_became_peered":"2024-08-28T19:29:48.129068+0000","last_unstale":"2024-08-28T19:31:56.152697+0000","last_undegraded":"2024-08-28T19:31:56.152697+0000","last_fullsized":"2024-08-28T19:31:56.152697+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:08:40.606411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895880+0000","last_change":"2024-08-28T19:29:55.262943+0000","last_active":"2024-08-28T19:31:27.895880+0000","last_peered":"2024-08-28T19:31:27.895880+0000","last_clean":"2024-08-28T19:31:27.895880+0000","last_became_active":"2024-08-28T19:29:55.262424+0000","last_became_peered":"2024-08-28T19:29:55.262424+0000","last_unstale":"2024-08-28T19:31:27.895880+0000","last_undegraded":"2024-08-28T19:31:27.895880+0000","last_fullsized":"2024-08-28T19:31:27.895880+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:19:40.618651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903555+0000","last_change":"2024-08-28T19:29:46.102571+0000","last_active":"2024-08-28T19:31:27.903555+0000","last_peered":"2024-08-28T19:31:27.903555+0000","last_clean":"2024-08-28T19:31:27.903555+0000","last_became_active":"2024-08-28T19:29:46.102081+0000","last_became_peered":"2024-08-28T19:29:46.102081+0000","last_unstale":"2024-08-28T19:31:27.903555+0000","last_undegraded":"2024-08-28T19:31:27.903555+0000","last_fullsized":"2024-08-28T19:31:27.903555+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:46:38.266122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149393+0000","last_change":"2024-08-28T19:30:27.550413+0000","last_active":"2024-08-28T19:31:56.149393+0000","last_peered":"2024-08-28T19:31:56.149393+0000","last_clean":"2024-08-28T19:31:56.149393+0000","last_became_active":"2024-08-28T19:30:27.550002+0000","last_became_peered":"2024-08-28T19:30:27.550002+0000","last_unstale":"2024-08-28T19:31:56.149393+0000","last_undegraded":"2024-08-28T19:31:56.149393+0000","last_fullsized":"2024-08-28T19:31:56.149393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:19:17.519332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895637+0000","last_change":"2024-08-28T19:29:55.261930+0000","last_active":"2024-08-28T19:31:27.895637+0000","last_peered":"2024-08-28T19:31:27.895637+0000","last_clean":"2024-08-28T19:31:27.895637+0000","last_became_active":"2024-08-28T19:29:55.261208+0000","last_became_peered":"2024-08-28T19:29:55.261208+0000","last_unstale":"2024-08-28T19:31:27.895637+0000","last_undegraded":"2024-08-28T19:31:27.895637+0000","last_fullsized":"2024-08-28T19:31:27.895637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.804993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152875+0000","last_change":"2024-08-28T19:29:48.133820+0000","last_active":"2024-08-28T19:31:56.152875+0000","last_peered":"2024-08-28T19:31:56.152875+0000","last_clean":"2024-08-28T19:31:56.152875+0000","last_became_active":"2024-08-28T19:29:48.132536+0000","last_became_peered":"2024-08-28T19:29:48.132536+0000","last_unstale":"2024-08-28T19:31:56.152875+0000","last_undegraded":"2024-08-28T19:31:56.152875+0000","last_fullsized":"2024-08-28T19:31:56.152875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:15:39.779698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902841+0000","last_change":"2024-08-28T19:29:46.101206+0000","last_active":"2024-08-28T19:31:27.902841+0000","last_peered":"2024-08-28T19:31:27.902841+0000","last_clean":"2024-08-28T19:31:27.902841+0000","last_became_active":"2024-08-28T19:29:46.100801+0000","last_became_peered":"2024-08-28T19:29:46.100801+0000","last_unstale":"2024-08-28T19:31:27.902841+0000","last_undegraded":"2024-08-28T19:31:27.902841+0000","last_fullsized":"2024-08-28T19:31:27.902841+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:43:33.156203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895905+0000","last_change":"2024-08-28T19:29:55.572774+0000","last_active":"2024-08-28T19:31:27.895905+0000","last_peered":"2024-08-28T19:31:27.895905+0000","last_clean":"2024-08-28T19:31:27.895905+0000","last_became_active":"2024-08-28T19:29:55.571703+0000","last_became_peered":"2024-08-28T19:29:55.571703+0000","last_unstale":"2024-08-28T19:31:27.895905+0000","last_undegraded":"2024-08-28T19:31:27.895905+0000","last_fullsized":"2024-08-28T19:31:27.895905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:56:52.695007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131019+0000","last_change":"2024-08-28T19:29:48.127683+0000","last_active":"2024-08-28T19:31:56.131019+0000","last_peered":"2024-08-28T19:31:56.131019+0000","last_clean":"2024-08-28T19:31:56.131019+0000","last_became_active":"2024-08-28T19:29:48.127139+0000","last_became_peered":"2024-08-28T19:29:48.127139+0000","last_unstale":"2024-08-28T19:31:56.131019+0000","last_undegraded":"2024-08-28T19:31:56.131019+0000","last_fullsized":"2024-08-28T19:31:56.131019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:38:16.269620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902182+0000","last_change":"2024-08-28T19:29:46.103233+0000","last_active":"2024-08-28T19:31:27.902182+0000","last_peered":"2024-08-28T19:31:27.902182+0000","last_clean":"2024-08-28T19:31:27.902182+0000","last_became_active":"2024-08-28T19:29:46.102515+0000","last_became_peered":"2024-08-28T19:29:46.102515+0000","last_unstale":"2024-08-28T19:31:27.902182+0000","last_undegraded":"2024-08-28T19:31:27.902182+0000","last_fullsized":"2024-08-28T19:31:27.902182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:49:35.905893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896101+0000","last_change":"2024-08-28T19:29:55.264291+0000","last_active":"2024-08-28T19:31:27.896101+0000","last_peered":"2024-08-28T19:31:27.896101+0000","last_clean":"2024-08-28T19:31:27.896101+0000","last_became_active":"2024-08-28T19:29:55.263692+0000","last_became_peered":"2024-08-28T19:29:55.263692+0000","last_unstale":"2024-08-28T19:31:27.896101+0000","last_undegraded":"2024-08-28T19:31:27.896101+0000","last_fullsized":"2024-08-28T19:31:27.896101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:47:01.795320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.147184+0000","last_change":"2024-08-28T19:29:48.115470+0000","last_active":"2024-08-28T19:31:56.147184+0000","last_peered":"2024-08-28T19:31:56.147184+0000","last_clean":"2024-08-28T19:31:56.147184+0000","last_became_active":"2024-08-28T19:29:48.115076+0000","last_became_peered":"2024-08-28T19:29:48.115076+0000","last_unstale":"2024-08-28T19:31:56.147184+0000","last_undegraded":"2024-08-28T19:31:56.147184+0000","last_fullsized":"2024-08-28T19:31:56.147184+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:59:32.863709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902180+0000","last_change":"2024-08-28T19:29:46.099970+0000","last_active":"2024-08-28T19:31:27.902180+0000","last_peered":"2024-08-28T19:31:27.902180+0000","last_clean":"2024-08-28T19:31:27.902180+0000","last_became_active":"2024-08-28T19:29:46.099661+0000","last_became_peered":"2024-08-28T19:29:46.099661+0000","last_unstale":"2024-08-28T19:31:27.902180+0000","last_undegraded":"2024-08-28T19:31:27.902180+0000","last_fullsized":"2024-08-28T19:31:27.902180+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:27.430026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894683+0000","last_change":"2024-08-28T19:29:55.265983+0000","last_active":"2024-08-28T19:31:27.894683+0000","last_peered":"2024-08-28T19:31:27.894683+0000","last_clean":"2024-08-28T19:31:27.894683+0000","last_became_active":"2024-08-28T19:29:55.265464+0000","last_became_peered":"2024-08-28T19:29:55.265464+0000","last_unstale":"2024-08-28T19:31:27.894683+0000","last_undegraded":"2024-08-28T19:31:27.894683+0000","last_fullsized":"2024-08-28T19:31:27.894683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:21:42.693385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139931+0000","last_change":"2024-08-28T19:29:48.119545+0000","last_active":"2024-08-28T19:31:56.139931+0000","last_peered":"2024-08-28T19:31:56.139931+0000","last_clean":"2024-08-28T19:31:56.139931+0000","last_became_active":"2024-08-28T19:29:48.119128+0000","last_became_peered":"2024-08-28T19:29:48.119128+0000","last_unstale":"2024-08-28T19:31:56.139931+0000","last_undegraded":"2024-08-28T19:31:56.139931+0000","last_fullsized":"2024-08-28T19:31:56.139931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:05:31.535016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.907887+0000","last_change":"2024-08-28T19:31:27.907348+0000","last_active":"2024-08-28T19:31:27.907887+0000","last_peered":"2024-08-28T19:31:27.907887+0000","last_clean":"2024-08-28T19:31:27.907887+0000","last_became_active":"2024-08-28T19:31:27.904502+0000","last_became_peered":"2024-08-28T19:31:27.904502+0000","last_unstale":"2024-08-28T19:31:27.907887+0000","last_undegraded":"2024-08-28T19:31:27.907887+0000","last_fullsized":"2024-08-28T19:31:27.907887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:16:50.269131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895761+0000","last_change":"2024-08-28T19:29:55.573320+0000","last_active":"2024-08-28T19:31:27.895761+0000","last_peered":"2024-08-28T19:31:27.895761+0000","last_clean":"2024-08-28T19:31:27.895761+0000","last_became_active":"2024-08-28T19:29:55.572858+0000","last_became_peered":"2024-08-28T19:29:55.572858+0000","last_unstale":"2024-08-28T19:31:27.895761+0000","last_undegraded":"2024-08-28T19:31:27.895761+0000","last_fullsized":"2024-08-28T19:31:27.895761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:09:34.676911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.133571+0000","last_change":"2024-08-28T19:30:27.404918+0000","last_active":"2024-08-28T19:31:56.133571+0000","last_peered":"2024-08-28T19:31:56.133571+0000","last_clean":"2024-08-28T19:31:56.133571+0000","last_became_active":"2024-08-28T19:30:27.404495+0000","last_became_peered":"2024-08-28T19:30:27.404495+0000","last_unstale":"2024-08-28T19:31:56.133571+0000","last_undegraded":"2024-08-28T19:31:56.133571+0000","last_fullsized":"2024-08-28T19:31:56.133571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:10:12.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896122+0000","last_change":"2024-08-28T19:29:46.110683+0000","last_active":"2024-08-28T19:31:27.896122+0000","last_peered":"2024-08-28T19:31:27.896122+0000","last_clean":"2024-08-28T19:31:27.896122+0000","last_became_active":"2024-08-28T19:29:46.110324+0000","last_became_peered":"2024-08-28T19:29:46.110324+0000","last_unstale":"2024-08-28T19:31:27.896122+0000","last_undegraded":"2024-08-28T19:31:27.896122+0000","last_fullsized":"2024-08-28T19:31:27.896122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:15:47.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901834+0000","last_change":"2024-08-28T19:29:55.271035+0000","last_active":"2024-08-28T19:31:27.901834+0000","last_peered":"2024-08-28T19:31:27.901834+0000","last_clean":"2024-08-28T19:31:27.901834+0000","last_became_active":"2024-08-28T19:29:55.268465+0000","last_became_peered":"2024-08-28T19:29:55.268465+0000","last_unstale":"2024-08-28T19:31:27.901834+0000","last_undegraded":"2024-08-28T19:31:27.901834+0000","last_fullsized":"2024-08-28T19:31:27.901834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:16:17.087665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132232+0000","last_change":"2024-08-28T19:29:48.127225+0000","last_active":"2024-08-28T19:31:56.132232+0000","last_peered":"2024-08-28T19:31:56.132232+0000","last_clean":"2024-08-28T19:31:56.132232+0000","last_became_active":"2024-08-28T19:29:48.126775+0000","last_became_peered":"2024-08-28T19:29:48.126775+0000","last_unstale":"2024-08-28T19:31:56.132232+0000","last_undegraded":"2024-08-28T19:31:56.132232+0000","last_fullsized":"2024-08-28T19:31:56.132232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:49:39.353082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'101","reported_seq":230,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:33.725289+0000","last_change":"2024-08-28T19:29:46.098076+0000","last_active":"2024-08-28T19:32:33.725289+0000","last_peered":"2024-08-28T19:32:33.725289+0000","last_clean":"2024-08-28T19:32:33.725289+0000","last_became_active":"2024-08-28T19:29:46.097726+0000","last_became_peered":"2024-08-28T19:29:46.097726+0000","last_unstale":"2024-08-28T19:32:33.725289+0000","last_undegraded":"2024-08-28T19:32:33.725289+0000","last_fullsized":"2024-08-28T19:32:33.725289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.624125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":184,"num_write_kb":1221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901585+0000","last_change":"2024-08-28T19:29:55.571830+0000","last_active":"2024-08-28T19:31:27.901585+0000","last_peered":"2024-08-28T19:31:27.901585+0000","last_clean":"2024-08-28T19:31:27.901585+0000","last_became_active":"2024-08-28T19:29:55.571318+0000","last_became_peered":"2024-08-28T19:29:55.571318+0000","last_unstale":"2024-08-28T19:31:27.901585+0000","last_undegraded":"2024-08-28T19:31:27.901585+0000","last_fullsized":"2024-08-28T19:31:27.901585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:41:03.397478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135204+0000","last_change":"2024-08-28T19:29:48.124998+0000","last_active":"2024-08-28T19:31:56.135204+0000","last_peered":"2024-08-28T19:31:56.135204+0000","last_clean":"2024-08-28T19:31:56.135204+0000","last_became_active":"2024-08-28T19:29:48.124600+0000","last_became_peered":"2024-08-28T19:29:48.124600+0000","last_unstale":"2024-08-28T19:31:56.135204+0000","last_undegraded":"2024-08-28T19:31:56.135204+0000","last_fullsized":"2024-08-28T19:31:56.135204+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:50:59.459372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903831+0000","last_change":"2024-08-28T19:29:46.189455+0000","last_active":"2024-08-28T19:31:27.903831+0000","last_peered":"2024-08-28T19:31:27.903831+0000","last_clean":"2024-08-28T19:31:27.903831+0000","last_became_active":"2024-08-28T19:29:46.188640+0000","last_became_peered":"2024-08-28T19:29:46.188640+0000","last_unstale":"2024-08-28T19:31:27.903831+0000","last_undegraded":"2024-08-28T19:31:27.903831+0000","last_fullsized":"2024-08-28T19:31:27.903831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:05:32.561725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899291+0000","last_change":"2024-08-28T19:29:55.269726+0000","last_active":"2024-08-28T19:31:27.899291+0000","last_peered":"2024-08-28T19:31:27.899291+0000","last_clean":"2024-08-28T19:31:27.899291+0000","last_became_active":"2024-08-28T19:29:55.269261+0000","last_became_peered":"2024-08-28T19:29:55.269261+0000","last_unstale":"2024-08-28T19:31:27.899291+0000","last_undegraded":"2024-08-28T19:31:27.899291+0000","last_fullsized":"2024-08-28T19:31:27.899291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:05.433044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128358+0000","last_change":"2024-08-28T19:29:48.125251+0000","last_active":"2024-08-28T19:31:56.128358+0000","last_peered":"2024-08-28T19:31:56.128358+0000","last_clean":"2024-08-28T19:31:56.128358+0000","last_became_active":"2024-08-28T19:29:48.124818+0000","last_became_peered":"2024-08-28T19:29:48.124818+0000","last_unstale":"2024-08-28T19:31:56.128358+0000","last_undegraded":"2024-08-28T19:31:56.128358+0000","last_fullsized":"2024-08-28T19:31:56.128358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:47:05.217199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894972+0000","last_change":"2024-08-28T19:29:46.189747+0000","last_active":"2024-08-28T19:31:27.894972+0000","last_peered":"2024-08-28T19:31:27.894972+0000","last_clean":"2024-08-28T19:31:27.894972+0000","last_became_active":"2024-08-28T19:29:46.189356+0000","last_became_peered":"2024-08-28T19:29:46.189356+0000","last_unstale":"2024-08-28T19:31:27.894972+0000","last_undegraded":"2024-08-28T19:31:27.894972+0000","last_fullsized":"2024-08-28T19:31:27.894972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:16:35.629054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902184+0000","last_change":"2024-08-28T19:29:55.572746+0000","last_active":"2024-08-28T19:31:27.902184+0000","last_peered":"2024-08-28T19:31:27.902184+0000","last_clean":"2024-08-28T19:31:27.902184+0000","last_became_active":"2024-08-28T19:29:55.572246+0000","last_became_peered":"2024-08-28T19:29:55.572246+0000","last_unstale":"2024-08-28T19:31:27.902184+0000","last_undegraded":"2024-08-28T19:31:27.902184+0000","last_fullsized":"2024-08-28T19:31:27.902184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:48:23.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.123589+0000","last_change":"2024-08-28T19:29:48.127579+0000","last_active":"2024-08-28T19:31:56.123589+0000","last_peered":"2024-08-28T19:31:56.123589+0000","last_clean":"2024-08-28T19:31:56.123589+0000","last_became_active":"2024-08-28T19:29:48.126978+0000","last_became_peered":"2024-08-28T19:29:48.126978+0000","last_unstale":"2024-08-28T19:31:56.123589+0000","last_undegraded":"2024-08-28T19:31:56.123589+0000","last_fullsized":"2024-08-28T19:31:56.123589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:27.657714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'5","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:33.616918+0000","last_change":"2024-08-28T19:29:46.102374+0000","last_active":"2024-08-28T19:32:33.616918+0000","last_peered":"2024-08-28T19:32:33.616918+0000","last_clean":"2024-08-28T19:32:33.616918+0000","last_became_active":"2024-08-28T19:29:46.101619+0000","last_became_peered":"2024-08-28T19:29:46.101619+0000","last_unstale":"2024-08-28T19:32:33.616918+0000","last_undegraded":"2024-08-28T19:32:33.616918+0000","last_fullsized":"2024-08-28T19:32:33.616918+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:46:21.353063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006989+0000","last_change":"2024-08-28T19:29:55.265403+0000","last_active":"2024-08-28T19:31:28.006989+0000","last_peered":"2024-08-28T19:31:28.006989+0000","last_clean":"2024-08-28T19:31:28.006989+0000","last_became_active":"2024-08-28T19:29:55.264979+0000","last_became_peered":"2024-08-28T19:29:55.264979+0000","last_unstale":"2024-08-28T19:31:28.006989+0000","last_undegraded":"2024-08-28T19:31:28.006989+0000","last_fullsized":"2024-08-28T19:31:28.006989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:18:18.623218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142841+0000","last_change":"2024-08-28T19:29:48.117437+0000","last_active":"2024-08-28T19:31:56.142841+0000","last_peered":"2024-08-28T19:31:56.142841+0000","last_clean":"2024-08-28T19:31:56.142841+0000","last_became_active":"2024-08-28T19:29:48.116379+0000","last_became_peered":"2024-08-28T19:29:48.116379+0000","last_unstale":"2024-08-28T19:31:56.142841+0000","last_undegraded":"2024-08-28T19:31:56.142841+0000","last_fullsized":"2024-08-28T19:31:56.142841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:22:23.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'7","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:31.606354+0000","last_change":"2024-08-28T19:29:46.188551+0000","last_active":"2024-08-28T19:32:31.606354+0000","last_peered":"2024-08-28T19:32:31.606354+0000","last_clean":"2024-08-28T19:32:31.606354+0000","last_became_active":"2024-08-28T19:29:46.188050+0000","last_became_peered":"2024-08-28T19:29:46.188050+0000","last_unstale":"2024-08-28T19:32:31.606354+0000","last_undegraded":"2024-08-28T19:32:31.606354+0000","last_fullsized":"2024-08-28T19:32:31.606354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:07:21.213056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":127,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007135+0000","last_change":"2024-08-28T19:29:55.572013+0000","last_active":"2024-08-28T19:31:28.007135+0000","last_peered":"2024-08-28T19:31:28.007135+0000","last_clean":"2024-08-28T19:31:28.007135+0000","last_became_active":"2024-08-28T19:29:55.571503+0000","last_became_peered":"2024-08-28T19:29:55.571503+0000","last_unstale":"2024-08-28T19:31:28.007135+0000","last_undegraded":"2024-08-28T19:31:28.007135+0000","last_fullsized":"2024-08-28T19:31:28.007135+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:40:21.669321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134828+0000","last_change":"2024-08-28T19:29:48.124646+0000","last_active":"2024-08-28T19:31:56.134828+0000","last_peered":"2024-08-28T19:31:56.134828+0000","last_clean":"2024-08-28T19:31:56.134828+0000","last_became_active":"2024-08-28T19:29:48.123062+0000","last_became_peered":"2024-08-28T19:29:48.123062+0000","last_unstale":"2024-08-28T19:31:56.134828+0000","last_undegraded":"2024-08-28T19:31:56.134828+0000","last_fullsized":"2024-08-28T19:31:56.134828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:16:03.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007156+0000","last_change":"2024-08-28T19:29:46.105979+0000","last_active":"2024-08-28T19:31:28.007156+0000","last_peered":"2024-08-28T19:31:28.007156+0000","last_clean":"2024-08-28T19:31:28.007156+0000","last_became_active":"2024-08-28T19:29:46.105558+0000","last_became_peered":"2024-08-28T19:29:46.105558+0000","last_unstale":"2024-08-28T19:31:28.007156+0000","last_undegraded":"2024-08-28T19:31:28.007156+0000","last_fullsized":"2024-08-28T19:31:28.007156+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:47.639236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896414+0000","last_change":"2024-08-28T19:29:55.574025+0000","last_active":"2024-08-28T19:31:27.896414+0000","last_peered":"2024-08-28T19:31:27.896414+0000","last_clean":"2024-08-28T19:31:27.896414+0000","last_became_active":"2024-08-28T19:29:55.573380+0000","last_became_peered":"2024-08-28T19:29:55.573380+0000","last_unstale":"2024-08-28T19:31:27.896414+0000","last_undegraded":"2024-08-28T19:31:27.896414+0000","last_fullsized":"2024-08-28T19:31:27.896414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:19:05.287692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.138839+0000","last_change":"2024-08-28T19:29:48.118606+0000","last_active":"2024-08-28T19:31:56.138839+0000","last_peered":"2024-08-28T19:31:56.138839+0000","last_clean":"2024-08-28T19:31:56.138839+0000","last_became_active":"2024-08-28T19:29:48.117534+0000","last_became_peered":"2024-08-28T19:29:48.117534+0000","last_unstale":"2024-08-28T19:31:56.138839+0000","last_undegraded":"2024-08-28T19:31:56.138839+0000","last_fullsized":"2024-08-28T19:31:56.138839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:23:34.253859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896326+0000","last_change":"2024-08-28T19:29:46.100420+0000","last_active":"2024-08-28T19:31:27.896326+0000","last_peered":"2024-08-28T19:31:27.896326+0000","last_clean":"2024-08-28T19:31:27.896326+0000","last_became_active":"2024-08-28T19:29:46.099990+0000","last_became_peered":"2024-08-28T19:29:46.099990+0000","last_unstale":"2024-08-28T19:31:27.896326+0000","last_undegraded":"2024-08-28T19:31:27.896326+0000","last_fullsized":"2024-08-28T19:31:27.896326+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:42:12.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":113,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007243+0000","last_change":"2024-08-28T19:28:32.822169+0000","last_active":"2024-08-28T19:31:28.007243+0000","last_peered":"2024-08-28T19:31:28.007243+0000","last_clean":"2024-08-28T19:31:28.007243+0000","last_became_active":"2024-08-28T19:28:32.816300+0000","last_became_peered":"2024-08-28T19:28:32.816300+0000","last_unstale":"2024-08-28T19:31:28.007243+0000","last_undegraded":"2024-08-28T19:31:28.007243+0000","last_fullsized":"2024-08-28T19:31:28.007243+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:25:14.491568+0000","last_clean_scrub_stamp":"2024-08-28T19:25:14.491568+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:41:37.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007780+0000","last_change":"2024-08-28T19:29:55.265437+0000","last_active":"2024-08-28T19:31:28.007780+0000","last_peered":"2024-08-28T19:31:28.007780+0000","last_clean":"2024-08-28T19:31:28.007780+0000","last_became_active":"2024-08-28T19:29:55.264818+0000","last_became_peered":"2024-08-28T19:29:55.264818+0000","last_unstale":"2024-08-28T19:31:28.007780+0000","last_undegraded":"2024-08-28T19:31:28.007780+0000","last_fullsized":"2024-08-28T19:31:28.007780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:28:18.684362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152410+0000","last_change":"2024-08-28T19:29:48.135800+0000","last_active":"2024-08-28T19:31:56.152410+0000","last_peered":"2024-08-28T19:31:56.152410+0000","last_clean":"2024-08-28T19:31:56.152410+0000","last_became_active":"2024-08-28T19:29:48.135258+0000","last_became_peered":"2024-08-28T19:29:48.135258+0000","last_unstale":"2024-08-28T19:31:56.152410+0000","last_undegraded":"2024-08-28T19:31:56.152410+0000","last_fullsized":"2024-08-28T19:31:56.152410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:57:55.183190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":177,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:31.634769+0000","last_change":"2024-08-28T19:29:46.189298+0000","last_active":"2024-08-28T19:32:31.634769+0000","last_peered":"2024-08-28T19:32:31.634769+0000","last_clean":"2024-08-28T19:32:31.634769+0000","last_became_active":"2024-08-28T19:29:46.188813+0000","last_became_peered":"2024-08-28T19:29:46.188813+0000","last_unstale":"2024-08-28T19:32:31.634769+0000","last_undegraded":"2024-08-28T19:32:31.634769+0000","last_fullsized":"2024-08-28T19:32:31.634769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:14:00.961682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899863+0000","last_change":"2024-08-28T19:29:55.269495+0000","last_active":"2024-08-28T19:31:27.899863+0000","last_peered":"2024-08-28T19:31:27.899863+0000","last_clean":"2024-08-28T19:31:27.899863+0000","last_became_active":"2024-08-28T19:29:55.268916+0000","last_became_peered":"2024-08-28T19:29:55.268916+0000","last_unstale":"2024-08-28T19:31:27.899863+0000","last_undegraded":"2024-08-28T19:31:27.899863+0000","last_fullsized":"2024-08-28T19:31:27.899863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:26:53.869661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143974+0000","last_change":"2024-08-28T19:29:48.127588+0000","last_active":"2024-08-28T19:31:56.143974+0000","last_peered":"2024-08-28T19:31:56.143974+0000","last_clean":"2024-08-28T19:31:56.143974+0000","last_became_active":"2024-08-28T19:29:48.127200+0000","last_became_peered":"2024-08-28T19:29:48.127200+0000","last_unstale":"2024-08-28T19:31:56.143974+0000","last_undegraded":"2024-08-28T19:31:56.143974+0000","last_fullsized":"2024-08-28T19:31:56.143974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:30:30.144866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'62","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:33.368987+0000","last_change":"2024-08-28T19:29:46.101010+0000","last_active":"2024-08-28T19:32:33.368987+0000","last_peered":"2024-08-28T19:32:33.368987+0000","last_clean":"2024-08-28T19:32:33.368987+0000","last_became_active":"2024-08-28T19:29:46.100082+0000","last_became_peered":"2024-08-28T19:29:46.100082+0000","last_unstale":"2024-08-28T19:32:33.368987+0000","last_undegraded":"2024-08-28T19:32:33.368987+0000","last_fullsized":"2024-08-28T19:32:33.368987+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:18:51.074343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902334+0000","last_change":"2024-08-28T19:30:27.551743+0000","last_active":"2024-08-28T19:31:27.902334+0000","last_peered":"2024-08-28T19:31:27.902334+0000","last_clean":"2024-08-28T19:31:27.902334+0000","last_became_active":"2024-08-28T19:30:27.551249+0000","last_became_peered":"2024-08-28T19:30:27.551249+0000","last_unstale":"2024-08-28T19:31:27.902334+0000","last_undegraded":"2024-08-28T19:31:27.902334+0000","last_fullsized":"2024-08-28T19:31:27.902334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:35.043553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149263+0000","last_change":"2024-08-28T19:29:48.132429+0000","last_active":"2024-08-28T19:31:56.149263+0000","last_peered":"2024-08-28T19:31:56.149263+0000","last_clean":"2024-08-28T19:31:56.149263+0000","last_became_active":"2024-08-28T19:29:48.132020+0000","last_became_peered":"2024-08-28T19:29:48.132020+0000","last_unstale":"2024-08-28T19:31:56.149263+0000","last_undegraded":"2024-08-28T19:31:56.149263+0000","last_fullsized":"2024-08-28T19:31:56.149263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:45:11.992083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007247+0000","last_change":"2024-08-28T19:29:46.097245+0000","last_active":"2024-08-28T19:31:28.007247+0000","last_peered":"2024-08-28T19:31:28.007247+0000","last_clean":"2024-08-28T19:31:28.007247+0000","last_became_active":"2024-08-28T19:29:46.096867+0000","last_became_peered":"2024-08-28T19:29:46.096867+0000","last_unstale":"2024-08-28T19:31:28.007247+0000","last_undegraded":"2024-08-28T19:31:28.007247+0000","last_fullsized":"2024-08-28T19:31:28.007247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:22:14.888597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895601+0000","last_change":"2024-08-28T19:29:55.265006+0000","last_active":"2024-08-28T19:31:27.895601+0000","last_peered":"2024-08-28T19:31:27.895601+0000","last_clean":"2024-08-28T19:31:27.895601+0000","last_became_active":"2024-08-28T19:29:55.264321+0000","last_became_peered":"2024-08-28T19:29:55.264321+0000","last_unstale":"2024-08-28T19:31:27.895601+0000","last_undegraded":"2024-08-28T19:31:27.895601+0000","last_fullsized":"2024-08-28T19:31:27.895601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:53:27.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146436+0000","last_change":"2024-08-28T19:29:48.120916+0000","last_active":"2024-08-28T19:31:56.146436+0000","last_peered":"2024-08-28T19:31:56.146436+0000","last_clean":"2024-08-28T19:31:56.146436+0000","last_became_active":"2024-08-28T19:29:48.120473+0000","last_became_peered":"2024-08-28T19:29:48.120473+0000","last_unstale":"2024-08-28T19:31:56.146436+0000","last_undegraded":"2024-08-28T19:31:56.146436+0000","last_fullsized":"2024-08-28T19:31:56.146436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:41:15.067237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903218+0000","last_change":"2024-08-28T19:29:46.103164+0000","last_active":"2024-08-28T19:31:27.903218+0000","last_peered":"2024-08-28T19:31:27.903218+0000","last_clean":"2024-08-28T19:31:27.903218+0000","last_became_active":"2024-08-28T19:29:46.101772+0000","last_became_peered":"2024-08-28T19:29:46.101772+0000","last_unstale":"2024-08-28T19:31:27.903218+0000","last_undegraded":"2024-08-28T19:31:27.903218+0000","last_fullsized":"2024-08-28T19:31:27.903218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:46:29.533552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902270+0000","last_change":"2024-08-28T19:30:27.550861+0000","last_active":"2024-08-28T19:31:27.902270+0000","last_peered":"2024-08-28T19:31:27.902270+0000","last_clean":"2024-08-28T19:31:27.902270+0000","last_became_active":"2024-08-28T19:30:27.550131+0000","last_became_peered":"2024-08-28T19:30:27.550131+0000","last_unstale":"2024-08-28T19:31:27.902270+0000","last_undegraded":"2024-08-28T19:31:27.902270+0000","last_fullsized":"2024-08-28T19:31:27.902270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:37:16.004222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,3,1],"acting":[8,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128073+0000","last_change":"2024-08-28T19:30:27.551445+0000","last_active":"2024-08-28T19:31:56.128073+0000","last_peered":"2024-08-28T19:31:56.128073+0000","last_clean":"2024-08-28T19:31:56.128073+0000","last_became_active":"2024-08-28T19:30:27.550927+0000","last_became_peered":"2024-08-28T19:30:27.550927+0000","last_unstale":"2024-08-28T19:31:56.128073+0000","last_undegraded":"2024-08-28T19:31:56.128073+0000","last_fullsized":"2024-08-28T19:31:56.128073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:52:56.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.920185+0000","last_change":"2024-08-28T19:31:27.920056+0000","last_active":"2024-08-28T19:31:27.920185+0000","last_peered":"2024-08-28T19:31:27.920185+0000","last_clean":"2024-08-28T19:31:27.920185+0000","last_became_active":"2024-08-28T19:31:27.904583+0000","last_became_peered":"2024-08-28T19:31:27.904583+0000","last_unstale":"2024-08-28T19:31:27.920185+0000","last_undegraded":"2024-08-28T19:31:27.920185+0000","last_fullsized":"2024-08-28T19:31:27.920185+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:35:25.188307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007217+0000","last_change":"2024-08-28T19:29:55.266777+0000","last_active":"2024-08-28T19:31:28.007217+0000","last_peered":"2024-08-28T19:31:28.007217+0000","last_clean":"2024-08-28T19:31:28.007217+0000","last_became_active":"2024-08-28T19:29:55.266296+0000","last_became_peered":"2024-08-28T19:29:55.266296+0000","last_unstale":"2024-08-28T19:31:28.007217+0000","last_undegraded":"2024-08-28T19:31:28.007217+0000","last_fullsized":"2024-08-28T19:31:28.007217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:28:20.279522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150735+0000","last_change":"2024-08-28T19:29:48.129070+0000","last_active":"2024-08-28T19:31:56.150735+0000","last_peered":"2024-08-28T19:31:56.150735+0000","last_clean":"2024-08-28T19:31:56.150735+0000","last_became_active":"2024-08-28T19:29:48.128701+0000","last_became_peered":"2024-08-28T19:29:48.128701+0000","last_unstale":"2024-08-28T19:31:56.150735+0000","last_undegraded":"2024-08-28T19:31:56.150735+0000","last_fullsized":"2024-08-28T19:31:56.150735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:29:29.375379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":179,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:32.608545+0000","last_change":"2024-08-28T19:29:46.098281+0000","last_active":"2024-08-28T19:32:32.608545+0000","last_peered":"2024-08-28T19:32:32.608545+0000","last_clean":"2024-08-28T19:32:32.608545+0000","last_became_active":"2024-08-28T19:29:46.097870+0000","last_became_peered":"2024-08-28T19:29:46.097870+0000","last_unstale":"2024-08-28T19:32:32.608545+0000","last_undegraded":"2024-08-28T19:32:32.608545+0000","last_fullsized":"2024-08-28T19:32:32.608545+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:24:09.693310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894981+0000","last_change":"2024-08-28T19:29:55.264883+0000","last_active":"2024-08-28T19:31:27.894981+0000","last_peered":"2024-08-28T19:31:27.894981+0000","last_clean":"2024-08-28T19:31:27.894981+0000","last_became_active":"2024-08-28T19:29:55.264392+0000","last_became_peered":"2024-08-28T19:29:55.264392+0000","last_unstale":"2024-08-28T19:31:27.894981+0000","last_undegraded":"2024-08-28T19:31:27.894981+0000","last_fullsized":"2024-08-28T19:31:27.894981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:34.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150300+0000","last_change":"2024-08-28T19:29:48.135499+0000","last_active":"2024-08-28T19:31:56.150300+0000","last_peered":"2024-08-28T19:31:56.150300+0000","last_clean":"2024-08-28T19:31:56.150300+0000","last_became_active":"2024-08-28T19:29:48.134934+0000","last_became_peered":"2024-08-28T19:29:48.134934+0000","last_unstale":"2024-08-28T19:31:56.150300+0000","last_undegraded":"2024-08-28T19:31:56.150300+0000","last_fullsized":"2024-08-28T19:31:56.150300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:57:01.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.895983+0000","last_change":"2024-08-28T19:29:46.104680+0000","last_active":"2024-08-28T19:31:27.895983+0000","last_peered":"2024-08-28T19:31:27.895983+0000","last_clean":"2024-08-28T19:31:27.895983+0000","last_became_active":"2024-08-28T19:29:46.104290+0000","last_became_peered":"2024-08-28T19:29:46.104290+0000","last_unstale":"2024-08-28T19:31:27.895983+0000","last_undegraded":"2024-08-28T19:31:27.895983+0000","last_fullsized":"2024-08-28T19:31:27.895983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:50:39.789935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899299+0000","last_change":"2024-08-28T19:29:55.264676+0000","last_active":"2024-08-28T19:31:27.899299+0000","last_peered":"2024-08-28T19:31:27.899299+0000","last_clean":"2024-08-28T19:31:27.899299+0000","last_became_active":"2024-08-28T19:29:55.264206+0000","last_became_peered":"2024-08-28T19:29:55.264206+0000","last_unstale":"2024-08-28T19:31:27.899299+0000","last_undegraded":"2024-08-28T19:31:27.899299+0000","last_fullsized":"2024-08-28T19:31:27.899299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:58:15.776366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.149998+0000","last_change":"2024-08-28T19:29:48.125092+0000","last_active":"2024-08-28T19:31:56.149998+0000","last_peered":"2024-08-28T19:31:56.149998+0000","last_clean":"2024-08-28T19:31:56.149998+0000","last_became_active":"2024-08-28T19:29:48.124711+0000","last_became_peered":"2024-08-28T19:29:48.124711+0000","last_unstale":"2024-08-28T19:31:56.149998+0000","last_undegraded":"2024-08-28T19:31:56.149998+0000","last_fullsized":"2024-08-28T19:31:56.149998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:17:27.806368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902878+0000","last_change":"2024-08-28T19:29:46.100546+0000","last_active":"2024-08-28T19:31:27.902878+0000","last_peered":"2024-08-28T19:31:27.902878+0000","last_clean":"2024-08-28T19:31:27.902878+0000","last_became_active":"2024-08-28T19:29:46.100043+0000","last_became_peered":"2024-08-28T19:29:46.100043+0000","last_unstale":"2024-08-28T19:31:27.902878+0000","last_undegraded":"2024-08-28T19:31:27.902878+0000","last_fullsized":"2024-08-28T19:31:27.902878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:41:32.488258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896351+0000","last_change":"2024-08-28T19:29:55.265497+0000","last_active":"2024-08-28T19:31:27.896351+0000","last_peered":"2024-08-28T19:31:27.896351+0000","last_clean":"2024-08-28T19:31:27.896351+0000","last_became_active":"2024-08-28T19:29:55.264499+0000","last_became_peered":"2024-08-28T19:29:55.264499+0000","last_unstale":"2024-08-28T19:31:27.896351+0000","last_undegraded":"2024-08-28T19:31:27.896351+0000","last_fullsized":"2024-08-28T19:31:27.896351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:04:15.192307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.139694+0000","last_change":"2024-08-28T19:29:48.133948+0000","last_active":"2024-08-28T19:31:56.139694+0000","last_peered":"2024-08-28T19:31:56.139694+0000","last_clean":"2024-08-28T19:31:56.139694+0000","last_became_active":"2024-08-28T19:29:48.133517+0000","last_became_peered":"2024-08-28T19:29:48.133517+0000","last_unstale":"2024-08-28T19:31:56.139694+0000","last_undegraded":"2024-08-28T19:31:56.139694+0000","last_fullsized":"2024-08-28T19:31:56.139694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:43:20.049931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'40","reported_seq":353,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:36.614199+0000","last_change":"2024-08-28T19:29:46.104744+0000","last_active":"2024-08-28T19:32:36.614199+0000","last_peered":"2024-08-28T19:32:36.614199+0000","last_clean":"2024-08-28T19:32:36.614199+0000","last_became_active":"2024-08-28T19:29:46.104278+0000","last_became_peered":"2024-08-28T19:29:46.104278+0000","last_unstale":"2024-08-28T19:32:36.614199+0000","last_undegraded":"2024-08-28T19:32:36.614199+0000","last_fullsized":"2024-08-28T19:32:36.614199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:18:36.539472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68002,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":273,"num_read_kb":205,"num_write":42,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894437+0000","last_change":"2024-08-28T19:29:55.264892+0000","last_active":"2024-08-28T19:31:27.894437+0000","last_peered":"2024-08-28T19:31:27.894437+0000","last_clean":"2024-08-28T19:31:27.894437+0000","last_became_active":"2024-08-28T19:29:55.264466+0000","last_became_peered":"2024-08-28T19:29:55.264466+0000","last_unstale":"2024-08-28T19:31:27.894437+0000","last_undegraded":"2024-08-28T19:31:27.894437+0000","last_fullsized":"2024-08-28T19:31:27.894437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:34:51.016927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152034+0000","last_change":"2024-08-28T19:29:48.121692+0000","last_active":"2024-08-28T19:31:56.152034+0000","last_peered":"2024-08-28T19:31:56.152034+0000","last_clean":"2024-08-28T19:31:56.152034+0000","last_became_active":"2024-08-28T19:29:48.121274+0000","last_became_peered":"2024-08-28T19:29:48.121274+0000","last_unstale":"2024-08-28T19:31:56.152034+0000","last_undegraded":"2024-08-28T19:31:56.152034+0000","last_fullsized":"2024-08-28T19:31:56.152034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:00:36.227609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896564+0000","last_change":"2024-08-28T19:29:46.188981+0000","last_active":"2024-08-28T19:31:27.896564+0000","last_peered":"2024-08-28T19:31:27.896564+0000","last_clean":"2024-08-28T19:31:27.896564+0000","last_became_active":"2024-08-28T19:29:46.188496+0000","last_became_peered":"2024-08-28T19:29:46.188496+0000","last_unstale":"2024-08-28T19:31:27.896564+0000","last_undegraded":"2024-08-28T19:31:27.896564+0000","last_fullsized":"2024-08-28T19:31:27.896564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:13:30.689602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896238+0000","last_change":"2024-08-28T19:30:27.552006+0000","last_active":"2024-08-28T19:31:27.896238+0000","last_peered":"2024-08-28T19:31:27.896238+0000","last_clean":"2024-08-28T19:31:27.896238+0000","last_became_active":"2024-08-28T19:30:27.551356+0000","last_became_peered":"2024-08-28T19:30:27.551356+0000","last_unstale":"2024-08-28T19:31:27.896238+0000","last_undegraded":"2024-08-28T19:31:27.896238+0000","last_fullsized":"2024-08-28T19:31:27.896238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:56:09.242401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144743+0000","last_change":"2024-08-28T19:29:48.116964+0000","last_active":"2024-08-28T19:31:56.144743+0000","last_peered":"2024-08-28T19:31:56.144743+0000","last_clean":"2024-08-28T19:31:56.144743+0000","last_became_active":"2024-08-28T19:29:48.116588+0000","last_became_peered":"2024-08-28T19:29:48.116588+0000","last_unstale":"2024-08-28T19:31:56.144743+0000","last_undegraded":"2024-08-28T19:31:56.144743+0000","last_fullsized":"2024-08-28T19:31:56.144743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:52:02.486724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007960+0000","last_change":"2024-08-28T19:29:46.104132+0000","last_active":"2024-08-28T19:31:28.007960+0000","last_peered":"2024-08-28T19:31:28.007960+0000","last_clean":"2024-08-28T19:31:28.007960+0000","last_became_active":"2024-08-28T19:29:46.103725+0000","last_became_peered":"2024-08-28T19:29:46.103725+0000","last_unstale":"2024-08-28T19:31:28.007960+0000","last_undegraded":"2024-08-28T19:31:28.007960+0000","last_fullsized":"2024-08-28T19:31:28.007960+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:50:12.859989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.894212+0000","last_change":"2024-08-28T19:29:55.265494+0000","last_active":"2024-08-28T19:31:27.894212+0000","last_peered":"2024-08-28T19:31:27.894212+0000","last_clean":"2024-08-28T19:31:27.894212+0000","last_became_active":"2024-08-28T19:29:55.265087+0000","last_became_peered":"2024-08-28T19:29:55.265087+0000","last_unstale":"2024-08-28T19:31:27.894212+0000","last_undegraded":"2024-08-28T19:31:27.894212+0000","last_fullsized":"2024-08-28T19:31:27.894212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:51:18.676889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152669+0000","last_change":"2024-08-28T19:29:48.127419+0000","last_active":"2024-08-28T19:31:56.152669+0000","last_peered":"2024-08-28T19:31:56.152669+0000","last_clean":"2024-08-28T19:31:56.152669+0000","last_became_active":"2024-08-28T19:29:48.126997+0000","last_became_peered":"2024-08-28T19:29:48.126997+0000","last_unstale":"2024-08-28T19:31:56.152669+0000","last_undegraded":"2024-08-28T19:31:56.152669+0000","last_fullsized":"2024-08-28T19:31:56.152669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:26:08.208724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'5","reported_seq":305,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:36.613987+0000","last_change":"2024-08-28T19:29:46.103451+0000","last_active":"2024-08-28T19:32:36.613987+0000","last_peered":"2024-08-28T19:32:36.613987+0000","last_clean":"2024-08-28T19:32:36.613987+0000","last_became_active":"2024-08-28T19:29:46.102991+0000","last_became_peered":"2024-08-28T19:29:46.102991+0000","last_unstale":"2024-08-28T19:32:36.613987+0000","last_undegraded":"2024-08-28T19:32:36.613987+0000","last_fullsized":"2024-08-28T19:32:36.613987+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:55:58.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":260,"num_read_kb":260,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.901836+0000","last_change":"2024-08-28T19:29:55.269310+0000","last_active":"2024-08-28T19:31:27.901836+0000","last_peered":"2024-08-28T19:31:27.901836+0000","last_clean":"2024-08-28T19:31:27.901836+0000","last_became_active":"2024-08-28T19:29:55.268893+0000","last_became_peered":"2024-08-28T19:29:55.268893+0000","last_unstale":"2024-08-28T19:31:27.901836+0000","last_undegraded":"2024-08-28T19:31:27.901836+0000","last_fullsized":"2024-08-28T19:31:27.901836+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:26:11.598773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902085+0000","last_change":"2024-08-28T19:29:55.261757+0000","last_active":"2024-08-28T19:31:27.902085+0000","last_peered":"2024-08-28T19:31:27.902085+0000","last_clean":"2024-08-28T19:31:27.902085+0000","last_became_active":"2024-08-28T19:29:55.261339+0000","last_became_peered":"2024-08-28T19:29:55.261339+0000","last_unstale":"2024-08-28T19:31:27.902085+0000","last_undegraded":"2024-08-28T19:31:27.902085+0000","last_fullsized":"2024-08-28T19:31:27.902085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:25:06.223029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.130201+0000","last_change":"2024-08-28T19:29:48.123097+0000","last_active":"2024-08-28T19:31:56.130201+0000","last_peered":"2024-08-28T19:31:56.130201+0000","last_clean":"2024-08-28T19:31:56.130201+0000","last_became_active":"2024-08-28T19:29:48.122718+0000","last_became_peered":"2024-08-28T19:29:48.122718+0000","last_unstale":"2024-08-28T19:31:56.130201+0000","last_undegraded":"2024-08-28T19:31:56.130201+0000","last_fullsized":"2024-08-28T19:31:56.130201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:47:19.530985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.896115+0000","last_change":"2024-08-28T19:29:46.105516+0000","last_active":"2024-08-28T19:31:27.896115+0000","last_peered":"2024-08-28T19:31:27.896115+0000","last_clean":"2024-08-28T19:31:27.896115+0000","last_became_active":"2024-08-28T19:29:46.105030+0000","last_became_peered":"2024-08-28T19:29:46.105030+0000","last_unstale":"2024-08-28T19:31:27.896115+0000","last_undegraded":"2024-08-28T19:31:27.896115+0000","last_fullsized":"2024-08-28T19:31:27.896115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:47:02.032933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.899627+0000","last_change":"2024-08-28T19:29:55.269759+0000","last_active":"2024-08-28T19:31:27.899627+0000","last_peered":"2024-08-28T19:31:27.899627+0000","last_clean":"2024-08-28T19:31:27.899627+0000","last_became_active":"2024-08-28T19:29:55.269275+0000","last_became_peered":"2024-08-28T19:29:55.269275+0000","last_unstale":"2024-08-28T19:31:27.899627+0000","last_undegraded":"2024-08-28T19:31:27.899627+0000","last_fullsized":"2024-08-28T19:31:27.899627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:01:45.870468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131493+0000","last_change":"2024-08-28T19:29:48.117400+0000","last_active":"2024-08-28T19:31:56.131493+0000","last_peered":"2024-08-28T19:31:56.131493+0000","last_clean":"2024-08-28T19:31:56.131493+0000","last_became_active":"2024-08-28T19:29:48.116987+0000","last_became_peered":"2024-08-28T19:29:48.116987+0000","last_unstale":"2024-08-28T19:31:56.131493+0000","last_undegraded":"2024-08-28T19:31:56.131493+0000","last_fullsized":"2024-08-28T19:31:56.131493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T05:10:43.822088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.006521+0000","last_change":"2024-08-28T19:29:46.096103+0000","last_active":"2024-08-28T19:31:28.006521+0000","last_peered":"2024-08-28T19:31:28.006521+0000","last_clean":"2024-08-28T19:31:28.006521+0000","last_became_active":"2024-08-28T19:29:46.095812+0000","last_became_peered":"2024-08-28T19:29:46.095812+0000","last_unstale":"2024-08-28T19:31:28.006521+0000","last_undegraded":"2024-08-28T19:31:28.006521+0000","last_fullsized":"2024-08-28T19:31:28.006521+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:49:29.266636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:28.007661+0000","last_change":"2024-08-28T19:29:46.106227+0000","last_active":"2024-08-28T19:31:28.007661+0000","last_peered":"2024-08-28T19:31:28.007661+0000","last_clean":"2024-08-28T19:31:28.007661+0000","last_became_active":"2024-08-28T19:29:46.105777+0000","last_became_peered":"2024-08-28T19:29:46.105777+0000","last_unstale":"2024-08-28T19:31:28.007661+0000","last_undegraded":"2024-08-28T19:31:28.007661+0000","last_fullsized":"2024-08-28T19:31:28.007661+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:26:14.815646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144860+0000","last_change":"2024-08-28T19:29:48.111051+0000","last_active":"2024-08-28T19:31:56.144860+0000","last_peered":"2024-08-28T19:31:56.144860+0000","last_clean":"2024-08-28T19:31:56.144860+0000","last_became_active":"2024-08-28T19:29:48.110421+0000","last_became_peered":"2024-08-28T19:29:48.110421+0000","last_unstale":"2024-08-28T19:31:56.144860+0000","last_undegraded":"2024-08-28T19:31:56.144860+0000","last_fullsized":"2024-08-28T19:31:56.144860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:19:47.765977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.902713+0000","last_change":"2024-08-28T19:30:27.408829+0000","last_active":"2024-08-28T19:31:27.902713+0000","last_peered":"2024-08-28T19:31:27.902713+0000","last_clean":"2024-08-28T19:31:27.902713+0000","last_became_active":"2024-08-28T19:30:27.408298+0000","last_became_peered":"2024-08-28T19:30:27.408298+0000","last_unstale":"2024-08-28T19:31:27.902713+0000","last_undegraded":"2024-08-28T19:31:27.902713+0000","last_fullsized":"2024-08-28T19:31:27.902713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:38:58.558783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":177,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:32:35.613157+0000","last_change":"2024-08-28T19:29:46.102607+0000","last_active":"2024-08-28T19:32:35.613157+0000","last_peered":"2024-08-28T19:32:35.613157+0000","last_clean":"2024-08-28T19:32:35.613157+0000","last_became_active":"2024-08-28T19:29:46.102150+0000","last_became_peered":"2024-08-28T19:29:46.102150+0000","last_unstale":"2024-08-28T19:32:35.613157+0000","last_undegraded":"2024-08-28T19:32:35.613157+0000","last_fullsized":"2024-08-28T19:32:35.613157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:45.073906+0000","last_clean_scrub_stamp":"2024-08-28T19:29:45.073906+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:01:44.973202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128134+0000","last_change":"2024-08-28T19:29:48.121598+0000","last_active":"2024-08-28T19:31:56.128134+0000","last_peered":"2024-08-28T19:31:56.128134+0000","last_clean":"2024-08-28T19:31:56.128134+0000","last_became_active":"2024-08-28T19:29:48.121189+0000","last_became_peered":"2024-08-28T19:29:48.121189+0000","last_unstale":"2024-08-28T19:31:56.128134+0000","last_undegraded":"2024-08-28T19:31:56.128134+0000","last_fullsized":"2024-08-28T19:31:56.128134+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:19:35.496859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:27.903566+0000","last_change":"2024-08-28T19:29:55.269648+0000","last_active":"2024-08-28T19:31:27.903566+0000","last_peered":"2024-08-28T19:31:27.903566+0000","last_clean":"2024-08-28T19:31:27.903566+0000","last_became_active":"2024-08-28T19:29:55.269182+0000","last_became_peered":"2024-08-28T19:29:55.269182+0000","last_unstale":"2024-08-28T19:31:27.903566+0000","last_undegraded":"2024-08-28T19:31:27.903566+0000","last_fullsized":"2024-08-28T19:31:27.903566+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:54.242677+0000","last_clean_scrub_stamp":"2024-08-28T19:29:54.242677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:09:47.581907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146872+0000","last_change":"2024-08-28T19:29:48.117143+0000","last_active":"2024-08-28T19:31:56.146872+0000","last_peered":"2024-08-28T19:31:56.146872+0000","last_clean":"2024-08-28T19:31:56.146872+0000","last_became_active":"2024-08-28T19:29:48.116756+0000","last_became_peered":"2024-08-28T19:29:48.116756+0000","last_unstale":"2024-08-28T19:31:56.146872+0000","last_undegraded":"2024-08-28T19:31:56.146872+0000","last_fullsized":"2024-08-28T19:31:56.146872+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:03:30.736872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141006+0000","last_change":"2024-08-28T19:30:27.407218+0000","last_active":"2024-08-28T19:31:56.141006+0000","last_peered":"2024-08-28T19:31:56.141006+0000","last_clean":"2024-08-28T19:31:56.141006+0000","last_became_active":"2024-08-28T19:30:27.406769+0000","last_became_peered":"2024-08-28T19:30:27.406769+0000","last_unstale":"2024-08-28T19:31:56.141006+0000","last_undegraded":"2024-08-28T19:31:56.141006+0000","last_fullsized":"2024-08-28T19:31:56.141006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:32:59.946922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.135902+0000","last_change":"2024-08-28T19:29:48.123969+0000","last_active":"2024-08-28T19:31:56.135902+0000","last_peered":"2024-08-28T19:31:56.135902+0000","last_clean":"2024-08-28T19:31:56.135902+0000","last_became_active":"2024-08-28T19:29:48.122534+0000","last_became_peered":"2024-08-28T19:29:48.122534+0000","last_unstale":"2024-08-28T19:31:56.135902+0000","last_undegraded":"2024-08-28T19:31:56.135902+0000","last_fullsized":"2024-08-28T19:31:56.135902+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:33:56.739763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132732+0000","last_change":"2024-08-28T19:29:48.108976+0000","last_active":"2024-08-28T19:31:56.132732+0000","last_peered":"2024-08-28T19:31:56.132732+0000","last_clean":"2024-08-28T19:31:56.132732+0000","last_became_active":"2024-08-28T19:29:48.108631+0000","last_became_peered":"2024-08-28T19:29:48.108631+0000","last_unstale":"2024-08-28T19:31:56.132732+0000","last_undegraded":"2024-08-28T19:31:56.132732+0000","last_fullsized":"2024-08-28T19:31:56.132732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:08:59.134811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131974+0000","last_change":"2024-08-28T19:29:48.109875+0000","last_active":"2024-08-28T19:31:56.131974+0000","last_peered":"2024-08-28T19:31:56.131974+0000","last_clean":"2024-08-28T19:31:56.131974+0000","last_became_active":"2024-08-28T19:29:48.109486+0000","last_became_peered":"2024-08-28T19:29:48.109486+0000","last_unstale":"2024-08-28T19:31:56.131974+0000","last_undegraded":"2024-08-28T19:31:56.131974+0000","last_fullsized":"2024-08-28T19:31:56.131974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:02:28.365203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.146393+0000","last_change":"2024-08-28T19:29:48.117237+0000","last_active":"2024-08-28T19:31:56.146393+0000","last_peered":"2024-08-28T19:31:56.146393+0000","last_clean":"2024-08-28T19:31:56.146393+0000","last_became_active":"2024-08-28T19:29:48.116799+0000","last_became_peered":"2024-08-28T19:29:48.116799+0000","last_unstale":"2024-08-28T19:31:56.146393+0000","last_undegraded":"2024-08-28T19:31:56.146393+0000","last_fullsized":"2024-08-28T19:31:56.146393+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:48:12.110566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144924+0000","last_change":"2024-08-28T19:29:48.120522+0000","last_active":"2024-08-28T19:31:56.144924+0000","last_peered":"2024-08-28T19:31:56.144924+0000","last_clean":"2024-08-28T19:31:56.144924+0000","last_became_active":"2024-08-28T19:29:48.120150+0000","last_became_peered":"2024-08-28T19:29:48.120150+0000","last_unstale":"2024-08-28T19:31:56.144924+0000","last_undegraded":"2024-08-28T19:31:56.144924+0000","last_fullsized":"2024-08-28T19:31:56.144924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:01:00.210596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.126169+0000","last_change":"2024-08-28T19:29:48.128451+0000","last_active":"2024-08-28T19:31:56.126169+0000","last_peered":"2024-08-28T19:31:56.126169+0000","last_clean":"2024-08-28T19:31:56.126169+0000","last_became_active":"2024-08-28T19:29:48.127898+0000","last_became_peered":"2024-08-28T19:29:48.127898+0000","last_unstale":"2024-08-28T19:31:56.126169+0000","last_undegraded":"2024-08-28T19:31:56.126169+0000","last_fullsized":"2024-08-28T19:31:56.126169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:48.663999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142755+0000","last_change":"2024-08-28T19:29:48.110788+0000","last_active":"2024-08-28T19:31:56.142755+0000","last_peered":"2024-08-28T19:31:56.142755+0000","last_clean":"2024-08-28T19:31:56.142755+0000","last_became_active":"2024-08-28T19:29:48.110355+0000","last_became_peered":"2024-08-28T19:29:48.110355+0000","last_unstale":"2024-08-28T19:31:56.142755+0000","last_undegraded":"2024-08-28T19:31:56.142755+0000","last_fullsized":"2024-08-28T19:31:56.142755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T01:57:25.345283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141195+0000","last_change":"2024-08-28T19:29:48.129667+0000","last_active":"2024-08-28T19:31:56.141195+0000","last_peered":"2024-08-28T19:31:56.141195+0000","last_clean":"2024-08-28T19:31:56.141195+0000","last_became_active":"2024-08-28T19:29:48.128237+0000","last_became_peered":"2024-08-28T19:29:48.128237+0000","last_unstale":"2024-08-28T19:31:56.141195+0000","last_undegraded":"2024-08-28T19:31:56.141195+0000","last_fullsized":"2024-08-28T19:31:56.141195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:23:35.920353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151419+0000","last_change":"2024-08-28T19:29:48.136070+0000","last_active":"2024-08-28T19:31:56.151419+0000","last_peered":"2024-08-28T19:31:56.151419+0000","last_clean":"2024-08-28T19:31:56.151419+0000","last_became_active":"2024-08-28T19:29:48.135515+0000","last_became_peered":"2024-08-28T19:29:48.135515+0000","last_unstale":"2024-08-28T19:31:56.151419+0000","last_undegraded":"2024-08-28T19:31:56.151419+0000","last_fullsized":"2024-08-28T19:31:56.151419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:25:29.267753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150677+0000","last_change":"2024-08-28T19:29:48.128614+0000","last_active":"2024-08-28T19:31:56.150677+0000","last_peered":"2024-08-28T19:31:56.150677+0000","last_clean":"2024-08-28T19:31:56.150677+0000","last_became_active":"2024-08-28T19:29:48.128231+0000","last_became_peered":"2024-08-28T19:29:48.128231+0000","last_unstale":"2024-08-28T19:31:56.150677+0000","last_undegraded":"2024-08-28T19:31:56.150677+0000","last_fullsized":"2024-08-28T19:31:56.150677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:11:08.541435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143953+0000","last_change":"2024-08-28T19:29:48.114930+0000","last_active":"2024-08-28T19:31:56.143953+0000","last_peered":"2024-08-28T19:31:56.143953+0000","last_clean":"2024-08-28T19:31:56.143953+0000","last_became_active":"2024-08-28T19:29:48.114389+0000","last_became_peered":"2024-08-28T19:29:48.114389+0000","last_unstale":"2024-08-28T19:31:56.143953+0000","last_undegraded":"2024-08-28T19:31:56.143953+0000","last_fullsized":"2024-08-28T19:31:56.143953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T00:28:51.361571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141213+0000","last_change":"2024-08-28T19:29:48.125031+0000","last_active":"2024-08-28T19:31:56.141213+0000","last_peered":"2024-08-28T19:31:56.141213+0000","last_clean":"2024-08-28T19:31:56.141213+0000","last_became_active":"2024-08-28T19:29:48.124417+0000","last_became_peered":"2024-08-28T19:29:48.124417+0000","last_unstale":"2024-08-28T19:31:56.141213+0000","last_undegraded":"2024-08-28T19:31:56.141213+0000","last_fullsized":"2024-08-28T19:31:56.141213+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T22:33:33.931496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.143690+0000","last_change":"2024-08-28T19:29:48.127815+0000","last_active":"2024-08-28T19:31:56.143690+0000","last_peered":"2024-08-28T19:31:56.143690+0000","last_clean":"2024-08-28T19:31:56.143690+0000","last_became_active":"2024-08-28T19:29:48.127455+0000","last_became_peered":"2024-08-28T19:29:48.127455+0000","last_unstale":"2024-08-28T19:31:56.143690+0000","last_undegraded":"2024-08-28T19:31:56.143690+0000","last_fullsized":"2024-08-28T19:31:56.143690+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:47:23.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.142376+0000","last_change":"2024-08-28T19:29:48.122105+0000","last_active":"2024-08-28T19:31:56.142376+0000","last_peered":"2024-08-28T19:31:56.142376+0000","last_clean":"2024-08-28T19:31:56.142376+0000","last_became_active":"2024-08-28T19:29:48.121546+0000","last_became_peered":"2024-08-28T19:29:48.121546+0000","last_unstale":"2024-08-28T19:31:56.142376+0000","last_undegraded":"2024-08-28T19:31:56.142376+0000","last_fullsized":"2024-08-28T19:31:56.142376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:21:00.428052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.151147+0000","last_change":"2024-08-28T19:29:48.136198+0000","last_active":"2024-08-28T19:31:56.151147+0000","last_peered":"2024-08-28T19:31:56.151147+0000","last_clean":"2024-08-28T19:31:56.151147+0000","last_became_active":"2024-08-28T19:29:48.135796+0000","last_became_peered":"2024-08-28T19:29:48.135796+0000","last_unstale":"2024-08-28T19:31:56.151147+0000","last_undegraded":"2024-08-28T19:31:56.151147+0000","last_fullsized":"2024-08-28T19:31:56.151147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T20:35:05.033399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.134895+0000","last_change":"2024-08-28T19:29:48.121245+0000","last_active":"2024-08-28T19:31:56.134895+0000","last_peered":"2024-08-28T19:31:56.134895+0000","last_clean":"2024-08-28T19:31:56.134895+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.134895+0000","last_undegraded":"2024-08-28T19:31:56.134895+0000","last_fullsized":"2024-08-28T19:31:56.134895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:25:39.936209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.132329+0000","last_change":"2024-08-28T19:29:48.119198+0000","last_active":"2024-08-28T19:31:56.132329+0000","last_peered":"2024-08-28T19:31:56.132329+0000","last_clean":"2024-08-28T19:31:56.132329+0000","last_became_active":"2024-08-28T19:29:48.118744+0000","last_became_peered":"2024-08-28T19:29:48.118744+0000","last_unstale":"2024-08-28T19:31:56.132329+0000","last_undegraded":"2024-08-28T19:31:56.132329+0000","last_fullsized":"2024-08-28T19:31:56.132329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:15:35.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131834+0000","last_change":"2024-08-28T19:30:27.403790+0000","last_active":"2024-08-28T19:31:56.131834+0000","last_peered":"2024-08-28T19:31:56.131834+0000","last_clean":"2024-08-28T19:31:56.131834+0000","last_became_active":"2024-08-28T19:30:27.403279+0000","last_became_peered":"2024-08-28T19:30:27.403279+0000","last_unstale":"2024-08-28T19:31:56.131834+0000","last_undegraded":"2024-08-28T19:31:56.131834+0000","last_fullsized":"2024-08-28T19:31:56.131834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T23:31:54.137839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.128885+0000","last_change":"2024-08-28T19:30:27.405173+0000","last_active":"2024-08-28T19:31:56.128885+0000","last_peered":"2024-08-28T19:31:56.128885+0000","last_clean":"2024-08-28T19:31:56.128885+0000","last_became_active":"2024-08-28T19:30:27.404752+0000","last_became_peered":"2024-08-28T19:30:27.404752+0000","last_unstale":"2024-08-28T19:31:56.128885+0000","last_undegraded":"2024-08-28T19:31:56.128885+0000","last_fullsized":"2024-08-28T19:31:56.128885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T03:49:16.544309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152246+0000","last_change":"2024-08-28T19:29:48.136738+0000","last_active":"2024-08-28T19:31:56.152246+0000","last_peered":"2024-08-28T19:31:56.152246+0000","last_clean":"2024-08-28T19:31:56.152246+0000","last_became_active":"2024-08-28T19:29:48.136046+0000","last_became_peered":"2024-08-28T19:29:48.136046+0000","last_unstale":"2024-08-28T19:31:56.152246+0000","last_undegraded":"2024-08-28T19:31:56.152246+0000","last_fullsized":"2024-08-28T19:31:56.152246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T19:43:32.905933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":51,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.127788+0000","last_change":"2024-08-28T19:29:48.127432+0000","last_active":"2024-08-28T19:31:56.127788+0000","last_peered":"2024-08-28T19:31:56.127788+0000","last_clean":"2024-08-28T19:31:56.127788+0000","last_became_active":"2024-08-28T19:29:48.126067+0000","last_became_peered":"2024-08-28T19:29:48.126067+0000","last_unstale":"2024-08-28T19:31:56.127788+0000","last_undegraded":"2024-08-28T19:31:56.127788+0000","last_fullsized":"2024-08-28T19:31:56.127788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:30:05.370076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.152540+0000","last_change":"2024-08-28T19:29:48.121154+0000","last_active":"2024-08-28T19:31:56.152540+0000","last_peered":"2024-08-28T19:31:56.152540+0000","last_clean":"2024-08-28T19:31:56.152540+0000","last_became_active":"2024-08-28T19:29:48.120709+0000","last_became_peered":"2024-08-28T19:29:48.120709+0000","last_unstale":"2024-08-28T19:31:56.152540+0000","last_undegraded":"2024-08-28T19:31:56.152540+0000","last_fullsized":"2024-08-28T19:31:56.152540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:30:52.716814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.144107+0000","last_change":"2024-08-28T19:29:48.127124+0000","last_active":"2024-08-28T19:31:56.144107+0000","last_peered":"2024-08-28T19:31:56.144107+0000","last_clean":"2024-08-28T19:31:56.144107+0000","last_became_active":"2024-08-28T19:29:48.126761+0000","last_became_peered":"2024-08-28T19:29:48.126761+0000","last_unstale":"2024-08-28T19:31:56.144107+0000","last_undegraded":"2024-08-28T19:31:56.144107+0000","last_fullsized":"2024-08-28T19:31:56.144107+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-29T21:05:31.150472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.150014+0000","last_change":"2024-08-28T19:29:48.132285+0000","last_active":"2024-08-28T19:31:56.150014+0000","last_peered":"2024-08-28T19:31:56.150014+0000","last_clean":"2024-08-28T19:31:56.150014+0000","last_became_active":"2024-08-28T19:29:48.131688+0000","last_became_peered":"2024-08-28T19:29:48.131688+0000","last_unstale":"2024-08-28T19:31:56.150014+0000","last_undegraded":"2024-08-28T19:31:56.150014+0000","last_fullsized":"2024-08-28T19:31:56.150014+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T07:23:08.343776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.124596+0000","last_change":"2024-08-28T19:29:48.126384+0000","last_active":"2024-08-28T19:31:56.124596+0000","last_peered":"2024-08-28T19:31:56.124596+0000","last_clean":"2024-08-28T19:31:56.124596+0000","last_became_active":"2024-08-28T19:29:48.125412+0000","last_became_peered":"2024-08-28T19:29:48.125412+0000","last_unstale":"2024-08-28T19:31:56.124596+0000","last_undegraded":"2024-08-28T19:31:56.124596+0000","last_fullsized":"2024-08-28T19:31:56.124596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:47:42.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.125963+0000","last_change":"2024-08-28T19:29:48.114032+0000","last_active":"2024-08-28T19:31:56.125963+0000","last_peered":"2024-08-28T19:31:56.125963+0000","last_clean":"2024-08-28T19:31:56.125963+0000","last_became_active":"2024-08-28T19:29:48.113625+0000","last_became_peered":"2024-08-28T19:29:48.113625+0000","last_unstale":"2024-08-28T19:31:56.125963+0000","last_undegraded":"2024-08-28T19:31:56.125963+0000","last_fullsized":"2024-08-28T19:31:56.125963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:07:08.825777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.131499+0000","last_change":"2024-08-28T19:29:48.124046+0000","last_active":"2024-08-28T19:31:56.131499+0000","last_peered":"2024-08-28T19:31:56.131499+0000","last_clean":"2024-08-28T19:31:56.131499+0000","last_became_active":"2024-08-28T19:29:48.123647+0000","last_became_peered":"2024-08-28T19:29:48.123647+0000","last_unstale":"2024-08-28T19:31:56.131499+0000","last_undegraded":"2024-08-28T19:31:56.131499+0000","last_fullsized":"2024-08-28T19:31:56.131499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:25:59.262454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.148165+0000","last_change":"2024-08-28T19:29:48.121258+0000","last_active":"2024-08-28T19:31:56.148165+0000","last_peered":"2024-08-28T19:31:56.148165+0000","last_clean":"2024-08-28T19:31:56.148165+0000","last_became_active":"2024-08-28T19:29:48.120906+0000","last_became_peered":"2024-08-28T19:29:48.120906+0000","last_unstale":"2024-08-28T19:31:56.148165+0000","last_undegraded":"2024-08-28T19:31:56.148165+0000","last_fullsized":"2024-08-28T19:31:56.148165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T02:37:05.610466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.129860+0000","last_change":"2024-08-28T19:29:48.125071+0000","last_active":"2024-08-28T19:31:56.129860+0000","last_peered":"2024-08-28T19:31:56.129860+0000","last_clean":"2024-08-28T19:31:56.129860+0000","last_became_active":"2024-08-28T19:29:48.124706+0000","last_became_peered":"2024-08-28T19:29:48.124706+0000","last_unstale":"2024-08-28T19:31:56.129860+0000","last_undegraded":"2024-08-28T19:31:56.129860+0000","last_fullsized":"2024-08-28T19:31:56.129860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T04:39:06.460682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-28T19:31:56.141807+0000","last_change":"2024-08-28T19:29:48.121905+0000","last_active":"2024-08-28T19:31:56.141807+0000","last_peered":"2024-08-28T19:31:56.141807+0000","last_clean":"2024-08-28T19:31:56.141807+0000","last_became_active":"2024-08-28T19:29:48.121045+0000","last_became_peered":"2024-08-28T19:29:48.121045+0000","last_unstale":"2024-08-28T19:31:56.141807+0000","last_undegraded":"2024-08-28T19:31:56.141807+0000","last_fullsized":"2024-08-28T19:31:56.141807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-28T19:29:47.083637+0000","last_clean_scrub_stamp":"2024-08-28T19:29:47.083637+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-30T06:56:58.124893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":862788,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1669,"num_read_kb":1055,"num_write":487,"num_write_kb":2246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":823296,"data_stored":2588364,"data_compressed":112140,"data_compressed_allocated":147456,"data_compressed_original":2285568,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":246047,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776176,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":496720,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939700,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36468,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708684,"statfs":{"total":95995035648,"available":95957692416,"internally_reserved":0,"allocated":1146880,"data_stored":1545510,"data_compressed":83633,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103226,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":893318,"data_compressed":48988,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":889488,"data_compressed":48988,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495682,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":1093330,"data_compressed":65542,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659208,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":491510,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855438,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1073152,"data_stored":1481848,"data_compressed":83633,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018961,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":496424,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215190,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":1278210,"data_compressed":67079,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411419,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":561294,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542241,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":560542,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":493498,"data_compressed":29699,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34225,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35843,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":787422,"data_compressed":37380,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":396596,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":394604,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":464354,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-28T19:32:40.178 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:32:40.434 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:40.698 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:40 smithi033 ceph-mon[18549]: from='client.15669 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:40 smithi059 ceph-mon[22052]: from='client.15669 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:40 smithi122 ceph-mon[22174]: from='client.15669 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-28T19:32:40.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.902+0000 7f0c7211f640 1 -- 172.21.15.33:0/3717931090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6c108180 msgr2=0x7f0c6c108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:40.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.902+0000 7f0c7211f640 1 --2- 172.21.15.33:0/3717931090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6c108180 0x7f0c6c108590 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009900 tx=0x7f0c5402a410 comp rx=0 tx=0).stop 2024-08-28T19:32:40.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.902+0000 7f0c7211f640 1 -- 172.21.15.33:0/3717931090 shutdown_connections 2024-08-28T19:32:40.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.902+0000 7f0c7211f640 1 --2- 172.21.15.33:0/3717931090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6c108ad0 0x7f0c6c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:40.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.902+0000 7f0c7211f640 1 --2- 172.21.15.33:0/3717931090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6c108180 0x7f0c6c108590 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:40.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.902+0000 7f0c7211f640 1 --2- 172.21.15.33:0/3717931090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c102840 0x7f0c6c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:40.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.902+0000 7f0c7211f640 1 -- 172.21.15.33:0/3717931090 >> 172.21.15.33:0/3717931090 conn(0x7f0c6c0794f0 msgr2=0x7f0c6c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:40.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.902+0000 7f0c7211f640 1 -- 172.21.15.33:0/3717931090 shutdown_connections 2024-08-28T19:32:40.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.902+0000 7f0c7211f640 1 -- 172.21.15.33:0/3717931090 wait complete. 2024-08-28T19:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.903+0000 7f0c7211f640 1 Processor -- start 2024-08-28T19:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.903+0000 7f0c7211f640 1 -- start start 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c7211f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6c102840 0x7f0c6c19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c7211f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108180 0x7f0c6c19b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c7211f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6c108ad0 0x7f0c6c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c7211f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c112740 con 0x7f0c6c108ad0 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c7211f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1125c0 con 0x7f0c6c102840 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c7211f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1128c0 con 0x7f0c6c108180 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c6bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6c108ad0 0x7f0c6c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c6bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6c108ad0 0x7f0c6c19bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47384/0 (socket says 172.21.15.33:47384) 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c6bfff640 1 -- 172.21.15.33:0/4249321312 learned_addr learned my addr 172.21.15.33:0/4249321312 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c6b7fe640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6c102840 0x7f0c6c19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c62ffd640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108180 0x7f0c6c19b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c6bfff640 1 -- 172.21.15.33:0/4249321312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108180 msgr2=0x7f0c6c19b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c6bfff640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108180 0x7f0c6c19b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c6bfff640 1 -- 172.21.15.33:0/4249321312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6c102840 msgr2=0x7f0c6c19b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c6bfff640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6c102840 0x7f0c6c19b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c6bfff640 1 -- 172.21.15.33:0/4249321312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c1a6280 con 0x7f0c6c108ad0 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.904+0000 7f0c6bfff640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6c108ad0 0x7f0c6c19bad0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400eaa0 tx=0x7f0c6400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.905+0000 7f0c697fa640 1 -- 172.21.15.33:0/4249321312 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64004d20 con 0x7f0c6c108ad0 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.905+0000 7f0c697fa640 1 -- 172.21.15.33:0/4249321312 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c64005020 con 0x7f0c6c108ad0 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.905+0000 7f0c7211f640 1 -- 172.21.15.33:0/4249321312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c1a6570 con 0x7f0c6c108ad0 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.905+0000 7f0c697fa640 1 -- 172.21.15.33:0/4249321312 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c640116b0 con 0x7f0c6c108ad0 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.905+0000 7f0c7211f640 1 -- 172.21.15.33:0/4249321312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c1a6a30 con 0x7f0c6c108ad0 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.906+0000 7f0c7211f640 1 -- 172.21.15.33:0/4249321312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6c103ac0 con 0x7f0c6c108ad0 2024-08-28T19:32:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.907+0000 7f0c697fa640 1 -- 172.21.15.33:0/4249321312 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f0c640051d0 con 0x7f0c6c108ad0 2024-08-28T19:32:40.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.908+0000 7f0c697fa640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c580b4c10 0x7f0c580b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:40.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.908+0000 7f0c6b7fe640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c580b4c10 0x7f0c580b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:40.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.908+0000 7f0c697fa640 1 -- 172.21.15.33:0/4249321312 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0c640e5960 con 0x7f0c6c108ad0 2024-08-28T19:32:40.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.909+0000 7f0c6b7fe640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c580b4c10 0x7f0c580b7120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c06c460 tx=0x7f0c5c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:40.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:40.912+0000 7f0c697fa640 1 -- 172.21.15.33:0/4249321312 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0c64016030 con 0x7f0c6c108ad0 2024-08-28T19:32:41.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.138+0000 7f0c7211f640 1 -- 172.21.15.33:0/4249321312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c6c102c50 con 0x7f0c6c108ad0 2024-08-28T19:32:41.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.139+0000 7f0c697fa640 1 -- 172.21.15.33:0/4249321312 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f0c640ac4c0 con 0x7f0c6c108ad0 2024-08-28T19:32:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:41.141 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:32:41.141 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:32:41.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 -- 172.21.15.33:0/4249321312 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c580b4c10 msgr2=0x7f0c580b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:41.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c580b4c10 0x7f0c580b7120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c06c460 tx=0x7f0c5c00a2d0 comp rx=0 tx=0).stop 2024-08-28T19:32:41.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 -- 172.21.15.33:0/4249321312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6c108ad0 msgr2=0x7f0c6c19bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:41.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6c108ad0 0x7f0c6c19bad0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400eaa0 tx=0x7f0c6400eea0 comp rx=0 tx=0).stop 2024-08-28T19:32:41.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 -- 172.21.15.33:0/4249321312 shutdown_connections 2024-08-28T19:32:41.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c6c108ad0 0x7f0c6c19bad0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:41.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0c580b4c10 0x7f0c580b7120 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:41.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c6c108180 0x7f0c6c19b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:41.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 --2- 172.21.15.33:0/4249321312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6c102840 0x7f0c6c19b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:41.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 -- 172.21.15.33:0/4249321312 >> 172.21.15.33:0/4249321312 conn(0x7f0c6c0794f0 msgr2=0x7f0c6c106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:41.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 -- 172.21.15.33:0/4249321312 shutdown_connections 2024-08-28T19:32:41.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:41.141+0000 7f0c7211f640 1 -- 172.21.15.33:0/4249321312 wait complete. 2024-08-28T19:32:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:41 smithi059 ceph-mon[22052]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-08-28T19:32:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:41 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4249321312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:41 smithi122 ceph-mon[22174]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-08-28T19:32:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:41 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4249321312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:41.860 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:41 smithi033 ceph-mon[18549]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 174 KiB/s wr, 56 op/s 2024-08-28T19:32:41.860 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:41 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4249321312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:41.890 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:32:42.144 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.620+0000 7f1ca159a640 1 -- 172.21.15.33:0/649337953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c9c101e20 msgr2=0x7f1c9c102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.620+0000 7f1ca159a640 1 --2- 172.21.15.33:0/649337953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c9c101e20 0x7f1c9c102230 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009900 tx=0x7f1c8c02a410 comp rx=0 tx=0).stop 2024-08-28T19:32:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.620+0000 7f1ca159a640 1 -- 172.21.15.33:0/649337953 shutdown_connections 2024-08-28T19:32:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.620+0000 7f1ca159a640 1 --2- 172.21.15.33:0/649337953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c9c109c50 0x7f1c9c110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.620+0000 7f1ca159a640 1 --2- 172.21.15.33:0/649337953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c9c109300 0x7f1c9c109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.620+0000 7f1ca159a640 1 --2- 172.21.15.33:0/649337953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c9c101e20 0x7f1c9c102230 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.620+0000 7f1ca159a640 1 -- 172.21.15.33:0/649337953 >> 172.21.15.33:0/649337953 conn(0x7f1c9c079c60 msgr2=0x7f1c9c07a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.620+0000 7f1ca159a640 1 -- 172.21.15.33:0/649337953 shutdown_connections 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.620+0000 7f1ca159a640 1 -- 172.21.15.33:0/649337953 wait complete. 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.621+0000 7f1ca159a640 1 Processor -- start 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.621+0000 7f1ca159a640 1 -- start start 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1ca159a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c9c101e20 0x7f1c9c19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1ca159a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c9c109300 0x7f1c9c19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1ca159a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c9c109c50 0x7f1c9c19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1ca159a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c113910 con 0x7f1c9c109300 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1ca159a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c113790 con 0x7f1c9c101e20 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1ca159a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c113a90 con 0x7f1c9c109c50 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c927fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c9c109300 0x7f1c9c19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c927fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c9c109300 0x7f1c9c19a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47408/0 (socket says 172.21.15.33:47408) 2024-08-28T19:32:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c927fc640 1 -- 172.21.15.33:0/292172290 learned_addr learned my addr 172.21.15.33:0/292172290 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c9affd640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c9c101e20 0x7f1c9c19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c9b7fe640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c9c109c50 0x7f1c9c19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c927fc640 1 -- 172.21.15.33:0/292172290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c9c109c50 msgr2=0x7f1c9c19fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c927fc640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c9c109c50 0x7f1c9c19fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c927fc640 1 -- 172.21.15.33:0/292172290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c9c101e20 msgr2=0x7f1c9c19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c927fc640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c9c101e20 0x7f1c9c19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c927fc640 1 -- 172.21.15.33:0/292172290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c1a01b0 con 0x7f1c9c109300 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c927fc640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c9c109300 0x7f1c9c19a8a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400d740 tx=0x7f1c8400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c98ff9640 1 -- 172.21.15.33:0/292172290 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84017070 con 0x7f1c9c109300 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c98ff9640 1 -- 172.21.15.33:0/292172290 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c8400de50 con 0x7f1c9c109300 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1c98ff9640 1 -- 172.21.15.33:0/292172290 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400f620 con 0x7f1c9c109300 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.622+0000 7f1ca159a640 1 -- 172.21.15.33:0/292172290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9c1a04a0 con 0x7f1c9c109300 2024-08-28T19:32:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.623+0000 7f1ca159a640 1 -- 172.21.15.33:0/292172290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9c1a6cc0 con 0x7f1c9c109300 2024-08-28T19:32:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.623+0000 7f1ca159a640 1 -- 172.21.15.33:0/292172290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9c102230 con 0x7f1c9c109300 2024-08-28T19:32:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.625+0000 7f1c98ff9640 1 -- 172.21.15.33:0/292172290 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f1c8401a070 con 0x7f1c9c109300 2024-08-28T19:32:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.626+0000 7f1c98ff9640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1c880b4cc0 0x7f1c880b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.626+0000 7f1c9affd640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1c880b4cc0 0x7f1c880b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.626+0000 7f1c98ff9640 1 -- 172.21.15.33:0/292172290 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1c840e5060 con 0x7f1c9c109300 2024-08-28T19:32:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.627+0000 7f1c9affd640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1c880b4cc0 0x7f1c880b71d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c031440 tx=0x7f1c8c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.629+0000 7f1c98ff9640 1 -- 172.21.15.33:0/292172290 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1c840ab5f0 con 0x7f1c9c109300 2024-08-28T19:32:42.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.852+0000 7f1ca159a640 1 -- 172.21.15.33:0/292172290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c9c19b430 con 0x7f1c9c109300 2024-08-28T19:32:42.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.853+0000 7f1c98ff9640 1 -- 172.21.15.33:0/292172290 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f1c840b4180 con 0x7f1c9c109300 2024-08-28T19:32:42.855 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:42.855 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:32:42.856 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:32:42.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 -- 172.21.15.33:0/292172290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1c880b4cc0 msgr2=0x7f1c880b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1c880b4cc0 0x7f1c880b71d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c031440 tx=0x7f1c8c009560 comp rx=0 tx=0).stop 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 -- 172.21.15.33:0/292172290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c9c109300 msgr2=0x7f1c9c19a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c9c109300 0x7f1c9c19a8a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400d740 tx=0x7f1c8400dc00 comp rx=0 tx=0).stop 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 -- 172.21.15.33:0/292172290 shutdown_connections 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1c880b4cc0 0x7f1c880b71d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c9c109c50 0x7f1c9c19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c9c109300 0x7f1c9c19a8a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 --2- 172.21.15.33:0/292172290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c9c101e20 0x7f1c9c19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 -- 172.21.15.33:0/292172290 >> 172.21.15.33:0/292172290 conn(0x7f1c9c079c60 msgr2=0x7f1c9c107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 -- 172.21.15.33:0/292172290 shutdown_connections 2024-08-28T19:32:42.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:42.856+0000 7f1ca159a640 1 -- 172.21.15.33:0/292172290 wait complete. 2024-08-28T19:32:43.515 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:32:43.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:43 smithi033 ceph-mon[18549]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-08-28T19:32:43.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:43 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/292172290' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:43.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:43 smithi059 ceph-mon[22052]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-08-28T19:32:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:43 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/292172290' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:43 smithi122 ceph-mon[22174]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 55 op/s 2024-08-28T19:32:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:43 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/292172290' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:44.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.270+0000 7f94709da640 1 -- 172.21.15.33:0/283767384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946c108aa0 msgr2=0x7f946c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:44.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.270+0000 7f94709da640 1 --2- 172.21.15.33:0/283767384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946c108aa0 0x7f946c10f2d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9464009ca0 tx=0x7f946402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:44.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.271+0000 7f94709da640 1 -- 172.21.15.33:0/283767384 shutdown_connections 2024-08-28T19:32:44.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.271+0000 7f94709da640 1 --2- 172.21.15.33:0/283767384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946c108aa0 0x7f946c10f2d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:44.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.271+0000 7f94709da640 1 --2- 172.21.15.33:0/283767384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946c108150 0x7f946c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:44.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.271+0000 7f94709da640 1 --2- 172.21.15.33:0/283767384 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f946c102810 0x7f946c102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:44.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.271+0000 7f94709da640 1 -- 172.21.15.33:0/283767384 >> 172.21.15.33:0/283767384 conn(0x7f946c0794b0 msgr2=0x7f946c0798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:44.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.271+0000 7f94709da640 1 -- 172.21.15.33:0/283767384 shutdown_connections 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.271+0000 7f94709da640 1 -- 172.21.15.33:0/283767384 wait complete. 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f94709da640 1 Processor -- start 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f94709da640 1 -- start start 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f94709da640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946c102810 0x7f946c19b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f94709da640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f946c108150 0x7f946c19b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f94709da640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946c108aa0 0x7f946c19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f94709da640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f946c112750 con 0x7f946c108aa0 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f94709da640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f946c1125d0 con 0x7f946c102810 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f94709da640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f946c1128d0 con 0x7f946c108150 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f946ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946c108aa0 0x7f946c19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:44.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f946ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946c108aa0 0x7f946c19bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47428/0 (socket says 172.21.15.33:47428) 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f946ad9d640 1 -- 172.21.15.33:0/2275706674 learned_addr learned my addr 172.21.15.33:0/2275706674 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f946a59c640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946c102810 0x7f946c19b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f9469d9b640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f946c108150 0x7f946c19b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f946ad9d640 1 -- 172.21.15.33:0/2275706674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f946c108150 msgr2=0x7f946c19b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f946ad9d640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f946c108150 0x7f946c19b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f946ad9d640 1 -- 172.21.15.33:0/2275706674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946c102810 msgr2=0x7f946c19b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f946ad9d640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946c102810 0x7f946c19b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f946ad9d640 1 -- 172.21.15.33:0/2275706674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c1a6350 con 0x7f946c108aa0 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.272+0000 7f946a59c640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946c102810 0x7f946c19b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.273+0000 7f946ad9d640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946c108aa0 0x7f946c19bac0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9464005cc0 tx=0x7f946402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.273+0000 7f945b7fe640 1 -- 172.21.15.33:0/2275706674 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9464003bf0 con 0x7f946c108aa0 2024-08-28T19:32:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.273+0000 7f945b7fe640 1 -- 172.21.15.33:0/2275706674 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9464003d90 con 0x7f946c108aa0 2024-08-28T19:32:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.273+0000 7f945b7fe640 1 -- 172.21.15.33:0/2275706674 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946402fbc0 con 0x7f946c108aa0 2024-08-28T19:32:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.273+0000 7f94709da640 1 -- 172.21.15.33:0/2275706674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946c1a65e0 con 0x7f946c108aa0 2024-08-28T19:32:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.273+0000 7f94709da640 1 -- 172.21.15.33:0/2275706674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f946c1a6b20 con 0x7f946c108aa0 2024-08-28T19:32:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.274+0000 7f94709da640 1 -- 172.21.15.33:0/2275706674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f946c103a90 con 0x7f946c108aa0 2024-08-28T19:32:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.275+0000 7f945b7fe640 1 -- 172.21.15.33:0/2275706674 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f946402fd60 con 0x7f946c108aa0 2024-08-28T19:32:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.276+0000 7f945b7fe640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94540b4c10 0x7f94540b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.276+0000 7f946a59c640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94540b4c10 0x7f94540b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.276+0000 7f945b7fe640 1 -- 172.21.15.33:0/2275706674 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9464106ec0 con 0x7f946c108aa0 2024-08-28T19:32:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.277+0000 7f946a59c640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94540b4c10 0x7f94540b7120 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f945c005fd0 tx=0x7f945c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.279+0000 7f945b7fe640 1 -- 172.21.15.33:0/2275706674 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f94640cd9c0 con 0x7f946c108aa0 2024-08-28T19:32:44.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.469+0000 7f94709da640 1 -- 172.21.15.33:0/2275706674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f946c102c20 con 0x7f946c108aa0 2024-08-28T19:32:44.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:44 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:32:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.471+0000 7f945b7fe640 1 -- 172.21.15.33:0/2275706674 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25092 (secure 0 0 0) 0x7f94640cd2c0 con 0x7f946c108aa0 2024-08-28T19:32:44.473 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:44.473 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":84,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:31:27.886529+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.473+0000 7f94709da640 1 -- 172.21.15.33:0/2275706674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94540b4c10 msgr2=0x7f94540b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.473+0000 7f94709da640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94540b4c10 0x7f94540b7120 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f945c005fd0 tx=0x7f945c005850 comp rx=0 tx=0).stop 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.473+0000 7f94709da640 1 -- 172.21.15.33:0/2275706674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946c108aa0 msgr2=0x7f946c19bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.473+0000 7f94709da640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946c108aa0 0x7f946c19bac0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9464005cc0 tx=0x7f946402f380 comp rx=0 tx=0).stop 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.473+0000 7f94709da640 1 -- 172.21.15.33:0/2275706674 shutdown_connections 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.473+0000 7f94709da640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f946c108aa0 0x7f946c19bac0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.474+0000 7f94709da640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94540b4c10 0x7f94540b7120 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.474+0000 7f94709da640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f946c108150 0x7f946c19b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.474+0000 7f94709da640 1 --2- 172.21.15.33:0/2275706674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946c102810 0x7f946c19b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.474+0000 7f94709da640 1 -- 172.21.15.33:0/2275706674 >> 172.21.15.33:0/2275706674 conn(0x7f946c0794b0 msgr2=0x7f946c106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.474+0000 7f94709da640 1 -- 172.21.15.33:0/2275706674 shutdown_connections 2024-08-28T19:32:44.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:44.474+0000 7f94709da640 1 -- 172.21.15.33:0/2275706674 wait complete. 2024-08-28T19:32:44.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:44 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:32:44.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:44 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:32:45.174 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-08-28T19:32:45.428 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:45.700 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:45 smithi033 ceph-mon[18549]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 58 op/s 2024-08-28T19:32:45.700 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:45 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2275706674' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:45 smithi059 ceph-mon[22052]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 58 op/s 2024-08-28T19:32:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:45 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2275706674' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:45 smithi122 ceph-mon[22174]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 174 KiB/s wr, 58 op/s 2024-08-28T19:32:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:45 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2275706674' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:32:46.686 INFO:teuthology.orchestra.run.smithi033.stdout:{"run_dir":"/var/run/ceph"} 2024-08-28T19:32:46.686 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-08-28T19:32:46.686 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7797 2024-08-28T19:32:46.686 DEBUG:tasks.quiescer:Yielding 2024-08-28T19:32:46.686 INFO:teuthology.run_tasks:Running task workunit... 2024-08-28T19:32:46.703 INFO:tasks.workunit:Pulling workunits from ref d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:32:46.704 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-28T19:32:46.704 INFO:tasks.workunit:timeout=3h 2024-08-28T19:32:46.704 INFO:tasks.workunit:cleanup=True 2024-08-28T19:32:46.704 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-28T19:32:46.704 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:32:46.721 INFO:teuthology.orchestra.run.smithi033.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-28T19:32:46.721 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-28T19:32:46.721 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 79h/121d Inode: 1099511628283 Links: 2 2024-08-28T19:32:46.721 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-28T19:32:46.722 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-08-28T19:32:46.722 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-08-28 19:30:34.697255946 +0000 2024-08-28T19:32:46.722 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-08-28 19:30:34.697255946 +0000 2024-08-28T19:32:46.722 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-08-28 19:32:22.939280840 +0000 2024-08-28T19:32:46.722 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-08-28 19:30:34.697255946 +0000 2024-08-28T19:32:46.722 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-28T19:32:46.722 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-28T19:32:46.795 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-28T19:32:46.850 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-28T19:32:46.970 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.448+0000 7fef2c145640 1 -- 172.21.15.33:0/4271043099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef24108160 msgr2=0x7fef24108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:47.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.448+0000 7fef2c145640 1 --2- 172.21.15.33:0/4271043099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef24108160 0x7fef24108570 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fef14009900 tx=0x7fef1402a410 comp rx=0 tx=0).stop 2024-08-28T19:32:47.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.448+0000 7fef2c145640 1 -- 172.21.15.33:0/4271043099 shutdown_connections 2024-08-28T19:32:47.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.448+0000 7fef2c145640 1 --2- 172.21.15.33:0/4271043099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef24108ab0 0x7fef2410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:47.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.448+0000 7fef2c145640 1 --2- 172.21.15.33:0/4271043099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef24108160 0x7fef24108570 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:47.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.448+0000 7fef2c145640 1 --2- 172.21.15.33:0/4271043099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef24102820 0x7fef24102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:47.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.448+0000 7fef2c145640 1 -- 172.21.15.33:0/4271043099 >> 172.21.15.33:0/4271043099 conn(0x7fef240794e0 msgr2=0x7fef240798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:47.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.448+0000 7fef2c145640 1 -- 172.21.15.33:0/4271043099 shutdown_connections 2024-08-28T19:32:47.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.448+0000 7fef2c145640 1 -- 172.21.15.33:0/4271043099 wait complete. 2024-08-28T19:32:47.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.449+0000 7fef2c145640 1 Processor -- start 2024-08-28T19:32:47.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.449+0000 7fef2c145640 1 -- start start 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.449+0000 7fef2c145640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef24102820 0x7fef241991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.449+0000 7fef2c145640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef24108160 0x7fef24199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.449+0000 7fef2c145640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef24108ab0 0x7fef2419ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.449+0000 7fef2c145640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fef24112700 con 0x7fef24108ab0 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.449+0000 7fef2c145640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fef24112580 con 0x7fef24102820 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.449+0000 7fef2c145640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fef24112880 con 0x7fef24108160 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2a6e2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef24108ab0 0x7fef2419ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2a6e2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef24108ab0 0x7fef2419ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47442/0 (socket says 172.21.15.33:47442) 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2a6e2640 1 -- 172.21.15.33:0/1277083552 learned_addr learned my addr 172.21.15.33:0/1277083552 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef296e0640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef24108160 0x7fef24199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef29ee1640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef24102820 0x7fef241991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:47.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2a6e2640 1 -- 172.21.15.33:0/1277083552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef24108160 msgr2=0x7fef24199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2a6e2640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef24108160 0x7fef24199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2a6e2640 1 -- 172.21.15.33:0/1277083552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef24102820 msgr2=0x7fef241991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2a6e2640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef24102820 0x7fef241991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2a6e2640 1 -- 172.21.15.33:0/1277083552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2419f140 con 0x7fef24108ab0 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2a6e2640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef24108ab0 0x7fef2419ea10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009fd0 tx=0x7fef1c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef1affd640 1 -- 172.21.15.33:0/1277083552 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c017070 con 0x7fef24108ab0 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2c145640 1 -- 172.21.15.33:0/1277083552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2419f430 con 0x7fef24108ab0 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef1affd640 1 -- 172.21.15.33:0/1277083552 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef1c003e20 con 0x7fef24108ab0 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef1affd640 1 -- 172.21.15.33:0/1277083552 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c010460 con 0x7fef24108ab0 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.450+0000 7fef2c145640 1 -- 172.21.15.33:0/1277083552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef241a5b90 con 0x7fef24108ab0 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.451+0000 7fef2c145640 1 -- 172.21.15.33:0/1277083552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef24103aa0 con 0x7fef24108ab0 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.453+0000 7fef1affd640 1 -- 172.21.15.33:0/1277083552 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7fef1c003970 con 0x7fef24108ab0 2024-08-28T19:32:47.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.454+0000 7fef1affd640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fef100b4c10 0x7fef100b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:47.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.454+0000 7fef29ee1640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fef100b4c10 0x7fef100b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:47.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.454+0000 7fef1affd640 1 -- 172.21.15.33:0/1277083552 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fef1c0e5500 con 0x7fef24108ab0 2024-08-28T19:32:47.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.454+0000 7fef29ee1640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fef100b4c10 0x7fef100b7120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fef20005fd0 tx=0x7fef20005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:47.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.457+0000 7fef1affd640 1 -- 172.21.15.33:0/1277083552 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fef1c0ac000 con 0x7fef24108ab0 2024-08-28T19:32:47.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:47 smithi033 ceph-mon[18549]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 104 KiB/s wr, 42 op/s 2024-08-28T19:32:47.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.680+0000 7fef2c145640 1 -- 172.21.15.33:0/1277083552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef24102c30 con 0x7fef24108ab0 2024-08-28T19:32:47.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.680+0000 7fef1affd640 1 -- 172.21.15.33:0/1277083552 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fef24102c30 con 0x7fef24108ab0 2024-08-28T19:32:47.682 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:32:47.683 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:32:47.683 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 -- 172.21.15.33:0/1277083552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fef100b4c10 msgr2=0x7fef100b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fef100b4c10 0x7fef100b7120 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fef20005fd0 tx=0x7fef20005850 comp rx=0 tx=0).stop 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 -- 172.21.15.33:0/1277083552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef24108ab0 msgr2=0x7fef2419ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef24108ab0 0x7fef2419ea10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009fd0 tx=0x7fef1c00b260 comp rx=0 tx=0).stop 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 -- 172.21.15.33:0/1277083552 shutdown_connections 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef24108ab0 0x7fef2419ea10 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fef100b4c10 0x7fef100b7120 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fef24108160 0x7fef24199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 --2- 172.21.15.33:0/1277083552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef24102820 0x7fef241991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 -- 172.21.15.33:0/1277083552 >> 172.21.15.33:0/1277083552 conn(0x7fef240794e0 msgr2=0x7fef24104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 -- 172.21.15.33:0/1277083552 shutdown_connections 2024-08-28T19:32:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:47.683+0000 7fef2c145640 1 -- 172.21.15.33:0/1277083552 wait complete. 2024-08-28T19:32:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:47 smithi059 ceph-mon[22052]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 104 KiB/s wr, 42 op/s 2024-08-28T19:32:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:47 smithi122 ceph-mon[22174]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 104 KiB/s wr, 42 op/s 2024-08-28T19:32:48.449 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-28T19:29:48.755873+0000', 'modified': '2024-08-28T19:32:23.633089+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24658, 'mds_1': 24653, 'mds_2': 24643, 'mds_3': 24631, 'mds_4': 24620}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14799': {'gid': 14799, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.33:6839/854752752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6838', 'nonce': 854752752}, {'type': 'v1', 'addr': '172.21.15.33:6839', 'nonce': 854752752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14805': {'gid': 14805, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.33:6841/4138539893', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6840', 'nonce': 4138539893}, {'type': 'v1', 'addr': '172.21.15.33:6841', 'nonce': 4138539893}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24572': {'gid': 24572, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6833/1923629681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1923629681}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1923629681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24593': {'gid': 24593, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6835/2308401306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 2308401306}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2308401306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24595': {'gid': 24595, 'name': 'l', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/2139914522', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 2139914522}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 2139914522}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24620': {'gid': 24620, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.59:6837/4143114753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6836', 'nonce': 4143114753}, {'type': 'v1', 'addr': '172.21.15.59:6837', 'nonce': 4143114753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.122:6835/364668654', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 364668654}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 364668654}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.122:6837/3665976487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 3665976487}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 3665976487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.59:6839/2455612621', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6838', 'nonce': 2455612621}, {'type': 'v1', 'addr': '172.21.15.59:6839', 'nonce': 2455612621}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24658': {'gid': 24658, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.122:6839/2515249026', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 2515249026}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 2515249026}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24658, 'qdb_cluster': [24620, 24631, 24643, 24653, 24658]} 2024-08-28T19:32:48.449 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-28T19:32:48.449 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-28T19:32:48.746 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:48.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:48 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1277083552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:48.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:48 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1277083552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:48.867 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:48 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1277083552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:32:49.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.227+0000 7f05211ad640 1 -- 172.21.15.33:0/3844018186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f051c102f60 msgr2=0x7f051c103370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.227+0000 7f05211ad640 1 --2- 172.21.15.33:0/3844018186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f051c102f60 0x7f051c103370 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f050c009900 tx=0x7f050c02a410 comp rx=0 tx=0).stop 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.227+0000 7f05211ad640 1 -- 172.21.15.33:0/3844018186 shutdown_connections 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.227+0000 7f05211ad640 1 --2- 172.21.15.33:0/3844018186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f051c105880 0x7f051c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.227+0000 7f05211ad640 1 --2- 172.21.15.33:0/3844018186 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051c104f30 0x7f051c105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.227+0000 7f05211ad640 1 --2- 172.21.15.33:0/3844018186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f051c102f60 0x7f051c103370 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.227+0000 7f05211ad640 1 -- 172.21.15.33:0/3844018186 >> 172.21.15.33:0/3844018186 conn(0x7f051c077a00 msgr2=0x7f051c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.227+0000 7f05211ad640 1 -- 172.21.15.33:0/3844018186 shutdown_connections 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.227+0000 7f05211ad640 1 -- 172.21.15.33:0/3844018186 wait complete. 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.228+0000 7f05211ad640 1 Processor -- start 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.228+0000 7f05211ad640 1 -- start start 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f05211ad640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f051c102f60 0x7f051c19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f05211ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f051c104f30 0x7f051c19b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f05211ad640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051c105880 0x7f051c19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f05211ad640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f051c112740 con 0x7f051c102f60 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f05211ad640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f051c1125c0 con 0x7f051c104f30 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f05211ad640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f051c1128c0 con 0x7f051c105880 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f051ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f051c102f60 0x7f051c19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f051ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f051c102f60 0x7f051c19b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57064/0 (socket says 172.21.15.33:57064) 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f051ad9d640 1 -- 172.21.15.33:0/4152537337 learned_addr learned my addr 172.21.15.33:0/4152537337 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f0513fff640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f051c104f30 0x7f051c19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f051b59e640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051c105880 0x7f051c19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f051ad9d640 1 -- 172.21.15.33:0/4152537337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051c105880 msgr2=0x7f051c19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f051ad9d640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051c105880 0x7f051c19bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f051ad9d640 1 -- 172.21.15.33:0/4152537337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f051c104f30 msgr2=0x7f051c19b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f051ad9d640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f051c104f30 0x7f051c19b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.229+0000 7f051ad9d640 1 -- 172.21.15.33:0/4152537337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c1a62f0 con 0x7f051c102f60 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.230+0000 7f051ad9d640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f051c102f60 0x7f051c19b030 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f050c005940 tx=0x7f050c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.230+0000 7f0518d99640 1 -- 172.21.15.33:0/4152537337 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c03f030 con 0x7f051c102f60 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.230+0000 7f0518d99640 1 -- 172.21.15.33:0/4152537337 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f050c003cb0 con 0x7f051c102f60 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.230+0000 7f0518d99640 1 -- 172.21.15.33:0/4152537337 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c035070 con 0x7f051c102f60 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.230+0000 7f05211ad640 1 -- 172.21.15.33:0/4152537337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051c198e20 con 0x7f051c102f60 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.230+0000 7f05211ad640 1 -- 172.21.15.33:0/4152537337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051c199350 con 0x7f051c102f60 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.232+0000 7f0527722740 1 Processor -- start 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.232+0000 7f0527722740 1 -- start start 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f0527722740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc3ef60 0x55831bfe47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f0527722740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc160a0 0x55831bfe4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f0527722740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc1e280 0x55831bfe5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f0527722740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55831bf5b3f0 con 0x55831bc3ef60 2024-08-28T19:32:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f0527722740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55831bf4a980 con 0x55831bc1e280 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f0527722740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55831bf4e930 con 0x55831bc160a0 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f051b59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc3ef60 0x55831bfe47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f051b59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc3ef60 0x55831bfe47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57072/0 (socket says 172.21.15.33:57072) 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f0518d99640 1 -- 172.21.15.33:0/4152537337 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f050c042030 con 0x7f051c102f60 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f051b59e640 1 -- 172.21.15.33:0/163636430 learned_addr learned my addr 172.21.15.33:0/163636430 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f0513fff640 1 --2- 172.21.15.33:0/163636430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc1e280 0x55831bfe5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f051b59e640 1 -- 172.21.15.33:0/163636430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc160a0 msgr2=0x55831bfe4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f051b59e640 1 --2- 172.21.15.33:0/163636430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc160a0 0x55831bfe4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f051b59e640 1 -- 172.21.15.33:0/163636430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc1e280 msgr2=0x55831bfe5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f051b59e640 1 --2- 172.21.15.33:0/163636430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc1e280 0x55831bfe5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.233+0000 7f051b59e640 1 -- 172.21.15.33:0/163636430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55831bcaa540 con 0x55831bc3ef60 2024-08-28T19:32:49.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.234+0000 7f051b59e640 1 --2- 172.21.15.33:0/163636430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc3ef60 0x55831bfe47b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0514010370 tx=0x7f0514010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81521122607faa05 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.234+0000 7f0518d99640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05080b4c90 0x7f05080b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.234+0000 7f05117fa640 1 -- 172.21.15.33:0/163636430 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514016070 con 0x55831bc3ef60 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.234+0000 7f05117fa640 1 -- 172.21.15.33:0/163636430 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0514004d20 con 0x55831bc3ef60 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.234+0000 7f05117fa640 1 -- 172.21.15.33:0/163636430 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0514005350 con 0x55831bc3ef60 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.234+0000 7f0518d99640 1 -- 172.21.15.33:0/4152537337 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f050c105f20 con 0x7f051c102f60 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.234+0000 7f051ad9d640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05080b4c90 0x7f05080b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.235+0000 7f0527722740 1 -- 172.21.15.33:0/163636430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc3ef60 msgr2=0x55831bfe47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.235+0000 7f051ad9d640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05080b4c90 0x7f05080b71a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55831bfe3430 tx=0x7f050c02a410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.235+0000 7f0527722740 1 --2- 172.21.15.33:0/163636430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc3ef60 0x55831bfe47b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0514010370 tx=0x7f0514010830 comp rx=0 tx=0).stop 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.235+0000 7f0527722740 1 -- 172.21.15.33:0/163636430 shutdown_connections 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.235+0000 7f0527722740 1 --2- 172.21.15.33:0/163636430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc1e280 0x55831bfe5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.235+0000 7f0527722740 1 --2- 172.21.15.33:0/163636430 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc160a0 0x55831bfe4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.235+0000 7f0527722740 1 --2- 172.21.15.33:0/163636430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc3ef60 0x55831bfe47b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.235+0000 7f0527722740 1 -- 172.21.15.33:0/163636430 >> 172.21.15.33:0/163636430 conn(0x55831bc33350 msgr2=0x55831bfe26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.235+0000 7f0527722740 1 -- 172.21.15.33:0/163636430 shutdown_connections 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.235+0000 7f0527722740 1 -- 172.21.15.33:0/163636430 wait complete. 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0527722740 1 -- start start 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0527722740 1 Processor -- start 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0527722740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc160a0 0x55831bfefe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0527722740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bff0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0527722740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc3ef60 0x55831bff0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0527722740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55831bdad5f0 con 0x55831bc1e280 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0527722740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55831bed1600 con 0x55831bc3ef60 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0527722740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55831bff2f90 con 0x55831bc160a0 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0527722740 10 client.0 _ll_register_callbacks cb 0x55831bef7af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:49.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0513fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bff0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0513fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bff0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57080/0 (socket says 172.21.15.33:57080) 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f0513fff640 1 -- 172.21.15.33:0/3462918532 learned_addr learned my addr 172.21.15.33:0/3462918532 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f051b59e640 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc3ef60 0x55831bff0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.236+0000 7f051b59e640 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc160a0 0x55831bfefe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f0513fff640 1 -- 172.21.15.33:0/3462918532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc160a0 msgr2=0x55831bfefe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f0513fff640 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc160a0 0x55831bfefe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f0513fff640 1 -- 172.21.15.33:0/3462918532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc3ef60 msgr2=0x55831bff0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f0513fff640 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc3ef60 0x55831bff0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f0513fff640 1 -- 172.21.15.33:0/3462918532 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55831bf0a7b0 con 0x55831bc1e280 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f051b59e640 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc3ef60 0x55831bff0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f0513fff640 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bff0390 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f05040106e0 tx=0x7f0504010ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36af4d0d83520c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f05027fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f05027fc640 1 -- 172.21.15.33:0/3462918532 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050400fa00 con 0x55831bc1e280 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f05027fc640 1 -- 172.21.15.33:0/3462918532 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f050400fba0 con 0x55831bc1e280 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f0527722740 1 -- 172.21.15.33:0/3462918532 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0514004d20 con 0x55831bc1e280 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f05027fc640 1 -- 172.21.15.33:0/3462918532 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0504024050 con 0x55831bc1e280 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f0527722740 10 client.15705 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f0527722740 1 -- 172.21.15.33:0/3462918532 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55831bffecf0 con 0x55831bc1e280 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.237+0000 7f05027fc640 1 -- 172.21.15.33:0/3462918532 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0514004d20 con 0x55831bc1e280 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.238+0000 7f05027fc640 1 -- 172.21.15.33:0/3462918532 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0504004b90 con 0x55831bc1e280 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.238+0000 7f0527722740 10 client.15705 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.238+0000 7f0527722740 10 client.15705 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.238+0000 7f0527722740 20 client.15705 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:49.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.238+0000 7f0527722740 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55831bbfd8e0 0x55831c0027e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.238+0000 7f0527722740 4 client.15705 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.238+0000 7f0527722740 1 -- 172.21.15.33:0/3462918532 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55831bf5d340 con 0x55831bbfd8e0 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.238+0000 7f051b59e640 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55831bbfd8e0 0x55831c0027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.239+0000 7f05027fc640 10 client.15705 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.239+0000 7f051b59e640 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55831bbfd8e0 0x55831c0027e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=759b5998fdc2f21b server_cookie=6094bcb407905358 in_seq=0 out_seq=0 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.239+0000 7f05027fc640 1 -- 172.21.15.33:0/3462918532 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55831bf5d340 con 0x55831bbfd8e0 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.239+0000 7f05027fc640 10 client.15705 handle_command_reply: tid=0 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.239+0000 7f0527722740 1 client.15705 shutdown 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 1 -- 172.21.15.33:0/3462918532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 msgr2=0x55831bff0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bff0390 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f05040106e0 tx=0x7f0504010ba0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 1 -- 172.21.15.33:0/3462918532 shutdown_connections 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55831bbfd8e0 0x55831c0027e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc3ef60 0x55831bff0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bff0390 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f05027fc640 0 client.15705 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:32:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 1 --2- 172.21.15.33:0/3462918532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc160a0 0x55831bfefe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 1 -- 172.21.15.33:0/3462918532 >> 172.21.15.33:0/3462918532 conn(0x55831bc33350 msgr2=0x55831bfe7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 1 -- 172.21.15.33:0/3462918532 shutdown_connections 2024-08-28T19:32:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 1 -- 172.21.15.33:0/3462918532 wait complete. 2024-08-28T19:32:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.240+0000 7f0527722740 20 client.15705 trim_cache size 0 max 16384 2024-08-28T19:32:49.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0527722740 1 Processor -- start 2024-08-28T19:32:49.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0527722740 1 -- start start 2024-08-28T19:32:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0527722740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 0x55831bfee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0527722740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bfeec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0527722740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 0x55831bfe1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0527722740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55831c000b20 con 0x55831bc1e280 2024-08-28T19:32:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0527722740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55831c0011f0 con 0x55831bc160a0 2024-08-28T19:32:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0527722740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55831c0018c0 con 0x55831bc3ef60 2024-08-28T19:32:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0513fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bfeec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0513fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bfeec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57090/0 (socket says 172.21.15.33:57090) 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.259+0000 7f0513fff640 1 -- 172.21.15.33:0/930140057 learned_addr learned my addr 172.21.15.33:0/930140057 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f051b59e640 1 --2- 172.21.15.33:0/930140057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 0x55831bfee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f051b59e640 1 --2- 172.21.15.33:0/930140057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 0x55831bfe1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f0513fff640 1 -- 172.21.15.33:0/930140057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 msgr2=0x55831bfe1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f0513fff640 1 --2- 172.21.15.33:0/930140057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 0x55831bfe1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f0513fff640 1 -- 172.21.15.33:0/930140057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 msgr2=0x55831bfee6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f0513fff640 1 --2- 172.21.15.33:0/930140057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 0x55831bfee6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f0513fff640 1 -- 172.21.15.33:0/930140057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55831bfe7610 con 0x55831bc1e280 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f051b59e640 1 --2- 172.21.15.33:0/930140057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 0x55831bfee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f0513fff640 1 --2- 172.21.15.33:0/930140057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bfeec10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0504000c00 tx=0x7f0504019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dae9cae2ea75883 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:49.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f0510ff9640 1 -- 172.21.15.33:0/930140057 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050402c070 con 0x55831bc1e280 2024-08-28T19:32:49.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f0510ff9640 1 -- 172.21.15.33:0/930140057 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0504019840 con 0x55831bc1e280 2024-08-28T19:32:49.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.260+0000 7f0510ff9640 1 -- 172.21.15.33:0/930140057 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05040054c0 con 0x55831bc1e280 2024-08-28T19:32:49.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.261+0000 7f0527722740 1 -- 172.21.15.33:0/930140057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 msgr2=0x55831bfeec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:49.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.261+0000 7f0527722740 1 --2- 172.21.15.33:0/930140057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bfeec10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0504000c00 tx=0x7f0504019650 comp rx=0 tx=0).stop 2024-08-28T19:32:49.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.261+0000 7f0527722740 1 -- 172.21.15.33:0/930140057 shutdown_connections 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.261+0000 7f0527722740 1 --2- 172.21.15.33:0/930140057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 0x55831bfe1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.261+0000 7f0527722740 1 --2- 172.21.15.33:0/930140057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831bfeec10 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.261+0000 7f0527722740 1 --2- 172.21.15.33:0/930140057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 0x55831bfee6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.261+0000 7f0527722740 1 -- 172.21.15.33:0/930140057 >> 172.21.15.33:0/930140057 conn(0x55831bc33350 msgr2=0x55831c0001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.261+0000 7f0527722740 1 -- 172.21.15.33:0/930140057 shutdown_connections 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.261+0000 7f0527722740 1 -- 172.21.15.33:0/930140057 wait complete. 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.261+0000 7f0527722740 1 -- start start 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0527722740 1 Processor -- start 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0527722740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 0x55831c00b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0527722740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0527722740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 0x55831c004bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0527722740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55831c002660 con 0x55831bc1e280 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0527722740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55831c001f90 con 0x55831bc160a0 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0527722740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55831c002d30 con 0x55831bc3ef60 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0527722740 10 client.0 _ll_register_callbacks cb 0x7f050400aeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0513fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0513fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831c004690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57096/0 (socket says 172.21.15.33:57096) 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0513fff640 1 -- 172.21.15.33:0/358102167 learned_addr learned my addr 172.21.15.33:0/358102167 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f051b59e640 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 0x55831c00b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f051b59e640 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 0x55831c004bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0513fff640 1 -- 172.21.15.33:0/358102167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 msgr2=0x55831c004bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0513fff640 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 0x55831c004bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0513fff640 1 -- 172.21.15.33:0/358102167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 msgr2=0x55831c00b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0513fff640 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 0x55831c00b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f0513fff640 1 -- 172.21.15.33:0/358102167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55831c005310 con 0x55831bc1e280 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.262+0000 7f051b59e640 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 0x55831c004bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.263+0000 7f0513fff640 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831c004690 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0504004f30 tx=0x7f050400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d765bfaf54a6434 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.263+0000 7f05027fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.263+0000 7f05027fc640 1 -- 172.21.15.33:0/358102167 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050402c040 con 0x55831bc1e280 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.263+0000 7f05027fc640 1 -- 172.21.15.33:0/358102167 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0504019c00 con 0x55831bc1e280 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.263+0000 7f0527722740 1 -- 172.21.15.33:0/358102167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0504019840 con 0x55831bc1e280 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.263+0000 7f05027fc640 1 -- 172.21.15.33:0/358102167 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0504043050 con 0x55831bc1e280 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.263+0000 7f0527722740 10 client.15711 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.263+0000 7f0527722740 1 -- 172.21.15.33:0/358102167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55831c00ac40 con 0x55831bc1e280 2024-08-28T19:32:49.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.263+0000 7f05027fc640 1 -- 172.21.15.33:0/358102167 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0504019840 con 0x55831bc1e280 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.264+0000 7f05027fc640 1 -- 172.21.15.33:0/358102167 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0504004ab0 con 0x55831bc1e280 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.264+0000 7f0527722740 10 client.15711 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.264+0000 7f0527722740 10 client.15711 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.264+0000 7f0527722740 20 client.15711 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.264+0000 7f0527722740 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55831bbd2c90 0x55831c070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.264+0000 7f0527722740 4 client.15711 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.264+0000 7f0527722740 1 -- 172.21.15.33:0/358102167 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "status"}) -- 0x55831bf58de0 con 0x55831bbd2c90 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.264+0000 7f051b59e640 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55831bbd2c90 0x55831c070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.264+0000 7f05027fc640 10 client.15711 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.264+0000 7f051b59e640 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55831bbd2c90 0x55831c070f90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5b39b117e44ddd1c server_cookie=6c4e3949d5ef24bb in_seq=0 out_seq=0 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f05027fc640 1 -- 172.21.15.33:0/358102167 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55831bf58de0 con 0x55831bbd2c90 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f05027fc640 10 client.15711 handle_command_reply: tid=0 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 client.15711 shutdown 2024-08-28T19:32:49.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 -- 172.21.15.33:0/358102167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 msgr2=0x55831c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831c004690 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0504004f30 tx=0x7f050400fcb0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 -- 172.21.15.33:0/358102167 shutdown_connections 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55831bbd2c90 0x55831c070f90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55831bc3ef60 0x55831c004bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55831bc1e280 0x55831c004690 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 --2- 172.21.15.33:0/358102167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55831bc160a0 0x55831c00b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 -- 172.21.15.33:0/358102167 >> 172.21.15.33:0/358102167 conn(0x55831bc33350 msgr2=0x55831bffb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f05027fc640 0 client.15711 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 -- 172.21.15.33:0/358102167 shutdown_connections 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 1 -- 172.21.15.33:0/358102167 wait complete. 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.265+0000 7f0527722740 20 client.15711 trim_cache size 0 max 16384 2024-08-28T19:32:49.272 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 4, 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24620, 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 142.86279803299999, 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 28, 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 84, 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 202.80271123599999 2024-08-28T19:32:49.273 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:49.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 -- 172.21.15.33:0/4152537337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05080b4c90 msgr2=0x7f05080b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:49.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05080b4c90 0x7f05080b71a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55831bfe3430 tx=0x7f050c02a410 comp rx=0 tx=0).stop 2024-08-28T19:32:49.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 -- 172.21.15.33:0/4152537337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f051c102f60 msgr2=0x7f051c19b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:49.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f051c102f60 0x7f051c19b030 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f050c005940 tx=0x7f050c0042f0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 -- 172.21.15.33:0/4152537337 shutdown_connections 2024-08-28T19:32:49.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05080b4c90 0x7f05080b71a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f051c105880 0x7f051c19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f051c104f30 0x7f051c19b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 --2- 172.21.15.33:0/4152537337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f051c102f60 0x7f051c19b030 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:49.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 -- 172.21.15.33:0/4152537337 >> 172.21.15.33:0/4152537337 conn(0x7f051c077a00 msgr2=0x7f051c106db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:49.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 -- 172.21.15.33:0/4152537337 shutdown_connections 2024-08-28T19:32:49.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:49.266+0000 7f05211ad640 1 -- 172.21.15.33:0/4152537337 wait complete. 2024-08-28T19:32:49.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:49 smithi059 ceph-mon[22052]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 105 KiB/s wr, 44 op/s 2024-08-28T19:32:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:49 smithi122 ceph-mon[22174]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 105 KiB/s wr, 44 op/s 2024-08-28T19:32:49.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:49 smithi033 ceph-mon[18549]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 105 KiB/s wr, 44 op/s 2024-08-28T19:32:50.071 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.f status 2024-08-28T19:32:50.336 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:50.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 -- 172.21.15.33:0/3031444911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c14108ac0 msgr2=0x7f0c1410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:50.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 --2- 172.21.15.33:0/3031444911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c14108ac0 0x7f0c1410f2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009ca0 tx=0x7f0c0c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 -- 172.21.15.33:0/3031444911 shutdown_connections 2024-08-28T19:32:50.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 --2- 172.21.15.33:0/3031444911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c14108ac0 0x7f0c1410f2f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 --2- 172.21.15.33:0/3031444911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c14108170 0x7f0c14108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 --2- 172.21.15.33:0/3031444911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c14102880 0x7f0c14102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 -- 172.21.15.33:0/3031444911 >> 172.21.15.33:0/3031444911 conn(0x7f0c14079500 msgr2=0x7f0c14079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 -- 172.21.15.33:0/3031444911 shutdown_connections 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 -- 172.21.15.33:0/3031444911 wait complete. 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 Processor -- start 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.838+0000 7f0c1aa71640 1 -- start start 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1aa71640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c14102880 0x7f0c1419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1aa71640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c14108170 0x7f0c1419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1aa71640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c14108ac0 0x7f0c1419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1aa71640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14112790 con 0x7f0c14108ac0 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1aa71640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14112610 con 0x7f0c14108170 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1aa71640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14112910 con 0x7f0c14102880 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1900e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c14108ac0 0x7f0c1419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1900e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c14108ac0 0x7f0c1419fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57102/0 (socket says 172.21.15.33:57102) 2024-08-28T19:32:50.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1900e640 1 -- 172.21.15.33:0/341486182 learned_addr learned my addr 172.21.15.33:0/341486182 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:50.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c14108170 0x7f0c1419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1880d640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c14102880 0x7f0c1419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1900e640 1 -- 172.21.15.33:0/341486182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c14102880 msgr2=0x7f0c1419a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:50.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1900e640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c14102880 0x7f0c1419a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1900e640 1 -- 172.21.15.33:0/341486182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c14108170 msgr2=0x7f0c1419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:50.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1900e640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c14108170 0x7f0c1419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1900e640 1 -- 172.21.15.33:0/341486182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c141a01a0 con 0x7f0c14108ac0 2024-08-28T19:32:50.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.839+0000 7f0c1900e640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c14108ac0 0x7f0c1419fa70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c005cc0 tx=0x7f0c0c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:50.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.840+0000 7f0c09ffb640 1 -- 172.21.15.33:0/341486182 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c003bf0 con 0x7f0c14108ac0 2024-08-28T19:32:50.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.840+0000 7f0c09ffb640 1 -- 172.21.15.33:0/341486182 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c0c003d90 con 0x7f0c14108ac0 2024-08-28T19:32:50.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.840+0000 7f0c1aa71640 1 -- 172.21.15.33:0/341486182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c141a0430 con 0x7f0c14108ac0 2024-08-28T19:32:50.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.840+0000 7f0c09ffb640 1 -- 172.21.15.33:0/341486182 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c02fb20 con 0x7f0c14108ac0 2024-08-28T19:32:50.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.840+0000 7f0c1aa71640 1 -- 172.21.15.33:0/341486182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c141a6bf0 con 0x7f0c14108ac0 2024-08-28T19:32:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c20fe6740 1 Processor -- start 2024-08-28T19:32:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c09ffb640 1 -- 172.21.15.33:0/341486182 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f0c0c004580 con 0x7f0c14108ac0 2024-08-28T19:32:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c20fe6740 1 -- start start 2024-08-28T19:32:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc6d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc6dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cbe43f0 con 0x55ef7c8a7280 2024-08-28T19:32:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cbd3980 con 0x55ef7c8c7f60 2024-08-28T19:32:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cbd7930 con 0x55ef7c89f0a0 2024-08-28T19:32:50.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c0bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c0bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57112/0 (socket says 172.21.15.33:57112) 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c0bfff640 1 -- 172.21.15.33:0/2883614575 learned_addr learned my addr 172.21.15.33:0/2883614575 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/2883614575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc6d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c1880d640 1 --2- 172.21.15.33:0/2883614575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc6dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c09ffb640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0bfc0b4c10 0x7f0bfc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c0bfff640 1 -- 172.21.15.33:0/2883614575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 msgr2=0x55ef7cc6dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/2883614575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc6dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c0bfff640 1 -- 172.21.15.33:0/2883614575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 msgr2=0x55ef7cc6d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.843+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/2883614575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc6d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.844+0000 7f0c0bfff640 1 -- 172.21.15.33:0/2883614575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef7c933540 con 0x55ef7c8a7280 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.844+0000 7f0c1900e640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0bfc0b4c10 0x7f0bfc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.844+0000 7f0c09ffb640 1 -- 172.21.15.33:0/341486182 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0c0c106a90 con 0x7f0c14108ac0 2024-08-28T19:32:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.844+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/2883614575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6e230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0c04017700 tx=0x7f0c040094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fb10301ddc9db1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.844+0000 7f0bfaffd640 1 -- 172.21.15.33:0/2883614575 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04015760 con 0x55ef7c8a7280 2024-08-28T19:32:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.844+0000 7f0bfaffd640 1 -- 172.21.15.33:0/2883614575 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c0401d070 con 0x55ef7c8a7280 2024-08-28T19:32:50.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.844+0000 7f0bfaffd640 1 -- 172.21.15.33:0/2883614575 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04018980 con 0x55ef7c8a7280 2024-08-28T19:32:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 -- 172.21.15.33:0/2883614575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 msgr2=0x55ef7cc6e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/2883614575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6e230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0c04017700 tx=0x7f0c040094d0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c1900e640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0bfc0b4c10 0x7f0bfc0b7120 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0cce80 tx=0x7f0c0c0c1770 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 -- 172.21.15.33:0/2883614575 shutdown_connections 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/2883614575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6e230 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/2883614575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc6dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/2883614575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc6d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 -- 172.21.15.33:0/2883614575 >> 172.21.15.33:0/2883614575 conn(0x55ef7c8bc350 msgr2=0x55ef7cc6b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 -- 172.21.15.33:0/2883614575 shutdown_connections 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 -- 172.21.15.33:0/2883614575 wait complete. 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 -- start start 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.845+0000 7f0c20fe6740 1 Processor -- start 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc78e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8a7280 0x55ef7cc79390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc85250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ef7ca365f0 con 0x55ef7c8c7f60 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cb5a600 con 0x55ef7c8a7280 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cc7bf30 con 0x55ef7c89f0a0 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c20fe6740 10 client.0 _ll_register_callbacks cb 0x55ef7cb80af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c0bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc85250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c0bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc85250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57118/0 (socket says 172.21.15.33:57118) 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c0bfff640 1 -- 172.21.15.33:0/3784623911 learned_addr learned my addr 172.21.15.33:0/3784623911 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c1880d640 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8a7280 0x55ef7cc79390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc78e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c0bfff640 1 -- 172.21.15.33:0/3784623911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 msgr2=0x55ef7cc78e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc78e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c0bfff640 1 -- 172.21.15.33:0/3784623911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8a7280 msgr2=0x55ef7cc79390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8a7280 0x55ef7cc79390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.846+0000 7f0c0bfff640 1 -- 172.21.15.33:0/3784623911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef7cb937b0 con 0x55ef7c8c7f60 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc85250 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0c04015fe0 tx=0x7f0c04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51984b1884776b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0bf3fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0bf3fff640 1 -- 172.21.15.33:0/3784623911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04027070 con 0x55ef7c8c7f60 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0bf3fff640 1 -- 172.21.15.33:0/3784623911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0c04018d70 con 0x55ef7c8c7f60 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0c20fe6740 1 -- 172.21.15.33:0/3784623911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c0401d070 con 0x55ef7c8c7f60 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0bf3fff640 1 -- 172.21.15.33:0/3784623911 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0c04015760 con 0x55ef7c8c7f60 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0c20fe6740 10 client.15723 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0c20fe6740 1 -- 172.21.15.33:0/3784623911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ef7cc87c50 con 0x55ef7c8c7f60 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0bf3fff640 1 -- 172.21.15.33:0/3784623911 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c0401d070 con 0x55ef7c8c7f60 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0bf3fff640 1 -- 172.21.15.33:0/3784623911 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0c04023790 con 0x55ef7c8c7f60 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.847+0000 7f0c20fe6740 10 client.15723 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.848+0000 7f0c20fe6740 10 client.15723 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-28T19:32:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.848+0000 7f0c20fe6740 20 client.15723 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.848+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ef7c8868e0 0x55ef7cc89000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.848+0000 7f0c20fe6740 4 client.15723 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.848+0000 7f0c20fe6740 1 -- 172.21.15.33:0/3784623911 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef7cbe6340 con 0x55ef7c8868e0 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.848+0000 7f0c1880d640 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ef7c8868e0 0x55ef7cc89000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.848+0000 7f0c1880d640 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ef7c8868e0 0x55ef7cc89000 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a77b30fa73af10e5 server_cookie=5f944ee4053f2431 in_seq=0 out_seq=0 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.848+0000 7f0bf3fff640 10 client.15723 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0bf3fff640 1 -- 172.21.15.33:0/3784623911 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef7cbe6340 con 0x55ef7c8868e0 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0bf3fff640 10 client.15723 handle_command_reply: tid=0 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0c20fe6740 1 client.15723 shutdown 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0c20fe6740 1 -- 172.21.15.33:0/3784623911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8c7f60 msgr2=0x55ef7cc85250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc85250 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0c04015fe0 tx=0x7f0c04008040 comp rx=0 tx=0).stop 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0c20fe6740 1 -- 172.21.15.33:0/3784623911 shutdown_connections 2024-08-28T19:32:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ef7c8868e0 0x55ef7cc89000 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc85250 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8a7280 0x55ef7cc79390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/3784623911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc78e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0c20fe6740 1 -- 172.21.15.33:0/3784623911 >> 172.21.15.33:0/3784623911 conn(0x55ef7c8bc350 msgr2=0x55ef7cc70940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.849+0000 7f0bf3fff640 0 client.15723 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:32:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.850+0000 7f0c20fe6740 1 -- 172.21.15.33:0/3784623911 shutdown_connections 2024-08-28T19:32:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.850+0000 7f0c20fe6740 1 -- 172.21.15.33:0/3784623911 wait complete. 2024-08-28T19:32:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.850+0000 7f0c20fe6740 20 client.15723 trim_cache size 0 max 16384 2024-08-28T19:32:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c20fe6740 1 Processor -- start 2024-08-28T19:32:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c20fe6740 1 -- start start 2024-08-28T19:32:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc851c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c8a7280 0x55ef7cc938d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc93e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cc89540 con 0x55ef7c89f0a0 2024-08-28T19:32:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cc89c10 con 0x55ef7c8c7f60 2024-08-28T19:32:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cc8a2e0 con 0x55ef7c8a7280 2024-08-28T19:32:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c0bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c0bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc851c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57126/0 (socket says 172.21.15.33:57126) 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c0bfff640 1 -- 172.21.15.33:0/2939785934 learned_addr learned my addr 172.21.15.33:0/2939785934 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c1880d640 1 --2- 172.21.15.33:0/2939785934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c8a7280 0x55ef7cc938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c0bfff640 1 -- 172.21.15.33:0/2939785934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c8a7280 msgr2=0x55ef7cc938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/2939785934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c8a7280 0x55ef7cc938d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c0bfff640 1 -- 172.21.15.33:0/2939785934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 msgr2=0x55ef7cc93e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/2939785934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc93e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c0bfff640 1 -- 172.21.15.33:0/2939785934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef7c886b10 con 0x55ef7c89f0a0 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.868+0000 7f0c1880d640 1 --2- 172.21.15.33:0/2939785934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c8a7280 0x55ef7cc938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.869+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/2939785934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc851c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0c04008010 tx=0x7f0c04006e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c391a0040cfd230 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.869+0000 7f0bfa7fc640 1 -- 172.21.15.33:0/2939785934 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0403c070 con 0x55ef7c89f0a0 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.869+0000 7f0bfa7fc640 1 -- 172.21.15.33:0/2939785934 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c0401d040 con 0x55ef7c89f0a0 2024-08-28T19:32:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.869+0000 7f0bfa7fc640 1 -- 172.21.15.33:0/2939785934 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04027050 con 0x55ef7c89f0a0 2024-08-28T19:32:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 -- 172.21.15.33:0/2939785934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c89f0a0 msgr2=0x55ef7cc851c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/2939785934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc851c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0c04008010 tx=0x7f0c04006e40 comp rx=0 tx=0).stop 2024-08-28T19:32:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 -- 172.21.15.33:0/2939785934 shutdown_connections 2024-08-28T19:32:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/2939785934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7cc93e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/2939785934 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c8a7280 0x55ef7cc938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/2939785934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc851c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 -- 172.21.15.33:0/2939785934 >> 172.21.15.33:0/2939785934 conn(0x55ef7c8bc350 msgr2=0x55ef7cc66400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 -- 172.21.15.33:0/2939785934 shutdown_connections 2024-08-28T19:32:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 -- 172.21.15.33:0/2939785934 wait complete. 2024-08-28T19:32:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 -- start start 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.870+0000 7f0c20fe6740 1 Processor -- start 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc6a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c20fe6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7ccf86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cc8b080 con 0x55ef7c8a7280 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cc8a9b0 con 0x55ef7c8c7f60 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c20fe6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cc8b750 con 0x55ef7c89f0a0 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c20fe6740 10 client.0 _ll_register_callbacks cb 0x7f0c04015f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c1880d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c1880d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57140/0 (socket says 172.21.15.33:57140) 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c1880d640 1 -- 172.21.15.33:0/1240559907 learned_addr learned my addr 172.21.15.33:0/1240559907 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc6a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7ccf86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c1880d640 1 -- 172.21.15.33:0/1240559907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 msgr2=0x55ef7cc6a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c1880d640 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc6a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c1880d640 1 -- 172.21.15.33:0/1240559907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 msgr2=0x55ef7ccf86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c1880d640 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7ccf86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c1880d640 1 -- 172.21.15.33:0/1240559907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef7ccf8ce0 con 0x55ef7c8a7280 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7ccf86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0c1880d640 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6aa50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0c10000c00 tx=0x7f0c1000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e099ea8eaf887136 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0bf3fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.871+0000 7f0bf3fff640 1 -- 172.21.15.33:0/1240559907 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c10005050 con 0x55ef7c8a7280 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0bf3fff640 1 -- 172.21.15.33:0/1240559907 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0c100051f0 con 0x55ef7c8a7280 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0c20fe6740 1 -- 172.21.15.33:0/1240559907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c0401d040 con 0x55ef7c8a7280 2024-08-28T19:32:50.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0bf3fff640 1 -- 172.21.15.33:0/1240559907 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0c1002c050 con 0x55ef7c8a7280 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0c20fe6740 10 client.15729 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0c20fe6740 1 -- 172.21.15.33:0/1240559907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ef7ccf9f30 con 0x55ef7c8a7280 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0bf3fff640 1 -- 172.21.15.33:0/1240559907 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c0401d040 con 0x55ef7c8a7280 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0bf3fff640 1 -- 172.21.15.33:0/1240559907 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0c1001d430 con 0x55ef7c8a7280 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0c20fe6740 10 client.15729 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0c20fe6740 10 client.15729 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0c20fe6740 20 client.15729 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ef7c85bc90 0x55ef7ccfd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0c20fe6740 4 client.15729 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.872+0000 7f0c20fe6740 1 -- 172.21.15.33:0/1240559907 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "status"}) -- 0x55ef7cbe1de0 con 0x55ef7c85bc90 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ef7c85bc90 0x55ef7ccfd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:50.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c0bfff640 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ef7c85bc90 0x55ef7ccfd880 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=422fec80a7e16922 server_cookie=54c1404263bff842 in_seq=0 out_seq=0 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0bf3fff640 10 client.15729 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0bf3fff640 1 -- 172.21.15.33:0/1240559907 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ef7cbe1de0 con 0x55ef7c85bc90 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0bf3fff640 10 client.15729 handle_command_reply: tid=0 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c20fe6740 1 client.15729 shutdown 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c20fe6740 1 -- 172.21.15.33:0/1240559907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 msgr2=0x55ef7cc6aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6aa50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f0c10000c00 tx=0x7f0c1000be20 comp rx=0 tx=0).stop 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c20fe6740 1 -- 172.21.15.33:0/1240559907 shutdown_connections 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ef7c85bc90 0x55ef7ccfd880 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ef7c8c7f60 0x55ef7ccf86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ef7c8a7280 0x55ef7cc6aa50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c20fe6740 1 --2- 172.21.15.33:0/1240559907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ef7c89f0a0 0x55ef7cc6a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0c20fe6740 1 -- 172.21.15.33:0/1240559907 >> 172.21.15.33:0/1240559907 conn(0x55ef7c8bc350 msgr2=0x55ef7cc66400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.873+0000 7f0bf3fff640 0 client.15729 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:32:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c20fe6740 1 -- 172.21.15.33:0/1240559907 shutdown_connections 2024-08-28T19:32:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c20fe6740 1 -- 172.21.15.33:0/1240559907 wait complete. 2024-08-28T19:32:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c20fe6740 20 client.15729 trim_cache size 0 max 16384 2024-08-28T19:32:50.882 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:50.882 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:32:50.882 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 3, 2024-08-28T19:32:50.882 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24631, 2024-08-28T19:32:50.882 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:32:50.882 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:32:50.883 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:32:50.883 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 145.48524704799999, 2024-08-28T19:32:50.883 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 28, 2024-08-28T19:32:50.883 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:32:50.883 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 84, 2024-08-28T19:32:50.883 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 209.635943758 2024-08-28T19:32:50.883 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:50.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 -- 172.21.15.33:0/341486182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0bfc0b4c10 msgr2=0x7f0bfc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:50.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0bfc0b4c10 0x7f0bfc0b7120 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0cce80 tx=0x7f0c0c0c1770 comp rx=0 tx=0).stop 2024-08-28T19:32:50.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 -- 172.21.15.33:0/341486182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c14108ac0 msgr2=0x7f0c1419fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:50.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c14108ac0 0x7f0c1419fa70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c005cc0 tx=0x7f0c0c02f380 comp rx=0 tx=0).stop 2024-08-28T19:32:50.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 -- 172.21.15.33:0/341486182 shutdown_connections 2024-08-28T19:32:50.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c14108ac0 0x7f0c1419fa70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c14108170 0x7f0c1419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0bfc0b4c10 0x7f0bfc0b7120 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 --2- 172.21.15.33:0/341486182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c14102880 0x7f0c1419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:50.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 -- 172.21.15.33:0/341486182 >> 172.21.15.33:0/341486182 conn(0x7f0c14079500 msgr2=0x7f0c1406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:50.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 -- 172.21.15.33:0/341486182 shutdown_connections 2024-08-28T19:32:50.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:50.874+0000 7f0c1aa71640 1 -- 172.21.15.33:0/341486182 wait complete. 2024-08-28T19:32:51.578 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:51 smithi033 ceph-mon[18549]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-28T19:32:51.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:32:51.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.606 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-28T19:32:51.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:51 smithi059 ceph-mon[22052]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-28T19:32:51.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:32:51.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:51 smithi122 ceph-mon[22174]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-28T19:32:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:32:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:51.866 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:52.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.362+0000 7f8d8810c640 1 -- 172.21.15.33:0/3109504174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d80102880 msgr2=0x7f8d80102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:52.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.362+0000 7f8d8810c640 1 --2- 172.21.15.33:0/3109504174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d80102880 0x7f8d80102c90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009900 tx=0x7f8d7c02a410 comp rx=0 tx=0).stop 2024-08-28T19:32:52.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.362+0000 7f8d8810c640 1 -- 172.21.15.33:0/3109504174 shutdown_connections 2024-08-28T19:32:52.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.362+0000 7f8d8810c640 1 --2- 172.21.15.33:0/3109504174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d80108b10 0x7f8d8010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.362+0000 7f8d8810c640 1 --2- 172.21.15.33:0/3109504174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d801081c0 0x7f8d801085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.362+0000 7f8d8810c640 1 --2- 172.21.15.33:0/3109504174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d80102880 0x7f8d80102c90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.362+0000 7f8d8810c640 1 -- 172.21.15.33:0/3109504174 >> 172.21.15.33:0/3109504174 conn(0x7f8d80079510 msgr2=0x7f8d80079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:52.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.362+0000 7f8d8810c640 1 -- 172.21.15.33:0/3109504174 shutdown_connections 2024-08-28T19:32:52.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.362+0000 7f8d8810c640 1 -- 172.21.15.33:0/3109504174 wait complete. 2024-08-28T19:32:52.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.363+0000 7f8d8810c640 1 Processor -- start 2024-08-28T19:32:52.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.363+0000 7f8d8810c640 1 -- start start 2024-08-28T19:32:52.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.363+0000 7f8d8810c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d80102880 0x7f8d8019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.363+0000 7f8d8810c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d801081c0 0x7f8d8019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.363+0000 7f8d8810c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d80108b10 0x7f8d8019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.363+0000 7f8d8810c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8d801127c0 con 0x7f8d801081c0 2024-08-28T19:32:52.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.363+0000 7f8d8810c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8d80112640 con 0x7f8d80108b10 2024-08-28T19:32:52.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.363+0000 7f8d8810c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8d80112940 con 0x7f8d80102880 2024-08-28T19:32:52.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.363+0000 7f8d856a7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d801081c0 0x7f8d8019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d856a7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d801081c0 0x7f8d8019a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57152/0 (socket says 172.21.15.33:57152) 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d856a7640 1 -- 172.21.15.33:0/4140328788 learned_addr learned my addr 172.21.15.33:0/4140328788 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d866a9640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d80108b10 0x7f8d8019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d80102880 0x7f8d8019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d856a7640 1 -- 172.21.15.33:0/4140328788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d80102880 msgr2=0x7f8d8019a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d856a7640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d80102880 0x7f8d8019a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d856a7640 1 -- 172.21.15.33:0/4140328788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d80108b10 msgr2=0x7f8d8019fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d856a7640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d80108b10 0x7f8d8019fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d856a7640 1 -- 172.21.15.33:0/4140328788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d801a0270 con 0x7f8d801081c0 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d856a7640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d801081c0 0x7f8d8019a8a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000d740 tx=0x7f8d7000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:52.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d76ffd640 1 -- 172.21.15.33:0/4140328788 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d70017070 con 0x7f8d801081c0 2024-08-28T19:32:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d76ffd640 1 -- 172.21.15.33:0/4140328788 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d7000de50 con 0x7f8d801081c0 2024-08-28T19:32:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.364+0000 7f8d8810c640 1 -- 172.21.15.33:0/4140328788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d801a0560 con 0x7f8d801081c0 2024-08-28T19:32:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.365+0000 7f8d76ffd640 1 -- 172.21.15.33:0/4140328788 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7000f620 con 0x7f8d801081c0 2024-08-28T19:32:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.365+0000 7f8d8810c640 1 -- 172.21.15.33:0/4140328788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d80109310 con 0x7f8d801081c0 2024-08-28T19:32:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.368+0000 7f8d76ffd640 1 -- 172.21.15.33:0/4140328788 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f8d7001a070 con 0x7f8d801081c0 2024-08-28T19:32:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.368+0000 7f8d8e681740 1 Processor -- start 2024-08-28T19:32:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d8e681740 1 -- start start 2024-08-28T19:32:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 0x557880ff47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c260a0 0x557880ff4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x557880ff5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d8e681740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557880f6b3f0 con 0x557880c2e280 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d8e681740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557880f5a980 con 0x557880c260a0 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d8e681740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557880f5e930 con 0x557880c4ef60 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d856a7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x557880ff5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d85ea8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c260a0 0x557880ff4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d856a7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x557880ff5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57166/0 (socket says 172.21.15.33:57166) 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d856a7640 1 -- 172.21.15.33:0/515830589 learned_addr learned my addr 172.21.15.33:0/515830589 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c260a0 0x557880ff4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:42338/0 (socket says 172.21.15.33:42338) 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d866a9640 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 0x557880ff47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.369+0000 7f8d76ffd640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d6c0b4c90 0x7f8d6c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d866a9640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d6c0b4c90 0x7f8d6c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d76ffd640 1 -- 172.21.15.33:0/4140328788 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8d700e5090 con 0x7f8d801081c0 2024-08-28T19:32:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d856a7640 1 -- 172.21.15.33:0/515830589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 msgr2=0x557880ff47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d856a7640 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 0x557880ff47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d856a7640 1 -- 172.21.15.33:0/515830589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c260a0 msgr2=0x557880ff4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d856a7640 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c260a0 0x557880ff4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d856a7640 1 -- 172.21.15.33:0/515830589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557880cba540 con 0x557880c2e280 2024-08-28T19:32:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c260a0 0x557880ff4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:32:52.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d866a9640 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 0x557880ff47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:32:52.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d856a7640 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x557880ff5230 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8d700e2510 tx=0x7f8d70010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec485f3155ac483 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:52.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d866a9640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d6c0b4c90 0x7f8d6c0b71a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800afd0 tx=0x7f8d78004ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:52.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d6bfff640 1 -- 172.21.15.33:0/515830589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d70021030 con 0x557880c2e280 2024-08-28T19:32:52.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d6bfff640 1 -- 172.21.15.33:0/515830589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d700e87f0 con 0x557880c2e280 2024-08-28T19:32:52.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.370+0000 7f8d6bfff640 1 -- 172.21.15.33:0/515830589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d700afd60 con 0x557880c2e280 2024-08-28T19:32:52.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 -- 172.21.15.33:0/515830589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 msgr2=0x557880ff5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x557880ff5230 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8d700e2510 tx=0x7f8d70010c70 comp rx=0 tx=0).stop 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 -- 172.21.15.33:0/515830589 shutdown_connections 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x557880ff5230 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c260a0 0x557880ff4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 --2- 172.21.15.33:0/515830589 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 0x557880ff47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 -- 172.21.15.33:0/515830589 >> 172.21.15.33:0/515830589 conn(0x557880c43350 msgr2=0x557880ff26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 -- 172.21.15.33:0/515830589 shutdown_connections 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 -- 172.21.15.33:0/515830589 wait complete. 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 -- start start 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.372+0000 7f8d8e681740 1 Processor -- start 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c260a0 0x557880fffd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x5578810002c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c4ef60 0x557881000800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d8e681740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557880dbd5f0 con 0x557880c2e280 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d8e681740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557880ee1600 con 0x557880c4ef60 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d8e681740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557881002ed0 con 0x557880c260a0 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d856a7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x5578810002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d856a7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x5578810002c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57174/0 (socket says 172.21.15.33:57174) 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d8e681740 10 client.0 _ll_register_callbacks cb 0x557880f07af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d856a7640 1 -- 172.21.15.33:0/4054853122 learned_addr learned my addr 172.21.15.33:0/4054853122 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c260a0 0x557880fffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.373+0000 7f8d866a9640 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c4ef60 0x557881000800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d85ea8640 1 -- 172.21.15.33:0/4054853122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c4ef60 msgr2=0x557881000800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c4ef60 0x557881000800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d85ea8640 1 -- 172.21.15.33:0/4054853122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 msgr2=0x5578810002c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x5578810002c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d85ea8640 1 -- 172.21.15.33:0/4054853122 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557880f1a7b0 con 0x557880c260a0 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d856a7640 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x5578810002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c260a0 0x557880fffd80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009230 tx=0x7f8d7c031810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5811f016230c4af1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d697fa640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d697fa640 1 -- 172.21.15.33:0/4054853122 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c035040 con 0x557880c260a0 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d8e681740 1 -- 172.21.15.33:0/4054853122 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557880f6d340 con 0x557880c260a0 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d697fa640 1 -- 172.21.15.33:0/4054853122 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8d7c004450 con 0x557880c260a0 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d697fa640 1 -- 172.21.15.33:0/4054853122 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8d7c052050 con 0x557880c260a0 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d8e681740 10 client.25333 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.374+0000 7f8d8e681740 1 -- 172.21.15.33:0/4054853122 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55788100eb80 con 0x557880c260a0 2024-08-28T19:32:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.375+0000 7f8d697fa640 1 -- 172.21.15.33:0/4054853122 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557880f6d340 con 0x557880c260a0 2024-08-28T19:32:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.375+0000 7f8d697fa640 1 -- 172.21.15.33:0/4054853122 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8d7c04d030 con 0x557880c260a0 2024-08-28T19:32:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.375+0000 7f8d8e681740 10 client.25333 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.375+0000 7f8d8e681740 10 client.25333 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-28T19:32:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.375+0000 7f8d8e681740 20 client.25333 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.375+0000 7f8d8e681740 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x557880c0d8e0 0x5578810125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.375+0000 7f8d8e681740 4 client.25333 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.375+0000 7f8d8e681740 1 -- 172.21.15.33:0/4054853122 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557880f68de0 con 0x557880c0d8e0 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.375+0000 7f8d856a7640 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x557880c0d8e0 0x5578810125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.376+0000 7f8d856a7640 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x557880c0d8e0 0x5578810125c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=18fed1319eb83bf server_cookie=3388dd35eec34bc5 in_seq=0 out_seq=0 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.376+0000 7f8d697fa640 10 client.25333 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.376+0000 7f8d697fa640 1 -- 172.21.15.33:0/4054853122 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557880f68de0 con 0x557880c0d8e0 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.376+0000 7f8d697fa640 10 client.25333 handle_command_reply: tid=0 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.376+0000 7f8d8e681740 1 client.25333 shutdown 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 1 -- 172.21.15.33:0/4054853122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c260a0 msgr2=0x557880fffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c260a0 0x557880fffd80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009230 tx=0x7f8d7c031810 comp rx=0 tx=0).stop 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 1 -- 172.21.15.33:0/4054853122 shutdown_connections 2024-08-28T19:32:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c4ef60 0x557881000800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x557880c0d8e0 0x5578810125c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c2e280 0x5578810002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 1 --2- 172.21.15.33:0/4054853122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c260a0 0x557880fffd80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d697fa640 0 client.25333 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:32:52.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 1 -- 172.21.15.33:0/4054853122 >> 172.21.15.33:0/4054853122 conn(0x557880c43350 msgr2=0x557880ff7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:52.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 1 -- 172.21.15.33:0/4054853122 shutdown_connections 2024-08-28T19:32:52.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 1 -- 172.21.15.33:0/4054853122 wait complete. 2024-08-28T19:32:52.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.377+0000 7f8d8e681740 20 client.25333 trim_cache size 0 max 16384 2024-08-28T19:32:52.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.395+0000 7f8d8e681740 1 Processor -- start 2024-08-28T19:32:52.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.395+0000 7f8d8e681740 1 -- start start 2024-08-28T19:32:52.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x557881011ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c2e280 0x557880ffe600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 0x55788100c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d8e681740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557881010900 con 0x557880c260a0 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d8e681740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557881010fd0 con 0x557880c2e280 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d8e681740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5578810116a0 con 0x557880c4ef60 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d85ea8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x557881011ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d85ea8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x557881011ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57186/0 (socket says 172.21.15.33:57186) 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d85ea8640 1 -- 172.21.15.33:0/3463163603 learned_addr learned my addr 172.21.15.33:0/3463163603 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d856a7640 1 --2- 172.21.15.33:0/3463163603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c2e280 0x557880ffe600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d866a9640 1 --2- 172.21.15.33:0/3463163603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 0x55788100c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d85ea8640 1 -- 172.21.15.33:0/3463163603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 msgr2=0x55788100c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/3463163603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 0x55788100c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d85ea8640 1 -- 172.21.15.33:0/3463163603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c2e280 msgr2=0x557880ffe600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:52.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/3463163603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c2e280 0x557880ffe600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d85ea8640 1 -- 172.21.15.33:0/3463163603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557880ffece0 con 0x557880c260a0 2024-08-28T19:32:52.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.396+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/3463163603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x557881011ef0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009850 tx=0x7f8d7c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65414013a8e5bbe server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:52.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.397+0000 7f8d6b7fe640 1 -- 172.21.15.33:0/3463163603 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c05b070 con 0x557880c260a0 2024-08-28T19:32:52.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.397+0000 7f8d6b7fe640 1 -- 172.21.15.33:0/3463163603 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d7c004450 con 0x557880c260a0 2024-08-28T19:32:52.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.397+0000 7f8d6b7fe640 1 -- 172.21.15.33:0/3463163603 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c035040 con 0x557880c260a0 2024-08-28T19:32:52.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.397+0000 7f8d8e681740 1 -- 172.21.15.33:0/3463163603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 msgr2=0x557881011ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:52.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.397+0000 7f8d8e681740 1 --2- 172.21.15.33:0/3463163603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x557881011ef0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009850 tx=0x7f8d7c02a410 comp rx=0 tx=0).stop 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.397+0000 7f8d8e681740 1 -- 172.21.15.33:0/3463163603 shutdown_connections 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.397+0000 7f8d8e681740 1 --2- 172.21.15.33:0/3463163603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c4ef60 0x55788100c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.397+0000 7f8d8e681740 1 --2- 172.21.15.33:0/3463163603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c2e280 0x557880ffe600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.397+0000 7f8d8e681740 1 --2- 172.21.15.33:0/3463163603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x557881011ef0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.397+0000 7f8d8e681740 1 -- 172.21.15.33:0/3463163603 >> 172.21.15.33:0/3463163603 conn(0x557880c43350 msgr2=0x557880ff57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 1 -- 172.21.15.33:0/3463163603 shutdown_connections 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 1 -- 172.21.15.33:0/3463163603 wait complete. 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 1 -- start start 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 1 Processor -- start 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x55788101b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c2e280 0x557881014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c4ef60 0x557881014b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557881012440 con 0x557880c260a0 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557881011d70 con 0x557880c4ef60 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557881012b10 con 0x557880c2e280 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.398+0000 7f8d8e681740 10 client.0 _ll_register_callbacks cb 0x7f8d7c0314a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d85ea8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x55788101b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d85ea8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x55788101b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57200/0 (socket says 172.21.15.33:57200) 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d85ea8640 1 -- 172.21.15.33:0/1652896454 learned_addr learned my addr 172.21.15.33:0/1652896454 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d856a7640 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c2e280 0x557881014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d866a9640 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c4ef60 0x557881014b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d85ea8640 1 -- 172.21.15.33:0/1652896454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c2e280 msgr2=0x557881014590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c2e280 0x557881014590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d85ea8640 1 -- 172.21.15.33:0/1652896454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c4ef60 msgr2=0x557881014b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c4ef60 0x557881014b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d85ea8640 1 -- 172.21.15.33:0/1652896454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578810152a0 con 0x557880c260a0 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d856a7640 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c2e280 0x557881014590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d85ea8640 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x55788101b090 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c004e30 tx=0x7f8d7c03abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479c610c38de8185 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d697fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d697fa640 1 -- 172.21.15.33:0/1652896454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c035070 con 0x557880c260a0 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d697fa640 1 -- 172.21.15.33:0/1652896454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8d7c0048d0 con 0x557880c260a0 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.399+0000 7f8d8e681740 1 -- 172.21.15.33:0/1652896454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d7c004450 con 0x557880c260a0 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d697fa640 1 -- 172.21.15.33:0/1652896454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8d7c05b030 con 0x557880c260a0 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d8e681740 10 client.15747 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d8e681740 1 -- 172.21.15.33:0/1652896454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55788107da90 con 0x557880c260a0 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d697fa640 1 -- 172.21.15.33:0/1652896454 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d7c004450 con 0x557880c260a0 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d697fa640 1 -- 172.21.15.33:0/1652896454 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8d7c04d070 con 0x557880c260a0 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d8e681740 10 client.15747 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:52.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d8e681740 10 client.15747 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d8e681740 20 client.15747 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d8e681740 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x557880be2c90 0x557881080ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d8e681740 4 client.15747 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d8e681740 1 -- 172.21.15.33:0/1652896454 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "status"}) -- 0x557880f66520 con 0x557880be2c90 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.400+0000 7f8d856a7640 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x557880be2c90 0x557881080ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d697fa640 10 client.15747 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d856a7640 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x557880be2c90 0x557881080ec0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=adc2d8c4ef42375f server_cookie=cce610c575194c41 in_seq=0 out_seq=0 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d697fa640 1 -- 172.21.15.33:0/1652896454 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557880f66520 con 0x557880be2c90 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d697fa640 10 client.15747 handle_command_reply: tid=0 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 client.15747 shutdown 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 -- 172.21.15.33:0/1652896454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 msgr2=0x55788101b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x55788101b090 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c004e30 tx=0x7f8d7c03abd0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 -- 172.21.15.33:0/1652896454 shutdown_connections 2024-08-28T19:32:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557880c4ef60 0x557881014b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557880c2e280 0x557881014590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x557880be2c90 0x557881080ec0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 --2- 172.21.15.33:0/1652896454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557880c260a0 0x55788101b090 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 -- 172.21.15.33:0/1652896454 >> 172.21.15.33:0/1652896454 conn(0x557880c43350 msgr2=0x557880ff57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d697fa640 0 client.15747 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:32:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 -- 172.21.15.33:0/1652896454 shutdown_connections 2024-08-28T19:32:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 1 -- 172.21.15.33:0/1652896454 wait complete. 2024-08-28T19:32:52.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.401+0000 7f8d8e681740 20 client.15747 trim_cache size 0 max 16384 2024-08-28T19:32:52.409 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:52.409 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:32:52.409 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 2, 2024-08-28T19:32:52.409 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24643, 2024-08-28T19:32:52.409 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:32:52.409 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:32:52.409 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:32:52.409 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 148.02061645399999, 2024-08-28T19:32:52.409 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 28, 2024-08-28T19:32:52.409 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:32:52.410 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 84, 2024-08-28T19:32:52.410 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 208.67180128199999 2024-08-28T19:32:52.410 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:52.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 -- 172.21.15.33:0/4140328788 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d6c0b4c90 msgr2=0x7f8d6c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:52.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d6c0b4c90 0x7f8d6c0b71a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800afd0 tx=0x7f8d78004ab0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 -- 172.21.15.33:0/4140328788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d801081c0 msgr2=0x7f8d8019a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:52.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d801081c0 0x7f8d8019a8a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000d740 tx=0x7f8d7000dc00 comp rx=0 tx=0).stop 2024-08-28T19:32:52.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 -- 172.21.15.33:0/4140328788 shutdown_connections 2024-08-28T19:32:52.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d80108b10 0x7f8d8019fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d801081c0 0x7f8d8019a8a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d6c0b4c90 0x7f8d6c0b71a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 --2- 172.21.15.33:0/4140328788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d80102880 0x7f8d8019a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:52.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 -- 172.21.15.33:0/4140328788 >> 172.21.15.33:0/4140328788 conn(0x7f8d80079510 msgr2=0x7f8d80101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:52.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 -- 172.21.15.33:0/4140328788 shutdown_connections 2024-08-28T19:32:52.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:52.402+0000 7f8d8810c640 1 -- 172.21.15.33:0/4140328788 wait complete. 2024-08-28T19:32:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:52 smithi059 ceph-mon[22052]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:32:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:32:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:32:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:52 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:53.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:53.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:53.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:52 smithi122 ceph-mon[22174]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:32:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:32:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:32:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:52 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:52 smithi033 ceph-mon[18549]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:32:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:32:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:32:53.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:52 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:32:53.159 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-28T19:32:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:53.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.916+0000 7f0d367f6640 1 -- 172.21.15.33:0/2814529775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d301039d0 msgr2=0x7f0d30103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:53.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.916+0000 7f0d367f6640 1 --2- 172.21.15.33:0/2814529775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d301039d0 0x7f0d30103de0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009900 tx=0x7f0d2002a410 comp rx=0 tx=0).stop 2024-08-28T19:32:53.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.916+0000 7f0d367f6640 1 -- 172.21.15.33:0/2814529775 shutdown_connections 2024-08-28T19:32:53.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.916+0000 7f0d367f6640 1 --2- 172.21.15.33:0/2814529775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d30109c60 0x7f0d30110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.916+0000 7f0d367f6640 1 --2- 172.21.15.33:0/2814529775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d30109310 0x7f0d30109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.916+0000 7f0d367f6640 1 --2- 172.21.15.33:0/2814529775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d301039d0 0x7f0d30103de0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.916+0000 7f0d367f6640 1 -- 172.21.15.33:0/2814529775 >> 172.21.15.33:0/2814529775 conn(0x7f0d3007b670 msgr2=0x7f0d3007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.916+0000 7f0d367f6640 1 -- 172.21.15.33:0/2814529775 shutdown_connections 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.916+0000 7f0d367f6640 1 -- 172.21.15.33:0/2814529775 wait complete. 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d367f6640 1 Processor -- start 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d367f6640 1 -- start start 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d367f6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d301039d0 0x7f0d3019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d367f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d30109310 0x7f0d3019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d367f6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d30109c60 0x7f0d3019fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d367f6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30113880 con 0x7f0d301039d0 2024-08-28T19:32:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d367f6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30113700 con 0x7f0d30109c60 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d367f6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30113a00 con 0x7f0d30109310 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d301039d0 0x7f0d3019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d301039d0 0x7f0d3019a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57214/0 (socket says 172.21.15.33:57214) 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d2ffff640 1 -- 172.21.15.33:0/2051230706 learned_addr learned my addr 172.21.15.33:0/2051230706 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.917+0000 7f0d27fff640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d30109310 0x7f0d3019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d34d93640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d30109c60 0x7f0d3019fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d2ffff640 1 -- 172.21.15.33:0/2051230706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d30109310 msgr2=0x7f0d3019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d30109310 0x7f0d3019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d2ffff640 1 -- 172.21.15.33:0/2051230706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d30109c60 msgr2=0x7f0d3019fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d30109c60 0x7f0d3019fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d2ffff640 1 -- 172.21.15.33:0/2051230706 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d301a0140 con 0x7f0d301039d0 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d301039d0 0x7f0d3019a290 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0d20005940 tx=0x7f0d20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:53.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d2dffb640 1 -- 172.21.15.33:0/2051230706 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2003f030 con 0x7f0d301039d0 2024-08-28T19:32:53.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d2dffb640 1 -- 172.21.15.33:0/2051230706 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d20003aa0 con 0x7f0d301039d0 2024-08-28T19:32:53.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d367f6640 1 -- 172.21.15.33:0/2051230706 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d301a03d0 con 0x7f0d301039d0 2024-08-28T19:32:53.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d2dffb640 1 -- 172.21.15.33:0/2051230706 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20035070 con 0x7f0d301039d0 2024-08-28T19:32:53.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.918+0000 7f0d367f6640 1 -- 172.21.15.33:0/2051230706 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d301a08b0 con 0x7f0d301039d0 2024-08-28T19:32:53.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.921+0000 7f0d3cd6b740 1 Processor -- start 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.921+0000 7f0d3cd6b740 1 -- start start 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.921+0000 7f0d2dffb640 1 -- 172.21.15.33:0/2051230706 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f0d20042030 con 0x7f0d301039d0 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.921+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 0x5626d466c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.921+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d466ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.921+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 0x5626d466d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.921+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5626d45e33f0 con 0x5626d429e0a0 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.921+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5626d45d2980 con 0x5626d42a6280 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.921+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5626d45d6930 con 0x5626d42c6f60 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d466ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d34d93640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 0x5626d466c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d466ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57216/0 (socket says 172.21.15.33:57216) 2024-08-28T19:32:53.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2ffff640 1 -- 172.21.15.33:0/3446389647 learned_addr learned my addr 172.21.15.33:0/3446389647 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d27fff640 1 --2- 172.21.15.33:0/3446389647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 0x5626d466d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2ffff640 1 -- 172.21.15.33:0/3446389647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 msgr2=0x5626d466c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/3446389647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 0x5626d466c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2ffff640 1 -- 172.21.15.33:0/3446389647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 msgr2=0x5626d466d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/3446389647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 0x5626d466d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2dffb640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d1c0b4c40 0x7f0d1c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2ffff640 1 -- 172.21.15.33:0/3446389647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d4332540 con 0x5626d429e0a0 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d27fff640 1 --2- 172.21.15.33:0/3446389647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 0x5626d466d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d34d93640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d1c0b4c40 0x7f0d1c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2dffb640 1 -- 172.21.15.33:0/2051230706 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0d20105930 con 0x7f0d301039d0 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.922+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/3446389647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d466ccf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0d200caa60 tx=0x7f0d200c84a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f2f5725fd4f53a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:53.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.923+0000 7f0d267fc640 1 -- 172.21.15.33:0/3446389647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20049070 con 0x5626d429e0a0 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.923+0000 7f0d267fc640 1 -- 172.21.15.33:0/3446389647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d200cc490 con 0x5626d429e0a0 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.923+0000 7f0d267fc640 1 -- 172.21.15.33:0/3446389647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200cbb60 con 0x5626d429e0a0 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.923+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3446389647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 msgr2=0x5626d466ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.923+0000 7f0d34d93640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d1c0b4c40 0x7f0d1c0b7150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d28007ed0 tx=0x7f0d28007680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.923+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/3446389647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d466ccf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0d200caa60 tx=0x7f0d200c84a0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.924+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3446389647 shutdown_connections 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.924+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/3446389647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 0x5626d466d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.924+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/3446389647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d466ccf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.924+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/3446389647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 0x5626d466c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.924+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3446389647 >> 172.21.15.33:0/3446389647 conn(0x5626d42bb350 msgr2=0x5626d466a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.924+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3446389647 shutdown_connections 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.924+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3446389647 wait complete. 2024-08-28T19:32:53.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.924+0000 7f0d3cd6b740 1 -- start start 2024-08-28T19:32:53.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.924+0000 7f0d3cd6b740 1 Processor -- start 2024-08-28T19:32:53.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d467c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 0x5626d467c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 0x5626d46882a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5626d44355f0 con 0x5626d429e0a0 2024-08-28T19:32:53.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5626d4559600 con 0x5626d42a6280 2024-08-28T19:32:53.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5626d467f080 con 0x5626d42c6f60 2024-08-28T19:32:53.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d467c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d3cd6b740 10 client.0 _ll_register_callbacks cb 0x5626d457faf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d467c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57224/0 (socket says 172.21.15.33:57224) 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d2ffff640 1 -- 172.21.15.33:0/3310081209 learned_addr learned my addr 172.21.15.33:0/3310081209 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d27fff640 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 0x5626d467c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d34d93640 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 0x5626d46882a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d2ffff640 1 -- 172.21.15.33:0/3310081209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 msgr2=0x5626d46882a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 0x5626d46882a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d2ffff640 1 -- 172.21.15.33:0/3310081209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 msgr2=0x5626d467c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 0x5626d467c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d2ffff640 1 -- 172.21.15.33:0/3310081209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d45927b0 con 0x5626d429e0a0 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d27fff640 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 0x5626d467c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:53.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d34d93640 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 0x5626d46882a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d467c250 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0d200c7e10 tx=0x7f0d200c7b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7844f9318f76206b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/3310081209 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20049040 con 0x5626d429e0a0 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.925+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/3310081209 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0d200b3110 con 0x5626d429e0a0 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3310081209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d200cc490 con 0x5626d429e0a0 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/3310081209 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d200cb500 con 0x5626d429e0a0 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d3cd6b740 10 client.15759 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3310081209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5626d468ac90 con 0x5626d429e0a0 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/3310081209 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d200cc490 con 0x5626d429e0a0 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/3310081209 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0d2004c060 con 0x5626d429e0a0 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d3cd6b740 10 client.15759 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d3cd6b740 10 client.15759 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d3cd6b740 20 client.15759 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:53.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5626d42858e0 0x5626d468e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d3cd6b740 4 client.15759 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:53.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.926+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3310081209 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626d45e5340 con 0x5626d42858e0 2024-08-28T19:32:53.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.927+0000 7f0d27fff640 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5626d42858e0 0x5626d468e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.927+0000 7f0d27fff640 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5626d42858e0 0x5626d468e410 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3813277982bd5270 server_cookie=41a6ec7765428956 in_seq=0 out_seq=0 2024-08-28T19:32:53.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.927+0000 7f0d0f7fe640 10 client.15759 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:32:53.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/3310081209 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5626d45e5340 con 0x5626d42858e0 2024-08-28T19:32:53.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d0f7fe640 10 client.15759 handle_command_reply: tid=0 2024-08-28T19:32:53.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 client.15759 shutdown 2024-08-28T19:32:53.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3310081209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 msgr2=0x5626d467c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:53.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d467c250 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0d200c7e10 tx=0x7f0d200c7b80 comp rx=0 tx=0).stop 2024-08-28T19:32:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3310081209 shutdown_connections 2024-08-28T19:32:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5626d42858e0 0x5626d468e410 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42c6f60 0x5626d46882a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d0f7fe640 0 client.15759 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:32:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42a6280 0x5626d467c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/3310081209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d429e0a0 0x5626d467c250 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3310081209 >> 172.21.15.33:0/3310081209 conn(0x5626d42bb350 msgr2=0x5626d466f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3310081209 shutdown_connections 2024-08-28T19:32:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/3310081209 wait complete. 2024-08-28T19:32:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.928+0000 7f0d3cd6b740 20 client.15759 trim_cache size 0 max 16384 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.946+0000 7f0d3cd6b740 1 Processor -- start 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d3cd6b740 1 -- start start 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42bb350 0x5626d467c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42858e0 0x5626d4688190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d429e0a0 0x5626d4669cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5626d468c750 con 0x5626d42858e0 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5626d468ce20 con 0x5626d429e0a0 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5626d468d4f0 con 0x5626d42bb350 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d27fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42858e0 0x5626d4688190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d27fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42858e0 0x5626d4688190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57230/0 (socket says 172.21.15.33:57230) 2024-08-28T19:32:53.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d27fff640 1 -- 172.21.15.33:0/801714800 learned_addr learned my addr 172.21.15.33:0/801714800 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d34d93640 1 --2- 172.21.15.33:0/801714800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d429e0a0 0x5626d4669cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/801714800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42bb350 0x5626d467c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d27fff640 1 -- 172.21.15.33:0/801714800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42bb350 msgr2=0x5626d467c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d27fff640 1 --2- 172.21.15.33:0/801714800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42bb350 0x5626d467c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d27fff640 1 -- 172.21.15.33:0/801714800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d429e0a0 msgr2=0x5626d4669cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d27fff640 1 --2- 172.21.15.33:0/801714800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d429e0a0 0x5626d4669cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d27fff640 1 -- 172.21.15.33:0/801714800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d467a750 con 0x5626d42858e0 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.947+0000 7f0d34d93640 1 --2- 172.21.15.33:0/801714800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d429e0a0 0x5626d4669cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d27fff640 1 --2- 172.21.15.33:0/801714800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42858e0 0x5626d4688190 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0d3006a830 tx=0x7f0d18005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbb5a0f3740c6ca server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d25ffb640 1 -- 172.21.15.33:0/801714800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18020040 con 0x5626d42858e0 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d25ffb640 1 -- 172.21.15.33:0/801714800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d18003e40 con 0x5626d42858e0 2024-08-28T19:32:53.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d25ffb640 1 -- 172.21.15.33:0/801714800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1801d470 con 0x5626d42858e0 2024-08-28T19:32:53.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/801714800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42858e0 msgr2=0x5626d4688190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:53.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/801714800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42858e0 0x5626d4688190 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0d3006a830 tx=0x7f0d18005f90 comp rx=0 tx=0).stop 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/801714800 shutdown_connections 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/801714800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d429e0a0 0x5626d4669cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/801714800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42858e0 0x5626d4688190 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/801714800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d42bb350 0x5626d467c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.948+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/801714800 >> 172.21.15.33:0/801714800 conn(0x5626d4665850 msgr2=0x5626d467c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/801714800 shutdown_connections 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/801714800 wait complete. 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 1 -- start start 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 1 Processor -- start 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42858e0 0x5626d4696c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d429e0a0 0x5626d4691120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42bb350 0x5626d4691660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5626d468e290 con 0x5626d42bb350 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5626d468dbc0 con 0x5626d42858e0 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5626d468e960 con 0x5626d429e0a0 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.949+0000 7f0d3cd6b740 10 client.0 _ll_register_callbacks cb 0x7f0d20109bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d34d93640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42bb350 0x5626d4691660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d34d93640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42bb350 0x5626d4691660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57244/0 (socket says 172.21.15.33:57244) 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d34d93640 1 -- 172.21.15.33:0/968231831 learned_addr learned my addr 172.21.15.33:0/968231831 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42858e0 0x5626d4696c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d27fff640 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d429e0a0 0x5626d4691120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d34d93640 1 -- 172.21.15.33:0/968231831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d429e0a0 msgr2=0x5626d4691120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d34d93640 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d429e0a0 0x5626d4691120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d34d93640 1 -- 172.21.15.33:0/968231831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42858e0 msgr2=0x5626d4696c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:53.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d34d93640 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42858e0 0x5626d4696c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d34d93640 1 -- 172.21.15.33:0/968231831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d4691bd0 con 0x5626d42bb350 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42858e0 0x5626d4696c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d34d93640 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42bb350 0x5626d4691660 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0d2801ddc0 tx=0x7f0d28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b3042c4ce356d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/968231831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2802b060 con 0x5626d42bb350 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/968231831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0d280263f0 con 0x5626d42bb350 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.950+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/968231831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5626d45e0de0 con 0x5626d42bb350 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/968231831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d28032050 con 0x5626d42bb350 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d3cd6b740 10 client.15765 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/968231831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5626d46fa650 con 0x5626d42bb350 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/968231831 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5626d45e0de0 con 0x5626d42bb350 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/968231831 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0d28025070 con 0x5626d42bb350 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d3cd6b740 10 client.15765 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:53.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d3cd6b740 10 client.15765 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d3cd6b740 20 client.15765 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5626d42a6280 0x5626d46fdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d3cd6b740 4 client.15765 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/968231831 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "status"}) -- 0x5626d45de520 con 0x5626d42a6280 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.951+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5626d42a6280 0x5626d46fdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d2ffff640 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5626d42a6280 0x5626d46fdfd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e43213991684b16f server_cookie=a97a25347e5b59b5 in_seq=0 out_seq=0 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d0f7fe640 10 client.15765 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d0f7fe640 1 -- 172.21.15.33:0/968231831 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5626d45de520 con 0x5626d42a6280 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d0f7fe640 10 client.15765 handle_command_reply: tid=0 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 client.15765 shutdown 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/968231831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42bb350 msgr2=0x5626d4691660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42bb350 0x5626d4691660 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0d2801ddc0 tx=0x7f0d28004a40 comp rx=0 tx=0).stop 2024-08-28T19:32:53.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/968231831 shutdown_connections 2024-08-28T19:32:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5626d42a6280 0x5626d46fdfd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5626d42bb350 0x5626d4691660 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5626d429e0a0 0x5626d4691120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 --2- 172.21.15.33:0/968231831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d42858e0 0x5626d4696c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/968231831 >> 172.21.15.33:0/968231831 conn(0x5626d4665850 msgr2=0x5626d467d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d0f7fe640 0 client.15765 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:32:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/968231831 shutdown_connections 2024-08-28T19:32:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.952+0000 7f0d3cd6b740 1 -- 172.21.15.33:0/968231831 wait complete. 2024-08-28T19:32:53.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d3cd6b740 20 client.15765 trim_cache size 0 max 16384 2024-08-28T19:32:53.960 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 1, 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24653, 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 150.585902073, 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 28, 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 84, 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 195.74201670100001 2024-08-28T19:32:53.961 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:53.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 -- 172.21.15.33:0/2051230706 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d1c0b4c40 msgr2=0x7f0d1c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:53.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d1c0b4c40 0x7f0d1c0b7150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d28007ed0 tx=0x7f0d28007680 comp rx=0 tx=0).stop 2024-08-28T19:32:53.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 -- 172.21.15.33:0/2051230706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d301039d0 msgr2=0x7f0d3019a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:53.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d301039d0 0x7f0d3019a290 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0d20005940 tx=0x7f0d20004270 comp rx=0 tx=0).stop 2024-08-28T19:32:53.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 -- 172.21.15.33:0/2051230706 shutdown_connections 2024-08-28T19:32:53.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d30109c60 0x7f0d3019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d1c0b4c40 0x7f0d1c0b7150 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d30109310 0x7f0d3019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 --2- 172.21.15.33:0/2051230706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d301039d0 0x7f0d3019a290 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:53.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 -- 172.21.15.33:0/2051230706 >> 172.21.15.33:0/2051230706 conn(0x7f0d3007b670 msgr2=0x7f0d301073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:53.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 -- 172.21.15.33:0/2051230706 shutdown_connections 2024-08-28T19:32:53.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:53.953+0000 7f0d367f6640 1 -- 172.21.15.33:0/2051230706 wait complete. 2024-08-28T19:32:54.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-28T19:32:54.945 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:32:55.065 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:54 smithi033 ceph-mon[18549]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-28T19:32:55.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:54 smithi059 ceph-mon[22052]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-28T19:32:55.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:54 smithi122 ceph-mon[22174]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-28T19:32:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.434+0000 7f1ae4114640 1 -- 172.21.15.33:0/279350220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1adc109b90 msgr2=0x7f1adc1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.434+0000 7f1ae4114640 1 --2- 172.21.15.33:0/279350220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1adc109b90 0x7f1adc1103c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009ca0 tx=0x7f1ad402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.435+0000 7f1ae4114640 1 -- 172.21.15.33:0/279350220 shutdown_connections 2024-08-28T19:32:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.435+0000 7f1ae4114640 1 --2- 172.21.15.33:0/279350220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1adc109b90 0x7f1adc1103c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.435+0000 7f1ae4114640 1 --2- 172.21.15.33:0/279350220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc109240 0x7f1adc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.435+0000 7f1ae4114640 1 --2- 172.21.15.33:0/279350220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1adc103900 0x7f1adc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.435+0000 7f1ae4114640 1 -- 172.21.15.33:0/279350220 >> 172.21.15.33:0/279350220 conn(0x7f1adc07b5f0 msgr2=0x7f1adc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.435+0000 7f1ae4114640 1 -- 172.21.15.33:0/279350220 shutdown_connections 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.435+0000 7f1ae4114640 1 -- 172.21.15.33:0/279350220 wait complete. 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.435+0000 7f1ae4114640 1 Processor -- start 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.435+0000 7f1ae4114640 1 -- start start 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae4114640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1adc103900 0x7f1adc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae4114640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc109240 0x7f1adc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae4114640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1adc109b90 0x7f1adc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae4114640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc113850 con 0x7f1adc103900 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae4114640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc1136d0 con 0x7f1adc109240 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae4114640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc1139d0 con 0x7f1adc109b90 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae1eb0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1adc103900 0x7f1adc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae1eb0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1adc103900 0x7f1adc0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57272/0 (socket says 172.21.15.33:57272) 2024-08-28T19:32:55.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae1eb0640 1 -- 172.21.15.33:0/3075841246 learned_addr learned my addr 172.21.15.33:0/3075841246 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:55.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc109240 0x7f1adc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1adc109b90 0x7f1adc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae1eb0640 1 -- 172.21.15.33:0/3075841246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1adc109b90 msgr2=0x7f1adc075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae1eb0640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1adc109b90 0x7f1adc075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae1eb0640 1 -- 172.21.15.33:0/3075841246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc109240 msgr2=0x7f1adc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae1eb0640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc109240 0x7f1adc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae1eb0640 1 -- 172.21.15.33:0/3075841246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc1a8480 con 0x7f1adc103900 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.436+0000 7f1ae1eb0640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1adc103900 0x7f1adc0754b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00d770 tx=0x7f1acc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.437+0000 7f1ad2ffd640 1 -- 172.21.15.33:0/3075841246 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc017070 con 0x7f1adc103900 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.437+0000 7f1ae4114640 1 -- 172.21.15.33:0/3075841246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc1a8770 con 0x7f1adc103900 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.437+0000 7f1ad2ffd640 1 -- 172.21.15.33:0/3075841246 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1acc0054d0 con 0x7f1adc103900 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.437+0000 7f1ad2ffd640 1 -- 172.21.15.33:0/3075841246 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc004c30 con 0x7f1adc103900 2024-08-28T19:32:55.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.437+0000 7f1ae4114640 1 -- 172.21.15.33:0/3075841246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc1a8cb0 con 0x7f1adc103900 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.439+0000 7f1aea689740 1 Processor -- start 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.439+0000 7f1aea689740 1 -- start start 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.439+0000 7f1ad2ffd640 1 -- 172.21.15.33:0/3075841246 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) ==== 152651+0+0 (secure 0 0 0) 0x7f1acc010460 con 0x7f1adc103900 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.439+0000 7f1aea689740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5899f60 0x55b1d5c3f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1aea689740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d58710a0 0x55b1d5c3fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1aea689740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 0x55b1d5c40230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1aea689740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5bb63f0 con 0x55b1d5899f60 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1aea689740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5ba5980 con 0x55b1d58710a0 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1aea689740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5ba9930 con 0x55b1d5879280 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae26b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5899f60 0x55b1d5c3f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae26b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5899f60 0x55b1d5c3f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57286/0 (socket says 172.21.15.33:57286) 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae26b1640 1 -- 172.21.15.33:0/2651800734 learned_addr learned my addr 172.21.15.33:0/2651800734 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:55.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae16af640 1 --2- 172.21.15.33:0/2651800734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 0x55b1d5c40230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae1eb0640 1 --2- 172.21.15.33:0/2651800734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d58710a0 0x55b1d5c3fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae26b1640 1 -- 172.21.15.33:0/2651800734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 msgr2=0x55b1d5c40230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/2651800734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 0x55b1d5c40230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae26b1640 1 -- 172.21.15.33:0/2651800734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d58710a0 msgr2=0x55b1d5c3fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/2651800734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d58710a0 0x55b1d5c3fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae26b1640 1 -- 172.21.15.33:0/2651800734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d5905540 con 0x55b1d5899f60 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ad2ffd640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ac80b4c10 0x7f1ac80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/2651800734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5899f60 0x55b1d5c3f7b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4005cc0 tx=0x7f1ad4009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c50ce5a28f464c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.440+0000 7f1ae1eb0640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ac80b4c10 0x7f1ac80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.441+0000 7f1ad2ffd640 1 -- 172.21.15.33:0/3075841246 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1acc0e52d0 con 0x7f1adc103900 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.441+0000 7f1ac7fff640 1 -- 172.21.15.33:0/2651800734 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4031cf0 con 0x55b1d5899f60 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.441+0000 7f1ac7fff640 1 -- 172.21.15.33:0/2651800734 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ad4036040 con 0x55b1d5899f60 2024-08-28T19:32:55.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.441+0000 7f1ac7fff640 1 -- 172.21.15.33:0/2651800734 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40042a0 con 0x55b1d5899f60 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 -- 172.21.15.33:0/2651800734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5899f60 msgr2=0x55b1d5c3f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1ae1eb0640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ac80b4c10 0x7f1ac80b7120 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0e8fd0 tx=0x7f1acc0e8e20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 --2- 172.21.15.33:0/2651800734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5899f60 0x55b1d5c3f7b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4005cc0 tx=0x7f1ad4009800 comp rx=0 tx=0).stop 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 -- 172.21.15.33:0/2651800734 shutdown_connections 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 --2- 172.21.15.33:0/2651800734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 0x55b1d5c40230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 --2- 172.21.15.33:0/2651800734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d58710a0 0x55b1d5c3fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 --2- 172.21.15.33:0/2651800734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5899f60 0x55b1d5c3f7b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 -- 172.21.15.33:0/2651800734 >> 172.21.15.33:0/2651800734 conn(0x55b1d588e350 msgr2=0x55b1d5c3d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 -- 172.21.15.33:0/2651800734 shutdown_connections 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 -- 172.21.15.33:0/2651800734 wait complete. 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 -- start start 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.442+0000 7f1aea689740 1 Processor -- start 2024-08-28T19:32:55.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1aea689740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d58710a0 0x55b1d5c4ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1aea689740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c4b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1aea689740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5899f60 0x55b1d5c4b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1aea689740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5a085f0 con 0x55b1d5879280 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1aea689740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5b2c600 con 0x55b1d58710a0 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1aea689740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5c4df30 con 0x55b1d5899f60 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1aea689740 10 client.0 _ll_register_callbacks cb 0x55b1d5b52af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae16af640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c4b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae16af640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c4b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57300/0 (socket says 172.21.15.33:57300) 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae16af640 1 -- 172.21.15.33:0/3124679721 learned_addr learned my addr 172.21.15.33:0/3124679721 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d58710a0 0x55b1d5c4ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5899f60 0x55b1d5c4b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae16af640 1 -- 172.21.15.33:0/3124679721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5899f60 msgr2=0x55b1d5c4b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:55.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5899f60 0x55b1d5c4b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae16af640 1 -- 172.21.15.33:0/3124679721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d58710a0 msgr2=0x55b1d5c4ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d58710a0 0x55b1d5c4ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae16af640 1 -- 172.21.15.33:0/3124679721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d5b657b0 con 0x55b1d5879280 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.443+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5899f60 0x55b1d5c4b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1ac57fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c4b320 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800bad0 tx=0x7f1ad800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10433a7a1a5ba799 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3124679721 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8003e00 con 0x55b1d5879280 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3124679721 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1ad8011440 con 0x55b1d5879280 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1aea689740 1 -- 172.21.15.33:0/3124679721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ad4036040 con 0x55b1d5879280 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3124679721 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ad8011680 con 0x55b1d5879280 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1aea689740 10 client.15777 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1aea689740 1 -- 172.21.15.33:0/3124679721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1d5c59c30 con 0x55b1d5879280 2024-08-28T19:32:55.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3124679721 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ad4036040 con 0x55b1d5879280 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3124679721 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1ad801ba40 con 0x55b1d5879280 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1aea689740 10 client.15777 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1aea689740 10 client.15777 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1aea689740 20 client.15777 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1aea689740 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b1d58588e0 0x55b1d5c5d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1aea689740 4 client.15777 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.444+0000 7f1aea689740 1 -- 172.21.15.33:0/3124679721 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1d5bb8340 con 0x55b1d58588e0 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.445+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b1d58588e0 0x55b1d5c5d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.445+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b1d58588e0 0x55b1d5c5d730 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c792fb476715965f server_cookie=e4eb196bf9fb5a2b in_seq=0 out_seq=0 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.445+0000 7f1ac57fa640 10 client.15777 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.446+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3124679721 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1d5bb8340 con 0x55b1d58588e0 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.446+0000 7f1ac57fa640 10 client.15777 handle_command_reply: tid=0 2024-08-28T19:32:55.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.446+0000 7f1aea689740 1 client.15777 shutdown 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 1 -- 172.21.15.33:0/3124679721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 msgr2=0x55b1d5c4b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c4b320 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800bad0 tx=0x7f1ad800bf90 comp rx=0 tx=0).stop 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 1 -- 172.21.15.33:0/3124679721 shutdown_connections 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5899f60 0x55b1d5c4b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b1d58588e0 0x55b1d5c5d730 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c4b320 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 1 --2- 172.21.15.33:0/3124679721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d58710a0 0x55b1d5c4ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1ac57fa640 0 client.15777 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 1 -- 172.21.15.33:0/3124679721 >> 172.21.15.33:0/3124679721 conn(0x55b1d588e350 msgr2=0x55b1d5c42990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 1 -- 172.21.15.33:0/3124679721 shutdown_connections 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 1 -- 172.21.15.33:0/3124679721 wait complete. 2024-08-28T19:32:55.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.447+0000 7f1aea689740 20 client.15777 trim_cache size 0 max 16384 2024-08-28T19:32:55.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.465+0000 7f1aea689740 1 Processor -- start 2024-08-28T19:32:55.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.465+0000 7f1aea689740 1 -- start start 2024-08-28T19:32:55.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.465+0000 7f1aea689740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d58710a0 0x55b1d5c3d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.465+0000 7f1aea689740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c5b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.465+0000 7f1aea689740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d5899f60 0x55b1d5c49660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.465+0000 7f1aea689740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5c5ba70 con 0x55b1d5879280 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.465+0000 7f1aea689740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5c5c140 con 0x55b1d5899f60 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.465+0000 7f1aea689740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5c5c810 con 0x55b1d58710a0 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae16af640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c5b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae16af640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c5b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57302/0 (socket says 172.21.15.33:57302) 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae16af640 1 -- 172.21.15.33:0/3932645771 learned_addr learned my addr 172.21.15.33:0/3932645771 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3932645771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d58710a0 0x55b1d5c3d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae16af640 1 -- 172.21.15.33:0/3932645771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d58710a0 msgr2=0x55b1d5c3d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3932645771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d5899f60 0x55b1d5c49660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3932645771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d58710a0 0x55b1d5c3d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae16af640 1 -- 172.21.15.33:0/3932645771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d5899f60 msgr2=0x55b1d5c49660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3932645771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d5899f60 0x55b1d5c49660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae16af640 1 -- 172.21.15.33:0/3932645771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1d5c46950 con 0x55b1d5879280 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3932645771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c5b0f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ad801be30 tx=0x7f1ad80114c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc0946d9ba0fa02 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ac77fe640 1 -- 172.21.15.33:0/3932645771 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8000e60 con 0x55b1d5879280 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ac77fe640 1 -- 172.21.15.33:0/3932645771 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ad80054f0 con 0x55b1d5879280 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.466+0000 7f1ac77fe640 1 -- 172.21.15.33:0/3932645771 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8011cc0 con 0x55b1d5879280 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.467+0000 7f1aea689740 1 -- 172.21.15.33:0/3932645771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 msgr2=0x55b1d5c5b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.467+0000 7f1aea689740 1 --2- 172.21.15.33:0/3932645771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c5b0f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ad801be30 tx=0x7f1ad80114c0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.467+0000 7f1aea689740 1 -- 172.21.15.33:0/3932645771 shutdown_connections 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.467+0000 7f1aea689740 1 --2- 172.21.15.33:0/3932645771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d5899f60 0x55b1d5c49660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.467+0000 7f1aea689740 1 --2- 172.21.15.33:0/3932645771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d5879280 0x55b1d5c5b0f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.467+0000 7f1aea689740 1 --2- 172.21.15.33:0/3932645771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d58710a0 0x55b1d5c3d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.467+0000 7f1aea689740 1 -- 172.21.15.33:0/3932645771 >> 172.21.15.33:0/3932645771 conn(0x55b1d588e350 msgr2=0x55b1d5c38400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.467+0000 7f1aea689740 1 -- 172.21.15.33:0/3932645771 shutdown_connections 2024-08-28T19:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.467+0000 7f1aea689740 1 -- 172.21.15.33:0/3932645771 wait complete. 2024-08-28T19:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1aea689740 1 -- start start 2024-08-28T19:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1aea689740 1 Processor -- start 2024-08-28T19:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1aea689740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d58710a0 0x55b1d5c60110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1aea689740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 0x55b1d5c60690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1aea689740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d5899f60 0x55b1d5c64f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1aea689740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5c5d5b0 con 0x55b1d58710a0 2024-08-28T19:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1aea689740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5c5cee0 con 0x55b1d5899f60 2024-08-28T19:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1aea689740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b1d5c5dc80 con 0x55b1d5879280 2024-08-28T19:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1aea689740 10 client.0 _ll_register_callbacks cb 0x7f1ad8004400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1ae26b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d58710a0 0x55b1d5c60110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1ae26b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d58710a0 0x55b1d5c60110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57316/0 (socket says 172.21.15.33:57316) 2024-08-28T19:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.468+0000 7f1ae26b1640 1 -- 172.21.15.33:0/3882921011 learned_addr learned my addr 172.21.15.33:0/3882921011 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 0x55b1d5c60690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ae26b1640 1 -- 172.21.15.33:0/3882921011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 msgr2=0x55b1d5c60690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 0x55b1d5c60690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ae26b1640 1 -- 172.21.15.33:0/3882921011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d5899f60 msgr2=0x55b1d5c64f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d5899f60 0x55b1d5c64f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ae26b1640 1 -- 172.21.15.33:0/3882921011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1d5c65570 con 0x55b1d58710a0 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 0x55b1d5c60690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ae26b1640 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d58710a0 0x55b1d5c60110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4003d10 tx=0x7f1ad4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2514fbec74fcc98 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ac57fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3882921011 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4009b20 con 0x55b1d58710a0 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3882921011 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1ad4003970 con 0x55b1d58710a0 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1aea689740 1 -- 172.21.15.33:0/3882921011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ad80054f0 con 0x55b1d58710a0 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3882921011 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ad4032b80 con 0x55b1d58710a0 2024-08-28T19:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1aea689740 10 client.15783 fetch_fsmap learned FSMap version 28 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1aea689740 1 -- 172.21.15.33:0/3882921011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1d5cc8c00 con 0x55b1d58710a0 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.469+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3882921011 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ad80054f0 con 0x55b1d58710a0 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.470+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3882921011 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1ad4004160 con 0x55b1d58710a0 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.470+0000 7f1aea689740 10 client.15783 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.470+0000 7f1aea689740 10 client.15783 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.470+0000 7f1aea689740 20 client.15783 populate_metadata read hostname 'smithi033' 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.470+0000 7f1aea689740 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b1d582dc90 0x55b1d5ccbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.470+0000 7f1aea689740 4 client.15783 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.470+0000 7f1aea689740 1 -- 172.21.15.33:0/3882921011 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "status"}) -- 0x55b1d5bb3de0 con 0x55b1d582dc90 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.470+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b1d582dc90 0x55b1d5ccbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1ae16af640 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b1d582dc90 0x55b1d5ccbf80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da85c7b99fe3ddc server_cookie=2d7c23892c12128e in_seq=0 out_seq=0 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1ac57fa640 10 client.15783 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1ac57fa640 1 -- 172.21.15.33:0/3882921011 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b1d5bb3de0 con 0x55b1d582dc90 2024-08-28T19:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1ac57fa640 10 client.15783 handle_command_reply: tid=0 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 client.15783 shutdown 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 -- 172.21.15.33:0/3882921011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d58710a0 msgr2=0x55b1d5c60110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d58710a0 0x55b1d5c60110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4003d10 tx=0x7f1ad4009a20 comp rx=0 tx=0).stop 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 -- 172.21.15.33:0/3882921011 shutdown_connections 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1d5899f60 0x55b1d5c64f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b1d5879280 0x55b1d5c60690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b1d582dc90 0x55b1d5ccbf80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 --2- 172.21.15.33:0/3882921011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b1d58710a0 0x55b1d5c60110 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1ac57fa640 0 client.15783 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 -- 172.21.15.33:0/3882921011 >> 172.21.15.33:0/3882921011 conn(0x55b1d588e350 msgr2=0x55b1d5c38400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 -- 172.21.15.33:0/3882921011 shutdown_connections 2024-08-28T19:32:55.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 1 -- 172.21.15.33:0/3882921011 wait complete. 2024-08-28T19:32:55.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.471+0000 7f1aea689740 20 client.15783 trim_cache size 0 max 16384 2024-08-28T19:32:55.482 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:32:55.482 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "9a2fc37c-6572-11ef-bcd4-c7b262605968", 2024-08-28T19:32:55.482 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-08-28T19:32:55.482 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24658, 2024-08-28T19:32:55.482 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-08-28T19:32:55.482 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-08-28T19:32:55.482 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-08-28T19:32:55.482 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 186.37080084600001, 2024-08-28T19:32:55.482 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 28, 2024-08-28T19:32:55.483 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 84, 2024-08-28T19:32:55.483 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 84, 2024-08-28T19:32:55.483 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 206.34314309499999 2024-08-28T19:32:55.483 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:32:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 -- 172.21.15.33:0/3075841246 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ac80b4c10 msgr2=0x7f1ac80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:55.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ac80b4c10 0x7f1ac80b7120 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0e8fd0 tx=0x7f1acc0e8e20 comp rx=0 tx=0).stop 2024-08-28T19:32:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 -- 172.21.15.33:0/3075841246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1adc103900 msgr2=0x7f1adc0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:32:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1adc103900 0x7f1adc0754b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00d770 tx=0x7f1acc00dc30 comp rx=0 tx=0).stop 2024-08-28T19:32:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 -- 172.21.15.33:0/3075841246 shutdown_connections 2024-08-28T19:32:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ac80b4c10 0x7f1ac80b7120 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1adc109b90 0x7f1adc075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc109240 0x7f1adc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 --2- 172.21.15.33:0/3075841246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1adc103900 0x7f1adc0754b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:32:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 -- 172.21.15.33:0/3075841246 >> 172.21.15.33:0/3075841246 conn(0x7f1adc07b5f0 msgr2=0x7f1adc105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:32:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 -- 172.21.15.33:0/3075841246 shutdown_connections 2024-08-28T19:32:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:32:55.472+0000 7f1ae4114640 1 -- 172.21.15.33:0/3075841246 wait complete. 2024-08-28T19:32:56.180 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-08-28T19:32:57.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:56 smithi033 ceph-mon[18549]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:32:57.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:56 smithi059 ceph-mon[22052]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:32:57.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:56 smithi122 ceph-mon[22174]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:32:59.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:32:58 smithi033 ceph-mon[18549]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-28T19:32:59.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:32:58 smithi059 ceph-mon[22052]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-28T19:32:59.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:32:58 smithi122 ceph-mon[22174]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-28T19:33:00.129 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:33:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:33:00.021+0000 7feaf159e640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T19:33:00.130 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:33:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:33:00.021+0000 7feaf159e640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T19:33:00.130 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:33:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:33:00.021+0000 7feaf159e640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T19:33:00.130 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:33:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:33:00.021+0000 7feaf159e640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T19:33:00.130 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:33:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:33:00.021+0000 7feaf159e640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-28T19:33:01.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:00 smithi033 ceph-mon[18549]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-28T19:33:01.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:00 smithi059 ceph-mon[22052]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-28T19:33:01.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:00 smithi122 ceph-mon[22174]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-28T19:33:03.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:02 smithi033 ceph-mon[18549]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-28T19:33:03.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:02 smithi033 ceph-mon[18549]: mgrmap e24: x(active, since 9m), standbys: y, z 2024-08-28T19:33:03.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:02 smithi059 ceph-mon[22052]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-28T19:33:03.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:02 smithi059 ceph-mon[22052]: mgrmap e24: x(active, since 9m), standbys: y, z 2024-08-28T19:33:03.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:02 smithi122 ceph-mon[22174]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-28T19:33:03.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:02 smithi122 ceph-mon[22174]: mgrmap e24: x(active, since 9m), standbys: y, z 2024-08-28T19:33:05.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:04 smithi033 ceph-mon[18549]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-08-28T19:33:05.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:04 smithi059 ceph-mon[22052]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-08-28T19:33:05.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:04 smithi122 ceph-mon[22174]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-08-28T19:33:05.387 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:33:05.655 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:06.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.164+0000 7ffbaed91640 1 -- 172.21.15.33:0/2529009652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffba8106060 msgr2=0x7ffba8106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.164+0000 7ffbaed91640 1 --2- 172.21.15.33:0/2529009652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffba8106060 0x7ffba8106470 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009900 tx=0x7ffb9402a410 comp rx=0 tx=0).stop 2024-08-28T19:33:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.164+0000 7ffbaed91640 1 -- 172.21.15.33:0/2529009652 shutdown_connections 2024-08-28T19:33:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.164+0000 7ffbaed91640 1 --2- 172.21.15.33:0/2529009652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffba81069b0 0x7ffba8110440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.164+0000 7ffbaed91640 1 --2- 172.21.15.33:0/2529009652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffba8106060 0x7ffba8106470 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.164+0000 7ffbaed91640 1 --2- 172.21.15.33:0/2529009652 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba8101e10 0x7ffba8102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.164+0000 7ffbaed91640 1 -- 172.21.15.33:0/2529009652 >> 172.21.15.33:0/2529009652 conn(0x7ffba8079bb0 msgr2=0x7ffba8079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.164+0000 7ffbaed91640 1 -- 172.21.15.33:0/2529009652 shutdown_connections 2024-08-28T19:33:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.164+0000 7ffbaed91640 1 -- 172.21.15.33:0/2529009652 wait complete. 2024-08-28T19:33:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.165+0000 7ffbaed91640 1 Processor -- start 2024-08-28T19:33:06.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.165+0000 7ffbaed91640 1 -- start start 2024-08-28T19:33:06.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.165+0000 7ffbaed91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffba8101e10 0x7ffba819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.165+0000 7ffbaed91640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffba8106060 0x7ffba819a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.165+0000 7ffbaed91640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba81069b0 0x7ffba819fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.165+0000 7ffbaed91640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffba81138d0 con 0x7ffba8106060 2024-08-28T19:33:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.165+0000 7ffbaed91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffba8113750 con 0x7ffba8101e10 2024-08-28T19:33:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.165+0000 7ffbaed91640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffba8113a50 con 0x7ffba81069b0 2024-08-28T19:33:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffba7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffba8106060 0x7ffba819a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffba7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffba8106060 0x7ffba819a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38452/0 (socket says 172.21.15.33:38452) 2024-08-28T19:33:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffba7fff640 1 -- 172.21.15.33:0/3006857059 learned_addr learned my addr 172.21.15.33:0/3006857059 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffbacb2d640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffba8101e10 0x7ffba819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffbad32e640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba81069b0 0x7ffba819fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffba7fff640 1 -- 172.21.15.33:0/3006857059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba81069b0 msgr2=0x7ffba819fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffba7fff640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba81069b0 0x7ffba819fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffba7fff640 1 -- 172.21.15.33:0/3006857059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffba8101e10 msgr2=0x7ffba819a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffba7fff640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffba8101e10 0x7ffba819a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffba7fff640 1 -- 172.21.15.33:0/3006857059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba81a0230 con 0x7ffba8106060 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.166+0000 7ffba7fff640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffba8106060 0x7ffba819a860 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ffb9402a930 tx=0x7ffb94003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.167+0000 7ffbad32e640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba81069b0 0x7ffba819fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.167+0000 7ffba5ffb640 1 -- 172.21.15.33:0/3006857059 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9403f070 con 0x7ffba8106060 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.167+0000 7ffba5ffb640 1 -- 172.21.15.33:0/3006857059 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb9403bd20 con 0x7ffba8106060 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.167+0000 7ffbaed91640 1 -- 172.21.15.33:0/3006857059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba81a04c0 con 0x7ffba8106060 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.167+0000 7ffba5ffb640 1 -- 172.21.15.33:0/3006857059 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94035030 con 0x7ffba8106060 2024-08-28T19:33:06.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.167+0000 7ffbaed91640 1 -- 172.21.15.33:0/3006857059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba8102c90 con 0x7ffba8106060 2024-08-28T19:33:06.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.171+0000 7ffba5ffb640 1 -- 172.21.15.33:0/3006857059 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ffb94042070 con 0x7ffba8106060 2024-08-28T19:33:06.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.171+0000 7ffbb5306740 1 Processor -- start 2024-08-28T19:33:06.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.171+0000 7ffbb5306740 1 -- start start 2024-08-28T19:33:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.171+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9156070 0x5591e94fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.171+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e94fb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.171+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9135390 0x5591e94fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.171+0000 7ffbb5306740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5591e9472630 con 0x5591e912d1b0 2024-08-28T19:33:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.171+0000 7ffbb5306740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5591e9461bc0 con 0x5591e9156070 2024-08-28T19:33:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.171+0000 7ffbb5306740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5591e9465b70 con 0x5591e9135390 2024-08-28T19:33:06.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffbacb2d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e94fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffbacb2d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e94fb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38468/0 (socket says 172.21.15.33:38468) 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffbacb2d640 1 -- 172.21.15.33:0/2278149280 learned_addr learned my addr 172.21.15.33:0/2278149280 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffba5ffb640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb980b4d20 0x7ffb980b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffbad32e640 1 --2- 172.21.15.33:0/2278149280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9156070 0x5591e94fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffbad32e640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb980b4d20 0x7ffb980b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffba5ffb640 1 -- 172.21.15.33:0/3006857059 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ffb94105fa0 con 0x7ffba8106060 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffbacb2d640 1 -- 172.21.15.33:0/2278149280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9135390 msgr2=0x5591e94fbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffba7fff640 1 --2- 172.21.15.33:0/2278149280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9135390 0x5591e94fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffbacb2d640 1 --2- 172.21.15.33:0/2278149280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9135390 0x5591e94fbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffbacb2d640 1 -- 172.21.15.33:0/2278149280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9156070 msgr2=0x5591e94fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffbacb2d640 1 --2- 172.21.15.33:0/2278149280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9156070 0x5591e94fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffbacb2d640 1 -- 172.21.15.33:0/2278149280 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e91c1650 con 0x5591e912d1b0 2024-08-28T19:33:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.172+0000 7ffba7fff640 1 --2- 172.21.15.33:0/2278149280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9135390 0x5591e94fbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:33:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.173+0000 7ffbacb2d640 1 --2- 172.21.15.33:0/2278149280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e94fb800 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00bcb0 tx=0x7ffb9c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e156b1ef0020755d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.173+0000 7ffbad32e640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb980b4d20 0x7ffb980b7230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009370 tx=0x7ffba00097e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.173+0000 7ffb92ffd640 1 -- 172.21.15.33:0/2278149280 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c01c480 con 0x5591e912d1b0 2024-08-28T19:33:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.173+0000 7ffb92ffd640 1 -- 172.21.15.33:0/2278149280 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb9c01cad0 con 0x5591e912d1b0 2024-08-28T19:33:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.173+0000 7ffb92ffd640 1 -- 172.21.15.33:0/2278149280 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c011b20 con 0x5591e912d1b0 2024-08-28T19:33:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.174+0000 7ffbb5306740 1 -- 172.21.15.33:0/2278149280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 msgr2=0x5591e94fb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.174+0000 7ffbb5306740 1 --2- 172.21.15.33:0/2278149280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e94fb800 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00bcb0 tx=0x7ffb9c0107a0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.174+0000 7ffbb5306740 1 -- 172.21.15.33:0/2278149280 shutdown_connections 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.174+0000 7ffbb5306740 1 --2- 172.21.15.33:0/2278149280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9135390 0x5591e94fbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.174+0000 7ffbb5306740 1 --2- 172.21.15.33:0/2278149280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e94fb800 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.174+0000 7ffbb5306740 1 --2- 172.21.15.33:0/2278149280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9156070 0x5591e94fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.174+0000 7ffbb5306740 1 -- 172.21.15.33:0/2278149280 >> 172.21.15.33:0/2278149280 conn(0x5591e914a460 msgr2=0x5591e94f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.174+0000 7ffbb5306740 1 -- 172.21.15.33:0/2278149280 shutdown_connections 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.175+0000 7ffbb5306740 1 -- 172.21.15.33:0/2278149280 wait complete. 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.175+0000 7ffbb5306740 1 -- start start 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.175+0000 7ffbb5306740 1 Processor -- start 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.176+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e912d1b0 0x5591e9506a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.176+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 0x5591e9506f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.176+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9156070 0x5591e9512dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.176+0000 7ffbb5306740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5591e92c4700 con 0x5591e9156070 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffbb5306740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5591e93e8700 con 0x5591e9135390 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffbb5306740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5591e9509aa0 con 0x5591e912d1b0 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffbad32e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9156070 0x5591e9512dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffba7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 0x5591e9506f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffba7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 0x5591e9506f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:54700/0 (socket says 172.21.15.33:54700) 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffba7fff640 1 -- 172.21.15.33:0/2457383701 learned_addr learned my addr 172.21.15.33:0/2457383701 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffbb5306740 10 client.0 _ll_register_callbacks cb 0x5591e9417dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffba7fff640 1 -- 172.21.15.33:0/2457383701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e912d1b0 msgr2=0x5591e9506a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffba7fff640 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e912d1b0 0x5591e9506a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffba7fff640 1 -- 172.21.15.33:0/2457383701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9156070 msgr2=0x5591e9512dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:06.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffba7fff640 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9156070 0x5591e9512dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffba7fff640 1 -- 172.21.15.33:0/2457383701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e94218b0 con 0x5591e9135390 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.177+0000 7ffbad32e640 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9156070 0x5591e9512dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.178+0000 7ffba7fff640 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 0x5591e9506f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffb940c95b0 tx=0x7ffb94009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dd57cdfde9d1901 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.178+0000 7ffb87fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.178+0000 7ffb87fff640 1 -- 172.21.15.33:0/2457383701 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94049030 con 0x5591e9135390 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.178+0000 7ffbb5306740 1 -- 172.21.15.33:0/2457383701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb9c01cad0 con 0x5591e9135390 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.178+0000 7ffb87fff640 1 -- 172.21.15.33:0/2457383701 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ffb940314c0 con 0x5591e9135390 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.178+0000 7ffb87fff640 1 -- 172.21.15.33:0/2457383701 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb940cbab0 con 0x5591e9135390 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.178+0000 7ffbb5306740 10 client.25388 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.178+0000 7ffbb5306740 1 -- 172.21.15.33:0/2457383701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5591e95157b0 con 0x5591e9135390 2024-08-28T19:33:06.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.178+0000 7ffb87fff640 1 -- 172.21.15.33:0/2457383701 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb9c01cad0 con 0x5591e9135390 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.179+0000 7ffb87fff640 1 -- 172.21.15.33:0/2457383701 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ffb940b5b70 con 0x5591e9135390 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.179+0000 7ffbb5306740 10 client.25388 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.179+0000 7ffbb5306740 10 client.25388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.179+0000 7ffbb5306740 20 client.25388 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.179+0000 7ffbb5306740 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5591e91149f0 0x5591e9518c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.179+0000 7ffbb5306740 4 client.25388 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.179+0000 7ffbb5306740 1 -- 172.21.15.33:0/2457383701 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591e9474580 con 0x5591e91149f0 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.179+0000 7ffbacb2d640 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5591e91149f0 0x5591e9518c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.180+0000 7ffbacb2d640 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5591e91149f0 0x5591e9518c50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d218fdef852e5dba server_cookie=b5fbdbd77c4f9aa7 in_seq=0 out_seq=0 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.180+0000 7ffb87fff640 10 client.25388 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.180+0000 7ffb87fff640 1 -- 172.21.15.33:0/2457383701 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5591e9474580 con 0x5591e91149f0 2024-08-28T19:33:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffb87fff640 10 client.25388 handle_command_reply: tid=0 2024-08-28T19:33:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 client.25388 shutdown 2024-08-28T19:33:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 -- 172.21.15.33:0/2457383701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 msgr2=0x5591e9506f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 0x5591e9506f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffb940c95b0 tx=0x7ffb94009560 comp rx=0 tx=0).stop 2024-08-28T19:33:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 -- 172.21.15.33:0/2457383701 shutdown_connections 2024-08-28T19:33:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5591e91149f0 0x5591e9518c50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9156070 0x5591e9512dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 0x5591e9506f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 --2- 172.21.15.33:0/2457383701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e912d1b0 0x5591e9506a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 -- 172.21.15.33:0/2457383701 >> 172.21.15.33:0/2457383701 conn(0x5591e914a460 msgr2=0x5591e94fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffb87fff640 0 client.25388 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 -- 172.21.15.33:0/2457383701 shutdown_connections 2024-08-28T19:33:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 1 -- 172.21.15.33:0/2457383701 wait complete. 2024-08-28T19:33:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.181+0000 7ffbb5306740 20 client.25388 trim_cache size 0 max 16384 2024-08-28T19:33:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffbb5306740 1 Processor -- start 2024-08-28T19:33:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffbb5306740 1 -- start start 2024-08-28T19:33:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e912d1b0 0x5591e94f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9135390 0x5591e94fe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 0x5591e94fe900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffbb5306740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffba81b2cf0 con 0x5591e9135390 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffbb5306740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffba81b4830 con 0x5591e912d1b0 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffbb5306740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffba81b33c0 con 0x5591e9156070 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffba7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9135390 0x5591e94fe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffba7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9135390 0x5591e94fe3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38492/0 (socket says 172.21.15.33:38492) 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.220+0000 7ffba7fff640 1 -- 172.21.15.33:0/3473117283 learned_addr learned my addr 172.21.15.33:0/3473117283 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffbacb2d640 1 --2- 172.21.15.33:0/3473117283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e912d1b0 0x5591e94f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffbad32e640 1 --2- 172.21.15.33:0/3473117283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 0x5591e94fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffba7fff640 1 -- 172.21.15.33:0/3473117283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 msgr2=0x5591e94fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffba7fff640 1 --2- 172.21.15.33:0/3473117283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 0x5591e94fe900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffba7fff640 1 -- 172.21.15.33:0/3473117283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e912d1b0 msgr2=0x5591e94f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffba7fff640 1 --2- 172.21.15.33:0/3473117283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e912d1b0 0x5591e94f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffba7fff640 1 -- 172.21.15.33:0/3473117283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e94f9aa0 con 0x5591e9135390 2024-08-28T19:33:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffba7fff640 1 --2- 172.21.15.33:0/3473117283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9135390 0x5591e94fe3c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ffb94103450 tx=0x7ffb94031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cec08b024af4107 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffb927fc640 1 -- 172.21.15.33:0/3473117283 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94049070 con 0x5591e9135390 2024-08-28T19:33:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffb927fc640 1 -- 172.21.15.33:0/3473117283 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb940cca40 con 0x5591e9135390 2024-08-28T19:33:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.221+0000 7ffb927fc640 1 -- 172.21.15.33:0/3473117283 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb940314c0 con 0x5591e9135390 2024-08-28T19:33:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.223+0000 7ffbb5306740 1 -- 172.21.15.33:0/3473117283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9135390 msgr2=0x5591e94fe3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.223+0000 7ffbb5306740 1 --2- 172.21.15.33:0/3473117283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9135390 0x5591e94fe3c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ffb94103450 tx=0x7ffb94031430 comp rx=0 tx=0).stop 2024-08-28T19:33:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.223+0000 7ffbb5306740 1 -- 172.21.15.33:0/3473117283 shutdown_connections 2024-08-28T19:33:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.223+0000 7ffbb5306740 1 --2- 172.21.15.33:0/3473117283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 0x5591e94fe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.223+0000 7ffbb5306740 1 --2- 172.21.15.33:0/3473117283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e9135390 0x5591e94fe3c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.223+0000 7ffbb5306740 1 --2- 172.21.15.33:0/3473117283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e912d1b0 0x5591e94f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.223+0000 7ffbb5306740 1 -- 172.21.15.33:0/3473117283 >> 172.21.15.33:0/3473117283 conn(0x5591e914a460 msgr2=0x5591e95052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.223+0000 7ffbb5306740 1 -- 172.21.15.33:0/3473117283 shutdown_connections 2024-08-28T19:33:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.223+0000 7ffbb5306740 1 -- 172.21.15.33:0/3473117283 wait complete. 2024-08-28T19:33:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.223+0000 7ffbb5306740 1 -- start start 2024-08-28T19:33:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.224+0000 7ffbb5306740 1 Processor -- start 2024-08-28T19:33:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.224+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e950afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.224+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 0x5591e950b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.224+0000 7ffbb5306740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 0x5591e958ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.224+0000 7ffbb5306740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffba81b4160 con 0x5591e912d1b0 2024-08-28T19:33:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.224+0000 7ffbb5306740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffba81b3a90 con 0x5591e9135390 2024-08-28T19:33:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.224+0000 7ffbb5306740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffba81b0cd0 con 0x5591e9156070 2024-08-28T19:33:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.224+0000 7ffbb5306740 10 client.0 _ll_register_callbacks cb 0x7ffb94005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.224+0000 7ffbacb2d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e950afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.224+0000 7ffbacb2d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e950afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38498/0 (socket says 172.21.15.33:38498) 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffbacb2d640 1 -- 172.21.15.33:0/758311144 learned_addr learned my addr 172.21.15.33:0/758311144 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffba7fff640 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 0x5591e950b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffbad32e640 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 0x5591e958ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffbacb2d640 1 -- 172.21.15.33:0/758311144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 msgr2=0x5591e958ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffbacb2d640 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 0x5591e958ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffbacb2d640 1 -- 172.21.15.33:0/758311144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 msgr2=0x5591e950b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffbacb2d640 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 0x5591e950b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffbacb2d640 1 -- 172.21.15.33:0/758311144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e950bd40 con 0x5591e912d1b0 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffbad32e640 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 0x5591e958ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffbacb2d640 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e950afe0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c011790 tx=0x7ffb9c010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f7ce1d941e16f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffb87fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.225+0000 7ffb87fff640 1 -- 172.21.15.33:0/758311144 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c032020 con 0x5591e912d1b0 2024-08-28T19:33:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.226+0000 7ffb87fff640 1 -- 172.21.15.33:0/758311144 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ffb9c005040 con 0x5591e912d1b0 2024-08-28T19:33:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.226+0000 7ffbb5306740 1 -- 172.21.15.33:0/758311144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb940cca40 con 0x5591e912d1b0 2024-08-28T19:33:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.226+0000 7ffb87fff640 1 -- 172.21.15.33:0/758311144 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb9c03a050 con 0x5591e912d1b0 2024-08-28T19:33:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.226+0000 7ffbb5306740 10 client.15807 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.226+0000 7ffbb5306740 1 -- 172.21.15.33:0/758311144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5591e958c340 con 0x5591e912d1b0 2024-08-28T19:33:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.226+0000 7ffb87fff640 1 -- 172.21.15.33:0/758311144 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb940cca40 con 0x5591e912d1b0 2024-08-28T19:33:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.227+0000 7ffb87fff640 1 -- 172.21.15.33:0/758311144 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ffb9c011cb0 con 0x5591e912d1b0 2024-08-28T19:33:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.227+0000 7ffbb5306740 10 client.15807 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.227+0000 7ffbb5306740 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:33:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.227+0000 7ffbb5306740 20 client.15807 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.227+0000 7ffbb5306740 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5591e90e9da0 0x5591e958e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.227+0000 7ffbb5306740 4 client.15807 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:33:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.227+0000 7ffbb5306740 1 -- 172.21.15.33:0/758311144 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5591e9470020 con 0x5591e90e9da0 2024-08-28T19:33:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.227+0000 7ffba7fff640 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5591e90e9da0 0x5591e958e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffb87fff640 10 client.15807 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffba7fff640 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5591e90e9da0 0x5591e958e820 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=492a8474e8137a78 server_cookie=f8078a0e0dd6e299 in_seq=0 out_seq=0 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffb87fff640 1 -- 172.21.15.33:0/758311144 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x5591e9470020 con 0x5591e90e9da0 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffb87fff640 10 client.15807 handle_command_reply: tid=0 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 client.15807 shutdown 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 -- 172.21.15.33:0/758311144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 msgr2=0x5591e950afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e950afe0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c011790 tx=0x7ffb9c010fd0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 -- 172.21.15.33:0/758311144 shutdown_connections 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5591e9156070 0x5591e958ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591e9135390 0x5591e950b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5591e90e9da0 0x5591e958e820 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 --2- 172.21.15.33:0/758311144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5591e912d1b0 0x5591e950afe0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffb87fff640 0 client.15807 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 -- 172.21.15.33:0/758311144 >> 172.21.15.33:0/758311144 conn(0x5591e914a460 msgr2=0x5591e94fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 -- 172.21.15.33:0/758311144 shutdown_connections 2024-08-28T19:33:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.228+0000 7ffbb5306740 1 -- 172.21.15.33:0/758311144 wait complete. 2024-08-28T19:33:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.229+0000 7ffbb5306740 20 client.15807 trim_cache size 0 max 16384 2024-08-28T19:33:06.234 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:33:06.234 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:06.235 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:33:06.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.229+0000 7ffbaed91640 1 -- 172.21.15.33:0/3006857059 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb980b4d20 msgr2=0x7ffb980b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:06.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.229+0000 7ffbaed91640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb980b4d20 0x7ffb980b7230 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009370 tx=0x7ffba00097e0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.229+0000 7ffbaed91640 1 -- 172.21.15.33:0/3006857059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffba8106060 msgr2=0x7ffba819a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:06.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.229+0000 7ffbaed91640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffba8106060 0x7ffba819a860 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ffb9402a930 tx=0x7ffb94003c20 comp rx=0 tx=0).stop 2024-08-28T19:33:06.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.229+0000 7ffbaed91640 1 -- 172.21.15.33:0/3006857059 shutdown_connections 2024-08-28T19:33:06.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.229+0000 7ffbaed91640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb980b4d20 0x7ffb980b7230 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.229+0000 7ffbaed91640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffba81069b0 0x7ffba819fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.229+0000 7ffbaed91640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffba8106060 0x7ffba819a860 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.229+0000 7ffbaed91640 1 --2- 172.21.15.33:0/3006857059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffba8101e10 0x7ffba819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:06.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.230+0000 7ffbaed91640 1 -- 172.21.15.33:0/3006857059 >> 172.21.15.33:0/3006857059 conn(0x7ffba8079bb0 msgr2=0x7ffba81072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:06.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.230+0000 7ffbaed91640 1 -- 172.21.15.33:0/3006857059 shutdown_connections 2024-08-28T19:33:06.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:06.230+0000 7ffbaed91640 1 -- 172.21.15.33:0/3006857059 wait complete. 2024-08-28T19:33:07.065 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:06 smithi033 ceph-mon[18549]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-28T19:33:07.067 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:33:07.067 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:33:07.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:06 smithi059 ceph-mon[22052]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-28T19:33:07.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:06 smithi122 ceph-mon[22174]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-28T19:33:07.334 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:07.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.845+0000 7f24b7238640 1 -- 172.21.15.33:0/123037229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b0109250 msgr2=0x7f24b0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:07.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.845+0000 7f24b7238640 1 --2- 172.21.15.33:0/123037229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b0109250 0x7f24b0109660 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f249c009900 tx=0x7f249c02a410 comp rx=0 tx=0).stop 2024-08-28T19:33:07.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.845+0000 7f24b7238640 1 -- 172.21.15.33:0/123037229 shutdown_connections 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.845+0000 7f24b7238640 1 --2- 172.21.15.33:0/123037229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b0109ba0 0x7f24b01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.845+0000 7f24b7238640 1 --2- 172.21.15.33:0/123037229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b0109250 0x7f24b0109660 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.845+0000 7f24b7238640 1 --2- 172.21.15.33:0/123037229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24b0101d10 0x7f24b0102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.845+0000 7f24b7238640 1 -- 172.21.15.33:0/123037229 >> 172.21.15.33:0/123037229 conn(0x7f24b0077a00 msgr2=0x7f24b0077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.845+0000 7f24b7238640 1 -- 172.21.15.33:0/123037229 shutdown_connections 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.845+0000 7f24b7238640 1 -- 172.21.15.33:0/123037229 wait complete. 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.845+0000 7f24b7238640 1 Processor -- start 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b7238640 1 -- start start 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b7238640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b0101d10 0x7f24b0102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b7238640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24b0109250 0x7f24b01031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b7238640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b0109ba0 0x7f24b0103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b7238640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0113860 con 0x7f24b0101d10 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b7238640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01136e0 con 0x7f24b0109ba0 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b7238640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f24b01139e0 con 0x7f24b0109250 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b4fd4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b0101d10 0x7f24b0102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b4fd4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b0101d10 0x7f24b0102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38518/0 (socket says 172.21.15.33:38518) 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b4fd4640 1 -- 172.21.15.33:0/2802302457 learned_addr learned my addr 172.21.15.33:0/2802302457 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24affff640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24b0109250 0x7f24b01031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b57d5640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b0109ba0 0x7f24b0103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b4fd4640 1 -- 172.21.15.33:0/2802302457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24b0109250 msgr2=0x7f24b01031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b4fd4640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24b0109250 0x7f24b01031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b4fd4640 1 -- 172.21.15.33:0/2802302457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b0109ba0 msgr2=0x7f24b0103730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b4fd4640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b0109ba0 0x7f24b0103730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:07.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.846+0000 7f24b4fd4640 1 -- 172.21.15.33:0/2802302457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b01a84f0 con 0x7f24b0101d10 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.847+0000 7f24b4fd4640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b0101d10 0x7f24b0102cb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f24a400d950 tx=0x7f24a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.847+0000 7f24adffb640 1 -- 172.21.15.33:0/2802302457 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4017070 con 0x7f24b0101d10 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.847+0000 7f24b7238640 1 -- 172.21.15.33:0/2802302457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b01a87e0 con 0x7f24b0101d10 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.847+0000 7f24adffb640 1 -- 172.21.15.33:0/2802302457 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a4009c30 con 0x7f24b0101d10 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.847+0000 7f24adffb640 1 -- 172.21.15.33:0/2802302457 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a400f620 con 0x7f24b0101d10 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.847+0000 7f24b7238640 1 -- 172.21.15.33:0/2802302457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b01a8cf0 con 0x7f24b0101d10 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.848+0000 7f24b7238640 1 -- 172.21.15.33:0/2802302457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b0102120 con 0x7f24b0101d10 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.850+0000 7f24adffb640 1 -- 172.21.15.33:0/2802302457 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f24a4010460 con 0x7f24b0101d10 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.850+0000 7f24adffb640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24a00b4ca0 0x7f24a00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.851+0000 7f24affff640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24a00b4ca0 0x7f24a00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.851+0000 7f24adffb640 1 -- 172.21.15.33:0/2802302457 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f24a40e5420 con 0x7f24b0101d10 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.851+0000 7f24affff640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24a00b4ca0 0x7f24a00b71b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f249c009230 tx=0x7f249c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:07.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:07.854+0000 7f24adffb640 1 -- 172.21.15.33:0/2802302457 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f24a4009de0 con 0x7f24b0101d10 2024-08-28T19:33:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.089+0000 7f24b7238640 1 -- 172.21.15.33:0/2802302457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24b002e430 con 0x7f24b0101d10 2024-08-28T19:33:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.090+0000 7f24adffb640 1 -- 172.21.15.33:0/2802302457 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f24a40b4400 con 0x7f24b0101d10 2024-08-28T19:33:08.091 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:33:08.091 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:33:08.092 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:33:08.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 -- 172.21.15.33:0/2802302457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24a00b4ca0 msgr2=0x7f24a00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:08.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24a00b4ca0 0x7f24a00b71b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f249c009230 tx=0x7f249c031400 comp rx=0 tx=0).stop 2024-08-28T19:33:08.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 -- 172.21.15.33:0/2802302457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b0101d10 msgr2=0x7f24b0102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:08.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b0101d10 0x7f24b0102cb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f24a400d950 tx=0x7f24a400de10 comp rx=0 tx=0).stop 2024-08-28T19:33:08.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 -- 172.21.15.33:0/2802302457 shutdown_connections 2024-08-28T19:33:08.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b0109ba0 0x7f24b0103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:08.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24a00b4ca0 0x7f24a00b71b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:08.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24b0109250 0x7f24b01031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:08.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 --2- 172.21.15.33:0/2802302457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b0101d10 0x7f24b0102cb0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:08.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 -- 172.21.15.33:0/2802302457 >> 172.21.15.33:0/2802302457 conn(0x7f24b0077a00 msgr2=0x7f24b01052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:08.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 -- 172.21.15.33:0/2802302457 shutdown_connections 2024-08-28T19:33:08.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:08.093+0000 7f24b7238640 1 -- 172.21.15.33:0/2802302457 wait complete. 2024-08-28T19:33:08.727 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:33:08.997 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:09.119 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:08 smithi033 ceph-mon[18549]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-08-28T19:33:09.119 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:08 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2802302457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:09.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:08 smithi059 ceph-mon[22052]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-08-28T19:33:09.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:08 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2802302457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:09.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:08 smithi122 ceph-mon[22174]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-08-28T19:33:09.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:08 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2802302457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.521+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/74775397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3eb0109260 msgr2=0x7f3eb0109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.521+0000 7f3eb7f3c640 1 --2- 172.21.15.33:0/74775397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3eb0109260 0x7f3eb0109670 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009900 tx=0x7f3ea002a410 comp rx=0 tx=0).stop 2024-08-28T19:33:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.521+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/74775397 shutdown_connections 2024-08-28T19:33:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.521+0000 7f3eb7f3c640 1 --2- 172.21.15.33:0/74775397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3eb0109bb0 0x7f3eb01103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.521+0000 7f3eb7f3c640 1 --2- 172.21.15.33:0/74775397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3eb0109260 0x7f3eb0109670 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.521+0000 7f3eb7f3c640 1 --2- 172.21.15.33:0/74775397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3eb0103920 0x7f3eb0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.521+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/74775397 >> 172.21.15.33:0/74775397 conn(0x7f3eb00ff350 msgr2=0x7f3eb01017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.521+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/74775397 shutdown_connections 2024-08-28T19:33:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.521+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/74775397 wait complete. 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb7f3c640 1 Processor -- start 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb7f3c640 1 -- start start 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb7f3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3eb0103920 0x7f3eb019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb7f3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3eb0109260 0x7f3eb019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb7f3c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3eb0109bb0 0x7f3eb019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb7f3c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb0113870 con 0x7f3eb0109bb0 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb7f3c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb01136f0 con 0x7f3eb0109260 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb7f3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb01139f0 con 0x7f3eb0103920 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb64d9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3eb0109bb0 0x7f3eb019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb64d9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3eb0109bb0 0x7f3eb019fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42824/0 (socket says 172.21.15.33:42824) 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb64d9640 1 -- 172.21.15.33:0/926072007 learned_addr learned my addr 172.21.15.33:0/926072007 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3eb0103920 0x7f3eb019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3eb0109260 0x7f3eb019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb64d9640 1 -- 172.21.15.33:0/926072007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3eb0103920 msgr2=0x7f3eb019a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb64d9640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3eb0103920 0x7f3eb019a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb64d9640 1 -- 172.21.15.33:0/926072007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3eb0109260 msgr2=0x7f3eb019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb64d9640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3eb0109260 0x7f3eb019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb64d9640 1 -- 172.21.15.33:0/926072007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb01a0170 con 0x7f3eb0109bb0 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.522+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3eb0109260 0x7f3eb019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.523+0000 7f3eb64d9640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3eb0109bb0 0x7f3eb019fa40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800eaa0 tx=0x7f3ea800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.523+0000 7f3ea6ffd640 1 -- 172.21.15.33:0/926072007 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800cdb0 con 0x7f3eb0109bb0 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.523+0000 7f3ea6ffd640 1 -- 172.21.15.33:0/926072007 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ea8005020 con 0x7f3eb0109bb0 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.523+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/926072007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb01a0460 con 0x7f3eb0109bb0 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.523+0000 7f3ea6ffd640 1 -- 172.21.15.33:0/926072007 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80116d0 con 0x7f3eb0109bb0 2024-08-28T19:33:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.523+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/926072007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb01a6bc0 con 0x7f3eb0109bb0 2024-08-28T19:33:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.526+0000 7f3ebe4b1740 1 Processor -- start 2024-08-28T19:33:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.526+0000 7f3ea6ffd640 1 -- 172.21.15.33:0/926072007 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3ea80051d0 con 0x7f3eb0109bb0 2024-08-28T19:33:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.526+0000 7f3ebe4b1740 1 -- start start 2024-08-28T19:33:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.526+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7392a2070 0x55b739647310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.526+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392791b0 0x55b739647850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.526+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b739281390 0x55b739647d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.526+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b7395be680 con 0x55b739281390 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.526+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b7395adc10 con 0x55b7392791b0 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.526+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b7395b1bc0 con 0x55b7392a2070 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb54d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b739281390 0x55b739647d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb54d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b739281390 0x55b739647d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42836/0 (socket says 172.21.15.33:42836) 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb54d7640 1 -- 172.21.15.33:0/450581294 learned_addr learned my addr 172.21.15.33:0/450581294 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/450581294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7392a2070 0x55b739647310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/450581294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392791b0 0x55b739647850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3ea6ffd640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e9c0b4ca0 0x7f3e9c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb54d7640 1 -- 172.21.15.33:0/450581294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7392a2070 msgr2=0x55b739647310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/450581294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7392a2070 0x55b739647310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb54d7640 1 -- 172.21.15.33:0/450581294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392791b0 msgr2=0x55b739647850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/450581294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392791b0 0x55b739647850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb54d7640 1 -- 172.21.15.33:0/450581294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b73930d650 con 0x55b739281390 2024-08-28T19:33:09.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb64d9640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e9c0b4ca0 0x7f3e9c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3ea6ffd640 1 -- 172.21.15.33:0/926072007 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3ea80e5a30 con 0x7f3eb0109bb0 2024-08-28T19:33:09.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.527+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/450581294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b739281390 0x55b739647d90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3ea00057c0 tx=0x7f3ea0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40781ea39a67ce7d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:09.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.528+0000 7f3e9bfff640 1 -- 172.21.15.33:0/450581294 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0035040 con 0x55b739281390 2024-08-28T19:33:09.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.528+0000 7f3eb64d9640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e9c0b4ca0 0x7f3e9c0b71b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80e2e90 tx=0x7f3ea80e5d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:09.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.528+0000 7f3e9bfff640 1 -- 172.21.15.33:0/450581294 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ea00035f0 con 0x55b739281390 2024-08-28T19:33:09.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.528+0000 7f3e9bfff640 1 -- 172.21.15.33:0/450581294 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea00044e0 con 0x55b739281390 2024-08-28T19:33:09.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.529+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/450581294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b739281390 msgr2=0x55b739647d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.529+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/450581294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b739281390 0x55b739647d90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3ea00057c0 tx=0x7f3ea0000bc0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.529+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/450581294 shutdown_connections 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.529+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/450581294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b739281390 0x55b739647d90 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.529+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/450581294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392791b0 0x55b739647850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.529+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/450581294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7392a2070 0x55b739647310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.529+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/450581294 >> 172.21.15.33:0/450581294 conn(0x55b739296460 msgr2=0x55b739645200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.529+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/450581294 shutdown_connections 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.529+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/450581294 wait complete. 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.529+0000 7f3ebe4b1740 1 -- start start 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3ebe4b1740 1 Processor -- start 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392791b0 0x55b739652a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 0x55b739652f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392a2070 0x55b73965edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b739410700 con 0x55b7392a2070 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b739534750 con 0x55b7392791b0 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b739655a90 con 0x55b739281390 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3ebe4b1740 10 client.0 _ll_register_callbacks cb 0x55b739563e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3eb54d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392a2070 0x55b73965edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3eb54d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392a2070 0x55b73965edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42846/0 (socket says 172.21.15.33:42846) 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3eb54d7640 1 -- 172.21.15.33:0/2731323833 learned_addr learned my addr 172.21.15.33:0/2731323833 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 0x55b739652f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.530+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392791b0 0x55b739652a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3eb54d7640 1 -- 172.21.15.33:0/2731323833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 msgr2=0x55b739652f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 0x55b739652f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3eb54d7640 1 -- 172.21.15.33:0/2731323833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392791b0 msgr2=0x55b739652a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392791b0 0x55b739652a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3eb54d7640 1 -- 172.21.15.33:0/2731323833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b73956d900 con 0x55b7392a2070 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 0x55b739652f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392a2070 0x55b73965edb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0006010 tx=0x7f3ea0003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ef9ad0677cc228 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3e997fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3e997fa640 1 -- 172.21.15.33:0/2731323833 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0000e60 con 0x55b7392a2070 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3e997fa640 1 -- 172.21.15.33:0/2731323833 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3ea00041e0 con 0x55b7392a2070 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2731323833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ea00035f0 con 0x55b7392a2070 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3e997fa640 1 -- 172.21.15.33:0/2731323833 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ea0035030 con 0x55b7392a2070 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3ebe4b1740 10 client.15825 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.531+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2731323833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b739661850 con 0x55b7392a2070 2024-08-28T19:33:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.532+0000 7f3e997fa640 1 -- 172.21.15.33:0/2731323833 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ea00035f0 con 0x55b7392a2070 2024-08-28T19:33:09.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.532+0000 7f3e997fa640 1 -- 172.21.15.33:0/2731323833 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3ea003a040 con 0x55b7392a2070 2024-08-28T19:33:09.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.532+0000 7f3ebe4b1740 10 client.15825 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:09.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.532+0000 7f3ebe4b1740 10 client.15825 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:33:09.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.532+0000 7f3ebe4b1740 20 client.15825 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:09.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.532+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b7392609f0 0x55b739664bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.532+0000 7f3ebe4b1740 4 client.15825 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:09.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.532+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2731323833 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7395c05d0 con 0x55b7392609f0 2024-08-28T19:33:09.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.532+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b7392609f0 0x55b739664bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.533+0000 7f3e997fa640 10 client.15825 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.533+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b7392609f0 0x55b739664bb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=64bd3e0a7574fe1d server_cookie=d4538ce2a1420b41 in_seq=0 out_seq=0 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.533+0000 7f3e997fa640 1 -- 172.21.15.33:0/2731323833 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7395c05d0 con 0x55b7392609f0 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.533+0000 7f3e997fa640 10 client.15825 handle_command_reply: tid=0 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.533+0000 7f3ebe4b1740 1 client.15825 shutdown 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2731323833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392a2070 msgr2=0x55b73965edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392a2070 0x55b73965edb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0006010 tx=0x7f3ea0003ed0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2731323833 shutdown_connections 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b7392609f0 0x55b739664bb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392a2070 0x55b73965edb0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 0x55b739652f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/2731323833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392791b0 0x55b739652a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3e997fa640 0 client.15825 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:33:09.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2731323833 >> 172.21.15.33:0/2731323833 conn(0x55b739296460 msgr2=0x55b73964a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:09.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2731323833 shutdown_connections 2024-08-28T19:33:09.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2731323833 wait complete. 2024-08-28T19:33:09.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.534+0000 7f3ebe4b1740 20 client.15825 trim_cache size 0 max 16384 2024-08-28T19:33:09.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3ebe4b1740 1 Processor -- start 2024-08-28T19:33:09.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3ebe4b1740 1 -- start start 2024-08-28T19:33:09.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b739648d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b739281390 0x55b739654680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7392a2070 0x55b73965ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb01ae8f0 con 0x55b7392791b0 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb01b0430 con 0x55b739281390 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb01aefc0 con 0x55b7392a2070 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3eb54d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b739648d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3eb54d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b739648d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42852/0 (socket says 172.21.15.33:42852) 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3eb54d7640 1 -- 172.21.15.33:0/2833188480 learned_addr learned my addr 172.21.15.33:0/2833188480 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/2833188480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b739281390 0x55b739654680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.548+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/2833188480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7392a2070 0x55b73965ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.549+0000 7f3eb5cd8640 1 -- 172.21.15.33:0/2833188480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7392a2070 msgr2=0x55b73965ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.549+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/2833188480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7392a2070 0x55b73965ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.549+0000 7f3eb5cd8640 1 -- 172.21.15.33:0/2833188480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 msgr2=0x55b739648d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.549+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/2833188480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b739648d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.549+0000 7f3eb5cd8640 1 -- 172.21.15.33:0/2833188480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b739655190 con 0x55b739281390 2024-08-28T19:33:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.549+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/2833188480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b739648d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.549+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/2833188480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b739281390 0x55b739654680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55b7395be6e0 tx=0x7f3eac00b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ef66e03cd889d0a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.549+0000 7f3e9b7fe640 1 -- 172.21.15.33:0/2833188480 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac028020 con 0x55b739281390 2024-08-28T19:33:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.549+0000 7f3e9b7fe640 1 -- 172.21.15.33:0/2833188480 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eac004220 con 0x55b739281390 2024-08-28T19:33:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.549+0000 7f3e9b7fe640 1 -- 172.21.15.33:0/2833188480 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac01d8c0 con 0x55b739281390 2024-08-28T19:33:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.550+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2833188480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b739281390 msgr2=0x55b739654680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.550+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/2833188480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b739281390 0x55b739654680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55b7395be6e0 tx=0x7f3eac00b410 comp rx=0 tx=0).stop 2024-08-28T19:33:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.550+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2833188480 shutdown_connections 2024-08-28T19:33:09.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.550+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/2833188480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7392a2070 0x55b73965ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.550+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/2833188480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b739281390 0x55b739654680 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.550+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/2833188480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b739648d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.550+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2833188480 >> 172.21.15.33:0/2833188480 conn(0x55b739296460 msgr2=0x55b739653f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.550+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2833188480 shutdown_connections 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.550+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/2833188480 wait complete. 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3ebe4b1740 1 -- start start 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3ebe4b1740 1 Processor -- start 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b7396684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 0x55b7396659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3ebe4b1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392a2070 0x55b739666020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb01afd60 con 0x55b7392791b0 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb01af690 con 0x55b7392a2070 2024-08-28T19:33:09.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3ebe4b1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb01ac8d0 con 0x55b739281390 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3ebe4b1740 10 client.0 _ll_register_callbacks cb 0x7f3eac00b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3eb54d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b7396684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3eb54d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b7396684b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42856/0 (socket says 172.21.15.33:42856) 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.551+0000 7f3eb54d7640 1 -- 172.21.15.33:0/1628749976 learned_addr learned my addr 172.21.15.33:0/1628749976 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 0x55b7396659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392a2070 0x55b739666020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3eb54d7640 1 -- 172.21.15.33:0/1628749976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 msgr2=0x55b7396659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 0x55b7396659d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3eb54d7640 1 -- 172.21.15.33:0/1628749976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392a2070 msgr2=0x55b739666020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392a2070 0x55b739666020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3eb54d7640 1 -- 172.21.15.33:0/1628749976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b739666790 con 0x55b7392791b0 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 0x55b7396659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3eb54d7640 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b7396684b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3ea002a930 tx=0x7f3ea0032f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecf52059eea4d2f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3e997fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3e997fa640 1 -- 172.21.15.33:0/1628749976 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0066020 con 0x55b7392791b0 2024-08-28T19:33:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3e997fa640 1 -- 172.21.15.33:0/1628749976 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3ea0004140 con 0x55b7392791b0 2024-08-28T19:33:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.552+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/1628749976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3eac004220 con 0x55b7392791b0 2024-08-28T19:33:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3e997fa640 1 -- 172.21.15.33:0/1628749976 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ea0071050 con 0x55b7392791b0 2024-08-28T19:33:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3ebe4b1740 10 client.15831 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/1628749976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b7396cf370 con 0x55b7392791b0 2024-08-28T19:33:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3e997fa640 1 -- 172.21.15.33:0/1628749976 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eac004220 con 0x55b7392791b0 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3e997fa640 1 -- 172.21.15.33:0/1628749976 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3ea0003aa0 con 0x55b7392791b0 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3ebe4b1740 10 client.15831 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3ebe4b1740 10 client.15831 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3ebe4b1740 20 client.15831 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b739235da0 0x55b7396d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3ebe4b1740 4 client.15831 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/1628749976 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7395bc070 con 0x55b739235da0 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.553+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b739235da0 0x55b7396d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3e997fa640 10 client.15831 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3eb5cd8640 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b739235da0 0x55b7396d1ad0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e5f4ca113c2cd9ed server_cookie=c769d20fcb180404 in_seq=0 out_seq=0 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3e997fa640 1 -- 172.21.15.33:0/1628749976 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7395bc070 con 0x55b739235da0 2024-08-28T19:33:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3e997fa640 10 client.15831 handle_command_reply: tid=0 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3ebe4b1740 1 client.15831 shutdown 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/1628749976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 msgr2=0x55b7396684b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b7396684b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3ea002a930 tx=0x7f3ea0032f70 comp rx=0 tx=0).stop 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/1628749976 shutdown_connections 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b739235da0 0x55b7396d1ad0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7392a2070 0x55b739666020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b739281390 0x55b7396659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3e997fa640 0 client.15831 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3ebe4b1740 1 --2- 172.21.15.33:0/1628749976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7392791b0 0x55b7396684b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.554+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/1628749976 >> 172.21.15.33:0/1628749976 conn(0x55b739296460 msgr2=0x55b739648ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/1628749976 shutdown_connections 2024-08-28T19:33:09.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3ebe4b1740 1 -- 172.21.15.33:0/1628749976 wait complete. 2024-08-28T19:33:09.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3ebe4b1740 20 client.15831 trim_cache size 0 max 16384 2024-08-28T19:33:09.560 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:33:09.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/926072007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e9c0b4ca0 msgr2=0x7f3e9c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e9c0b4ca0 0x7f3e9c0b71b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80e2e90 tx=0x7f3ea80e5d30 comp rx=0 tx=0).stop 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/926072007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3eb0109bb0 msgr2=0x7f3eb019fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3eb0109bb0 0x7f3eb019fa40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800eaa0 tx=0x7f3ea800ef60 comp rx=0 tx=0).stop 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/926072007 shutdown_connections 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3eb0109bb0 0x7f3eb019fa40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3eb0109260 0x7f3eb019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e9c0b4ca0 0x7f3e9c0b71b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 --2- 172.21.15.33:0/926072007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3eb0103920 0x7f3eb019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/926072007 >> 172.21.15.33:0/926072007 conn(0x7f3eb00ff350 msgr2=0x7f3eb0106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/926072007 shutdown_connections 2024-08-28T19:33:09.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:09.555+0000 7f3eb7f3c640 1 -- 172.21.15.33:0/926072007 wait complete. 2024-08-28T19:33:10.287 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:33:10.546 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:10.973 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:10 smithi033 ceph-mon[18549]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-28T19:33:11.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.067+0000 7ffa76781640 1 -- 172.21.15.33:0/4290485247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa70102800 msgr2=0x7ffa70102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.067+0000 7ffa76781640 1 --2- 172.21.15.33:0/4290485247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa70102800 0x7ffa70102c10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009900 tx=0x7ffa6002a410 comp rx=0 tx=0).stop 2024-08-28T19:33:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.067+0000 7ffa76781640 1 -- 172.21.15.33:0/4290485247 shutdown_connections 2024-08-28T19:33:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.067+0000 7ffa76781640 1 --2- 172.21.15.33:0/4290485247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa70108a90 0x7ffa7010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.067+0000 7ffa76781640 1 --2- 172.21.15.33:0/4290485247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa70108140 0x7ffa70108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.067+0000 7ffa76781640 1 --2- 172.21.15.33:0/4290485247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa70102800 0x7ffa70102c10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.067+0000 7ffa76781640 1 -- 172.21.15.33:0/4290485247 >> 172.21.15.33:0/4290485247 conn(0x7ffa700794d0 msgr2=0x7ffa700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.067+0000 7ffa76781640 1 -- 172.21.15.33:0/4290485247 shutdown_connections 2024-08-28T19:33:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.067+0000 7ffa76781640 1 -- 172.21.15.33:0/4290485247 wait complete. 2024-08-28T19:33:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.068+0000 7ffa76781640 1 Processor -- start 2024-08-28T19:33:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.068+0000 7ffa76781640 1 -- start start 2024-08-28T19:33:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa76781640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa70102800 0x7ffa7019c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa76781640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa70108140 0x7ffa7019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa76781640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa70108a90 0x7ffa701a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa76781640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffa70112760 con 0x7ffa70108140 2024-08-28T19:33:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa76781640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa701125e0 con 0x7ffa70102800 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa76781640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffa701128e0 con 0x7ffa70108a90 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa6f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa70108140 0x7ffa7019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa6f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa70108140 0x7ffa7019ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42888/0 (socket says 172.21.15.33:42888) 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa6ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa70102800 0x7ffa7019c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa6f7fe640 1 -- 172.21.15.33:0/1354742738 learned_addr learned my addr 172.21.15.33:0/1354742738 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.069+0000 7ffa74d1e640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa70108a90 0x7ffa701a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa6f7fe640 1 -- 172.21.15.33:0/1354742738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa70108a90 msgr2=0x7ffa701a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa6f7fe640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa70108a90 0x7ffa701a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa6f7fe640 1 -- 172.21.15.33:0/1354742738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa70102800 msgr2=0x7ffa7019c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa6f7fe640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa70102800 0x7ffa7019c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa6f7fe640 1 -- 172.21.15.33:0/1354742738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa701a23d0 con 0x7ffa70108140 2024-08-28T19:33:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa6f7fe640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa70108140 0x7ffa7019ca00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400d740 tx=0x7ffa6400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa6d7fa640 1 -- 172.21.15.33:0/1354742738 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64017070 con 0x7ffa70108140 2024-08-28T19:33:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa6d7fa640 1 -- 172.21.15.33:0/1354742738 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa6400de50 con 0x7ffa70108140 2024-08-28T19:33:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa76781640 1 -- 172.21.15.33:0/1354742738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa701a26c0 con 0x7ffa70108140 2024-08-28T19:33:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa6d7fa640 1 -- 172.21.15.33:0/1354742738 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64004ce0 con 0x7ffa70108140 2024-08-28T19:33:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.070+0000 7ffa76781640 1 -- 172.21.15.33:0/1354742738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa701a8e20 con 0x7ffa70108140 2024-08-28T19:33:11.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa7ccf6740 1 Processor -- start 2024-08-28T19:33:11.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa7ccf6740 1 -- start start 2024-08-28T19:33:11.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfc4070 0x55687e369310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df9b1b0 0x55687e369850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfa3390 0x55687e369d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55687e2e0680 con 0x55687dfc4070 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55687e2cfc10 con 0x55687df9b1b0 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55687e2d3bc0 con 0x55687dfa3390 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa6ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df9b1b0 0x55687e369850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa6ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df9b1b0 0x55687e369850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:44284/0 (socket says 172.21.15.33:44284) 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa6ffff640 1 -- 172.21.15.33:0/3648950866 learned_addr learned my addr 172.21.15.33:0/3648950866 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.073+0000 7ffa74d1e640 1 --2- 172.21.15.33:0/3648950866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfc4070 0x55687e369310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.074+0000 7ffa6ffff640 1 -- 172.21.15.33:0/3648950866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfa3390 msgr2=0x55687e369d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.074+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/3648950866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfa3390 0x55687e369d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.074+0000 7ffa6ffff640 1 -- 172.21.15.33:0/3648950866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfc4070 msgr2=0x55687e369310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:11.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.074+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/3648950866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfc4070 0x55687e369310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.074+0000 7ffa6ffff640 1 -- 172.21.15.33:0/3648950866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687e02f650 con 0x55687df9b1b0 2024-08-28T19:33:11.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.074+0000 7ffa6d7fa640 1 -- 172.21.15.33:0/1354742738 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ffa64004e80 con 0x7ffa70108140 2024-08-28T19:33:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.074+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/3648950866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df9b1b0 0x55687e369850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009230 tx=0x7ffa60004180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fce44940eb7d4554 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.074+0000 7ffa567fc640 1 -- 172.21.15.33:0/3648950866 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60035040 con 0x55687df9b1b0 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.074+0000 7ffa567fc640 1 -- 172.21.15.33:0/3648950866 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa600054f0 con 0x55687df9b1b0 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.074+0000 7ffa567fc640 1 -- 172.21.15.33:0/3648950866 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60003850 con 0x55687df9b1b0 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa6d7fa640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffa580b4d20 0x7ffa580b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa74d1e640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffa580b4d20 0x7ffa580b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa6d7fa640 1 -- 172.21.15.33:0/1354742738 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ffa640e5130 con 0x7ffa70108140 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/3648950866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df9b1b0 msgr2=0x55687e369850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/3648950866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df9b1b0 0x55687e369850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009230 tx=0x7ffa60004180 comp rx=0 tx=0).stop 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa74d1e640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffa580b4d20 0x7ffa580b7230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffa68005fd0 tx=0x7ffa680096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/3648950866 shutdown_connections 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/3648950866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfa3390 0x55687e369d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/3648950866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df9b1b0 0x55687e369850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/3648950866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfc4070 0x55687e369310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/3648950866 >> 172.21.15.33:0/3648950866 conn(0x55687dfb8460 msgr2=0x55687e367200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.075+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/3648950866 shutdown_connections 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.076+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/3648950866 wait complete. 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.076+0000 7ffa7ccf6740 1 -- start start 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.076+0000 7ffa7ccf6740 1 Processor -- start 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.076+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df9b1b0 0x55687e374b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.076+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfa3390 0x55687e3750b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.076+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfc4070 0x55687e380de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.076+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55687e132700 con 0x55687df9b1b0 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.076+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55687e256750 con 0x55687dfc4070 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.076+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55687e377a90 con 0x55687dfa3390 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa6ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df9b1b0 0x55687e374b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa7ccf6740 10 client.0 _ll_register_callbacks cb 0x55687e285e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa6ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df9b1b0 0x55687e374b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42912/0 (socket says 172.21.15.33:42912) 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa6ffff640 1 -- 172.21.15.33:0/1097277290 learned_addr learned my addr 172.21.15.33:0/1097277290 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa6f7fe640 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfa3390 0x55687e3750b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa74d1e640 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfc4070 0x55687e380de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa6ffff640 1 -- 172.21.15.33:0/1097277290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfa3390 msgr2=0x55687e3750b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfa3390 0x55687e3750b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa6ffff640 1 -- 172.21.15.33:0/1097277290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfc4070 msgr2=0x55687e380de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfc4070 0x55687e380de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa6ffff640 1 -- 172.21.15.33:0/1097277290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55687e28f900 con 0x55687df9b1b0 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df9b1b0 0x55687e374b50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ffa6002a930 tx=0x7ffa60009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc5c30a4dfb2dea server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.077+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/1097277290 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60053060 con 0x55687df9b1b0 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1097277290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa600054f0 con 0x55687df9b1b0 2024-08-28T19:33:11.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/1097277290 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ffa60004980 con 0x55687df9b1b0 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/1097277290 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa60035050 con 0x55687df9b1b0 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa7ccf6740 10 client.15843 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1097277290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55687e383930 con 0x55687df9b1b0 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/1097277290 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa600054f0 con 0x55687df9b1b0 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/1097277290 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ffa60003c50 con 0x55687df9b1b0 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa7ccf6740 10 client.15843 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa7ccf6740 10 client.15843 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa7ccf6740 20 client.15843 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55687df829f0 0x55687e386c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa7ccf6740 4 client.15843 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.078+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1097277290 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55687e2e25d0 con 0x55687df829f0 2024-08-28T19:33:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.079+0000 7ffa6f7fe640 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55687df829f0 0x55687e386c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.079+0000 7ffa6f7fe640 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55687df829f0 0x55687e386c90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c1ed21a966c88d42 server_cookie=8fff8efce60d2b62 in_seq=0 out_seq=0 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.079+0000 7ffa4f7fe640 10 client.15843 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/1097277290 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55687e2e25d0 con 0x55687df829f0 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa4f7fe640 10 client.15843 handle_command_reply: tid=0 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 client.15843 shutdown 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1097277290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df9b1b0 msgr2=0x55687e374b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df9b1b0 0x55687e374b50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ffa6002a930 tx=0x7ffa60009260 comp rx=0 tx=0).stop 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1097277290 shutdown_connections 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55687df829f0 0x55687e386c90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfc4070 0x55687e380de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfa3390 0x55687e3750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/1097277290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df9b1b0 0x55687e374b50 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1097277290 >> 172.21.15.33:0/1097277290 conn(0x55687dfb8460 msgr2=0x55687e36c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:11.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa4f7fe640 0 client.15843 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:33:11.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1097277290 shutdown_connections 2024-08-28T19:33:11.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.080+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1097277290 wait complete. 2024-08-28T19:33:11.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.081+0000 7ffa7ccf6740 20 client.15843 trim_cache size 0 max 16384 2024-08-28T19:33:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa7ccf6740 1 Processor -- start 2024-08-28T19:33:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa7ccf6740 1 -- start start 2024-08-28T19:33:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfa3390 0x55687e375010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 0x55687e36c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df57da0 0x55687e36c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffa701b2cd0 con 0x55687df57da0 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa701b4810 con 0x55687dfa3390 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffa701b33a0 con 0x55687dfc4070 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa74d1e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df57da0 0x55687e36c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa74d1e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df57da0 0x55687e36c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42926/0 (socket says 172.21.15.33:42926) 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa74d1e640 1 -- 172.21.15.33:0/1962076533 learned_addr learned my addr 172.21.15.33:0/1962076533 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/1962076533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfa3390 0x55687e375010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa6f7fe640 1 --2- 172.21.15.33:0/1962076533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 0x55687e36c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa6ffff640 1 -- 172.21.15.33:0/1962076533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 msgr2=0x55687e36c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.095+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/1962076533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 0x55687e36c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.096+0000 7ffa6ffff640 1 -- 172.21.15.33:0/1962076533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df57da0 msgr2=0x55687e36c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.096+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/1962076533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df57da0 0x55687e36c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.096+0000 7ffa6ffff640 1 -- 172.21.15.33:0/1962076533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687e3627e0 con 0x55687dfa3390 2024-08-28T19:33:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.096+0000 7ffa74d1e640 1 --2- 172.21.15.33:0/1962076533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df57da0 0x55687e36c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.096+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/1962076533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfa3390 0x55687e375010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa6004a000 tx=0x7ffa60000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a77a0486d998db5b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.096+0000 7ffa55ffb640 1 -- 172.21.15.33:0/1962076533 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60053040 con 0x55687dfa3390 2024-08-28T19:33:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.096+0000 7ffa55ffb640 1 -- 172.21.15.33:0/1962076533 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa60009520 con 0x55687dfa3390 2024-08-28T19:33:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.096+0000 7ffa55ffb640 1 -- 172.21.15.33:0/1962076533 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60003b50 con 0x55687dfa3390 2024-08-28T19:33:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.097+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1962076533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfa3390 msgr2=0x55687e375010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.097+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/1962076533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfa3390 0x55687e375010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa6004a000 tx=0x7ffa60000bc0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.097+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1962076533 shutdown_connections 2024-08-28T19:33:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.097+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/1962076533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687df57da0 0x55687e36c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.097+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/1962076533 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 0x55687e36c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.097+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/1962076533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687dfa3390 0x55687e375010 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.097+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1962076533 >> 172.21.15.33:0/1962076533 conn(0x55687dfb8460 msgr2=0x55687e374900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.097+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1962076533 shutdown_connections 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.097+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/1962076533 wait complete. 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa7ccf6740 1 -- start start 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa7ccf6740 1 Processor -- start 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df57da0 0x55687e38a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfa3390 0x55687e387740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa7ccf6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 0x55687e387c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffa701b4140 con 0x55687dfa3390 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa701b3a70 con 0x55687df57da0 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa7ccf6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffa701b0cb0 con 0x55687dfc4070 2024-08-28T19:33:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa7ccf6740 10 client.0 _ll_register_callbacks cb 0x7ffa68009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa6f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfa3390 0x55687e387740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa6f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfa3390 0x55687e387740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42940/0 (socket says 172.21.15.33:42940) 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.098+0000 7ffa6f7fe640 1 -- 172.21.15.33:0/666373269 learned_addr learned my addr 172.21.15.33:0/666373269 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df57da0 0x55687e38a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa74d1e640 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 0x55687e387c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa6f7fe640 1 -- 172.21.15.33:0/666373269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 msgr2=0x55687e387c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa6f7fe640 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 0x55687e387c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa6f7fe640 1 -- 172.21.15.33:0/666373269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df57da0 msgr2=0x55687e38a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa6f7fe640 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df57da0 0x55687e38a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa6f7fe640 1 -- 172.21.15.33:0/666373269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55687e3881f0 con 0x55687dfa3390 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa74d1e640 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 0x55687e387c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df57da0 0x55687e38a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:11.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa6f7fe640 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfa3390 0x55687e387740 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009610 tx=0x7ffa64009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2484f0fe978632 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/666373269 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64096070 con 0x55687dfa3390 2024-08-28T19:33:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/666373269 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ffa640a7810 con 0x55687dfa3390 2024-08-28T19:33:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/666373269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa60009520 con 0x55687dfa3390 2024-08-28T19:33:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/666373269 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa64020040 con 0x55687dfa3390 2024-08-28T19:33:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa7ccf6740 10 client.15849 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:11.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.099+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/666373269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55687e3f1120 con 0x55687dfa3390 2024-08-28T19:33:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.100+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/666373269 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa60009520 con 0x55687dfa3390 2024-08-28T19:33:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.100+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/666373269 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ffa64092ce0 con 0x55687dfa3390 2024-08-28T19:33:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.100+0000 7ffa7ccf6740 10 client.15849 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.100+0000 7ffa7ccf6740 10 client.15849 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:33:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.100+0000 7ffa7ccf6740 20 client.15849 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.100+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55687e3f1820 0x55687e3f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.100+0000 7ffa7ccf6740 4 client.15849 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:33:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.100+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/666373269 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55687e2de070 con 0x55687e3f1820 2024-08-28T19:33:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.100+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55687e3f1820 0x55687e3f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:11.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa4f7fe640 10 client.15849 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa6ffff640 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55687e3f1820 0x55687e3f3c40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5f083d66afcedcda server_cookie=99de5a7ac29581ee in_seq=0 out_seq=0 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa4f7fe640 1 -- 172.21.15.33:0/666373269 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55687e2de070 con 0x55687e3f1820 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa4f7fe640 10 client.15849 handle_command_reply: tid=0 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 client.15849 shutdown 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/666373269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfa3390 msgr2=0x55687e387740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfa3390 0x55687e387740 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009610 tx=0x7ffa64009e60 comp rx=0 tx=0).stop 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/666373269 shutdown_connections 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55687e3f1820 0x55687e3f3c40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55687dfc4070 0x55687e387c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55687dfa3390 0x55687e387740 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 --2- 172.21.15.33:0/666373269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55687df57da0 0x55687e38a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/666373269 >> 172.21.15.33:0/666373269 conn(0x55687dfb8460 msgr2=0x55687e36c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa4f7fe640 0 client.15849 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:33:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/666373269 shutdown_connections 2024-08-28T19:33:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.101+0000 7ffa7ccf6740 1 -- 172.21.15.33:0/666373269 wait complete. 2024-08-28T19:33:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa7ccf6740 20 client.15849 trim_cache size 0 max 16384 2024-08-28T19:33:11.107 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:33:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa76781640 1 -- 172.21.15.33:0/1354742738 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffa580b4d20 msgr2=0x7ffa580b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa76781640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffa580b4d20 0x7ffa580b7230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffa68005fd0 tx=0x7ffa680096a0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa76781640 1 -- 172.21.15.33:0/1354742738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa70108140 msgr2=0x7ffa7019ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa76781640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa70108140 0x7ffa7019ca00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400d740 tx=0x7ffa6400dc00 comp rx=0 tx=0).stop 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa76781640 1 -- 172.21.15.33:0/1354742738 shutdown_connections 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa76781640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffa580b4d20 0x7ffa580b7230 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa76781640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffa70108a90 0x7ffa701a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa76781640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa70108140 0x7ffa7019ca00 secure :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400d740 tx=0x7ffa6400dc00 comp rx=0 tx=0).stop 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa76781640 1 --2- 172.21.15.33:0/1354742738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa70102800 0x7ffa7019c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.102+0000 7ffa76781640 1 -- 172.21.15.33:0/1354742738 >> 172.21.15.33:0/1354742738 conn(0x7ffa700794d0 msgr2=0x7ffa70101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.103+0000 7ffa76781640 1 -- 172.21.15.33:0/1354742738 shutdown_connections 2024-08-28T19:33:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:11.103+0000 7ffa76781640 1 -- 172.21.15.33:0/1354742738 wait complete. 2024-08-28T19:33:11.181 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 34.4 2024-08-28T19:33:11.181 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:33:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:10 smithi059 ceph-mon[22052]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-28T19:33:11.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:10 smithi122 ceph-mon[22174]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-28T19:33:11.867 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:33:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.448+0000 7fab8fab9640 1 -- 172.21.15.33:0/3254306629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab881045e0 msgr2=0x7fab881049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.448+0000 7fab8fab9640 1 --2- 172.21.15.33:0/3254306629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab881045e0 0x7fab881049f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fab84009900 tx=0x7fab8402a410 comp rx=0 tx=0).stop 2024-08-28T19:33:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.448+0000 7fab8fab9640 1 -- 172.21.15.33:0/3254306629 shutdown_connections 2024-08-28T19:33:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.448+0000 7fab8fab9640 1 --2- 172.21.15.33:0/3254306629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8810db90 0x7fab881100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.448+0000 7fab8fab9640 1 --2- 172.21.15.33:0/3254306629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab88105010 0x7fab8810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.448+0000 7fab8fab9640 1 --2- 172.21.15.33:0/3254306629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab881045e0 0x7fab881049f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.448+0000 7fab8fab9640 1 -- 172.21.15.33:0/3254306629 >> 172.21.15.33:0/3254306629 conn(0x7fab880794d0 msgr2=0x7fab880798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.448+0000 7fab8fab9640 1 -- 172.21.15.33:0/3254306629 shutdown_connections 2024-08-28T19:33:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.448+0000 7fab8fab9640 1 -- 172.21.15.33:0/3254306629 wait complete. 2024-08-28T19:33:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8fab9640 1 Processor -- start 2024-08-28T19:33:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8fab9640 1 -- start start 2024-08-28T19:33:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8fab9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab881045e0 0x7fab8819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8fab9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab88105010 0x7fab8819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8fab9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8810db90 0x7fab8819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8fab9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fab88113810 con 0x7fab88105010 2024-08-28T19:33:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8fab9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fab88113690 con 0x7fab881045e0 2024-08-28T19:33:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8fab9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fab88113990 con 0x7fab8810db90 2024-08-28T19:33:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8d054640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab88105010 0x7fab8819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8d054640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab88105010 0x7fab8819a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42956/0 (socket says 172.21.15.33:42956) 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8d054640 1 -- 172.21.15.33:0/3945555191 learned_addr learned my addr 172.21.15.33:0/3945555191 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8d855640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab881045e0 0x7fab8819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8e056640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8810db90 0x7fab8819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8d054640 1 -- 172.21.15.33:0/3945555191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8810db90 msgr2=0x7fab8819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8d054640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8810db90 0x7fab8819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8d054640 1 -- 172.21.15.33:0/3945555191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab881045e0 msgr2=0x7fab8819a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8d054640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab881045e0 0x7fab8819a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8d054640 1 -- 172.21.15.33:0/3945555191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab881a01b0 con 0x7fab88105010 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.449+0000 7fab8e056640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8810db90 0x7fab8819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.450+0000 7fab8d054640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab88105010 0x7fab8819a7e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fab7800e9f0 tx=0x7fab7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.450+0000 7fab7effd640 1 -- 172.21.15.33:0/3945555191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7800ccc0 con 0x7fab88105010 2024-08-28T19:33:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.450+0000 7fab8fab9640 1 -- 172.21.15.33:0/3945555191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab881a04a0 con 0x7fab88105010 2024-08-28T19:33:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.450+0000 7fab7effd640 1 -- 172.21.15.33:0/3945555191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab780108e0 con 0x7fab88105010 2024-08-28T19:33:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.450+0000 7fab7effd640 1 -- 172.21.15.33:0/3945555191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78018860 con 0x7fab88105010 2024-08-28T19:33:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.450+0000 7fab8fab9640 1 -- 172.21.15.33:0/3945555191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab881a6c00 con 0x7fab88105010 2024-08-28T19:33:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.451+0000 7fab8fab9640 1 -- 172.21.15.33:0/3945555191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab881049f0 con 0x7fab88105010 2024-08-28T19:33:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.452+0000 7fab7effd640 1 -- 172.21.15.33:0/3945555191 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fab78010430 con 0x7fab88105010 2024-08-28T19:33:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.453+0000 7fab7effd640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab740b4ca0 0x7fab740b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.454+0000 7fab8d855640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab740b4ca0 0x7fab740b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.454+0000 7fab7effd640 1 -- 172.21.15.33:0/3945555191 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fab780e5bd0 con 0x7fab88105010 2024-08-28T19:33:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.454+0000 7fab8d855640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab740b4ca0 0x7fab740b71b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fab84000c00 tx=0x7fab84031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:12.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.458+0000 7fab7effd640 1 -- 172.21.15.33:0/3945555191 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fab780ac670 con 0x7fab88105010 2024-08-28T19:33:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:12.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.706+0000 7fab8fab9640 1 -- 172.21.15.33:0/3945555191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab881a6e90 con 0x7fab88105010 2024-08-28T19:33:12.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.707+0000 7fab7effd640 1 -- 172.21.15.33:0/3945555191 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fab780abf70 con 0x7fab88105010 2024-08-28T19:33:12.708 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:33:12.708 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:33:12.709 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 -- 172.21.15.33:0/3945555191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab740b4ca0 msgr2=0x7fab740b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab740b4ca0 0x7fab740b71b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fab84000c00 tx=0x7fab84031400 comp rx=0 tx=0).stop 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 -- 172.21.15.33:0/3945555191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab88105010 msgr2=0x7fab8819a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab88105010 0x7fab8819a7e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fab7800e9f0 tx=0x7fab7800eeb0 comp rx=0 tx=0).stop 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 -- 172.21.15.33:0/3945555191 shutdown_connections 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab740b4ca0 0x7fab740b71b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fab8810db90 0x7fab8819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab88105010 0x7fab8819a7e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 --2- 172.21.15.33:0/3945555191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab881045e0 0x7fab8819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 -- 172.21.15.33:0/3945555191 >> 172.21.15.33:0/3945555191 conn(0x7fab880794d0 msgr2=0x7fab88107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 -- 172.21.15.33:0/3945555191 shutdown_connections 2024-08-28T19:33:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:12.710+0000 7fab8fab9640 1 -- 172.21.15.33:0/3945555191 wait complete. 2024-08-28T19:33:12.973 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:12 smithi033 ceph-mon[18549]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-28T19:33:12.973 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:12 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3945555191' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:13.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.192+0000 7f5e65e7a640 1 -- 172.21.15.33:0/2455247410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e60104770 msgr2=0x7f5e60104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:13.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.192+0000 7f5e65e7a640 1 --2- 172.21.15.33:0/2455247410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e60104770 0x7f5e60104b80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009900 tx=0x7f5e5002a410 comp rx=0 tx=0).stop 2024-08-28T19:33:13.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.192+0000 7f5e65e7a640 1 -- 172.21.15.33:0/2455247410 shutdown_connections 2024-08-28T19:33:13.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.192+0000 7f5e65e7a640 1 --2- 172.21.15.33:0/2455247410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6010dbd0 0x7f5e601100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.192+0000 7f5e65e7a640 1 --2- 172.21.15.33:0/2455247410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e601050c0 0x7f5e6010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.192+0000 7f5e65e7a640 1 --2- 172.21.15.33:0/2455247410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e60104770 0x7f5e60104b80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.192+0000 7f5e65e7a640 1 -- 172.21.15.33:0/2455247410 >> 172.21.15.33:0/2455247410 conn(0x7f5e600794e0 msgr2=0x7f5e600798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:13.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.192+0000 7f5e65e7a640 1 -- 172.21.15.33:0/2455247410 shutdown_connections 2024-08-28T19:33:13.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.192+0000 7f5e65e7a640 1 -- 172.21.15.33:0/2455247410 wait complete. 2024-08-28T19:33:13.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.193+0000 7f5e65e7a640 1 Processor -- start 2024-08-28T19:33:13.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e65e7a640 1 -- start start 2024-08-28T19:33:13.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e65e7a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e60104770 0x7f5e6019a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e65e7a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e601050c0 0x7f5e6019a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e65e7a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6010dbd0 0x7f5e6019fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e65e7a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5e60113850 con 0x7f5e60104770 2024-08-28T19:33:13.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e65e7a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601136d0 con 0x7f5e6010dbd0 2024-08-28T19:33:13.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e65e7a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601139d0 con 0x7f5e601050c0 2024-08-28T19:33:13.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e5f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e60104770 0x7f5e6019a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e5f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e60104770 0x7f5e6019a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42968/0 (socket says 172.21.15.33:42968) 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e5f7fe640 1 -- 172.21.15.33:0/599469123 learned_addr learned my addr 172.21.15.33:0/599469123 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e5effd640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e601050c0 0x7f5e6019a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6010dbd0 0x7f5e6019fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e5f7fe640 1 -- 172.21.15.33:0/599469123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e601050c0 msgr2=0x7f5e6019a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e601050c0 0x7f5e6019a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e5f7fe640 1 -- 172.21.15.33:0/599469123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6010dbd0 msgr2=0x7f5e6019fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6010dbd0 0x7f5e6019fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.194+0000 7f5e5f7fe640 1 -- 172.21.15.33:0/599469123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e601a0230 con 0x7f5e60104770 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.195+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e60104770 0x7f5e6019a2c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5e50032fd0 tx=0x7f5e50031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.195+0000 7f5e5cff9640 1 -- 172.21.15.33:0/599469123 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5003f030 con 0x7f5e60104770 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.195+0000 7f5e5cff9640 1 -- 172.21.15.33:0/599469123 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e50004490 con 0x7f5e60104770 2024-08-28T19:33:13.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.195+0000 7f5e65e7a640 1 -- 172.21.15.33:0/599469123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e601a04c0 con 0x7f5e60104770 2024-08-28T19:33:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.195+0000 7f5e5cff9640 1 -- 172.21.15.33:0/599469123 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50035070 con 0x7f5e60104770 2024-08-28T19:33:13.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.195+0000 7f5e65e7a640 1 -- 172.21.15.33:0/599469123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e601a6c80 con 0x7f5e60104770 2024-08-28T19:33:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.198+0000 7f5e5cff9640 1 -- 172.21.15.33:0/599469123 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5e50042030 con 0x7f5e60104770 2024-08-28T19:33:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.198+0000 7f5e6c3ef740 1 Processor -- start 2024-08-28T19:33:13.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.198+0000 7f5e6c3ef740 1 -- start start 2024-08-28T19:33:13.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.198+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f1027070 0x55d0f13cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.198+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.198+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 0x55d0f13ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.198+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d0f1343680 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.198+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d0f1332c10 con 0x55d0f1027070 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.198+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d0f1336bc0 con 0x55d0f1006390 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.198+0000 7f5e5f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42982/0 (socket says 172.21.15.33:42982) 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5f7fe640 1 -- 172.21.15.33:0/2577802477 learned_addr learned my addr 172.21.15.33:0/2577802477 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/2577802477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f1027070 0x55d0f13cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5effd640 1 --2- 172.21.15.33:0/2577802477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 0x55d0f13ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5cff9640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e480b4ca0 0x7f5e480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5f7fe640 1 -- 172.21.15.33:0/2577802477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 msgr2=0x55d0f13ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:13.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/2577802477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 0x55d0f13ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5f7fe640 1 -- 172.21.15.33:0/2577802477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f1027070 msgr2=0x55d0f13cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/2577802477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f1027070 0x55d0f13cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5f7fe640 1 -- 172.21.15.33:0/2577802477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f1092650 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5effd640 1 --2- 172.21.15.33:0/2577802477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 0x55d0f13ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e480b4ca0 0x7f5e480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5cff9640 1 -- 172.21.15.33:0/599469123 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5e50105bd0 con 0x7f5e60104770 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/2577802477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13cc850 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5e50102f40 tx=0x7f5e500fc170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200a36927ce1205d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.199+0000 7f5e45ffb640 1 -- 172.21.15.33:0/2577802477 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50049070 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.200+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e480b4ca0 0x7f5e480b71b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009fd0 tx=0x7f5e58004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.200+0000 7f5e45ffb640 1 -- 172.21.15.33:0/2577802477 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e500e33e0 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.200+0000 7f5e45ffb640 1 -- 172.21.15.33:0/2577802477 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e500cb790 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.200+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/2577802477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 msgr2=0x55d0f13cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:13.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.200+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/2577802477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13cc850 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5e50102f40 tx=0x7f5e500fc170 comp rx=0 tx=0).stop 2024-08-28T19:33:13.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.201+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/2577802477 shutdown_connections 2024-08-28T19:33:13.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.201+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/2577802477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 0x55d0f13ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.201+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/2577802477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13cc850 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.201+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/2577802477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f1027070 0x55d0f13cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.201+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/2577802477 >> 172.21.15.33:0/2577802477 conn(0x55d0f101b460 msgr2=0x55d0f13ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.201+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/2577802477 shutdown_connections 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.201+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/2577802477 wait complete. 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.201+0000 7f5e6c3ef740 1 -- start start 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.201+0000 7f5e6c3ef740 1 Processor -- start 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13d7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 0x55d0f13d8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1027070 0x55d0f13e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d0f1195700 con 0x55d0f1027070 2024-08-28T19:33:13.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d0f12b9750 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d0f1343680 con 0x55d0f1006390 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e6c3ef740 10 client.0 _ll_register_callbacks cb 0x55d0f12e8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1027070 0x55d0f13e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1027070 0x55d0f13e3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42986/0 (socket says 172.21.15.33:42986) 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5ffff640 1 -- 172.21.15.33:0/4079150505 learned_addr learned my addr 172.21.15.33:0/4079150505 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13d7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5effd640 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 0x55d0f13d8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5ffff640 1 -- 172.21.15.33:0/4079150505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 msgr2=0x55d0f13d8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 0x55d0f13d8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5ffff640 1 -- 172.21.15.33:0/4079150505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 msgr2=0x55d0f13d7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13d7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5ffff640 1 -- 172.21.15.33:0/4079150505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f12f2900 con 0x55d0f1027070 2024-08-28T19:33:13.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.202+0000 7f5e5effd640 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 0x55d0f13d8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.203+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1027070 0x55d0f13e3a50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009d20 tx=0x7f5e58004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1baedab47a75f3b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.203+0000 7f5e3effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.203+0000 7f5e3effd640 1 -- 172.21.15.33:0/4079150505 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5801ea40 con 0x55d0f1027070 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.203+0000 7f5e3effd640 1 -- 172.21.15.33:0/4079150505 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5e5801ebe0 con 0x55d0f1027070 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.203+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/4079150505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e500e33e0 con 0x55d0f1027070 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.203+0000 7f5e3effd640 1 -- 172.21.15.33:0/4079150505 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e5801ede0 con 0x55d0f1027070 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.203+0000 7f5e6c3ef740 10 client.15867 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.203+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/4079150505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d0f13e6510 con 0x55d0f1027070 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.203+0000 7f5e3effd640 1 -- 172.21.15.33:0/4079150505 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e500e33e0 con 0x55d0f1027070 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.203+0000 7f5e3effd640 1 -- 172.21.15.33:0/4079150505 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5e58028420 con 0x55d0f1027070 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.204+0000 7f5e6c3ef740 10 client.15867 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.204+0000 7f5e6c3ef740 10 client.15867 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:33:13.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.204+0000 7f5e6c3ef740 20 client.15867 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:13.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.204+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d0f0fe59f0 0x55d0f13e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.204+0000 7f5e6c3ef740 4 client.15867 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:13.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.204+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/4079150505 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0f13455d0 con 0x55d0f0fe59f0 2024-08-28T19:33:13.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.204+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d0f0fe59f0 0x55d0f13e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.204+0000 7f5e3effd640 10 client.15867 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:33:13.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.204+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d0f0fe59f0 0x55d0f13e9ad0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9ce9c4017ae1d96e server_cookie=5967ddf2fe9ae38c in_seq=0 out_seq=0 2024-08-28T19:33:13.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.205+0000 7f5e3effd640 1 -- 172.21.15.33:0/4079150505 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0f13455d0 con 0x55d0f0fe59f0 2024-08-28T19:33:13.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.205+0000 7f5e3effd640 10 client.15867 handle_command_reply: tid=0 2024-08-28T19:33:13.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.205+0000 7f5e6c3ef740 1 client.15867 shutdown 2024-08-28T19:33:13.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.205+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/4079150505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1027070 msgr2=0x55d0f13e3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:13.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.205+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1027070 0x55d0f13e3a50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009d20 tx=0x7f5e58004ab0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.205+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/4079150505 shutdown_connections 2024-08-28T19:33:13.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.205+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d0f0fe59f0 0x55d0f13e9ad0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.206+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1027070 0x55d0f13e3a50 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.206+0000 7f5e3effd640 0 client.15867 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:33:13.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.206+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f1006390 0x55d0f13d8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.206+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/4079150505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13d7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.206+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/4079150505 >> 172.21.15.33:0/4079150505 conn(0x55d0f101b460 msgr2=0x55d0f13cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:13.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.206+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/4079150505 shutdown_connections 2024-08-28T19:33:13.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.206+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/4079150505 wait complete. 2024-08-28T19:33:13.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.206+0000 7f5e6c3ef740 20 client.15867 trim_cache size 0 max 16384 2024-08-28T19:33:13.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e6c3ef740 1 Processor -- start 2024-08-28T19:33:13.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e6c3ef740 1 -- start start 2024-08-28T19:33:13.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 0x55d0f13d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13d9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1006390 0x55d0f13e3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601b2df0 con 0x55d0f1006390 2024-08-28T19:33:13.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601b4930 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601b34c0 con 0x55d0f0fe59f0 2024-08-28T19:33:13.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e5ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1006390 0x55d0f13e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e5ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1006390 0x55d0f13e3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42994/0 (socket says 172.21.15.33:42994) 2024-08-28T19:33:13.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e5ffff640 1 -- 172.21.15.33:0/742474285 learned_addr learned my addr 172.21.15.33:0/742474285 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:13.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.221+0000 7f5e5effd640 1 --2- 172.21.15.33:0/742474285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13d9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/742474285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 0x55d0f13d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e5ffff640 1 -- 172.21.15.33:0/742474285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 msgr2=0x55d0f13d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:13.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/742474285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 0x55d0f13d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e5ffff640 1 -- 172.21.15.33:0/742474285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 msgr2=0x55d0f13d9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:13.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/742474285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13d9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e5ffff640 1 -- 172.21.15.33:0/742474285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f13d8db0 con 0x55d0f1006390 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e5effd640 1 --2- 172.21.15.33:0/742474285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13d9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/742474285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1006390 0x55d0f13e3950 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009fa0 tx=0x7f5e58009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3926bac156c3be5b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e457fa640 1 -- 172.21.15.33:0/742474285 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5803b070 con 0x55d0f1006390 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e457fa640 1 -- 172.21.15.33:0/742474285 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e5801ea40 con 0x55d0f1006390 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.222+0000 7f5e457fa640 1 -- 172.21.15.33:0/742474285 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e58036840 con 0x55d0f1006390 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.223+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/742474285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1006390 msgr2=0x55d0f13e3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.223+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/742474285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1006390 0x55d0f13e3950 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009fa0 tx=0x7f5e58009500 comp rx=0 tx=0).stop 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.223+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/742474285 shutdown_connections 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.223+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/742474285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f1006390 0x55d0f13e3950 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.223+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/742474285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f0ffe1b0 0x55d0f13d9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.223+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/742474285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 0x55d0f13d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.223+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/742474285 >> 172.21.15.33:0/742474285 conn(0x55d0f101b460 msgr2=0x55d0f13d9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.224+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/742474285 shutdown_connections 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.224+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/742474285 wait complete. 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.224+0000 7f5e6c3ef740 1 -- start start 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e6c3ef740 1 Processor -- start 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 0x55d0f144d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f144dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e6c3ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f1006390 0x55d0f13dc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601b4260 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601b3b90 con 0x55d0f1006390 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e6c3ef740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5e601b0dd0 con 0x55d0f0fe59f0 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e6c3ef740 10 client.0 _ll_register_callbacks cb 0x7f5e58009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:13.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e5effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f144dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e5effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f144dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43010/0 (socket says 172.21.15.33:43010) 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e5effd640 1 -- 172.21.15.33:0/3925044528 learned_addr learned my addr 172.21.15.33:0/3925044528 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 0x55d0f144d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.225+0000 7f5e5ffff640 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f1006390 0x55d0f13dc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e5effd640 1 -- 172.21.15.33:0/3925044528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 msgr2=0x55d0f144d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e5effd640 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 0x55d0f144d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e5effd640 1 -- 172.21.15.33:0/3925044528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f1006390 msgr2=0x55d0f13dc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e5effd640 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f1006390 0x55d0f13dc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e5effd640 1 -- 172.21.15.33:0/3925044528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f13dc8a0 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 0x55d0f144d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e5effd640 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f144dd80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5e54012840 tx=0x7f5e54012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be501ee202f963bb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:13.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e3effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e3effd640 1 -- 172.21.15.33:0/3925044528 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e54011d30 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e3effd640 1 -- 172.21.15.33:0/3925044528 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5e5401d3f0 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/3925044528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e5801ea40 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e3effd640 1 -- 172.21.15.33:0/3925044528 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e5402b050 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e6c3ef740 10 client.15873 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.226+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/3925044528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d0f1454fd0 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.227+0000 7f5e3effd640 1 -- 172.21.15.33:0/3925044528 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e5801ea40 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.227+0000 7f5e3effd640 1 -- 172.21.15.33:0/3925044528 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5e54026550 con 0x55d0f0ffe1b0 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.227+0000 7f5e6c3ef740 10 client.15873 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.227+0000 7f5e6c3ef740 10 client.15873 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.227+0000 7f5e6c3ef740 20 client.15873 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:13.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.227+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d0f1027070 0x55d0f1457840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:13.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.227+0000 7f5e6c3ef740 4 client.15873 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:33:13.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.227+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/3925044528 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0f1341070 con 0x55d0f1027070 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.227+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d0f1027070 0x55d0f1457840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e3effd640 10 client.15873 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e5f7fe640 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d0f1027070 0x55d0f1457840 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=18d38021e7b4caf2 server_cookie=9fdcf25ac5e50ed4 in_seq=0 out_seq=0 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e3effd640 1 -- 172.21.15.33:0/3925044528 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0f1341070 con 0x55d0f1027070 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e3effd640 10 client.15873 handle_command_reply: tid=0 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e6c3ef740 1 client.15873 shutdown 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/3925044528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 msgr2=0x55d0f144dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f144dd80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5e54012840 tx=0x7f5e54012d00 comp rx=0 tx=0).stop 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/3925044528 shutdown_connections 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0f1006390 0x55d0f13dc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d0f1027070 0x55d0f1457840 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e3effd640 0 client.15873 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:33:13.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d0f0ffe1b0 0x55d0f144dd80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.228+0000 7f5e6c3ef740 1 --2- 172.21.15.33:0/3925044528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d0f0fe59f0 0x55d0f144d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.229+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/3925044528 >> 172.21.15.33:0/3925044528 conn(0x55d0f101b460 msgr2=0x55d0f13d9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:13.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.229+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/3925044528 shutdown_connections 2024-08-28T19:33:13.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.229+0000 7f5e6c3ef740 1 -- 172.21.15.33:0/3925044528 wait complete. 2024-08-28T19:33:13.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.229+0000 7f5e6c3ef740 20 client.15873 trim_cache size 0 max 16384 2024-08-28T19:33:13.233 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:33:13.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.229+0000 7f5e65e7a640 1 -- 172.21.15.33:0/599469123 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e480b4ca0 msgr2=0x7f5e480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:13.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.229+0000 7f5e65e7a640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e480b4ca0 0x7f5e480b71b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009fd0 tx=0x7f5e58004a40 comp rx=0 tx=0).stop 2024-08-28T19:33:13.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.229+0000 7f5e65e7a640 1 -- 172.21.15.33:0/599469123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e60104770 msgr2=0x7f5e6019a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:13.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.229+0000 7f5e65e7a640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e60104770 0x7f5e6019a2c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5e50032fd0 tx=0x7f5e50031a20 comp rx=0 tx=0).stop 2024-08-28T19:33:13.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.230+0000 7f5e65e7a640 1 -- 172.21.15.33:0/599469123 shutdown_connections 2024-08-28T19:33:13.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.230+0000 7f5e65e7a640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6010dbd0 0x7f5e6019fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.230+0000 7f5e65e7a640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5e480b4ca0 0x7f5e480b71b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.230+0000 7f5e65e7a640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5e601050c0 0x7f5e6019a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.230+0000 7f5e65e7a640 1 --2- 172.21.15.33:0/599469123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e60104770 0x7f5e6019a2c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:13.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.230+0000 7f5e65e7a640 1 -- 172.21.15.33:0/599469123 >> 172.21.15.33:0/599469123 conn(0x7f5e600794e0 msgr2=0x7f5e601005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:13.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.230+0000 7f5e65e7a640 1 -- 172.21.15.33:0/599469123 shutdown_connections 2024-08-28T19:33:13.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:13.230+0000 7f5e65e7a640 1 -- 172.21.15.33:0/599469123 wait complete. 2024-08-28T19:33:13.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:12 smithi059 ceph-mon[22052]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-28T19:33:13.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:12 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3945555191' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:13.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:12 smithi122 ceph-mon[22174]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-28T19:33:13.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:12 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3945555191' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:13.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:33:14.597 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 154.4 --await-for 45.0' 2024-08-28T19:33:14.598 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 154.4 --await-for 45.0 2024-08-28T19:33:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:15.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:14 smithi033 ceph-mon[18549]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-08-28T19:33:15.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.187+0000 7fa476db2640 1 -- 172.21.15.33:0/1551326655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa470108140 msgr2=0x7fa470108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:15.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.187+0000 7fa476db2640 1 --2- 172.21.15.33:0/1551326655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa470108140 0x7fa470108550 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009900 tx=0x7fa45c02a410 comp rx=0 tx=0).stop 2024-08-28T19:33:15.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.187+0000 7fa476db2640 1 -- 172.21.15.33:0/1551326655 shutdown_connections 2024-08-28T19:33:15.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.188+0000 7fa476db2640 1 --2- 172.21.15.33:0/1551326655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa470108a90 0x7fa47010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.188+0000 7fa476db2640 1 --2- 172.21.15.33:0/1551326655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa470108140 0x7fa470108550 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.188+0000 7fa476db2640 1 --2- 172.21.15.33:0/1551326655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470102800 0x7fa470102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.188+0000 7fa476db2640 1 -- 172.21.15.33:0/1551326655 >> 172.21.15.33:0/1551326655 conn(0x7fa4700794d0 msgr2=0x7fa4700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:15.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.188+0000 7fa476db2640 1 -- 172.21.15.33:0/1551326655 shutdown_connections 2024-08-28T19:33:15.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.188+0000 7fa476db2640 1 -- 172.21.15.33:0/1551326655 wait complete. 2024-08-28T19:33:15.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.188+0000 7fa476db2640 1 Processor -- start 2024-08-28T19:33:15.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa476db2640 1 -- start start 2024-08-28T19:33:15.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa476db2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa470102800 0x7fa47019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa476db2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470108140 0x7fa47019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa474b4e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa470102800 0x7fa47019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa476db2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa470108a90 0x7fa47019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa474b4e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa470102800 0x7fa47019a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43024/0 (socket says 172.21.15.33:43024) 2024-08-28T19:33:15.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa474b4e640 1 -- 172.21.15.33:0/3633071822 learned_addr learned my addr 172.21.15.33:0/3633071822 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:15.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa470113820 con 0x7fa470102800 2024-08-28T19:33:15.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701136a0 con 0x7fa470108140 2024-08-28T19:33:15.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701139a0 con 0x7fa470108a90 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.189+0000 7fa46ffff640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470108140 0x7fa47019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa47534f640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa470108a90 0x7fa47019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa474b4e640 1 -- 172.21.15.33:0/3633071822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa470108a90 msgr2=0x7fa47019fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa474b4e640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa470108a90 0x7fa47019fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa474b4e640 1 -- 172.21.15.33:0/3633071822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470108140 msgr2=0x7fa47019a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa474b4e640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470108140 0x7fa47019a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa474b4e640 1 -- 172.21.15.33:0/3633071822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4701a01c0 con 0x7fa470102800 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa474b4e640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa470102800 0x7fa47019a310 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c920 tx=0x7fa46400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa46dffb640 1 -- 172.21.15.33:0/3633071822 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464007c70 con 0x7fa470102800 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4701a04b0 con 0x7fa470102800 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa46dffb640 1 -- 172.21.15.33:0/3633071822 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa464007e10 con 0x7fa470102800 2024-08-28T19:33:15.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.190+0000 7fa46dffb640 1 -- 172.21.15.33:0/3633071822 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464018820 con 0x7fa470102800 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.191+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa47010fc30 con 0x7fa470102800 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47d327740 1 Processor -- start 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47d327740 1 -- start start 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47d327740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 0x559cd18a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47d327740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47d327740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47d327740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559cd1818680 con 0x559cd14d31b0 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47d327740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559cd1807c10 con 0x559cd14fc070 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47d327740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559cd180bbc0 con 0x559cd14db390 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47534f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 0x559cd18a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47534f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 0x559cd18a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:44396/0 (socket says 172.21.15.33:44396) 2024-08-28T19:33:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa47534f640 1 -- 172.21.15.33:0/4186978274 learned_addr learned my addr 172.21.15.33:0/4186978274 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.194+0000 7fa46ffff640 1 --2- 172.21.15.33:0/4186978274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.195+0000 7fa46ffff640 1 -- 172.21.15.33:0/4186978274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 msgr2=0x559cd18a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.195+0000 7fa46ffff640 1 --2- 172.21.15.33:0/4186978274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 0x559cd18a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.195+0000 7fa46ffff640 1 -- 172.21.15.33:0/4186978274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 msgr2=0x559cd18a1850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T19:33:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.195+0000 7fa46ffff640 1 --2- 172.21.15.33:0/4186978274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18a1850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.195+0000 7fa46ffff640 1 -- 172.21.15.33:0/4186978274 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd1567650 con 0x559cd14db390 2024-08-28T19:33:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.195+0000 7fa46dffb640 1 -- 172.21.15.33:0/3633071822 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa46400f450 con 0x7fa470102800 2024-08-28T19:33:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.195+0000 7fa47534f640 1 --2- 172.21.15.33:0/4186978274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 0x559cd18a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.195+0000 7fa46ffff640 1 --2- 172.21.15.33:0/4186978274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18a1d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa45c006010 tx=0x7fa45c032df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f90195bbca385c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.196+0000 7fa45affd640 1 -- 172.21.15.33:0/4186978274 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c040070 con 0x559cd14db390 2024-08-28T19:33:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.196+0000 7fa45affd640 1 -- 172.21.15.33:0/4186978274 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa45c005db0 con 0x559cd14db390 2024-08-28T19:33:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.196+0000 7fa45affd640 1 -- 172.21.15.33:0/4186978274 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c035040 con 0x559cd14db390 2024-08-28T19:33:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.196+0000 7fa46dffb640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4600b4cd0 0x7fa4600b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.196+0000 7fa47534f640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4600b4cd0 0x7fa4600b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.196+0000 7fa46dffb640 1 -- 172.21.15.33:0/3633071822 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fa4640e59b0 con 0x7fa470102800 2024-08-28T19:33:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.197+0000 7fa47d327740 1 -- 172.21.15.33:0/4186978274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 msgr2=0x559cd18a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.197+0000 7fa47534f640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4600b4cd0 0x7fa4600b71e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa468009fd0 tx=0x7fa468009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.197+0000 7fa47d327740 1 --2- 172.21.15.33:0/4186978274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18a1d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa45c006010 tx=0x7fa45c032df0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.197+0000 7fa47d327740 1 -- 172.21.15.33:0/4186978274 shutdown_connections 2024-08-28T19:33:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.197+0000 7fa47d327740 1 --2- 172.21.15.33:0/4186978274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18a1d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.197+0000 7fa47d327740 1 --2- 172.21.15.33:0/4186978274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.197+0000 7fa47d327740 1 --2- 172.21.15.33:0/4186978274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 0x559cd18a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.197+0000 7fa47d327740 1 -- 172.21.15.33:0/4186978274 >> 172.21.15.33:0/4186978274 conn(0x559cd14f0460 msgr2=0x559cd189f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.198+0000 7fa47d327740 1 -- 172.21.15.33:0/4186978274 shutdown_connections 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.198+0000 7fa47d327740 1 -- 172.21.15.33:0/4186978274 wait complete. 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.198+0000 7fa47d327740 1 -- start start 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.198+0000 7fa47d327740 1 Processor -- start 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa47d327740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa47d327740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa47d327740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 0x559cd18b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa47d327740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559cd166a700 con 0x559cd14d31b0 2024-08-28T19:33:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa47d327740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559cd178e750 con 0x559cd14fc070 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa47d327740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559cd18afa90 con 0x559cd14db390 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa474b4e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa474b4e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43036/0 (socket says 172.21.15.33:43036) 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa474b4e640 1 -- 172.21.15.33:0/3087470677 learned_addr learned my addr 172.21.15.33:0/3087470677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa46ffff640 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa47534f640 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 0x559cd18b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa47d327740 10 client.0 _ll_register_callbacks cb 0x559cd17bde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa474b4e640 1 -- 172.21.15.33:0/3087470677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 msgr2=0x559cd18ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa474b4e640 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa474b4e640 1 -- 172.21.15.33:0/3087470677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 msgr2=0x559cd18b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa474b4e640 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 0x559cd18b8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa474b4e640 1 -- 172.21.15.33:0/3087470677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cd17c7900 con 0x559cd14d31b0 2024-08-28T19:33:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa474b4e640 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18acb40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa4640e33b0 tx=0x7fa46400f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233f32de874d3745 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.199+0000 7fa44ffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.200+0000 7fa44ffff640 1 -- 172.21.15.33:0/3087470677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4640b05c0 con 0x559cd14d31b0 2024-08-28T19:33:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.200+0000 7fa44ffff640 1 -- 172.21.15.33:0/3087470677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fa4640a7fe0 con 0x559cd14d31b0 2024-08-28T19:33:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.200+0000 7fa47d327740 1 -- 172.21.15.33:0/3087470677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa45c005db0 con 0x559cd14d31b0 2024-08-28T19:33:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.200+0000 7fa44ffff640 1 -- 172.21.15.33:0/3087470677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4640b5070 con 0x559cd14d31b0 2024-08-28T19:33:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.200+0000 7fa47d327740 10 client.15882 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:15.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.200+0000 7fa47d327740 1 -- 172.21.15.33:0/3087470677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559cd18bb970 con 0x559cd14d31b0 2024-08-28T19:33:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.200+0000 7fa44ffff640 1 -- 172.21.15.33:0/3087470677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4640b0220 con 0x559cd14d31b0 2024-08-28T19:33:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.201+0000 7fa44ffff640 1 -- 172.21.15.33:0/3087470677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa4640aafb0 con 0x559cd14d31b0 2024-08-28T19:33:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.201+0000 7fa47d327740 10 client.15882 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.201+0000 7fa47d327740 10 client.15882 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:33:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.201+0000 7fa47d327740 20 client.15882 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.201+0000 7fa47d327740 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559cd14ba9f0 0x559cd18bee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.201+0000 7fa47d327740 4 client.15882 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.201+0000 7fa47d327740 1 -- 172.21.15.33:0/3087470677 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa45c005db0 con 0x559cd14ba9f0 2024-08-28T19:33:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.201+0000 7fa46ffff640 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559cd14ba9f0 0x559cd18bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.202+0000 7fa44ffff640 10 client.15882 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.202+0000 7fa46ffff640 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559cd14ba9f0 0x559cd18bee40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=79d7ede4372876c7 server_cookie=94c8544d050e296a in_seq=0 out_seq=0 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.202+0000 7fa44ffff640 1 -- 172.21.15.33:0/3087470677 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa45c005db0 con 0x559cd14ba9f0 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.202+0000 7fa44ffff640 10 client.15882 handle_command_reply: tid=0 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.202+0000 7fa47d327740 1 client.15882 shutdown 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 1 -- 172.21.15.33:0/3087470677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 msgr2=0x559cd18acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18acb40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa4640e33b0 tx=0x7fa46400f9f0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 1 -- 172.21.15.33:0/3087470677 shutdown_connections 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559cd14ba9f0 0x559cd18bee40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14fc070 0x559cd18b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 1 --2- 172.21.15.33:0/3087470677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18acb40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa44ffff640 0 client.15882 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:33:15.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 1 -- 172.21.15.33:0/3087470677 >> 172.21.15.33:0/3087470677 conn(0x559cd14f0460 msgr2=0x559cd18a44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:15.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 1 -- 172.21.15.33:0/3087470677 shutdown_connections 2024-08-28T19:33:15.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 1 -- 172.21.15.33:0/3087470677 wait complete. 2024-08-28T19:33:15.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.203+0000 7fa47d327740 20 client.15882 trim_cache size 0 max 16384 2024-08-28T19:33:15.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.229+0000 7fa47d327740 1 Processor -- start 2024-08-28T19:33:15.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.229+0000 7fa47d327740 1 -- start start 2024-08-28T19:33:15.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa47d327740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 0x559cd18a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa47d327740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14d31b0 0x559cd18a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa47d327740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14db390 0x559cd18aa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa47d327740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701b2ba0 con 0x559cd14db390 2024-08-28T19:33:15.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa47d327740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701b46e0 con 0x559cd14ba9f0 2024-08-28T19:33:15.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa47d327740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701b3270 con 0x559cd14d31b0 2024-08-28T19:33:15.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa47534f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14db390 0x559cd18aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa47534f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14db390 0x559cd18aa270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43044/0 (socket says 172.21.15.33:43044) 2024-08-28T19:33:15.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa47534f640 1 -- 172.21.15.33:0/3521617800 learned_addr learned my addr 172.21.15.33:0/3521617800 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:15.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa474b4e640 1 --2- 172.21.15.33:0/3521617800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 0x559cd18a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.230+0000 7fa46ffff640 1 --2- 172.21.15.33:0/3521617800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14d31b0 0x559cd18a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.231+0000 7fa47534f640 1 -- 172.21.15.33:0/3521617800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14d31b0 msgr2=0x559cd18a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:15.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.231+0000 7fa47534f640 1 --2- 172.21.15.33:0/3521617800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14d31b0 0x559cd18a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.231+0000 7fa47534f640 1 -- 172.21.15.33:0/3521617800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 msgr2=0x559cd18a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:15.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.231+0000 7fa47534f640 1 --2- 172.21.15.33:0/3521617800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 0x559cd18a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.231+0000 7fa47534f640 1 -- 172.21.15.33:0/3521617800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cd18a3600 con 0x559cd14db390 2024-08-28T19:33:15.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.231+0000 7fa47534f640 1 --2- 172.21.15.33:0/3521617800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14db390 0x559cd18aa270 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa468009c20 tx=0x7fa468015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadca4d8cc263320 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:15.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.232+0000 7fa45a7fc640 1 -- 172.21.15.33:0/3521617800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4680207f0 con 0x559cd14db390 2024-08-28T19:33:15.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.232+0000 7fa45a7fc640 1 -- 172.21.15.33:0/3521617800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa468020e40 con 0x559cd14db390 2024-08-28T19:33:15.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.232+0000 7fa45a7fc640 1 -- 172.21.15.33:0/3521617800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46801b3a0 con 0x559cd14db390 2024-08-28T19:33:15.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.233+0000 7fa47d327740 1 -- 172.21.15.33:0/3521617800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14db390 msgr2=0x559cd18aa270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:15.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.233+0000 7fa47d327740 1 --2- 172.21.15.33:0/3521617800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14db390 0x559cd18aa270 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa468009c20 tx=0x7fa468015000 comp rx=0 tx=0).stop 2024-08-28T19:33:15.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.234+0000 7fa47d327740 1 -- 172.21.15.33:0/3521617800 shutdown_connections 2024-08-28T19:33:15.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.234+0000 7fa47d327740 1 --2- 172.21.15.33:0/3521617800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14db390 0x559cd18aa270 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.234+0000 7fa47d327740 1 --2- 172.21.15.33:0/3521617800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14d31b0 0x559cd18a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.234+0000 7fa47d327740 1 --2- 172.21.15.33:0/3521617800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 0x559cd18a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.234+0000 7fa47d327740 1 -- 172.21.15.33:0/3521617800 >> 172.21.15.33:0/3521617800 conn(0x559cd14f0460 msgr2=0x559cd18a4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:15.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.234+0000 7fa47d327740 1 -- 172.21.15.33:0/3521617800 shutdown_connections 2024-08-28T19:33:15.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.234+0000 7fa47d327740 1 -- 172.21.15.33:0/3521617800 wait complete. 2024-08-28T19:33:15.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.234+0000 7fa47d327740 1 -- start start 2024-08-28T19:33:15.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.234+0000 7fa47d327740 1 Processor -- start 2024-08-28T19:33:15.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa47d327740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 0x559cd18b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa47d327740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa474b4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 0x559cd18b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa46ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa474b4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 0x559cd18b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:44418/0 (socket says 172.21.15.33:44418) 2024-08-28T19:33:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa46ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18b17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43046/0 (socket says 172.21.15.33:43046) 2024-08-28T19:33:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa474b4e640 1 -- 172.21.15.33:0/2946179008 learned_addr learned my addr 172.21.15.33:0/2946179008 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:15.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa47d327740 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701b4010 con 0x559cd14d31b0 2024-08-28T19:33:15.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701b3940 con 0x559cd14ba9f0 2024-08-28T19:33:15.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.235+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701b0b80 con 0x559cd14db390 2024-08-28T19:33:15.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.236+0000 7fa474b4e640 1 -- 172.21.15.33:0/2946179008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 msgr2=0x559cd18b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:15.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.236+0000 7fa474b4e640 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.236+0000 7fa474b4e640 1 -- 172.21.15.33:0/2946179008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 msgr2=0x559cd18b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:15.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.236+0000 7fa474b4e640 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.236+0000 7fa47d327740 10 client.0 _ll_register_callbacks cb 0x7fa46400cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.236+0000 7fa474b4e640 1 -- 172.21.15.33:0/2946179008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cd18b2310 con 0x559cd14ba9f0 2024-08-28T19:33:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.236+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559cd181a5d0 con 0x559cd14ba9f0 2024-08-28T19:33:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.236+0000 7fa46ffff640 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.236+0000 7fa474b4e640 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 0x559cd18b5320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4640a7dd0 tx=0x7fa4640ab1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8af94626baf654b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.236+0000 7fa44ffff640 10 client.25472 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:33:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.237+0000 7fa44ffff640 1 -- 172.21.15.33:0/2946179008 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4640a7c10 con 0x559cd14ba9f0 2024-08-28T19:33:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.237+0000 7fa44ffff640 1 -- 172.21.15.33:0/2946179008 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fa4640a7fe0 con 0x559cd14ba9f0 2024-08-28T19:33:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.237+0000 7fa44ffff640 1 -- 172.21.15.33:0/2946179008 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4640b05c0 con 0x559cd14ba9f0 2024-08-28T19:33:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.237+0000 7fa47d327740 10 client.25472 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.237+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559cd192a390 con 0x559cd14ba9f0 2024-08-28T19:33:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.238+0000 7fa44ffff640 1 -- 172.21.15.33:0/2946179008 <== mon.2 v2:172.21.15.59:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa4640a76c0 con 0x559cd14ba9f0 2024-08-28T19:33:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.238+0000 7fa47d327740 10 client.25472 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.238+0000 7fa47d327740 10 client.25472 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:33:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.238+0000 7fa47d327740 20 client.25472 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.238+0000 7fa47d327740 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559cd14fc070 0x559cd192c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.238+0000 7fa47d327740 4 client.25472 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:33:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.238+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559cd1816070 con 0x559cd14fc070 2024-08-28T19:33:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.238+0000 7fa46ffff640 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559cd14fc070 0x559cd192c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.238+0000 7fa46ffff640 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559cd14fc070 0x559cd192c880 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=250a94979f192396 server_cookie=1c6ccccae43f727d in_seq=0 out_seq=0 2024-08-28T19:33:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.238+0000 7fa44ffff640 10 client.25472 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:33:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa44ffff640 1 -- 172.21.15.33:0/2946179008 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559cd1816070 con 0x559cd14fc070 2024-08-28T19:33:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa44ffff640 10 client.25472 handle_command_reply: tid=0 2024-08-28T19:33:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa47d327740 1 client.25472 shutdown 2024-08-28T19:33:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 msgr2=0x559cd18b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa47d327740 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 0x559cd18b5320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4640a7dd0 tx=0x7fa4640ab1c0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 shutdown_connections 2024-08-28T19:33:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa47d327740 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559cd14fc070 0x559cd192c880 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa47d327740 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559cd14db390 0x559cd18b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa47d327740 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559cd14d31b0 0x559cd18b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa44ffff640 0 client.25472 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:33:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa47d327740 1 --2- 172.21.15.33:0/2946179008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cd14ba9f0 0x559cd18b5320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.239+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 >> 172.21.15.33:0/2946179008 conn(0x559cd14f0460 msgr2=0x559cd18adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.240+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 shutdown_connections 2024-08-28T19:33:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.240+0000 7fa47d327740 1 -- 172.21.15.33:0/2946179008 wait complete. 2024-08-28T19:33:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.240+0000 7fa47d327740 20 client.25472 trim_cache size 0 max 16384 2024-08-28T19:33:15.249 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:33:15.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.240+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4600b4cd0 msgr2=0x7fa4600b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:15.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.240+0000 7fa476db2640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4600b4cd0 0x7fa4600b71e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa468009fd0 tx=0x7fa468009760 comp rx=0 tx=0).stop 2024-08-28T19:33:15.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.240+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa470102800 msgr2=0x7fa47019a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:15.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.240+0000 7fa476db2640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa470102800 0x7fa47019a310 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c920 tx=0x7fa46400cde0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.241+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 shutdown_connections 2024-08-28T19:33:15.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.241+0000 7fa476db2640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4600b4cd0 0x7fa4600b71e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.241+0000 7fa476db2640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa470108a90 0x7fa47019fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.241+0000 7fa476db2640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa470108140 0x7fa47019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.241+0000 7fa476db2640 1 --2- 172.21.15.33:0/3633071822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa470102800 0x7fa47019a310 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:15.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.241+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 >> 172.21.15.33:0/3633071822 conn(0x7fa4700794d0 msgr2=0x7fa470105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:15.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.241+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 shutdown_connections 2024-08-28T19:33:15.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:15.241+0000 7fa476db2640 1 -- 172.21.15.33:0/3633071822 wait complete. 2024-08-28T19:33:15.251 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:15.285 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:14 smithi059 ceph-mon[22052]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-08-28T19:33:15.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:14 smithi122 ceph-mon[22174]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-08-28T19:33:16.314 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:33:16.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.546+0000 7fd697905640 1 -- 172.21.15.33:0/241341545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd690108180 msgr2=0x7fd690108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:16.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.546+0000 7fd697905640 1 --2- 172.21.15.33:0/241341545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd690108180 0x7fd690108590 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00d910 tx=0x7fd68c02c370 comp rx=0 tx=0).stop 2024-08-28T19:33:16.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.546+0000 7fd697905640 1 -- 172.21.15.33:0/241341545 shutdown_connections 2024-08-28T19:33:16.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.546+0000 7fd697905640 1 --2- 172.21.15.33:0/241341545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd690108ad0 0x7fd69010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.546+0000 7fd697905640 1 --2- 172.21.15.33:0/241341545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd690108180 0x7fd690108590 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.546+0000 7fd697905640 1 --2- 172.21.15.33:0/241341545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd690102890 0x7fd690102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.546+0000 7fd697905640 1 -- 172.21.15.33:0/241341545 >> 172.21.15.33:0/241341545 conn(0x7fd6900795d0 msgr2=0x7fd6900799e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:16.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.546+0000 7fd697905640 1 -- 172.21.15.33:0/241341545 shutdown_connections 2024-08-28T19:33:16.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.546+0000 7fd697905640 1 -- 172.21.15.33:0/241341545 wait complete. 2024-08-28T19:33:16.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.547+0000 7fd697905640 1 Processor -- start 2024-08-28T19:33:16.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.547+0000 7fd697905640 1 -- start start 2024-08-28T19:33:16.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd697905640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd690102890 0x7fd690113d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd697905640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd690108180 0x7fd690110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd697905640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd690108ad0 0x7fd690110790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd697905640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd690115ac0 con 0x7fd690108ad0 2024-08-28T19:33:16.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd697905640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd690115940 con 0x7fd690102890 2024-08-28T19:33:16.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd697905640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd690115c40 con 0x7fd690108180 2024-08-28T19:33:16.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd695ea2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd690108ad0 0x7fd690110790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd695ea2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd690108ad0 0x7fd690110790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43068/0 (socket says 172.21.15.33:43068) 2024-08-28T19:33:16.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd695ea2640 1 -- 172.21.15.33:0/146725135 learned_addr learned my addr 172.21.15.33:0/146725135 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:16.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd694ea0640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd690108180 0x7fd690110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd6956a1640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd690102890 0x7fd690113d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd695ea2640 1 -- 172.21.15.33:0/146725135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd690108180 msgr2=0x7fd690110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:16.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd695ea2640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd690108180 0x7fd690110070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd695ea2640 1 -- 172.21.15.33:0/146725135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd690102890 msgr2=0x7fd690113d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:16.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd695ea2640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd690102890 0x7fd690113d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.548+0000 7fd695ea2640 1 -- 172.21.15.33:0/146725135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6901aca20 con 0x7fd690108ad0 2024-08-28T19:33:16.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.549+0000 7fd695ea2640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd690108ad0 0x7fd690110790 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd68800b970 tx=0x7fd68800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:16.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.549+0000 7fd6867fc640 1 -- 172.21.15.33:0/146725135 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688019070 con 0x7fd690108ad0 2024-08-28T19:33:16.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.549+0000 7fd6867fc640 1 -- 172.21.15.33:0/146725135 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd688014440 con 0x7fd690108ad0 2024-08-28T19:33:16.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.549+0000 7fd6867fc640 1 -- 172.21.15.33:0/146725135 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6880075d0 con 0x7fd690108ad0 2024-08-28T19:33:16.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.550+0000 7fd697905640 1 -- 172.21.15.33:0/146725135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6901acc50 con 0x7fd690108ad0 2024-08-28T19:33:16.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.550+0000 7fd697905640 1 -- 172.21.15.33:0/146725135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6901ad110 con 0x7fd690108ad0 2024-08-28T19:33:16.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.554+0000 7fd6867fc640 1 -- 172.21.15.33:0/146725135 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd68801c070 con 0x7fd690108ad0 2024-08-28T19:33:16.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.554+0000 7fd69de7a740 1 Processor -- start 2024-08-28T19:33:16.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.554+0000 7fd69de7a740 1 -- start start 2024-08-28T19:33:16.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743dd980 0x55e6747ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743e5b60 0x55e6747ae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd69de7a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e674722330 con 0x55e674406840 2024-08-28T19:33:16.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd69de7a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e6747118c0 con 0x55e6743e5b60 2024-08-28T19:33:16.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd69de7a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e674715870 con 0x55e6743dd980 2024-08-28T19:33:16.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd694ea0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd694ea0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747adc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43078/0 (socket says 172.21.15.33:43078) 2024-08-28T19:33:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd694ea0640 1 -- 172.21.15.33:0/4196691945 learned_addr learned my addr 172.21.15.33:0/4196691945 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd6956a1640 1 --2- 172.21.15.33:0/4196691945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743dd980 0x55e6747ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd6867fc640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd67c0b4df0 0x7fd67c0b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd6956a1640 1 -- 172.21.15.33:0/4196691945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743e5b60 msgr2=0x55e6747ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:16.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd6956a1640 1 --2- 172.21.15.33:0/4196691945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743e5b60 0x55e6747ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd6956a1640 1 -- 172.21.15.33:0/4196691945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 msgr2=0x55e6747adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd6956a1640 1 --2- 172.21.15.33:0/4196691945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd6956a1640 1 -- 172.21.15.33:0/4196691945 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6746c9df0 con 0x55e6743dd980 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.555+0000 7fd695ea2640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd67c0b4df0 0x7fd67c0b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.556+0000 7fd694ea0640 1 --2- 172.21.15.33:0/4196691945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.556+0000 7fd6956a1640 1 --2- 172.21.15.33:0/4196691945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743dd980 0x55e6747ae1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd68000bbc0 tx=0x7fd6800107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ebb845f76f1d557 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.556+0000 7fd6867fc640 1 -- 172.21.15.33:0/146725135 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd6880e4ce0 con 0x7fd690108ad0 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.556+0000 7fd67b7fe640 1 -- 172.21.15.33:0/4196691945 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68001c480 con 0x55e6743dd980 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.556+0000 7fd67b7fe640 1 -- 172.21.15.33:0/4196691945 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6800118f0 con 0x55e6743dd980 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.556+0000 7fd67b7fe640 1 -- 172.21.15.33:0/4196691945 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68001a840 con 0x55e6743dd980 2024-08-28T19:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.557+0000 7fd69de7a740 1 -- 172.21.15.33:0/4196691945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743dd980 msgr2=0x55e6747ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.557+0000 7fd695ea2640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd67c0b4df0 0x7fd67c0b7300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd6880e2190 tx=0x7fd688004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.557+0000 7fd69de7a740 1 --2- 172.21.15.33:0/4196691945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743dd980 0x55e6747ae1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd68000bbc0 tx=0x7fd6800107a0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.557+0000 7fd69de7a740 1 -- 172.21.15.33:0/4196691945 shutdown_connections 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.557+0000 7fd69de7a740 1 --2- 172.21.15.33:0/4196691945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743e5b60 0x55e6747ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.557+0000 7fd69de7a740 1 --2- 172.21.15.33:0/4196691945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743dd980 0x55e6747ae1d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.557+0000 7fd69de7a740 1 --2- 172.21.15.33:0/4196691945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.557+0000 7fd69de7a740 1 -- 172.21.15.33:0/4196691945 >> 172.21.15.33:0/4196691945 conn(0x55e6743fa990 msgr2=0x55e6747abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.557+0000 7fd69de7a740 1 -- 172.21.15.33:0/4196691945 shutdown_connections 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.557+0000 7fd69de7a740 1 -- 172.21.15.33:0/4196691945 wait complete. 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.558+0000 7fd69de7a740 1 -- start start 2024-08-28T19:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.558+0000 7fd69de7a740 1 Processor -- start 2024-08-28T19:33:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6743dd980 0x55e6747b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743e5b60 0x55e6747b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e674406840 0x55e6747c5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd694ea0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6743dd980 0x55e6747b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd694ea0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6743dd980 0x55e6747b9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43092/0 (socket says 172.21.15.33:43092) 2024-08-28T19:33:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd694ea0640 1 -- 172.21.15.33:0/2598848402 learned_addr learned my addr 172.21.15.33:0/2598848402 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e6745747a0 con 0x55e6743dd980 2024-08-28T19:33:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e674698240 con 0x55e6743e5b60 2024-08-28T19:33:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e6747bc470 con 0x55e674406840 2024-08-28T19:33:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd69de7a740 10 client.0 _ll_register_callbacks cb 0x55e67441e090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd6956a1640 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743e5b60 0x55e6747b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd694ea0640 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e674406840 0x55e6747c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd694ea0640 1 -- 172.21.15.33:0/2598848402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e674406840 msgr2=0x55e6747c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd694ea0640 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e674406840 0x55e6747c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd694ea0640 1 -- 172.21.15.33:0/2598848402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743e5b60 msgr2=0x55e6747b99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd694ea0640 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743e5b60 0x55e6747b99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.559+0000 7fd694ea0640 1 -- 172.21.15.33:0/2598848402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6746ce2b0 con 0x55e6743dd980 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.560+0000 7fd694ea0640 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6743dd980 0x55e6747b9490 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009230 tx=0x7fd68c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d656c1125d44ac server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.560+0000 7fd678ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.560+0000 7fd678ff9640 1 -- 172.21.15.33:0/2598848402 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c004b00 con 0x55e6743dd980 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.560+0000 7fd678ff9640 1 -- 172.21.15.33:0/2598848402 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd68c004ca0 con 0x55e6743dd980 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.560+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6800118f0 con 0x55e6743dd980 2024-08-28T19:33:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.560+0000 7fd678ff9640 1 -- 172.21.15.33:0/2598848402 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd68c004ef0 con 0x55e6743dd980 2024-08-28T19:33:16.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.560+0000 7fd69de7a740 10 client.15900 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:16.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.560+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e674480b90 con 0x55e6743dd980 2024-08-28T19:33:16.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.561+0000 7fd678ff9640 1 -- 172.21.15.33:0/2598848402 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd68c030070 con 0x55e6743dd980 2024-08-28T19:33:16.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.561+0000 7fd678ff9640 1 -- 172.21.15.33:0/2598848402 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd68c04a030 con 0x55e6743dd980 2024-08-28T19:33:16.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.561+0000 7fd69de7a740 10 client.15900 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:16.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.561+0000 7fd69de7a740 10 client.15900 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:33:16.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.561+0000 7fd69de7a740 20 client.15900 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:16.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.561+0000 7fd69de7a740 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e6743c51c0 0x55e6747cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.561+0000 7fd69de7a740 4 client.15900 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:16.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.561+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd6800118f0 con 0x55e6743c51c0 2024-08-28T19:33:16.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.561+0000 7fd6956a1640 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e6743c51c0 0x55e6747cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.562+0000 7fd678ff9640 10 client.15900 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:16.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.563+0000 7fd6956a1640 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e6743c51c0 0x55e6747cb5d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce2f3e414686a5c5 server_cookie=3767e63a2ed9388b in_seq=0 out_seq=0 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd678ff9640 1 -- 172.21.15.33:0/2598848402 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd6800118f0 con 0x55e6743c51c0 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd678ff9640 10 client.15900 handle_command_reply: tid=0 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd69de7a740 1 client.15900 shutdown 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6743dd980 msgr2=0x55e6747b9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd69de7a740 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6743dd980 0x55e6747b9490 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009230 tx=0x7fd68c005f30 comp rx=0 tx=0).stop 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 shutdown_connections 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd69de7a740 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e674406840 0x55e6747c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd69de7a740 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743e5b60 0x55e6747b99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd69de7a740 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e6743c51c0 0x55e6747cb5d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd69de7a740 1 --2- 172.21.15.33:0/2598848402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6743dd980 0x55e6747b9490 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd678ff9640 0 client.15900 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:16.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.564+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 >> 172.21.15.33:0/2598848402 conn(0x55e6743fa990 msgr2=0x55e6747b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:16.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.565+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 shutdown_connections 2024-08-28T19:33:16.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.565+0000 7fd69de7a740 1 -- 172.21.15.33:0/2598848402 wait complete. 2024-08-28T19:33:16.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.565+0000 7fd69de7a740 20 client.15900 trim_cache size 0 max 16384 2024-08-28T19:33:16.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.584+0000 7fd69de7a740 1 Processor -- start 2024-08-28T19:33:16.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.584+0000 7fd69de7a740 1 -- start start 2024-08-28T19:33:16.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.585+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 0x55e6747bb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.585+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 0x55e6747b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.585+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.585+0000 7fd69de7a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b7220 con 0x55e674406840 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.585+0000 7fd694ea0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 0x55e6747bb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.586+0000 7fd694ea0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 0x55e6747bb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:44462/0 (socket says 172.21.15.33:44462) 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.586+0000 7fd694ea0640 1 -- 172.21.15.33:0/3425369638 learned_addr learned my addr 172.21.15.33:0/3425369638 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.586+0000 7fd6956a1640 1 --2- 172.21.15.33:0/3425369638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 0x55e6747b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.586+0000 7fd69de7a740 1 -- 172.21.15.33:0/3425369638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b8d60 con 0x55e6743dd980 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.586+0000 7fd69de7a740 1 -- 172.21.15.33:0/3425369638 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b78f0 con 0x55e6743e5b60 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.586+0000 7fd694ea0640 1 --2- 172.21.15.33:0/3425369638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.586+0000 7fd694ea0640 1 -- 172.21.15.33:0/3425369638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 msgr2=0x55e6747b98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.586+0000 7fd694ea0640 1 --2- 172.21.15.33:0/3425369638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 0x55e6747b98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.586+0000 7fd694ea0640 1 -- 172.21.15.33:0/3425369638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 msgr2=0x55e6747aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.586+0000 7fd694ea0640 1 --2- 172.21.15.33:0/3425369638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747aaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.587+0000 7fd694ea0640 1 -- 172.21.15.33:0/3425369638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6746e1d90 con 0x55e6743dd980 2024-08-28T19:33:16.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.587+0000 7fd6956a1640 1 --2- 172.21.15.33:0/3425369638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 0x55e6747b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:16.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.587+0000 7fd694ea0640 1 --2- 172.21.15.33:0/3425369638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 0x55e6747bb370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0044b0 tx=0x7fd68c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8933ce772bd800f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:16.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.587+0000 7fd67affd640 1 -- 172.21.15.33:0/3425369638 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c004d10 con 0x55e6743dd980 2024-08-28T19:33:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.587+0000 7fd67affd640 1 -- 172.21.15.33:0/3425369638 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd68c030020 con 0x55e6743dd980 2024-08-28T19:33:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.587+0000 7fd67affd640 1 -- 172.21.15.33:0/3425369638 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c0416a0 con 0x55e6743dd980 2024-08-28T19:33:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.588+0000 7fd69de7a740 1 -- 172.21.15.33:0/3425369638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 msgr2=0x55e6747bb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.588+0000 7fd69de7a740 1 --2- 172.21.15.33:0/3425369638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 0x55e6747bb370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0044b0 tx=0x7fd68c000bc0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.588+0000 7fd69de7a740 1 -- 172.21.15.33:0/3425369638 shutdown_connections 2024-08-28T19:33:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.588+0000 7fd69de7a740 1 --2- 172.21.15.33:0/3425369638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.588+0000 7fd69de7a740 1 --2- 172.21.15.33:0/3425369638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 0x55e6747b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.588+0000 7fd69de7a740 1 --2- 172.21.15.33:0/3425369638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 0x55e6747bb370 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.588+0000 7fd69de7a740 1 -- 172.21.15.33:0/3425369638 >> 172.21.15.33:0/3425369638 conn(0x55e6743fa990 msgr2=0x55e6747aa340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.589+0000 7fd69de7a740 1 -- 172.21.15.33:0/3425369638 shutdown_connections 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.589+0000 7fd69de7a740 1 -- 172.21.15.33:0/3425369638 wait complete. 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.589+0000 7fd69de7a740 1 -- start start 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.589+0000 7fd69de7a740 1 Processor -- start 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 0x55e6747c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 0x55e6747c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd69de7a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747bc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd69de7a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b8690 con 0x55e674406840 2024-08-28T19:33:16.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd69de7a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b7fc0 con 0x55e6743dd980 2024-08-28T19:33:16.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd69de7a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b5200 con 0x55e6743e5b60 2024-08-28T19:33:16.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd69de7a740 10 client.0 _ll_register_callbacks cb 0x7fd68c00d650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:16.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd6956a1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 0x55e6747c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd694ea0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747bc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd6956a1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 0x55e6747c1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:52170/0 (socket says 172.21.15.33:52170) 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd6956a1640 1 -- 172.21.15.33:0/911483109 learned_addr learned my addr 172.21.15.33:0/911483109 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd694ea0640 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 0x55e6747c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd694ea0640 1 -- 172.21.15.33:0/911483109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 msgr2=0x55e6747c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.590+0000 7fd694ea0640 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 0x55e6747c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.591+0000 7fd694ea0640 1 -- 172.21.15.33:0/911483109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 msgr2=0x55e6747c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.591+0000 7fd694ea0640 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 0x55e6747c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.591+0000 7fd694ea0640 1 -- 172.21.15.33:0/911483109 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6747bcec0 con 0x55e674406840 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.591+0000 7fd694ea0640 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747bc730 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd68c02cb40 tx=0x7fd68c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515441d02009d025 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:16.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.591+0000 7fd678ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.591+0000 7fd678ff9640 1 -- 172.21.15.33:0/911483109 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c05d040 con 0x55e674406840 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.591+0000 7fd678ff9640 1 -- 172.21.15.33:0/911483109 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd68c003800 con 0x55e674406840 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.591+0000 7fd69de7a740 1 -- 172.21.15.33:0/911483109 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd68c030020 con 0x55e674406840 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd678ff9640 1 -- 172.21.15.33:0/911483109 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd68c003a00 con 0x55e674406840 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd69de7a740 10 client.15906 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd69de7a740 1 -- 172.21.15.33:0/911483109 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e674836970 con 0x55e674406840 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd678ff9640 1 -- 172.21.15.33:0/911483109 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd68c030020 con 0x55e674406840 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd678ff9640 1 -- 172.21.15.33:0/911483109 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd68c04a070 con 0x55e674406840 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd69de7a740 10 client.15906 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd69de7a740 10 client.15906 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd69de7a740 20 client.15906 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd69de7a740 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e67439a570 0x55e674838f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:16.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd69de7a740 4 client.15906 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.4, "await_for": 45.0}] 2024-08-28T19:33:16.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.592+0000 7fd69de7a740 1 -- 172.21.15.33:0/911483109 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.4, "await_for": 45.0}) -- 0x55e674724280 con 0x55e67439a570 2024-08-28T19:33:16.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.593+0000 7fd6956a1640 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e67439a570 0x55e674838f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:16.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.593+0000 7fd6956a1640 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e67439a570 0x55e674838f50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4d9dfb24476ce7 server_cookie=d42810725402c2b5 in_seq=0 out_seq=0 2024-08-28T19:33:16.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.593+0000 7fd678ff9640 10 client.15906 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:16.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.605+0000 7fd678ff9640 1 -- 172.21.15.33:0/911483109 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e674724280 con 0x55e67439a570 2024-08-28T19:33:16.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.605+0000 7fd678ff9640 10 client.15906 handle_command_reply: tid=0 2024-08-28T19:33:16.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.605+0000 7fd69de7a740 1 client.15906 shutdown 2024-08-28T19:33:16.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.605+0000 7fd69de7a740 1 -- 172.21.15.33:0/911483109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 msgr2=0x55e6747bc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:16.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.605+0000 7fd69de7a740 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747bc730 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd68c02cb40 tx=0x7fd68c005fd0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.606+0000 7fd69de7a740 1 -- 172.21.15.33:0/911483109 shutdown_connections 2024-08-28T19:33:16.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.606+0000 7fd69de7a740 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e67439a570 0x55e674838f50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.606+0000 7fd678ff9640 0 client.15906 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:16.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.606+0000 7fd69de7a740 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e674406840 0x55e6747bc730 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.606+0000 7fd69de7a740 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6743e5b60 0x55e6747c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.606+0000 7fd69de7a740 1 --2- 172.21.15.33:0/911483109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6743dd980 0x55e6747c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.606+0000 7fd69de7a740 1 -- 172.21.15.33:0/911483109 >> 172.21.15.33:0/911483109 conn(0x55e6743fa990 msgr2=0x55e6747aaad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:16.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.606+0000 7fd69de7a740 1 -- 172.21.15.33:0/911483109 shutdown_connections 2024-08-28T19:33:16.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.606+0000 7fd69de7a740 1 -- 172.21.15.33:0/911483109 wait complete. 2024-08-28T19:33:16.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.606+0000 7fd69de7a740 20 client.15906 trim_cache size 0 max 16384 2024-08-28T19:33:16.608 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:33:16.608 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:33:16.608 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:33:16.608 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 2, 2024-08-28T19:33:16.608 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:33:16.608 INFO:teuthology.orchestra.run.smithi033.stdout: "13983a21": { 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 2, 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 154.4, 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:33:16.609 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:33:16.610 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:33:16.610 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:16.610 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:16.610 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:16.610 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:16.610 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:16.610 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:33:16.610 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 -- 172.21.15.33:0/146725135 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd67c0b4df0 msgr2=0x7fd67c0b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd67c0b4df0 0x7fd67c0b7300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd6880e2190 tx=0x7fd688004a40 comp rx=0 tx=0).stop 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 -- 172.21.15.33:0/146725135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd690108ad0 msgr2=0x7fd690110790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd690108ad0 0x7fd690110790 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd68800b970 tx=0x7fd68800be30 comp rx=0 tx=0).stop 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 -- 172.21.15.33:0/146725135 shutdown_connections 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd690108ad0 0x7fd690110790 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd67c0b4df0 0x7fd67c0b7300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd690108180 0x7fd690110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 --2- 172.21.15.33:0/146725135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd690102890 0x7fd690113d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 -- 172.21.15.33:0/146725135 >> 172.21.15.33:0/146725135 conn(0x7fd6900795d0 msgr2=0x7fd690106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 -- 172.21.15.33:0/146725135 shutdown_connections 2024-08-28T19:33:16.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:16.608+0000 7fd697905640 1 -- 172.21.15.33:0/146725135 wait complete. 2024-08-28T19:33:17.111 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:16 smithi033 ceph-mon[18549]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:33:17.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:16 smithi059 ceph-mon[22052]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:33:17.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:16 smithi122 ceph-mon[22174]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:33:17.675 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '13983a21', quiesce took 6.5 seconds. Will release after: 27.9 2024-08-28T19:33:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.100+0000 7ff9ff197640 1 -- 172.21.15.33:0/2149479211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9f8108a90 msgr2=0x7ff9f810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.100+0000 7ff9ff197640 1 --2- 172.21.15.33:0/2149479211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9f8108a90 0x7ff9f810f2c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009ca0 tx=0x7ff9f002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.100+0000 7ff9ff197640 1 -- 172.21.15.33:0/2149479211 shutdown_connections 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.100+0000 7ff9ff197640 1 --2- 172.21.15.33:0/2149479211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9f8108a90 0x7ff9f810f2c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.100+0000 7ff9ff197640 1 --2- 172.21.15.33:0/2149479211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9f8108140 0x7ff9f8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.100+0000 7ff9ff197640 1 --2- 172.21.15.33:0/2149479211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9f8102800 0x7ff9f8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.100+0000 7ff9ff197640 1 -- 172.21.15.33:0/2149479211 >> 172.21.15.33:0/2149479211 conn(0x7ff9f80794d0 msgr2=0x7ff9f80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.101+0000 7ff9ff197640 1 -- 172.21.15.33:0/2149479211 shutdown_connections 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.101+0000 7ff9ff197640 1 -- 172.21.15.33:0/2149479211 wait complete. 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.101+0000 7ff9ff197640 1 Processor -- start 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9ff197640 1 -- start start 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9ff197640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9f8102800 0x7ff9f819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9ff197640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9f8108140 0x7ff9f819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9ff197640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9f8108a90 0x7ff9f819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9ff197640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f8112740 con 0x7ff9f8102800 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9ff197640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81125c0 con 0x7ff9f8108a90 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9ff197640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81128c0 con 0x7ff9f8108140 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9fcf33640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9f8102800 0x7ff9f819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9fcf33640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9f8102800 0x7ff9f819a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43144/0 (socket says 172.21.15.33:43144) 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9fcf33640 1 -- 172.21.15.33:0/575461553 learned_addr learned my addr 172.21.15.33:0/575461553 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9fd734640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9f8108a90 0x7ff9f819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9f8108140 0x7ff9f819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9fcf33640 1 -- 172.21.15.33:0/575461553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9f8108140 msgr2=0x7ff9f819a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9f8108140 0x7ff9f819a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9fcf33640 1 -- 172.21.15.33:0/575461553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9f8108a90 msgr2=0x7ff9f819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9f8108a90 0x7ff9f819fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.102+0000 7ff9fcf33640 1 -- 172.21.15.33:0/575461553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f81a0130 con 0x7ff9f8102800 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.103+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9f8102800 0x7ff9f819a280 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00d950 tx=0x7ff9ec00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.103+0000 7ff9f5ffb640 1 -- 172.21.15.33:0/575461553 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec017030 con 0x7ff9f8102800 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.104+0000 7ff9ff197640 1 -- 172.21.15.33:0/575461553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f81a0420 con 0x7ff9f8102800 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.104+0000 7ff9f5ffb640 1 -- 172.21.15.33:0/575461553 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9ec004020 con 0x7ff9f8102800 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.104+0000 7ff9f5ffb640 1 -- 172.21.15.33:0/575461553 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec005560 con 0x7ff9f8102800 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.104+0000 7ff9ff197640 1 -- 172.21.15.33:0/575461553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f81a6c40 con 0x7ff9f8102800 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.107+0000 7ffa0570c740 1 Processor -- start 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.107+0000 7ffa0570c740 1 -- start start 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.107+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d41350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.107+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a129731b0 0x559a12d41890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.107+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d41dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.107+0000 7ffa0570c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559a12cb8680 con 0x559a1299c070 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.107+0000 7ffa0570c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559a12ca7c10 con 0x559a129731b0 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.107+0000 7ffa0570c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559a12cabbc0 con 0x559a1297b390 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9f7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d41dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9f7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d41dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:52192/0 (socket says 172.21.15.33:52192) 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9f7fff640 1 -- 172.21.15.33:0/4253660008 learned_addr learned my addr 172.21.15.33:0/4253660008 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9f5ffb640 1 -- 172.21.15.33:0/575461553 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff9ec009a30 con 0x7ff9f8102800 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9fd734640 1 --2- 172.21.15.33:0/4253660008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d41350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9f7fff640 1 -- 172.21.15.33:0/4253660008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a129731b0 msgr2=0x559a12d41890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/4253660008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a129731b0 0x559a12d41890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9f7fff640 1 -- 172.21.15.33:0/4253660008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 msgr2=0x559a12d41350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/4253660008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d41350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9f7fff640 1 -- 172.21.15.33:0/4253660008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a12a07650 con 0x559a1297b390 2024-08-28T19:33:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9fd734640 1 --2- 172.21.15.33:0/4253660008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d41350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.108+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/4253660008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d41dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400abf0 tx=0x7ff9e400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b34dfd003d0528c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.109+0000 7ff9f5ffb640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff9e80b4dd0 0x7ff9e80b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.109+0000 7ff9e2ffd640 1 -- 172.21.15.33:0/4253660008 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e401d070 con 0x559a1297b390 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.109+0000 7ff9f5ffb640 1 -- 172.21.15.33:0/575461553 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff9ec0e4b20 con 0x7ff9f8102800 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.109+0000 7ff9fd734640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff9e80b4dd0 0x7ff9e80b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.109+0000 7ff9e2ffd640 1 -- 172.21.15.33:0/4253660008 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e4018af0 con 0x559a1297b390 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.109+0000 7ff9e2ffd640 1 -- 172.21.15.33:0/4253660008 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4010ad0 con 0x559a1297b390 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.110+0000 7ff9fd734640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff9e80b4dd0 0x7ff9e80b72e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0006010 tx=0x7ff9f0005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.110+0000 7ffa0570c740 1 -- 172.21.15.33:0/4253660008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 msgr2=0x559a12d41dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.110+0000 7ffa0570c740 1 --2- 172.21.15.33:0/4253660008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d41dd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400abf0 tx=0x7ff9e400f790 comp rx=0 tx=0).stop 2024-08-28T19:33:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.110+0000 7ffa0570c740 1 -- 172.21.15.33:0/4253660008 shutdown_connections 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.110+0000 7ffa0570c740 1 --2- 172.21.15.33:0/4253660008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d41dd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.110+0000 7ffa0570c740 1 --2- 172.21.15.33:0/4253660008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a129731b0 0x559a12d41890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.110+0000 7ffa0570c740 1 --2- 172.21.15.33:0/4253660008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d41350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.110+0000 7ffa0570c740 1 -- 172.21.15.33:0/4253660008 >> 172.21.15.33:0/4253660008 conn(0x559a12990460 msgr2=0x559a12d3f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.110+0000 7ffa0570c740 1 -- 172.21.15.33:0/4253660008 shutdown_connections 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.111+0000 7ffa0570c740 1 -- 172.21.15.33:0/4253660008 wait complete. 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.111+0000 7ffa0570c740 1 -- start start 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.111+0000 7ffa0570c740 1 Processor -- start 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.112+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d50f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d51450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ff9fcf33640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d50f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ff9fcf33640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d50f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43156/0 (socket says 172.21.15.33:43156) 2024-08-28T19:33:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ff9fcf33640 1 -- 172.21.15.33:0/1687285961 learned_addr learned my addr 172.21.15.33:0/1687285961 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 0x559a12d5d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559a12b0a700 con 0x559a129731b0 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559a12c2e750 con 0x559a1299c070 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d51450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559a12d53e90 con 0x559a1297b390 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ff9f7fff640 1 -- 172.21.15.33:0/1687285961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 msgr2=0x559a12d5d1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.113+0000 7ffa0570c740 10 client.0 _ll_register_callbacks cb 0x559a12c5de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ff9fd734640 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 0x559a12d5d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 0x559a12d5d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ff9f7fff640 1 -- 172.21.15.33:0/1687285961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 msgr2=0x559a12d50f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d50f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ff9f7fff640 1 -- 172.21.15.33:0/1687285961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a12c67900 con 0x559a1297b390 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d50f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e4018af0 con 0x559a1297b390 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d51450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40106b0 tx=0x7ff9e400a910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51c129fb7a532fa8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ff9d7fff640 10 client.25474 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ff9d7fff640 1 -- 172.21.15.33:0/1687285961 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4027020 con 0x559a1297b390 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.114+0000 7ff9d7fff640 1 -- 172.21.15.33:0/1687285961 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff9e40186c0 con 0x559a1297b390 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.115+0000 7ff9d7fff640 1 -- 172.21.15.33:0/1687285961 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff9e401d040 con 0x559a1297b390 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.115+0000 7ffa0570c740 10 client.25474 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.115+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559a12d5fbc0 con 0x559a1297b390 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.115+0000 7ff9d7fff640 1 -- 172.21.15.33:0/1687285961 <== mon.1 v2:172.21.15.122:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff9e4005040 con 0x559a1297b390 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.115+0000 7ffa0570c740 10 client.25474 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.115+0000 7ffa0570c740 10 client.25474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:33:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.115+0000 7ffa0570c740 20 client.25474 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.115+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559a1295a9f0 0x559a12d62f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.115+0000 7ffa0570c740 4 client.25474 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.115+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a12cba5d0 con 0x559a1295a9f0 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.116+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559a1295a9f0 0x559a12d62f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.116+0000 7ff9d7fff640 10 client.25474 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.116+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559a1295a9f0 0x559a12d62f20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3423863a3ff57531 server_cookie=b6c13b65b5432623 in_seq=0 out_seq=0 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.117+0000 7ff9d7fff640 1 -- 172.21.15.33:0/1687285961 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a12cba5d0 con 0x559a1295a9f0 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.117+0000 7ff9d7fff640 10 client.25474 handle_command_reply: tid=0 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.117+0000 7ffa0570c740 1 client.25474 shutdown 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.117+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 msgr2=0x559a12d51450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.117+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d51450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40106b0 tx=0x7ff9e400a910 comp rx=0 tx=0).stop 2024-08-28T19:33:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.117+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 shutdown_connections 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.118+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 0x559a12d5d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.118+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d51450 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.118+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559a1295a9f0 0x559a12d62f20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.118+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1687285961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d50f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.118+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 >> 172.21.15.33:0/1687285961 conn(0x559a12990460 msgr2=0x559a12d42d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.118+0000 7ff9d7fff640 0 client.25474 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.118+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 shutdown_connections 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.118+0000 7ffa0570c740 1 -- 172.21.15.33:0/1687285961 wait complete. 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.118+0000 7ffa0570c740 20 client.25474 trim_cache size 0 max 16384 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.131+0000 7ffa0570c740 1 Processor -- start 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.131+0000 7ffa0570c740 1 -- start start 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.131+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d513d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.131+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d5d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 0x559a12d4e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ffa0570c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81ae950 con 0x559a129731b0 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ffa0570c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81b0490 con 0x559a1299c070 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fcf33640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ffa0570c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81af020 con 0x559a1297b390 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fcf33640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43168/0 (socket says 172.21.15.33:43168) 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fcf33640 1 -- 172.21.15.33:0/1375480569 learned_addr learned my addr 172.21.15.33:0/1375480569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/1375480569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d5d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fd734640 1 --2- 172.21.15.33:0/1375480569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 0x559a12d4e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fcf33640 1 -- 172.21.15.33:0/1375480569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 msgr2=0x559a12d5d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/1375480569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d5d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fcf33640 1 -- 172.21.15.33:0/1375480569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 msgr2=0x559a12d4e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/1375480569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 0x559a12d4e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fcf33640 1 -- 172.21.15.33:0/1375480569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a12d521d0 con 0x559a129731b0 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fd734640 1 --2- 172.21.15.33:0/1375480569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 0x559a12d4e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.132+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/1375480569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d513d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0a80d0 tx=0x7ff9ec0aad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a286ff2c0fb1852 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.133+0000 7ff9e27fc640 1 -- 172.21.15.33:0/1375480569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0af6d0 con 0x559a129731b0 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.133+0000 7ff9e27fc640 1 -- 172.21.15.33:0/1375480569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9ec0b4180 con 0x559a129731b0 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.133+0000 7ff9e27fc640 1 -- 172.21.15.33:0/1375480569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0a70f0 con 0x559a129731b0 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.134+0000 7ffa0570c740 1 -- 172.21.15.33:0/1375480569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 msgr2=0x559a12d513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.134+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1375480569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d513d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0a80d0 tx=0x7ff9ec0aad50 comp rx=0 tx=0).stop 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.134+0000 7ffa0570c740 1 -- 172.21.15.33:0/1375480569 shutdown_connections 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.134+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1375480569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a1299c070 0x559a12d4e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.134+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1375480569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d5d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.134+0000 7ffa0570c740 1 --2- 172.21.15.33:0/1375480569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a129731b0 0x559a12d513d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.134+0000 7ffa0570c740 1 -- 172.21.15.33:0/1375480569 >> 172.21.15.33:0/1375480569 conn(0x559a12990460 msgr2=0x559a12d50cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.134+0000 7ffa0570c740 1 -- 172.21.15.33:0/1375480569 shutdown_connections 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.134+0000 7ffa0570c740 1 -- 172.21.15.33:0/1375480569 wait complete. 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.134+0000 7ffa0570c740 1 -- start start 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.135+0000 7ffa0570c740 1 Processor -- start 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.135+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a129731b0 0x559a12d667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.135+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d63c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.135+0000 7ffa0570c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d64240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.135+0000 7ffa0570c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81afdc0 con 0x559a1299c070 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.135+0000 7ff9fd734640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d64240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.135+0000 7ff9fd734640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d64240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43174/0 (socket says 172.21.15.33:43174) 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.135+0000 7ff9fd734640 1 -- 172.21.15.33:0/862230334 learned_addr learned my addr 172.21.15.33:0/862230334 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.135+0000 7ffa0570c740 1 -- 172.21.15.33:0/862230334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81af6f0 con 0x559a129731b0 2024-08-28T19:33:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.135+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a129731b0 0x559a12d667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d63c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ffa0570c740 1 -- 172.21.15.33:0/862230334 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81ac930 con 0x559a1297b390 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ffa0570c740 10 client.0 _ll_register_callbacks cb 0x7ff9e401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ff9fd734640 1 -- 172.21.15.33:0/862230334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 msgr2=0x559a12d63c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ff9fd734640 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d63c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ff9fd734640 1 -- 172.21.15.33:0/862230334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a129731b0 msgr2=0x559a12d667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ff9fd734640 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a129731b0 0x559a12d667b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ff9fd734640 1 -- 172.21.15.33:0/862230334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a12d649d0 con 0x559a1299c070 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ff9f7fff640 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d63c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ffa0570c740 1 -- 172.21.15.33:0/862230334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9ec0b4180 con 0x559a1299c070 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ff9fd734640 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d64240 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff9f002aeb0 tx=0x7ff9f002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5e897273aaa788 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.136+0000 7ff9d7fff640 10 client.15924 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ff9d7fff640 1 -- 172.21.15.33:0/862230334 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0057060 con 0x559a1299c070 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ff9d7fff640 1 -- 172.21.15.33:0/862230334 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff9f002f610 con 0x559a1299c070 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ff9d7fff640 1 -- 172.21.15.33:0/862230334 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff9f002f810 con 0x559a1299c070 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ffa0570c740 10 client.15924 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ffa0570c740 1 -- 172.21.15.33:0/862230334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559a12dcd4e0 con 0x559a1299c070 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ff9d7fff640 1 -- 172.21.15.33:0/862230334 <== mon.0 v2:172.21.15.33:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff9f002f9b0 con 0x559a1299c070 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ffa0570c740 10 client.15924 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ffa0570c740 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ffa0570c740 20 client.15924 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ffa0570c740 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559a1292fda0 0x559a12dcfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ffa0570c740 4 client.15924 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.137+0000 7ffa0570c740 1 -- 172.21.15.33:0/862230334 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a12cb6070 con 0x559a1292fda0 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.138+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559a1292fda0 0x559a12dcfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.138+0000 7ff9d7fff640 10 client.15924 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.138+0000 7ff9fcf33640 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559a1292fda0 0x559a12dcfb00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d16c30aa6630b817 server_cookie=9840955b0f1b2505 in_seq=0 out_seq=0 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ff9d7fff640 1 -- 172.21.15.33:0/862230334 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a12cb6070 con 0x559a1292fda0 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ff9d7fff640 10 client.15924 handle_command_reply: tid=0 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 client.15924 shutdown 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 -- 172.21.15.33:0/862230334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 msgr2=0x559a12d64240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d64240 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff9f002aeb0 tx=0x7ff9f002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 -- 172.21.15.33:0/862230334 shutdown_connections 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559a1292fda0 0x559a12dcfb00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559a1299c070 0x559a12d64240 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559a1297b390 0x559a12d63c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 --2- 172.21.15.33:0/862230334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a129731b0 0x559a12d667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 -- 172.21.15.33:0/862230334 >> 172.21.15.33:0/862230334 conn(0x559a12990460 msgr2=0x559a12d42cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ff9d7fff640 0 client.15924 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 -- 172.21.15.33:0/862230334 shutdown_connections 2024-08-28T19:33:18.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.139+0000 7ffa0570c740 1 -- 172.21.15.33:0/862230334 wait complete. 2024-08-28T19:33:18.835 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:33:18.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ffa0570c740 20 client.15924 trim_cache size 0 max 16384 2024-08-28T19:33:18.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 -- 172.21.15.33:0/575461553 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff9e80b4dd0 msgr2=0x7ff9e80b72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:18.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff9e80b4dd0 0x7ff9e80b72e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0006010 tx=0x7ff9f0005d80 comp rx=0 tx=0).stop 2024-08-28T19:33:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 -- 172.21.15.33:0/575461553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9f8102800 msgr2=0x7ff9f819a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9f8102800 0x7ff9f819a280 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00d950 tx=0x7ff9ec00dd50 comp rx=0 tx=0).stop 2024-08-28T19:33:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 -- 172.21.15.33:0/575461553 shutdown_connections 2024-08-28T19:33:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9f8108a90 0x7ff9f819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff9e80b4dd0 0x7ff9e80b72e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff9f8108140 0x7ff9f819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 --2- 172.21.15.33:0/575461553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9f8102800 0x7ff9f819a280 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 -- 172.21.15.33:0/575461553 >> 172.21.15.33:0/575461553 conn(0x7ff9f80794d0 msgr2=0x7ff9f8103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 -- 172.21.15.33:0/575461553 shutdown_connections 2024-08-28T19:33:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:18.140+0000 7ff9ff197640 1 -- 172.21.15.33:0/575461553 wait complete. 2024-08-28T19:33:19.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:18 smithi033 ceph-mon[18549]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-08-28T19:33:19.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:18 smithi059 ceph-mon[22052]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-08-28T19:33:19.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:18 smithi122 ceph-mon[22174]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-08-28T19:33:21.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:20 smithi033 ceph-mon[18549]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-28T19:33:21.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:20 smithi059 ceph-mon[22052]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-28T19:33:21.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:20 smithi122 ceph-mon[22174]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-28T19:33:22.900 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:33:22.901 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:33:23.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:22 smithi033 ceph-mon[18549]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-28T19:33:23.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:22 smithi059 ceph-mon[22052]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-28T19:33:23.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:22 smithi122 ceph-mon[22174]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-28T19:33:23.307 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:23.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.851+0000 7f81958eb640 1 -- 172.21.15.33:0/2403618012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8190104750 msgr2=0x7f8190104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:23.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.851+0000 7f81958eb640 1 --2- 172.21.15.33:0/2403618012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8190104750 0x7f8190104b60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8180009900 tx=0x7f818002a410 comp rx=0 tx=0).stop 2024-08-28T19:33:23.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.851+0000 7f81958eb640 1 -- 172.21.15.33:0/2403618012 shutdown_connections 2024-08-28T19:33:23.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.851+0000 7f81958eb640 1 --2- 172.21.15.33:0/2403618012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f819010dbb0 0x7f81901100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.851+0000 7f81958eb640 1 --2- 172.21.15.33:0/2403618012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81901050a0 0x7f819010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.851+0000 7f81958eb640 1 --2- 172.21.15.33:0/2403618012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8190104750 0x7f8190104b60 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.851+0000 7f81958eb640 1 -- 172.21.15.33:0/2403618012 >> 172.21.15.33:0/2403618012 conn(0x7f81900794d0 msgr2=0x7f81900798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:23.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.851+0000 7f81958eb640 1 -- 172.21.15.33:0/2403618012 shutdown_connections 2024-08-28T19:33:23.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.852+0000 7f81958eb640 1 -- 172.21.15.33:0/2403618012 wait complete. 2024-08-28T19:33:23.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.852+0000 7f81958eb640 1 Processor -- start 2024-08-28T19:33:23.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f81958eb640 1 -- start start 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f81958eb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8190104750 0x7f81901a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f81958eb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81901050a0 0x7f81901a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f81958eb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f819010dbb0 0x7f81901a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f81958eb640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8190111620 con 0x7f819010dbb0 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f81958eb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f81901114a0 con 0x7f8190104750 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f81958eb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81901117a0 con 0x7f81901050a0 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f819010dbb0 0x7f81901a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f819010dbb0 0x7f81901a6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52186/0 (socket says 172.21.15.33:52186) 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f818f7fe640 1 -- 172.21.15.33:0/1827007762 learned_addr learned my addr 172.21.15.33:0/1827007762 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.853+0000 7f818e7fc640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81901050a0 0x7f81901a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.854+0000 7f818e7fc640 1 -- 172.21.15.33:0/1827007762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8190104750 msgr2=0x7f81901a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.854+0000 7f818effd640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8190104750 0x7f81901a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.854+0000 7f818e7fc640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8190104750 0x7f81901a0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.854+0000 7f818e7fc640 1 -- 172.21.15.33:0/1827007762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f819010dbb0 msgr2=0x7f81901a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:23.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.854+0000 7f818e7fc640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f819010dbb0 0x7f81901a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.854+0000 7f818e7fc640 1 -- 172.21.15.33:0/1827007762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81901a67b0 con 0x7f81901050a0 2024-08-28T19:33:23.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.854+0000 7f818f7fe640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f819010dbb0 0x7f81901a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:23.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.854+0000 7f818e7fc640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81901050a0 0x7f81901a0de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8184005fd0 tx=0x7f818400dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:23.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.854+0000 7f81948e9640 1 -- 172.21.15.33:0/1827007762 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184009c00 con 0x7f81901050a0 2024-08-28T19:33:23.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.854+0000 7f81948e9640 1 -- 172.21.15.33:0/1827007762 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8184009da0 con 0x7f81901050a0 2024-08-28T19:33:23.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.855+0000 7f81948e9640 1 -- 172.21.15.33:0/1827007762 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184003e10 con 0x7f81901050a0 2024-08-28T19:33:23.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.855+0000 7f81958eb640 1 -- 172.21.15.33:0/1827007762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81901a6aa0 con 0x7f81901050a0 2024-08-28T19:33:23.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.855+0000 7f81958eb640 1 -- 172.21.15.33:0/1827007762 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81901ad200 con 0x7f81901050a0 2024-08-28T19:33:23.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.858+0000 7f81948e9640 1 -- 172.21.15.33:0/1827007762 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8184004000 con 0x7f81901050a0 2024-08-28T19:33:23.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.858+0000 7f819be60740 1 Processor -- start 2024-08-28T19:33:23.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.858+0000 7f819be60740 1 -- start start 2024-08-28T19:33:23.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.858+0000 7f81948e9640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81780b4d20 0x7f81780b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.859+0000 7f81948e9640 1 -- 172.21.15.33:0/1827007762 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f81840e5840 con 0x7f81901050a0 2024-08-28T19:33:23.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.859+0000 7f818f7fe640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81780b4d20 0x7f81780b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.860+0000 7f818f7fe640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81780b4d20 0x7f81780b7230 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f81880049d0 tx=0x7f8188009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:23.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.860+0000 7f819be60740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c0ad350 0x56358c453780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.860+0000 7f819be60740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c453cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.860+0000 7f819be60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c08c670 0x56358c454200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.860+0000 7f818e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c453cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.860+0000 7f819be60740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56358c3c95f0 con 0x56358c084490 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.860+0000 7f819be60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56358c3b8b80 con 0x56358c08c670 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.860+0000 7f819be60740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56358c3bcb30 con 0x56358c0ad350 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.860+0000 7f818e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c453cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52192/0 (socket says 172.21.15.33:52192) 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.860+0000 7f818e7fc640 1 -- 172.21.15.33:0/3706756383 learned_addr learned my addr 172.21.15.33:0/3706756383 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.861+0000 7f818e7fc640 1 -- 172.21.15.33:0/3706756383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c0ad350 msgr2=0x56358c453780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.861+0000 7f818e7fc640 1 --2- 172.21.15.33:0/3706756383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c0ad350 0x56358c453780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.861+0000 7f818e7fc640 1 -- 172.21.15.33:0/3706756383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c08c670 msgr2=0x56358c454200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.861+0000 7f818e7fc640 1 --2- 172.21.15.33:0/3706756383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c08c670 0x56358c454200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.861+0000 7f818e7fc640 1 -- 172.21.15.33:0/3706756383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56358c118930 con 0x56358c084490 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.861+0000 7f818e7fc640 1 --2- 172.21.15.33:0/3706756383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c453cc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f818400bf50 tx=0x7f81840a7b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376052594bfc5679 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.861+0000 7f8175ffb640 1 -- 172.21.15.33:0/3706756383 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184020070 con 0x56358c084490 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.861+0000 7f8175ffb640 1 -- 172.21.15.33:0/3706756383 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81840b4ea0 con 0x56358c084490 2024-08-28T19:33:23.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.861+0000 7f8175ffb640 1 -- 172.21.15.33:0/3706756383 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81840e5430 con 0x56358c084490 2024-08-28T19:33:23.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.863+0000 7f819be60740 1 -- 172.21.15.33:0/3706756383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 msgr2=0x56358c453cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:23.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.863+0000 7f819be60740 1 --2- 172.21.15.33:0/3706756383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c453cc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f818400bf50 tx=0x7f81840a7b70 comp rx=0 tx=0).stop 2024-08-28T19:33:23.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.863+0000 7f819be60740 1 -- 172.21.15.33:0/3706756383 shutdown_connections 2024-08-28T19:33:23.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.863+0000 7f819be60740 1 --2- 172.21.15.33:0/3706756383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c08c670 0x56358c454200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.863+0000 7f819be60740 1 --2- 172.21.15.33:0/3706756383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c453cc0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.863+0000 7f819be60740 1 --2- 172.21.15.33:0/3706756383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c0ad350 0x56358c453780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.863+0000 7f819be60740 1 -- 172.21.15.33:0/3706756383 >> 172.21.15.33:0/3706756383 conn(0x56358c0a1740 msgr2=0x56358c451670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:23.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.863+0000 7f819be60740 1 -- 172.21.15.33:0/3706756383 shutdown_connections 2024-08-28T19:33:23.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.863+0000 7f819be60740 1 -- 172.21.15.33:0/3706756383 wait complete. 2024-08-28T19:33:23.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.863+0000 7f819be60740 1 -- start start 2024-08-28T19:33:23.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f819be60740 1 Processor -- start 2024-08-28T19:33:23.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f819be60740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c084490 0x56358c45eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f819be60740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c45f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f819be60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c0ad350 0x56358c46b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f819be60740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56358c21b890 con 0x56358c08c670 2024-08-28T19:33:23.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f819be60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56358c33f790 con 0x56358c0ad350 2024-08-28T19:33:23.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f819be60740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56358c461f60 con 0x56358c084490 2024-08-28T19:33:23.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f819be60740 10 client.0 _ll_register_callbacks cb 0x56358c0c4ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:23.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f818e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c45f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f818e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c45f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52198/0 (socket says 172.21.15.33:52198) 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f818e7fc640 1 -- 172.21.15.33:0/538273834 learned_addr learned my addr 172.21.15.33:0/538273834 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.864+0000 7f818effd640 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c084490 0x56358c45eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.865+0000 7f818e7fc640 1 -- 172.21.15.33:0/538273834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c084490 msgr2=0x56358c45eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.865+0000 7f818e7fc640 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c084490 0x56358c45eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.865+0000 7f818e7fc640 1 -- 172.21.15.33:0/538273834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c0ad350 msgr2=0x56358c46b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.865+0000 7f818e7fc640 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c0ad350 0x56358c46b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.865+0000 7f818e7fc640 1 -- 172.21.15.33:0/538273834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56358c376f30 con 0x56358c08c670 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.865+0000 7f818e7fc640 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c45f5d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f81840abb10 tx=0x7f8184009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0332419ba66698 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.865+0000 7f816effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.865+0000 7f816effd640 1 -- 172.21.15.33:0/538273834 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184020070 con 0x56358c08c670 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.865+0000 7f816effd640 1 -- 172.21.15.33:0/538273834 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f81840e5430 con 0x56358c08c670 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.865+0000 7f819be60740 1 -- 172.21.15.33:0/538273834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81840b4ea0 con 0x56358c08c670 2024-08-28T19:33:23.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f816effd640 1 -- 172.21.15.33:0/538273834 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f81840e5630 con 0x56358c08c670 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f819be60740 10 client.15936 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f819be60740 1 -- 172.21.15.33:0/538273834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56358c46de20 con 0x56358c08c670 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f816effd640 1 -- 172.21.15.33:0/538273834 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81840e2e60 con 0x56358c08c670 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f816effd640 1 -- 172.21.15.33:0/538273834 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f81840ce070 con 0x56358c08c670 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f819be60740 10 client.15936 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f819be60740 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f819be60740 20 client.15936 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f819be60740 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56358c06bcd0 0x56358c471180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f819be60740 4 client.15936 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f819be60740 1 -- 172.21.15.33:0/538273834 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f81840b4ea0 con 0x56358c06bcd0 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.866+0000 7f818effd640 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56358c06bcd0 0x56358c471180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.867+0000 7f816effd640 10 client.15936 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:23.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.868+0000 7f818effd640 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56358c06bcd0 0x56358c471180 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c59031e3e5393166 server_cookie=5cb2850da5b205bb in_seq=0 out_seq=0 2024-08-28T19:33:23.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f816effd640 1 -- 172.21.15.33:0/538273834 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f81840b4ea0 con 0x56358c06bcd0 2024-08-28T19:33:23.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f816effd640 10 client.15936 handle_command_reply: tid=0 2024-08-28T19:33:23.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 client.15936 shutdown 2024-08-28T19:33:23.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 -- 172.21.15.33:0/538273834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 msgr2=0x56358c45f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c45f5d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f81840abb10 tx=0x7f8184009f50 comp rx=0 tx=0).stop 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 -- 172.21.15.33:0/538273834 shutdown_connections 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c0ad350 0x56358c46b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56358c06bcd0 0x56358c471180 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f816effd640 0 client.15936 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c45f5d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 --2- 172.21.15.33:0/538273834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c084490 0x56358c45eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 -- 172.21.15.33:0/538273834 >> 172.21.15.33:0/538273834 conn(0x56358c0a1740 msgr2=0x56358c456930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 -- 172.21.15.33:0/538273834 shutdown_connections 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 1 -- 172.21.15.33:0/538273834 wait complete. 2024-08-28T19:33:23.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.869+0000 7f819be60740 20 client.15936 trim_cache size 0 max 16384 2024-08-28T19:33:23.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.888+0000 7f819be60740 1 Processor -- start 2024-08-28T19:33:23.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.888+0000 7f819be60740 1 -- start start 2024-08-28T19:33:23.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.888+0000 7f819be60740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c06bcd0 0x56358c456ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.888+0000 7f819be60740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c454ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.888+0000 7f818e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c454ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.888+0000 7f818e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c454ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52206/0 (socket says 172.21.15.33:52206) 2024-08-28T19:33:23.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.888+0000 7f819be60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c08c670 0x56358c46b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f818e7fc640 1 -- 172.21.15.33:0/933395175 learned_addr learned my addr 172.21.15.33:0/933395175 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f819be60740 1 -- 172.21.15.33:0/933395175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f81901b72d0 con 0x56358c084490 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f819be60740 1 -- 172.21.15.33:0/933395175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f81901b8e10 con 0x56358c08c670 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f819be60740 1 -- 172.21.15.33:0/933395175 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81901b79a0 con 0x56358c06bcd0 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f818effd640 1 --2- 172.21.15.33:0/933395175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c06bcd0 0x56358c456ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f818e7fc640 1 -- 172.21.15.33:0/933395175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c06bcd0 msgr2=0x56358c456ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f818e7fc640 1 --2- 172.21.15.33:0/933395175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c06bcd0 0x56358c456ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f818e7fc640 1 -- 172.21.15.33:0/933395175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c08c670 msgr2=0x56358c46b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f818e7fc640 1 --2- 172.21.15.33:0/933395175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c08c670 0x56358c46b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f818e7fc640 1 -- 172.21.15.33:0/933395175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56358c45d4f0 con 0x56358c084490 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f818e7fc640 1 --2- 172.21.15.33:0/933395175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c454ec0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8184003fd0 tx=0x7f818400df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3943a5842b6ec7a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f81757fa640 1 -- 172.21.15.33:0/933395175 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81840042f0 con 0x56358c084490 2024-08-28T19:33:23.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f81757fa640 1 -- 172.21.15.33:0/933395175 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81840ab690 con 0x56358c084490 2024-08-28T19:33:23.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.889+0000 7f81757fa640 1 -- 172.21.15.33:0/933395175 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81840e5430 con 0x56358c084490 2024-08-28T19:33:23.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.890+0000 7f819be60740 1 -- 172.21.15.33:0/933395175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 msgr2=0x56358c454ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:23.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.890+0000 7f819be60740 1 --2- 172.21.15.33:0/933395175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c454ec0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8184003fd0 tx=0x7f818400df10 comp rx=0 tx=0).stop 2024-08-28T19:33:23.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.890+0000 7f819be60740 1 -- 172.21.15.33:0/933395175 shutdown_connections 2024-08-28T19:33:23.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.890+0000 7f819be60740 1 --2- 172.21.15.33:0/933395175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c08c670 0x56358c46b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.890+0000 7f819be60740 1 --2- 172.21.15.33:0/933395175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c084490 0x56358c454ec0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.890+0000 7f819be60740 1 --2- 172.21.15.33:0/933395175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c06bcd0 0x56358c456ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.890+0000 7f819be60740 1 -- 172.21.15.33:0/933395175 >> 172.21.15.33:0/933395175 conn(0x56358c0a1740 msgr2=0x56358c4547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:23.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.890+0000 7f819be60740 1 -- 172.21.15.33:0/933395175 shutdown_connections 2024-08-28T19:33:23.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.890+0000 7f819be60740 1 -- 172.21.15.33:0/933395175 wait complete. 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.891+0000 7f819be60740 1 -- start start 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.891+0000 7f819be60740 1 Processor -- start 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.891+0000 7f819be60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c06bcd0 0x56358c4cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.891+0000 7f819be60740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c4d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.891+0000 7f819be60740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c0ad350 0x56358c4d5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f819be60740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f81901b8740 con 0x56358c08c670 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f819be60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f81901b8070 con 0x56358c06bcd0 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f819be60740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f81901b52b0 con 0x56358c0ad350 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f819be60740 10 client.0 _ll_register_callbacks cb 0x7f81840ab3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c06bcd0 0x56358c4cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c06bcd0 0x56358c4cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:59136/0 (socket says 172.21.15.33:59136) 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818effd640 1 -- 172.21.15.33:0/3721726104 learned_addr learned my addr 172.21.15.33:0/3721726104 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c4d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818f7fe640 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c0ad350 0x56358c4d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818e7fc640 1 -- 172.21.15.33:0/3721726104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c0ad350 msgr2=0x56358c4d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818e7fc640 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c0ad350 0x56358c4d5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818e7fc640 1 -- 172.21.15.33:0/3721726104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c06bcd0 msgr2=0x56358c4cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818e7fc640 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c06bcd0 0x56358c4cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818e7fc640 1 -- 172.21.15.33:0/3721726104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56358c4d5670 con 0x56358c08c670 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f818e7fc640 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c4d0050 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f81840a7860 tx=0x7f8184009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fd67eb056df846 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.892+0000 7f816effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f816effd640 1 -- 172.21.15.33:0/3721726104 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81840b4ea0 con 0x56358c08c670 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f816effd640 1 -- 172.21.15.33:0/3721726104 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f81840e2e60 con 0x56358c08c670 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f819be60740 1 -- 172.21.15.33:0/3721726104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81840ab690 con 0x56358c08c670 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f816effd640 1 -- 172.21.15.33:0/3721726104 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f81840e5430 con 0x56358c08c670 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f819be60740 10 client.15942 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:23.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f819be60740 1 -- 172.21.15.33:0/3721726104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56358c4d5670 con 0x56358c08c670 2024-08-28T19:33:23.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f816effd640 1 -- 172.21.15.33:0/3721726104 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81840ab690 con 0x56358c08c670 2024-08-28T19:33:23.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f816effd640 1 -- 172.21.15.33:0/3721726104 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f81840ce070 con 0x56358c08c670 2024-08-28T19:33:23.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f819be60740 10 client.15942 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:23.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f819be60740 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:33:23.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f819be60740 20 client.15942 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:23.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f819be60740 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56358c041080 0x56358c4ded40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:23.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f819be60740 4 client.15942 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:33:23.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.893+0000 7f819be60740 1 -- 172.21.15.33:0/3721726104 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56358c3cb540 con 0x56358c041080 2024-08-28T19:33:23.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.894+0000 7f818effd640 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56358c041080 0x56358c4ded40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:23.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.894+0000 7f816effd640 10 client.15942 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:23.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.895+0000 7f818effd640 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56358c041080 0x56358c4ded40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7dc19faa6ed6b48 server_cookie=d938da066203c8af in_seq=0 out_seq=0 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.896+0000 7f816effd640 1 -- 172.21.15.33:0/3721726104 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56358c3cb540 con 0x56358c041080 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.896+0000 7f816effd640 10 client.15942 handle_command_reply: tid=0 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.896+0000 7f819be60740 1 client.15942 shutdown 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 1 -- 172.21.15.33:0/3721726104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 msgr2=0x56358c4d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c4d0050 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f81840a7860 tx=0x7f8184009f50 comp rx=0 tx=0).stop 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 1 -- 172.21.15.33:0/3721726104 shutdown_connections 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56358c0ad350 0x56358c4d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56358c041080 0x56358c4ded40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56358c08c670 0x56358c4d0050 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 1 --2- 172.21.15.33:0/3721726104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56358c06bcd0 0x56358c4cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 1 -- 172.21.15.33:0/3721726104 >> 172.21.15.33:0/3721726104 conn(0x56358c0a1740 msgr2=0x56358c46a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f816effd640 0 client.15942 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:23.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 1 -- 172.21.15.33:0/3721726104 shutdown_connections 2024-08-28T19:33:23.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 1 -- 172.21.15.33:0/3721726104 wait complete. 2024-08-28T19:33:23.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.897+0000 7f819be60740 20 client.15942 trim_cache size 0 max 16384 2024-08-28T19:33:23.900 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:33:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:33:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "3188dec0-29fb-4644-91c6-a89667b41421", 2024-08-28T19:33:23.900 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:33:23.900 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:33:23.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 -- 172.21.15.33:0/1827007762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81780b4d20 msgr2=0x7f81780b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:23.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81780b4d20 0x7f81780b7230 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f81880049d0 tx=0x7f8188009500 comp rx=0 tx=0).stop 2024-08-28T19:33:23.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 -- 172.21.15.33:0/1827007762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81901050a0 msgr2=0x7f81901a0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:23.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81901050a0 0x7f81901a0de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8184005fd0 tx=0x7f818400dde0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 -- 172.21.15.33:0/1827007762 shutdown_connections 2024-08-28T19:33:23.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f819010dbb0 0x7f81901a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f81780b4d20 0x7f81780b7230 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f81901050a0 0x7f81901a0de0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 --2- 172.21.15.33:0/1827007762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8190104750 0x7f81901a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:23.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 -- 172.21.15.33:0/1827007762 >> 172.21.15.33:0/1827007762 conn(0x7f81900794d0 msgr2=0x7f8190100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:23.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 -- 172.21.15.33:0/1827007762 shutdown_connections 2024-08-28T19:33:23.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:23.898+0000 7f81958eb640 1 -- 172.21.15.33:0/1827007762 wait complete. 2024-08-28T19:33:24.644 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:33:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:25.175 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:24 smithi033 ceph-mon[18549]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-08-28T19:33:25.175 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:24 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:33:25.175 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:24 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:33:25.175 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:24 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:33:25.175 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:24 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:33:25.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:24 smithi059 ceph-mon[22052]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-08-28T19:33:25.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:24 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:33:25.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:24 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:33:25.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:24 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:33:25.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:24 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:33:25.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:24 smithi122 ceph-mon[22174]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 853 B/s wr, 11 op/s 2024-08-28T19:33:25.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:24 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:33:25.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:24 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:33:25.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:24 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:33:25.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:24 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.489+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3321720923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da0108a90 msgr2=0x7f5da010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.489+0000 7f5da5cd4640 1 --2- 172.21.15.33:0/3321720923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da0108a90 0x7f5da010f2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009be0 tx=0x7f5d9802a440 comp rx=0 tx=0).stop 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.489+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3321720923 shutdown_connections 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.489+0000 7f5da5cd4640 1 --2- 172.21.15.33:0/3321720923 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da0108a90 0x7f5da010f2c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.489+0000 7f5da5cd4640 1 --2- 172.21.15.33:0/3321720923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0108140 0x7f5da0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.489+0000 7f5da5cd4640 1 --2- 172.21.15.33:0/3321720923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5da0102800 0x7f5da0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.489+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3321720923 >> 172.21.15.33:0/3321720923 conn(0x7f5da00794d0 msgr2=0x7f5da00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.489+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3321720923 shutdown_connections 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.489+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3321720923 wait complete. 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.490+0000 7f5da5cd4640 1 Processor -- start 2024-08-28T19:33:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.490+0000 7f5da5cd4640 1 -- start start 2024-08-28T19:33:25.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.490+0000 7f5da5cd4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0102800 0x7f5da0197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.490+0000 7f5da5cd4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5da0108140 0x7f5da0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.490+0000 7f5da5cd4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da0108a90 0x7f5da019d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.490+0000 7f5da5cd4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0111640 con 0x7f5da0108140 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.490+0000 7f5da5cd4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01114c0 con 0x7f5da0102800 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.490+0000 7f5da5cd4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01117c0 con 0x7f5da0108a90 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5da0108140 0x7f5da0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5da0108140 0x7f5da0198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52244/0 (socket says 172.21.15.33:52244) 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9effd640 1 -- 172.21.15.33:0/3622640953 learned_addr learned my addr 172.21.15.33:0/3622640953 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0102800 0x7f5da0197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9ffff640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da0108a90 0x7f5da019d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/3622640953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da0108a90 msgr2=0x7f5da019d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da0108a90 0x7f5da019d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/3622640953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5da0108140 msgr2=0x7f5da0198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5da0108140 0x7f5da0198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/3622640953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da019df60 con 0x7f5da0102800 2024-08-28T19:33:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9effd640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5da0108140 0x7f5da0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.491+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0102800 0x7f5da0197ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d90005fd0 tx=0x7f5d9000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.492+0000 7f5d9cff9640 1 -- 172.21.15.33:0/3622640953 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000cd00 con 0x7f5da0102800 2024-08-28T19:33:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.492+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3622640953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da019e250 con 0x7f5da0102800 2024-08-28T19:33:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.492+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3622640953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da01a49b0 con 0x7f5da0102800 2024-08-28T19:33:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.492+0000 7f5d9cff9640 1 -- 172.21.15.33:0/3622640953 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d900035f0 con 0x7f5da0102800 2024-08-28T19:33:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.492+0000 7f5d9cff9640 1 -- 172.21.15.33:0/3622640953 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90010670 con 0x7f5da0102800 2024-08-28T19:33:25.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.495+0000 7f5dac249740 1 Processor -- start 2024-08-28T19:33:25.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.495+0000 7f5dac249740 1 -- start start 2024-08-28T19:33:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5dac249740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c7a070 0x55943301f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5dac249740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x55943301f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5dac249740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 0x55943301fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5dac249740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559432f96630 con 0x559432c511b0 2024-08-28T19:33:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5dac249740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559432f85bc0 con 0x559432c59390 2024-08-28T19:33:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5dac249740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559432f89b70 con 0x559432c7a070 2024-08-28T19:33:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5d9cff9640 1 -- 172.21.15.33:0/3622640953 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5d90010810 con 0x7f5da0102800 2024-08-28T19:33:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 0x55943301fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 0x55943301fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:59146/0 (socket says 172.21.15.33:59146) 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5d9effd640 1 -- 172.21.15.33:0/452466720 learned_addr learned my addr 172.21.15.33:0/452466720 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5d9ffff640 1 --2- 172.21.15.33:0/452466720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c7a070 0x55943301f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5d9effd640 1 -- 172.21.15.33:0/452466720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c7a070 msgr2=0x55943301f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5d9effd640 1 --2- 172.21.15.33:0/452466720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c7a070 0x55943301f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.496+0000 7f5d9effd640 1 -- 172.21.15.33:0/452466720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 msgr2=0x55943301f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.497+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/452466720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x55943301f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.497+0000 7f5d9effd640 1 --2- 172.21.15.33:0/452466720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x55943301f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.497+0000 7f5d9effd640 1 -- 172.21.15.33:0/452466720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559432ce5650 con 0x559432c59390 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.497+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/452466720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x55943301f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.497+0000 7f5d9effd640 1 --2- 172.21.15.33:0/452466720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 0x55943301fd40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800f570 tx=0x7f5d88005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d41be4d99634c36 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.497+0000 7f5d95ffb640 1 -- 172.21.15.33:0/452466720 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88019430 con 0x559432c59390 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.498+0000 7f5d95ffb640 1 -- 172.21.15.33:0/452466720 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d88019a80 con 0x559432c59390 2024-08-28T19:33:25.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.498+0000 7f5d95ffb640 1 -- 172.21.15.33:0/452466720 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88018b20 con 0x559432c59390 2024-08-28T19:33:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.498+0000 7f5d9cff9640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d8c0b4de0 0x7f5d8c0b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.498+0000 7f5d9ffff640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d8c0b4de0 0x7f5d8c0b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5dac249740 1 -- 172.21.15.33:0/452466720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 msgr2=0x55943301fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5dac249740 1 --2- 172.21.15.33:0/452466720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 0x55943301fd40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800f570 tx=0x7f5d88005f90 comp rx=0 tx=0).stop 2024-08-28T19:33:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5d9cff9640 1 -- 172.21.15.33:0/3622640953 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5d900e5800 con 0x7f5da0102800 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5d9ffff640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d8c0b4de0 0x7f5d8c0b72f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5d980092f0 tx=0x7f5d98009280 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5dac249740 1 -- 172.21.15.33:0/452466720 shutdown_connections 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5dac249740 1 --2- 172.21.15.33:0/452466720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 0x55943301fd40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5dac249740 1 --2- 172.21.15.33:0/452466720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x55943301f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5dac249740 1 --2- 172.21.15.33:0/452466720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c7a070 0x55943301f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5dac249740 1 -- 172.21.15.33:0/452466720 >> 172.21.15.33:0/452466720 conn(0x559432c6e460 msgr2=0x55943301d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5dac249740 1 -- 172.21.15.33:0/452466720 shutdown_connections 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.499+0000 7f5dac249740 1 -- 172.21.15.33:0/452466720 wait complete. 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.500+0000 7f5dac249740 1 -- start start 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.500+0000 7f5dac249740 1 Processor -- start 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5dac249740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c511b0 0x559433033060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5dac249740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c59390 0x5594330335a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5dac249740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c7a070 0x559433033ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c511b0 0x559433033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c511b0 0x559433033060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:59162/0 (socket says 172.21.15.33:59162) 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5d9ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c7a070 0x559433033ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c59390 0x5594330335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5d9ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c7a070 0x559433033ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52258/0 (socket says 172.21.15.33:52258) 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/364332151 learned_addr learned my addr 172.21.15.33:0/364332151 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559432de8700 con 0x559432c7a070 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559432f0c700 con 0x559432c511b0 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5594330361d0 con 0x559432c59390 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/364332151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c59390 msgr2=0x5594330335a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c59390 0x5594330335a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.501+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/364332151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c7a070 msgr2=0x559433033ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c7a070 0x559433033ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/364332151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559432f458b0 con 0x559432c511b0 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5d9ffff640 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c7a070 0x559433033ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5dac249740 10 client.0 _ll_register_callbacks cb 0x559432f3bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c511b0 0x559433033060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d900a8db0 tx=0x7f5d900ac160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57c4f41927d8fc80 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d88019a80 con 0x559432c511b0 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5d7effd640 10 client.25511 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5d7effd640 1 -- 172.21.15.33:0/364332151 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900ab650 con 0x559432c511b0 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5d7effd640 1 -- 172.21.15.33:0/364332151 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5d90010d10 con 0x559432c511b0 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5d7effd640 1 -- 172.21.15.33:0/364332151 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d900ac240 con 0x559432c511b0 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5dac249740 10 client.25511 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.502+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=28}) -- 0x559433041c80 con 0x559432c511b0 2024-08-28T19:33:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.503+0000 7f5d7effd640 1 -- 172.21.15.33:0/364332151 <== mon.2 v2:172.21.15.59:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5d900e4030 con 0x559432c511b0 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.503+0000 7f5dac249740 10 client.25511 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.503+0000 7f5dac249740 10 client.25511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.503+0000 7f5dac249740 20 client.25511 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.503+0000 7f5dac249740 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559432c389f0 0x5594330452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.503+0000 7f5dac249740 4 client.25511 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.503+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559432f98580 con 0x559432c389f0 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.503+0000 7f5d9effd640 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559432c389f0 0x5594330452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.504+0000 7f5d9effd640 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559432c389f0 0x5594330452b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9aa7904c7380a9e server_cookie=e25bf3877c3675fe in_seq=0 out_seq=0 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.504+0000 7f5d7effd640 10 client.25511 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.504+0000 7f5d7effd640 1 -- 172.21.15.33:0/364332151 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559432f98580 con 0x559432c389f0 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.504+0000 7f5d7effd640 10 client.25511 handle_command_reply: tid=0 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 client.25511 shutdown 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c511b0 msgr2=0x559433033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c511b0 0x559433033060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d900a8db0 tx=0x7f5d900ac160 comp rx=0 tx=0).stop 2024-08-28T19:33:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 shutdown_connections 2024-08-28T19:33:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559432c389f0 0x5594330452b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5d7effd640 0 client.25511 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c7a070 0x559433033ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c59390 0x5594330335a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 --2- 172.21.15.33:0/364332151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c511b0 0x559433033060 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 >> 172.21.15.33:0/364332151 conn(0x559432c6e460 msgr2=0x55943301b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 shutdown_connections 2024-08-28T19:33:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 1 -- 172.21.15.33:0/364332151 wait complete. 2024-08-28T19:33:25.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.505+0000 7f5dac249740 20 client.25511 trim_cache size 0 max 16384 2024-08-28T19:33:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.540+0000 7f5dac249740 1 Processor -- start 2024-08-28T19:33:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.540+0000 7f5dac249740 1 -- start start 2024-08-28T19:33:25.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.540+0000 7f5dac249740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c389f0 0x55943302e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.540+0000 7f5dac249740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433034f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433034f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c389f0 0x55943302e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c389f0 0x55943302e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:59172/0 (socket says 172.21.15.33:59172) 2024-08-28T19:33:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433034f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52262/0 (socket says 172.21.15.33:52262) 2024-08-28T19:33:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/1688590615 learned_addr learned my addr 172.21.15.33:0/1688590615 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5dac249740 1 --2- 172.21.15.33:0/1688590615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c59390 0x55943303eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5dac249740 1 -- 172.21.15.33:0/1688590615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8000fd30 con 0x559432c511b0 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5dac249740 1 -- 172.21.15.33:0/1688590615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80011870 con 0x559432c389f0 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5dac249740 1 -- 172.21.15.33:0/1688590615 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80010400 con 0x559432c59390 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/1688590615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c59390 msgr2=0x55943303eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/1688590615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c59390 0x55943303eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/1688590615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 msgr2=0x559433034f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/1688590615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433034f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/1688590615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559433033e20 con 0x559432c389f0 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.541+0000 7f5d9effd640 1 --2- 172.21.15.33:0/1688590615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433034f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.542+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/1688590615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c389f0 0x55943302e810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009230 tx=0x7f5d90011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=579ae91f9813e210 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.542+0000 7f5d957fa640 1 -- 172.21.15.33:0/1688590615 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900ab650 con 0x559432c389f0 2024-08-28T19:33:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.542+0000 7f5d957fa640 1 -- 172.21.15.33:0/1688590615 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d88019a80 con 0x559432c389f0 2024-08-28T19:33:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.542+0000 7f5d957fa640 1 -- 172.21.15.33:0/1688590615 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900b4e60 con 0x559432c389f0 2024-08-28T19:33:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.543+0000 7f5dac249740 1 -- 172.21.15.33:0/1688590615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c389f0 msgr2=0x55943302e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.543+0000 7f5dac249740 1 --2- 172.21.15.33:0/1688590615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c389f0 0x55943302e810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009230 tx=0x7f5d90011000 comp rx=0 tx=0).stop 2024-08-28T19:33:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.543+0000 7f5dac249740 1 -- 172.21.15.33:0/1688590615 shutdown_connections 2024-08-28T19:33:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.543+0000 7f5dac249740 1 --2- 172.21.15.33:0/1688590615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c59390 0x55943303eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.543+0000 7f5dac249740 1 --2- 172.21.15.33:0/1688590615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433034f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.543+0000 7f5dac249740 1 --2- 172.21.15.33:0/1688590615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c389f0 0x55943302e810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.543+0000 7f5dac249740 1 -- 172.21.15.33:0/1688590615 >> 172.21.15.33:0/1688590615 conn(0x559432c6e460 msgr2=0x55943303e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:25.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.543+0000 7f5dac249740 1 -- 172.21.15.33:0/1688590615 shutdown_connections 2024-08-28T19:33:25.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.543+0000 7f5dac249740 1 -- 172.21.15.33:0/1688590615 wait complete. 2024-08-28T19:33:25.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.544+0000 7f5dac249740 1 -- start start 2024-08-28T19:33:25.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.544+0000 7f5dac249740 1 Processor -- start 2024-08-28T19:33:25.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.544+0000 7f5dac249740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c389f0 0x559433039620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.544+0000 7f5dac249740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433039b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433039b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5d9effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433039b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52278/0 (socket says 172.21.15.33:52278) 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5d9effd640 1 -- 172.21.15.33:0/2462156771 learned_addr learned my addr 172.21.15.33:0/2462156771 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5dac249740 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 0x55943303a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c389f0 0x559433039620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d800111a0 con 0x559432c511b0 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80010ad0 con 0x559432c59390 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8000dd10 con 0x559432c389f0 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/2462156771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 msgr2=0x55943303a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 0x55943303a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/2462156771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 msgr2=0x559433039b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433039b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5d9f7fe640 1 -- 172.21.15.33:0/2462156771 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55943302c660 con 0x559432c389f0 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5d9effd640 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433039b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5dac249740 10 client.0 _ll_register_callbacks cb 0x7f5d900ab910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.545+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d88019a80 con 0x559432c389f0 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5d9f7fe640 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c389f0 0x559433039620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000c6a0 tx=0x7f5d900a7400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf843d24a786bf66 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5d7effd640 10 client.25507 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5d7effd640 1 -- 172.21.15.33:0/2462156771 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900ab650 con 0x559432c389f0 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5d7effd640 1 -- 172.21.15.33:0/2462156771 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5d900a76c0 con 0x559432c389f0 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5d7effd640 1 -- 172.21.15.33:0/2462156771 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d900b0170 con 0x559432c389f0 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5dac249740 10 client.25507 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55943302d680 con 0x559432c389f0 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5d7effd640 1 -- 172.21.15.33:0/2462156771 <== mon.1 v2:172.21.15.122:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5d900e4040 con 0x559432c389f0 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5dac249740 10 client.25507 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5dac249740 10 client.25507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:33:25.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5dac249740 20 client.25507 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:25.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5dac249740 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559432c7a070 0x5594330a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:25.553 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:33:25.553 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:33:25.553 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:33:25.553 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:33:25.553 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:33:25.553 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "3188dec0-29fb-4644-91c6-a89667b41421", 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:33:25.554 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5dac249740 4 client.25507 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.546+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559432f94020 con 0x559432c7a070 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.547+0000 7f5d9effd640 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559432c7a070 0x5594330a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:25.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.547+0000 7f5d9effd640 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559432c7a070 0x5594330a9c80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=530efcd82db8fa3b server_cookie=c66276a93b3223d5 in_seq=0 out_seq=0 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.547+0000 7f5d7effd640 10 client.25507 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.547+0000 7f5d7effd640 1 -- 172.21.15.33:0/2462156771 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x559432f94020 con 0x559432c7a070 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.547+0000 7f5d7effd640 10 client.25507 handle_command_reply: tid=0 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.547+0000 7f5dac249740 1 client.25507 shutdown 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c389f0 msgr2=0x559433039620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c389f0 0x559433039620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000c6a0 tx=0x7f5d900a7400 comp rx=0 tx=0).stop 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 shutdown_connections 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559432c59390 0x55943303a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559432c7a070 0x5594330a9c80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559432c511b0 0x559433039b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 1 --2- 172.21.15.33:0/2462156771 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559432c389f0 0x559433039620 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5d7effd640 0 client.25507 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:25.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 >> 172.21.15.33:0/2462156771 conn(0x559432c6e460 msgr2=0x559433034d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 shutdown_connections 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 1 -- 172.21.15.33:0/2462156771 wait complete. 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.548+0000 7f5dac249740 20 client.25507 trim_cache size 0 max 16384 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3622640953 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d8c0b4de0 msgr2=0x7f5d8c0b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d8c0b4de0 0x7f5d8c0b72f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5d980092f0 tx=0x7f5d98009280 comp rx=0 tx=0).stop 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3622640953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0102800 msgr2=0x7f5da0197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0102800 0x7f5da0197ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d90005fd0 tx=0x7f5d9000ee50 comp rx=0 tx=0).stop 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3622640953 shutdown_connections 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d8c0b4de0 0x7f5d8c0b72f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da0108a90 0x7f5da019d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5da0108140 0x7f5da0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 --2- 172.21.15.33:0/3622640953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0102800 0x7f5da0197ff0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:25.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3622640953 >> 172.21.15.33:0/3622640953 conn(0x7f5da00794d0 msgr2=0x7f5da0104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:25.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3622640953 shutdown_connections 2024-08-28T19:33:25.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:25.549+0000 7f5da5cd4640 1 -- 172.21.15.33:0/3622640953 wait complete. 2024-08-28T19:33:26.327 INFO:tasks.cephfs.filesystem:scrub status for tag:3188dec0-29fb-4644-91c6-a89667b41421 - {'path': '/', 'tag': '3188dec0-29fb-4644-91c6-a89667b41421', 'options': 'recursive,force'} 2024-08-28T19:33:27.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:26 smithi059 ceph-mon[22052]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-28T19:33:27.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:26 smithi122 ceph-mon[22174]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-28T19:33:27.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:26 smithi033 ceph-mon[18549]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-28T19:33:29.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:28 smithi059 ceph-mon[22052]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-08-28T19:33:29.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:28 smithi122 ceph-mon[22174]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-08-28T19:33:29.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:28 smithi033 ceph-mon[18549]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-08-28T19:33:31.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:30 smithi033 ceph-mon[18549]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:33:31.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:30 smithi059 ceph-mon[22052]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:33:31.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:30 smithi122 ceph-mon[22174]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:33:33.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:32 smithi059 ceph-mon[22052]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:33:33.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:32 smithi122 ceph-mon[22174]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:33:33.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:32 smithi033 ceph-mon[18549]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:33:35.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:35 smithi122 ceph-mon[22174]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:33:35.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:35 smithi033 ceph-mon[18549]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:33:35.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:35 smithi059 ceph-mon[22052]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:33:37.545 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:37 smithi122 ceph-mon[22174]: pgmap v377: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:33:37.633 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:37 smithi033 ceph-mon[18549]: pgmap v377: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:33:37.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:37 smithi059 ceph-mon[22052]: pgmap v377: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:33:39.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:39 smithi122 ceph-mon[22174]: pgmap v378: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:33:39.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:39 smithi033 ceph-mon[18549]: pgmap v378: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:33:39.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:39 smithi059 ceph-mon[22052]: pgmap v378: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:33:41.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:41 smithi033 ceph-mon[18549]: pgmap v379: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:33:41.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:41 smithi059 ceph-mon[22052]: pgmap v379: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:33:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:41 smithi122 ceph-mon[22174]: pgmap v379: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:33:43.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:43 smithi033 ceph-mon[18549]: pgmap v380: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:33:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:43 smithi059 ceph-mon[22052]: pgmap v380: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:33:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:43 smithi122 ceph-mon[22174]: pgmap v380: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:33:45.576 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:33:45.599 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:45 smithi033 ceph-mon[18549]: pgmap v381: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:33:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:45 smithi059 ceph-mon[22052]: pgmap v381: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:33:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:45 smithi122 ceph-mon[22174]: pgmap v381: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:33:45.833 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 -- 172.21.15.33:0/151923942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dd4108170 msgr2=0x7f0dd4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 --2- 172.21.15.33:0/151923942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dd4108170 0x7f0dd4108580 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009900 tx=0x7f0dc402a410 comp rx=0 tx=0).stop 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 -- 172.21.15.33:0/151923942 shutdown_connections 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 --2- 172.21.15.33:0/151923942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd4108ac0 0x7f0dd410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 --2- 172.21.15.33:0/151923942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dd4108170 0x7f0dd4108580 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 --2- 172.21.15.33:0/151923942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd4102880 0x7f0dd4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 -- 172.21.15.33:0/151923942 >> 172.21.15.33:0/151923942 conn(0x7f0dd4079530 msgr2=0x7f0dd4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 -- 172.21.15.33:0/151923942 shutdown_connections 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 -- 172.21.15.33:0/151923942 wait complete. 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 Processor -- start 2024-08-28T19:33:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.359+0000 7f0ddbd98640 1 -- start start 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0ddbd98640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd4102880 0x7f0dd419b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0ddbd98640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dd4108170 0x7f0dd419b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0ddbd98640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd4108ac0 0x7f0dd419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0ddbd98640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd4112730 con 0x7f0dd4108170 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0ddbd98640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd41125b0 con 0x7f0dd4108ac0 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0ddbd98640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd41128b0 con 0x7f0dd4102880 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dd9333640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dd4108170 0x7f0dd419b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dd9333640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dd4108170 0x7f0dd419b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57188/0 (socket says 172.21.15.33:57188) 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dd9333640 1 -- 172.21.15.33:0/1359011195 learned_addr learned my addr 172.21.15.33:0/1359011195 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dd9b34640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd4102880 0x7f0dd419b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dda335640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd4108ac0 0x7f0dd419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dd9333640 1 -- 172.21.15.33:0/1359011195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd4102880 msgr2=0x7f0dd419b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dd9333640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd4102880 0x7f0dd419b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dd9333640 1 -- 172.21.15.33:0/1359011195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd4108ac0 msgr2=0x7f0dd419bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dd9333640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd4108ac0 0x7f0dd419bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dd9333640 1 -- 172.21.15.33:0/1359011195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd41a6330 con 0x7f0dd4108170 2024-08-28T19:33:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.360+0000 7f0dd9333640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dd4108170 0x7f0dd419b640 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0dc402a930 tx=0x7f0dc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.361+0000 7f0dcaffd640 1 -- 172.21.15.33:0/1359011195 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc403f030 con 0x7f0dd4108170 2024-08-28T19:33:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.361+0000 7f0ddbd98640 1 -- 172.21.15.33:0/1359011195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd41a65c0 con 0x7f0dd4108170 2024-08-28T19:33:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.361+0000 7f0dcaffd640 1 -- 172.21.15.33:0/1359011195 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dc4003aa0 con 0x7f0dd4108170 2024-08-28T19:33:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.361+0000 7f0dcaffd640 1 -- 172.21.15.33:0/1359011195 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4035070 con 0x7f0dd4108170 2024-08-28T19:33:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.361+0000 7f0ddbd98640 1 -- 172.21.15.33:0/1359011195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd41a6af0 con 0x7f0dd4108170 2024-08-28T19:33:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.362+0000 7f0ddbd98640 1 -- 172.21.15.33:0/1359011195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd4102c90 con 0x7f0dd4108170 2024-08-28T19:33:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.363+0000 7f0dcaffd640 1 -- 172.21.15.33:0/1359011195 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0dc4042030 con 0x7f0dd4108170 2024-08-28T19:33:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.364+0000 7f0dcaffd640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0dc00b4ca0 0x7f0dc00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.365+0000 7f0dd9b34640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0dc00b4ca0 0x7f0dc00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.365+0000 7f0dcaffd640 1 -- 172.21.15.33:0/1359011195 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0dc4106370 con 0x7f0dd4108170 2024-08-28T19:33:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.365+0000 7f0dd9b34640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0dc00b4ca0 0x7f0dc00b71b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0dd406c140 tx=0x7f0dd000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.368+0000 7f0dcaffd640 1 -- 172.21.15.33:0/1359011195 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0dc40cce10 con 0x7f0dd4108170 2024-08-28T19:33:46.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.592+0000 7f0ddbd98640 1 -- 172.21.15.33:0/1359011195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dd410a900 con 0x7f0dd4108170 2024-08-28T19:33:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.593+0000 7f0dcaffd640 1 -- 172.21.15.33:0/1359011195 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f0dd410a900 con 0x7f0dd4108170 2024-08-28T19:33:46.596 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:33:46.596 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:33:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:33:46.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 -- 172.21.15.33:0/1359011195 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0dc00b4ca0 msgr2=0x7f0dc00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:46.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0dc00b4ca0 0x7f0dc00b71b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0dd406c140 tx=0x7f0dd000a2d0 comp rx=0 tx=0).stop 2024-08-28T19:33:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 -- 172.21.15.33:0/1359011195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dd4108170 msgr2=0x7f0dd419b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dd4108170 0x7f0dd419b640 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0dc402a930 tx=0x7f0dc4004270 comp rx=0 tx=0).stop 2024-08-28T19:33:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 -- 172.21.15.33:0/1359011195 shutdown_connections 2024-08-28T19:33:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd4108ac0 0x7f0dd419bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0dd4108170 0x7f0dd419b640 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0dc00b4ca0 0x7f0dc00b71b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 --2- 172.21.15.33:0/1359011195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0dd4102880 0x7f0dd419b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 -- 172.21.15.33:0/1359011195 >> 172.21.15.33:0/1359011195 conn(0x7f0dd4079530 msgr2=0x7f0dd4106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 -- 172.21.15.33:0/1359011195 shutdown_connections 2024-08-28T19:33:46.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:46.596+0000 7f0ddbd98640 1 -- 172.21.15.33:0/1359011195 wait complete. 2024-08-28T19:33:47.383 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id 13983a21 --release --await' 2024-08-28T19:33:47.383 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id 13983a21 --release --await 2024-08-28T19:33:47.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:47 smithi033 ceph-mon[18549]: pgmap v382: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:33:47.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:47 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1359011195' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:47.688 INFO:tasks.workunit.client.0.smithi033.stderr:Updating files: 90% (11453/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-28T19:33:47.691 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:47.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:47 smithi059 ceph-mon[22052]: pgmap v382: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:33:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:47 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1359011195' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:47 smithi122 ceph-mon[22174]: pgmap v382: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:33:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:47 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1359011195' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.232+0000 7f69cf496640 1 -- 172.21.15.33:0/1803086295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69c8108160 msgr2=0x7f69c8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.232+0000 7f69cf496640 1 --2- 172.21.15.33:0/1803086295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69c8108160 0x7f69c8108570 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009900 tx=0x7f69b802a410 comp rx=0 tx=0).stop 2024-08-28T19:33:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.232+0000 7f69cf496640 1 -- 172.21.15.33:0/1803086295 shutdown_connections 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.232+0000 7f69cf496640 1 --2- 172.21.15.33:0/1803086295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69c8108ab0 0x7f69c810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.232+0000 7f69cf496640 1 --2- 172.21.15.33:0/1803086295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69c8108160 0x7f69c8108570 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.232+0000 7f69cf496640 1 --2- 172.21.15.33:0/1803086295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c8102820 0x7f69c8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.232+0000 7f69cf496640 1 -- 172.21.15.33:0/1803086295 >> 172.21.15.33:0/1803086295 conn(0x7f69c80794e0 msgr2=0x7f69c80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.232+0000 7f69cf496640 1 -- 172.21.15.33:0/1803086295 shutdown_connections 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.232+0000 7f69cf496640 1 -- 172.21.15.33:0/1803086295 wait complete. 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cf496640 1 Processor -- start 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cf496640 1 -- start start 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cf496640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69c8102820 0x7f69c8198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cf496640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c8108160 0x7f69c8199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cf496640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69c8108ab0 0x7f69c81998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cf496640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81126e0 con 0x7f69c8102820 2024-08-28T19:33:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cf496640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8112560 con 0x7f69c8108ab0 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cf496640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8112860 con 0x7f69c8108160 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cd232640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69c8102820 0x7f69c8198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cd232640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69c8102820 0x7f69c8198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57208/0 (socket says 172.21.15.33:57208) 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.233+0000 7f69cd232640 1 -- 172.21.15.33:0/1170043371 learned_addr learned my addr 172.21.15.33:0/1170043371 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69cda33640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69c8108ab0 0x7f69c81998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69cca31640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c8108160 0x7f69c8199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69cd232640 1 -- 172.21.15.33:0/1170043371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c8108160 msgr2=0x7f69c8199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69cd232640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c8108160 0x7f69c8199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69cd232640 1 -- 172.21.15.33:0/1170043371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69c8108ab0 msgr2=0x7f69c81998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69cd232640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69c8108ab0 0x7f69c81998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69cd232640 1 -- 172.21.15.33:0/1170043371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c81a84d0 con 0x7f69c8102820 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69cd232640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69c8102820 0x7f69c8198e20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f69c400c890 tx=0x7f69c400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69be7fc640 1 -- 172.21.15.33:0/1170043371 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4004220 con 0x7f69c8102820 2024-08-28T19:33:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69be7fc640 1 -- 172.21.15.33:0/1170043371 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69c40043c0 con 0x7f69c8102820 2024-08-28T19:33:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69cf496640 1 -- 172.21.15.33:0/1170043371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c81a87c0 con 0x7f69c8102820 2024-08-28T19:33:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69be7fc640 1 -- 172.21.15.33:0/1170043371 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4004a00 con 0x7f69c8102820 2024-08-28T19:33:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.234+0000 7f69cf496640 1 -- 172.21.15.33:0/1170043371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c81a8cd0 con 0x7f69c8102820 2024-08-28T19:33:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.237+0000 7f69be7fc640 1 -- 172.21.15.33:0/1170043371 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f69c40079b0 con 0x7f69c8102820 2024-08-28T19:33:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.238+0000 7f69be7fc640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69b40b4ca0 0x7f69b40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.238+0000 7f69cca31640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69b40b4ca0 0x7f69b40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.238+0000 7f69d5a0b740 1 Processor -- start 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.238+0000 7f69be7fc640 1 -- 172.21.15.33:0/1170043371 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f69c40e5760 con 0x7f69c8102820 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.238+0000 7f69d5a0b740 1 -- start start 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.238+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fe1520 0x55e832386c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fb8660 0x55e8323871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fc0840 0x55e832387700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cca31640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69b40b4ca0 0x7f69b40b71b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f69b8000c00 tx=0x7f69b8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e8322fda70 con 0x55e831fe1520 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e8322ed000 con 0x55e831fb8660 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e8322f0fb0 con 0x55e831fc0840 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cd232640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fe1520 0x55e832386c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cd232640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fe1520 0x55e832386c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57222/0 (socket says 172.21.15.33:57222) 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cd232640 1 -- 172.21.15.33:0/423493608 learned_addr learned my addr 172.21.15.33:0/423493608 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cda33640 1 --2- 172.21.15.33:0/423493608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fc0840 0x55e832387700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cca31640 1 --2- 172.21.15.33:0/423493608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fb8660 0x55e8323871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cd232640 1 -- 172.21.15.33:0/423493608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fc0840 msgr2=0x55e832387700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cd232640 1 --2- 172.21.15.33:0/423493608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fc0840 0x55e832387700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cd232640 1 -- 172.21.15.33:0/423493608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fb8660 msgr2=0x55e8323871c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cd232640 1 --2- 172.21.15.33:0/423493608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fb8660 0x55e8323871c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cd232640 1 -- 172.21.15.33:0/423493608 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83204cb00 con 0x55e831fe1520 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69cd232640 1 --2- 172.21.15.33:0/423493608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fe1520 0x55e832386c80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f69c40aba30 tx=0x7f69c40053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cbe8700ee63f40 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69b37fe640 1 -- 172.21.15.33:0/423493608 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c401d040 con 0x55e831fe1520 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.239+0000 7f69b37fe640 1 -- 172.21.15.33:0/423493608 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69c40b0310 con 0x55e831fe1520 2024-08-28T19:33:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.240+0000 7f69b37fe640 1 -- 172.21.15.33:0/423493608 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c40b4930 con 0x55e831fe1520 2024-08-28T19:33:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.240+0000 7f69d5a0b740 1 -- 172.21.15.33:0/423493608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fe1520 msgr2=0x55e832386c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.240+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/423493608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fe1520 0x55e832386c80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f69c40aba30 tx=0x7f69c40053b0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.240+0000 7f69d5a0b740 1 -- 172.21.15.33:0/423493608 shutdown_connections 2024-08-28T19:33:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.240+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/423493608 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fc0840 0x55e832387700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.240+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/423493608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fb8660 0x55e8323871c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.240+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/423493608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fe1520 0x55e832386c80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.240+0000 7f69d5a0b740 1 -- 172.21.15.33:0/423493608 >> 172.21.15.33:0/423493608 conn(0x55e831fd5910 msgr2=0x55e832384b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.240+0000 7f69d5a0b740 1 -- 172.21.15.33:0/423493608 shutdown_connections 2024-08-28T19:33:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.241+0000 7f69d5a0b740 1 -- 172.21.15.33:0/423493608 wait complete. 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.241+0000 7f69d5a0b740 1 -- start start 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.241+0000 7f69d5a0b740 1 Processor -- start 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.241+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fb8660 0x55e8323928c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.241+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fc0840 0x55e832392e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.241+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fe1520 0x55e83239e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e832395400 con 0x55e831fc0840 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e8322ae520 con 0x55e831fe1520 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e832395580 con 0x55e831fb8660 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cca31640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fc0840 0x55e832392e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cca31640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fc0840 0x55e832392e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57238/0 (socket says 172.21.15.33:57238) 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69d5a0b740 10 client.0 _ll_register_callbacks cb 0x55e8322e6c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cca31640 1 -- 172.21.15.33:0/3407509316 learned_addr learned my addr 172.21.15.33:0/3407509316 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cd232640 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fb8660 0x55e8323928c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cda33640 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fe1520 0x55e83239e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cca31640 1 -- 172.21.15.33:0/3407509316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fb8660 msgr2=0x55e8323928c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cca31640 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fb8660 0x55e8323928c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cca31640 1 -- 172.21.15.33:0/3407509316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fe1520 msgr2=0x55e83239e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cca31640 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fe1520 0x55e83239e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cca31640 1 -- 172.21.15.33:0/3407509316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8320c3960 con 0x55e831fc0840 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cd232640 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fb8660 0x55e8323928c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69cca31640 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fc0840 0x55e832392e80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009900 tx=0x7f69b8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb81b1f3b1906c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3407509316 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8035050 con 0x55e831fc0840 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3407509316 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f69b8042040 con 0x55e831fc0840 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.242+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3407509316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e83228c9a0 con 0x55e831fc0840 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3407509316 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f69b80318e0 con 0x55e831fc0840 2024-08-28T19:33:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69d5a0b740 10 client.15975 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3407509316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8323a1620 con 0x55e831fc0840 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3407509316 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e83228c9a0 con 0x55e831fc0840 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3407509316 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f69b8004880 con 0x55e831fc0840 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69d5a0b740 10 client.15975 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69d5a0b740 10 client.15975 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69d5a0b740 20 client.15975 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e831f9fea0 0x55e8323a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69d5a0b740 4 client.15975 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3407509316 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8322ff9c0 con 0x55e831f9fea0 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.243+0000 7f69cd232640 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e831f9fea0 0x55e8323a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.244+0000 7f69cd232640 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e831f9fea0 0x55e8323a4b50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b28ba1ab901a4268 server_cookie=3d7c072a3d859427 in_seq=0 out_seq=0 2024-08-28T19:33:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.244+0000 7f69b0ff9640 10 client.15975 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3407509316 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8322ff9c0 con 0x55e831f9fea0 2024-08-28T19:33:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69b0ff9640 10 client.15975 handle_command_reply: tid=0 2024-08-28T19:33:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69d5a0b740 1 client.15975 shutdown 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3407509316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fc0840 msgr2=0x55e832392e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fc0840 0x55e832392e80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009900 tx=0x7f69b8009260 comp rx=0 tx=0).stop 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3407509316 shutdown_connections 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fe1520 0x55e83239e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e831f9fea0 0x55e8323a4b50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fc0840 0x55e832392e80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3407509316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fb8660 0x55e8323928c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69b0ff9640 0 client.15975 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3407509316 >> 172.21.15.33:0/3407509316 conn(0x55e831fd5910 msgr2=0x55e832389e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.245+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3407509316 shutdown_connections 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.246+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3407509316 wait complete. 2024-08-28T19:33:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.246+0000 7f69d5a0b740 20 client.15975 trim_cache size 0 max 16384 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.263+0000 7f69d5a0b740 1 Processor -- start 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.263+0000 7f69d5a0b740 1 -- start start 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.263+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831f9fea0 0x55e83238c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.263+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fb8660 0x55e832384160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.263+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fc0840 0x55e8323846a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.263+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81ae980 con 0x55e831f9fea0 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.263+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81b04c0 con 0x55e831fb8660 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.263+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81af050 con 0x55e831fc0840 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cd232640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831f9fea0 0x55e83238c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cd232640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831f9fea0 0x55e83238c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57246/0 (socket says 172.21.15.33:57246) 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cd232640 1 -- 172.21.15.33:0/3240707741 learned_addr learned my addr 172.21.15.33:0/3240707741 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cda33640 1 --2- 172.21.15.33:0/3240707741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fc0840 0x55e8323846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cca31640 1 --2- 172.21.15.33:0/3240707741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fb8660 0x55e832384160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cd232640 1 -- 172.21.15.33:0/3240707741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fc0840 msgr2=0x55e8323846a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cd232640 1 --2- 172.21.15.33:0/3240707741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fc0840 0x55e8323846a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cd232640 1 -- 172.21.15.33:0/3240707741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fb8660 msgr2=0x55e832384160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cd232640 1 --2- 172.21.15.33:0/3240707741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fb8660 0x55e832384160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cd232640 1 -- 172.21.15.33:0/3240707741 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83237ede0 con 0x55e831f9fea0 2024-08-28T19:33:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69cd232640 1 --2- 172.21.15.33:0/3240707741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831f9fea0 0x55e83238c4a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f69c40ab750 tx=0x7f69c4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fadf2caebba5fb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69b2ffd640 1 -- 172.21.15.33:0/3240707741 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c401d040 con 0x55e831f9fea0 2024-08-28T19:33:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69b2ffd640 1 -- 172.21.15.33:0/3240707741 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69c40b4dc0 con 0x55e831f9fea0 2024-08-28T19:33:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.264+0000 7f69b2ffd640 1 -- 172.21.15.33:0/3240707741 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c40cede0 con 0x55e831f9fea0 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.265+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3240707741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831f9fea0 msgr2=0x55e83238c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.265+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3240707741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831f9fea0 0x55e83238c4a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f69c40ab750 tx=0x7f69c4000bc0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.265+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3240707741 shutdown_connections 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.265+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3240707741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831fc0840 0x55e8323846a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.265+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3240707741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fb8660 0x55e832384160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.265+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3240707741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831f9fea0 0x55e83238c4a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.265+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3240707741 >> 172.21.15.33:0/3240707741 conn(0x55e831fd5910 msgr2=0x55e83238bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.265+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3240707741 shutdown_connections 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.265+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3240707741 wait complete. 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.266+0000 7f69d5a0b740 1 -- start start 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.266+0000 7f69d5a0b740 1 Processor -- start 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.266+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831f9fea0 0x55e83239ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.266+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fb8660 0x55e832397290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.266+0000 7f69d5a0b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fc0840 0x55e8323977d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.266+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81afdf0 con 0x55e831fb8660 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.266+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81af720 con 0x55e831fc0840 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.266+0000 7f69d5a0b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81ac960 con 0x55e831f9fea0 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.266+0000 7f69d5a0b740 10 client.0 _ll_register_callbacks cb 0x7f69b8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cca31640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fb8660 0x55e832397290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cca31640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fb8660 0x55e832397290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57248/0 (socket says 172.21.15.33:57248) 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cca31640 1 -- 172.21.15.33:0/3722449697 learned_addr learned my addr 172.21.15.33:0/3722449697 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cd232640 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831f9fea0 0x55e83239ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cda33640 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fc0840 0x55e8323977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cca31640 1 -- 172.21.15.33:0/3722449697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831f9fea0 msgr2=0x55e83239ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cca31640 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831f9fea0 0x55e83239ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cca31640 1 -- 172.21.15.33:0/3722449697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fc0840 msgr2=0x55e8323977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cca31640 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fc0840 0x55e8323977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cca31640 1 -- 172.21.15.33:0/3722449697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e832397d40 con 0x55e831fb8660 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69cca31640 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fb8660 0x55e832397290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f69b8005f70 tx=0x7f69b80049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bd7a72e8719a97 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3722449697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8035030 con 0x55e831fb8660 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3722449697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f69b8005170 con 0x55e831fb8660 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.267+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3722449697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69c40b4dc0 con 0x55e831fb8660 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3722449697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f69b8072050 con 0x55e831fb8660 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69d5a0b740 10 client.15981 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3722449697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e832410270 con 0x55e831fb8660 2024-08-28T19:33:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3722449697 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69b8069070 con 0x55e831fb8660 2024-08-28T19:33:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3722449697 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f69b8064480 con 0x55e831fb8660 2024-08-28T19:33:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69d5a0b740 10 client.15981 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69d5a0b740 10 client.15981 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:33:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69d5a0b740 20 client.15981 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e831fe1520 0x55e832412ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69d5a0b740 4 client.15981 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "13983a21", "release": true, "await": true}] 2024-08-28T19:33:48.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3722449697 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "13983a21", "release": true, "await": true}) -- 0x7f69c40b4dc0 con 0x55e831fe1520 2024-08-28T19:33:48.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.268+0000 7f69cd232640 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e831fe1520 0x55e832412ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:48.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.269+0000 7f69b0ff9640 10 client.15981 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:48.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.269+0000 7f69cd232640 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e831fe1520 0x55e832412ab0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef011c0a27af002f server_cookie=f03101ff82341ade in_seq=0 out_seq=0 2024-08-28T19:33:48.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69b0ff9640 1 -- 172.21.15.33:0/3722449697 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f69c40b4dc0 con 0x55e831fe1520 2024-08-28T19:33:48.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69b0ff9640 10 client.15981 handle_command_reply: tid=0 2024-08-28T19:33:48.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 client.15981 shutdown 2024-08-28T19:33:48.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3722449697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fb8660 msgr2=0x55e832397290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fb8660 0x55e832397290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f69b8005f70 tx=0x7f69b80049e0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3722449697 shutdown_connections 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e831fc0840 0x55e8323977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e831fe1520 0x55e832412ab0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e831fb8660 0x55e832397290 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 --2- 172.21.15.33:0/3722449697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e831f9fea0 0x55e83239ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69b0ff9640 0 client.15981 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3722449697 >> 172.21.15.33:0/3722449697 conn(0x55e831fd5910 msgr2=0x55e832393b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3722449697 shutdown_connections 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.273+0000 7f69d5a0b740 1 -- 172.21.15.33:0/3722449697 wait complete. 2024-08-28T19:33:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69d5a0b740 20 client.15981 trim_cache size 0 max 16384 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 4, 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout: "13983a21": { 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 4, 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:33:48.277 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 154.4, 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:48.278 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:48.279 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:33:48.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 -- 172.21.15.33:0/1170043371 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69b40b4ca0 msgr2=0x7f69b40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:48.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69b40b4ca0 0x7f69b40b71b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f69b8000c00 tx=0x7f69b8031400 comp rx=0 tx=0).stop 2024-08-28T19:33:48.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 -- 172.21.15.33:0/1170043371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69c8102820 msgr2=0x7f69c8198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:48.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69c8102820 0x7f69c8198e20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f69c400c890 tx=0x7f69c400cd50 comp rx=0 tx=0).stop 2024-08-28T19:33:48.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 -- 172.21.15.33:0/1170043371 shutdown_connections 2024-08-28T19:33:48.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69c8108ab0 0x7f69c81998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69b40b4ca0 0x7f69b40b71b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69c8108160 0x7f69c8199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 --2- 172.21.15.33:0/1170043371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69c8102820 0x7f69c8198e20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 -- 172.21.15.33:0/1170043371 >> 172.21.15.33:0/1170043371 conn(0x7f69c80794e0 msgr2=0x7f69c81041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 -- 172.21.15.33:0/1170043371 shutdown_connections 2024-08-28T19:33:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:48.274+0000 7f69cf496640 1 -- 172.21.15.33:0/1170043371 wait complete. 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-08-28T19:33:48.498 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-08-28T19:33:48.499 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-08-28T19:33:48.499 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-08-28T19:33:48.499 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-08-28T19:33:48.499 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-08-28T19:33:48.499 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-28T19:33:48.499 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-08-28T19:33:48.499 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-28T19:33:48.503 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-28T19:33:48.552 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-28T19:33:48.554 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-28T19:33:48.554 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-28T19:33:49.220 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '13983a21', total seconds elapsed: 38.0 2024-08-28T19:33:49.624 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-28T19:33:49.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:49 smithi033 ceph-mon[18549]: pgmap v383: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:33:49.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:49 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:33:49.693 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-28T19:33:49.734 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-28T19:33:49.736 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-28T19:33:49.736 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-28T19:33:49.774 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-28T19:33:49.778 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:33:49.778 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-28T19:33:49.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:49 smithi059 ceph-mon[22052]: pgmap v383: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:33:49.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:49 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:33:49.793 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-08-28T19:33:49.794 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-08-28T19:33:49.795 DEBUG:teuthology.orchestra.run.smithi033:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-08-28T19:33:49.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:49 smithi122 ceph-mon[22174]: pgmap v383: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:33:49.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:49 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:33:49.856 INFO:tasks.workunit.client.0.smithi033.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-08-28T19:33:49.856 INFO:tasks.workunit.client.0.smithi033.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-08-28T19:33:49.857 INFO:tasks.workunit.client.0.smithi033.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-08-28T19:33:51.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:51 smithi033 ceph-mon[18549]: pgmap v384: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:33:51.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:51 smithi059 ceph-mon[22052]: pgmap v384: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:33:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:51 smithi122 ceph-mon[22174]: pgmap v384: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:33:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:53 smithi033 ceph-mon[18549]: pgmap v385: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:33:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:33:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:33:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:33:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:33:53.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:53 smithi059 ceph-mon[22052]: pgmap v385: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:33:53.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:33:53.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:33:53.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:33:53.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:33:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:53 smithi122 ceph-mon[22174]: pgmap v385: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:33:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:33:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:33:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:33:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:33:55.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:55 smithi033 ceph-mon[18549]: pgmap v386: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-08-28T19:33:55.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:55 smithi059 ceph-mon[22052]: pgmap v386: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-08-28T19:33:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:55 smithi122 ceph-mon[22174]: pgmap v386: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-08-28T19:33:56.328 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:33:56.595 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:57.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.083+0000 7f3c807a8640 1 -- 172.21.15.33:0/3351683366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c78102880 msgr2=0x7f3c78102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:57.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.083+0000 7f3c807a8640 1 --2- 172.21.15.33:0/3351683366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c78102880 0x7f3c78102c90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009900 tx=0x7f3c7402a410 comp rx=0 tx=0).stop 2024-08-28T19:33:57.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.083+0000 7f3c807a8640 1 -- 172.21.15.33:0/3351683366 shutdown_connections 2024-08-28T19:33:57.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.083+0000 7f3c807a8640 1 --2- 172.21.15.33:0/3351683366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c78108b10 0x7f3c7810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.083+0000 7f3c807a8640 1 --2- 172.21.15.33:0/3351683366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c781081c0 0x7f3c781085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.084+0000 7f3c807a8640 1 --2- 172.21.15.33:0/3351683366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c78102880 0x7f3c78102c90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.084+0000 7f3c807a8640 1 -- 172.21.15.33:0/3351683366 >> 172.21.15.33:0/3351683366 conn(0x7f3c78079510 msgr2=0x7f3c78079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:57.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.084+0000 7f3c807a8640 1 -- 172.21.15.33:0/3351683366 shutdown_connections 2024-08-28T19:33:57.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.084+0000 7f3c807a8640 1 -- 172.21.15.33:0/3351683366 wait complete. 2024-08-28T19:33:57.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.084+0000 7f3c807a8640 1 Processor -- start 2024-08-28T19:33:57.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.084+0000 7f3c807a8640 1 -- start start 2024-08-28T19:33:57.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c807a8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c78102880 0x7f3c7819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c807a8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c781081c0 0x7f3c7819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c807a8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c78108b10 0x7f3c7819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c807a8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3c78112890 con 0x7f3c781081c0 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c807a8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c78112710 con 0x7f3c78102880 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c807a8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c78112a10 con 0x7f3c78108b10 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7dd43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c781081c0 0x7f3c7819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7dd43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c781081c0 0x7f3c7819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50274/0 (socket says 172.21.15.33:50274) 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7dd43640 1 -- 172.21.15.33:0/1229387846 learned_addr learned my addr 172.21.15.33:0/1229387846 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7e544640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c78102880 0x7f3c7819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7ed45640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c78108b10 0x7f3c7819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7dd43640 1 -- 172.21.15.33:0/1229387846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c78108b10 msgr2=0x7f3c7819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c78108b10 0x7f3c7819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7dd43640 1 -- 172.21.15.33:0/1229387846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c78102880 msgr2=0x7f3c7819a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:57.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c78102880 0x7f3c7819a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7dd43640 1 -- 172.21.15.33:0/1229387846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c781a0360 con 0x7f3c781081c0 2024-08-28T19:33:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.085+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c781081c0 0x7f3c7819a990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3c68006fd0 tx=0x7f3c6800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.086+0000 7f3c6f7fe640 1 -- 172.21.15.33:0/1229387846 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68011830 con 0x7f3c781081c0 2024-08-28T19:33:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.086+0000 7f3c807a8640 1 -- 172.21.15.33:0/1229387846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c781a0650 con 0x7f3c781081c0 2024-08-28T19:33:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.086+0000 7f3c6f7fe640 1 -- 172.21.15.33:0/1229387846 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c68016070 con 0x7f3c781081c0 2024-08-28T19:33:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.086+0000 7f3c6f7fe640 1 -- 172.21.15.33:0/1229387846 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68010e00 con 0x7f3c781081c0 2024-08-28T19:33:57.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.086+0000 7f3c807a8640 1 -- 172.21.15.33:0/1229387846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c781a6db0 con 0x7f3c781081c0 2024-08-28T19:33:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.088+0000 7f3c86d1d740 1 Processor -- start 2024-08-28T19:33:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c86d1d740 1 -- start start 2024-08-28T19:33:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d16a070 0x556a6d50f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c6f7fe640 1 -- 172.21.15.33:0/1229387846 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3c6801b460 con 0x7f3c781081c0 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d1411b0 0x556a6d50f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d149390 0x556a6d50fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556a6d486630 con 0x556a6d16a070 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556a6d475bc0 con 0x556a6d1411b0 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556a6d479b70 con 0x556a6d149390 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c7ed45640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d16a070 0x556a6d50f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c7ed45640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d16a070 0x556a6d50f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50284/0 (socket says 172.21.15.33:50284) 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c7ed45640 1 -- 172.21.15.33:0/2553125731 learned_addr learned my addr 172.21.15.33:0/2553125731 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/2553125731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d149390 0x556a6d50fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c7e544640 1 --2- 172.21.15.33:0/2553125731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d1411b0 0x556a6d50f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c7ed45640 1 -- 172.21.15.33:0/2553125731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d149390 msgr2=0x556a6d50fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:57.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c7ed45640 1 --2- 172.21.15.33:0/2553125731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d149390 0x556a6d50fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c7ed45640 1 -- 172.21.15.33:0/2553125731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d1411b0 msgr2=0x556a6d50f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c7ed45640 1 --2- 172.21.15.33:0/2553125731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d1411b0 0x556a6d50f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.089+0000 7f3c7ed45640 1 -- 172.21.15.33:0/2553125731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a6d1d5650 con 0x556a6d16a070 2024-08-28T19:33:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.090+0000 7f3c7ed45640 1 --2- 172.21.15.33:0/2553125731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d16a070 0x556a6d50f2c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000a430 tx=0x7f3c70009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2048a9a303d01688 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.090+0000 7f3c6cff9640 1 -- 172.21.15.33:0/2553125731 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c70013790 con 0x556a6d16a070 2024-08-28T19:33:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.090+0000 7f3c6f7fe640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c640b4ca0 0x7f3c640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.090+0000 7f3c6cff9640 1 -- 172.21.15.33:0/2553125731 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c70019070 con 0x556a6d16a070 2024-08-28T19:33:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.090+0000 7f3c6cff9640 1 -- 172.21.15.33:0/2553125731 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c70014ce0 con 0x556a6d16a070 2024-08-28T19:33:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.090+0000 7f3c7e544640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c640b4ca0 0x7f3c640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.090+0000 7f3c6f7fe640 1 -- 172.21.15.33:0/1229387846 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3c680e4d40 con 0x7f3c781081c0 2024-08-28T19:33:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2553125731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d16a070 msgr2=0x556a6d50f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2553125731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d16a070 0x556a6d50f2c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000a430 tx=0x7f3c70009650 comp rx=0 tx=0).stop 2024-08-28T19:33:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c7e544640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c640b4ca0 0x7f3c640b71b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3c74031440 tx=0x7f3c74009660 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:57.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2553125731 shutdown_connections 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2553125731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d149390 0x556a6d50fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2553125731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d1411b0 0x556a6d50f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2553125731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d16a070 0x556a6d50f2c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2553125731 >> 172.21.15.33:0/2553125731 conn(0x556a6d15e460 msgr2=0x556a6d50d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2553125731 shutdown_connections 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2553125731 wait complete. 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.091+0000 7f3c86d1d740 1 -- start start 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c86d1d740 1 Processor -- start 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1411b0 0x556a6d51aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d149390 0x556a6d51afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d16a070 0x556a6d526d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556a6d2d8700 con 0x556a6d149390 2024-08-28T19:33:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556a6d3fc700 con 0x556a6d16a070 2024-08-28T19:33:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556a6d51daa0 con 0x556a6d1411b0 2024-08-28T19:33:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c86d1d740 10 client.0 _ll_register_callbacks cb 0x556a6d42bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7dd43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d149390 0x556a6d51afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7dd43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d149390 0x556a6d51afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50298/0 (socket says 172.21.15.33:50298) 2024-08-28T19:33:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2288088196 learned_addr learned my addr 172.21.15.33:0/2288088196 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7e544640 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1411b0 0x556a6d51aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7ed45640 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d16a070 0x556a6d526d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2288088196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1411b0 msgr2=0x556a6d51aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1411b0 0x556a6d51aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2288088196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d16a070 msgr2=0x556a6d526d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d16a070 0x556a6d526d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2288088196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a6d4358b0 con 0x556a6d149390 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7e544640 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1411b0 0x556a6d51aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.092+0000 7f3c7ed45640 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d16a070 0x556a6d526d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d149390 0x556a6d51afb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800bde0 tx=0x7f3c680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40d80beb4cc5e37 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2288088196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c680ab7e0 con 0x556a6d149390 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2288088196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3c680a7370 con 0x556a6d149390 2024-08-28T19:33:57.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2288088196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c70019070 con 0x556a6d149390 2024-08-28T19:33:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2288088196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c680ab0e0 con 0x556a6d149390 2024-08-28T19:33:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c86d1d740 10 client.15993 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2288088196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556a6d5298a0 con 0x556a6d149390 2024-08-28T19:33:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2288088196 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c70019070 con 0x556a6d149390 2024-08-28T19:33:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2288088196 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3c680a6a50 con 0x556a6d149390 2024-08-28T19:33:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c86d1d740 10 client.15993 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c86d1d740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:33:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c86d1d740 20 client.15993 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:57.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556a6d1289f0 0x556a6d52cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c86d1d740 4 client.15993 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.093+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2288088196 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a6d488580 con 0x556a6d1289f0 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.094+0000 7f3c7e544640 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556a6d1289f0 0x556a6d52cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.094+0000 7f3c61ffb640 10 client.15993 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.094+0000 7f3c7e544640 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556a6d1289f0 0x556a6d52cd70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e4ab8093dc7d909 server_cookie=4df67e29abd10b10 in_seq=0 out_seq=0 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2288088196 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a6d488580 con 0x556a6d1289f0 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c61ffb640 10 client.15993 handle_command_reply: tid=0 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 client.15993 shutdown 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2288088196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d149390 msgr2=0x556a6d51afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d149390 0x556a6d51afb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800bde0 tx=0x7f3c680046c0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2288088196 shutdown_connections 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d16a070 0x556a6d526d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556a6d1289f0 0x556a6d52cd70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d149390 0x556a6d51afb0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c61ffb640 0 client.15993 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2288088196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1411b0 0x556a6d51aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2288088196 >> 172.21.15.33:0/2288088196 conn(0x556a6d15e460 msgr2=0x556a6d5124a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2288088196 shutdown_connections 2024-08-28T19:33:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.095+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2288088196 wait complete. 2024-08-28T19:33:57.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.096+0000 7f3c86d1d740 20 client.15993 trim_cache size 0 max 16384 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c86d1d740 1 Processor -- start 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c86d1d740 1 -- start start 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1289f0 0x556a6d526c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d5271d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d149390 0x556a6d5123c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781b0d40 con 0x556a6d1411b0 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781b2880 con 0x556a6d149390 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781b1410 con 0x556a6d1289f0 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c7dd43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d5271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c7dd43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d5271d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50302/0 (socket says 172.21.15.33:50302) 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.113+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2609520134 learned_addr learned my addr 172.21.15.33:0/2609520134 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.114+0000 7f3c7e544640 1 --2- 172.21.15.33:0/2609520134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1289f0 0x556a6d526c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.114+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2609520134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1289f0 msgr2=0x556a6d526c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:57.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.114+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/2609520134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1289f0 0x556a6d526c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.114+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2609520134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d149390 msgr2=0x556a6d5123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:57.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.114+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/2609520134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d149390 0x556a6d5123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.114+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2609520134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a6d51d1b0 con 0x556a6d1411b0 2024-08-28T19:33:57.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.114+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/2609520134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d5271d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3c68015000 tx=0x7f3c68010820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763529af5fb49cba server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:57.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.114+0000 7f3c63fff640 1 -- 172.21.15.33:0/2609520134 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c680b3f70 con 0x556a6d1411b0 2024-08-28T19:33:57.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.114+0000 7f3c63fff640 1 -- 172.21.15.33:0/2609520134 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c680b4160 con 0x556a6d1411b0 2024-08-28T19:33:57.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.114+0000 7f3c63fff640 1 -- 172.21.15.33:0/2609520134 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c680aa850 con 0x556a6d1411b0 2024-08-28T19:33:57.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.115+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2609520134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 msgr2=0x556a6d5271d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:57.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.115+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2609520134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d5271d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3c68015000 tx=0x7f3c68010820 comp rx=0 tx=0).stop 2024-08-28T19:33:57.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.115+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2609520134 shutdown_connections 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.115+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2609520134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d149390 0x556a6d5123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.115+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2609520134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d5271d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.115+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2609520134 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1289f0 0x556a6d526c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.115+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2609520134 >> 172.21.15.33:0/2609520134 conn(0x556a6d15e460 msgr2=0x556a6d5192f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.115+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2609520134 shutdown_connections 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.115+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2609520134 wait complete. 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.115+0000 7f3c86d1d740 1 -- start start 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c86d1d740 1 Processor -- start 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1289f0 0x556a6d51f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d51fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c86d1d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d149390 0x556a6d5906c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781b21b0 con 0x556a6d1411b0 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781b1ae0 con 0x556a6d149390 2024-08-28T19:33:57.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c86d1d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c781aed20 con 0x556a6d1289f0 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c86d1d740 10 client.0 _ll_register_callbacks cb 0x7f3c68010720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c7dd43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d51fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c7dd43640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d51fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50314/0 (socket says 172.21.15.33:50314) 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2917743760 learned_addr learned my addr 172.21.15.33:0/2917743760 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c7ed45640 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d149390 0x556a6d5906c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c7e544640 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1289f0 0x556a6d51f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2917743760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1289f0 msgr2=0x556a6d51f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1289f0 0x556a6d51f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2917743760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d149390 msgr2=0x556a6d5906c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d149390 0x556a6d5906c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.116+0000 7f3c7dd43640 1 -- 172.21.15.33:0/2917743760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a6d590d30 con 0x556a6d1411b0 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c7dd43640 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d51fbb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000c00 tx=0x7f3c68010380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b181cb74baaa166 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:57.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2917743760 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c680aa850 con 0x556a6d1411b0 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2917743760 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3c680a9e30 con 0x556a6d1411b0 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2917743760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556a6d484020 con 0x556a6d1411b0 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2917743760 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c680af950 con 0x556a6d1411b0 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c86d1d740 10 client.15999 fetch_fsmap learned FSMap version 28 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2917743760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556a6d598080 con 0x556a6d1411b0 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2917743760 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556a6d484020 con 0x556a6d1411b0 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2917743760 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3c68096230 con 0x556a6d1411b0 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c86d1d740 10 client.15999 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c86d1d740 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c86d1d740 20 client.15999 populate_metadata read hostname 'smithi033' 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556a6d16a070 0x556a6d59a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c86d1d740 4 client.15999 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:33:57.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.117+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2917743760 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556a6d481760 con 0x556a6d16a070 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c7e544640 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556a6d16a070 0x556a6d59a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c61ffb640 10 client.15999 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c7e544640 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556a6d16a070 0x556a6d59a560 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef13371270c02a37 server_cookie=2939e5bf0b4dd3cc in_seq=0 out_seq=0 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c61ffb640 1 -- 172.21.15.33:0/2917743760 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x556a6d481760 con 0x556a6d16a070 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c61ffb640 10 client.15999 handle_command_reply: tid=0 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c86d1d740 1 client.15999 shutdown 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2917743760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 msgr2=0x556a6d51fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d51fbb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000c00 tx=0x7f3c68010380 comp rx=0 tx=0).stop 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2917743760 shutdown_connections 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556a6d149390 0x556a6d5906c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.118+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556a6d16a070 0x556a6d59a560 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556a6d1411b0 0x556a6d51fbb0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c86d1d740 1 --2- 172.21.15.33:0/2917743760 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556a6d1289f0 0x556a6d51f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2917743760 >> 172.21.15.33:0/2917743760 conn(0x556a6d15e460 msgr2=0x556a6d5102f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:57.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c61ffb640 0 client.15999 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:33:57.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2917743760 shutdown_connections 2024-08-28T19:33:57.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c86d1d740 1 -- 172.21.15.33:0/2917743760 wait complete. 2024-08-28T19:33:57.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c86d1d740 20 client.15999 trim_cache size 0 max 16384 2024-08-28T19:33:57.126 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:33:57.126 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:33:57.126 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:33:57.126 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:33:57.126 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:33:57.126 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:33:57.126 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:33:57.127 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:33:57.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c807a8640 1 -- 172.21.15.33:0/1229387846 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c640b4ca0 msgr2=0x7f3c640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:57.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c807a8640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c640b4ca0 0x7f3c640b71b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3c74031440 tx=0x7f3c74009660 comp rx=0 tx=0).stop 2024-08-28T19:33:57.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c807a8640 1 -- 172.21.15.33:0/1229387846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c781081c0 msgr2=0x7f3c7819a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:57.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c807a8640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c781081c0 0x7f3c7819a990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3c68006fd0 tx=0x7f3c6800b8e0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c807a8640 1 -- 172.21.15.33:0/1229387846 shutdown_connections 2024-08-28T19:33:57.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c807a8640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c640b4ca0 0x7f3c640b71b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c807a8640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c78108b10 0x7f3c7819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c807a8640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c781081c0 0x7f3c7819a990 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c807a8640 1 --2- 172.21.15.33:0/1229387846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c78102880 0x7f3c7819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:57.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.119+0000 7f3c807a8640 1 -- 172.21.15.33:0/1229387846 >> 172.21.15.33:0/1229387846 conn(0x7f3c78079510 msgr2=0x7f3c78101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:57.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.120+0000 7f3c807a8640 1 -- 172.21.15.33:0/1229387846 shutdown_connections 2024-08-28T19:33:57.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:57.120+0000 7f3c807a8640 1 -- 172.21.15.33:0/1229387846 wait complete. 2024-08-28T19:33:57.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:57 smithi033 ceph-mon[18549]: pgmap v387: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-08-28T19:33:57.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:57 smithi059 ceph-mon[22052]: pgmap v387: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-08-28T19:33:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:57 smithi122 ceph-mon[22174]: pgmap v387: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-08-28T19:33:57.988 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:33:57.988 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:33:58.248 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:33:58.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.724+0000 7fb981b45640 1 -- 172.21.15.33:0/28025752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb97c102800 msgr2=0x7fb97c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:58.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.724+0000 7fb981b45640 1 --2- 172.21.15.33:0/28025752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb97c102800 0x7fb97c102c10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009900 tx=0x7fb96c02a410 comp rx=0 tx=0).stop 2024-08-28T19:33:58.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.724+0000 7fb981b45640 1 -- 172.21.15.33:0/28025752 shutdown_connections 2024-08-28T19:33:58.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.724+0000 7fb981b45640 1 --2- 172.21.15.33:0/28025752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb97c108a90 0x7fb97c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:58.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.724+0000 7fb981b45640 1 --2- 172.21.15.33:0/28025752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb97c108140 0x7fb97c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:58.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.724+0000 7fb981b45640 1 --2- 172.21.15.33:0/28025752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb97c102800 0x7fb97c102c10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:58.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.724+0000 7fb981b45640 1 -- 172.21.15.33:0/28025752 >> 172.21.15.33:0/28025752 conn(0x7fb97c0794d0 msgr2=0x7fb97c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.724+0000 7fb981b45640 1 -- 172.21.15.33:0/28025752 shutdown_connections 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.724+0000 7fb981b45640 1 -- 172.21.15.33:0/28025752 wait complete. 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.725+0000 7fb981b45640 1 Processor -- start 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.725+0000 7fb981b45640 1 -- start start 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.725+0000 7fb981b45640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb97c102800 0x7fb97c19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.725+0000 7fb981b45640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb97c108140 0x7fb97c19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb981b45640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb97c108a90 0x7fb97c19fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb981b45640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c1126f0 con 0x7fb97c108140 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb981b45640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c112570 con 0x7fb97c102800 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb981b45640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c112870 con 0x7fb97c108a90 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb97c108140 0x7fb97c19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:58.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb97c108140 0x7fb97c19a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59954/0 (socket says 172.21.15.33:59954) 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97affd640 1 -- 172.21.15.33:0/1318797156 learned_addr learned my addr 172.21.15.33:0/1318797156 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97b7fe640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb97c102800 0x7fb97c19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97bfff640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb97c108a90 0x7fb97c19fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97affd640 1 -- 172.21.15.33:0/1318797156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb97c108a90 msgr2=0x7fb97c19fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97affd640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb97c108a90 0x7fb97c19fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97affd640 1 -- 172.21.15.33:0/1318797156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb97c102800 msgr2=0x7fb97c19a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97affd640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb97c102800 0x7fb97c19a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97affd640 1 -- 172.21.15.33:0/1318797156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c1a00c0 con 0x7fb97c108140 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97bfff640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb97c108a90 0x7fb97c19fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97b7fe640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb97c102800 0x7fb97c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb97affd640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb97c108140 0x7fb97c19a7b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c970 tx=0x7fb97000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb978ff9640 1 -- 172.21.15.33:0/1318797156 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970014070 con 0x7fb97c108140 2024-08-28T19:33:58.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb981b45640 1 -- 172.21.15.33:0/1318797156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97c1a03b0 con 0x7fb97c108140 2024-08-28T19:33:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb978ff9640 1 -- 172.21.15.33:0/1318797156 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb970004440 con 0x7fb97c108140 2024-08-28T19:33:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.726+0000 7fb978ff9640 1 -- 172.21.15.33:0/1318797156 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970003e50 con 0x7fb97c108140 2024-08-28T19:33:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.727+0000 7fb981b45640 1 -- 172.21.15.33:0/1318797156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97c1a6bd0 con 0x7fb97c108140 2024-08-28T19:33:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.727+0000 7fb981b45640 1 -- 172.21.15.33:0/1318797156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb97c102c10 con 0x7fb97c108140 2024-08-28T19:33:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.729+0000 7fb978ff9640 1 -- 172.21.15.33:0/1318797156 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb970017070 con 0x7fb97c108140 2024-08-28T19:33:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.730+0000 7fb978ff9640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9640b4e70 0x7fb9640b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:33:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.730+0000 7fb97b7fe640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9640b4e70 0x7fb9640b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:33:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.730+0000 7fb978ff9640 1 -- 172.21.15.33:0/1318797156 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fb9700e5cd0 con 0x7fb97c108140 2024-08-28T19:33:58.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.731+0000 7fb97b7fe640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9640b4e70 0x7fb9640b7380 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb96c031440 tx=0x7fb96c005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:33:58.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.734+0000 7fb978ff9640 1 -- 172.21.15.33:0/1318797156 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb97001e030 con 0x7fb97c108140 2024-08-28T19:33:58.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.959+0000 7fb981b45640 1 -- 172.21.15.33:0/1318797156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb97c19b340 con 0x7fb97c108140 2024-08-28T19:33:58.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.960+0000 7fb978ff9640 1 -- 172.21.15.33:0/1318797156 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fb97c19b340 con 0x7fb97c108140 2024-08-28T19:33:58.962 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:33:58.962 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:33:58.962 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:33:58.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 -- 172.21.15.33:0/1318797156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9640b4e70 msgr2=0x7fb9640b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:58.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9640b4e70 0x7fb9640b7380 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb96c031440 tx=0x7fb96c005d50 comp rx=0 tx=0).stop 2024-08-28T19:33:58.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 -- 172.21.15.33:0/1318797156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb97c108140 msgr2=0x7fb97c19a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:33:58.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb97c108140 0x7fb97c19a7b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c970 tx=0x7fb97000ce30 comp rx=0 tx=0).stop 2024-08-28T19:33:58.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 -- 172.21.15.33:0/1318797156 shutdown_connections 2024-08-28T19:33:58.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9640b4e70 0x7fb9640b7380 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:58.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb97c108a90 0x7fb97c19fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:58.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb97c108140 0x7fb97c19a7b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:58.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 --2- 172.21.15.33:0/1318797156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb97c102800 0x7fb97c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:33:58.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 -- 172.21.15.33:0/1318797156 >> 172.21.15.33:0/1318797156 conn(0x7fb97c0794d0 msgr2=0x7fb97c101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:33:58.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 -- 172.21.15.33:0/1318797156 shutdown_connections 2024-08-28T19:33:58.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:33:58.962+0000 7fb981b45640 1 -- 172.21.15.33:0/1318797156 wait complete. 2024-08-28T19:33:59.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:59 smithi033 ceph-mon[18549]: pgmap v388: 129 pgs: 129 active+clean; 1.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-08-28T19:33:59.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:33:59 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1318797156' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:59.776 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:33:59.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:59 smithi059 ceph-mon[22052]: pgmap v388: 129 pgs: 129 active+clean; 1.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-08-28T19:33:59.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:33:59 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1318797156' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:33:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:59 smithi122 ceph-mon[22174]: pgmap v388: 129 pgs: 129 active+clean; 1.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-08-28T19:33:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:33:59 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1318797156' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:34:00.036 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.553+0000 7f6913909640 1 -- 172.21.15.33:0/1602197592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f690c102fd0 msgr2=0x7f690c1033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.553+0000 7f6913909640 1 --2- 172.21.15.33:0/1602197592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f690c102fd0 0x7f690c1033e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6908009900 tx=0x7f690802a410 comp rx=0 tx=0).stop 2024-08-28T19:34:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.553+0000 7f6913909640 1 -- 172.21.15.33:0/1602197592 shutdown_connections 2024-08-28T19:34:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.553+0000 7f6913909640 1 --2- 172.21.15.33:0/1602197592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c108b50 0x7f690c10f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.553+0000 7f6913909640 1 --2- 172.21.15.33:0/1602197592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c108200 0x7f690c108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.553+0000 7f6913909640 1 --2- 172.21.15.33:0/1602197592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f690c102fd0 0x7f690c1033e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.553+0000 7f6913909640 1 -- 172.21.15.33:0/1602197592 >> 172.21.15.33:0/1602197592 conn(0x7f690c079c60 msgr2=0x7f690c07a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.553+0000 7f6913909640 1 -- 172.21.15.33:0/1602197592 shutdown_connections 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.553+0000 7f6913909640 1 -- 172.21.15.33:0/1602197592 wait complete. 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6913909640 1 Processor -- start 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6913909640 1 -- start start 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6913909640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c102fd0 0x7f690c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6913909640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f690c108200 0x7f690c19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6913909640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c108b50 0x7f690c19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6913909640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f690c112810 con 0x7f690c108200 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6913909640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f690c112690 con 0x7f690c108b50 2024-08-28T19:34:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6913909640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f690c112990 con 0x7f690c102fd0 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6910ea4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f690c108200 0x7f690c19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6910ea4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f690c108200 0x7f690c19a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59970/0 (socket says 172.21.15.33:59970) 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6910ea4640 1 -- 172.21.15.33:0/900930636 learned_addr learned my addr 172.21.15.33:0/900930636 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f69116a5640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c102fd0 0x7f690c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.554+0000 7f6911ea6640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c108b50 0x7f690c19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f6910ea4640 1 -- 172.21.15.33:0/900930636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c102fd0 msgr2=0x7f690c19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f6910ea4640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c102fd0 0x7f690c19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f6910ea4640 1 -- 172.21.15.33:0/900930636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c108b50 msgr2=0x7f690c19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f6910ea4640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c108b50 0x7f690c19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f6910ea4640 1 -- 172.21.15.33:0/900930636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690c1a02e0 con 0x7f690c108200 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f6911ea6640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c108b50 0x7f690c19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f69116a5640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c102fd0 0x7f690c19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f6910ea4640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f690c108200 0x7f690c19a910 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00d950 tx=0x7f68fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f69027fc640 1 -- 172.21.15.33:0/900930636 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc017070 con 0x7f690c108200 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f6913909640 1 -- 172.21.15.33:0/900930636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690c1a05d0 con 0x7f690c108200 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f69027fc640 1 -- 172.21.15.33:0/900930636 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68fc009c30 con 0x7f690c108200 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f69027fc640 1 -- 172.21.15.33:0/900930636 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0047a0 con 0x7f690c108200 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.555+0000 7f6913909640 1 -- 172.21.15.33:0/900930636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f690c1a6d30 con 0x7f690c108200 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f69027fc640 1 -- 172.21.15.33:0/900930636 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f68fc004020 con 0x7f690c108200 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6919e7e740 1 Processor -- start 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6919e7e740 1 -- start start 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278bd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 0x5640278bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6919e7e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564027834680 con 0x5640274f7390 2024-08-28T19:34:00.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6919e7e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564027823c10 con 0x5640274ef1b0 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6919e7e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564027827bc0 con 0x564027518070 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6910ea4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278bddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6910ea4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278bddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59986/0 (socket says 172.21.15.33:59986) 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6910ea4640 1 -- 172.21.15.33:0/1367205664 learned_addr learned my addr 172.21.15.33:0/1367205664 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.558+0000 7f6911ea6640 1 --2- 172.21.15.33:0/1367205664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f69116a5640 1 --2- 172.21.15.33:0/1367205664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 0x5640278bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f6910ea4640 1 -- 172.21.15.33:0/1367205664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 msgr2=0x5640278bd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f6910ea4640 1 --2- 172.21.15.33:0/1367205664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278bd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f6910ea4640 1 -- 172.21.15.33:0/1367205664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 msgr2=0x5640278bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f6910ea4640 1 --2- 172.21.15.33:0/1367205664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 0x5640278bd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f69027fc640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f68f80b4ca0 0x7f68f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f6910ea4640 1 -- 172.21.15.33:0/1367205664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564027583650 con 0x5640274f7390 2024-08-28T19:34:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f69116a5640 1 --2- 172.21.15.33:0/1367205664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 0x5640278bd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f6911ea6640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f68f80b4ca0 0x7f68f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f6910ea4640 1 --2- 172.21.15.33:0/1367205664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278bddd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0e2910 tx=0x7f68fc0a8080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8285d08ab46778f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f69027fc640 1 -- 172.21.15.33:0/900930636 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f68fc0e55d0 con 0x7f690c108200 2024-08-28T19:34:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f68f77fe640 1 -- 172.21.15.33:0/1367205664 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0ab740 con 0x5640274f7390 2024-08-28T19:34:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f68f77fe640 1 -- 172.21.15.33:0/1367205664 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68fc0b0440 con 0x5640274f7390 2024-08-28T19:34:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.559+0000 7f68f77fe640 1 -- 172.21.15.33:0/1367205664 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0ab0e0 con 0x5640274f7390 2024-08-28T19:34:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.560+0000 7f6919e7e740 1 -- 172.21.15.33:0/1367205664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 msgr2=0x5640278bddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.560+0000 7f6911ea6640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f68f80b4ca0 0x7f68f80b71b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6904005fd0 tx=0x7f69040085b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.560+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1367205664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278bddd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0e2910 tx=0x7f68fc0a8080 comp rx=0 tx=0).stop 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.560+0000 7f6919e7e740 1 -- 172.21.15.33:0/1367205664 shutdown_connections 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.560+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1367205664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278bddd0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.560+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1367205664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 0x5640278bd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.560+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1367205664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278bd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.560+0000 7f6919e7e740 1 -- 172.21.15.33:0/1367205664 >> 172.21.15.33:0/1367205664 conn(0x56402750c460 msgr2=0x5640278bb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.560+0000 7f6919e7e740 1 -- 172.21.15.33:0/1367205664 shutdown_connections 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.560+0000 7f6919e7e740 1 -- 172.21.15.33:0/1367205664 wait complete. 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.561+0000 7f6919e7e740 1 -- start start 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.561+0000 7f6919e7e740 1 Processor -- start 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.561+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5640274ef1b0 0x5640278cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.561+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274f7390 0x5640278cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.561+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564027518070 0x5640278d9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.561+0000 7f6919e7e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564027686700 con 0x564027518070 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6919e7e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5640277aa750 con 0x5640274f7390 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6919e7e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5640278cfe60 con 0x5640274ef1b0 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6919e7e740 10 client.0 _ll_register_callbacks cb 0x5640277d9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6911ea6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564027518070 0x5640278d9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6911ea6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564027518070 0x5640278d9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59996/0 (socket says 172.21.15.33:59996) 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6911ea6640 1 -- 172.21.15.33:0/1449808796 learned_addr learned my addr 172.21.15.33:0/1449808796 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f69116a5640 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5640274ef1b0 0x5640278cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6910ea4640 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274f7390 0x5640278cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6911ea6640 1 -- 172.21.15.33:0/1449808796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5640274ef1b0 msgr2=0x5640278cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6911ea6640 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5640274ef1b0 0x5640278cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6911ea6640 1 -- 172.21.15.33:0/1449808796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274f7390 msgr2=0x5640278cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:00.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6911ea6640 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274f7390 0x5640278cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6911ea6640 1 -- 172.21.15.33:0/1449808796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640277e3900 con 0x564027518070 2024-08-28T19:34:00.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f6911ea6640 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564027518070 0x5640278d9190 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6904008580 tx=0x7f6904004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f72793beb4901a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:00.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f68f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:00.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.562+0000 7f68f4ff9640 1 -- 172.21.15.33:0/1449808796 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6904025600 con 0x564027518070 2024-08-28T19:34:00.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f68f4ff9640 1 -- 172.21.15.33:0/1449808796 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f69040257a0 con 0x564027518070 2024-08-28T19:34:00.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f6919e7e740 1 -- 172.21.15.33:0/1449808796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5640278365d0 con 0x564027518070 2024-08-28T19:34:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f68f4ff9640 1 -- 172.21.15.33:0/1449808796 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f690402e050 con 0x564027518070 2024-08-28T19:34:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f6919e7e740 10 client.16017 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f6919e7e740 1 -- 172.21.15.33:0/1449808796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640278dbc70 con 0x564027518070 2024-08-28T19:34:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f68f4ff9640 1 -- 172.21.15.33:0/1449808796 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5640278365d0 con 0x564027518070 2024-08-28T19:34:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f68f4ff9640 1 -- 172.21.15.33:0/1449808796 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f690401d7a0 con 0x564027518070 2024-08-28T19:34:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f6919e7e740 10 client.16017 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f6919e7e740 10 client.16017 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:34:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f6919e7e740 20 client.16017 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5640274d69f0 0x5640278df190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f6919e7e740 4 client.16017 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.563+0000 7f6919e7e740 1 -- 172.21.15.33:0/1449808796 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564027832070 con 0x5640274d69f0 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.564+0000 7f69116a5640 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5640274d69f0 0x5640278df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.564+0000 7f69116a5640 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5640274d69f0 0x5640278df190 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d2815b4d0b23478 server_cookie=f22f34832988016c in_seq=0 out_seq=0 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.564+0000 7f68f4ff9640 10 client.16017 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f68f4ff9640 1 -- 172.21.15.33:0/1449808796 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564027832070 con 0x5640274d69f0 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f68f4ff9640 10 client.16017 handle_command_reply: tid=0 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 client.16017 shutdown 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 -- 172.21.15.33:0/1449808796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564027518070 msgr2=0x5640278d9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564027518070 0x5640278d9190 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6904008580 tx=0x7f6904004a40 comp rx=0 tx=0).stop 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 -- 172.21.15.33:0/1449808796 shutdown_connections 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5640274d69f0 0x5640278df190 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564027518070 0x5640278d9190 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274f7390 0x5640278cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1449808796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5640274ef1b0 0x5640278cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 -- 172.21.15.33:0/1449808796 >> 172.21.15.33:0/1449808796 conn(0x56402750c460 msgr2=0x5640278c04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f68f4ff9640 0 client.16017 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:34:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 -- 172.21.15.33:0/1449808796 shutdown_connections 2024-08-28T19:34:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 1 -- 172.21.15.33:0/1449808796 wait complete. 2024-08-28T19:34:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.565+0000 7f6919e7e740 20 client.16017 trim_cache size 0 max 16384 2024-08-28T19:34:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.578+0000 7f6919e7e740 1 Processor -- start 2024-08-28T19:34:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6919e7e740 1 -- start start 2024-08-28T19:34:00.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 0x5640278bb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6919e7e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f690c1aea50 con 0x5640274f7390 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6919e7e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f690c1b0590 con 0x5640274ef1b0 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6919e7e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f690c1af120 con 0x564027518070 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6910ea4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6910ea4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278d9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60008/0 (socket says 172.21.15.33:60008) 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6910ea4640 1 -- 172.21.15.33:0/1432732122 learned_addr learned my addr 172.21.15.33:0/1432732122 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f69116a5640 1 --2- 172.21.15.33:0/1432732122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 0x5640278bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6911ea6640 1 --2- 172.21.15.33:0/1432732122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6910ea4640 1 -- 172.21.15.33:0/1432732122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 msgr2=0x5640278c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6910ea4640 1 --2- 172.21.15.33:0/1432732122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278c03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6910ea4640 1 -- 172.21.15.33:0/1432732122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 msgr2=0x5640278bb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6910ea4640 1 --2- 172.21.15.33:0/1432732122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 0x5640278bb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6910ea4640 1 -- 172.21.15.33:0/1432732122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640278be130 con 0x5640274f7390 2024-08-28T19:34:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.579+0000 7f6910ea4640 1 --2- 172.21.15.33:0/1432732122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278d9090 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0a8130 tx=0x7f68fc00b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bb609b3899909e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.580+0000 7f68f6ffd640 1 -- 172.21.15.33:0/1432732122 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc095020 con 0x5640274f7390 2024-08-28T19:34:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.580+0000 7f68f6ffd640 1 -- 172.21.15.33:0/1432732122 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68fc0ab480 con 0x5640274f7390 2024-08-28T19:34:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.580+0000 7f68f6ffd640 1 -- 172.21.15.33:0/1432732122 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0ab2c0 con 0x5640274f7390 2024-08-28T19:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.580+0000 7f6919e7e740 1 -- 172.21.15.33:0/1432732122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 msgr2=0x5640278d9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.580+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1432732122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278d9090 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0a8130 tx=0x7f68fc00b4b0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.580+0000 7f6919e7e740 1 -- 172.21.15.33:0/1432732122 shutdown_connections 2024-08-28T19:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.580+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1432732122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.580+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1432732122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274f7390 0x5640278d9090 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.580+0000 7f6919e7e740 1 --2- 172.21.15.33:0/1432732122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274ef1b0 0x5640278bb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.580+0000 7f6919e7e740 1 -- 172.21.15.33:0/1432732122 >> 172.21.15.33:0/1432732122 conn(0x56402750c460 msgr2=0x5640278bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.581+0000 7f6919e7e740 1 -- 172.21.15.33:0/1432732122 shutdown_connections 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.581+0000 7f6919e7e740 1 -- 172.21.15.33:0/1432732122 wait complete. 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.581+0000 7f6919e7e740 1 -- start start 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.581+0000 7f6919e7e740 1 Processor -- start 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274ef1b0 0x5640278d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274f7390 0x5640278d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f6919e7e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f6919e7e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f690c1afec0 con 0x5640274ef1b0 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f6919e7e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f690c1af7f0 con 0x5640274f7390 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f6919e7e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f690c1aca30 con 0x564027518070 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f6919e7e740 10 client.0 _ll_register_callbacks cb 0x7f6904005bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f69116a5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274ef1b0 0x5640278d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f69116a5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274ef1b0 0x5640278d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60018/0 (socket says 172.21.15.33:60018) 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f69116a5640 1 -- 172.21.15.33:0/2328965660 learned_addr learned my addr 172.21.15.33:0/2328965660 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f6910ea4640 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274f7390 0x5640278d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f6911ea6640 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f69116a5640 1 -- 172.21.15.33:0/2328965660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 msgr2=0x5640278d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f69116a5640 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f69116a5640 1 -- 172.21.15.33:0/2328965660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274f7390 msgr2=0x5640278d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f69116a5640 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274f7390 0x5640278d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f69116a5640 1 -- 172.21.15.33:0/2328965660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564027948b50 con 0x5640274ef1b0 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f69116a5640 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274ef1b0 0x5640278d1040 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6908005f70 tx=0x7f69080041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd5529ebef51471 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f68f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.582+0000 7f68f4ff9640 1 -- 172.21.15.33:0/2328965660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908035040 con 0x5640274ef1b0 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f68f4ff9640 1 -- 172.21.15.33:0/2328965660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f6908005240 con 0x5640274ef1b0 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f6919e7e740 1 -- 172.21.15.33:0/2328965660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68fc0ab480 con 0x5640274ef1b0 2024-08-28T19:34:00.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f68f4ff9640 1 -- 172.21.15.33:0/2328965660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6908054050 con 0x5640274ef1b0 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f6919e7e740 10 client.16023 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f6919e7e740 1 -- 172.21.15.33:0/2328965660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564027949da0 con 0x5640274ef1b0 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f68f4ff9640 1 -- 172.21.15.33:0/2328965660 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68fc0ab480 con 0x5640274ef1b0 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f68f4ff9640 1 -- 172.21.15.33:0/2328965660 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f69080035f0 con 0x5640274ef1b0 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f6919e7e740 10 client.16023 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f6919e7e740 10 client.16023 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f6919e7e740 20 client.16023 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f6919e7e740 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5640274abda0 0x56402794c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f6919e7e740 4 client.16023 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.583+0000 7f6919e7e740 1 -- 172.21.15.33:0/2328965660 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56402782f7b0 con 0x5640274abda0 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f6910ea4640 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5640274abda0 0x56402794c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f6910ea4640 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5640274abda0 0x56402794c5e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2bf6c6fe7d2a7176 server_cookie=35e1aba20e103d65 in_seq=0 out_seq=0 2024-08-28T19:34:00.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f68f4ff9640 10 client.16023 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f68f4ff9640 1 -- 172.21.15.33:0/2328965660 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56402782f7b0 con 0x5640274abda0 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f68f4ff9640 10 client.16023 handle_command_reply: tid=0 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f6919e7e740 1 client.16023 shutdown 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f6919e7e740 1 -- 172.21.15.33:0/2328965660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274ef1b0 msgr2=0x5640278d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f6919e7e740 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274ef1b0 0x5640278d1040 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6908005f70 tx=0x7f69080041f0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f6919e7e740 1 -- 172.21.15.33:0/2328965660 shutdown_connections 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f6919e7e740 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5640274abda0 0x56402794c5e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.584+0000 7f6919e7e740 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564027518070 0x5640278d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6919e7e740 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5640274f7390 0x5640278d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6919e7e740 1 --2- 172.21.15.33:0/2328965660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5640274ef1b0 0x5640278d1040 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6919e7e740 1 -- 172.21.15.33:0/2328965660 >> 172.21.15.33:0/2328965660 conn(0x56402750c460 msgr2=0x5640278be380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f68f4ff9640 0 client.16023 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6919e7e740 1 -- 172.21.15.33:0/2328965660 shutdown_connections 2024-08-28T19:34:00.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6919e7e740 1 -- 172.21.15.33:0/2328965660 wait complete. 2024-08-28T19:34:00.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6919e7e740 20 client.16023 trim_cache size 0 max 16384 2024-08-28T19:34:00.592 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:34:00.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6913909640 1 -- 172.21.15.33:0/900930636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f68f80b4ca0 msgr2=0x7f68f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6913909640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f68f80b4ca0 0x7f68f80b71b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6904005fd0 tx=0x7f69040085b0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6913909640 1 -- 172.21.15.33:0/900930636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f690c108200 msgr2=0x7f690c19a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6913909640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f690c108200 0x7f690c19a910 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00d950 tx=0x7f68fc00de10 comp rx=0 tx=0).stop 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6913909640 1 -- 172.21.15.33:0/900930636 shutdown_connections 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6913909640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f690c108b50 0x7f690c19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6913909640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f690c108200 0x7f690c19a910 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6913909640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f68f80b4ca0 0x7f68f80b71b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6913909640 1 --2- 172.21.15.33:0/900930636 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f690c102fd0 0x7f690c19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.585+0000 7f6913909640 1 -- 172.21.15.33:0/900930636 >> 172.21.15.33:0/900930636 conn(0x7f690c079c60 msgr2=0x7f690c1011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.586+0000 7f6913909640 1 -- 172.21.15.33:0/900930636 shutdown_connections 2024-08-28T19:34:00.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:00.586+0000 7f6913909640 1 -- 172.21.15.33:0/900930636 wait complete. 2024-08-28T19:34:01.463 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:34:01.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:01 smithi033 ceph-mon[18549]: pgmap v389: 129 pgs: 129 active+clean; 1.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-08-28T19:34:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:01 smithi059 ceph-mon[22052]: pgmap v389: 129 pgs: 129 active+clean; 1.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-08-28T19:34:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:01 smithi122 ceph-mon[22174]: pgmap v389: 129 pgs: 129 active+clean; 1.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-08-28T19:34:02.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.255+0000 7f8de37b1640 1 -- 172.21.15.33:0/1112889745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc104790 msgr2=0x7f8ddc104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.255+0000 7f8de37b1640 1 --2- 172.21.15.33:0/1112889745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc104790 0x7f8ddc104ba0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009900 tx=0x7f8dd802a410 comp rx=0 tx=0).stop 2024-08-28T19:34:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.255+0000 7f8de37b1640 1 -- 172.21.15.33:0/1112889745 shutdown_connections 2024-08-28T19:34:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.255+0000 7f8de37b1640 1 --2- 172.21.15.33:0/1112889745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc10dbf0 0x7f8ddc1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.255+0000 7f8de37b1640 1 --2- 172.21.15.33:0/1112889745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ddc1050e0 0x7f8ddc10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.255+0000 7f8de37b1640 1 --2- 172.21.15.33:0/1112889745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc104790 0x7f8ddc104ba0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.255+0000 7f8de37b1640 1 -- 172.21.15.33:0/1112889745 >> 172.21.15.33:0/1112889745 conn(0x7f8ddc0794f0 msgr2=0x7f8ddc079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.255+0000 7f8de37b1640 1 -- 172.21.15.33:0/1112889745 shutdown_connections 2024-08-28T19:34:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.255+0000 7f8de37b1640 1 -- 172.21.15.33:0/1112889745 wait complete. 2024-08-28T19:34:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.256+0000 7f8de37b1640 1 Processor -- start 2024-08-28T19:34:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.256+0000 7f8de37b1640 1 -- start start 2024-08-28T19:34:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de37b1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc104790 0x7f8ddc19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de37b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc1050e0 0x7f8ddc19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de37b1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ddc10dbf0 0x7f8ddc19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de37b1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc113870 con 0x7f8ddc1050e0 2024-08-28T19:34:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de37b1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc1136f0 con 0x7f8ddc104790 2024-08-28T19:34:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de37b1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc1139f0 con 0x7f8ddc10dbf0 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de0d4c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc1050e0 0x7f8ddc19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de0d4c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc1050e0 0x7f8ddc19a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60044/0 (socket says 172.21.15.33:60044) 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de0d4c640 1 -- 172.21.15.33:0/3398753751 learned_addr learned my addr 172.21.15.33:0/3398753751 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de154d640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc104790 0x7f8ddc19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de1d4e640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ddc10dbf0 0x7f8ddc19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de0d4c640 1 -- 172.21.15.33:0/3398753751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ddc10dbf0 msgr2=0x7f8ddc19fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ddc10dbf0 0x7f8ddc19fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de0d4c640 1 -- 172.21.15.33:0/3398753751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc104790 msgr2=0x7f8ddc19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc104790 0x7f8ddc19a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de0d4c640 1 -- 172.21.15.33:0/3398753751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc1a0290 con 0x7f8ddc1050e0 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc1050e0 0x7f8ddc19a8c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00d750 tx=0x7f8dcc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.257+0000 7f8dd27fc640 1 -- 172.21.15.33:0/3398753751 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc017070 con 0x7f8ddc1050e0 2024-08-28T19:34:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.258+0000 7f8dd27fc640 1 -- 172.21.15.33:0/3398753751 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dcc0054d0 con 0x7f8ddc1050e0 2024-08-28T19:34:02.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.258+0000 7f8de37b1640 1 -- 172.21.15.33:0/3398753751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ddc1a0580 con 0x7f8ddc1050e0 2024-08-28T19:34:02.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.258+0000 7f8dd27fc640 1 -- 172.21.15.33:0/3398753751 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc004c30 con 0x7f8ddc1050e0 2024-08-28T19:34:02.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.258+0000 7f8de37b1640 1 -- 172.21.15.33:0/3398753751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ddc1a6ce0 con 0x7f8ddc1050e0 2024-08-28T19:34:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.260+0000 7f8de9d26740 1 Processor -- start 2024-08-28T19:34:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.260+0000 7f8de9d26740 1 -- start start 2024-08-28T19:34:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.260+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af66070 0x55af7b30b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.260+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b30b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.260+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 0x55af7b30bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.260+0000 7f8de9d26740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55af7b282680 con 0x55af7af3d1b0 2024-08-28T19:34:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.260+0000 7f8de9d26740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55af7b271c10 con 0x55af7af66070 2024-08-28T19:34:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.260+0000 7f8de9d26740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55af7b275bc0 con 0x55af7af45390 2024-08-28T19:34:02.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8dd27fc640 1 -- 172.21.15.33:0/3398753751 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8dcc010460 con 0x7f8ddc1050e0 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de154d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b30b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de154d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b30b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60056/0 (socket says 172.21.15.33:60056) 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de154d640 1 -- 172.21.15.33:0/635805197 learned_addr learned my addr 172.21.15.33:0/635805197 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de1d4e640 1 --2- 172.21.15.33:0/635805197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af66070 0x55af7b30b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/635805197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 0x55af7b30bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de154d640 1 -- 172.21.15.33:0/635805197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 msgr2=0x55af7b30bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de154d640 1 --2- 172.21.15.33:0/635805197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 0x55af7b30bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de154d640 1 -- 172.21.15.33:0/635805197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af66070 msgr2=0x55af7b30b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de154d640 1 --2- 172.21.15.33:0/635805197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af66070 0x55af7b30b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de154d640 1 -- 172.21.15.33:0/635805197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af7afd1650 con 0x55af7af3d1b0 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/635805197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 0x55af7b30bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.261+0000 7f8de154d640 1 --2- 172.21.15.33:0/635805197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b30b850 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8dd802a930 tx=0x7f8dd8032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580514280ac9ac72 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:02.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.262+0000 7f8dc77fe640 1 -- 172.21.15.33:0/635805197 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd803f070 con 0x55af7af3d1b0 2024-08-28T19:34:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.262+0000 7f8dd27fc640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8dc80b4ca0 0x7f8dc80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.262+0000 7f8dc77fe640 1 -- 172.21.15.33:0/635805197 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd8032e40 con 0x55af7af3d1b0 2024-08-28T19:34:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.262+0000 7f8dc77fe640 1 -- 172.21.15.33:0/635805197 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8035070 con 0x55af7af3d1b0 2024-08-28T19:34:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.262+0000 7f8de1d4e640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8dc80b4ca0 0x7f8dc80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.262+0000 7f8dd27fc640 1 -- 172.21.15.33:0/3398753751 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8dcc0e5400 con 0x7f8ddc1050e0 2024-08-28T19:34:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 -- 172.21.15.33:0/635805197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 msgr2=0x55af7b30b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 --2- 172.21.15.33:0/635805197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b30b850 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8dd802a930 tx=0x7f8dd8032c50 comp rx=0 tx=0).stop 2024-08-28T19:34:02.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de1d4e640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8dc80b4ca0 0x7f8dc80b71b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4005fd0 tx=0x7f8dd4009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 -- 172.21.15.33:0/635805197 shutdown_connections 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 --2- 172.21.15.33:0/635805197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 0x55af7b30bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 --2- 172.21.15.33:0/635805197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b30b850 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 --2- 172.21.15.33:0/635805197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af66070 0x55af7b30b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 -- 172.21.15.33:0/635805197 >> 172.21.15.33:0/635805197 conn(0x55af7af5a460 msgr2=0x55af7b309200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 -- 172.21.15.33:0/635805197 shutdown_connections 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 -- 172.21.15.33:0/635805197 wait complete. 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 -- start start 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.263+0000 7f8de9d26740 1 Processor -- start 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af3d1b0 0x55af7b316a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 0x55af7b316fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af66070 0x55af7b322db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de9d26740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55af7b0d4700 con 0x55af7af66070 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de9d26740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55af7b1f8750 con 0x55af7af3d1b0 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de9d26740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55af7b319a90 con 0x55af7af45390 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de9d26740 10 client.0 _ll_register_callbacks cb 0x55af7b227e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de1d4e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af66070 0x55af7b322db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de1d4e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af66070 0x55af7b322db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60062/0 (socket says 172.21.15.33:60062) 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de0d4c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 0x55af7b316fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de1d4e640 1 -- 172.21.15.33:0/2574467054 learned_addr learned my addr 172.21.15.33:0/2574467054 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de154d640 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af3d1b0 0x55af7b316a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de1d4e640 1 -- 172.21.15.33:0/2574467054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 msgr2=0x55af7b316fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de1d4e640 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 0x55af7b316fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de1d4e640 1 -- 172.21.15.33:0/2574467054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af3d1b0 msgr2=0x55af7b316a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de1d4e640 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af3d1b0 0x55af7b316a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.264+0000 7f8de1d4e640 1 -- 172.21.15.33:0/2574467054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af7b231900 con 0x55af7af66070 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8de1d4e640 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af66070 0x55af7b322db0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009730 tx=0x7f8dd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee14b6076b4fc61 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8dc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/2574467054 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd402a060 con 0x55af7af66070 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/2574467054 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8dd4010e40 con 0x55af7af66070 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8de9d26740 1 -- 172.21.15.33:0/2574467054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af7b2845d0 con 0x55af7af66070 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/2574467054 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8dd4031050 con 0x55af7af66070 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8de9d26740 10 client.16035 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8de9d26740 1 -- 172.21.15.33:0/2574467054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af7b325890 con 0x55af7af66070 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/2574467054 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55af7b2845d0 con 0x55af7af66070 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/2574467054 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8dd4019040 con 0x55af7af66070 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8de9d26740 10 client.16035 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8de9d26740 10 client.16035 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:34:02.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8de9d26740 20 client.16035 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8de9d26740 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55af7af249f0 0x55af7b328e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8de9d26740 4 client.16035 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.265+0000 7f8de9d26740 1 -- 172.21.15.33:0/2574467054 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af7b280070 con 0x55af7af249f0 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.266+0000 7f8de154d640 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55af7af249f0 0x55af7b328e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.266+0000 7f8de154d640 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55af7af249f0 0x55af7b328e20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3b6557e707475dff server_cookie=a6f8c2c20f944a8a in_seq=0 out_seq=0 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.266+0000 7f8dc4ff9640 10 client.16035 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/2574467054 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af7b280070 con 0x55af7af249f0 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8dc4ff9640 10 client.16035 handle_command_reply: tid=0 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8de9d26740 1 client.16035 shutdown 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8de9d26740 1 -- 172.21.15.33:0/2574467054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af66070 msgr2=0x55af7b322db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8de9d26740 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af66070 0x55af7b322db0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009730 tx=0x7f8dd4004a40 comp rx=0 tx=0).stop 2024-08-28T19:34:02.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8de9d26740 1 -- 172.21.15.33:0/2574467054 shutdown_connections 2024-08-28T19:34:02.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8de9d26740 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55af7af249f0 0x55af7b328e20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8de9d26740 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af66070 0x55af7b322db0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8de9d26740 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af45390 0x55af7b316fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8de9d26740 1 --2- 172.21.15.33:0/2574467054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af3d1b0 0x55af7b316a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8de9d26740 1 -- 172.21.15.33:0/2574467054 >> 172.21.15.33:0/2574467054 conn(0x55af7af5a460 msgr2=0x55af7b30e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:02.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.267+0000 7f8dc4ff9640 0 client.16035 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:34:02.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.268+0000 7f8de9d26740 1 -- 172.21.15.33:0/2574467054 shutdown_connections 2024-08-28T19:34:02.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.268+0000 7f8de9d26740 1 -- 172.21.15.33:0/2574467054 wait complete. 2024-08-28T19:34:02.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.268+0000 7f8de9d26740 20 client.16035 trim_cache size 0 max 16384 2024-08-28T19:34:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de9d26740 1 Processor -- start 2024-08-28T19:34:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de9d26740 1 -- start start 2024-08-28T19:34:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b304230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 0x55af7b30e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af66070 0x55af7b30e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de9d26740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc1b0bb0 con 0x55af7af3d1b0 2024-08-28T19:34:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de9d26740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc1b26f0 con 0x55af7af45390 2024-08-28T19:34:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de9d26740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc1b1280 con 0x55af7af66070 2024-08-28T19:34:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de154d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b304230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de154d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b304230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60066/0 (socket says 172.21.15.33:60066) 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.281+0000 7f8de154d640 1 -- 172.21.15.33:0/2758520217 learned_addr learned my addr 172.21.15.33:0/2758520217 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/2758520217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 0x55af7b30e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8de154d640 1 -- 172.21.15.33:0/2758520217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af66070 msgr2=0x55af7b30e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8de154d640 1 --2- 172.21.15.33:0/2758520217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af66070 0x55af7b30e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8de154d640 1 -- 172.21.15.33:0/2758520217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 msgr2=0x55af7b30e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8de154d640 1 --2- 172.21.15.33:0/2758520217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 0x55af7b30e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8de154d640 1 -- 172.21.15.33:0/2758520217 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af7b30dba0 con 0x55af7af3d1b0 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/2758520217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 0x55af7b30e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8de154d640 1 --2- 172.21.15.33:0/2758520217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b304230 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009900 tx=0x7f8dd8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07996b93b4a0547 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8dc6ffd640 1 -- 172.21.15.33:0/2758520217 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd803f040 con 0x55af7af3d1b0 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8dc6ffd640 1 -- 172.21.15.33:0/2758520217 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd8005630 con 0x55af7af3d1b0 2024-08-28T19:34:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.282+0000 7f8dc6ffd640 1 -- 172.21.15.33:0/2758520217 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8035040 con 0x55af7af3d1b0 2024-08-28T19:34:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 -- 172.21.15.33:0/2758520217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 msgr2=0x55af7b304230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 --2- 172.21.15.33:0/2758520217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b304230 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009900 tx=0x7f8dd8005a20 comp rx=0 tx=0).stop 2024-08-28T19:34:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 -- 172.21.15.33:0/2758520217 shutdown_connections 2024-08-28T19:34:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 --2- 172.21.15.33:0/2758520217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af66070 0x55af7b30e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 --2- 172.21.15.33:0/2758520217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 0x55af7b30e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 --2- 172.21.15.33:0/2758520217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b304230 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 -- 172.21.15.33:0/2758520217 >> 172.21.15.33:0/2758520217 conn(0x55af7af5a460 msgr2=0x55af7b3152f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 -- 172.21.15.33:0/2758520217 shutdown_connections 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 -- 172.21.15.33:0/2758520217 wait complete. 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 -- start start 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.283+0000 7f8de9d26740 1 Processor -- start 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b38eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 0x55af7b31ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de9d26740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af66070 0x55af7b31f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de9d26740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc1b2020 con 0x55af7af3d1b0 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de9d26740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc1b1950 con 0x55af7af45390 2024-08-28T19:34:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de9d26740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc1aeb90 con 0x55af7af66070 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de9d26740 10 client.0 _ll_register_callbacks cb 0x7f8dd4009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de154d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b38eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de154d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b38eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60074/0 (socket says 172.21.15.33:60074) 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de154d640 1 -- 172.21.15.33:0/1287102223 learned_addr learned my addr 172.21.15.33:0/1287102223 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 0x55af7b31ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de154d640 1 -- 172.21.15.33:0/1287102223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af66070 msgr2=0x55af7b31f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de1d4e640 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af66070 0x55af7b31f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de154d640 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af66070 0x55af7b31f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de154d640 1 -- 172.21.15.33:0/1287102223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 msgr2=0x55af7b31ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de154d640 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 0x55af7b31ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de154d640 1 -- 172.21.15.33:0/1287102223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af7b31f9c0 con 0x55af7af3d1b0 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.284+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 0x55af7b31ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8de154d640 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b38eff0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80314d0 tx=0x7f8dd8031500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1998c11910f7f822 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8dc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/1287102223 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8035040 con 0x55af7af3d1b0 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/1287102223 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8dd8057680 con 0x55af7af3d1b0 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8de9d26740 1 -- 172.21.15.33:0/1287102223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af7b27d7b0 con 0x55af7af3d1b0 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/1287102223 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8dd803f040 con 0x55af7af3d1b0 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8de9d26740 10 client.16041 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8de9d26740 1 -- 172.21.15.33:0/1287102223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af7b397bf0 con 0x55af7af3d1b0 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/1287102223 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55af7b27d7b0 con 0x55af7af3d1b0 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/1287102223 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8dd804b070 con 0x55af7af3d1b0 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8de9d26740 10 client.16041 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8de9d26740 10 client.16041 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:34:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.285+0000 7f8de9d26740 20 client.16041 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.286+0000 7f8de9d26740 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55af7aef9da0 0x55af7b399ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.286+0000 7f8de9d26740 4 client.16041 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:34:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.286+0000 7f8de9d26740 1 -- 172.21.15.33:0/1287102223 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55af7b1f4aa0 con 0x55af7aef9da0 2024-08-28T19:34:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.286+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55af7aef9da0 0x55af7b399ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.286+0000 7f8de0d4c640 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55af7aef9da0 0x55af7b399ec0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a7869280c9e0d3ac server_cookie=656e4d08434f0c99 in_seq=0 out_seq=0 2024-08-28T19:34:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.286+0000 7f8dc4ff9640 10 client.16041 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:34:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8dc4ff9640 1 -- 172.21.15.33:0/1287102223 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55af7b1f4aa0 con 0x55af7aef9da0 2024-08-28T19:34:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8dc4ff9640 10 client.16041 handle_command_reply: tid=0 2024-08-28T19:34:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 client.16041 shutdown 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 -- 172.21.15.33:0/1287102223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 msgr2=0x55af7b38eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b38eff0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80314d0 tx=0x7f8dd8031500 comp rx=0 tx=0).stop 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 -- 172.21.15.33:0/1287102223 shutdown_connections 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55af7aef9da0 0x55af7b399ec0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af7af66070 0x55af7b31f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af7af45390 0x55af7b31ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 --2- 172.21.15.33:0/1287102223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af7af3d1b0 0x55af7b38eff0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 -- 172.21.15.33:0/1287102223 >> 172.21.15.33:0/1287102223 conn(0x55af7af5a460 msgr2=0x55af7b30c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8dc4ff9640 0 client.16041 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 -- 172.21.15.33:0/1287102223 shutdown_connections 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 1 -- 172.21.15.33:0/1287102223 wait complete. 2024-08-28T19:34:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de9d26740 20 client.16041 trim_cache size 0 max 16384 2024-08-28T19:34:02.295 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:34:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de37b1640 1 -- 172.21.15.33:0/3398753751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8dc80b4ca0 msgr2=0x7f8dc80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de37b1640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8dc80b4ca0 0x7f8dc80b71b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4005fd0 tx=0x7f8dd4009760 comp rx=0 tx=0).stop 2024-08-28T19:34:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de37b1640 1 -- 172.21.15.33:0/3398753751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc1050e0 msgr2=0x7f8ddc19a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.287+0000 7f8de37b1640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc1050e0 0x7f8ddc19a8c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00d750 tx=0x7f8dcc00dc10 comp rx=0 tx=0).stop 2024-08-28T19:34:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.288+0000 7f8de37b1640 1 -- 172.21.15.33:0/3398753751 shutdown_connections 2024-08-28T19:34:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.288+0000 7f8de37b1640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8dc80b4ca0 0x7f8dc80b71b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.288+0000 7f8de37b1640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ddc10dbf0 0x7f8ddc19fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.288+0000 7f8de37b1640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc1050e0 0x7f8ddc19a8c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.288+0000 7f8de37b1640 1 --2- 172.21.15.33:0/3398753751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc104790 0x7f8ddc19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.288+0000 7f8de37b1640 1 -- 172.21.15.33:0/3398753751 >> 172.21.15.33:0/3398753751 conn(0x7f8ddc0794f0 msgr2=0x7f8ddc107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.288+0000 7f8de37b1640 1 -- 172.21.15.33:0/3398753751 shutdown_connections 2024-08-28T19:34:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:02.288+0000 7f8de37b1640 1 -- 172.21.15.33:0/3398753751 wait complete. 2024-08-28T19:34:03.064 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:34:03.322 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:03.611 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:03 smithi033 ceph-mon[18549]: pgmap v390: 129 pgs: 129 active+clean; 1.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-28T19:34:03.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:03 smithi059 ceph-mon[22052]: pgmap v390: 129 pgs: 129 active+clean; 1.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-28T19:34:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:03 smithi122 ceph-mon[22174]: pgmap v390: 129 pgs: 129 active+clean; 1.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-08-28T19:34:03.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.840+0000 7f3bf3c86640 1 -- 172.21.15.33:0/1183911194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bec109bd0 msgr2=0x7f3bec110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:03.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.840+0000 7f3bf3c86640 1 --2- 172.21.15.33:0/1183911194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bec109bd0 0x7f3bec110400 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009900 tx=0x7f3be402a410 comp rx=0 tx=0).stop 2024-08-28T19:34:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.840+0000 7f3bf3c86640 1 -- 172.21.15.33:0/1183911194 shutdown_connections 2024-08-28T19:34:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.840+0000 7f3bf3c86640 1 --2- 172.21.15.33:0/1183911194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bec109bd0 0x7f3bec110400 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.840+0000 7f3bf3c86640 1 --2- 172.21.15.33:0/1183911194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bec109280 0x7f3bec109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.840+0000 7f3bf3c86640 1 --2- 172.21.15.33:0/1183911194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bec103940 0x7f3bec103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.840+0000 7f3bf3c86640 1 -- 172.21.15.33:0/1183911194 >> 172.21.15.33:0/1183911194 conn(0x7f3bec0ff3d0 msgr2=0x7f3bec101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.840+0000 7f3bf3c86640 1 -- 172.21.15.33:0/1183911194 shutdown_connections 2024-08-28T19:34:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.840+0000 7f3bf3c86640 1 -- 172.21.15.33:0/1183911194 wait complete. 2024-08-28T19:34:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf3c86640 1 Processor -- start 2024-08-28T19:34:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf3c86640 1 -- start start 2024-08-28T19:34:03.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf3c86640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bec103940 0x7f3bec19a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf3c86640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bec109280 0x7f3bec19a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf3c86640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bec109bd0 0x7f3bec19faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf3c86640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec1138f0 con 0x7f3bec103940 2024-08-28T19:34:03.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf3c86640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec113770 con 0x7f3bec109bd0 2024-08-28T19:34:03.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf3c86640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec113a70 con 0x7f3bec109280 2024-08-28T19:34:03.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf1a22640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bec103940 0x7f3bec19a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf1a22640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bec103940 0x7f3bec19a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60102/0 (socket says 172.21.15.33:60102) 2024-08-28T19:34:03.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf1a22640 1 -- 172.21.15.33:0/221595097 learned_addr learned my addr 172.21.15.33:0/221595097 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf1221640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bec109280 0x7f3bec19a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.841+0000 7f3bf2223640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bec109bd0 0x7f3bec19faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3bf1a22640 1 -- 172.21.15.33:0/221595097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bec109280 msgr2=0x7f3bec19a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bec109280 0x7f3bec19a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3bf1a22640 1 -- 172.21.15.33:0/221595097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bec109bd0 msgr2=0x7f3bec19faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bec109bd0 0x7f3bec19faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3bf1a22640 1 -- 172.21.15.33:0/221595097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec1a01d0 con 0x7f3bec103940 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bec103940 0x7f3bec19a260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00ba50 tx=0x7f3bdc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3beaffd640 1 -- 172.21.15.33:0/221595097 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc019070 con 0x7f3bec103940 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3beaffd640 1 -- 172.21.15.33:0/221595097 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bdc00cbe0 con 0x7f3bec103940 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3beaffd640 1 -- 172.21.15.33:0/221595097 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0075d0 con 0x7f3bec103940 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3bf3c86640 1 -- 172.21.15.33:0/221595097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bec1a04c0 con 0x7f3bec103940 2024-08-28T19:34:03.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.842+0000 7f3bf3c86640 1 -- 172.21.15.33:0/221595097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bec1a6c20 con 0x7f3bec103940 2024-08-28T19:34:03.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bfa1fb740 1 Processor -- start 2024-08-28T19:34:03.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bfa1fb740 1 -- start start 2024-08-28T19:34:03.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3beaffd640 1 -- 172.21.15.33:0/221595097 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3bdc01c070 con 0x7f3bec103940 2024-08-28T19:34:03.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1fa8070 0x55c8e234d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1f7f1b0 0x55c8e234d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e234dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c8e22c4680 con 0x55c8e1f87390 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c8e22b3c10 con 0x55c8e1f7f1b0 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c8e22b7bc0 con 0x55c8e1fa8070 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bf1221640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e234dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bf1221640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e234dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60104/0 (socket says 172.21.15.33:60104) 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.846+0000 7f3bf1221640 1 -- 172.21.15.33:0/1799629163 learned_addr learned my addr 172.21.15.33:0/1799629163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/1799629163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1f7f1b0 0x55c8e234d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bf2223640 1 --2- 172.21.15.33:0/1799629163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1fa8070 0x55c8e234d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bf1221640 1 -- 172.21.15.33:0/1799629163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1fa8070 msgr2=0x55c8e234d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bf1221640 1 --2- 172.21.15.33:0/1799629163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1fa8070 0x55c8e234d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bf1221640 1 -- 172.21.15.33:0/1799629163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1f7f1b0 msgr2=0x55c8e234d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bf1221640 1 --2- 172.21.15.33:0/1799629163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1f7f1b0 0x55c8e234d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bf1221640 1 -- 172.21.15.33:0/1799629163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e2013650 con 0x55c8e1f87390 2024-08-28T19:34:03.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bf2223640 1 --2- 172.21.15.33:0/1799629163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1fa8070 0x55c8e234d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:03.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bf1221640 1 --2- 172.21.15.33:0/1799629163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e234dd90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3be000bc30 tx=0x7f3be00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bc909f04847c2b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:03.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3beaffd640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bd40b4ca0 0x7f3bd40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bd3fff640 1 -- 172.21.15.33:0/1799629163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be001c480 con 0x55c8e1f87390 2024-08-28T19:34:03.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bf2223640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bd40b4ca0 0x7f3bd40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bd3fff640 1 -- 172.21.15.33:0/1799629163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3be001cad0 con 0x55c8e1f87390 2024-08-28T19:34:03.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3bd3fff640 1 -- 172.21.15.33:0/1799629163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0011aa0 con 0x55c8e1f87390 2024-08-28T19:34:03.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.847+0000 7f3beaffd640 1 -- 172.21.15.33:0/221595097 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3bdc0e4d80 con 0x7f3bec103940 2024-08-28T19:34:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.848+0000 7f3bf2223640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bd40b4ca0 0x7f3bd40b71b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3be4006010 tx=0x7f3be40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.848+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/1799629163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 msgr2=0x55c8e234dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.848+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/1799629163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e234dd90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3be000bc30 tx=0x7f3be00107a0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.849+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/1799629163 shutdown_connections 2024-08-28T19:34:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.849+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/1799629163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e234dd90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.849+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/1799629163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1f7f1b0 0x55c8e234d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.849+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/1799629163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1fa8070 0x55c8e234d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.849+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/1799629163 >> 172.21.15.33:0/1799629163 conn(0x55c8e1f9c460 msgr2=0x55c8e234b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.849+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/1799629163 shutdown_connections 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.849+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/1799629163 wait complete. 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.849+0000 7f3bfa1fb740 1 -- start start 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.849+0000 7f3bfa1fb740 1 Processor -- start 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f7f1b0 0x55c8e2358a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1f87390 0x55c8e2358f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1fa8070 0x55c8e2369220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c8e2116700 con 0x55c8e1fa8070 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c8e223a750 con 0x55c8e1f87390 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c8e235ff00 con 0x55c8e1f7f1b0 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf2223640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1fa8070 0x55c8e2369220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf2223640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1fa8070 0x55c8e2369220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60108/0 (socket says 172.21.15.33:60108) 2024-08-28T19:34:03.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bfa1fb740 10 client.0 _ll_register_callbacks cb 0x55c8e2269e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf2223640 1 -- 172.21.15.33:0/14089724 learned_addr learned my addr 172.21.15.33:0/14089724 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f7f1b0 0x55c8e2358a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf1221640 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1f87390 0x55c8e2358f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf2223640 1 -- 172.21.15.33:0/14089724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f7f1b0 msgr2=0x55c8e2358a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf2223640 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f7f1b0 0x55c8e2358a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf2223640 1 -- 172.21.15.33:0/14089724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1f87390 msgr2=0x55c8e2358f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf2223640 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1f87390 0x55c8e2358f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf2223640 1 -- 172.21.15.33:0/14089724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e2273900 con 0x55c8e1fa8070 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bf2223640 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1fa8070 0x55c8e2369220 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009900 tx=0x7f3be4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1051d09c1566737c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.850+0000 7f3bd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bd17fa640 1 -- 172.21.15.33:0/14089724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be404c070 con 0x55c8e1fa8070 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/14089724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3be001cad0 con 0x55c8e1fa8070 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bd17fa640 1 -- 172.21.15.33:0/14089724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3be4005050 con 0x55c8e1fa8070 2024-08-28T19:34:03.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bd17fa640 1 -- 172.21.15.33:0/14089724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3be4058050 con 0x55c8e1fa8070 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bfa1fb740 10 client.16053 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/14089724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8e236bca0 con 0x55c8e1fa8070 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bd17fa640 1 -- 172.21.15.33:0/14089724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3be001cad0 con 0x55c8e1fa8070 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bd17fa640 1 -- 172.21.15.33:0/14089724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3be40035f0 con 0x55c8e1fa8070 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bfa1fb740 10 client.16053 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bfa1fb740 10 client.16053 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bfa1fb740 20 client.16053 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c8e1f669f0 0x55c8e236f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bfa1fb740 4 client.16053 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.851+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/14089724 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8e22c65d0 con 0x55c8e1f669f0 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.852+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c8e1f669f0 0x55c8e236f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.852+0000 7f3bd17fa640 10 client.16053 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:34:03.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.852+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c8e1f669f0 0x55c8e236f1c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed3907a8416af407 server_cookie=9f798b9fcb97ab60 in_seq=0 out_seq=0 2024-08-28T19:34:03.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bd17fa640 1 -- 172.21.15.33:0/14089724 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8e22c65d0 con 0x55c8e1f669f0 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bd17fa640 10 client.16053 handle_command_reply: tid=0 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 client.16053 shutdown 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/14089724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1fa8070 msgr2=0x55c8e2369220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1fa8070 0x55c8e2369220 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009900 tx=0x7f3be4009260 comp rx=0 tx=0).stop 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/14089724 shutdown_connections 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c8e1f669f0 0x55c8e236f1c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1fa8070 0x55c8e2369220 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1f87390 0x55c8e2358f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bd17fa640 0 client.16053 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/14089724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f7f1b0 0x55c8e2358a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/14089724 >> 172.21.15.33:0/14089724 conn(0x55c8e1f9c460 msgr2=0x55c8e23504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/14089724 shutdown_connections 2024-08-28T19:34:03.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/14089724 wait complete. 2024-08-28T19:34:03.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.853+0000 7f3bfa1fb740 20 client.16053 trim_cache size 0 max 16384 2024-08-28T19:34:03.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bfa1fb740 1 Processor -- start 2024-08-28T19:34:03.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bfa1fb740 1 -- start start 2024-08-28T19:34:03.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f7f1b0 0x55c8e235a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f87390 0x55c8e2369120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 0x55c8e2355c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec1ae900 con 0x55c8e1f7f1b0 2024-08-28T19:34:03.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec1b0440 con 0x55c8e1fa8070 2024-08-28T19:34:03.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec1aefd0 con 0x55c8e1f87390 2024-08-28T19:34:03.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bf1a22640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f7f1b0 0x55c8e235a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bf1a22640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f7f1b0 0x55c8e235a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60124/0 (socket says 172.21.15.33:60124) 2024-08-28T19:34:03.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bf1a22640 1 -- 172.21.15.33:0/4099604617 learned_addr learned my addr 172.21.15.33:0/4099604617 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:03.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bf1221640 1 --2- 172.21.15.33:0/4099604617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f87390 0x55c8e2369120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.867+0000 7f3bf2223640 1 --2- 172.21.15.33:0/4099604617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 0x55c8e2355c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.868+0000 7f3bf1a22640 1 -- 172.21.15.33:0/4099604617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f87390 msgr2=0x55c8e2369120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:03.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.868+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/4099604617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f87390 0x55c8e2369120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.868+0000 7f3bf1a22640 1 -- 172.21.15.33:0/4099604617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 msgr2=0x55c8e2355c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:03.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.868+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/4099604617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 0x55c8e2355c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.868+0000 7f3bf1a22640 1 -- 172.21.15.33:0/4099604617 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e2353660 con 0x55c8e1f7f1b0 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.868+0000 7f3bf2223640 1 --2- 172.21.15.33:0/4099604617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 0x55c8e2355c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.868+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/4099604617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f7f1b0 0x55c8e235a660 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0e2780 tx=0x7f3bdc0e7290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119ec5e1572aff4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.868+0000 7f3bd37fe640 1 -- 172.21.15.33:0/4099604617 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0af990 con 0x55c8e1f7f1b0 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.868+0000 7f3bd37fe640 1 -- 172.21.15.33:0/4099604617 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bdc0b4440 con 0x55c8e1f7f1b0 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.868+0000 7f3bd37fe640 1 -- 172.21.15.33:0/4099604617 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0b4210 con 0x55c8e1f7f1b0 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.869+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/4099604617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f7f1b0 msgr2=0x55c8e235a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.869+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/4099604617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f7f1b0 0x55c8e235a660 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0e2780 tx=0x7f3bdc0e7290 comp rx=0 tx=0).stop 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.869+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/4099604617 shutdown_connections 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.869+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/4099604617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 0x55c8e2355c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.869+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/4099604617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f87390 0x55c8e2369120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.869+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/4099604617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f7f1b0 0x55c8e235a660 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.869+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/4099604617 >> 172.21.15.33:0/4099604617 conn(0x55c8e1f9c460 msgr2=0x55c8e2359f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:03.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.869+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/4099604617 shutdown_connections 2024-08-28T19:34:03.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.869+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/4099604617 wait complete. 2024-08-28T19:34:03.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.869+0000 7f3bfa1fb740 1 -- start start 2024-08-28T19:34:03.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bfa1fb740 1 Processor -- start 2024-08-28T19:34:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f7f1b0 0x55c8e2361a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e2362040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bfa1fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 0x55c8e23d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec1afd70 con 0x55c8e1f87390 2024-08-28T19:34:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec1af6a0 con 0x55c8e1fa8070 2024-08-28T19:34:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bfa1fb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec1ac8e0 con 0x55c8e1f7f1b0 2024-08-28T19:34:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bf1221640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e2362040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bfa1fb740 10 client.0 _ll_register_callbacks cb 0x7f3be4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bf1221640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e2362040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60136/0 (socket says 172.21.15.33:60136) 2024-08-28T19:34:03.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bf1221640 1 -- 172.21.15.33:0/2553083714 learned_addr learned my addr 172.21.15.33:0/2553083714 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bf2223640 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 0x55c8e23d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.870+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f7f1b0 0x55c8e2361a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bf1221640 1 -- 172.21.15.33:0/2553083714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f7f1b0 msgr2=0x55c8e2361a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bf1221640 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f7f1b0 0x55c8e2361a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bf1221640 1 -- 172.21.15.33:0/2553083714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 msgr2=0x55c8e23d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bf1221640 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 0x55c8e23d2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bf1221640 1 -- 172.21.15.33:0/2553083714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e23d31c0 con 0x55c8e1f87390 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bf2223640 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 0x55c8e23d2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bf1221640 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e2362040 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3be0000c00 tx=0x7f3be0011710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d304c4526ff862 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bd17fa640 1 -- 172.21.15.33:0/2553083714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0004220 con 0x55c8e1f87390 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bd17fa640 1 -- 172.21.15.33:0/2553083714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f3be00043c0 con 0x55c8e1f87390 2024-08-28T19:34:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/2553083714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bdc0b4440 con 0x55c8e1f87390 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bd17fa640 1 -- 172.21.15.33:0/2553083714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3be003c050 con 0x55c8e1f87390 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bfa1fb740 10 client.16059 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.871+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/2553083714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8e235b830 con 0x55c8e1f87390 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.872+0000 7f3bd17fa640 1 -- 172.21.15.33:0/2553083714 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bdc0b4440 con 0x55c8e1f87390 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.872+0000 7f3bd17fa640 1 -- 172.21.15.33:0/2553083714 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3be0032030 con 0x55c8e1f87390 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.872+0000 7f3bfa1fb740 10 client.16059 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.872+0000 7f3bfa1fb740 10 client.16059 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.872+0000 7f3bfa1fb740 20 client.16059 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.872+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c8e1f3bda0 0x55c8e235dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.872+0000 7f3bfa1fb740 4 client.16059 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.872+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/2553083714 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8e22c2070 con 0x55c8e1f3bda0 2024-08-28T19:34:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.872+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c8e1f3bda0 0x55c8e235dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bf1a22640 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c8e1f3bda0 0x55c8e235dec0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cffddd9b07cbc5a4 server_cookie=f239b76b0d8e9087 in_seq=0 out_seq=0 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bd17fa640 10 client.16059 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bd17fa640 1 -- 172.21.15.33:0/2553083714 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8e22c2070 con 0x55c8e1f3bda0 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bd17fa640 10 client.16059 handle_command_reply: tid=0 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 client.16059 shutdown 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/2553083714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 msgr2=0x55c8e2362040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e2362040 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3be0000c00 tx=0x7f3be0011710 comp rx=0 tx=0).stop 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/2553083714 shutdown_connections 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8e1fa8070 0x55c8e23d2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c8e1f3bda0 0x55c8e235dec0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8e1f87390 0x55c8e2362040 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 --2- 172.21.15.33:0/2553083714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8e1f7f1b0 0x55c8e2361a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/2553083714 >> 172.21.15.33:0/2553083714 conn(0x55c8e1f9c460 msgr2=0x55c8e234b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:03.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bd17fa640 0 client.16059 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:34:03.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/2553083714 shutdown_connections 2024-08-28T19:34:03.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.873+0000 7f3bfa1fb740 1 -- 172.21.15.33:0/2553083714 wait complete. 2024-08-28T19:34:03.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bfa1fb740 20 client.16059 trim_cache size 0 max 16384 2024-08-28T19:34:03.879 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:34:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 -- 172.21.15.33:0/221595097 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bd40b4ca0 msgr2=0x7f3bd40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bd40b4ca0 0x7f3bd40b71b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3be4006010 tx=0x7f3be40058d0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 -- 172.21.15.33:0/221595097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bec103940 msgr2=0x7f3bec19a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bec103940 0x7f3bec19a260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00ba50 tx=0x7f3bdc00bf10 comp rx=0 tx=0).stop 2024-08-28T19:34:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 -- 172.21.15.33:0/221595097 shutdown_connections 2024-08-28T19:34:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bec109bd0 0x7f3bec19faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3bd40b4ca0 0x7f3bd40b71b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3bec109280 0x7f3bec19a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 --2- 172.21.15.33:0/221595097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bec103940 0x7f3bec19a260 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 -- 172.21.15.33:0/221595097 >> 172.21.15.33:0/221595097 conn(0x7f3bec0ff3d0 msgr2=0x7f3bec1088b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 -- 172.21.15.33:0/221595097 shutdown_connections 2024-08-28T19:34:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:03.874+0000 7f3bf3c86640 1 -- 172.21.15.33:0/221595097 wait complete. 2024-08-28T19:34:04.628 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:34:04.885 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:05.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.392+0000 7ff00e9e5640 1 -- 172.21.15.33:0/2880120565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff008108ad0 msgr2=0x7ff00810f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:05.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.392+0000 7ff00e9e5640 1 --2- 172.21.15.33:0/2880120565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff008108ad0 0x7ff00810f300 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff000009ca0 tx=0x7ff00002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.392+0000 7ff00e9e5640 1 -- 172.21.15.33:0/2880120565 shutdown_connections 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.392+0000 7ff00e9e5640 1 --2- 172.21.15.33:0/2880120565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff008108ad0 0x7ff00810f300 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.392+0000 7ff00e9e5640 1 --2- 172.21.15.33:0/2880120565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff008108180 0x7ff008108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.392+0000 7ff00e9e5640 1 --2- 172.21.15.33:0/2880120565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff008102840 0x7ff008102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.392+0000 7ff00e9e5640 1 -- 172.21.15.33:0/2880120565 >> 172.21.15.33:0/2880120565 conn(0x7ff0080794f0 msgr2=0x7ff008079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.392+0000 7ff00e9e5640 1 -- 172.21.15.33:0/2880120565 shutdown_connections 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.392+0000 7ff00e9e5640 1 -- 172.21.15.33:0/2880120565 wait complete. 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7ff00e9e5640 1 Processor -- start 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7ff00e9e5640 1 -- start start 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7ff00e9e5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff008102840 0x7ff008198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7ff00e9e5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff008108180 0x7ff008199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7ff00e9e5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff008108ad0 0x7ff008199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7ff00e9e5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081127f0 con 0x7ff008108180 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7ff00e9e5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff008112670 con 0x7ff008102840 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7ff00e9e5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff008112970 con 0x7ff008108ad0 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7feffffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff008108180 0x7ff008199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7feffffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff008108180 0x7ff008199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60160/0 (socket says 172.21.15.33:60160) 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7feffffff640 1 -- 172.21.15.33:0/3787069120 learned_addr learned my addr 172.21.15.33:0/3787069120 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.393+0000 7ff007fff640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff008102840 0x7ff008198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7ff00cf82640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff008108ad0 0x7ff008199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7feffffff640 1 -- 172.21.15.33:0/3787069120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff008108ad0 msgr2=0x7ff008199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7feffffff640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff008108ad0 0x7ff008199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7feffffff640 1 -- 172.21.15.33:0/3787069120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff008102840 msgr2=0x7ff008198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7feffffff640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff008102840 0x7ff008198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7feffffff640 1 -- 172.21.15.33:0/3787069120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0081a8580 con 0x7ff008108180 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7feffffff640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff008108180 0x7ff008199410 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feff000d740 tx=0x7feff000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:05.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7ff005ffb640 1 -- 172.21.15.33:0/3787069120 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0017070 con 0x7ff008108180 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7ff005ffb640 1 -- 172.21.15.33:0/3787069120 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feff0010460 con 0x7ff008108180 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7ff00e9e5640 1 -- 172.21.15.33:0/3787069120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0081a8870 con 0x7ff008108180 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7ff005ffb640 1 -- 172.21.15.33:0/3787069120 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff000f600 con 0x7ff008108180 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.394+0000 7ff00e9e5640 1 -- 172.21.15.33:0/3787069120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0081a8db0 con 0x7ff008108180 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.397+0000 7ff014f5a740 1 Processor -- start 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.397+0000 7ff014f5a740 1 -- start start 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af982070 0x55e9afd27310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd27850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af961390 0x55e9afd27d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff014f5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e9afc9e680 con 0x55e9af9591b0 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff014f5a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e9afc8dc10 con 0x55e9af982070 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff014f5a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e9afc91bc0 con 0x55e9af961390 2024-08-28T19:34:05.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff007fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd27850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff007fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd27850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60164/0 (socket says 172.21.15.33:60164) 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff007fff640 1 -- 172.21.15.33:0/3197050379 learned_addr learned my addr 172.21.15.33:0/3197050379 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff005ffb640 1 -- 172.21.15.33:0/3787069120 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7feff001a070 con 0x7ff008108180 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff00cf82640 1 --2- 172.21.15.33:0/3197050379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af982070 0x55e9afd27310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff007fff640 1 -- 172.21.15.33:0/3197050379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af961390 msgr2=0x55e9afd27d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff007fff640 1 --2- 172.21.15.33:0/3197050379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af961390 0x55e9afd27d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff007fff640 1 -- 172.21.15.33:0/3197050379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af982070 msgr2=0x55e9afd27310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff007fff640 1 --2- 172.21.15.33:0/3197050379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af982070 0x55e9afd27310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff007fff640 1 -- 172.21.15.33:0/3197050379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9af9ed650 con 0x55e9af9591b0 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.398+0000 7ff007fff640 1 --2- 172.21.15.33:0/3197050379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd27850 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7feff8009a40 tx=0x7feff8009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823cafb3b375f585 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.399+0000 7feffe7fc640 1 -- 172.21.15.33:0/3197050379 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff8017070 con 0x55e9af9591b0 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.399+0000 7feffe7fc640 1 -- 172.21.15.33:0/3197050379 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feff8013470 con 0x55e9af9591b0 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.399+0000 7feffe7fc640 1 -- 172.21.15.33:0/3197050379 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff80125d0 con 0x55e9af9591b0 2024-08-28T19:34:05.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.399+0000 7ff005ffb640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feff40b4ca0 0x7feff40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.399+0000 7ff00cf82640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feff40b4ca0 0x7feff40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.399+0000 7ff005ffb640 1 -- 172.21.15.33:0/3787069120 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7feff00e5300 con 0x7ff008108180 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 -- 172.21.15.33:0/3197050379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 msgr2=0x55e9afd27850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 --2- 172.21.15.33:0/3197050379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd27850 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7feff8009a40 tx=0x7feff8009f00 comp rx=0 tx=0).stop 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff00cf82640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feff40b4ca0 0x7feff40b71b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff000006010 tx=0x7ff000009440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 -- 172.21.15.33:0/3197050379 shutdown_connections 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 --2- 172.21.15.33:0/3197050379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af961390 0x55e9afd27d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 --2- 172.21.15.33:0/3197050379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd27850 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 --2- 172.21.15.33:0/3197050379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af982070 0x55e9afd27310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 -- 172.21.15.33:0/3197050379 >> 172.21.15.33:0/3197050379 conn(0x55e9af976460 msgr2=0x55e9afd25200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 -- 172.21.15.33:0/3197050379 shutdown_connections 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 -- 172.21.15.33:0/3197050379 wait complete. 2024-08-28T19:34:05.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 -- start start 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.400+0000 7ff014f5a740 1 Processor -- start 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af9591b0 0x55e9afd32a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd32fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd3ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff014f5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e9afaf0700 con 0x55e9af982070 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff014f5a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e9afc14750 con 0x55e9af961390 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff014f5a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e9afd35af0 con 0x55e9af9591b0 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff014f5a740 10 client.0 _ll_register_callbacks cb 0x55e9afc43e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff00cf82640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd3ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff00cf82640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd3ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60178/0 (socket says 172.21.15.33:60178) 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff00cf82640 1 -- 172.21.15.33:0/1450897515 learned_addr learned my addr 172.21.15.33:0/1450897515 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff007fff640 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af9591b0 0x55e9afd32a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7feffffff640 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd32fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff00cf82640 1 -- 172.21.15.33:0/1450897515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af9591b0 msgr2=0x55e9afd32a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff00cf82640 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af9591b0 0x55e9afd32a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff00cf82640 1 -- 172.21.15.33:0/1450897515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 msgr2=0x55e9afd32fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff00cf82640 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd32fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff00cf82640 1 -- 172.21.15.33:0/1450897515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9afc4d900 con 0x55e9af982070 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7ff00cf82640 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd3ee10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff00002f430 tx=0x7ff00002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad613d2ae09d2e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7fefe77fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.401+0000 7fefe77fe640 1 -- 172.21.15.33:0/1450897515 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000004250 con 0x55e9af982070 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7fefe77fe640 1 -- 172.21.15.33:0/1450897515 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff0000043f0 con 0x55e9af982070 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7ff014f5a740 1 -- 172.21.15.33:0/1450897515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feff8013470 con 0x55e9af982070 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7fefe77fe640 1 -- 172.21.15.33:0/1450897515 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff0000045f0 con 0x55e9af982070 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7ff014f5a740 10 client.16071 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7ff014f5a740 1 -- 172.21.15.33:0/1450897515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9afd41890 con 0x55e9af982070 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7fefe77fe640 1 -- 172.21.15.33:0/1450897515 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feff8013470 con 0x55e9af982070 2024-08-28T19:34:05.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7fefe77fe640 1 -- 172.21.15.33:0/1450897515 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff000050070 con 0x55e9af982070 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7ff014f5a740 10 client.16071 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7ff014f5a740 10 client.16071 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7ff014f5a740 20 client.16071 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7ff014f5a740 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e9af9409f0 0x55e9afd44d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7ff014f5a740 4 client.16071 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7ff014f5a740 1 -- 172.21.15.33:0/1450897515 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9afca05d0 con 0x55e9af9409f0 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.402+0000 7ff007fff640 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e9af9409f0 0x55e9afd44d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.403+0000 7ff007fff640 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e9af9409f0 0x55e9afd44d80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b80975dc0a13909 server_cookie=7cc53603fba77162 in_seq=0 out_seq=0 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.403+0000 7fefe77fe640 10 client.16071 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7fefe77fe640 1 -- 172.21.15.33:0/1450897515 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9afca05d0 con 0x55e9af9409f0 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7fefe77fe640 10 client.16071 handle_command_reply: tid=0 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 client.16071 shutdown 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 -- 172.21.15.33:0/1450897515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 msgr2=0x55e9afd3ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd3ee10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff00002f430 tx=0x7ff00002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 -- 172.21.15.33:0/1450897515 shutdown_connections 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e9af9409f0 0x55e9afd44d80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd3ee10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd32fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 --2- 172.21.15.33:0/1450897515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af9591b0 0x55e9afd32a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 -- 172.21.15.33:0/1450897515 >> 172.21.15.33:0/1450897515 conn(0x55e9af976460 msgr2=0x55e9afd2a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7fefe77fe640 0 client.16071 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 -- 172.21.15.33:0/1450897515 shutdown_connections 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 1 -- 172.21.15.33:0/1450897515 wait complete. 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.404+0000 7ff014f5a740 20 client.16071 trim_cache size 0 max 16384 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.417+0000 7ff014f5a740 1 Processor -- start 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.417+0000 7ff014f5a740 1 -- start start 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af9591b0 0x55e9afd25250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd3ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd2a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff014f5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b2d20 con 0x55e9af982070 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff014f5a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b4860 con 0x55e9af961390 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff014f5a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b33f0 con 0x55e9af9591b0 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff00cf82640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd2a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff00cf82640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd2a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60182/0 (socket says 172.21.15.33:60182) 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff00cf82640 1 -- 172.21.15.33:0/3779391106 learned_addr learned my addr 172.21.15.33:0/3779391106 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff007fff640 1 --2- 172.21.15.33:0/3779391106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af9591b0 0x55e9afd25250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7feffffff640 1 --2- 172.21.15.33:0/3779391106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd3ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff00cf82640 1 -- 172.21.15.33:0/3779391106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af9591b0 msgr2=0x55e9afd25250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff00cf82640 1 --2- 172.21.15.33:0/3779391106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af9591b0 0x55e9afd25250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff00cf82640 1 -- 172.21.15.33:0/3779391106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 msgr2=0x55e9afd3ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff00cf82640 1 --2- 172.21.15.33:0/3779391106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd3ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff00cf82640 1 -- 172.21.15.33:0/3779391106 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9afd29600 con 0x55e9af982070 2024-08-28T19:34:05.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7ff00cf82640 1 --2- 172.21.15.33:0/3779391106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd2a410 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff000009a60 tx=0x7ff000031e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5928b7679bcbb31 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7feffdffb640 1 -- 172.21.15.33:0/3779391106 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000030da0 con 0x55e9af982070 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7feffdffb640 1 -- 172.21.15.33:0/3779391106 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff000036050 con 0x55e9af982070 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.418+0000 7feffdffb640 1 -- 172.21.15.33:0/3779391106 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00002fb10 con 0x55e9af982070 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.419+0000 7ff014f5a740 1 -- 172.21.15.33:0/3779391106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 msgr2=0x55e9afd2a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.419+0000 7ff014f5a740 1 --2- 172.21.15.33:0/3779391106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd2a410 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff000009a60 tx=0x7ff000031e90 comp rx=0 tx=0).stop 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.419+0000 7ff014f5a740 1 -- 172.21.15.33:0/3779391106 shutdown_connections 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.419+0000 7ff014f5a740 1 --2- 172.21.15.33:0/3779391106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af982070 0x55e9afd2a410 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.419+0000 7ff014f5a740 1 --2- 172.21.15.33:0/3779391106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd3ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.419+0000 7ff014f5a740 1 --2- 172.21.15.33:0/3779391106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af9591b0 0x55e9afd25250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.419+0000 7ff014f5a740 1 -- 172.21.15.33:0/3779391106 >> 172.21.15.33:0/3779391106 conn(0x55e9af976460 msgr2=0x55e9afd24b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.419+0000 7ff014f5a740 1 -- 172.21.15.33:0/3779391106 shutdown_connections 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.419+0000 7ff014f5a740 1 -- 172.21.15.33:0/3779391106 wait complete. 2024-08-28T19:34:05.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff014f5a740 1 -- start start 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff014f5a740 1 Processor -- start 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd3b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd36c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff014f5a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af982070 0x55e9afd37330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff014f5a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b4190 con 0x55e9af9591b0 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff014f5a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b3ac0 con 0x55e9af961390 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff014f5a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081b0d00 con 0x55e9af982070 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff014f5a740 10 client.0 _ll_register_callbacks cb 0x7ff000009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff007fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd3b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff007fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd3b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60196/0 (socket says 172.21.15.33:60196) 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7ff007fff640 1 -- 172.21.15.33:0/2182043415 learned_addr learned my addr 172.21.15.33:0/2182043415 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.420+0000 7feffffff640 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd36c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7ff00cf82640 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af982070 0x55e9afd37330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7ff007fff640 1 -- 172.21.15.33:0/2182043415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af982070 msgr2=0x55e9afd37330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7ff007fff640 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af982070 0x55e9afd37330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7ff007fff640 1 -- 172.21.15.33:0/2182043415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 msgr2=0x55e9afd36c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7ff007fff640 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd36c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7ff007fff640 1 -- 172.21.15.33:0/2182043415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9afdae700 con 0x55e9af9591b0 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7feffffff640 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd36c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7ff007fff640 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd3b720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7feff800ec00 tx=0x7feff8013e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c9cbd283a2f295 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7fefe77fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7fefe77fe640 1 -- 172.21.15.33:0/2182043415 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff8017040 con 0x55e9af9591b0 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7fefe77fe640 1 -- 172.21.15.33:0/2182043415 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7feff8005dd0 con 0x55e9af9591b0 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7ff014f5a740 1 -- 172.21.15.33:0/2182043415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff000036050 con 0x55e9af9591b0 2024-08-28T19:34:05.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7fefe77fe640 1 -- 172.21.15.33:0/2182043415 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feff8039050 con 0x55e9af9591b0 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7ff014f5a740 10 client.16077 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7ff014f5a740 1 -- 172.21.15.33:0/2182043415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e9afdaf820 con 0x55e9af9591b0 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.421+0000 7fefe77fe640 1 -- 172.21.15.33:0/2182043415 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff000036050 con 0x55e9af9591b0 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.422+0000 7fefe77fe640 1 -- 172.21.15.33:0/2182043415 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feff80060d0 con 0x55e9af9591b0 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.422+0000 7ff014f5a740 10 client.16077 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.422+0000 7ff014f5a740 10 client.16077 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.422+0000 7ff014f5a740 20 client.16077 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.422+0000 7ff014f5a740 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e9af915da0 0x55e9afdb1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.422+0000 7ff014f5a740 4 client.16077 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.422+0000 7ff014f5a740 1 -- 172.21.15.33:0/2182043415 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9afc9c070 con 0x55e9af915da0 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.422+0000 7feffffff640 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e9af915da0 0x55e9afdb1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.422+0000 7fefe77fe640 10 client.16077 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:34:05.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.422+0000 7feffffff640 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e9af915da0 0x55e9afdb1c80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8e1ab33d3d7263f0 server_cookie=30639c7675dc92b0 in_seq=0 out_seq=0 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7fefe77fe640 1 -- 172.21.15.33:0/2182043415 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9afc9c070 con 0x55e9af915da0 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7fefe77fe640 10 client.16077 handle_command_reply: tid=0 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 client.16077 shutdown 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 -- 172.21.15.33:0/2182043415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 msgr2=0x55e9afd3b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd3b720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7feff800ec00 tx=0x7feff8013e20 comp rx=0 tx=0).stop 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 -- 172.21.15.33:0/2182043415 shutdown_connections 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e9af915da0 0x55e9afdb1c80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e9af982070 0x55e9afd37330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e9af961390 0x55e9afd36c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7fefe77fe640 0 client.16077 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 --2- 172.21.15.33:0/2182043415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e9af9591b0 0x55e9afd3b720 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 -- 172.21.15.33:0/2182043415 >> 172.21.15.33:0/2182043415 conn(0x55e9af976460 msgr2=0x55e9afd249e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 -- 172.21.15.33:0/2182043415 shutdown_connections 2024-08-28T19:34:05.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 1 -- 172.21.15.33:0/2182043415 wait complete. 2024-08-28T19:34:05.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.423+0000 7ff014f5a740 20 client.16077 trim_cache size 0 max 16384 2024-08-28T19:34:05.442 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:34:05.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 -- 172.21.15.33:0/3787069120 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feff40b4ca0 msgr2=0x7feff40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:05.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feff40b4ca0 0x7feff40b71b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff000006010 tx=0x7ff000009440 comp rx=0 tx=0).stop 2024-08-28T19:34:05.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 -- 172.21.15.33:0/3787069120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff008108180 msgr2=0x7ff008199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:05.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff008108180 0x7ff008199410 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feff000d740 tx=0x7feff000db40 comp rx=0 tx=0).stop 2024-08-28T19:34:05.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 -- 172.21.15.33:0/3787069120 shutdown_connections 2024-08-28T19:34:05.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feff40b4ca0 0x7feff40b71b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff008108ad0 0x7ff008199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff008108180 0x7ff008199410 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 --2- 172.21.15.33:0/3787069120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff008102840 0x7ff008198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:05.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 -- 172.21.15.33:0/3787069120 >> 172.21.15.33:0/3787069120 conn(0x7ff0080794f0 msgr2=0x7ff008106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:05.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 -- 172.21.15.33:0/3787069120 shutdown_connections 2024-08-28T19:34:05.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:05.424+0000 7ff00e9e5640 1 -- 172.21.15.33:0/3787069120 wait complete. 2024-08-28T19:34:05.585 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:05 smithi059 ceph-mon[22052]: pgmap v391: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 41 KiB/s wr, 32 op/s 2024-08-28T19:34:05.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:05 smithi033 ceph-mon[18549]: pgmap v391: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 41 KiB/s wr, 32 op/s 2024-08-28T19:34:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:05 smithi122 ceph-mon[22174]: pgmap v391: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 41 KiB/s wr, 32 op/s 2024-08-28T19:34:06.253 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:34:06.509 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:07.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.019+0000 7f48a37aa640 1 -- 172.21.15.33:0/3037856709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f489c108160 msgr2=0x7f489c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:07.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.019+0000 7f48a37aa640 1 --2- 172.21.15.33:0/3037856709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f489c108160 0x7f489c108570 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4890009900 tx=0x7f489002a3f0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.019+0000 7f48a37aa640 1 -- 172.21.15.33:0/3037856709 shutdown_connections 2024-08-28T19:34:07.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.019+0000 7f48a37aa640 1 --2- 172.21.15.33:0/3037856709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c108ab0 0x7f489c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.019+0000 7f48a37aa640 1 --2- 172.21.15.33:0/3037856709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f489c108160 0x7f489c108570 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.019+0000 7f48a37aa640 1 --2- 172.21.15.33:0/3037856709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f489c102820 0x7f489c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.019+0000 7f48a37aa640 1 -- 172.21.15.33:0/3037856709 >> 172.21.15.33:0/3037856709 conn(0x7f489c0794e0 msgr2=0x7f489c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.019+0000 7f48a37aa640 1 -- 172.21.15.33:0/3037856709 shutdown_connections 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.019+0000 7f48a37aa640 1 -- 172.21.15.33:0/3037856709 wait complete. 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a37aa640 1 Processor -- start 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a37aa640 1 -- start start 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a37aa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f489c102820 0x7f489c199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a37aa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f489c108160 0x7f489c199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a37aa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c108ab0 0x7f489c19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a37aa640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f489c1126e0 con 0x7f489c108160 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a37aa640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f489c112560 con 0x7f489c108ab0 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a37aa640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f489c112860 con 0x7f489c102820 2024-08-28T19:34:07.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a0d45640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f489c108160 0x7f489c199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a0d45640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f489c108160 0x7f489c199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60204/0 (socket says 172.21.15.33:60204) 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.020+0000 7f48a0d45640 1 -- 172.21.15.33:0/208415536 learned_addr learned my addr 172.21.15.33:0/208415536 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f48a1546640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f489c102820 0x7f489c199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f48a1d47640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c108ab0 0x7f489c19e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f48a0d45640 1 -- 172.21.15.33:0/208415536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f489c102820 msgr2=0x7f489c199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f48a0d45640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f489c102820 0x7f489c199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f48a0d45640 1 -- 172.21.15.33:0/208415536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c108ab0 msgr2=0x7f489c19e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f48a0d45640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c108ab0 0x7f489c19e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f48a0d45640 1 -- 172.21.15.33:0/208415536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c19f020 con 0x7f489c108160 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f48a0d45640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f489c108160 0x7f489c199710 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4890031a90 tx=0x7f4890004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f488e7fc640 1 -- 172.21.15.33:0/208415536 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489003f030 con 0x7f489c108160 2024-08-28T19:34:07.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f48a37aa640 1 -- 172.21.15.33:0/208415536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489c19f2b0 con 0x7f489c108160 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f488e7fc640 1 -- 172.21.15.33:0/208415536 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4890003cb0 con 0x7f489c108160 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f488e7fc640 1 -- 172.21.15.33:0/208415536 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4890035070 con 0x7f489c108160 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.021+0000 7f48a37aa640 1 -- 172.21.15.33:0/208415536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f489c19f7e0 con 0x7f489c108160 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.024+0000 7f48a9d1f740 1 Processor -- start 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.024+0000 7f48a9d1f740 1 -- start start 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.024+0000 7f488e7fc640 1 -- 172.21.15.33:0/208415536 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4890042030 con 0x7f489c108160 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.024+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d13350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.024+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe29451b0 0x559fe2d13890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.024+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 0x559fe2d13dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.024+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559fe2c8a680 con 0x559fe296e070 2024-08-28T19:34:07.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.024+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559fe2c79c10 con 0x559fe29451b0 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.024+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fe2c7dbc0 con 0x559fe294d390 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1d47640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d13350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1d47640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d13350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60214/0 (socket says 172.21.15.33:60214) 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1d47640 1 -- 172.21.15.33:0/2594555997 learned_addr learned my addr 172.21.15.33:0/2594555997 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1546640 1 --2- 172.21.15.33:0/2594555997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe29451b0 0x559fe2d13890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a0d45640 1 --2- 172.21.15.33:0/2594555997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 0x559fe2d13dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1d47640 1 -- 172.21.15.33:0/2594555997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 msgr2=0x559fe2d13dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1d47640 1 --2- 172.21.15.33:0/2594555997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 0x559fe2d13dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1d47640 1 -- 172.21.15.33:0/2594555997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe29451b0 msgr2=0x559fe2d13890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1d47640 1 --2- 172.21.15.33:0/2594555997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe29451b0 0x559fe2d13890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1d47640 1 -- 172.21.15.33:0/2594555997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fe29d9650 con 0x559fe296e070 2024-08-28T19:34:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1546640 1 --2- 172.21.15.33:0/2594555997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe29451b0 0x559fe2d13890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:34:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f488e7fc640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f48880b4cd0 0x7f48880b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1546640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f48880b4cd0 0x7f48880b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48a1d47640 1 --2- 172.21.15.33:0/2594555997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d13350 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f489400ee30 tx=0x7f48940077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea85784b1726e960 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f488e7fc640 1 -- 172.21.15.33:0/208415536 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4890105ec0 con 0x7f489c108160 2024-08-28T19:34:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48877fe640 1 -- 172.21.15.33:0/2594555997 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894004b20 con 0x559fe296e070 2024-08-28T19:34:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48877fe640 1 -- 172.21.15.33:0/2594555997 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4894004cc0 con 0x559fe296e070 2024-08-28T19:34:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.025+0000 7f48877fe640 1 -- 172.21.15.33:0/2594555997 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894005280 con 0x559fe296e070 2024-08-28T19:34:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.026+0000 7f48a1546640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f48880b4cd0 0x7f48880b71e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x559fe2d11fd0 tx=0x7f489800c4b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:07.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.026+0000 7f48a9d1f740 1 -- 172.21.15.33:0/2594555997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 msgr2=0x559fe2d13350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.026+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/2594555997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d13350 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f489400ee30 tx=0x7f48940077d0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.026+0000 7f48a9d1f740 1 -- 172.21.15.33:0/2594555997 shutdown_connections 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.026+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/2594555997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 0x559fe2d13dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.026+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/2594555997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe29451b0 0x559fe2d13890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.026+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/2594555997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d13350 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.026+0000 7f48a9d1f740 1 -- 172.21.15.33:0/2594555997 >> 172.21.15.33:0/2594555997 conn(0x559fe2962460 msgr2=0x559fe2d11240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.026+0000 7f48a9d1f740 1 -- 172.21.15.33:0/2594555997 shutdown_connections 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.027+0000 7f48a9d1f740 1 -- 172.21.15.33:0/2594555997 wait complete. 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.027+0000 7f48a9d1f740 1 -- start start 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.027+0000 7f48a9d1f740 1 Processor -- start 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.027+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d1eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.027+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 0x559fe2d1f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.027+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe296e070 0x559fe2d2ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.027+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559fe2adc700 con 0x559fe29451b0 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.027+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559fe2c00750 con 0x559fe296e070 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.027+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fe2d21b30 con 0x559fe294d390 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.027+0000 7f48a9d1f740 10 client.0 _ll_register_callbacks cb 0x559fe2c2fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a1546640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d1eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a1546640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d1eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60220/0 (socket says 172.21.15.33:60220) 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a1546640 1 -- 172.21.15.33:0/1716751474 learned_addr learned my addr 172.21.15.33:0/1716751474 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a1d47640 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe296e070 0x559fe2d2ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a0d45640 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 0x559fe2d1f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a1546640 1 -- 172.21.15.33:0/1716751474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 msgr2=0x559fe2d1f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:07.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a1546640 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 0x559fe2d1f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a1546640 1 -- 172.21.15.33:0/1716751474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe296e070 msgr2=0x559fe2d2ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a1546640 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe296e070 0x559fe2d2ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a1546640 1 -- 172.21.15.33:0/1716751474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fe2c39900 con 0x559fe29451b0 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a0d45640 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 0x559fe2d1f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a1546640 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d1eac0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f489800edb0 tx=0x7f48980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab3687a66553cba server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f4884ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f4884ff9640 1 -- 172.21.15.33:0/1716751474 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489801caa0 con 0x559fe29451b0 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f4884ff9640 1 -- 172.21.15.33:0/1716751474 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f489801cc40 con 0x559fe29451b0 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.028+0000 7f48a9d1f740 1 -- 172.21.15.33:0/1716751474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4894004cc0 con 0x559fe29451b0 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f4884ff9640 1 -- 172.21.15.33:0/1716751474 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4898030050 con 0x559fe29451b0 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f48a9d1f740 10 client.16089 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:07.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f48a9d1f740 1 -- 172.21.15.33:0/1716751474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559fe2d2d950 con 0x559fe29451b0 2024-08-28T19:34:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f4884ff9640 1 -- 172.21.15.33:0/1716751474 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4894004cc0 con 0x559fe29451b0 2024-08-28T19:34:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f4884ff9640 1 -- 172.21.15.33:0/1716751474 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f489801d410 con 0x559fe29451b0 2024-08-28T19:34:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f48a9d1f740 10 client.16089 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f48a9d1f740 10 client.16089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f48a9d1f740 20 client.16089 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fe292c9f0 0x559fe2d30e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f48a9d1f740 4 client.16089 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:07.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f48a9d1f740 1 -- 172.21.15.33:0/1716751474 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fe2c8c5d0 con 0x559fe292c9f0 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.029+0000 7f48a0d45640 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fe292c9f0 0x559fe2d30e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.030+0000 7f48a0d45640 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fe292c9f0 0x559fe2d30e40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b3dabe8aeccac6b server_cookie=33d754812c7d28c3 in_seq=0 out_seq=0 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.030+0000 7f4884ff9640 10 client.16089 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f4884ff9640 1 -- 172.21.15.33:0/1716751474 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559fe2c8c5d0 con 0x559fe292c9f0 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f4884ff9640 10 client.16089 handle_command_reply: tid=0 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 client.16089 shutdown 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 -- 172.21.15.33:0/1716751474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 msgr2=0x559fe2d1eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d1eac0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f489800edb0 tx=0x7f48980046c0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 -- 172.21.15.33:0/1716751474 shutdown_connections 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe296e070 0x559fe2d2ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe294d390 0x559fe2d1f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fe292c9f0 0x559fe2d30e40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/1716751474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d1eac0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f4884ff9640 0 client.16089 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:07.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 -- 172.21.15.33:0/1716751474 >> 172.21.15.33:0/1716751474 conn(0x559fe2962460 msgr2=0x559fe2d16530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:07.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 -- 172.21.15.33:0/1716751474 shutdown_connections 2024-08-28T19:34:07.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 1 -- 172.21.15.33:0/1716751474 wait complete. 2024-08-28T19:34:07.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.031+0000 7f48a9d1f740 20 client.16089 trim_cache size 0 max 16384 2024-08-28T19:34:07.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.044+0000 7f48a9d1f740 1 Processor -- start 2024-08-28T19:34:07.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.044+0000 7f48a9d1f740 1 -- start start 2024-08-28T19:34:07.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe29451b0 0x559fe2d16b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe294d390 0x559fe2d2ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d1bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f489c1ae8e0 con 0x559fe296e070 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f489c1b0420 con 0x559fe294d390 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f489c1aefb0 con 0x559fe29451b0 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a1d47640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d1bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a1d47640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d1bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60232/0 (socket says 172.21.15.33:60232) 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a1d47640 1 -- 172.21.15.33:0/2853811775 learned_addr learned my addr 172.21.15.33:0/2853811775 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a1546640 1 --2- 172.21.15.33:0/2853811775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe29451b0 0x559fe2d16b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a0d45640 1 --2- 172.21.15.33:0/2853811775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe294d390 0x559fe2d2ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a1d47640 1 -- 172.21.15.33:0/2853811775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe29451b0 msgr2=0x559fe2d16b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:07.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a1d47640 1 --2- 172.21.15.33:0/2853811775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe29451b0 0x559fe2d16b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a1d47640 1 -- 172.21.15.33:0/2853811775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe294d390 msgr2=0x559fe2d2ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:07.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a1d47640 1 --2- 172.21.15.33:0/2853811775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe294d390 0x559fe2d2ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a1d47640 1 -- 172.21.15.33:0/2853811775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fe2d170a0 con 0x559fe296e070 2024-08-28T19:34:07.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.045+0000 7f48a1d47640 1 --2- 172.21.15.33:0/2853811775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d1bcb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f489400edd0 tx=0x7f489400ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1afdd0c3b0146b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:07.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.046+0000 7f4886ffd640 1 -- 172.21.15.33:0/2853811775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894003970 con 0x559fe296e070 2024-08-28T19:34:07.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.046+0000 7f4886ffd640 1 -- 172.21.15.33:0/2853811775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4894026070 con 0x559fe296e070 2024-08-28T19:34:07.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.046+0000 7f4886ffd640 1 -- 172.21.15.33:0/2853811775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894005310 con 0x559fe296e070 2024-08-28T19:34:07.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.046+0000 7f48a9d1f740 1 -- 172.21.15.33:0/2853811775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 msgr2=0x559fe2d1bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:07.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.046+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/2853811775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d1bcb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f489400edd0 tx=0x7f489400ff90 comp rx=0 tx=0).stop 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.046+0000 7f48a9d1f740 1 -- 172.21.15.33:0/2853811775 shutdown_connections 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.046+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/2853811775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe296e070 0x559fe2d1bcb0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.047+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/2853811775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe294d390 0x559fe2d2ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.047+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/2853811775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe29451b0 0x559fe2d16b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.047+0000 7f48a9d1f740 1 -- 172.21.15.33:0/2853811775 >> 172.21.15.33:0/2853811775 conn(0x559fe2962460 msgr2=0x559fe2d16450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.047+0000 7f48a9d1f740 1 -- 172.21.15.33:0/2853811775 shutdown_connections 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.047+0000 7f48a9d1f740 1 -- 172.21.15.33:0/2853811775 wait complete. 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.047+0000 7f48a9d1f740 1 -- start start 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.047+0000 7f48a9d1f740 1 Processor -- start 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.047+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d98f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.047+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe294d390 0x559fe2d994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a9d1f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe296e070 0x559fe2d23500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f489c1afd50 con 0x559fe29451b0 2024-08-28T19:34:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f489c1af680 con 0x559fe294d390 2024-08-28T19:34:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a9d1f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f489c1ac8c0 con 0x559fe296e070 2024-08-28T19:34:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a9d1f740 10 client.0 _ll_register_callbacks cb 0x7f489800cf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1546640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d98f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1546640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d98f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60234/0 (socket says 172.21.15.33:60234) 2024-08-28T19:34:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1546640 1 -- 172.21.15.33:0/3148294153 learned_addr learned my addr 172.21.15.33:0/3148294153 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a0d45640 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe294d390 0x559fe2d994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1d47640 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe296e070 0x559fe2d23500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1546640 1 -- 172.21.15.33:0/3148294153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe296e070 msgr2=0x559fe2d23500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1546640 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe296e070 0x559fe2d23500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1546640 1 -- 172.21.15.33:0/3148294153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe294d390 msgr2=0x559fe2d994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1546640 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe294d390 0x559fe2d994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1546640 1 -- 172.21.15.33:0/3148294153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fe2d23c70 con 0x559fe29451b0 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1d47640 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe296e070 0x559fe2d23500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a1546640 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d98f00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f489800ead0 tx=0x7f489801d640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef588fb1813b334 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f4884ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f4884ff9640 1 -- 172.21.15.33:0/3148294153 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489803a070 con 0x559fe29451b0 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f4884ff9640 1 -- 172.21.15.33:0/3148294153 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4898005030 con 0x559fe29451b0 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.048+0000 7f48a9d1f740 1 -- 172.21.15.33:0/3148294153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4894026070 con 0x559fe29451b0 2024-08-28T19:34:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f4884ff9640 1 -- 172.21.15.33:0/3148294153 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4898005230 con 0x559fe29451b0 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f48a9d1f740 10 client.16095 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f48a9d1f740 1 -- 172.21.15.33:0/3148294153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559fe2da06e0 con 0x559fe29451b0 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f4884ff9640 1 -- 172.21.15.33:0/3148294153 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4898043020 con 0x559fe29451b0 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f4884ff9640 1 -- 172.21.15.33:0/3148294153 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f489801c770 con 0x559fe29451b0 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f48a9d1f740 10 client.16095 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f48a9d1f740 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f48a9d1f740 20 client.16095 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fe2901da0 0x559fe2da2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f48a9d1f740 4 client.16095 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f48a9d1f740 1 -- 172.21.15.33:0/3148294153 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559fe2c88070 con 0x559fe2901da0 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.049+0000 7f48a0d45640 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fe2901da0 0x559fe2da2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a0d45640 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fe2901da0 0x559fe2da2ed0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f18513f169b0222f server_cookie=ae67dd6a9056405f in_seq=0 out_seq=0 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f4884ff9640 10 client.16095 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f4884ff9640 1 -- 172.21.15.33:0/3148294153 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559fe2c88070 con 0x559fe2901da0 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f4884ff9640 10 client.16095 handle_command_reply: tid=0 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 client.16095 shutdown 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 -- 172.21.15.33:0/3148294153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 msgr2=0x559fe2d98f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d98f00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f489800ead0 tx=0x7f489801d640 comp rx=0 tx=0).stop 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 -- 172.21.15.33:0/3148294153 shutdown_connections 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fe296e070 0x559fe2d23500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fe294d390 0x559fe2d994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fe2901da0 0x559fe2da2ed0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 --2- 172.21.15.33:0/3148294153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fe29451b0 0x559fe2d98f00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f4884ff9640 0 client.16095 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:07.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 -- 172.21.15.33:0/3148294153 >> 172.21.15.33:0/3148294153 conn(0x559fe2962460 msgr2=0x559fe2d14380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:07.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 -- 172.21.15.33:0/3148294153 shutdown_connections 2024-08-28T19:34:07.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 1 -- 172.21.15.33:0/3148294153 wait complete. 2024-08-28T19:34:07.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.050+0000 7f48a9d1f740 20 client.16095 trim_cache size 0 max 16384 2024-08-28T19:34:07.061 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:34:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 -- 172.21.15.33:0/208415536 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f48880b4cd0 msgr2=0x7f48880b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f48880b4cd0 0x7f48880b71e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x559fe2d11fd0 tx=0x7f489800c4b0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 -- 172.21.15.33:0/208415536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f489c108160 msgr2=0x7f489c199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f489c108160 0x7f489c199710 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4890031a90 tx=0x7f4890004270 comp rx=0 tx=0).stop 2024-08-28T19:34:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 -- 172.21.15.33:0/208415536 shutdown_connections 2024-08-28T19:34:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c108ab0 0x7f489c19e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f489c108160 0x7f489c199710 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f48880b4cd0 0x7f48880b71e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 --2- 172.21.15.33:0/208415536 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f489c102820 0x7f489c199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 -- 172.21.15.33:0/208415536 >> 172.21.15.33:0/208415536 conn(0x7f489c0794e0 msgr2=0x7f489c104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 -- 172.21.15.33:0/208415536 shutdown_connections 2024-08-28T19:34:07.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:07.051+0000 7f48a37aa640 1 -- 172.21.15.33:0/208415536 wait complete. 2024-08-28T19:34:07.595 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:07 smithi122 ceph-mon[22174]: pgmap v392: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 37 KiB/s wr, 28 op/s 2024-08-28T19:34:07.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:07 smithi033 ceph-mon[18549]: pgmap v392: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 37 KiB/s wr, 28 op/s 2024-08-28T19:34:07.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:07 smithi059 ceph-mon[22052]: pgmap v392: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 37 KiB/s wr, 28 op/s 2024-08-28T19:34:08.856 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:34:08.857 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:34:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:09.553 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:09 smithi033 ceph-mon[18549]: pgmap v393: 129 pgs: 129 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 46 KiB/s wr, 32 op/s 2024-08-28T19:34:09.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.647+0000 7f016ab60640 1 -- 172.21.15.33:0/626554840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164102840 msgr2=0x7f0164102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:09.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.647+0000 7f016ab60640 1 --2- 172.21.15.33:0/626554840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164102840 0x7f0164102c50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0158009900 tx=0x7f015802a410 comp rx=0 tx=0).stop 2024-08-28T19:34:09.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.647+0000 7f016ab60640 1 -- 172.21.15.33:0/626554840 shutdown_connections 2024-08-28T19:34:09.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.647+0000 7f016ab60640 1 --2- 172.21.15.33:0/626554840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0164108ad0 0x7f016410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.647+0000 7f016ab60640 1 --2- 172.21.15.33:0/626554840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0164108180 0x7f0164108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.647+0000 7f016ab60640 1 --2- 172.21.15.33:0/626554840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164102840 0x7f0164102c50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.647+0000 7f016ab60640 1 -- 172.21.15.33:0/626554840 >> 172.21.15.33:0/626554840 conn(0x7f01640794f0 msgr2=0x7f0164079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:09.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.647+0000 7f016ab60640 1 -- 172.21.15.33:0/626554840 shutdown_connections 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.647+0000 7f016ab60640 1 -- 172.21.15.33:0/626554840 wait complete. 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f016ab60640 1 Processor -- start 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f016ab60640 1 -- start start 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f016ab60640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0164102840 0x7f016419b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f016ab60640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164108180 0x7f016419b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f016ab60640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0164108ad0 0x7f016419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f016ab60640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f01641127a0 con 0x7f0164108180 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f016ab60640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0164112620 con 0x7f0164108ad0 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f016ab60640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0164112920 con 0x7f0164102840 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f0163fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164108180 0x7f016419b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f0163fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164108180 0x7f016419b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54574/0 (socket says 172.21.15.33:54574) 2024-08-28T19:34:09.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.648+0000 7f0163fff640 1 -- 172.21.15.33:0/4140752854 learned_addr learned my addr 172.21.15.33:0/4140752854 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f01688fc640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0164102840 0x7f016419b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f01690fd640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0164108ad0 0x7f016419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f0163fff640 1 -- 172.21.15.33:0/4140752854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0164102840 msgr2=0x7f016419b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f0163fff640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0164102840 0x7f016419b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f0163fff640 1 -- 172.21.15.33:0/4140752854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0164108ad0 msgr2=0x7f016419bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f0163fff640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0164108ad0 0x7f016419bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f0163fff640 1 -- 172.21.15.33:0/4140752854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01641a6340 con 0x7f0164108180 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f01688fc640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0164102840 0x7f016419b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f0163fff640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164108180 0x7f016419b570 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f015000d950 tx=0x7f015000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f0161ffb640 1 -- 172.21.15.33:0/4140752854 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0150017070 con 0x7f0164108180 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f016ab60640 1 -- 172.21.15.33:0/4140752854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01641a6630 con 0x7f0164108180 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f0161ffb640 1 -- 172.21.15.33:0/4140752854 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0150009c30 con 0x7f0164108180 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f0161ffb640 1 -- 172.21.15.33:0/4140752854 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01500047a0 con 0x7f0164108180 2024-08-28T19:34:09.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.649+0000 7f016ab60640 1 -- 172.21.15.33:0/4140752854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01641a6bc0 con 0x7f0164108180 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.652+0000 7f0161ffb640 1 -- 172.21.15.33:0/4140752854 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0150004020 con 0x7f0164108180 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.652+0000 7f01710d5740 1 Processor -- start 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.652+0000 7f01710d5740 1 -- start start 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.652+0000 7f01710d5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0da6350 0x5602e114c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.652+0000 7f01710d5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d7d490 0x5602e114ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.652+0000 7f01710d5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d85670 0x5602e114d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.652+0000 7f01710d5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5602e10c25f0 con 0x5602e0da6350 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.652+0000 7f01710d5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5602e10b1b80 con 0x5602e0d85670 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.652+0000 7f01710d5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5602e10b5b30 con 0x5602e0d7d490 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01690fd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0da6350 0x5602e114c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01690fd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0da6350 0x5602e114c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54588/0 (socket says 172.21.15.33:54588) 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01690fd640 1 -- 172.21.15.33:0/933280045 learned_addr learned my addr 172.21.15.33:0/933280045 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:09.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01688fc640 1 --2- 172.21.15.33:0/933280045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d7d490 0x5602e114ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f0163fff640 1 --2- 172.21.15.33:0/933280045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d85670 0x5602e114d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f0161ffb640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f01540b4ca0 0x7f01540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01690fd640 1 -- 172.21.15.33:0/933280045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d7d490 msgr2=0x5602e114ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01690fd640 1 --2- 172.21.15.33:0/933280045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d7d490 0x5602e114ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01690fd640 1 -- 172.21.15.33:0/933280045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d85670 msgr2=0x5602e114d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01690fd640 1 --2- 172.21.15.33:0/933280045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d85670 0x5602e114d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01690fd640 1 -- 172.21.15.33:0/933280045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e0e11930 con 0x5602e0da6350 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f0163fff640 1 --2- 172.21.15.33:0/933280045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d85670 0x5602e114d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01690fd640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f01540b4ca0 0x7f01540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f0161ffb640 1 -- 172.21.15.33:0/4140752854 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f01500e56c0 con 0x7f0164108180 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f01690fd640 1 --2- 172.21.15.33:0/933280045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0da6350 0x5602e114c780 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f015c009eb0 tx=0x7f015c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172e02d6bec13094 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.653+0000 7f014effd640 1 -- 172.21.15.33:0/933280045 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c01a410 con 0x5602e0da6350 2024-08-28T19:34:09.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f014effd640 1 -- 172.21.15.33:0/933280045 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f015c01aa60 con 0x5602e0da6350 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f014effd640 1 -- 172.21.15.33:0/933280045 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c0106c0 con 0x5602e0da6350 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f01710d5740 1 -- 172.21.15.33:0/933280045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0da6350 msgr2=0x5602e114c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f01690fd640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f01540b4ca0 0x7f01540b71b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f015c020000 tx=0x7f015c01d000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f01710d5740 1 --2- 172.21.15.33:0/933280045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0da6350 0x5602e114c780 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f015c009eb0 tx=0x7f015c00f730 comp rx=0 tx=0).stop 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f01710d5740 1 -- 172.21.15.33:0/933280045 shutdown_connections 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f01710d5740 1 --2- 172.21.15.33:0/933280045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d85670 0x5602e114d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f01710d5740 1 --2- 172.21.15.33:0/933280045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d7d490 0x5602e114ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f01710d5740 1 --2- 172.21.15.33:0/933280045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0da6350 0x5602e114c780 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f01710d5740 1 -- 172.21.15.33:0/933280045 >> 172.21.15.33:0/933280045 conn(0x5602e0d9a740 msgr2=0x5602e114a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.654+0000 7f01710d5740 1 -- 172.21.15.33:0/933280045 shutdown_connections 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.655+0000 7f01710d5740 1 -- 172.21.15.33:0/933280045 wait complete. 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.655+0000 7f01710d5740 1 -- start start 2024-08-28T19:34:09.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.655+0000 7f01710d5740 1 Processor -- start 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.655+0000 7f01710d5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d7d490 0x5602e115c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.655+0000 7f01710d5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.655+0000 7f01710d5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0da6350 0x5602e1168590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.655+0000 7f01710d5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5602e0f14890 con 0x5602e0d85670 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.655+0000 7f01710d5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5602e1038790 con 0x5602e0d7d490 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.655+0000 7f01710d5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5602e115f260 con 0x5602e0da6350 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f01710d5740 10 client.0 _ll_register_callbacks cb 0x5602e0dbdba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0163fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0163fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54594/0 (socket says 172.21.15.33:54594) 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0163fff640 1 -- 172.21.15.33:0/2695941631 learned_addr learned my addr 172.21.15.33:0/2695941631 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f01688fc640 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d7d490 0x5602e115c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f01690fd640 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0da6350 0x5602e1168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0163fff640 1 -- 172.21.15.33:0/2695941631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0da6350 msgr2=0x5602e1168590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0163fff640 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0da6350 0x5602e1168590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0163fff640 1 -- 172.21.15.33:0/2695941631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d7d490 msgr2=0x5602e115c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0163fff640 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d7d490 0x5602e115c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0163fff640 1 -- 172.21.15.33:0/2695941631 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e106ff30 con 0x5602e0d85670 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f01688fc640 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d7d490 0x5602e115c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0163fff640 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115c860 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0150009610 tx=0x7f01500ab410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381d254d22842dc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0143fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0143fff640 1 -- 172.21.15.33:0/2695941631 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01500ce050 con 0x5602e0d85670 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0143fff640 1 -- 172.21.15.33:0/2695941631 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f01500e52b0 con 0x5602e0d85670 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f01710d5740 1 -- 172.21.15.33:0/2695941631 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f015c01aa60 con 0x5602e0d85670 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.656+0000 7f0143fff640 1 -- 172.21.15.33:0/2695941631 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f01500e2ef0 con 0x5602e0d85670 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f01710d5740 10 client.16107 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:09.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f01710d5740 1 -- 172.21.15.33:0/2695941631 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5602e116b0a0 con 0x5602e0d85670 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f0143fff640 1 -- 172.21.15.33:0/2695941631 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f015c01aa60 con 0x5602e0d85670 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f0143fff640 1 -- 172.21.15.33:0/2695941631 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f01500ceae0 con 0x5602e0d85670 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f01710d5740 10 client.16107 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f01710d5740 10 client.16107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f01710d5740 20 client.16107 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f01710d5740 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5602e0d64cd0 0x5602e116e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f01710d5740 4 client.16107 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f01710d5740 1 -- 172.21.15.33:0/2695941631 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602e10c4540 con 0x5602e0d64cd0 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.657+0000 7f01688fc640 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5602e0d64cd0 0x5602e116e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.658+0000 7f0143fff640 10 client.16107 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.658+0000 7f01688fc640 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5602e0d64cd0 0x5602e116e5b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a1261ce116e8c8 server_cookie=5c969abd54b918d9 in_seq=0 out_seq=0 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.658+0000 7f0143fff640 1 -- 172.21.15.33:0/2695941631 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602e10c4540 con 0x5602e0d64cd0 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.658+0000 7f0143fff640 10 client.16107 handle_command_reply: tid=0 2024-08-28T19:34:09.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.658+0000 7f01710d5740 1 client.16107 shutdown 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 1 -- 172.21.15.33:0/2695941631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 msgr2=0x5602e115c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115c860 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0150009610 tx=0x7f01500ab410 comp rx=0 tx=0).stop 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 1 -- 172.21.15.33:0/2695941631 shutdown_connections 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0da6350 0x5602e1168590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5602e0d64cd0 0x5602e116e5b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115c860 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 1 --2- 172.21.15.33:0/2695941631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0d7d490 0x5602e115c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 1 -- 172.21.15.33:0/2695941631 >> 172.21.15.33:0/2695941631 conn(0x5602e0d9a740 msgr2=0x5602e114e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f0143fff640 0 client.16107 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 1 -- 172.21.15.33:0/2695941631 shutdown_connections 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 1 -- 172.21.15.33:0/2695941631 wait complete. 2024-08-28T19:34:09.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.659+0000 7f01710d5740 20 client.16107 trim_cache size 0 max 16384 2024-08-28T19:34:09.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f01710d5740 1 Processor -- start 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f01710d5740 1 -- start start 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f01710d5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d7d490 0x5602e115aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f01710d5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f01710d5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 0x5602e1159510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f01710d5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f01641ae900 con 0x5602e0d85670 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f01710d5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f01641b0440 con 0x5602e0da6350 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f01710d5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f01641aefd0 con 0x5602e0d7d490 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f0163fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f0163fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54602/0 (socket says 172.21.15.33:54602) 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.677+0000 7f0163fff640 1 -- 172.21.15.33:0/3567789672 learned_addr learned my addr 172.21.15.33:0/3567789672 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f01690fd640 1 --2- 172.21.15.33:0/3567789672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 0x5602e1159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f01688fc640 1 --2- 172.21.15.33:0/3567789672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d7d490 0x5602e115aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f0163fff640 1 -- 172.21.15.33:0/3567789672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d7d490 msgr2=0x5602e115aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:09.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f0163fff640 1 --2- 172.21.15.33:0/3567789672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d7d490 0x5602e115aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f0163fff640 1 -- 172.21.15.33:0/3567789672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 msgr2=0x5602e1159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:09.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f0163fff640 1 --2- 172.21.15.33:0/3567789672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 0x5602e1159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f0163fff640 1 -- 172.21.15.33:0/3567789672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e115d5e0 con 0x5602e0d85670 2024-08-28T19:34:09.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f01690fd640 1 --2- 172.21.15.33:0/3567789672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 0x5602e1159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:09.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f0163fff640 1 --2- 172.21.15.33:0/3567789672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115b0e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0150005fd0 tx=0x7f01500b4d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaaa5fbd0441267a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:09.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f014e7fc640 1 -- 172.21.15.33:0/3567789672 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01500ce040 con 0x5602e0d85670 2024-08-28T19:34:09.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f014e7fc640 1 -- 172.21.15.33:0/3567789672 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0150009de0 con 0x5602e0d85670 2024-08-28T19:34:09.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.678+0000 7f014e7fc640 1 -- 172.21.15.33:0/3567789672 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01500aac60 con 0x5602e0d85670 2024-08-28T19:34:09.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.679+0000 7f01710d5740 1 -- 172.21.15.33:0/3567789672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 msgr2=0x5602e115b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:09.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.679+0000 7f01710d5740 1 --2- 172.21.15.33:0/3567789672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115b0e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0150005fd0 tx=0x7f01500b4d20 comp rx=0 tx=0).stop 2024-08-28T19:34:09.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.679+0000 7f01710d5740 1 -- 172.21.15.33:0/3567789672 shutdown_connections 2024-08-28T19:34:09.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.679+0000 7f01710d5740 1 --2- 172.21.15.33:0/3567789672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 0x5602e1159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.679+0000 7f01710d5740 1 --2- 172.21.15.33:0/3567789672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d85670 0x5602e115b0e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.679+0000 7f01710d5740 1 --2- 172.21.15.33:0/3567789672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d7d490 0x5602e115aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.679+0000 7f01710d5740 1 -- 172.21.15.33:0/3567789672 >> 172.21.15.33:0/3567789672 conn(0x5602e0d9a740 msgr2=0x5602e1157460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.679+0000 7f01710d5740 1 -- 172.21.15.33:0/3567789672 shutdown_connections 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.679+0000 7f01710d5740 1 -- 172.21.15.33:0/3567789672 wait complete. 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.679+0000 7f01710d5740 1 -- start start 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01710d5740 1 Processor -- start 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01710d5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d7d490 0x5602e1164700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01710d5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d85670 0x5602e1164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01710d5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 0x5602e115f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01710d5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f01641afd70 con 0x5602e0d7d490 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01710d5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f01641af6a0 con 0x5602e0da6350 2024-08-28T19:34:09.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01710d5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f01641ac8e0 con 0x5602e0d85670 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01710d5740 10 client.0 _ll_register_callbacks cb 0x7f01500ab7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01688fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d7d490 0x5602e1164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01688fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d7d490 0x5602e1164700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54612/0 (socket says 172.21.15.33:54612) 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01688fc640 1 -- 172.21.15.33:0/2891446434 learned_addr learned my addr 172.21.15.33:0/2891446434 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f0163fff640 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d85670 0x5602e1164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01690fd640 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 0x5602e115f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01688fc640 1 -- 172.21.15.33:0/2891446434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d85670 msgr2=0x5602e1164cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01688fc640 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d85670 0x5602e1164cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01688fc640 1 -- 172.21.15.33:0/2891446434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 msgr2=0x5602e115f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01688fc640 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 0x5602e115f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.680+0000 7f01688fc640 1 -- 172.21.15.33:0/2891446434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e115fba0 con 0x5602e0d7d490 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.681+0000 7f01690fd640 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 0x5602e115f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.681+0000 7f01688fc640 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d7d490 0x5602e1164700 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0158005ab0 tx=0x7f0158004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b289c96c1de9418b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:09.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.681+0000 7f0143fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.681+0000 7f0143fff640 1 -- 172.21.15.33:0/2891446434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015804b060 con 0x5602e0d7d490 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.681+0000 7f0143fff640 1 -- 172.21.15.33:0/2891446434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0158005040 con 0x5602e0d7d490 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.681+0000 7f01710d5740 1 -- 172.21.15.33:0/2891446434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0150009de0 con 0x5602e0d7d490 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.681+0000 7f0143fff640 1 -- 172.21.15.33:0/2891446434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0158035040 con 0x5602e0d7d490 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.681+0000 7f01710d5740 10 client.16113 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.681+0000 7f01710d5740 1 -- 172.21.15.33:0/2891446434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5602e11d9970 con 0x5602e0d7d490 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.681+0000 7f0143fff640 1 -- 172.21.15.33:0/2891446434 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0150009de0 con 0x5602e0d7d490 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.682+0000 7f0143fff640 1 -- 172.21.15.33:0/2891446434 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0158045070 con 0x5602e0d7d490 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.682+0000 7f01710d5740 10 client.16113 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.682+0000 7f01710d5740 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.682+0000 7f01710d5740 20 client.16113 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.682+0000 7f01710d5740 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5602e0d3a080 0x5602e11dc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:09.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.682+0000 7f01710d5740 4 client.16113 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:34:09.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.682+0000 7f01710d5740 1 -- 172.21.15.33:0/2891446434 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5602e10bffe0 con 0x5602e0d3a080 2024-08-28T19:34:09.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.682+0000 7f0163fff640 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5602e0d3a080 0x5602e11dc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:09.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.682+0000 7f0143fff640 10 client.16113 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:09.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.682+0000 7f0163fff640 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5602e0d3a080 0x5602e11dc160 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e29746f5690d9c61 server_cookie=e07c26b56bb587b8 in_seq=0 out_seq=0 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f0143fff640 1 -- 172.21.15.33:0/2891446434 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5602e10bffe0 con 0x5602e0d3a080 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f0143fff640 10 client.16113 handle_command_reply: tid=0 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 client.16113 shutdown 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 -- 172.21.15.33:0/2891446434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d7d490 msgr2=0x5602e1164700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d7d490 0x5602e1164700 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0158005ab0 tx=0x7f0158004040 comp rx=0 tx=0).stop 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 -- 172.21.15.33:0/2891446434 shutdown_connections 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602e0da6350 0x5602e115f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5602e0d85670 0x5602e1164cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5602e0d3a080 0x5602e11dc160 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 --2- 172.21.15.33:0/2891446434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5602e0d7d490 0x5602e1164700 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 -- 172.21.15.33:0/2891446434 >> 172.21.15.33:0/2891446434 conn(0x5602e0d9a740 msgr2=0x5602e1149cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:09.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f0143fff640 0 client.16113 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:09.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 -- 172.21.15.33:0/2891446434 shutdown_connections 2024-08-28T19:34:09.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 1 -- 172.21.15.33:0/2891446434 wait complete. 2024-08-28T19:34:09.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.684+0000 7f01710d5740 20 client.16113 trim_cache size 0 max 16384 2024-08-28T19:34:09.689 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:34:09.689 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:34:09.689 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6", 2024-08-28T19:34:09.689 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:34:09.689 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:34:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 -- 172.21.15.33:0/4140752854 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f01540b4ca0 msgr2=0x7f01540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f01540b4ca0 0x7f01540b71b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f015c020000 tx=0x7f015c01d000 comp rx=0 tx=0).stop 2024-08-28T19:34:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 -- 172.21.15.33:0/4140752854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164108180 msgr2=0x7f016419b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164108180 0x7f016419b570 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f015000d950 tx=0x7f015000de10 comp rx=0 tx=0).stop 2024-08-28T19:34:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 -- 172.21.15.33:0/4140752854 shutdown_connections 2024-08-28T19:34:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0164108ad0 0x7f016419bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0164108180 0x7f016419b570 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f01540b4ca0 0x7f01540b71b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 --2- 172.21.15.33:0/4140752854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0164102840 0x7f016419b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 -- 172.21.15.33:0/4140752854 >> 172.21.15.33:0/4140752854 conn(0x7f01640794f0 msgr2=0x7f0164106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 -- 172.21.15.33:0/4140752854 shutdown_connections 2024-08-28T19:34:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:09.685+0000 7f016ab60640 1 -- 172.21.15.33:0/4140752854 wait complete. 2024-08-28T19:34:09.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:09 smithi059 ceph-mon[22052]: pgmap v393: 129 pgs: 129 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 46 KiB/s wr, 32 op/s 2024-08-28T19:34:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:09 smithi122 ceph-mon[22174]: pgmap v393: 129 pgs: 129 active+clean; 1.7 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 46 KiB/s wr, 32 op/s 2024-08-28T19:34:10.520 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:34:10.543 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:10 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:34:10.544 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:10 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:10.544 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:10 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:34:10.544 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:10 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:10.779 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:10.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:10 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:34:10.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:10 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:10.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:10 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:34:10.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:10 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:10.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:10 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:34:10.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:10 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:10.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:10 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:34:10.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:10 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:11.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.297+0000 7f66aa920640 1 -- 172.21.15.33:0/3190719485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a4108140 msgr2=0x7f66a4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:11.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.297+0000 7f66aa920640 1 --2- 172.21.15.33:0/3190719485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a4108140 0x7f66a4108550 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6698009980 tx=0x7f669802c620 comp rx=0 tx=0).stop 2024-08-28T19:34:11.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.297+0000 7f66aa920640 1 -- 172.21.15.33:0/3190719485 shutdown_connections 2024-08-28T19:34:11.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.297+0000 7f66aa920640 1 --2- 172.21.15.33:0/3190719485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a4108a90 0x7f66a410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.297+0000 7f66aa920640 1 --2- 172.21.15.33:0/3190719485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a4108140 0x7f66a4108550 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.297+0000 7f66aa920640 1 --2- 172.21.15.33:0/3190719485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a4102800 0x7f66a4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.297+0000 7f66aa920640 1 -- 172.21.15.33:0/3190719485 >> 172.21.15.33:0/3190719485 conn(0x7f66a40794d0 msgr2=0x7f66a40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:11.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.297+0000 7f66aa920640 1 -- 172.21.15.33:0/3190719485 shutdown_connections 2024-08-28T19:34:11.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.297+0000 7f66aa920640 1 -- 172.21.15.33:0/3190719485 wait complete. 2024-08-28T19:34:11.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.298+0000 7f66aa920640 1 Processor -- start 2024-08-28T19:34:11.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.298+0000 7f66aa920640 1 -- start start 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.298+0000 7f66aa920640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a4102800 0x7f66a419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.298+0000 7f66aa920640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a4108140 0x7f66a419cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.298+0000 7f66aa920640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a4108a90 0x7f66a41a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.298+0000 7f66aa920640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f66a4111640 con 0x7f66a4108a90 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.298+0000 7f66aa920640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66a41114c0 con 0x7f66a4102800 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.298+0000 7f66aa920640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f66a41117c0 con 0x7f66a4108140 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a8ebd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a4108a90 0x7f66a41a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a8ebd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a4108a90 0x7f66a41a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54618/0 (socket says 172.21.15.33:54618) 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a8ebd640 1 -- 172.21.15.33:0/2642649409 learned_addr learned my addr 172.21.15.33:0/2642649409 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a37fe640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a4108140 0x7f66a419cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a3fff640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a4102800 0x7f66a419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a8ebd640 1 -- 172.21.15.33:0/2642649409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a4108140 msgr2=0x7f66a419cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:11.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a8ebd640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a4108140 0x7f66a419cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a8ebd640 1 -- 172.21.15.33:0/2642649409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a4102800 msgr2=0x7f66a419c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:11.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a8ebd640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a4102800 0x7f66a419c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a8ebd640 1 -- 172.21.15.33:0/2642649409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a41a2480 con 0x7f66a4108a90 2024-08-28T19:34:11.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a8ebd640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a4108a90 0x7f66a41a1d50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f669c00eaa0 tx=0x7f669c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:11.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a17fa640 1 -- 172.21.15.33:0/2642649409 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c00cdb0 con 0x7f66a4108a90 2024-08-28T19:34:11.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66aa920640 1 -- 172.21.15.33:0/2642649409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a41a2770 con 0x7f66a4108a90 2024-08-28T19:34:11.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a17fa640 1 -- 172.21.15.33:0/2642649409 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f669c005020 con 0x7f66a4108a90 2024-08-28T19:34:11.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66a17fa640 1 -- 172.21.15.33:0/2642649409 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c0116d0 con 0x7f66a4108a90 2024-08-28T19:34:11.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.299+0000 7f66aa920640 1 -- 172.21.15.33:0/2642649409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a41a8ed0 con 0x7f66a4108a90 2024-08-28T19:34:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.302+0000 7f66b0e95740 1 Processor -- start 2024-08-28T19:34:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.302+0000 7f66a17fa640 1 -- 172.21.15.33:0/2642649409 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f669c0051d0 con 0x7f66a4108a90 2024-08-28T19:34:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.302+0000 7f66b0e95740 1 -- start start 2024-08-28T19:34:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.302+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9677070 0x55e0e9a1c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.302+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a1c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.302+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 0x55e0e9a1cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.302+0000 7f66b0e95740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e0e9993630 con 0x55e0e964e1b0 2024-08-28T19:34:11.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.302+0000 7f66b0e95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0e9982bc0 con 0x55e0e9656390 2024-08-28T19:34:11.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.302+0000 7f66b0e95740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e0e9986b70 con 0x55e0e9677070 2024-08-28T19:34:11.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a1c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9677070 0x55e0e9a1c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a1c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54624/0 (socket says 172.21.15.33:54624) 2024-08-28T19:34:11.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a3fff640 1 -- 172.21.15.33:0/3537532383 learned_addr learned my addr 172.21.15.33:0/3537532383 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:11.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a37fe640 1 --2- 172.21.15.33:0/3537532383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 0x55e0e9a1cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a3fff640 1 -- 172.21.15.33:0/3537532383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9677070 msgr2=0x55e0e9a1c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:11.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a3fff640 1 --2- 172.21.15.33:0/3537532383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9677070 0x55e0e9a1c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a3fff640 1 -- 172.21.15.33:0/3537532383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 msgr2=0x55e0e9a1cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:11.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a3fff640 1 --2- 172.21.15.33:0/3537532383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 0x55e0e9a1cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a3fff640 1 -- 172.21.15.33:0/3537532383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0e96e2650 con 0x55e0e964e1b0 2024-08-28T19:34:11.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a37fe640 1 --2- 172.21.15.33:0/3537532383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 0x55e0e9a1cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:11.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a17fa640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f668c0b4ca0 0x7f668c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a3fff640 1 --2- 172.21.15.33:0/3537532383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a1c800 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f669400b820 tx=0x7f669400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccb47fc589a6a45 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:11.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a37fe640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f668c0b4ca0 0x7f668c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f66a17fa640 1 -- 172.21.15.33:0/2642649409 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f669c0e5b40 con 0x7f66a4108a90 2024-08-28T19:34:11.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.303+0000 7f668a7fc640 1 -- 172.21.15.33:0/3537532383 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669400d950 con 0x55e0e964e1b0 2024-08-28T19:34:11.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.304+0000 7f668a7fc640 1 -- 172.21.15.33:0/3537532383 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6694019070 con 0x55e0e964e1b0 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.304+0000 7f668a7fc640 1 -- 172.21.15.33:0/3537532383 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66940123e0 con 0x55e0e964e1b0 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.304+0000 7f66b0e95740 1 -- 172.21.15.33:0/3537532383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 msgr2=0x55e0e9a1c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.304+0000 7f66b0e95740 1 --2- 172.21.15.33:0/3537532383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a1c800 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f669400b820 tx=0x7f669400bce0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.304+0000 7f66a37fe640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f668c0b4ca0 0x7f668c0b71b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6698000c00 tx=0x7f6698033400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.304+0000 7f66b0e95740 1 -- 172.21.15.33:0/3537532383 shutdown_connections 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.304+0000 7f66b0e95740 1 --2- 172.21.15.33:0/3537532383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 0x55e0e9a1cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.304+0000 7f66b0e95740 1 --2- 172.21.15.33:0/3537532383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a1c800 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.304+0000 7f66b0e95740 1 --2- 172.21.15.33:0/3537532383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9677070 0x55e0e9a1c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.305+0000 7f66b0e95740 1 -- 172.21.15.33:0/3537532383 >> 172.21.15.33:0/3537532383 conn(0x55e0e966b460 msgr2=0x55e0e9a1a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.305+0000 7f66b0e95740 1 -- 172.21.15.33:0/3537532383 shutdown_connections 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.305+0000 7f66b0e95740 1 -- 172.21.15.33:0/3537532383 wait complete. 2024-08-28T19:34:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.305+0000 7f66b0e95740 1 -- start start 2024-08-28T19:34:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.305+0000 7f66b0e95740 1 Processor -- start 2024-08-28T19:34:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.305+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a27a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.305+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 0x55e0e9a27f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9677070 0x55e0e9a33dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66b0e95740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e0e97e5700 con 0x55e0e964e1b0 2024-08-28T19:34:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66b0e95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0e9909700 con 0x55e0e9656390 2024-08-28T19:34:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66b0e95740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e0e9a2aaa0 con 0x55e0e9677070 2024-08-28T19:34:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66b0e95740 10 client.0 _ll_register_callbacks cb 0x55e0e9938dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a27a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a27a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54634/0 (socket says 172.21.15.33:54634) 2024-08-28T19:34:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a3fff640 1 -- 172.21.15.33:0/2120073399 learned_addr learned my addr 172.21.15.33:0/2120073399 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a8ebd640 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9677070 0x55e0e9a33dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a37fe640 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 0x55e0e9a27f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a3fff640 1 -- 172.21.15.33:0/2120073399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9677070 msgr2=0x55e0e9a33dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a3fff640 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9677070 0x55e0e9a33dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a3fff640 1 -- 172.21.15.33:0/2120073399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 msgr2=0x55e0e9a27f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a3fff640 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 0x55e0e9a27f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a3fff640 1 -- 172.21.15.33:0/2120073399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0e99428b0 con 0x55e0e964e1b0 2024-08-28T19:34:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66a3fff640 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a27a50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6694004810 tx=0x7f6694014e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346767b50ff6525f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66837fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66837fe640 1 -- 172.21.15.33:0/2120073399 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6694023070 con 0x55e0e964e1b0 2024-08-28T19:34:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66837fe640 1 -- 172.21.15.33:0/2120073399 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f669400d950 con 0x55e0e964e1b0 2024-08-28T19:34:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.306+0000 7f66b0e95740 1 -- 172.21.15.33:0/2120073399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6694019070 con 0x55e0e964e1b0 2024-08-28T19:34:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66837fe640 1 -- 172.21.15.33:0/2120073399 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f669402f050 con 0x55e0e964e1b0 2024-08-28T19:34:11.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66b0e95740 10 client.16125 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:11.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66b0e95740 1 -- 172.21.15.33:0/2120073399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0e9a36860 con 0x55e0e964e1b0 2024-08-28T19:34:11.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66837fe640 1 -- 172.21.15.33:0/2120073399 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6694019070 con 0x55e0e964e1b0 2024-08-28T19:34:11.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66837fe640 1 -- 172.21.15.33:0/2120073399 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6694013070 con 0x55e0e964e1b0 2024-08-28T19:34:11.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66b0e95740 10 client.16125 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:11.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66b0e95740 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:11.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66b0e95740 20 client.16125 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:11.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66b0e95740 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0e96359f0 0x55e0e9a39bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66b0e95740 4 client.16125 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:11.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66b0e95740 1 -- 172.21.15.33:0/2120073399 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0e9995580 con 0x55e0e96359f0 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.307+0000 7f66a37fe640 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0e96359f0 0x55e0e9a39bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.308+0000 7f66a37fe640 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0e96359f0 0x55e0e9a39bc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fe627bf3ee0474b server_cookie=bc32dfc0ef373f06 in_seq=0 out_seq=0 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.308+0000 7f66837fe640 10 client.16125 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66837fe640 1 -- 172.21.15.33:0/2120073399 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0e9995580 con 0x55e0e96359f0 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66837fe640 10 client.16125 handle_command_reply: tid=0 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 client.16125 shutdown 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 -- 172.21.15.33:0/2120073399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 msgr2=0x55e0e9a27a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a27a50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6694004810 tx=0x7f6694014e00 comp rx=0 tx=0).stop 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 -- 172.21.15.33:0/2120073399 shutdown_connections 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9677070 0x55e0e9a33dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e9656390 0x55e0e9a27f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0e96359f0 0x55e0e9a39bc0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 --2- 172.21.15.33:0/2120073399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e964e1b0 0x55e0e9a27a50 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 -- 172.21.15.33:0/2120073399 >> 172.21.15.33:0/2120073399 conn(0x55e0e966b460 msgr2=0x55e0e9a1f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:11.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66837fe640 0 client.16125 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:11.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 -- 172.21.15.33:0/2120073399 shutdown_connections 2024-08-28T19:34:11.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 1 -- 172.21.15.33:0/2120073399 wait complete. 2024-08-28T19:34:11.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.309+0000 7f66b0e95740 20 client.16125 trim_cache size 0 max 16384 2024-08-28T19:34:11.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66b0e95740 1 Processor -- start 2024-08-28T19:34:11.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66b0e95740 1 -- start start 2024-08-28T19:34:11.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e964e1b0 0x55e0e9a1da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9656390 0x55e0e9a33d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a24c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66b0e95740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f66a41b2e20 con 0x55e0e9677070 2024-08-28T19:34:11.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66b0e95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66a41b4960 con 0x55e0e964e1b0 2024-08-28T19:34:11.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66b0e95740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f66a41b34f0 con 0x55e0e9656390 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66a8ebd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a24c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66a8ebd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a24c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54648/0 (socket says 172.21.15.33:54648) 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66a8ebd640 1 -- 172.21.15.33:0/3090823788 learned_addr learned my addr 172.21.15.33:0/3090823788 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66a3fff640 1 --2- 172.21.15.33:0/3090823788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e964e1b0 0x55e0e9a1da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66a37fe640 1 --2- 172.21.15.33:0/3090823788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9656390 0x55e0e9a33d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66a8ebd640 1 -- 172.21.15.33:0/3090823788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9656390 msgr2=0x55e0e9a33d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66a8ebd640 1 --2- 172.21.15.33:0/3090823788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9656390 0x55e0e9a33d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66a8ebd640 1 -- 172.21.15.33:0/3090823788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e964e1b0 msgr2=0x55e0e9a1da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66a8ebd640 1 --2- 172.21.15.33:0/3090823788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e964e1b0 0x55e0e9a1da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.327+0000 7f66a8ebd640 1 -- 172.21.15.33:0/3090823788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0e9a28d10 con 0x55e0e9677070 2024-08-28T19:34:11.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.328+0000 7f66a8ebd640 1 --2- 172.21.15.33:0/3090823788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a24c40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f669c0a7f60 tx=0x7f669c0abee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c256bd178fd90720 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:11.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.328+0000 7f6689ffb640 1 -- 172.21.15.33:0/3090823788 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c01f040 con 0x55e0e9677070 2024-08-28T19:34:11.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.328+0000 7f6689ffb640 1 -- 172.21.15.33:0/3090823788 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f669c0a8170 con 0x55e0e9677070 2024-08-28T19:34:11.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.328+0000 7f6689ffb640 1 -- 172.21.15.33:0/3090823788 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c0930c0 con 0x55e0e9677070 2024-08-28T19:34:11.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.328+0000 7f66b0e95740 1 -- 172.21.15.33:0/3090823788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 msgr2=0x55e0e9a24c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.328+0000 7f66b0e95740 1 --2- 172.21.15.33:0/3090823788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a24c40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f669c0a7f60 tx=0x7f669c0abee0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.329+0000 7f66b0e95740 1 -- 172.21.15.33:0/3090823788 shutdown_connections 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.329+0000 7f66b0e95740 1 --2- 172.21.15.33:0/3090823788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a24c40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.329+0000 7f66b0e95740 1 --2- 172.21.15.33:0/3090823788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9656390 0x55e0e9a33d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.329+0000 7f66b0e95740 1 --2- 172.21.15.33:0/3090823788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e964e1b0 0x55e0e9a1da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.329+0000 7f66b0e95740 1 -- 172.21.15.33:0/3090823788 >> 172.21.15.33:0/3090823788 conn(0x55e0e966b460 msgr2=0x55e0e9a1d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.329+0000 7f66b0e95740 1 -- 172.21.15.33:0/3090823788 shutdown_connections 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.329+0000 7f66b0e95740 1 -- 172.21.15.33:0/3090823788 wait complete. 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.329+0000 7f66b0e95740 1 -- start start 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.329+0000 7f66b0e95740 1 Processor -- start 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e964e1b0 0x55e0e9a3b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9656390 0x55e0e9a3bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66b0e95740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a9d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66b0e95740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f66a41b4290 con 0x55e0e9677070 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66b0e95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66a41b3bc0 con 0x55e0e964e1b0 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66b0e95740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f66a41b0e00 con 0x55e0e9656390 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66b0e95740 10 client.0 _ll_register_callbacks cb 0x7f66980097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a8ebd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a9d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a8ebd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a9d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54650/0 (socket says 172.21.15.33:54650) 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a8ebd640 1 -- 172.21.15.33:0/1864347658 learned_addr learned my addr 172.21.15.33:0/1864347658 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a3fff640 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e964e1b0 0x55e0e9a3b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a37fe640 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9656390 0x55e0e9a3bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a8ebd640 1 -- 172.21.15.33:0/1864347658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9656390 msgr2=0x55e0e9a3bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a8ebd640 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9656390 0x55e0e9a3bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a8ebd640 1 -- 172.21.15.33:0/1864347658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e964e1b0 msgr2=0x55e0e9a3b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a8ebd640 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e964e1b0 0x55e0e9a3b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a8ebd640 1 -- 172.21.15.33:0/1864347658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0e9a9d980 con 0x55e0e9677070 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66a8ebd640 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a9d310 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f669c0abbe0 tx=0x7f669c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80664d9d7772ce9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66837fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66837fe640 1 -- 172.21.15.33:0/1864347658 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c01f040 con 0x55e0e9677070 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66837fe640 1 -- 172.21.15.33:0/1864347658 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f669c093050 con 0x55e0e9677070 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.330+0000 7f66b0e95740 1 -- 172.21.15.33:0/1864347658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f669c0a8170 con 0x55e0e9677070 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66837fe640 1 -- 172.21.15.33:0/1864347658 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f669c093250 con 0x55e0e9677070 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66b0e95740 10 client.16131 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66b0e95740 1 -- 172.21.15.33:0/1864347658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0e9aa4c60 con 0x55e0e9677070 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66837fe640 1 -- 172.21.15.33:0/1864347658 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f669c0a8170 con 0x55e0e9677070 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66837fe640 1 -- 172.21.15.33:0/1864347658 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f669c00f040 con 0x55e0e9677070 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66b0e95740 10 client.16131 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:11.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66b0e95740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66b0e95740 20 client.16131 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66b0e95740 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0e960ada0 0x55e0e9aa7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66b0e95740 4 client.16131 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66b0e95740 1 -- 172.21.15.33:0/1864347658 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e0e9991020 con 0x55e0e960ada0 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.331+0000 7f66a3fff640 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0e960ada0 0x55e0e9aa7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66a3fff640 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0e960ada0 0x55e0e9aa7340 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60d76f47bc396cbf server_cookie=d97f40aa7ce3605f in_seq=0 out_seq=0 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66837fe640 10 client.16131 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66837fe640 1 -- 172.21.15.33:0/1864347658 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x55e0e9991020 con 0x55e0e960ada0 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66837fe640 10 client.16131 handle_command_reply: tid=0 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 client.16131 shutdown 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 -- 172.21.15.33:0/1864347658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 msgr2=0x55e0e9a9d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a9d310 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f669c0abbe0 tx=0x7f669c005800 comp rx=0 tx=0).stop 2024-08-28T19:34:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 -- 172.21.15.33:0/1864347658 shutdown_connections 2024-08-28T19:34:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e0e960ada0 0x55e0e9aa7340 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0e9677070 0x55e0e9a9d310 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0e9656390 0x55e0e9a3bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 --2- 172.21.15.33:0/1864347658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0e964e1b0 0x55e0e9a3b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66837fe640 0 client.16131 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 -- 172.21.15.33:0/1864347658 >> 172.21.15.33:0/1864347658 conn(0x55e0e966b460 msgr2=0x55e0e9a1fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 -- 172.21.15.33:0/1864347658 shutdown_connections 2024-08-28T19:34:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.332+0000 7f66b0e95740 1 -- 172.21.15.33:0/1864347658 wait complete. 2024-08-28T19:34:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66b0e95740 20 client.16131 trim_cache size 0 max 16384 2024-08-28T19:34:11.339 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6", 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:11.340 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:34:11.341 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:34:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:34:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:34:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:34:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:34:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:11.342 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:11.342 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 -- 172.21.15.33:0/2642649409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f668c0b4ca0 msgr2=0x7f668c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f668c0b4ca0 0x7f668c0b71b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6698000c00 tx=0x7f6698033400 comp rx=0 tx=0).stop 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 -- 172.21.15.33:0/2642649409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a4108a90 msgr2=0x7f66a41a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a4108a90 0x7f66a41a1d50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f669c00eaa0 tx=0x7f669c00ef60 comp rx=0 tx=0).stop 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 -- 172.21.15.33:0/2642649409 shutdown_connections 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a4108a90 0x7f66a41a1d50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f668c0b4ca0 0x7f668c0b71b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a4108140 0x7f66a419cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 --2- 172.21.15.33:0/2642649409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a4102800 0x7f66a419c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 -- 172.21.15.33:0/2642649409 >> 172.21.15.33:0/2642649409 conn(0x7f66a40794d0 msgr2=0x7f66a4104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 -- 172.21.15.33:0/2642649409 shutdown_connections 2024-08-28T19:34:11.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:11.333+0000 7f66aa920640 1 -- 172.21.15.33:0/2642649409 wait complete. 2024-08-28T19:34:11.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:11 smithi033 ceph-mon[18549]: pgmap v394: 129 pgs: 129 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 29 op/s 2024-08-28T19:34:11.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:11 smithi059 ceph-mon[22052]: pgmap v394: 129 pgs: 129 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 29 op/s 2024-08-28T19:34:11.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:11 smithi122 ceph-mon[22174]: pgmap v394: 129 pgs: 129 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 29 op/s 2024-08-28T19:34:12.058 INFO:tasks.cephfs.filesystem:scrub status for tag:7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6 - {'path': '/', 'tag': '7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6', 'options': 'recursive,force'} 2024-08-28T19:34:13.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:13 smithi033 ceph-mon[18549]: pgmap v395: 129 pgs: 129 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 28 op/s 2024-08-28T19:34:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:13 smithi059 ceph-mon[22052]: pgmap v395: 129 pgs: 129 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 28 op/s 2024-08-28T19:34:13.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:13 smithi122 ceph-mon[22174]: pgmap v395: 129 pgs: 129 active+clean; 1.7 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 28 op/s 2024-08-28T19:34:14.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:14 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:34:14.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:14 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:34:14.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:14 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:34:15.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:15 smithi033 ceph-mon[18549]: pgmap v396: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 33 op/s 2024-08-28T19:34:15.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:15 smithi059 ceph-mon[22052]: pgmap v396: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 33 op/s 2024-08-28T19:34:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:15 smithi122 ceph-mon[22174]: pgmap v396: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 33 op/s 2024-08-28T19:34:17.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:17 smithi033 ceph-mon[18549]: pgmap v397: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:17.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:17 smithi059 ceph-mon[22052]: pgmap v397: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:17 smithi122 ceph-mon[22174]: pgmap v397: 129 pgs: 129 active+clean; 1.8 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:19.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:19 smithi033 ceph-mon[18549]: pgmap v398: 129 pgs: 129 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-28T19:34:19.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:19 smithi059 ceph-mon[22052]: pgmap v398: 129 pgs: 129 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-28T19:34:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:19 smithi122 ceph-mon[22174]: pgmap v398: 129 pgs: 129 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-28T19:34:21.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:21 smithi033 ceph-mon[18549]: pgmap v399: 129 pgs: 129 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:21.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:21 smithi059 ceph-mon[22052]: pgmap v399: 129 pgs: 129 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:21 smithi122 ceph-mon[22174]: pgmap v399: 129 pgs: 129 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:23.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:23 smithi033 ceph-mon[18549]: pgmap v400: 129 pgs: 129 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:23.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:23 smithi059 ceph-mon[22052]: pgmap v400: 129 pgs: 129 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:23 smithi122 ceph-mon[22174]: pgmap v400: 129 pgs: 129 active+clean; 1.9 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:25.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:25 smithi033 ceph-mon[18549]: pgmap v401: 129 pgs: 129 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-08-28T19:34:25.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:25 smithi059 ceph-mon[22052]: pgmap v401: 129 pgs: 129 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-08-28T19:34:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:25 smithi122 ceph-mon[22174]: pgmap v401: 129 pgs: 129 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-08-28T19:34:27.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:27 smithi033 ceph-mon[18549]: pgmap v402: 129 pgs: 129 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:27.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:27 smithi059 ceph-mon[22052]: pgmap v402: 129 pgs: 129 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:27 smithi122 ceph-mon[22174]: pgmap v402: 129 pgs: 129 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:29 smithi059 ceph-mon[22052]: pgmap v403: 129 pgs: 129 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-28T19:34:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:29 smithi122 ceph-mon[22174]: pgmap v403: 129 pgs: 129 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-28T19:34:29.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:29 smithi033 ceph-mon[18549]: pgmap v403: 129 pgs: 129 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-28T19:34:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:31 smithi059 ceph-mon[22052]: pgmap v404: 129 pgs: 129 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:31 smithi122 ceph-mon[22174]: pgmap v404: 129 pgs: 129 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:31 smithi033 ceph-mon[18549]: pgmap v404: 129 pgs: 129 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:33.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:33 smithi059 ceph-mon[22052]: pgmap v405: 129 pgs: 129 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:33 smithi122 ceph-mon[22174]: pgmap v405: 129 pgs: 129 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:33 smithi033 ceph-mon[18549]: pgmap v405: 129 pgs: 129 active+clean; 2.1 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:35 smithi059 ceph-mon[22052]: pgmap v406: 129 pgs: 129 active+clean; 2.2 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-08-28T19:34:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:35 smithi122 ceph-mon[22174]: pgmap v406: 129 pgs: 129 active+clean; 2.2 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-08-28T19:34:35.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:35 smithi033 ceph-mon[18549]: pgmap v406: 129 pgs: 129 active+clean; 2.2 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-08-28T19:34:37.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:37 smithi059 ceph-mon[22052]: pgmap v407: 129 pgs: 129 active+clean; 2.2 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:37 smithi122 ceph-mon[22174]: pgmap v407: 129 pgs: 129 active+clean; 2.2 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:37.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:37 smithi033 ceph-mon[18549]: pgmap v407: 129 pgs: 129 active+clean; 2.2 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:39 smithi059 ceph-mon[22052]: pgmap v408: 129 pgs: 129 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 KiB/s wr, 17 op/s 2024-08-28T19:34:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:39 smithi122 ceph-mon[22174]: pgmap v408: 129 pgs: 129 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 KiB/s wr, 17 op/s 2024-08-28T19:34:39.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:39 smithi033 ceph-mon[18549]: pgmap v408: 129 pgs: 129 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 KiB/s wr, 17 op/s 2024-08-28T19:34:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:41 smithi059 ceph-mon[22052]: pgmap v409: 129 pgs: 129 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:41 smithi122 ceph-mon[22174]: pgmap v409: 129 pgs: 129 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:41 smithi033 ceph-mon[18549]: pgmap v409: 129 pgs: 129 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:42.059 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:34:42.329 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.949+0000 7f1796c8e640 1 -- 172.21.15.33:0/2183743136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179010dc00 msgr2=0x7f17901100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.949+0000 7f1796c8e640 1 --2- 172.21.15.33:0/2183743136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179010dc00 0x7f17901100d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1788009ca0 tx=0x7f178802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.949+0000 7f1796c8e640 1 -- 172.21.15.33:0/2183743136 shutdown_connections 2024-08-28T19:34:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.949+0000 7f1796c8e640 1 --2- 172.21.15.33:0/2183743136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179010dc00 0x7f17901100d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.949+0000 7f1796c8e640 1 --2- 172.21.15.33:0/2183743136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790105080 0x7f179010d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.949+0000 7f1796c8e640 1 --2- 172.21.15.33:0/2183743136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1790104650 0x7f1790104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.949+0000 7f1796c8e640 1 -- 172.21.15.33:0/2183743136 >> 172.21.15.33:0/2183743136 conn(0x7f17900794d0 msgr2=0x7f17900798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:42.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.949+0000 7f1796c8e640 1 -- 172.21.15.33:0/2183743136 shutdown_connections 2024-08-28T19:34:42.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.949+0000 7f1796c8e640 1 -- 172.21.15.33:0/2183743136 wait complete. 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.950+0000 7f1796c8e640 1 Processor -- start 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.950+0000 7f1796c8e640 1 -- start start 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.950+0000 7f1796c8e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1790104650 0x7f179019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.950+0000 7f1796c8e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790105080 0x7f179019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.950+0000 7f1796c8e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179010dc00 0x7f179019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f179522b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179010dc00 0x7f179019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f1796c8e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1790113840 con 0x7f179010dc00 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f1796c8e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17901136c0 con 0x7f1790105080 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f179522b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179010dc00 0x7f179019fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44240/0 (socket says 172.21.15.33:44240) 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f1796c8e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f17901139c0 con 0x7f1790104650 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f179522b640 1 -- 172.21.15.33:0/2818398433 learned_addr learned my addr 172.21.15.33:0/2818398433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:42.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f178ffff640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790105080 0x7f179019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f1794a2a640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1790104650 0x7f179019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f179522b640 1 -- 172.21.15.33:0/2818398433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1790104650 msgr2=0x7f179019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f179522b640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1790104650 0x7f179019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f179522b640 1 -- 172.21.15.33:0/2818398433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790105080 msgr2=0x7f179019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f179522b640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790105080 0x7f179019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f179522b640 1 -- 172.21.15.33:0/2818398433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17901a0140 con 0x7f179010dc00 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f178ffff640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790105080 0x7f179019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f179522b640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179010dc00 0x7f179019fa10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1788005cc0 tx=0x7f178802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f178dffb640 1 -- 172.21.15.33:0/2818398433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788003bf0 con 0x7f179010dc00 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f1796c8e640 1 -- 172.21.15.33:0/2818398433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17901a03d0 con 0x7f179010dc00 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f178dffb640 1 -- 172.21.15.33:0/2818398433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1788003d90 con 0x7f179010dc00 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.951+0000 7f178dffb640 1 -- 172.21.15.33:0/2818398433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178802fbc0 con 0x7f179010dc00 2024-08-28T19:34:42.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.952+0000 7f1796c8e640 1 -- 172.21.15.33:0/2818398433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17901a6b90 con 0x7f179010dc00 2024-08-28T19:34:42.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.954+0000 7f179d203740 1 Processor -- start 2024-08-28T19:34:42.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.954+0000 7f178dffb640 1 -- 172.21.15.33:0/2818398433 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f178802fd60 con 0x7f179010dc00 2024-08-28T19:34:42.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f179d203740 1 -- start start 2024-08-28T19:34:42.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f179d203740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1d3070 0x559fbf578300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f179d203740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf578840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f179d203740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf578d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f179d203740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559fbf4ef630 con 0x559fbf1b2390 2024-08-28T19:34:42.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f179d203740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559fbf4debc0 con 0x559fbf1aa1b0 2024-08-28T19:34:42.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f179d203740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fbf4e2b70 con 0x559fbf1d3070 2024-08-28T19:34:42.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f178ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf578d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f178ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf578d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44252/0 (socket says 172.21.15.33:44252) 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f178ffff640 1 -- 172.21.15.33:0/1212789547 learned_addr learned my addr 172.21.15.33:0/1212789547 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f1794a2a640 1 --2- 172.21.15.33:0/1212789547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf578840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f178ffff640 1 --2- 172.21.15.33:0/1212789547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1d3070 0x559fbf578300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f178dffb640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17780b4ca0 0x7f17780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f178ffff640 1 -- 172.21.15.33:0/1212789547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1d3070 msgr2=0x559fbf578300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.955+0000 7f178ffff640 1 --2- 172.21.15.33:0/1212789547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1d3070 0x559fbf578300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.956+0000 7f178ffff640 1 -- 172.21.15.33:0/1212789547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 msgr2=0x559fbf578840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.956+0000 7f178ffff640 1 --2- 172.21.15.33:0/1212789547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf578840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.956+0000 7f178ffff640 1 -- 172.21.15.33:0/1212789547 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fbf23e650 con 0x559fbf1b2390 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.956+0000 7f179522b640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17780b4ca0 0x7f17780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.956+0000 7f178dffb640 1 -- 172.21.15.33:0/2818398433 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1788106e50 con 0x7f179010dc00 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.956+0000 7f178ffff640 1 --2- 172.21.15.33:0/1212789547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf578d80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f178400ceb0 tx=0x7f178400c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbb0d983c0962de server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.956+0000 7f1776ffd640 1 -- 172.21.15.33:0/1212789547 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784019020 con 0x559fbf1b2390 2024-08-28T19:34:42.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.956+0000 7f179522b640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17780b4ca0 0x7f17780b71b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1788104300 tx=0x7f1788003f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:42.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.956+0000 7f1776ffd640 1 -- 172.21.15.33:0/1212789547 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1784004230 con 0x559fbf1b2390 2024-08-28T19:34:42.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.956+0000 7f1776ffd640 1 -- 172.21.15.33:0/1212789547 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178400f800 con 0x559fbf1b2390 2024-08-28T19:34:42.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 -- 172.21.15.33:0/1212789547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 msgr2=0x559fbf578d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:42.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 --2- 172.21.15.33:0/1212789547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf578d80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f178400ceb0 tx=0x7f178400c540 comp rx=0 tx=0).stop 2024-08-28T19:34:42.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 -- 172.21.15.33:0/1212789547 shutdown_connections 2024-08-28T19:34:42.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 --2- 172.21.15.33:0/1212789547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf578d80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 --2- 172.21.15.33:0/1212789547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf578840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 --2- 172.21.15.33:0/1212789547 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1d3070 0x559fbf578300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 -- 172.21.15.33:0/1212789547 >> 172.21.15.33:0/1212789547 conn(0x559fbf1c7460 msgr2=0x559fbf5761f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 -- 172.21.15.33:0/1212789547 shutdown_connections 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 -- 172.21.15.33:0/1212789547 wait complete. 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 -- start start 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.957+0000 7f179d203740 1 Processor -- start 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f179d203740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf583a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f179d203740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf583f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f179d203740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1d3070 0x559fbf58fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f179d203740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559fbf341700 con 0x559fbf1b2390 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f179d203740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559fbf465700 con 0x559fbf1aa1b0 2024-08-28T19:34:42.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f179d203740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fbf586ae0 con 0x559fbf1d3070 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f179d203740 10 client.0 _ll_register_callbacks cb 0x559fbf494dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f1794a2a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf583f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f1794a2a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf583f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44254/0 (socket says 172.21.15.33:44254) 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f1794a2a640 1 -- 172.21.15.33:0/1369400475 learned_addr learned my addr 172.21.15.33:0/1369400475 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f178ffff640 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1d3070 0x559fbf58fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f178ffff640 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf583a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f1794a2a640 1 -- 172.21.15.33:0/1369400475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1d3070 msgr2=0x559fbf58fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f1794a2a640 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1d3070 0x559fbf58fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f1794a2a640 1 -- 172.21.15.33:0/1369400475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 msgr2=0x559fbf583a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f1794a2a640 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf583a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f1794a2a640 1 -- 172.21.15.33:0/1369400475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fbf49e8b0 con 0x559fbf1b2390 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.958+0000 7f178ffff640 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf583a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.959+0000 7f1794a2a640 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf583f60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1780011780 tx=0x7f1780011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95395af2fc2107da server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.959+0000 7f176ffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.959+0000 7f176ffff640 1 -- 172.21.15.33:0/1369400475 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178001e060 con 0x559fbf1b2390 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.959+0000 7f176ffff640 1 -- 172.21.15.33:0/1369400475 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f178000fdb0 con 0x559fbf1b2390 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.959+0000 7f179d203740 1 -- 172.21.15.33:0/1369400475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1784004230 con 0x559fbf1b2390 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.959+0000 7f176ffff640 1 -- 172.21.15.33:0/1369400475 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1780025050 con 0x559fbf1b2390 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.959+0000 7f179d203740 10 client.16143 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.959+0000 7f179d203740 1 -- 172.21.15.33:0/1369400475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559fbf5928e0 con 0x559fbf1b2390 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.959+0000 7f176ffff640 1 -- 172.21.15.33:0/1369400475 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1784004230 con 0x559fbf1b2390 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.959+0000 7f176ffff640 1 -- 172.21.15.33:0/1369400475 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1780018030 con 0x559fbf1b2390 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.960+0000 7f179d203740 10 client.16143 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.960+0000 7f179d203740 10 client.16143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.960+0000 7f179d203740 20 client.16143 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.960+0000 7f179d203740 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fbf1919f0 0x559fbf595df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.960+0000 7f179d203740 4 client.16143 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.960+0000 7f179d203740 1 -- 172.21.15.33:0/1369400475 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fbf4f1580 con 0x559fbf1919f0 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.960+0000 7f178ffff640 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fbf1919f0 0x559fbf595df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.960+0000 7f176ffff640 10 client.16143 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.960+0000 7f178ffff640 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fbf1919f0 0x559fbf595df0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f77abbc557942794 server_cookie=1d53e283e72965e4 in_seq=0 out_seq=0 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f176ffff640 1 -- 172.21.15.33:0/1369400475 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559fbf4f1580 con 0x559fbf1919f0 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f176ffff640 10 client.16143 handle_command_reply: tid=0 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f179d203740 1 client.16143 shutdown 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f179d203740 1 -- 172.21.15.33:0/1369400475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 msgr2=0x559fbf583f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f179d203740 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf583f60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1780011780 tx=0x7f1780011c40 comp rx=0 tx=0).stop 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f179d203740 1 -- 172.21.15.33:0/1369400475 shutdown_connections 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f179d203740 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1d3070 0x559fbf58fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f179d203740 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fbf1919f0 0x559fbf595df0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f179d203740 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf583f60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f179d203740 1 --2- 172.21.15.33:0/1369400475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf583a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f176ffff640 0 client.16143 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:42.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.961+0000 7f179d203740 1 -- 172.21.15.33:0/1369400475 >> 172.21.15.33:0/1369400475 conn(0x559fbf1c7460 msgr2=0x559fbf57b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:42.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.962+0000 7f179d203740 1 -- 172.21.15.33:0/1369400475 shutdown_connections 2024-08-28T19:34:42.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.962+0000 7f179d203740 1 -- 172.21.15.33:0/1369400475 wait complete. 2024-08-28T19:34:42.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.962+0000 7f179d203740 20 client.16143 trim_cache size 0 max 16384 2024-08-28T19:34:42.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.979+0000 7f179d203740 1 Processor -- start 2024-08-28T19:34:42.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.979+0000 7f179d203740 1 -- start start 2024-08-28T19:34:42.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.979+0000 7f179d203740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1919f0 0x559fbf585650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f179d203740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf5757c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f179d203740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf575d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f179d203740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f17901b0a90 con 0x559fbf1b2390 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f179d203740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17901b25d0 con 0x559fbf1aa1b0 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f179d203740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f17901b1160 con 0x559fbf1919f0 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f178ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf575d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f178ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf575d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44256/0 (socket says 172.21.15.33:44256) 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f178ffff640 1 -- 172.21.15.33:0/651841513 learned_addr learned my addr 172.21.15.33:0/651841513 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f178ffff640 1 --2- 172.21.15.33:0/651841513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1919f0 0x559fbf585650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f1794a2a640 1 --2- 172.21.15.33:0/651841513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf5757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f178ffff640 1 -- 172.21.15.33:0/651841513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1919f0 msgr2=0x559fbf585650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f178ffff640 1 --2- 172.21.15.33:0/651841513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1919f0 0x559fbf585650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f178ffff640 1 -- 172.21.15.33:0/651841513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 msgr2=0x559fbf5757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:42.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f178ffff640 1 --2- 172.21.15.33:0/651841513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf5757c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f178ffff640 1 -- 172.21.15.33:0/651841513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fbf582980 con 0x559fbf1b2390 2024-08-28T19:34:42.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f1794a2a640 1 --2- 172.21.15.33:0/651841513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf5757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:42.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f178ffff640 1 --2- 172.21.15.33:0/651841513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf575d00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1784013f90 tx=0x7f1784003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbfae6c05aa606b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:42.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.980+0000 7f17767fc640 1 -- 172.21.15.33:0/651841513 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784019070 con 0x559fbf1b2390 2024-08-28T19:34:42.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.981+0000 7f17767fc640 1 -- 172.21.15.33:0/651841513 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1784004350 con 0x559fbf1b2390 2024-08-28T19:34:42.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.981+0000 7f17767fc640 1 -- 172.21.15.33:0/651841513 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784003c10 con 0x559fbf1b2390 2024-08-28T19:34:42.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.981+0000 7f179d203740 1 -- 172.21.15.33:0/651841513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 msgr2=0x559fbf575d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:42.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.981+0000 7f179d203740 1 --2- 172.21.15.33:0/651841513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf575d00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1784013f90 tx=0x7f1784003de0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.981+0000 7f179d203740 1 -- 172.21.15.33:0/651841513 shutdown_connections 2024-08-28T19:34:42.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.981+0000 7f179d203740 1 --2- 172.21.15.33:0/651841513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1b2390 0x559fbf575d00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.981+0000 7f179d203740 1 --2- 172.21.15.33:0/651841513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1aa1b0 0x559fbf5757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.981+0000 7f179d203740 1 --2- 172.21.15.33:0/651841513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1919f0 0x559fbf585650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.981+0000 7f179d203740 1 -- 172.21.15.33:0/651841513 >> 172.21.15.33:0/651841513 conn(0x559fbf1c7460 msgr2=0x559fbf584f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.981+0000 7f179d203740 1 -- 172.21.15.33:0/651841513 shutdown_connections 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.982+0000 7f179d203740 1 -- 172.21.15.33:0/651841513 wait complete. 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.982+0000 7f179d203740 1 -- start start 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.982+0000 7f179d203740 1 Processor -- start 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.982+0000 7f179d203740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1919f0 0x559fbf588520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.982+0000 7f179d203740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1aa1b0 0x559fbf588a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f179d203740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1b2390 0x559fbf5ff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f179d203740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f17901b1f00 con 0x559fbf1919f0 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f179d203740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17901b1830 con 0x559fbf1b2390 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f179d203740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f17901aea70 con 0x559fbf1aa1b0 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f179d203740 10 client.0 _ll_register_callbacks cb 0x7f178000c690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f178ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1919f0 0x559fbf588520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f178ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1919f0 0x559fbf588520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44258/0 (socket says 172.21.15.33:44258) 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f178ffff640 1 -- 172.21.15.33:0/1968879604 learned_addr learned my addr 172.21.15.33:0/1968879604 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f1794a2a640 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1aa1b0 0x559fbf588a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f178ffff640 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1b2390 0x559fbf5ff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f178ffff640 1 -- 172.21.15.33:0/1968879604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1aa1b0 msgr2=0x559fbf588a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f178ffff640 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1aa1b0 0x559fbf588a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f178ffff640 1 -- 172.21.15.33:0/1968879604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1b2390 msgr2=0x559fbf5ff7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f178ffff640 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1b2390 0x559fbf5ff7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f178ffff640 1 -- 172.21.15.33:0/1968879604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fbf5ffda0 con 0x559fbf1919f0 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f178ffff640 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1919f0 0x559fbf588520 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1784006010 tx=0x7f1784003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca36ac0a6e17412 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f176ffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f176ffff640 1 -- 172.21.15.33:0/1968879604 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784019070 con 0x559fbf1919f0 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f176ffff640 1 -- 172.21.15.33:0/1968879604 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f17840035f0 con 0x559fbf1919f0 2024-08-28T19:34:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.983+0000 7f179d203740 1 -- 172.21.15.33:0/1968879604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1784004350 con 0x559fbf1919f0 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f176ffff640 1 -- 172.21.15.33:0/1968879604 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1784013450 con 0x559fbf1919f0 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f179d203740 10 client.16149 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f179d203740 1 -- 172.21.15.33:0/1968879604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559fbf600fa0 con 0x559fbf1919f0 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f176ffff640 1 -- 172.21.15.33:0/1968879604 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1784004350 con 0x559fbf1919f0 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f176ffff640 1 -- 172.21.15.33:0/1968879604 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f178400fce0 con 0x559fbf1919f0 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f179d203740 10 client.16149 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f179d203740 10 client.16149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f179d203740 20 client.16149 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f179d203740 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fbf1d3070 0x559fbf603480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f179d203740 4 client.16149 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.984+0000 7f179d203740 1 -- 172.21.15.33:0/1968879604 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559fbf4ed020 con 0x559fbf1d3070 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f1794a2a640 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fbf1d3070 0x559fbf603480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:42.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f176ffff640 10 client.16149 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f1794a2a640 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fbf1d3070 0x559fbf603480 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65e8f8712c7b5471 server_cookie=2b2c87bb44549ca3 in_seq=0 out_seq=0 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f176ffff640 1 -- 172.21.15.33:0/1968879604 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x559fbf4ed020 con 0x559fbf1d3070 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f176ffff640 10 client.16149 handle_command_reply: tid=0 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f179d203740 1 client.16149 shutdown 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f179d203740 1 -- 172.21.15.33:0/1968879604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1919f0 msgr2=0x559fbf588520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f179d203740 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1919f0 0x559fbf588520 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1784006010 tx=0x7f1784003e50 comp rx=0 tx=0).stop 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f179d203740 1 -- 172.21.15.33:0/1968879604 shutdown_connections 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f179d203740 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf1b2390 0x559fbf5ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f179d203740 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf1aa1b0 0x559fbf588a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.985+0000 7f179d203740 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fbf1d3070 0x559fbf603480 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.986+0000 7f179d203740 1 --2- 172.21.15.33:0/1968879604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf1919f0 0x559fbf588520 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.986+0000 7f176ffff640 0 client.16149 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.986+0000 7f179d203740 1 -- 172.21.15.33:0/1968879604 >> 172.21.15.33:0/1968879604 conn(0x559fbf1c7460 msgr2=0x559fbf584ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.986+0000 7f179d203740 1 -- 172.21.15.33:0/1968879604 shutdown_connections 2024-08-28T19:34:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.986+0000 7f179d203740 1 -- 172.21.15.33:0/1968879604 wait complete. 2024-08-28T19:34:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.986+0000 7f179d203740 20 client.16149 trim_cache size 0 max 16384 2024-08-28T19:34:42.993 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:34:42.993 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:34:42.993 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:34:42.993 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:34:42.993 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:34:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:34:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:34:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:34:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:34:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:34:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:34:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:34:42.995 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:34:42.996 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:34:42.996 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:42.996 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:42.996 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:34:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.986+0000 7f1796c8e640 1 -- 172.21.15.33:0/2818398433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17780b4ca0 msgr2=0x7f17780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17780b4ca0 0x7f17780b71b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1788104300 tx=0x7f1788003f40 comp rx=0 tx=0).stop 2024-08-28T19:34:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 -- 172.21.15.33:0/2818398433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179010dc00 msgr2=0x7f179019fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179010dc00 0x7f179019fa10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1788005cc0 tx=0x7f178802f380 comp rx=0 tx=0).stop 2024-08-28T19:34:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 -- 172.21.15.33:0/2818398433 shutdown_connections 2024-08-28T19:34:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f179010dc00 0x7f179019fa10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1790105080 0x7f179019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17780b4ca0 0x7f17780b71b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 --2- 172.21.15.33:0/2818398433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1790104650 0x7f179019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 -- 172.21.15.33:0/2818398433 >> 172.21.15.33:0/2818398433 conn(0x7f17900794d0 msgr2=0x7f1790107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 -- 172.21.15.33:0/2818398433 shutdown_connections 2024-08-28T19:34:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:42.987+0000 7f1796c8e640 1 -- 172.21.15.33:0/2818398433 wait complete. 2024-08-28T19:34:43.772 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:43 smithi033 ceph-mon[18549]: pgmap v410: 129 pgs: 129 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:43.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:43 smithi059 ceph-mon[22052]: pgmap v410: 129 pgs: 129 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:43 smithi122 ceph-mon[22174]: pgmap v410: 129 pgs: 129 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:43.804 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:34:43.804 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:34:44.061 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:44.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.600+0000 7f8ffca59640 1 -- 172.21.15.33:0/156164964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ff8109b90 msgr2=0x7f8ff81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.600+0000 7f8ffca59640 1 --2- 172.21.15.33:0/156164964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ff8109b90 0x7f8ff81103c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009ca0 tx=0x7f8ff002a8e0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.600+0000 7f8ffca59640 1 -- 172.21.15.33:0/156164964 shutdown_connections 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.600+0000 7f8ffca59640 1 --2- 172.21.15.33:0/156164964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ff8109b90 0x7f8ff81103c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.600+0000 7f8ffca59640 1 --2- 172.21.15.33:0/156164964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff8109240 0x7f8ff8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.600+0000 7f8ffca59640 1 --2- 172.21.15.33:0/156164964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ff8103900 0x7f8ff8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.600+0000 7f8ffca59640 1 -- 172.21.15.33:0/156164964 >> 172.21.15.33:0/156164964 conn(0x7f8ff807b5f0 msgr2=0x7f8ff807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.600+0000 7f8ffca59640 1 -- 172.21.15.33:0/156164964 shutdown_connections 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.601+0000 7f8ffca59640 1 -- 172.21.15.33:0/156164964 wait complete. 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.601+0000 7f8ffca59640 1 Processor -- start 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.601+0000 7f8ffca59640 1 -- start start 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ffca59640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ff8103900 0x7f8ff80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ffca59640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ff8109240 0x7f8ff80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:44.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ffca59640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff8109b90 0x7f8ff8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ffca59640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff8113890 con 0x7f8ff8109240 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ffca59640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff8113710 con 0x7f8ff8109b90 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ffca59640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff8113a10 con 0x7f8ff8103900 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ff8109240 0x7f8ff80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ff8109240 0x7f8ff80759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44264/0 (socket says 172.21.15.33:44264) 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff5d9b640 1 -- 172.21.15.33:0/2921267663 learned_addr learned my addr 172.21.15.33:0/2921267663 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff659c640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ff8103900 0x7f8ff80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff6d9d640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff8109b90 0x7f8ff8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff5d9b640 1 -- 172.21.15.33:0/2921267663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ff8103900 msgr2=0x7f8ff80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff5d9b640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ff8103900 0x7f8ff80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff5d9b640 1 -- 172.21.15.33:0/2921267663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff8109b90 msgr2=0x7f8ff8075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff5d9b640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff8109b90 0x7f8ff8075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff5d9b640 1 -- 172.21.15.33:0/2921267663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff81a8520 con 0x7f8ff8109240 2024-08-28T19:34:44.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.602+0000 7f8ff5d9b640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ff8109240 0x7f8ff80759f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8006fd0 tx=0x7f8fe800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.603+0000 7f8fef7fe640 1 -- 172.21.15.33:0/2921267663 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8011830 con 0x7f8ff8109240 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.603+0000 7f8fef7fe640 1 -- 172.21.15.33:0/2921267663 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe8016070 con 0x7f8ff8109240 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.603+0000 7f8ffca59640 1 -- 172.21.15.33:0/2921267663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff81a8810 con 0x7f8ff8109240 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.603+0000 7f8fef7fe640 1 -- 172.21.15.33:0/2921267663 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8010e00 con 0x7f8ff8109240 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.603+0000 7f8ffca59640 1 -- 172.21.15.33:0/2921267663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff81a8dd0 con 0x7f8ff8109240 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.604+0000 7f8ffca59640 1 -- 172.21.15.33:0/2921267663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff8103d10 con 0x7f8ff8109240 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.605+0000 7f8fef7fe640 1 -- 172.21.15.33:0/2921267663 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8fe801b460 con 0x7f8ff8109240 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.606+0000 7f8fef7fe640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fe40b4ca0 0x7f8fe40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.606+0000 7f8ff659c640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fe40b4ca0 0x7f8fe40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.606+0000 7f8fef7fe640 1 -- 172.21.15.33:0/2921267663 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8fe80e5410 con 0x7f8ff8109240 2024-08-28T19:34:44.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.607+0000 7f8ff659c640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fe40b4ca0 0x7f8fe40b71b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8076f00 tx=0x7f8fe000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:44.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.609+0000 7f8fef7fe640 1 -- 172.21.15.33:0/2921267663 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8fe80abe50 con 0x7f8ff8109240 2024-08-28T19:34:44.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.834+0000 7f8ffca59640 1 -- 172.21.15.33:0/2921267663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ff80767b0 con 0x7f8ff8109240 2024-08-28T19:34:44.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.835+0000 7f8fef7fe640 1 -- 172.21.15.33:0/2921267663 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f8ff80767b0 con 0x7f8ff8109240 2024-08-28T19:34:44.837 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:34:44.837 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:34:44.837 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:34:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 -- 172.21.15.33:0/2921267663 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fe40b4ca0 msgr2=0x7f8fe40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fe40b4ca0 0x7f8fe40b71b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8076f00 tx=0x7f8fe000b390 comp rx=0 tx=0).stop 2024-08-28T19:34:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 -- 172.21.15.33:0/2921267663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ff8109240 msgr2=0x7f8ff80759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ff8109240 0x7f8ff80759f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8006fd0 tx=0x7f8fe800b8e0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 -- 172.21.15.33:0/2921267663 shutdown_connections 2024-08-28T19:34:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff8109b90 0x7f8ff8075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ff8109240 0x7f8ff80759f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fe40b4ca0 0x7f8fe40b71b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 --2- 172.21.15.33:0/2921267663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ff8103900 0x7f8ff80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 -- 172.21.15.33:0/2921267663 >> 172.21.15.33:0/2921267663 conn(0x7f8ff807b5f0 msgr2=0x7f8ff8107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 -- 172.21.15.33:0/2921267663 shutdown_connections 2024-08-28T19:34:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:44.837+0000 7f8ffca59640 1 -- 172.21.15.33:0/2921267663 wait complete. 2024-08-28T19:34:45.616 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:45 smithi033 ceph-mon[18549]: pgmap v411: 129 pgs: 129 active+clean; 2.4 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-08-28T19:34:45.616 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:45 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2921267663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:34:45.649 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:34:45.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:45 smithi059 ceph-mon[22052]: pgmap v411: 129 pgs: 129 active+clean; 2.4 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-08-28T19:34:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:45 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2921267663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:34:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:45 smithi122 ceph-mon[22174]: pgmap v411: 129 pgs: 129 active+clean; 2.4 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-08-28T19:34:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:45 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2921267663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:34:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.410+0000 7fc4847e9640 1 -- 172.21.15.33:0/4246513641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc47c103900 msgr2=0x7fc47c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.410+0000 7fc4847e9640 1 --2- 172.21.15.33:0/4246513641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc47c103900 0x7fc47c103d10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc478009900 tx=0x7fc47802a410 comp rx=0 tx=0).stop 2024-08-28T19:34:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.411+0000 7fc4847e9640 1 -- 172.21.15.33:0/4246513641 shutdown_connections 2024-08-28T19:34:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.411+0000 7fc4847e9640 1 --2- 172.21.15.33:0/4246513641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc47c109b90 0x7fc47c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.411+0000 7fc4847e9640 1 --2- 172.21.15.33:0/4246513641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc47c109240 0x7fc47c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.411+0000 7fc4847e9640 1 --2- 172.21.15.33:0/4246513641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc47c103900 0x7fc47c103d10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.411+0000 7fc4847e9640 1 -- 172.21.15.33:0/4246513641 >> 172.21.15.33:0/4246513641 conn(0x7fc47c07b5f0 msgr2=0x7fc47c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.411+0000 7fc4847e9640 1 -- 172.21.15.33:0/4246513641 shutdown_connections 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.411+0000 7fc4847e9640 1 -- 172.21.15.33:0/4246513641 wait complete. 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.411+0000 7fc4847e9640 1 Processor -- start 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.411+0000 7fc4847e9640 1 -- start start 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc4847e9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc47c103900 0x7fc47c19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc4847e9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc47c109240 0x7fc47c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc4847e9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc47c109b90 0x7fc47c19fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc4847e9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c113850 con 0x7fc47c109b90 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc4847e9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c1136d0 con 0x7fc47c103900 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc4847e9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c1139d0 con 0x7fc47c109240 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc482d86640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc47c109b90 0x7fc47c19fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc482d86640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc47c109b90 0x7fc47c19fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44282/0 (socket says 172.21.15.33:44282) 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc482d86640 1 -- 172.21.15.33:0/3487881542 learned_addr learned my addr 172.21.15.33:0/3487881542 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc481d84640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc47c109240 0x7fc47c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc482585640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc47c103900 0x7fc47c19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc482d86640 1 -- 172.21.15.33:0/3487881542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc47c109240 msgr2=0x7fc47c19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc482d86640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc47c109240 0x7fc47c19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc482d86640 1 -- 172.21.15.33:0/3487881542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc47c103900 msgr2=0x7fc47c19a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc482d86640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc47c103900 0x7fc47c19a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc482d86640 1 -- 172.21.15.33:0/3487881542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c1a0190 con 0x7fc47c109b90 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc482d86640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc47c109b90 0x7fc47c19fa60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc47400eb10 tx=0x7fc47400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.412+0000 7fc4737fe640 1 -- 172.21.15.33:0/3487881542 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474004b20 con 0x7fc47c109b90 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.413+0000 7fc4737fe640 1 -- 172.21.15.33:0/3487881542 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc474004cc0 con 0x7fc47c109b90 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.413+0000 7fc4847e9640 1 -- 172.21.15.33:0/3487881542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc47c1a0480 con 0x7fc47c109b90 2024-08-28T19:34:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.413+0000 7fc4737fe640 1 -- 172.21.15.33:0/3487881542 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474010670 con 0x7fc47c109b90 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.413+0000 7fc4847e9640 1 -- 172.21.15.33:0/3487881542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47c1a6be0 con 0x7fc47c109b90 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.415+0000 7fc48ad5e740 1 Processor -- start 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.415+0000 7fc4737fe640 1 -- 172.21.15.33:0/3487881542 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc474005020 con 0x7fc47c109b90 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc48ad5e740 1 -- start start 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c8c070 0x55d963031310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963031850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 0x55d963031d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d962fa8680 con 0x55d962c631b0 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d962f97c10 con 0x55d962c6b390 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d962f9bbc0 con 0x55d962c8c070 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc482585640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963031850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc482585640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963031850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44298/0 (socket says 172.21.15.33:44298) 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc482585640 1 -- 172.21.15.33:0/1910319376 learned_addr learned my addr 172.21.15.33:0/1910319376 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc481d84640 1 --2- 172.21.15.33:0/1910319376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c8c070 0x55d963031310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc481d84640 1 --2- 172.21.15.33:0/1910319376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 0x55d963031d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc4737fe640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc4680b4ca0 0x7fc4680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc482585640 1 -- 172.21.15.33:0/1910319376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c8c070 msgr2=0x55d963031310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc482585640 1 --2- 172.21.15.33:0/1910319376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c8c070 0x55d963031310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc482585640 1 -- 172.21.15.33:0/1910319376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 msgr2=0x55d963031d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc482585640 1 --2- 172.21.15.33:0/1910319376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 0x55d963031d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc482585640 1 -- 172.21.15.33:0/1910319376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d962cf7650 con 0x55d962c631b0 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc481d84640 1 --2- 172.21.15.33:0/1910319376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 0x55d963031d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.416+0000 7fc482d86640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc4680b4ca0 0x7fc4680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.417+0000 7fc4737fe640 1 -- 172.21.15.33:0/3487881542 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc4740e5df0 con 0x7fc47c109b90 2024-08-28T19:34:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.417+0000 7fc482585640 1 --2- 172.21.15.33:0/1910319376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963031850 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc478033000 tx=0x7fc478032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98239b9332e9dabd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.417+0000 7fc470ff9640 1 -- 172.21.15.33:0/1910319376 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478035040 con 0x55d962c631b0 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.417+0000 7fc470ff9640 1 -- 172.21.15.33:0/1910319376 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc478004030 con 0x55d962c631b0 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.417+0000 7fc470ff9640 1 -- 172.21.15.33:0/1910319376 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478005580 con 0x55d962c631b0 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1910319376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 msgr2=0x55d963031850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc482d86640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc4680b4ca0 0x7fc4680b71b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc4740a9400 tx=0x7fc474078390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/1910319376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963031850 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc478033000 tx=0x7fc478032b90 comp rx=0 tx=0).stop 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1910319376 shutdown_connections 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/1910319376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 0x55d963031d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/1910319376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963031850 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/1910319376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c8c070 0x55d963031310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1910319376 >> 172.21.15.33:0/1910319376 conn(0x55d962c80460 msgr2=0x55d96302f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1910319376 shutdown_connections 2024-08-28T19:34:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1910319376 wait complete. 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 -- start start 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.418+0000 7fc48ad5e740 1 Processor -- start 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963040e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 0x55d9630413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c8c070 0x55d96304d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d962dfa700 con 0x55d962c631b0 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d962f1e750 con 0x55d962c6b390 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d963043dc0 con 0x55d962c8c070 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc48ad5e740 10 client.0 _ll_register_callbacks cb 0x55d962f4de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc481d84640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc481d84640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963040e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44304/0 (socket says 172.21.15.33:44304) 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc481d84640 1 -- 172.21.15.33:0/2714022043 learned_addr learned my addr 172.21.15.33:0/2714022043 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc482585640 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 0x55d9630413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc481d84640 1 -- 172.21.15.33:0/2714022043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c8c070 msgr2=0x55d96304d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc481d84640 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c8c070 0x55d96304d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc481d84640 1 -- 172.21.15.33:0/2714022043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 msgr2=0x55d9630413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc481d84640 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 0x55d9630413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc481d84640 1 -- 172.21.15.33:0/2714022043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d962f57900 con 0x55d962c631b0 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc482585640 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 0x55d9630413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc481d84640 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963040e90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009de0 tx=0x7fc46c010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5d0867f8350934 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.419+0000 7fc465ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc465ffb640 1 -- 172.21.15.33:0/2714022043 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c004320 con 0x55d962c631b0 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc465ffb640 1 -- 172.21.15.33:0/2714022043 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc46c00f980 con 0x55d962c631b0 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc48ad5e740 1 -- 172.21.15.33:0/2714022043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc478004030 con 0x55d962c631b0 2024-08-28T19:34:46.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc465ffb640 1 -- 172.21.15.33:0/2714022043 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc46c0044c0 con 0x55d962c631b0 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc48ad5e740 10 client.16167 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc48ad5e740 1 -- 172.21.15.33:0/2714022043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d96304fc60 con 0x55d962c631b0 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc465ffb640 1 -- 172.21.15.33:0/2714022043 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc478004030 con 0x55d962c631b0 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc465ffb640 1 -- 172.21.15.33:0/2714022043 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc46c01e420 con 0x55d962c631b0 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc48ad5e740 10 client.16167 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc48ad5e740 10 client.16167 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc48ad5e740 20 client.16167 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55d962c4a9f0 0x55d9630531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc48ad5e740 4 client.16167 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.420+0000 7fc48ad5e740 1 -- 172.21.15.33:0/2714022043 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d962faa5d0 con 0x55d962c4a9f0 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.421+0000 7fc482585640 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55d962c4a9f0 0x55d9630531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.421+0000 7fc482585640 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55d962c4a9f0 0x55d9630531e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ae9e5c0602e06c0a server_cookie=5d7934b00b03c53 in_seq=0 out_seq=0 2024-08-28T19:34:46.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.421+0000 7fc465ffb640 10 client.16167 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc465ffb640 1 -- 172.21.15.33:0/2714022043 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d962faa5d0 con 0x55d962c4a9f0 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc465ffb640 10 client.16167 handle_command_reply: tid=0 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 client.16167 shutdown 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 -- 172.21.15.33:0/2714022043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 msgr2=0x55d963040e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963040e90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009de0 tx=0x7fc46c010f30 comp rx=0 tx=0).stop 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 -- 172.21.15.33:0/2714022043 shutdown_connections 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55d962c4a9f0 0x55d9630531e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c8c070 0x55d96304d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc465ffb640 0 client.16167 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c6b390 0x55d9630413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/2714022043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c631b0 0x55d963040e90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 -- 172.21.15.33:0/2714022043 >> 172.21.15.33:0/2714022043 conn(0x55d962c80460 msgr2=0x55d9630344a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:46.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 -- 172.21.15.33:0/2714022043 shutdown_connections 2024-08-28T19:34:46.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 1 -- 172.21.15.33:0/2714022043 wait complete. 2024-08-28T19:34:46.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.422+0000 7fc48ad5e740 20 client.16167 trim_cache size 0 max 16384 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc48ad5e740 1 Processor -- start 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc48ad5e740 1 -- start start 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c631b0 0x55d96302a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c6b390 0x55d963034460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c8c070 0x55d9630349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c1ae9c0 con 0x55d962c6b390 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c1b0500 con 0x55d962c8c070 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c1af090 con 0x55d962c631b0 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc482585640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c6b390 0x55d963034460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc482585640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c6b390 0x55d963034460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44312/0 (socket says 172.21.15.33:44312) 2024-08-28T19:34:46.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.436+0000 7fc482585640 1 -- 172.21.15.33:0/4104608963 learned_addr learned my addr 172.21.15.33:0/4104608963 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc481d84640 1 --2- 172.21.15.33:0/4104608963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c631b0 0x55d96302a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc481d84640 1 --2- 172.21.15.33:0/4104608963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c8c070 0x55d9630349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc482585640 1 -- 172.21.15.33:0/4104608963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c631b0 msgr2=0x55d96302a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc482585640 1 --2- 172.21.15.33:0/4104608963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c631b0 0x55d96302a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc482585640 1 -- 172.21.15.33:0/4104608963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c8c070 msgr2=0x55d9630349a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc482585640 1 --2- 172.21.15.33:0/4104608963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c8c070 0x55d9630349a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc482585640 1 -- 172.21.15.33:0/4104608963 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96303f390 con 0x55d962c6b390 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc481d84640 1 --2- 172.21.15.33:0/4104608963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c8c070 0x55d9630349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc482585640 1 --2- 172.21.15.33:0/4104608963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c6b390 0x55d963034460 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc478009900 tx=0x7fc478005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9069d447e6c44a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc467fff640 1 -- 172.21.15.33:0/4104608963 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478035040 con 0x55d962c6b390 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc467fff640 1 -- 172.21.15.33:0/4104608963 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4780314a0 con 0x55d962c6b390 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.437+0000 7fc467fff640 1 -- 172.21.15.33:0/4104608963 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4780046c0 con 0x55d962c6b390 2024-08-28T19:34:46.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.438+0000 7fc48ad5e740 1 -- 172.21.15.33:0/4104608963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c6b390 msgr2=0x55d963034460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.438+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/4104608963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c6b390 0x55d963034460 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc478009900 tx=0x7fc478005160 comp rx=0 tx=0).stop 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.438+0000 7fc48ad5e740 1 -- 172.21.15.33:0/4104608963 shutdown_connections 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.438+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/4104608963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c8c070 0x55d9630349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.438+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/4104608963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c6b390 0x55d963034460 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.438+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/4104608963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c631b0 0x55d96302a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.438+0000 7fc48ad5e740 1 -- 172.21.15.33:0/4104608963 >> 172.21.15.33:0/4104608963 conn(0x55d962c80460 msgr2=0x55d96303f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.438+0000 7fc48ad5e740 1 -- 172.21.15.33:0/4104608963 shutdown_connections 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.438+0000 7fc48ad5e740 1 -- 172.21.15.33:0/4104608963 wait complete. 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc48ad5e740 1 -- start start 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc48ad5e740 1 Processor -- start 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c631b0 0x55d963045930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c6b390 0x55d963045f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc48ad5e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c8c070 0x55d9630bcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c1afe30 con 0x55d962c8c070 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c1af760 con 0x55d962c631b0 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc48ad5e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c1ac9a0 con 0x55d962c6b390 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc48ad5e740 10 client.0 _ll_register_callbacks cb 0x7fc46c009d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc481d84640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c8c070 0x55d9630bcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc481d84640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c8c070 0x55d9630bcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44326/0 (socket says 172.21.15.33:44326) 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc481d84640 1 -- 172.21.15.33:0/1991562693 learned_addr learned my addr 172.21.15.33:0/1991562693 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc481d84640 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c631b0 0x55d963045930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.439+0000 7fc482585640 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c6b390 0x55d963045f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc481d84640 1 -- 172.21.15.33:0/1991562693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c6b390 msgr2=0x55d963045f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc481d84640 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c6b390 0x55d963045f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc481d84640 1 -- 172.21.15.33:0/1991562693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c631b0 msgr2=0x55d963045930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc481d84640 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c631b0 0x55d963045930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc481d84640 1 -- 172.21.15.33:0/1991562693 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9630bd210 con 0x55d962c8c070 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc481d84640 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c8c070 0x55d9630bcba0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc46c004490 tx=0x7fc46c010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115d96c16932ebe6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc465ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc465ffb640 1 -- 172.21.15.33:0/1991562693 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c00f980 con 0x55d962c8c070 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc465ffb640 1 -- 172.21.15.33:0/1991562693 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc46c00fb20 con 0x55d962c8c070 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1991562693 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4780314a0 con 0x55d962c8c070 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc465ffb640 1 -- 172.21.15.33:0/1991562693 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc46c00fd20 con 0x55d962c8c070 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc48ad5e740 10 client.16173 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1991562693 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d9630be400 con 0x55d962c8c070 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.440+0000 7fc465ffb640 1 -- 172.21.15.33:0/1991562693 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4780314a0 con 0x55d962c8c070 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc465ffb640 1 -- 172.21.15.33:0/1991562693 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc46c02c6c0 con 0x55d962c8c070 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc48ad5e740 10 client.16173 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:46.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc48ad5e740 10 client.16173 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc48ad5e740 20 client.16173 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55d962c1fda0 0x55d9630c0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc48ad5e740 4 client.16173 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1991562693 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d962fa6070 con 0x55d962c1fda0 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc482585640 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55d962c1fda0 0x55d9630c0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc482585640 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55d962c1fda0 0x55d9630c0b90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=623285f93d2ad1f2 server_cookie=ea152588fc55b6d9 in_seq=0 out_seq=0 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc465ffb640 10 client.16173 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc465ffb640 1 -- 172.21.15.33:0/1991562693 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d962fa6070 con 0x55d962c1fda0 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc465ffb640 10 client.16173 handle_command_reply: tid=0 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.441+0000 7fc48ad5e740 1 client.16173 shutdown 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1991562693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c8c070 msgr2=0x55d9630bcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c8c070 0x55d9630bcba0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc46c004490 tx=0x7fc46c010f30 comp rx=0 tx=0).stop 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1991562693 shutdown_connections 2024-08-28T19:34:46.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55d962c1fda0 0x55d9630c0b90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d962c8c070 0x55d9630bcba0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d962c6b390 0x55d963045f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 1 --2- 172.21.15.33:0/1991562693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d962c631b0 0x55d963045930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1991562693 >> 172.21.15.33:0/1991562693 conn(0x55d962c80460 msgr2=0x55d963034460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:46.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc465ffb640 0 client.16173 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:34:46.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1991562693 shutdown_connections 2024-08-28T19:34:46.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 1 -- 172.21.15.33:0/1991562693 wait complete. 2024-08-28T19:34:46.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc48ad5e740 20 client.16173 trim_cache size 0 max 16384 2024-08-28T19:34:46.451 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:34:46.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc4847e9640 1 -- 172.21.15.33:0/3487881542 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc4680b4ca0 msgr2=0x7fc4680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:46.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc4847e9640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc4680b4ca0 0x7fc4680b71b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc4740a9400 tx=0x7fc474078390 comp rx=0 tx=0).stop 2024-08-28T19:34:46.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc4847e9640 1 -- 172.21.15.33:0/3487881542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc47c109b90 msgr2=0x7fc47c19fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:46.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc4847e9640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc47c109b90 0x7fc47c19fa60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc47400eb10 tx=0x7fc47400c2d0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc4847e9640 1 -- 172.21.15.33:0/3487881542 shutdown_connections 2024-08-28T19:34:46.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc4847e9640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc47c109b90 0x7fc47c19fa60 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc4847e9640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc4680b4ca0 0x7fc4680b71b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc4847e9640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc47c109240 0x7fc47c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc4847e9640 1 --2- 172.21.15.33:0/3487881542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc47c103900 0x7fc47c19a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:46.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.442+0000 7fc4847e9640 1 -- 172.21.15.33:0/3487881542 >> 172.21.15.33:0/3487881542 conn(0x7fc47c07b5f0 msgr2=0x7fc47c107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:46.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.443+0000 7fc4847e9640 1 -- 172.21.15.33:0/3487881542 shutdown_connections 2024-08-28T19:34:46.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:46.443+0000 7fc4847e9640 1 -- 172.21.15.33:0/3487881542 wait complete. 2024-08-28T19:34:47.175 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:34:47.434 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:47.702 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:47 smithi033 ceph-mon[18549]: pgmap v412: 129 pgs: 129 active+clean; 2.4 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:47.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:47 smithi059 ceph-mon[22052]: pgmap v412: 129 pgs: 129 active+clean; 2.4 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:47 smithi122 ceph-mon[22174]: pgmap v412: 129 pgs: 129 active+clean; 2.4 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.953+0000 7f7aa7e78640 1 -- 172.21.15.33:0/3971793830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa0108ab0 msgr2=0x7f7aa010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.953+0000 7f7aa7e78640 1 --2- 172.21.15.33:0/3971793830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa0108ab0 0x7f7aa010f2e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009ca0 tx=0x7f7a9802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.953+0000 7f7aa7e78640 1 -- 172.21.15.33:0/3971793830 shutdown_connections 2024-08-28T19:34:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.953+0000 7f7aa7e78640 1 --2- 172.21.15.33:0/3971793830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa0108ab0 0x7f7aa010f2e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.953+0000 7f7aa7e78640 1 --2- 172.21.15.33:0/3971793830 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7aa0108160 0x7f7aa0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.953+0000 7f7aa7e78640 1 --2- 172.21.15.33:0/3971793830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aa0102820 0x7f7aa0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.953+0000 7f7aa7e78640 1 -- 172.21.15.33:0/3971793830 >> 172.21.15.33:0/3971793830 conn(0x7f7aa00794e0 msgr2=0x7f7aa00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.953+0000 7f7aa7e78640 1 -- 172.21.15.33:0/3971793830 shutdown_connections 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.953+0000 7f7aa7e78640 1 -- 172.21.15.33:0/3971793830 wait complete. 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.954+0000 7f7aa7e78640 1 Processor -- start 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.954+0000 7f7aa7e78640 1 -- start start 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.954+0000 7f7aa7e78640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa0102820 0x7f7aa019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa7e78640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aa0108160 0x7f7aa019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa7e78640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7aa0108ab0 0x7f7aa019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa7e78640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa0113840 con 0x7f7aa0102820 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa7e78640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa01136c0 con 0x7f7aa0108160 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa7e78640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa01139c0 con 0x7f7aa0108ab0 2024-08-28T19:34:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5c14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa0102820 0x7f7aa019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5c14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa0102820 0x7f7aa019a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44344/0 (socket says 172.21.15.33:44344) 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5c14640 1 -- 172.21.15.33:0/2835017232 learned_addr learned my addr 172.21.15.33:0/2835017232 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5413640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aa0108160 0x7f7aa019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa6415640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7aa0108ab0 0x7f7aa019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5c14640 1 -- 172.21.15.33:0/2835017232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7aa0108ab0 msgr2=0x7f7aa019fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7aa0108ab0 0x7f7aa019fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5c14640 1 -- 172.21.15.33:0/2835017232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aa0108160 msgr2=0x7f7aa019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aa0108160 0x7f7aa019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5c14640 1 -- 172.21.15.33:0/2835017232 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa01a0140 con 0x7f7aa0102820 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa6415640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7aa0108ab0 0x7f7aa019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5413640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aa0108160 0x7f7aa019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa0102820 0x7f7aa019a1d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00d950 tx=0x7f7a9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7a96ffd640 1 -- 172.21.15.33:0/2835017232 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c017070 con 0x7f7aa0102820 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa7e78640 1 -- 172.21.15.33:0/2835017232 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa01a0430 con 0x7f7aa0102820 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7a96ffd640 1 -- 172.21.15.33:0/2835017232 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a9c009c30 con 0x7f7aa0102820 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7a96ffd640 1 -- 172.21.15.33:0/2835017232 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00f620 con 0x7f7aa0102820 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.955+0000 7f7aa7e78640 1 -- 172.21.15.33:0/2835017232 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa01a6b90 con 0x7f7aa0102820 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.958+0000 7f7aae3ed740 1 Processor -- start 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.958+0000 7f7aae3ed740 1 -- start start 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.958+0000 7f7a96ffd640 1 -- 172.21.15.33:0/2835017232 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7a9c010460 con 0x7f7aa0102820 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.958+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a706310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.958+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a706850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.958+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a706d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555b8a67d680 con 0x555b8a3381b0 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555b8a66cc10 con 0x555b8a340390 2024-08-28T19:34:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b8a670bc0 con 0x555b8a361070 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa5c14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a706850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa5c14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a706850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44352/0 (socket says 172.21.15.33:44352) 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa5c14640 1 -- 172.21.15.33:0/528791079 learned_addr learned my addr 172.21.15.33:0/528791079 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa5413640 1 --2- 172.21.15.33:0/528791079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a706d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa6415640 1 --2- 172.21.15.33:0/528791079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a706310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa5c14640 1 -- 172.21.15.33:0/528791079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 msgr2=0x555b8a706310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/528791079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a706310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa5c14640 1 -- 172.21.15.33:0/528791079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 msgr2=0x555b8a706d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/528791079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a706d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa5c14640 1 -- 172.21.15.33:0/528791079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8a3cc650 con 0x555b8a3381b0 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7a96ffd640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7a8c0b4ca0 0x7f7a8c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa6415640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7a8c0b4ca0 0x7f7a8c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/528791079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a706850 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0e2910 tx=0x7f7a9c0ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a34ec52a83d32b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.959+0000 7f7a96ffd640 1 -- 172.21.15.33:0/2835017232 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f7a9c0e55a0 con 0x7f7aa0102820 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.960+0000 7f7a8bfff640 1 -- 172.21.15.33:0/528791079 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c020030 con 0x555b8a3381b0 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.960+0000 7f7a8bfff640 1 -- 172.21.15.33:0/528791079 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a9c0a70c0 con 0x555b8a3381b0 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.960+0000 7f7a8bfff640 1 -- 172.21.15.33:0/528791079 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c0ab290 con 0x555b8a3381b0 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 -- 172.21.15.33:0/528791079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 msgr2=0x555b8a706850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/528791079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a706850 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0e2910 tx=0x7f7a9c0ed690 comp rx=0 tx=0).stop 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aa6415640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7a8c0b4ca0 0x7f7a8c0b71b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7a98004af0 tx=0x7f7a98005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 -- 172.21.15.33:0/528791079 shutdown_connections 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/528791079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a706d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/528791079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a706850 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/528791079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a706310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 -- 172.21.15.33:0/528791079 >> 172.21.15.33:0/528791079 conn(0x555b8a355460 msgr2=0x555b8a704200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 -- 172.21.15.33:0/528791079 shutdown_connections 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 -- 172.21.15.33:0/528791079 wait complete. 2024-08-28T19:34:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 -- start start 2024-08-28T19:34:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.961+0000 7f7aae3ed740 1 Processor -- start 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.962+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a711b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.962+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a712040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.962+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a71de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.962+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555b8a4cf700 con 0x555b8a3381b0 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.962+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555b8a5f3750 con 0x555b8a340390 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.962+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b8a714af0 con 0x555b8a361070 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.962+0000 7f7aa5c14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a711b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.962+0000 7f7aa5c14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a711b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44354/0 (socket says 172.21.15.33:44354) 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.962+0000 7f7aa5c14640 1 -- 172.21.15.33:0/1763527261 learned_addr learned my addr 172.21.15.33:0/1763527261 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.962+0000 7f7aae3ed740 10 client.0 _ll_register_callbacks cb 0x555b8a622e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aa5413640 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a712040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aa6415640 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a71de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aa5c14640 1 -- 172.21.15.33:0/1763527261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 msgr2=0x555b8a71de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a71de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aa5c14640 1 -- 172.21.15.33:0/1763527261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 msgr2=0x555b8a712040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a712040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aa5c14640 1 -- 172.21.15.33:0/1763527261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8a62c900 con 0x555b8a3381b0 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aa6415640 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a71de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aa5413640 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a712040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a711b00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0e2a50 tx=0x7f7a9c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde185d0caad7160 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7a897fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7a897fa640 1 -- 172.21.15.33:0/1763527261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c020050 con 0x555b8a3381b0 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7a897fa640 1 -- 172.21.15.33:0/1763527261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f7a9c0eb680 con 0x555b8a3381b0 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1763527261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a9c0a70c0 con 0x555b8a3381b0 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7a897fa640 1 -- 172.21.15.33:0/1763527261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a9c0ab0b0 con 0x555b8a3381b0 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aae3ed740 10 client.16185 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.963+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1763527261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555b8a7208e0 con 0x555b8a3381b0 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.964+0000 7f7a897fa640 1 -- 172.21.15.33:0/1763527261 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a9c0a70c0 con 0x555b8a3381b0 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.964+0000 7f7a897fa640 1 -- 172.21.15.33:0/1763527261 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7a9c0e51f0 con 0x555b8a3381b0 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.964+0000 7f7aae3ed740 10 client.16185 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.964+0000 7f7aae3ed740 10 client.16185 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.964+0000 7f7aae3ed740 20 client.16185 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.964+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555b8a31f9f0 0x555b8a723c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.964+0000 7f7aae3ed740 4 client.16185 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.964+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1763527261 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b8a67f5d0 con 0x555b8a31f9f0 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.964+0000 7f7aa5413640 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555b8a31f9f0 0x555b8a723c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.965+0000 7f7aa5413640 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555b8a31f9f0 0x555b8a723c40 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3feafb6738936748 server_cookie=6568225619ad9f1f in_seq=0 out_seq=0 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.965+0000 7f7a897fa640 10 client.16185 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.965+0000 7f7a897fa640 1 -- 172.21.15.33:0/1763527261 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b8a67f5d0 con 0x555b8a31f9f0 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.965+0000 7f7a897fa640 10 client.16185 handle_command_reply: tid=0 2024-08-28T19:34:47.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.965+0000 7f7aae3ed740 1 client.16185 shutdown 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1763527261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 msgr2=0x555b8a711b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a711b00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0e2a50 tx=0x7f7a9c00bf60 comp rx=0 tx=0).stop 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1763527261 shutdown_connections 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555b8a31f9f0 0x555b8a723c40 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a71de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a712040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7a897fa640 0 client.16185 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/1763527261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a711b00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1763527261 >> 172.21.15.33:0/1763527261 conn(0x555b8a355460 msgr2=0x555b8a7094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1763527261 shutdown_connections 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1763527261 wait complete. 2024-08-28T19:34:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.966+0000 7f7aae3ed740 20 client.16185 trim_cache size 0 max 16384 2024-08-28T19:34:47.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.981+0000 7f7aae3ed740 1 Processor -- start 2024-08-28T19:34:47.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.981+0000 7f7aae3ed740 1 -- start start 2024-08-28T19:34:47.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.981+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a3381b0 0x555b8a711fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.981+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a71dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.981+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a361070 0x555b8a709410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.981+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa01ae980 con 0x555b8a361070 2024-08-28T19:34:47.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.981+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa01b04c0 con 0x555b8a340390 2024-08-28T19:34:47.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.981+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa01af050 con 0x555b8a3381b0 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa6415640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a361070 0x555b8a709410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa6415640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a361070 0x555b8a709410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44356/0 (socket says 172.21.15.33:44356) 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa6415640 1 -- 172.21.15.33:0/1215366008 learned_addr learned my addr 172.21.15.33:0/1215366008 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/1215366008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a3381b0 0x555b8a711fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa5413640 1 --2- 172.21.15.33:0/1215366008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a71dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa6415640 1 -- 172.21.15.33:0/1215366008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a3381b0 msgr2=0x555b8a711fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa6415640 1 --2- 172.21.15.33:0/1215366008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a3381b0 0x555b8a711fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa6415640 1 -- 172.21.15.33:0/1215366008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 msgr2=0x555b8a71dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa6415640 1 --2- 172.21.15.33:0/1215366008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a71dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa6415640 1 -- 172.21.15.33:0/1215366008 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8a708600 con 0x555b8a361070 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7aa6415640 1 --2- 172.21.15.33:0/1215366008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a361070 0x555b8a709410 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009ca0 tx=0x7f7a98041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6747dc6920912389 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7a8b7fe640 1 -- 172.21.15.33:0/1215366008 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98003970 con 0x555b8a361070 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7a8b7fe640 1 -- 172.21.15.33:0/1215366008 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a98036040 con 0x555b8a361070 2024-08-28T19:34:47.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.982+0000 7f7a8b7fe640 1 -- 172.21.15.33:0/1215366008 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98004760 con 0x555b8a361070 2024-08-28T19:34:47.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.983+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1215366008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a361070 msgr2=0x555b8a709410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:47.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.983+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/1215366008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a361070 0x555b8a709410 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009ca0 tx=0x7f7a98041000 comp rx=0 tx=0).stop 2024-08-28T19:34:47.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.983+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1215366008 shutdown_connections 2024-08-28T19:34:47.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.983+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/1215366008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a361070 0x555b8a709410 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.983+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/1215366008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a71dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.983+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/1215366008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a3381b0 0x555b8a711fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.983+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1215366008 >> 172.21.15.33:0/1215366008 conn(0x555b8a355460 msgr2=0x555b8a7118b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.983+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1215366008 shutdown_connections 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.983+0000 7f7aae3ed740 1 -- 172.21.15.33:0/1215366008 wait complete. 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aae3ed740 1 -- start start 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aae3ed740 1 Processor -- start 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a725090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a725630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aae3ed740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a78d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa01afdf0 con 0x555b8a3381b0 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa01af720 con 0x555b8a340390 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aae3ed740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa01ac960 con 0x555b8a361070 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aae3ed740 10 client.0 _ll_register_callbacks cb 0x7f7a9000b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aa5c14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a725090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aa5c14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a725090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44360/0 (socket says 172.21.15.33:44360) 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aa5c14640 1 -- 172.21.15.33:0/3229124152 learned_addr learned my addr 172.21.15.33:0/3229124152 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.984+0000 7f7aa5413640 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a725630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aa6415640 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a78d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aa5c14640 1 -- 172.21.15.33:0/3229124152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 msgr2=0x555b8a78d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a78d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aa5c14640 1 -- 172.21.15.33:0/3229124152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 msgr2=0x555b8a725630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a725630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aa5c14640 1 -- 172.21.15.33:0/3229124152 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8a78d900 con 0x555b8a3381b0 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aa6415640 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a78d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aa5c14640 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a725090 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009de0 tx=0x7f7a9c0ab780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e790877be88dac server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7a897fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7a897fa640 1 -- 172.21.15.33:0/3229124152 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c020070 con 0x555b8a3381b0 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7a897fa640 1 -- 172.21.15.33:0/3229124152 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f7a9c0b47d0 con 0x555b8a3381b0 2024-08-28T19:34:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aae3ed740 1 -- 172.21.15.33:0/3229124152 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a98036040 con 0x555b8a3381b0 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7a897fa640 1 -- 172.21.15.33:0/3229124152 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a9c0ab290 con 0x555b8a3381b0 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aae3ed740 10 client.16191 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7aae3ed740 1 -- 172.21.15.33:0/3229124152 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555b8a78ea80 con 0x555b8a3381b0 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.985+0000 7f7a897fa640 1 -- 172.21.15.33:0/3229124152 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a98036040 con 0x555b8a3381b0 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.986+0000 7f7a897fa640 1 -- 172.21.15.33:0/3229124152 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7a9c0abba0 con 0x555b8a3381b0 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.986+0000 7f7aae3ed740 10 client.16191 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.986+0000 7f7aae3ed740 10 client.16191 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.986+0000 7f7aae3ed740 20 client.16191 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.986+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555b8a2f4da0 0x555b8a790f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.986+0000 7f7aae3ed740 4 client.16191 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.986+0000 7f7aae3ed740 1 -- 172.21.15.33:0/3229124152 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b8a67b070 con 0x555b8a2f4da0 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.986+0000 7f7aa5413640 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555b8a2f4da0 0x555b8a790f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aa5413640 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555b8a2f4da0 0x555b8a790f10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ea1d39dfa113db62 server_cookie=b63bb092b89f0b9c in_seq=0 out_seq=0 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7a897fa640 10 client.16191 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:34:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7a897fa640 1 -- 172.21.15.33:0/3229124152 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b8a67b070 con 0x555b8a2f4da0 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7a897fa640 10 client.16191 handle_command_reply: tid=0 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 client.16191 shutdown 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 -- 172.21.15.33:0/3229124152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 msgr2=0x555b8a725090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a725090 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009de0 tx=0x7f7a9c0ab780 comp rx=0 tx=0).stop 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 -- 172.21.15.33:0/3229124152 shutdown_connections 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555b8a2f4da0 0x555b8a790f10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8a361070 0x555b8a78d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b8a340390 0x555b8a725630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7a897fa640 0 client.16191 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 --2- 172.21.15.33:0/3229124152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8a3381b0 0x555b8a725090 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 -- 172.21.15.33:0/3229124152 >> 172.21.15.33:0/3229124152 conn(0x555b8a355460 msgr2=0x555b8a709410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 -- 172.21.15.33:0/3229124152 shutdown_connections 2024-08-28T19:34:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 1 -- 172.21.15.33:0/3229124152 wait complete. 2024-08-28T19:34:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.987+0000 7f7aae3ed740 20 client.16191 trim_cache size 0 max 16384 2024-08-28T19:34:47.994 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:34:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 -- 172.21.15.33:0/2835017232 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7a8c0b4ca0 msgr2=0x7f7a8c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7a8c0b4ca0 0x7f7a8c0b71b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7a98004af0 tx=0x7f7a98005c30 comp rx=0 tx=0).stop 2024-08-28T19:34:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 -- 172.21.15.33:0/2835017232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa0102820 msgr2=0x7f7aa019a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa0102820 0x7f7aa019a1d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00d950 tx=0x7f7a9c00de10 comp rx=0 tx=0).stop 2024-08-28T19:34:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 -- 172.21.15.33:0/2835017232 shutdown_connections 2024-08-28T19:34:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7a8c0b4ca0 0x7f7a8c0b71b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7aa0108ab0 0x7f7aa019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aa0108160 0x7f7aa019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 --2- 172.21.15.33:0/2835017232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7aa0102820 0x7f7aa019a1d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 -- 172.21.15.33:0/2835017232 >> 172.21.15.33:0/2835017232 conn(0x7f7aa00794e0 msgr2=0x7f7aa0105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 -- 172.21.15.33:0/2835017232 shutdown_connections 2024-08-28T19:34:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:47.988+0000 7f7aa7e78640 1 -- 172.21.15.33:0/2835017232 wait complete. 2024-08-28T19:34:48.827 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:34:49.085 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:49.523 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:49 smithi033 ceph-mon[18549]: pgmap v413: 129 pgs: 129 active+clean; 2.4 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 17 op/s 2024-08-28T19:34:49.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.613+0000 7f5727574640 1 -- 172.21.15.33:0/1827668627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5720103960 msgr2=0x7f5720103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.613+0000 7f5727574640 1 --2- 172.21.15.33:0/1827668627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5720103960 0x7f5720103d70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5718009900 tx=0x7f571802a410 comp rx=0 tx=0).stop 2024-08-28T19:34:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.613+0000 7f5727574640 1 -- 172.21.15.33:0/1827668627 shutdown_connections 2024-08-28T19:34:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.613+0000 7f5727574640 1 --2- 172.21.15.33:0/1827668627 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5720109ba0 0x7f57201103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.613+0000 7f5727574640 1 --2- 172.21.15.33:0/1827668627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5720109250 0x7f5720109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.613+0000 7f5727574640 1 --2- 172.21.15.33:0/1827668627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5720103960 0x7f5720103d70 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.613+0000 7f5727574640 1 -- 172.21.15.33:0/1827668627 >> 172.21.15.33:0/1827668627 conn(0x7f572007b6b0 msgr2=0x7f572007bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.613+0000 7f5727574640 1 -- 172.21.15.33:0/1827668627 shutdown_connections 2024-08-28T19:34:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.613+0000 7f5727574640 1 -- 172.21.15.33:0/1827668627 wait complete. 2024-08-28T19:34:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5727574640 1 Processor -- start 2024-08-28T19:34:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5727574640 1 -- start start 2024-08-28T19:34:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5727574640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5720103960 0x7f572019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5727574640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5720109250 0x7f572019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5727574640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5720109ba0 0x7f57201a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5727574640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f57201138c0 con 0x7f5720103960 2024-08-28T19:34:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5727574640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5720113740 con 0x7f5720109250 2024-08-28T19:34:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5727574640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5720113a40 con 0x7f5720109ba0 2024-08-28T19:34:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5725310640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5720103960 0x7f572019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5725310640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5720103960 0x7f572019c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45092/0 (socket says 172.21.15.33:45092) 2024-08-28T19:34:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.614+0000 7f5725310640 1 -- 172.21.15.33:0/2703420699 learned_addr learned my addr 172.21.15.33:0/2703420699 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:49.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f5724b0f640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5720109250 0x7f572019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f5725b11640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5720109ba0 0x7f57201a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f5725310640 1 -- 172.21.15.33:0/2703420699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5720109ba0 msgr2=0x7f57201a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f5725310640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5720109ba0 0x7f57201a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f5725310640 1 -- 172.21.15.33:0/2703420699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5720109250 msgr2=0x7f572019cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f5725310640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5720109250 0x7f572019cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f5725310640 1 -- 172.21.15.33:0/2703420699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57201a2480 con 0x7f5720103960 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f5725310640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5720103960 0x7f572019c510 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5718005940 tx=0x7f57180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f571e7fc640 1 -- 172.21.15.33:0/2703420699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571803f030 con 0x7f5720103960 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f571e7fc640 1 -- 172.21.15.33:0/2703420699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5718003cb0 con 0x7f5720103960 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f5727574640 1 -- 172.21.15.33:0/2703420699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57201a2710 con 0x7f5720103960 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f571e7fc640 1 -- 172.21.15.33:0/2703420699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718035070 con 0x7f5720103960 2024-08-28T19:34:49.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.615+0000 7f5727574640 1 -- 172.21.15.33:0/2703420699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57201a8ed0 con 0x7f5720103960 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f572dae9740 1 Processor -- start 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f572dae9740 1 -- start start 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f571e7fc640 1 -- 172.21.15.33:0/2703420699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5718042030 con 0x7f5720103960 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f572dae9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed3a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f572dae9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e96c1b0 0x56496ed3a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f572dae9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed3ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f572dae9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56496ecb1680 con 0x56496e995070 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f572dae9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56496eca0c10 con 0x56496e96c1b0 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f572dae9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56496eca4bc0 con 0x56496e974390 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f5725b11640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed3a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f5725b11640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed3a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45102/0 (socket says 172.21.15.33:45102) 2024-08-28T19:34:49.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.618+0000 7f5725b11640 1 -- 172.21.15.33:0/924275560 learned_addr learned my addr 172.21.15.33:0/924275560 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f5724b0f640 1 --2- 172.21.15.33:0/924275560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed3ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f5725310640 1 --2- 172.21.15.33:0/924275560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e96c1b0 0x56496ed3a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f5725b11640 1 -- 172.21.15.33:0/924275560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 msgr2=0x56496ed3ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f5725b11640 1 --2- 172.21.15.33:0/924275560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed3ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f5725b11640 1 -- 172.21.15.33:0/924275560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e96c1b0 msgr2=0x56496ed3a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f5725b11640 1 --2- 172.21.15.33:0/924275560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e96c1b0 0x56496ed3a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f5725b11640 1 -- 172.21.15.33:0/924275560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56496ea00650 con 0x56496e995070 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f571e7fc640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57080b4d20 0x7f57080b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f5725b11640 1 --2- 172.21.15.33:0/924275560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed3a310 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5710009f20 tx=0x7f571000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8fb87996f42e6e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f5725310640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57080b4d20 0x7f57080b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f57077fe640 1 -- 172.21.15.33:0/924275560 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571001a070 con 0x56496e995070 2024-08-28T19:34:49.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f57077fe640 1 -- 172.21.15.33:0/924275560 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57100158c0 con 0x56496e995070 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f57077fe640 1 -- 172.21.15.33:0/924275560 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571000a7e0 con 0x56496e995070 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.619+0000 7f571e7fc640 1 -- 172.21.15.33:0/2703420699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f57181060d0 con 0x7f5720103960 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.620+0000 7f572dae9740 1 -- 172.21.15.33:0/924275560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 msgr2=0x56496ed3a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.620+0000 7f5725310640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57080b4d20 0x7f57080b7230 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5718103580 tx=0x7f5718109c20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.620+0000 7f572dae9740 1 --2- 172.21.15.33:0/924275560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed3a310 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5710009f20 tx=0x7f571000c8b0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.620+0000 7f572dae9740 1 -- 172.21.15.33:0/924275560 shutdown_connections 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.620+0000 7f572dae9740 1 --2- 172.21.15.33:0/924275560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed3ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.620+0000 7f572dae9740 1 --2- 172.21.15.33:0/924275560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e96c1b0 0x56496ed3a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.620+0000 7f572dae9740 1 --2- 172.21.15.33:0/924275560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed3a310 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.620+0000 7f572dae9740 1 -- 172.21.15.33:0/924275560 >> 172.21.15.33:0/924275560 conn(0x56496e989460 msgr2=0x56496ed38200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.620+0000 7f572dae9740 1 -- 172.21.15.33:0/924275560 shutdown_connections 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.620+0000 7f572dae9740 1 -- 172.21.15.33:0/924275560 wait complete. 2024-08-28T19:34:49.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.621+0000 7f572dae9740 1 -- start start 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.621+0000 7f572dae9740 1 Processor -- start 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.621+0000 7f572dae9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed45a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.621+0000 7f572dae9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed45f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.621+0000 7f572dae9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e995070 0x56496ed51e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.621+0000 7f572dae9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56496eb03700 con 0x56496e96c1b0 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.621+0000 7f572dae9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56496ec27750 con 0x56496e995070 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.621+0000 7f572dae9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56496ed48af0 con 0x56496e974390 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.621+0000 7f572dae9740 10 client.0 _ll_register_callbacks cb 0x56496ec56e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.621+0000 7f5725b11640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed45a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5725b11640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed45a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45118/0 (socket says 172.21.15.33:45118) 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5725b11640 1 -- 172.21.15.33:0/3816428135 learned_addr learned my addr 172.21.15.33:0/3816428135 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:49.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5725b11640 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e995070 0x56496ed51e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5724b0f640 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed45f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5725b11640 1 -- 172.21.15.33:0/3816428135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 msgr2=0x56496ed45f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5725b11640 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed45f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5725b11640 1 -- 172.21.15.33:0/3816428135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e995070 msgr2=0x56496ed51e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5725b11640 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e995070 0x56496ed51e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5725b11640 1 -- 172.21.15.33:0/3816428135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56496ec60900 con 0x56496e96c1b0 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5725b11640 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed45a40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5710004b90 tx=0x7f5710009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d47f6b18a0bec8f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5704ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5704ff9640 1 -- 172.21.15.33:0/3816428135 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710028060 con 0x56496e96c1b0 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f5704ff9640 1 -- 172.21.15.33:0/3816428135 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f571000a790 con 0x56496e96c1b0 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.622+0000 7f572dae9740 1 -- 172.21.15.33:0/3816428135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57100158c0 con 0x56496e96c1b0 2024-08-28T19:34:49.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f5704ff9640 1 -- 172.21.15.33:0/3816428135 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f571001a070 con 0x56496e96c1b0 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f572dae9740 10 client.16203 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f572dae9740 1 -- 172.21.15.33:0/3816428135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56496ed54840 con 0x56496e96c1b0 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f5704ff9640 1 -- 172.21.15.33:0/3816428135 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57100158c0 con 0x56496e96c1b0 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f5704ff9640 1 -- 172.21.15.33:0/3816428135 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5710020960 con 0x56496e96c1b0 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f572dae9740 10 client.16203 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f572dae9740 10 client.16203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f572dae9740 20 client.16203 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f572dae9740 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56496e9539f0 0x56496ed57ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f572dae9740 4 client.16203 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f572dae9740 1 -- 172.21.15.33:0/3816428135 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56496ecb35d0 con 0x56496e9539f0 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.623+0000 7f5724b0f640 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56496e9539f0 0x56496ed57ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.624+0000 7f5704ff9640 10 client.16203 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:34:49.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.624+0000 7f5724b0f640 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56496e9539f0 0x56496ed57ce0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ff929bbfe6181dca server_cookie=a29e738996ef763e in_seq=0 out_seq=0 2024-08-28T19:34:49.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f5704ff9640 1 -- 172.21.15.33:0/3816428135 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56496ecb35d0 con 0x56496e9539f0 2024-08-28T19:34:49.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f5704ff9640 10 client.16203 handle_command_reply: tid=0 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 client.16203 shutdown 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 -- 172.21.15.33:0/3816428135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 msgr2=0x56496ed45a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed45a40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5710004b90 tx=0x7f5710009fb0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 -- 172.21.15.33:0/3816428135 shutdown_connections 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e995070 0x56496ed51e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed45f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56496e9539f0 0x56496ed57ce0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 --2- 172.21.15.33:0/3816428135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed45a40 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 -- 172.21.15.33:0/3816428135 >> 172.21.15.33:0/3816428135 conn(0x56496e989460 msgr2=0x56496ed3d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f5704ff9640 0 client.16203 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 -- 172.21.15.33:0/3816428135 shutdown_connections 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 1 -- 172.21.15.33:0/3816428135 wait complete. 2024-08-28T19:34:49.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.625+0000 7f572dae9740 20 client.16203 trim_cache size 0 max 16384 2024-08-28T19:34:49.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.638+0000 7f572dae9740 1 Processor -- start 2024-08-28T19:34:49.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.638+0000 7f572dae9740 1 -- start start 2024-08-28T19:34:49.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f572dae9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e96c1b0 0x56496ed3db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f572dae9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed51d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f572dae9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed42c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f572dae9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f57201b2e30 con 0x56496e995070 2024-08-28T19:34:49.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f572dae9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f57201b4970 con 0x56496e96c1b0 2024-08-28T19:34:49.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f572dae9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f57201b3500 con 0x56496e974390 2024-08-28T19:34:49.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5725b11640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed42c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5725b11640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed42c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45124/0 (socket says 172.21.15.33:45124) 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5725b11640 1 -- 172.21.15.33:0/529966620 learned_addr learned my addr 172.21.15.33:0/529966620 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5725b11640 1 --2- 172.21.15.33:0/529966620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e96c1b0 0x56496ed3db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5724b0f640 1 --2- 172.21.15.33:0/529966620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed51d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5725b11640 1 -- 172.21.15.33:0/529966620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 msgr2=0x56496ed51d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5725b11640 1 --2- 172.21.15.33:0/529966620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed51d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5725b11640 1 -- 172.21.15.33:0/529966620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e96c1b0 msgr2=0x56496ed3db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5725b11640 1 --2- 172.21.15.33:0/529966620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e96c1b0 0x56496ed3db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5725b11640 1 -- 172.21.15.33:0/529966620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56496ed3e060 con 0x56496e995070 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5724b0f640 1 --2- 172.21.15.33:0/529966620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed51d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5725b11640 1 --2- 172.21.15.33:0/529966620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed42c30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5710009f20 tx=0x7f571000e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a16fbba8d76f8e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5706ffd640 1 -- 172.21.15.33:0/529966620 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710028070 con 0x56496e995070 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5706ffd640 1 -- 172.21.15.33:0/529966620 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5710009ba0 con 0x56496e995070 2024-08-28T19:34:49.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.639+0000 7f5706ffd640 1 -- 172.21.15.33:0/529966620 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710007790 con 0x56496e995070 2024-08-28T19:34:49.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.640+0000 7f572dae9740 1 -- 172.21.15.33:0/529966620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 msgr2=0x56496ed42c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:49.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.640+0000 7f572dae9740 1 --2- 172.21.15.33:0/529966620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed42c30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5710009f20 tx=0x7f571000e040 comp rx=0 tx=0).stop 2024-08-28T19:34:49.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.640+0000 7f572dae9740 1 -- 172.21.15.33:0/529966620 shutdown_connections 2024-08-28T19:34:49.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.640+0000 7f572dae9740 1 --2- 172.21.15.33:0/529966620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e995070 0x56496ed42c30 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.640+0000 7f572dae9740 1 --2- 172.21.15.33:0/529966620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e974390 0x56496ed51d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.640+0000 7f572dae9740 1 --2- 172.21.15.33:0/529966620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e96c1b0 0x56496ed3db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.640+0000 7f572dae9740 1 -- 172.21.15.33:0/529966620 >> 172.21.15.33:0/529966620 conn(0x56496e989460 msgr2=0x56496ed3d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:49.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.640+0000 7f572dae9740 1 -- 172.21.15.33:0/529966620 shutdown_connections 2024-08-28T19:34:49.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.640+0000 7f572dae9740 1 -- 172.21.15.33:0/529966620 wait complete. 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f572dae9740 1 -- start start 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f572dae9740 1 Processor -- start 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f572dae9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed59040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f572dae9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e974390 0x56496ed59580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f572dae9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e995070 0x56496edc1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f572dae9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f57201b42a0 con 0x56496e96c1b0 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f572dae9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f57201b3bd0 con 0x56496e974390 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f572dae9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f57201b0e10 con 0x56496e995070 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f572dae9740 10 client.0 _ll_register_callbacks cb 0x7f5710018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f5725b11640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed59040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f5725b11640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed59040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45134/0 (socket says 172.21.15.33:45134) 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.641+0000 7f5725b11640 1 -- 172.21.15.33:0/3940296537 learned_addr learned my addr 172.21.15.33:0/3940296537 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5724b0f640 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e974390 0x56496ed59580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5725b11640 1 -- 172.21.15.33:0/3940296537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e995070 msgr2=0x56496edc1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5725b11640 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e995070 0x56496edc1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5725b11640 1 -- 172.21.15.33:0/3940296537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e974390 msgr2=0x56496ed59580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5725b11640 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e974390 0x56496ed59580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5725b11640 1 -- 172.21.15.33:0/3940296537 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56496ed59e70 con 0x56496e96c1b0 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5724b0f640 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e974390 0x56496ed59580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5725b11640 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed59040 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f57100098f0 tx=0x7f5710009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29a524a98baad6d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5704ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5704ff9640 1 -- 172.21.15.33:0/3940296537 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710028050 con 0x56496e96c1b0 2024-08-28T19:34:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5704ff9640 1 -- 172.21.15.33:0/3940296537 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f571000a9a0 con 0x56496e96c1b0 2024-08-28T19:34:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f572dae9740 1 -- 172.21.15.33:0/3940296537 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56496ecaf070 con 0x56496e96c1b0 2024-08-28T19:34:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f5704ff9640 1 -- 172.21.15.33:0/3940296537 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5710049050 con 0x56496e96c1b0 2024-08-28T19:34:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f572dae9740 10 client.16209 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.642+0000 7f572dae9740 1 -- 172.21.15.33:0/3940296537 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56496edc2a90 con 0x56496e96c1b0 2024-08-28T19:34:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f5704ff9640 1 -- 172.21.15.33:0/3940296537 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56496ecaf070 con 0x56496e96c1b0 2024-08-28T19:34:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f5704ff9640 1 -- 172.21.15.33:0/3940296537 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f57100203c0 con 0x56496e96c1b0 2024-08-28T19:34:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f572dae9740 10 client.16209 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f572dae9740 10 client.16209 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:34:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f572dae9740 20 client.16209 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f572dae9740 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56496e928da0 0x56496edc5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f572dae9740 4 client.16209 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f572dae9740 1 -- 172.21.15.33:0/3940296537 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56496ecac7b0 con 0x56496e928da0 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f5724b0f640 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56496e928da0 0x56496edc5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f5704ff9640 10 client.16209 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.643+0000 7f5724b0f640 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56496e928da0 0x56496edc5280 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f39edf78b84c150 server_cookie=32f9b5bd042ef738 in_seq=0 out_seq=0 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f5704ff9640 1 -- 172.21.15.33:0/3940296537 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56496ecac7b0 con 0x56496e928da0 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f5704ff9640 10 client.16209 handle_command_reply: tid=0 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 client.16209 shutdown 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 -- 172.21.15.33:0/3940296537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 msgr2=0x56496ed59040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed59040 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f57100098f0 tx=0x7f5710009470 comp rx=0 tx=0).stop 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 -- 172.21.15.33:0/3940296537 shutdown_connections 2024-08-28T19:34:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56496e995070 0x56496edc1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56496e974390 0x56496ed59580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56496e928da0 0x56496edc5280 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 --2- 172.21.15.33:0/3940296537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56496e96c1b0 0x56496ed59040 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 -- 172.21.15.33:0/3940296537 >> 172.21.15.33:0/3940296537 conn(0x56496e989460 msgr2=0x56496ed46d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f5704ff9640 0 client.16209 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:34:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 -- 172.21.15.33:0/3940296537 shutdown_connections 2024-08-28T19:34:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 1 -- 172.21.15.33:0/3940296537 wait complete. 2024-08-28T19:34:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.644+0000 7f572dae9740 20 client.16209 trim_cache size 0 max 16384 2024-08-28T19:34:49.653 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:34:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 -- 172.21.15.33:0/2703420699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57080b4d20 msgr2=0x7f57080b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57080b4d20 0x7f57080b7230 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5718103580 tx=0x7f5718109c20 comp rx=0 tx=0).stop 2024-08-28T19:34:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 -- 172.21.15.33:0/2703420699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5720103960 msgr2=0x7f572019c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5720103960 0x7f572019c510 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5718005940 tx=0x7f57180042f0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 -- 172.21.15.33:0/2703420699 shutdown_connections 2024-08-28T19:34:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57080b4d20 0x7f57080b7230 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5720109ba0 0x7f57201a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5720109250 0x7f572019cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 --2- 172.21.15.33:0/2703420699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5720103960 0x7f572019c510 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:49.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 -- 172.21.15.33:0/2703420699 >> 172.21.15.33:0/2703420699 conn(0x7f572007b6b0 msgr2=0x7f5720107160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:49.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 -- 172.21.15.33:0/2703420699 shutdown_connections 2024-08-28T19:34:49.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:49.645+0000 7f5727574640 1 -- 172.21.15.33:0/2703420699 wait complete. 2024-08-28T19:34:49.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:49 smithi059 ceph-mon[22052]: pgmap v413: 129 pgs: 129 active+clean; 2.4 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 17 op/s 2024-08-28T19:34:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:49 smithi122 ceph-mon[22174]: pgmap v413: 129 pgs: 129 active+clean; 2.4 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 17 op/s 2024-08-28T19:34:50.458 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:34:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:51.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.242+0000 7f266c562640 1 -- 172.21.15.33:0/3747699895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2664103900 msgr2=0x7f2664103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.242+0000 7f266c562640 1 --2- 172.21.15.33:0/3747699895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2664103900 0x7f2664103d10 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2660009900 tx=0x7f266002a410 comp rx=0 tx=0).stop 2024-08-28T19:34:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.242+0000 7f266c562640 1 -- 172.21.15.33:0/3747699895 shutdown_connections 2024-08-28T19:34:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.242+0000 7f266c562640 1 --2- 172.21.15.33:0/3747699895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2664109b90 0x7f26641103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.242+0000 7f266c562640 1 --2- 172.21.15.33:0/3747699895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2664109240 0x7f2664109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.242+0000 7f266c562640 1 --2- 172.21.15.33:0/3747699895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2664103900 0x7f2664103d10 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.242+0000 7f266c562640 1 -- 172.21.15.33:0/3747699895 >> 172.21.15.33:0/3747699895 conn(0x7f266407b5f0 msgr2=0x7f266407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.242+0000 7f266c562640 1 -- 172.21.15.33:0/3747699895 shutdown_connections 2024-08-28T19:34:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.242+0000 7f266c562640 1 -- 172.21.15.33:0/3747699895 wait complete. 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.243+0000 7f266c562640 1 Processor -- start 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.243+0000 7f266c562640 1 -- start start 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.243+0000 7f266c562640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2664103900 0x7f266419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.243+0000 7f266c562640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2664109240 0x7f266419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.243+0000 7f266c562640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2664109b90 0x7f266419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.243+0000 7f266c562640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2664113890 con 0x7f2664109b90 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.243+0000 7f266c562640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2664113710 con 0x7f2664109240 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.243+0000 7f266c562640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2664113a10 con 0x7f2664103900 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266aaff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2664109b90 0x7f266419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266aaff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2664109b90 0x7f266419fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45162/0 (socket says 172.21.15.33:45162) 2024-08-28T19:34:51.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266aaff640 1 -- 172.21.15.33:0/1255211346 learned_addr learned my addr 172.21.15.33:0/1255211346 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266a2fe640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2664103900 0x7f266419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f2669afd640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2664109240 0x7f266419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266aaff640 1 -- 172.21.15.33:0/1255211346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2664103900 msgr2=0x7f266419a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266aaff640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2664103900 0x7f266419a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266aaff640 1 -- 172.21.15.33:0/1255211346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2664109240 msgr2=0x7f266419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266aaff640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2664109240 0x7f266419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266aaff640 1 -- 172.21.15.33:0/1255211346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26641a01f0 con 0x7f2664109b90 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f2669afd640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2664109240 0x7f266419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266aaff640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2664109b90 0x7f266419fac0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f265c00eaa0 tx=0x7f265c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f265b7fe640 1 -- 172.21.15.33:0/1255211346 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c00cdb0 con 0x7f2664109b90 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f265b7fe640 1 -- 172.21.15.33:0/1255211346 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f265c005020 con 0x7f2664109b90 2024-08-28T19:34:51.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266c562640 1 -- 172.21.15.33:0/1255211346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26641a04e0 con 0x7f2664109b90 2024-08-28T19:34:51.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f265b7fe640 1 -- 172.21.15.33:0/1255211346 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c0116d0 con 0x7f2664109b90 2024-08-28T19:34:51.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.244+0000 7f266c562640 1 -- 172.21.15.33:0/1255211346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26641a6c40 con 0x7f2664109b90 2024-08-28T19:34:51.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.247+0000 7f2672ad7740 1 Processor -- start 2024-08-28T19:34:51.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.247+0000 7f265b7fe640 1 -- 172.21.15.33:0/1255211346 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f265c0051d0 con 0x7f2664109b90 2024-08-28T19:34:51.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2672ad7740 1 -- start start 2024-08-28T19:34:51.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf83b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf46d1b0 0x559fbf83b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf475390 0x559fbf83bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2672ad7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559fbf7b2680 con 0x559fbf496070 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2672ad7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559fbf7a1c10 con 0x559fbf46d1b0 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2672ad7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fbf7a5bc0 con 0x559fbf475390 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2669afd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf83b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2669afd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf83b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45170/0 (socket says 172.21.15.33:45170) 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2669afd640 1 -- 172.21.15.33:0/229943836 learned_addr learned my addr 172.21.15.33:0/229943836 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f266a2fe640 1 --2- 172.21.15.33:0/229943836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf46d1b0 0x559fbf83b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2669afd640 1 --2- 172.21.15.33:0/229943836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf475390 0x559fbf83bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2669afd640 1 -- 172.21.15.33:0/229943836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf475390 msgr2=0x559fbf83bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2669afd640 1 --2- 172.21.15.33:0/229943836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf475390 0x559fbf83bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2669afd640 1 -- 172.21.15.33:0/229943836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf46d1b0 msgr2=0x559fbf83b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2669afd640 1 --2- 172.21.15.33:0/229943836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf46d1b0 0x559fbf83b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f2669afd640 1 -- 172.21.15.33:0/229943836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fbf501650 con 0x559fbf496070 2024-08-28T19:34:51.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.248+0000 7f265b7fe640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26500b4ca0 0x7f26500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.249+0000 7f2669afd640 1 --2- 172.21.15.33:0/229943836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf83b310 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f265400ac30 tx=0x7f265400a3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f63eda6f580f230 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:51.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.249+0000 7f266a2fe640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26500b4ca0 0x7f26500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.249+0000 7f265b7fe640 1 -- 172.21.15.33:0/1255211346 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f265c0e5a90 con 0x7f2664109b90 2024-08-28T19:34:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.249+0000 7f2658ff9640 1 -- 172.21.15.33:0/229943836 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265400f040 con 0x559fbf496070 2024-08-28T19:34:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.249+0000 7f2658ff9640 1 -- 172.21.15.33:0/229943836 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2654019070 con 0x559fbf496070 2024-08-28T19:34:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.249+0000 7f2658ff9640 1 -- 172.21.15.33:0/229943836 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26540133a0 con 0x559fbf496070 2024-08-28T19:34:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 -- 172.21.15.33:0/229943836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 msgr2=0x559fbf83b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f266a2fe640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26500b4ca0 0x7f26500b71b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2660031440 tx=0x7f2660032b60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 --2- 172.21.15.33:0/229943836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf83b310 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f265400ac30 tx=0x7f265400a3b0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 -- 172.21.15.33:0/229943836 shutdown_connections 2024-08-28T19:34:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 --2- 172.21.15.33:0/229943836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf475390 0x559fbf83bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 --2- 172.21.15.33:0/229943836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf46d1b0 0x559fbf83b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 --2- 172.21.15.33:0/229943836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf83b310 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 -- 172.21.15.33:0/229943836 >> 172.21.15.33:0/229943836 conn(0x559fbf48a460 msgr2=0x559fbf839200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 -- 172.21.15.33:0/229943836 shutdown_connections 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 -- 172.21.15.33:0/229943836 wait complete. 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 -- start start 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.250+0000 7f2672ad7740 1 Processor -- start 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf46d1b0 0x559fbf84ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf84b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf496070 0x559fbf8570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2672ad7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559fbf604700 con 0x559fbf475390 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2672ad7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559fbf728750 con 0x559fbf46d1b0 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2672ad7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fbf84ddc0 con 0x559fbf496070 2024-08-28T19:34:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2672ad7740 10 client.0 _ll_register_callbacks cb 0x559fbf757e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2669afd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf84b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2669afd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf84b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45182/0 (socket says 172.21.15.33:45182) 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2669afd640 1 -- 172.21.15.33:0/1667158641 learned_addr learned my addr 172.21.15.33:0/1667158641 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f266a2fe640 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf46d1b0 0x559fbf84ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f266aaff640 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf496070 0x559fbf8570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2669afd640 1 -- 172.21.15.33:0/1667158641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf496070 msgr2=0x559fbf8570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2669afd640 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf496070 0x559fbf8570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2669afd640 1 -- 172.21.15.33:0/1667158641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf46d1b0 msgr2=0x559fbf84ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2669afd640 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf46d1b0 0x559fbf84ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2669afd640 1 -- 172.21.15.33:0/1667158641 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fbf761900 con 0x559fbf475390 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f2669afd640 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf84b320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2654006d70 tx=0x7f265400a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d651b1cec19dbf2a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.251+0000 7f264dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f264dffb640 1 -- 172.21.15.33:0/1667158641 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2654014440 con 0x559fbf475390 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f264dffb640 1 -- 172.21.15.33:0/1667158641 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f26540145e0 con 0x559fbf475390 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f2672ad7740 1 -- 172.21.15.33:0/1667158641 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2654019070 con 0x559fbf475390 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f264dffb640 1 -- 172.21.15.33:0/1667158641 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f265402f050 con 0x559fbf475390 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f2672ad7740 10 client.16221 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f2672ad7740 1 -- 172.21.15.33:0/1667158641 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559fbf859b10 con 0x559fbf475390 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f264dffb640 1 -- 172.21.15.33:0/1667158641 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2654019070 con 0x559fbf475390 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f264dffb640 1 -- 172.21.15.33:0/1667158641 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2654006590 con 0x559fbf475390 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f2672ad7740 10 client.16221 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f2672ad7740 10 client.16221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f2672ad7740 20 client.16221 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f2672ad7740 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559fbf4549f0 0x559fbf85cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f2672ad7740 4 client.16221 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.252+0000 7f2672ad7740 1 -- 172.21.15.33:0/1667158641 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fbf7b45d0 con 0x559fbf4549f0 2024-08-28T19:34:51.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.253+0000 7f266a2fe640 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559fbf4549f0 0x559fbf85cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.253+0000 7f266a2fe640 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559fbf4549f0 0x559fbf85cf80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ebbab841304649b9 server_cookie=ff8c905f4c86725f in_seq=0 out_seq=0 2024-08-28T19:34:51.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.253+0000 7f264dffb640 10 client.16221 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:34:51.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.254+0000 7f264dffb640 1 -- 172.21.15.33:0/1667158641 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559fbf7b45d0 con 0x559fbf4549f0 2024-08-28T19:34:51.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.254+0000 7f264dffb640 10 client.16221 handle_command_reply: tid=0 2024-08-28T19:34:51.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.254+0000 7f2672ad7740 1 client.16221 shutdown 2024-08-28T19:34:51.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.254+0000 7f2672ad7740 1 -- 172.21.15.33:0/1667158641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 msgr2=0x559fbf84b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:51.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.254+0000 7f2672ad7740 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf84b320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2654006d70 tx=0x7f265400a770 comp rx=0 tx=0).stop 2024-08-28T19:34:51.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.254+0000 7f2672ad7740 1 -- 172.21.15.33:0/1667158641 shutdown_connections 2024-08-28T19:34:51.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.254+0000 7f2672ad7740 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559fbf4549f0 0x559fbf85cf80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.254+0000 7f2672ad7740 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf496070 0x559fbf8570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.255+0000 7f2672ad7740 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf84b320 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.255+0000 7f2672ad7740 1 --2- 172.21.15.33:0/1667158641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf46d1b0 0x559fbf84ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.255+0000 7f2672ad7740 1 -- 172.21.15.33:0/1667158641 >> 172.21.15.33:0/1667158641 conn(0x559fbf48a460 msgr2=0x559fbf8377c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:51.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.255+0000 7f264dffb640 0 client.16221 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:34:51.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.255+0000 7f2672ad7740 1 -- 172.21.15.33:0/1667158641 shutdown_connections 2024-08-28T19:34:51.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.255+0000 7f2672ad7740 1 -- 172.21.15.33:0/1667158641 wait complete. 2024-08-28T19:34:51.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.255+0000 7f2672ad7740 20 client.16221 trim_cache size 0 max 16384 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f2672ad7740 1 Processor -- start 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f2672ad7740 1 -- start start 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 0x559fbf857060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf475390 0x559fbf83ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf847fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f2672ad7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f26641ae9a0 con 0x559fbf496070 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f2672ad7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26641b04e0 con 0x559fbf475390 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f2672ad7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26641af070 con 0x559fbf46d1b0 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f266aaff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf847fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f266aaff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf847fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45186/0 (socket says 172.21.15.33:45186) 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f266aaff640 1 -- 172.21.15.33:0/1704675697 learned_addr learned my addr 172.21.15.33:0/1704675697 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:51.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f266a2fe640 1 --2- 172.21.15.33:0/1704675697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 0x559fbf857060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f266aaff640 1 -- 172.21.15.33:0/1704675697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 msgr2=0x559fbf857060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.268+0000 7f266aaff640 1 --2- 172.21.15.33:0/1704675697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 0x559fbf857060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.269+0000 7f266aaff640 1 -- 172.21.15.33:0/1704675697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf475390 msgr2=0x559fbf83ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.269+0000 7f2669afd640 1 --2- 172.21.15.33:0/1704675697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf475390 0x559fbf83ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.269+0000 7f266aaff640 1 --2- 172.21.15.33:0/1704675697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf475390 0x559fbf83ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.269+0000 7f266aaff640 1 -- 172.21.15.33:0/1704675697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fbf83e120 con 0x559fbf496070 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.269+0000 7f266a2fe640 1 --2- 172.21.15.33:0/1704675697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 0x559fbf857060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.269+0000 7f266aaff640 1 --2- 172.21.15.33:0/1704675697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf847fd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f265c0e2ef0 tx=0x7f265c0abef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd6e4ad172928e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.269+0000 7f264ffff640 1 -- 172.21.15.33:0/1704675697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c01f040 con 0x559fbf496070 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.269+0000 7f264ffff640 1 -- 172.21.15.33:0/1704675697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f265c0a80c0 con 0x559fbf496070 2024-08-28T19:34:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.269+0000 7f264ffff640 1 -- 172.21.15.33:0/1704675697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c0b4f20 con 0x559fbf496070 2024-08-28T19:34:51.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 -- 172.21.15.33:0/1704675697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 msgr2=0x559fbf847fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 --2- 172.21.15.33:0/1704675697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf847fd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f265c0e2ef0 tx=0x7f265c0abef0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 -- 172.21.15.33:0/1704675697 shutdown_connections 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 --2- 172.21.15.33:0/1704675697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf496070 0x559fbf847fd0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 --2- 172.21.15.33:0/1704675697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf475390 0x559fbf83ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 --2- 172.21.15.33:0/1704675697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 0x559fbf857060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 -- 172.21.15.33:0/1704675697 >> 172.21.15.33:0/1704675697 conn(0x559fbf48a460 msgr2=0x559fbf83c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 -- 172.21.15.33:0/1704675697 shutdown_connections 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 -- 172.21.15.33:0/1704675697 wait complete. 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 -- start start 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.270+0000 7f2672ad7740 1 Processor -- start 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 0x559fbf85eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf85f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f2672ad7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf496070 0x559fbf8bf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f2672ad7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f26641afe10 con 0x559fbf475390 2024-08-28T19:34:51.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f2672ad7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26641af740 con 0x559fbf496070 2024-08-28T19:34:51.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f2672ad7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26641ac980 con 0x559fbf46d1b0 2024-08-28T19:34:51.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f2672ad7740 10 client.0 _ll_register_callbacks cb 0x7f2660009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:51.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f266a2fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 0x559fbf85eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f2669afd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf85f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f2669afd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf85f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45188/0 (socket says 172.21.15.33:45188) 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f2669afd640 1 -- 172.21.15.33:0/96601080 learned_addr learned my addr 172.21.15.33:0/96601080 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.271+0000 7f266aaff640 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf496070 0x559fbf8bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.272+0000 7f266a2fe640 1 -- 172.21.15.33:0/96601080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf496070 msgr2=0x559fbf8bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.272+0000 7f266a2fe640 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf496070 0x559fbf8bf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.272+0000 7f266a2fe640 1 -- 172.21.15.33:0/96601080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 msgr2=0x559fbf85f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.272+0000 7f266a2fe640 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf85f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.272+0000 7f266a2fe640 1 -- 172.21.15.33:0/96601080 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fbf8bfda0 con 0x559fbf46d1b0 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.272+0000 7f266aaff640 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf496070 0x559fbf8bf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.273+0000 7f264dffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.273+0000 7f266a2fe640 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 0x559fbf85eb00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2660009230 tx=0x7f2660009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e61078076e3246cb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:51.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.273+0000 7f264dffb640 1 -- 172.21.15.33:0/96601080 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660035040 con 0x559fbf46d1b0 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.273+0000 7f264dffb640 1 -- 172.21.15.33:0/96601080 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2660005240 con 0x559fbf46d1b0 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.273+0000 7f2672ad7740 1 -- 172.21.15.33:0/96601080 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f265c0a80c0 con 0x559fbf46d1b0 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.273+0000 7f264dffb640 1 -- 172.21.15.33:0/96601080 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2660005440 con 0x559fbf46d1b0 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.273+0000 7f2672ad7740 10 client.25681 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.273+0000 7f2672ad7740 1 -- 172.21.15.33:0/96601080 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559fbf8c8250 con 0x559fbf46d1b0 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.274+0000 7f264dffb640 1 -- 172.21.15.33:0/96601080 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f265c0a80c0 con 0x559fbf46d1b0 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.274+0000 7f264dffb640 1 -- 172.21.15.33:0/96601080 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2660059020 con 0x559fbf46d1b0 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.274+0000 7f2672ad7740 10 client.25681 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.274+0000 7f2672ad7740 10 client.25681 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.274+0000 7f2672ad7740 20 client.25681 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.274+0000 7f2672ad7740 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559fbf429da0 0x559fbf8ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.274+0000 7f2672ad7740 4 client.25681 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.274+0000 7f2672ad7740 1 -- 172.21.15.33:0/96601080 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559fbf7b0070 con 0x559fbf429da0 2024-08-28T19:34:51.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.274+0000 7f2669afd640 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559fbf429da0 0x559fbf8ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:51.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2669afd640 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559fbf429da0 0x559fbf8ca9f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b26ceac94fa5074 server_cookie=687561f3c30f9e47 in_seq=0 out_seq=0 2024-08-28T19:34:51.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f264dffb640 10 client.25681 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f264dffb640 1 -- 172.21.15.33:0/96601080 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559fbf7b0070 con 0x559fbf429da0 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f264dffb640 10 client.25681 handle_command_reply: tid=0 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 client.25681 shutdown 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 -- 172.21.15.33:0/96601080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 msgr2=0x559fbf85eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 0x559fbf85eb00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2660009230 tx=0x7f2660009260 comp rx=0 tx=0).stop 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 -- 172.21.15.33:0/96601080 shutdown_connections 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559fbf429da0 0x559fbf8ca9f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fbf496070 0x559fbf8bf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fbf475390 0x559fbf85f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 --2- 172.21.15.33:0/96601080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fbf46d1b0 0x559fbf85eb00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 -- 172.21.15.33:0/96601080 >> 172.21.15.33:0/96601080 conn(0x559fbf48a460 msgr2=0x559fbf83cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f264dffb640 0 client.25681 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:34:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 -- 172.21.15.33:0/96601080 shutdown_connections 2024-08-28T19:34:51.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.275+0000 7f2672ad7740 1 -- 172.21.15.33:0/96601080 wait complete. 2024-08-28T19:34:51.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f2672ad7740 20 client.25681 trim_cache size 0 max 16384 2024-08-28T19:34:51.281 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 -- 172.21.15.33:0/1255211346 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26500b4ca0 msgr2=0x7f26500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26500b4ca0 0x7f26500b71b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2660031440 tx=0x7f2660032b60 comp rx=0 tx=0).stop 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 -- 172.21.15.33:0/1255211346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2664109b90 msgr2=0x7f266419fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2664109b90 0x7f266419fac0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f265c00eaa0 tx=0x7f265c00ef60 comp rx=0 tx=0).stop 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 -- 172.21.15.33:0/1255211346 shutdown_connections 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2664109b90 0x7f266419fac0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2664109240 0x7f266419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26500b4ca0 0x7f26500b71b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 --2- 172.21.15.33:0/1255211346 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2664103900 0x7f266419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 -- 172.21.15.33:0/1255211346 >> 172.21.15.33:0/1255211346 conn(0x7f266407b5f0 msgr2=0x7f26641072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 -- 172.21.15.33:0/1255211346 shutdown_connections 2024-08-28T19:34:51.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:51.276+0000 7f266c562640 1 -- 172.21.15.33:0/1255211346 wait complete. 2024-08-28T19:34:51.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:51 smithi059 ceph-mon[22052]: pgmap v414: 129 pgs: 129 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:51 smithi122 ceph-mon[22174]: pgmap v414: 129 pgs: 129 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:51.850 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:51 smithi033 ceph-mon[18549]: pgmap v414: 129 pgs: 129 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-08-28T19:34:52.081 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:34:52.342 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:52.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.851+0000 7f91e43a4640 1 -- 172.21.15.33:0/3473968382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91dc108b40 msgr2=0x7f91dc10f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:52.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.851+0000 7f91e43a4640 1 --2- 172.21.15.33:0/3473968382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91dc108b40 0x7f91dc10f370 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009ca0 tx=0x7f91d402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.851+0000 7f91e43a4640 1 -- 172.21.15.33:0/3473968382 shutdown_connections 2024-08-28T19:34:52.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.851+0000 7f91e43a4640 1 --2- 172.21.15.33:0/3473968382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91dc108b40 0x7f91dc10f370 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.851+0000 7f91e43a4640 1 --2- 172.21.15.33:0/3473968382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91dc1081f0 0x7f91dc108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.851+0000 7f91e43a4640 1 --2- 172.21.15.33:0/3473968382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91dc1028b0 0x7f91dc102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.851+0000 7f91e43a4640 1 -- 172.21.15.33:0/3473968382 >> 172.21.15.33:0/3473968382 conn(0x7f91dc079470 msgr2=0x7f91dc079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.851+0000 7f91e43a4640 1 -- 172.21.15.33:0/3473968382 shutdown_connections 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.851+0000 7f91e43a4640 1 -- 172.21.15.33:0/3473968382 wait complete. 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.852+0000 7f91e43a4640 1 Processor -- start 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.852+0000 7f91e43a4640 1 -- start start 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e43a4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91dc1028b0 0x7f91dc19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e43a4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91dc1081f0 0x7f91dc19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e43a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91dc108b40 0x7f91dc19faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e43a4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc113920 con 0x7f91dc108b40 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e43a4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc1137a0 con 0x7f91dc1081f0 2024-08-28T19:34:52.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e43a4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc113aa0 con 0x7f91dc1028b0 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e2941640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91dc108b40 0x7f91dc19faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e2941640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91dc108b40 0x7f91dc19faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45208/0 (socket says 172.21.15.33:45208) 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e2941640 1 -- 172.21.15.33:0/3289141127 learned_addr learned my addr 172.21.15.33:0/3289141127 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e193f640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91dc1081f0 0x7f91dc19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e2140640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91dc1028b0 0x7f91dc19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e2941640 1 -- 172.21.15.33:0/3289141127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91dc1028b0 msgr2=0x7f91dc19a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e2941640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91dc1028b0 0x7f91dc19a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e2941640 1 -- 172.21.15.33:0/3289141127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91dc1081f0 msgr2=0x7f91dc19a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e2941640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91dc1081f0 0x7f91dc19a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.853+0000 7f91e2941640 1 -- 172.21.15.33:0/3289141127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91dc1a0220 con 0x7f91dc108b40 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.854+0000 7f91e2941640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91dc108b40 0x7f91dc19faf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f91d4005cc0 tx=0x7f91d402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.854+0000 7f91d37fe640 1 -- 172.21.15.33:0/3289141127 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4003cf0 con 0x7f91dc108b40 2024-08-28T19:34:52.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.854+0000 7f91e43a4640 1 -- 172.21.15.33:0/3289141127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91dc1a04b0 con 0x7f91dc108b40 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.854+0000 7f91d37fe640 1 -- 172.21.15.33:0/3289141127 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91d40044f0 con 0x7f91dc108b40 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.854+0000 7f91d37fe640 1 -- 172.21.15.33:0/3289141127 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d402fd10 con 0x7f91dc108b40 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.854+0000 7f91e43a4640 1 -- 172.21.15.33:0/3289141127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91dc1a6c70 con 0x7f91dc108b40 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.856+0000 7f91ea919740 1 Processor -- start 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.857+0000 7f91d37fe640 1 -- 172.21.15.33:0/3289141127 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f91d4004040 con 0x7f91dc108b40 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.857+0000 7f91ea919740 1 -- start start 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.857+0000 7f91ea919740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 0x564fb2112310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.857+0000 7f91ea919740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2112850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.857+0000 7f91ea919740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2112d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.857+0000 7f91ea919740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564fb2089680 con 0x564fb1d441b0 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.857+0000 7f91ea919740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564fb2078c10 con 0x564fb1d6d070 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.857+0000 7f91ea919740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564fb207cbc0 con 0x564fb1d4c390 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.857+0000 7f91e2140640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2112850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91e2140640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2112850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45216/0 (socket says 172.21.15.33:45216) 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91e2140640 1 -- 172.21.15.33:0/2214665716 learned_addr learned my addr 172.21.15.33:0/2214665716 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91e193f640 1 --2- 172.21.15.33:0/2214665716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 0x564fb2112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91e2140640 1 -- 172.21.15.33:0/2214665716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 msgr2=0x564fb2112d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91e2140640 1 --2- 172.21.15.33:0/2214665716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2112d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91e2140640 1 -- 172.21.15.33:0/2214665716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 msgr2=0x564fb2112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91e2140640 1 --2- 172.21.15.33:0/2214665716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 0x564fb2112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91e2140640 1 -- 172.21.15.33:0/2214665716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb1dd8650 con 0x564fb1d441b0 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91d37fe640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f91c80b4ca0 0x7f91c80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91e2140640 1 --2- 172.21.15.33:0/2214665716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2112850 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f91d800ac20 tx=0x7f91d800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fbbb7ef1b63d078 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91e193f640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f91c80b4ca0 0x7f91c80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91d37fe640 1 -- 172.21.15.33:0/3289141127 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f91d4106e30 con 0x7f91dc108b40 2024-08-28T19:34:52.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91d0d9a640 1 -- 172.21.15.33:0/2214665716 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d801d070 con 0x564fb1d441b0 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91d0d9a640 1 -- 172.21.15.33:0/2214665716 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91d8018af0 con 0x564fb1d441b0 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.858+0000 7f91d0d9a640 1 -- 172.21.15.33:0/2214665716 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8010a40 con 0x564fb1d441b0 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.859+0000 7f91ea919740 1 -- 172.21.15.33:0/2214665716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 msgr2=0x564fb2112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.859+0000 7f91e193f640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f91c80b4ca0 0x7f91c80b71b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f91dc107f30 tx=0x7f91cc012040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.859+0000 7f91ea919740 1 --2- 172.21.15.33:0/2214665716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2112850 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f91d800ac20 tx=0x7f91d800f790 comp rx=0 tx=0).stop 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.859+0000 7f91ea919740 1 -- 172.21.15.33:0/2214665716 shutdown_connections 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.859+0000 7f91ea919740 1 --2- 172.21.15.33:0/2214665716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2112d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.859+0000 7f91ea919740 1 --2- 172.21.15.33:0/2214665716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2112850 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.859+0000 7f91ea919740 1 --2- 172.21.15.33:0/2214665716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 0x564fb2112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.859+0000 7f91ea919740 1 -- 172.21.15.33:0/2214665716 >> 172.21.15.33:0/2214665716 conn(0x564fb1d61460 msgr2=0x564fb2110200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.859+0000 7f91ea919740 1 -- 172.21.15.33:0/2214665716 shutdown_connections 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.859+0000 7f91ea919740 1 -- 172.21.15.33:0/2214665716 wait complete. 2024-08-28T19:34:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91ea919740 1 -- start start 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91ea919740 1 Processor -- start 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91ea919740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb211da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91ea919740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d4c390 0x564fb211dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91ea919740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d6d070 0x564fb2129de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91ea919740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564fb1edb700 con 0x564fb1d441b0 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91ea919740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564fb1fff750 con 0x564fb1d4c390 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91ea919740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564fb2120af0 con 0x564fb1d6d070 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91ea919740 10 client.0 _ll_register_callbacks cb 0x564fb202ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91e2140640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb211da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91e2140640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb211da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45230/0 (socket says 172.21.15.33:45230) 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91e2140640 1 -- 172.21.15.33:0/722458035 learned_addr learned my addr 172.21.15.33:0/722458035 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.860+0000 7f91e193f640 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d4c390 0x564fb211dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91e2140640 1 -- 172.21.15.33:0/722458035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d6d070 msgr2=0x564fb2129de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91e2140640 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d6d070 0x564fb2129de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91e2140640 1 -- 172.21.15.33:0/722458035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d4c390 msgr2=0x564fb211dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91e2140640 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d4c390 0x564fb211dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91e2140640 1 -- 172.21.15.33:0/722458035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb2038900 con 0x564fb1d441b0 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91e2140640 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb211da90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f91d8005e90 tx=0x7f91d80186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6dc5bd83eee5ee server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91c5ffb640 1 -- 172.21.15.33:0/722458035 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d801d050 con 0x564fb1d441b0 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91c5ffb640 1 -- 172.21.15.33:0/722458035 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f91d8005450 con 0x564fb1d441b0 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91ea919740 1 -- 172.21.15.33:0/722458035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91d8018af0 con 0x564fb1d441b0 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91c5ffb640 1 -- 172.21.15.33:0/722458035 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91d8032050 con 0x564fb1d441b0 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91ea919740 10 client.16239 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91ea919740 1 -- 172.21.15.33:0/722458035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564fb212c860 con 0x564fb1d441b0 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.861+0000 7f91c5ffb640 1 -- 172.21.15.33:0/722458035 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91d8018af0 con 0x564fb1d441b0 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.862+0000 7f91c5ffb640 1 -- 172.21.15.33:0/722458035 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f91d80046c0 con 0x564fb1d441b0 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.862+0000 7f91ea919740 10 client.16239 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.862+0000 7f91ea919740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.862+0000 7f91ea919740 20 client.16239 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.862+0000 7f91ea919740 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564fb1d2b9f0 0x564fb212fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.862+0000 7f91ea919740 4 client.16239 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.862+0000 7f91ea919740 1 -- 172.21.15.33:0/722458035 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fb208b5d0 con 0x564fb1d2b9f0 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.862+0000 7f91e193f640 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564fb1d2b9f0 0x564fb212fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.862+0000 7f91e193f640 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564fb1d2b9f0 0x564fb212fc70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=164a2e6b6732c617 server_cookie=43a0be834df566d5 in_seq=0 out_seq=0 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.862+0000 7f91c5ffb640 10 client.16239 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91c5ffb640 1 -- 172.21.15.33:0/722458035 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564fb208b5d0 con 0x564fb1d2b9f0 2024-08-28T19:34:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91c5ffb640 10 client.16239 handle_command_reply: tid=0 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 client.16239 shutdown 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 -- 172.21.15.33:0/722458035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 msgr2=0x564fb211da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb211da90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f91d8005e90 tx=0x7f91d80186f0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 -- 172.21.15.33:0/722458035 shutdown_connections 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d6d070 0x564fb2129de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d4c390 0x564fb211dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564fb1d2b9f0 0x564fb212fc70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 --2- 172.21.15.33:0/722458035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb211da90 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91c5ffb640 0 client.16239 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 -- 172.21.15.33:0/722458035 >> 172.21.15.33:0/722458035 conn(0x564fb1d61460 msgr2=0x564fb21154f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 -- 172.21.15.33:0/722458035 shutdown_connections 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.863+0000 7f91ea919740 1 -- 172.21.15.33:0/722458035 wait complete. 2024-08-28T19:34:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.864+0000 7f91ea919740 20 client.16239 trim_cache size 0 max 16384 2024-08-28T19:34:52.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.877+0000 7f91ea919740 1 Processor -- start 2024-08-28T19:34:52.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.877+0000 7f91ea919740 1 -- start start 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.877+0000 7f91ea919740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2113d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.877+0000 7f91ea919740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2129ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.877+0000 7f91ea919740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 0x564fb211f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.877+0000 7f91ea919740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc1b0b90 con 0x564fb1d441b0 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.877+0000 7f91ea919740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc1b26d0 con 0x564fb1d6d070 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.877+0000 7f91ea919740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc1b1260 con 0x564fb1d4c390 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.877+0000 7f91e2140640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2113d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e2140640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2113d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45242/0 (socket says 172.21.15.33:45242) 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e2140640 1 -- 172.21.15.33:0/4240175887 learned_addr learned my addr 172.21.15.33:0/4240175887 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e193f640 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2129ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e2941640 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 0x564fb211f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e2140640 1 -- 172.21.15.33:0/4240175887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 msgr2=0x564fb2129ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e2140640 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2129ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e2140640 1 -- 172.21.15.33:0/4240175887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 msgr2=0x564fb211f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e2140640 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 0x564fb211f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e2140640 1 -- 172.21.15.33:0/4240175887 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb211ed50 con 0x564fb1d441b0 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e193f640 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2129ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e2941640 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 0x564fb211f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91e2140640 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2113d00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f91d80058c0 tx=0x7f91d800a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da813ad5ca79f47b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91c7fff640 1 -- 172.21.15.33:0/4240175887 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d801d040 con 0x564fb1d441b0 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91c7fff640 1 -- 172.21.15.33:0/4240175887 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91d8029070 con 0x564fb1d441b0 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.878+0000 7f91c7fff640 1 -- 172.21.15.33:0/4240175887 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80054b0 con 0x564fb1d441b0 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.879+0000 7f91ea919740 1 -- 172.21.15.33:0/4240175887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 msgr2=0x564fb2113d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.879+0000 7f91ea919740 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2113d00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f91d80058c0 tx=0x7f91d800a940 comp rx=0 tx=0).stop 2024-08-28T19:34:52.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.879+0000 7f91ea919740 1 -- 172.21.15.33:0/4240175887 shutdown_connections 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.879+0000 7f91ea919740 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d6d070 0x564fb211f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.879+0000 7f91ea919740 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2129ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.879+0000 7f91ea919740 1 --2- 172.21.15.33:0/4240175887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d441b0 0x564fb2113d00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.879+0000 7f91ea919740 1 -- 172.21.15.33:0/4240175887 >> 172.21.15.33:0/4240175887 conn(0x564fb1d61460 msgr2=0x564fb211efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.879+0000 7f91ea919740 1 -- 172.21.15.33:0/4240175887 shutdown_connections 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.879+0000 7f91ea919740 1 -- 172.21.15.33:0/4240175887 wait complete. 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.879+0000 7f91ea919740 1 -- start start 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91ea919740 1 Processor -- start 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91ea919740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d441b0 0x564fb2124040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91ea919740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2124580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91ea919740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d6d070 0x564fb2199420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91ea919740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc1b2000 con 0x564fb1d6d070 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91ea919740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc1b1930 con 0x564fb1d441b0 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91ea919740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc1aeb70 con 0x564fb1d4c390 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91ea919740 10 client.0 _ll_register_callbacks cb 0x7f91d801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e2941640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d6d070 0x564fb2199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e2941640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d6d070 0x564fb2199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45258/0 (socket says 172.21.15.33:45258) 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e2941640 1 -- 172.21.15.33:0/2610058550 learned_addr learned my addr 172.21.15.33:0/2610058550 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e2140640 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d441b0 0x564fb2124040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e193f640 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2124580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e2941640 1 -- 172.21.15.33:0/2610058550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 msgr2=0x564fb2124580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e2941640 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2124580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e2941640 1 -- 172.21.15.33:0/2610058550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d441b0 msgr2=0x564fb2124040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e2941640 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d441b0 0x564fb2124040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e2941640 1 -- 172.21.15.33:0/2610058550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb2124e20 con 0x564fb1d6d070 2024-08-28T19:34:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91e2941640 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d6d070 0x564fb2199420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f91d40ca440 tx=0x7f91d4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b081e3457ceec3d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.880+0000 7f91c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91c5ffb640 1 -- 172.21.15.33:0/2610058550 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d402f660 con 0x564fb1d6d070 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91c5ffb640 1 -- 172.21.15.33:0/2610058550 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f91d40c9460 con 0x564fb1d6d070 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91ea919740 1 -- 172.21.15.33:0/2610058550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91d8029070 con 0x564fb1d6d070 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91c5ffb640 1 -- 172.21.15.33:0/2610058550 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91d40ccce0 con 0x564fb1d6d070 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91ea919740 10 client.16245 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91ea919740 1 -- 172.21.15.33:0/2610058550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564fb219a8f0 con 0x564fb1d6d070 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91c5ffb640 1 -- 172.21.15.33:0/2610058550 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91d8029070 con 0x564fb1d6d070 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91c5ffb640 1 -- 172.21.15.33:0/2610058550 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f91d40d6060 con 0x564fb1d6d070 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91ea919740 10 client.16245 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91ea919740 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91ea919740 20 client.16245 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91ea919740 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564fb1d00da0 0x564fb219d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:52.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91ea919740 4 client.16245 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:34:52.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.881+0000 7f91ea919740 1 -- 172.21.15.33:0/2610058550 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564fb2087070 con 0x564fb1d00da0 2024-08-28T19:34:52.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91e2140640 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564fb1d00da0 0x564fb219d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:52.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91c5ffb640 10 client.16245 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:52.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91e2140640 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564fb1d00da0 0x564fb219d020 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a386e8134dc3836b server_cookie=d76f74bd4ef824c0 in_seq=0 out_seq=0 2024-08-28T19:34:52.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91c5ffb640 1 -- 172.21.15.33:0/2610058550 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564fb2087070 con 0x564fb1d00da0 2024-08-28T19:34:52.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91c5ffb640 10 client.16245 handle_command_reply: tid=0 2024-08-28T19:34:52.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91ea919740 1 client.16245 shutdown 2024-08-28T19:34:52.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91ea919740 1 -- 172.21.15.33:0/2610058550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d6d070 msgr2=0x564fb2199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:52.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91ea919740 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d6d070 0x564fb2199420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f91d40ca440 tx=0x7f91d4004470 comp rx=0 tx=0).stop 2024-08-28T19:34:52.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91ea919740 1 -- 172.21.15.33:0/2610058550 shutdown_connections 2024-08-28T19:34:52.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91ea919740 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564fb1d00da0 0x564fb219d020 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91ea919740 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564fb1d6d070 0x564fb2199420 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91ea919740 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564fb1d4c390 0x564fb2124580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91c5ffb640 0 client.16245 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91ea919740 1 --2- 172.21.15.33:0/2610058550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564fb1d441b0 0x564fb2124040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.882+0000 7f91ea919740 1 -- 172.21.15.33:0/2610058550 >> 172.21.15.33:0/2610058550 conn(0x564fb1d61460 msgr2=0x564fb2113ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91ea919740 1 -- 172.21.15.33:0/2610058550 shutdown_connections 2024-08-28T19:34:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91ea919740 1 -- 172.21.15.33:0/2610058550 wait complete. 2024-08-28T19:34:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91ea919740 20 client.16245 trim_cache size 0 max 16384 2024-08-28T19:34:52.891 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:34:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 -- 172.21.15.33:0/3289141127 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f91c80b4ca0 msgr2=0x7f91c80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f91c80b4ca0 0x7f91c80b71b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f91dc107f30 tx=0x7f91cc012040 comp rx=0 tx=0).stop 2024-08-28T19:34:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 -- 172.21.15.33:0/3289141127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91dc108b40 msgr2=0x7f91dc19faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91dc108b40 0x7f91dc19faf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f91d4005cc0 tx=0x7f91d402f470 comp rx=0 tx=0).stop 2024-08-28T19:34:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 -- 172.21.15.33:0/3289141127 shutdown_connections 2024-08-28T19:34:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91dc108b40 0x7f91dc19faf0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91dc1081f0 0x7f91dc19a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f91c80b4ca0 0x7f91c80b71b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 --2- 172.21.15.33:0/3289141127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f91dc1028b0 0x7f91dc19a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:52.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 -- 172.21.15.33:0/3289141127 >> 172.21.15.33:0/3289141127 conn(0x7f91dc079470 msgr2=0x7f91dc106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 -- 172.21.15.33:0/3289141127 shutdown_connections 2024-08-28T19:34:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:52.883+0000 7f91e43a4640 1 -- 172.21.15.33:0/3289141127 wait complete. 2024-08-28T19:34:53.108 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.6 2024-08-28T19:34:53.108 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:34:53.371 INFO:tasks.workunit.client.0.smithi033.stdout:1/600: open fd = 3 2024-08-28T19:34:53.371 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:2/600: open fd = 3 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:3/600: open fd = 3 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:4/600: open fd = 3 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.372 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:5/600: open fd = 3 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:6/600: open fd = 3 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:7/600: open fd = 3 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.373 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:8/600: open fd = 3 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:9/600: open fd = 3 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:10/600: open fd = 3 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.374 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:11/600: open fd = 3 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:12/600: open fd = 3 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:13/600: open fd = 3 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:14/600: open fd = 3 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.375 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:15/600: open fd = 3 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:16/600: open fd = 3 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:17/600: open fd = 3 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.376 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:18/600: open fd = 3 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:19/600: open fd = 3 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:20/600: open fd = 3 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.377 INFO:tasks.workunit.client.0.smithi033.stdout:21/600: open fd = 3 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:22/600: open fd = 3 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:23/600: open fd = 3 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:24/600: open fd = 3 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.378 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:25/600: open fd = 3 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:26/600: open fd = 3 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:27/600: open fd = 3 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:28/600: open fd = 3 2024-08-28T19:34:53.379 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:29/600: open fd = 3 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:30/600: open fd = 3 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:31/600: open fd = 3 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.380 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:32/600: open fd = 3 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:33/600: open fd = 3 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:34/600: open fd = 3 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.381 INFO:tasks.workunit.client.0.smithi033.stdout:35/600: open fd = 3 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:36/600: open fd = 3 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:37/600: open fd = 3 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:38/600: open fd = 3 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.382 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:39/600: open fd = 3 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:40/600: open fd = 3 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:41/600: open fd = 3 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.383 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:42/600: open fd = 3 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:43/600: open fd = 3 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:44/600: open fd = 3 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.384 INFO:tasks.workunit.client.0.smithi033.stdout:45/600: open fd = 3 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:46/600: open fd = 3 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:47/600: open fd = 3 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.385 INFO:tasks.workunit.client.0.smithi033.stdout:48/600: open fd = 3 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:49/600: open fd = 3 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:50/600: open fd = 3 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:51/600: open fd = 3 2024-08-28T19:34:53.386 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:52/600: open fd = 3 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:53/600: open fd = 3 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:54/600: open fd = 3 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.387 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:55/600: open fd = 3 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:56/600: open fd = 3 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:57/600: open fd = 3 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.388 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:58/600: open fd = 3 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:59/600: open fd = 3 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:60/600: open fd = 3 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.389 INFO:tasks.workunit.client.0.smithi033.stdout:61/600: open fd = 3 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:62/600: open fd = 3 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:63/600: open fd = 3 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:34:53.390 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:34:53.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:53 smithi033 ceph-mon[18549]: pgmap v415: 129 pgs: 129 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-08-28T19:34:53.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:34:53.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:53 smithi059 ceph-mon[22052]: pgmap v415: 129 pgs: 129 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-08-28T19:34:53.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:34:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:53 smithi122 ceph-mon[22174]: pgmap v415: 129 pgs: 129 active+clean; 2.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-08-28T19:34:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:34:53.835 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.343+0000 7fd89abe7640 1 -- 172.21.15.33:0/1680505714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8941050e0 msgr2=0x7fd89410d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.343+0000 7fd89abe7640 1 --2- 172.21.15.33:0/1680505714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8941050e0 0x7fd89410d630 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd880009900 tx=0x7fd88002a410 comp rx=0 tx=0).stop 2024-08-28T19:34:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.343+0000 7fd89abe7640 1 -- 172.21.15.33:0/1680505714 shutdown_connections 2024-08-28T19:34:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.343+0000 7fd89abe7640 1 --2- 172.21.15.33:0/1680505714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd89410dbf0 0x7fd8941100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.343+0000 7fd89abe7640 1 --2- 172.21.15.33:0/1680505714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8941050e0 0x7fd89410d630 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.343+0000 7fd89abe7640 1 --2- 172.21.15.33:0/1680505714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd894104790 0x7fd894104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.343+0000 7fd89abe7640 1 -- 172.21.15.33:0/1680505714 >> 172.21.15.33:0/1680505714 conn(0x7fd894079580 msgr2=0x7fd894079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.343+0000 7fd89abe7640 1 -- 172.21.15.33:0/1680505714 shutdown_connections 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.343+0000 7fd89abe7640 1 -- 172.21.15.33:0/1680505714 wait complete. 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.343+0000 7fd89abe7640 1 Processor -- start 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd89abe7640 1 -- start start 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd89abe7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894104790 0x7fd89419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd89abe7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8941050e0 0x7fd89419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd89abe7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd89410dbf0 0x7fd89419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd89abe7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd894113850 con 0x7fd89410dbf0 2024-08-28T19:34:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd89abe7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8941136d0 con 0x7fd894104790 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd89abe7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd8941139d0 con 0x7fd8941050e0 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd899184640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd89410dbf0 0x7fd89419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd899184640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd89410dbf0 0x7fd89419fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45276/0 (socket says 172.21.15.33:45276) 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd899184640 1 -- 172.21.15.33:0/2600062387 learned_addr learned my addr 172.21.15.33:0/2600062387 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd893fff640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8941050e0 0x7fd89419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd898983640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894104790 0x7fd89419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd899184640 1 -- 172.21.15.33:0/2600062387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8941050e0 msgr2=0x7fd89419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd899184640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8941050e0 0x7fd89419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd899184640 1 -- 172.21.15.33:0/2600062387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894104790 msgr2=0x7fd89419a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd899184640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894104790 0x7fd89419a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.344+0000 7fd899184640 1 -- 172.21.15.33:0/2600062387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8941a0270 con 0x7fd89410dbf0 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.345+0000 7fd899184640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd89410dbf0 0x7fd89419fb40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009fd0 tx=0x7fd88c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.345+0000 7fd891ffb640 1 -- 172.21.15.33:0/2600062387 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c017070 con 0x7fd89410dbf0 2024-08-28T19:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.345+0000 7fd891ffb640 1 -- 172.21.15.33:0/2600062387 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd88c003e20 con 0x7fd89410dbf0 2024-08-28T19:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.345+0000 7fd89abe7640 1 -- 172.21.15.33:0/2600062387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8941a0560 con 0x7fd89410dbf0 2024-08-28T19:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.345+0000 7fd891ffb640 1 -- 172.21.15.33:0/2600062387 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c010460 con 0x7fd89410dbf0 2024-08-28T19:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.345+0000 7fd89abe7640 1 -- 172.21.15.33:0/2600062387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8941a6cc0 con 0x7fd89410dbf0 2024-08-28T19:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.346+0000 7fd89abe7640 1 -- 172.21.15.33:0/2600062387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd894104ba0 con 0x7fd89410dbf0 2024-08-28T19:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.348+0000 7fd891ffb640 1 -- 172.21.15.33:0/2600062387 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd88c003970 con 0x7fd89410dbf0 2024-08-28T19:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.349+0000 7fd891ffb640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8840b4d20 0x7fd8840b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.349+0000 7fd898983640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8840b4d20 0x7fd8840b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.349+0000 7fd891ffb640 1 -- 172.21.15.33:0/2600062387 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd88c0e54e0 con 0x7fd89410dbf0 2024-08-28T19:34:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.349+0000 7fd898983640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8840b4d20 0x7fd8840b7230 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd89406c3c0 tx=0x7fd888005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.353+0000 7fd891ffb640 1 -- 172.21.15.33:0/2600062387 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd88c0ab8d0 con 0x7fd89410dbf0 2024-08-28T19:34:54.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.579+0000 7fd89abe7640 1 -- 172.21.15.33:0/2600062387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd894108cf0 con 0x7fd89410dbf0 2024-08-28T19:34:54.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.580+0000 7fd891ffb640 1 -- 172.21.15.33:0/2600062387 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fd88c0b0090 con 0x7fd89410dbf0 2024-08-28T19:34:54.582 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:34:54.582 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:34:54.583 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:34:54.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.582+0000 7fd89abe7640 1 -- 172.21.15.33:0/2600062387 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8840b4d20 msgr2=0x7fd8840b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.582+0000 7fd89abe7640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8840b4d20 0x7fd8840b7230 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd89406c3c0 tx=0x7fd888005f90 comp rx=0 tx=0).stop 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.582+0000 7fd89abe7640 1 -- 172.21.15.33:0/2600062387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd89410dbf0 msgr2=0x7fd89419fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.582+0000 7fd89abe7640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd89410dbf0 0x7fd89419fb40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009fd0 tx=0x7fd88c00b260 comp rx=0 tx=0).stop 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.583+0000 7fd89abe7640 1 -- 172.21.15.33:0/2600062387 shutdown_connections 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.583+0000 7fd89abe7640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd89410dbf0 0x7fd89419fb40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.583+0000 7fd89abe7640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8840b4d20 0x7fd8840b7230 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.583+0000 7fd89abe7640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8941050e0 0x7fd89419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.583+0000 7fd89abe7640 1 --2- 172.21.15.33:0/2600062387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd894104790 0x7fd89419a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.583+0000 7fd89abe7640 1 -- 172.21.15.33:0/2600062387 >> 172.21.15.33:0/2600062387 conn(0x7fd894079580 msgr2=0x7fd894100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.583+0000 7fd89abe7640 1 -- 172.21.15.33:0/2600062387 shutdown_connections 2024-08-28T19:34:54.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:54.583+0000 7fd89abe7640 1 -- 172.21.15.33:0/2600062387 wait complete. 2024-08-28T19:34:54.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:34:54.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:34:54.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:34:54.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:34:54.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:34:54.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:34:54.805 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:34:54.805 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:34:54.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:34:54.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:34:54.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:34:55.416 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 146.6 --await-for 45.0' 2024-08-28T19:34:55.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 146.6 --await-for 45.0 2024-08-28T19:34:55.499 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:55.661 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:55 smithi033 ceph-mon[18549]: pgmap v416: 129 pgs: 129 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-08-28T19:34:55.661 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:55 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2600062387' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:34:55.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:55 smithi059 ceph-mon[22052]: pgmap v416: 129 pgs: 129 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-08-28T19:34:55.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:55 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2600062387' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:34:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:55 smithi122 ceph-mon[22174]: pgmap v416: 129 pgs: 129 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 18 op/s 2024-08-28T19:34:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:55 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2600062387' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:34:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.007+0000 7f87aca75640 1 -- 172.21.15.33:0/4150829027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a8109260 msgr2=0x7f87a8109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.007+0000 7f87aca75640 1 --2- 172.21.15.33:0/4150829027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a8109260 0x7f87a8109670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f879c009900 tx=0x7f879c02a410 comp rx=0 tx=0).stop 2024-08-28T19:34:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.007+0000 7f87aca75640 1 -- 172.21.15.33:0/4150829027 shutdown_connections 2024-08-28T19:34:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.007+0000 7f87aca75640 1 --2- 172.21.15.33:0/4150829027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a8109bb0 0x7f87a81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.007+0000 7f87aca75640 1 --2- 172.21.15.33:0/4150829027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a8109260 0x7f87a8109670 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.007+0000 7f87aca75640 1 --2- 172.21.15.33:0/4150829027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87a8103920 0x7f87a8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.007+0000 7f87aca75640 1 -- 172.21.15.33:0/4150829027 >> 172.21.15.33:0/4150829027 conn(0x7f87a80ff370 msgr2=0x7f87a81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.007+0000 7f87aca75640 1 -- 172.21.15.33:0/4150829027 shutdown_connections 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.007+0000 7f87aca75640 1 -- 172.21.15.33:0/4150829027 wait complete. 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87aca75640 1 Processor -- start 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87aca75640 1 -- start start 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87aca75640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87a8103920 0x7f87a819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87aca75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a8109260 0x7f87a819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87aca75640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a8109bb0 0x7f87a819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87aca75640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f87a8113870 con 0x7f87a8109260 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87aca75640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81136f0 con 0x7f87a8109bb0 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87aca75640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81139f0 con 0x7f87a8103920 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87a5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a8109260 0x7f87a819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87a5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a8109260 0x7f87a819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45306/0 (socket says 172.21.15.33:45306) 2024-08-28T19:34:56.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87a5d9b640 1 -- 172.21.15.33:0/72142616 learned_addr learned my addr 172.21.15.33:0/72142616 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87a6d9d640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a8109bb0 0x7f87a819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.008+0000 7f87a659c640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87a8103920 0x7f87a819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87a5d9b640 1 -- 172.21.15.33:0/72142616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87a8103920 msgr2=0x7f87a819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87a8103920 0x7f87a819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87a5d9b640 1 -- 172.21.15.33:0/72142616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a8109bb0 msgr2=0x7f87a819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a8109bb0 0x7f87a819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87a5d9b640 1 -- 172.21.15.33:0/72142616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a81a0190 con 0x7f87a8109260 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a8109260 0x7f87a819a7c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f879c02a930 tx=0x7f879c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87977fe640 1 -- 172.21.15.33:0/72142616 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c03f030 con 0x7f87a8109260 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87aca75640 1 -- 172.21.15.33:0/72142616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a81a0420 con 0x7f87a8109260 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87977fe640 1 -- 172.21.15.33:0/72142616 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f879c003aa0 con 0x7f87a8109260 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87977fe640 1 -- 172.21.15.33:0/72142616 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c035070 con 0x7f87a8109260 2024-08-28T19:34:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.009+0000 7f87aca75640 1 -- 172.21.15.33:0/72142616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a81a6be0 con 0x7f87a8109260 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87b2fea740 1 Processor -- start 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87b2fea740 1 -- start start 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87977fe640 1 -- 172.21.15.33:0/72142616 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f879c042030 con 0x7f87a8109260 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2fa0c350 0x55ee2fdb2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 0x55ee2fdb2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2f9eb670 0x55ee2fdb3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87b2fea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ee2fd285f0 con 0x55ee2fa0c350 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87b2fea740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ee2fd17b80 con 0x55ee2f9e3490 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87b2fea740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ee2fd1bb30 con 0x55ee2f9eb670 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87a6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2fa0c350 0x55ee2fdb2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87a6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2fa0c350 0x55ee2fdb2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45322/0 (socket says 172.21.15.33:45322) 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.012+0000 7f87a6d9d640 1 -- 172.21.15.33:0/2304914128 learned_addr learned my addr 172.21.15.33:0/2304914128 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:56.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/2304914128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2f9eb670 0x55ee2fdb3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87a659c640 1 --2- 172.21.15.33:0/2304914128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 0x55ee2fdb2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87a6d9d640 1 -- 172.21.15.33:0/2304914128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2f9eb670 msgr2=0x55ee2fdb3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87a6d9d640 1 --2- 172.21.15.33:0/2304914128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2f9eb670 0x55ee2fdb3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87a6d9d640 1 -- 172.21.15.33:0/2304914128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 msgr2=0x55ee2fdb2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87a6d9d640 1 --2- 172.21.15.33:0/2304914128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 0x55ee2fdb2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87a6d9d640 1 -- 172.21.15.33:0/2304914128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2fa77930 con 0x55ee2fa0c350 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87a6d9d640 1 --2- 172.21.15.33:0/2304914128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2fa0c350 0x55ee2fdb2780 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f87a0010370 tx=0x7f87a0010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128c7c77404d75b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87977fe640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87900b4ca0 0x7f87900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f8794ff9640 1 -- 172.21.15.33:0/2304914128 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0016070 con 0x55ee2fa0c350 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f8794ff9640 1 -- 172.21.15.33:0/2304914128 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87a0004d20 con 0x55ee2fa0c350 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f8794ff9640 1 -- 172.21.15.33:0/2304914128 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0012810 con 0x55ee2fa0c350 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87a659c640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87900b4ca0 0x7f87900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.013+0000 7f87977fe640 1 -- 172.21.15.33:0/72142616 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f879c105ff0 con 0x7f87a8109260 2024-08-28T19:34:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.014+0000 7f87b2fea740 1 -- 172.21.15.33:0/2304914128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2fa0c350 msgr2=0x55ee2fdb2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.014+0000 7f87a659c640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87900b4ca0 0x7f87900b71b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55ee2fdb1400 tx=0x7f879800c430 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.014+0000 7f87b2fea740 1 --2- 172.21.15.33:0/2304914128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2fa0c350 0x55ee2fdb2780 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f87a0010370 tx=0x7f87a0010830 comp rx=0 tx=0).stop 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.014+0000 7f87b2fea740 1 -- 172.21.15.33:0/2304914128 shutdown_connections 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.014+0000 7f87b2fea740 1 --2- 172.21.15.33:0/2304914128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2f9eb670 0x55ee2fdb3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.014+0000 7f87b2fea740 1 --2- 172.21.15.33:0/2304914128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 0x55ee2fdb2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.014+0000 7f87b2fea740 1 --2- 172.21.15.33:0/2304914128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2fa0c350 0x55ee2fdb2780 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.014+0000 7f87b2fea740 1 -- 172.21.15.33:0/2304914128 >> 172.21.15.33:0/2304914128 conn(0x55ee2fa00740 msgr2=0x55ee2fdb0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.014+0000 7f87b2fea740 1 -- 172.21.15.33:0/2304914128 shutdown_connections 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87b2fea740 1 -- 172.21.15.33:0/2304914128 wait complete. 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87b2fea740 1 -- start start 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87b2fea740 1 Processor -- start 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9eb670 0x55ee2fdc2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87b2fea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ee2fb7a890 con 0x55ee2f9e3490 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87b2fea740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ee2fc9e790 con 0x55ee2f9eb670 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87b2fea740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ee2fdc52c0 con 0x55ee2fa0c350 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87b2fea740 10 client.0 _ll_register_callbacks cb 0x55ee2fa23ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87a659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87a659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45336/0 (socket says 172.21.15.33:45336) 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.015+0000 7f87a659c640 1 -- 172.21.15.33:0/2115795866 learned_addr learned my addr 172.21.15.33:0/2115795866 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9eb670 0x55ee2fdc2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87a6d9d640 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87a659c640 1 -- 172.21.15.33:0/2115795866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 msgr2=0x55ee2fdce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87a659c640 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87a659c640 1 -- 172.21.15.33:0/2115795866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9eb670 msgr2=0x55ee2fdc2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87a659c640 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9eb670 0x55ee2fdc2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87a659c640 1 -- 172.21.15.33:0/2115795866 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2fcd5f30 con 0x55ee2f9e3490 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87a659c640 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc2330 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f879801cd40 tx=0x7f87980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbecb27ff1c5e6f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f878dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f878dffb640 1 -- 172.21.15.33:0/2115795866 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879800ce80 con 0x55ee2f9e3490 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f878dffb640 1 -- 172.21.15.33:0/2115795866 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f879800ed40 con 0x55ee2f9e3490 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87b2fea740 1 -- 172.21.15.33:0/2115795866 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87a0004d20 con 0x55ee2f9e3490 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f878dffb640 1 -- 172.21.15.33:0/2115795866 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f879802f050 con 0x55ee2f9e3490 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87b2fea740 10 client.16263 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.016+0000 7f87b2fea740 1 -- 172.21.15.33:0/2115795866 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ee2fdd1160 con 0x55ee2f9e3490 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f878dffb640 1 -- 172.21.15.33:0/2115795866 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87a0004d20 con 0x55ee2f9e3490 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f878dffb640 1 -- 172.21.15.33:0/2115795866 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8798018040 con 0x55ee2f9e3490 2024-08-28T19:34:56.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f87b2fea740 10 client.16263 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f87b2fea740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f87b2fea740 20 client.16263 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f87b2fea740 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ee2f9cacd0 0x55ee2fdd4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f87b2fea740 4 client.16263 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f87b2fea740 1 -- 172.21.15.33:0/2115795866 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee2fd2a540 con 0x55ee2f9cacd0 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ee2f9cacd0 0x55ee2fdd4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f878dffb640 10 client.16263 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.017+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ee2f9cacd0 0x55ee2fdd4750 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae0217b25ebdf0c7 server_cookie=c9bee2aeff307304 in_seq=0 out_seq=0 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f878dffb640 1 -- 172.21.15.33:0/2115795866 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee2fd2a540 con 0x55ee2f9cacd0 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f878dffb640 10 client.16263 handle_command_reply: tid=0 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f87b2fea740 1 client.16263 shutdown 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f87b2fea740 1 -- 172.21.15.33:0/2115795866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 msgr2=0x55ee2fdc2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f87b2fea740 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc2330 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f879801cd40 tx=0x7f87980046c0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f87b2fea740 1 -- 172.21.15.33:0/2115795866 shutdown_connections 2024-08-28T19:34:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f87b2fea740 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f87b2fea740 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9eb670 0x55ee2fdc2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f87b2fea740 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ee2f9cacd0 0x55ee2fdd4750 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f87b2fea740 1 --2- 172.21.15.33:0/2115795866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc2330 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f878dffb640 0 client.16263 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.018+0000 7f87b2fea740 1 -- 172.21.15.33:0/2115795866 >> 172.21.15.33:0/2115795866 conn(0x55ee2fa00740 msgr2=0x55ee2fdaec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.019+0000 7f87b2fea740 1 -- 172.21.15.33:0/2115795866 shutdown_connections 2024-08-28T19:34:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.019+0000 7f87b2fea740 1 -- 172.21.15.33:0/2115795866 wait complete. 2024-08-28T19:34:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.019+0000 7f87b2fea740 20 client.16263 trim_cache size 0 max 16384 2024-08-28T19:34:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.037+0000 7f87b2fea740 1 Processor -- start 2024-08-28T19:34:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.037+0000 7f87b2fea740 1 -- start start 2024-08-28T19:34:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9eb670 0x55ee2fdce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdbf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87b2fea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81ae8e0 con 0x55ee2f9e3490 2024-08-28T19:34:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87b2fea740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81b0420 con 0x55ee2f9eb670 2024-08-28T19:34:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87b2fea740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81aefb0 con 0x55ee2fa0c350 2024-08-28T19:34:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87a659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87a659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45348/0 (socket says 172.21.15.33:45348) 2024-08-28T19:34:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87a659c640 1 -- 172.21.15.33:0/1562374918 learned_addr learned my addr 172.21.15.33:0/1562374918 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87a6d9d640 1 --2- 172.21.15.33:0/1562374918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdbf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/1562374918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9eb670 0x55ee2fdce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87a659c640 1 -- 172.21.15.33:0/1562374918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 msgr2=0x55ee2fdbf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87a659c640 1 --2- 172.21.15.33:0/1562374918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdbf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87a659c640 1 -- 172.21.15.33:0/1562374918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9eb670 msgr2=0x55ee2fdce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87a659c640 1 --2- 172.21.15.33:0/1562374918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9eb670 0x55ee2fdce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.038+0000 7f87a659c640 1 -- 172.21.15.33:0/1562374918 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2fdc35f0 con 0x55ee2f9e3490 2024-08-28T19:34:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.039+0000 7f87a659c640 1 --2- 172.21.15.33:0/1562374918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc3ec0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8798016040 tx=0x7f8798004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292db6794b975783 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.039+0000 7f878ffff640 1 -- 172.21.15.33:0/1562374918 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798011d70 con 0x55ee2f9e3490 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.039+0000 7f878ffff640 1 -- 172.21.15.33:0/1562374918 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f879800ec10 con 0x55ee2f9e3490 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.039+0000 7f878ffff640 1 -- 172.21.15.33:0/1562374918 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87980039c0 con 0x55ee2f9e3490 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.040+0000 7f87b2fea740 1 -- 172.21.15.33:0/1562374918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 msgr2=0x55ee2fdc3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.040+0000 7f87b2fea740 1 --2- 172.21.15.33:0/1562374918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc3ec0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8798016040 tx=0x7f8798004730 comp rx=0 tx=0).stop 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.040+0000 7f87b2fea740 1 -- 172.21.15.33:0/1562374918 shutdown_connections 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.040+0000 7f87b2fea740 1 --2- 172.21.15.33:0/1562374918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdbf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.040+0000 7f87b2fea740 1 --2- 172.21.15.33:0/1562374918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9eb670 0x55ee2fdce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.040+0000 7f87b2fea740 1 --2- 172.21.15.33:0/1562374918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9e3490 0x55ee2fdc3ec0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.040+0000 7f87b2fea740 1 -- 172.21.15.33:0/1562374918 >> 172.21.15.33:0/1562374918 conn(0x55ee2fa00740 msgr2=0x55ee2fdb4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.040+0000 7f87b2fea740 1 -- 172.21.15.33:0/1562374918 shutdown_connections 2024-08-28T19:34:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.040+0000 7f87b2fea740 1 -- 172.21.15.33:0/1562374918 wait complete. 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.041+0000 7f87b2fea740 1 -- start start 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.041+0000 7f87b2fea740 1 Processor -- start 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.041+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 0x55ee2fdcab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.041+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9eb670 0x55ee2fdc7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.041+0000 7f87b2fea740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdc7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.041+0000 7f87b2fea740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81afd50 con 0x55ee2f9eb670 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.041+0000 7f87b2fea740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81af680 con 0x55ee2f9e3490 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.041+0000 7f87b2fea740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81ac8c0 con 0x55ee2fa0c350 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.041+0000 7f87b2fea740 10 client.0 _ll_register_callbacks cb 0x7f879801c9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9eb670 0x55ee2fdc7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9eb670 0x55ee2fdc7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45350/0 (socket says 172.21.15.33:45350) 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a5d9b640 1 -- 172.21.15.33:0/3803615925 learned_addr learned my addr 172.21.15.33:0/3803615925 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a6d9d640 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdc7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a659c640 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 0x55ee2fdcab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a5d9b640 1 -- 172.21.15.33:0/3803615925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 msgr2=0x55ee2fdc7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdc7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a5d9b640 1 -- 172.21.15.33:0/3803615925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 msgr2=0x55ee2fdcab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 0x55ee2fdcab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a5d9b640 1 -- 172.21.15.33:0/3803615925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2fdc7aa0 con 0x55ee2f9eb670 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a659c640 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 0x55ee2fdcab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87a5d9b640 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9eb670 0x55ee2fdc7020 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f879c1034a0 tx=0x7f879c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344a36d517839181 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f878dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f878dffb640 1 -- 172.21.15.33:0/3803615925 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c049040 con 0x55ee2f9eb670 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f878dffb640 1 -- 172.21.15.33:0/3803615925 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f879c0ef0b0 con 0x55ee2f9eb670 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.042+0000 7f87b2fea740 1 -- 172.21.15.33:0/3803615925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f879800ec10 con 0x55ee2f9eb670 2024-08-28T19:34:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f878dffb640 1 -- 172.21.15.33:0/3803615925 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f879c0cbea0 con 0x55ee2f9eb670 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f87b2fea740 10 client.16269 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f87b2fea740 1 -- 172.21.15.33:0/3803615925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ee2fe3ff20 con 0x55ee2f9eb670 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f878dffb640 1 -- 172.21.15.33:0/3803615925 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f879800ec10 con 0x55ee2f9eb670 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f878dffb640 1 -- 172.21.15.33:0/3803615925 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f879c103670 con 0x55ee2f9eb670 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f87b2fea740 10 client.16269 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f87b2fea740 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f87b2fea740 20 client.16269 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f87b2fea740 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ee2f9a0080 0x55ee2fe42690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f87b2fea740 4 client.16269 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f87b2fea740 1 -- 172.21.15.33:0/3803615925 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ee2fd25fe0 con 0x55ee2f9a0080 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.043+0000 7f87a659c640 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ee2f9a0080 0x55ee2fe42690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.044+0000 7f878dffb640 10 client.16269 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.044+0000 7f87a659c640 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ee2f9a0080 0x55ee2fe42690 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ead053887b1259a server_cookie=2a3bc3f1ca8be6ed in_seq=0 out_seq=0 2024-08-28T19:34:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.046+0000 7f878dffb640 1 -- 172.21.15.33:0/3803615925 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ee2fd25fe0 con 0x55ee2f9a0080 2024-08-28T19:34:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.046+0000 7f878dffb640 10 client.16269 handle_command_reply: tid=0 2024-08-28T19:34:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.046+0000 7f87b2fea740 1 client.16269 shutdown 2024-08-28T19:34:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 1 -- 172.21.15.33:0/3803615925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9eb670 msgr2=0x55ee2fdc7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9eb670 0x55ee2fdc7020 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f879c1034a0 tx=0x7f879c000bc0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 1 -- 172.21.15.33:0/3803615925 shutdown_connections 2024-08-28T19:34:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ee2fa0c350 0x55ee2fdc7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ee2f9a0080 0x55ee2fe42690 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ee2f9eb670 0x55ee2fdc7020 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f878dffb640 0 client.16269 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 1 --2- 172.21.15.33:0/3803615925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee2f9e3490 0x55ee2fdcab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 1 -- 172.21.15.33:0/3803615925 >> 172.21.15.33:0/3803615925 conn(0x55ee2fa00740 msgr2=0x55ee2fdb82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 1 -- 172.21.15.33:0/3803615925 shutdown_connections 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 1 -- 172.21.15.33:0/3803615925 wait complete. 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.047+0000 7f87b2fea740 20 client.16269 trim_cache size 0 max 16384 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "8d4916ee-3aa5-498f-b19e-ffb12b88516d", 2024-08-28T19:34:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:34:56.053 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:34:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 -- 172.21.15.33:0/72142616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87900b4ca0 msgr2=0x7f87900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87900b4ca0 0x7f87900b71b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55ee2fdb1400 tx=0x7f879800c430 comp rx=0 tx=0).stop 2024-08-28T19:34:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 -- 172.21.15.33:0/72142616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a8109260 msgr2=0x7f87a819a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a8109260 0x7f87a819a7c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f879c02a930 tx=0x7f879c004270 comp rx=0 tx=0).stop 2024-08-28T19:34:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 -- 172.21.15.33:0/72142616 shutdown_connections 2024-08-28T19:34:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a8109bb0 0x7f87a819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a8109260 0x7f87a819a7c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f87900b4ca0 0x7f87900b71b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 --2- 172.21.15.33:0/72142616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f87a8103920 0x7f87a819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 -- 172.21.15.33:0/72142616 >> 172.21.15.33:0/72142616 conn(0x7f87a80ff370 msgr2=0x7f87a8101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 -- 172.21.15.33:0/72142616 shutdown_connections 2024-08-28T19:34:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:56.048+0000 7f87aca75640 1 -- 172.21.15.33:0/72142616 wait complete. 2024-08-28T19:34:56.061 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:56.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:56 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:34:56.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:56 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:56.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:56 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:34:56.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:56 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:56 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:34:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:56 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:56 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:34:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:56 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:56 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:34:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:56 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:56 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:34:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:56 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:34:57.162 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:34:57.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.386+0000 7f82ccedc640 1 -- 172.21.15.33:0/283635012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82c8108ab0 msgr2=0x7f82c810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:57.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.386+0000 7f82ccedc640 1 --2- 172.21.15.33:0/283635012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82c8108ab0 0x7f82c810f2e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009ca0 tx=0x7f82c002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.386+0000 7f82ccedc640 1 -- 172.21.15.33:0/283635012 shutdown_connections 2024-08-28T19:34:57.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.386+0000 7f82ccedc640 1 --2- 172.21.15.33:0/283635012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82c8108ab0 0x7f82c810f2e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.386+0000 7f82ccedc640 1 --2- 172.21.15.33:0/283635012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c8108160 0x7f82c8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.386+0000 7f82ccedc640 1 --2- 172.21.15.33:0/283635012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c8102820 0x7f82c8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.386+0000 7f82ccedc640 1 -- 172.21.15.33:0/283635012 >> 172.21.15.33:0/283635012 conn(0x7f82c80795d0 msgr2=0x7f82c80799e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:57.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.386+0000 7f82ccedc640 1 -- 172.21.15.33:0/283635012 shutdown_connections 2024-08-28T19:34:57.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.386+0000 7f82ccedc640 1 -- 172.21.15.33:0/283635012 wait complete. 2024-08-28T19:34:57.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82ccedc640 1 Processor -- start 2024-08-28T19:34:57.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82ccedc640 1 -- start start 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82ccedc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82c8102820 0x7f82c819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82ccedc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c8108160 0x7f82c819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82ccedc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c8108ab0 0x7f82c819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82ccedc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f82c8112780 con 0x7f82c8102820 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82ccedc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82c8112600 con 0x7f82c8108ab0 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82ccedc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82c8112900 con 0x7f82c8108160 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82c659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82c8102820 0x7f82c819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82c659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82c8102820 0x7f82c819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45370/0 (socket says 172.21.15.33:45370) 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.387+0000 7f82c659c640 1 -- 172.21.15.33:0/1344124064 learned_addr learned my addr 172.21.15.33:0/1344124064 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82bffff640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c8108160 0x7f82c819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c8108ab0 0x7f82c819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82c659c640 1 -- 172.21.15.33:0/1344124064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c8108160 msgr2=0x7f82c819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82c659c640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c8108160 0x7f82c819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82c659c640 1 -- 172.21.15.33:0/1344124064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c8108ab0 msgr2=0x7f82c819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82c659c640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c8108ab0 0x7f82c819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82c659c640 1 -- 172.21.15.33:0/1344124064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c81a01b0 con 0x7f82c8102820 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c8108ab0 0x7f82c819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82c659c640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82c8102820 0x7f82c819a240 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f82b800e9f0 tx=0x7f82b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82bf7fe640 1 -- 172.21.15.33:0/1344124064 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b800cd80 con 0x7f82c8102820 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82ccedc640 1 -- 172.21.15.33:0/1344124064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c81a04a0 con 0x7f82c8102820 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82bf7fe640 1 -- 172.21.15.33:0/1344124064 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82b80054d0 con 0x7f82c8102820 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82bf7fe640 1 -- 172.21.15.33:0/1344124064 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8010690 con 0x7f82c8102820 2024-08-28T19:34:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.388+0000 7f82ccedc640 1 -- 172.21.15.33:0/1344124064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c81a6c00 con 0x7f82c8102820 2024-08-28T19:34:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.391+0000 7f82d3451740 1 Processor -- start 2024-08-28T19:34:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.391+0000 7f82d3451740 1 -- start start 2024-08-28T19:34:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.391+0000 7f82d3451740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a36840 0x55c0d9dddc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.391+0000 7f82d3451740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a0d980 0x55c0d9dde1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.391+0000 7f82d3451740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a15b60 0x55c0d9dde710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.391+0000 7f82d3451740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c0d9d52330 con 0x55c0d9a0d980 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.391+0000 7f82d3451740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c0d9d418c0 con 0x55c0d9a15b60 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.391+0000 7f82d3451740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c0d9d45870 con 0x55c0d9a36840 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.391+0000 7f82bf7fe640 1 -- 172.21.15.33:0/1344124064 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f82b8004e90 con 0x7f82c8102820 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.392+0000 7f82c659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a0d980 0x55c0d9dde1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.392+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a36840 0x55c0d9dddc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.392+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a36840 0x55c0d9dddc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:33756/0 (socket says 172.21.15.33:33756) 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.392+0000 7f82c6d9d640 1 -- 172.21.15.33:0/2406580103 learned_addr learned my addr 172.21.15.33:0/2406580103 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.392+0000 7f82bffff640 1 --2- 172.21.15.33:0/2406580103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a15b60 0x55c0d9dde710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.392+0000 7f82c6d9d640 1 -- 172.21.15.33:0/2406580103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a15b60 msgr2=0x55c0d9dde710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.392+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/2406580103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a15b60 0x55c0d9dde710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.392+0000 7f82c6d9d640 1 -- 172.21.15.33:0/2406580103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a0d980 msgr2=0x55c0d9dde1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.392+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/2406580103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a0d980 0x55c0d9dde1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.392+0000 7f82c6d9d640 1 -- 172.21.15.33:0/2406580103 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d9cf9df0 con 0x55c0d9a36840 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.393+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/2406580103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a36840 0x55c0d9dddc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82c0006010 tx=0x7f82c0009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfbc511a49f2d306 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.393+0000 7f82bf7fe640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82b40b4ca0 0x7f82b40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.393+0000 7f82bcff9640 1 -- 172.21.15.33:0/2406580103 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0031cf0 con 0x55c0d9a36840 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.393+0000 7f82bcff9640 1 -- 172.21.15.33:0/2406580103 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82c0036070 con 0x55c0d9a36840 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.393+0000 7f82bcff9640 1 -- 172.21.15.33:0/2406580103 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c003fa10 con 0x55c0d9a36840 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.393+0000 7f82bf7fe640 1 -- 172.21.15.33:0/1344124064 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f82b80e5e00 con 0x7f82c8102820 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.393+0000 7f82c659c640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82b40b4ca0 0x7f82b40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.394+0000 7f82d3451740 1 -- 172.21.15.33:0/2406580103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a36840 msgr2=0x55c0d9dddc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.394+0000 7f82d3451740 1 --2- 172.21.15.33:0/2406580103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a36840 0x55c0d9dddc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f82c0006010 tx=0x7f82c0009800 comp rx=0 tx=0).stop 2024-08-28T19:34:57.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.394+0000 7f82c659c640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82b40b4ca0 0x7f82b40b71b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f82b80e32b0 tx=0x7f82b8091f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.394+0000 7f82d3451740 1 -- 172.21.15.33:0/2406580103 shutdown_connections 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.394+0000 7f82d3451740 1 --2- 172.21.15.33:0/2406580103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a15b60 0x55c0d9dde710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.394+0000 7f82d3451740 1 --2- 172.21.15.33:0/2406580103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a0d980 0x55c0d9dde1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.394+0000 7f82d3451740 1 --2- 172.21.15.33:0/2406580103 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a36840 0x55c0d9dddc90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.394+0000 7f82d3451740 1 -- 172.21.15.33:0/2406580103 >> 172.21.15.33:0/2406580103 conn(0x55c0d9a2a990 msgr2=0x55c0d9ddbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.394+0000 7f82d3451740 1 -- 172.21.15.33:0/2406580103 shutdown_connections 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.394+0000 7f82d3451740 1 -- 172.21.15.33:0/2406580103 wait complete. 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82d3451740 1 -- start start 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82d3451740 1 Processor -- start 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82d3451740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 0x55c0d9de93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82d3451740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82d3451740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a36840 0x55c0d9df5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 0x55c0d9de93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 0x55c0d9de93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:33770/0 (socket says 172.21.15.33:33770) 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82c6d9d640 1 -- 172.21.15.33:0/3825508949 learned_addr learned my addr 172.21.15.33:0/3825508949 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c0d9ba47a0 con 0x55c0d9a15b60 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c0d9cc8240 con 0x55c0d9a36840 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c0d9dec410 con 0x55c0d9a0d980 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.395+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a36840 0x55c0d9df5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82d3451740 10 client.0 _ll_register_callbacks cb 0x55c0d9a4e090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82bffff640 1 -- 172.21.15.33:0/3825508949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 msgr2=0x55c0d9de93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82bffff640 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 0x55c0d9de93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82bffff640 1 -- 172.21.15.33:0/3825508949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a36840 msgr2=0x55c0d9df5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82bffff640 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a36840 0x55c0d9df5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82bffff640 1 -- 172.21.15.33:0/3825508949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0d9cfe2b0 con 0x55c0d9a15b60 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82c0036070 con 0x55c0d9a15b60 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82bffff640 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de9910 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f82c806a5a0 tx=0x7f82b00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb778f083edd13e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82adffb640 10 client.16281 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82adffb640 1 -- 172.21.15.33:0/3825508949 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0012650 con 0x55c0d9a15b60 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82adffb640 1 -- 172.21.15.33:0/3825508949 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f82b00127f0 con 0x55c0d9a15b60 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82adffb640 1 -- 172.21.15.33:0/3825508949 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f82b0012a30 con 0x55c0d9a15b60 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82d3451740 10 client.16281 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.396+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c0d9ab0b90 con 0x55c0d9a15b60 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.397+0000 7f82adffb640 1 -- 172.21.15.33:0/3825508949 <== mon.0 v2:172.21.15.33:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f82b0012bd0 con 0x55c0d9a15b60 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.397+0000 7f82d3451740 10 client.16281 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.397+0000 7f82d3451740 10 client.16281 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.397+0000 7f82d3451740 20 client.16281 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:57.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.397+0000 7f82d3451740 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c0d99f51c0 0x55c0d9dfb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.397+0000 7f82d3451740 4 client.16281 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:57.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.397+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0d9d54280 con 0x55c0d99f51c0 2024-08-28T19:34:57.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.397+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c0d99f51c0 0x55c0d9dfb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.398+0000 7f82adffb640 10 client.16281 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:57.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.398+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c0d99f51c0 0x55c0d9dfb440 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51185f74e9e5d09a server_cookie=1692f3fdb955da3b in_seq=0 out_seq=0 2024-08-28T19:34:57.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.398+0000 7f82adffb640 1 -- 172.21.15.33:0/3825508949 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c0d9d54280 con 0x55c0d99f51c0 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.398+0000 7f82adffb640 10 client.16281 handle_command_reply: tid=0 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.398+0000 7f82d3451740 1 client.16281 shutdown 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 msgr2=0x55c0d9de9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de9910 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f82c806a5a0 tx=0x7f82b00117b0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 shutdown_connections 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a36840 0x55c0d9df5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c0d99f51c0 0x55c0d9dfb440 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82adffb640 0 client.16281 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de9910 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 1 --2- 172.21.15.33:0/3825508949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 0x55c0d9de93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 >> 172.21.15.33:0/3825508949 conn(0x55c0d9a2a990 msgr2=0x55c0d9dda340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 shutdown_connections 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 1 -- 172.21.15.33:0/3825508949 wait complete. 2024-08-28T19:34:57.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.399+0000 7f82d3451740 20 client.16281 trim_cache size 0 max 16384 2024-08-28T19:34:57.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82d3451740 1 Processor -- start 2024-08-28T19:34:57.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82d3451740 1 -- start start 2024-08-28T19:34:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82d3451740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d99f51c0 0x55c0d9deb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82d3451740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a0d980 0x55c0d9df5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82d3451740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82d3451740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81ae970 con 0x55c0d9a15b60 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82d3451740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81b04b0 con 0x55c0d9a0d980 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82d3451740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81af040 con 0x55c0d99f51c0 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45392/0 (socket says 172.21.15.33:45392) 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.417+0000 7f82c6d9d640 1 -- 172.21.15.33:0/1936738347 learned_addr learned my addr 172.21.15.33:0/1936738347 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82bffff640 1 --2- 172.21.15.33:0/1936738347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a0d980 0x55c0d9df5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/1936738347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d99f51c0 0x55c0d9deb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82c6d9d640 1 -- 172.21.15.33:0/1936738347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d99f51c0 msgr2=0x55c0d9deb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/1936738347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d99f51c0 0x55c0d9deb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82c6d9d640 1 -- 172.21.15.33:0/1936738347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a0d980 msgr2=0x55c0d9df5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:57.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/1936738347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a0d980 0x55c0d9df5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82c6d9d640 1 -- 172.21.15.33:0/1936738347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d9d11d90 con 0x55c0d9a15b60 2024-08-28T19:34:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/1936738347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de65c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f82c00094e0 tx=0x7f82c0009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f347798de92d0e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82affff640 1 -- 172.21.15.33:0/1936738347 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0031cf0 con 0x55c0d9a15b60 2024-08-28T19:34:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82affff640 1 -- 172.21.15.33:0/1936738347 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82c004e040 con 0x55c0d9a15b60 2024-08-28T19:34:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.418+0000 7f82affff640 1 -- 172.21.15.33:0/1936738347 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c003fd90 con 0x55c0d9a15b60 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.419+0000 7f82d3451740 1 -- 172.21.15.33:0/1936738347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 msgr2=0x55c0d9de65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.419+0000 7f82d3451740 1 --2- 172.21.15.33:0/1936738347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de65c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f82c00094e0 tx=0x7f82c0009800 comp rx=0 tx=0).stop 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.419+0000 7f82d3451740 1 -- 172.21.15.33:0/1936738347 shutdown_connections 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.419+0000 7f82d3451740 1 --2- 172.21.15.33:0/1936738347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9de65c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.419+0000 7f82d3451740 1 --2- 172.21.15.33:0/1936738347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d9a0d980 0x55c0d9df5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.419+0000 7f82d3451740 1 --2- 172.21.15.33:0/1936738347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d99f51c0 0x55c0d9deb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.419+0000 7f82d3451740 1 -- 172.21.15.33:0/1936738347 >> 172.21.15.33:0/1936738347 conn(0x55c0d9a2a990 msgr2=0x55c0d9dea8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.419+0000 7f82d3451740 1 -- 172.21.15.33:0/1936738347 shutdown_connections 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.419+0000 7f82d3451740 1 -- 172.21.15.33:0/1936738347 wait complete. 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.420+0000 7f82d3451740 1 -- start start 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.420+0000 7f82d3451740 1 Processor -- start 2024-08-28T19:34:57.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.420+0000 7f82d3451740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d99f51c0 0x55c0d9dee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.420+0000 7f82d3451740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 0x55c0d9dee660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.420+0000 7f82d3451740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9e5ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.420+0000 7f82d3451740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81afde0 con 0x55c0d9a15b60 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.420+0000 7f82d3451740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81af710 con 0x55c0d99f51c0 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82d3451740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81ac950 con 0x55c0d9a0d980 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d99f51c0 0x55c0d9dee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9e5ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9e5ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45394/0 (socket says 172.21.15.33:45394) 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82c6d9d640 1 -- 172.21.15.33:0/2440309885 learned_addr learned my addr 172.21.15.33:0/2440309885 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82d3451740 10 client.0 _ll_register_callbacks cb 0x7f82b0005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82bffff640 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 0x55c0d9dee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82c6d9d640 1 -- 172.21.15.33:0/2440309885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 msgr2=0x55c0d9dee660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 0x55c0d9dee660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82c6d9d640 1 -- 172.21.15.33:0/2440309885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d99f51c0 msgr2=0x55c0d9dee0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:57.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d99f51c0 0x55c0d9dee0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82c6d9d640 1 -- 172.21.15.33:0/2440309885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0d9e5f570 con 0x55c0d9a15b60 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82c6d9d640 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9e5ef00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x55c0d9ded6e0 tx=0x7f82c002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6730fc3ce53dd2ba server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82adffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82adffb640 1 -- 172.21.15.33:0/2440309885 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0064070 con 0x55c0d9a15b60 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82adffb640 1 -- 172.21.15.33:0/2440309885 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f82c003fd30 con 0x55c0d9a15b60 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.421+0000 7f82d3451740 1 -- 172.21.15.33:0/2440309885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82c004e040 con 0x55c0d9a15b60 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82adffb640 1 -- 172.21.15.33:0/2440309885 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f82c0031af0 con 0x55c0d9a15b60 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82d3451740 10 client.16287 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82d3451740 1 -- 172.21.15.33:0/2440309885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c0d9e66900 con 0x55c0d9a15b60 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82adffb640 1 -- 172.21.15.33:0/2440309885 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82c004e040 con 0x55c0d9a15b60 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82adffb640 1 -- 172.21.15.33:0/2440309885 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f82c0067030 con 0x55c0d9a15b60 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82d3451740 10 client.16287 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82d3451740 10 client.16287 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82d3451740 20 client.16287 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:57.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82d3451740 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c0d9a36840 0x55c0d9e68b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:57.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82d3451740 4 client.16287 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.6, "await_for": 45.0}] 2024-08-28T19:34:57.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.422+0000 7f82d3451740 1 -- 172.21.15.33:0/2440309885 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.6, "await_for": 45.0}) -- 0x55c0d9d4fd20 con 0x55c0d9a36840 2024-08-28T19:34:57.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.423+0000 7f82bffff640 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c0d9a36840 0x55c0d9e68b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:57.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.423+0000 7f82adffb640 10 client.16287 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:57.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.423+0000 7f82bffff640 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c0d9a36840 0x55c0d9e68b90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=853ab32a0ca89c58 server_cookie=ca7bec4771be435b in_seq=0 out_seq=0 2024-08-28T19:34:57.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82adffb640 1 -- 172.21.15.33:0/2440309885 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c0d9d4fd20 con 0x55c0d9a36840 2024-08-28T19:34:57.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82adffb640 10 client.16287 handle_command_reply: tid=0 2024-08-28T19:34:57.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 client.16287 shutdown 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 -- 172.21.15.33:0/2440309885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 msgr2=0x55c0d9e5ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9e5ef00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x55c0d9ded6e0 tx=0x7f82c002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 -- 172.21.15.33:0/2440309885 shutdown_connections 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c0d9a36840 0x55c0d9e68b90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82adffb640 0 client.16287 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c0d9a15b60 0x55c0d9e5ef00 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c0d9a0d980 0x55c0d9dee660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 --2- 172.21.15.33:0/2440309885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c0d99f51c0 0x55c0d9dee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 -- 172.21.15.33:0/2440309885 >> 172.21.15.33:0/2440309885 conn(0x55c0d9a2a990 msgr2=0x55c0d9dea730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 -- 172.21.15.33:0/2440309885 shutdown_connections 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 1 -- 172.21.15.33:0/2440309885 wait complete. 2024-08-28T19:34:57.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.438+0000 7f82d3451740 20 client.16287 trim_cache size 0 max 16384 2024-08-28T19:34:57.442 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:34:57.442 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:34:57.442 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:34:57.442 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 6, 2024-08-28T19:34:57.442 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:34:57.442 INFO:teuthology.orchestra.run.smithi033.stdout: "c3ab418a": { 2024-08-28T19:34:57.442 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 6, 2024-08-28T19:34:57.442 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:34:57.442 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:34:57.442 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 146.6, 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:57.443 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:57.444 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:57.444 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:57.444 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:57.444 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:34:57.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 -- 172.21.15.33:0/1344124064 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82b40b4ca0 msgr2=0x7f82b40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:57.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82b40b4ca0 0x7f82b40b71b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f82b80e32b0 tx=0x7f82b8091f90 comp rx=0 tx=0).stop 2024-08-28T19:34:57.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 -- 172.21.15.33:0/1344124064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82c8102820 msgr2=0x7f82c819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:57.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82c8102820 0x7f82c819a240 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f82b800e9f0 tx=0x7f82b800edf0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 -- 172.21.15.33:0/1344124064 shutdown_connections 2024-08-28T19:34:57.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c8108ab0 0x7f82c819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82b40b4ca0 0x7f82b40b71b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82c8108160 0x7f82c819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 --2- 172.21.15.33:0/1344124064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82c8102820 0x7f82c819a240 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:57.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 -- 172.21.15.33:0/1344124064 >> 172.21.15.33:0/1344124064 conn(0x7f82c80795d0 msgr2=0x7f82c806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:57.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 -- 172.21.15.33:0/1344124064 shutdown_connections 2024-08-28T19:34:57.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:57.439+0000 7f82ccedc640 1 -- 172.21.15.33:0/1344124064 wait complete. 2024-08-28T19:34:57.699 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:34:57.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:57 smithi059 ceph-mon[22052]: pgmap v417: 129 pgs: 129 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:57 smithi122 ceph-mon[22174]: pgmap v417: 129 pgs: 129 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:57.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:57 smithi033 ceph-mon[18549]: pgmap v417: 129 pgs: 129 active+clean; 2.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-08-28T19:34:58.284 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c3ab418a', quiesce took 5.2 seconds. Will release after: 21.400000000000002 2024-08-28T19:34:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/2695339963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f14102880 msgr2=0x7f2f14102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 --2- 172.21.15.33:0/2695339963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f14102880 0x7f2f14102c90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009900 tx=0x7f2f0402a410 comp rx=0 tx=0).stop 2024-08-28T19:34:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/2695339963 shutdown_connections 2024-08-28T19:34:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 --2- 172.21.15.33:0/2695339963 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f14108b10 0x7f2f1410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 --2- 172.21.15.33:0/2695339963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f141081c0 0x7f2f141085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 --2- 172.21.15.33:0/2695339963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f14102880 0x7f2f14102c90 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/2695339963 >> 172.21.15.33:0/2695339963 conn(0x7f2f14079510 msgr2=0x7f2f14079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/2695339963 shutdown_connections 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/2695339963 wait complete. 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 Processor -- start 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.843+0000 7f2f1a6b7640 1 -- start start 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f1a6b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f14102880 0x7f2f1419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f1a6b7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f141081c0 0x7f2f1419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f1a6b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f14108b10 0x7f2f1419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f1a6b7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14112830 con 0x7f2f14102880 2024-08-28T19:34:58.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f1a6b7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f141126b0 con 0x7f2f14108b10 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f1a6b7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2f141129b0 con 0x7f2f141081c0 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f13fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f14102880 0x7f2f1419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f13fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f14102880 0x7f2f1419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50056/0 (socket says 172.21.15.33:50056) 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f13fff640 1 -- 172.21.15.33:0/4034105345 learned_addr learned my addr 172.21.15.33:0/4034105345 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f18c54640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f14108b10 0x7f2f1419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f137fe640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f141081c0 0x7f2f1419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f13fff640 1 -- 172.21.15.33:0/4034105345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f141081c0 msgr2=0x7f2f1419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f13fff640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f141081c0 0x7f2f1419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f13fff640 1 -- 172.21.15.33:0/4034105345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f14108b10 msgr2=0x7f2f1419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f13fff640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f14108b10 0x7f2f1419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f13fff640 1 -- 172.21.15.33:0/4034105345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f141a02e0 con 0x7f2f14102880 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f18c54640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f14108b10 0x7f2f1419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f137fe640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f141081c0 0x7f2f1419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.844+0000 7f2f13fff640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f14102880 0x7f2f1419a370 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2f04006010 tx=0x7f2f040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.845+0000 7f2f117fa640 1 -- 172.21.15.33:0/4034105345 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0403f030 con 0x7f2f14102880 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.845+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/4034105345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f141a0570 con 0x7f2f14102880 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.845+0000 7f2f117fa640 1 -- 172.21.15.33:0/4034105345 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f04003800 con 0x7f2f14102880 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.845+0000 7f2f117fa640 1 -- 172.21.15.33:0/4034105345 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04035070 con 0x7f2f14102880 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.845+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/4034105345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f141a6d30 con 0x7f2f14102880 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.847+0000 7f2f20c2c740 1 Processor -- start 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.847+0000 7f2f20c2c740 1 -- start start 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.847+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f641827070 0x55f641bcc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.847+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417fe1b0 0x55f641bcc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641bccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f117fa640 1 -- 172.21.15.33:0/4034105345 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2f04031b10 con 0x7f2f14102880 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f641b43630 con 0x55f6417fe1b0 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f641b32bc0 con 0x55f641827070 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f641b36b70 con 0x55f641806390 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f13fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417fe1b0 0x55f641bcc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f13fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417fe1b0 0x55f641bcc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50064/0 (socket says 172.21.15.33:50064) 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f13fff640 1 -- 172.21.15.33:0/18153120 learned_addr learned my addr 172.21.15.33:0/18153120 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f18c54640 1 --2- 172.21.15.33:0/18153120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f641827070 0x55f641bcc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f137fe640 1 --2- 172.21.15.33:0/18153120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641bccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f13fff640 1 -- 172.21.15.33:0/18153120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 msgr2=0x55f641bccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f13fff640 1 --2- 172.21.15.33:0/18153120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641bccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f13fff640 1 -- 172.21.15.33:0/18153120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f641827070 msgr2=0x55f641bcc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f13fff640 1 --2- 172.21.15.33:0/18153120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f641827070 0x55f641bcc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f13fff640 1 -- 172.21.15.33:0/18153120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f641892650 con 0x55f6417fe1b0 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f117fa640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2efc0b4ca0 0x7f2efc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.848+0000 7f2f13fff640 1 --2- 172.21.15.33:0/18153120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417fe1b0 0x55f641bcc800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2f041036d0 tx=0x7f2f0410e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316428a887c2b02b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.849+0000 7f2f18c54640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2efc0b4ca0 0x7f2efc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.849+0000 7f2f117fa640 1 -- 172.21.15.33:0/4034105345 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2f04106330 con 0x7f2f14102880 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.849+0000 7f2efa7fc640 1 -- 172.21.15.33:0/18153120 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f040c8590 con 0x55f6417fe1b0 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.849+0000 7f2efa7fc640 1 -- 172.21.15.33:0/18153120 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f04031e00 con 0x55f6417fe1b0 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.849+0000 7f2efa7fc640 1 -- 172.21.15.33:0/18153120 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f040cbe40 con 0x55f6417fe1b0 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 -- 172.21.15.33:0/18153120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417fe1b0 msgr2=0x55f641bcc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f18c54640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2efc0b4ca0 0x7f2efc0b71b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00c610 tx=0x7f2f0c00e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/18153120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417fe1b0 0x55f641bcc800 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2f041036d0 tx=0x7f2f0410e600 comp rx=0 tx=0).stop 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 -- 172.21.15.33:0/18153120 shutdown_connections 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/18153120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641bccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/18153120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417fe1b0 0x55f641bcc800 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/18153120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f641827070 0x55f641bcc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 -- 172.21.15.33:0/18153120 >> 172.21.15.33:0/18153120 conn(0x55f64181b460 msgr2=0x55f641bca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 -- 172.21.15.33:0/18153120 shutdown_connections 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 -- 172.21.15.33:0/18153120 wait complete. 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 -- start start 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.850+0000 7f2f20c2c740 1 Processor -- start 2024-08-28T19:34:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641bd7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641bd7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641827070 0x55f641be3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f641995700 con 0x55f641827070 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f641ab9700 con 0x55f6417fe1b0 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f641bda860 con 0x55f641806390 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f20c2c740 10 client.0 _ll_register_callbacks cb 0x55f641ae8dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f18c54640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641827070 0x55f641be3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f18c54640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641827070 0x55f641be3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50068/0 (socket says 172.21.15.33:50068) 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f18c54640 1 -- 172.21.15.33:0/2435397382 learned_addr learned my addr 172.21.15.33:0/2435397382 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f137fe640 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641bd7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f13fff640 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641bd7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f18c54640 1 -- 172.21.15.33:0/2435397382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 msgr2=0x55f641bd7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f18c54640 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641bd7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f18c54640 1 -- 172.21.15.33:0/2435397382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 msgr2=0x55f641bd7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f18c54640 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641bd7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f18c54640 1 -- 172.21.15.33:0/2435397382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f641af28b0 con 0x55f641827070 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.851+0000 7f2f137fe640 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641bd7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.852+0000 7f2f18c54640 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641827070 0x55f641be3ac0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c007da0 tx=0x7f2f0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee51babab646ba8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.852+0000 7f2ef37fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.852+0000 7f2ef37fe640 1 -- 172.21.15.33:0/2435397382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c01e040 con 0x55f641827070 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.852+0000 7f2f20c2c740 1 -- 172.21.15.33:0/2435397382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f641b45580 con 0x55f641827070 2024-08-28T19:34:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.852+0000 7f2ef37fe640 1 -- 172.21.15.33:0/2435397382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2f0c022420 con 0x55f641827070 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.852+0000 7f2ef37fe640 1 -- 172.21.15.33:0/2435397382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f0c022620 con 0x55f641827070 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.852+0000 7f2f20c2c740 10 client.16299 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.852+0000 7f2f20c2c740 1 -- 172.21.15.33:0/2435397382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f641be65e0 con 0x55f641827070 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.852+0000 7f2ef37fe640 1 -- 172.21.15.33:0/2435397382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f641b45580 con 0x55f641827070 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.852+0000 7f2ef37fe640 1 -- 172.21.15.33:0/2435397382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2f0c02c860 con 0x55f641827070 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.853+0000 7f2f20c2c740 10 client.16299 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.853+0000 7f2f20c2c740 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.853+0000 7f2f20c2c740 20 client.16299 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.853+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f6417e59f0 0x55f641be9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.853+0000 7f2f20c2c740 4 client.16299 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:34:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.853+0000 7f2f20c2c740 1 -- 172.21.15.33:0/2435397382 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f641b41020 con 0x55f6417e59f0 2024-08-28T19:34:58.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.853+0000 7f2f13fff640 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f6417e59f0 0x55f641be9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.853+0000 7f2ef37fe640 10 client.16299 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:58.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.853+0000 7f2f13fff640 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f6417e59f0 0x55f641be9be0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fb4d80fd4d758dc server_cookie=997db2a7b0c4058d in_seq=0 out_seq=0 2024-08-28T19:34:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2ef37fe640 1 -- 172.21.15.33:0/2435397382 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f641b41020 con 0x55f6417e59f0 2024-08-28T19:34:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2ef37fe640 10 client.16299 handle_command_reply: tid=0 2024-08-28T19:34:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 client.16299 shutdown 2024-08-28T19:34:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 -- 172.21.15.33:0/2435397382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641827070 msgr2=0x55f641be3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641827070 0x55f641be3ac0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c007da0 tx=0x7f2f0c004a40 comp rx=0 tx=0).stop 2024-08-28T19:34:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 -- 172.21.15.33:0/2435397382 shutdown_connections 2024-08-28T19:34:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f6417e59f0 0x55f641be9be0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2ef37fe640 0 client.16299 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641827070 0x55f641be3ac0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641bd7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/2435397382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641bd7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 -- 172.21.15.33:0/2435397382 >> 172.21.15.33:0/2435397382 conn(0x55f64181b460 msgr2=0x55f641bcf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 -- 172.21.15.33:0/2435397382 shutdown_connections 2024-08-28T19:34:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.854+0000 7f2f20c2c740 1 -- 172.21.15.33:0/2435397382 wait complete. 2024-08-28T19:34:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.855+0000 7f2f20c2c740 20 client.16299 trim_cache size 0 max 16384 2024-08-28T19:34:58.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.872+0000 7f2f20c2c740 1 Processor -- start 2024-08-28T19:34:58.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.872+0000 7f2f20c2c740 1 -- start start 2024-08-28T19:34:58.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.872+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417e59f0 0x55f641bd7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.872+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641be3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.872+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641be3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.872+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2f141b0c20 con 0x55f6417e59f0 2024-08-28T19:34:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.872+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f141b2760 con 0x55f6417fe1b0 2024-08-28T19:34:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.872+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2f141b12f0 con 0x55f641806390 2024-08-28T19:34:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f13fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417e59f0 0x55f641bd7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f13fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417e59f0 0x55f641bd7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50080/0 (socket says 172.21.15.33:50080) 2024-08-28T19:34:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f13fff640 1 -- 172.21.15.33:0/354271633 learned_addr learned my addr 172.21.15.33:0/354271633 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f137fe640 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641be3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f13fff640 1 -- 172.21.15.33:0/354271633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 msgr2=0x55f641be3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f18c54640 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641be3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f13fff640 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641be3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f13fff640 1 -- 172.21.15.33:0/354271633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 msgr2=0x55f641be3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f13fff640 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641be3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f13fff640 1 -- 172.21.15.33:0/354271633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f641bd26b0 con 0x55f6417e59f0 2024-08-28T19:34:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f137fe640 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641be3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:34:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f18c54640 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641be3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:34:58.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2f13fff640 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417e59f0 0x55f641bd7f40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2f04031440 tx=0x7f2f0402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9ed847029a3df4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2ef9ffb640 1 -- 172.21.15.33:0/354271633 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04049040 con 0x55f6417e59f0 2024-08-28T19:34:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2ef9ffb640 1 -- 172.21.15.33:0/354271633 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f040d5320 con 0x55f6417e59f0 2024-08-28T19:34:58.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.873+0000 7f2ef9ffb640 1 -- 172.21.15.33:0/354271633 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f040cc020 con 0x55f6417e59f0 2024-08-28T19:34:58.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.874+0000 7f2f20c2c740 1 -- 172.21.15.33:0/354271633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417e59f0 msgr2=0x55f641bd7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:58.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.874+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417e59f0 0x55f641bd7f40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2f04031440 tx=0x7f2f0402a410 comp rx=0 tx=0).stop 2024-08-28T19:34:58.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.874+0000 7f2f20c2c740 1 -- 172.21.15.33:0/354271633 shutdown_connections 2024-08-28T19:34:58.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.874+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f641806390 0x55f641be3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.874+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641be3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.874+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/354271633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f6417e59f0 0x55f641bd7f40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.874+0000 7f2f20c2c740 1 -- 172.21.15.33:0/354271633 >> 172.21.15.33:0/354271633 conn(0x55f64181b460 msgr2=0x55f641bd7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.874+0000 7f2f20c2c740 1 -- 172.21.15.33:0/354271633 shutdown_connections 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.874+0000 7f2f20c2c740 1 -- 172.21.15.33:0/354271633 wait complete. 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.874+0000 7f2f20c2c740 1 -- start start 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f20c2c740 1 Processor -- start 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f6417e59f0 0x55f641be02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641bdb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f20c2c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641806390 0x55f641bdbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2f141b2090 con 0x55f641806390 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f141b19c0 con 0x55f6417fe1b0 2024-08-28T19:34:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f20c2c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2f141aec00 con 0x55f6417e59f0 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f20c2c740 10 client.0 _ll_register_callbacks cb 0x7f2f0c01b040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f18c54640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641806390 0x55f641bdbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f18c54640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641806390 0x55f641bdbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50096/0 (socket says 172.21.15.33:50096) 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f18c54640 1 -- 172.21.15.33:0/1855197452 learned_addr learned my addr 172.21.15.33:0/1855197452 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f13fff640 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f6417e59f0 0x55f641be02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.875+0000 7f2f137fe640 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641bdb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2f18c54640 1 -- 172.21.15.33:0/1855197452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f6417e59f0 msgr2=0x55f641be02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2f18c54640 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f6417e59f0 0x55f641be02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2f18c54640 1 -- 172.21.15.33:0/1855197452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 msgr2=0x55f641bdb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2f18c54640 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641bdb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2f18c54640 1 -- 172.21.15.33:0/1855197452 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f641bdc570 con 0x55f641806390 2024-08-28T19:34:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2f18c54640 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641806390 0x55f641bdbde0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c007d70 tx=0x7f2f0c009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6afee615617a43 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2ef37fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2ef37fe640 1 -- 172.21.15.33:0/1855197452 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c03b070 con 0x55f641806390 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2ef37fe640 1 -- 172.21.15.33:0/1855197452 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2f0c007dd0 con 0x55f641806390 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2f20c2c740 1 -- 172.21.15.33:0/1855197452 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f040d5320 con 0x55f641806390 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2ef37fe640 1 -- 172.21.15.33:0/1855197452 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f0c047050 con 0x55f641806390 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2f20c2c740 10 client.16305 fetch_fsmap learned FSMap version 28 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2f20c2c740 1 -- 172.21.15.33:0/1855197452 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f641c545b0 con 0x55f641806390 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.876+0000 7f2ef37fe640 1 -- 172.21.15.33:0/1855197452 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f040d5320 con 0x55f641806390 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.877+0000 7f2ef37fe640 1 -- 172.21.15.33:0/1855197452 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2f0c022c80 con 0x55f641806390 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.877+0000 7f2f20c2c740 10 client.16305 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.877+0000 7f2f20c2c740 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:34:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.877+0000 7f2f20c2c740 20 client.16305 populate_metadata read hostname 'smithi033' 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.877+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f641827070 0x55f641c56da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.877+0000 7f2f20c2c740 4 client.16305 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.877+0000 7f2f20c2c740 1 -- 172.21.15.33:0/1855197452 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f641b3e760 con 0x55f641827070 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.877+0000 7f2f13fff640 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f641827070 0x55f641c56da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.877+0000 7f2ef37fe640 10 client.16305 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.877+0000 7f2f13fff640 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f641827070 0x55f641c56da0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86f8ae664522f179 server_cookie=8c2ab456dea30178 in_seq=0 out_seq=0 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2ef37fe640 1 -- 172.21.15.33:0/1855197452 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x55f641b3e760 con 0x55f641827070 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2ef37fe640 10 client.16305 handle_command_reply: tid=0 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 client.16305 shutdown 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 -- 172.21.15.33:0/1855197452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641806390 msgr2=0x55f641bdbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641806390 0x55f641bdbde0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c007d70 tx=0x7f2f0c009eb0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 -- 172.21.15.33:0/1855197452 shutdown_connections 2024-08-28T19:34:58.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f641827070 0x55f641c56da0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f641806390 0x55f641bdbde0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f6417fe1b0 0x55f641bdb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 --2- 172.21.15.33:0/1855197452 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f6417e59f0 0x55f641be02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 -- 172.21.15.33:0/1855197452 >> 172.21.15.33:0/1855197452 conn(0x55f64181b460 msgr2=0x55f641bcf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:58.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2ef37fe640 0 client.16305 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:34:58.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 -- 172.21.15.33:0/1855197452 shutdown_connections 2024-08-28T19:34:58.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 1 -- 172.21.15.33:0/1855197452 wait complete. 2024-08-28T19:34:58.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.878+0000 7f2f20c2c740 20 client.16305 trim_cache size 0 max 16384 2024-08-28T19:34:58.887 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "8d4916ee-3aa5-498f-b19e-ffb12b88516d", 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:34:58.888 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:34:58.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:34:58.890 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:34:58.891 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:34:58.891 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:34:58.891 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:34:58.891 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:34:58.891 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:34:58.891 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:58.891 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:34:58.891 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:34:58.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/4034105345 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2efc0b4ca0 msgr2=0x7f2efc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:58.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2efc0b4ca0 0x7f2efc0b71b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00c610 tx=0x7f2f0c00e040 comp rx=0 tx=0).stop 2024-08-28T19:34:58.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/4034105345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f14102880 msgr2=0x7f2f1419a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:34:58.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f14102880 0x7f2f1419a370 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2f04006010 tx=0x7f2f040042f0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/4034105345 shutdown_connections 2024-08-28T19:34:58.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f14108b10 0x7f2f1419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2efc0b4ca0 0x7f2efc0b71b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f141081c0 0x7f2f1419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 --2- 172.21.15.33:0/4034105345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f14102880 0x7f2f1419a370 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:34:58.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/4034105345 >> 172.21.15.33:0/4034105345 conn(0x7f2f14079510 msgr2=0x7f2f141017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:34:58.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/4034105345 shutdown_connections 2024-08-28T19:34:58.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:34:58.879+0000 7f2f1a6b7640 1 -- 172.21.15.33:0/4034105345 wait complete. 2024-08-28T19:34:59.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:59 smithi033 ceph-mon[18549]: pgmap v418: 129 pgs: 129 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-28T19:34:59.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:34:59 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:34:59.687 INFO:tasks.cephfs.filesystem:scrub status for tag:8d4916ee-3aa5-498f-b19e-ffb12b88516d - {'path': '/', 'tag': '8d4916ee-3aa5-498f-b19e-ffb12b88516d', 'options': 'recursive,force'} 2024-08-28T19:34:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:59 smithi059 ceph-mon[22052]: pgmap v418: 129 pgs: 129 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-28T19:34:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:34:59 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:34:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:59 smithi122 ceph-mon[22174]: pgmap v418: 129 pgs: 129 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-28T19:34:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:34:59 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:35:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:01 smithi059 ceph-mon[22052]: pgmap v419: 129 pgs: 129 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-08-28T19:35:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:01 smithi122 ceph-mon[22174]: pgmap v419: 129 pgs: 129 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-08-28T19:35:01.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:01 smithi033 ceph-mon[18549]: pgmap v419: 129 pgs: 129 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-08-28T19:35:03.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:03 smithi059 ceph-mon[22052]: pgmap v420: 129 pgs: 129 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-08-28T19:35:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:03 smithi122 ceph-mon[22174]: pgmap v420: 129 pgs: 129 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-08-28T19:35:03.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:03 smithi033 ceph-mon[18549]: pgmap v420: 129 pgs: 129 active+clean; 2.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-08-28T19:35:05.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:05 smithi059 ceph-mon[22052]: pgmap v421: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 42 KiB/s wr, 32 op/s 2024-08-28T19:35:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:05 smithi122 ceph-mon[22174]: pgmap v421: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 42 KiB/s wr, 32 op/s 2024-08-28T19:35:05.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:05 smithi033 ceph-mon[18549]: pgmap v421: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 42 KiB/s wr, 32 op/s 2024-08-28T19:35:07.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:07 smithi059 ceph-mon[22052]: pgmap v422: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 27 op/s 2024-08-28T19:35:07.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:07 smithi122 ceph-mon[22174]: pgmap v422: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 27 op/s 2024-08-28T19:35:07.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:07 smithi033 ceph-mon[18549]: pgmap v422: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 27 op/s 2024-08-28T19:35:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:09 smithi059 ceph-mon[22052]: pgmap v423: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 KiB/s wr, 28 op/s 2024-08-28T19:35:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:09 smithi122 ceph-mon[22174]: pgmap v423: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 KiB/s wr, 28 op/s 2024-08-28T19:35:09.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:09 smithi033 ceph-mon[18549]: pgmap v423: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 KiB/s wr, 28 op/s 2024-08-28T19:35:11.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:11 smithi059 ceph-mon[22052]: pgmap v424: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-08-28T19:35:11.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:11 smithi122 ceph-mon[22174]: pgmap v424: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-08-28T19:35:11.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:11 smithi033 ceph-mon[18549]: pgmap v424: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-08-28T19:35:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:13 smithi059 ceph-mon[22052]: pgmap v425: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-28T19:35:13.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:13 smithi122 ceph-mon[22174]: pgmap v425: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-28T19:35:13.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:13 smithi033 ceph-mon[18549]: pgmap v425: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-28T19:35:15.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:15 smithi059 ceph-mon[22052]: pgmap v426: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-08-28T19:35:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:15 smithi122 ceph-mon[22174]: pgmap v426: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-08-28T19:35:15.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:15 smithi033 ceph-mon[18549]: pgmap v426: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-08-28T19:35:17.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:17 smithi059 ceph-mon[22052]: pgmap v427: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-28T19:35:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:17 smithi122 ceph-mon[22174]: pgmap v427: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-28T19:35:17.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:17 smithi033 ceph-mon[18549]: pgmap v427: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-28T19:35:19.685 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:35:19.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:19 smithi059 ceph-mon[22052]: pgmap v428: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 11 op/s 2024-08-28T19:35:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:19 smithi122 ceph-mon[22174]: pgmap v428: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 11 op/s 2024-08-28T19:35:19.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:19 smithi033 ceph-mon[18549]: pgmap v428: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 11 op/s 2024-08-28T19:35:19.955 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:20.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.576+0000 7fa11470f640 1 -- 172.21.15.33:0/3107707685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c102800 msgr2=0x7fa10c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.576+0000 7fa11470f640 1 --2- 172.21.15.33:0/3107707685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c102800 0x7fa10c102c10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa108009900 tx=0x7fa10802a410 comp rx=0 tx=0).stop 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.577+0000 7fa11470f640 1 -- 172.21.15.33:0/3107707685 shutdown_connections 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.577+0000 7fa11470f640 1 --2- 172.21.15.33:0/3107707685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa10c108a90 0x7fa10c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.577+0000 7fa11470f640 1 --2- 172.21.15.33:0/3107707685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa10c108140 0x7fa10c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.577+0000 7fa11470f640 1 --2- 172.21.15.33:0/3107707685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c102800 0x7fa10c102c10 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.577+0000 7fa11470f640 1 -- 172.21.15.33:0/3107707685 >> 172.21.15.33:0/3107707685 conn(0x7fa10c0794d0 msgr2=0x7fa10c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.577+0000 7fa11470f640 1 -- 172.21.15.33:0/3107707685 shutdown_connections 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.577+0000 7fa11470f640 1 -- 172.21.15.33:0/3107707685 wait complete. 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.577+0000 7fa11470f640 1 Processor -- start 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.577+0000 7fa11470f640 1 -- start start 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa11470f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c102800 0x7fa10c19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa11470f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa10c108140 0x7fa10c19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa11470f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa10c108a90 0x7fa10c19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:20.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa11470f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c112710 con 0x7fa10c102800 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa11470f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c112590 con 0x7fa10c108140 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa11470f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c112890 con 0x7fa10c108a90 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1124ab640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c102800 0x7fa10c19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1124ab640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c102800 0x7fa10c19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49474/0 (socket says 172.21.15.33:49474) 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1124ab640 1 -- 172.21.15.33:0/3357110677 learned_addr learned my addr 172.21.15.33:0/3357110677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa111caa640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa10c108140 0x7fa10c19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa112cac640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa10c108a90 0x7fa10c19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1124ab640 1 -- 172.21.15.33:0/3357110677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa10c108a90 msgr2=0x7fa10c19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1124ab640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa10c108a90 0x7fa10c19fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1124ab640 1 -- 172.21.15.33:0/3357110677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa10c108140 msgr2=0x7fa10c19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1124ab640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa10c108140 0x7fa10c19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1124ab640 1 -- 172.21.15.33:0/3357110677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c1a00e0 con 0x7fa10c102800 2024-08-28T19:35:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1124ab640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c102800 0x7fa10c19a230 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa108005940 tx=0x7fa1080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1037fe640 1 -- 172.21.15.33:0/3357110677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10803f030 con 0x7fa10c102800 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1037fe640 1 -- 172.21.15.33:0/3357110677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa108003cb0 con 0x7fa10c102800 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa11470f640 1 -- 172.21.15.33:0/3357110677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10c1a0370 con 0x7fa10c102800 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.578+0000 7fa1037fe640 1 -- 172.21.15.33:0/3357110677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108035070 con 0x7fa10c102800 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.579+0000 7fa11470f640 1 -- 172.21.15.33:0/3357110677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10c1a0850 con 0x7fa10c102800 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.580+0000 7fa11470f640 1 -- 172.21.15.33:0/3357110677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10c102c10 con 0x7fa10c102800 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.581+0000 7fa1037fe640 1 -- 172.21.15.33:0/3357110677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa108042030 con 0x7fa10c102800 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.582+0000 7fa1037fe640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0f80b4cd0 0x7fa0f80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.582+0000 7fa111caa640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0f80b4cd0 0x7fa0f80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.582+0000 7fa1037fe640 1 -- 172.21.15.33:0/3357110677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fa1081060c0 con 0x7fa10c102800 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.583+0000 7fa111caa640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0f80b4cd0 0x7fa0f80b71e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc005e10 tx=0x7fa0fc005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.585+0000 7fa1037fe640 1 -- 172.21.15.33:0/3357110677 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa1080ccb60 con 0x7fa10c102800 2024-08-28T19:35:20.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.807+0000 7fa11470f640 1 -- 172.21.15.33:0/3357110677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa10c1a6d70 con 0x7fa10c102800 2024-08-28T19:35:20.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.808+0000 7fa1037fe640 1 -- 172.21.15.33:0/3357110677 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fa1080cc460 con 0x7fa10c102800 2024-08-28T19:35:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:35:20.809 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:35:20.809 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 -- 172.21.15.33:0/3357110677 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0f80b4cd0 msgr2=0x7fa0f80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0f80b4cd0 0x7fa0f80b71e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc005e10 tx=0x7fa0fc005da0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 -- 172.21.15.33:0/3357110677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c102800 msgr2=0x7fa10c19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c102800 0x7fa10c19a230 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa108005940 tx=0x7fa1080042f0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 -- 172.21.15.33:0/3357110677 shutdown_connections 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa0f80b4cd0 0x7fa0f80b71e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa10c108a90 0x7fa10c19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa10c108140 0x7fa10c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 --2- 172.21.15.33:0/3357110677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c102800 0x7fa10c19a230 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 -- 172.21.15.33:0/3357110677 >> 172.21.15.33:0/3357110677 conn(0x7fa10c0794d0 msgr2=0x7fa10c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:20.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 -- 172.21.15.33:0/3357110677 shutdown_connections 2024-08-28T19:35:20.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:20.810+0000 7fa11470f640 1 -- 172.21.15.33:0/3357110677 wait complete. 2024-08-28T19:35:21.592 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id c3ab418a --release --await' 2024-08-28T19:35:21.592 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id c3ab418a --release --await 2024-08-28T19:35:21.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:21 smithi059 ceph-mon[22052]: pgmap v429: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:35:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:21 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3357110677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:35:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:21 smithi122 ceph-mon[22174]: pgmap v429: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:35:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:21 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3357110677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:35:21.846 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:21.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:21 smithi033 ceph-mon[18549]: pgmap v429: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:35:21.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:21 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3357110677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:35:22.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.370+0000 7f4b37e49640 1 -- 172.21.15.33:0/1221629523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b30109bf0 msgr2=0x7f4b30110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:22.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.370+0000 7f4b37e49640 1 --2- 172.21.15.33:0/1221629523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b30109bf0 0x7f4b30110420 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009ca0 tx=0x7f4b2802a8e0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.370+0000 7f4b37e49640 1 -- 172.21.15.33:0/1221629523 shutdown_connections 2024-08-28T19:35:22.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.370+0000 7f4b37e49640 1 --2- 172.21.15.33:0/1221629523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b30109bf0 0x7f4b30110420 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.370+0000 7f4b37e49640 1 --2- 172.21.15.33:0/1221629523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b301092a0 0x7f4b301096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.370+0000 7f4b37e49640 1 --2- 172.21.15.33:0/1221629523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b30101d60 0x7f4b30102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.370+0000 7f4b37e49640 1 -- 172.21.15.33:0/1221629523 >> 172.21.15.33:0/1221629523 conn(0x7f4b30079d30 msgr2=0x7f4b3007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.370+0000 7f4b37e49640 1 -- 172.21.15.33:0/1221629523 shutdown_connections 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.370+0000 7f4b37e49640 1 -- 172.21.15.33:0/1221629523 wait complete. 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b37e49640 1 Processor -- start 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b37e49640 1 -- start start 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b37e49640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b30101d60 0x7f4b301a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b37e49640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b301092a0 0x7f4b301a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b37e49640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b30109bf0 0x7f4b301a6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b37e49640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3011a060 con 0x7f4b301092a0 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b37e49640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4b30104b00 con 0x7f4b30109bf0 2024-08-28T19:35:22.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b37e49640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3011a1e0 con 0x7f4b30101d60 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b353e4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b301092a0 0x7f4b301a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b353e4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b301092a0 0x7f4b301a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49498/0 (socket says 172.21.15.33:49498) 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b353e4640 1 -- 172.21.15.33:0/1612556745 learned_addr learned my addr 172.21.15.33:0/1612556745 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.371+0000 7f4b35be5640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b30101d60 0x7f4b301a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b363e6640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b30109bf0 0x7f4b301a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b353e4640 1 -- 172.21.15.33:0/1612556745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b30101d60 msgr2=0x7f4b301a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b353e4640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b30101d60 0x7f4b301a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b353e4640 1 -- 172.21.15.33:0/1612556745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b30109bf0 msgr2=0x7f4b301a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b353e4640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b30109bf0 0x7f4b301a6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b353e4640 1 -- 172.21.15.33:0/1612556745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b301a6850 con 0x7f4b301092a0 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b363e6640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b30109bf0 0x7f4b301a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b353e4640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b301092a0 0x7f4b301a0e80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4b20006fd0 tx=0x7f4b2000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:22.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b26ffd640 1 -- 172.21.15.33:0/1612556745 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20011830 con 0x7f4b301092a0 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b26ffd640 1 -- 172.21.15.33:0/1612556745 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b20016070 con 0x7f4b301092a0 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b37e49640 1 -- 172.21.15.33:0/1612556745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b301a6b40 con 0x7f4b301092a0 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b26ffd640 1 -- 172.21.15.33:0/1612556745 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20010e00 con 0x7f4b301092a0 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.372+0000 7f4b37e49640 1 -- 172.21.15.33:0/1612556745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b301ad2a0 con 0x7f4b301092a0 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b3e3be740 1 Processor -- start 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b3e3be740 1 -- start start 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b26ffd640 1 -- 172.21.15.33:0/1612556745 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4b2001b460 con 0x7f4b301092a0 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x561626994c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269951c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x561626995700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56162690ba70 con 0x5616265c6660 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5616268fb000 con 0x5616265ce840 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5616268fefb0 con 0x5616265ef520 2024-08-28T19:35:22.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b35be5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b35be5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269951c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49502/0 (socket says 172.21.15.33:49502) 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b35be5640 1 -- 172.21.15.33:0/4158745131 learned_addr learned my addr 172.21.15.33:0/4158745131 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b363e6640 1 --2- 172.21.15.33:0/4158745131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x561626994c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.375+0000 7f4b353e4640 1 --2- 172.21.15.33:0/4158745131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x561626995700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b35be5640 1 -- 172.21.15.33:0/4158745131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 msgr2=0x561626994c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b35be5640 1 --2- 172.21.15.33:0/4158745131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x561626994c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b35be5640 1 -- 172.21.15.33:0/4158745131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 msgr2=0x561626995700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b35be5640 1 --2- 172.21.15.33:0/4158745131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x561626995700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b35be5640 1 -- 172.21.15.33:0/4158745131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162665ab00 con 0x5616265c6660 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b35be5640 1 --2- 172.21.15.33:0/4158745131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269951c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00cbf0 tx=0x7f4b2c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51c365889fa6a2b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b1bfff640 1 -- 172.21.15.33:0/4158745131 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c010630 con 0x5616265c6660 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b26ffd640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4b1c0b4c80 0x7f4b1c0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b1bfff640 1 -- 172.21.15.33:0/4158745131 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b2c010c80 con 0x5616265c6660 2024-08-28T19:35:22.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b1bfff640 1 -- 172.21.15.33:0/4158745131 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c019b40 con 0x5616265c6660 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b363e6640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4b1c0b4c80 0x7f4b1c0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.376+0000 7f4b26ffd640 1 -- 172.21.15.33:0/1612556745 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4b200e4e90 con 0x7f4b301092a0 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.377+0000 7f4b3e3be740 1 -- 172.21.15.33:0/4158745131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 msgr2=0x5616269951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.377+0000 7f4b363e6640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4b1c0b4c80 0x7f4b1c0b7190 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4b280094e0 tx=0x7f4b28009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.377+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/4158745131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269951c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00cbf0 tx=0x7f4b2c00e720 comp rx=0 tx=0).stop 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.377+0000 7f4b3e3be740 1 -- 172.21.15.33:0/4158745131 shutdown_connections 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.377+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/4158745131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x561626995700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.377+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/4158745131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269951c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.377+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/4158745131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x561626994c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.377+0000 7f4b3e3be740 1 -- 172.21.15.33:0/4158745131 >> 172.21.15.33:0/4158745131 conn(0x5616265e3910 msgr2=0x561626992b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.377+0000 7f4b3e3be740 1 -- 172.21.15.33:0/4158745131 shutdown_connections 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.377+0000 7f4b3e3be740 1 -- 172.21.15.33:0/4158745131 wait complete. 2024-08-28T19:35:22.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b3e3be740 1 -- start start 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b3e3be740 1 Processor -- start 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265c6660 0x5616269a0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ce840 0x5616269a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265ef520 0x5616269ac900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5616269a3460 con 0x5616265ef520 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5616268bc520 con 0x5616265c6660 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5616269a35e0 con 0x5616265ce840 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b3e3be740 10 client.0 _ll_register_callbacks cb 0x5616268f4c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b363e6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265ef520 0x5616269ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b363e6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265ef520 0x5616269ac900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49514/0 (socket says 172.21.15.33:49514) 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.378+0000 7f4b363e6640 1 -- 172.21.15.33:0/2031257699 learned_addr learned my addr 172.21.15.33:0/2031257699 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b35be5640 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265c6660 0x5616269a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b353e4640 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ce840 0x5616269a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b363e6640 1 -- 172.21.15.33:0/2031257699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ce840 msgr2=0x5616269a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b363e6640 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ce840 0x5616269a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b363e6640 1 -- 172.21.15.33:0/2031257699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265c6660 msgr2=0x5616269a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b363e6640 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265c6660 0x5616269a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b363e6640 1 -- 172.21.15.33:0/2031257699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616266d1960 con 0x5616265ef520 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b363e6640 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265ef520 0x5616269ac900 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4b28003c50 tx=0x7f4b280095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb11dcd0b7597b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b197fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b197fa640 1 -- 172.21.15.33:0/2031257699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b280307e0 con 0x5616265ef520 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b197fa640 1 -- 172.21.15.33:0/2031257699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4b28030980 con 0x5616265ef520 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b3e3be740 1 -- 172.21.15.33:0/2031257699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56162689a9a0 con 0x5616265ef520 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b197fa640 1 -- 172.21.15.33:0/2031257699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4b28003e90 con 0x5616265ef520 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b3e3be740 10 client.16323 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:22.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b3e3be740 1 -- 172.21.15.33:0/2031257699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616269af620 con 0x5616265ef520 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.379+0000 7f4b197fa640 1 -- 172.21.15.33:0/2031257699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56162689a9a0 con 0x5616265ef520 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.380+0000 7f4b197fa640 1 -- 172.21.15.33:0/2031257699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4b2804e020 con 0x5616265ef520 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.380+0000 7f4b3e3be740 10 client.16323 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.380+0000 7f4b3e3be740 10 client.16323 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.380+0000 7f4b3e3be740 20 client.16323 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.380+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5616265adea0 0x5616269b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.380+0000 7f4b3e3be740 4 client.16323 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.380+0000 7f4b3e3be740 1 -- 172.21.15.33:0/2031257699 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56162690d9c0 con 0x5616265adea0 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.380+0000 7f4b35be5640 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5616265adea0 0x5616269b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.380+0000 7f4b197fa640 10 client.16323 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.380+0000 7f4b35be5640 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5616265adea0 0x5616269b2b90 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e74e5e1e76d48fb7 server_cookie=87fa584b698e7f59 in_seq=0 out_seq=0 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b197fa640 1 -- 172.21.15.33:0/2031257699 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56162690d9c0 con 0x5616265adea0 2024-08-28T19:35:22.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b197fa640 10 client.16323 handle_command_reply: tid=0 2024-08-28T19:35:22.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 client.16323 shutdown 2024-08-28T19:35:22.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 -- 172.21.15.33:0/2031257699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265ef520 msgr2=0x5616269ac900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:22.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265ef520 0x5616269ac900 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4b28003c50 tx=0x7f4b280095c0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 -- 172.21.15.33:0/2031257699 shutdown_connections 2024-08-28T19:35:22.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5616265adea0 0x5616269b2b90 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265ef520 0x5616269ac900 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ce840 0x5616269a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/2031257699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265c6660 0x5616269a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b197fa640 0 client.16323 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:22.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 -- 172.21.15.33:0/2031257699 >> 172.21.15.33:0/2031257699 conn(0x5616265e3910 msgr2=0x561626997e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:22.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 -- 172.21.15.33:0/2031257699 shutdown_connections 2024-08-28T19:35:22.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.381+0000 7f4b3e3be740 1 -- 172.21.15.33:0/2031257699 wait complete. 2024-08-28T19:35:22.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.382+0000 7f4b3e3be740 20 client.16323 trim_cache size 0 max 16384 2024-08-28T19:35:22.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b3e3be740 1 Processor -- start 2024-08-28T19:35:22.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b3e3be740 1 -- start start 2024-08-28T19:35:22.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x56162699a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x561626992160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x5616269926a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b7230 con 0x5616265c6660 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b8d70 con 0x5616265ce840 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b7900 con 0x5616265ef520 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b35be5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x56162699a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b35be5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x56162699a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49530/0 (socket says 172.21.15.33:49530) 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b35be5640 1 -- 172.21.15.33:0/3966876587 learned_addr learned my addr 172.21.15.33:0/3966876587 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.399+0000 7f4b363e6640 1 --2- 172.21.15.33:0/3966876587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x5616269926a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b353e4640 1 --2- 172.21.15.33:0/3966876587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x561626992160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b35be5640 1 -- 172.21.15.33:0/3966876587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 msgr2=0x5616269926a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b35be5640 1 --2- 172.21.15.33:0/3966876587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x5616269926a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b35be5640 1 -- 172.21.15.33:0/3966876587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 msgr2=0x561626992160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b35be5640 1 --2- 172.21.15.33:0/3966876587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x561626992160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b35be5640 1 -- 172.21.15.33:0/3966876587 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616269a1950 con 0x5616265c6660 2024-08-28T19:35:22.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b353e4640 1 --2- 172.21.15.33:0/3966876587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x561626992160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:22.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b35be5640 1 --2- 172.21.15.33:0/3966876587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x56162699a4a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00cbf0 tx=0x7f4b2c00c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1bbbf14534cf9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:22.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b1b7fe640 1 -- 172.21.15.33:0/3966876587 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c029070 con 0x5616265c6660 2024-08-28T19:35:22.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b1b7fe640 1 -- 172.21.15.33:0/3966876587 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b2c004660 con 0x5616265c6660 2024-08-28T19:35:22.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.400+0000 7f4b1b7fe640 1 -- 172.21.15.33:0/3966876587 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c019890 con 0x5616265c6660 2024-08-28T19:35:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 -- 172.21.15.33:0/3966876587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 msgr2=0x56162699a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/3966876587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x56162699a4a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00cbf0 tx=0x7f4b2c00c4f0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 -- 172.21.15.33:0/3966876587 shutdown_connections 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/3966876587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x5616269926a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/3966876587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x561626992160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/3966876587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x56162699a4a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 -- 172.21.15.33:0/3966876587 >> 172.21.15.33:0/3966876587 conn(0x5616265e3910 msgr2=0x561626999d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 -- 172.21.15.33:0/3966876587 shutdown_connections 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 -- 172.21.15.33:0/3966876587 wait complete. 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 -- start start 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.401+0000 7f4b3e3be740 1 Processor -- start 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x5616269a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b3e3be740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x5616269a6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b86a0 con 0x5616265c6660 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b7fd0 con 0x5616265ce840 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b3e3be740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301b5210 con 0x5616265ef520 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b3e3be740 10 client.0 _ll_register_callbacks cb 0x7f4b28009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b35be5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b35be5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269a59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49538/0 (socket says 172.21.15.33:49538) 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b35be5640 1 -- 172.21.15.33:0/727635115 learned_addr learned my addr 172.21.15.33:0/727635115 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b353e4640 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x5616269a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b363e6640 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x5616269a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b35be5640 1 -- 172.21.15.33:0/727635115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 msgr2=0x5616269a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:22.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b35be5640 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x5616269a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b35be5640 1 -- 172.21.15.33:0/727635115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 msgr2=0x5616269a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b35be5640 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x5616269a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b35be5640 1 -- 172.21.15.33:0/727635115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561626a1d700 con 0x5616265c6660 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b353e4640 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x5616269a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.402+0000 7f4b363e6640 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x5616269a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b35be5640 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269a59b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00cfa0 tx=0x7f4b2c00cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4aa9b6aa6dbc681 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b197fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b197fa640 1 -- 172.21.15.33:0/727635115 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c029040 con 0x5616265c6660 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b197fa640 1 -- 172.21.15.33:0/727635115 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4b2c004810 con 0x5616265c6660 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b3e3be740 1 -- 172.21.15.33:0/727635115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b2c004660 con 0x5616265c6660 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b197fa640 1 -- 172.21.15.33:0/727635115 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4b2c004a10 con 0x5616265c6660 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b3e3be740 10 client.16329 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:22.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b3e3be740 1 -- 172.21.15.33:0/727635115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561626a1e930 con 0x5616265c6660 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b197fa640 1 -- 172.21.15.33:0/727635115 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b2c004660 con 0x5616265c6660 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b197fa640 1 -- 172.21.15.33:0/727635115 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4b2c0198a0 con 0x5616265c6660 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b3e3be740 10 client.16329 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b3e3be740 10 client.16329 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b3e3be740 20 client.16329 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561626583250 0x561626a20e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b3e3be740 4 client.16329 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c3ab418a", "release": true, "await": true}] 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.403+0000 7f4b3e3be740 1 -- 172.21.15.33:0/727635115 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c3ab418a", "release": true, "await": true}) -- 0x561626909460 con 0x561626583250 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.404+0000 7f4b353e4640 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561626583250 0x561626a20e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.404+0000 7f4b353e4640 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561626583250 0x561626a20e10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e103326eadbed862 server_cookie=5dc1d0b947d6a8e4 in_seq=0 out_seq=0 2024-08-28T19:35:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.404+0000 7f4b197fa640 10 client.16329 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b197fa640 1 -- 172.21.15.33:0/727635115 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x561626909460 con 0x561626583250 2024-08-28T19:35:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b197fa640 10 client.16329 handle_command_reply: tid=0 2024-08-28T19:35:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 client.16329 shutdown 2024-08-28T19:35:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 -- 172.21.15.33:0/727635115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 msgr2=0x5616269a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269a59b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00cfa0 tx=0x7f4b2c00cfd0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 -- 172.21.15.33:0/727635115 shutdown_connections 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616265ef520 0x5616269a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616265ce840 0x5616269a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561626583250 0x561626a20e10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 --2- 172.21.15.33:0/727635115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616265c6660 0x5616269a59b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 -- 172.21.15.33:0/727635115 >> 172.21.15.33:0/727635115 conn(0x5616265e3910 msgr2=0x5616269a1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b197fa640 0 client.16329 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 -- 172.21.15.33:0/727635115 shutdown_connections 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 1 -- 172.21.15.33:0/727635115 wait complete. 2024-08-28T19:35:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.409+0000 7f4b3e3be740 20 client.16329 trim_cache size 0 max 16384 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 8, 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: "c3ab418a": { 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 8, 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:35:22.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 146.6, 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:22.413 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:22.414 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:35:22.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 -- 172.21.15.33:0/1612556745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4b1c0b4c80 msgr2=0x7f4b1c0b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:22.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4b1c0b4c80 0x7f4b1c0b7190 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4b280094e0 tx=0x7f4b28009360 comp rx=0 tx=0).stop 2024-08-28T19:35:22.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 -- 172.21.15.33:0/1612556745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b301092a0 msgr2=0x7f4b301a0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:22.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b301092a0 0x7f4b301a0e80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4b20006fd0 tx=0x7f4b2000b8e0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 -- 172.21.15.33:0/1612556745 shutdown_connections 2024-08-28T19:35:22.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b30109bf0 0x7f4b301a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b301092a0 0x7f4b301a0e80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4b1c0b4c80 0x7f4b1c0b7190 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 --2- 172.21.15.33:0/1612556745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4b30101d60 0x7f4b301a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:22.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 -- 172.21.15.33:0/1612556745 >> 172.21.15.33:0/1612556745 conn(0x7f4b30079d30 msgr2=0x7f4b301072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:22.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 -- 172.21.15.33:0/1612556745 shutdown_connections 2024-08-28T19:35:22.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:22.410+0000 7f4b37e49640 1 -- 172.21.15.33:0/1612556745 wait complete. 2024-08-28T19:35:23.118 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c3ab418a', total seconds elapsed: 30.0 2024-08-28T19:35:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:23 smithi122 ceph-mon[22174]: pgmap v430: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:35:23.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:23 smithi033 ceph-mon[18549]: pgmap v430: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:35:24.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:23 smithi059 ceph-mon[22052]: pgmap v430: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-28T19:35:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:25 smithi122 ceph-mon[22174]: pgmap v431: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-08-28T19:35:25.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:25 smithi033 ceph-mon[18549]: pgmap v431: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-08-28T19:35:26.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:25 smithi059 ceph-mon[22052]: pgmap v431: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-08-28T19:35:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:27 smithi122 ceph-mon[22174]: pgmap v432: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-08-28T19:35:27.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:27 smithi033 ceph-mon[18549]: pgmap v432: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-08-28T19:35:28.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:27 smithi059 ceph-mon[22052]: pgmap v432: 129 pgs: 129 active+clean; 2.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-08-28T19:35:29.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:35:29.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:29 smithi033 ceph-mon[18549]: pgmap v433: 129 pgs: 129 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-08-28T19:35:29.957 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:30.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:29 smithi059 ceph-mon[22052]: pgmap v433: 129 pgs: 129 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-08-28T19:35:30.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:29 smithi122 ceph-mon[22174]: pgmap v433: 129 pgs: 129 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-08-28T19:35:30.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.458+0000 7ff70c42c640 1 -- 172.21.15.33:0/3749926376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7040754f0 msgr2=0x7ff704075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:30.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.458+0000 7ff70c42c640 1 --2- 172.21.15.33:0/3749926376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7040754f0 0x7ff704075900 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009ca0 tx=0x7ff6f402a8e0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.458+0000 7ff70c42c640 1 -- 172.21.15.33:0/3749926376 shutdown_connections 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.458+0000 7ff70c42c640 1 --2- 172.21.15.33:0/3749926376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff70410ff90 0x7ff7041123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.458+0000 7ff70c42c640 1 --2- 172.21.15.33:0/3749926376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff704075e40 0x7ff70410fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.458+0000 7ff70c42c640 1 --2- 172.21.15.33:0/3749926376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7040754f0 0x7ff704075900 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.458+0000 7ff70c42c640 1 -- 172.21.15.33:0/3749926376 >> 172.21.15.33:0/3749926376 conn(0x7ff70407b670 msgr2=0x7ff70407ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.458+0000 7ff70c42c640 1 -- 172.21.15.33:0/3749926376 shutdown_connections 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.458+0000 7ff70c42c640 1 -- 172.21.15.33:0/3749926376 wait complete. 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.459+0000 7ff70c42c640 1 Processor -- start 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.459+0000 7ff70c42c640 1 -- start start 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.459+0000 7ff70c42c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7040754f0 0x7ff70419c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.459+0000 7ff70c42c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff704075e40 0x7ff70419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.459+0000 7ff70c42c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff70410ff90 0x7ff7041a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.459+0000 7ff70c42c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff704115ac0 con 0x7ff704075e40 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.459+0000 7ff70c42c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff704115940 con 0x7ff7040754f0 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.459+0000 7ff70c42c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff704115c40 con 0x7ff70410ff90 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.459+0000 7ff7099c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff704075e40 0x7ff70419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7099c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff704075e40 0x7ff70419ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47638/0 (socket says 172.21.15.33:47638) 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7099c7640 1 -- 172.21.15.33:0/3221849832 learned_addr learned my addr 172.21.15.33:0/3221849832 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7040754f0 0x7ff70419c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff70a9c9640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff70410ff90 0x7ff7041a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7099c7640 1 -- 172.21.15.33:0/3221849832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff70410ff90 msgr2=0x7ff7041a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7099c7640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff70410ff90 0x7ff7041a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7099c7640 1 -- 172.21.15.33:0/3221849832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7040754f0 msgr2=0x7ff70419c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7099c7640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7040754f0 0x7ff70419c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7099c7640 1 -- 172.21.15.33:0/3221849832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7041a2440 con 0x7ff704075e40 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7040754f0 0x7ff70419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff70a9c9640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff70410ff90 0x7ff7041a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7099c7640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff704075e40 0x7ff70419ca70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8006fd0 tx=0x7ff6f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7037fe640 1 -- 172.21.15.33:0/3221849832 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8011830 con 0x7ff704075e40 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff70c42c640 1 -- 172.21.15.33:0/3221849832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7041a2730 con 0x7ff704075e40 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7037fe640 1 -- 172.21.15.33:0/3221849832 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6f8016070 con 0x7ff704075e40 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff7037fe640 1 -- 172.21.15.33:0/3221849832 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8010e00 con 0x7ff704075e40 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.460+0000 7ff70c42c640 1 -- 172.21.15.33:0/3221849832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7041a8f10 con 0x7ff704075e40 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.463+0000 7ff7129a1740 1 Processor -- start 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.463+0000 7ff7129a1740 1 -- start start 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.463+0000 7ff7037fe640 1 -- 172.21.15.33:0/3221849832 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff6f801b460 con 0x7ff704075e40 2024-08-28T19:35:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.463+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12585070 0x55ad1292a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.463+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad1255c1b0 0x55ad1292a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.463+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12564390 0x55ad1292ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.463+0000 7ff7129a1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ad128a1630 con 0x55ad12585070 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.463+0000 7ff7129a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ad12890bc0 con 0x55ad12564390 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.463+0000 7ff7129a1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad12894b70 con 0x55ad1255c1b0 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff70a9c9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12585070 0x55ad1292a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff70a9c9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12585070 0x55ad1292a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47648/0 (socket says 172.21.15.33:47648) 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff70a9c9640 1 -- 172.21.15.33:0/840371540 learned_addr learned my addr 172.21.15.33:0/840371540 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff7099c7640 1 --2- 172.21.15.33:0/840371540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12564390 0x55ad1292ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/840371540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad1255c1b0 0x55ad1292a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff70a9c9640 1 -- 172.21.15.33:0/840371540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad1255c1b0 msgr2=0x55ad1292a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff70a9c9640 1 --2- 172.21.15.33:0/840371540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad1255c1b0 0x55ad1292a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff70a9c9640 1 -- 172.21.15.33:0/840371540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12564390 msgr2=0x55ad1292ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff70a9c9640 1 --2- 172.21.15.33:0/840371540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12564390 0x55ad1292ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff70a9c9640 1 -- 172.21.15.33:0/840371540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad125f0650 con 0x55ad12585070 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff70a9c9640 1 --2- 172.21.15.33:0/840371540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12585070 0x55ad1292a2c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009bd0 tx=0x7ff6fc00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df9f18650d86740 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff700d9a640 1 -- 172.21.15.33:0/840371540 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc016070 con 0x55ad12585070 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff7037fe640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6ec0b4ca0 0x7ff6ec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff700d9a640 1 -- 172.21.15.33:0/840371540 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6fc011920 con 0x55ad12585070 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.464+0000 7ff700d9a640 1 -- 172.21.15.33:0/840371540 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc010790 con 0x55ad12585070 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.465+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6ec0b4ca0 0x7ff6ec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.465+0000 7ff7037fe640 1 -- 172.21.15.33:0/3221849832 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff6f80e4e90 con 0x7ff704075e40 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.465+0000 7ff7129a1740 1 -- 172.21.15.33:0/840371540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12585070 msgr2=0x55ad1292a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.465+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6ec0b4ca0 0x7ff6ec0b71b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009a60 tx=0x7ff6f4009890 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.465+0000 7ff7129a1740 1 --2- 172.21.15.33:0/840371540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12585070 0x55ad1292a2c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009bd0 tx=0x7ff6fc00e6c0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.465+0000 7ff7129a1740 1 -- 172.21.15.33:0/840371540 shutdown_connections 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.465+0000 7ff7129a1740 1 --2- 172.21.15.33:0/840371540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12564390 0x55ad1292ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.465+0000 7ff7129a1740 1 --2- 172.21.15.33:0/840371540 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad1255c1b0 0x55ad1292a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.465+0000 7ff7129a1740 1 --2- 172.21.15.33:0/840371540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12585070 0x55ad1292a2c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.465+0000 7ff7129a1740 1 -- 172.21.15.33:0/840371540 >> 172.21.15.33:0/840371540 conn(0x55ad12579460 msgr2=0x55ad129281b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 1 -- 172.21.15.33:0/840371540 shutdown_connections 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 1 -- 172.21.15.33:0/840371540 wait complete. 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 1 -- start start 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 1 Processor -- start 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad1255c1b0 0x55ad12935a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad12935fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12585070 0x55ad12941dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ad126f3700 con 0x55ad12564390 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ad12817700 con 0x55ad12585070 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ad12938aa0 con 0x55ad1255c1b0 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7129a1740 10 client.0 _ll_register_callbacks cb 0x55ad12846dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7099c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad12935fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7099c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad12935fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47654/0 (socket says 172.21.15.33:47654) 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.466+0000 7ff7099c7640 1 -- 172.21.15.33:0/1576308006 learned_addr learned my addr 172.21.15.33:0/1576308006 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff70a9c9640 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12585070 0x55ad12941dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad1255c1b0 0x55ad12935a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff7099c7640 1 -- 172.21.15.33:0/1576308006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad1255c1b0 msgr2=0x55ad12935a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff7099c7640 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad1255c1b0 0x55ad12935a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff7099c7640 1 -- 172.21.15.33:0/1576308006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12585070 msgr2=0x55ad12941dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff7099c7640 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12585070 0x55ad12941dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff7099c7640 1 -- 172.21.15.33:0/1576308006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad128508b0 con 0x55ad12564390 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff7099c7640 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad12935fd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800bde0 tx=0x7ff6f80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f9145071666c7a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff6e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/1576308006 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8021250 con 0x55ad12564390 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/1576308006 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff6f80a74c0 con 0x55ad12564390 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff7129a1740 1 -- 172.21.15.33:0/1576308006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6fc011920 con 0x55ad12564390 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/1576308006 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff6f80aad40 con 0x55ad12564390 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff7129a1740 10 client.16341 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff7129a1740 1 -- 172.21.15.33:0/1576308006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad129448a0 con 0x55ad12564390 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.467+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/1576308006 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6fc011920 con 0x55ad12564390 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.468+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/1576308006 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff6f80a6ba0 con 0x55ad12564390 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.468+0000 7ff7129a1740 10 client.16341 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.468+0000 7ff7129a1740 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.468+0000 7ff7129a1740 20 client.16341 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.468+0000 7ff7129a1740 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ad125439f0 0x55ad12947d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.468+0000 7ff7129a1740 4 client.16341 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.468+0000 7ff7129a1740 1 -- 172.21.15.33:0/1576308006 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad128a3580 con 0x55ad125439f0 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.468+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ad125439f0 0x55ad12947d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.468+0000 7ff6e9ffb640 10 client.16341 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.468+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ad125439f0 0x55ad12947d70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3d97f2308f112e9 server_cookie=fe684f28eaacb3f2 in_seq=0 out_seq=0 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/1576308006 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad128a3580 con 0x55ad125439f0 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff6e9ffb640 10 client.16341 handle_command_reply: tid=0 2024-08-28T19:35:30.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 client.16341 shutdown 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 -- 172.21.15.33:0/1576308006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 msgr2=0x55ad12935fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad12935fd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800bde0 tx=0x7ff6f80047d0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 -- 172.21.15.33:0/1576308006 shutdown_connections 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12585070 0x55ad12941dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ad125439f0 0x55ad12947d70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad12935fd0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 --2- 172.21.15.33:0/1576308006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad1255c1b0 0x55ad12935a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff6e9ffb640 0 client.16341 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 -- 172.21.15.33:0/1576308006 >> 172.21.15.33:0/1576308006 conn(0x55ad12579460 msgr2=0x55ad1292d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 -- 172.21.15.33:0/1576308006 shutdown_connections 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.469+0000 7ff7129a1740 1 -- 172.21.15.33:0/1576308006 wait complete. 2024-08-28T19:35:30.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.470+0000 7ff7129a1740 20 client.16341 trim_cache size 0 max 16384 2024-08-28T19:35:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.487+0000 7ff7129a1740 1 Processor -- start 2024-08-28T19:35:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.487+0000 7ff7129a1740 1 -- start start 2024-08-28T19:35:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.487+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad1255c1b0 0x55ad12941cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.487+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad1292d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.487+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad12585070 0x55ad1292d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7129a1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff7041b2e30 con 0x55ad12564390 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7129a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff7041b4970 con 0x55ad1255c1b0 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7129a1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff7041b3500 con 0x55ad12585070 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7099c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad1292d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7099c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad1292d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47658/0 (socket says 172.21.15.33:47658) 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7099c7640 1 -- 172.21.15.33:0/2520642998 learned_addr learned my addr 172.21.15.33:0/2520642998 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/2520642998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad1255c1b0 0x55ad12941cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff70a9c9640 1 --2- 172.21.15.33:0/2520642998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad12585070 0x55ad1292d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7099c7640 1 -- 172.21.15.33:0/2520642998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad12585070 msgr2=0x55ad1292d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:30.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7099c7640 1 --2- 172.21.15.33:0/2520642998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad12585070 0x55ad1292d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7099c7640 1 -- 172.21.15.33:0/2520642998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad1255c1b0 msgr2=0x55ad12941cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7099c7640 1 --2- 172.21.15.33:0/2520642998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad1255c1b0 0x55ad12941cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7099c7640 1 -- 172.21.15.33:0/2520642998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad129286f0 con 0x55ad12564390 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/2520642998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad1255c1b0 0x55ad12941cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff7099c7640 1 --2- 172.21.15.33:0/2520642998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad1292d3c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80a72b0 tx=0x7ff6f8010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c524499b0e2af283 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff6ebfff640 1 -- 172.21.15.33:0/2520642998 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8021250 con 0x55ad12564390 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff6ebfff640 1 -- 172.21.15.33:0/2520642998 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6f80ab930 con 0x55ad12564390 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.488+0000 7ff6ebfff640 1 -- 172.21.15.33:0/2520642998 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80aa9a0 con 0x55ad12564390 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.489+0000 7ff7129a1740 1 -- 172.21.15.33:0/2520642998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 msgr2=0x55ad1292d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.489+0000 7ff7129a1740 1 --2- 172.21.15.33:0/2520642998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad1292d3c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80a72b0 tx=0x7ff6f8010680 comp rx=0 tx=0).stop 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.489+0000 7ff7129a1740 1 -- 172.21.15.33:0/2520642998 shutdown_connections 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.489+0000 7ff7129a1740 1 --2- 172.21.15.33:0/2520642998 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad12585070 0x55ad1292d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.489+0000 7ff7129a1740 1 --2- 172.21.15.33:0/2520642998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad12564390 0x55ad1292d3c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.489+0000 7ff7129a1740 1 --2- 172.21.15.33:0/2520642998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad1255c1b0 0x55ad12941cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.489+0000 7ff7129a1740 1 -- 172.21.15.33:0/2520642998 >> 172.21.15.33:0/2520642998 conn(0x55ad12579460 msgr2=0x55ad12934310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.489+0000 7ff7129a1740 1 -- 172.21.15.33:0/2520642998 shutdown_connections 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.489+0000 7ff7129a1740 1 -- 172.21.15.33:0/2520642998 wait complete. 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff7129a1740 1 -- start start 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff7129a1740 1 Processor -- start 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad1255c1b0 0x55ad1293a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad12564390 0x55ad1293a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff7129a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12585070 0x55ad129b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff7129a1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff7041b42a0 con 0x55ad1255c1b0 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff7129a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff7041b3bd0 con 0x55ad12585070 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff7129a1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff7041b0e10 con 0x55ad12564390 2024-08-28T19:35:30.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff7129a1740 10 client.0 _ll_register_callbacks cb 0x7ff6f8010720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:30.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff70a1c8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad1255c1b0 0x55ad1293a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff70a1c8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad1255c1b0 0x55ad1293a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47674/0 (socket says 172.21.15.33:47674) 2024-08-28T19:35:30.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff70a1c8640 1 -- 172.21.15.33:0/710357421 learned_addr learned my addr 172.21.15.33:0/710357421 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:30.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff7099c7640 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad12564390 0x55ad1293a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff70a9c9640 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12585070 0x55ad129b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff70a1c8640 1 -- 172.21.15.33:0/710357421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad12564390 msgr2=0x55ad1293a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:30.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad12564390 0x55ad1293a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff70a1c8640 1 -- 172.21.15.33:0/710357421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12585070 msgr2=0x55ad129b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:30.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12585070 0x55ad129b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.490+0000 7ff70a1c8640 1 -- 172.21.15.33:0/710357421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad129b1c10 con 0x55ad1255c1b0 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff70a1c8640 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad1255c1b0 0x55ad1293a450 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009ca0 tx=0x7ff6f40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d351e856ff951766 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff6e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/710357421 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4004720 con 0x55ad1255c1b0 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/710357421 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7ff6f40305e0 con 0x55ad1255c1b0 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff7129a1740 1 -- 172.21.15.33:0/710357421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6f80ab930 con 0x55ad1255c1b0 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/710357421 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff6f4061050 con 0x55ad1255c1b0 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff7129a1740 10 client.16347 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff7129a1740 1 -- 172.21.15.33:0/710357421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad129b2ed0 con 0x55ad1255c1b0 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/710357421 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6f80ab930 con 0x55ad1255c1b0 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/710357421 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff6f4057030 con 0x55ad1255c1b0 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff7129a1740 10 client.16347 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff7129a1740 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff7129a1740 20 client.16347 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:30.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff7129a1740 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ad12518da0 0x55ad129b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:30.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff7129a1740 4 client.16347 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:35:30.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.491+0000 7ff7129a1740 1 -- 172.21.15.33:0/710357421 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ad1289f020 con 0x55ad12518da0 2024-08-28T19:35:30.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.492+0000 7ff7099c7640 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ad12518da0 0x55ad129b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:30.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.492+0000 7ff7099c7640 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ad12518da0 0x55ad129b56f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70db21dbc1ad199a server_cookie=861728771c68ec7c in_seq=0 out_seq=0 2024-08-28T19:35:30.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.492+0000 7ff6e9ffb640 10 client.16347 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:30.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff6e9ffb640 1 -- 172.21.15.33:0/710357421 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55ad1289f020 con 0x55ad12518da0 2024-08-28T19:35:30.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff6e9ffb640 10 client.16347 handle_command_reply: tid=0 2024-08-28T19:35:30.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 client.16347 shutdown 2024-08-28T19:35:30.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 -- 172.21.15.33:0/710357421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad1255c1b0 msgr2=0x55ad1293a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:30.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad1255c1b0 0x55ad1293a450 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009ca0 tx=0x7ff6f40095c0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 -- 172.21.15.33:0/710357421 shutdown_connections 2024-08-28T19:35:30.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad12585070 0x55ad129b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ad12564390 0x55ad1293a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ad12518da0 0x55ad129b56f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 --2- 172.21.15.33:0/710357421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ad1255c1b0 0x55ad1293a450 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff6e9ffb640 0 client.16347 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:30.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 -- 172.21.15.33:0/710357421 >> 172.21.15.33:0/710357421 conn(0x55ad12579460 msgr2=0x55ad12933ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:30.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 -- 172.21.15.33:0/710357421 shutdown_connections 2024-08-28T19:35:30.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 1 -- 172.21.15.33:0/710357421 wait complete. 2024-08-28T19:35:30.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff7129a1740 20 client.16347 trim_cache size 0 max 16384 2024-08-28T19:35:30.505 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:35:30.505 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:35:30.505 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:35:30.505 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:35:30.505 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:35:30.505 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:35:30.506 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:30.506 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:30.506 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:30.506 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:30.506 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:30.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:30.506 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:35:30.507 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:35:30.507 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:30.507 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:30.507 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:30.507 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:30.507 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:30.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:30.508 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:35:30.508 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:35:30.508 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:30.508 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:30.508 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:30.509 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:30.509 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:30.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:30.509 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:35:30.509 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:35:30.509 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:30.510 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:30.510 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:30.510 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:30.510 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:30.510 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:30.510 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:30.510 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:35:30.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff70c42c640 1 -- 172.21.15.33:0/3221849832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6ec0b4ca0 msgr2=0x7ff6ec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:30.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff70c42c640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6ec0b4ca0 0x7ff6ec0b71b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009a60 tx=0x7ff6f4009890 comp rx=0 tx=0).stop 2024-08-28T19:35:30.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff70c42c640 1 -- 172.21.15.33:0/3221849832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff704075e40 msgr2=0x7ff70419ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:30.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.493+0000 7ff70c42c640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff704075e40 0x7ff70419ca70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8006fd0 tx=0x7ff6f800b8e0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.494+0000 7ff70c42c640 1 -- 172.21.15.33:0/3221849832 shutdown_connections 2024-08-28T19:35:30.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.494+0000 7ff70c42c640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff6ec0b4ca0 0x7ff6ec0b71b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.494+0000 7ff70c42c640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff70410ff90 0x7ff7041a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.494+0000 7ff70c42c640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff704075e40 0x7ff70419ca70 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.494+0000 7ff70c42c640 1 --2- 172.21.15.33:0/3221849832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7040754f0 0x7ff70419c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:30.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.494+0000 7ff70c42c640 1 -- 172.21.15.33:0/3221849832 >> 172.21.15.33:0/3221849832 conn(0x7ff70407b670 msgr2=0x7ff704109b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:30.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.494+0000 7ff70c42c640 1 -- 172.21.15.33:0/3221849832 shutdown_connections 2024-08-28T19:35:30.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:30.494+0000 7ff70c42c640 1 -- 172.21.15.33:0/3221849832 wait complete. 2024-08-28T19:35:31.415 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:35:31.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:35:31.678 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:31.799 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:31 smithi033 ceph-mon[18549]: pgmap v434: 129 pgs: 129 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-08-28T19:35:32.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:31 smithi059 ceph-mon[22052]: pgmap v434: 129 pgs: 129 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-08-28T19:35:32.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:31 smithi122 ceph-mon[22174]: pgmap v434: 129 pgs: 129 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-08-28T19:35:32.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.141+0000 7f07e8d48640 1 -- 172.21.15.33:0/656635711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e4108170 msgr2=0x7f07e4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:32.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.141+0000 7f07e8d48640 1 --2- 172.21.15.33:0/656635711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e4108170 0x7f07e4108580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009900 tx=0x7f07cc02a410 comp rx=0 tx=0).stop 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.141+0000 7f07e8d48640 1 -- 172.21.15.33:0/656635711 shutdown_connections 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.141+0000 7f07e8d48640 1 --2- 172.21.15.33:0/656635711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e4108ac0 0x7f07e410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.141+0000 7f07e8d48640 1 --2- 172.21.15.33:0/656635711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e4108170 0x7f07e4108580 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.141+0000 7f07e8d48640 1 --2- 172.21.15.33:0/656635711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07e4102880 0x7f07e4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.141+0000 7f07e8d48640 1 -- 172.21.15.33:0/656635711 >> 172.21.15.33:0/656635711 conn(0x7f07e4079530 msgr2=0x7f07e4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.141+0000 7f07e8d48640 1 -- 172.21.15.33:0/656635711 shutdown_connections 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.141+0000 7f07e8d48640 1 -- 172.21.15.33:0/656635711 wait complete. 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.142+0000 7f07e8d48640 1 Processor -- start 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.142+0000 7f07e8d48640 1 -- start start 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07e8d48640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e4102880 0x7f07e40ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07e8d48640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e4108170 0x7f07e40ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07e8d48640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07e4108ac0 0x7f07e40ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07e8d48640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f07e4112750 con 0x7f07e4108170 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07e8d48640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f07e41125d0 con 0x7f07e4102880 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07e8d48640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f07e41128d0 con 0x7f07e4108ac0 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e4108170 0x7f07e40ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e4108170 0x7f07e40ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47700/0 (socket says 172.21.15.33:47700) 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07dbfff640 1 -- 172.21.15.33:0/374675395 learned_addr learned my addr 172.21.15.33:0/374675395 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07e259c640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e4102880 0x7f07e40ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07e2d9d640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07e4108ac0 0x7f07e40ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07dbfff640 1 -- 172.21.15.33:0/374675395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07e4108ac0 msgr2=0x7f07e40ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07dbfff640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07e4108ac0 0x7f07e40ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07dbfff640 1 -- 172.21.15.33:0/374675395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e4102880 msgr2=0x7f07e40ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07dbfff640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e4102880 0x7f07e40ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07dbfff640 1 -- 172.21.15.33:0/374675395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e41a8550 con 0x7f07e4108170 2024-08-28T19:35:32.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07dbfff640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e4108170 0x7f07e40ff950 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f07cc006010 tx=0x7f07cc004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.143+0000 7f07db7fe640 1 -- 172.21.15.33:0/374675395 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc03f030 con 0x7f07e4108170 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.144+0000 7f07e8d48640 1 -- 172.21.15.33:0/374675395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e41a87e0 con 0x7f07e4108170 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.144+0000 7f07db7fe640 1 -- 172.21.15.33:0/374675395 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07cc003aa0 con 0x7f07e4108170 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.144+0000 7f07db7fe640 1 -- 172.21.15.33:0/374675395 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc035070 con 0x7f07e4108170 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.144+0000 7f07e8d48640 1 -- 172.21.15.33:0/374675395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e41a8cc0 con 0x7f07e4108170 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.145+0000 7f07e8d48640 1 -- 172.21.15.33:0/374675395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e4103ab0 con 0x7f07e4108170 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.146+0000 7f07db7fe640 1 -- 172.21.15.33:0/374675395 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f07cc042030 con 0x7f07e4108170 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.147+0000 7f07db7fe640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07d00b4ca0 0x7f07d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.147+0000 7f07e259c640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07d00b4ca0 0x7f07d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.147+0000 7f07db7fe640 1 -- 172.21.15.33:0/374675395 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f07cc1061a0 con 0x7f07e4108170 2024-08-28T19:35:32.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.148+0000 7f07e259c640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07d00b4ca0 0x7f07d00b71b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f07e4100e60 tx=0x7f07d4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:32.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.151+0000 7f07db7fe640 1 -- 172.21.15.33:0/374675395 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f07cc0cc590 con 0x7f07e4108170 2024-08-28T19:35:32.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.372+0000 7f07e8d48640 1 -- 172.21.15.33:0/374675395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07e4102c90 con 0x7f07e4108170 2024-08-28T19:35:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.373+0000 7f07db7fe640 1 -- 172.21.15.33:0/374675395 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f07cc0d0d50 con 0x7f07e4108170 2024-08-28T19:35:32.374 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:35:32.374 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:35:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:35:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 -- 172.21.15.33:0/374675395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07d00b4ca0 msgr2=0x7f07d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07d00b4ca0 0x7f07d00b71b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f07e4100e60 tx=0x7f07d4005f90 comp rx=0 tx=0).stop 2024-08-28T19:35:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 -- 172.21.15.33:0/374675395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e4108170 msgr2=0x7f07e40ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e4108170 0x7f07e40ff950 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f07cc006010 tx=0x7f07cc004060 comp rx=0 tx=0).stop 2024-08-28T19:35:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 -- 172.21.15.33:0/374675395 shutdown_connections 2024-08-28T19:35:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07d00b4ca0 0x7f07d00b71b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f07e4108ac0 0x7f07e40ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e4108170 0x7f07e40ff950 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 --2- 172.21.15.33:0/374675395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e4102880 0x7f07e40ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 -- 172.21.15.33:0/374675395 >> 172.21.15.33:0/374675395 conn(0x7f07e4079530 msgr2=0x7f07e41016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 -- 172.21.15.33:0/374675395 shutdown_connections 2024-08-28T19:35:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:32.375+0000 7f07e8d48640 1 -- 172.21.15.33:0/374675395 wait complete. 2024-08-28T19:35:32.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:32 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/374675395' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:35:33.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:32 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/374675395' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:35:33.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:32 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/374675395' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:35:33.148 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:35:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:33.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:33 smithi033 ceph-mon[18549]: pgmap v435: 129 pgs: 129 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-28T19:35:33.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 -- 172.21.15.33:0/2020008731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faba4105880 msgr2=0x7faba410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:33.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 --2- 172.21.15.33:0/2020008731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faba4105880 0x7faba410f2d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009be0 tx=0x7fab9c02a6c0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 -- 172.21.15.33:0/2020008731 shutdown_connections 2024-08-28T19:35:33.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 --2- 172.21.15.33:0/2020008731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faba4105880 0x7faba410f2d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 --2- 172.21.15.33:0/2020008731 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faba4104f30 0x7faba4105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 --2- 172.21.15.33:0/2020008731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba4102f60 0x7faba4103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 -- 172.21.15.33:0/2020008731 >> 172.21.15.33:0/2020008731 conn(0x7faba4077a00 msgr2=0x7faba4077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:33.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 -- 172.21.15.33:0/2020008731 shutdown_connections 2024-08-28T19:35:33.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 -- 172.21.15.33:0/2020008731 wait complete. 2024-08-28T19:35:33.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 Processor -- start 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.886+0000 7fabaabbd640 1 -- start start 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7fabaabbd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba4102f60 0x7faba40feb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7fabaabbd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faba4104f30 0x7faba40ff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7fabaabbd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faba4105880 0x7faba40ff600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7fabaabbd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faba4112740 con 0x7faba4105880 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7fabaabbd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faba41125c0 con 0x7faba4102f60 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7fabaabbd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faba41128c0 con 0x7faba4104f30 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba915a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faba4105880 0x7faba40ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba915a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faba4105880 0x7faba40ff600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47722/0 (socket says 172.21.15.33:47722) 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba915a640 1 -- 172.21.15.33:0/770242894 learned_addr learned my addr 172.21.15.33:0/770242894 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba8959640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba4102f60 0x7faba40feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba3fff640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faba4104f30 0x7faba40ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba915a640 1 -- 172.21.15.33:0/770242894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faba4104f30 msgr2=0x7faba40ff0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba915a640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faba4104f30 0x7faba40ff0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba915a640 1 -- 172.21.15.33:0/770242894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba4102f60 msgr2=0x7faba40feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba915a640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba4102f60 0x7faba40feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba915a640 1 -- 172.21.15.33:0/770242894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba41a84a0 con 0x7faba4105880 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba915a640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faba4105880 0x7faba40ff600 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fab9c004af0 tx=0x7fab9c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba1ffb640 1 -- 172.21.15.33:0/770242894 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c041020 con 0x7faba4105880 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7fabaabbd640 1 -- 172.21.15.33:0/770242894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba41a8730 con 0x7faba4105880 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.887+0000 7faba1ffb640 1 -- 172.21.15.33:0/770242894 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9c003e10 con 0x7faba4105880 2024-08-28T19:35:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.888+0000 7faba1ffb640 1 -- 172.21.15.33:0/770242894 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c036040 con 0x7faba4105880 2024-08-28T19:35:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.888+0000 7fabaabbd640 1 -- 172.21.15.33:0/770242894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba41a8c60 con 0x7faba4105880 2024-08-28T19:35:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.890+0000 7fabb1132740 1 Processor -- start 2024-08-28T19:35:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.890+0000 7faba1ffb640 1 -- 172.21.15.33:0/770242894 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fab9c044020 con 0x7faba4105880 2024-08-28T19:35:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.890+0000 7fabb1132740 1 -- start start 2024-08-28T19:35:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7fabb1132740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad49e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7fabb1132740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad49e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7fabb1132740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad49edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7fabb1132740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5588ad415680 con 0x5588ad0f9070 2024-08-28T19:35:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7fabb1132740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5588ad404c10 con 0x5588ad0d01b0 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7fabb1132740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588ad408bc0 con 0x5588ad0d8390 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad49e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad49e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47734/0 (socket says 172.21.15.33:47734) 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba3fff640 1 -- 172.21.15.33:0/2266270443 learned_addr learned my addr 172.21.15.33:0/2266270443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba3fff640 1 --2- 172.21.15.33:0/2266270443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad49edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba8959640 1 --2- 172.21.15.33:0/2266270443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad49e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba1ffb640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab940b4ca0 0x7fab940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba3fff640 1 -- 172.21.15.33:0/2266270443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 msgr2=0x5588ad49edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba3fff640 1 --2- 172.21.15.33:0/2266270443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad49edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba3fff640 1 -- 172.21.15.33:0/2266270443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 msgr2=0x5588ad49e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba3fff640 1 --2- 172.21.15.33:0/2266270443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad49e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba915a640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab940b4ca0 0x7fab940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba3fff640 1 -- 172.21.15.33:0/2266270443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ad164650 con 0x5588ad0f9070 2024-08-28T19:35:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba1ffb640 1 -- 172.21.15.33:0/770242894 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fab9c1065b0 con 0x7faba4105880 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.891+0000 7faba3fff640 1 --2- 172.21.15.33:0/2266270443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad49e350 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fab900157e0 tx=0x7fab90009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb83f9969d0bfb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.892+0000 7fab8effd640 1 -- 172.21.15.33:0/2266270443 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90015e20 con 0x5588ad0f9070 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.892+0000 7faba915a640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab940b4ca0 0x7fab940b71b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fab9c103a60 tx=0x7fab9c098b50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.892+0000 7fab8effd640 1 -- 172.21.15.33:0/2266270443 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9000eba0 con 0x5588ad0f9070 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.892+0000 7fab8effd640 1 -- 172.21.15.33:0/2266270443 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90010800 con 0x5588ad0f9070 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 -- 172.21.15.33:0/2266270443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 msgr2=0x5588ad49e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 --2- 172.21.15.33:0/2266270443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad49e350 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fab900157e0 tx=0x7fab90009670 comp rx=0 tx=0).stop 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 -- 172.21.15.33:0/2266270443 shutdown_connections 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 --2- 172.21.15.33:0/2266270443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad49edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 --2- 172.21.15.33:0/2266270443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad49e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 --2- 172.21.15.33:0/2266270443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad49e350 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 -- 172.21.15.33:0/2266270443 >> 172.21.15.33:0/2266270443 conn(0x5588ad0ed460 msgr2=0x5588ad49c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 -- 172.21.15.33:0/2266270443 shutdown_connections 2024-08-28T19:35:33.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 -- 172.21.15.33:0/2266270443 wait complete. 2024-08-28T19:35:33.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 -- start start 2024-08-28T19:35:33.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.893+0000 7fabb1132740 1 Processor -- start 2024-08-28T19:35:33.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7fabb1132740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad4a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7fabb1132740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad4a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7fabb1132740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7fabb1132740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5588ad267700 con 0x5588ad0f9070 2024-08-28T19:35:33.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7fabb1132740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5588ad38b750 con 0x5588ad0d01b0 2024-08-28T19:35:33.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7fabb1132740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5588ad4acad0 con 0x5588ad0d8390 2024-08-28T19:35:33.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7fabb1132740 10 client.0 _ll_register_callbacks cb 0x5588ad3bae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47748/0 (socket says 172.21.15.33:47748) 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba3fff640 1 -- 172.21.15.33:0/1997193842 learned_addr learned my addr 172.21.15.33:0/1997193842 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba8959640 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad4a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba3fff640 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad4a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba3fff640 1 -- 172.21.15.33:0/1997193842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 msgr2=0x5588ad4a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba3fff640 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad4a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba3fff640 1 -- 172.21.15.33:0/1997193842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 msgr2=0x5588ad4a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba3fff640 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad4a9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba3fff640 1 -- 172.21.15.33:0/1997193842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ad3c4900 con 0x5588ad0f9070 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7faba3fff640 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b5dc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fab9000efd0 tx=0x7fab900104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9587ce07b7e596a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.894+0000 7fab83fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:33.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fab83fff640 1 -- 172.21.15.33:0/1997193842 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90025070 con 0x5588ad0f9070 2024-08-28T19:35:33.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fab83fff640 1 -- 172.21.15.33:0/1997193842 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fab9000e8f0 con 0x5588ad0f9070 2024-08-28T19:35:33.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fabb1132740 1 -- 172.21.15.33:0/1997193842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab9000eba0 con 0x5588ad0f9070 2024-08-28T19:35:33.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fab83fff640 1 -- 172.21.15.33:0/1997193842 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fab90010580 con 0x5588ad0f9070 2024-08-28T19:35:33.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fabb1132740 10 client.16365 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:33.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fabb1132740 1 -- 172.21.15.33:0/1997193842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5588ad4b8840 con 0x5588ad0f9070 2024-08-28T19:35:33.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fab83fff640 1 -- 172.21.15.33:0/1997193842 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9000eba0 con 0x5588ad0f9070 2024-08-28T19:35:33.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fab83fff640 1 -- 172.21.15.33:0/1997193842 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fab9000f040 con 0x5588ad0f9070 2024-08-28T19:35:33.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fabb1132740 10 client.16365 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:33.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fabb1132740 10 client.16365 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:35:33.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fabb1132740 20 client.16365 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fabb1132740 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5588ad0b79f0 0x5588ad4bbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fabb1132740 4 client.16365 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.895+0000 7fabb1132740 1 -- 172.21.15.33:0/1997193842 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588ad4175d0 con 0x5588ad0b79f0 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.896+0000 7faba8959640 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5588ad0b79f0 0x5588ad4bbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.896+0000 7fab83fff640 10 client.16365 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.896+0000 7faba8959640 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5588ad0b79f0 0x5588ad4bbc50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=55add497380a58c7 server_cookie=5ae5d648e318aff0 in_seq=0 out_seq=0 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fab83fff640 1 -- 172.21.15.33:0/1997193842 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588ad4175d0 con 0x5588ad0b79f0 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fab83fff640 10 client.16365 handle_command_reply: tid=0 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 client.16365 shutdown 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 -- 172.21.15.33:0/1997193842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 msgr2=0x5588ad4b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:33.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b5dc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fab9000efd0 tx=0x7fab900104a0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 -- 172.21.15.33:0/1997193842 shutdown_connections 2024-08-28T19:35:33.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5588ad0b79f0 0x5588ad4bbc50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b5dc0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad4a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 --2- 172.21.15.33:0/1997193842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad4a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fab83fff640 0 client.16365 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:35:33.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 -- 172.21.15.33:0/1997193842 >> 172.21.15.33:0/1997193842 conn(0x5588ad0ed460 msgr2=0x5588ad4a1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:33.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 -- 172.21.15.33:0/1997193842 shutdown_connections 2024-08-28T19:35:33.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 1 -- 172.21.15.33:0/1997193842 wait complete. 2024-08-28T19:35:33.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.897+0000 7fabb1132740 20 client.16365 trim_cache size 0 max 16384 2024-08-28T19:35:33.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7fabb1132740 1 Processor -- start 2024-08-28T19:35:33.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7fabb1132740 1 -- start start 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7fabb1132740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0d01b0 0x5588ad49fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7fabb1132740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d8390 0x5588ad4ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7fabb1132740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0f9070 0x5588ad4b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7fabb1132740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b2d60 con 0x5588ad0d01b0 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7fabb1132740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b48a0 con 0x5588ad0d8390 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7fabb1132740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b3430 con 0x5588ad0f9070 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7faba3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0d01b0 0x5588ad49fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7faba3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0d01b0 0x5588ad49fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47760/0 (socket says 172.21.15.33:47760) 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7faba3fff640 1 -- 172.21.15.33:0/1963429407 learned_addr learned my addr 172.21.15.33:0/1963429407 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7faba3fff640 1 -- 172.21.15.33:0/1963429407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0f9070 msgr2=0x5588ad4b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7faba3fff640 1 --2- 172.21.15.33:0/1963429407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0f9070 0x5588ad4b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7faba3fff640 1 -- 172.21.15.33:0/1963429407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d8390 msgr2=0x5588ad4ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7faba3fff640 1 --2- 172.21.15.33:0/1963429407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d8390 0x5588ad4ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7faba3fff640 1 -- 172.21.15.33:0/1963429407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ad4a0be0 con 0x5588ad0d01b0 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.911+0000 7faba3fff640 1 --2- 172.21.15.33:0/1963429407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0d01b0 0x5588ad49fd40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fab900099c0 tx=0x7fab90009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af425e8b9f98da7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fab8e7fc640 1 -- 172.21.15.33:0/1963429407 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90025070 con 0x5588ad0d01b0 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fab8e7fc640 1 -- 172.21.15.33:0/1963429407 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9000eb70 con 0x5588ad0d01b0 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fab8e7fc640 1 -- 172.21.15.33:0/1963429407 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90021de0 con 0x5588ad0d01b0 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fabb1132740 1 -- 172.21.15.33:0/1963429407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0d01b0 msgr2=0x5588ad49fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fabb1132740 1 --2- 172.21.15.33:0/1963429407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0d01b0 0x5588ad49fd40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fab900099c0 tx=0x7fab90009f70 comp rx=0 tx=0).stop 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fabb1132740 1 -- 172.21.15.33:0/1963429407 shutdown_connections 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fabb1132740 1 --2- 172.21.15.33:0/1963429407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0f9070 0x5588ad4b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fabb1132740 1 --2- 172.21.15.33:0/1963429407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d8390 0x5588ad4ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fabb1132740 1 --2- 172.21.15.33:0/1963429407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0d01b0 0x5588ad49fd40 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fabb1132740 1 -- 172.21.15.33:0/1963429407 >> 172.21.15.33:0/1963429407 conn(0x5588ad0ed460 msgr2=0x5588ad4aafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.912+0000 7fabb1132740 1 -- 172.21.15.33:0/1963429407 shutdown_connections 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.913+0000 7fabb1132740 1 -- 172.21.15.33:0/1963429407 wait complete. 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.913+0000 7fabb1132740 1 -- start start 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.913+0000 7fabb1132740 1 Processor -- start 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.913+0000 7fabb1132740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad4afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7fabb1132740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad4b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7fabb1132740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7fabb1132740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b41d0 con 0x5588ad0f9070 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7fabb1132740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b3b00 con 0x5588ad0d01b0 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7fabb1132740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faba41b0d40 con 0x5588ad0d8390 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7fabb1132740 10 client.0 _ll_register_callbacks cb 0x7fab98009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47772/0 (socket says 172.21.15.33:47772) 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba3fff640 1 -- 172.21.15.33:0/846539727 learned_addr learned my addr 172.21.15.33:0/846539727 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba3fff640 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad4afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba8959640 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad4b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba3fff640 1 -- 172.21.15.33:0/846539727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 msgr2=0x5588ad4b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba3fff640 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad4b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba3fff640 1 -- 172.21.15.33:0/846539727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 msgr2=0x5588ad4afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba3fff640 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad4afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba3fff640 1 -- 172.21.15.33:0/846539727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ad525460 con 0x5588ad0f9070 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba8959640 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad4b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7faba3fff640 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b0750 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fab90001eb0 tx=0x7fab90015f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75605f3c3e993da2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7fab83fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7fab83fff640 1 -- 172.21.15.33:0/846539727 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90025030 con 0x5588ad0f9070 2024-08-28T19:35:33.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7fab83fff640 1 -- 172.21.15.33:0/846539727 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fab90021860 con 0x5588ad0f9070 2024-08-28T19:35:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.914+0000 7fabb1132740 1 -- 172.21.15.33:0/846539727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab9000eb70 con 0x5588ad0f9070 2024-08-28T19:35:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fab83fff640 1 -- 172.21.15.33:0/846539727 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fab90021be0 con 0x5588ad0f9070 2024-08-28T19:35:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fabb1132740 10 client.16371 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fabb1132740 1 -- 172.21.15.33:0/846539727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5588ad526690 con 0x5588ad0f9070 2024-08-28T19:35:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fab83fff640 1 -- 172.21.15.33:0/846539727 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9000eb70 con 0x5588ad0f9070 2024-08-28T19:35:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fab83fff640 1 -- 172.21.15.33:0/846539727 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fab90035020 con 0x5588ad0f9070 2024-08-28T19:35:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fabb1132740 10 client.16371 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fabb1132740 10 client.16371 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:35:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fabb1132740 20 client.16371 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fabb1132740 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5588ad08cda0 0x5588ad5289c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fabb1132740 4 client.16371 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7fabb1132740 1 -- 172.21.15.33:0/846539727 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588ad413070 con 0x5588ad08cda0 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.915+0000 7faba8959640 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5588ad08cda0 0x5588ad5289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7faba8959640 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5588ad08cda0 0x5588ad5289c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b5a829c48ffe67d3 server_cookie=d18d9a2808d5f8f in_seq=0 out_seq=0 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fab83fff640 10 client.16371 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fab83fff640 1 -- 172.21.15.33:0/846539727 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5588ad413070 con 0x5588ad08cda0 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fab83fff640 10 client.16371 handle_command_reply: tid=0 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 client.16371 shutdown 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 -- 172.21.15.33:0/846539727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 msgr2=0x5588ad4b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b0750 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fab90001eb0 tx=0x7fab90015f10 comp rx=0 tx=0).stop 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 -- 172.21.15.33:0/846539727 shutdown_connections 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5588ad08cda0 0x5588ad5289c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588ad0f9070 0x5588ad4b0750 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588ad0d8390 0x5588ad4b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 --2- 172.21.15.33:0/846539727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588ad0d01b0 0x5588ad4afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 -- 172.21.15.33:0/846539727 >> 172.21.15.33:0/846539727 conn(0x5588ad0ed460 msgr2=0x5588ad49fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:33.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fab83fff640 0 client.16371 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:35:33.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 -- 172.21.15.33:0/846539727 shutdown_connections 2024-08-28T19:35:33.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.916+0000 7fabb1132740 1 -- 172.21.15.33:0/846539727 wait complete. 2024-08-28T19:35:33.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabb1132740 20 client.16371 trim_cache size 0 max 16384 2024-08-28T19:35:33.925 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:35:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 -- 172.21.15.33:0/770242894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab940b4ca0 msgr2=0x7fab940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab940b4ca0 0x7fab940b71b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fab9c103a60 tx=0x7fab9c098b50 comp rx=0 tx=0).stop 2024-08-28T19:35:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 -- 172.21.15.33:0/770242894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faba4105880 msgr2=0x7faba40ff600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faba4105880 0x7faba40ff600 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fab9c004af0 tx=0x7fab9c003c20 comp rx=0 tx=0).stop 2024-08-28T19:35:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 -- 172.21.15.33:0/770242894 shutdown_connections 2024-08-28T19:35:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faba4105880 0x7faba40ff600 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fab940b4ca0 0x7fab940b71b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faba4104f30 0x7faba40ff0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 --2- 172.21.15.33:0/770242894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faba4102f60 0x7faba40feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 -- 172.21.15.33:0/770242894 >> 172.21.15.33:0/770242894 conn(0x7faba4077a00 msgr2=0x7faba4100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 -- 172.21.15.33:0/770242894 shutdown_connections 2024-08-28T19:35:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:33.917+0000 7fabaabbd640 1 -- 172.21.15.33:0/770242894 wait complete. 2024-08-28T19:35:34.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:33 smithi059 ceph-mon[22052]: pgmap v435: 129 pgs: 129 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-28T19:35:34.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:33 smithi122 ceph-mon[22174]: pgmap v435: 129 pgs: 129 active+clean; 2.8 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-28T19:35:34.803 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:35:35.063 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:35.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.552+0000 7fc5c0560640 1 -- 172.21.15.33:0/397780690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5b8102810 msgr2=0x7fc5b8102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:35.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.552+0000 7fc5c0560640 1 --2- 172.21.15.33:0/397780690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5b8102810 0x7fc5b8102c20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009900 tx=0x7fc5b402a410 comp rx=0 tx=0).stop 2024-08-28T19:35:35.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.552+0000 7fc5c0560640 1 -- 172.21.15.33:0/397780690 shutdown_connections 2024-08-28T19:35:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.552+0000 7fc5c0560640 1 --2- 172.21.15.33:0/397780690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5b8108aa0 0x7fc5b810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.552+0000 7fc5c0560640 1 --2- 172.21.15.33:0/397780690 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8108150 0x7fc5b8108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.552+0000 7fc5c0560640 1 --2- 172.21.15.33:0/397780690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5b8102810 0x7fc5b8102c20 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.552+0000 7fc5c0560640 1 -- 172.21.15.33:0/397780690 >> 172.21.15.33:0/397780690 conn(0x7fc5b80794d0 msgr2=0x7fc5b80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.552+0000 7fc5c0560640 1 -- 172.21.15.33:0/397780690 shutdown_connections 2024-08-28T19:35:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.552+0000 7fc5c0560640 1 -- 172.21.15.33:0/397780690 wait complete. 2024-08-28T19:35:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.553+0000 7fc5c0560640 1 Processor -- start 2024-08-28T19:35:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.553+0000 7fc5c0560640 1 -- start start 2024-08-28T19:35:35.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.553+0000 7fc5c0560640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5b8102810 0x7fc5b819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.553+0000 7fc5c0560640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5b8108150 0x7fc5b819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.553+0000 7fc5c0560640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8108aa0 0x7fc5b819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.553+0000 7fc5c0560640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b8113810 con 0x7fc5b8108150 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.553+0000 7fc5c0560640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b8113690 con 0x7fc5b8102810 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.553+0000 7fc5c0560640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b8113990 con 0x7fc5b8108aa0 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5bdafb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5b8108150 0x7fc5b819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5bdafb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5b8108150 0x7fc5b819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47788/0 (socket says 172.21.15.33:47788) 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5bdafb640 1 -- 172.21.15.33:0/1304689619 learned_addr learned my addr 172.21.15.33:0/1304689619 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5b8102810 0x7fc5b819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5beafd640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8108aa0 0x7fc5b819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5bdafb640 1 -- 172.21.15.33:0/1304689619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8108aa0 msgr2=0x7fc5b819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8108aa0 0x7fc5b819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5bdafb640 1 -- 172.21.15.33:0/1304689619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5b8102810 msgr2=0x7fc5b819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5b8102810 0x7fc5b819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5bdafb640 1 -- 172.21.15.33:0/1304689619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b81a0170 con 0x7fc5b8108150 2024-08-28T19:35:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.554+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5b8108150 0x7fc5b819a7a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800d740 tx=0x7fc5a800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.557+0000 7fc5af7fe640 1 -- 172.21.15.33:0/1304689619 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8017070 con 0x7fc5b8108150 2024-08-28T19:35:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.557+0000 7fc5af7fe640 1 -- 172.21.15.33:0/1304689619 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5a800de50 con 0x7fc5b8108150 2024-08-28T19:35:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.557+0000 7fc5c0560640 1 -- 172.21.15.33:0/1304689619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b81a0460 con 0x7fc5b8108150 2024-08-28T19:35:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.557+0000 7fc5af7fe640 1 -- 172.21.15.33:0/1304689619 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8004ce0 con 0x7fc5b8108150 2024-08-28T19:35:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.557+0000 7fc5c0560640 1 -- 172.21.15.33:0/1304689619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b81a6bc0 con 0x7fc5b8108150 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.559+0000 7fc5c6ad5740 1 Processor -- start 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5c6ad5740 1 -- start start 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5af7fe640 1 -- 172.21.15.33:0/1304689619 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc5a8010460 con 0x7fc5b8108150 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481627310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x556481627850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481261390 0x556481627d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55648159e680 con 0x5564812591b0 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55648158dc10 con 0x556481282070 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556481591bc0 con 0x556481261390 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5be2fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x556481627850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5be2fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x556481627850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47794/0 (socket says 172.21.15.33:47794) 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5be2fc640 1 -- 172.21.15.33:0/1380748026 learned_addr learned my addr 172.21.15.33:0/1380748026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5beafd640 1 --2- 172.21.15.33:0/1380748026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481627310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/1380748026 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481261390 0x556481627d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5be2fc640 1 -- 172.21.15.33:0/1380748026 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481261390 msgr2=0x556481627d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/1380748026 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481261390 0x556481627d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5be2fc640 1 -- 172.21.15.33:0/1380748026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 msgr2=0x556481627310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/1380748026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481627310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.560+0000 7fc5be2fc640 1 -- 172.21.15.33:0/1380748026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564812ed650 con 0x5564812591b0 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.561+0000 7fc5af7fe640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5a40b4d20 0x7fc5a40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.561+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/1380748026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x556481627850 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4033000 tx=0x7fc5b4032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b491fda0e6ff79f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.561+0000 7fc5beafd640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5a40b4d20 0x7fc5a40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.561+0000 7fc5af7fe640 1 -- 172.21.15.33:0/1304689619 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc5a80e5200 con 0x7fc5b8108150 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.561+0000 7fc5acff9640 1 -- 172.21.15.33:0/1380748026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4035040 con 0x5564812591b0 2024-08-28T19:35:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.561+0000 7fc5acff9640 1 -- 172.21.15.33:0/1380748026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b40316a0 con 0x5564812591b0 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.561+0000 7fc5acff9640 1 -- 172.21.15.33:0/1380748026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4004750 con 0x5564812591b0 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.562+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1380748026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 msgr2=0x556481627850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.562+0000 7fc5beafd640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5a40b4d20 0x7fc5a40b7230 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0005fd0 tx=0x7fc5b0009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.562+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1380748026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x556481627850 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4033000 tx=0x7fc5b4032cd0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.562+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1380748026 shutdown_connections 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.562+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1380748026 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481261390 0x556481627d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.562+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1380748026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x556481627850 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.562+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1380748026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481627310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.562+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1380748026 >> 172.21.15.33:0/1380748026 conn(0x556481276460 msgr2=0x556481625200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.562+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1380748026 shutdown_connections 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.562+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1380748026 wait complete. 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5c6ad5740 1 -- start start 2024-08-28T19:35:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5c6ad5740 1 Processor -- start 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5564812591b0 0x556481636dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481637300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481643150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5564813f0700 con 0x556481261390 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556481514750 con 0x556481282070 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556481639dc0 con 0x5564812591b0 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5c6ad5740 10 client.0 _ll_register_callbacks cb 0x556481543e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5bdafb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481637300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5bdafb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481637300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47800/0 (socket says 172.21.15.33:47800) 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5bdafb640 1 -- 172.21.15.33:0/1073382967 learned_addr learned my addr 172.21.15.33:0/1073382967 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5564812591b0 0x556481636dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5beafd640 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481643150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5bdafb640 1 -- 172.21.15.33:0/1073382967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5564812591b0 msgr2=0x556481636dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5564812591b0 0x556481636dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5bdafb640 1 -- 172.21.15.33:0/1073382967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 msgr2=0x556481643150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481643150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.563+0000 7fc5bdafb640 1 -- 172.21.15.33:0/1073382967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55648154d900 con 0x556481261390 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5beafd640 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481643150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481637300 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80ab580 tx=0x7fc5a80a74b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c73c7fb791bd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1073382967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8020070 con 0x556481261390 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1073382967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc5a80ce0b0 con 0x556481261390 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1073382967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5b40316a0 con 0x556481261390 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1073382967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc5a80aad60 con 0x556481261390 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5c6ad5740 10 client.16383 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1073382967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556481645b50 con 0x556481261390 2024-08-28T19:35:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1073382967 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b40316a0 con 0x556481261390 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1073382967 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc5a80a6f60 con 0x556481261390 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5c6ad5740 10 client.16383 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5c6ad5740 10 client.16383 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5c6ad5740 20 client.16383 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5564812409f0 0x556481649110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5c6ad5740 4 client.16383 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.564+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1073382967 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564815a05d0 con 0x5564812409f0 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.565+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5564812409f0 0x556481649110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.565+0000 7fc5a1ffb640 10 client.16383 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.565+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5564812409f0 0x556481649110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=497445dcbb5d592e server_cookie=7f891b9706c24b5c in_seq=0 out_seq=0 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1073382967 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564815a05d0 con 0x5564812409f0 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5a1ffb640 10 client.16383 handle_command_reply: tid=0 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 client.16383 shutdown 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1073382967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 msgr2=0x556481637300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481637300 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80ab580 tx=0x7fc5a80a74b0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1073382967 shutdown_connections 2024-08-28T19:35:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5564812409f0 0x556481649110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481643150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481637300 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5a1ffb640 0 client.16383 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:35:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1073382967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5564812591b0 0x556481636dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1073382967 >> 172.21.15.33:0/1073382967 conn(0x556481276460 msgr2=0x55648162a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1073382967 shutdown_connections 2024-08-28T19:35:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1073382967 wait complete. 2024-08-28T19:35:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.566+0000 7fc5c6ad5740 20 client.16383 trim_cache size 0 max 16384 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5c6ad5740 1 Processor -- start 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5c6ad5740 1 -- start start 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5564812591b0 0x556481638db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481643050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481633fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b81ae850 con 0x556481261390 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b81b0390 con 0x556481282070 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b81aef20 con 0x5564812591b0 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5bdafb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481643050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5bdafb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481643050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47806/0 (socket says 172.21.15.33:47806) 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5bdafb640 1 -- 172.21.15.33:0/2036529892 learned_addr learned my addr 172.21.15.33:0/2036529892 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/2036529892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5564812591b0 0x556481638db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.580+0000 7fc5beafd640 1 --2- 172.21.15.33:0/2036529892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481633fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.581+0000 7fc5bdafb640 1 -- 172.21.15.33:0/2036529892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5564812591b0 msgr2=0x556481638db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.581+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/2036529892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5564812591b0 0x556481638db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.581+0000 7fc5bdafb640 1 -- 172.21.15.33:0/2036529892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 msgr2=0x556481633fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.581+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/2036529892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481633fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.581+0000 7fc5bdafb640 1 -- 172.21.15.33:0/2036529892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564816280f0 con 0x556481261390 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.581+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/2036529892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481643050 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80a8860 tx=0x7fc5a80e5480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bcf58eee4a85b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.581+0000 7fc5a3fff640 1 -- 172.21.15.33:0/2036529892 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a805b070 con 0x556481261390 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.581+0000 7fc5a3fff640 1 -- 172.21.15.33:0/2036529892 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5a80ab100 con 0x556481261390 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.581+0000 7fc5a3fff640 1 -- 172.21.15.33:0/2036529892 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8020050 con 0x556481261390 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/2036529892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 msgr2=0x556481643050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/2036529892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481643050 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80a8860 tx=0x7fc5a80e5480 comp rx=0 tx=0).stop 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/2036529892 shutdown_connections 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/2036529892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481282070 0x556481633fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/2036529892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556481261390 0x556481643050 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/2036529892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5564812591b0 0x556481638db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/2036529892 >> 172.21.15.33:0/2036529892 conn(0x556481276460 msgr2=0x556481628d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/2036529892 shutdown_connections 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/2036529892 wait complete. 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 -- start start 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.582+0000 7fc5c6ad5740 1 Processor -- start 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x55648163f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481261390 0x55648163bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5c6ad5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481282070 0x55648163c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b81afcc0 con 0x5564812591b0 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b81af5f0 con 0x556481261390 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5c6ad5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b81ac830 con 0x556481282070 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5c6ad5740 10 client.0 _ll_register_callbacks cb 0x7fc5a80e89a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5be2fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x55648163f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5be2fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x55648163f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47814/0 (socket says 172.21.15.33:47814) 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5be2fc640 1 -- 172.21.15.33:0/1344328449 learned_addr learned my addr 172.21.15.33:0/1344328449 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481261390 0x55648163bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5beafd640 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481282070 0x55648163c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5be2fc640 1 -- 172.21.15.33:0/1344328449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481282070 msgr2=0x55648163c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481282070 0x55648163c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5be2fc640 1 -- 172.21.15.33:0/1344328449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481261390 msgr2=0x55648163bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481261390 0x55648163bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5be2fc640 1 -- 172.21.15.33:0/1344328449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55648163c950 con 0x5564812591b0 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5beafd640 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481282070 0x55648163c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5be2fc640 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x55648163f810 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009900 tx=0x7fc5b4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55b4f8266182e90 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.583+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1344328449 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4053070 con 0x5564812591b0 2024-08-28T19:35:35.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1344328449 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc5b40054f0 con 0x5564812591b0 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1344328449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5a80ab100 con 0x5564812591b0 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1344328449 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc5b405f050 con 0x5564812591b0 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5c6ad5740 10 client.16389 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1344328449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5564816b4a20 con 0x5564812591b0 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1344328449 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5a80ab100 con 0x5564812591b0 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1344328449 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc5b40035f0 con 0x5564812591b0 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5c6ad5740 10 client.16389 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5c6ad5740 10 client.16389 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5c6ad5740 20 client.16389 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556481215da0 0x5564816b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5c6ad5740 4 client.16389 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1344328449 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556481632970 con 0x556481215da0 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.584+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556481215da0 0x5564816b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5bdafb640 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556481215da0 0x5564816b6df0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bf1a3979a900dc7b server_cookie=9537b477a375b5a5 in_seq=0 out_seq=0 2024-08-28T19:35:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5a1ffb640 10 client.16389 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5a1ffb640 1 -- 172.21.15.33:0/1344328449 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556481632970 con 0x556481215da0 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5a1ffb640 10 client.16389 handle_command_reply: tid=0 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 client.16389 shutdown 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1344328449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 msgr2=0x55648163f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x55648163f810 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009900 tx=0x7fc5b4005ef0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1344328449 shutdown_connections 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556481215da0 0x5564816b6df0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556481282070 0x55648163c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5a1ffb640 0 client.16389 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556481261390 0x55648163bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 --2- 172.21.15.33:0/1344328449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5564812591b0 0x55648163f810 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1344328449 >> 172.21.15.33:0/1344328449 conn(0x556481276460 msgr2=0x55648162ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1344328449 shutdown_connections 2024-08-28T19:35:35.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 1 -- 172.21.15.33:0/1344328449 wait complete. 2024-08-28T19:35:35.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.585+0000 7fc5c6ad5740 20 client.16389 trim_cache size 0 max 16384 2024-08-28T19:35:35.600 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:35:35.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 -- 172.21.15.33:0/1304689619 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5a40b4d20 msgr2=0x7fc5a40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5a40b4d20 0x7fc5a40b7230 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0005fd0 tx=0x7fc5b0009600 comp rx=0 tx=0).stop 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 -- 172.21.15.33:0/1304689619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5b8108150 msgr2=0x7fc5b819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5b8108150 0x7fc5b819a7a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800d740 tx=0x7fc5a800dc00 comp rx=0 tx=0).stop 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 -- 172.21.15.33:0/1304689619 shutdown_connections 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5a40b4d20 0x7fc5a40b7230 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8108aa0 0x7fc5b819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5b8108150 0x7fc5b819a7a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 --2- 172.21.15.33:0/1304689619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5b8102810 0x7fc5b819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 -- 172.21.15.33:0/1304689619 >> 172.21.15.33:0/1304689619 conn(0x7fc5b80794d0 msgr2=0x7fc5b8101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 -- 172.21.15.33:0/1304689619 shutdown_connections 2024-08-28T19:35:35.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:35.586+0000 7fc5c0560640 1 -- 172.21.15.33:0/1304689619 wait complete. 2024-08-28T19:35:35.835 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:35 smithi059 ceph-mon[22052]: pgmap v436: 129 pgs: 129 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 16 op/s 2024-08-28T19:35:35.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:35 smithi033 ceph-mon[18549]: pgmap v436: 129 pgs: 129 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 16 op/s 2024-08-28T19:35:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:35 smithi122 ceph-mon[22174]: pgmap v436: 129 pgs: 129 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 16 op/s 2024-08-28T19:35:36.398 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:35:36.653 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.172+0000 7f98a1c80640 1 -- 172.21.15.33:0/2273609602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f989c108b10 msgr2=0x7f989c10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.172+0000 7f98a1c80640 1 --2- 172.21.15.33:0/2273609602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f989c108b10 0x7f989c10f340 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9894009ca0 tx=0x7f989402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.172+0000 7f98a1c80640 1 -- 172.21.15.33:0/2273609602 shutdown_connections 2024-08-28T19:35:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.172+0000 7f98a1c80640 1 --2- 172.21.15.33:0/2273609602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f989c108b10 0x7f989c10f340 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.172+0000 7f98a1c80640 1 --2- 172.21.15.33:0/2273609602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f989c1081c0 0x7f989c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.172+0000 7f98a1c80640 1 --2- 172.21.15.33:0/2273609602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989c102880 0x7f989c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.172+0000 7f98a1c80640 1 -- 172.21.15.33:0/2273609602 >> 172.21.15.33:0/2273609602 conn(0x7f989c079510 msgr2=0x7f989c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.172+0000 7f98a1c80640 1 -- 172.21.15.33:0/2273609602 shutdown_connections 2024-08-28T19:35:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.172+0000 7f98a1c80640 1 -- 172.21.15.33:0/2273609602 wait complete. 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f98a1c80640 1 Processor -- start 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f98a1c80640 1 -- start start 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f98a1c80640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f989c102880 0x7f989c19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f98a1c80640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f989c1081c0 0x7f989c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f98a1c80640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989c108b10 0x7f989c19fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f98a1c80640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1127e0 con 0x7f989c102880 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f98a1c80640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f989c112660 con 0x7f989c108b10 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f98a1c80640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f989c112960 con 0x7f989c1081c0 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f989b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f989c102880 0x7f989c19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f989b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f989c102880 0x7f989c19a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47842/0 (socket says 172.21.15.33:47842) 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f989b7fe640 1 -- 172.21.15.33:0/615161191 learned_addr learned my addr 172.21.15.33:0/615161191 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.173+0000 7f989bfff640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989c108b10 0x7f989c19fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f989b7fe640 1 -- 172.21.15.33:0/615161191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f989c1081c0 msgr2=0x7f989c19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f989affd640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f989c1081c0 0x7f989c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f989b7fe640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f989c1081c0 0x7f989c19a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f989b7fe640 1 -- 172.21.15.33:0/615161191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989c108b10 msgr2=0x7f989c19fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f989b7fe640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989c108b10 0x7f989c19fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f989b7fe640 1 -- 172.21.15.33:0/615161191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c1a0190 con 0x7f989c102880 2024-08-28T19:35:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f989bfff640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989c108b10 0x7f989c19fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f989b7fe640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f989c102880 0x7f989c19a220 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f988c00d950 tx=0x7f988c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f9898ff9640 1 -- 172.21.15.33:0/615161191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c017070 con 0x7f989c102880 2024-08-28T19:35:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f98a1c80640 1 -- 172.21.15.33:0/615161191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c1a0480 con 0x7f989c102880 2024-08-28T19:35:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f9898ff9640 1 -- 172.21.15.33:0/615161191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f988c009c30 con 0x7f989c102880 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f9898ff9640 1 -- 172.21.15.33:0/615161191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c00f620 con 0x7f989c102880 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.174+0000 7f98a1c80640 1 -- 172.21.15.33:0/615161191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c1a6be0 con 0x7f989c102880 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f98a81f5740 1 Processor -- start 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f98a81f5740 1 -- start start 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f9898ff9640 1 -- 172.21.15.33:0/615161191 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f988c010460 con 0x7f989c102880 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda990350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 0x55efda990890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5ca390 0x55efda990dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f98a81f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55efda907680 con 0x55efda5eb070 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f98a81f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55efda8f6c10 con 0x55efda5ca390 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f98a81f5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55efda8fabc0 con 0x55efda5c21b0 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f989bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda990350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f989bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda990350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47854/0 (socket says 172.21.15.33:47854) 2024-08-28T19:35:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f989bfff640 1 -- 172.21.15.33:0/3714534508 learned_addr learned my addr 172.21.15.33:0/3714534508 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.177+0000 7f989b7fe640 1 --2- 172.21.15.33:0/3714534508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 0x55efda990890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f989bfff640 1 -- 172.21.15.33:0/3714534508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 msgr2=0x55efda990890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f989bfff640 1 --2- 172.21.15.33:0/3714534508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 0x55efda990890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f989bfff640 1 -- 172.21.15.33:0/3714534508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5ca390 msgr2=0x55efda990dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f989affd640 1 --2- 172.21.15.33:0/3714534508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5ca390 0x55efda990dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f989bfff640 1 --2- 172.21.15.33:0/3714534508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5ca390 0x55efda990dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f989bfff640 1 -- 172.21.15.33:0/3714534508 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efda656650 con 0x55efda5eb070 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f989affd640 1 --2- 172.21.15.33:0/3714534508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5ca390 0x55efda990dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f9898ff9640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98840b4ca0 0x7f98840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f989bfff640 1 --2- 172.21.15.33:0/3714534508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda990350 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f989402f500 tx=0x7f98940099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2821c08fdf4bc471 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f989b7fe640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98840b4ca0 0x7f98840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f9881ffb640 1 -- 172.21.15.33:0/3714534508 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894031450 con 0x55efda5eb070 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f9898ff9640 1 -- 172.21.15.33:0/615161191 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f988c0e55a0 con 0x7f989c102880 2024-08-28T19:35:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f9881ffb640 1 -- 172.21.15.33:0/3714534508 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9894036040 con 0x55efda5eb070 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.178+0000 7f9881ffb640 1 -- 172.21.15.33:0/3714534508 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98940043e0 con 0x55efda5eb070 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.179+0000 7f98a81f5740 1 -- 172.21.15.33:0/3714534508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 msgr2=0x55efda990350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.179+0000 7f989b7fe640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98840b4ca0 0x7f98840b71b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f988c0e2a50 tx=0x7f988c005880 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.179+0000 7f98a81f5740 1 --2- 172.21.15.33:0/3714534508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda990350 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f989402f500 tx=0x7f98940099c0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.179+0000 7f98a81f5740 1 -- 172.21.15.33:0/3714534508 shutdown_connections 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.179+0000 7f98a81f5740 1 --2- 172.21.15.33:0/3714534508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5ca390 0x55efda990dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.179+0000 7f98a81f5740 1 --2- 172.21.15.33:0/3714534508 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 0x55efda990890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.179+0000 7f98a81f5740 1 --2- 172.21.15.33:0/3714534508 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda990350 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.179+0000 7f98a81f5740 1 -- 172.21.15.33:0/3714534508 >> 172.21.15.33:0/3714534508 conn(0x55efda5df460 msgr2=0x55efda98e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.179+0000 7f98a81f5740 1 -- 172.21.15.33:0/3714534508 shutdown_connections 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.179+0000 7f98a81f5740 1 -- 172.21.15.33:0/3714534508 wait complete. 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f98a81f5740 1 -- start start 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f98a81f5740 1 Processor -- start 2024-08-28T19:35:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 0x55efda99bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5ca390 0x55efda99c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda9a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f98a81f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55efda759700 con 0x55efda5eb070 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f98a81f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55efda87d750 con 0x55efda5c21b0 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f98a81f5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55efda99ead0 con 0x55efda5ca390 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f98a81f5740 10 client.0 _ll_register_callbacks cb 0x55efda8ace10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f989bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda9a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f989bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda9a7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47866/0 (socket says 172.21.15.33:47866) 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f989bfff640 1 -- 172.21.15.33:0/1453989563 learned_addr learned my addr 172.21.15.33:0/1453989563 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.180+0000 7f989bfff640 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 0x55efda99bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f989affd640 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5ca390 0x55efda99c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f989bfff640 1 -- 172.21.15.33:0/1453989563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5ca390 msgr2=0x55efda99c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:37.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f989bfff640 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5ca390 0x55efda99c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f989bfff640 1 -- 172.21.15.33:0/1453989563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 msgr2=0x55efda99bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f989bfff640 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 0x55efda99bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f989bfff640 1 -- 172.21.15.33:0/1453989563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efda8b6900 con 0x55efda5eb070 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f989bfff640 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda9a7dc0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9894005cc0 tx=0x7f989403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd719d0a86531b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f987affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f987affd640 1 -- 172.21.15.33:0/1453989563 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894059060 con 0x55efda5eb070 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f987affd640 1 -- 172.21.15.33:0/1453989563 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9894003970 con 0x55efda5eb070 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f98a81f5740 1 -- 172.21.15.33:0/1453989563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9894036040 con 0x55efda5eb070 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f987affd640 1 -- 172.21.15.33:0/1453989563 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9894003b70 con 0x55efda5eb070 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f98a81f5740 10 client.16401 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:37.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f98a81f5740 1 -- 172.21.15.33:0/1453989563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55efda9aa820 con 0x55efda5eb070 2024-08-28T19:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.181+0000 7f987affd640 1 -- 172.21.15.33:0/1453989563 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9894036040 con 0x55efda5eb070 2024-08-28T19:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.182+0000 7f987affd640 1 -- 172.21.15.33:0/1453989563 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f989405c080 con 0x55efda5eb070 2024-08-28T19:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.182+0000 7f98a81f5740 10 client.16401 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.182+0000 7f98a81f5740 10 client.16401 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.182+0000 7f98a81f5740 20 client.16401 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.182+0000 7f98a81f5740 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55efda5a99f0 0x55efda9adb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.182+0000 7f98a81f5740 4 client.16401 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.182+0000 7f98a81f5740 1 -- 172.21.15.33:0/1453989563 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efda9095d0 con 0x55efda5a99f0 2024-08-28T19:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.182+0000 7f989affd640 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55efda5a99f0 0x55efda9adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.182+0000 7f987affd640 10 client.16401 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.182+0000 7f989affd640 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55efda5a99f0 0x55efda9adb80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4bb6dec476dc4690 server_cookie=8d1d243033f3622a in_seq=0 out_seq=0 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f987affd640 1 -- 172.21.15.33:0/1453989563 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55efda9095d0 con 0x55efda5a99f0 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f987affd640 10 client.16401 handle_command_reply: tid=0 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f98a81f5740 1 client.16401 shutdown 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f98a81f5740 1 -- 172.21.15.33:0/1453989563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 msgr2=0x55efda9a7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f98a81f5740 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda9a7dc0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9894005cc0 tx=0x7f989403e040 comp rx=0 tx=0).stop 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f98a81f5740 1 -- 172.21.15.33:0/1453989563 shutdown_connections 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f98a81f5740 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55efda5a99f0 0x55efda9adb80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f98a81f5740 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5eb070 0x55efda9a7dc0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f98a81f5740 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5ca390 0x55efda99c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f987affd640 0 client.16401 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:35:37.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f98a81f5740 1 --2- 172.21.15.33:0/1453989563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 0x55efda99bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.183+0000 7f98a81f5740 1 -- 172.21.15.33:0/1453989563 >> 172.21.15.33:0/1453989563 conn(0x55efda5df460 msgr2=0x55efda993530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:37.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.184+0000 7f98a81f5740 1 -- 172.21.15.33:0/1453989563 shutdown_connections 2024-08-28T19:35:37.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.184+0000 7f98a81f5740 1 -- 172.21.15.33:0/1453989563 wait complete. 2024-08-28T19:35:37.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.184+0000 7f98a81f5740 20 client.16401 trim_cache size 0 max 16384 2024-08-28T19:35:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f98a81f5740 1 Processor -- start 2024-08-28T19:35:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f98a81f5740 1 -- start start 2024-08-28T19:35:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5a99f0 0x55efda99a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 0x55efda993b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5ca390 0x55efda998cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f98a81f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1b0bd0 con 0x55efda5a99f0 2024-08-28T19:35:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f98a81f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1b2710 con 0x55efda5ca390 2024-08-28T19:35:37.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f98a81f5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1b12a0 con 0x55efda5c21b0 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f989bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5a99f0 0x55efda99a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f989bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5a99f0 0x55efda99a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47868/0 (socket says 172.21.15.33:47868) 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.197+0000 7f989bfff640 1 -- 172.21.15.33:0/1519602209 learned_addr learned my addr 172.21.15.33:0/1519602209 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f989affd640 1 --2- 172.21.15.33:0/1519602209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 0x55efda993b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f989bfff640 1 -- 172.21.15.33:0/1519602209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 msgr2=0x55efda993b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f989bfff640 1 --2- 172.21.15.33:0/1519602209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 0x55efda993b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f989bfff640 1 -- 172.21.15.33:0/1519602209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5ca390 msgr2=0x55efda998cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f989bfff640 1 --2- 172.21.15.33:0/1519602209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5ca390 0x55efda998cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f989bfff640 1 -- 172.21.15.33:0/1519602209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efda98ee40 con 0x55efda5a99f0 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f989affd640 1 --2- 172.21.15.33:0/1519602209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 0x55efda993b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f989bfff640 1 --2- 172.21.15.33:0/1519602209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5a99f0 0x55efda99a9d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9894005d50 tx=0x7f9894003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55055892502362 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f98817fa640 1 -- 172.21.15.33:0/1519602209 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894059040 con 0x55efda5a99f0 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f98817fa640 1 -- 172.21.15.33:0/1519602209 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9894036040 con 0x55efda5a99f0 2024-08-28T19:35:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.198+0000 7f98817fa640 1 -- 172.21.15.33:0/1519602209 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989402fed0 con 0x55efda5a99f0 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 -- 172.21.15.33:0/1519602209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5a99f0 msgr2=0x55efda99a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 --2- 172.21.15.33:0/1519602209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5a99f0 0x55efda99a9d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9894005d50 tx=0x7f9894003f50 comp rx=0 tx=0).stop 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 -- 172.21.15.33:0/1519602209 shutdown_connections 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 --2- 172.21.15.33:0/1519602209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5ca390 0x55efda998cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 --2- 172.21.15.33:0/1519602209 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5c21b0 0x55efda993b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 --2- 172.21.15.33:0/1519602209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5a99f0 0x55efda99a9d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 -- 172.21.15.33:0/1519602209 >> 172.21.15.33:0/1519602209 conn(0x55efda5df460 msgr2=0x55efda993450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 -- 172.21.15.33:0/1519602209 shutdown_connections 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 -- 172.21.15.33:0/1519602209 wait complete. 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 -- start start 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.199+0000 7f98a81f5740 1 Processor -- start 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5a99f0 0x55efda9af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 0x55efda9af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f98a81f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5ca390 0x55efdaa17300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f98a81f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1b2040 con 0x55efda5ca390 2024-08-28T19:35:37.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f98a81f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1b1970 con 0x55efda5c21b0 2024-08-28T19:35:37.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f98a81f5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f989c1aebb0 con 0x55efda5a99f0 2024-08-28T19:35:37.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f98a81f5740 10 client.0 _ll_register_callbacks cb 0x7f9894009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:37.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5ca390 0x55efdaa17300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5ca390 0x55efdaa17300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47884/0 (socket says 172.21.15.33:47884) 2024-08-28T19:35:37.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989bfff640 1 -- 172.21.15.33:0/3560004695 learned_addr learned my addr 172.21.15.33:0/3560004695 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:37.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989affd640 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 0x55efda9af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989bfff640 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5a99f0 0x55efda9af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989bfff640 1 -- 172.21.15.33:0/3560004695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5a99f0 msgr2=0x55efda9af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989bfff640 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5a99f0 0x55efda9af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989bfff640 1 -- 172.21.15.33:0/3560004695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 msgr2=0x55efda9af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989bfff640 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 0x55efda9af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989bfff640 1 -- 172.21.15.33:0/3560004695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efdaa17840 con 0x55efda5ca390 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989affd640 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 0x55efda9af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f989bfff640 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5ca390 0x55efdaa17300 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9894009ca0 tx=0x7f989402f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30879ff66e1015d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.200+0000 7f987affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f987affd640 1 -- 172.21.15.33:0/3560004695 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894003d10 con 0x55efda5ca390 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f987affd640 1 -- 172.21.15.33:0/3560004695 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9894031450 con 0x55efda5ca390 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f98a81f5740 1 -- 172.21.15.33:0/3560004695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9894036040 con 0x55efda5ca390 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f987affd640 1 -- 172.21.15.33:0/3560004695 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9894031650 con 0x55efda5ca390 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f98a81f5740 10 client.16407 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f98a81f5740 1 -- 172.21.15.33:0/3560004695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55efdaa18940 con 0x55efda5ca390 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f987affd640 1 -- 172.21.15.33:0/3560004695 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9894036040 con 0x55efda5ca390 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f987affd640 1 -- 172.21.15.33:0/3560004695 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f989405c070 con 0x55efda5ca390 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f98a81f5740 10 client.16407 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f98a81f5740 10 client.16407 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f98a81f5740 20 client.16407 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f98a81f5740 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55efda5eb070 0x55efdaa1ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f98a81f5740 4 client.16407 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.201+0000 7f98a81f5740 1 -- 172.21.15.33:0/3560004695 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55efda997690 con 0x55efda5eb070 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.202+0000 7f989affd640 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55efda5eb070 0x55efdaa1ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.202+0000 7f989affd640 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55efda5eb070 0x55efdaa1ac70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dfce22c4ad645201 server_cookie=d7723065b5cc2d8 in_seq=0 out_seq=0 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.202+0000 7f987affd640 10 client.16407 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.202+0000 7f987affd640 1 -- 172.21.15.33:0/3560004695 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55efda997690 con 0x55efda5eb070 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.202+0000 7f987affd640 10 client.16407 handle_command_reply: tid=0 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.202+0000 7f98a81f5740 1 client.16407 shutdown 2024-08-28T19:35:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.202+0000 7f98a81f5740 1 -- 172.21.15.33:0/3560004695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5ca390 msgr2=0x55efdaa17300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.202+0000 7f98a81f5740 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5ca390 0x55efdaa17300 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9894009ca0 tx=0x7f989402f950 comp rx=0 tx=0).stop 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a81f5740 1 -- 172.21.15.33:0/3560004695 shutdown_connections 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a81f5740 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55efda5eb070 0x55efdaa1ac70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a81f5740 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55efda5ca390 0x55efdaa17300 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a81f5740 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55efda5c21b0 0x55efda9af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f987affd640 0 client.16407 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a81f5740 1 --2- 172.21.15.33:0/3560004695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55efda5a99f0 0x55efda9af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a81f5740 1 -- 172.21.15.33:0/3560004695 >> 172.21.15.33:0/3560004695 conn(0x55efda5df460 msgr2=0x55efda991380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a81f5740 1 -- 172.21.15.33:0/3560004695 shutdown_connections 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a81f5740 1 -- 172.21.15.33:0/3560004695 wait complete. 2024-08-28T19:35:37.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a81f5740 20 client.16407 trim_cache size 0 max 16384 2024-08-28T19:35:37.212 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:35:37.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a1c80640 1 -- 172.21.15.33:0/615161191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98840b4ca0 msgr2=0x7f98840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:37.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a1c80640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98840b4ca0 0x7f98840b71b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f988c0e2a50 tx=0x7f988c005880 comp rx=0 tx=0).stop 2024-08-28T19:35:37.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a1c80640 1 -- 172.21.15.33:0/615161191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f989c102880 msgr2=0x7f989c19a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a1c80640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f989c102880 0x7f989c19a220 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f988c00d950 tx=0x7f988c00de10 comp rx=0 tx=0).stop 2024-08-28T19:35:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a1c80640 1 -- 172.21.15.33:0/615161191 shutdown_connections 2024-08-28T19:35:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a1c80640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989c108b10 0x7f989c19fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a1c80640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98840b4ca0 0x7f98840b71b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a1c80640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f989c1081c0 0x7f989c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a1c80640 1 --2- 172.21.15.33:0/615161191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f989c102880 0x7f989c19a220 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.203+0000 7f98a1c80640 1 -- 172.21.15.33:0/615161191 >> 172.21.15.33:0/615161191 conn(0x7f989c079510 msgr2=0x7f989c1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.204+0000 7f98a1c80640 1 -- 172.21.15.33:0/615161191 shutdown_connections 2024-08-28T19:35:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:37.204+0000 7f98a1c80640 1 -- 172.21.15.33:0/615161191 wait complete. 2024-08-28T19:35:37.845 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:37 smithi122 ceph-mon[22174]: pgmap v437: 129 pgs: 129 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-08-28T19:35:37.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:37 smithi033 ceph-mon[18549]: pgmap v437: 129 pgs: 129 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-08-28T19:35:37.958 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:35:38.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:37 smithi059 ceph-mon[22052]: pgmap v437: 129 pgs: 129 active+clean; 2.9 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-08-28T19:35:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:38.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.749+0000 7f1ec09bc640 1 -- 172.21.15.33:0/1836293530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ebc102820 msgr2=0x7f1ebc102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:38.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.749+0000 7f1ec09bc640 1 --2- 172.21.15.33:0/1836293530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ebc102820 0x7f1ebc102c30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009900 tx=0x7f1eac02a410 comp rx=0 tx=0).stop 2024-08-28T19:35:38.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.749+0000 7f1ec09bc640 1 -- 172.21.15.33:0/1836293530 shutdown_connections 2024-08-28T19:35:38.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.749+0000 7f1ec09bc640 1 --2- 172.21.15.33:0/1836293530 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ebc108ab0 0x7f1ebc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.749+0000 7f1ec09bc640 1 --2- 172.21.15.33:0/1836293530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ebc108160 0x7f1ebc108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.749+0000 7f1ec09bc640 1 --2- 172.21.15.33:0/1836293530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ebc102820 0x7f1ebc102c30 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.749+0000 7f1ec09bc640 1 -- 172.21.15.33:0/1836293530 >> 172.21.15.33:0/1836293530 conn(0x7f1ebc0794e0 msgr2=0x7f1ebc0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:38.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.749+0000 7f1ec09bc640 1 -- 172.21.15.33:0/1836293530 shutdown_connections 2024-08-28T19:35:38.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.749+0000 7f1ec09bc640 1 -- 172.21.15.33:0/1836293530 wait complete. 2024-08-28T19:35:38.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ec09bc640 1 Processor -- start 2024-08-28T19:35:38.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ec09bc640 1 -- start start 2024-08-28T19:35:38.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ec09bc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ebc102820 0x7f1ebc19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ec09bc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ebc108160 0x7f1ebc19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ec09bc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ebc108ab0 0x7f1ebc19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ec09bc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc112730 con 0x7f1ebc108ab0 2024-08-28T19:35:38.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ec09bc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc1125b0 con 0x7f1ebc102820 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ec09bc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc1128b0 con 0x7f1ebc108160 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ebad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ebc108ab0 0x7f1ebc19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ebad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ebc108ab0 0x7f1ebc19bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59000/0 (socket says 172.21.15.33:59000) 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1ebad9d640 1 -- 172.21.15.33:0/4013849380 learned_addr learned my addr 172.21.15.33:0/4013849380 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.750+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ebc108160 0x7f1ebc19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1eba59c640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ebc102820 0x7f1ebc19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1ebad9d640 1 -- 172.21.15.33:0/4013849380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ebc108160 msgr2=0x7f1ebc19b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1ebad9d640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ebc108160 0x7f1ebc19b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1ebad9d640 1 -- 172.21.15.33:0/4013849380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ebc102820 msgr2=0x7f1ebc19b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1ebad9d640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ebc102820 0x7f1ebc19b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1ebad9d640 1 -- 172.21.15.33:0/4013849380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc1a62b0 con 0x7f1ebc108ab0 2024-08-28T19:35:38.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ebc108160 0x7f1ebc19b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1ebad9d640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ebc108ab0 0x7f1ebc19bb00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400eaa0 tx=0x7f1eb400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1eab7fe640 1 -- 172.21.15.33:0/4013849380 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400cdb0 con 0x7f1ebc108ab0 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1ec09bc640 1 -- 172.21.15.33:0/4013849380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ebc1a65a0 con 0x7f1ebc108ab0 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1eab7fe640 1 -- 172.21.15.33:0/4013849380 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb4005020 con 0x7f1ebc108ab0 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1eab7fe640 1 -- 172.21.15.33:0/4013849380 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40116d0 con 0x7f1ebc108ab0 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.751+0000 7f1ec09bc640 1 -- 172.21.15.33:0/4013849380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ebc1a6b30 con 0x7f1ebc108ab0 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.754+0000 7f1ec6f31740 1 Processor -- start 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.754+0000 7f1eab7fe640 1 -- 172.21.15.33:0/4013849380 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1eb40054a0 con 0x7f1ebc108ab0 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.754+0000 7f1ec6f31740 1 -- start start 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.754+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a087310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.754+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cb91b0 0x56327a087850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.754+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cc1390 0x56327a087d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.754+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563279ffe680 con 0x563279ce2070 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.754+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563279fedc10 con 0x563279cc1390 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.754+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563279ff1bc0 con 0x563279cb91b0 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eb9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a087310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eb9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a087310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59008/0 (socket says 172.21.15.33:59008) 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/416167666 learned_addr learned my addr 172.21.15.33:0/416167666 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/416167666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cc1390 0x56327a087d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eba59c640 1 --2- 172.21.15.33:0/416167666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cb91b0 0x56327a087850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eab7fe640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ea40b4ca0 0x7f1ea40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1ebad9d640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ea40b4ca0 0x7f1ea40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/416167666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cb91b0 msgr2=0x56327a087850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/416167666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cb91b0 0x56327a087850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/416167666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cc1390 msgr2=0x56327a087d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/416167666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cc1390 0x56327a087d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/416167666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563279d4d650 con 0x563279ce2070 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eab7fe640 1 -- 172.21.15.33:0/4013849380 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1eb40e5a80 con 0x7f1ebc108ab0 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.755+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/416167666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a087310 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0013960 tx=0x7f1eb000a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e162b0e8a8db53 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.756+0000 7f1ea8ff9640 1 -- 172.21.15.33:0/416167666 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb000eb00 con 0x563279ce2070 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.756+0000 7f1ebad9d640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ea40b4ca0 0x7f1ea40b71b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40e3480 tx=0x7f1eb4078020 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.756+0000 7f1ea8ff9640 1 -- 172.21.15.33:0/416167666 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb000eca0 con 0x563279ce2070 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.756+0000 7f1ea8ff9640 1 -- 172.21.15.33:0/416167666 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb00053a0 con 0x563279ce2070 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.756+0000 7f1ec6f31740 1 -- 172.21.15.33:0/416167666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 msgr2=0x56327a087310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.756+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/416167666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a087310 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0013960 tx=0x7f1eb000a4d0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.756+0000 7f1ec6f31740 1 -- 172.21.15.33:0/416167666 shutdown_connections 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.756+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/416167666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cc1390 0x56327a087d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.757+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/416167666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cb91b0 0x56327a087850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.757+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/416167666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a087310 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.757+0000 7f1ec6f31740 1 -- 172.21.15.33:0/416167666 >> 172.21.15.33:0/416167666 conn(0x563279cd6460 msgr2=0x56327a085200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.757+0000 7f1ec6f31740 1 -- 172.21.15.33:0/416167666 shutdown_connections 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.757+0000 7f1ec6f31740 1 -- 172.21.15.33:0/416167666 wait complete. 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.757+0000 7f1ec6f31740 1 -- start start 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.757+0000 7f1ec6f31740 1 Processor -- start 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.757+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279cb91b0 0x56327a092a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cc1390 0x56327a092f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279ce2070 0x56327a09ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563279e50700 con 0x563279cb91b0 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563279f74750 con 0x563279ce2070 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56327a095a90 con 0x563279cc1390 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ec6f31740 10 client.0 _ll_register_callbacks cb 0x563279fa3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1eb9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279cb91b0 0x56327a092a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1eb9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279cb91b0 0x56327a092a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59018/0 (socket says 172.21.15.33:59018) 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/1239223415 learned_addr learned my addr 172.21.15.33:0/1239223415 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1eba59c640 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cc1390 0x56327a092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/1239223415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cc1390 msgr2=0x56327a092f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cc1390 0x56327a092f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/1239223415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279ce2070 msgr2=0x56327a09ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279ce2070 0x56327a09ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/1239223415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563279fad900 con 0x563279cb91b0 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279cb91b0 0x56327a092a00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000a820 tx=0x7f1eb000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122694df7d55bb60 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ea1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/1239223415 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb002c060 con 0x563279cb91b0 2024-08-28T19:35:38.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/1239223415 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1eb0005320 con 0x563279cb91b0 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ec6f31740 1 -- 172.21.15.33:0/1239223415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eb000eca0 con 0x563279cb91b0 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/1239223415 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1eb0005520 con 0x563279cb91b0 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ec6f31740 10 client.16419 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.758+0000 7f1ec6f31740 1 -- 172.21.15.33:0/1239223415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56327a0a17d0 con 0x563279cb91b0 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.759+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/1239223415 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb000eca0 con 0x563279cb91b0 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.759+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/1239223415 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1eb000f040 con 0x563279cb91b0 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.759+0000 7f1ec6f31740 10 client.16419 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.759+0000 7f1ec6f31740 10 client.16419 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.759+0000 7f1ec6f31740 20 client.16419 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.759+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x563279ca09f0 0x56327a0a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.759+0000 7f1ec6f31740 4 client.16419 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.759+0000 7f1ec6f31740 1 -- 172.21.15.33:0/1239223415 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56327a0005d0 con 0x563279ca09f0 2024-08-28T19:35:38.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.759+0000 7f1eba59c640 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x563279ca09f0 0x56327a0a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.760+0000 7f1eba59c640 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x563279ca09f0 0x56327a0a4be0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=49447951b7e117cf server_cookie=3f193fde28fc15d7 in_seq=0 out_seq=0 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.760+0000 7f1ea1ffb640 10 client.16419 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.760+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/1239223415 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56327a0005d0 con 0x563279ca09f0 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.760+0000 7f1ea1ffb640 10 client.16419 handle_command_reply: tid=0 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.760+0000 7f1ec6f31740 1 client.16419 shutdown 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 1 -- 172.21.15.33:0/1239223415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279cb91b0 msgr2=0x56327a092a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279cb91b0 0x56327a092a00 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000a820 tx=0x7f1eb000ef20 comp rx=0 tx=0).stop 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 1 -- 172.21.15.33:0/1239223415 shutdown_connections 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x563279ca09f0 0x56327a0a4be0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279ce2070 0x56327a09ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ea1ffb640 0 client.16419 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cc1390 0x56327a092f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/1239223415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279cb91b0 0x56327a092a00 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 1 -- 172.21.15.33:0/1239223415 >> 172.21.15.33:0/1239223415 conn(0x563279cd6460 msgr2=0x56327a08a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:38.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 1 -- 172.21.15.33:0/1239223415 shutdown_connections 2024-08-28T19:35:38.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 1 -- 172.21.15.33:0/1239223415 wait complete. 2024-08-28T19:35:38.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.761+0000 7f1ec6f31740 20 client.16419 trim_cache size 0 max 16384 2024-08-28T19:35:38.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.774+0000 7f1ec6f31740 1 Processor -- start 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.774+0000 7f1ec6f31740 1 -- start start 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cb91b0 0x56327a085250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cc1390 0x56327a09ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a08a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc1b0ba0 con 0x563279ce2070 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc1b26e0 con 0x563279cc1390 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc1b1270 con 0x563279cb91b0 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1eb9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a08a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1eb9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a08a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59022/0 (socket says 172.21.15.33:59022) 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/3067947842 learned_addr learned my addr 172.21.15.33:0/3067947842 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1eba59c640 1 --2- 172.21.15.33:0/3067947842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cc1390 0x56327a09ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/3067947842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cb91b0 0x56327a085250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/3067947842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cb91b0 msgr2=0x56327a085250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/3067947842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cb91b0 0x56327a085250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/3067947842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cc1390 msgr2=0x56327a09ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/3067947842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cc1390 0x56327a09ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.775+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/3067947842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327a093cc0 con 0x563279ce2070 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.776+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/3067947842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a08a3e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x563279ff1cd0 tx=0x7f1eb000aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a247863982709e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.776+0000 7f1ea3fff640 1 -- 172.21.15.33:0/3067947842 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb002c040 con 0x563279ce2070 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.776+0000 7f1ea3fff640 1 -- 172.21.15.33:0/3067947842 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb00056c0 con 0x563279ce2070 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.776+0000 7f1ea3fff640 1 -- 172.21.15.33:0/3067947842 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0005090 con 0x563279ce2070 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.776+0000 7f1ec6f31740 1 -- 172.21.15.33:0/3067947842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 msgr2=0x56327a08a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.776+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/3067947842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a08a3e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x563279ff1cd0 tx=0x7f1eb000aa90 comp rx=0 tx=0).stop 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.777+0000 7f1ec6f31740 1 -- 172.21.15.33:0/3067947842 shutdown_connections 2024-08-28T19:35:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.777+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/3067947842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a08a3e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.777+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/3067947842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cc1390 0x56327a09ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.777+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/3067947842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cb91b0 0x56327a085250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.777+0000 7f1ec6f31740 1 -- 172.21.15.33:0/3067947842 >> 172.21.15.33:0/3067947842 conn(0x563279cd6460 msgr2=0x56327a084b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.777+0000 7f1ec6f31740 1 -- 172.21.15.33:0/3067947842 shutdown_connections 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.777+0000 7f1ec6f31740 1 -- 172.21.15.33:0/3067947842 wait complete. 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.777+0000 7f1ec6f31740 1 -- start start 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.777+0000 7f1ec6f31740 1 Processor -- start 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cb91b0 0x56327a0a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cc1390 0x56327a0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ec6f31740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a0a6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc1b2010 con 0x563279ce2070 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc1b1940 con 0x563279cb91b0 2024-08-28T19:35:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ec6f31740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc1aeb80 con 0x563279cc1390 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ec6f31740 10 client.0 _ll_register_callbacks cb 0x7f1eb000af10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eb9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a0a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eb9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a0a6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59024/0 (socket says 172.21.15.33:59024) 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/2883489944 learned_addr learned my addr 172.21.15.33:0/2883489944 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cb91b0 0x56327a0a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eba59c640 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cc1390 0x56327a0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/2883489944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cc1390 msgr2=0x56327a0a61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cc1390 0x56327a0a61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/2883489944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cb91b0 msgr2=0x56327a0a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cb91b0 0x56327a0a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eb9d9b640 1 -- 172.21.15.33:0/2883489944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56327a10e3e0 con 0x563279ce2070 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1eb9d9b640 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a0a6710 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000acf0 tx=0x7f1eb0027530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5c028eb1e9611c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ea1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/2883489944 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb002c070 con 0x563279ce2070 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/2883489944 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1eb0027850 con 0x563279ce2070 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.778+0000 7f1ec6f31740 1 -- 172.21.15.33:0/2883489944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eb00056c0 con 0x563279ce2070 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/2883489944 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1eb0027a50 con 0x563279ce2070 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ec6f31740 10 client.16425 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ec6f31740 1 -- 172.21.15.33:0/2883489944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56327a10f660 con 0x563279ce2070 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/2883489944 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb00056c0 con 0x563279ce2070 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/2883489944 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1eb0003710 con 0x563279ce2070 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ec6f31740 10 client.16425 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:38.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ec6f31740 10 client.16425 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ec6f31740 20 client.16425 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x563279c75da0 0x56327a111d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ec6f31740 4 client.16425 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1ec6f31740 1 -- 172.21.15.33:0/2883489944 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563279ffc070 con 0x563279c75da0 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.779+0000 7f1eba59c640 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x563279c75da0 0x56327a111d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1eba59c640 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x563279c75da0 0x56327a111d90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0a2ec11cde7e385 server_cookie=1bc349a8f52523fb in_seq=0 out_seq=0 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ea1ffb640 10 client.16425 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ea1ffb640 1 -- 172.21.15.33:0/2883489944 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563279ffc070 con 0x563279c75da0 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ea1ffb640 10 client.16425 handle_command_reply: tid=0 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 client.16425 shutdown 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 -- 172.21.15.33:0/2883489944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 msgr2=0x56327a0a6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a0a6710 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000acf0 tx=0x7f1eb0027530 comp rx=0 tx=0).stop 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 -- 172.21.15.33:0/2883489944 shutdown_connections 2024-08-28T19:35:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x563279c75da0 0x56327a111d90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563279ce2070 0x56327a0a6710 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563279cc1390 0x56327a0a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 --2- 172.21.15.33:0/2883489944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563279cb91b0 0x56327a0a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 -- 172.21.15.33:0/2883489944 >> 172.21.15.33:0/2883489944 conn(0x563279cd6460 msgr2=0x56327a08a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ea1ffb640 0 client.16425 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:35:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 -- 172.21.15.33:0/2883489944 shutdown_connections 2024-08-28T19:35:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 1 -- 172.21.15.33:0/2883489944 wait complete. 2024-08-28T19:35:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.780+0000 7f1ec6f31740 20 client.16425 trim_cache size 0 max 16384 2024-08-28T19:35:38.796 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:35:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 -- 172.21.15.33:0/4013849380 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ea40b4ca0 msgr2=0x7f1ea40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ea40b4ca0 0x7f1ea40b71b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40e3480 tx=0x7f1eb4078020 comp rx=0 tx=0).stop 2024-08-28T19:35:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 -- 172.21.15.33:0/4013849380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ebc108ab0 msgr2=0x7f1ebc19bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ebc108ab0 0x7f1ebc19bb00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400eaa0 tx=0x7f1eb400ef60 comp rx=0 tx=0).stop 2024-08-28T19:35:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 -- 172.21.15.33:0/4013849380 shutdown_connections 2024-08-28T19:35:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ebc108ab0 0x7f1ebc19bb00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1ea40b4ca0 0x7f1ea40b71b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ebc108160 0x7f1ebc19b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 --2- 172.21.15.33:0/4013849380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ebc102820 0x7f1ebc19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 -- 172.21.15.33:0/4013849380 >> 172.21.15.33:0/4013849380 conn(0x7f1ebc0794e0 msgr2=0x7f1ebc101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 -- 172.21.15.33:0/4013849380 shutdown_connections 2024-08-28T19:35:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:38.781+0000 7f1ec09bc640 1 -- 172.21.15.33:0/4013849380 wait complete. 2024-08-28T19:35:39.611 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:35:39.866 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:39.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:39 smithi033 ceph-mon[18549]: pgmap v438: 129 pgs: 129 active+clean; 3.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-08-28T19:35:40.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:39 smithi059 ceph-mon[22052]: pgmap v438: 129 pgs: 129 active+clean; 3.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-08-28T19:35:40.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:39 smithi122 ceph-mon[22174]: pgmap v438: 129 pgs: 129 active+clean; 3.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-08-28T19:35:40.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.334+0000 7f5548c47640 1 -- 172.21.15.33:0/3674927086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5544108a90 msgr2=0x7f554410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:40.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.334+0000 7f5548c47640 1 --2- 172.21.15.33:0/3674927086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5544108a90 0x7f554410f2c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f553c009ca0 tx=0x7f553c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.334+0000 7f5548c47640 1 -- 172.21.15.33:0/3674927086 shutdown_connections 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.334+0000 7f5548c47640 1 --2- 172.21.15.33:0/3674927086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5544108a90 0x7f554410f2c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.334+0000 7f5548c47640 1 --2- 172.21.15.33:0/3674927086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5544108140 0x7f5544108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.334+0000 7f5548c47640 1 --2- 172.21.15.33:0/3674927086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5544102800 0x7f5544102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.334+0000 7f5548c47640 1 -- 172.21.15.33:0/3674927086 >> 172.21.15.33:0/3674927086 conn(0x7f55440794d0 msgr2=0x7f55440798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.334+0000 7f5548c47640 1 -- 172.21.15.33:0/3674927086 shutdown_connections 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.334+0000 7f5548c47640 1 -- 172.21.15.33:0/3674927086 wait complete. 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5548c47640 1 Processor -- start 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5548c47640 1 -- start start 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5548c47640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5544102800 0x7f554419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5548c47640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5544108140 0x7f554419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5548c47640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5544108a90 0x7f554419fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5548c47640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5544112740 con 0x7f5544108a90 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5548c47640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f55441125c0 con 0x7f5544102800 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5548c47640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f55441128c0 con 0x7f5544108140 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5542d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5544108a90 0x7f554419fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5542d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5544108a90 0x7f554419fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59042/0 (socket says 172.21.15.33:59042) 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5542d9d640 1 -- 172.21.15.33:0/1226314796 learned_addr learned my addr 172.21.15.33:0/1226314796 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f554259c640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5544102800 0x7f554419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.335+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5544108140 0x7f554419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f5542d9d640 1 -- 172.21.15.33:0/1226314796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5544108140 msgr2=0x7f554419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f5542d9d640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5544108140 0x7f554419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f5542d9d640 1 -- 172.21.15.33:0/1226314796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5544102800 msgr2=0x7f554419a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f5542d9d640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5544102800 0x7f554419a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f5542d9d640 1 -- 172.21.15.33:0/1226314796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55441a0070 con 0x7f5544108a90 2024-08-28T19:35:40.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f5542d9d640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5544108a90 0x7f554419fa00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f553c009430 tx=0x7f553c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f55337fe640 1 -- 172.21.15.33:0/1226314796 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c003b70 con 0x7f5544108a90 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f5548c47640 1 -- 172.21.15.33:0/1226314796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55441a0300 con 0x7f5544108a90 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f55337fe640 1 -- 172.21.15.33:0/1226314796 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f553c003d10 con 0x7f5544108a90 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f55337fe640 1 -- 172.21.15.33:0/1226314796 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c02fa30 con 0x7f5544108a90 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.336+0000 7f5548c47640 1 -- 172.21.15.33:0/1226314796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55441a0840 con 0x7f5544108a90 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.338+0000 7f554f1bc740 1 Processor -- start 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.338+0000 7f55337fe640 1 -- 172.21.15.33:0/1226314796 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f553c02fbd0 con 0x7f5544108a90 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554f1bc740 1 -- start start 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413eb070 0x55d341790310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d341790850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 0x55d341790d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554f1bc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d341707680 con 0x55d3413c21b0 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554f1bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d3416f6c10 con 0x55d3413eb070 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554f1bc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d3416fabc0 con 0x55d3413ca390 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d341790850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d341790850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59054/0 (socket says 172.21.15.33:59054) 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554259c640 1 -- 172.21.15.33:0/1799140697 learned_addr learned my addr 172.21.15.33:0/1799140697 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1799140697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413eb070 0x55d341790310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1799140697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 0x55d341790d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554259c640 1 -- 172.21.15.33:0/1799140697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 msgr2=0x55d341790d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.339+0000 7f554259c640 1 --2- 172.21.15.33:0/1799140697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 0x55d341790d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f554259c640 1 -- 172.21.15.33:0/1799140697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413eb070 msgr2=0x55d341790310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f554259c640 1 --2- 172.21.15.33:0/1799140697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413eb070 0x55d341790310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f554259c640 1 -- 172.21.15.33:0/1799140697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d341456650 con 0x55d3413c21b0 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1799140697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 0x55d341790d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f55337fe640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f552c0b4cd0 0x7f552c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f554259c640 1 --2- 172.21.15.33:0/1799140697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d341790850 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f553400ad00 tx=0x7f553400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b39a9db6096c987 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f552c0b4cd0 0x7f552c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f55337fe640 1 -- 172.21.15.33:0/1226314796 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f553c106b90 con 0x7f5544108a90 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f5530ff9640 1 -- 172.21.15.33:0/1799140697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553401d070 con 0x55d3413c21b0 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f5530ff9640 1 -- 172.21.15.33:0/1799140697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5534018af0 con 0x55d3413c21b0 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.340+0000 7f5530ff9640 1 -- 172.21.15.33:0/1799140697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534010b30 con 0x55d3413c21b0 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f554f1bc740 1 -- 172.21.15.33:0/1799140697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 msgr2=0x55d341790850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f552c0b4cd0 0x7f552c0b71e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f55380058c0 tx=0x7f5538004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1799140697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d341790850 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f553400ad00 tx=0x7f553400f790 comp rx=0 tx=0).stop 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f554f1bc740 1 -- 172.21.15.33:0/1799140697 shutdown_connections 2024-08-28T19:35:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1799140697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 0x55d341790d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1799140697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d341790850 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1799140697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413eb070 0x55d341790310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f554f1bc740 1 -- 172.21.15.33:0/1799140697 >> 172.21.15.33:0/1799140697 conn(0x55d3413df460 msgr2=0x55d34178e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f554f1bc740 1 -- 172.21.15.33:0/1799140697 shutdown_connections 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f554f1bc740 1 -- 172.21.15.33:0/1799140697 wait complete. 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.341+0000 7f554f1bc740 1 -- start start 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554f1bc740 1 Processor -- start 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d34179ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 0x55d34179bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413eb070 0x55d3417a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554f1bc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d341559700 con 0x55d3413c21b0 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554f1bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d34167d750 con 0x55d3413ca390 2024-08-28T19:35:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554f1bc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d34179eaf0 con 0x55d3413eb070 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554f1bc740 10 client.0 _ll_register_callbacks cb 0x55d3416ace10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d34179ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d34179ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59070/0 (socket says 172.21.15.33:59070) 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554259c640 1 -- 172.21.15.33:0/1067835638 learned_addr learned my addr 172.21.15.33:0/1067835638 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 0x55d34179bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f5542d9d640 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413eb070 0x55d3417a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554259c640 1 -- 172.21.15.33:0/1067835638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413eb070 msgr2=0x55d3417a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554259c640 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413eb070 0x55d3417a7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554259c640 1 -- 172.21.15.33:0/1067835638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 msgr2=0x55d34179bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554259c640 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 0x55d34179bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.342+0000 7f554259c640 1 -- 172.21.15.33:0/1067835638 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3416b6900 con 0x55d3413c21b0 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f554259c640 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d34179ba50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5534010470 tx=0x7f5534018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f676b9aa7f57b9bb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f5529ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f5529ffb640 1 -- 172.21.15.33:0/1067835638 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553401d040 con 0x55d3413c21b0 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f5529ffb640 1 -- 172.21.15.33:0/1067835638 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5534010870 con 0x55d3413c21b0 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f554f1bc740 1 -- 172.21.15.33:0/1067835638 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5534018af0 con 0x55d3413c21b0 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f5529ffb640 1 -- 172.21.15.33:0/1067835638 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5534031050 con 0x55d3413c21b0 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f554f1bc740 10 client.16437 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f554f1bc740 1 -- 172.21.15.33:0/1067835638 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3417aa7a0 con 0x55d3413c21b0 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f5529ffb640 1 -- 172.21.15.33:0/1067835638 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5534018af0 con 0x55d3413c21b0 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f5529ffb640 1 -- 172.21.15.33:0/1067835638 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5534020030 con 0x55d3413c21b0 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f554f1bc740 10 client.16437 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f554f1bc740 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f554f1bc740 20 client.16437 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d3413a99f0 0x55d3417adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f554f1bc740 4 client.16437 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.343+0000 7f554f1bc740 1 -- 172.21.15.33:0/1067835638 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3417095d0 con 0x55d3413a99f0 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.344+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d3413a99f0 0x55d3417adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.344+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d3413a99f0 0x55d3417adbb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=623c6d815184a63 server_cookie=3db6e65feec27a5a in_seq=0 out_seq=0 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.344+0000 7f5529ffb640 10 client.16437 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f5529ffb640 1 -- 172.21.15.33:0/1067835638 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3417095d0 con 0x55d3413a99f0 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f5529ffb640 10 client.16437 handle_command_reply: tid=0 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 client.16437 shutdown 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 -- 172.21.15.33:0/1067835638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 msgr2=0x55d34179ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d34179ba50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5534010470 tx=0x7f5534018670 comp rx=0 tx=0).stop 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 -- 172.21.15.33:0/1067835638 shutdown_connections 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413eb070 0x55d3417a7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 0x55d34179bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d3413a99f0 0x55d3417adbb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1067835638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d34179ba50 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f5529ffb640 0 client.16437 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:40.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 -- 172.21.15.33:0/1067835638 >> 172.21.15.33:0/1067835638 conn(0x55d3413df460 msgr2=0x55d3417934f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:40.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 -- 172.21.15.33:0/1067835638 shutdown_connections 2024-08-28T19:35:40.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 1 -- 172.21.15.33:0/1067835638 wait complete. 2024-08-28T19:35:40.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.345+0000 7f554f1bc740 20 client.16437 trim_cache size 0 max 16384 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.358+0000 7f554f1bc740 1 Processor -- start 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.358+0000 7f554f1bc740 1 -- start start 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413c21b0 0x55d341793410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 0x55d341793950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413eb070 0x55d341798c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f554f1bc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b0ad0 con 0x55d3413eb070 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f554f1bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b2610 con 0x55d3413c21b0 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f554f1bc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b11a0 con 0x55d3413ca390 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5542d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413eb070 0x55d341798c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5542d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413eb070 0x55d341798c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59072/0 (socket says 172.21.15.33:59072) 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5542d9d640 1 -- 172.21.15.33:0/1698913448 learned_addr learned my addr 172.21.15.33:0/1698913448 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 0x55d341793950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f554259c640 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413c21b0 0x55d341793410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5542d9d640 1 -- 172.21.15.33:0/1698913448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 msgr2=0x55d341793950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5542d9d640 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 0x55d341793950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5542d9d640 1 -- 172.21.15.33:0/1698913448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413c21b0 msgr2=0x55d341793410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5542d9d640 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413c21b0 0x55d341793410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5542d9d640 1 -- 172.21.15.33:0/1698913448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d34179e9d0 con 0x55d3413eb070 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f554259c640 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413c21b0 0x55d341793410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 0x55d341793950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f5542d9d640 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413eb070 0x55d341798c40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f553c0ca1a0 tx=0x7f553c02f500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef58b21593033d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f552bfff640 1 -- 172.21.15.33:0/1698913448 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c0cd630 con 0x55d3413eb070 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f552bfff640 1 -- 172.21.15.33:0/1698913448 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f553c036070 con 0x55d3413eb070 2024-08-28T19:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.359+0000 7f552bfff640 1 -- 172.21.15.33:0/1698913448 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c0cd190 con 0x55d3413eb070 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.360+0000 7f554f1bc740 1 -- 172.21.15.33:0/1698913448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413eb070 msgr2=0x55d341798c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.360+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413eb070 0x55d341798c40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f553c0ca1a0 tx=0x7f553c02f500 comp rx=0 tx=0).stop 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.360+0000 7f554f1bc740 1 -- 172.21.15.33:0/1698913448 shutdown_connections 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.360+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413eb070 0x55d341798c40 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.360+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413ca390 0x55d341793950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.360+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1698913448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413c21b0 0x55d341793410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.360+0000 7f554f1bc740 1 -- 172.21.15.33:0/1698913448 >> 172.21.15.33:0/1698913448 conn(0x55d3413df460 msgr2=0x55d34179a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.360+0000 7f554f1bc740 1 -- 172.21.15.33:0/1698913448 shutdown_connections 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.360+0000 7f554f1bc740 1 -- 172.21.15.33:0/1698913448 wait complete. 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554f1bc740 1 -- start start 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554f1bc740 1 Processor -- start 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d3417aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 0x55d3417af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554f1bc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413eb070 0x55d341817330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554f1bc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b1f40 con 0x55d3413c21b0 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554f1bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f55441b1870 con 0x55d3413ca390 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554f1bc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f55441aeab0 con 0x55d3413eb070 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554f1bc740 10 client.0 _ll_register_callbacks cb 0x7f553401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d3417aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d3417aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59074/0 (socket says 172.21.15.33:59074) 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554259c640 1 -- 172.21.15.33:0/1492589819 learned_addr learned my addr 172.21.15.33:0/1492589819 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 0x55d3417af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f5542d9d640 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413eb070 0x55d341817330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554259c640 1 -- 172.21.15.33:0/1492589819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413eb070 msgr2=0x55d341817330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554259c640 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413eb070 0x55d341817330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554259c640 1 -- 172.21.15.33:0/1492589819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 msgr2=0x55d3417af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554259c640 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 0x55d3417af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f554259c640 1 -- 172.21.15.33:0/1492589819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d341817870 con 0x55d3413c21b0 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.361+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 0x55d3417af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f554259c640 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d3417aefa0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f55340057e0 tx=0x7f553400a3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f81cef5a88ae02 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f5529ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f5529ffb640 1 -- 172.21.15.33:0/1492589819 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553403a060 con 0x55d3413c21b0 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f5529ffb640 1 -- 172.21.15.33:0/1492589819 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5534010a00 con 0x55d3413c21b0 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f554f1bc740 1 -- 172.21.15.33:0/1492589819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f553c036070 con 0x55d3413c21b0 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f5529ffb640 1 -- 172.21.15.33:0/1492589819 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f553401d030 con 0x55d3413c21b0 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f554f1bc740 10 client.16443 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f554f1bc740 1 -- 172.21.15.33:0/1492589819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3418188d0 con 0x55d3413c21b0 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f5529ffb640 1 -- 172.21.15.33:0/1492589819 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f553c036070 con 0x55d3413c21b0 2024-08-28T19:35:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f5529ffb640 1 -- 172.21.15.33:0/1492589819 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5534020040 con 0x55d3413c21b0 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f554f1bc740 10 client.16443 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f554f1bc740 10 client.16443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.362+0000 7f554f1bc740 20 client.16443 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.363+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d34137eda0 0x55d34181b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.363+0000 7f554f1bc740 4 client.16443 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.363+0000 7f554f1bc740 1 -- 172.21.15.33:0/1492589819 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d341705070 con 0x55d34137eda0 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.363+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d34137eda0 0x55d34181b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.363+0000 7f5541d9b640 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d34137eda0 0x55d34181b030 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bb2ddce89352741 server_cookie=d302771d41adeff6 in_seq=0 out_seq=0 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.363+0000 7f5529ffb640 10 client.16443 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.363+0000 7f5529ffb640 1 -- 172.21.15.33:0/1492589819 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d341705070 con 0x55d34137eda0 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.363+0000 7f5529ffb640 10 client.16443 handle_command_reply: tid=0 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.363+0000 7f554f1bc740 1 client.16443 shutdown 2024-08-28T19:35:40.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 1 -- 172.21.15.33:0/1492589819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 msgr2=0x55d3417aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d3417aefa0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f55340057e0 tx=0x7f553400a3d0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 1 -- 172.21.15.33:0/1492589819 shutdown_connections 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d3413eb070 0x55d341817330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3413ca390 0x55d3417af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d34137eda0 0x55d34181b030 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 1 --2- 172.21.15.33:0/1492589819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d3413c21b0 0x55d3417aefa0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f5529ffb640 0 client.16443 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 1 -- 172.21.15.33:0/1492589819 >> 172.21.15.33:0/1492589819 conn(0x55d3413df460 msgr2=0x55d341799f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 1 -- 172.21.15.33:0/1492589819 shutdown_connections 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 1 -- 172.21.15.33:0/1492589819 wait complete. 2024-08-28T19:35:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f554f1bc740 20 client.16443 trim_cache size 0 max 16384 2024-08-28T19:35:40.374 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:35:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f5548c47640 1 -- 172.21.15.33:0/1226314796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f552c0b4cd0 msgr2=0x7f552c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f5548c47640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f552c0b4cd0 0x7f552c0b71e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f55380058c0 tx=0x7f5538004730 comp rx=0 tx=0).stop 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f5548c47640 1 -- 172.21.15.33:0/1226314796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5544108a90 msgr2=0x7f554419fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.364+0000 7f5548c47640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5544108a90 0x7f554419fa00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f553c009430 tx=0x7f553c0319f0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.365+0000 7f5548c47640 1 -- 172.21.15.33:0/1226314796 shutdown_connections 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.365+0000 7f5548c47640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5544108a90 0x7f554419fa00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.365+0000 7f5548c47640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f552c0b4cd0 0x7f552c0b71e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.365+0000 7f5548c47640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5544108140 0x7f554419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.365+0000 7f5548c47640 1 --2- 172.21.15.33:0/1226314796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5544102800 0x7f554419a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.365+0000 7f5548c47640 1 -- 172.21.15.33:0/1226314796 >> 172.21.15.33:0/1226314796 conn(0x7f55440794d0 msgr2=0x7f55441008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.365+0000 7f5548c47640 1 -- 172.21.15.33:0/1226314796 shutdown_connections 2024-08-28T19:35:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:40.365+0000 7f5548c47640 1 -- 172.21.15.33:0/1226314796 wait complete. 2024-08-28T19:35:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:41 smithi033 ceph-mon[18549]: pgmap v439: 129 pgs: 129 active+clean; 3.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-08-28T19:35:42.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:41 smithi059 ceph-mon[22052]: pgmap v439: 129 pgs: 129 active+clean; 3.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-08-28T19:35:42.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:41 smithi122 ceph-mon[22174]: pgmap v439: 129 pgs: 129 active+clean; 3.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-08-28T19:35:42.236 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:35:42.236 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:35:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.030+0000 7fcf094a9640 1 -- 172.21.15.33:0/3625024661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf04109bb0 msgr2=0x7fcf041103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.030+0000 7fcf094a9640 1 --2- 172.21.15.33:0/3625024661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf04109bb0 0x7fcf041103e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009900 tx=0x7fcefc02a410 comp rx=0 tx=0).stop 2024-08-28T19:35:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.030+0000 7fcf094a9640 1 -- 172.21.15.33:0/3625024661 shutdown_connections 2024-08-28T19:35:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.030+0000 7fcf094a9640 1 --2- 172.21.15.33:0/3625024661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf04109bb0 0x7fcf041103e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.030+0000 7fcf094a9640 1 --2- 172.21.15.33:0/3625024661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf04109260 0x7fcf04109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.030+0000 7fcf094a9640 1 --2- 172.21.15.33:0/3625024661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf04103920 0x7fcf04103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.030+0000 7fcf094a9640 1 -- 172.21.15.33:0/3625024661 >> 172.21.15.33:0/3625024661 conn(0x7fcf040ff3b0 msgr2=0x7fcf04101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.030+0000 7fcf094a9640 1 -- 172.21.15.33:0/3625024661 shutdown_connections 2024-08-28T19:35:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.030+0000 7fcf094a9640 1 -- 172.21.15.33:0/3625024661 wait complete. 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.031+0000 7fcf094a9640 1 Processor -- start 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.031+0000 7fcf094a9640 1 -- start start 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.031+0000 7fcf094a9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf04103920 0x7fcf0419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.031+0000 7fcf094a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf04109260 0x7fcf0419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.031+0000 7fcf094a9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf04109bb0 0x7fcf0419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.031+0000 7fcf094a9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcf04113870 con 0x7fcf04109bb0 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.031+0000 7fcf094a9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041136f0 con 0x7fcf04103920 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.031+0000 7fcf094a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041139f0 con 0x7fcf04109260 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf04109bb0 0x7fcf0419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf04109bb0 0x7fcf0419fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59098/0 (socket says 172.21.15.33:59098) 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf037fe640 1 -- 172.21.15.33:0/430455984 learned_addr learned my addr 172.21.15.33:0/430455984 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf027fc640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf04109260 0x7fcf0419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf02ffd640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf04103920 0x7fcf0419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf037fe640 1 -- 172.21.15.33:0/430455984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf04109260 msgr2=0x7fcf0419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf037fe640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf04109260 0x7fcf0419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf037fe640 1 -- 172.21.15.33:0/430455984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf04103920 msgr2=0x7fcf0419a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf037fe640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf04103920 0x7fcf0419a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf037fe640 1 -- 172.21.15.33:0/430455984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf041a01f0 con 0x7fcf04109bb0 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf02ffd640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf04103920 0x7fcf0419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fcf037fe640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf04109bb0 0x7fcf0419fac0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcefc004770 tx=0x7fcefc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fceebfff640 1 -- 172.21.15.33:0/430455984 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc03f030 con 0x7fcf04109bb0 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fceebfff640 1 -- 172.21.15.33:0/430455984 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcefc003aa0 con 0x7fcf04109bb0 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.032+0000 7fceebfff640 1 -- 172.21.15.33:0/430455984 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc035070 con 0x7fcf04109bb0 2024-08-28T19:35:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.033+0000 7fcf094a9640 1 -- 172.21.15.33:0/430455984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf041a0480 con 0x7fcf04109bb0 2024-08-28T19:35:43.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.033+0000 7fcf094a9640 1 -- 172.21.15.33:0/430455984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf041a6c40 con 0x7fcf04109bb0 2024-08-28T19:35:43.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.035+0000 7fceebfff640 1 -- 172.21.15.33:0/430455984 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcefc042030 con 0x7fcf04109bb0 2024-08-28T19:35:43.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.036+0000 7fcf0fa1e740 1 Processor -- start 2024-08-28T19:35:43.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.036+0000 7fcf0fa1e740 1 -- start start 2024-08-28T19:35:43.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.036+0000 7fceebfff640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceec0b4d20 0x7fceec0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.036+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae116c350 0x55fae1512780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.036+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 0x55fae1512cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.036+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1513200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.036+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fae14885f0 con 0x55fae114b670 2024-08-28T19:35:43.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.036+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fae1477b80 con 0x55fae116c350 2024-08-28T19:35:43.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.036+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fae147bb30 con 0x55fae1143490 2024-08-28T19:35:43.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1513200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf027fc640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceec0b4d20 0x7fceec0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1513200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59106/0 (socket says 172.21.15.33:59106) 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf037fe640 1 -- 172.21.15.33:0/1742326114 learned_addr learned my addr 172.21.15.33:0/1742326114 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fceebfff640 1 -- 172.21.15.33:0/430455984 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcefc105f90 con 0x7fcf04109bb0 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf02ffd640 1 --2- 172.21.15.33:0/1742326114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae116c350 0x55fae1512780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf027fc640 1 --2- 172.21.15.33:0/1742326114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 0x55fae1512cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf037fe640 1 -- 172.21.15.33:0/1742326114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 msgr2=0x55fae1512cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf037fe640 1 --2- 172.21.15.33:0/1742326114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 0x55fae1512cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf037fe640 1 -- 172.21.15.33:0/1742326114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae116c350 msgr2=0x55fae1512780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf037fe640 1 --2- 172.21.15.33:0/1742326114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae116c350 0x55fae1512780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf037fe640 1 -- 172.21.15.33:0/1742326114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fae11d7930 con 0x55fae114b670 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf027fc640 1 --2- 172.21.15.33:0/1742326114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 0x55fae1512cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf037fe640 1 --2- 172.21.15.33:0/1742326114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1513200 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0c9540 tx=0x7fcefc078260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8d6f7b00ef7fad server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcf027fc640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceec0b4d20 0x7fceec0b7230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55fae1511400 tx=0x7fcef8009a50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcee97fa640 1 -- 172.21.15.33:0/1742326114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0cbc20 con 0x55fae114b670 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.037+0000 7fcee97fa640 1 -- 172.21.15.33:0/1742326114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcefc0cbde0 con 0x55fae114b670 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.038+0000 7fcee97fa640 1 -- 172.21.15.33:0/1742326114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc09ec50 con 0x55fae114b670 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.038+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/1742326114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 msgr2=0x55fae1513200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.038+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/1742326114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1513200 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0c9540 tx=0x7fcefc078260 comp rx=0 tx=0).stop 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.038+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/1742326114 shutdown_connections 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.038+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/1742326114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1513200 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.038+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/1742326114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 0x55fae1512cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.038+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/1742326114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae116c350 0x55fae1512780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.038+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/1742326114 >> 172.21.15.33:0/1742326114 conn(0x55fae1160740 msgr2=0x55fae1510670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.038+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/1742326114 shutdown_connections 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/1742326114 wait complete. 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf0fa1e740 1 -- start start 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf0fa1e740 1 Processor -- start 2024-08-28T19:35:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae1143490 0x55fae151de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 0x55fae151e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 0x55fae152e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fae12da890 con 0x55fae1143490 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fae13fe790 con 0x55fae114b670 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fae1525130 con 0x55fae116c350 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf0fa1e740 10 client.0 _ll_register_callbacks cb 0x55fae1183ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf02ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae1143490 0x55fae151de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf02ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae1143490 0x55fae151de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59114/0 (socket says 172.21.15.33:59114) 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.039+0000 7fcf02ffd640 1 -- 172.21.15.33:0/2079019496 learned_addr learned my addr 172.21.15.33:0/2079019496 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf037fe640 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 0x55fae152e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf027fc640 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 0x55fae151e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf02ffd640 1 -- 172.21.15.33:0/2079019496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 msgr2=0x55fae152e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf02ffd640 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 0x55fae152e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf02ffd640 1 -- 172.21.15.33:0/2079019496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 msgr2=0x55fae151e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf02ffd640 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 0x55fae151e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf02ffd640 1 -- 172.21.15.33:0/2079019496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fae1435f30 con 0x55fae1143490 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf037fe640 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 0x55fae152e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf027fc640 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 0x55fae151e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf02ffd640 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae1143490 0x55fae151de80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcef4013d00 tx=0x7fcef40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840fc0c73c35e187 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcee6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcee6ff5640 1 -- 172.21.15.33:0/2079019496 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef401c440 con 0x55fae1143490 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/2079019496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcefc0cbde0 con 0x55fae1143490 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcee6ff5640 1 -- 172.21.15.33:0/2079019496 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcef401b3e0 con 0x55fae1143490 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcee6ff5640 1 -- 172.21.15.33:0/2079019496 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcef401c5e0 con 0x55fae1143490 2024-08-28T19:35:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf0fa1e740 10 client.16455 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.040+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/2079019496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fae1530e30 con 0x55fae1143490 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.041+0000 7fcee6ff5640 1 -- 172.21.15.33:0/2079019496 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcefc0cbde0 con 0x55fae1143490 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.041+0000 7fcee6ff5640 1 -- 172.21.15.33:0/2079019496 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcef401a070 con 0x55fae1143490 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.041+0000 7fcf0fa1e740 10 client.16455 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.041+0000 7fcf0fa1e740 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.041+0000 7fcf0fa1e740 20 client.16455 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.041+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fae112acd0 0x55fae1534330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.041+0000 7fcf0fa1e740 4 client.16455 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.041+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/2079019496 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fae148a540 con 0x55fae112acd0 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.041+0000 7fcf027fc640 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fae112acd0 0x55fae1534330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.042+0000 7fcee6ff5640 10 client.16455 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.042+0000 7fcf027fc640 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fae112acd0 0x55fae1534330 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef457b55b8362ec8 server_cookie=7e3c4e0d59614222 in_seq=0 out_seq=0 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcee6ff5640 1 -- 172.21.15.33:0/2079019496 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fae148a540 con 0x55fae112acd0 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcee6ff5640 10 client.16455 handle_command_reply: tid=0 2024-08-28T19:35:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 client.16455 shutdown 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/2079019496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae1143490 msgr2=0x55fae151de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae1143490 0x55fae151de80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcef4013d00 tx=0x7fcef40117b0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/2079019496 shutdown_connections 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 0x55fae152e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 0x55fae151e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fae112acd0 0x55fae1534330 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/2079019496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae1143490 0x55fae151de80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcee6ff5640 0 client.16455 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/2079019496 >> 172.21.15.33:0/2079019496 conn(0x55fae1160740 msgr2=0x55fae1514170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/2079019496 shutdown_connections 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/2079019496 wait complete. 2024-08-28T19:35:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.043+0000 7fcf0fa1e740 20 client.16455 trim_cache size 0 max 16384 2024-08-28T19:35:43.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf0fa1e740 1 Processor -- start 2024-08-28T19:35:43.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf0fa1e740 1 -- start start 2024-08-28T19:35:43.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 0x55fae151b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 0x55fae151b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae116c350 0x55fae1539af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041ae9b0 con 0x55fae116c350 2024-08-28T19:35:43.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041b04f0 con 0x55fae114b670 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041af080 con 0x55fae1143490 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae116c350 0x55fae1539af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf037fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae116c350 0x55fae1539af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59124/0 (socket says 172.21.15.33:59124) 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf037fe640 1 -- 172.21.15.33:0/1082505371 learned_addr learned my addr 172.21.15.33:0/1082505371 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.061+0000 7fcf027fc640 1 --2- 172.21.15.33:0/1082505371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 0x55fae151b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcf037fe640 1 -- 172.21.15.33:0/1082505371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 msgr2=0x55fae151b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcf02ffd640 1 --2- 172.21.15.33:0/1082505371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 0x55fae151b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcf037fe640 1 --2- 172.21.15.33:0/1082505371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 0x55fae151b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcf037fe640 1 -- 172.21.15.33:0/1082505371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 msgr2=0x55fae151b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcf037fe640 1 --2- 172.21.15.33:0/1082505371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 0x55fae151b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcf037fe640 1 -- 172.21.15.33:0/1082505371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fae151c380 con 0x55fae116c350 2024-08-28T19:35:43.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcf027fc640 1 --2- 172.21.15.33:0/1082505371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 0x55fae151b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:43.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcf037fe640 1 --2- 172.21.15.33:0/1082505371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae116c350 0x55fae1539af0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcefc03d040 tx=0x7fcefc003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862398607d45c288 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:43.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcee8ff9640 1 -- 172.21.15.33:0/1082505371 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc049040 con 0x55fae116c350 2024-08-28T19:35:43.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcee8ff9640 1 -- 172.21.15.33:0/1082505371 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcefc0d0b40 con 0x55fae116c350 2024-08-28T19:35:43.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.062+0000 7fcee8ff9640 1 -- 172.21.15.33:0/1082505371 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0cba40 con 0x55fae116c350 2024-08-28T19:35:43.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/1082505371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae116c350 msgr2=0x55fae1539af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/1082505371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae116c350 0x55fae1539af0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcefc03d040 tx=0x7fcefc003f50 comp rx=0 tx=0).stop 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/1082505371 shutdown_connections 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/1082505371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae116c350 0x55fae1539af0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/1082505371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae114b670 0x55fae151b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/1082505371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae1143490 0x55fae151b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/1082505371 >> 172.21.15.33:0/1082505371 conn(0x55fae1160740 msgr2=0x55fae151c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/1082505371 shutdown_connections 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/1082505371 wait complete. 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 -- start start 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.063+0000 7fcf0fa1e740 1 Processor -- start 2024-08-28T19:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae1143490 0x55fae1528bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1529190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf0fa1e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 0x55fae1597cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041afe20 con 0x55fae114b670 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041af750 con 0x55fae1143490 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf0fa1e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041ac990 con 0x55fae116c350 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf0fa1e740 10 client.0 _ll_register_callbacks cb 0x7fcef4009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf027fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1529190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf027fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1529190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59126/0 (socket says 172.21.15.33:59126) 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf027fc640 1 -- 172.21.15.33:0/4030190423 learned_addr learned my addr 172.21.15.33:0/4030190423 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf037fe640 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 0x55fae1597cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf02ffd640 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae1143490 0x55fae1528bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf027fc640 1 -- 172.21.15.33:0/4030190423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 msgr2=0x55fae1597cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf027fc640 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 0x55fae1597cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf027fc640 1 -- 172.21.15.33:0/4030190423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae1143490 msgr2=0x55fae1528bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf027fc640 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae1143490 0x55fae1528bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf027fc640 1 -- 172.21.15.33:0/4030190423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fae1598340 con 0x55fae114b670 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcf027fc640 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1529190 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55fae1534a90 tx=0x7fcef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251c6b27c50cd948 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.064+0000 7fcee6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcee6ff5640 1 -- 172.21.15.33:0/4030190423 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef802f030 con 0x55fae114b670 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/4030190423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fae1485fe0 con 0x55fae114b670 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcee6ff5640 1 -- 172.21.15.33:0/4030190423 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcef8005020 con 0x55fae114b670 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcee6ff5640 1 -- 172.21.15.33:0/4030190423 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcef8039050 con 0x55fae114b670 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcf0fa1e740 10 client.16461 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:43.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/4030190423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fae159f720 con 0x55fae114b670 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcee6ff5640 1 -- 172.21.15.33:0/4030190423 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fae1485fe0 con 0x55fae114b670 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcee6ff5640 1 -- 172.21.15.33:0/4030190423 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcef801b040 con 0x55fae114b670 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcf0fa1e740 10 client.16461 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcf0fa1e740 10 client.16461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcf0fa1e740 20 client.16461 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fae1100080 0x55fae15a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcf0fa1e740 4 client.16461 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.065+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/4030190423 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fae1483720 con 0x55fae1100080 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.066+0000 7fcf02ffd640 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fae1100080 0x55fae15a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.066+0000 7fcf02ffd640 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fae1100080 0x55fae15a1eb0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6d4b187b05ee6d server_cookie=72634ac7dff9b364 in_seq=0 out_seq=0 2024-08-28T19:35:43.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.066+0000 7fcee6ff5640 10 client.16461 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcee6ff5640 1 -- 172.21.15.33:0/4030190423 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fae1483720 con 0x55fae1100080 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcee6ff5640 10 client.16461 handle_command_reply: tid=0 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 client.16461 shutdown 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/4030190423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 msgr2=0x55fae1529190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1529190 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55fae1534a90 tx=0x7fcef80046c0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/4030190423 shutdown_connections 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fae116c350 0x55fae1597cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fae1100080 0x55fae15a1eb0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fae114b670 0x55fae1529190 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 --2- 172.21.15.33:0/4030190423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fae1143490 0x55fae1528bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/4030190423 >> 172.21.15.33:0/4030190423 conn(0x55fae1160740 msgr2=0x55fae15137b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:43.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcee6ff5640 0 client.16461 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:43.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/4030190423 shutdown_connections 2024-08-28T19:35:43.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 1 -- 172.21.15.33:0/4030190423 wait complete. 2024-08-28T19:35:43.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.068+0000 7fcf0fa1e740 20 client.16461 trim_cache size 0 max 16384 2024-08-28T19:35:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:35:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:35:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "f53b0aa4-957f-44a9-bb72-a48225282b53", 2024-08-28T19:35:43.075 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:35:43.075 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:35:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 -- 172.21.15.33:0/430455984 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceec0b4d20 msgr2=0x7fceec0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceec0b4d20 0x7fceec0b7230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55fae1511400 tx=0x7fcef8009a50 comp rx=0 tx=0).stop 2024-08-28T19:35:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 -- 172.21.15.33:0/430455984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf04109bb0 msgr2=0x7fcf0419fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf04109bb0 0x7fcf0419fac0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcefc004770 tx=0x7fcefc004270 comp rx=0 tx=0).stop 2024-08-28T19:35:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 -- 172.21.15.33:0/430455984 shutdown_connections 2024-08-28T19:35:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf04109bb0 0x7fcf0419fac0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceec0b4d20 0x7fceec0b7230 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf04109260 0x7fcf0419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 --2- 172.21.15.33:0/430455984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf04103920 0x7fcf0419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 -- 172.21.15.33:0/430455984 >> 172.21.15.33:0/430455984 conn(0x7fcf040ff3b0 msgr2=0x7fcf04106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 -- 172.21.15.33:0/430455984 shutdown_connections 2024-08-28T19:35:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:43.069+0000 7fcf094a9640 1 -- 172.21.15.33:0/430455984 wait complete. 2024-08-28T19:35:43.877 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:43 smithi033 ceph-mon[18549]: pgmap v440: 129 pgs: 129 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-08-28T19:35:43.878 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:43 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:35:43.878 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:43 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:43.878 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:43 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:35:43.878 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:43 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:43.911 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:35:44.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:43 smithi059 ceph-mon[22052]: pgmap v440: 129 pgs: 129 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-08-28T19:35:44.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:43 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:35:44.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:43 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:44.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:43 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:35:44.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:43 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:44.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:43 smithi122 ceph-mon[22174]: pgmap v440: 129 pgs: 129 active+clean; 3.0 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-08-28T19:35:44.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:43 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:35:44.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:43 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:44.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:43 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:35:44.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:43 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:44.168 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.613+0000 7f35e8525640 1 -- 172.21.15.33:0/1038047902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35e0108a90 msgr2=0x7f35e010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.613+0000 7f35e8525640 1 --2- 172.21.15.33:0/1038047902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35e0108a90 0x7f35e010f2c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009ca0 tx=0x7f35d802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.613+0000 7f35e8525640 1 -- 172.21.15.33:0/1038047902 shutdown_connections 2024-08-28T19:35:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.613+0000 7f35e8525640 1 --2- 172.21.15.33:0/1038047902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35e0108a90 0x7f35e010f2c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.613+0000 7f35e8525640 1 --2- 172.21.15.33:0/1038047902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35e0108140 0x7f35e0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.613+0000 7f35e8525640 1 --2- 172.21.15.33:0/1038047902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35e0102800 0x7f35e0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.613+0000 7f35e8525640 1 -- 172.21.15.33:0/1038047902 >> 172.21.15.33:0/1038047902 conn(0x7f35e00794d0 msgr2=0x7f35e00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.613+0000 7f35e8525640 1 -- 172.21.15.33:0/1038047902 shutdown_connections 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.613+0000 7f35e8525640 1 -- 172.21.15.33:0/1038047902 wait complete. 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e8525640 1 Processor -- start 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e8525640 1 -- start start 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e8525640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35e0102800 0x7f35e019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e8525640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35e0108140 0x7f35e019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e8525640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35e0108a90 0x7f35e019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e8525640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f35e0113820 con 0x7f35e0102800 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e8525640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f35e01136a0 con 0x7f35e0108140 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e8525640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f35e01139a0 con 0x7f35e0108a90 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e62c1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35e0102800 0x7f35e019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e62c1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35e0102800 0x7f35e019a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59148/0 (socket says 172.21.15.33:59148) 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.614+0000 7f35e62c1640 1 -- 172.21.15.33:0/2409201284 learned_addr learned my addr 172.21.15.33:0/2409201284 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e5ac0640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35e0108140 0x7f35e019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e6ac2640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35e0108a90 0x7f35e019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e62c1640 1 -- 172.21.15.33:0/2409201284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35e0108a90 msgr2=0x7f35e019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e62c1640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35e0108a90 0x7f35e019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e62c1640 1 -- 172.21.15.33:0/2409201284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35e0108140 msgr2=0x7f35e019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e62c1640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35e0108140 0x7f35e019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e62c1640 1 -- 172.21.15.33:0/2409201284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e01a01a0 con 0x7f35e0102800 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e6ac2640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35e0108a90 0x7f35e019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e62c1640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35e0102800 0x7f35e019a230 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f35dc00d950 tx=0x7f35dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35d77fe640 1 -- 172.21.15.33:0/2409201284 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc017070 con 0x7f35e0102800 2024-08-28T19:35:44.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35d77fe640 1 -- 172.21.15.33:0/2409201284 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35dc009c30 con 0x7f35e0102800 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e8525640 1 -- 172.21.15.33:0/2409201284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e01a0490 con 0x7f35e0102800 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35d77fe640 1 -- 172.21.15.33:0/2409201284 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc00f620 con 0x7f35e0102800 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.615+0000 7f35e8525640 1 -- 172.21.15.33:0/2409201284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e01a6bf0 con 0x7f35e0102800 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35eea9a740 1 Processor -- start 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35d77fe640 1 -- 172.21.15.33:0/2409201284 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f35dc010460 con 0x7f35e0102800 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35eea9a740 1 -- start start 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1e6070 0x55a3bf58b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 0x55a3bf58bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35eea9a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a3bf502630 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35eea9a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a3bf4f1bc0 con 0x55a3bf1c5390 2024-08-28T19:35:44.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35eea9a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a3bf4f5b70 con 0x55a3bf1e6070 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35e62c1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35e62c1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59150/0 (socket says 172.21.15.33:59150) 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35e62c1640 1 -- 172.21.15.33:0/3015629697 learned_addr learned my addr 172.21.15.33:0/3015629697 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.618+0000 7f35e5ac0640 1 --2- 172.21.15.33:0/3015629697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 0x55a3bf58bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35e6ac2640 1 --2- 172.21.15.33:0/3015629697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1e6070 0x55a3bf58b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35e62c1640 1 -- 172.21.15.33:0/3015629697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1e6070 msgr2=0x55a3bf58b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35e62c1640 1 --2- 172.21.15.33:0/3015629697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1e6070 0x55a3bf58b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35e62c1640 1 -- 172.21.15.33:0/3015629697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 msgr2=0x55a3bf58bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35d77fe640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35cc0b4ca0 0x7f35cc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35e62c1640 1 --2- 172.21.15.33:0/3015629697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 0x55a3bf58bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35e62c1640 1 -- 172.21.15.33:0/3015629697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3bf251650 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35e5ac0640 1 --2- 172.21.15.33:0/3015629697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 0x55a3bf58bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35e6ac2640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35cc0b4ca0 0x7f35cc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35d77fe640 1 -- 172.21.15.33:0/2409201284 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f35dc0e5450 con 0x7f35e0102800 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35e62c1640 1 --2- 172.21.15.33:0/3015629697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58b800 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0e2860 tx=0x7f35dc0bd400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16db2217bdca7c09 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35d4ff9640 1 -- 172.21.15.33:0/3015629697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc020070 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35d4ff9640 1 -- 172.21.15.33:0/3015629697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35dc0ab3a0 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35d4ff9640 1 -- 172.21.15.33:0/3015629697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0ab1e0 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.619+0000 7f35e6ac2640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35cc0b4ca0 0x7f35cc0b71b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f35d802f500 tx=0x7f35d802f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.620+0000 7f35eea9a740 1 -- 172.21.15.33:0/3015629697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 msgr2=0x55a3bf58b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.620+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3015629697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58b800 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0e2860 tx=0x7f35dc0bd400 comp rx=0 tx=0).stop 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.620+0000 7f35eea9a740 1 -- 172.21.15.33:0/3015629697 shutdown_connections 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.620+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3015629697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 0x55a3bf58bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.620+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3015629697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58b800 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.620+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3015629697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1e6070 0x55a3bf58b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.620+0000 7f35eea9a740 1 -- 172.21.15.33:0/3015629697 >> 172.21.15.33:0/3015629697 conn(0x55a3bf1da460 msgr2=0x55a3bf5891b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:44.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.620+0000 7f35eea9a740 1 -- 172.21.15.33:0/3015629697 shutdown_connections 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.620+0000 7f35eea9a740 1 -- 172.21.15.33:0/3015629697 wait complete. 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35eea9a740 1 -- start start 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35eea9a740 1 Processor -- start 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf59ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1c5390 0x55a3bf59b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1e6070 0x55a3bf5a7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35eea9a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a3bf354700 con 0x55a3bf1c5390 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35eea9a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a3bf478700 con 0x55a3bf1e6070 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35eea9a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a3bf59ddd0 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35eea9a740 10 client.0 _ll_register_callbacks cb 0x55a3bf4a7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35e5ac0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1c5390 0x55a3bf59b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35e5ac0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1c5390 0x55a3bf59b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59166/0 (socket says 172.21.15.33:59166) 2024-08-28T19:35:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35e5ac0640 1 -- 172.21.15.33:0/3196562909 learned_addr learned my addr 172.21.15.33:0/3196562909 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35e62c1640 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf59ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.621+0000 7f35e6ac2640 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1e6070 0x55a3bf5a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.622+0000 7f35e5ac0640 1 -- 172.21.15.33:0/3196562909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1bd1b0 msgr2=0x55a3bf59ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.622+0000 7f35e5ac0640 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf59ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.622+0000 7f35e5ac0640 1 -- 172.21.15.33:0/3196562909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1e6070 msgr2=0x55a3bf5a7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.622+0000 7f35e5ac0640 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1e6070 0x55a3bf5a7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.622+0000 7f35e5ac0640 1 -- 172.21.15.33:0/3196562909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3bf4b18b0 con 0x55a3bf1c5390 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.622+0000 7f35e5ac0640 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1c5390 0x55a3bf59b3b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f35d000b9b0 tx=0x7f35d000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa46e41d7f60f3f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.622+0000 7f35c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.622+0000 7f35c9ffb640 1 -- 172.21.15.33:0/3196562909 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0003dc0 con 0x55a3bf1c5390 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35eea9a740 1 -- 172.21.15.33:0/3196562909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35dc0ab3a0 con 0x55a3bf1c5390 2024-08-28T19:35:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.622+0000 7f35c9ffb640 1 -- 172.21.15.33:0/3196562909 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f35d0005020 con 0x55a3bf1c5390 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35c9ffb640 1 -- 172.21.15.33:0/3196562909 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f35d0024050 con 0x55a3bf1c5390 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35eea9a740 10 client.16473 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35eea9a740 1 -- 172.21.15.33:0/3196562909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a3bf5a9c40 con 0x55a3bf1c5390 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35c9ffb640 1 -- 172.21.15.33:0/3196562909 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35dc0ab3a0 con 0x55a3bf1c5390 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35c9ffb640 1 -- 172.21.15.33:0/3196562909 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f35d0011440 con 0x55a3bf1c5390 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35eea9a740 10 client.16473 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35eea9a740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35eea9a740 20 client.16473 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3bf1a49f0 0x55a3bf5ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35eea9a740 4 client.16473 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.623+0000 7f35eea9a740 1 -- 172.21.15.33:0/3196562909 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3bf504580 con 0x55a3bf1a49f0 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.624+0000 7f35e62c1640 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3bf1a49f0 0x55a3bf5ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.624+0000 7f35c9ffb640 10 client.16473 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.624+0000 7f35e62c1640 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3bf1a49f0 0x55a3bf5ad1b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=537d3cc3384cf740 server_cookie=e99a90241e73d829 in_seq=0 out_seq=0 2024-08-28T19:35:44.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35c9ffb640 1 -- 172.21.15.33:0/3196562909 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a3bf504580 con 0x55a3bf1a49f0 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35c9ffb640 10 client.16473 handle_command_reply: tid=0 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 client.16473 shutdown 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 -- 172.21.15.33:0/3196562909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1c5390 msgr2=0x55a3bf59b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1c5390 0x55a3bf59b3b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f35d000b9b0 tx=0x7f35d000be70 comp rx=0 tx=0).stop 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 -- 172.21.15.33:0/3196562909 shutdown_connections 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1e6070 0x55a3bf5a7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3bf1a49f0 0x55a3bf5ad1b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1c5390 0x55a3bf59b3b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3196562909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf59ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35c9ffb640 0 client.16473 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 -- 172.21.15.33:0/3196562909 >> 172.21.15.33:0/3196562909 conn(0x55a3bf1da460 msgr2=0x55a3bf58e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 -- 172.21.15.33:0/3196562909 shutdown_connections 2024-08-28T19:35:44.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 1 -- 172.21.15.33:0/3196562909 wait complete. 2024-08-28T19:35:44.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.625+0000 7f35eea9a740 20 client.16473 trim_cache size 0 max 16384 2024-08-28T19:35:44.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35eea9a740 1 Processor -- start 2024-08-28T19:35:44.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35eea9a740 1 -- start start 2024-08-28T19:35:44.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 0x55a3bf5a7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1e6070 0x55a3bf5a7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35eea9a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f35e01ae950 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35eea9a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f35e01b0490 con 0x55a3bf1c5390 2024-08-28T19:35:44.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35eea9a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f35e01af020 con 0x55a3bf1e6070 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35e62c1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35e62c1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59180/0 (socket says 172.21.15.33:59180) 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35e62c1640 1 -- 172.21.15.33:0/3087131971 learned_addr learned my addr 172.21.15.33:0/3087131971 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35e6ac2640 1 --2- 172.21.15.33:0/3087131971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1e6070 0x55a3bf5a7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.643+0000 7f35e5ac0640 1 --2- 172.21.15.33:0/3087131971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 0x55a3bf5a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.644+0000 7f35e62c1640 1 -- 172.21.15.33:0/3087131971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1e6070 msgr2=0x55a3bf5a7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.644+0000 7f35e62c1640 1 --2- 172.21.15.33:0/3087131971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1e6070 0x55a3bf5a7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.644+0000 7f35e62c1640 1 -- 172.21.15.33:0/3087131971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 msgr2=0x55a3bf5a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.644+0000 7f35e62c1640 1 --2- 172.21.15.33:0/3087131971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 0x55a3bf5a7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.644+0000 7f35e62c1640 1 -- 172.21.15.33:0/3087131971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3bf59d5b0 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.644+0000 7f35e5ac0640 1 --2- 172.21.15.33:0/3087131971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 0x55a3bf5a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.644+0000 7f35e62c1640 1 --2- 172.21.15.33:0/3087131971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58eb20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000c00 tx=0x7f35dc00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88087229a518882 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.644+0000 7f35cbfff640 1 -- 172.21.15.33:0/3087131971 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc020040 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.644+0000 7f35cbfff640 1 -- 172.21.15.33:0/3087131971 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35dc0ab3a0 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.644+0000 7f35cbfff640 1 -- 172.21.15.33:0/3087131971 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0ab000 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 -- 172.21.15.33:0/3087131971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 msgr2=0x55a3bf58eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3087131971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58eb20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000c00 tx=0x7f35dc00bf60 comp rx=0 tx=0).stop 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 -- 172.21.15.33:0/3087131971 shutdown_connections 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3087131971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1e6070 0x55a3bf5a7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3087131971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1c5390 0x55a3bf5a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 --2- 172.21.15.33:0/3087131971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf58eb20 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 -- 172.21.15.33:0/3087131971 >> 172.21.15.33:0/3087131971 conn(0x55a3bf1da460 msgr2=0x55a3bf58e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:44.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 -- 172.21.15.33:0/3087131971 shutdown_connections 2024-08-28T19:35:44.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 -- 172.21.15.33:0/3087131971 wait complete. 2024-08-28T19:35:44.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 -- start start 2024-08-28T19:35:44.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.645+0000 7f35eea9a740 1 Processor -- start 2024-08-28T19:35:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf59f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1c5390 0x55a3bf59fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35eea9a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1e6070 0x55a3bf616b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35eea9a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f35e01afdc0 con 0x55a3bf1e6070 2024-08-28T19:35:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35eea9a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f35e01af6f0 con 0x55a3bf1bd1b0 2024-08-28T19:35:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35eea9a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f35e01ac930 con 0x55a3bf1c5390 2024-08-28T19:35:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35eea9a740 10 client.0 _ll_register_callbacks cb 0x7f35d00041f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e6ac2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1e6070 0x55a3bf616b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e6ac2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1e6070 0x55a3bf616b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59182/0 (socket says 172.21.15.33:59182) 2024-08-28T19:35:44.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e62c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf59f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e6ac2640 1 -- 172.21.15.33:0/680335107 learned_addr learned my addr 172.21.15.33:0/680335107 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e5ac0640 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1c5390 0x55a3bf59fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e6ac2640 1 -- 172.21.15.33:0/680335107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1c5390 msgr2=0x55a3bf59fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e6ac2640 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1c5390 0x55a3bf59fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e6ac2640 1 -- 172.21.15.33:0/680335107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1bd1b0 msgr2=0x55a3bf59f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e6ac2640 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf59f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e6ac2640 1 -- 172.21.15.33:0/680335107 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3bf6171a0 con 0x55a3bf1e6070 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35e6ac2640 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1e6070 0x55a3bf616b30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f35d80318a0 tx=0x7f35d80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c76db860cd79b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.646+0000 7f35c9ffb640 1 -- 172.21.15.33:0/680335107 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d8055060 con 0x55a3bf1e6070 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35c9ffb640 1 -- 172.21.15.33:0/680335107 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f35d80309d0 con 0x55a3bf1e6070 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35eea9a740 1 -- 172.21.15.33:0/680335107 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35dc0ab3a0 con 0x55a3bf1e6070 2024-08-28T19:35:44.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35c9ffb640 1 -- 172.21.15.33:0/680335107 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f35d8030bd0 con 0x55a3bf1e6070 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35eea9a740 10 client.16479 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35eea9a740 1 -- 172.21.15.33:0/680335107 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a3bf618380 con 0x55a3bf1e6070 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35c9ffb640 1 -- 172.21.15.33:0/680335107 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35dc0ab3a0 con 0x55a3bf1e6070 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35c9ffb640 1 -- 172.21.15.33:0/680335107 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f35d8043040 con 0x55a3bf1e6070 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35eea9a740 10 client.16479 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35eea9a740 10 client.16479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35eea9a740 20 client.16479 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35eea9a740 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3bf179da0 0x55a3bf61aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35eea9a740 4 client.16479 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35eea9a740 1 -- 172.21.15.33:0/680335107 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a3bf500020 con 0x55a3bf179da0 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.647+0000 7f35e62c1640 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3bf179da0 0x55a3bf61aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35e62c1640 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3bf179da0 0x55a3bf61aba0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58db1393ca59c686 server_cookie=eb0db7b476fc3aeb in_seq=0 out_seq=0 2024-08-28T19:35:44.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35c9ffb640 10 client.16479 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35c9ffb640 1 -- 172.21.15.33:0/680335107 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55a3bf500020 con 0x55a3bf179da0 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35c9ffb640 10 client.16479 handle_command_reply: tid=0 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 client.16479 shutdown 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 -- 172.21.15.33:0/680335107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1e6070 msgr2=0x55a3bf616b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1e6070 0x55a3bf616b30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f35d80318a0 tx=0x7f35d80095c0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 -- 172.21.15.33:0/680335107 shutdown_connections 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3bf179da0 0x55a3bf61aba0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3bf1e6070 0x55a3bf616b30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3bf1c5390 0x55a3bf59fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 --2- 172.21.15.33:0/680335107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3bf1bd1b0 0x55a3bf59f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 -- 172.21.15.33:0/680335107 >> 172.21.15.33:0/680335107 conn(0x55a3bf1da460 msgr2=0x55a3bf58c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35c9ffb640 0 client.16479 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:44.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 -- 172.21.15.33:0/680335107 shutdown_connections 2024-08-28T19:35:44.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 1 -- 172.21.15.33:0/680335107 wait complete. 2024-08-28T19:35:44.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.648+0000 7f35eea9a740 20 client.16479 trim_cache size 0 max 16384 2024-08-28T19:35:44.657 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:35:44.657 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:35:44.657 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:35:44.657 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:35:44.657 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:35:44.657 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:35:44.657 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:44.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:44.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:44.661 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:35:44.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 -- 172.21.15.33:0/2409201284 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35cc0b4ca0 msgr2=0x7f35cc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:44.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35cc0b4ca0 0x7f35cc0b71b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f35d802f500 tx=0x7f35d802f310 comp rx=0 tx=0).stop 2024-08-28T19:35:44.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 -- 172.21.15.33:0/2409201284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35e0102800 msgr2=0x7f35e019a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:44.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35e0102800 0x7f35e019a230 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f35dc00d950 tx=0x7f35dc00de10 comp rx=0 tx=0).stop 2024-08-28T19:35:44.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 -- 172.21.15.33:0/2409201284 shutdown_connections 2024-08-28T19:35:44.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35cc0b4ca0 0x7f35cc0b71b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f35e0108a90 0x7f35e019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35e0108140 0x7f35e019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 --2- 172.21.15.33:0/2409201284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35e0102800 0x7f35e019a230 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:44.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 -- 172.21.15.33:0/2409201284 >> 172.21.15.33:0/2409201284 conn(0x7f35e00794d0 msgr2=0x7f35e01041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:44.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 -- 172.21.15.33:0/2409201284 shutdown_connections 2024-08-28T19:35:44.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:44.649+0000 7f35e8525640 1 -- 172.21.15.33:0/2409201284 wait complete. 2024-08-28T19:35:44.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:44 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:35:45.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:44 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:35:45.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:44 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:35:45.366 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:35:45.367 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:35:45.620 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:45.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:45 smithi033 ceph-mon[18549]: pgmap v441: 129 pgs: 129 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-08-28T19:35:46.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:45 smithi059 ceph-mon[22052]: pgmap v441: 129 pgs: 129 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-08-28T19:35:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:45 smithi122 ceph-mon[22174]: pgmap v441: 129 pgs: 129 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-08-28T19:35:46.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.080+0000 7f76705f6640 1 -- 172.21.15.33:0/4231610789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76681069c0 msgr2=0x7f7668110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:46.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.080+0000 7f76705f6640 1 --2- 172.21.15.33:0/4231610789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76681069c0 0x7f7668110450 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7660009ca0 tx=0x7f766002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:35:46.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.080+0000 7f76705f6640 1 -- 172.21.15.33:0/4231610789 shutdown_connections 2024-08-28T19:35:46.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.080+0000 7f76705f6640 1 --2- 172.21.15.33:0/4231610789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76681069c0 0x7f7668110450 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:46.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.080+0000 7f76705f6640 1 --2- 172.21.15.33:0/4231610789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7668106070 0x7f7668106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:46.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.080+0000 7f76705f6640 1 --2- 172.21.15.33:0/4231610789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7668101e80 0x7f7668102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:46.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.080+0000 7f76705f6640 1 -- 172.21.15.33:0/4231610789 >> 172.21.15.33:0/4231610789 conn(0x7f7668079d30 msgr2=0x7f766807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:46.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.080+0000 7f76705f6640 1 -- 172.21.15.33:0/4231610789 shutdown_connections 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.080+0000 7f76705f6640 1 -- 172.21.15.33:0/4231610789 wait complete. 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f76705f6640 1 Processor -- start 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f76705f6640 1 -- start start 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f76705f6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7668101e80 0x7f766819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f76705f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7668106070 0x7f766819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f76705f6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76681069c0 0x7f766819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f76705f6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f76681138b0 con 0x7f76681069c0 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f76705f6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7668113730 con 0x7f7668101e80 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f76705f6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7668113a30 con 0x7f7668106070 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f766eb93640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76681069c0 0x7f766819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f766eb93640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76681069c0 0x7f766819fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59194/0 (socket says 172.21.15.33:59194) 2024-08-28T19:35:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.081+0000 7f766eb93640 1 -- 172.21.15.33:0/3348055650 learned_addr learned my addr 172.21.15.33:0/3348055650 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f766db91640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7668106070 0x7f766819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f766e392640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7668101e80 0x7f766819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f766eb93640 1 -- 172.21.15.33:0/3348055650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7668106070 msgr2=0x7f766819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f766eb93640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7668106070 0x7f766819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f766eb93640 1 -- 172.21.15.33:0/3348055650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7668101e80 msgr2=0x7f766819a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f766eb93640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7668101e80 0x7f766819a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f766eb93640 1 -- 172.21.15.33:0/3348055650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76681a01b0 con 0x7f76681069c0 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f766eb93640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76681069c0 0x7f766819fa80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7660005cc0 tx=0x7f7660031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f765f7fe640 1 -- 172.21.15.33:0/3348055650 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660003b70 con 0x7f76681069c0 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f765f7fe640 1 -- 172.21.15.33:0/3348055650 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7660003d10 con 0x7f76681069c0 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f76705f6640 1 -- 172.21.15.33:0/3348055650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76681a0440 con 0x7f76681069c0 2024-08-28T19:35:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f765f7fe640 1 -- 172.21.15.33:0/3348055650 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766002fb20 con 0x7f76681069c0 2024-08-28T19:35:46.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.082+0000 7f76705f6640 1 -- 172.21.15.33:0/3348055650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76681a6c00 con 0x7f76681069c0 2024-08-28T19:35:46.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.083+0000 7f76705f6640 1 -- 172.21.15.33:0/3348055650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7668102290 con 0x7f76681069c0 2024-08-28T19:35:46.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.085+0000 7f765f7fe640 1 -- 172.21.15.33:0/3348055650 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7660004580 con 0x7f76681069c0 2024-08-28T19:35:46.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.086+0000 7f765f7fe640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76540b4ca0 0x7f76540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:46.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.086+0000 7f765f7fe640 1 -- 172.21.15.33:0/3348055650 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f7660106e90 con 0x7f76681069c0 2024-08-28T19:35:46.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.086+0000 7f766e392640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76540b4ca0 0x7f76540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:46.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.086+0000 7f766e392640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76540b4ca0 0x7f76540b71b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7664005d00 tx=0x7f7664005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:46.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.089+0000 7f765f7fe640 1 -- 172.21.15.33:0/3348055650 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f76600cd930 con 0x7f76681069c0 2024-08-28T19:35:46.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.314+0000 7f76705f6640 1 -- 172.21.15.33:0/3348055650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f766819b370 con 0x7f76681069c0 2024-08-28T19:35:46.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.315+0000 7f765f7fe640 1 -- 172.21.15.33:0/3348055650 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f766819b370 con 0x7f76681069c0 2024-08-28T19:35:46.317 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:35:46.317 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:35:46.317 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:35:46.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.318+0000 7f76705f6640 1 -- 172.21.15.33:0/3348055650 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76540b4ca0 msgr2=0x7f76540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:46.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.318+0000 7f76705f6640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76540b4ca0 0x7f76540b71b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7664005d00 tx=0x7f7664005c50 comp rx=0 tx=0).stop 2024-08-28T19:35:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.318+0000 7f76705f6640 1 -- 172.21.15.33:0/3348055650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76681069c0 msgr2=0x7f766819fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.318+0000 7f76705f6640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76681069c0 0x7f766819fa80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7660005cc0 tx=0x7f7660031840 comp rx=0 tx=0).stop 2024-08-28T19:35:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.318+0000 7f76705f6640 1 -- 172.21.15.33:0/3348055650 shutdown_connections 2024-08-28T19:35:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.318+0000 7f76705f6640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76681069c0 0x7f766819fa80 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.318+0000 7f76705f6640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76540b4ca0 0x7f76540b71b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.318+0000 7f76705f6640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7668106070 0x7f766819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.319+0000 7f76705f6640 1 --2- 172.21.15.33:0/3348055650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7668101e80 0x7f766819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.319+0000 7f76705f6640 1 -- 172.21.15.33:0/3348055650 >> 172.21.15.33:0/3348055650 conn(0x7f7668079d30 msgr2=0x7f7668107260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.319+0000 7f76705f6640 1 -- 172.21.15.33:0/3348055650 shutdown_connections 2024-08-28T19:35:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:46.319+0000 7f76705f6640 1 -- 172.21.15.33:0/3348055650 wait complete. 2024-08-28T19:35:46.877 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:46 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3348055650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:35:47.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:46 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3348055650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:35:47.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:46 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3348055650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:35:47.118 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:35:47.373 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:47.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:47 smithi033 ceph-mon[18549]: pgmap v442: 129 pgs: 129 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-08-28T19:35:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.875+0000 7f432a99b640 1 -- 172.21.15.33:0/1204997185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43241081c0 msgr2=0x7f43241085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.875+0000 7f432a99b640 1 --2- 172.21.15.33:0/1204997185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43241081c0 0x7f43241085d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4318009900 tx=0x7f431802a410 comp rx=0 tx=0).stop 2024-08-28T19:35:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.875+0000 7f432a99b640 1 -- 172.21.15.33:0/1204997185 shutdown_connections 2024-08-28T19:35:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.875+0000 7f432a99b640 1 --2- 172.21.15.33:0/1204997185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4324108b10 0x7f432410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.875+0000 7f432a99b640 1 --2- 172.21.15.33:0/1204997185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43241081c0 0x7f43241085d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.875+0000 7f432a99b640 1 --2- 172.21.15.33:0/1204997185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4324102880 0x7f4324102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.875+0000 7f432a99b640 1 -- 172.21.15.33:0/1204997185 >> 172.21.15.33:0/1204997185 conn(0x7f4324079510 msgr2=0x7f4324079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.875+0000 7f432a99b640 1 -- 172.21.15.33:0/1204997185 shutdown_connections 2024-08-28T19:35:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.875+0000 7f432a99b640 1 -- 172.21.15.33:0/1204997185 wait complete. 2024-08-28T19:35:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.876+0000 7f432a99b640 1 Processor -- start 2024-08-28T19:35:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.876+0000 7f432a99b640 1 -- start start 2024-08-28T19:35:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.876+0000 7f432a99b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4324102880 0x7f432419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.876+0000 7f432a99b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43241081c0 0x7f432419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.876+0000 7f432a99b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4324108b10 0x7f432419fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.876+0000 7f432a99b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4324113920 con 0x7f4324102880 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.876+0000 7f432a99b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43241137a0 con 0x7f4324108b10 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.876+0000 7f432a99b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4324113aa0 con 0x7f43241081c0 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f4323fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4324102880 0x7f432419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f4323fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4324102880 0x7f432419a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59222/0 (socket says 172.21.15.33:59222) 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f4323fff640 1 -- 172.21.15.33:0/3661078261 learned_addr learned my addr 172.21.15.33:0/3661078261 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f4328f38640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4324108b10 0x7f432419fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f43237fe640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43241081c0 0x7f432419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f4323fff640 1 -- 172.21.15.33:0/3661078261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43241081c0 msgr2=0x7f432419a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f4323fff640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43241081c0 0x7f432419a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f4323fff640 1 -- 172.21.15.33:0/3661078261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4324108b10 msgr2=0x7f432419fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f4323fff640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4324108b10 0x7f432419fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f4323fff640 1 -- 172.21.15.33:0/3661078261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43241a0180 con 0x7f4324102880 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f43237fe640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43241081c0 0x7f432419a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f4323fff640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4324102880 0x7f432419a2d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f431400c920 tx=0x7f431400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f43217fa640 1 -- 172.21.15.33:0/3661078261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314007c70 con 0x7f4324102880 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f432a99b640 1 -- 172.21.15.33:0/3661078261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43241a0470 con 0x7f4324102880 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f43217fa640 1 -- 172.21.15.33:0/3661078261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4314007e10 con 0x7f4324102880 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.877+0000 7f43217fa640 1 -- 172.21.15.33:0/3661078261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314018820 con 0x7f4324102880 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.878+0000 7f432a99b640 1 -- 172.21.15.33:0/3661078261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43241a6c90 con 0x7f4324102880 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.880+0000 7f4330f10740 1 Processor -- start 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.880+0000 7f4330f10740 1 -- start start 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.880+0000 7f43217fa640 1 -- 172.21.15.33:0/3661078261 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f43140189c0 con 0x7f4324102880 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.880+0000 7f4330f10740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e4004070 0x5624e43a9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.880+0000 7f4330f10740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.880+0000 7f4330f10740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fe3390 0x5624e43a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.880+0000 7f4330f10740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5624e4320680 con 0x5624e3fdb1b0 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.880+0000 7f4330f10740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5624e430fc10 con 0x5624e3fe3390 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.880+0000 7f4330f10740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5624e4313bc0 con 0x5624e4004070 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.880+0000 7f4323fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f4323fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59238/0 (socket says 172.21.15.33:59238) 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f4323fff640 1 -- 172.21.15.33:0/1063554422 learned_addr learned my addr 172.21.15.33:0/1063554422 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f4328f38640 1 --2- 172.21.15.33:0/1063554422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e4004070 0x5624e43a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f43237fe640 1 --2- 172.21.15.33:0/1063554422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fe3390 0x5624e43a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f4323fff640 1 -- 172.21.15.33:0/1063554422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e4004070 msgr2=0x5624e43a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f4323fff640 1 --2- 172.21.15.33:0/1063554422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e4004070 0x5624e43a9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f4323fff640 1 -- 172.21.15.33:0/1063554422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fe3390 msgr2=0x5624e43a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f4323fff640 1 --2- 172.21.15.33:0/1063554422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fe3390 0x5624e43a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f4323fff640 1 -- 172.21.15.33:0/1063554422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624e406f650 con 0x5624e3fdb1b0 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f4323fff640 1 --2- 172.21.15.33:0/1063554422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43a9850 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f43140e2d60 tx=0x7f43140e9ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57248ee665b2a21d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f43217fa640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f430c0b4cd0 0x7f430c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f430a7fc640 1 -- 172.21.15.33:0/1063554422 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43140f9070 con 0x5624e3fdb1b0 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f4328f38640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f430c0b4cd0 0x7f430c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f430a7fc640 1 -- 172.21.15.33:0/1063554422 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43140ab8a0 con 0x5624e3fdb1b0 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f430a7fc640 1 -- 172.21.15.33:0/1063554422 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43140ab6e0 con 0x5624e3fdb1b0 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.881+0000 7f43217fa640 1 -- 172.21.15.33:0/3661078261 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f43140e59f0 con 0x7f4324102880 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.882+0000 7f4330f10740 1 -- 172.21.15.33:0/1063554422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 msgr2=0x5624e43a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.882+0000 7f4328f38640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f430c0b4cd0 0x7f430c0b71e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f431c005fd0 tx=0x7f431c009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.882+0000 7f4330f10740 1 --2- 172.21.15.33:0/1063554422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43a9850 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f43140e2d60 tx=0x7f43140e9ab0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.882+0000 7f4330f10740 1 -- 172.21.15.33:0/1063554422 shutdown_connections 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.882+0000 7f4330f10740 1 --2- 172.21.15.33:0/1063554422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fe3390 0x5624e43a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.882+0000 7f4330f10740 1 --2- 172.21.15.33:0/1063554422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43a9850 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.882+0000 7f4330f10740 1 --2- 172.21.15.33:0/1063554422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e4004070 0x5624e43a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.882+0000 7f4330f10740 1 -- 172.21.15.33:0/1063554422 >> 172.21.15.33:0/1063554422 conn(0x5624e3ff8460 msgr2=0x5624e43a7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.882+0000 7f4330f10740 1 -- 172.21.15.33:0/1063554422 shutdown_connections 2024-08-28T19:35:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.882+0000 7f4330f10740 1 -- 172.21.15.33:0/1063554422 wait complete. 2024-08-28T19:35:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.883+0000 7f4330f10740 1 -- start start 2024-08-28T19:35:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.883+0000 7f4330f10740 1 Processor -- start 2024-08-28T19:35:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.883+0000 7f4330f10740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fdb1b0 0x5624e43b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.883+0000 7f4330f10740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fe3390 0x5624e43b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.883+0000 7f4330f10740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e4004070 0x5624e43c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.883+0000 7f4330f10740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5624e4172700 con 0x5624e3fe3390 2024-08-28T19:35:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.883+0000 7f4330f10740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5624e4296750 con 0x5624e3fdb1b0 2024-08-28T19:35:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.883+0000 7f4330f10740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5624e43b7af0 con 0x5624e4004070 2024-08-28T19:35:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.883+0000 7f4330f10740 10 client.0 _ll_register_callbacks cb 0x5624e42c5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.883+0000 7f43237fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fe3390 0x5624e43b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43237fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fe3390 0x5624e43b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59240/0 (socket says 172.21.15.33:59240) 2024-08-28T19:35:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43237fe640 1 -- 172.21.15.33:0/421017806 learned_addr learned my addr 172.21.15.33:0/421017806 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f4323fff640 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fdb1b0 0x5624e43b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f4328f38640 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e4004070 0x5624e43c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43237fe640 1 -- 172.21.15.33:0/421017806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e4004070 msgr2=0x5624e43c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43237fe640 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e4004070 0x5624e43c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43237fe640 1 -- 172.21.15.33:0/421017806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fdb1b0 msgr2=0x5624e43b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43237fe640 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fdb1b0 0x5624e43b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43237fe640 1 -- 172.21.15.33:0/421017806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624e42cf900 con 0x5624e3fe3390 2024-08-28T19:35:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43237fe640 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fe3390 0x5624e43b4f80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4318006010 tx=0x7f43180052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db47e8c92f032e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43037fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43037fe640 1 -- 172.21.15.33:0/421017806 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318035030 con 0x5624e3fe3390 2024-08-28T19:35:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f43037fe640 1 -- 172.21.15.33:0/421017806 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f43180048c0 con 0x5624e3fe3390 2024-08-28T19:35:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.884+0000 7f4330f10740 1 -- 172.21.15.33:0/421017806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43140ab8a0 con 0x5624e3fe3390 2024-08-28T19:35:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f43037fe640 1 -- 172.21.15.33:0/421017806 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4318004ac0 con 0x5624e3fe3390 2024-08-28T19:35:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f4330f10740 10 client.16497 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f4330f10740 1 -- 172.21.15.33:0/421017806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5624e43c3890 con 0x5624e3fe3390 2024-08-28T19:35:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f43037fe640 1 -- 172.21.15.33:0/421017806 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43140ab8a0 con 0x5624e3fe3390 2024-08-28T19:35:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f43037fe640 1 -- 172.21.15.33:0/421017806 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f43180314a0 con 0x5624e3fe3390 2024-08-28T19:35:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f4330f10740 10 client.16497 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f4330f10740 10 client.16497 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:35:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f4330f10740 20 client.16497 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f4330f10740 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5624e3fc29f0 0x5624e43c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f4330f10740 4 client.16497 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f4330f10740 1 -- 172.21.15.33:0/421017806 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624e43225d0 con 0x5624e3fc29f0 2024-08-28T19:35:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.885+0000 7f4323fff640 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5624e3fc29f0 0x5624e43c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.886+0000 7f4323fff640 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5624e3fc29f0 0x5624e43c6da0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d0c94c895c5de2e6 server_cookie=49b46d99a23e8d12 in_seq=0 out_seq=0 2024-08-28T19:35:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.886+0000 7f43037fe640 10 client.16497 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:35:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f43037fe640 1 -- 172.21.15.33:0/421017806 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624e43225d0 con 0x5624e3fc29f0 2024-08-28T19:35:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f43037fe640 10 client.16497 handle_command_reply: tid=0 2024-08-28T19:35:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 client.16497 shutdown 2024-08-28T19:35:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 -- 172.21.15.33:0/421017806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fe3390 msgr2=0x5624e43b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fe3390 0x5624e43b4f80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4318006010 tx=0x7f43180052f0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 -- 172.21.15.33:0/421017806 shutdown_connections 2024-08-28T19:35:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5624e3fc29f0 0x5624e43c6da0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f43037fe640 0 client.16497 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:35:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e4004070 0x5624e43c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fe3390 0x5624e43b4f80 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 --2- 172.21.15.33:0/421017806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fdb1b0 0x5624e43b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 -- 172.21.15.33:0/421017806 >> 172.21.15.33:0/421017806 conn(0x5624e3ff8460 msgr2=0x5624e43ac4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 -- 172.21.15.33:0/421017806 shutdown_connections 2024-08-28T19:35:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 1 -- 172.21.15.33:0/421017806 wait complete. 2024-08-28T19:35:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.887+0000 7f4330f10740 20 client.16497 trim_cache size 0 max 16384 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f4330f10740 1 Processor -- start 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f4330f10740 1 -- start start 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f4330f10740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fc29f0 0x5624e43acb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f4330f10740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f4330f10740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 0x5624e43a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f4330f10740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f43241b09f0 con 0x5624e3fdb1b0 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f4330f10740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43241b2530 con 0x5624e3fc29f0 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f4330f10740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f43241b10c0 con 0x5624e3fe3390 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f43237fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f43237fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43c0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59252/0 (socket says 172.21.15.33:59252) 2024-08-28T19:35:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f43237fe640 1 -- 172.21.15.33:0/899460772 learned_addr learned my addr 172.21.15.33:0/899460772 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f4323fff640 1 --2- 172.21.15.33:0/899460772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fc29f0 0x5624e43acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.901+0000 7f4328f38640 1 --2- 172.21.15.33:0/899460772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 0x5624e43a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.902+0000 7f43237fe640 1 -- 172.21.15.33:0/899460772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 msgr2=0x5624e43a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.902+0000 7f43237fe640 1 --2- 172.21.15.33:0/899460772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 0x5624e43a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.902+0000 7f43237fe640 1 -- 172.21.15.33:0/899460772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fc29f0 msgr2=0x5624e43acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.902+0000 7f43237fe640 1 --2- 172.21.15.33:0/899460772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fc29f0 0x5624e43acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.902+0000 7f43237fe640 1 -- 172.21.15.33:0/899460772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624e43aa150 con 0x5624e3fdb1b0 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.902+0000 7f4323fff640 1 --2- 172.21.15.33:0/899460772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fc29f0 0x5624e43acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.902+0000 7f43237fe640 1 --2- 172.21.15.33:0/899460772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43c0d10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4318031440 tx=0x7f4318009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bed2b63afc377ad server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.902+0000 7f4309ffb640 1 -- 172.21.15.33:0/899460772 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318035070 con 0x5624e3fdb1b0 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.902+0000 7f4309ffb640 1 -- 172.21.15.33:0/899460772 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f431803f070 con 0x5624e3fdb1b0 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.902+0000 7f4309ffb640 1 -- 172.21.15.33:0/899460772 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43180046c0 con 0x5624e3fdb1b0 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.903+0000 7f4330f10740 1 -- 172.21.15.33:0/899460772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 msgr2=0x5624e43c0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:47.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.903+0000 7f4330f10740 1 --2- 172.21.15.33:0/899460772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43c0d10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4318031440 tx=0x7f4318009230 comp rx=0 tx=0).stop 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.903+0000 7f4330f10740 1 -- 172.21.15.33:0/899460772 shutdown_connections 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.903+0000 7f4330f10740 1 --2- 172.21.15.33:0/899460772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 0x5624e43a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.903+0000 7f4330f10740 1 --2- 172.21.15.33:0/899460772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fdb1b0 0x5624e43c0d10 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.903+0000 7f4330f10740 1 --2- 172.21.15.33:0/899460772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fc29f0 0x5624e43acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.903+0000 7f4330f10740 1 -- 172.21.15.33:0/899460772 >> 172.21.15.33:0/899460772 conn(0x5624e3ff8460 msgr2=0x5624e43ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.903+0000 7f4330f10740 1 -- 172.21.15.33:0/899460772 shutdown_connections 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.903+0000 7f4330f10740 1 -- 172.21.15.33:0/899460772 wait complete. 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.903+0000 7f4330f10740 1 -- start start 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4330f10740 1 Processor -- start 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4330f10740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fc29f0 0x5624e43b95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4330f10740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fdb1b0 0x5624e43b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4330f10740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 0x5624e44307b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4330f10740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f43241b1e60 con 0x5624e3fc29f0 2024-08-28T19:35:47.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4330f10740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43241b1790 con 0x5624e3fdb1b0 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4330f10740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f43241ae9d0 con 0x5624e3fe3390 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4330f10740 10 client.0 _ll_register_callbacks cb 0x7f4318009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4323fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fc29f0 0x5624e43b95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4323fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fc29f0 0x5624e43b95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59254/0 (socket says 172.21.15.33:59254) 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4323fff640 1 -- 172.21.15.33:0/4118106300 learned_addr learned my addr 172.21.15.33:0/4118106300 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f43237fe640 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fdb1b0 0x5624e43b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.904+0000 7f4328f38640 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 0x5624e44307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f4323fff640 1 -- 172.21.15.33:0/4118106300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 msgr2=0x5624e44307b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f4323fff640 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 0x5624e44307b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f4323fff640 1 -- 172.21.15.33:0/4118106300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fdb1b0 msgr2=0x5624e43b9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:47.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f4323fff640 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fdb1b0 0x5624e43b9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f4323fff640 1 -- 172.21.15.33:0/4118106300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624e4430e20 con 0x5624e3fc29f0 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f4328f38640 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 0x5624e44307b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f4323fff640 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fc29f0 0x5624e43b95d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f43140a7e10 tx=0x7f4314000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d49d75b40b6810 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f43037fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f43037fe640 1 -- 172.21.15.33:0/4118106300 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431401e740 con 0x5624e3fc29f0 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f43037fe640 1 -- 172.21.15.33:0/4118106300 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f43140dfe50 con 0x5624e3fc29f0 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f4330f10740 1 -- 172.21.15.33:0/4118106300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f431803f070 con 0x5624e3fc29f0 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f43037fe640 1 -- 172.21.15.33:0/4118106300 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f431401e9a0 con 0x5624e3fc29f0 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f4330f10740 10 client.16503 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f4330f10740 1 -- 172.21.15.33:0/4118106300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5624e44320a0 con 0x5624e3fc29f0 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f43037fe640 1 -- 172.21.15.33:0/4118106300 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f431803f070 con 0x5624e3fc29f0 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.905+0000 7f43037fe640 1 -- 172.21.15.33:0/4118106300 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f43140930b0 con 0x5624e3fc29f0 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.906+0000 7f4330f10740 10 client.16503 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:47.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.906+0000 7f4330f10740 10 client.16503 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.906+0000 7f4330f10740 20 client.16503 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.906+0000 7f4330f10740 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5624e4004070 0x5624e4434280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.906+0000 7f4330f10740 4 client.16503 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.906+0000 7f4330f10740 1 -- 172.21.15.33:0/4118106300 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624e431e070 con 0x5624e4004070 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.906+0000 7f43237fe640 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5624e4004070 0x5624e4434280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.906+0000 7f43237fe640 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5624e4004070 0x5624e4434280 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=73df2f57b3bf768a server_cookie=956ef87bfb3dacab in_seq=0 out_seq=0 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.906+0000 7f43037fe640 10 client.16503 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f43037fe640 1 -- 172.21.15.33:0/4118106300 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624e431e070 con 0x5624e4004070 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f43037fe640 10 client.16503 handle_command_reply: tid=0 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 client.16503 shutdown 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 -- 172.21.15.33:0/4118106300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fc29f0 msgr2=0x5624e43b95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fc29f0 0x5624e43b95d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f43140a7e10 tx=0x7f4314000bc0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 -- 172.21.15.33:0/4118106300 shutdown_connections 2024-08-28T19:35:47.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5624e4004070 0x5624e4434280 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5624e3fe3390 0x5624e44307b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5624e3fdb1b0 0x5624e43b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 --2- 172.21.15.33:0/4118106300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5624e3fc29f0 0x5624e43b95d0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 -- 172.21.15.33:0/4118106300 >> 172.21.15.33:0/4118106300 conn(0x5624e3ff8460 msgr2=0x5624e43a69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:47.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f43037fe640 0 client.16503 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:35:47.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 -- 172.21.15.33:0/4118106300 shutdown_connections 2024-08-28T19:35:47.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 1 -- 172.21.15.33:0/4118106300 wait complete. 2024-08-28T19:35:47.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.907+0000 7f4330f10740 20 client.16503 trim_cache size 0 max 16384 2024-08-28T19:35:47.921 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:35:47.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 -- 172.21.15.33:0/3661078261 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f430c0b4cd0 msgr2=0x7f430c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:47.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f430c0b4cd0 0x7f430c0b71e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f431c005fd0 tx=0x7f431c009600 comp rx=0 tx=0).stop 2024-08-28T19:35:47.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 -- 172.21.15.33:0/3661078261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4324102880 msgr2=0x7f432419a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:47.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4324102880 0x7f432419a2d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f431400c920 tx=0x7f431400cde0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 -- 172.21.15.33:0/3661078261 shutdown_connections 2024-08-28T19:35:47.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4324108b10 0x7f432419fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f430c0b4cd0 0x7f430c0b71e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43241081c0 0x7f432419a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 --2- 172.21.15.33:0/3661078261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4324102880 0x7f432419a2d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:47.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 -- 172.21.15.33:0/3661078261 >> 172.21.15.33:0/3661078261 conn(0x7f4324079510 msgr2=0x7f4324106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:47.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 -- 172.21.15.33:0/3661078261 shutdown_connections 2024-08-28T19:35:47.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:47.908+0000 7f432a99b640 1 -- 172.21.15.33:0/3661078261 wait complete. 2024-08-28T19:35:48.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:47 smithi059 ceph-mon[22052]: pgmap v442: 129 pgs: 129 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-08-28T19:35:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:47 smithi122 ceph-mon[22174]: pgmap v442: 129 pgs: 129 active+clean; 3.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-08-28T19:35:48.729 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:35:48.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:48 smithi033 ceph-mon[18549]: pgmap v443: 129 pgs: 129 active+clean; 3.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-08-28T19:35:48.984 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:49.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:48 smithi059 ceph-mon[22052]: pgmap v443: 129 pgs: 129 active+clean; 3.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-08-28T19:35:49.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:48 smithi122 ceph-mon[22174]: pgmap v443: 129 pgs: 129 active+clean; 3.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-08-28T19:35:49.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 -- 172.21.15.33:0/1921023752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f01046c0 msgr2=0x7fe5f0104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:49.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 --2- 172.21.15.33:0/1921023752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f01046c0 0x7fe5f0104ad0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009900 tx=0x7fe5ec02a410 comp rx=0 tx=0).stop 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 -- 172.21.15.33:0/1921023752 shutdown_connections 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 --2- 172.21.15.33:0/1921023752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5f010dc70 0x7fe5f0110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 --2- 172.21.15.33:0/1921023752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f01050f0 0x7fe5f010d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 --2- 172.21.15.33:0/1921023752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f01046c0 0x7fe5f0104ad0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 -- 172.21.15.33:0/1921023752 >> 172.21.15.33:0/1921023752 conn(0x7fe5f0079510 msgr2=0x7fe5f0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 -- 172.21.15.33:0/1921023752 shutdown_connections 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 -- 172.21.15.33:0/1921023752 wait complete. 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 Processor -- start 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.494+0000 7fe5f848b640 1 -- start start 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f848b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f01046c0 0x7fe5f019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f848b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5f01050f0 0x7fe5f019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f848b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f010dc70 0x7fe5f019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f848b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f0113880 con 0x7fe5f010dc70 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f848b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f0113700 con 0x7fe5f01046c0 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f848b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f0113a00 con 0x7fe5f01050f0 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f6a28640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f010dc70 0x7fe5f019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f6a28640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f010dc70 0x7fe5f019fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39134/0 (socket says 172.21.15.33:39134) 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f6a28640 1 -- 172.21.15.33:0/3833332093 learned_addr learned my addr 172.21.15.33:0/3833332093 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5f01050f0 0x7fe5f019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f6227640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f01046c0 0x7fe5f019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f6a28640 1 -- 172.21.15.33:0/3833332093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5f01050f0 msgr2=0x7fe5f019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f6a28640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5f01050f0 0x7fe5f019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f6a28640 1 -- 172.21.15.33:0/3833332093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f01046c0 msgr2=0x7fe5f019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:49.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f6a28640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f01046c0 0x7fe5f019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f6a28640 1 -- 172.21.15.33:0/3833332093 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f01a0120 con 0x7fe5f010dc70 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.495+0000 7fe5f6a28640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f010dc70 0x7fe5f019fab0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800eb10 tx=0x7fe5e800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.496+0000 7fe5e77fe640 1 -- 172.21.15.33:0/3833332093 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800ce20 con 0x7fe5f010dc70 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.496+0000 7fe5f848b640 1 -- 172.21.15.33:0/3833332093 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f01a0410 con 0x7fe5f010dc70 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.496+0000 7fe5e77fe640 1 -- 172.21.15.33:0/3833332093 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5e8005020 con 0x7fe5f010dc70 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.496+0000 7fe5e77fe640 1 -- 172.21.15.33:0/3833332093 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8010690 con 0x7fe5f010dc70 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.496+0000 7fe5f848b640 1 -- 172.21.15.33:0/3833332093 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f01a6c30 con 0x7fe5f010dc70 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.498+0000 7fe5fea00740 1 Processor -- start 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.498+0000 7fe5e77fe640 1 -- 172.21.15.33:0/3833332093 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe5e8004b20 con 0x7fe5f010dc70 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5fea00740 1 -- start start 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 0x55f989fe4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c161b0 0x55f989fe4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c1e390 0x55f989fe4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5fea00740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f989f5b680 con 0x55f989c161b0 2024-08-28T19:35:49.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5fea00740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f989f4ac10 con 0x55f989c1e390 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5fea00740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f989f4ebc0 con 0x55f989c3f070 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f6227640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c161b0 0x55f989fe4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f6227640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c161b0 0x55f989fe4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39144/0 (socket says 172.21.15.33:39144) 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f6227640 1 -- 172.21.15.33:0/2401584114 learned_addr learned my addr 172.21.15.33:0/2401584114 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5e77fe640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5dc0b4cd0 0x7fe5dc0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/2401584114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 0x55f989fe4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/2401584114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c1e390 0x55f989fe4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f6a28640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5dc0b4cd0 0x7fe5dc0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f6227640 1 -- 172.21.15.33:0/2401584114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 msgr2=0x55f989fe4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f6227640 1 --2- 172.21.15.33:0/2401584114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 0x55f989fe4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f6227640 1 -- 172.21.15.33:0/2401584114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c1e390 msgr2=0x55f989fe4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f6227640 1 --2- 172.21.15.33:0/2401584114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c1e390 0x55f989fe4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.499+0000 7fe5f6227640 1 -- 172.21.15.33:0/2401584114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f989caa650 con 0x55f989c161b0 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.500+0000 7fe5e77fe640 1 -- 172.21.15.33:0/3833332093 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe5e80e5e50 con 0x7fe5f010dc70 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.500+0000 7fe5f6227640 1 --2- 172.21.15.33:0/2401584114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c161b0 0x55f989fe4850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec02a930 tx=0x7fe5ec032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634f32a1bbcef54b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.500+0000 7fe5f6a28640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5dc0b4cd0 0x7fe5dc0b71e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80e3850 tx=0x7fe5e8079690 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.500+0000 7fe5e4d9a640 1 -- 172.21.15.33:0/2401584114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec03f070 con 0x55f989c161b0 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.500+0000 7fe5e4d9a640 1 -- 172.21.15.33:0/2401584114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5ec032e20 con 0x55f989c161b0 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.500+0000 7fe5e4d9a640 1 -- 172.21.15.33:0/2401584114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec035070 con 0x55f989c161b0 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.501+0000 7fe5fea00740 1 -- 172.21.15.33:0/2401584114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c161b0 msgr2=0x55f989fe4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.501+0000 7fe5fea00740 1 --2- 172.21.15.33:0/2401584114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c161b0 0x55f989fe4850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec02a930 tx=0x7fe5ec032c30 comp rx=0 tx=0).stop 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.501+0000 7fe5fea00740 1 -- 172.21.15.33:0/2401584114 shutdown_connections 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.501+0000 7fe5fea00740 1 --2- 172.21.15.33:0/2401584114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c1e390 0x55f989fe4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.501+0000 7fe5fea00740 1 --2- 172.21.15.33:0/2401584114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c161b0 0x55f989fe4850 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.501+0000 7fe5fea00740 1 --2- 172.21.15.33:0/2401584114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 0x55f989fe4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.501+0000 7fe5fea00740 1 -- 172.21.15.33:0/2401584114 >> 172.21.15.33:0/2401584114 conn(0x55f989c33460 msgr2=0x55f989fe2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.501+0000 7fe5fea00740 1 -- 172.21.15.33:0/2401584114 shutdown_connections 2024-08-28T19:35:49.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.501+0000 7fe5fea00740 1 -- 172.21.15.33:0/2401584114 wait complete. 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.501+0000 7fe5fea00740 1 -- start start 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.502+0000 7fe5fea00740 1 Processor -- start 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.502+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989fefa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.502+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f989feffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.502+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 0x55f989ffbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.502+0000 7fe5fea00740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f989dad700 con 0x55f989c1e390 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.502+0000 7fe5fea00740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f989ed1750 con 0x55f989c161b0 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.502+0000 7fe5fea00740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f989ff2a90 con 0x55f989c3f070 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.502+0000 7fe5fea00740 10 client.0 _ll_register_callbacks cb 0x55f989f00e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.502+0000 7fe5f5a26640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989fefa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.502+0000 7fe5f5a26640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989fefa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:48564/0 (socket says 172.21.15.33:48564) 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5f5a26640 1 -- 172.21.15.33:0/4135591515 learned_addr learned my addr 172.21.15.33:0/4135591515 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:49.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 0x55f989ffbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5f6227640 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f989feffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5f5a26640 1 -- 172.21.15.33:0/4135591515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 msgr2=0x55f989fefa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989fefa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5f5a26640 1 -- 172.21.15.33:0/4135591515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 msgr2=0x55f989feffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f989feffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5f5a26640 1 -- 172.21.15.33:0/4135591515 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f989f0a900 con 0x55f989c3f070 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 0x55f989ffbd80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0005bd0 tx=0x7fe5e00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b09d94c8b0b25dcf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.503+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/4135591515 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0017030 con 0x55f989c3f070 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/4135591515 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe5e001e350 con 0x55f989c3f070 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5fea00740 1 -- 172.21.15.33:0/4135591515 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5ec032e20 con 0x55f989c3f070 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/4135591515 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5e001a040 con 0x55f989c3f070 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5fea00740 10 client.25891 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:49.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5fea00740 1 -- 172.21.15.33:0/4135591515 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f989ffe8f0 con 0x55f989c3f070 2024-08-28T19:35:49.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/4135591515 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5ec032e20 con 0x55f989c3f070 2024-08-28T19:35:49.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/4135591515 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe5e001e670 con 0x55f989c3f070 2024-08-28T19:35:49.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5fea00740 10 client.25891 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5fea00740 10 client.25891 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5fea00740 20 client.25891 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5fea00740 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55f989bfd9f0 0x55f98a001de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5fea00740 4 client.25891 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.504+0000 7fe5fea00740 1 -- 172.21.15.33:0/4135591515 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f989f5d5d0 con 0x55f989bfd9f0 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.505+0000 7fe5f6227640 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55f989bfd9f0 0x55f98a001de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.505+0000 7fe5d9ffb640 10 client.25891 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.505+0000 7fe5f6227640 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55f989bfd9f0 0x55f98a001de0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3c95dca6b33bfeb8 server_cookie=5f5820952827541d in_seq=0 out_seq=0 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/4135591515 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f989f5d5d0 con 0x55f989bfd9f0 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5d9ffb640 10 client.25891 handle_command_reply: tid=0 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 client.25891 shutdown 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 -- 172.21.15.33:0/4135591515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 msgr2=0x55f989ffbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:49.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 0x55f989ffbd80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0005bd0 tx=0x7fe5e00046c0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 -- 172.21.15.33:0/4135591515 shutdown_connections 2024-08-28T19:35:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55f989bfd9f0 0x55f98a001de0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989c3f070 0x55f989ffbd80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f989feffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5d9ffb640 0 client.25891 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:35:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 --2- 172.21.15.33:0/4135591515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989fefa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 -- 172.21.15.33:0/4135591515 >> 172.21.15.33:0/4135591515 conn(0x55f989c33460 msgr2=0x55f989fe74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 -- 172.21.15.33:0/4135591515 shutdown_connections 2024-08-28T19:35:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 1 -- 172.21.15.33:0/4135591515 wait complete. 2024-08-28T19:35:49.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.506+0000 7fe5fea00740 20 client.25891 trim_cache size 0 max 16384 2024-08-28T19:35:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.519+0000 7fe5fea00740 1 Processor -- start 2024-08-28T19:35:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5fea00740 1 -- start start 2024-08-28T19:35:49.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989bfd9f0 0x55f989fe7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989fe7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f989fecc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5fea00740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b09f0 con 0x55f989c1e390 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5fea00740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b2530 con 0x55f989c161b0 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5fea00740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b10c0 con 0x55f989bfd9f0 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5f5a26640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f989fecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5f5a26640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f989fecc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39162/0 (socket says 172.21.15.33:39162) 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5f5a26640 1 -- 172.21.15.33:0/196187075 learned_addr learned my addr 172.21.15.33:0/196187075 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/196187075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989bfd9f0 0x55f989fe7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5f6227640 1 --2- 172.21.15.33:0/196187075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989fe7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5f5a26640 1 -- 172.21.15.33:0/196187075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989bfd9f0 msgr2=0x55f989fe7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/196187075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989bfd9f0 0x55f989fe7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5f5a26640 1 -- 172.21.15.33:0/196187075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 msgr2=0x55f989fe7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:49.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/196187075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989fe7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.520+0000 7fe5f5a26640 1 -- 172.21.15.33:0/196187075 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f989fe6600 con 0x55f989c1e390 2024-08-28T19:35:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.521+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/196187075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f989fecc60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00057c0 tx=0x7fe5e0011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa6f80ec535dbed server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.521+0000 7fe5dbfff640 1 -- 172.21.15.33:0/196187075 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0017070 con 0x55f989c1e390 2024-08-28T19:35:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.521+0000 7fe5dbfff640 1 -- 172.21.15.33:0/196187075 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5e001e800 con 0x55f989c1e390 2024-08-28T19:35:49.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.521+0000 7fe5dbfff640 1 -- 172.21.15.33:0/196187075 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e00207e0 con 0x55f989c1e390 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.521+0000 7fe5fea00740 1 -- 172.21.15.33:0/196187075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 msgr2=0x55f989fecc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.521+0000 7fe5fea00740 1 --2- 172.21.15.33:0/196187075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f989fecc60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00057c0 tx=0x7fe5e0011040 comp rx=0 tx=0).stop 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 -- 172.21.15.33:0/196187075 shutdown_connections 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 --2- 172.21.15.33:0/196187075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f989fecc60 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 --2- 172.21.15.33:0/196187075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989fe7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 --2- 172.21.15.33:0/196187075 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989bfd9f0 0x55f989fe7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 -- 172.21.15.33:0/196187075 >> 172.21.15.33:0/196187075 conn(0x55f989c33460 msgr2=0x55f989fee2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 -- 172.21.15.33:0/196187075 shutdown_connections 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 -- 172.21.15.33:0/196187075 wait complete. 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 -- start start 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 Processor -- start 2024-08-28T19:35:49.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989bfd9f0 0x55f989ff44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989ff4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f98a06b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b1e60 con 0x55f989c1e390 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01b1790 con 0x55f989c161b0 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f01ae9d0 con 0x55f989bfd9f0 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5fea00740 10 client.0 _ll_register_callbacks cb 0x7fe5e000af10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.522+0000 7fe5f5a26640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f98a06b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f5a26640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f98a06b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39170/0 (socket says 172.21.15.33:39170) 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f5a26640 1 -- 172.21.15.33:0/3183095224 learned_addr learned my addr 172.21.15.33:0/3183095224 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f6227640 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989ff4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989bfd9f0 0x55f989ff44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f5a26640 1 -- 172.21.15.33:0/3183095224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989bfd9f0 msgr2=0x55f989ff44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989bfd9f0 0x55f989ff44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f5a26640 1 -- 172.21.15.33:0/3183095224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 msgr2=0x55f989ff4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989ff4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f5a26640 1 -- 172.21.15.33:0/3183095224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f98a06bd90 con 0x55f989c1e390 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f6227640 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989ff4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5f5a26640 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f98a06b7a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x55f989ff0d70 tx=0x7fe5e00056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7e39395dc5b97f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/3183095224 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0017070 con 0x55f989c1e390 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/3183095224 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe5e0020650 con 0x55f989c1e390 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5fea00740 1 -- 172.21.15.33:0/3183095224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5e001e800 con 0x55f989c1e390 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/3183095224 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5e0034040 con 0x55f989c1e390 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5fea00740 10 client.16521 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.523+0000 7fe5fea00740 1 -- 172.21.15.33:0/3183095224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f98a06d010 con 0x55f989c1e390 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.524+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/3183095224 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5e001e800 con 0x55f989c1e390 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.524+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/3183095224 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe5e003d070 con 0x55f989c1e390 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.524+0000 7fe5fea00740 10 client.16521 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:49.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.524+0000 7fe5fea00740 10 client.16521 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.524+0000 7fe5fea00740 20 client.16521 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.524+0000 7fe5fea00740 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55f989c3f070 0x55f98a06f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.524+0000 7fe5fea00740 4 client.16521 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.524+0000 7fe5fea00740 1 -- 172.21.15.33:0/3183095224 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f989f59070 con 0x55f989c3f070 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.524+0000 7fe5f6227640 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55f989c3f070 0x55f98a06f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5f6227640 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55f989c3f070 0x55f98a06f680 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=56d8a44276aee267 server_cookie=57d8332a86aeea7d in_seq=0 out_seq=0 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5d9ffb640 10 client.16521 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5d9ffb640 1 -- 172.21.15.33:0/3183095224 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f989f59070 con 0x55f989c3f070 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5d9ffb640 10 client.16521 handle_command_reply: tid=0 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 client.16521 shutdown 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 -- 172.21.15.33:0/3183095224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 msgr2=0x55f98a06b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f98a06b7a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x55f989ff0d70 tx=0x7fe5e00056d0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 -- 172.21.15.33:0/3183095224 shutdown_connections 2024-08-28T19:35:49.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55f989c3f070 0x55f98a06f680 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f989c1e390 0x55f98a06b7a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f989c161b0 0x55f989ff4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 --2- 172.21.15.33:0/3183095224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f989bfd9f0 0x55f989ff44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 -- 172.21.15.33:0/3183095224 >> 172.21.15.33:0/3183095224 conn(0x55f989c33460 msgr2=0x55f989fedef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5d9ffb640 0 client.16521 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:35:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 -- 172.21.15.33:0/3183095224 shutdown_connections 2024-08-28T19:35:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 1 -- 172.21.15.33:0/3183095224 wait complete. 2024-08-28T19:35:49.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.525+0000 7fe5fea00740 20 client.16521 trim_cache size 0 max 16384 2024-08-28T19:35:49.532 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:35:49.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 -- 172.21.15.33:0/3833332093 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5dc0b4cd0 msgr2=0x7fe5dc0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:49.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5dc0b4cd0 0x7fe5dc0b71e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80e3850 tx=0x7fe5e8079690 comp rx=0 tx=0).stop 2024-08-28T19:35:49.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 -- 172.21.15.33:0/3833332093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f010dc70 msgr2=0x7fe5f019fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:49.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f010dc70 0x7fe5f019fab0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800eb10 tx=0x7fe5e800ef10 comp rx=0 tx=0).stop 2024-08-28T19:35:49.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 -- 172.21.15.33:0/3833332093 shutdown_connections 2024-08-28T19:35:49.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f010dc70 0x7fe5f019fab0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5dc0b4cd0 0x7fe5dc0b71e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5f01050f0 0x7fe5f019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 --2- 172.21.15.33:0/3833332093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f01046c0 0x7fe5f019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:49.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 -- 172.21.15.33:0/3833332093 >> 172.21.15.33:0/3833332093 conn(0x7fe5f0079510 msgr2=0x7fe5f0100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:49.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 -- 172.21.15.33:0/3833332093 shutdown_connections 2024-08-28T19:35:49.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:49.526+0000 7fe5f848b640 1 -- 172.21.15.33:0/3833332093 wait complete. 2024-08-28T19:35:50.255 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:35:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:51.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.029+0000 7fcc3986f640 1 -- 172.21.15.33:0/2335860912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc34109260 msgr2=0x7fcc34109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.029+0000 7fcc3986f640 1 --2- 172.21.15.33:0/2335860912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc34109260 0x7fcc34109670 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009900 tx=0x7fcc2802a410 comp rx=0 tx=0).stop 2024-08-28T19:35:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.029+0000 7fcc3986f640 1 -- 172.21.15.33:0/2335860912 shutdown_connections 2024-08-28T19:35:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.029+0000 7fcc3986f640 1 --2- 172.21.15.33:0/2335860912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc34109bb0 0x7fcc341103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.029+0000 7fcc3986f640 1 --2- 172.21.15.33:0/2335860912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc34109260 0x7fcc34109670 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.029+0000 7fcc3986f640 1 --2- 172.21.15.33:0/2335860912 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc34103920 0x7fcc34103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.029+0000 7fcc3986f640 1 -- 172.21.15.33:0/2335860912 >> 172.21.15.33:0/2335860912 conn(0x7fcc340ff3b0 msgr2=0x7fcc34101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.029+0000 7fcc3986f640 1 -- 172.21.15.33:0/2335860912 shutdown_connections 2024-08-28T19:35:51.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.029+0000 7fcc3986f640 1 -- 172.21.15.33:0/2335860912 wait complete. 2024-08-28T19:35:51.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.030+0000 7fcc3986f640 1 Processor -- start 2024-08-28T19:35:51.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.030+0000 7fcc3986f640 1 -- start start 2024-08-28T19:35:51.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc3986f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc34103920 0x7fcc3419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc3986f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc34109260 0x7fcc3419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc3986f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc34109bb0 0x7fcc3419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc3986f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcc34113870 con 0x7fcc34103920 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc3986f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341136f0 con 0x7fcc34109bb0 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc3986f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341139f0 con 0x7fcc34109260 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc34103920 0x7fcc3419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc34103920 0x7fcc3419a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39188/0 (socket says 172.21.15.33:39188) 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc32ffd640 1 -- 172.21.15.33:0/1557584714 learned_addr learned my addr 172.21.15.33:0/1557584714 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc337fe640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc34109bb0 0x7fcc3419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc327fc640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc34109260 0x7fcc3419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc32ffd640 1 -- 172.21.15.33:0/1557584714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc34109260 msgr2=0x7fcc3419a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc34109260 0x7fcc3419a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc32ffd640 1 -- 172.21.15.33:0/1557584714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc34109bb0 msgr2=0x7fcc3419faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc34109bb0 0x7fcc3419faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc32ffd640 1 -- 172.21.15.33:0/1557584714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc341a01d0 con 0x7fcc34103920 2024-08-28T19:35:51.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc34103920 0x7fcc3419a260 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400c970 tx=0x7fcc2400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:51.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.031+0000 7fcc3886d640 1 -- 172.21.15.33:0/1557584714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24007bb0 con 0x7fcc34103920 2024-08-28T19:35:51.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.032+0000 7fcc3886d640 1 -- 172.21.15.33:0/1557584714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc24007d50 con 0x7fcc34103920 2024-08-28T19:35:51.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.032+0000 7fcc3886d640 1 -- 172.21.15.33:0/1557584714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400f450 con 0x7fcc34103920 2024-08-28T19:35:51.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.032+0000 7fcc3986f640 1 -- 172.21.15.33:0/1557584714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc341a04c0 con 0x7fcc34103920 2024-08-28T19:35:51.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.032+0000 7fcc3986f640 1 -- 172.21.15.33:0/1557584714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc341a6c20 con 0x7fcc34103920 2024-08-28T19:35:51.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.034+0000 7fcc3886d640 1 -- 172.21.15.33:0/1557584714 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcc24004f20 con 0x7fcc34103920 2024-08-28T19:35:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.034+0000 7fcc3fde4740 1 Processor -- start 2024-08-28T19:35:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.034+0000 7fcc3fde4740 1 -- start start 2024-08-28T19:35:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3bff310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 0x55e7e3bff850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3bffd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e7e3b76680 con 0x55e7e3839390 2024-08-28T19:35:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e7e3b65c10 con 0x55e7e385a070 2024-08-28T19:35:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e7e3b69bc0 con 0x55e7e38311b0 2024-08-28T19:35:51.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc327fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3bffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc327fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3bffd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39198/0 (socket says 172.21.15.33:39198) 2024-08-28T19:35:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc327fc640 1 -- 172.21.15.33:0/4068707594 learned_addr learned my addr 172.21.15.33:0/4068707594 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc337fe640 1 --2- 172.21.15.33:0/4068707594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3bff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/4068707594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 0x55e7e3bff850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc3886d640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcc1c0b4ca0 0x7fcc1c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc327fc640 1 -- 172.21.15.33:0/4068707594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 msgr2=0x55e7e3bff850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:51.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc327fc640 1 --2- 172.21.15.33:0/4068707594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 0x55e7e3bff850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc327fc640 1 -- 172.21.15.33:0/4068707594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 msgr2=0x55e7e3bff310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:51.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc327fc640 1 --2- 172.21.15.33:0/4068707594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3bff310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc327fc640 1 -- 172.21.15.33:0/4068707594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e38c5650 con 0x55e7e3839390 2024-08-28T19:35:51.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.035+0000 7fcc337fe640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcc1c0b4ca0 0x7fcc1c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.036+0000 7fcc3886d640 1 -- 172.21.15.33:0/1557584714 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcc240e55d0 con 0x7fcc34103920 2024-08-28T19:35:51.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.036+0000 7fcc327fc640 1 --2- 172.21.15.33:0/4068707594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3bffd90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcc28000c00 tx=0x7fcc28032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be228bbaa38068a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:51.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.036+0000 7fcc19ffb640 1 -- 172.21.15.33:0/4068707594 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2803f070 con 0x55e7e3839390 2024-08-28T19:35:51.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.036+0000 7fcc19ffb640 1 -- 172.21.15.33:0/4068707594 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc280316a0 con 0x55e7e3839390 2024-08-28T19:35:51.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.036+0000 7fcc19ffb640 1 -- 172.21.15.33:0/4068707594 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28035070 con 0x55e7e3839390 2024-08-28T19:35:51.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc3fde4740 1 -- 172.21.15.33:0/4068707594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 msgr2=0x55e7e3bffd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/4068707594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3bffd90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcc28000c00 tx=0x7fcc28032ce0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc337fe640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcc1c0b4ca0 0x7fcc1c0b71b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009fd0 tx=0x7fcc2c004ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc3fde4740 1 -- 172.21.15.33:0/4068707594 shutdown_connections 2024-08-28T19:35:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/4068707594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3bffd90 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/4068707594 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 0x55e7e3bff850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/4068707594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3bff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc3fde4740 1 -- 172.21.15.33:0/4068707594 >> 172.21.15.33:0/4068707594 conn(0x55e7e384e460 msgr2=0x55e7e3bfd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc3fde4740 1 -- 172.21.15.33:0/4068707594 shutdown_connections 2024-08-28T19:35:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc3fde4740 1 -- 172.21.15.33:0/4068707594 wait complete. 2024-08-28T19:35:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.037+0000 7fcc3fde4740 1 -- start start 2024-08-28T19:35:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc3fde4740 1 Processor -- start 2024-08-28T19:35:51.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c0ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 0x55e7e3c0f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c1b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e7e39c8700 con 0x55e7e38311b0 2024-08-28T19:35:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e7e3aec750 con 0x55e7e385a070 2024-08-28T19:35:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e7e3c11df0 con 0x55e7e3839390 2024-08-28T19:35:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc3fde4740 10 client.0 _ll_register_callbacks cb 0x55e7e3b1be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c0ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c0ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39212/0 (socket says 172.21.15.33:39212) 2024-08-28T19:35:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc32ffd640 1 -- 172.21.15.33:0/2989433157 learned_addr learned my addr 172.21.15.33:0/2989433157 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc327fc640 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 0x55e7e3c0f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc337fe640 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c1b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc32ffd640 1 -- 172.21.15.33:0/2989433157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 msgr2=0x55e7e3c0f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 0x55e7e3c0f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.038+0000 7fcc32ffd640 1 -- 172.21.15.33:0/2989433157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 msgr2=0x55e7e3c1b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c1b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc32ffd640 1 -- 172.21.15.33:0/2989433157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e3b25900 con 0x55e7e38311b0 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c0ee10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcc240e2a30 tx=0x7fcc240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dbc57549954b2f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2989433157 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2401d040 con 0x55e7e38311b0 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2989433157 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcc240e5220 con 0x55e7e38311b0 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2989433157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc280316a0 con 0x55e7e38311b0 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2989433157 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcc240e5420 con 0x55e7e38311b0 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc3fde4740 10 client.16533 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:51.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2989433157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e7e3c1dba0 con 0x55e7e38311b0 2024-08-28T19:35:51.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.039+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2989433157 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc280316a0 con 0x55e7e38311b0 2024-08-28T19:35:51.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.040+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2989433157 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcc24005210 con 0x55e7e38311b0 2024-08-28T19:35:51.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.040+0000 7fcc3fde4740 10 client.16533 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:51.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.040+0000 7fcc3fde4740 10 client.16533 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:35:51.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.040+0000 7fcc3fde4740 20 client.16533 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:51.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.040+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e7e38189f0 0x55e7e3c20f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.040+0000 7fcc3fde4740 4 client.16533 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.040+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2989433157 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7e3b785d0 con 0x55e7e38189f0 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.040+0000 7fcc327fc640 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e7e38189f0 0x55e7e3c20f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.040+0000 7fcc327fc640 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e7e38189f0 0x55e7e3c20f90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6cdfbc1af5efe8ba server_cookie=a9b311b22fd3eeb6 in_seq=0 out_seq=0 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.040+0000 7fcc12ffd640 10 client.16533 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.041+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2989433157 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e7e3b785d0 con 0x55e7e38189f0 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.041+0000 7fcc12ffd640 10 client.16533 handle_command_reply: tid=0 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.041+0000 7fcc3fde4740 1 client.16533 shutdown 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.041+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2989433157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 msgr2=0x55e7e3c0ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.041+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c0ee10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcc240e2a30 tx=0x7fcc240048f0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.042+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2989433157 shutdown_connections 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.042+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c1b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.042+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 0x55e7e3c0f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.042+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e7e38189f0 0x55e7e3c20f90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.042+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2989433157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c0ee10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.042+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2989433157 >> 172.21.15.33:0/2989433157 conn(0x55e7e384e460 msgr2=0x55e7e3bfb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:51.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.042+0000 7fcc12ffd640 0 client.16533 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:35:51.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.042+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2989433157 shutdown_connections 2024-08-28T19:35:51.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.042+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2989433157 wait complete. 2024-08-28T19:35:51.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.042+0000 7fcc3fde4740 20 client.16533 trim_cache size 0 max 16384 2024-08-28T19:35:51.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.055+0000 7fcc3fde4740 1 Processor -- start 2024-08-28T19:35:51.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.055+0000 7fcc3fde4740 1 -- start start 2024-08-28T19:35:51.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.055+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c00d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.055+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 0x55e7e3c10a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.055+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c1b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.055+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341ae830 con 0x55e7e38311b0 2024-08-28T19:35:51.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.055+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341b0370 con 0x55e7e385a070 2024-08-28T19:35:51.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.055+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341aef00 con 0x55e7e3839390 2024-08-28T19:35:51.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.055+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c00d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc32ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c00d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39214/0 (socket says 172.21.15.33:39214) 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc32ffd640 1 -- 172.21.15.33:0/2341908151 learned_addr learned my addr 172.21.15.33:0/2341908151 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc327fc640 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 0x55e7e3c10a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc337fe640 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c1b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc32ffd640 1 -- 172.21.15.33:0/2341908151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 msgr2=0x55e7e3c10a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 0x55e7e3c10a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc32ffd640 1 -- 172.21.15.33:0/2341908151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 msgr2=0x55e7e3c1b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c1b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc32ffd640 1 -- 172.21.15.33:0/2341908151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e3c0d310 con 0x55e7e38311b0 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc327fc640 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 0x55e7e3c10a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc337fe640 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c1b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:51.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c00d00 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcc240a8be0 tx=0x7fcc2400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c562add88d7f650a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc197fa640 1 -- 172.21.15.33:0/2341908151 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2405b070 con 0x55e7e38311b0 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc197fa640 1 -- 172.21.15.33:0/2341908151 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc240055f0 con 0x55e7e38311b0 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.056+0000 7fcc197fa640 1 -- 172.21.15.33:0/2341908151 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc240b48a0 con 0x55e7e38311b0 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.057+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2341908151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 msgr2=0x55e7e3c00d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.057+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c00d00 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcc240a8be0 tx=0x7fcc2400cf80 comp rx=0 tx=0).stop 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.057+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2341908151 shutdown_connections 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.057+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c1b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.057+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e3839390 0x55e7e3c10a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.057+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2341908151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e38311b0 0x55e7e3c00d00 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.057+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2341908151 >> 172.21.15.33:0/2341908151 conn(0x55e7e384e460 msgr2=0x55e7e3c10330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.057+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2341908151 shutdown_connections 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.057+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2341908151 wait complete. 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.057+0000 7fcc3fde4740 1 -- start start 2024-08-28T19:35:51.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc3fde4740 1 Processor -- start 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 0x55e7e3c84cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3c85290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc3fde4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c13890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341afca0 con 0x55e7e3839390 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341af5d0 con 0x55e7e385a070 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc3fde4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcc341ac810 con 0x55e7e38311b0 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc3fde4740 10 client.0 _ll_register_callbacks cb 0x7fcc24007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc327fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3c85290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc327fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3c85290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39220/0 (socket says 172.21.15.33:39220) 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc327fc640 1 -- 172.21.15.33:0/2072554172 learned_addr learned my addr 172.21.15.33:0/2072554172 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc337fe640 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c13890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 0x55e7e3c84cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc327fc640 1 -- 172.21.15.33:0/2072554172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 msgr2=0x55e7e3c84cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc327fc640 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 0x55e7e3c84cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc327fc640 1 -- 172.21.15.33:0/2072554172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 msgr2=0x55e7e3c13890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc327fc640 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c13890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc327fc640 1 -- 172.21.15.33:0/2072554172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e3c14000 con 0x55e7e3839390 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.058+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 0x55e7e3c84cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc327fc640 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3c85290 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fcc2802a930 tx=0x7fcc28032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83dbc5f5942acd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2072554172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2803f040 con 0x55e7e3839390 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2072554172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcc280319d0 con 0x55e7e3839390 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2072554172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e7e3b74070 con 0x55e7e3839390 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2072554172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcc2805a050 con 0x55e7e3839390 2024-08-28T19:35:51.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc3fde4740 10 client.16539 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:51.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2072554172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e7e3c8c3f0 con 0x55e7e3839390 2024-08-28T19:35:51.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2072554172 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e7e3b74070 con 0x55e7e3839390 2024-08-28T19:35:51.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2072554172 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcc280035f0 con 0x55e7e3839390 2024-08-28T19:35:51.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc3fde4740 10 client.16539 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:51.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc3fde4740 10 client.16539 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:35:51.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc3fde4740 20 client.16539 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:51.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e7e37edda0 0x55e7e3c8e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:51.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc3fde4740 4 client.16539 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:35:51.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.059+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2072554172 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e7e3b717b0 con 0x55e7e37edda0 2024-08-28T19:35:51.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.060+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e7e37edda0 0x55e7e3c8e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.060+0000 7fcc12ffd640 10 client.16539 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.060+0000 7fcc32ffd640 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e7e37edda0 0x55e7e3c8e810 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f14fa807840eea6 server_cookie=52041bb84f60c78f in_seq=0 out_seq=0 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.060+0000 7fcc12ffd640 1 -- 172.21.15.33:0/2072554172 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e7e3b717b0 con 0x55e7e37edda0 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.060+0000 7fcc12ffd640 10 client.16539 handle_command_reply: tid=0 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 client.16539 shutdown 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2072554172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 msgr2=0x55e7e3c85290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3c85290 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fcc2802a930 tx=0x7fcc28032f90 comp rx=0 tx=0).stop 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2072554172 shutdown_connections 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7e385a070 0x55e7e3c13890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e7e37edda0 0x55e7e3c8e810 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e7e3839390 0x55e7e3c85290 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 --2- 172.21.15.33:0/2072554172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e7e38311b0 0x55e7e3c84cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2072554172 >> 172.21.15.33:0/2072554172 conn(0x55e7e384e460 msgr2=0x55e7e3c00ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:51.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc12ffd640 0 client.16539 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:35:51.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2072554172 shutdown_connections 2024-08-28T19:35:51.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 1 -- 172.21.15.33:0/2072554172 wait complete. 2024-08-28T19:35:51.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3fde4740 20 client.16539 trim_cache size 0 max 16384 2024-08-28T19:35:51.071 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:35:51.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3986f640 1 -- 172.21.15.33:0/1557584714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcc1c0b4ca0 msgr2=0x7fcc1c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:51.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3986f640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcc1c0b4ca0 0x7fcc1c0b71b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009fd0 tx=0x7fcc2c004ab0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3986f640 1 -- 172.21.15.33:0/1557584714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc34103920 msgr2=0x7fcc3419a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:51.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.061+0000 7fcc3986f640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc34103920 0x7fcc3419a260 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400c970 tx=0x7fcc2400ce30 comp rx=0 tx=0).stop 2024-08-28T19:35:51.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.062+0000 7fcc3986f640 1 -- 172.21.15.33:0/1557584714 shutdown_connections 2024-08-28T19:35:51.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.062+0000 7fcc3986f640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc34109bb0 0x7fcc3419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.062+0000 7fcc3986f640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcc1c0b4ca0 0x7fcc1c0b71b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.062+0000 7fcc3986f640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcc34109260 0x7fcc3419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.062+0000 7fcc3986f640 1 --2- 172.21.15.33:0/1557584714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc34103920 0x7fcc3419a260 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:51.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.062+0000 7fcc3986f640 1 -- 172.21.15.33:0/1557584714 >> 172.21.15.33:0/1557584714 conn(0x7fcc340ff3b0 msgr2=0x7fcc341017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:51.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.062+0000 7fcc3986f640 1 -- 172.21.15.33:0/1557584714 shutdown_connections 2024-08-28T19:35:51.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:51.062+0000 7fcc3986f640 1 -- 172.21.15.33:0/1557584714 wait complete. 2024-08-28T19:35:51.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:50 smithi059 ceph-mon[22052]: pgmap v444: 129 pgs: 129 active+clean; 3.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-28T19:35:51.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:50 smithi122 ceph-mon[22174]: pgmap v444: 129 pgs: 129 active+clean; 3.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-28T19:35:51.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:50 smithi033 ceph-mon[18549]: pgmap v444: 129 pgs: 129 active+clean; 3.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-28T19:35:51.934 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:35:52.187 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:52.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.649+0000 7f4950a4b640 1 -- 172.21.15.33:0/2319544239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f494c108b40 msgr2=0x7f494c10f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:52.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.649+0000 7f4950a4b640 1 --2- 172.21.15.33:0/2319544239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f494c108b40 0x7f494c10f370 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4944009ca0 tx=0x7f494402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.649+0000 7f4950a4b640 1 -- 172.21.15.33:0/2319544239 shutdown_connections 2024-08-28T19:35:52.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.649+0000 7f4950a4b640 1 --2- 172.21.15.33:0/2319544239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f494c108b40 0x7f494c10f370 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.649+0000 7f4950a4b640 1 --2- 172.21.15.33:0/2319544239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f494c1081f0 0x7f494c108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.649+0000 7f4950a4b640 1 --2- 172.21.15.33:0/2319544239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f494c1028b0 0x7f494c102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.649+0000 7f4950a4b640 1 -- 172.21.15.33:0/2319544239 >> 172.21.15.33:0/2319544239 conn(0x7f494c079470 msgr2=0x7f494c079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.649+0000 7f4950a4b640 1 -- 172.21.15.33:0/2319544239 shutdown_connections 2024-08-28T19:35:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.649+0000 7f4950a4b640 1 -- 172.21.15.33:0/2319544239 wait complete. 2024-08-28T19:35:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.650+0000 7f4950a4b640 1 Processor -- start 2024-08-28T19:35:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.650+0000 7f4950a4b640 1 -- start start 2024-08-28T19:35:52.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.650+0000 7f4950a4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f494c1028b0 0x7f494c19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.650+0000 7f4950a4b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f494c1081f0 0x7f494c19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f4950a4b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f494c108b40 0x7f494c19fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f4950a4b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f494c1127f0 con 0x7f494c108b40 2024-08-28T19:35:52.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f4950a4b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f494c112670 con 0x7f494c1081f0 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f4950a4b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f494c112970 con 0x7f494c1028b0 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f494ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f494c108b40 0x7f494c19fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f494ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f494c108b40 0x7f494c19fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39238/0 (socket says 172.21.15.33:39238) 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f494ad9d640 1 -- 172.21.15.33:0/873817056 learned_addr learned my addr 172.21.15.33:0/873817056 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f4949d9b640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f494c1081f0 0x7f494c19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f494a59c640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f494c1028b0 0x7f494c19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f494ad9d640 1 -- 172.21.15.33:0/873817056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f494c1028b0 msgr2=0x7f494c19a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f494ad9d640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f494c1028b0 0x7f494c19a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f494ad9d640 1 -- 172.21.15.33:0/873817056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f494c1081f0 msgr2=0x7f494c19a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f494ad9d640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f494c1081f0 0x7f494c19a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f494ad9d640 1 -- 172.21.15.33:0/873817056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c1a00c0 con 0x7f494c108b40 2024-08-28T19:35:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f494ad9d640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f494c108b40 0x7f494c19fa50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4944005cc0 tx=0x7f494402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f493b7fe640 1 -- 172.21.15.33:0/873817056 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944003bf0 con 0x7f494c108b40 2024-08-28T19:35:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f4950a4b640 1 -- 172.21.15.33:0/873817056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494c1a0350 con 0x7f494c108b40 2024-08-28T19:35:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f493b7fe640 1 -- 172.21.15.33:0/873817056 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4944003d90 con 0x7f494c108b40 2024-08-28T19:35:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.651+0000 7f493b7fe640 1 -- 172.21.15.33:0/873817056 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494402fbc0 con 0x7f494c108b40 2024-08-28T19:35:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.652+0000 7f4950a4b640 1 -- 172.21.15.33:0/873817056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494c1a0890 con 0x7f494c108b40 2024-08-28T19:35:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.654+0000 7f4956fc0740 1 Processor -- start 2024-08-28T19:35:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.654+0000 7f493b7fe640 1 -- 172.21.15.33:0/873817056 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f494402fd60 con 0x7f494c108b40 2024-08-28T19:35:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.654+0000 7f4956fc0740 1 -- start start 2024-08-28T19:35:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.654+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2667070 0x5590f2a0c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f263e1b0 0x5590f2a0c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f2646390 0x5590f2a0cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4956fc0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5590f2983680 con 0x5590f2667070 2024-08-28T19:35:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4956fc0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5590f2972c10 con 0x5590f2646390 2024-08-28T19:35:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4956fc0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5590f2976bc0 con 0x5590f263e1b0 2024-08-28T19:35:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2667070 0x5590f2a0c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2667070 0x5590f2a0c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39244/0 (socket says 172.21.15.33:39244) 2024-08-28T19:35:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4949d9b640 1 -- 172.21.15.33:0/2099915193 learned_addr learned my addr 172.21.15.33:0/2099915193 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4949d9b640 1 --2- 172.21.15.33:0/2099915193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f2646390 0x5590f2a0cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f494a59c640 1 --2- 172.21.15.33:0/2099915193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f263e1b0 0x5590f2a0c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4949d9b640 1 -- 172.21.15.33:0/2099915193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f263e1b0 msgr2=0x5590f2a0c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4949d9b640 1 --2- 172.21.15.33:0/2099915193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f263e1b0 0x5590f2a0c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4949d9b640 1 -- 172.21.15.33:0/2099915193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f2646390 msgr2=0x5590f2a0cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4949d9b640 1 --2- 172.21.15.33:0/2099915193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f2646390 0x5590f2a0cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4949d9b640 1 -- 172.21.15.33:0/2099915193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590f26d2650 con 0x5590f2667070 2024-08-28T19:35:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f493b7fe640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49340b4cd0 0x7f49340b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f494a59c640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49340b4cd0 0x7f49340b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4949d9b640 1 --2- 172.21.15.33:0/2099915193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2667070 0x5590f2a0c310 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4940012520 tx=0x7f494000c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4eaff8bccdb5e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f493b7fe640 1 -- 172.21.15.33:0/873817056 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4944106cb0 con 0x7f494c108b40 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.655+0000 7f4938ff9640 1 -- 172.21.15.33:0/2099915193 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940004260 con 0x5590f2667070 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.656+0000 7f4938ff9640 1 -- 172.21.15.33:0/2099915193 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4940004400 con 0x5590f2667070 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.656+0000 7f4938ff9640 1 -- 172.21.15.33:0/2099915193 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49400035f0 con 0x5590f2667070 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.657+0000 7f4956fc0740 1 -- 172.21.15.33:0/2099915193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2667070 msgr2=0x5590f2a0c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.657+0000 7f4956fc0740 1 --2- 172.21.15.33:0/2099915193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2667070 0x5590f2a0c310 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4940012520 tx=0x7f494000c5c0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.657+0000 7f494a59c640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49340b4cd0 0x7f49340b71e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f493c005fd0 tx=0x7f493c005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.657+0000 7f4956fc0740 1 -- 172.21.15.33:0/2099915193 shutdown_connections 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.657+0000 7f4956fc0740 1 --2- 172.21.15.33:0/2099915193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f2646390 0x5590f2a0cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.657+0000 7f4956fc0740 1 --2- 172.21.15.33:0/2099915193 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f263e1b0 0x5590f2a0c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.657+0000 7f4956fc0740 1 --2- 172.21.15.33:0/2099915193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2667070 0x5590f2a0c310 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.657+0000 7f4956fc0740 1 -- 172.21.15.33:0/2099915193 >> 172.21.15.33:0/2099915193 conn(0x5590f265b460 msgr2=0x5590f2a0a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.657+0000 7f4956fc0740 1 -- 172.21.15.33:0/2099915193 shutdown_connections 2024-08-28T19:35:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.657+0000 7f4956fc0740 1 -- 172.21.15.33:0/2099915193 wait complete. 2024-08-28T19:35:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4956fc0740 1 -- start start 2024-08-28T19:35:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4956fc0740 1 Processor -- start 2024-08-28T19:35:52.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 0x5590f2a1bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a1c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2667070 0x5590f2a28150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4956fc0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5590f27d5700 con 0x5590f2646390 2024-08-28T19:35:52.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4956fc0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5590f28f9750 con 0x5590f263e1b0 2024-08-28T19:35:52.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4956fc0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5590f2a1ee20 con 0x5590f2667070 2024-08-28T19:35:52.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4956fc0740 10 client.0 _ll_register_callbacks cb 0x5590f2928e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:52.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a1c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a1c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39254/0 (socket says 172.21.15.33:39254) 2024-08-28T19:35:52.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f4949d9b640 1 -- 172.21.15.33:0/929768433 learned_addr learned my addr 172.21.15.33:0/929768433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:52.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f494ad9d640 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2667070 0x5590f2a28150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.658+0000 7f494a59c640 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 0x5590f2a1bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4949d9b640 1 -- 172.21.15.33:0/929768433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2667070 msgr2=0x5590f2a28150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4949d9b640 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2667070 0x5590f2a28150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4949d9b640 1 -- 172.21.15.33:0/929768433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 msgr2=0x5590f2a1bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4949d9b640 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 0x5590f2a1bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4949d9b640 1 -- 172.21.15.33:0/929768433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590f2932900 con 0x5590f2646390 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f494a59c640 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 0x5590f2a1bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4949d9b640 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a1c420 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f49400058c0 tx=0x7f4940004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb5653c533f348 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4931ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4931ffb640 1 -- 172.21.15.33:0/929768433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494002b060 con 0x5590f2646390 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4931ffb640 1 -- 172.21.15.33:0/929768433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4940005430 con 0x5590f2646390 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4956fc0740 1 -- 172.21.15.33:0/929768433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4940004400 con 0x5590f2646390 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4931ffb640 1 -- 172.21.15.33:0/929768433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4940032050 con 0x5590f2646390 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4956fc0740 10 client.16551 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4956fc0740 1 -- 172.21.15.33:0/929768433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5590f2a2ac90 con 0x5590f2646390 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.659+0000 7f4931ffb640 1 -- 172.21.15.33:0/929768433 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4940004400 con 0x5590f2646390 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.660+0000 7f4931ffb640 1 -- 172.21.15.33:0/929768433 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f494001d4c0 con 0x5590f2646390 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.660+0000 7f4956fc0740 10 client.16551 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.660+0000 7f4956fc0740 10 client.16551 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.660+0000 7f4956fc0740 20 client.16551 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.660+0000 7f4956fc0740 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5590f26259f0 0x5590f2a2e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.660+0000 7f4956fc0740 4 client.16551 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.660+0000 7f4956fc0740 1 -- 172.21.15.33:0/929768433 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590f29855d0 con 0x5590f26259f0 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.660+0000 7f494a59c640 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5590f26259f0 0x5590f2a2e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.661+0000 7f4931ffb640 10 client.16551 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.661+0000 7f494a59c640 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5590f26259f0 0x5590f2a2e0a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7cfaa38a625cd56 server_cookie=4b2c209b4f721182 in_seq=0 out_seq=0 2024-08-28T19:35:52.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.661+0000 7f4931ffb640 1 -- 172.21.15.33:0/929768433 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5590f29855d0 con 0x5590f26259f0 2024-08-28T19:35:52.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.661+0000 7f4931ffb640 10 client.16551 handle_command_reply: tid=0 2024-08-28T19:35:52.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.661+0000 7f4956fc0740 1 client.16551 shutdown 2024-08-28T19:35:52.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 1 -- 172.21.15.33:0/929768433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 msgr2=0x5590f2a1c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:52.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a1c420 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f49400058c0 tx=0x7f4940004730 comp rx=0 tx=0).stop 2024-08-28T19:35:52.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 1 -- 172.21.15.33:0/929768433 shutdown_connections 2024-08-28T19:35:52.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5590f26259f0 0x5590f2a2e0a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2667070 0x5590f2a28150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a1c420 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 1 --2- 172.21.15.33:0/929768433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 0x5590f2a1bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4931ffb640 0 client.16551 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:35:52.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 1 -- 172.21.15.33:0/929768433 >> 172.21.15.33:0/929768433 conn(0x5590f265b460 msgr2=0x5590f2a0f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:52.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 1 -- 172.21.15.33:0/929768433 shutdown_connections 2024-08-28T19:35:52.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 1 -- 172.21.15.33:0/929768433 wait complete. 2024-08-28T19:35:52.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.662+0000 7f4956fc0740 20 client.16551 trim_cache size 0 max 16384 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.675+0000 7f4956fc0740 1 Processor -- start 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.675+0000 7f4956fc0740 1 -- start start 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.675+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 0x5590f2a190d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.675+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a19610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.675+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2667070 0x5590f2a336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.675+0000 7f4956fc0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f494c1ae790 con 0x5590f2646390 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.675+0000 7f4956fc0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f494c1b02d0 con 0x5590f263e1b0 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.675+0000 7f4956fc0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f494c1aee60 con 0x5590f2667070 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.675+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a19610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4949d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a19610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39270/0 (socket says 172.21.15.33:39270) 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4949d9b640 1 -- 172.21.15.33:0/1777435597 learned_addr learned my addr 172.21.15.33:0/1777435597 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f494a59c640 1 --2- 172.21.15.33:0/1777435597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 0x5590f2a190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f494ad9d640 1 --2- 172.21.15.33:0/1777435597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2667070 0x5590f2a336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4949d9b640 1 -- 172.21.15.33:0/1777435597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2667070 msgr2=0x5590f2a336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4949d9b640 1 --2- 172.21.15.33:0/1777435597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2667070 0x5590f2a336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4949d9b640 1 -- 172.21.15.33:0/1777435597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 msgr2=0x5590f2a190d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4949d9b640 1 --2- 172.21.15.33:0/1777435597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 0x5590f2a190d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4949d9b640 1 -- 172.21.15.33:0/1777435597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590f2a1a3e0 con 0x5590f2646390 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4949d9b640 1 --2- 172.21.15.33:0/1777435597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a19610 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f494001d8c0 tx=0x7f494000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea7f2944db1914e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4933fff640 1 -- 172.21.15.33:0/1777435597 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494002b030 con 0x5590f2646390 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4933fff640 1 -- 172.21.15.33:0/1777435597 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4940004460 con 0x5590f2646390 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.676+0000 7f4933fff640 1 -- 172.21.15.33:0/1777435597 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494001d670 con 0x5590f2646390 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.677+0000 7f4956fc0740 1 -- 172.21.15.33:0/1777435597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 msgr2=0x5590f2a19610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.677+0000 7f4956fc0740 1 --2- 172.21.15.33:0/1777435597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a19610 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f494001d8c0 tx=0x7f494000c520 comp rx=0 tx=0).stop 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.677+0000 7f4956fc0740 1 -- 172.21.15.33:0/1777435597 shutdown_connections 2024-08-28T19:35:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.677+0000 7f4956fc0740 1 --2- 172.21.15.33:0/1777435597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2667070 0x5590f2a336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.677+0000 7f4956fc0740 1 --2- 172.21.15.33:0/1777435597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f2646390 0x5590f2a19610 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.677+0000 7f4956fc0740 1 --2- 172.21.15.33:0/1777435597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f263e1b0 0x5590f2a190d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.677+0000 7f4956fc0740 1 -- 172.21.15.33:0/1777435597 >> 172.21.15.33:0/1777435597 conn(0x5590f265b460 msgr2=0x5590f2a1a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:52.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.677+0000 7f4956fc0740 1 -- 172.21.15.33:0/1777435597 shutdown_connections 2024-08-28T19:35:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.677+0000 7f4956fc0740 1 -- 172.21.15.33:0/1777435597 wait complete. 2024-08-28T19:35:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.677+0000 7f4956fc0740 1 -- start start 2024-08-28T19:35:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f4956fc0740 1 Processor -- start 2024-08-28T19:35:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f263e1b0 0x5590f2a24830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2646390 0x5590f2a20cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f4956fc0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f2667070 0x5590f2a21230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f4956fc0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f494c1afc00 con 0x5590f263e1b0 2024-08-28T19:35:52.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f4956fc0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f494c1af530 con 0x5590f2667070 2024-08-28T19:35:52.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f4956fc0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f494c1ac770 con 0x5590f2646390 2024-08-28T19:35:52.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f4956fc0740 10 client.0 _ll_register_callbacks cb 0x7f494000cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:52.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f494a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f263e1b0 0x5590f2a24830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f494a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f263e1b0 0x5590f2a24830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39278/0 (socket says 172.21.15.33:39278) 2024-08-28T19:35:52.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f494a59c640 1 -- 172.21.15.33:0/2949851675 learned_addr learned my addr 172.21.15.33:0/2949851675 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:52.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f494ad9d640 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f2667070 0x5590f2a21230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f4949d9b640 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2646390 0x5590f2a20cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f494a59c640 1 -- 172.21.15.33:0/2949851675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2646390 msgr2=0x5590f2a20cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f494a59c640 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2646390 0x5590f2a20cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f494a59c640 1 -- 172.21.15.33:0/2949851675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f2667070 msgr2=0x5590f2a21230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f494a59c640 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f2667070 0x5590f2a21230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f494a59c640 1 -- 172.21.15.33:0/2949851675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590f2a21970 con 0x5590f263e1b0 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.678+0000 7f4949d9b640 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2646390 0x5590f2a20cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f494a59c640 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f263e1b0 0x5590f2a24830 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x5590f2a2e640 tx=0x7f493c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25eac8479a5b255c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4931ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4931ffb640 1 -- 172.21.15.33:0/2949851675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c004230 con 0x5590f263e1b0 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4931ffb640 1 -- 172.21.15.33:0/2949851675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f493c0043d0 con 0x5590f263e1b0 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4956fc0740 1 -- 172.21.15.33:0/2949851675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4940004460 con 0x5590f263e1b0 2024-08-28T19:35:52.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4931ffb640 1 -- 172.21.15.33:0/2949851675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f493c012e50 con 0x5590f263e1b0 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4956fc0740 10 client.16557 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4956fc0740 1 -- 172.21.15.33:0/2949851675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5590f2a99810 con 0x5590f263e1b0 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4931ffb640 1 -- 172.21.15.33:0/2949851675 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4940004460 con 0x5590f263e1b0 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4931ffb640 1 -- 172.21.15.33:0/2949851675 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f493c02e070 con 0x5590f263e1b0 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4956fc0740 10 client.16557 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4956fc0740 10 client.16557 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.679+0000 7f4956fc0740 20 client.16557 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.680+0000 7f4956fc0740 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5590f25fada0 0x5590f2a9c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.680+0000 7f4956fc0740 4 client.16557 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.680+0000 7f4956fc0740 1 -- 172.21.15.33:0/2949851675 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5590f2981070 con 0x5590f25fada0 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.680+0000 7f4949d9b640 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5590f25fada0 0x5590f2a9c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.680+0000 7f4949d9b640 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5590f25fada0 0x5590f2a9c000 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f753bcd257d81c2e server_cookie=87591820371bafa0 in_seq=0 out_seq=0 2024-08-28T19:35:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.680+0000 7f4931ffb640 10 client.16557 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:35:52.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4931ffb640 1 -- 172.21.15.33:0/2949851675 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5590f2981070 con 0x5590f25fada0 2024-08-28T19:35:52.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4931ffb640 10 client.16557 handle_command_reply: tid=0 2024-08-28T19:35:52.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 client.16557 shutdown 2024-08-28T19:35:52.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 -- 172.21.15.33:0/2949851675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f263e1b0 msgr2=0x5590f2a24830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:52.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f263e1b0 0x5590f2a24830 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x5590f2a2e640 tx=0x7f493c0046c0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 -- 172.21.15.33:0/2949851675 shutdown_connections 2024-08-28T19:35:52.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5590f25fada0 0x5590f2a9c000 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590f2667070 0x5590f2a21230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5590f2646390 0x5590f2a20cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4931ffb640 0 client.16557 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:35:52.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 --2- 172.21.15.33:0/2949851675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5590f263e1b0 0x5590f2a24830 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 -- 172.21.15.33:0/2949851675 >> 172.21.15.33:0/2949851675 conn(0x5590f265b460 msgr2=0x5590f2a0d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:52.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 -- 172.21.15.33:0/2949851675 shutdown_connections 2024-08-28T19:35:52.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 1 -- 172.21.15.33:0/2949851675 wait complete. 2024-08-28T19:35:52.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4956fc0740 20 client.16557 trim_cache size 0 max 16384 2024-08-28T19:35:52.693 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:35:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4950a4b640 1 -- 172.21.15.33:0/873817056 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49340b4cd0 msgr2=0x7f49340b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4950a4b640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49340b4cd0 0x7f49340b71e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f493c005fd0 tx=0x7f493c005c50 comp rx=0 tx=0).stop 2024-08-28T19:35:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4950a4b640 1 -- 172.21.15.33:0/873817056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f494c108b40 msgr2=0x7f494c19fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4950a4b640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f494c108b40 0x7f494c19fa50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4944005cc0 tx=0x7f494402f380 comp rx=0 tx=0).stop 2024-08-28T19:35:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4950a4b640 1 -- 172.21.15.33:0/873817056 shutdown_connections 2024-08-28T19:35:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4950a4b640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f494c108b40 0x7f494c19fa50 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4950a4b640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f494c1081f0 0x7f494c19a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4950a4b640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f49340b4cd0 0x7f49340b71e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4950a4b640 1 --2- 172.21.15.33:0/873817056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f494c1028b0 0x7f494c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.681+0000 7f4950a4b640 1 -- 172.21.15.33:0/873817056 >> 172.21.15.33:0/873817056 conn(0x7f494c079470 msgr2=0x7f494c06bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.682+0000 7f4950a4b640 1 -- 172.21.15.33:0/873817056 shutdown_connections 2024-08-28T19:35:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:52.682+0000 7f4950a4b640 1 -- 172.21.15.33:0/873817056 wait complete. 2024-08-28T19:35:53.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:52 smithi033 ceph-mon[18549]: pgmap v445: 129 pgs: 129 active+clean; 3.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-08-28T19:35:53.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:52 smithi059 ceph-mon[22052]: pgmap v445: 129 pgs: 129 active+clean; 3.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-08-28T19:35:53.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:52 smithi122 ceph-mon[22174]: pgmap v445: 129 pgs: 129 active+clean; 3.3 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-08-28T19:35:53.587 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:35:53.852 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:54.243 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:53 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:35:54.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:53 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:35:54.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:53 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:35:54.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.333+0000 7f6232a3c640 1 -- 172.21.15.33:0/417024965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f622c1050c0 msgr2=0x7f622c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:54.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.333+0000 7f6232a3c640 1 --2- 172.21.15.33:0/417024965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f622c1050c0 0x7f622c10d610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6220009900 tx=0x7f622002a410 comp rx=0 tx=0).stop 2024-08-28T19:35:54.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.333+0000 7f6232a3c640 1 -- 172.21.15.33:0/417024965 shutdown_connections 2024-08-28T19:35:54.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.333+0000 7f6232a3c640 1 --2- 172.21.15.33:0/417024965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f622c10dbd0 0x7f622c1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.333+0000 7f6232a3c640 1 --2- 172.21.15.33:0/417024965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f622c1050c0 0x7f622c10d610 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.333+0000 7f6232a3c640 1 --2- 172.21.15.33:0/417024965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622c104770 0x7f622c104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.333+0000 7f6232a3c640 1 -- 172.21.15.33:0/417024965 >> 172.21.15.33:0/417024965 conn(0x7f622c0794e0 msgr2=0x7f622c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:54.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.333+0000 7f6232a3c640 1 -- 172.21.15.33:0/417024965 shutdown_connections 2024-08-28T19:35:54.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.333+0000 7f6232a3c640 1 -- 172.21.15.33:0/417024965 wait complete. 2024-08-28T19:35:54.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.334+0000 7f6232a3c640 1 Processor -- start 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.334+0000 7f6232a3c640 1 -- start start 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.334+0000 7f6232a3c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f622c104770 0x7f622c1024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.334+0000 7f6232a3c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f622c1050c0 0x7f622c1029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.334+0000 7f6232a3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622c10dbd0 0x7f622c102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.334+0000 7f6232a3c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f622c113810 con 0x7f622c1050c0 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.334+0000 7f6232a3c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f622c113690 con 0x7f622c10dbd0 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.334+0000 7f6232a3c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f622c113990 con 0x7f622c104770 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.334+0000 7f622b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f622c1050c0 0x7f622c1029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f622b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f622c1050c0 0x7f622c1029f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39302/0 (socket says 172.21.15.33:39302) 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f622b7fe640 1 -- 172.21.15.33:0/4018200409 learned_addr learned my addr 172.21.15.33:0/4018200409 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f622bfff640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f622c104770 0x7f622c1024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f6230fd9640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622c10dbd0 0x7f622c102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f622b7fe640 1 -- 172.21.15.33:0/4018200409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f622c104770 msgr2=0x7f622c1024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f622b7fe640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f622c104770 0x7f622c1024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f622b7fe640 1 -- 172.21.15.33:0/4018200409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622c10dbd0 msgr2=0x7f622c102f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f622b7fe640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622c10dbd0 0x7f622c102f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f622b7fe640 1 -- 172.21.15.33:0/4018200409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622c1a8560 con 0x7f622c1050c0 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f6230fd9640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622c10dbd0 0x7f622c102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f622b7fe640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f622c1050c0 0x7f622c1029f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6220006010 tx=0x7f6220004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f62297fa640 1 -- 172.21.15.33:0/4018200409 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622003f030 con 0x7f622c1050c0 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f6232a3c640 1 -- 172.21.15.33:0/4018200409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622c1a87f0 con 0x7f622c1050c0 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f62297fa640 1 -- 172.21.15.33:0/4018200409 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6220003aa0 con 0x7f622c1050c0 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f62297fa640 1 -- 172.21.15.33:0/4018200409 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220035070 con 0x7f622c1050c0 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.335+0000 7f6232a3c640 1 -- 172.21.15.33:0/4018200409 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622c1a8cd0 con 0x7f622c1050c0 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.338+0000 7f6238fb1740 1 Processor -- start 2024-08-28T19:35:54.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.338+0000 7f6238fb1740 1 -- start start 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.338+0000 7f62297fa640 1 -- 172.21.15.33:0/4018200409 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6220042030 con 0x7f622c1050c0 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.338+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1ac2070 0x5597f1e67310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.338+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1a991b0 0x5597f1e67850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.338+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 0x5597f1e67d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.338+0000 7f6238fb1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5597f1dde680 con 0x5597f1a991b0 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.338+0000 7f6238fb1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5597f1dcdc10 con 0x5597f1ac2070 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.338+0000 7f6238fb1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5597f1dd1bc0 con 0x5597f1aa1390 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f622bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1a991b0 0x5597f1e67850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f622bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1a991b0 0x5597f1e67850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39318/0 (socket says 172.21.15.33:39318) 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f622bfff640 1 -- 172.21.15.33:0/295107067 learned_addr learned my addr 172.21.15.33:0/295107067 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f6230fd9640 1 --2- 172.21.15.33:0/295107067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1ac2070 0x5597f1e67310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f622b7fe640 1 --2- 172.21.15.33:0/295107067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 0x5597f1e67d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f622bfff640 1 -- 172.21.15.33:0/295107067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 msgr2=0x5597f1e67d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f622bfff640 1 --2- 172.21.15.33:0/295107067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 0x5597f1e67d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f622bfff640 1 -- 172.21.15.33:0/295107067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1ac2070 msgr2=0x5597f1e67310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f622bfff640 1 --2- 172.21.15.33:0/295107067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1ac2070 0x5597f1e67310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f622bfff640 1 -- 172.21.15.33:0/295107067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f1b2d650 con 0x5597f1a991b0 2024-08-28T19:35:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f6230fd9640 1 --2- 172.21.15.33:0/295107067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1ac2070 0x5597f1e67310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f62297fa640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62140b4ca0 0x7f62140b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f622bfff640 1 --2- 172.21.15.33:0/295107067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1a991b0 0x5597f1e67850 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f621c009c60 tx=0x7f621c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c886fdd70aedc354 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f6230fd9640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62140b4ca0 0x7f62140b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f62127fc640 1 -- 172.21.15.33:0/295107067 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c004220 con 0x5597f1a991b0 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f62297fa640 1 -- 172.21.15.33:0/4018200409 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f6220105db0 con 0x7f622c1050c0 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f62127fc640 1 -- 172.21.15.33:0/295107067 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f621c0043c0 con 0x5597f1a991b0 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.339+0000 7f62127fc640 1 -- 172.21.15.33:0/295107067 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c004ce0 con 0x5597f1a991b0 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.340+0000 7f6238fb1740 1 -- 172.21.15.33:0/295107067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1a991b0 msgr2=0x5597f1e67850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.340+0000 7f6230fd9640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62140b4ca0 0x7f62140b71b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f622400a520 tx=0x7f622400a4b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.340+0000 7f6238fb1740 1 --2- 172.21.15.33:0/295107067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1a991b0 0x5597f1e67850 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f621c009c60 tx=0x7f621c011810 comp rx=0 tx=0).stop 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.340+0000 7f6238fb1740 1 -- 172.21.15.33:0/295107067 shutdown_connections 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.340+0000 7f6238fb1740 1 --2- 172.21.15.33:0/295107067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 0x5597f1e67d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.340+0000 7f6238fb1740 1 --2- 172.21.15.33:0/295107067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1a991b0 0x5597f1e67850 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.340+0000 7f6238fb1740 1 --2- 172.21.15.33:0/295107067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1ac2070 0x5597f1e67310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.340+0000 7f6238fb1740 1 -- 172.21.15.33:0/295107067 >> 172.21.15.33:0/295107067 conn(0x5597f1ab6460 msgr2=0x5597f1e65200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.340+0000 7f6238fb1740 1 -- 172.21.15.33:0/295107067 shutdown_connections 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.340+0000 7f6238fb1740 1 -- 172.21.15.33:0/295107067 wait complete. 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.341+0000 7f6238fb1740 1 -- start start 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.341+0000 7f6238fb1740 1 Processor -- start 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.341+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1a991b0 0x5597f1e72a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.341+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 0x5597f1e72f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.341+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e7ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.341+0000 7f6238fb1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5597f1c30700 con 0x5597f1ac2070 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.341+0000 7f6238fb1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5597f1d54750 con 0x5597f1a991b0 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.341+0000 7f6238fb1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5597f1e75af0 con 0x5597f1aa1390 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.341+0000 7f6238fb1740 10 client.0 _ll_register_callbacks cb 0x5597f1d83e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.341+0000 7f6230fd9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e7ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6230fd9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e7ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39320/0 (socket says 172.21.15.33:39320) 2024-08-28T19:35:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6230fd9640 1 -- 172.21.15.33:0/3478272976 learned_addr learned my addr 172.21.15.33:0/3478272976 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f622bfff640 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1a991b0 0x5597f1e72a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f622b7fe640 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 0x5597f1e72f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6230fd9640 1 -- 172.21.15.33:0/3478272976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 msgr2=0x5597f1e72f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6230fd9640 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 0x5597f1e72f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6230fd9640 1 -- 172.21.15.33:0/3478272976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1a991b0 msgr2=0x5597f1e72a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6230fd9640 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1a991b0 0x5597f1e72a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6230fd9640 1 -- 172.21.15.33:0/3478272976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597f1d8d900 con 0x5597f1ac2070 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f622b7fe640 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 0x5597f1e72f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6230fd9640 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e7ede0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6224011e10 tx=0x7f6224004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f27cb797ea1b7e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f620b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f620b7fe640 1 -- 172.21.15.33:0/3478272976 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622401e620 con 0x5597f1ac2070 2024-08-28T19:35:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f620b7fe640 1 -- 172.21.15.33:0/3478272976 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f622401e7c0 con 0x5597f1ac2070 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6238fb1740 1 -- 172.21.15.33:0/3478272976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f621c0043c0 con 0x5597f1ac2070 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f620b7fe640 1 -- 172.21.15.33:0/3478272976 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f622402f050 con 0x5597f1ac2070 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6238fb1740 10 client.16569 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.342+0000 7f6238fb1740 1 -- 172.21.15.33:0/3478272976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5597f1e81890 con 0x5597f1ac2070 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f620b7fe640 1 -- 172.21.15.33:0/3478272976 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f621c0043c0 con 0x5597f1ac2070 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f620b7fe640 1 -- 172.21.15.33:0/3478272976 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f622401c930 con 0x5597f1ac2070 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f6238fb1740 10 client.16569 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f6238fb1740 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f6238fb1740 20 client.16569 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f6238fb1740 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5597f1a809f0 0x5597f1e84e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f6238fb1740 4 client.16569 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f6238fb1740 1 -- 172.21.15.33:0/3478272976 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597f1de05d0 con 0x5597f1a809f0 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f622bfff640 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5597f1a809f0 0x5597f1e84e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f622bfff640 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5597f1a809f0 0x5597f1e84e00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb3f07b4012c33c server_cookie=fb21d844e977a6ae in_seq=0 out_seq=0 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.343+0000 7f620b7fe640 10 client.16569 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.344+0000 7f620b7fe640 1 -- 172.21.15.33:0/3478272976 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597f1de05d0 con 0x5597f1a809f0 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.344+0000 7f620b7fe640 10 client.16569 handle_command_reply: tid=0 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.344+0000 7f6238fb1740 1 client.16569 shutdown 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.344+0000 7f6238fb1740 1 -- 172.21.15.33:0/3478272976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 msgr2=0x5597f1e7ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.344+0000 7f6238fb1740 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e7ede0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6224011e10 tx=0x7f6224004a40 comp rx=0 tx=0).stop 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.344+0000 7f6238fb1740 1 -- 172.21.15.33:0/3478272976 shutdown_connections 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.344+0000 7f6238fb1740 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5597f1a809f0 0x5597f1e84e00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.344+0000 7f6238fb1740 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e7ede0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.344+0000 7f6238fb1740 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1aa1390 0x5597f1e72f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.345+0000 7f6238fb1740 1 --2- 172.21.15.33:0/3478272976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1a991b0 0x5597f1e72a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.345+0000 7f620b7fe640 0 client.16569 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.345+0000 7f6238fb1740 1 -- 172.21.15.33:0/3478272976 >> 172.21.15.33:0/3478272976 conn(0x5597f1ab6460 msgr2=0x5597f1e6a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.345+0000 7f6238fb1740 1 -- 172.21.15.33:0/3478272976 shutdown_connections 2024-08-28T19:35:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.345+0000 7f6238fb1740 1 -- 172.21.15.33:0/3478272976 wait complete. 2024-08-28T19:35:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.345+0000 7f6238fb1740 20 client.16569 trim_cache size 0 max 16384 2024-08-28T19:35:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6238fb1740 1 Processor -- start 2024-08-28T19:35:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6238fb1740 1 -- start start 2024-08-28T19:35:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1a991b0 0x5597f1e6ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1aa1390 0x5597f1e7ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e64b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6238fb1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b2d80 con 0x5597f1ac2070 2024-08-28T19:35:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6238fb1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b48c0 con 0x5597f1aa1390 2024-08-28T19:35:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6238fb1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b3450 con 0x5597f1a991b0 2024-08-28T19:35:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6230fd9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e64b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6230fd9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e64b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39332/0 (socket says 172.21.15.33:39332) 2024-08-28T19:35:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f6230fd9640 1 -- 172.21.15.33:0/3056985537 learned_addr learned my addr 172.21.15.33:0/3056985537 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.358+0000 7f622bfff640 1 --2- 172.21.15.33:0/3056985537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1a991b0 0x5597f1e6ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.359+0000 7f622b7fe640 1 --2- 172.21.15.33:0/3056985537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1aa1390 0x5597f1e7ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.359+0000 7f6230fd9640 1 -- 172.21.15.33:0/3056985537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1a991b0 msgr2=0x5597f1e6ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.359+0000 7f6230fd9640 1 --2- 172.21.15.33:0/3056985537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1a991b0 0x5597f1e6ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.359+0000 7f6230fd9640 1 -- 172.21.15.33:0/3056985537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1aa1390 msgr2=0x5597f1e7ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.359+0000 7f6230fd9640 1 --2- 172.21.15.33:0/3056985537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1aa1390 0x5597f1e7ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.359+0000 7f6230fd9640 1 -- 172.21.15.33:0/3056985537 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f1e65af0 con 0x5597f1ac2070 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.359+0000 7f6230fd9640 1 --2- 172.21.15.33:0/3056985537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e64b60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6224005c40 tx=0x7f6224011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279d393ce7bd6e91 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.359+0000 7f6211ffb640 1 -- 172.21.15.33:0/3056985537 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224039020 con 0x5597f1ac2070 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.359+0000 7f6211ffb640 1 -- 172.21.15.33:0/3056985537 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f622401ca60 con 0x5597f1ac2070 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.359+0000 7f6211ffb640 1 -- 172.21.15.33:0/3056985537 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224035d80 con 0x5597f1ac2070 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.360+0000 7f6238fb1740 1 -- 172.21.15.33:0/3056985537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 msgr2=0x5597f1e64b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.360+0000 7f6238fb1740 1 --2- 172.21.15.33:0/3056985537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e64b60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6224005c40 tx=0x7f6224011aa0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.360+0000 7f6238fb1740 1 -- 172.21.15.33:0/3056985537 shutdown_connections 2024-08-28T19:35:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.360+0000 7f6238fb1740 1 --2- 172.21.15.33:0/3056985537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1e64b60 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.360+0000 7f6238fb1740 1 --2- 172.21.15.33:0/3056985537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1aa1390 0x5597f1e7ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.360+0000 7f6238fb1740 1 --2- 172.21.15.33:0/3056985537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1a991b0 0x5597f1e6ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.360+0000 7f6238fb1740 1 -- 172.21.15.33:0/3056985537 >> 172.21.15.33:0/3056985537 conn(0x5597f1ab6460 msgr2=0x5597f1e6a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.360+0000 7f6238fb1740 1 -- 172.21.15.33:0/3056985537 shutdown_connections 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.360+0000 7f6238fb1740 1 -- 172.21.15.33:0/3056985537 wait complete. 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.360+0000 7f6238fb1740 1 -- start start 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6238fb1740 1 Processor -- start 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1a991b0 0x5597f1e774d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1aa1390 0x5597f1e77a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6238fb1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1eee800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6238fb1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b41f0 con 0x5597f1ac2070 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6238fb1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b3b20 con 0x5597f1aa1390 2024-08-28T19:35:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6238fb1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1b0d60 con 0x5597f1a991b0 2024-08-28T19:35:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6238fb1740 10 client.0 _ll_register_callbacks cb 0x7f622400ad00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6230fd9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1eee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6230fd9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1eee800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39334/0 (socket says 172.21.15.33:39334) 2024-08-28T19:35:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6230fd9640 1 -- 172.21.15.33:0/256046677 learned_addr learned my addr 172.21.15.33:0/256046677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f622b7fe640 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1aa1390 0x5597f1e77a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f622bfff640 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1a991b0 0x5597f1e774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6230fd9640 1 -- 172.21.15.33:0/256046677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1a991b0 msgr2=0x5597f1e774d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:54.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6230fd9640 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1a991b0 0x5597f1e774d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6230fd9640 1 -- 172.21.15.33:0/256046677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1aa1390 msgr2=0x5597f1e77a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6230fd9640 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1aa1390 0x5597f1e77a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.361+0000 7f6230fd9640 1 -- 172.21.15.33:0/256046677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597f1eeedc0 con 0x5597f1ac2070 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f6230fd9640 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1eee800 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6224011010 tx=0x7f622401c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db4080876276e8c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f620b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f620b7fe640 1 -- 172.21.15.33:0/256046677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224039030 con 0x5597f1ac2070 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f620b7fe640 1 -- 172.21.15.33:0/256046677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f6224005240 con 0x5597f1ac2070 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f6238fb1740 1 -- 172.21.15.33:0/256046677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f622401ca60 con 0x5597f1ac2070 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f620b7fe640 1 -- 172.21.15.33:0/256046677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f622400ec20 con 0x5597f1ac2070 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f6238fb1740 10 client.16575 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f6238fb1740 1 -- 172.21.15.33:0/256046677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5597f1ef0040 con 0x5597f1ac2070 2024-08-28T19:35:54.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f620b7fe640 1 -- 172.21.15.33:0/256046677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f622401ca60 con 0x5597f1ac2070 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f620b7fe640 1 -- 172.21.15.33:0/256046677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6224032070 con 0x5597f1ac2070 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f6238fb1740 10 client.16575 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f6238fb1740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f6238fb1740 20 client.16575 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f6238fb1740 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5597f1a55da0 0x5597f1ef2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.362+0000 7f6238fb1740 4 client.16575 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.363+0000 7f6238fb1740 1 -- 172.21.15.33:0/256046677 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5597f1ddc070 con 0x5597f1a55da0 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.363+0000 7f622bfff640 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5597f1a55da0 0x5597f1ef2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.363+0000 7f622bfff640 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5597f1a55da0 0x5597f1ef2750 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b49c3d70289cd8d3 server_cookie=e805a4daf5017870 in_seq=0 out_seq=0 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.363+0000 7f620b7fe640 10 client.16575 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.363+0000 7f620b7fe640 1 -- 172.21.15.33:0/256046677 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5597f1ddc070 con 0x5597f1a55da0 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.363+0000 7f620b7fe640 10 client.16575 handle_command_reply: tid=0 2024-08-28T19:35:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.363+0000 7f6238fb1740 1 client.16575 shutdown 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.363+0000 7f6238fb1740 1 -- 172.21.15.33:0/256046677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 msgr2=0x5597f1eee800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.363+0000 7f6238fb1740 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1eee800 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6224011010 tx=0x7f622401c5e0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6238fb1740 1 -- 172.21.15.33:0/256046677 shutdown_connections 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6238fb1740 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5597f1a55da0 0x5597f1ef2750 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6238fb1740 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5597f1ac2070 0x5597f1eee800 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6238fb1740 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597f1aa1390 0x5597f1e77a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f620b7fe640 0 client.16575 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6238fb1740 1 --2- 172.21.15.33:0/256046677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5597f1a991b0 0x5597f1e774d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6238fb1740 1 -- 172.21.15.33:0/256046677 >> 172.21.15.33:0/256046677 conn(0x5597f1ab6460 msgr2=0x5597f1e64a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6238fb1740 1 -- 172.21.15.33:0/256046677 shutdown_connections 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6238fb1740 1 -- 172.21.15.33:0/256046677 wait complete. 2024-08-28T19:35:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6238fb1740 20 client.16575 trim_cache size 0 max 16384 2024-08-28T19:35:54.376 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:35:54.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6232a3c640 1 -- 172.21.15.33:0/4018200409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62140b4ca0 msgr2=0x7f62140b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:54.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6232a3c640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62140b4ca0 0x7f62140b71b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f622400a520 tx=0x7f622400a4b0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6232a3c640 1 -- 172.21.15.33:0/4018200409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f622c1050c0 msgr2=0x7f622c1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.364+0000 7f6232a3c640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f622c1050c0 0x7f622c1029f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6220006010 tx=0x7f6220004060 comp rx=0 tx=0).stop 2024-08-28T19:35:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.365+0000 7f6232a3c640 1 -- 172.21.15.33:0/4018200409 shutdown_connections 2024-08-28T19:35:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.365+0000 7f6232a3c640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622c10dbd0 0x7f622c102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.365+0000 7f6232a3c640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f622c1050c0 0x7f622c1029f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.365+0000 7f6232a3c640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62140b4ca0 0x7f62140b71b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.365+0000 7f6232a3c640 1 --2- 172.21.15.33:0/4018200409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f622c104770 0x7f622c1024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.365+0000 7f6232a3c640 1 -- 172.21.15.33:0/4018200409 >> 172.21.15.33:0/4018200409 conn(0x7f622c0794e0 msgr2=0x7f622c100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.365+0000 7f6232a3c640 1 -- 172.21.15.33:0/4018200409 shutdown_connections 2024-08-28T19:35:54.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:54.365+0000 7f6232a3c640 1 -- 172.21.15.33:0/4018200409 wait complete. 2024-08-28T19:35:55.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:54 smithi059 ceph-mon[22052]: pgmap v446: 129 pgs: 129 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 19 op/s 2024-08-28T19:35:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:35:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:35:55.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:54 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:35:55.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:54 smithi122 ceph-mon[22174]: pgmap v446: 129 pgs: 129 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 19 op/s 2024-08-28T19:35:55.296 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:35:55.296 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:35:55.296 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:54 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:35:55.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:54 smithi033 ceph-mon[18549]: pgmap v446: 129 pgs: 129 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 19 op/s 2024-08-28T19:35:55.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:35:55.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:35:55.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:54 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:35:56.108 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:35:56.108 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:35:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:56.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.900+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/774575728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f81081c0 msgr2=0x7fd7f81085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.900+0000 7fd7fd3b8640 1 --2- 172.21.15.33:0/774575728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f81081c0 0x7fd7f81085d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009900 tx=0x7fd7e002a410 comp rx=0 tx=0).stop 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.900+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/774575728 shutdown_connections 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.900+0000 7fd7fd3b8640 1 --2- 172.21.15.33:0/774575728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f8108b10 0x7fd7f810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.900+0000 7fd7fd3b8640 1 --2- 172.21.15.33:0/774575728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f81081c0 0x7fd7f81085d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.900+0000 7fd7fd3b8640 1 --2- 172.21.15.33:0/774575728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7f8102880 0x7fd7f8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.900+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/774575728 >> 172.21.15.33:0/774575728 conn(0x7fd7f8079510 msgr2=0x7fd7f8079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.900+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/774575728 shutdown_connections 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.900+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/774575728 wait complete. 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.901+0000 7fd7fd3b8640 1 Processor -- start 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.901+0000 7fd7fd3b8640 1 -- start start 2024-08-28T19:35:56.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.901+0000 7fd7fd3b8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7f8102880 0x7fd7f819b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.901+0000 7fd7fd3b8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f81081c0 0x7fd7f819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.901+0000 7fd7fd3b8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f8108b10 0x7fd7f819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.901+0000 7fd7fd3b8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8112780 con 0x7fd7f81081c0 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.901+0000 7fd7fd3b8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8112600 con 0x7fd7f8108b10 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.901+0000 7fd7fd3b8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8112900 con 0x7fd7f8102880 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f81081c0 0x7fd7f819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f81081c0 0x7fd7f819b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39358/0 (socket says 172.21.15.33:39358) 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7effff640 1 -- 172.21.15.33:0/18643977 learned_addr learned my addr 172.21.15.33:0/18643977 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7f8102880 0x7fd7f819b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7f77fe640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f8108b10 0x7fd7f819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7effff640 1 -- 172.21.15.33:0/18643977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7f8102880 msgr2=0x7fd7f819b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7effff640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7f8102880 0x7fd7f819b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7effff640 1 -- 172.21.15.33:0/18643977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f8108b10 msgr2=0x7fd7f819bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7effff640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f8108b10 0x7fd7f819bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7effff640 1 -- 172.21.15.33:0/18643977 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f81a6360 con 0x7fd7f81081c0 2024-08-28T19:35:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7effff640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f81081c0 0x7fd7f819b590 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd7e002a930 tx=0x7fd7e0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7f4ff9640 1 -- 172.21.15.33:0/18643977 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e003f030 con 0x7fd7f81081c0 2024-08-28T19:35:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7f4ff9640 1 -- 172.21.15.33:0/18643977 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7e0004490 con 0x7fd7f81081c0 2024-08-28T19:35:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7f4ff9640 1 -- 172.21.15.33:0/18643977 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0035070 con 0x7fd7f81081c0 2024-08-28T19:35:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.902+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/18643977 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f81a65f0 con 0x7fd7f81081c0 2024-08-28T19:35:56.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.903+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/18643977 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f81a6b20 con 0x7fd7f81081c0 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.905+0000 7fd7f4ff9640 1 -- 172.21.15.33:0/18643977 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd7e0042030 con 0x7fd7f81081c0 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.905+0000 7fd80392d740 1 Processor -- start 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.905+0000 7fd80392d740 1 -- start start 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd80392d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061d3350 0x565306579780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd80392d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306579cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd80392d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x56530657a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd80392d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5653064ef5f0 con 0x5653061aa490 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd80392d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5653064deb80 con 0x5653061b2670 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd80392d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5653064e2b30 con 0x5653061d3350 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306579cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f4ff9640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd7e40b4d20 0x7fd7e40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306579cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39360/0 (socket says 172.21.15.33:39360) 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f6ffd640 1 -- 172.21.15.33:0/1339141067 learned_addr learned my addr 172.21.15.33:0/1339141067 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f77fe640 1 --2- 172.21.15.33:0/1339141067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061d3350 0x565306579780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7effff640 1 --2- 172.21.15.33:0/1339141067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x56530657a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f77fe640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd7e40b4d20 0x7fd7e40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f4ff9640 1 -- 172.21.15.33:0/18643977 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd7e0105790 con 0x7fd7f81081c0 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f6ffd640 1 -- 172.21.15.33:0/1339141067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061d3350 msgr2=0x565306579780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/1339141067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061d3350 0x565306579780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f6ffd640 1 -- 172.21.15.33:0/1339141067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 msgr2=0x56530657a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.906+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/1339141067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x56530657a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.907+0000 7fd7f6ffd640 1 -- 172.21.15.33:0/1339141067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56530623e930 con 0x5653061aa490 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.907+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/1339141067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306579cc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009c90 tx=0x7fd7e8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8327cacb4648d1c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:56.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.907+0000 7fd7f77fe640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd7e40b4d20 0x7fd7e40b7230 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0005c40 tx=0x7fd7f0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.907+0000 7fd7ed7fa640 1 -- 172.21.15.33:0/1339141067 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8005220 con 0x5653061aa490 2024-08-28T19:35:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.907+0000 7fd7ed7fa640 1 -- 172.21.15.33:0/1339141067 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7e8009e40 con 0x5653061aa490 2024-08-28T19:35:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.907+0000 7fd7ed7fa640 1 -- 172.21.15.33:0/1339141067 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8019630 con 0x5653061aa490 2024-08-28T19:35:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.908+0000 7fd80392d740 1 -- 172.21.15.33:0/1339141067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 msgr2=0x565306579cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.908+0000 7fd80392d740 1 --2- 172.21.15.33:0/1339141067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306579cc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009c90 tx=0x7fd7e8011810 comp rx=0 tx=0).stop 2024-08-28T19:35:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.908+0000 7fd80392d740 1 -- 172.21.15.33:0/1339141067 shutdown_connections 2024-08-28T19:35:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.908+0000 7fd80392d740 1 --2- 172.21.15.33:0/1339141067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x56530657a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.908+0000 7fd80392d740 1 --2- 172.21.15.33:0/1339141067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306579cc0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.908+0000 7fd80392d740 1 --2- 172.21.15.33:0/1339141067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061d3350 0x565306579780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.908+0000 7fd80392d740 1 -- 172.21.15.33:0/1339141067 >> 172.21.15.33:0/1339141067 conn(0x5653061c7740 msgr2=0x565306577670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.908+0000 7fd80392d740 1 -- 172.21.15.33:0/1339141067 shutdown_connections 2024-08-28T19:35:56.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.908+0000 7fd80392d740 1 -- 172.21.15.33:0/1339141067 wait complete. 2024-08-28T19:35:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.908+0000 7fd80392d740 1 -- start start 2024-08-28T19:35:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd80392d740 1 Processor -- start 2024-08-28T19:35:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd80392d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 0x565306584eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd80392d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x5653065853f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd80392d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061d3350 0x565306591280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd80392d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x565306341890 con 0x5653061d3350 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd80392d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x565306465790 con 0x5653061b2670 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd80392d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x565306587f60 con 0x5653061aa490 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd80392d740 10 client.0 _ll_register_callbacks cb 0x5653061eaba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7f77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061d3350 0x565306591280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7f77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061d3350 0x565306591280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39376/0 (socket says 172.21.15.33:39376) 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7f77fe640 1 -- 172.21.15.33:0/1850064991 learned_addr learned my addr 172.21.15.33:0/1850064991 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 0x565306584eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7effff640 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x5653065853f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7f77fe640 1 -- 172.21.15.33:0/1850064991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 msgr2=0x565306584eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7f77fe640 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 0x565306584eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7f77fe640 1 -- 172.21.15.33:0/1850064991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 msgr2=0x5653065853f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:56.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7f77fe640 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x5653065853f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7f77fe640 1 -- 172.21.15.33:0/1850064991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56530649cf30 con 0x5653061d3350 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.909+0000 7fd7effff640 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x5653065853f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.910+0000 7fd7f77fe640 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061d3350 0x565306591280 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0011e60 tx=0x7fd7f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debd013e1a48cc88 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.910+0000 7fd7de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.910+0000 7fd7de7fc640 1 -- 172.21.15.33:0/1850064991 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f002d060 con 0x5653061d3350 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.910+0000 7fd7de7fc640 1 -- 172.21.15.33:0/1850064991 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd7f00047c0 con 0x5653061d3350 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.910+0000 7fd80392d740 1 -- 172.21.15.33:0/1850064991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5653064f1540 con 0x5653061d3350 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.910+0000 7fd7de7fc640 1 -- 172.21.15.33:0/1850064991 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd7f0034050 con 0x5653061d3350 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.910+0000 7fd80392d740 10 client.16587 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.910+0000 7fd80392d740 1 -- 172.21.15.33:0/1850064991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565306593d10 con 0x5653061d3350 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.910+0000 7fd7de7fc640 1 -- 172.21.15.33:0/1850064991 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5653064f1540 con 0x5653061d3350 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.910+0000 7fd7de7fc640 1 -- 172.21.15.33:0/1850064991 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd7f0027030 con 0x5653061d3350 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.911+0000 7fd80392d740 10 client.16587 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:56.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.911+0000 7fd80392d740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.911+0000 7fd80392d740 20 client.16587 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.911+0000 7fd80392d740 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x565306191cd0 0x5653065972c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.911+0000 7fd80392d740 4 client.16587 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.911+0000 7fd80392d740 1 -- 172.21.15.33:0/1850064991 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653064ecfe0 con 0x565306191cd0 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.911+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x565306191cd0 0x5653065972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.911+0000 7fd7de7fc640 10 client.16587 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.911+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x565306191cd0 0x5653065972c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a5e67110e093344 server_cookie=f35c4551902889d2 in_seq=0 out_seq=0 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.912+0000 7fd7de7fc640 1 -- 172.21.15.33:0/1850064991 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653064ecfe0 con 0x565306191cd0 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.912+0000 7fd7de7fc640 10 client.16587 handle_command_reply: tid=0 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.912+0000 7fd80392d740 1 client.16587 shutdown 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.912+0000 7fd80392d740 1 -- 172.21.15.33:0/1850064991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061d3350 msgr2=0x565306591280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.912+0000 7fd80392d740 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061d3350 0x565306591280 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0011e60 tx=0x7fd7f0004a40 comp rx=0 tx=0).stop 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.913+0000 7fd80392d740 1 -- 172.21.15.33:0/1850064991 shutdown_connections 2024-08-28T19:35:56.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.913+0000 7fd80392d740 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x565306191cd0 0x5653065972c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.913+0000 7fd80392d740 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061d3350 0x565306591280 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.913+0000 7fd80392d740 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x5653065853f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.913+0000 7fd80392d740 1 --2- 172.21.15.33:0/1850064991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 0x565306584eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.913+0000 7fd80392d740 1 -- 172.21.15.33:0/1850064991 >> 172.21.15.33:0/1850064991 conn(0x5653061c7740 msgr2=0x56530657c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:56.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.913+0000 7fd7de7fc640 0 client.16587 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:56.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.913+0000 7fd80392d740 1 -- 172.21.15.33:0/1850064991 shutdown_connections 2024-08-28T19:35:56.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.913+0000 7fd80392d740 1 -- 172.21.15.33:0/1850064991 wait complete. 2024-08-28T19:35:56.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.913+0000 7fd80392d740 20 client.16587 trim_cache size 0 max 16384 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd80392d740 1 Processor -- start 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd80392d740 1 -- start start 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd80392d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 0x56530657aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd80392d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061b2670 0x565306591180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd80392d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061d3350 0x5653065820a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd80392d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81b0ba0 con 0x5653061b2670 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd80392d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81b26e0 con 0x5653061d3350 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd80392d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81b1270 con 0x5653061aa490 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd7effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061b2670 0x565306591180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd7effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061b2670 0x565306591180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39388/0 (socket says 172.21.15.33:39388) 2024-08-28T19:35:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd7effff640 1 -- 172.21.15.33:0/2351699903 learned_addr learned my addr 172.21.15.33:0/2351699903 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.931+0000 7fd7f77fe640 1 --2- 172.21.15.33:0/2351699903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061d3350 0x5653065820a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/2351699903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 0x56530657aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7effff640 1 -- 172.21.15.33:0/2351699903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 msgr2=0x56530657aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7effff640 1 --2- 172.21.15.33:0/2351699903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 0x56530657aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7effff640 1 -- 172.21.15.33:0/2351699903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061d3350 msgr2=0x5653065820a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7effff640 1 --2- 172.21.15.33:0/2351699903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061d3350 0x5653065820a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7effff640 1 -- 172.21.15.33:0/2351699903 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56530657ba70 con 0x5653061b2670 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/2351699903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 0x56530657aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7effff640 1 --2- 172.21.15.33:0/2351699903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061b2670 0x565306591180 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0006010 tx=0x7fd7e0036b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3b47a59ecf2432 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7ecff9640 1 -- 172.21.15.33:0/2351699903 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00cce60 con 0x5653061b2670 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7ecff9640 1 -- 172.21.15.33:0/2351699903 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7e00cb6f0 con 0x5653061b2670 2024-08-28T19:35:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.932+0000 7fd7ecff9640 1 -- 172.21.15.33:0/2351699903 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0049040 con 0x5653061b2670 2024-08-28T19:35:56.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.933+0000 7fd80392d740 1 -- 172.21.15.33:0/2351699903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061b2670 msgr2=0x565306591180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:56.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.933+0000 7fd80392d740 1 --2- 172.21.15.33:0/2351699903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061b2670 0x565306591180 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0006010 tx=0x7fd7e0036b60 comp rx=0 tx=0).stop 2024-08-28T19:35:56.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.933+0000 7fd80392d740 1 -- 172.21.15.33:0/2351699903 shutdown_connections 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.933+0000 7fd80392d740 1 --2- 172.21.15.33:0/2351699903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061d3350 0x5653065820a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.933+0000 7fd80392d740 1 --2- 172.21.15.33:0/2351699903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061b2670 0x565306591180 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.933+0000 7fd80392d740 1 --2- 172.21.15.33:0/2351699903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061aa490 0x56530657aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.933+0000 7fd80392d740 1 -- 172.21.15.33:0/2351699903 >> 172.21.15.33:0/2351699903 conn(0x5653061c7740 msgr2=0x56530657a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.933+0000 7fd80392d740 1 -- 172.21.15.33:0/2351699903 shutdown_connections 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.933+0000 7fd80392d740 1 -- 172.21.15.33:0/2351699903 wait complete. 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.933+0000 7fd80392d740 1 -- start start 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd80392d740 1 Processor -- start 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd80392d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306589470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd80392d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x5653065899b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd80392d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061d3350 0x565306589f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd80392d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81b2010 con 0x5653061aa490 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd80392d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81b1940 con 0x5653061b2670 2024-08-28T19:35:56.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd80392d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81aeb80 con 0x5653061d3350 2024-08-28T19:35:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd80392d740 10 client.0 _ll_register_callbacks cb 0x7fd7f0011d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7f6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306589470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7f6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306589470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39392/0 (socket says 172.21.15.33:39392) 2024-08-28T19:35:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7f6ffd640 1 -- 172.21.15.33:0/3533743230 learned_addr learned my addr 172.21.15.33:0/3533743230 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7f77fe640 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061d3350 0x565306589f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7effff640 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x5653065899b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7f6ffd640 1 -- 172.21.15.33:0/3533743230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061d3350 msgr2=0x565306589f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061d3350 0x565306589f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7f6ffd640 1 -- 172.21.15.33:0/3533743230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 msgr2=0x5653065899b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x5653065899b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7f6ffd640 1 -- 172.21.15.33:0/3533743230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565306605300 con 0x5653061aa490 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7effff640 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x5653065899b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7f6ffd640 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306589470 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009250 tx=0x7fd7e8009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f137479d06478c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.934+0000 7fd7de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd7de7fc640 1 -- 172.21.15.33:0/3533743230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8005450 con 0x5653061aa490 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd7de7fc640 1 -- 172.21.15.33:0/3533743230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd7e8005b90 con 0x5653061aa490 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd80392d740 1 -- 172.21.15.33:0/3533743230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7e00cb6f0 con 0x5653061aa490 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd7de7fc640 1 -- 172.21.15.33:0/3533743230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd7e8039050 con 0x5653061aa490 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd80392d740 10 client.16593 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd80392d740 1 -- 172.21.15.33:0/3533743230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565306606530 con 0x5653061aa490 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd7de7fc640 1 -- 172.21.15.33:0/3533743230 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7e00cb6f0 con 0x5653061aa490 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd7de7fc640 1 -- 172.21.15.33:0/3533743230 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd7e8019660 con 0x5653061aa490 2024-08-28T19:35:56.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd80392d740 10 client.16593 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:56.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd80392d740 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:56.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd80392d740 20 client.16593 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:56.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd80392d740 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x565306167080 0x565306608b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:56.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd80392d740 4 client.16593 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:35:56.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.935+0000 7fd80392d740 1 -- 172.21.15.33:0/3533743230 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5653064ea720 con 0x565306167080 2024-08-28T19:35:56.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.936+0000 7fd7effff640 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x565306167080 0x565306608b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:56.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.936+0000 7fd7de7fc640 10 client.16593 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:56.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.936+0000 7fd7effff640 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x565306167080 0x565306608b80 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deb3bbbad90869fb server_cookie=30e0a54c15866167 in_seq=0 out_seq=0 2024-08-28T19:35:56.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd7de7fc640 1 -- 172.21.15.33:0/3533743230 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5653064ea720 con 0x565306167080 2024-08-28T19:35:56.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd7de7fc640 10 client.16593 handle_command_reply: tid=0 2024-08-28T19:35:56.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 client.16593 shutdown 2024-08-28T19:35:56.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 -- 172.21.15.33:0/3533743230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 msgr2=0x565306589470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:56.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306589470 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009250 tx=0x7fd7e8009690 comp rx=0 tx=0).stop 2024-08-28T19:35:56.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 -- 172.21.15.33:0/3533743230 shutdown_connections 2024-08-28T19:35:56.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653061d3350 0x565306589f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653061b2670 0x5653065899b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x565306167080 0x565306608b80 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 --2- 172.21.15.33:0/3533743230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653061aa490 0x565306589470 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 -- 172.21.15.33:0/3533743230 >> 172.21.15.33:0/3533743230 conn(0x5653061c7740 msgr2=0x565306586360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:56.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd7de7fc640 0 client.16593 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:56.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 -- 172.21.15.33:0/3533743230 shutdown_connections 2024-08-28T19:35:56.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 1 -- 172.21.15.33:0/3533743230 wait complete. 2024-08-28T19:35:56.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.938+0000 7fd80392d740 20 client.16593 trim_cache size 0 max 16384 2024-08-28T19:35:56.944 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:35:56.945 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:35:56.945 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "cdd402b6-fb58-45b1-9ec1-948fff4a2068", 2024-08-28T19:35:56.945 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:35:56.945 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:35:56.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/18643977 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd7e40b4d20 msgr2=0x7fd7e40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd7e40b4d20 0x7fd7e40b7230 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0005c40 tx=0x7fd7f0009500 comp rx=0 tx=0).stop 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/18643977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f81081c0 msgr2=0x7fd7f819b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f81081c0 0x7fd7f819b590 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd7e002a930 tx=0x7fd7e0031a20 comp rx=0 tx=0).stop 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/18643977 shutdown_connections 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f8108b10 0x7fd7f819bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f81081c0 0x7fd7f819b590 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd7e40b4d20 0x7fd7e40b7230 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 --2- 172.21.15.33:0/18643977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7f8102880 0x7fd7f819b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/18643977 >> 172.21.15.33:0/18643977 conn(0x7fd7f8079510 msgr2=0x7fd7f8106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/18643977 shutdown_connections 2024-08-28T19:35:56.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:56.939+0000 7fd7fd3b8640 1 -- 172.21.15.33:0/18643977 wait complete. 2024-08-28T19:35:57.132 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:56 smithi033 ceph-mon[18549]: pgmap v447: 129 pgs: 129 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 14 op/s 2024-08-28T19:35:57.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:56 smithi059 ceph-mon[22052]: pgmap v447: 129 pgs: 129 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 14 op/s 2024-08-28T19:35:57.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:56 smithi122 ceph-mon[22174]: pgmap v447: 129 pgs: 129 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 14 op/s 2024-08-28T19:35:57.698 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:35:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:35:58.242 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:57 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:35:58.242 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:57 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:58.242 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:57 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:35:58.242 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:57 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:58.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:57 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:35:58.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:57 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:58.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:57 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:35:58.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:57 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:58.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:57 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:35:58.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:57 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:58.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:57 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:35:58.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:57 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:35:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.454+0000 7f53f8d63640 1 -- 172.21.15.33:0/2291581821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f4103900 msgr2=0x7f53f4103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.454+0000 7f53f8d63640 1 --2- 172.21.15.33:0/2291581821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f4103900 0x7f53f4103d10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009ca0 tx=0x7f53e402a8e0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.454+0000 7f53f8d63640 1 -- 172.21.15.33:0/2291581821 shutdown_connections 2024-08-28T19:35:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.454+0000 7f53f8d63640 1 --2- 172.21.15.33:0/2291581821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f4109b90 0x7f53f41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.454+0000 7f53f8d63640 1 --2- 172.21.15.33:0/2291581821 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53f4109240 0x7f53f4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.454+0000 7f53f8d63640 1 --2- 172.21.15.33:0/2291581821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f4103900 0x7f53f4103d10 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.454+0000 7f53f8d63640 1 -- 172.21.15.33:0/2291581821 >> 172.21.15.33:0/2291581821 conn(0x7f53f407b5f0 msgr2=0x7f53f407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.454+0000 7f53f8d63640 1 -- 172.21.15.33:0/2291581821 shutdown_connections 2024-08-28T19:35:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.454+0000 7f53f8d63640 1 -- 172.21.15.33:0/2291581821 wait complete. 2024-08-28T19:35:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f8d63640 1 Processor -- start 2024-08-28T19:35:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f8d63640 1 -- start start 2024-08-28T19:35:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f8d63640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f4103900 0x7f53f419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f8d63640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53f4109240 0x7f53f419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f8d63640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f4109b90 0x7f53f419fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f8d63640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4113890 con 0x7f53f4103900 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f8d63640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4113710 con 0x7f53f4109b90 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f8d63640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4113a10 con 0x7f53f4109240 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f4103900 0x7f53f419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f4103900 0x7f53f419a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50820/0 (socket says 172.21.15.33:50820) 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f259c640 1 -- 172.21.15.33:0/1367802642 learned_addr learned my addr 172.21.15.33:0/1367802642 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.455+0000 7f53f1d9b640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53f4109240 0x7f53f419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f4109b90 0x7f53f419fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53f259c640 1 -- 172.21.15.33:0/1367802642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53f4109240 msgr2=0x7f53f419a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53f259c640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53f4109240 0x7f53f419a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53f259c640 1 -- 172.21.15.33:0/1367802642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f4109b90 msgr2=0x7f53f419fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53f259c640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f4109b90 0x7f53f419fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53f259c640 1 -- 172.21.15.33:0/1367802642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f41a0150 con 0x7f53f4103900 2024-08-28T19:35:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53f1d9b640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53f4109240 0x7f53f419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53f259c640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f4103900 0x7f53f419a2a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f53e402ae00 tx=0x7f53e4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53eb7fe640 1 -- 172.21.15.33:0/1367802642 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4004240 con 0x7f53f4103900 2024-08-28T19:35:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53eb7fe640 1 -- 172.21.15.33:0/1367802642 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53e4003e50 con 0x7f53f4103900 2024-08-28T19:35:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53f8d63640 1 -- 172.21.15.33:0/1367802642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f41a03e0 con 0x7f53f4103900 2024-08-28T19:35:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53eb7fe640 1 -- 172.21.15.33:0/1367802642 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e403a400 con 0x7f53f4103900 2024-08-28T19:35:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.456+0000 7f53f8d63640 1 -- 172.21.15.33:0/1367802642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f4075390 con 0x7f53f4103900 2024-08-28T19:35:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.459+0000 7f53eb7fe640 1 -- 172.21.15.33:0/1367802642 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f53e40305e0 con 0x7f53f4103900 2024-08-28T19:35:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53ff2d8740 1 Processor -- start 2024-08-28T19:35:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53ff2d8740 1 -- start start 2024-08-28T19:35:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b402c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b40800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 0x555c60b40d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555c60ab7630 con 0x555c6079b070 2024-08-28T19:35:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555c60aa6bc0 con 0x555c6077a390 2024-08-28T19:35:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555c60aaab70 con 0x555c607721b0 2024-08-28T19:35:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53eb7fe640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f53e00b4cd0 0x7f53e00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53f2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53f2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50830/0 (socket says 172.21.15.33:50830) 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53f2d9d640 1 -- 172.21.15.33:0/3556997125 learned_addr learned my addr 172.21.15.33:0/3556997125 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f53e00b4cd0 0x7f53e00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.460+0000 7f53f1d9b640 1 --2- 172.21.15.33:0/3556997125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 0x555c60b40d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53eb7fe640 1 -- 172.21.15.33:0/1367802642 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f53e4106fa0 con 0x7f53f4103900 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53f259c640 1 --2- 172.21.15.33:0/3556997125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b40800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53f2d9d640 1 -- 172.21.15.33:0/3556997125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 msgr2=0x555c60b40800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/3556997125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b40800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53f2d9d640 1 -- 172.21.15.33:0/3556997125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 msgr2=0x555c60b40d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/3556997125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 0x555c60b40d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53f2d9d640 1 -- 172.21.15.33:0/3556997125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c60806650 con 0x555c6079b070 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f53e00b4cd0 0x7f53e00b71e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f53ec013990 tx=0x7f53ec00b740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/3556997125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b402c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f53ec010c90 tx=0x7f53ec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919d8efab7b7e4d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53e8ff9640 1 -- 172.21.15.33:0/3556997125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec023070 con 0x555c6079b070 2024-08-28T19:35:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53e8ff9640 1 -- 172.21.15.33:0/3556997125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53ec00ba10 con 0x555c6079b070 2024-08-28T19:35:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.461+0000 7f53e8ff9640 1 -- 172.21.15.33:0/3556997125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0049e0 con 0x555c6079b070 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.462+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3556997125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 msgr2=0x555c60b402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.462+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/3556997125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b402c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f53ec010c90 tx=0x7f53ec01a000 comp rx=0 tx=0).stop 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.462+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3556997125 shutdown_connections 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.462+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/3556997125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 0x555c60b40d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.462+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/3556997125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b40800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.462+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/3556997125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b402c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.462+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3556997125 >> 172.21.15.33:0/3556997125 conn(0x555c6078f460 msgr2=0x555c60b3e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.462+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3556997125 shutdown_connections 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.462+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3556997125 wait complete. 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53ff2d8740 1 -- start start 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53ff2d8740 1 Processor -- start 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b4bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 0x555c60b4c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b57d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555c60909700 con 0x555c6079b070 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555c60a2d700 con 0x555c6077a390 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555c60b4ea40 con 0x555c607721b0 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53ff2d8740 10 client.0 _ll_register_callbacks cb 0x555c60a5cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53f2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b57d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53f2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b57d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50846/0 (socket says 172.21.15.33:50846) 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53f2d9d640 1 -- 172.21.15.33:0/3564845609 learned_addr learned my addr 172.21.15.33:0/3564845609 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.463+0000 7f53f1d9b640 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 0x555c60b4c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53f259c640 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b4bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53f2d9d640 1 -- 172.21.15.33:0/3564845609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 msgr2=0x555c60b4bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b4bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53f2d9d640 1 -- 172.21.15.33:0/3564845609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 msgr2=0x555c60b4c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 0x555c60b4c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53f2d9d640 1 -- 172.21.15.33:0/3564845609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c60a668b0 con 0x555c6079b070 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53f1d9b640 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 0x555c60b4c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b57d80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0056c0 tx=0x7f53ec00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246b395665563d83 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53d9ffb640 1 -- 172.21.15.33:0/3564845609 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec034060 con 0x555c6079b070 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53d9ffb640 1 -- 172.21.15.33:0/3564845609 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f53ec01f830 con 0x555c6079b070 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3564845609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c60ab9580 con 0x555c6079b070 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53d9ffb640 1 -- 172.21.15.33:0/3564845609 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53ec03b050 con 0x555c6079b070 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53ff2d8740 10 client.16605 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3564845609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c60b5a8f0 con 0x555c6079b070 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.464+0000 7f53d9ffb640 1 -- 172.21.15.33:0/3564845609 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555c60ab9580 con 0x555c6079b070 2024-08-28T19:35:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.465+0000 7f53d9ffb640 1 -- 172.21.15.33:0/3564845609 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f53ec027910 con 0x555c6079b070 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.465+0000 7f53ff2d8740 10 client.16605 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.465+0000 7f53ff2d8740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.465+0000 7f53ff2d8740 20 client.16605 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.465+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555c607599f0 0x555c60b5dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.465+0000 7f53ff2d8740 4 client.16605 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.465+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3564845609 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c60ab5020 con 0x555c607599f0 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.465+0000 7f53f259c640 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555c607599f0 0x555c60b5dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.465+0000 7f53f259c640 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555c607599f0 0x555c60b5dd60 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=631677e123d877ec server_cookie=cc757965b7176a0d in_seq=0 out_seq=0 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.465+0000 7f53d9ffb640 10 client.16605 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53d9ffb640 1 -- 172.21.15.33:0/3564845609 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c60ab5020 con 0x555c607599f0 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53d9ffb640 10 client.16605 handle_command_reply: tid=0 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53ff2d8740 1 client.16605 shutdown 2024-08-28T19:35:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3564845609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 msgr2=0x555c60b57d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b57d80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0056c0 tx=0x7f53ec00ee90 comp rx=0 tx=0).stop 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3564845609 shutdown_connections 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555c607599f0 0x555c60b5dd60 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53d9ffb640 0 client.16605 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6079b070 0x555c60b57d80 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c6077a390 0x555c60b4c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.466+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/3564845609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b4bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.467+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3564845609 >> 172.21.15.33:0/3564845609 conn(0x555c6078f460 msgr2=0x555c60b434a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.467+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3564845609 shutdown_connections 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.467+0000 7f53ff2d8740 1 -- 172.21.15.33:0/3564845609 wait complete. 2024-08-28T19:35:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.467+0000 7f53ff2d8740 20 client.16605 trim_cache size 0 max 16384 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.484+0000 7f53ff2d8740 1 Processor -- start 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.484+0000 7f53ff2d8740 1 -- start start 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.484+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c607599f0 0x555c60b41a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.484+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c607721b0 0x555c60b57cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.484+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c6077a390 0x555c60b58230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.484+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f53f41b2cd0 con 0x555c607599f0 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.484+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53f41b4810 con 0x555c607721b0 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.484+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f53f41b33a0 con 0x555c6077a390 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53f259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c607599f0 0x555c60b41a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53f259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c607599f0 0x555c60b41a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50856/0 (socket says 172.21.15.33:50856) 2024-08-28T19:35:58.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53f259c640 1 -- 172.21.15.33:0/827897757 learned_addr learned my addr 172.21.15.33:0/827897757 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53f1d9b640 1 --2- 172.21.15.33:0/827897757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c607721b0 0x555c60b57cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53f259c640 1 -- 172.21.15.33:0/827897757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c6077a390 msgr2=0x555c60b58230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53f259c640 1 --2- 172.21.15.33:0/827897757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c6077a390 0x555c60b58230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53f259c640 1 -- 172.21.15.33:0/827897757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c607721b0 msgr2=0x555c60b57cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53f259c640 1 --2- 172.21.15.33:0/827897757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c607721b0 0x555c60b57cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53f259c640 1 -- 172.21.15.33:0/827897757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c60b4cd70 con 0x555c607599f0 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53f259c640 1 --2- 172.21.15.33:0/827897757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c607599f0 0x555c60b41a00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f53e40cd270 tx=0x7f53e40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947d9b4732c96d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53dbfff640 1 -- 172.21.15.33:0/827897757 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e40cd9e0 con 0x555c607599f0 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53dbfff640 1 -- 172.21.15.33:0/827897757 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53e4036040 con 0x555c607599f0 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.485+0000 7f53dbfff640 1 -- 172.21.15.33:0/827897757 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e41045c0 con 0x555c607599f0 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.486+0000 7f53ff2d8740 1 -- 172.21.15.33:0/827897757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c607599f0 msgr2=0x555c60b41a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.486+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/827897757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c607599f0 0x555c60b41a00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f53e40cd270 tx=0x7f53e40095c0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.486+0000 7f53ff2d8740 1 -- 172.21.15.33:0/827897757 shutdown_connections 2024-08-28T19:35:58.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.486+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/827897757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c6077a390 0x555c60b58230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.486+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/827897757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c607721b0 0x555c60b57cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.486+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/827897757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c607599f0 0x555c60b41a00 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.486+0000 7f53ff2d8740 1 -- 172.21.15.33:0/827897757 >> 172.21.15.33:0/827897757 conn(0x555c6078f460 msgr2=0x555c60b412f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:58.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.486+0000 7f53ff2d8740 1 -- 172.21.15.33:0/827897757 shutdown_connections 2024-08-28T19:35:58.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.486+0000 7f53ff2d8740 1 -- 172.21.15.33:0/827897757 wait complete. 2024-08-28T19:35:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53ff2d8740 1 -- start start 2024-08-28T19:35:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53ff2d8740 1 Processor -- start 2024-08-28T19:35:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c607599f0 0x555c60b5f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b5f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53ff2d8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6077a390 0x555c60bc74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f53f41b4140 con 0x555c6077a390 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53f41b3a70 con 0x555c607599f0 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53ff2d8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f53f41b0cb0 con 0x555c607721b0 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53ff2d8740 10 client.0 _ll_register_callbacks cb 0x7f53dc0071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53f2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6077a390 0x555c60bc74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53f2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6077a390 0x555c60bc74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50872/0 (socket says 172.21.15.33:50872) 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53f2d9d640 1 -- 172.21.15.33:0/1860745417 learned_addr learned my addr 172.21.15.33:0/1860745417 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53f1d9b640 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b5f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53f259c640 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c607599f0 0x555c60b5f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53f2d9d640 1 -- 172.21.15.33:0/1860745417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 msgr2=0x555c60b5f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b5f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53f2d9d640 1 -- 172.21.15.33:0/1860745417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c607599f0 msgr2=0x555c60b5f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.487+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c607599f0 0x555c60b5f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53f2d9d640 1 -- 172.21.15.33:0/1860745417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c60bc7a20 con 0x555c6077a390 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53f2d9d640 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6077a390 0x555c60bc74e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f53ec006010 tx=0x7f53ec013640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f32880dc05ca8f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53d9ffb640 1 -- 172.21.15.33:0/1860745417 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec043070 con 0x555c6077a390 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53d9ffb640 1 -- 172.21.15.33:0/1860745417 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f53ec027610 con 0x555c6077a390 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53ff2d8740 1 -- 172.21.15.33:0/1860745417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53e4036040 con 0x555c6077a390 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53d9ffb640 1 -- 172.21.15.33:0/1860745417 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53ec034040 con 0x555c6077a390 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53ff2d8740 10 client.16611 fetch_fsmap learned FSMap version 28 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53ff2d8740 1 -- 172.21.15.33:0/1860745417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c60bc8b60 con 0x555c6077a390 2024-08-28T19:35:58.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53d9ffb640 1 -- 172.21.15.33:0/1860745417 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53e4036040 con 0x555c6077a390 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.488+0000 7f53d9ffb640 1 -- 172.21.15.33:0/1860745417 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f53ec01fb70 con 0x555c6077a390 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53ff2d8740 10 client.16611 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53ff2d8740 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53ff2d8740 20 client.16611 populate_metadata read hostname 'smithi033' 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555c6079b070 0x555c60bcb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53ff2d8740 4 client.16611 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53ff2d8740 1 -- 172.21.15.33:0/1860745417 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c60ab2760 con 0x555c6079b070 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53f259c640 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555c6079b070 0x555c60bcb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53d9ffb640 10 client.16611 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53f259c640 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555c6079b070 0x555c60bcb200 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57cc6e3ffd83ff28 server_cookie=92c6785efcf9ca8f in_seq=0 out_seq=0 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53d9ffb640 1 -- 172.21.15.33:0/1860745417 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x555c60ab2760 con 0x555c6079b070 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53d9ffb640 10 client.16611 handle_command_reply: tid=0 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.489+0000 7f53ff2d8740 1 client.16611 shutdown 2024-08-28T19:35:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 1 -- 172.21.15.33:0/1860745417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6077a390 msgr2=0x555c60bc74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6077a390 0x555c60bc74e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f53ec006010 tx=0x7f53ec013640 comp rx=0 tx=0).stop 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 1 -- 172.21.15.33:0/1860745417 shutdown_connections 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555c6079b070 0x555c60bcb200 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555c6077a390 0x555c60bc74e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555c607721b0 0x555c60b5f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 1 --2- 172.21.15.33:0/1860745417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c607599f0 0x555c60b5f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 1 -- 172.21.15.33:0/1860745417 >> 172.21.15.33:0/1860745417 conn(0x555c6078f460 msgr2=0x555c60b43b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53d9ffb640 0 client.16611 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 1 -- 172.21.15.33:0/1860745417 shutdown_connections 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 1 -- 172.21.15.33:0/1860745417 wait complete. 2024-08-28T19:35:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.490+0000 7f53ff2d8740 20 client.16611 trim_cache size 0 max 16384 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "cdd402b6-fb58-45b1-9ec1-948fff4a2068", 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:35:58.498 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:58.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:58.500 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:35:58.501 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:35:58.502 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:35:58.502 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:35:58.502 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:58.502 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:35:58.502 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:35:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 -- 172.21.15.33:0/1367802642 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f53e00b4cd0 msgr2=0x7f53e00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f53e00b4cd0 0x7f53e00b71e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f53ec013990 tx=0x7f53ec00b740 comp rx=0 tx=0).stop 2024-08-28T19:35:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 -- 172.21.15.33:0/1367802642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f4103900 msgr2=0x7f53f419a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:35:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f4103900 0x7f53f419a2a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f53e402ae00 tx=0x7f53e4003ba0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 -- 172.21.15.33:0/1367802642 shutdown_connections 2024-08-28T19:35:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f4109b90 0x7f53f419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f53e00b4cd0 0x7f53e00b71e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f53f4109240 0x7f53f419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 --2- 172.21.15.33:0/1367802642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f4103900 0x7f53f419a2a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:35:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 -- 172.21.15.33:0/1367802642 >> 172.21.15.33:0/1367802642 conn(0x7f53f407b5f0 msgr2=0x7f53f41072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:35:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 -- 172.21.15.33:0/1367802642 shutdown_connections 2024-08-28T19:35:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:35:58.491+0000 7f53f8d63640 1 -- 172.21.15.33:0/1367802642 wait complete. 2024-08-28T19:35:59.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:58 smithi033 ceph-mon[18549]: pgmap v448: 129 pgs: 129 active+clean; 3.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 17 op/s 2024-08-28T19:35:59.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:58 smithi059 ceph-mon[22052]: pgmap v448: 129 pgs: 129 active+clean; 3.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 17 op/s 2024-08-28T19:35:59.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:58 smithi122 ceph-mon[22174]: pgmap v448: 129 pgs: 129 active+clean; 3.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 17 op/s 2024-08-28T19:35:59.410 INFO:tasks.cephfs.filesystem:scrub status for tag:cdd402b6-fb58-45b1-9ec1-948fff4a2068 - {'path': '/', 'tag': 'cdd402b6-fb58-45b1-9ec1-948fff4a2068', 'options': 'recursive,force'} 2024-08-28T19:36:00.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:35:59 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:36:00.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:35:59 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:36:00.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:35:59 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:36:01.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:00 smithi059 ceph-mon[22052]: pgmap v449: 129 pgs: 129 active+clean; 3.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-28T19:36:01.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:00 smithi122 ceph-mon[22174]: pgmap v449: 129 pgs: 129 active+clean; 3.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-28T19:36:01.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:00 smithi033 ceph-mon[18549]: pgmap v449: 129 pgs: 129 active+clean; 3.5 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-28T19:36:03.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:02 smithi059 ceph-mon[22052]: pgmap v450: 129 pgs: 129 active+clean; 3.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-08-28T19:36:03.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:02 smithi122 ceph-mon[22174]: pgmap v450: 129 pgs: 129 active+clean; 3.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-08-28T19:36:03.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:02 smithi033 ceph-mon[18549]: pgmap v450: 129 pgs: 129 active+clean; 3.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-08-28T19:36:05.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:04 smithi059 ceph-mon[22052]: pgmap v451: 129 pgs: 129 active+clean; 3.6 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 33 op/s 2024-08-28T19:36:05.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:04 smithi122 ceph-mon[22174]: pgmap v451: 129 pgs: 129 active+clean; 3.6 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 33 op/s 2024-08-28T19:36:05.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:04 smithi033 ceph-mon[18549]: pgmap v451: 129 pgs: 129 active+clean; 3.6 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 33 op/s 2024-08-28T19:36:07.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:06 smithi059 ceph-mon[22052]: pgmap v452: 129 pgs: 129 active+clean; 3.6 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-08-28T19:36:07.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:06 smithi122 ceph-mon[22174]: pgmap v452: 129 pgs: 129 active+clean; 3.6 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-08-28T19:36:07.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:06 smithi033 ceph-mon[18549]: pgmap v452: 129 pgs: 129 active+clean; 3.6 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-08-28T19:36:09.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:08 smithi059 ceph-mon[22052]: pgmap v453: 129 pgs: 129 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 32 op/s 2024-08-28T19:36:09.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:08 smithi122 ceph-mon[22174]: pgmap v453: 129 pgs: 129 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 32 op/s 2024-08-28T19:36:09.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:08 smithi033 ceph-mon[18549]: pgmap v453: 129 pgs: 129 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 32 op/s 2024-08-28T19:36:11.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:10 smithi059 ceph-mon[22052]: pgmap v454: 129 pgs: 129 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 29 op/s 2024-08-28T19:36:11.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:10 smithi122 ceph-mon[22174]: pgmap v454: 129 pgs: 129 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 29 op/s 2024-08-28T19:36:11.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:10 smithi033 ceph-mon[18549]: pgmap v454: 129 pgs: 129 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 29 op/s 2024-08-28T19:36:12.519 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.0 2024-08-28T19:36:12.519 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:36:12.787 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:13.189 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:12 smithi033 ceph-mon[18549]: pgmap v455: 129 pgs: 129 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-08-28T19:36:13.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:12 smithi059 ceph-mon[22052]: pgmap v455: 129 pgs: 129 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-08-28T19:36:13.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:12 smithi122 ceph-mon[22174]: pgmap v455: 129 pgs: 129 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-08-28T19:36:13.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.279+0000 7f153e486640 1 -- 172.21.15.33:0/914919466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1538109240 msgr2=0x7f1538109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:13.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.279+0000 7f153e486640 1 --2- 172.21.15.33:0/914919466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1538109240 0x7f1538109650 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f152c009900 tx=0x7f152c02a410 comp rx=0 tx=0).stop 2024-08-28T19:36:13.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.279+0000 7f153e486640 1 -- 172.21.15.33:0/914919466 shutdown_connections 2024-08-28T19:36:13.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.279+0000 7f153e486640 1 --2- 172.21.15.33:0/914919466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538109b90 0x7f15381103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:13.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.279+0000 7f153e486640 1 --2- 172.21.15.33:0/914919466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1538109240 0x7f1538109650 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:13.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.279+0000 7f153e486640 1 --2- 172.21.15.33:0/914919466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1538103900 0x7f1538103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:13.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.279+0000 7f153e486640 1 -- 172.21.15.33:0/914919466 >> 172.21.15.33:0/914919466 conn(0x7f153807b5f0 msgr2=0x7f153807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:13.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.279+0000 7f153e486640 1 -- 172.21.15.33:0/914919466 shutdown_connections 2024-08-28T19:36:13.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.279+0000 7f153e486640 1 -- 172.21.15.33:0/914919466 wait complete. 2024-08-28T19:36:13.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153e486640 1 Processor -- start 2024-08-28T19:36:13.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153e486640 1 -- start start 2024-08-28T19:36:13.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153e486640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1538103900 0x7f153819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:13.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153e486640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538109240 0x7f153819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:13.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153e486640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1538109b90 0x7f153819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153e486640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1538113850 con 0x7f1538109b90 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153e486640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f15381136d0 con 0x7f1538109240 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153e486640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f15381139d0 con 0x7f1538103900 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153ca23640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1538109b90 0x7f153819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153ca23640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1538109b90 0x7f153819fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39706/0 (socket says 172.21.15.33:39706) 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f153ca23640 1 -- 172.21.15.33:0/3192251544 learned_addr learned my addr 172.21.15.33:0/3192251544 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f15377fe640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538109240 0x7f153819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.280+0000 7f1537fff640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1538103900 0x7f153819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f153ca23640 1 -- 172.21.15.33:0/3192251544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1538103900 msgr2=0x7f153819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f153ca23640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1538103900 0x7f153819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f153ca23640 1 -- 172.21.15.33:0/3192251544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538109240 msgr2=0x7f153819a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:13.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f153ca23640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538109240 0x7f153819a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f153ca23640 1 -- 172.21.15.33:0/3192251544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15381a0130 con 0x7f1538109b90 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f15377fe640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538109240 0x7f153819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f153ca23640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1538109b90 0x7f153819fac0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1530009fd0 tx=0x7f153000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f15357fa640 1 -- 172.21.15.33:0/3192251544 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530017070 con 0x7f1538109b90 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f153e486640 1 -- 172.21.15.33:0/3192251544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15381a0420 con 0x7f1538109b90 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f15357fa640 1 -- 172.21.15.33:0/3192251544 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1530003e20 con 0x7f1538109b90 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f15357fa640 1 -- 172.21.15.33:0/3192251544 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530010460 con 0x7f1538109b90 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.281+0000 7f153e486640 1 -- 172.21.15.33:0/3192251544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15381a6c40 con 0x7f1538109b90 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.282+0000 7f153e486640 1 -- 172.21.15.33:0/3192251544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1538104b80 con 0x7f1538109b90 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.283+0000 7f15357fa640 1 -- 172.21.15.33:0/3192251544 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1530003970 con 0x7f1538109b90 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.284+0000 7f15357fa640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15200b4cd0 0x7f15200b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.284+0000 7f1537fff640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15200b4cd0 0x7f15200b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.284+0000 7f15357fa640 1 -- 172.21.15.33:0/3192251544 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f15300e56c0 con 0x7f1538109b90 2024-08-28T19:36:13.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.285+0000 7f1537fff640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15200b4cd0 0x7f15200b71e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1528005e10 tx=0x7f1528005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:13.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.287+0000 7f15357fa640 1 -- 172.21.15.33:0/3192251544 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f15300ac160 con 0x7f1538109b90 2024-08-28T19:36:13.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.510+0000 7f153e486640 1 -- 172.21.15.33:0/3192251544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f153810b980 con 0x7f1538109b90 2024-08-28T19:36:13.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.511+0000 7f15357fa640 1 -- 172.21.15.33:0/3192251544 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f15300aba60 con 0x7f1538109b90 2024-08-28T19:36:13.512 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:36:13.513 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:36:13.513 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 -- 172.21.15.33:0/3192251544 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15200b4cd0 msgr2=0x7f15200b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15200b4cd0 0x7f15200b71e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1528005e10 tx=0x7f1528005da0 comp rx=0 tx=0).stop 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 -- 172.21.15.33:0/3192251544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1538109b90 msgr2=0x7f153819fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1538109b90 0x7f153819fac0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1530009fd0 tx=0x7f153000b260 comp rx=0 tx=0).stop 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 -- 172.21.15.33:0/3192251544 shutdown_connections 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1538109b90 0x7f153819fac0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1538109240 0x7f153819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f15200b4cd0 0x7f15200b71e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 --2- 172.21.15.33:0/3192251544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1538103900 0x7f153819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 -- 172.21.15.33:0/3192251544 >> 172.21.15.33:0/3192251544 conn(0x7f153807b5f0 msgr2=0x7f1538107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 -- 172.21.15.33:0/3192251544 shutdown_connections 2024-08-28T19:36:13.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:13.514+0000 7f153e486640 1 -- 172.21.15.33:0/3192251544 wait complete. 2024-08-28T19:36:14.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:13 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3192251544' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:14.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:13 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3192251544' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:14.295 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:13 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3192251544' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:14.325 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 147.0 --await-for 45.0' 2024-08-28T19:36:14.326 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 147.0 --await-for 45.0 2024-08-28T19:36:14.580 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:14.982 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:14 smithi033 ceph-mon[18549]: pgmap v456: 129 pgs: 129 active+clean; 3.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-08-28T19:36:15.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.082+0000 7f16f9889640 1 -- 172.21.15.33:0/1859641231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f4103040 msgr2=0x7f16f4103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.082+0000 7f16f9889640 1 --2- 172.21.15.33:0/1859641231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f4103040 0x7f16f4103450 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009900 tx=0x7f16e402a410 comp rx=0 tx=0).stop 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.082+0000 7f16f9889640 1 -- 172.21.15.33:0/1859641231 shutdown_connections 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.082+0000 7f16f9889640 1 --2- 172.21.15.33:0/1859641231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f4108af0 0x7f16f410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.082+0000 7f16f9889640 1 --2- 172.21.15.33:0/1859641231 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16f41081a0 0x7f16f41085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.082+0000 7f16f9889640 1 --2- 172.21.15.33:0/1859641231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f4103040 0x7f16f4103450 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.082+0000 7f16f9889640 1 -- 172.21.15.33:0/1859641231 >> 172.21.15.33:0/1859641231 conn(0x7f16f4079d70 msgr2=0x7f16f407a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.082+0000 7f16f9889640 1 -- 172.21.15.33:0/1859641231 shutdown_connections 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.082+0000 7f16f9889640 1 -- 172.21.15.33:0/1859641231 wait complete. 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f9889640 1 Processor -- start 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f9889640 1 -- start start 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f9889640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f4103040 0x7f16f4198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f9889640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16f41081a0 0x7f16f41993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f9889640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f4108af0 0x7f16f4199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f9889640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f16f4112770 con 0x7f16f4103040 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f9889640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41125f0 con 0x7f16f4108af0 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f9889640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41128f0 con 0x7f16f41081a0 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f4103040 0x7f16f4198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f4103040 0x7f16f4198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39730/0 (socket says 172.21.15.33:39730) 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f2ffd640 1 -- 172.21.15.33:0/2159751308 learned_addr learned my addr 172.21.15.33:0/2159751308 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.083+0000 7f16f27fc640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16f41081a0 0x7f16f41993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f37fe640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f4108af0 0x7f16f4199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f2ffd640 1 -- 172.21.15.33:0/2159751308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16f41081a0 msgr2=0x7f16f41993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16f41081a0 0x7f16f41993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f2ffd640 1 -- 172.21.15.33:0/2159751308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f4108af0 msgr2=0x7f16f4199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f4108af0 0x7f16f4199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f2ffd640 1 -- 172.21.15.33:0/2159751308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f41a8560 con 0x7f16f4103040 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f37fe640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f4108af0 0x7f16f4199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f4103040 0x7f16f4198eb0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f16e4006010 tx=0x7f16e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f8887640 1 -- 172.21.15.33:0/2159751308 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e403f030 con 0x7f16f4103040 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f8887640 1 -- 172.21.15.33:0/2159751308 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16e4003cb0 con 0x7f16f4103040 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f9889640 1 -- 172.21.15.33:0/2159751308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f41a87f0 con 0x7f16f4103040 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f8887640 1 -- 172.21.15.33:0/2159751308 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4035070 con 0x7f16f4103040 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.084+0000 7f16f9889640 1 -- 172.21.15.33:0/2159751308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f41a8cd0 con 0x7f16f4103040 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16ffdfe740 1 Processor -- start 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16ffdfe740 1 -- start start 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16f8887640 1 -- 172.21.15.33:0/2159751308 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f16e4042030 con 0x7f16f4103040 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa90840 0x55d8cfe37c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe381d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe38710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d8cfdac330 con 0x55d8cfa67980 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d8cfd9b8c0 con 0x55d8cfa90840 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d8cfd9f870 con 0x55d8cfa6fb60 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16f2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16f2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe381d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39734/0 (socket says 172.21.15.33:39734) 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16f2ffd640 1 -- 172.21.15.33:0/542459867 learned_addr learned my addr 172.21.15.33:0/542459867 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16f27fc640 1 --2- 172.21.15.33:0/542459867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe38710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.087+0000 7f16f37fe640 1 --2- 172.21.15.33:0/542459867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa90840 0x55d8cfe37c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16f2ffd640 1 -- 172.21.15.33:0/542459867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa6fb60 msgr2=0x55d8cfe38710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/542459867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe38710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16f2ffd640 1 -- 172.21.15.33:0/542459867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa90840 msgr2=0x55d8cfe37c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/542459867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa90840 0x55d8cfe37c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16f2ffd640 1 -- 172.21.15.33:0/542459867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8cfd53df0 con 0x55d8cfa67980 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16f8887640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16dc0b4ca0 0x7f16dc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16f37fe640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16dc0b4ca0 0x7f16dc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/542459867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe381d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f16e4103130 tx=0x7f16e410e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b431d455962bcdc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16f8887640 1 -- 172.21.15.33:0/2159751308 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f16e4105dc0 con 0x7f16f4103040 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16d9ffb640 1 -- 172.21.15.33:0/542459867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4049020 con 0x55d8cfa67980 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16d9ffb640 1 -- 172.21.15.33:0/542459867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16e40cbc70 con 0x55d8cfa67980 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.088+0000 7f16d9ffb640 1 -- 172.21.15.33:0/542459867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e40cbf30 con 0x55d8cfa67980 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.089+0000 7f16ffdfe740 1 -- 172.21.15.33:0/542459867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 msgr2=0x55d8cfe381d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.089+0000 7f16f37fe640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16dc0b4ca0 0x7f16dc0b71b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f16ec005fd0 tx=0x7f16ec009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.089+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/542459867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe381d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f16e4103130 tx=0x7f16e410e0e0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.089+0000 7f16ffdfe740 1 -- 172.21.15.33:0/542459867 shutdown_connections 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.089+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/542459867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe38710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.089+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/542459867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe381d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.089+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/542459867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa90840 0x55d8cfe37c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.089+0000 7f16ffdfe740 1 -- 172.21.15.33:0/542459867 >> 172.21.15.33:0/542459867 conn(0x55d8cfa84990 msgr2=0x55d8cfe35b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.089+0000 7f16ffdfe740 1 -- 172.21.15.33:0/542459867 shutdown_connections 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.089+0000 7f16ffdfe740 1 -- 172.21.15.33:0/542459867 wait complete. 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16ffdfe740 1 -- start start 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16ffdfe740 1 Processor -- start 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa67980 0x55d8cfe43440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe43980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa90840 0x55d8cfe4f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d8cfbfe7a0 con 0x55d8cfa90840 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d8cfd22240 con 0x55d8cfa6fb60 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d8cfe46230 con 0x55d8cfa67980 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16ffdfe740 10 client.0 _ll_register_callbacks cb 0x55d8cfaa8090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16f37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa90840 0x55d8cfe4f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16f37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa90840 0x55d8cfe4f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39736/0 (socket says 172.21.15.33:39736) 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.090+0000 7f16f37fe640 1 -- 172.21.15.33:0/3826734208 learned_addr learned my addr 172.21.15.33:0/3826734208 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa67980 0x55d8cfe43440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16f27fc640 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe43980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16f37fe640 1 -- 172.21.15.33:0/3826734208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa67980 msgr2=0x55d8cfe43440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16f37fe640 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa67980 0x55d8cfe43440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16f37fe640 1 -- 172.21.15.33:0/3826734208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa6fb60 msgr2=0x55d8cfe43980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16f37fe640 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe43980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16f37fe640 1 -- 172.21.15.33:0/3826734208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8cfd582b0 con 0x55d8cfa90840 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16f37fe640 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa90840 0x55d8cfe4f490 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f16ec012930 tx=0x7f16ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528bcfbe67b9e3d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16d2ffd640 1 -- 172.21.15.33:0/3826734208 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00fcf0 con 0x55d8cfa90840 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16d2ffd640 1 -- 172.21.15.33:0/3826734208 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f16ec01f420 con 0x55d8cfa90840 2024-08-28T19:36:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16ffdfe740 1 -- 172.21.15.33:0/3826734208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16e40cbc70 con 0x55d8cfa90840 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16d2ffd640 1 -- 172.21.15.33:0/3826734208 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f16ec01f620 con 0x55d8cfa90840 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16ffdfe740 10 client.16629 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.091+0000 7f16ffdfe740 1 -- 172.21.15.33:0/3826734208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d8cfb0ab90 con 0x55d8cfa90840 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.092+0000 7f16d2ffd640 1 -- 172.21.15.33:0/3826734208 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16e40cbc70 con 0x55d8cfa90840 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.092+0000 7f16d2ffd640 1 -- 172.21.15.33:0/3826734208 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f16ec0276d0 con 0x55d8cfa90840 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.092+0000 7f16ffdfe740 10 client.16629 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.092+0000 7f16ffdfe740 10 client.16629 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.092+0000 7f16ffdfe740 20 client.16629 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.092+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d8cfa4f1c0 0x55d8cfe55300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.092+0000 7f16ffdfe740 4 client.16629 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.092+0000 7f16ffdfe740 1 -- 172.21.15.33:0/3826734208 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8cfdae280 con 0x55d8cfa4f1c0 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.092+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d8cfa4f1c0 0x55d8cfe55300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.093+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d8cfa4f1c0 0x55d8cfe55300 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee06c572c50270e3 server_cookie=306f31bb669807ae in_seq=0 out_seq=0 2024-08-28T19:36:15.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.093+0000 7f16d2ffd640 10 client.16629 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.093+0000 7f16d2ffd640 1 -- 172.21.15.33:0/3826734208 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d8cfdae280 con 0x55d8cfa4f1c0 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.093+0000 7f16d2ffd640 10 client.16629 handle_command_reply: tid=0 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.093+0000 7f16ffdfe740 1 client.16629 shutdown 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 1 -- 172.21.15.33:0/3826734208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa90840 msgr2=0x55d8cfe4f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa90840 0x55d8cfe4f490 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f16ec012930 tx=0x7f16ec004a40 comp rx=0 tx=0).stop 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 1 -- 172.21.15.33:0/3826734208 shutdown_connections 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d8cfa4f1c0 0x55d8cfe55300 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16d2ffd640 0 client.16629 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa90840 0x55d8cfe4f490 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe43980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/3826734208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa67980 0x55d8cfe43440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 1 -- 172.21.15.33:0/3826734208 >> 172.21.15.33:0/3826734208 conn(0x55d8cfa84990 msgr2=0x55d8cfe34340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:15.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 1 -- 172.21.15.33:0/3826734208 shutdown_connections 2024-08-28T19:36:15.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 1 -- 172.21.15.33:0/3826734208 wait complete. 2024-08-28T19:36:15.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.094+0000 7f16ffdfe740 20 client.16629 trim_cache size 0 max 16384 2024-08-28T19:36:15.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.111+0000 7f16ffdfe740 1 Processor -- start 2024-08-28T19:36:15.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.111+0000 7f16ffdfe740 1 -- start start 2024-08-28T19:36:15.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.111+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa4f1c0 0x55d8cfe45070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.111+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa67980 0x55d8cfe4f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.111+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe4f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.111+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b2de0 con 0x55d8cfa4f1c0 2024-08-28T19:36:15.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.111+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b4920 con 0x55d8cfa6fb60 2024-08-28T19:36:15.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.111+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b34b0 con 0x55d8cfa67980 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa4f1c0 0x55d8cfe45070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa4f1c0 0x55d8cfe45070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39746/0 (socket says 172.21.15.33:39746) 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f2ffd640 1 -- 172.21.15.33:0/4109421504 learned_addr learned my addr 172.21.15.33:0/4109421504 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f37fe640 1 --2- 172.21.15.33:0/4109421504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe4f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f27fc640 1 --2- 172.21.15.33:0/4109421504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa67980 0x55d8cfe4f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f2ffd640 1 -- 172.21.15.33:0/4109421504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa67980 msgr2=0x55d8cfe4f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/4109421504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa67980 0x55d8cfe4f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f2ffd640 1 -- 172.21.15.33:0/4109421504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa6fb60 msgr2=0x55d8cfe4f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/4109421504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe4f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f2ffd640 1 -- 172.21.15.33:0/4109421504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8cfd6bd90 con 0x55d8cfa4f1c0 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/4109421504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa4f1c0 0x55d8cfe45070 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f16e40c93d0 tx=0x7f16e40c8020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae60b015e210e86b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16d97fa640 1 -- 172.21.15.33:0/4109421504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4049040 con 0x55d8cfa4f1c0 2024-08-28T19:36:15.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16d97fa640 1 -- 172.21.15.33:0/4109421504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16e40cbc70 con 0x55d8cfa4f1c0 2024-08-28T19:36:15.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.112+0000 7f16d97fa640 1 -- 172.21.15.33:0/4109421504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4005e00 con 0x55d8cfa4f1c0 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.113+0000 7f16ffdfe740 1 -- 172.21.15.33:0/4109421504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa4f1c0 msgr2=0x55d8cfe45070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.113+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/4109421504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa4f1c0 0x55d8cfe45070 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f16e40c93d0 tx=0x7f16e40c8020 comp rx=0 tx=0).stop 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.113+0000 7f16ffdfe740 1 -- 172.21.15.33:0/4109421504 shutdown_connections 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.113+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/4109421504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe4f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.113+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/4109421504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa67980 0x55d8cfe4f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.113+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/4109421504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa4f1c0 0x55d8cfe45070 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.113+0000 7f16ffdfe740 1 -- 172.21.15.33:0/4109421504 >> 172.21.15.33:0/4109421504 conn(0x55d8cfa84990 msgr2=0x55d8cfe44960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.113+0000 7f16ffdfe740 1 -- 172.21.15.33:0/4109421504 shutdown_connections 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.113+0000 7f16ffdfe740 1 -- 172.21.15.33:0/4109421504 wait complete. 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.113+0000 7f16ffdfe740 1 -- start start 2024-08-28T19:36:15.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16ffdfe740 1 Processor -- start 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa4f1c0 0x55d8cfe4ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe46320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16ffdfe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe46860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b4250 con 0x55d8cfa67980 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b3b80 con 0x55d8cfa4f1c0 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16ffdfe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41b0dc0 con 0x55d8cfa6fb60 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16ffdfe740 10 client.0 _ll_register_callbacks cb 0x7f16ec0125e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16f27fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe46320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16f27fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe46320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39760/0 (socket says 172.21.15.33:39760) 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16f27fc640 1 -- 172.21.15.33:0/1069133676 learned_addr learned my addr 172.21.15.33:0/1069133676 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa4f1c0 0x55d8cfe4ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.114+0000 7f16f37fe640 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe46860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16f27fc640 1 -- 172.21.15.33:0/1069133676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa6fb60 msgr2=0x55d8cfe46860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16f27fc640 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe46860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16f27fc640 1 -- 172.21.15.33:0/1069133676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa4f1c0 msgr2=0x55d8cfe4ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16f27fc640 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa4f1c0 0x55d8cfe4ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16f27fc640 1 -- 172.21.15.33:0/1069133676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8cfe46e50 con 0x55d8cfa67980 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16f27fc640 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe46320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f16f40759f0 tx=0x7f16e80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12499384effab43 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16d2ffd640 1 -- 172.21.15.33:0/1069133676 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8004020 con 0x55d8cfa67980 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16d2ffd640 1 -- 172.21.15.33:0/1069133676 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f16e80041c0 con 0x55d8cfa67980 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16ffdfe740 1 -- 172.21.15.33:0/1069133676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16e40cbc70 con 0x55d8cfa67980 2024-08-28T19:36:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16d2ffd640 1 -- 172.21.15.33:0/1069133676 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f16e802a050 con 0x55d8cfa67980 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16ffdfe740 10 client.16635 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.115+0000 7f16ffdfe740 1 -- 172.21.15.33:0/1069133676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d8cfec0ac0 con 0x55d8cfa67980 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.116+0000 7f16d2ffd640 1 -- 172.21.15.33:0/1069133676 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16e40cbc70 con 0x55d8cfa67980 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.116+0000 7f16d2ffd640 1 -- 172.21.15.33:0/1069133676 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f16e80036f0 con 0x55d8cfa67980 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.116+0000 7f16ffdfe740 10 client.16635 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.116+0000 7f16ffdfe740 10 client.16635 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.116+0000 7f16ffdfe740 20 client.16635 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.116+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d8cfa90840 0x55d8cfec3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.116+0000 7f16ffdfe740 4 client.16635 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.0, "await_for": 45.0}] 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.116+0000 7f16ffdfe740 1 -- 172.21.15.33:0/1069133676 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.0, "await_for": 45.0}) -- 0x55d8cfda9d20 con 0x55d8cfa90840 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.116+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d8cfa90840 0x55d8cfec3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.117+0000 7f16d2ffd640 10 client.16635 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:15.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.117+0000 7f16f2ffd640 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d8cfa90840 0x55d8cfec3360 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63c2a0b36e7fbb50 server_cookie=e604346fa40ff4ce in_seq=0 out_seq=0 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.127+0000 7f16d2ffd640 1 -- 172.21.15.33:0/1069133676 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d8cfda9d20 con 0x55d8cfa90840 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.127+0000 7f16d2ffd640 10 client.16635 handle_command_reply: tid=0 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.127+0000 7f16ffdfe740 1 client.16635 shutdown 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.127+0000 7f16ffdfe740 1 -- 172.21.15.33:0/1069133676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 msgr2=0x55d8cfe46320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.127+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe46320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f16f40759f0 tx=0x7f16e80118d0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16ffdfe740 1 -- 172.21.15.33:0/1069133676 shutdown_connections 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8cfa6fb60 0x55d8cfe46860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d8cfa90840 0x55d8cfec3360 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8cfa67980 0x55d8cfe46320 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16ffdfe740 1 --2- 172.21.15.33:0/1069133676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8cfa4f1c0 0x55d8cfe4ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16ffdfe740 1 -- 172.21.15.33:0/1069133676 >> 172.21.15.33:0/1069133676 conn(0x55d8cfa84990 msgr2=0x55d8cfe38be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16d2ffd640 0 client.16635 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:15.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16ffdfe740 1 -- 172.21.15.33:0/1069133676 shutdown_connections 2024-08-28T19:36:15.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16ffdfe740 1 -- 172.21.15.33:0/1069133676 wait complete. 2024-08-28T19:36:15.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16ffdfe740 20 client.16635 trim_cache size 0 max 16384 2024-08-28T19:36:15.130 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:36:15.130 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:36:15.130 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:36:15.130 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 10, 2024-08-28T19:36:15.130 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:36:15.130 INFO:teuthology.orchestra.run.smithi033.stdout: "6a071a40": { 2024-08-28T19:36:15.130 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 10, 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 147.0, 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:36:15.131 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:36:15.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:15.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:15.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:15.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:15.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:15.132 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:36:15.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16f9889640 1 -- 172.21.15.33:0/2159751308 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16dc0b4ca0 msgr2=0x7f16dc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16f9889640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16dc0b4ca0 0x7f16dc0b71b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f16ec005fd0 tx=0x7f16ec009680 comp rx=0 tx=0).stop 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16f9889640 1 -- 172.21.15.33:0/2159751308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f4103040 msgr2=0x7f16f4198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16f9889640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f4103040 0x7f16f4198eb0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f16e4006010 tx=0x7f16e40042f0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16f9889640 1 -- 172.21.15.33:0/2159751308 shutdown_connections 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16f9889640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f4108af0 0x7f16f4199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16f9889640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16dc0b4ca0 0x7f16dc0b71b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16f9889640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f16f41081a0 0x7f16f41993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16f9889640 1 --2- 172.21.15.33:0/2159751308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16f4103040 0x7f16f4198eb0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.128+0000 7f16f9889640 1 -- 172.21.15.33:0/2159751308 >> 172.21.15.33:0/2159751308 conn(0x7f16f4079d70 msgr2=0x7f16f4106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.129+0000 7f16f9889640 1 -- 172.21.15.33:0/2159751308 shutdown_connections 2024-08-28T19:36:15.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:15.129+0000 7f16f9889640 1 -- 172.21.15.33:0/2159751308 wait complete. 2024-08-28T19:36:15.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:14 smithi059 ceph-mon[22052]: pgmap v456: 129 pgs: 129 active+clean; 3.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-08-28T19:36:15.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:14 smithi122 ceph-mon[22174]: pgmap v456: 129 pgs: 129 active+clean; 3.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-08-28T19:36:15.916 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6a071a40', quiesce took 3.4 seconds. Will release after: 23.6 2024-08-28T19:36:17.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:16 smithi059 ceph-mon[22052]: pgmap v457: 129 pgs: 129 active+clean; 3.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-08-28T19:36:17.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:16 smithi122 ceph-mon[22174]: pgmap v457: 129 pgs: 129 active+clean; 3.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-08-28T19:36:17.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:16 smithi033 ceph-mon[18549]: pgmap v457: 129 pgs: 129 active+clean; 3.9 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-08-28T19:36:19.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:18 smithi059 ceph-mon[22052]: pgmap v458: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-08-28T19:36:19.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:18 smithi122 ceph-mon[22174]: pgmap v458: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-08-28T19:36:19.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:18 smithi033 ceph-mon[18549]: pgmap v458: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-08-28T19:36:21.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:20 smithi059 ceph-mon[22052]: pgmap v459: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-08-28T19:36:21.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:20 smithi122 ceph-mon[22174]: pgmap v459: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-08-28T19:36:21.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:20 smithi033 ceph-mon[18549]: pgmap v459: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-08-28T19:36:23.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:22 smithi059 ceph-mon[22052]: pgmap v460: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-28T19:36:23.294 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:22 smithi122 ceph-mon[22174]: pgmap v460: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-28T19:36:23.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:22 smithi033 ceph-mon[18549]: pgmap v460: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-28T19:36:25.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:24 smithi059 ceph-mon[22052]: pgmap v461: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-28T19:36:25.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:24 smithi122 ceph-mon[22174]: pgmap v461: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-28T19:36:25.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:24 smithi033 ceph-mon[18549]: pgmap v461: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-08-28T19:36:27.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:26 smithi059 ceph-mon[22052]: pgmap v462: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-08-28T19:36:27.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:26 smithi122 ceph-mon[22174]: pgmap v462: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-08-28T19:36:27.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:26 smithi033 ceph-mon[18549]: pgmap v462: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-08-28T19:36:29.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:28 smithi059 ceph-mon[22052]: pgmap v463: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-08-28T19:36:29.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:28 smithi122 ceph-mon[22174]: pgmap v463: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-08-28T19:36:29.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:28 smithi033 ceph-mon[18549]: pgmap v463: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-08-28T19:36:29.411 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:36:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:30.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.142+0000 7f4fec9a3640 1 -- 172.21.15.33:0/4294620828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe8109b90 msgr2=0x7f4fe81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.142+0000 7f4fec9a3640 1 --2- 172.21.15.33:0/4294620828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe8109b90 0x7f4fe81103c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009ca0 tx=0x7f4fe002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.142+0000 7f4fec9a3640 1 -- 172.21.15.33:0/4294620828 shutdown_connections 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.142+0000 7f4fec9a3640 1 --2- 172.21.15.33:0/4294620828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe8109b90 0x7f4fe81103c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.142+0000 7f4fec9a3640 1 --2- 172.21.15.33:0/4294620828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe8109240 0x7f4fe8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.142+0000 7f4fec9a3640 1 --2- 172.21.15.33:0/4294620828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8103900 0x7f4fe8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.142+0000 7f4fec9a3640 1 -- 172.21.15.33:0/4294620828 >> 172.21.15.33:0/4294620828 conn(0x7f4fe807b5f0 msgr2=0x7f4fe807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.142+0000 7f4fec9a3640 1 -- 172.21.15.33:0/4294620828 shutdown_connections 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.142+0000 7f4fec9a3640 1 -- 172.21.15.33:0/4294620828 wait complete. 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fec9a3640 1 Processor -- start 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fec9a3640 1 -- start start 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fec9a3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe8103900 0x7f4fe819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fec9a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe8109240 0x7f4fe819c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fec9a3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8109b90 0x7f4fe81a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fec9a3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe8113850 con 0x7f4fe8109240 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fec9a3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81136d0 con 0x7f4fe8109b90 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fec9a3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81139d0 con 0x7f4fe8103900 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe8109240 0x7f4fe819c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe8109240 0x7f4fe819c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58026/0 (socket says 172.21.15.33:58026) 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe5d9b640 1 -- 172.21.15.33:0/862424714 learned_addr learned my addr 172.21.15.33:0/862424714 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe659c640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe8103900 0x7f4fe819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe6d9d640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8109b90 0x7f4fe81a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe5d9b640 1 -- 172.21.15.33:0/862424714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe8103900 msgr2=0x7f4fe819c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe8103900 0x7f4fe819c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe5d9b640 1 -- 172.21.15.33:0/862424714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8109b90 msgr2=0x7f4fe81a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:30.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8109b90 0x7f4fe81a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe5d9b640 1 -- 172.21.15.33:0/862424714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe81a22d0 con 0x7f4fe8109240 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.143+0000 7f4fe6d9d640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8109b90 0x7f4fe81a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.144+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe8109240 0x7f4fe819c9c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00d750 tx=0x7f4fdc00db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.144+0000 7f4fd77fe640 1 -- 172.21.15.33:0/862424714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc017070 con 0x7f4fe8109240 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.144+0000 7f4fec9a3640 1 -- 172.21.15.33:0/862424714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe81a25c0 con 0x7f4fe8109240 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.144+0000 7f4fd77fe640 1 -- 172.21.15.33:0/862424714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fdc009820 con 0x7f4fe8109240 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.144+0000 7f4fd77fe640 1 -- 172.21.15.33:0/862424714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc004c40 con 0x7f4fe8109240 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.144+0000 7f4fec9a3640 1 -- 172.21.15.33:0/862424714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe81a8de0 con 0x7f4fe8109240 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.147+0000 7f4ff2f18740 1 Processor -- start 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.147+0000 7f4ff2f18740 1 -- start start 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.147+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2d7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.147+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 0x55beac2d7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.147+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2d7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.147+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55beac24e630 con 0x55beabf32070 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.147+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55beac23dbc0 con 0x55beabf091b0 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.147+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55beac241b70 con 0x55beabf11390 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fd77fe640 1 -- 172.21.15.33:0/862424714 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4fdc0099d0 con 0x7f4fe8109240 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2d7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2d7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58030/0 (socket says 172.21.15.33:58030) 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe6d9d640 1 -- 172.21.15.33:0/4151029247 learned_addr learned my addr 172.21.15.33:0/4151029247 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe659c640 1 --2- 172.21.15.33:0/4151029247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 0x55beac2d7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/4151029247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2d7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe6d9d640 1 -- 172.21.15.33:0/4151029247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 msgr2=0x55beac2d7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe6d9d640 1 --2- 172.21.15.33:0/4151029247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2d7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe6d9d640 1 -- 172.21.15.33:0/4151029247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 msgr2=0x55beac2d7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe6d9d640 1 --2- 172.21.15.33:0/4151029247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 0x55beac2d7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe6d9d640 1 -- 172.21.15.33:0/4151029247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beabf9d650 con 0x55beabf32070 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/4151029247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2d7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fe6d9d640 1 --2- 172.21.15.33:0/4151029247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2d7300 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0006010 tx=0x7f4fe0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abf3e10980c0799 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.148+0000 7f4fd77fe640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4fd00b4cd0 0x7f4fd00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.149+0000 7f4fe659c640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4fd00b4cd0 0x7f4fd00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.149+0000 7f4fd4ff9640 1 -- 172.21.15.33:0/4151029247 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0031d70 con 0x55beabf32070 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.149+0000 7f4fd77fe640 1 -- 172.21.15.33:0/862424714 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4fdc0e51f0 con 0x7f4fe8109240 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.149+0000 7f4fd4ff9640 1 -- 172.21.15.33:0/4151029247 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fe0036070 con 0x55beabf32070 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.149+0000 7f4fd4ff9640 1 -- 172.21.15.33:0/4151029247 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00042a0 con 0x55beabf32070 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.149+0000 7f4ff2f18740 1 -- 172.21.15.33:0/4151029247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 msgr2=0x55beac2d7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.149+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/4151029247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2d7300 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0006010 tx=0x7f4fe0009880 comp rx=0 tx=0).stop 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.149+0000 7f4fe659c640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4fd00b4cd0 0x7f4fd00b71e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55beac2d5f80 tx=0x7f4fd800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 -- 172.21.15.33:0/4151029247 shutdown_connections 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/4151029247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2d7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/4151029247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 0x55beac2d7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/4151029247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2d7300 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 -- 172.21.15.33:0/4151029247 >> 172.21.15.33:0/4151029247 conn(0x55beabf26460 msgr2=0x55beac2d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 -- 172.21.15.33:0/4151029247 shutdown_connections 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 -- 172.21.15.33:0/4151029247 wait complete. 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 -- start start 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 Processor -- start 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf091b0 0x55beac2e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2e3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 0x55beac2eed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55beac0a0700 con 0x55beabf091b0 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55beac1c4700 con 0x55beabf32070 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.150+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55beac2e5a80 con 0x55beabf11390 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4ff2f18740 10 client.0 _ll_register_callbacks cb 0x55beac1f3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf091b0 0x55beac2e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf091b0 0x55beac2e2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58034/0 (socket says 172.21.15.33:58034) 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe659c640 1 -- 172.21.15.33:0/3287273511 learned_addr learned my addr 172.21.15.33:0/3287273511 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2e3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe6d9d640 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 0x55beac2eed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe659c640 1 -- 172.21.15.33:0/3287273511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 msgr2=0x55beac2e3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe659c640 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2e3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe659c640 1 -- 172.21.15.33:0/3287273511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 msgr2=0x55beac2eed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe659c640 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 0x55beac2eed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe659c640 1 -- 172.21.15.33:0/3287273511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beac1fd8b0 con 0x55beabf091b0 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fe659c640 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf091b0 0x55beac2e2b10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4fd801cc10 tx=0x7f4fd8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d95cbbed4ac065 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fcdffb640 1 -- 172.21.15.33:0/3287273511 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd802c060 con 0x55beabf091b0 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3287273511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fe0036070 con 0x55beabf091b0 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fcdffb640 1 -- 172.21.15.33:0/3287273511 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4fd8016030 con 0x55beabf091b0 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4fcdffb640 1 -- 172.21.15.33:0/3287273511 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4fd8033050 con 0x55beabf091b0 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.151+0000 7f4ff2f18740 10 client.16647 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.152+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3287273511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55beac2f18a0 con 0x55beabf091b0 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.152+0000 7f4fcdffb640 1 -- 172.21.15.33:0/3287273511 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fe0036070 con 0x55beabf091b0 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.152+0000 7f4fcdffb640 1 -- 172.21.15.33:0/3287273511 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4fd801a5d0 con 0x55beabf091b0 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.152+0000 7f4ff2f18740 10 client.16647 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.152+0000 7f4ff2f18740 10 client.16647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.152+0000 7f4ff2f18740 20 client.16647 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.152+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55beabef09f0 0x55beac2f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.152+0000 7f4ff2f18740 4 client.16647 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.152+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3287273511 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55beac250580 con 0x55beabef09f0 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.152+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55beabef09f0 0x55beac2f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.153+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55beabef09f0 0x55beac2f4ce0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e043570048ffde2c server_cookie=1a3f4b23f9bf80fb in_seq=0 out_seq=0 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.153+0000 7f4fcdffb640 10 client.16647 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.153+0000 7f4fcdffb640 1 -- 172.21.15.33:0/3287273511 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55beac250580 con 0x55beabef09f0 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.153+0000 7f4fcdffb640 10 client.16647 handle_command_reply: tid=0 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.153+0000 7f4ff2f18740 1 client.16647 shutdown 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3287273511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf091b0 msgr2=0x55beac2e2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf091b0 0x55beac2e2b10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4fd801cc10 tx=0x7f4fd8004730 comp rx=0 tx=0).stop 2024-08-28T19:36:30.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3287273511 shutdown_connections 2024-08-28T19:36:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 0x55beac2eed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2e3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55beabef09f0 0x55beac2f4ce0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/3287273511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf091b0 0x55beac2e2b10 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4fcdffb640 0 client.16647 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3287273511 >> 172.21.15.33:0/3287273511 conn(0x55beabf26460 msgr2=0x55beac2da4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3287273511 shutdown_connections 2024-08-28T19:36:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3287273511 wait complete. 2024-08-28T19:36:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.154+0000 7f4ff2f18740 20 client.16647 trim_cache size 0 max 16384 2024-08-28T19:36:30.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4ff2f18740 1 Processor -- start 2024-08-28T19:36:30.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4ff2f18740 1 -- start start 2024-08-28T19:36:30.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 0x55beac2dab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2dfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2e0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81b2cb0 con 0x55beabf32070 2024-08-28T19:36:30.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81b47f0 con 0x55beabf091b0 2024-08-28T19:36:30.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81b3380 con 0x55beabf11390 2024-08-28T19:36:30.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4fe6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2e0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4fe659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 0x55beac2dab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4fe6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2e0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58036/0 (socket says 172.21.15.33:58036) 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4fe659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 0x55beac2dab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:56470/0 (socket says 172.21.15.33:56470) 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4fe6d9d640 1 -- 172.21.15.33:0/3959699140 learned_addr learned my addr 172.21.15.33:0/3959699140 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.172+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/3959699140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2dfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.173+0000 7f4fe659c640 1 -- 172.21.15.33:0/3959699140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 msgr2=0x55beac2dfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.173+0000 7f4fe659c640 1 --2- 172.21.15.33:0/3959699140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2dfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.173+0000 7f4fe659c640 1 -- 172.21.15.33:0/3959699140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 msgr2=0x55beac2e0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.173+0000 7f4fe659c640 1 --2- 172.21.15.33:0/3959699140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2e0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.173+0000 7f4fe659c640 1 -- 172.21.15.33:0/3959699140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beac2dd7b0 con 0x55beabf091b0 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.173+0000 7f4fe6d9d640 1 --2- 172.21.15.33:0/3959699140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2e0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.173+0000 7f4fe659c640 1 --2- 172.21.15.33:0/3959699140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 0x55beac2dab10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4fd801ab90 tx=0x7f4fd8005b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e67609a5051af0f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.173+0000 7f4fcffff640 1 -- 172.21.15.33:0/3959699140 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd801cd00 con 0x55beabf091b0 2024-08-28T19:36:30.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.173+0000 7f4fcffff640 1 -- 172.21.15.33:0/3959699140 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fd800ae70 con 0x55beabf091b0 2024-08-28T19:36:30.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.173+0000 7f4fcffff640 1 -- 172.21.15.33:0/3959699140 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800fb50 con 0x55beabf091b0 2024-08-28T19:36:30.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.174+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3959699140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 msgr2=0x55beac2dab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:30.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.174+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/3959699140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 0x55beac2dab10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4fd801ab90 tx=0x7f4fd8005b10 comp rx=0 tx=0).stop 2024-08-28T19:36:30.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.174+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3959699140 shutdown_connections 2024-08-28T19:36:30.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.174+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/3959699140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf32070 0x55beac2e0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.174+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/3959699140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf11390 0x55beac2dfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.174+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/3959699140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf091b0 0x55beac2dab10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.174+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3959699140 >> 172.21.15.33:0/3959699140 conn(0x55beabf26460 msgr2=0x55beac2da400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.174+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3959699140 shutdown_connections 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.174+0000 7f4ff2f18740 1 -- 172.21.15.33:0/3959699140 wait complete. 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4ff2f18740 1 -- start start 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4ff2f18740 1 Processor -- start 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf091b0 0x55beac358a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf11390 0x55beac358fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4ff2f18740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 0x55beac2e74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81b4120 con 0x55beabf11390 2024-08-28T19:36:30.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81b3a50 con 0x55beabf32070 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4ff2f18740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81b0c90 con 0x55beabf091b0 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4ff2f18740 10 client.0 _ll_register_callbacks cb 0x7f4fd800a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4fe5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf11390 0x55beac358fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4fe5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf11390 0x55beac358fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58038/0 (socket says 172.21.15.33:58038) 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4fe5d9b640 1 -- 172.21.15.33:0/302829887 learned_addr learned my addr 172.21.15.33:0/302829887 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4fe659c640 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf091b0 0x55beac358a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.175+0000 7f4fe6d9d640 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 0x55beac2e74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fe5d9b640 1 -- 172.21.15.33:0/302829887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf091b0 msgr2=0x55beac358a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf091b0 0x55beac358a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fe5d9b640 1 -- 172.21.15.33:0/302829887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 msgr2=0x55beac2e74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 0x55beac2e74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fe5d9b640 1 -- 172.21.15.33:0/302829887 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beac2e7c50 con 0x55beabf11390 2024-08-28T19:36:30.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fe6d9d640 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 0x55beac2e74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fe659c640 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf091b0 0x55beac358a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fe5d9b640 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf11390 0x55beac358fe0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0e2650 tx=0x7f4fdc0ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da299a07d9dc0e95 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fcdffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fcdffb640 1 -- 172.21.15.33:0/302829887 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc020040 con 0x55beabf11390 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fcdffb640 1 -- 172.21.15.33:0/302829887 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4fdc0e2870 con 0x55beabf11390 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4ff2f18740 1 -- 172.21.15.33:0/302829887 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fd800ae70 con 0x55beabf11390 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fcdffb640 1 -- 172.21.15.33:0/302829887 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4fdc0afe00 con 0x55beabf11390 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4ff2f18740 10 client.16653 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4ff2f18740 1 -- 172.21.15.33:0/302829887 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55beac360240 con 0x55beabf11390 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.176+0000 7f4fcdffb640 1 -- 172.21.15.33:0/302829887 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fd800ae70 con 0x55beabf11390 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.177+0000 7f4fcdffb640 1 -- 172.21.15.33:0/302829887 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4fdc0a7820 con 0x55beabf11390 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.177+0000 7f4ff2f18740 10 client.16653 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.177+0000 7f4ff2f18740 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.177+0000 7f4ff2f18740 20 client.16653 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.177+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55beabec5da0 0x55beac362980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.177+0000 7f4ff2f18740 4 client.16653 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.177+0000 7f4ff2f18740 1 -- 172.21.15.33:0/302829887 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55beac24c020 con 0x55beabec5da0 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.177+0000 7f4fe659c640 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55beabec5da0 0x55beac362980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.177+0000 7f4fe659c640 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55beabec5da0 0x55beac362980 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98d5fdc22eb84a0a server_cookie=c10fda34eb414732 in_seq=0 out_seq=0 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.177+0000 7f4fcdffb640 10 client.16653 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4fcdffb640 1 -- 172.21.15.33:0/302829887 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55beac24c020 con 0x55beabec5da0 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4fcdffb640 10 client.16653 handle_command_reply: tid=0 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 client.16653 shutdown 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 -- 172.21.15.33:0/302829887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf11390 msgr2=0x55beac358fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf11390 0x55beac358fe0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0e2650 tx=0x7f4fdc0ce040 comp rx=0 tx=0).stop 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 -- 172.21.15.33:0/302829887 shutdown_connections 2024-08-28T19:36:30.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55beabf32070 0x55beac2e74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55beabec5da0 0x55beac362980 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55beabf11390 0x55beac358fe0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 --2- 172.21.15.33:0/302829887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55beabf091b0 0x55beac358a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4fcdffb640 0 client.16653 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:30.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 -- 172.21.15.33:0/302829887 >> 172.21.15.33:0/302829887 conn(0x55beabf26460 msgr2=0x55beac2d8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:30.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 -- 172.21.15.33:0/302829887 shutdown_connections 2024-08-28T19:36:30.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 1 -- 172.21.15.33:0/302829887 wait complete. 2024-08-28T19:36:30.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.178+0000 7f4ff2f18740 20 client.16653 trim_cache size 0 max 16384 2024-08-28T19:36:30.184 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:36:30.184 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:36:30.185 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:30.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:30.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:30.188 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:36:30.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 -- 172.21.15.33:0/862424714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4fd00b4cd0 msgr2=0x7f4fd00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:30.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4fd00b4cd0 0x7f4fd00b71e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55beac2d5f80 tx=0x7f4fd800a2d0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 -- 172.21.15.33:0/862424714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe8109240 msgr2=0x7f4fe819c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:30.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe8109240 0x7f4fe819c9c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00d750 tx=0x7f4fdc00db50 comp rx=0 tx=0).stop 2024-08-28T19:36:30.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 -- 172.21.15.33:0/862424714 shutdown_connections 2024-08-28T19:36:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8109b90 0x7f4fe81a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe8109240 0x7f4fe819c9c0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4fd00b4cd0 0x7f4fd00b71e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 --2- 172.21.15.33:0/862424714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4fe8103900 0x7f4fe819c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 -- 172.21.15.33:0/862424714 >> 172.21.15.33:0/862424714 conn(0x7f4fe807b5f0 msgr2=0x7f4fe8107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 -- 172.21.15.33:0/862424714 shutdown_connections 2024-08-28T19:36:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:30.179+0000 7f4fec9a3640 1 -- 172.21.15.33:0/862424714 wait complete. 2024-08-28T19:36:30.961 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:36:30.962 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:36:31.218 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:31.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:30 smithi059 ceph-mon[22052]: pgmap v464: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-08-28T19:36:31.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:30 smithi122 ceph-mon[22174]: pgmap v464: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-08-28T19:36:31.339 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:30 smithi033 ceph-mon[18549]: pgmap v464: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-08-28T19:36:31.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.716+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2579877420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e08102800 msgr2=0x7f7e08102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:31.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.716+0000 7f7e0eabe640 1 --2- 172.21.15.33:0/2579877420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e08102800 0x7f7e08102c10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009900 tx=0x7f7dfc02a410 comp rx=0 tx=0).stop 2024-08-28T19:36:31.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.716+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2579877420 shutdown_connections 2024-08-28T19:36:31.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.716+0000 7f7e0eabe640 1 --2- 172.21.15.33:0/2579877420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e08108a90 0x7f7e0810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:31.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.716+0000 7f7e0eabe640 1 --2- 172.21.15.33:0/2579877420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e08108140 0x7f7e08108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:31.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.716+0000 7f7e0eabe640 1 --2- 172.21.15.33:0/2579877420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e08102800 0x7f7e08102c10 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:31.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.716+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2579877420 >> 172.21.15.33:0/2579877420 conn(0x7f7e080794c0 msgr2=0x7f7e080798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:31.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.716+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2579877420 shutdown_connections 2024-08-28T19:36:31.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.716+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2579877420 wait complete. 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0eabe640 1 Processor -- start 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0eabe640 1 -- start start 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0eabe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e08102800 0x7f7e0819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0eabe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e08108140 0x7f7e0819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0eabe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e08108a90 0x7f7e0819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0eabe640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08113810 con 0x7f7e08102800 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0eabe640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08113690 con 0x7f7e08108a90 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0eabe640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08113990 con 0x7f7e08108140 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0c85a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e08102800 0x7f7e0819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0c85a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e08102800 0x7f7e0819a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58056/0 (socket says 172.21.15.33:58056) 2024-08-28T19:36:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.717+0000 7f7e0c85a640 1 -- 172.21.15.33:0/2304477390 learned_addr learned my addr 172.21.15.33:0/2304477390 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e0d05b640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e08108a90 0x7f7e0819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e07fff640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e08108140 0x7f7e0819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e0c85a640 1 -- 172.21.15.33:0/2304477390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e08108140 msgr2=0x7f7e0819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e0c85a640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e08108140 0x7f7e0819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e0c85a640 1 -- 172.21.15.33:0/2304477390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e08108a90 msgr2=0x7f7e0819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e0c85a640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e08108a90 0x7f7e0819fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e0c85a640 1 -- 172.21.15.33:0/2304477390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e081a0190 con 0x7f7e08102800 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e0c85a640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e08102800 0x7f7e0819a220 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc005940 tx=0x7f7dfc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e05ffb640 1 -- 172.21.15.33:0/2304477390 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc03f030 con 0x7f7e08102800 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e05ffb640 1 -- 172.21.15.33:0/2304477390 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dfc003aa0 con 0x7f7e08102800 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e05ffb640 1 -- 172.21.15.33:0/2304477390 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc035070 con 0x7f7e08102800 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2304477390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e081a0420 con 0x7f7e08102800 2024-08-28T19:36:31.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.718+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2304477390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e081a6be0 con 0x7f7e08102800 2024-08-28T19:36:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.719+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2304477390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e08103a80 con 0x7f7e08102800 2024-08-28T19:36:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.721+0000 7f7e05ffb640 1 -- 172.21.15.33:0/2304477390 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7dfc042030 con 0x7f7e08102800 2024-08-28T19:36:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.722+0000 7f7e05ffb640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7df80b4ca0 0x7f7df80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:31.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.722+0000 7f7e05ffb640 1 -- 172.21.15.33:0/2304477390 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f7dfc1062a0 con 0x7f7e08102800 2024-08-28T19:36:31.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.722+0000 7f7e07fff640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7df80b4ca0 0x7f7df80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:31.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.722+0000 7f7e07fff640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7df80b4ca0 0x7f7df80b71b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7e08100a40 tx=0x7f7df4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:31.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.725+0000 7f7e05ffb640 1 -- 172.21.15.33:0/2304477390 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7dfc0ccd40 con 0x7f7e08102800 2024-08-28T19:36:31.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.949+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2304477390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e08102c10 con 0x7f7e08102800 2024-08-28T19:36:31.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.950+0000 7f7e05ffb640 1 -- 172.21.15.33:0/2304477390 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f7dfc0cc640 con 0x7f7e08102800 2024-08-28T19:36:31.951 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:36:31.952 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:36:31.952 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:36:31.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2304477390 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7df80b4ca0 msgr2=0x7f7df80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:31.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7df80b4ca0 0x7f7df80b71b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7e08100a40 tx=0x7f7df4005f90 comp rx=0 tx=0).stop 2024-08-28T19:36:31.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2304477390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e08102800 msgr2=0x7f7e0819a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:31.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e08102800 0x7f7e0819a220 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc005940 tx=0x7f7dfc004270 comp rx=0 tx=0).stop 2024-08-28T19:36:31.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2304477390 shutdown_connections 2024-08-28T19:36:31.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e08108a90 0x7f7e0819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:31.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7df80b4ca0 0x7f7df80b71b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:31.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7e08108140 0x7f7e0819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:31.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 --2- 172.21.15.33:0/2304477390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e08102800 0x7f7e0819a220 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:31.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2304477390 >> 172.21.15.33:0/2304477390 conn(0x7f7e080794c0 msgr2=0x7f7e081012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:31.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2304477390 shutdown_connections 2024-08-28T19:36:31.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:31.953+0000 7f7e0eabe640 1 -- 172.21.15.33:0/2304477390 wait complete. 2024-08-28T19:36:32.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:31 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2304477390' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:32.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:31 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2304477390' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:32.375 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:31 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2304477390' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:32.636 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:36:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:33.268 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:32 smithi033 ceph-mon[18549]: pgmap v465: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-08-28T19:36:33.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:32 smithi059 ceph-mon[22052]: pgmap v465: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-08-28T19:36:33.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:32 smithi122 ceph-mon[22174]: pgmap v465: 129 pgs: 129 active+clean; 4.0 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-08-28T19:36:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.357+0000 7fe5da438640 1 -- 172.21.15.33:0/2000427825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5d4102820 msgr2=0x7fe5d4102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.357+0000 7fe5da438640 1 --2- 172.21.15.33:0/2000427825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5d4102820 0x7fe5d4102c30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009900 tx=0x7fe5c402a410 comp rx=0 tx=0).stop 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.357+0000 7fe5da438640 1 -- 172.21.15.33:0/2000427825 shutdown_connections 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.357+0000 7fe5da438640 1 --2- 172.21.15.33:0/2000427825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d4108ab0 0x7fe5d410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.357+0000 7fe5da438640 1 --2- 172.21.15.33:0/2000427825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d4108160 0x7fe5d4108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.357+0000 7fe5da438640 1 --2- 172.21.15.33:0/2000427825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5d4102820 0x7fe5d4102c30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.357+0000 7fe5da438640 1 -- 172.21.15.33:0/2000427825 >> 172.21.15.33:0/2000427825 conn(0x7fe5d40794e0 msgr2=0x7fe5d40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.358+0000 7fe5da438640 1 -- 172.21.15.33:0/2000427825 shutdown_connections 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.358+0000 7fe5da438640 1 -- 172.21.15.33:0/2000427825 wait complete. 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.358+0000 7fe5da438640 1 Processor -- start 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.358+0000 7fe5da438640 1 -- start start 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5da438640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d4102820 0x7fe5d419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5da438640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5d4108160 0x7fe5d419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5da438640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d4108ab0 0x7fe5d419fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5da438640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d4113840 con 0x7fe5d4108160 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5da438640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d41136c0 con 0x7fe5d4102820 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5da438640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d41139c0 con 0x7fe5d4108ab0 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5d4108160 0x7fe5d419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5d4108160 0x7fe5d419a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58082/0 (socket says 172.21.15.33:58082) 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d37fe640 1 -- 172.21.15.33:0/1939080487 learned_addr learned my addr 172.21.15.33:0/1939080487 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d4102820 0x7fe5d419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d89d5640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d4108ab0 0x7fe5d419fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d37fe640 1 -- 172.21.15.33:0/1939080487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d4108ab0 msgr2=0x7fe5d419fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d4108ab0 0x7fe5d419fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d37fe640 1 -- 172.21.15.33:0/1939080487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d4102820 msgr2=0x7fe5d419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d4102820 0x7fe5d419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d37fe640 1 -- 172.21.15.33:0/1939080487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d41a0140 con 0x7fe5d4108160 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d4102820 0x7fe5d419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5d4108160 0x7fe5d419a830 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800c970 tx=0x7fe5c800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.359+0000 7fe5d17fa640 1 -- 172.21.15.33:0/1939080487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8014070 con 0x7fe5d4108160 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.360+0000 7fe5da438640 1 -- 172.21.15.33:0/1939080487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d41a0430 con 0x7fe5d4108160 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.360+0000 7fe5d17fa640 1 -- 172.21.15.33:0/1939080487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5c8004440 con 0x7fe5d4108160 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.360+0000 7fe5d17fa640 1 -- 172.21.15.33:0/1939080487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8003e50 con 0x7fe5d4108160 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.360+0000 7fe5da438640 1 -- 172.21.15.33:0/1939080487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d41a6c50 con 0x7fe5d4108160 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.362+0000 7fe5e09ad740 1 Processor -- start 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.362+0000 7fe5d17fa640 1 -- 172.21.15.33:0/1939080487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe5c8017070 con 0x7fe5d4108160 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.362+0000 7fe5e09ad740 1 -- start start 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.362+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 0x5623dea23310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.362+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea23850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.362+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea23d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.362+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5623de99a680 con 0x5623de6551b0 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.362+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5623de989c10 con 0x5623de67e070 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.362+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5623de98dbc0 con 0x5623de65d390 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea23850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea23850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58092/0 (socket says 172.21.15.33:58092) 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d3fff640 1 -- 172.21.15.33:0/2003073085 learned_addr learned my addr 172.21.15.33:0/2003073085 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d89d5640 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 0x5623dea23310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea23d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d3fff640 1 -- 172.21.15.33:0/2003073085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 msgr2=0x5623dea23d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea23d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d3fff640 1 -- 172.21.15.33:0/2003073085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 msgr2=0x5623dea23310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 0x5623dea23310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d3fff640 1 -- 172.21.15.33:0/2003073085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623de6e9650 con 0x5623de6551b0 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea23d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d89d5640 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 0x5623dea23310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d17fa640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5bc0b4e70 0x7fe5bc0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d89d5640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5bc0b4e70 0x7fe5bc0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea23850 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009900 tx=0x7fe5c4032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93eade2c719761a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5d17fa640 1 -- 172.21.15.33:0/1939080487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe5c80e5490 con 0x7fe5d4108160 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5ba7fc640 1 -- 172.21.15.33:0/2003073085 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c403f070 con 0x5623de6551b0 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5ba7fc640 1 -- 172.21.15.33:0/2003073085 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5c40316a0 con 0x5623de6551b0 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.363+0000 7fe5ba7fc640 1 -- 172.21.15.33:0/2003073085 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4035070 con 0x5623de6551b0 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.364+0000 7fe5e09ad740 1 -- 172.21.15.33:0/2003073085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 msgr2=0x5623dea23850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.364+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea23850 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009900 tx=0x7fe5c4032e70 comp rx=0 tx=0).stop 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.364+0000 7fe5d89d5640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5bc0b4e70 0x7fe5bc0b7380 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc005fd0 tx=0x7fe5cc009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.364+0000 7fe5e09ad740 1 -- 172.21.15.33:0/2003073085 shutdown_connections 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.364+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea23d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.364+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea23850 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.364+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/2003073085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 0x5623dea23310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.364+0000 7fe5e09ad740 1 -- 172.21.15.33:0/2003073085 >> 172.21.15.33:0/2003073085 conn(0x5623de672460 msgr2=0x5623dea21200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.364+0000 7fe5e09ad740 1 -- 172.21.15.33:0/2003073085 shutdown_connections 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.364+0000 7fe5e09ad740 1 -- 172.21.15.33:0/2003073085 wait complete. 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.365+0000 7fe5e09ad740 1 -- start start 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.365+0000 7fe5e09ad740 1 Processor -- start 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.365+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea2ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.365+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea2ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.365+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 0x5623dea3ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.365+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5623de7ec700 con 0x5623de6551b0 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.365+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5623de910750 con 0x5623de67e070 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.365+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5623dea31a90 con 0x5623de65d390 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.365+0000 7fe5d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea2ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.365+0000 7fe5e09ad740 10 client.0 _ll_register_callbacks cb 0x5623de93fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea2ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58106/0 (socket says 172.21.15.33:58106) 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d3fff640 1 -- 172.21.15.33:0/1084067394 learned_addr learned my addr 172.21.15.33:0/1084067394 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea2ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d89d5640 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 0x5623dea3ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d3fff640 1 -- 172.21.15.33:0/1084067394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 msgr2=0x5623dea2ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea2ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d3fff640 1 -- 172.21.15.33:0/1084067394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 msgr2=0x5623dea3ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 0x5623dea3ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d3fff640 1 -- 172.21.15.33:0/1084067394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623de949900 con 0x5623de6551b0 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d89d5640 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 0x5623dea3ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea2ea50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe5c402a930 tx=0x7fe5c4005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6635c1ed0dc80698 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5b37fe640 1 -- 172.21.15.33:0/1084067394 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c404b060 con 0x5623de6551b0 2024-08-28T19:36:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5b37fe640 1 -- 172.21.15.33:0/1084067394 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe5c4005560 con 0x5623de6551b0 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5e09ad740 1 -- 172.21.15.33:0/1084067394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c40316a0 con 0x5623de6551b0 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5b37fe640 1 -- 172.21.15.33:0/1084067394 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5c4052050 con 0x5623de6551b0 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.366+0000 7fe5e09ad740 10 client.16671 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.367+0000 7fe5e09ad740 1 -- 172.21.15.33:0/1084067394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5623dea3d7d0 con 0x5623de6551b0 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.367+0000 7fe5b37fe640 1 -- 172.21.15.33:0/1084067394 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5c40316a0 con 0x5623de6551b0 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.367+0000 7fe5b37fe640 1 -- 172.21.15.33:0/1084067394 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe5c40035f0 con 0x5623de6551b0 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.367+0000 7fe5e09ad740 10 client.16671 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.367+0000 7fe5e09ad740 10 client.16671 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.367+0000 7fe5e09ad740 20 client.16671 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.367+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5623de63c9f0 0x5623dea40b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.367+0000 7fe5e09ad740 4 client.16671 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.367+0000 7fe5e09ad740 1 -- 172.21.15.33:0/1084067394 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623de99c5d0 con 0x5623de63c9f0 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.367+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5623de63c9f0 0x5623dea40b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.368+0000 7fe5b37fe640 10 client.16671 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.368+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5623de63c9f0 0x5623dea40b30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8a5691a2498e5845 server_cookie=5e1476e2aac1edb8 in_seq=0 out_seq=0 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5b37fe640 1 -- 172.21.15.33:0/1084067394 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623de99c5d0 con 0x5623de63c9f0 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5b37fe640 10 client.16671 handle_command_reply: tid=0 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 client.16671 shutdown 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 -- 172.21.15.33:0/1084067394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 msgr2=0x5623dea2ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea2ea50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe5c402a930 tx=0x7fe5c4005340 comp rx=0 tx=0).stop 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 -- 172.21.15.33:0/1084067394 shutdown_connections 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5623de63c9f0 0x5623dea40b30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de67e070 0x5623dea3ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea2ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/1084067394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de6551b0 0x5623dea2ea50 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 -- 172.21.15.33:0/1084067394 >> 172.21.15.33:0/1084067394 conn(0x5623de672460 msgr2=0x5623dea264f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5b37fe640 0 client.16671 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 -- 172.21.15.33:0/1084067394 shutdown_connections 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 1 -- 172.21.15.33:0/1084067394 wait complete. 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.369+0000 7fe5e09ad740 20 client.16671 trim_cache size 0 max 16384 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.382+0000 7fe5e09ad740 1 Processor -- start 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.382+0000 7fe5e09ad740 1 -- start start 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 0x5623dea24a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de65d390 0x5623dea2bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de67e070 0x5623dea2c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d41b0ad0 con 0x5623de65d390 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d41b2610 con 0x5623de6551b0 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d41b11a0 con 0x5623de67e070 2024-08-28T19:36:33.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de65d390 0x5623dea2bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de65d390 0x5623dea2bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58118/0 (socket says 172.21.15.33:58118) 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d37fe640 1 -- 172.21.15.33:0/3604510570 learned_addr learned my addr 172.21.15.33:0/3604510570 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/3604510570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 0x5623dea24a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d37fe640 1 -- 172.21.15.33:0/3604510570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de67e070 msgr2=0x5623dea2c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/3604510570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de67e070 0x5623dea2c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d37fe640 1 -- 172.21.15.33:0/3604510570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 msgr2=0x5623dea24a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/3604510570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 0x5623dea24a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d37fe640 1 -- 172.21.15.33:0/3604510570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623de63cc20 con 0x5623de65d390 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/3604510570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 0x5623dea24a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/3604510570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de65d390 0x5623dea2bc40 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80e28f0 tx=0x7fe5c80ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd410a9c3d43fcd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.383+0000 7fe5b9ffb640 1 -- 172.21.15.33:0/3604510570 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80ab340 con 0x5623de65d390 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5b9ffb640 1 -- 172.21.15.33:0/3604510570 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5c80abf30 con 0x5623de65d390 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5b9ffb640 1 -- 172.21.15.33:0/3604510570 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80e8cd0 con 0x5623de65d390 2024-08-28T19:36:33.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5e09ad740 1 -- 172.21.15.33:0/3604510570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de65d390 msgr2=0x5623dea2bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/3604510570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de65d390 0x5623dea2bc40 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80e28f0 tx=0x7fe5c80ce040 comp rx=0 tx=0).stop 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5e09ad740 1 -- 172.21.15.33:0/3604510570 shutdown_connections 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/3604510570 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de67e070 0x5623dea2c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/3604510570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de65d390 0x5623dea2bc40 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/3604510570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 0x5623dea24a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5e09ad740 1 -- 172.21.15.33:0/3604510570 >> 172.21.15.33:0/3604510570 conn(0x5623de672460 msgr2=0x5623dea24340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5e09ad740 1 -- 172.21.15.33:0/3604510570 shutdown_connections 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.384+0000 7fe5e09ad740 1 -- 172.21.15.33:0/3604510570 wait complete. 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5e09ad740 1 -- start start 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5e09ad740 1 Processor -- start 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 0x5623dea43be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5e09ad740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de67e070 0x5623deaa3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d41b1f40 con 0x5623de67e070 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d41b1870 con 0x5623de6551b0 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5e09ad740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d41aeab0 con 0x5623de65d390 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5e09ad740 10 client.0 _ll_register_callbacks cb 0x7fe5c4032d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5d89d5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de67e070 0x5623deaa3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5d89d5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de67e070 0x5623deaa3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58132/0 (socket says 172.21.15.33:58132) 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5d89d5640 1 -- 172.21.15.33:0/667900950 learned_addr learned my addr 172.21.15.33:0/667900950 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.385+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 0x5623dea43be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5d37fe640 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5d89d5640 1 -- 172.21.15.33:0/667900950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 msgr2=0x5623dea441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5d89d5640 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5d89d5640 1 -- 172.21.15.33:0/667900950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 msgr2=0x5623dea43be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:33.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5d89d5640 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 0x5623dea43be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5d89d5640 1 -- 172.21.15.33:0/667900950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623deaa3fe0 con 0x5623de67e070 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5d89d5640 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de67e070 0x5623deaa3970 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc012960 tx=0x7fe5cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89f70e514df2f79 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5b37fe640 1 -- 172.21.15.33:0/667900950 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc01ecc0 con 0x5623de67e070 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5b37fe640 1 -- 172.21.15.33:0/667900950 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe5cc01f420 con 0x5623de67e070 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5e09ad740 1 -- 172.21.15.33:0/667900950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c80abf30 con 0x5623de67e070 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5b37fe640 1 -- 172.21.15.33:0/667900950 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5cc032050 con 0x5623de67e070 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5e09ad740 10 client.16677 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.386+0000 7fe5e09ad740 1 -- 172.21.15.33:0/667900950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5623deaab410 con 0x5623de67e070 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5b37fe640 1 -- 172.21.15.33:0/667900950 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5c80abf30 con 0x5623de67e070 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5b37fe640 1 -- 172.21.15.33:0/667900950 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe5cc01c610 con 0x5623de67e070 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5e09ad740 10 client.16677 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:33.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5e09ad740 10 client.16677 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5e09ad740 20 client.16677 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5623de611da0 0x5623deaadbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5e09ad740 4 client.16677 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5e09ad740 1 -- 172.21.15.33:0/667900950 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5623de998070 con 0x5623de611da0 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5623de611da0 0x5623deaadbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5b37fe640 10 client.16677 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.387+0000 7fe5d3fff640 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5623de611da0 0x5623deaadbf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3523b1bfa04719a9 server_cookie=2f567d28f10cdcb5 in_seq=0 out_seq=0 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5b37fe640 1 -- 172.21.15.33:0/667900950 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5623de998070 con 0x5623de611da0 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5b37fe640 10 client.16677 handle_command_reply: tid=0 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 client.16677 shutdown 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 -- 172.21.15.33:0/667900950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de67e070 msgr2=0x5623deaa3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de67e070 0x5623deaa3970 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc012960 tx=0x7fe5cc004ab0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 -- 172.21.15.33:0/667900950 shutdown_connections 2024-08-28T19:36:33.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5623de611da0 0x5623deaadbf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5b37fe640 0 client.16677 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:36:33.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5623de67e070 0x5623deaa3970 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5623de65d390 0x5623dea441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 --2- 172.21.15.33:0/667900950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623de6551b0 0x5623dea43be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 -- 172.21.15.33:0/667900950 >> 172.21.15.33:0/667900950 conn(0x5623de672460 msgr2=0x5623dea2fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:33.410 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 -- 172.21.15.33:0/667900950 shutdown_connections 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 1 -- 172.21.15.33:0/667900950 wait complete. 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.388+0000 7fe5e09ad740 20 client.16677 trim_cache size 0 max 16384 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 -- 172.21.15.33:0/1939080487 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5bc0b4e70 msgr2=0x7fe5bc0b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5bc0b4e70 0x7fe5bc0b7380 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc005fd0 tx=0x7fe5cc009560 comp rx=0 tx=0).stop 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 -- 172.21.15.33:0/1939080487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5d4108160 msgr2=0x7fe5d419a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5d4108160 0x7fe5d419a830 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800c970 tx=0x7fe5c800ce30 comp rx=0 tx=0).stop 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 -- 172.21.15.33:0/1939080487 shutdown_connections 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5bc0b4e70 0x7fe5bc0b7380 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5d4108ab0 0x7fe5d419fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5d4108160 0x7fe5d419a830 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 --2- 172.21.15.33:0/1939080487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d4102820 0x7fe5d419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:33.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 -- 172.21.15.33:0/1939080487 >> 172.21.15.33:0/1939080487 conn(0x7fe5d40794e0 msgr2=0x7fe5d41012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:33.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 -- 172.21.15.33:0/1939080487 shutdown_connections 2024-08-28T19:36:33.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:33.389+0000 7fe5da438640 1 -- 172.21.15.33:0/1939080487 wait complete. 2024-08-28T19:36:34.221 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:36:34.474 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:35.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.062+0000 7fb077c08640 1 -- 172.21.15.33:0/2786507172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb070108a90 msgr2=0x7fb07010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.062+0000 7fb077c08640 1 --2- 172.21.15.33:0/2786507172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb070108a90 0x7fb07010f2c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb068009900 tx=0x7fb06802a410 comp rx=0 tx=0).stop 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.062+0000 7fb077c08640 1 -- 172.21.15.33:0/2786507172 shutdown_connections 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.062+0000 7fb077c08640 1 --2- 172.21.15.33:0/2786507172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb070108a90 0x7fb07010f2c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.062+0000 7fb077c08640 1 --2- 172.21.15.33:0/2786507172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb070108140 0x7fb070108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.062+0000 7fb077c08640 1 --2- 172.21.15.33:0/2786507172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb070102800 0x7fb070102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.062+0000 7fb077c08640 1 -- 172.21.15.33:0/2786507172 >> 172.21.15.33:0/2786507172 conn(0x7fb070079500 msgr2=0x7fb070079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.062+0000 7fb077c08640 1 -- 172.21.15.33:0/2786507172 shutdown_connections 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.062+0000 7fb077c08640 1 -- 172.21.15.33:0/2786507172 wait complete. 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.062+0000 7fb077c08640 1 Processor -- start 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb077c08640 1 -- start start 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb077c08640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb070102800 0x7fb07019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb077c08640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb070108140 0x7fb07019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb077c08640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb070108a90 0x7fb07019fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb077c08640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb070113860 con 0x7fb070108a90 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb077c08640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb0701136e0 con 0x7fb070108140 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb077c08640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb0701139e0 con 0x7fb070102800 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0761a5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb070108a90 0x7fb07019fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0761a5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb070108a90 0x7fb07019fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58142/0 (socket says 172.21.15.33:58142) 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0761a5640 1 -- 172.21.15.33:0/137713184 learned_addr learned my addr 172.21.15.33:0/137713184 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0751a3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb070108140 0x7fb07019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0759a4640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb070102800 0x7fb07019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0761a5640 1 -- 172.21.15.33:0/137713184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb070102800 msgr2=0x7fb07019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0761a5640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb070102800 0x7fb07019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0761a5640 1 -- 172.21.15.33:0/137713184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb070108140 msgr2=0x7fb07019a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:35.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0761a5640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb070108140 0x7fb07019a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0761a5640 1 -- 172.21.15.33:0/137713184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0701a0180 con 0x7fb070108a90 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0751a3640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb070108140 0x7fb07019a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.063+0000 7fb0759a4640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb070102800 0x7fb07019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.064+0000 7fb0761a5640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb070108a90 0x7fb07019fa50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb068004770 tx=0x7fb068004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.064+0000 7fb06effd640 1 -- 172.21.15.33:0/137713184 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06803f030 con 0x7fb070108a90 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.064+0000 7fb06effd640 1 -- 172.21.15.33:0/137713184 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb068004440 con 0x7fb070108a90 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.064+0000 7fb077c08640 1 -- 172.21.15.33:0/137713184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0701a0410 con 0x7fb070108a90 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.064+0000 7fb06effd640 1 -- 172.21.15.33:0/137713184 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068035070 con 0x7fb070108a90 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.064+0000 7fb077c08640 1 -- 172.21.15.33:0/137713184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0701a6bd0 con 0x7fb070108a90 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.066+0000 7fb07e17d740 1 Processor -- start 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.066+0000 7fb06effd640 1 -- 172.21.15.33:0/137713184 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb068042030 con 0x7fb070108a90 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb07e17d740 1 -- start start 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 0x556fa47f0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa47f0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb07e17d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556fa4767680 con 0x556fa442a390 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb07e17d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556fa4756c10 con 0x556fa444b070 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb07e17d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556fa475abc0 con 0x556fa44221b0 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb0751a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb0751a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47f0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58156/0 (socket says 172.21.15.33:58156) 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb0751a3640 1 -- 172.21.15.33:0/2100046848 learned_addr learned my addr 172.21.15.33:0/2100046848 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb0751a3640 1 --2- 172.21.15.33:0/2100046848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 0x556fa47f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb0759a4640 1 --2- 172.21.15.33:0/2100046848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa47f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb06effd640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0580b4d20 0x7fb0580b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb0751a3640 1 -- 172.21.15.33:0/2100046848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 msgr2=0x556fa47f0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.067+0000 7fb0751a3640 1 --2- 172.21.15.33:0/2100046848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa47f0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.068+0000 7fb0751a3640 1 -- 172.21.15.33:0/2100046848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 msgr2=0x556fa47f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.068+0000 7fb0751a3640 1 --2- 172.21.15.33:0/2100046848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 0x556fa47f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.068+0000 7fb0751a3640 1 -- 172.21.15.33:0/2100046848 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa44b6650 con 0x556fa442a390 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.068+0000 7fb0761a5640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0580b4d20 0x7fb0580b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.068+0000 7fb06effd640 1 -- 172.21.15.33:0/137713184 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fb068105be0 con 0x7fb070108a90 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.068+0000 7fb0751a3640 1 --2- 172.21.15.33:0/2100046848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47f0d90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb064011b60 tx=0x7fb064005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e43bcade92e442 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.068+0000 7fb057fff640 1 -- 172.21.15.33:0/2100046848 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06400fc50 con 0x556fa442a390 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.068+0000 7fb057fff640 1 -- 172.21.15.33:0/2100046848 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb06400fdf0 con 0x556fa442a390 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.068+0000 7fb057fff640 1 -- 172.21.15.33:0/2100046848 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0640039b0 con 0x556fa442a390 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.069+0000 7fb07e17d740 1 -- 172.21.15.33:0/2100046848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 msgr2=0x556fa47f0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.069+0000 7fb0761a5640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0580b4d20 0x7fb0580b7230 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb068103090 tx=0x7fb0680fc180 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.069+0000 7fb07e17d740 1 --2- 172.21.15.33:0/2100046848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47f0d90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb064011b60 tx=0x7fb064005850 comp rx=0 tx=0).stop 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.069+0000 7fb07e17d740 1 -- 172.21.15.33:0/2100046848 shutdown_connections 2024-08-28T19:36:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.069+0000 7fb07e17d740 1 --2- 172.21.15.33:0/2100046848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47f0d90 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.069+0000 7fb07e17d740 1 --2- 172.21.15.33:0/2100046848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa47f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.069+0000 7fb07e17d740 1 --2- 172.21.15.33:0/2100046848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 0x556fa47f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.069+0000 7fb07e17d740 1 -- 172.21.15.33:0/2100046848 >> 172.21.15.33:0/2100046848 conn(0x556fa443f460 msgr2=0x556fa47ee200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:35.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.069+0000 7fb07e17d740 1 -- 172.21.15.33:0/2100046848 shutdown_connections 2024-08-28T19:36:35.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.069+0000 7fb07e17d740 1 -- 172.21.15.33:0/2100046848 wait complete. 2024-08-28T19:36:35.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb07e17d740 1 -- start start 2024-08-28T19:36:35.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb07e17d740 1 Processor -- start 2024-08-28T19:36:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa47fba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47fbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 0x556fa4807e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb07e17d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556fa45b9700 con 0x556fa442a390 2024-08-28T19:36:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb07e17d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556fa46dd750 con 0x556fa444b070 2024-08-28T19:36:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb07e17d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556fa47feaf0 con 0x556fa44221b0 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb07e17d740 10 client.0 _ll_register_callbacks cb 0x556fa470ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb0759a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47fbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb0759a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47fbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58164/0 (socket says 172.21.15.33:58164) 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.070+0000 7fb0759a4640 1 -- 172.21.15.33:0/1972392253 learned_addr learned my addr 172.21.15.33:0/1972392253 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0751a3640 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa47fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0751a3640 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 0x556fa4807e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0759a4640 1 -- 172.21.15.33:0/1972392253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 msgr2=0x556fa47fba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0759a4640 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa47fba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0759a4640 1 -- 172.21.15.33:0/1972392253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 msgr2=0x556fa4807e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0759a4640 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 0x556fa4807e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0759a4640 1 -- 172.21.15.33:0/1972392253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fa4716900 con 0x556fa442a390 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0751a3640 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 0x556fa4807e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0759a4640 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47fbf40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb0600042f0 tx=0x7fb060003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a751a85526cba5a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:35.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0557fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0557fa640 1 -- 172.21.15.33:0/1972392253 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0600119a0 con 0x556fa442a390 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0557fa640 1 -- 172.21.15.33:0/1972392253 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fb060011b40 con 0x556fa442a390 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb07e17d740 1 -- 172.21.15.33:0/1972392253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb06400fdf0 con 0x556fa442a390 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb0557fa640 1 -- 172.21.15.33:0/1972392253 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb060024050 con 0x556fa442a390 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb07e17d740 10 client.16689 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.071+0000 7fb07e17d740 1 -- 172.21.15.33:0/1972392253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556fa480a8f0 con 0x556fa442a390 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.072+0000 7fb0557fa640 1 -- 172.21.15.33:0/1972392253 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb06400fdf0 con 0x556fa442a390 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.072+0000 7fb0557fa640 1 -- 172.21.15.33:0/1972392253 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb060010440 con 0x556fa442a390 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.072+0000 7fb07e17d740 10 client.16689 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.072+0000 7fb07e17d740 10 client.16689 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.072+0000 7fb07e17d740 20 client.16689 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.072+0000 7fb07e17d740 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556fa44099f0 0x556fa480de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.072+0000 7fb07e17d740 4 client.16689 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.072+0000 7fb07e17d740 1 -- 172.21.15.33:0/1972392253 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fa47695d0 con 0x556fa44099f0 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.072+0000 7fb0751a3640 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556fa44099f0 0x556fa480de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.073+0000 7fb0557fa640 10 client.16689 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.073+0000 7fb0751a3640 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556fa44099f0 0x556fa480de40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=83675ffa6200fe98 server_cookie=3fd4fad16fea79d5 in_seq=0 out_seq=0 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.073+0000 7fb0557fa640 1 -- 172.21.15.33:0/1972392253 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556fa47695d0 con 0x556fa44099f0 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.073+0000 7fb0557fa640 10 client.16689 handle_command_reply: tid=0 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.073+0000 7fb07e17d740 1 client.16689 shutdown 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 1 -- 172.21.15.33:0/1972392253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 msgr2=0x556fa47fbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47fbf40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb0600042f0 tx=0x7fb060003f90 comp rx=0 tx=0).stop 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 1 -- 172.21.15.33:0/1972392253 shutdown_connections 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556fa44099f0 0x556fa480de40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa444b070 0x556fa4807e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa442a390 0x556fa47fbf40 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 1 --2- 172.21.15.33:0/1972392253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa47fba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb0557fa640 0 client.16689 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:36:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 1 -- 172.21.15.33:0/1972392253 >> 172.21.15.33:0/1972392253 conn(0x556fa443f460 msgr2=0x556fa47f34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 1 -- 172.21.15.33:0/1972392253 shutdown_connections 2024-08-28T19:36:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 1 -- 172.21.15.33:0/1972392253 wait complete. 2024-08-28T19:36:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.074+0000 7fb07e17d740 20 client.16689 trim_cache size 0 max 16384 2024-08-28T19:36:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.087+0000 7fb07e17d740 1 Processor -- start 2024-08-28T19:36:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.087+0000 7fb07e17d740 1 -- start start 2024-08-28T19:36:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.087+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa44221b0 0x556fa47fbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.087+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa442a390 0x556fa4807d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.087+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa444b070 0x556fa47f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.087+0000 7fb07e17d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb0701b0b30 con 0x556fa44221b0 2024-08-28T19:36:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.087+0000 7fb07e17d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb0701b2670 con 0x556fa442a390 2024-08-28T19:36:35.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.087+0000 7fb07e17d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb0701b1200 con 0x556fa444b070 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0751a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa44221b0 0x556fa47fbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0751a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa44221b0 0x556fa47fbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58176/0 (socket says 172.21.15.33:58176) 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0751a3640 1 -- 172.21.15.33:0/1194508856 learned_addr learned my addr 172.21.15.33:0/1194508856 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0759a4640 1 --2- 172.21.15.33:0/1194508856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa442a390 0x556fa4807d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0751a3640 1 -- 172.21.15.33:0/1194508856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa444b070 msgr2=0x556fa47f8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0751a3640 1 --2- 172.21.15.33:0/1194508856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa444b070 0x556fa47f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0751a3640 1 -- 172.21.15.33:0/1194508856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa442a390 msgr2=0x556fa4807d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0751a3640 1 --2- 172.21.15.33:0/1194508856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa442a390 0x556fa4807d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0751a3640 1 -- 172.21.15.33:0/1194508856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa47f3170 con 0x556fa44221b0 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0751a3640 1 --2- 172.21.15.33:0/1194508856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa44221b0 0x556fa47fbec0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb064009710 tx=0x7fb0640096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87378378fe554238 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0577fe640 1 -- 172.21.15.33:0/1194508856 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0640111c0 con 0x556fa44221b0 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0577fe640 1 -- 172.21.15.33:0/1194508856 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb064011360 con 0x556fa44221b0 2024-08-28T19:36:35.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.088+0000 7fb0577fe640 1 -- 172.21.15.33:0/1194508856 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064003df0 con 0x556fa44221b0 2024-08-28T19:36:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.089+0000 7fb07e17d740 1 -- 172.21.15.33:0/1194508856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa44221b0 msgr2=0x556fa47fbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.089+0000 7fb07e17d740 1 --2- 172.21.15.33:0/1194508856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa44221b0 0x556fa47fbec0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb064009710 tx=0x7fb0640096a0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.089+0000 7fb07e17d740 1 -- 172.21.15.33:0/1194508856 shutdown_connections 2024-08-28T19:36:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.089+0000 7fb07e17d740 1 --2- 172.21.15.33:0/1194508856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa444b070 0x556fa47f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.089+0000 7fb07e17d740 1 --2- 172.21.15.33:0/1194508856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa442a390 0x556fa4807d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.089+0000 7fb07e17d740 1 --2- 172.21.15.33:0/1194508856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa44221b0 0x556fa47fbec0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.089+0000 7fb07e17d740 1 -- 172.21.15.33:0/1194508856 >> 172.21.15.33:0/1194508856 conn(0x556fa443f460 msgr2=0x556fa47fb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.089+0000 7fb07e17d740 1 -- 172.21.15.33:0/1194508856 shutdown_connections 2024-08-28T19:36:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.089+0000 7fb07e17d740 1 -- 172.21.15.33:0/1194508856 wait complete. 2024-08-28T19:36:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.090+0000 7fb07e17d740 1 -- start start 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.090+0000 7fb07e17d740 1 Processor -- start 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.090+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa48000c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.090+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa442a390 0x556fa4800600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.090+0000 7fb07e17d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa444b070 0x556fa48777e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.090+0000 7fb07e17d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb0701b1fa0 con 0x556fa444b070 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.090+0000 7fb07e17d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb0701b18d0 con 0x556fa442a390 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.090+0000 7fb07e17d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb0701aeb10 con 0x556fa44221b0 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb07e17d740 10 client.0 _ll_register_callbacks cb 0x7fb060009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0751a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa444b070 0x556fa48777e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0751a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa444b070 0x556fa48777e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58178/0 (socket says 172.21.15.33:58178) 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0751a3640 1 -- 172.21.15.33:0/386184915 learned_addr learned my addr 172.21.15.33:0/386184915 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0759a4640 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa442a390 0x556fa4800600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0751a3640 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa48000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0751a3640 1 -- 172.21.15.33:0/386184915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 msgr2=0x556fa48000c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0751a3640 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa48000c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0751a3640 1 -- 172.21.15.33:0/386184915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa442a390 msgr2=0x556fa4800600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0751a3640 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa442a390 0x556fa4800600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0751a3640 1 -- 172.21.15.33:0/386184915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fa4800ed0 con 0x556fa444b070 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0751a3640 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa444b070 0x556fa48777e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb064003fd0 tx=0x7fb064011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dd20b9e1ad6f9b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0557fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0557fa640 1 -- 172.21.15.33:0/386184915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06403b070 con 0x556fa444b070 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb07e17d740 1 -- 172.21.15.33:0/386184915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb064011360 con 0x556fa444b070 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.091+0000 7fb0557fa640 1 -- 172.21.15.33:0/386184915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fb0640052c0 con 0x556fa444b070 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb0557fa640 1 -- 172.21.15.33:0/386184915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb064044050 con 0x556fa444b070 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb07e17d740 10 client.16695 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb07e17d740 1 -- 172.21.15.33:0/386184915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556fa4878da0 con 0x556fa444b070 2024-08-28T19:36:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb0557fa640 1 -- 172.21.15.33:0/386184915 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb064011360 con 0x556fa444b070 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb0557fa640 1 -- 172.21.15.33:0/386184915 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb06403e020 con 0x556fa444b070 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb07e17d740 10 client.16695 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb07e17d740 10 client.16695 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb07e17d740 20 client.16695 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb07e17d740 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556fa43deda0 0x556fa487b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb07e17d740 4 client.16695 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.092+0000 7fb07e17d740 1 -- 172.21.15.33:0/386184915 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556fa4765070 con 0x556fa43deda0 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.093+0000 7fb0759a4640 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556fa43deda0 0x556fa487b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.093+0000 7fb0759a4640 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556fa43deda0 0x556fa487b340 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d0e5e065844a349b server_cookie=b7c048ab02c74c1a in_seq=0 out_seq=0 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.093+0000 7fb0557fa640 10 client.16695 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.093+0000 7fb0557fa640 1 -- 172.21.15.33:0/386184915 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556fa4765070 con 0x556fa43deda0 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.093+0000 7fb0557fa640 10 client.16695 handle_command_reply: tid=0 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.093+0000 7fb07e17d740 1 client.16695 shutdown 2024-08-28T19:36:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.093+0000 7fb07e17d740 1 -- 172.21.15.33:0/386184915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa444b070 msgr2=0x556fa48777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.093+0000 7fb07e17d740 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa444b070 0x556fa48777e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb064003fd0 tx=0x7fb064011930 comp rx=0 tx=0).stop 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb07e17d740 1 -- 172.21.15.33:0/386184915 shutdown_connections 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb07e17d740 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556fa43deda0 0x556fa487b340 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb07e17d740 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fa444b070 0x556fa48777e0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb07e17d740 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fa442a390 0x556fa4800600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb0557fa640 0 client.16695 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb07e17d740 1 --2- 172.21.15.33:0/386184915 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fa44221b0 0x556fa48000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb07e17d740 1 -- 172.21.15.33:0/386184915 >> 172.21.15.33:0/386184915 conn(0x556fa443f460 msgr2=0x556fa47f1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb07e17d740 1 -- 172.21.15.33:0/386184915 shutdown_connections 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb07e17d740 1 -- 172.21.15.33:0/386184915 wait complete. 2024-08-28T19:36:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb07e17d740 20 client.16695 trim_cache size 0 max 16384 2024-08-28T19:36:35.101 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:36:35.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 -- 172.21.15.33:0/137713184 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0580b4d20 msgr2=0x7fb0580b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:35.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0580b4d20 0x7fb0580b7230 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb068103090 tx=0x7fb0680fc180 comp rx=0 tx=0).stop 2024-08-28T19:36:35.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 -- 172.21.15.33:0/137713184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb070108a90 msgr2=0x7fb07019fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb070108a90 0x7fb07019fa50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb068004770 tx=0x7fb068004040 comp rx=0 tx=0).stop 2024-08-28T19:36:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 -- 172.21.15.33:0/137713184 shutdown_connections 2024-08-28T19:36:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb070108a90 0x7fb07019fa50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb070108140 0x7fb07019a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb0580b4d20 0x7fb0580b7230 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 --2- 172.21.15.33:0/137713184 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb070102800 0x7fb07019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 -- 172.21.15.33:0/137713184 >> 172.21.15.33:0/137713184 conn(0x7fb070079500 msgr2=0x7fb070106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 -- 172.21.15.33:0/137713184 shutdown_connections 2024-08-28T19:36:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:35.094+0000 7fb077c08640 1 -- 172.21.15.33:0/137713184 wait complete. 2024-08-28T19:36:35.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:35 smithi059 ceph-mon[22052]: pgmap v466: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-08-28T19:36:35.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:35 smithi122 ceph-mon[22174]: pgmap v466: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-08-28T19:36:35.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:35 smithi033 ceph-mon[18549]: pgmap v466: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-08-28T19:36:35.872 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:36:36.127 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:36.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.715+0000 7fb99fbfb640 1 -- 172.21.15.33:0/125159052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb998102800 msgr2=0x7fb998102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:36.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.715+0000 7fb99fbfb640 1 --2- 172.21.15.33:0/125159052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb998102800 0x7fb998102c10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb994009900 tx=0x7fb99402a410 comp rx=0 tx=0).stop 2024-08-28T19:36:36.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.715+0000 7fb99fbfb640 1 -- 172.21.15.33:0/125159052 shutdown_connections 2024-08-28T19:36:36.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.715+0000 7fb99fbfb640 1 --2- 172.21.15.33:0/125159052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb998108a90 0x7fb99810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.715+0000 7fb99fbfb640 1 --2- 172.21.15.33:0/125159052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb998108140 0x7fb998108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.715+0000 7fb99fbfb640 1 --2- 172.21.15.33:0/125159052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb998102800 0x7fb998102c10 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.715+0000 7fb99fbfb640 1 -- 172.21.15.33:0/125159052 >> 172.21.15.33:0/125159052 conn(0x7fb9980794d0 msgr2=0x7fb9980798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:36.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.715+0000 7fb99fbfb640 1 -- 172.21.15.33:0/125159052 shutdown_connections 2024-08-28T19:36:36.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.716+0000 7fb99fbfb640 1 -- 172.21.15.33:0/125159052 wait complete. 2024-08-28T19:36:36.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.716+0000 7fb99fbfb640 1 Processor -- start 2024-08-28T19:36:36.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.716+0000 7fb99fbfb640 1 -- start start 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.716+0000 7fb99fbfb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb998102800 0x7fb99819c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.716+0000 7fb99fbfb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb998108140 0x7fb99819cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.716+0000 7fb99fbfb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb998108a90 0x7fb9981a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.716+0000 7fb99fbfb640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981126f0 con 0x7fb998108140 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.716+0000 7fb99fbfb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb998112570 con 0x7fb998102800 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.716+0000 7fb99fbfb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb998112870 con 0x7fb998108a90 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99d196640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb998108140 0x7fb99819cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99d196640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb998108140 0x7fb99819cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58194/0 (socket says 172.21.15.33:58194) 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99d196640 1 -- 172.21.15.33:0/2172473968 learned_addr learned my addr 172.21.15.33:0/2172473968 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99d997640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb998102800 0x7fb99819c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99e198640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb998108a90 0x7fb9981a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99d196640 1 -- 172.21.15.33:0/2172473968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb998108a90 msgr2=0x7fb9981a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:36.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99d196640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb998108a90 0x7fb9981a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99d196640 1 -- 172.21.15.33:0/2172473968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb998102800 msgr2=0x7fb99819c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99d196640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb998102800 0x7fb99819c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99d196640 1 -- 172.21.15.33:0/2172473968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9981a2480 con 0x7fb998108140 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99d196640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb998108140 0x7fb99819cab0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb988005fd0 tx=0x7fb98800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb98effd640 1 -- 172.21.15.33:0/2172473968 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988017070 con 0x7fb998108140 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb98effd640 1 -- 172.21.15.33:0/2172473968 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb988009c30 con 0x7fb998108140 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99fbfb640 1 -- 172.21.15.33:0/2172473968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9981a2770 con 0x7fb998108140 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb98effd640 1 -- 172.21.15.33:0/2172473968 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988003d30 con 0x7fb998108140 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.717+0000 7fb99fbfb640 1 -- 172.21.15.33:0/2172473968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9981a8ed0 con 0x7fb998108140 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.720+0000 7fb98effd640 1 -- 172.21.15.33:0/2172473968 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb988003ed0 con 0x7fb998108140 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.720+0000 7fb9a6170740 1 Processor -- start 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.720+0000 7fb9a6170740 1 -- start start 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.720+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 0x556ddc5f1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc22b390 0x556ddc5f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb9a6170740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556ddc568680 con 0x556ddc2231b0 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb9a6170740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556ddc557c10 con 0x556ddc24c070 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb9a6170740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556ddc55bbc0 con 0x556ddc22b390 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99d997640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99d997640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58210/0 (socket says 172.21.15.33:58210) 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99d997640 1 -- 172.21.15.33:0/1692603326 learned_addr learned my addr 172.21.15.33:0/1692603326 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99d196640 1 --2- 172.21.15.33:0/1692603326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc22b390 0x556ddc5f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99e198640 1 --2- 172.21.15.33:0/1692603326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 0x556ddc5f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb98effd640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9840b4ca0 0x7fb9840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99d997640 1 -- 172.21.15.33:0/1692603326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc22b390 msgr2=0x556ddc5f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99d997640 1 --2- 172.21.15.33:0/1692603326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc22b390 0x556ddc5f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99d997640 1 -- 172.21.15.33:0/1692603326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 msgr2=0x556ddc5f1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99d997640 1 --2- 172.21.15.33:0/1692603326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 0x556ddc5f1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99d997640 1 -- 172.21.15.33:0/1692603326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ddc2b7650 con 0x556ddc2231b0 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99e198640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9840b4ca0 0x7fb9840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb98effd640 1 -- 172.21.15.33:0/2172473968 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fb9880e5560 con 0x7fb998108140 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.721+0000 7fb99d997640 1 --2- 172.21.15.33:0/1692603326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f1850 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb994009900 tx=0x7fb994032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479f077d14ce7132 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.722+0000 7fb983fff640 1 -- 172.21.15.33:0/1692603326 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994040070 con 0x556ddc2231b0 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.722+0000 7fb983fff640 1 -- 172.21.15.33:0/1692603326 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb994004030 con 0x556ddc2231b0 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.722+0000 7fb983fff640 1 -- 172.21.15.33:0/1692603326 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994035040 con 0x556ddc2231b0 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.722+0000 7fb9a6170740 1 -- 172.21.15.33:0/1692603326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 msgr2=0x556ddc5f1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.722+0000 7fb9a6170740 1 --2- 172.21.15.33:0/1692603326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f1850 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb994009900 tx=0x7fb994032c40 comp rx=0 tx=0).stop 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.722+0000 7fb99e198640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9840b4ca0 0x7fb9840b71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb990005fd0 tx=0x7fb990004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.723+0000 7fb9a6170740 1 -- 172.21.15.33:0/1692603326 shutdown_connections 2024-08-28T19:36:36.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.723+0000 7fb9a6170740 1 --2- 172.21.15.33:0/1692603326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc22b390 0x556ddc5f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.723+0000 7fb9a6170740 1 --2- 172.21.15.33:0/1692603326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f1850 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.723+0000 7fb9a6170740 1 --2- 172.21.15.33:0/1692603326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 0x556ddc5f1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.723+0000 7fb9a6170740 1 -- 172.21.15.33:0/1692603326 >> 172.21.15.33:0/1692603326 conn(0x556ddc240460 msgr2=0x556ddc5ef200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.723+0000 7fb9a6170740 1 -- 172.21.15.33:0/1692603326 shutdown_connections 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.723+0000 7fb9a6170740 1 -- 172.21.15.33:0/1692603326 wait complete. 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.723+0000 7fb9a6170740 1 -- start start 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.723+0000 7fb9a6170740 1 Processor -- start 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5fca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc22b390 0x556ddc5fcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 0x556ddc608db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb9a6170740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556ddc3ba700 con 0x556ddc2231b0 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb9a6170740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556ddc4de750 con 0x556ddc24c070 2024-08-28T19:36:36.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb9a6170740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556ddc5ffa90 con 0x556ddc22b390 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb9a6170740 10 client.0 _ll_register_callbacks cb 0x556ddc50de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99d997640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99d997640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5fca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58214/0 (socket says 172.21.15.33:58214) 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99d997640 1 -- 172.21.15.33:0/2531789421 learned_addr learned my addr 172.21.15.33:0/2531789421 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99d196640 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc22b390 0x556ddc5fcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99e198640 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 0x556ddc608db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99d997640 1 -- 172.21.15.33:0/2531789421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc22b390 msgr2=0x556ddc5fcfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99d997640 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc22b390 0x556ddc5fcfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99d997640 1 -- 172.21.15.33:0/2531789421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 msgr2=0x556ddc608db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99d997640 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 0x556ddc608db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99d997640 1 -- 172.21.15.33:0/2531789421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ddc517900 con 0x556ddc2231b0 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99e198640 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 0x556ddc608db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb99d997640 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5fca90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb99402a930 tx=0x7fb9940051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8148a0b6893e2869 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb9817fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.724+0000 7fb9817fa640 1 -- 172.21.15.33:0/2531789421 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99404d060 con 0x556ddc2231b0 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9817fa640 1 -- 172.21.15.33:0/2531789421 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fb9940043e0 con 0x556ddc2231b0 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9a6170740 1 -- 172.21.15.33:0/2531789421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb994004030 con 0x556ddc2231b0 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9817fa640 1 -- 172.21.15.33:0/2531789421 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb994054050 con 0x556ddc2231b0 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9a6170740 10 client.16707 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9a6170740 1 -- 172.21.15.33:0/2531789421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556ddc60b830 con 0x556ddc2231b0 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9817fa640 1 -- 172.21.15.33:0/2531789421 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb994004030 con 0x556ddc2231b0 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9817fa640 1 -- 172.21.15.33:0/2531789421 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb994004e40 con 0x556ddc2231b0 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9a6170740 10 client.16707 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9a6170740 10 client.16707 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9a6170740 20 client.16707 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x556ddc20a9f0 0x556ddc60eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9a6170740 4 client.16707 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.725+0000 7fb9a6170740 1 -- 172.21.15.33:0/2531789421 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ddc56a5d0 con 0x556ddc20a9f0 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.726+0000 7fb99d196640 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x556ddc20a9f0 0x556ddc60eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.726+0000 7fb99d196640 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x556ddc20a9f0 0x556ddc60eb90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d53ff1e15d4ca77 server_cookie=8671482ad4aff7e in_seq=0 out_seq=0 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.726+0000 7fb9817fa640 10 client.16707 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9817fa640 1 -- 172.21.15.33:0/2531789421 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ddc56a5d0 con 0x556ddc20a9f0 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9817fa640 10 client.16707 handle_command_reply: tid=0 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 client.16707 shutdown 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 -- 172.21.15.33:0/2531789421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 msgr2=0x556ddc5fca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5fca90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb99402a930 tx=0x7fb9940051c0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 -- 172.21.15.33:0/2531789421 shutdown_connections 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc24c070 0x556ddc608db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc22b390 0x556ddc5fcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x556ddc20a9f0 0x556ddc60eb90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2531789421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5fca90 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 -- 172.21.15.33:0/2531789421 >> 172.21.15.33:0/2531789421 conn(0x556ddc240460 msgr2=0x556ddc5f44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:36.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9817fa640 0 client.16707 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:36:36.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 -- 172.21.15.33:0/2531789421 shutdown_connections 2024-08-28T19:36:36.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 1 -- 172.21.15.33:0/2531789421 wait complete. 2024-08-28T19:36:36.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.727+0000 7fb9a6170740 20 client.16707 trim_cache size 0 max 16384 2024-08-28T19:36:36.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb9a6170740 1 Processor -- start 2024-08-28T19:36:36.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb9a6170740 1 -- start start 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 0x556ddc5f4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc24c070 0x556ddc5f9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb9a6170740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981b2d90 con 0x556ddc2231b0 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb9a6170740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981b48d0 con 0x556ddc22b390 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb9a6170740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981b3460 con 0x556ddc24c070 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99d997640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99d997640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58216/0 (socket says 172.21.15.33:58216) 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99d997640 1 -- 172.21.15.33:0/3497452874 learned_addr learned my addr 172.21.15.33:0/3497452874 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99e198640 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc24c070 0x556ddc5f9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99d997640 1 -- 172.21.15.33:0/3497452874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc24c070 msgr2=0x556ddc5f9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:36.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99d196640 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 0x556ddc5f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99d997640 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc24c070 0x556ddc5f9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99d997640 1 -- 172.21.15.33:0/3497452874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 msgr2=0x556ddc5f4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:36.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99d997640 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 0x556ddc5f4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99d997640 1 -- 172.21.15.33:0/3497452874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ddc5fdd50 con 0x556ddc2231b0 2024-08-28T19:36:36.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99e198640 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc24c070 0x556ddc5f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:36.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.741+0000 7fb99d196640 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 0x556ddc5f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:36.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.742+0000 7fb99d997640 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f4410 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb9940053f0 tx=0x7fb994031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=addc248b6858b25a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:36.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.742+0000 7fb9837fe640 1 -- 172.21.15.33:0/3497452874 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99405d070 con 0x556ddc2231b0 2024-08-28T19:36:36.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.742+0000 7fb9837fe640 1 -- 172.21.15.33:0/3497452874 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9940316a0 con 0x556ddc2231b0 2024-08-28T19:36:36.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.742+0000 7fb9837fe640 1 -- 172.21.15.33:0/3497452874 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99404d070 con 0x556ddc2231b0 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 -- 172.21.15.33:0/3497452874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 msgr2=0x556ddc5f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f4410 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb9940053f0 tx=0x7fb994031400 comp rx=0 tx=0).stop 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 -- 172.21.15.33:0/3497452874 shutdown_connections 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc24c070 0x556ddc5f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 0x556ddc5f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 --2- 172.21.15.33:0/3497452874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc2231b0 0x556ddc5f4410 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 -- 172.21.15.33:0/3497452874 >> 172.21.15.33:0/3497452874 conn(0x556ddc240460 msgr2=0x556ddc5fb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 -- 172.21.15.33:0/3497452874 shutdown_connections 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 -- 172.21.15.33:0/3497452874 wait complete. 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 -- start start 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.743+0000 7fb9a6170740 1 Processor -- start 2024-08-28T19:36:36.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc2231b0 0x556ddc6125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 0x556ddc60fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9a6170740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc24c070 0x556ddc6101e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9a6170740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981b4200 con 0x556ddc24c070 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9a6170740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981b3b30 con 0x556ddc22b390 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9a6170740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981b0d70 con 0x556ddc2231b0 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9a6170740 10 client.0 _ll_register_callbacks cb 0x7fb9900099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99e198640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc24c070 0x556ddc6101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99e198640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc24c070 0x556ddc6101e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58224/0 (socket says 172.21.15.33:58224) 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99e198640 1 -- 172.21.15.33:0/2977776244 learned_addr learned my addr 172.21.15.33:0/2977776244 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99d997640 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc2231b0 0x556ddc6125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99d196640 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 0x556ddc60fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99e198640 1 -- 172.21.15.33:0/2977776244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc2231b0 msgr2=0x556ddc6125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99e198640 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc2231b0 0x556ddc6125c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99e198640 1 -- 172.21.15.33:0/2977776244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 msgr2=0x556ddc60fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99e198640 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 0x556ddc60fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99e198640 1 -- 172.21.15.33:0/2977776244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ddc678310 con 0x556ddc24c070 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb99e198640 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc24c070 0x556ddc6101e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb990003f30 tx=0x7fb990004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913d8d337b0e8be9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9817fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9817fa640 1 -- 172.21.15.33:0/2977776244 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990010a20 con 0x556ddc24c070 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9817fa640 1 -- 172.21.15.33:0/2977776244 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fb990010bc0 con 0x556ddc24c070 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.744+0000 7fb9a6170740 1 -- 172.21.15.33:0/2977776244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9940316a0 con 0x556ddc24c070 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9817fa640 1 -- 172.21.15.33:0/2977776244 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb990010dc0 con 0x556ddc24c070 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9a6170740 10 client.16713 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9a6170740 1 -- 172.21.15.33:0/2977776244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556ddc6793a0 con 0x556ddc24c070 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9817fa640 1 -- 172.21.15.33:0/2977776244 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9940316a0 con 0x556ddc24c070 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9817fa640 1 -- 172.21.15.33:0/2977776244 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb990022540 con 0x556ddc24c070 2024-08-28T19:36:36.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9a6170740 10 client.16713 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9a6170740 10 client.16713 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9a6170740 20 client.16713 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x556ddc1dfda0 0x556ddc67bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9a6170740 4 client.16713 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb9a6170740 1 -- 172.21.15.33:0/2977776244 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ddc566070 con 0x556ddc1dfda0 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.745+0000 7fb99d997640 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x556ddc1dfda0 0x556ddc67bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb99d997640 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x556ddc1dfda0 0x556ddc67bb60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be8d3a9259ceb67f server_cookie=b126c5200c171e27 in_seq=0 out_seq=0 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9817fa640 10 client.16713 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9817fa640 1 -- 172.21.15.33:0/2977776244 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ddc566070 con 0x556ddc1dfda0 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9817fa640 10 client.16713 handle_command_reply: tid=0 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 client.16713 shutdown 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 -- 172.21.15.33:0/2977776244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc24c070 msgr2=0x556ddc6101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc24c070 0x556ddc6101e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb990003f30 tx=0x7fb990004ab0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 -- 172.21.15.33:0/2977776244 shutdown_connections 2024-08-28T19:36:36.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x556ddc1dfda0 0x556ddc67bb60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556ddc24c070 0x556ddc6101e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556ddc22b390 0x556ddc60fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 --2- 172.21.15.33:0/2977776244 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556ddc2231b0 0x556ddc6125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9817fa640 0 client.16713 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:36:36.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 -- 172.21.15.33:0/2977776244 >> 172.21.15.33:0/2977776244 conn(0x556ddc240460 msgr2=0x556ddc5f2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:36.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 -- 172.21.15.33:0/2977776244 shutdown_connections 2024-08-28T19:36:36.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.746+0000 7fb9a6170740 1 -- 172.21.15.33:0/2977776244 wait complete. 2024-08-28T19:36:36.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb9a6170740 20 client.16713 trim_cache size 0 max 16384 2024-08-28T19:36:36.753 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:36:36.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 -- 172.21.15.33:0/2172473968 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9840b4ca0 msgr2=0x7fb9840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:36.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9840b4ca0 0x7fb9840b71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb990005fd0 tx=0x7fb990004a40 comp rx=0 tx=0).stop 2024-08-28T19:36:36.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 -- 172.21.15.33:0/2172473968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb998108140 msgr2=0x7fb99819cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:36.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb998108140 0x7fb99819cab0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb988005fd0 tx=0x7fb98800dde0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 -- 172.21.15.33:0/2172473968 shutdown_connections 2024-08-28T19:36:36.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb9840b4ca0 0x7fb9840b71b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb998108a90 0x7fb9981a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb998108140 0x7fb99819cab0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 --2- 172.21.15.33:0/2172473968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb998102800 0x7fb99819c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:36.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 -- 172.21.15.33:0/2172473968 >> 172.21.15.33:0/2172473968 conn(0x7fb9980794d0 msgr2=0x7fb9981016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:36.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 -- 172.21.15.33:0/2172473968 shutdown_connections 2024-08-28T19:36:36.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:36.747+0000 7fb99fbfb640 1 -- 172.21.15.33:0/2172473968 wait complete. 2024-08-28T19:36:37.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:37 smithi059 ceph-mon[22052]: pgmap v467: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:36:37.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:37 smithi122 ceph-mon[22174]: pgmap v467: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:36:37.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:37 smithi033 ceph-mon[18549]: pgmap v467: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:36:37.552 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:36:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:38.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.325+0000 7f32da6f6640 1 -- 172.21.15.33:0/590699490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d4109b90 msgr2=0x7f32d41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:38.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.325+0000 7f32da6f6640 1 --2- 172.21.15.33:0/590699490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d4109b90 0x7f32d41103c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009ca0 tx=0x7f32cc02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.326+0000 7f32da6f6640 1 -- 172.21.15.33:0/590699490 shutdown_connections 2024-08-28T19:36:38.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.326+0000 7f32da6f6640 1 --2- 172.21.15.33:0/590699490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d4109b90 0x7f32d41103c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.326+0000 7f32da6f6640 1 --2- 172.21.15.33:0/590699490 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32d4109240 0x7f32d4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.326+0000 7f32da6f6640 1 --2- 172.21.15.33:0/590699490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d4103900 0x7f32d4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.326+0000 7f32da6f6640 1 -- 172.21.15.33:0/590699490 >> 172.21.15.33:0/590699490 conn(0x7f32d407b5f0 msgr2=0x7f32d407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.326+0000 7f32da6f6640 1 -- 172.21.15.33:0/590699490 shutdown_connections 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.326+0000 7f32da6f6640 1 -- 172.21.15.33:0/590699490 wait complete. 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.326+0000 7f32da6f6640 1 Processor -- start 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.326+0000 7f32da6f6640 1 -- start start 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32da6f6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d4103900 0x7f32d40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32da6f6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d4109240 0x7f32d40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32da6f6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32d4109b90 0x7f32d4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32da6f6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32d4113850 con 0x7f32d4103900 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32da6f6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41136d0 con 0x7f32d4109240 2024-08-28T19:36:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32da6f6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41139d0 con 0x7f32d4109b90 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d4103900 0x7f32d40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d4103900 0x7f32d40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58242/0 (socket says 172.21.15.33:58242) 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d3fff640 1 -- 172.21.15.33:0/4092757200 learned_addr learned my addr 172.21.15.33:0/4092757200 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d37fe640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d4109240 0x7f32d40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d8c93640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32d4109b90 0x7f32d4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d3fff640 1 -- 172.21.15.33:0/4092757200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32d4109b90 msgr2=0x7f32d4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d3fff640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32d4109b90 0x7f32d4075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d3fff640 1 -- 172.21.15.33:0/4092757200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d4109240 msgr2=0x7f32d40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d3fff640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d4109240 0x7f32d40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d3fff640 1 -- 172.21.15.33:0/4092757200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d41a84c0 con 0x7f32d4103900 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d37fe640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d4109240 0x7f32d40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:38.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d3fff640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d4103900 0x7f32d40754b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f32c400d950 tx=0x7f32c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.327+0000 7f32d17fa640 1 -- 172.21.15.33:0/4092757200 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4017030 con 0x7f32d4103900 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.328+0000 7f32d17fa640 1 -- 172.21.15.33:0/4092757200 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32c4004020 con 0x7f32d4103900 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.328+0000 7f32da6f6640 1 -- 172.21.15.33:0/4092757200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d41a87b0 con 0x7f32d4103900 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.328+0000 7f32d17fa640 1 -- 172.21.15.33:0/4092757200 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40047a0 con 0x7f32d4103900 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.328+0000 7f32da6f6640 1 -- 172.21.15.33:0/4092757200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d41a8cf0 con 0x7f32d4103900 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32e0c6b740 1 Processor -- start 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32e0c6b740 1 -- start start 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd163070 0x5562bd508310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd13a1b0 0x5562bd508850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd142390 0x5562bd508d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5562bd47f680 con 0x5562bd142390 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5562bd46ec10 con 0x5562bd163070 2024-08-28T19:36:38.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5562bd472bc0 con 0x5562bd13a1b0 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd142390 0x5562bd508d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd142390 0x5562bd508d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58246/0 (socket says 172.21.15.33:58246) 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32d37fe640 1 -- 172.21.15.33:0/2147658332 learned_addr learned my addr 172.21.15.33:0/2147658332 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32d8c93640 1 --2- 172.21.15.33:0/2147658332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd163070 0x5562bd508310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32d37fe640 1 -- 172.21.15.33:0/2147658332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd13a1b0 msgr2=0x5562bd508850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32d37fe640 1 --2- 172.21.15.33:0/2147658332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd13a1b0 0x5562bd508850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32d37fe640 1 -- 172.21.15.33:0/2147658332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd163070 msgr2=0x5562bd508310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32d37fe640 1 --2- 172.21.15.33:0/2147658332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd163070 0x5562bd508310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.331+0000 7f32d37fe640 1 -- 172.21.15.33:0/2147658332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562bd1ce650 con 0x5562bd142390 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.332+0000 7f32d17fa640 1 -- 172.21.15.33:0/4092757200 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f32c4009a30 con 0x7f32d4103900 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.332+0000 7f32d37fe640 1 --2- 172.21.15.33:0/2147658332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd142390 0x5562bd508d90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f32c800bc60 tx=0x7f32c800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcc4b2947856db8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:38.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.332+0000 7f32ba7fc640 1 -- 172.21.15.33:0/2147658332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8015070 con 0x5562bd142390 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.332+0000 7f32ba7fc640 1 -- 172.21.15.33:0/2147658332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32c80054d0 con 0x5562bd142390 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.332+0000 7f32ba7fc640 1 -- 172.21.15.33:0/2147658332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8011440 con 0x5562bd142390 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.332+0000 7f32d17fa640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32bc0b4ca0 0x7f32bc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.332+0000 7f32d8c93640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32bc0b4ca0 0x7f32bc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.332+0000 7f32d17fa640 1 -- 172.21.15.33:0/4092757200 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f32c40e5460 con 0x7f32d4103900 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32e0c6b740 1 -- 172.21.15.33:0/2147658332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd142390 msgr2=0x5562bd508d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/2147658332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd142390 0x5562bd508d90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f32c800bc60 tx=0x7f32c800f730 comp rx=0 tx=0).stop 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32e0c6b740 1 -- 172.21.15.33:0/2147658332 shutdown_connections 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/2147658332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd142390 0x5562bd508d90 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/2147658332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd13a1b0 0x5562bd508850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/2147658332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd163070 0x5562bd508310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32d8c93640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32bc0b4ca0 0x7f32bc0b71b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f32cc006010 tx=0x7f32cc009440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:38.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32e0c6b740 1 -- 172.21.15.33:0/2147658332 >> 172.21.15.33:0/2147658332 conn(0x5562bd157460 msgr2=0x5562bd506200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32e0c6b740 1 -- 172.21.15.33:0/2147658332 shutdown_connections 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32e0c6b740 1 -- 172.21.15.33:0/2147658332 wait complete. 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.333+0000 7f32e0c6b740 1 -- start start 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32e0c6b740 1 Processor -- start 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 0x5562bd513b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 0x5562bd514090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd163070 0x5562bd51fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5562bd2d1700 con 0x5562bd163070 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5562bd3f5750 con 0x5562bd13a1b0 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5562bd516af0 con 0x5562bd142390 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 0x5562bd513b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32e0c6b740 10 client.0 _ll_register_callbacks cb 0x5562bd424e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 0x5562bd513b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:56706/0 (socket says 172.21.15.33:56706) 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32d3fff640 1 -- 172.21.15.33:0/3444669216 learned_addr learned my addr 172.21.15.33:0/3444669216 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32d8c93640 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd163070 0x5562bd51fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.334+0000 7f32d37fe640 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 0x5562bd514090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32d3fff640 1 -- 172.21.15.33:0/3444669216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 msgr2=0x5562bd514090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32d3fff640 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 0x5562bd514090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32d3fff640 1 -- 172.21.15.33:0/3444669216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd163070 msgr2=0x5562bd51fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32d3fff640 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd163070 0x5562bd51fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32d3fff640 1 -- 172.21.15.33:0/3444669216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562bd42e900 con 0x5562bd13a1b0 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32d8c93640 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd163070 0x5562bd51fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32d37fe640 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 0x5562bd514090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32d3fff640 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 0x5562bd513b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32c40e2e60 tx=0x7f32c40ab060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86f6d04ccff1b198 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:38.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32b37fe640 1 -- 172.21.15.33:0/3444669216 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40b0070 con 0x5562bd13a1b0 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32b37fe640 1 -- 172.21.15.33:0/3444669216 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f32c40e5170 con 0x5562bd13a1b0 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3444669216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32c80054d0 con 0x5562bd13a1b0 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32b37fe640 1 -- 172.21.15.33:0/3444669216 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f32c40b4b20 con 0x5562bd13a1b0 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32e0c6b740 10 client.26120 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.335+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3444669216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5562bd5229e0 con 0x5562bd13a1b0 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.336+0000 7f32b37fe640 1 -- 172.21.15.33:0/3444669216 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32c80054d0 con 0x5562bd13a1b0 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.336+0000 7f32b37fe640 1 -- 172.21.15.33:0/3444669216 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f32c405b1d0 con 0x5562bd13a1b0 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.336+0000 7f32e0c6b740 10 client.26120 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.336+0000 7f32e0c6b740 10 client.26120 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.336+0000 7f32e0c6b740 20 client.26120 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.336+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5562bd1219f0 0x5562bd525eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.336+0000 7f32e0c6b740 4 client.26120 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:38.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.336+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3444669216 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562bd4815d0 con 0x5562bd1219f0 2024-08-28T19:36:38.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.336+0000 7f32d37fe640 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5562bd1219f0 0x5562bd525eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.337+0000 7f32b37fe640 10 client.26120 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:36:38.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.337+0000 7f32d37fe640 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5562bd1219f0 0x5562bd525eb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e9de967e8167397 server_cookie=4e62da563e4e75dc in_seq=0 out_seq=0 2024-08-28T19:36:38.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32b37fe640 1 -- 172.21.15.33:0/3444669216 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562bd4815d0 con 0x5562bd1219f0 2024-08-28T19:36:38.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32b37fe640 10 client.26120 handle_command_reply: tid=0 2024-08-28T19:36:38.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 client.26120 shutdown 2024-08-28T19:36:38.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3444669216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 msgr2=0x5562bd513b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:38.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 0x5562bd513b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32c40e2e60 tx=0x7f32c40ab060 comp rx=0 tx=0).stop 2024-08-28T19:36:38.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3444669216 shutdown_connections 2024-08-28T19:36:38.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5562bd1219f0 0x5562bd525eb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd163070 0x5562bd51fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 0x5562bd514090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32b37fe640 0 client.26120 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:36:38.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3444669216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 0x5562bd513b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3444669216 >> 172.21.15.33:0/3444669216 conn(0x5562bd157460 msgr2=0x5562bd50b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:38.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3444669216 shutdown_connections 2024-08-28T19:36:38.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3444669216 wait complete. 2024-08-28T19:36:38.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.338+0000 7f32e0c6b740 20 client.26120 trim_cache size 0 max 16384 2024-08-28T19:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.351+0000 7f32e0c6b740 1 Processor -- start 2024-08-28T19:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.351+0000 7f32e0c6b740 1 -- start start 2024-08-28T19:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd50b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 0x5562bd50b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 0x5562bd510d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41b2cd0 con 0x5562bd1219f0 2024-08-28T19:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41b4810 con 0x5562bd13a1b0 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41b33a0 con 0x5562bd142390 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd50b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd50b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58254/0 (socket says 172.21.15.33:58254) 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d3fff640 1 -- 172.21.15.33:0/3171645827 learned_addr learned my addr 172.21.15.33:0/3171645827 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d8c93640 1 --2- 172.21.15.33:0/3171645827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 0x5562bd510d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d37fe640 1 --2- 172.21.15.33:0/3171645827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 0x5562bd50b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d3fff640 1 -- 172.21.15.33:0/3171645827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 msgr2=0x5562bd510d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d3fff640 1 --2- 172.21.15.33:0/3171645827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 0x5562bd510d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d3fff640 1 -- 172.21.15.33:0/3171645827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 msgr2=0x5562bd50b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d3fff640 1 --2- 172.21.15.33:0/3171645827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 0x5562bd50b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d3fff640 1 -- 172.21.15.33:0/3171645827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562bd516620 con 0x5562bd1219f0 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32d3fff640 1 --2- 172.21.15.33:0/3171645827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd50b410 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f32c40ab4b0 tx=0x7f32c4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da4164e08dac9ca server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32b9ffb640 1 -- 172.21.15.33:0/3171645827 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40a76c0 con 0x5562bd1219f0 2024-08-28T19:36:38.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32b9ffb640 1 -- 172.21.15.33:0/3171645827 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32c40b0070 con 0x5562bd1219f0 2024-08-28T19:36:38.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.352+0000 7f32b9ffb640 1 -- 172.21.15.33:0/3171645827 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40e2ae0 con 0x5562bd1219f0 2024-08-28T19:36:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.353+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3171645827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 msgr2=0x5562bd50b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.353+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3171645827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd50b410 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f32c40ab4b0 tx=0x7f32c4000bc0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.353+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3171645827 shutdown_connections 2024-08-28T19:36:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.353+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3171645827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd142390 0x5562bd510d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.353+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3171645827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd13a1b0 0x5562bd50b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.353+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3171645827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd50b410 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.353+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3171645827 >> 172.21.15.33:0/3171645827 conn(0x5562bd157460 msgr2=0x5562bd512390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.353+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3171645827 shutdown_connections 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.353+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3171645827 wait complete. 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32e0c6b740 1 -- start start 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32e0c6b740 1 Processor -- start 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd517f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd13a1b0 0x5562bd5184c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32e0c6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd142390 0x5562bd518a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41b4140 con 0x5562bd1219f0 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41b3a70 con 0x5562bd142390 2024-08-28T19:36:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32e0c6b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41b0cb0 con 0x5562bd13a1b0 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd517f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32e0c6b740 10 client.0 _ll_register_callbacks cb 0x7f32c40ab1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd517f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58270/0 (socket says 172.21.15.33:58270) 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32d3fff640 1 -- 172.21.15.33:0/3050270979 learned_addr learned my addr 172.21.15.33:0/3050270979 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.354+0000 7f32d37fe640 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd13a1b0 0x5562bd5184c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32d8c93640 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd142390 0x5562bd518a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32d3fff640 1 -- 172.21.15.33:0/3050270979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd13a1b0 msgr2=0x5562bd5184c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32d3fff640 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd13a1b0 0x5562bd5184c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32d3fff640 1 -- 172.21.15.33:0/3050270979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd142390 msgr2=0x5562bd518a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32d3fff640 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd142390 0x5562bd518a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32d3fff640 1 -- 172.21.15.33:0/3050270979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562bd501960 con 0x5562bd1219f0 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32d37fe640 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd13a1b0 0x5562bd5184c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32d3fff640 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd517f80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f32c40aaf00 tx=0x7f32c40ab930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a02cad772b738d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32b37fe640 1 -- 172.21.15.33:0/3050270979 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40a76c0 con 0x5562bd1219f0 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32b37fe640 1 -- 172.21.15.33:0/3050270979 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f32c40e5170 con 0x5562bd1219f0 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3050270979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32c40b0070 con 0x5562bd1219f0 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32b37fe640 1 -- 172.21.15.33:0/3050270979 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f32c405b120 con 0x5562bd1219f0 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32e0c6b740 10 client.16731 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3050270979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5562bd590ab0 con 0x5562bd1219f0 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.355+0000 7f32b37fe640 1 -- 172.21.15.33:0/3050270979 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32c40b0070 con 0x5562bd1219f0 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.356+0000 7f32b37fe640 1 -- 172.21.15.33:0/3050270979 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f32c40aa4d0 con 0x5562bd1219f0 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.356+0000 7f32e0c6b740 10 client.16731 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.356+0000 7f32e0c6b740 10 client.16731 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.356+0000 7f32e0c6b740 20 client.16731 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.356+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5562bd163070 0x5562bd592f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:38.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.356+0000 7f32e0c6b740 4 client.16731 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.356+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3050270979 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5562bd47d070 con 0x5562bd163070 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.356+0000 7f32d37fe640 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5562bd163070 0x5562bd592f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.356+0000 7f32b37fe640 10 client.16731 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.356+0000 7f32d37fe640 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5562bd163070 0x5562bd592f40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d60caf5b5d69ef00 server_cookie=2ca0d38732bbeb19 in_seq=0 out_seq=0 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32b37fe640 1 -- 172.21.15.33:0/3050270979 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5562bd47d070 con 0x5562bd163070 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32b37fe640 10 client.16731 handle_command_reply: tid=0 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 client.16731 shutdown 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3050270979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 msgr2=0x5562bd517f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd517f80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f32c40aaf00 tx=0x7f32c40ab930 comp rx=0 tx=0).stop 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3050270979 shutdown_connections 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x5562bd163070 0x5562bd592f40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5562bd142390 0x5562bd518a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5562bd13a1b0 0x5562bd5184c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32b37fe640 0 client.16731 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:36:38.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 --2- 172.21.15.33:0/3050270979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5562bd1219f0 0x5562bd517f80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3050270979 >> 172.21.15.33:0/3050270979 conn(0x5562bd157460 msgr2=0x5562bd50b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3050270979 shutdown_connections 2024-08-28T19:36:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 1 -- 172.21.15.33:0/3050270979 wait complete. 2024-08-28T19:36:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.357+0000 7f32e0c6b740 20 client.16731 trim_cache size 0 max 16384 2024-08-28T19:36:38.364 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:36:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 -- 172.21.15.33:0/4092757200 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32bc0b4ca0 msgr2=0x7f32bc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32bc0b4ca0 0x7f32bc0b71b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f32cc006010 tx=0x7f32cc009440 comp rx=0 tx=0).stop 2024-08-28T19:36:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 -- 172.21.15.33:0/4092757200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d4103900 msgr2=0x7f32d40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d4103900 0x7f32d40754b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f32c400d950 tx=0x7f32c400de10 comp rx=0 tx=0).stop 2024-08-28T19:36:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 -- 172.21.15.33:0/4092757200 shutdown_connections 2024-08-28T19:36:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32bc0b4ca0 0x7f32bc0b71b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32d4109b90 0x7f32d4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d4109240 0x7f32d40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 --2- 172.21.15.33:0/4092757200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32d4103900 0x7f32d40754b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 -- 172.21.15.33:0/4092757200 >> 172.21.15.33:0/4092757200 conn(0x7f32d407b5f0 msgr2=0x7f32d4107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 -- 172.21.15.33:0/4092757200 shutdown_connections 2024-08-28T19:36:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:38.358+0000 7f32da6f6640 1 -- 172.21.15.33:0/4092757200 wait complete. 2024-08-28T19:36:39.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:36:39.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:39 smithi033 ceph-mon[18549]: pgmap v468: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-08-28T19:36:39.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:39 smithi059 ceph-mon[22052]: pgmap v468: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-08-28T19:36:39.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:39 smithi122 ceph-mon[22174]: pgmap v468: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-08-28T19:36:39.465 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:39.517 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:36:40.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.005+0000 7f51a7e9a640 1 -- 172.21.15.33:0/527236509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a01081c0 msgr2=0x7f51a01085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:40.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.005+0000 7f51a7e9a640 1 --2- 172.21.15.33:0/527236509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a01081c0 0x7f51a01085d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5190009900 tx=0x7f519002a410 comp rx=0 tx=0).stop 2024-08-28T19:36:40.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.005+0000 7f51a7e9a640 1 -- 172.21.15.33:0/527236509 shutdown_connections 2024-08-28T19:36:40.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.005+0000 7f51a7e9a640 1 --2- 172.21.15.33:0/527236509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51a0108b10 0x7f51a010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.005+0000 7f51a7e9a640 1 --2- 172.21.15.33:0/527236509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a01081c0 0x7f51a01085d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.005+0000 7f51a7e9a640 1 --2- 172.21.15.33:0/527236509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a0102880 0x7f51a0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.005+0000 7f51a7e9a640 1 -- 172.21.15.33:0/527236509 >> 172.21.15.33:0/527236509 conn(0x7f51a0079510 msgr2=0x7f51a0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:40.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.005+0000 7f51a7e9a640 1 -- 172.21.15.33:0/527236509 shutdown_connections 2024-08-28T19:36:40.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.005+0000 7f51a7e9a640 1 -- 172.21.15.33:0/527236509 wait complete. 2024-08-28T19:36:40.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.006+0000 7f51a7e9a640 1 Processor -- start 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.006+0000 7f51a7e9a640 1 -- start start 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.006+0000 7f51a7e9a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0102880 0x7f51a019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.006+0000 7f51a7e9a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51a01081c0 0x7f51a019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.006+0000 7f51a7e9a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a0108b10 0x7f51a019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.006+0000 7f51a7e9a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0112780 con 0x7f51a0102880 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.006+0000 7f51a7e9a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0112600 con 0x7f51a01081c0 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.006+0000 7f51a7e9a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0112900 con 0x7f51a0108b10 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.006+0000 7f51a5c36640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0102880 0x7f51a019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.007+0000 7f51a5c36640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0102880 0x7f51a019a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41842/0 (socket says 172.21.15.33:41842) 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.007+0000 7f51a5c36640 1 -- 172.21.15.33:0/929990019 learned_addr learned my addr 172.21.15.33:0/929990019 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.007+0000 7f51a6437640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a0108b10 0x7f51a019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.007+0000 7f51a5435640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51a01081c0 0x7f51a019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.007+0000 7f51a5c36640 1 -- 172.21.15.33:0/929990019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a0108b10 msgr2=0x7f51a019fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.007+0000 7f51a5c36640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a0108b10 0x7f51a019fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.007+0000 7f51a5c36640 1 -- 172.21.15.33:0/929990019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51a01081c0 msgr2=0x7f51a019a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.007+0000 7f51a5c36640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51a01081c0 0x7f51a019a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.007+0000 7f51a5c36640 1 -- 172.21.15.33:0/929990019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a01a01b0 con 0x7f51a0102880 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.007+0000 7f51a5c36640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0102880 0x7f51a019a300 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c920 tx=0x7f519c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.008+0000 7f5196ffd640 1 -- 172.21.15.33:0/929990019 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c007c70 con 0x7f51a0102880 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.008+0000 7f5196ffd640 1 -- 172.21.15.33:0/929990019 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f519c007e10 con 0x7f51a0102880 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.008+0000 7f51a7e9a640 1 -- 172.21.15.33:0/929990019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a01a04a0 con 0x7f51a0102880 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.008+0000 7f5196ffd640 1 -- 172.21.15.33:0/929990019 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c018820 con 0x7f51a0102880 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.008+0000 7f51a7e9a640 1 -- 172.21.15.33:0/929990019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a01a6cc0 con 0x7f51a0102880 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.011+0000 7f5196ffd640 1 -- 172.21.15.33:0/929990019 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f519c00f450 con 0x7f51a0102880 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.011+0000 7f51ae40f740 1 Processor -- start 2024-08-28T19:36:40.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51ae40f740 1 -- start start 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f5196ffd640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f518c0b4d50 0x7f518c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214494070 0x562214839350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56221446b1b0 0x562214839890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 0x562214839dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51ae40f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5622147b0680 con 0x562214494070 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51ae40f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56221479fc10 con 0x562214473390 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51ae40f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5622147a3bc0 con 0x56221446b1b0 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51a6437640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f518c0b4d50 0x7f518c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51a5c36640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214494070 0x562214839350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51a5c36640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214494070 0x562214839350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41852/0 (socket says 172.21.15.33:41852) 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51a5c36640 1 -- 172.21.15.33:0/484913214 learned_addr learned my addr 172.21.15.33:0/484913214 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51a5435640 1 --2- 172.21.15.33:0/484913214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56221446b1b0 0x562214839890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f5196ffd640 1 -- 172.21.15.33:0/929990019 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f519c0e58a0 con 0x7f51a0102880 2024-08-28T19:36:40.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.012+0000 7f51a6437640 1 --2- 172.21.15.33:0/484913214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 0x562214839dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.013+0000 7f51a5c36640 1 -- 172.21.15.33:0/484913214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56221446b1b0 msgr2=0x562214839890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.013+0000 7f51a5c36640 1 --2- 172.21.15.33:0/484913214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56221446b1b0 0x562214839890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.013+0000 7f51a5c36640 1 -- 172.21.15.33:0/484913214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 msgr2=0x562214839dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.013+0000 7f51a5c36640 1 --2- 172.21.15.33:0/484913214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 0x562214839dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.013+0000 7f51a5c36640 1 -- 172.21.15.33:0/484913214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622144ff650 con 0x562214494070 2024-08-28T19:36:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.013+0000 7f51a6437640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f518c0b4d50 0x7f518c0b7260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f519800a780 tx=0x7f519800ae00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.013+0000 7f51a5c36640 1 --2- 172.21.15.33:0/484913214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214494070 0x562214839350 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c8f0 tx=0x7f519c0c6c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529764d1d85bf605 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.013+0000 7f518bfff640 1 -- 172.21.15.33:0/484913214 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c0abc40 con 0x562214494070 2024-08-28T19:36:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.013+0000 7f518bfff640 1 -- 172.21.15.33:0/484913214 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f519c0b04b0 con 0x562214494070 2024-08-28T19:36:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.013+0000 7f518bfff640 1 -- 172.21.15.33:0/484913214 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c00f8d0 con 0x562214494070 2024-08-28T19:36:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.014+0000 7f51ae40f740 1 -- 172.21.15.33:0/484913214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214494070 msgr2=0x562214839350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.014+0000 7f51ae40f740 1 --2- 172.21.15.33:0/484913214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214494070 0x562214839350 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c8f0 tx=0x7f519c0c6c90 comp rx=0 tx=0).stop 2024-08-28T19:36:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.014+0000 7f51ae40f740 1 -- 172.21.15.33:0/484913214 shutdown_connections 2024-08-28T19:36:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.014+0000 7f51ae40f740 1 --2- 172.21.15.33:0/484913214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 0x562214839dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.014+0000 7f51ae40f740 1 --2- 172.21.15.33:0/484913214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56221446b1b0 0x562214839890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.014+0000 7f51ae40f740 1 --2- 172.21.15.33:0/484913214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214494070 0x562214839350 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.014+0000 7f51ae40f740 1 -- 172.21.15.33:0/484913214 >> 172.21.15.33:0/484913214 conn(0x562214488460 msgr2=0x562214837240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.014+0000 7f51ae40f740 1 -- 172.21.15.33:0/484913214 shutdown_connections 2024-08-28T19:36:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.014+0000 7f51ae40f740 1 -- 172.21.15.33:0/484913214 wait complete. 2024-08-28T19:36:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51ae40f740 1 -- start start 2024-08-28T19:36:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51ae40f740 1 Processor -- start 2024-08-28T19:36:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56221446b1b0 0x562214844ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 0x562214845020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x562214850e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51ae40f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562214602700 con 0x56221446b1b0 2024-08-28T19:36:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51ae40f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562214726750 con 0x562214473390 2024-08-28T19:36:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51ae40f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562214847b30 con 0x562214494070 2024-08-28T19:36:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51ae40f740 10 client.0 _ll_register_callbacks cb 0x562214755e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51a5c36640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56221446b1b0 0x562214844ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51a5c36640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56221446b1b0 0x562214844ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41860/0 (socket says 172.21.15.33:41860) 2024-08-28T19:36:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.015+0000 7f51a5c36640 1 -- 172.21.15.33:0/1171438976 learned_addr learned my addr 172.21.15.33:0/1171438976 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51a6437640 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x562214850e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51a5435640 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 0x562214845020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51a5c36640 1 -- 172.21.15.33:0/1171438976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 msgr2=0x562214850e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51a5c36640 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x562214850e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51a5c36640 1 -- 172.21.15.33:0/1171438976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 msgr2=0x562214845020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51a5c36640 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 0x562214845020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51a5c36640 1 -- 172.21.15.33:0/1171438976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56221475f900 con 0x56221446b1b0 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51a5435640 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 0x562214845020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51a5c36640 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56221446b1b0 0x562214844ae0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f519c0c5c60 tx=0x7f519c00fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d130d7eb769f53a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51897fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51897fa640 1 -- 172.21.15.33:0/1171438976 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c05b020 con 0x56221446b1b0 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51ae40f740 1 -- 172.21.15.33:0/1171438976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f519c0b04b0 con 0x56221446b1b0 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51897fa640 1 -- 172.21.15.33:0/1171438976 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f519c0c1550 con 0x56221446b1b0 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51897fa640 1 -- 172.21.15.33:0/1171438976 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f519c0aba10 con 0x56221446b1b0 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51ae40f740 10 client.16743 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.016+0000 7f51ae40f740 1 -- 172.21.15.33:0/1171438976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562214853910 con 0x56221446b1b0 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.017+0000 7f51897fa640 1 -- 172.21.15.33:0/1171438976 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f519c0b4f60 con 0x56221446b1b0 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.018+0000 7f51897fa640 1 -- 172.21.15.33:0/1171438976 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f519c094ce0 con 0x56221446b1b0 2024-08-28T19:36:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.018+0000 7f51ae40f740 10 client.16743 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.018+0000 7f51ae40f740 10 client.16743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.018+0000 7f51ae40f740 20 client.16743 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.018+0000 7f51ae40f740 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5622144529f0 0x562214856c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.018+0000 7f51ae40f740 4 client.16743 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.018+0000 7f51ae40f740 1 -- 172.21.15.33:0/1171438976 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f519c0b04b0 con 0x5622144529f0 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.018+0000 7f51a5435640 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5622144529f0 0x562214856c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.018+0000 7f51897fa640 10 client.16743 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.018+0000 7f51a5435640 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5622144529f0 0x562214856c70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2017accc6444fb2f server_cookie=50e8d47a080932db in_seq=0 out_seq=0 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.019+0000 7f51897fa640 1 -- 172.21.15.33:0/1171438976 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f519c0b04b0 con 0x5622144529f0 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.019+0000 7f51897fa640 10 client.16743 handle_command_reply: tid=0 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.019+0000 7f51ae40f740 1 client.16743 shutdown 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.019+0000 7f51ae40f740 1 -- 172.21.15.33:0/1171438976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56221446b1b0 msgr2=0x562214844ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.019+0000 7f51ae40f740 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56221446b1b0 0x562214844ae0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f519c0c5c60 tx=0x7f519c00fca0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.020+0000 7f51ae40f740 1 -- 172.21.15.33:0/1171438976 shutdown_connections 2024-08-28T19:36:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.020+0000 7f51ae40f740 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x562214850e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.020+0000 7f51ae40f740 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562214473390 0x562214845020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.020+0000 7f51ae40f740 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5622144529f0 0x562214856c70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.020+0000 7f51ae40f740 1 --2- 172.21.15.33:0/1171438976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56221446b1b0 0x562214844ae0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.020+0000 7f51897fa640 0 client.16743 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.020+0000 7f51ae40f740 1 -- 172.21.15.33:0/1171438976 >> 172.21.15.33:0/1171438976 conn(0x562214488460 msgr2=0x56221483a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.020+0000 7f51ae40f740 1 -- 172.21.15.33:0/1171438976 shutdown_connections 2024-08-28T19:36:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.020+0000 7f51ae40f740 1 -- 172.21.15.33:0/1171438976 wait complete. 2024-08-28T19:36:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.020+0000 7f51ae40f740 20 client.16743 trim_cache size 0 max 16384 2024-08-28T19:36:40.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51ae40f740 1 Processor -- start 2024-08-28T19:36:40.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51ae40f740 1 -- start start 2024-08-28T19:36:40.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221446b1b0 0x56221483a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214844fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x562214850dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51ae40f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01b0a30 con 0x562214473390 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51ae40f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01b2570 con 0x56221446b1b0 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51ae40f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01b1100 con 0x562214494070 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51a5435640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214844fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51a5435640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214844fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41864/0 (socket says 172.21.15.33:41864) 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.034+0000 7f51a5435640 1 -- 172.21.15.33:0/727871085 learned_addr learned my addr 172.21.15.33:0/727871085 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f51a5c36640 1 --2- 172.21.15.33:0/727871085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221446b1b0 0x56221483a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f51a6437640 1 --2- 172.21.15.33:0/727871085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x562214850dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f51a5435640 1 -- 172.21.15.33:0/727871085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 msgr2=0x562214850dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f51a5435640 1 --2- 172.21.15.33:0/727871085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x562214850dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f51a5435640 1 -- 172.21.15.33:0/727871085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221446b1b0 msgr2=0x56221483a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f51a5435640 1 --2- 172.21.15.33:0/727871085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221446b1b0 0x56221483a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f51a5435640 1 -- 172.21.15.33:0/727871085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562214851c30 con 0x562214473390 2024-08-28T19:36:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f51a6437640 1 --2- 172.21.15.33:0/727871085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x562214850dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f51a5435640 1 --2- 172.21.15.33:0/727871085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214844fa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f51a006b760 tx=0x7f5190000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7a77e7dcc427f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f518b7fe640 1 -- 172.21.15.33:0/727871085 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190049030 con 0x562214473390 2024-08-28T19:36:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f518b7fe640 1 -- 172.21.15.33:0/727871085 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5190031950 con 0x562214473390 2024-08-28T19:36:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.035+0000 7f518b7fe640 1 -- 172.21.15.33:0/727871085 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190035040 con 0x562214473390 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.036+0000 7f51ae40f740 1 -- 172.21.15.33:0/727871085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 msgr2=0x562214844fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.036+0000 7f51ae40f740 1 --2- 172.21.15.33:0/727871085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214844fa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f51a006b760 tx=0x7f5190000bc0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.036+0000 7f51ae40f740 1 -- 172.21.15.33:0/727871085 shutdown_connections 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.036+0000 7f51ae40f740 1 --2- 172.21.15.33:0/727871085 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x562214850dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.036+0000 7f51ae40f740 1 --2- 172.21.15.33:0/727871085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214844fa0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.036+0000 7f51ae40f740 1 --2- 172.21.15.33:0/727871085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221446b1b0 0x56221483a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.036+0000 7f51ae40f740 1 -- 172.21.15.33:0/727871085 >> 172.21.15.33:0/727871085 conn(0x562214488460 msgr2=0x562214844890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.036+0000 7f51ae40f740 1 -- 172.21.15.33:0/727871085 shutdown_connections 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.036+0000 7f51ae40f740 1 -- 172.21.15.33:0/727871085 wait complete. 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.037+0000 7f51ae40f740 1 -- start start 2024-08-28T19:36:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.037+0000 7f51ae40f740 1 Processor -- start 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.037+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221446b1b0 0x56221485a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.037+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214857b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.037+0000 7f51ae40f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x5622148581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.037+0000 7f51ae40f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01b1ea0 con 0x562214473390 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.037+0000 7f51ae40f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01b17d0 con 0x56221446b1b0 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.037+0000 7f51ae40f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f51a01aea10 con 0x562214494070 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51ae40f740 10 client.0 _ll_register_callbacks cb 0x7f5198014750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a5435640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214857b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a5435640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214857b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41880/0 (socket says 172.21.15.33:41880) 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a5435640 1 -- 172.21.15.33:0/2623525194 learned_addr learned my addr 172.21.15.33:0/2623525194 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a5c36640 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221446b1b0 0x56221485a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a6437640 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x5622148581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a5435640 1 -- 172.21.15.33:0/2623525194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 msgr2=0x5622148581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a5435640 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x5622148581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a5435640 1 -- 172.21.15.33:0/2623525194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221446b1b0 msgr2=0x56221485a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a5435640 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221446b1b0 0x56221485a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a5435640 1 -- 172.21.15.33:0/2623525194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622148c03f0 con 0x562214473390 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.038+0000 7f51a5435640 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214857b00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f519002a930 tx=0x7f5190009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7dc581ec7074c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.039+0000 7f51897fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.039+0000 7f51897fa640 1 -- 172.21.15.33:0/2623525194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5190035050 con 0x562214473390 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.039+0000 7f51ae40f740 1 -- 172.21.15.33:0/2623525194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5190031950 con 0x562214473390 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.039+0000 7f51897fa640 1 -- 172.21.15.33:0/2623525194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5190004200 con 0x562214473390 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.039+0000 7f51897fa640 1 -- 172.21.15.33:0/2623525194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f519005f050 con 0x562214473390 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.039+0000 7f51ae40f740 10 client.16749 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.039+0000 7f51ae40f740 1 -- 172.21.15.33:0/2623525194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5622148c14e0 con 0x562214473390 2024-08-28T19:36:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.039+0000 7f51897fa640 1 -- 172.21.15.33:0/2623525194 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5190031950 con 0x562214473390 2024-08-28T19:36:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.039+0000 7f51897fa640 1 -- 172.21.15.33:0/2623525194 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5190004ab0 con 0x562214473390 2024-08-28T19:36:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.040+0000 7f51ae40f740 10 client.16749 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.040+0000 7f51ae40f740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.040+0000 7f51ae40f740 20 client.16749 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.040+0000 7f51ae40f740 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562214427da0 0x5622148c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.040+0000 7f51ae40f740 4 client.16749 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:36:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.040+0000 7f51ae40f740 1 -- 172.21.15.33:0/2623525194 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5622147b25d0 con 0x562214427da0 2024-08-28T19:36:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.040+0000 7f51a5c36640 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562214427da0 0x5622148c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.040+0000 7f51897fa640 10 client.16749 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.040+0000 7f51a5c36640 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562214427da0 0x5622148c3bc0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=117c63f8b51d62eb server_cookie=65e626983a48a0b4 in_seq=0 out_seq=0 2024-08-28T19:36:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51897fa640 1 -- 172.21.15.33:0/2623525194 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5622147b25d0 con 0x562214427da0 2024-08-28T19:36:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51897fa640 10 client.16749 handle_command_reply: tid=0 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51ae40f740 1 client.16749 shutdown 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51ae40f740 1 -- 172.21.15.33:0/2623525194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 msgr2=0x562214857b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51ae40f740 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214857b00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f519002a930 tx=0x7f5190009250 comp rx=0 tx=0).stop 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51ae40f740 1 -- 172.21.15.33:0/2623525194 shutdown_connections 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51ae40f740 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562214494070 0x5622148581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51ae40f740 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562214427da0 0x5622148c3bc0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51ae40f740 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562214473390 0x562214857b00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51ae40f740 1 --2- 172.21.15.33:0/2623525194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56221446b1b0 0x56221485a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51ae40f740 1 -- 172.21.15.33:0/2623525194 >> 172.21.15.33:0/2623525194 conn(0x562214488460 msgr2=0x562214836a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.041+0000 7f51897fa640 0 client.16749 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51ae40f740 1 -- 172.21.15.33:0/2623525194 shutdown_connections 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51ae40f740 1 -- 172.21.15.33:0/2623525194 wait complete. 2024-08-28T19:36:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51ae40f740 20 client.16749 trim_cache size 0 max 16384 2024-08-28T19:36:40.048 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:36:40.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51a7e9a640 1 -- 172.21.15.33:0/929990019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f518c0b4d50 msgr2=0x7f518c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:40.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51a7e9a640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f518c0b4d50 0x7f518c0b7260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f519800a780 tx=0x7f519800ae00 comp rx=0 tx=0).stop 2024-08-28T19:36:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51a7e9a640 1 -- 172.21.15.33:0/929990019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0102880 msgr2=0x7f51a019a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51a7e9a640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0102880 0x7f51a019a300 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c920 tx=0x7f519c00cde0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51a7e9a640 1 -- 172.21.15.33:0/929990019 shutdown_connections 2024-08-28T19:36:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51a7e9a640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f518c0b4d50 0x7f518c0b7260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51a7e9a640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51a0108b10 0x7f51a019fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51a7e9a640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51a01081c0 0x7f51a019a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51a7e9a640 1 --2- 172.21.15.33:0/929990019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0102880 0x7f51a019a300 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.042+0000 7f51a7e9a640 1 -- 172.21.15.33:0/929990019 >> 172.21.15.33:0/929990019 conn(0x7f51a0079510 msgr2=0x7f51a0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.043+0000 7f51a7e9a640 1 -- 172.21.15.33:0/929990019 shutdown_connections 2024-08-28T19:36:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:40.043+0000 7f51a7e9a640 1 -- 172.21.15.33:0/929990019 wait complete. 2024-08-28T19:36:40.056 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:41.114 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:41 smithi033 ceph-mon[18549]: pgmap v469: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:36:41.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:41 smithi059 ceph-mon[22052]: pgmap v469: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:36:41.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:41 smithi122 ceph-mon[22174]: pgmap v469: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:36:41.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.348+0000 7f69afca6640 1 -- 172.21.15.33:0/1605553201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69a8108a90 msgr2=0x7f69a810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:41.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.348+0000 7f69afca6640 1 --2- 172.21.15.33:0/1605553201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69a8108a90 0x7f69a810f2c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009ca0 tx=0x7f69a002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.348+0000 7f69afca6640 1 -- 172.21.15.33:0/1605553201 shutdown_connections 2024-08-28T19:36:41.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.348+0000 7f69afca6640 1 --2- 172.21.15.33:0/1605553201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69a8108a90 0x7f69a810f2c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.348+0000 7f69afca6640 1 --2- 172.21.15.33:0/1605553201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8108140 0x7f69a8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.348+0000 7f69afca6640 1 --2- 172.21.15.33:0/1605553201 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69a8102800 0x7f69a8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.348+0000 7f69afca6640 1 -- 172.21.15.33:0/1605553201 >> 172.21.15.33:0/1605553201 conn(0x7f69a80794d0 msgr2=0x7f69a80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:41.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.348+0000 7f69afca6640 1 -- 172.21.15.33:0/1605553201 shutdown_connections 2024-08-28T19:36:41.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.348+0000 7f69afca6640 1 -- 172.21.15.33:0/1605553201 wait complete. 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69afca6640 1 Processor -- start 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69afca6640 1 -- start start 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69afca6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69a8102800 0x7f69a819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69afca6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69a8108140 0x7f69a819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69afca6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8108a90 0x7f69a819fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69afca6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f69a81126f0 con 0x7f69a8102800 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69afca6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f69a8112570 con 0x7f69a8108a90 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69afca6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f69a8112870 con 0x7f69a8108140 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69ada42640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69a8102800 0x7f69a819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69ada42640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69a8102800 0x7f69a819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41900/0 (socket says 172.21.15.33:41900) 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69ada42640 1 -- 172.21.15.33:0/3073507379 learned_addr learned my addr 172.21.15.33:0/3073507379 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:41.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69ae243640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8108a90 0x7f69a819fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.349+0000 7f69ad241640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69a8108140 0x7f69a819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.350+0000 7f69ada42640 1 -- 172.21.15.33:0/3073507379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69a8108140 msgr2=0x7f69a819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.350+0000 7f69ada42640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69a8108140 0x7f69a819a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.350+0000 7f69ada42640 1 -- 172.21.15.33:0/3073507379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8108a90 msgr2=0x7f69a819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.350+0000 7f69ada42640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8108a90 0x7f69a819fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.350+0000 7f69ada42640 1 -- 172.21.15.33:0/3073507379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a81a0120 con 0x7f69a8102800 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.350+0000 7f69ad241640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69a8108140 0x7f69a819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.350+0000 7f69ada42640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69a8102800 0x7f69a819a270 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f69a400c920 tx=0x7f69a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.350+0000 7f699effd640 1 -- 172.21.15.33:0/3073507379 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4007c70 con 0x7f69a8102800 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.350+0000 7f699effd640 1 -- 172.21.15.33:0/3073507379 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69a4007e10 con 0x7f69a8102800 2024-08-28T19:36:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.350+0000 7f69afca6640 1 -- 172.21.15.33:0/3073507379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a81a0410 con 0x7f69a8102800 2024-08-28T19:36:41.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.351+0000 7f699effd640 1 -- 172.21.15.33:0/3073507379 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4018820 con 0x7f69a8102800 2024-08-28T19:36:41.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.351+0000 7f69afca6640 1 -- 172.21.15.33:0/3073507379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a81a6c30 con 0x7f69a8102800 2024-08-28T19:36:41.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.352+0000 7f69afca6640 1 -- 172.21.15.33:0/3073507379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a8103a80 con 0x7f69a8102800 2024-08-28T19:36:41.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.353+0000 7f699effd640 1 -- 172.21.15.33:0/3073507379 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f69a40189c0 con 0x7f69a8102800 2024-08-28T19:36:41.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.353+0000 7f699effd640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69940b4c00 0x7f69940b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:41.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.353+0000 7f69ad241640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69940b4c00 0x7f69940b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:41.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.353+0000 7f699effd640 1 -- 172.21.15.33:0/3073507379 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f69a40e5970 con 0x7f69a8102800 2024-08-28T19:36:41.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.354+0000 7f69ad241640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69940b4c00 0x7f69940b7110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6998005d90 tx=0x7f6998005d20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.358+0000 7f699effd640 1 -- 172.21.15.33:0/3073507379 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f69a4014030 con 0x7f69a8102800 2024-08-28T19:36:41.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.582+0000 7f69afca6640 1 -- 172.21.15.33:0/3073507379 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69a81a6e00 con 0x7f69a8102800 2024-08-28T19:36:41.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.583+0000 7f699effd640 1 -- 172.21.15.33:0/3073507379 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f69a40ac410 con 0x7f69a8102800 2024-08-28T19:36:41.585 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:36:41.585 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:36:41.585 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:36:41.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 -- 172.21.15.33:0/3073507379 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69940b4c00 msgr2=0x7f69940b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:41.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69940b4c00 0x7f69940b7110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6998005d90 tx=0x7f6998005d20 comp rx=0 tx=0).stop 2024-08-28T19:36:41.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 -- 172.21.15.33:0/3073507379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69a8102800 msgr2=0x7f69a819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:41.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69a8102800 0x7f69a819a270 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f69a400c920 tx=0x7f69a400cde0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 -- 172.21.15.33:0/3073507379 shutdown_connections 2024-08-28T19:36:41.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8108a90 0x7f69a819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f69940b4c00 0x7f69940b7110 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f69a8108140 0x7f69a819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 --2- 172.21.15.33:0/3073507379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69a8102800 0x7f69a819a270 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:41.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 -- 172.21.15.33:0/3073507379 >> 172.21.15.33:0/3073507379 conn(0x7f69a80794d0 msgr2=0x7f69a80ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:41.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 -- 172.21.15.33:0/3073507379 shutdown_connections 2024-08-28T19:36:41.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:41.585+0000 7f69afca6640 1 -- 172.21.15.33:0/3073507379 wait complete. 2024-08-28T19:36:41.876 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:36:41.876 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:36:42.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:42 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3073507379' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:42.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:42 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3073507379' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:42.349 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:42 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3073507379' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:42.377 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id 6a071a40 --release --await' 2024-08-28T19:36:42.377 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id 6a071a40 --release --await 2024-08-28T19:36:42.473 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.987+0000 7f5ab19c2640 1 -- 172.21.15.33:0/3469277717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aac108a90 msgr2=0x7f5aac10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:42.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.987+0000 7f5ab19c2640 1 --2- 172.21.15.33:0/3469277717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aac108a90 0x7f5aac10f2c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009ca0 tx=0x7f5aa402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:36:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.987+0000 7f5ab19c2640 1 -- 172.21.15.33:0/3469277717 shutdown_connections 2024-08-28T19:36:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.987+0000 7f5ab19c2640 1 --2- 172.21.15.33:0/3469277717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aac108a90 0x7f5aac10f2c0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.987+0000 7f5ab19c2640 1 --2- 172.21.15.33:0/3469277717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aac108140 0x7f5aac108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.987+0000 7f5ab19c2640 1 --2- 172.21.15.33:0/3469277717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aac102800 0x7f5aac102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.987+0000 7f5ab19c2640 1 -- 172.21.15.33:0/3469277717 >> 172.21.15.33:0/3469277717 conn(0x7f5aac0794d0 msgr2=0x7f5aac0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.987+0000 7f5ab19c2640 1 -- 172.21.15.33:0/3469277717 shutdown_connections 2024-08-28T19:36:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.987+0000 7f5ab19c2640 1 -- 172.21.15.33:0/3469277717 wait complete. 2024-08-28T19:36:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.988+0000 7f5ab19c2640 1 Processor -- start 2024-08-28T19:36:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.988+0000 7f5ab19c2640 1 -- start start 2024-08-28T19:36:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5ab19c2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aac102800 0x7f5aac19b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5ab19c2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aac108140 0x7f5aac19b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5ab19c2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aac108a90 0x7f5aac19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5ab19c2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac112740 con 0x7f5aac108a90 2024-08-28T19:36:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5ab19c2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac1125c0 con 0x7f5aac108140 2024-08-28T19:36:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5ab19c2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac1128c0 con 0x7f5aac102800 2024-08-28T19:36:42.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aac108a90 0x7f5aac19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aab7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aac108a90 0x7f5aac19baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41908/0 (socket says 172.21.15.33:41908) 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aab7fe640 1 -- 172.21.15.33:0/1870497648 learned_addr learned my addr 172.21.15.33:0/1870497648 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aac108140 0x7f5aac19b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aaaffd640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aac102800 0x7f5aac19b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aab7fe640 1 -- 172.21.15.33:0/1870497648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aac102800 msgr2=0x7f5aac19b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aab7fe640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aac102800 0x7f5aac19b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aab7fe640 1 -- 172.21.15.33:0/1870497648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aac108140 msgr2=0x7f5aac19b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aab7fe640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aac108140 0x7f5aac19b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aab7fe640 1 -- 172.21.15.33:0/1870497648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aac1a6300 con 0x7f5aac108a90 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.989+0000 7f5aab7fe640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aac108a90 0x7f5aac19baf0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009430 tx=0x7f5aa40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.990+0000 7f5ab09c0640 1 -- 172.21.15.33:0/1870497648 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4003c30 con 0x7f5aac108a90 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.990+0000 7f5ab19c2640 1 -- 172.21.15.33:0/1870497648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aac1a6590 con 0x7f5aac108a90 2024-08-28T19:36:42.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.990+0000 7f5ab09c0640 1 -- 172.21.15.33:0/1870497648 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aa4003dd0 con 0x7f5aac108a90 2024-08-28T19:36:42.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.990+0000 7f5ab09c0640 1 -- 172.21.15.33:0/1870497648 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa402faa0 con 0x7f5aac108a90 2024-08-28T19:36:42.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.990+0000 7f5ab19c2640 1 -- 172.21.15.33:0/1870497648 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aac1a6ad0 con 0x7f5aac108a90 2024-08-28T19:36:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.992+0000 7f5ab7f37740 1 Processor -- start 2024-08-28T19:36:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5ab09c0640 1 -- 172.21.15.33:0/1870497648 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5aa402fc60 con 0x7f5aac108a90 2024-08-28T19:36:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5ab7f37740 1 -- start start 2024-08-28T19:36:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171593b350 0x561715ce1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561715912490 0x561715ce1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715ce2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5ab7f37740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561715c575f0 con 0x56171593b350 2024-08-28T19:36:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5ab7f37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561715c46b80 con 0x561715912490 2024-08-28T19:36:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5ab7f37740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561715c4ab30 con 0x56171591a670 2024-08-28T19:36:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5aaa7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171593b350 0x561715ce1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5aaa7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171593b350 0x561715ce1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41912/0 (socket says 172.21.15.33:41912) 2024-08-28T19:36:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/2475663316 learned_addr learned my addr 172.21.15.33:0/2475663316 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.993+0000 7f5aaaffd640 1 --2- 172.21.15.33:0/2475663316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561715912490 0x561715ce1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5ab09c0640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a940b4cd0 0x7f5a940b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/2475663316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715ce2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5aab7fe640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a940b4cd0 0x7f5a940b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/2475663316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 msgr2=0x561715ce2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/2475663316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715ce2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/2475663316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561715912490 msgr2=0x561715ce1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/2475663316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561715912490 0x561715ce1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/2475663316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617159a6930 con 0x56171593b350 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5ab09c0640 1 -- 172.21.15.33:0/1870497648 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5aa4106b80 con 0x7f5aac108a90 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/2475663316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171593b350 0x561715ce1780 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5aa000bf60 tx=0x7f5aa000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e137ab1996a93b06 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5aab7fe640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a940b4cd0 0x7f5a940b71e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4045000 tx=0x7f5aa40c8ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.994+0000 7f5a91ffb640 1 -- 172.21.15.33:0/2475663316 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0004020 con 0x56171593b350 2024-08-28T19:36:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.995+0000 7f5a91ffb640 1 -- 172.21.15.33:0/2475663316 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aa0004c50 con 0x56171593b350 2024-08-28T19:36:42.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.995+0000 7f5a91ffb640 1 -- 172.21.15.33:0/2475663316 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0005280 con 0x56171593b350 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.996+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2475663316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171593b350 msgr2=0x561715ce1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.996+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2475663316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171593b350 0x561715ce1780 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5aa000bf60 tx=0x7f5aa000b650 comp rx=0 tx=0).stop 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.996+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2475663316 shutdown_connections 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.996+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2475663316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715ce2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.996+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2475663316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561715912490 0x561715ce1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.996+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2475663316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171593b350 0x561715ce1780 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.996+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2475663316 >> 172.21.15.33:0/2475663316 conn(0x56171592f740 msgr2=0x561715cdf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.996+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2475663316 shutdown_connections 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.996+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2475663316 wait complete. 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.996+0000 7f5ab7f37740 1 -- start start 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.997+0000 7f5ab7f37740 1 Processor -- start 2024-08-28T19:36:43.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.997+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715ced000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.997+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715ced5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.997+0000 7f5aaa7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715ced000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.997+0000 7f5aaa7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715ced000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41916/0 (socket says 172.21.15.33:41916) 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.997+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/2145276948 learned_addr learned my addr 172.21.15.33:0/2145276948 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56171593b350 0x561715cf9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561715aa9890 con 0x561715912490 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561715bcd790 con 0x56171593b350 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561715ceff60 con 0x56171591a670 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5aaaffd640 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715ced5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56171593b350 0x561715cf9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/2145276948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 msgr2=0x561715ced5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715ced5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/2145276948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56171593b350 msgr2=0x561715cf9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56171593b350 0x561715cf9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/2145276948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561715c04f30 con 0x561715912490 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5ab7f37740 10 client.0 _ll_register_callbacks cb 0x561715952ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aa0004c50 con 0x561715912490 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715ced000 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0006010 tx=0x7f5aa0004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485356948d665536 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.998+0000 7f5a8affd640 10 client.16767 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.999+0000 7f5a8affd640 1 -- 172.21.15.33:0/2145276948 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0033050 con 0x561715912490 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.999+0000 7f5a8affd640 1 -- 172.21.15.33:0/2145276948 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5aa0005000 con 0x561715912490 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.999+0000 7f5a8affd640 1 -- 172.21.15.33:0/2145276948 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5aa0005200 con 0x561715912490 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.999+0000 7f5ab7f37740 10 client.16767 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.999+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561715cfbb30 con 0x561715912490 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.999+0000 7f5a8affd640 1 -- 172.21.15.33:0/2145276948 <== mon.0 v2:172.21.15.33:3300/0 4 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5aa00053a0 con 0x561715912490 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.999+0000 7f5ab7f37740 10 client.16767 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:42.999+0000 7f5ab7f37740 10 client.16767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.000+0000 7f5ab7f37740 20 client.16767 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.000+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5617158f9cd0 0x561715cfeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.000+0000 7f5ab7f37740 4 client.16767 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.000+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561715c59540 con 0x5617158f9cd0 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.000+0000 7f5aaaffd640 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5617158f9cd0 0x561715cfeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.000+0000 7f5a8affd640 10 client.16767 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.000+0000 7f5aaaffd640 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5617158f9cd0 0x561715cfeef0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a73fb3277119b8aa server_cookie=5776dc8d9b3989b7 in_seq=0 out_seq=0 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.001+0000 7f5a8affd640 1 -- 172.21.15.33:0/2145276948 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561715c59540 con 0x5617158f9cd0 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.001+0000 7f5a8affd640 10 client.16767 handle_command_reply: tid=0 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.001+0000 7f5ab7f37740 1 client.16767 shutdown 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 msgr2=0x561715ced000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715ced000 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0006010 tx=0x7f5aa0004520 comp rx=0 tx=0).stop 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 shutdown_connections 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56171593b350 0x561715cf9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715ced5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5617158f9cd0 0x561715cfeef0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/2145276948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715ced000 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5a8affd640 0 client.16767 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:43.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 >> 172.21.15.33:0/2145276948 conn(0x56171592f740 msgr2=0x561715ce4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 shutdown_connections 2024-08-28T19:36:43.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 1 -- 172.21.15.33:0/2145276948 wait complete. 2024-08-28T19:36:43.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.002+0000 7f5ab7f37740 20 client.16767 trim_cache size 0 max 16384 2024-08-28T19:36:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:43.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.024+0000 7f5ab7f37740 1 Processor -- start 2024-08-28T19:36:43.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.024+0000 7f5ab7f37740 1 -- start start 2024-08-28T19:36:43.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.024+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5617158f9cd0 0x561715ce5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.024+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561715912490 0x561715cf9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.024+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171591a670 0x561715cee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.024+0000 7f5ab7f37740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac1b0b80 con 0x56171591a670 2024-08-28T19:36:43.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.024+0000 7f5ab7f37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac1b26c0 con 0x561715912490 2024-08-28T19:36:43.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5ab7f37740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac1b1250 con 0x5617158f9cd0 2024-08-28T19:36:43.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaa7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171591a670 0x561715cee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaa7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171591a670 0x561715cee9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41918/0 (socket says 172.21.15.33:41918) 2024-08-28T19:36:43.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/4251817697 learned_addr learned my addr 172.21.15.33:0/4251817697 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:43.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaaffd640 1 --2- 172.21.15.33:0/4251817697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561715912490 0x561715cf9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/4251817697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5617158f9cd0 0x561715ce5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/4251817697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5617158f9cd0 msgr2=0x561715ce5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/4251817697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5617158f9cd0 0x561715ce5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/4251817697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561715912490 msgr2=0x561715cf9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/4251817697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561715912490 0x561715cf9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaa7fc640 1 -- 172.21.15.33:0/4251817697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561715ce3f80 con 0x56171591a670 2024-08-28T19:36:43.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.025+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/4251817697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171591a670 0x561715cee9d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0000c00 tx=0x7f5aa0021050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634e90bde8c87d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:43.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.026+0000 7f5a917fa640 1 -- 172.21.15.33:0/4251817697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0033070 con 0x56171591a670 2024-08-28T19:36:43.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.026+0000 7f5a917fa640 1 -- 172.21.15.33:0/4251817697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aa0004c50 con 0x56171591a670 2024-08-28T19:36:43.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.026+0000 7f5a917fa640 1 -- 172.21.15.33:0/4251817697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0010910 con 0x56171591a670 2024-08-28T19:36:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.026+0000 7f5ab7f37740 1 -- 172.21.15.33:0/4251817697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171591a670 msgr2=0x561715cee9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.027+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/4251817697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171591a670 0x561715cee9d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0000c00 tx=0x7f5aa0021050 comp rx=0 tx=0).stop 2024-08-28T19:36:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.027+0000 7f5ab7f37740 1 -- 172.21.15.33:0/4251817697 shutdown_connections 2024-08-28T19:36:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.027+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/4251817697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56171591a670 0x561715cee9d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.027+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/4251817697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561715912490 0x561715cf9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.027+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/4251817697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5617158f9cd0 0x561715ce5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.027+0000 7f5ab7f37740 1 -- 172.21.15.33:0/4251817697 >> 172.21.15.33:0/4251817697 conn(0x56171592f740 msgr2=0x561715cee2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.027+0000 7f5ab7f37740 1 -- 172.21.15.33:0/4251817697 shutdown_connections 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.027+0000 7f5ab7f37740 1 -- 172.21.15.33:0/4251817697 wait complete. 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.027+0000 7f5ab7f37740 1 -- start start 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.027+0000 7f5ab7f37740 1 Processor -- start 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617158f9cd0 0x561715cf1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715cf21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5ab7f37740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715d628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5ab7f37740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac1b1ff0 con 0x561715912490 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5ab7f37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac1b1920 con 0x5617158f9cd0 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5ab7f37740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac1aeb60 con 0x56171591a670 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5ab7f37740 10 client.0 _ll_register_callbacks cb 0x7f5a9c00b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715cf21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715cf21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41926/0 (socket says 172.21.15.33:41926) 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaaffd640 1 -- 172.21.15.33:0/3316940156 learned_addr learned my addr 172.21.15.33:0/3316940156 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:43.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617158f9cd0 0x561715cf1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715d628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaaffd640 1 -- 172.21.15.33:0/3316940156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 msgr2=0x561715d628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaaffd640 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715d628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaaffd640 1 -- 172.21.15.33:0/3316940156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617158f9cd0 msgr2=0x561715cf1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaaffd640 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617158f9cd0 0x561715cf1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaaffd640 1 -- 172.21.15.33:0/3316940156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561715d62f50 con 0x561715912490 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.028+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715d628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.029+0000 7f5aaaffd640 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715cf21b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5aac06b760 tx=0x7f5a9c012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5636e7ac846d9c65 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.029+0000 7f5a8affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.029+0000 7f5a8affd640 1 -- 172.21.15.33:0/3316940156 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c028030 con 0x561715912490 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.029+0000 7f5a8affd640 1 -- 172.21.15.33:0/3316940156 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5a9c01eba0 con 0x561715912490 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.029+0000 7f5ab7f37740 1 -- 172.21.15.33:0/3316940156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aa0004c50 con 0x561715912490 2024-08-28T19:36:43.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.029+0000 7f5a8affd640 1 -- 172.21.15.33:0/3316940156 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a9c032050 con 0x561715912490 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.029+0000 7f5ab7f37740 10 client.16773 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.029+0000 7f5ab7f37740 1 -- 172.21.15.33:0/3316940156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561715d6a3e0 con 0x561715912490 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.030+0000 7f5a8affd640 1 -- 172.21.15.33:0/3316940156 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a9c01eda0 con 0x561715912490 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.030+0000 7f5a8affd640 1 -- 172.21.15.33:0/3316940156 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5a9c024470 con 0x561715912490 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.030+0000 7f5ab7f37740 10 client.16773 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.030+0000 7f5ab7f37740 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.030+0000 7f5ab7f37740 20 client.16773 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.030+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56171593b350 0x561715d6cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.030+0000 7f5ab7f37740 4 client.16773 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.030+0000 7f5ab7f37740 1 -- 172.21.15.33:0/3316940156 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f5aa0004c50 con 0x56171593b350 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.030+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56171593b350 0x561715d6cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.031+0000 7f5a8affd640 10 client.16773 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:43.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.031+0000 7f5aaa7fc640 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56171593b350 0x561715d6cbc0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f6e317019274e53 server_cookie=fc9c87131e61db64 in_seq=0 out_seq=0 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.032+0000 7f5a8affd640 1 -- 172.21.15.33:0/3316940156 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f5aa0004c50 con 0x56171593b350 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.032+0000 7f5a8affd640 10 client.16773 handle_command_reply: tid=0 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.032+0000 7f5ab7f37740 1 client.16773 shutdown 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 1 -- 172.21.15.33:0/3316940156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 msgr2=0x561715cf21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715cf21b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5aac06b760 tx=0x7f5a9c012b20 comp rx=0 tx=0).stop 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 1 -- 172.21.15.33:0/3316940156 shutdown_connections 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56171591a670 0x561715d628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56171593b350 0x561715d6cbc0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561715912490 0x561715cf21b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 1 --2- 172.21.15.33:0/3316940156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617158f9cd0 0x561715cf1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 1 -- 172.21.15.33:0/3316940156 >> 172.21.15.33:0/3316940156 conn(0x56171592f740 msgr2=0x561715ceb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5a8affd640 0 client.16773 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 1 -- 172.21.15.33:0/3316940156 shutdown_connections 2024-08-28T19:36:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 1 -- 172.21.15.33:0/3316940156 wait complete. 2024-08-28T19:36:43.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.033+0000 7f5ab7f37740 20 client.16773 trim_cache size 0 max 16384 2024-08-28T19:36:43.039 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:36:43.039 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:36:43.039 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "0d2ec7ad-63e2-4255-a66a-f158a142ebf4", 2024-08-28T19:36:43.039 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:36:43.039 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:36:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 -- 172.21.15.33:0/1870497648 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a940b4cd0 msgr2=0x7f5a940b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a940b4cd0 0x7f5a940b71e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4045000 tx=0x7f5aa40c8ec0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 -- 172.21.15.33:0/1870497648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aac108a90 msgr2=0x7f5aac19baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aac108a90 0x7f5aac19baf0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009430 tx=0x7f5aa40319f0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 -- 172.21.15.33:0/1870497648 shutdown_connections 2024-08-28T19:36:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5aac108a90 0x7f5aac19baf0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aac108140 0x7f5aac19b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a940b4cd0 0x7f5a940b71e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 --2- 172.21.15.33:0/1870497648 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5aac102800 0x7f5aac19b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 -- 172.21.15.33:0/1870497648 >> 172.21.15.33:0/1870497648 conn(0x7f5aac0794d0 msgr2=0x7f5aac105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 -- 172.21.15.33:0/1870497648 shutdown_connections 2024-08-28T19:36:43.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.034+0000 7f5ab19c2640 1 -- 172.21.15.33:0/1870497648 wait complete. 2024-08-28T19:36:43.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:43 smithi059 ceph-mon[22052]: pgmap v470: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:36:43.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:43 smithi122 ceph-mon[22174]: pgmap v470: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:36:43.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:43 smithi033 ceph-mon[18549]: pgmap v470: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.805+0000 7f7402c08640 1 -- 172.21.15.33:0/3153925617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73fc108b10 msgr2=0x7f73fc10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.805+0000 7f7402c08640 1 --2- 172.21.15.33:0/3153925617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73fc108b10 0x7f73fc10f340 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009ca0 tx=0x7f73f402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.805+0000 7f7402c08640 1 -- 172.21.15.33:0/3153925617 shutdown_connections 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.805+0000 7f7402c08640 1 --2- 172.21.15.33:0/3153925617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73fc108b10 0x7f73fc10f340 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.805+0000 7f7402c08640 1 --2- 172.21.15.33:0/3153925617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73fc1081c0 0x7f73fc1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.805+0000 7f7402c08640 1 --2- 172.21.15.33:0/3153925617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc102880 0x7f73fc102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.805+0000 7f7402c08640 1 -- 172.21.15.33:0/3153925617 >> 172.21.15.33:0/3153925617 conn(0x7f73fc079510 msgr2=0x7f73fc079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.805+0000 7f7402c08640 1 -- 172.21.15.33:0/3153925617 shutdown_connections 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.805+0000 7f7402c08640 1 -- 172.21.15.33:0/3153925617 wait complete. 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.806+0000 7f7402c08640 1 Processor -- start 2024-08-28T19:36:43.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.806+0000 7f7402c08640 1 -- start start 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.806+0000 7f7402c08640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73fc102880 0x7f73fc19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.806+0000 7f7402c08640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc1081c0 0x7f73fc19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.806+0000 7f7402c08640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73fc108b10 0x7f73fc19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.806+0000 7f7402c08640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1127c0 con 0x7f73fc102880 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.806+0000 7f7402c08640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc112640 con 0x7f73fc1081c0 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.806+0000 7f7402c08640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc112940 con 0x7f73fc108b10 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.806+0000 7f74009a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73fc102880 0x7f73fc19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f74009a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73fc102880 0x7f73fc19a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41944/0 (socket says 172.21.15.33:41944) 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f74009a4640 1 -- 172.21.15.33:0/931963793 learned_addr learned my addr 172.21.15.33:0/931963793 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f74011a5640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73fc108b10 0x7f73fc19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f73fbfff640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc1081c0 0x7f73fc19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f74009a4640 1 -- 172.21.15.33:0/931963793 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73fc108b10 msgr2=0x7f73fc19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f74009a4640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73fc108b10 0x7f73fc19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f74009a4640 1 -- 172.21.15.33:0/931963793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc1081c0 msgr2=0x7f73fc19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f74009a4640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc1081c0 0x7f73fc19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f74009a4640 1 -- 172.21.15.33:0/931963793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc1a01b0 con 0x7f73fc102880 2024-08-28T19:36:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f73fbfff640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc1081c0 0x7f73fc19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f74009a4640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73fc102880 0x7f73fc19a240 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f73f000d950 tx=0x7f73f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f73f9ffb640 1 -- 172.21.15.33:0/931963793 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0017070 con 0x7f73fc102880 2024-08-28T19:36:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f7402c08640 1 -- 172.21.15.33:0/931963793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc1a04a0 con 0x7f73fc102880 2024-08-28T19:36:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f73f9ffb640 1 -- 172.21.15.33:0/931963793 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73f0009c30 con 0x7f73fc102880 2024-08-28T19:36:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.807+0000 7f73f9ffb640 1 -- 172.21.15.33:0/931963793 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f000f620 con 0x7f73fc102880 2024-08-28T19:36:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.808+0000 7f7402c08640 1 -- 172.21.15.33:0/931963793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc1a6c00 con 0x7f73fc102880 2024-08-28T19:36:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.810+0000 7f73f9ffb640 1 -- 172.21.15.33:0/931963793 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f73f0010460 con 0x7f73fc102880 2024-08-28T19:36:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.810+0000 7f740917d740 1 Processor -- start 2024-08-28T19:36:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.810+0000 7f740917d740 1 -- start start 2024-08-28T19:36:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f740917d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35f55c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f740917d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f561c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f740917d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 0x55eb35f56700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f740917d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55eb35ecca70 con 0x55eb35b87660 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f740917d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eb35ebc000 con 0x55eb35b8f840 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f740917d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55eb35ebffb0 con 0x55eb35bb0520 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f74009a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f74009a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41948/0 (socket says 172.21.15.33:41948) 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f74009a4640 1 -- 172.21.15.33:0/1571123437 learned_addr learned my addr 172.21.15.33:0/1571123437 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f74011a5640 1 --2- 172.21.15.33:0/1571123437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35f55c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f73fbfff640 1 --2- 172.21.15.33:0/1571123437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 0x55eb35f56700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f74009a4640 1 -- 172.21.15.33:0/1571123437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 msgr2=0x55eb35f55c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f74009a4640 1 --2- 172.21.15.33:0/1571123437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35f55c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f74009a4640 1 -- 172.21.15.33:0/1571123437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 msgr2=0x55eb35f56700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f74009a4640 1 --2- 172.21.15.33:0/1571123437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 0x55eb35f56700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f74009a4640 1 -- 172.21.15.33:0/1571123437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb35c1bb00 con 0x55eb35b87660 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f73f9ffb640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73ec0b4ca0 0x7f73ec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.811+0000 7f73fbfff640 1 --2- 172.21.15.33:0/1571123437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 0x55eb35f56700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.812+0000 7f74011a5640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73ec0b4ca0 0x7f73ec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.812+0000 7f73f9ffb640 1 -- 172.21.15.33:0/931963793 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f73f00e54b0 con 0x7f73fc102880 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.812+0000 7f74009a4640 1 --2- 172.21.15.33:0/1571123437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f561c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f73f00e2860 tx=0x7f73f00ebb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d06a7ce6bcce545 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.812+0000 7f73e6ffd640 1 -- 172.21.15.33:0/1571123437 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0020030 con 0x55eb35b87660 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.812+0000 7f73e6ffd640 1 -- 172.21.15.33:0/1571123437 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73f00ab3a0 con 0x55eb35b87660 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.812+0000 7f73e6ffd640 1 -- 172.21.15.33:0/1571123437 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f00ab660 con 0x55eb35b87660 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 -- 172.21.15.33:0/1571123437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 msgr2=0x55eb35f561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 --2- 172.21.15.33:0/1571123437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f561c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f73f00e2860 tx=0x7f73f00ebb60 comp rx=0 tx=0).stop 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f74011a5640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73ec0b4ca0 0x7f73ec0b71b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f73f402f500 tx=0x7f73f402f370 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 -- 172.21.15.33:0/1571123437 shutdown_connections 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 --2- 172.21.15.33:0/1571123437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 0x55eb35f56700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 --2- 172.21.15.33:0/1571123437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f561c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 --2- 172.21.15.33:0/1571123437 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35f55c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 -- 172.21.15.33:0/1571123437 >> 172.21.15.33:0/1571123437 conn(0x55eb35ba4910 msgr2=0x55eb35f53b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 -- 172.21.15.33:0/1571123437 shutdown_connections 2024-08-28T19:36:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 -- 172.21.15.33:0/1571123437 wait complete. 2024-08-28T19:36:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 -- start start 2024-08-28T19:36:43.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.813+0000 7f740917d740 1 Processor -- start 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f740917d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f65c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f740917d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 0x55eb35f66190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f740917d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35f71c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f740917d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55eb35f68760 con 0x55eb35b87660 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f740917d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eb35e7d520 con 0x55eb35b8f840 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f740917d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55eb35f688e0 con 0x55eb35bb0520 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f74009a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f65c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f74009a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f65c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41964/0 (socket says 172.21.15.33:41964) 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f74009a4640 1 -- 172.21.15.33:0/620453250 learned_addr learned my addr 172.21.15.33:0/620453250 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f740917d740 10 client.0 _ll_register_callbacks cb 0x55eb35eb5c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f73fbfff640 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 0x55eb35f66190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f74011a5640 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35f71c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f74009a4640 1 -- 172.21.15.33:0/620453250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 msgr2=0x55eb35f71c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f74009a4640 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35f71c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f74009a4640 1 -- 172.21.15.33:0/620453250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 msgr2=0x55eb35f66190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f74009a4640 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 0x55eb35f66190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f74009a4640 1 -- 172.21.15.33:0/620453250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb35c92960 con 0x55eb35b87660 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f74011a5640 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35f71c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.814+0000 7f73fbfff640 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 0x55eb35f66190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f74009a4640 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f65c50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f73f00ab820 tx=0x7f73f000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86796985801a2692 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f73dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:43.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f73dbfff640 1 -- 172.21.15.33:0/620453250 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f00ab000 con 0x55eb35b87660 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f73dbfff640 1 -- 172.21.15.33:0/620453250 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f73f00abaf0 con 0x55eb35b87660 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f740917d740 1 -- 172.21.15.33:0/620453250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eb35e5b9a0 con 0x55eb35b87660 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f73dbfff640 1 -- 172.21.15.33:0/620453250 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f73f00ab1e0 con 0x55eb35b87660 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f740917d740 10 client.16785 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f740917d740 1 -- 172.21.15.33:0/620453250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eb35f68760 con 0x55eb35b87660 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f73dbfff640 1 -- 172.21.15.33:0/620453250 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55eb35e5b9a0 con 0x55eb35b87660 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f73dbfff640 1 -- 172.21.15.33:0/620453250 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f73f00b4720 con 0x55eb35b87660 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f740917d740 10 client.16785 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f740917d740 10 client.16785 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f740917d740 20 client.16785 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f740917d740 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55eb35b6eea0 0x55eb35f77aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f740917d740 4 client.16785 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.815+0000 7f740917d740 1 -- 172.21.15.33:0/620453250 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb35ece9c0 con 0x55eb35b6eea0 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.816+0000 7f73fbfff640 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55eb35b6eea0 0x55eb35f77aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.816+0000 7f73dbfff640 10 client.16785 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.816+0000 7f73fbfff640 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55eb35b6eea0 0x55eb35f77aa0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f08f376ad2cb74c server_cookie=bd323267605057ad in_seq=0 out_seq=0 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f73dbfff640 1 -- 172.21.15.33:0/620453250 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb35ece9c0 con 0x55eb35b6eea0 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f73dbfff640 10 client.16785 handle_command_reply: tid=0 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 client.16785 shutdown 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 -- 172.21.15.33:0/620453250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 msgr2=0x55eb35f65c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f65c50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f73f00ab820 tx=0x7f73f000bf60 comp rx=0 tx=0).stop 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 -- 172.21.15.33:0/620453250 shutdown_connections 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35f71c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b8f840 0x55eb35f66190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55eb35b6eea0 0x55eb35f77aa0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 --2- 172.21.15.33:0/620453250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b87660 0x55eb35f65c50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 -- 172.21.15.33:0/620453250 >> 172.21.15.33:0/620453250 conn(0x55eb35ba4910 msgr2=0x55eb35f57670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f73dbfff640 0 client.16785 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 -- 172.21.15.33:0/620453250 shutdown_connections 2024-08-28T19:36:43.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 1 -- 172.21.15.33:0/620453250 wait complete. 2024-08-28T19:36:43.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.817+0000 7f740917d740 20 client.16785 trim_cache size 0 max 16384 2024-08-28T19:36:43.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.834+0000 7f740917d740 1 Processor -- start 2024-08-28T19:36:43.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f740917d740 1 -- start start 2024-08-28T19:36:43.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f740917d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 0x55eb35f573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f740917d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35b8f840 0x55eb35f71b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f740917d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35bb0520 0x55eb35f72080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f740917d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1ae900 con 0x55eb35bb0520 2024-08-28T19:36:43.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f740917d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1b0440 con 0x55eb35b87660 2024-08-28T19:36:43.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f740917d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1aefd0 con 0x55eb35b8f840 2024-08-28T19:36:43.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f74011a5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35bb0520 0x55eb35f72080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f74011a5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35bb0520 0x55eb35f72080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41976/0 (socket says 172.21.15.33:41976) 2024-08-28T19:36:43.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f74011a5640 1 -- 172.21.15.33:0/2303729405 learned_addr learned my addr 172.21.15.33:0/2303729405 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:43.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f73fbfff640 1 --2- 172.21.15.33:0/2303729405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35b8f840 0x55eb35f71b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f74009a4640 1 --2- 172.21.15.33:0/2303729405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 0x55eb35f573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f74011a5640 1 -- 172.21.15.33:0/2303729405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35b8f840 msgr2=0x55eb35f71b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f74011a5640 1 --2- 172.21.15.33:0/2303729405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35b8f840 0x55eb35f71b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f74011a5640 1 -- 172.21.15.33:0/2303729405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 msgr2=0x55eb35f573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f74011a5640 1 --2- 172.21.15.33:0/2303729405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 0x55eb35f573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f74011a5640 1 -- 172.21.15.33:0/2303729405 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb35f56ac0 con 0x55eb35bb0520 2024-08-28T19:36:43.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.835+0000 7f74009a4640 1 --2- 172.21.15.33:0/2303729405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 0x55eb35f573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:43.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.836+0000 7f74011a5640 1 --2- 172.21.15.33:0/2303729405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35bb0520 0x55eb35f72080 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009ca0 tx=0x7f73f4041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2718a0fc678069e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:43.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.836+0000 7f73e67fc640 1 -- 172.21.15.33:0/2303729405 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4003970 con 0x55eb35bb0520 2024-08-28T19:36:43.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.836+0000 7f73e67fc640 1 -- 172.21.15.33:0/2303729405 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73f4036050 con 0x55eb35bb0520 2024-08-28T19:36:43.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.836+0000 7f73e67fc640 1 -- 172.21.15.33:0/2303729405 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f402f660 con 0x55eb35bb0520 2024-08-28T19:36:43.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 -- 172.21.15.33:0/2303729405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35bb0520 msgr2=0x55eb35f72080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 --2- 172.21.15.33:0/2303729405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35bb0520 0x55eb35f72080 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009ca0 tx=0x7f73f4041000 comp rx=0 tx=0).stop 2024-08-28T19:36:43.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 -- 172.21.15.33:0/2303729405 shutdown_connections 2024-08-28T19:36:43.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 --2- 172.21.15.33:0/2303729405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35bb0520 0x55eb35f72080 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 --2- 172.21.15.33:0/2303729405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35b8f840 0x55eb35f71b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 --2- 172.21.15.33:0/2303729405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 0x55eb35f573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 -- 172.21.15.33:0/2303729405 >> 172.21.15.33:0/2303729405 conn(0x55eb35ba4910 msgr2=0x55eb35f56cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 -- 172.21.15.33:0/2303729405 shutdown_connections 2024-08-28T19:36:43.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 -- 172.21.15.33:0/2303729405 wait complete. 2024-08-28T19:36:43.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 -- start start 2024-08-28T19:36:43.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.837+0000 7f740917d740 1 Processor -- start 2024-08-28T19:36:43.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f740917d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 0x55eb35f6a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f740917d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b8f840 0x55eb35f6aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f740917d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35fdb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f740917d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1afd70 con 0x55eb35b8f840 2024-08-28T19:36:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f740917d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1af6a0 con 0x55eb35b87660 2024-08-28T19:36:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f740917d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1ac8e0 con 0x55eb35bb0520 2024-08-28T19:36:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f740917d740 10 client.0 _ll_register_callbacks cb 0x7f73f4009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73fbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b8f840 0x55eb35f6aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73fbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b8f840 0x55eb35f6aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41992/0 (socket says 172.21.15.33:41992) 2024-08-28T19:36:43.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73fbfff640 1 -- 172.21.15.33:0/1726547967 learned_addr learned my addr 172.21.15.33:0/1726547967 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f74009a4640 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 0x55eb35f6a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f74011a5640 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35fdb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73fbfff640 1 -- 172.21.15.33:0/1726547967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 msgr2=0x55eb35fdb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73fbfff640 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35fdb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73fbfff640 1 -- 172.21.15.33:0/1726547967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 msgr2=0x55eb35f6a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:43.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73fbfff640 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 0x55eb35f6a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73fbfff640 1 -- 172.21.15.33:0/1726547967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb35fdb940 con 0x55eb35b8f840 2024-08-28T19:36:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f74009a4640 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 0x55eb35f6a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73fbfff640 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b8f840 0x55eb35f6aa70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f73e8005f00 tx=0x7f73e80137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e82a9494e663ec1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73dbfff640 1 -- 172.21.15.33:0/1726547967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e8004440 con 0x55eb35b8f840 2024-08-28T19:36:43.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f73dbfff640 1 -- 172.21.15.33:0/1726547967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f73e80035f0 con 0x55eb35b8f840 2024-08-28T19:36:43.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.838+0000 7f740917d740 1 -- 172.21.15.33:0/1726547967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73f4036050 con 0x55eb35b8f840 2024-08-28T19:36:43.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f73dbfff640 1 -- 172.21.15.33:0/1726547967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f73e80037f0 con 0x55eb35b8f840 2024-08-28T19:36:43.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f740917d740 10 client.16791 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:43.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f740917d740 1 -- 172.21.15.33:0/1726547967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eb35fe2d50 con 0x55eb35b8f840 2024-08-28T19:36:43.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f73dbfff640 1 -- 172.21.15.33:0/1726547967 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73f4036050 con 0x55eb35b8f840 2024-08-28T19:36:43.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f73dbfff640 1 -- 172.21.15.33:0/1726547967 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f73e8022070 con 0x55eb35b8f840 2024-08-28T19:36:43.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f740917d740 10 client.16791 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:43.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f740917d740 10 client.16791 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:36:43.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f740917d740 20 client.16791 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:43.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f740917d740 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55eb35b44250 0x55eb35fe5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:43.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f740917d740 4 client.16791 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6a071a40", "release": true, "await": true}] 2024-08-28T19:36:43.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f740917d740 1 -- 172.21.15.33:0/1726547967 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6a071a40", "release": true, "await": true}) -- 0x55eb35eca460 con 0x55eb35b44250 2024-08-28T19:36:43.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.839+0000 7f74009a4640 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55eb35b44250 0x55eb35fe5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:43.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.840+0000 7f74009a4640 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55eb35b44250 0x55eb35fe5540 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2f641e03ee8b7c0 server_cookie=c33a9a2b6bd7ea2c in_seq=0 out_seq=0 2024-08-28T19:36:43.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.840+0000 7f73dbfff640 10 client.16791 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.844+0000 7f73dbfff640 1 -- 172.21.15.33:0/1726547967 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55eb35eca460 con 0x55eb35b44250 2024-08-28T19:36:43.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.844+0000 7f73dbfff640 10 client.16791 handle_command_reply: tid=0 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.844+0000 7f740917d740 1 client.16791 shutdown 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 1 -- 172.21.15.33:0/1726547967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b8f840 msgr2=0x55eb35f6aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b8f840 0x55eb35f6aa70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f73e8005f00 tx=0x7f73e80137d0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 1 -- 172.21.15.33:0/1726547967 shutdown_connections 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55eb35bb0520 0x55eb35fdb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55eb35b44250 0x55eb35fe5540 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f73dbfff640 0 client.16791 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55eb35b8f840 0x55eb35f6aa70 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 1 --2- 172.21.15.33:0/1726547967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb35b87660 0x55eb35f6a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 1 -- 172.21.15.33:0/1726547967 >> 172.21.15.33:0/1726547967 conn(0x55eb35ba4910 msgr2=0x55eb35f57650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 1 -- 172.21.15.33:0/1726547967 shutdown_connections 2024-08-28T19:36:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 1 -- 172.21.15.33:0/1726547967 wait complete. 2024-08-28T19:36:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.845+0000 7f740917d740 20 client.16791 trim_cache size 0 max 16384 2024-08-28T19:36:43.860 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:36:43.860 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:36:43.860 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:36:43.860 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 12, 2024-08-28T19:36:43.860 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:36:43.860 INFO:teuthology.orchestra.run.smithi033.stdout: "6a071a40": { 2024-08-28T19:36:43.860 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 12, 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 147.0, 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:36:43.861 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:43.862 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:43.862 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:43.862 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:43.862 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:43.862 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:36:43.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 -- 172.21.15.33:0/931963793 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73ec0b4ca0 msgr2=0x7f73ec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73ec0b4ca0 0x7f73ec0b71b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f73f402f500 tx=0x7f73f402f370 comp rx=0 tx=0).stop 2024-08-28T19:36:43.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 -- 172.21.15.33:0/931963793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73fc102880 msgr2=0x7f73fc19a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73fc102880 0x7f73fc19a240 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f73f000d950 tx=0x7f73f000de10 comp rx=0 tx=0).stop 2024-08-28T19:36:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 -- 172.21.15.33:0/931963793 shutdown_connections 2024-08-28T19:36:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f73ec0b4ca0 0x7f73ec0b71b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f73fc108b10 0x7f73fc19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73fc1081c0 0x7f73fc19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 --2- 172.21.15.33:0/931963793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73fc102880 0x7f73fc19a240 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 -- 172.21.15.33:0/931963793 >> 172.21.15.33:0/931963793 conn(0x7f73fc079510 msgr2=0x7f73fc101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 -- 172.21.15.33:0/931963793 shutdown_connections 2024-08-28T19:36:43.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:43.846+0000 7f7402c08640 1 -- 172.21.15.33:0/931963793 wait complete. 2024-08-28T19:36:44.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:44 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:36:44.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:44 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:36:44.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:44 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:36:44.283 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:44 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:36:44.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:44 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:36:44.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:44 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:36:44.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:44 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:36:44.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:44 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:36:44.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:44 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:36:44.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:44 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:36:44.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:44 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:36:44.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:44 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:36:44.476 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:36:45.112 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:45 smithi033 ceph-mon[18549]: pgmap v471: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-08-28T19:36:45.112 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:45 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:36:45.150 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6a071a40', total seconds elapsed: 32.6 2024-08-28T19:36:45.154 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:45.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:45 smithi059 ceph-mon[22052]: pgmap v471: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-08-28T19:36:45.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:45 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:36:45.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:45 smithi122 ceph-mon[22174]: pgmap v471: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-08-28T19:36:45.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:45 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:36:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.657+0000 7fcecb99a640 1 -- 172.21.15.33:0/1050485802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcec4107920 msgr2=0x7fcec4107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.657+0000 7fcecb99a640 1 --2- 172.21.15.33:0/1050485802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcec4107920 0x7fcec4107d30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009900 tx=0x7fcec002a410 comp rx=0 tx=0).stop 2024-08-28T19:36:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.657+0000 7fcecb99a640 1 -- 172.21.15.33:0/1050485802 shutdown_connections 2024-08-28T19:36:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.657+0000 7fcecb99a640 1 --2- 172.21.15.33:0/1050485802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec4108270 0x7fcec410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.657+0000 7fcecb99a640 1 --2- 172.21.15.33:0/1050485802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcec4107920 0x7fcec4107d30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.657+0000 7fcecb99a640 1 --2- 172.21.15.33:0/1050485802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4101fe0 0x7fcec41023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.657+0000 7fcecb99a640 1 -- 172.21.15.33:0/1050485802 >> 172.21.15.33:0/1050485802 conn(0x7fcec4079d30 msgr2=0x7fcec407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.657+0000 7fcecb99a640 1 -- 172.21.15.33:0/1050485802 shutdown_connections 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.657+0000 7fcecb99a640 1 -- 172.21.15.33:0/1050485802 wait complete. 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcecb99a640 1 Processor -- start 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcecb99a640 1 -- start start 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcecb99a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4101fe0 0x7fcec419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcecb99a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec4107920 0x7fcec419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcecb99a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcec4108270 0x7fcec419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcecb99a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4111f30 con 0x7fcec4108270 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcecb99a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4111db0 con 0x7fcec4101fe0 2024-08-28T19:36:45.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcecb99a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41120b0 con 0x7fcec4107920 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcec9f37640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcec4108270 0x7fcec419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcec9f37640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcec4108270 0x7fcec419faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42020/0 (socket says 172.21.15.33:42020) 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcec9f37640 1 -- 172.21.15.33:0/698930044 learned_addr learned my addr 172.21.15.33:0/698930044 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.658+0000 7fcec9736640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4101fe0 0x7fcec419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fcec8f35640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec4107920 0x7fcec419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fcec9f37640 1 -- 172.21.15.33:0/698930044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec4107920 msgr2=0x7fcec419a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fcec9f37640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec4107920 0x7fcec419a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fcec9f37640 1 -- 172.21.15.33:0/698930044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4101fe0 msgr2=0x7fcec419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fcec9f37640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4101fe0 0x7fcec419a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fcec9f37640 1 -- 172.21.15.33:0/698930044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec41a01d0 con 0x7fcec4108270 2024-08-28T19:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fcec9f37640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcec4108270 0x7fcec419faa0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00eaa0 tx=0x7fcebc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fceba7fc640 1 -- 172.21.15.33:0/698930044 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00cdb0 con 0x7fcec4108270 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fcecb99a640 1 -- 172.21.15.33:0/698930044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec41a04c0 con 0x7fcec4108270 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fceba7fc640 1 -- 172.21.15.33:0/698930044 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcebc005020 con 0x7fcec4108270 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fceba7fc640 1 -- 172.21.15.33:0/698930044 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc0116d0 con 0x7fcec4108270 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.659+0000 7fcecb99a640 1 -- 172.21.15.33:0/698930044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec41a6c20 con 0x7fcec4108270 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.662+0000 7fced1f0f740 1 Processor -- start 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.662+0000 7fceba7fc640 1 -- 172.21.15.33:0/698930044 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcebc0054a0 con 0x7fcec4108270 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.662+0000 7fced1f0f740 1 -- start start 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.662+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b69070 0x561f29f0e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.662+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f0e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.662+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f0ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.662+0000 7fced1f0f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561f29e85630 con 0x561f29b69070 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.662+0000 7fced1f0f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561f29e74bc0 con 0x561f29b401b0 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.662+0000 7fced1f0f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561f29e78b70 con 0x561f29b48390 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec8f35640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b69070 0x561f29f0e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec8f35640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b69070 0x561f29f0e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42022/0 (socket says 172.21.15.33:42022) 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec8f35640 1 -- 172.21.15.33:0/2567190324 learned_addr learned my addr 172.21.15.33:0/2567190324 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec9736640 1 --2- 172.21.15.33:0/2567190324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f0e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fceba7fc640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceb00b4ca0 0x7fceb00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec8f35640 1 --2- 172.21.15.33:0/2567190324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f0ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec8f35640 1 -- 172.21.15.33:0/2567190324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 msgr2=0x561f29f0ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:45.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec8f35640 1 --2- 172.21.15.33:0/2567190324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f0ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec8f35640 1 -- 172.21.15.33:0/2567190324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 msgr2=0x561f29f0e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec8f35640 1 --2- 172.21.15.33:0/2567190324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f0e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec8f35640 1 -- 172.21.15.33:0/2567190324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f29bd4650 con 0x561f29b69070 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec9f37640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceb00b4ca0 0x7fceb00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec9736640 1 --2- 172.21.15.33:0/2567190324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f0e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fceba7fc640 1 -- 172.21.15.33:0/698930044 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcebc0e5a30 con 0x7fcec4108270 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fcec8f35640 1 --2- 172.21.15.33:0/2567190324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b69070 0x561f29f0e300 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcec002a930 tx=0x7fcec0005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d992f0189559603f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fceaf7fe640 1 -- 172.21.15.33:0/2567190324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0035050 con 0x561f29b69070 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fceaf7fe640 1 -- 172.21.15.33:0/2567190324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec00317c0 con 0x561f29b69070 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.663+0000 7fceaf7fe640 1 -- 172.21.15.33:0/2567190324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec00046c0 con 0x561f29b69070 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.664+0000 7fced1f0f740 1 -- 172.21.15.33:0/2567190324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b69070 msgr2=0x561f29f0e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.664+0000 7fcec9f37640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceb00b4ca0 0x7fceb00b71b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0e3430 tx=0x7fcebc093040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:45.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.664+0000 7fced1f0f740 1 --2- 172.21.15.33:0/2567190324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b69070 0x561f29f0e300 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcec002a930 tx=0x7fcec0005a20 comp rx=0 tx=0).stop 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.664+0000 7fced1f0f740 1 -- 172.21.15.33:0/2567190324 shutdown_connections 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.664+0000 7fced1f0f740 1 --2- 172.21.15.33:0/2567190324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f0ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.664+0000 7fced1f0f740 1 --2- 172.21.15.33:0/2567190324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f0e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.664+0000 7fced1f0f740 1 --2- 172.21.15.33:0/2567190324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b69070 0x561f29f0e300 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.664+0000 7fced1f0f740 1 -- 172.21.15.33:0/2567190324 >> 172.21.15.33:0/2567190324 conn(0x561f29b5d460 msgr2=0x561f29f0c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.664+0000 7fced1f0f740 1 -- 172.21.15.33:0/2567190324 shutdown_connections 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.664+0000 7fced1f0f740 1 -- 172.21.15.33:0/2567190324 wait complete. 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.665+0000 7fced1f0f740 1 -- start start 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.665+0000 7fced1f0f740 1 Processor -- start 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f1de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b48390 0x561f29f1e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b69070 0x561f29f2a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fced1f0f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561f29cd7700 con 0x561f29b48390 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fced1f0f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561f29dfb700 con 0x561f29b401b0 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fced1f0f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561f29f20de0 con 0x561f29b69070 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fced1f0f740 10 client.0 _ll_register_callbacks cb 0x561f29e2adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec9736640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b48390 0x561f29f1e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec9736640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b48390 0x561f29f1e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42034/0 (socket says 172.21.15.33:42034) 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec9736640 1 -- 172.21.15.33:0/1797922840 learned_addr learned my addr 172.21.15.33:0/1797922840 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec8f35640 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f1de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec8f35640 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b69070 0x561f29f2a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec9736640 1 -- 172.21.15.33:0/1797922840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b69070 msgr2=0x561f29f2a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:45.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec9736640 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b69070 0x561f29f2a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec9736640 1 -- 172.21.15.33:0/1797922840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 msgr2=0x561f29f1de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec9736640 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f1de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec9736640 1 -- 172.21.15.33:0/1797922840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f29e348b0 con 0x561f29b48390 2024-08-28T19:36:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fcec9736640 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b48390 0x561f29f1e340 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fceb40127f0 tx=0x7fceb4012cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9961459a1cbe9709 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.666+0000 7fceacff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fceacff9640 1 -- 172.21.15.33:0/1797922840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb401f060 con 0x561f29b48390 2024-08-28T19:36:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fceacff9640 1 -- 172.21.15.33:0/1797922840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fceb4010d60 con 0x561f29b48390 2024-08-28T19:36:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fced1f0f740 1 -- 172.21.15.33:0/1797922840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec00317c0 con 0x561f29b48390 2024-08-28T19:36:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fceacff9640 1 -- 172.21.15.33:0/1797922840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fceb4026050 con 0x561f29b48390 2024-08-28T19:36:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fced1f0f740 10 client.16803 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fced1f0f740 1 -- 172.21.15.33:0/1797922840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f29f2cb90 con 0x561f29b48390 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fceacff9640 1 -- 172.21.15.33:0/1797922840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec00317c0 con 0x561f29b48390 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fceacff9640 1 -- 172.21.15.33:0/1797922840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fceb400e4b0 con 0x561f29b48390 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fced1f0f740 10 client.16803 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fced1f0f740 10 client.16803 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fced1f0f740 20 client.16803 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fced1f0f740 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561f29b279f0 0x561f29f300c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fced1f0f740 4 client.16803 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.667+0000 7fced1f0f740 1 -- 172.21.15.33:0/1797922840 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f29e87580 con 0x561f29b279f0 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.668+0000 7fcec8f35640 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561f29b279f0 0x561f29f300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.668+0000 7fcec8f35640 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561f29b279f0 0x561f29f300c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25998156eb8f9204 server_cookie=68190bbbe8404b5e in_seq=0 out_seq=0 2024-08-28T19:36:45.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.668+0000 7fceacff9640 10 client.16803 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fceacff9640 1 -- 172.21.15.33:0/1797922840 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f29e87580 con 0x561f29b279f0 2024-08-28T19:36:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fceacff9640 10 client.16803 handle_command_reply: tid=0 2024-08-28T19:36:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 client.16803 shutdown 2024-08-28T19:36:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 -- 172.21.15.33:0/1797922840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b48390 msgr2=0x561f29f1e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b48390 0x561f29f1e340 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fceb40127f0 tx=0x7fceb4012cb0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 -- 172.21.15.33:0/1797922840 shutdown_connections 2024-08-28T19:36:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b69070 0x561f29f2a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561f29b279f0 0x561f29f300c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b48390 0x561f29f1e340 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fceacff9640 0 client.16803 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 --2- 172.21.15.33:0/1797922840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f1de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 -- 172.21.15.33:0/1797922840 >> 172.21.15.33:0/1797922840 conn(0x561f29b5d460 msgr2=0x561f29f0a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 -- 172.21.15.33:0/1797922840 shutdown_connections 2024-08-28T19:36:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 1 -- 172.21.15.33:0/1797922840 wait complete. 2024-08-28T19:36:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.669+0000 7fced1f0f740 20 client.16803 trim_cache size 0 max 16384 2024-08-28T19:36:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fced1f0f740 1 Processor -- start 2024-08-28T19:36:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fced1f0f740 1 -- start start 2024-08-28T19:36:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b279f0 0x561f29f0fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b401b0 0x561f29f1fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f2a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fced1f0f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41ae8b0 con 0x561f29b401b0 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fced1f0f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41b03f0 con 0x561f29b279f0 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fced1f0f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41aef80 con 0x561f29b48390 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fcec9736640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b401b0 0x561f29f1fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fcec9736640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b401b0 0x561f29f1fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42044/0 (socket says 172.21.15.33:42044) 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.687+0000 7fcec9736640 1 -- 172.21.15.33:0/752560127 learned_addr learned my addr 172.21.15.33:0/752560127 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fcec8f35640 1 --2- 172.21.15.33:0/752560127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b279f0 0x561f29f0fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fcec8f35640 1 --2- 172.21.15.33:0/752560127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f2a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fcec9736640 1 -- 172.21.15.33:0/752560127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 msgr2=0x561f29f2a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fcec9736640 1 --2- 172.21.15.33:0/752560127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f2a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fcec9736640 1 -- 172.21.15.33:0/752560127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b279f0 msgr2=0x561f29f0fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fcec9736640 1 --2- 172.21.15.33:0/752560127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b279f0 0x561f29f0fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fcec9736640 1 -- 172.21.15.33:0/752560127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f29f11130 con 0x561f29b401b0 2024-08-28T19:36:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fcec8f35640 1 --2- 172.21.15.33:0/752560127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b279f0 0x561f29f0fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fcec9736640 1 --2- 172.21.15.33:0/752560127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b401b0 0x561f29f1fa30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fceb400ac00 tx=0x7fceb4005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34906d6219b97d8b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fceaeffd640 1 -- 172.21.15.33:0/752560127 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb402e030 con 0x561f29b401b0 2024-08-28T19:36:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fceaeffd640 1 -- 172.21.15.33:0/752560127 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceb400ebb0 con 0x561f29b401b0 2024-08-28T19:36:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.688+0000 7fceaeffd640 1 -- 172.21.15.33:0/752560127 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4005290 con 0x561f29b401b0 2024-08-28T19:36:45.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 -- 172.21.15.33:0/752560127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b401b0 msgr2=0x561f29f1fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:45.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 --2- 172.21.15.33:0/752560127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b401b0 0x561f29f1fa30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fceb400ac00 tx=0x7fceb4005a10 comp rx=0 tx=0).stop 2024-08-28T19:36:45.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 -- 172.21.15.33:0/752560127 shutdown_connections 2024-08-28T19:36:45.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 --2- 172.21.15.33:0/752560127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f2a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 --2- 172.21.15.33:0/752560127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b401b0 0x561f29f1fa30 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 --2- 172.21.15.33:0/752560127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b279f0 0x561f29f0fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 -- 172.21.15.33:0/752560127 >> 172.21.15.33:0/752560127 conn(0x561f29b5d460 msgr2=0x561f29f1f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 -- 172.21.15.33:0/752560127 shutdown_connections 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 -- 172.21.15.33:0/752560127 wait complete. 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 -- start start 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.689+0000 7fced1f0f740 1 Processor -- start 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b279f0 0x561f29f248f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f24e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fced1f0f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f99a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fced1f0f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41afd20 con 0x561f29b279f0 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fced1f0f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41af650 con 0x561f29b401b0 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fced1f0f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41ac890 con 0x561f29b48390 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fced1f0f740 10 client.0 _ll_register_callbacks cb 0x7fceb400a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fcec8f35640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b279f0 0x561f29f248f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fcec8f35640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b279f0 0x561f29f248f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42058/0 (socket says 172.21.15.33:42058) 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fcec8f35640 1 -- 172.21.15.33:0/2984143063 learned_addr learned my addr 172.21.15.33:0/2984143063 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fcec9736640 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f24e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fcec8f35640 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f99a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fcec8f35640 1 -- 172.21.15.33:0/2984143063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 msgr2=0x561f29f99a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fcec8f35640 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f99a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fcec8f35640 1 -- 172.21.15.33:0/2984143063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 msgr2=0x561f29f24e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fcec8f35640 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f24e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.690+0000 7fcec8f35640 1 -- 172.21.15.33:0/2984143063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f29f9a0d0 con 0x561f29b279f0 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fcec8f35640 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b279f0 0x561f29f248f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fcec0031640 tx=0x7fcec0051f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d94814e0b3a85 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fceacff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fceacff9640 1 -- 172.21.15.33:0/2984143063 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0035040 con 0x561f29b279f0 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fceacff9640 1 -- 172.21.15.33:0/2984143063 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcec0004300 con 0x561f29b279f0 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fced1f0f740 1 -- 172.21.15.33:0/2984143063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fceb400ebb0 con 0x561f29b279f0 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fceacff9640 1 -- 172.21.15.33:0/2984143063 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcec0031b10 con 0x561f29b279f0 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fced1f0f740 10 client.16809 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fced1f0f740 1 -- 172.21.15.33:0/2984143063 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f29f9b360 con 0x561f29b279f0 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fceacff9640 1 -- 172.21.15.33:0/2984143063 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceb400ebb0 con 0x561f29b279f0 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fceacff9640 1 -- 172.21.15.33:0/2984143063 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcec00049d0 con 0x561f29b279f0 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fced1f0f740 10 client.16809 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.691+0000 7fced1f0f740 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.692+0000 7fced1f0f740 20 client.16809 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.692+0000 7fced1f0f740 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561f29b69070 0x561f29f9d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.692+0000 7fced1f0f740 4 client.16809 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.692+0000 7fced1f0f740 1 -- 172.21.15.33:0/2984143063 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561f29e83020 con 0x561f29b69070 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.692+0000 7fcec9736640 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561f29b69070 0x561f29f9d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.692+0000 7fceacff9640 10 client.16809 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.692+0000 7fcec9736640 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561f29b69070 0x561f29f9d700 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dd02be164a1d663 server_cookie=f4f49ba37a5d7529 in_seq=0 out_seq=0 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fceacff9640 1 -- 172.21.15.33:0/2984143063 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x561f29e83020 con 0x561f29b69070 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fceacff9640 10 client.16809 handle_command_reply: tid=0 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 client.16809 shutdown 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 -- 172.21.15.33:0/2984143063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b279f0 msgr2=0x561f29f248f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b279f0 0x561f29f248f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fcec0031640 tx=0x7fcec0051f90 comp rx=0 tx=0).stop 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 -- 172.21.15.33:0/2984143063 shutdown_connections 2024-08-28T19:36:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561f29b48390 0x561f29f99a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561f29b401b0 0x561f29f24e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561f29b69070 0x561f29f9d700 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 --2- 172.21.15.33:0/2984143063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561f29b279f0 0x561f29f248f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fceacff9640 0 client.16809 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:45.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 -- 172.21.15.33:0/2984143063 >> 172.21.15.33:0/2984143063 conn(0x561f29b5d460 msgr2=0x561f29f0fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:45.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 -- 172.21.15.33:0/2984143063 shutdown_connections 2024-08-28T19:36:45.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 1 -- 172.21.15.33:0/2984143063 wait complete. 2024-08-28T19:36:45.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.693+0000 7fced1f0f740 20 client.16809 trim_cache size 0 max 16384 2024-08-28T19:36:45.703 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:36:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:36:45.704 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:45.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:45.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:36:45.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:36:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:36:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:36:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:36:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:45.708 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:36:45.708 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:36:45.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 -- 172.21.15.33:0/698930044 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceb00b4ca0 msgr2=0x7fceb00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceb00b4ca0 0x7fceb00b71b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0e3430 tx=0x7fcebc093040 comp rx=0 tx=0).stop 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 -- 172.21.15.33:0/698930044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcec4108270 msgr2=0x7fcec419faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcec4108270 0x7fcec419faa0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00eaa0 tx=0x7fcebc00ef60 comp rx=0 tx=0).stop 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 -- 172.21.15.33:0/698930044 shutdown_connections 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcec4108270 0x7fcec419faa0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fceb00b4ca0 0x7fceb00b71b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcec4107920 0x7fcec419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 --2- 172.21.15.33:0/698930044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4101fe0 0x7fcec419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 -- 172.21.15.33:0/698930044 >> 172.21.15.33:0/698930044 conn(0x7fcec4079d30 msgr2=0x7fcec4108950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 -- 172.21.15.33:0/698930044 shutdown_connections 2024-08-28T19:36:45.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:45.694+0000 7fcecb99a640 1 -- 172.21.15.33:0/698930044 wait complete. 2024-08-28T19:36:46.577 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:36:46.577 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:36:46.882 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:47.282 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:47 smithi059 ceph-mon[22052]: pgmap v472: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-08-28T19:36:47.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:47 smithi122 ceph-mon[22174]: pgmap v472: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-08-28T19:36:47.303 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:47 smithi033 ceph-mon[18549]: pgmap v472: 129 pgs: 129 active+clean; 4.0 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-08-28T19:36:47.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.393+0000 7f9ad6c19640 1 -- 172.21.15.33:0/2775425292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ad0104620 msgr2=0x7f9ad0104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:47.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.393+0000 7f9ad6c19640 1 --2- 172.21.15.33:0/2775425292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ad0104620 0x7f9ad0104a30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009900 tx=0x7f9ab802a410 comp rx=0 tx=0).stop 2024-08-28T19:36:47.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.393+0000 7f9ad6c19640 1 -- 172.21.15.33:0/2775425292 shutdown_connections 2024-08-28T19:36:47.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.393+0000 7f9ad6c19640 1 --2- 172.21.15.33:0/2775425292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad010dbd0 0x7f9ad01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:47.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.393+0000 7f9ad6c19640 1 --2- 172.21.15.33:0/2775425292 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ad0105050 0x7f9ad010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:47.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.393+0000 7f9ad6c19640 1 --2- 172.21.15.33:0/2775425292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ad0104620 0x7f9ad0104a30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:47.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.393+0000 7f9ad6c19640 1 -- 172.21.15.33:0/2775425292 >> 172.21.15.33:0/2775425292 conn(0x7f9ad00794d0 msgr2=0x7f9ad00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.393+0000 7f9ad6c19640 1 -- 172.21.15.33:0/2775425292 shutdown_connections 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.393+0000 7f9ad6c19640 1 -- 172.21.15.33:0/2775425292 wait complete. 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad6c19640 1 Processor -- start 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad6c19640 1 -- start start 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad6c19640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad0104620 0x7f9ad019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad6c19640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ad0105050 0x7f9ad019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad6c19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ad010dbd0 0x7f9ad019fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad6c19640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad01137f0 con 0x7f9ad010dbd0 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad6c19640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad0113670 con 0x7f9ad0104620 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad6c19640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad0113970 con 0x7f9ad0105050 2024-08-28T19:36:47.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad51b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ad010dbd0 0x7f9ad019fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad51b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ad010dbd0 0x7f9ad019fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42082/0 (socket says 172.21.15.33:42082) 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.394+0000 7f9ad51b6640 1 -- 172.21.15.33:0/883538486 learned_addr learned my addr 172.21.15.33:0/883538486 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9ad49b5640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad0104620 0x7f9ad019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9acffff640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ad0105050 0x7f9ad019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9ad51b6640 1 -- 172.21.15.33:0/883538486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ad0105050 msgr2=0x7f9ad019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9ad51b6640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ad0105050 0x7f9ad019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9ad51b6640 1 -- 172.21.15.33:0/883538486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad0104620 msgr2=0x7f9ad019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9ad51b6640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad0104620 0x7f9ad019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9ad51b6640 1 -- 172.21.15.33:0/883538486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad01a0090 con 0x7f9ad010dbd0 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9ad51b6640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ad010dbd0 0x7f9ad019fa20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800d750 tx=0x7f9ac800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9acdffb640 1 -- 172.21.15.33:0/883538486 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8017070 con 0x7f9ad010dbd0 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9acdffb640 1 -- 172.21.15.33:0/883538486 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ac80054d0 con 0x7f9ad010dbd0 2024-08-28T19:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9ad6c19640 1 -- 172.21.15.33:0/883538486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad01a0380 con 0x7f9ad010dbd0 2024-08-28T19:36:47.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9acdffb640 1 -- 172.21.15.33:0/883538486 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8004c60 con 0x7f9ad010dbd0 2024-08-28T19:36:47.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.395+0000 7f9ad6c19640 1 -- 172.21.15.33:0/883538486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad01a6ba0 con 0x7f9ad010dbd0 2024-08-28T19:36:47.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.396+0000 7f9ad6c19640 1 -- 172.21.15.33:0/883538486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad006b260 con 0x7f9ad010dbd0 2024-08-28T19:36:47.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.398+0000 7f9acdffb640 1 -- 172.21.15.33:0/883538486 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9ac8009bd0 con 0x7f9ad010dbd0 2024-08-28T19:36:47.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.399+0000 7f9acdffb640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9abc0b4cd0 0x7f9abc0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:47.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.399+0000 7f9ad49b5640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9abc0b4cd0 0x7f9abc0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:47.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.399+0000 7f9acdffb640 1 -- 172.21.15.33:0/883538486 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9ac80e5660 con 0x7f9ad010dbd0 2024-08-28T19:36:47.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.399+0000 7f9ad49b5640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9abc0b4cd0 0x7f9abc0b71e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8000c00 tx=0x7f9ab8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:47.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.402+0000 7f9acdffb640 1 -- 172.21.15.33:0/883538486 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9ac80aba50 con 0x7f9ad010dbd0 2024-08-28T19:36:47.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.623+0000 7f9ad6c19640 1 -- 172.21.15.33:0/883538486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ad0108d00 con 0x7f9ad010dbd0 2024-08-28T19:36:47.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.624+0000 7f9acdffb640 1 -- 172.21.15.33:0/883538486 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f9ac80b0210 con 0x7f9ad010dbd0 2024-08-28T19:36:47.626 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:36:47.626 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:36:47.626 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:36:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 -- 172.21.15.33:0/883538486 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9abc0b4cd0 msgr2=0x7f9abc0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9abc0b4cd0 0x7f9abc0b71e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8000c00 tx=0x7f9ab8031400 comp rx=0 tx=0).stop 2024-08-28T19:36:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 -- 172.21.15.33:0/883538486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ad010dbd0 msgr2=0x7f9ad019fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ad010dbd0 0x7f9ad019fa20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800d750 tx=0x7f9ac800dc10 comp rx=0 tx=0).stop 2024-08-28T19:36:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 -- 172.21.15.33:0/883538486 shutdown_connections 2024-08-28T19:36:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ad010dbd0 0x7f9ad019fa20 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9abc0b4cd0 0x7f9abc0b71e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9ad0105050 0x7f9ad019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 --2- 172.21.15.33:0/883538486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad0104620 0x7f9ad019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 -- 172.21.15.33:0/883538486 >> 172.21.15.33:0/883538486 conn(0x7f9ad00794d0 msgr2=0x7f9ad0100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 -- 172.21.15.33:0/883538486 shutdown_connections 2024-08-28T19:36:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:47.626+0000 7f9ad6c19640 1 -- 172.21.15.33:0/883538486 wait complete. 2024-08-28T19:36:48.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:48 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/883538486' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:48.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:48 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/883538486' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:48.465 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:36:48.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:48 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/883538486' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:36:48.720 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:48.893 INFO:tasks.workunit.client.0.smithi033.stdout:64/600: open fd = 3 2024-08-28T19:36:48.893 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.893 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:65/600: open fd = 3 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:66/600: open fd = 3 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:67/600: open fd = 3 2024-08-28T19:36:48.894 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:68/600: open fd = 3 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:69/600: open fd = 3 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:70/600: open fd = 3 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.895 INFO:tasks.workunit.client.0.smithi033.stdout:71/600: open fd = 3 2024-08-28T19:36:48.896 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.896 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.896 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.896 INFO:tasks.workunit.client.0.smithi033.stdout:72/600: open fd = 3 2024-08-28T19:36:48.896 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.896 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.896 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.896 INFO:tasks.workunit.client.0.smithi033.stdout:73/600: open fd = 3 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:74/600: open fd = 3 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:75/600: open fd = 3 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.897 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:76/600: open fd = 3 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:77/600: open fd = 3 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:78/600: open fd = 3 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.898 INFO:tasks.workunit.client.0.smithi033.stdout:79/600: open fd = 3 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:80/600: open fd = 3 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:81/600: open fd = 3 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:82/600: open fd = 3 2024-08-28T19:36:48.899 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:83/600: open fd = 3 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:84/600: open fd = 3 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:85/600: open fd = 3 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.900 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:86/600: open fd = 3 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:87/600: open fd = 3 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:88/600: open fd = 3 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.901 INFO:tasks.workunit.client.0.smithi033.stdout:89/600: open fd = 3 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:90/600: open fd = 3 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:91/600: open fd = 3 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.902 INFO:tasks.workunit.client.0.smithi033.stdout:92/600: open fd = 3 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:93/600: open fd = 3 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:94/600: open fd = 3 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:95/600: open fd = 3 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.903 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:96/600: open fd = 3 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:97/600: open fd = 3 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:98/600: open fd = 3 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.904 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:99/600: open fd = 3 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:100/600: open fd = 3 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:101/600: open fd = 3 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.905 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:102/600: open fd = 3 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:103/600: open fd = 3 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:104/600: open fd = 3 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.906 INFO:tasks.workunit.client.0.smithi033.stdout:105/600: open fd = 3 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:106/600: open fd = 3 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:107/600: open fd = 3 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:108/600: open fd = 3 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.907 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:109/600: open fd = 3 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:110/600: open fd = 3 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:111/600: open fd = 3 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.908 INFO:tasks.workunit.client.0.smithi033.stdout:112/600: open fd = 3 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:113/600: open fd = 3 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:114/600: open fd = 3 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:115/600: open fd = 3 2024-08-28T19:36:48.909 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:116/600: open fd = 3 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:117/600: open fd = 3 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:118/600: open fd = 3 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.910 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:119/600: open fd = 3 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:120/600: open fd = 3 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:121/600: open fd = 3 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:122/600: open fd = 3 2024-08-28T19:36:48.911 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:123/600: open fd = 3 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:124/600: open fd = 3 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:125/600: open fd = 3 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:48.912 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:36:48.913 INFO:tasks.workunit.client.0.smithi033.stdout:126/600: open fd = 3 2024-08-28T19:36:48.913 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:36:49.097 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:49 smithi033 ceph-mon[18549]: pgmap v473: 129 pgs: 129 active+clean; 4.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-08-28T19:36:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.187+0000 7fc5e50bd640 1 -- 172.21.15.33:0/948348712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e0108a90 msgr2=0x7fc5e010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.187+0000 7fc5e50bd640 1 --2- 172.21.15.33:0/948348712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e0108a90 0x7fc5e010f2c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009ca0 tx=0x7fc5d802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.187+0000 7fc5e50bd640 1 -- 172.21.15.33:0/948348712 shutdown_connections 2024-08-28T19:36:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.187+0000 7fc5e50bd640 1 --2- 172.21.15.33:0/948348712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e0108a90 0x7fc5e010f2c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.187+0000 7fc5e50bd640 1 --2- 172.21.15.33:0/948348712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5e0108140 0x7fc5e0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.187+0000 7fc5e50bd640 1 --2- 172.21.15.33:0/948348712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5e0102800 0x7fc5e0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.187+0000 7fc5e50bd640 1 -- 172.21.15.33:0/948348712 >> 172.21.15.33:0/948348712 conn(0x7fc5e00794d0 msgr2=0x7fc5e00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.187+0000 7fc5e50bd640 1 -- 172.21.15.33:0/948348712 shutdown_connections 2024-08-28T19:36:49.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.187+0000 7fc5e50bd640 1 -- 172.21.15.33:0/948348712 wait complete. 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.188+0000 7fc5e50bd640 1 Processor -- start 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.188+0000 7fc5e50bd640 1 -- start start 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5e50bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5e0102800 0x7fc5e019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5e50bd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e0108140 0x7fc5e019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5e50bd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5e0108a90 0x7fc5e019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5e50bd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e0113820 con 0x7fc5e0108140 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5e50bd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e01136a0 con 0x7fc5e0102800 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5e50bd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e01139a0 con 0x7fc5e0108a90 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5de59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e0108140 0x7fc5e019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5de59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e0108140 0x7fc5e019a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51856/0 (socket says 172.21.15.33:51856) 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5de59c640 1 -- 172.21.15.33:0/1181916685 learned_addr learned my addr 172.21.15.33:0/1181916685 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5e0102800 0x7fc5e019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5df59e640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5e0108a90 0x7fc5e019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5de59c640 1 -- 172.21.15.33:0/1181916685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5e0108a90 msgr2=0x7fc5e019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5de59c640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5e0108a90 0x7fc5e019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5de59c640 1 -- 172.21.15.33:0/1181916685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5e0102800 msgr2=0x7fc5e019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5de59c640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5e0102800 0x7fc5e019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5de59c640 1 -- 172.21.15.33:0/1181916685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e01a01a0 con 0x7fc5e0108140 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5de59c640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e0108140 0x7fc5e019a7d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4005fd0 tx=0x7fc5d400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5c7fff640 1 -- 172.21.15.33:0/1181916685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4017070 con 0x7fc5e0108140 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5e50bd640 1 -- 172.21.15.33:0/1181916685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e01a0490 con 0x7fc5e0108140 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5c7fff640 1 -- 172.21.15.33:0/1181916685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5d4009c30 con 0x7fc5e0108140 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.189+0000 7fc5c7fff640 1 -- 172.21.15.33:0/1181916685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4003d30 con 0x7fc5e0108140 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.190+0000 7fc5e50bd640 1 -- 172.21.15.33:0/1181916685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e01a6bf0 con 0x7fc5e0108140 2024-08-28T19:36:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.192+0000 7fc5eb632740 1 Processor -- start 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.192+0000 7fc5eb632740 1 -- start start 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 0x559974d99310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749cb1b0 0x559974d99850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749d3390 0x559974d99d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5eb632740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559974d10680 con 0x5599749cb1b0 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5eb632740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559974cffc10 con 0x5599749f4070 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5eb632740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559974d03bc0 con 0x5599749d3390 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5c7fff640 1 -- 172.21.15.33:0/1181916685 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc5d4004020 con 0x7fc5e0108140 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5ded9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749cb1b0 0x559974d99850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5ded9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749cb1b0 0x559974d99850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51862/0 (socket says 172.21.15.33:51862) 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5ded9d640 1 -- 172.21.15.33:0/4043359108 learned_addr learned my addr 172.21.15.33:0/4043359108 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5df59e640 1 --2- 172.21.15.33:0/4043359108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 0x559974d99310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5de59c640 1 --2- 172.21.15.33:0/4043359108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749d3390 0x559974d99d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5ded9d640 1 -- 172.21.15.33:0/4043359108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749d3390 msgr2=0x559974d99d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/4043359108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749d3390 0x559974d99d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5ded9d640 1 -- 172.21.15.33:0/4043359108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 msgr2=0x559974d99310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/4043359108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 0x559974d99310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5ded9d640 1 -- 172.21.15.33:0/4043359108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559974a5f650 con 0x5599749cb1b0 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/4043359108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749cb1b0 0x559974d99850 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009d20 tx=0x7fc5d0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52364e928de908c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5c57fa640 1 -- 172.21.15.33:0/4043359108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d001e070 con 0x5599749cb1b0 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.193+0000 7fc5c57fa640 1 -- 172.21.15.33:0/4043359108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5d0019ae0 con 0x5599749cb1b0 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5c57fa640 1 -- 172.21.15.33:0/4043359108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d000ea60 con 0x5599749cb1b0 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5c7fff640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5c80b4ca0 0x7fc5c80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5df59e640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5c80b4ca0 0x7fc5c80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5c7fff640 1 -- 172.21.15.33:0/1181916685 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc5d40e5410 con 0x7fc5e0108140 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5eb632740 1 -- 172.21.15.33:0/4043359108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749cb1b0 msgr2=0x559974d99850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5df59e640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5c80b4ca0 0x7fc5c80b71b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc5d802f500 tx=0x7fc5d802f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5eb632740 1 --2- 172.21.15.33:0/4043359108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749cb1b0 0x559974d99850 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009d20 tx=0x7fc5d0011810 comp rx=0 tx=0).stop 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5eb632740 1 -- 172.21.15.33:0/4043359108 shutdown_connections 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5eb632740 1 --2- 172.21.15.33:0/4043359108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749d3390 0x559974d99d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5eb632740 1 --2- 172.21.15.33:0/4043359108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749cb1b0 0x559974d99850 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5eb632740 1 --2- 172.21.15.33:0/4043359108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 0x559974d99310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5eb632740 1 -- 172.21.15.33:0/4043359108 >> 172.21.15.33:0/4043359108 conn(0x5599749e8460 msgr2=0x559974d97200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5eb632740 1 -- 172.21.15.33:0/4043359108 shutdown_connections 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.194+0000 7fc5eb632740 1 -- 172.21.15.33:0/4043359108 wait complete. 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5eb632740 1 -- start start 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5eb632740 1 Processor -- start 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 0x559974da4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 0x559974db0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5eb632740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559974b62700 con 0x5599749d3390 2024-08-28T19:36:49.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5eb632740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559974c86750 con 0x5599749cb1b0 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5eb632740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559974da7af0 con 0x5599749f4070 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5eb632740 10 client.0 _ll_register_callbacks cb 0x559974cb5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5de59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5de59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51874/0 (socket says 172.21.15.33:51874) 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5de59c640 1 -- 172.21.15.33:0/2612375893 learned_addr learned my addr 172.21.15.33:0/2612375893 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.195+0000 7fc5df59e640 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 0x559974db0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 0x559974da4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5de59c640 1 -- 172.21.15.33:0/2612375893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 msgr2=0x559974db0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5de59c640 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 0x559974db0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5de59c640 1 -- 172.21.15.33:0/2612375893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 msgr2=0x559974da4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5de59c640 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 0x559974da4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5de59c640 1 -- 172.21.15.33:0/2612375893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559974cbf900 con 0x5599749d3390 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5df59e640 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 0x559974db0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:49.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 0x559974da4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5de59c640 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da4f50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009610 tx=0x7fc5d40ab640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d46ad83a16c1bf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2612375893 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40b4410 con 0x5599749d3390 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2612375893 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc5d40e5120 con 0x5599749d3390 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5eb632740 1 -- 172.21.15.33:0/2612375893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5d0019ae0 con 0x5599749d3390 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2612375893 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc5d40ab2c0 con 0x5599749d3390 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5eb632740 10 client.16827 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5eb632740 1 -- 172.21.15.33:0/2612375893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559974db3870 con 0x5599749d3390 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.196+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2612375893 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5d0019ae0 con 0x5599749d3390 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.197+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2612375893 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc5d40a7a40 con 0x5599749d3390 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.197+0000 7fc5eb632740 10 client.16827 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.197+0000 7fc5eb632740 10 client.16827 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.197+0000 7fc5eb632740 20 client.16827 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:49.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.197+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5599749b29f0 0x559974db6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.197+0000 7fc5eb632740 4 client.16827 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.197+0000 7fc5eb632740 1 -- 172.21.15.33:0/2612375893 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559974d125d0 con 0x5599749b29f0 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.197+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5599749b29f0 0x559974db6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.197+0000 7fc5c2ff5640 10 client.16827 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.197+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5599749b29f0 0x559974db6dc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b9f95749d9c0e558 server_cookie=d9331c067020dca9 in_seq=0 out_seq=0 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.198+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2612375893 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559974d125d0 con 0x5599749b29f0 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.198+0000 7fc5c2ff5640 10 client.16827 handle_command_reply: tid=0 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.198+0000 7fc5eb632740 1 client.16827 shutdown 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.198+0000 7fc5eb632740 1 -- 172.21.15.33:0/2612375893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 msgr2=0x559974da4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.198+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da4f50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009610 tx=0x7fc5d40ab640 comp rx=0 tx=0).stop 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.199+0000 7fc5eb632740 1 -- 172.21.15.33:0/2612375893 shutdown_connections 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.199+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5599749b29f0 0x559974db6dc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.199+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 0x559974db0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.199+0000 7fc5c2ff5640 0 client.16827 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:36:49.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.199+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da4f50 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.199+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2612375893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 0x559974da4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.199+0000 7fc5eb632740 1 -- 172.21.15.33:0/2612375893 >> 172.21.15.33:0/2612375893 conn(0x5599749e8460 msgr2=0x559974d9c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:49.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.199+0000 7fc5eb632740 1 -- 172.21.15.33:0/2612375893 shutdown_connections 2024-08-28T19:36:49.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.199+0000 7fc5eb632740 1 -- 172.21.15.33:0/2612375893 wait complete. 2024-08-28T19:36:49.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.199+0000 7fc5eb632740 20 client.16827 trim_cache size 0 max 16384 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.212+0000 7fc5eb632740 1 Processor -- start 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.212+0000 7fc5eb632740 1 -- start start 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 0x559974d9ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 0x559974db0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5eb632740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e01b0ac0 con 0x5599749d3390 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5eb632740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e01b2600 con 0x5599749cb1b0 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5eb632740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e01b1190 con 0x5599749f4070 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5de59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5de59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51888/0 (socket says 172.21.15.33:51888) 2024-08-28T19:36:49.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5de59c640 1 -- 172.21.15.33:0/76376107 learned_addr learned my addr 172.21.15.33:0/76376107 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/76376107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 0x559974d9ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5df59e640 1 --2- 172.21.15.33:0/76376107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 0x559974db0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5de59c640 1 -- 172.21.15.33:0/76376107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 msgr2=0x559974db0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5de59c640 1 --2- 172.21.15.33:0/76376107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 0x559974db0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5de59c640 1 -- 172.21.15.33:0/76376107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 msgr2=0x559974d9ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5de59c640 1 --2- 172.21.15.33:0/76376107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 0x559974d9ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5de59c640 1 -- 172.21.15.33:0/76376107 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559974d9b600 con 0x5599749d3390 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/76376107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 0x559974d9ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5de59c640 1 --2- 172.21.15.33:0/76376107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da6640 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40ab740 tx=0x7fc5d40e5710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6892874735962308 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5c4ff9640 1 -- 172.21.15.33:0/76376107 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4009de0 con 0x5599749d3390 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.213+0000 7fc5c4ff9640 1 -- 172.21.15.33:0/76376107 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5d40abeb0 con 0x5599749d3390 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.214+0000 7fc5c4ff9640 1 -- 172.21.15.33:0/76376107 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40e5220 con 0x5599749d3390 2024-08-28T19:36:49.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.214+0000 7fc5eb632740 1 -- 172.21.15.33:0/76376107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 msgr2=0x559974da6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.214+0000 7fc5eb632740 1 --2- 172.21.15.33:0/76376107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da6640 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40ab740 tx=0x7fc5d40e5710 comp rx=0 tx=0).stop 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.214+0000 7fc5eb632740 1 -- 172.21.15.33:0/76376107 shutdown_connections 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.214+0000 7fc5eb632740 1 --2- 172.21.15.33:0/76376107 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749f4070 0x559974db0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.214+0000 7fc5eb632740 1 --2- 172.21.15.33:0/76376107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974da6640 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.214+0000 7fc5eb632740 1 --2- 172.21.15.33:0/76376107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749cb1b0 0x559974d9ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.214+0000 7fc5eb632740 1 -- 172.21.15.33:0/76376107 >> 172.21.15.33:0/76376107 conn(0x5599749e8460 msgr2=0x559974da5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.214+0000 7fc5eb632740 1 -- 172.21.15.33:0/76376107 shutdown_connections 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.214+0000 7fc5eb632740 1 -- 172.21.15.33:0/76376107 wait complete. 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5eb632740 1 -- start start 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5eb632740 1 Processor -- start 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749cb1b0 0x559974dab440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974dab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5eb632740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 0x559974e20790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5eb632740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e01b1f30 con 0x5599749d3390 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5eb632740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e01b1860 con 0x5599749f4070 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5eb632740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e01aeaa0 con 0x5599749cb1b0 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5eb632740 10 client.0 _ll_register_callbacks cb 0x7fc5d4005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5de59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974dab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5de59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974dab980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51890/0 (socket says 172.21.15.33:51890) 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.215+0000 7fc5de59c640 1 -- 172.21.15.33:0/2515402069 learned_addr learned my addr 172.21.15.33:0/2515402069 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749cb1b0 0x559974dab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5df59e640 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 0x559974e20790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5de59c640 1 -- 172.21.15.33:0/2515402069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749cb1b0 msgr2=0x559974dab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5de59c640 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749cb1b0 0x559974dab440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5de59c640 1 -- 172.21.15.33:0/2515402069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 msgr2=0x559974e20790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:49.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5de59c640 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 0x559974e20790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5de59c640 1 -- 172.21.15.33:0/2515402069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559974e20cd0 con 0x5599749d3390 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749cb1b0 0x559974dab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5df59e640 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 0x559974e20790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5de59c640 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974dab980 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40a8a20 tx=0x7fc5d40e5350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e0e19dbc778657 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2515402069 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40ab7b0 con 0x5599749d3390 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2515402069 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc5d40b4640 con 0x5599749d3390 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5eb632740 1 -- 172.21.15.33:0/2515402069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5d40abeb0 con 0x5599749d3390 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2515402069 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc5d40b48c0 con 0x5599749d3390 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5eb632740 10 client.16833 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5eb632740 1 -- 172.21.15.33:0/2515402069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559974e21ee0 con 0x5599749d3390 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.216+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2515402069 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5d40abeb0 con 0x5599749d3390 2024-08-28T19:36:49.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.217+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2515402069 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc5d40a7120 con 0x5599749d3390 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.217+0000 7fc5eb632740 10 client.16833 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.217+0000 7fc5eb632740 10 client.16833 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.217+0000 7fc5eb632740 20 client.16833 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.217+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x559974987da0 0x559974e24370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.217+0000 7fc5eb632740 4 client.16833 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.217+0000 7fc5eb632740 1 -- 172.21.15.33:0/2515402069 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559974d0e070 con 0x559974987da0 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.217+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x559974987da0 0x559974e24370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.217+0000 7fc5ded9d640 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x559974987da0 0x559974e24370 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=204b4835dbb6e463 server_cookie=73810124e6e2026b in_seq=0 out_seq=0 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.217+0000 7fc5c2ff5640 10 client.16833 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5c2ff5640 1 -- 172.21.15.33:0/2515402069 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559974d0e070 con 0x559974987da0 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5c2ff5640 10 client.16833 handle_command_reply: tid=0 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 client.16833 shutdown 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 -- 172.21.15.33:0/2515402069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 msgr2=0x559974dab980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:49.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974dab980 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40a8a20 tx=0x7fc5d40e5350 comp rx=0 tx=0).stop 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 -- 172.21.15.33:0/2515402069 shutdown_connections 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x559974987da0 0x559974e24370 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5599749f4070 0x559974e20790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5599749d3390 0x559974dab980 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 --2- 172.21.15.33:0/2515402069 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5599749cb1b0 0x559974dab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 -- 172.21.15.33:0/2515402069 >> 172.21.15.33:0/2515402069 conn(0x5599749e8460 msgr2=0x559974d9aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5c2ff5640 0 client.16833 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 -- 172.21.15.33:0/2515402069 shutdown_connections 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 1 -- 172.21.15.33:0/2515402069 wait complete. 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5eb632740 20 client.16833 trim_cache size 0 max 16384 2024-08-28T19:36:49.227 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:36:49.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5e50bd640 1 -- 172.21.15.33:0/1181916685 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5c80b4ca0 msgr2=0x7fc5c80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:49.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5e50bd640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5c80b4ca0 0x7fc5c80b71b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc5d802f500 tx=0x7fc5d802f310 comp rx=0 tx=0).stop 2024-08-28T19:36:49.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5e50bd640 1 -- 172.21.15.33:0/1181916685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e0108140 msgr2=0x7fc5e019a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:49.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.218+0000 7fc5e50bd640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e0108140 0x7fc5e019a7d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4005fd0 tx=0x7fc5d400dde0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.219+0000 7fc5e50bd640 1 -- 172.21.15.33:0/1181916685 shutdown_connections 2024-08-28T19:36:49.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.219+0000 7fc5e50bd640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5c80b4ca0 0x7fc5c80b71b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.219+0000 7fc5e50bd640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5e0108a90 0x7fc5e019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.219+0000 7fc5e50bd640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e0108140 0x7fc5e019a7d0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.219+0000 7fc5e50bd640 1 --2- 172.21.15.33:0/1181916685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5e0102800 0x7fc5e019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:49.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.219+0000 7fc5e50bd640 1 -- 172.21.15.33:0/1181916685 >> 172.21.15.33:0/1181916685 conn(0x7fc5e00794d0 msgr2=0x7fc5e0104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:49.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.219+0000 7fc5e50bd640 1 -- 172.21.15.33:0/1181916685 shutdown_connections 2024-08-28T19:36:49.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:49.219+0000 7fc5e50bd640 1 -- 172.21.15.33:0/1181916685 wait complete. 2024-08-28T19:36:49.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:49 smithi122 ceph-mon[22174]: pgmap v473: 129 pgs: 129 active+clean; 4.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-08-28T19:36:49.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:49 smithi059 ceph-mon[22052]: pgmap v473: 129 pgs: 129 active+clean; 4.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-08-28T19:36:49.970 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:36:50.229 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:50.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.838+0000 7fc0e5261640 1 -- 172.21.15.33:0/3774838463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0e0108a90 msgr2=0x7fc0e010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:50.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.838+0000 7fc0e5261640 1 --2- 172.21.15.33:0/3774838463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0e0108a90 0x7fc0e010f2c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009ca0 tx=0x7fc0d002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.838+0000 7fc0e5261640 1 -- 172.21.15.33:0/3774838463 shutdown_connections 2024-08-28T19:36:50.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.838+0000 7fc0e5261640 1 --2- 172.21.15.33:0/3774838463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0e0108a90 0x7fc0e010f2c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.838+0000 7fc0e5261640 1 --2- 172.21.15.33:0/3774838463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e0108140 0x7fc0e0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.838+0000 7fc0e5261640 1 --2- 172.21.15.33:0/3774838463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0e0102800 0x7fc0e0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.838+0000 7fc0e5261640 1 -- 172.21.15.33:0/3774838463 >> 172.21.15.33:0/3774838463 conn(0x7fc0e00794d0 msgr2=0x7fc0e00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.838+0000 7fc0e5261640 1 -- 172.21.15.33:0/3774838463 shutdown_connections 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.838+0000 7fc0e5261640 1 -- 172.21.15.33:0/3774838463 wait complete. 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.838+0000 7fc0e5261640 1 Processor -- start 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0e5261640 1 -- start start 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0e5261640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0e0102800 0x7fc0e019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0e5261640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e0108140 0x7fc0e019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0e5261640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0e0108a90 0x7fc0e019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0e5261640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e0113820 con 0x7fc0e0108a90 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0e5261640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01136a0 con 0x7fc0e0108140 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0e5261640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01139a0 con 0x7fc0e0102800 2024-08-28T19:36:50.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0df7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0e0108a90 0x7fc0e019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0df7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0e0108a90 0x7fc0e019fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51898/0 (socket says 172.21.15.33:51898) 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0df7fe640 1 -- 172.21.15.33:0/100712099 learned_addr learned my addr 172.21.15.33:0/100712099 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0deffd640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0e0102800 0x7fc0e019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e0108140 0x7fc0e019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0df7fe640 1 -- 172.21.15.33:0/100712099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0e0102800 msgr2=0x7fc0e019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0df7fe640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0e0102800 0x7fc0e019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0df7fe640 1 -- 172.21.15.33:0/100712099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e0108140 msgr2=0x7fc0e019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0df7fe640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e0108140 0x7fc0e019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0df7fe640 1 -- 172.21.15.33:0/100712099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e01a01a0 con 0x7fc0e0108a90 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.839+0000 7fc0df7fe640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0e0108a90 0x7fc0e019fa70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0005cc0 tx=0x7fc0d002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.840+0000 7fc0d7fff640 1 -- 172.21.15.33:0/100712099 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0003bf0 con 0x7fc0e0108a90 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.840+0000 7fc0e5261640 1 -- 172.21.15.33:0/100712099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e01a0430 con 0x7fc0e0108a90 2024-08-28T19:36:50.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.840+0000 7fc0d7fff640 1 -- 172.21.15.33:0/100712099 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0d0003d90 con 0x7fc0e0108a90 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.840+0000 7fc0d7fff640 1 -- 172.21.15.33:0/100712099 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d002fbc0 con 0x7fc0e0108a90 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.840+0000 7fc0e5261640 1 -- 172.21.15.33:0/100712099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e01a6bf0 con 0x7fc0e0108a90 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.842+0000 7fc0eb7d6740 1 Processor -- start 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.842+0000 7fc0d7fff640 1 -- 172.21.15.33:0/100712099 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc0d002fd60 con 0x7fc0e0108a90 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.842+0000 7fc0eb7d6740 1 -- start start 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 0x55c7b9dee350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9dee890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a28390 0x55c7b9deedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c7b9d65680 con 0x55c7b9a201b0 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c7b9d54c10 con 0x55c7b9a49070 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c7b9d58bc0 con 0x55c7b9a28390 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0deffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9dee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0deffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9dee890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51914/0 (socket says 172.21.15.33:51914) 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0deffd640 1 -- 172.21.15.33:0/3882352999 learned_addr learned my addr 172.21.15.33:0/3882352999 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/3882352999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 0x55c7b9dee350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/3882352999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a28390 0x55c7b9deedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0d7fff640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc0cc0b4ca0 0x7fc0cc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0deffd640 1 -- 172.21.15.33:0/3882352999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a28390 msgr2=0x55c7b9deedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0deffd640 1 --2- 172.21.15.33:0/3882352999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a28390 0x55c7b9deedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0deffd640 1 -- 172.21.15.33:0/3882352999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 msgr2=0x55c7b9dee350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0deffd640 1 --2- 172.21.15.33:0/3882352999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 0x55c7b9dee350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0deffd640 1 -- 172.21.15.33:0/3882352999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7b9ab4650 con 0x55c7b9a201b0 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0df7fe640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc0cc0b4ca0 0x7fc0cc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.843+0000 7fc0d7fff640 1 -- 172.21.15.33:0/100712099 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc0d0106d40 con 0x7fc0e0108a90 2024-08-28T19:36:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.844+0000 7fc0deffd640 1 --2- 172.21.15.33:0/3882352999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9dee890 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800b760 tx=0x7fc0d800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e973460b78ded5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.844+0000 7fc0d57fa640 1 -- 172.21.15.33:0/3882352999 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8003dd0 con 0x55c7b9a201b0 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.844+0000 7fc0d57fa640 1 -- 172.21.15.33:0/3882352999 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0d8015070 con 0x55c7b9a201b0 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.844+0000 7fc0d57fa640 1 -- 172.21.15.33:0/3882352999 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8004da0 con 0x55c7b9a201b0 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/3882352999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 msgr2=0x55c7b9dee890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0df7fe640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc0cc0b4ca0 0x7fc0cc0b71b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc0d01041f0 tx=0x7fc0d00993f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/3882352999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9dee890 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800b760 tx=0x7fc0d800bc20 comp rx=0 tx=0).stop 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/3882352999 shutdown_connections 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/3882352999 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a28390 0x55c7b9deedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/3882352999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9dee890 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/3882352999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 0x55c7b9dee350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/3882352999 >> 172.21.15.33:0/3882352999 conn(0x55c7b9a3d460 msgr2=0x55c7b9dec240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/3882352999 shutdown_connections 2024-08-28T19:36:50.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/3882352999 wait complete. 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 -- start start 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.845+0000 7fc0eb7d6740 1 Processor -- start 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a201b0 0x55c7b9df9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a28390 0x55c7b9dfa020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 0x55c7b9e05e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c7b9bb7700 con 0x55c7b9a28390 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c7b9cdb750 con 0x55c7b9a49070 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c7b9dfcb30 con 0x55c7b9a201b0 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0eb7d6740 10 client.0 _ll_register_callbacks cb 0x55c7b9d0ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0deffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a28390 0x55c7b9dfa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0deffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a28390 0x55c7b9dfa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51926/0 (socket says 172.21.15.33:51926) 2024-08-28T19:36:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0deffd640 1 -- 172.21.15.33:0/896429569 learned_addr learned my addr 172.21.15.33:0/896429569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a201b0 0x55c7b9df9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 0x55c7b9e05e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0deffd640 1 -- 172.21.15.33:0/896429569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a201b0 msgr2=0x55c7b9df9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0deffd640 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a201b0 0x55c7b9df9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0deffd640 1 -- 172.21.15.33:0/896429569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 msgr2=0x55c7b9e05e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0deffd640 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 0x55c7b9e05e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0deffd640 1 -- 172.21.15.33:0/896429569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7b9d14900 con 0x55c7b9a28390 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 0x55c7b9e05e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0deffd640 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a28390 0x55c7b9dfa020 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80046c0 tx=0x7fc0d80046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e4e66dbe175f9c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.846+0000 7fc0c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0c67fc640 1 -- 172.21.15.33:0/896429569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8028060 con 0x55c7b9a28390 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0c67fc640 1 -- 172.21.15.33:0/896429569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc0d8011640 con 0x55c7b9a28390 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/896429569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0d8015070 con 0x55c7b9a28390 2024-08-28T19:36:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0c67fc640 1 -- 172.21.15.33:0/896429569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc0d802f050 con 0x55c7b9a28390 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0eb7d6740 10 client.16845 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/896429569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c7b9e088f0 con 0x55c7b9a28390 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0c67fc640 1 -- 172.21.15.33:0/896429569 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0d8015070 con 0x55c7b9a28390 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0c67fc640 1 -- 172.21.15.33:0/896429569 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc0d8022070 con 0x55c7b9a28390 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0eb7d6740 10 client.16845 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0eb7d6740 10 client.16845 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0eb7d6740 20 client.16845 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55c7b9a079f0 0x55c7b9e0bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0eb7d6740 4 client.16845 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.847+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/896429569 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7b9d675d0 con 0x55c7b9a079f0 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.848+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55c7b9a079f0 0x55c7b9e0bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.848+0000 7fc0c67fc640 10 client.16845 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:36:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.848+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55c7b9a079f0 0x55c7b9e0bd00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2089b77760b19212 server_cookie=52c413e242dc0278 in_seq=0 out_seq=0 2024-08-28T19:36:50.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0c67fc640 1 -- 172.21.15.33:0/896429569 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c7b9d675d0 con 0x55c7b9a079f0 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0c67fc640 10 client.16845 handle_command_reply: tid=0 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 client.16845 shutdown 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/896429569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a28390 msgr2=0x55c7b9dfa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a28390 0x55c7b9dfa020 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80046c0 tx=0x7fc0d80046f0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/896429569 shutdown_connections 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55c7b9a079f0 0x55c7b9e0bd00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a49070 0x55c7b9e05e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a28390 0x55c7b9dfa020 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0c67fc640 0 client.16845 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/896429569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a201b0 0x55c7b9df9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/896429569 >> 172.21.15.33:0/896429569 conn(0x55c7b9a3d460 msgr2=0x55c7b9df14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:50.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/896429569 shutdown_connections 2024-08-28T19:36:50.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/896429569 wait complete. 2024-08-28T19:36:50.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.849+0000 7fc0eb7d6740 20 client.16845 trim_cache size 0 max 16384 2024-08-28T19:36:50.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0eb7d6740 1 Processor -- start 2024-08-28T19:36:50.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0eb7d6740 1 -- start start 2024-08-28T19:36:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9df1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 0x55c7b9e05dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a49070 0x55c7b9debb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01b0b40 con 0x55c7b9a201b0 2024-08-28T19:36:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01b2680 con 0x55c7b9a28390 2024-08-28T19:36:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01b1210 con 0x55c7b9a49070 2024-08-28T19:36:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0de7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9df1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0de7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9df1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51942/0 (socket says 172.21.15.33:51942) 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.863+0000 7fc0de7fc640 1 -- 172.21.15.33:0/2238931683 learned_addr learned my addr 172.21.15.33:0/2238931683 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/2238931683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a49070 0x55c7b9debb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0deffd640 1 --2- 172.21.15.33:0/2238931683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 0x55c7b9e05dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0de7fc640 1 -- 172.21.15.33:0/2238931683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a49070 msgr2=0x55c7b9debb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/2238931683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a49070 0x55c7b9debb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0de7fc640 1 -- 172.21.15.33:0/2238931683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 msgr2=0x55c7b9e05dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/2238931683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 0x55c7b9e05dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0de7fc640 1 -- 172.21.15.33:0/2238931683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7b9dfada0 con 0x55c7b9a201b0 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0deffd640 1 --2- 172.21.15.33:0/2238931683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 0x55c7b9e05dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/2238931683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9df1b60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0105c70 tx=0x7fc0c800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f93c92fc0ae271b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0d4ff9640 1 -- 172.21.15.33:0/2238931683 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c801b040 con 0x55c7b9a201b0 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0d4ff9640 1 -- 172.21.15.33:0/2238931683 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0c8012b00 con 0x55c7b9a201b0 2024-08-28T19:36:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.864+0000 7fc0d4ff9640 1 -- 172.21.15.33:0/2238931683 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8023a90 con 0x55c7b9a201b0 2024-08-28T19:36:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.865+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/2238931683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 msgr2=0x55c7b9df1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.865+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/2238931683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9df1b60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0105c70 tx=0x7fc0c800b5b0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.865+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/2238931683 shutdown_connections 2024-08-28T19:36:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.865+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/2238931683 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a49070 0x55c7b9debb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.865+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/2238931683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 0x55c7b9e05dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.865+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/2238931683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9df1b60 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.865+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/2238931683 >> 172.21.15.33:0/2238931683 conn(0x55c7b9a3d460 msgr2=0x55c7b9df1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.865+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/2238931683 shutdown_connections 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.865+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/2238931683 wait complete. 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.865+0000 7fc0eb7d6740 1 -- start start 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0eb7d6740 1 Processor -- start 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9e0ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 0x55c7b9e0d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0eb7d6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a49070 0x55c7b9e0d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01b1fb0 con 0x55c7b9a201b0 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01b18e0 con 0x55c7b9a28390 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0eb7d6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e01aeb20 con 0x55c7b9a49070 2024-08-28T19:36:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0eb7d6740 10 client.0 _ll_register_callbacks cb 0x7fc0c800b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0de7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9e0ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0de7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9e0ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51950/0 (socket says 172.21.15.33:51950) 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0de7fc640 1 -- 172.21.15.33:0/1105911208 learned_addr learned my addr 172.21.15.33:0/1105911208 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0deffd640 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 0x55c7b9e0d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0de7fc640 1 -- 172.21.15.33:0/1105911208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a49070 msgr2=0x55c7b9e0d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a49070 0x55c7b9e0d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0de7fc640 1 -- 172.21.15.33:0/1105911208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 msgr2=0x55c7b9e0d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 0x55c7b9e0d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.866+0000 7fc0de7fc640 1 -- 172.21.15.33:0/1105911208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7b9e755b0 con 0x55c7b9a201b0 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0de7fc640 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9e0ce50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80041d0 tx=0x7fc0c8014cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1ac6a1c96310c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0c67fc640 1 -- 172.21.15.33:0/1105911208 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8012650 con 0x55c7b9a201b0 2024-08-28T19:36:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0c67fc640 1 -- 172.21.15.33:0/1105911208 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc0c80127f0 con 0x55c7b9a201b0 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/1105911208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0c8012b00 con 0x55c7b9a201b0 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0c67fc640 1 -- 172.21.15.33:0/1105911208 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc0c8005020 con 0x55c7b9a201b0 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0eb7d6740 10 client.16851 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/1105911208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c7b9e76830 con 0x55c7b9a201b0 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0c67fc640 1 -- 172.21.15.33:0/1105911208 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0c8012b00 con 0x55c7b9a201b0 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0c67fc640 1 -- 172.21.15.33:0/1105911208 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc0c8033070 con 0x55c7b9a201b0 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0eb7d6740 10 client.16851 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0eb7d6740 10 client.16851 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.867+0000 7fc0eb7d6740 20 client.16851 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.868+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55c7b99dcda0 0x55c7b9e78f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.868+0000 7fc0eb7d6740 4 client.16851 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.868+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/1105911208 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c7b9d63070 con 0x55c7b99dcda0 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.868+0000 7fc0deffd640 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55c7b99dcda0 0x55c7b9e78f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.868+0000 7fc0deffd640 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55c7b99dcda0 0x55c7b9e78f60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1cecdb3210a2936c server_cookie=c73b5b3cf6df075 in_seq=0 out_seq=0 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.868+0000 7fc0c67fc640 10 client.16851 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0c67fc640 1 -- 172.21.15.33:0/1105911208 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c7b9d63070 con 0x55c7b99dcda0 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0c67fc640 10 client.16851 handle_command_reply: tid=0 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 client.16851 shutdown 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/1105911208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 msgr2=0x55c7b9e0ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9e0ce50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80041d0 tx=0x7fc0c8014cd0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/1105911208 shutdown_connections 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55c7b99dcda0 0x55c7b9e78f60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7b9a49070 0x55c7b9e0d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7b9a28390 0x55c7b9e0d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 --2- 172.21.15.33:0/1105911208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7b9a201b0 0x55c7b9e0ce50 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/1105911208 >> 172.21.15.33:0/1105911208 conn(0x55c7b9a3d460 msgr2=0x55c7b9deba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0c67fc640 0 client.16851 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:36:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/1105911208 shutdown_connections 2024-08-28T19:36:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 1 -- 172.21.15.33:0/1105911208 wait complete. 2024-08-28T19:36:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.869+0000 7fc0eb7d6740 20 client.16851 trim_cache size 0 max 16384 2024-08-28T19:36:50.876 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:36:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 -- 172.21.15.33:0/100712099 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc0cc0b4ca0 msgr2=0x7fc0cc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc0cc0b4ca0 0x7fc0cc0b71b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc0d01041f0 tx=0x7fc0d00993f0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 -- 172.21.15.33:0/100712099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0e0108a90 msgr2=0x7fc0e019fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0e0108a90 0x7fc0e019fa70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0005cc0 tx=0x7fc0d002f380 comp rx=0 tx=0).stop 2024-08-28T19:36:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 -- 172.21.15.33:0/100712099 shutdown_connections 2024-08-28T19:36:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0e0108a90 0x7fc0e019fa70 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e0108140 0x7fc0e019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc0cc0b4ca0 0x7fc0cc0b71b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 --2- 172.21.15.33:0/100712099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc0e0102800 0x7fc0e019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 -- 172.21.15.33:0/100712099 >> 172.21.15.33:0/100712099 conn(0x7fc0e00794d0 msgr2=0x7fc0e0104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 -- 172.21.15.33:0/100712099 shutdown_connections 2024-08-28T19:36:50.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:50.870+0000 7fc0e5261640 1 -- 172.21.15.33:0/100712099 wait complete. 2024-08-28T19:36:51.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:51 smithi122 ceph-mon[22174]: pgmap v474: 129 pgs: 129 active+clean; 4.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-08-28T19:36:51.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:51 smithi033 ceph-mon[18549]: pgmap v474: 129 pgs: 129 active+clean; 4.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-08-28T19:36:51.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:51 smithi059 ceph-mon[22052]: pgmap v474: 129 pgs: 129 active+clean; 4.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 11 op/s 2024-08-28T19:36:51.684 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:36:51.936 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:52.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.442+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/2252692034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c58103930 msgr2=0x7f8c58103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.442+0000 7f8c5f2bc640 1 --2- 172.21.15.33:0/2252692034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c58103930 0x7f8c58103d40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009900 tx=0x7f8c5402a410 comp rx=0 tx=0).stop 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.442+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/2252692034 shutdown_connections 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.442+0000 7f8c5f2bc640 1 --2- 172.21.15.33:0/2252692034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c58109bc0 0x7f8c581103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.442+0000 7f8c5f2bc640 1 --2- 172.21.15.33:0/2252692034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c58109270 0x7f8c58109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.442+0000 7f8c5f2bc640 1 --2- 172.21.15.33:0/2252692034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c58103930 0x7f8c58103d40 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.442+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/2252692034 >> 172.21.15.33:0/2252692034 conn(0x7f8c580ff3a0 msgr2=0x7f8c581017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.442+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/2252692034 shutdown_connections 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.442+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/2252692034 wait complete. 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5f2bc640 1 Processor -- start 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5f2bc640 1 -- start start 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5f2bc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c58103930 0x7f8c580754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5f2bc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c58109270 0x7f8c580759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5f2bc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c58109bc0 0x7f8c58075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5f2bc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8c581138e0 con 0x7f8c58109bc0 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5f2bc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c58113760 con 0x7f8c58109270 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5f2bc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8c58113a60 con 0x7f8c58103930 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5d859640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c58109bc0 0x7f8c58075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5d859640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c58109bc0 0x7f8c58075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51968/0 (socket says 172.21.15.33:51968) 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5d859640 1 -- 172.21.15.33:0/240329559 learned_addr learned my addr 172.21.15.33:0/240329559 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.443+0000 7f8c5d058640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c58103930 0x7f8c580754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c5c857640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c58109270 0x7f8c580759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c5d859640 1 -- 172.21.15.33:0/240329559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c58103930 msgr2=0x7f8c580754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c5d859640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c58103930 0x7f8c580754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c5d859640 1 -- 172.21.15.33:0/240329559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c58109270 msgr2=0x7f8c580759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c5d859640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c58109270 0x7f8c580759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c5d859640 1 -- 172.21.15.33:0/240329559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c581a85f0 con 0x7f8c58109bc0 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c5c857640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c58109270 0x7f8c580759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c5d859640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c58109bc0 0x7f8c58075f30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000eaa0 tx=0x7f8c5000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c4e7fc640 1 -- 172.21.15.33:0/240329559 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000cdb0 con 0x7f8c58109bc0 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/240329559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c581a88e0 con 0x7f8c58109bc0 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c4e7fc640 1 -- 172.21.15.33:0/240329559 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c50005020 con 0x7f8c58109bc0 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c4e7fc640 1 -- 172.21.15.33:0/240329559 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c500116d0 con 0x7f8c58109bc0 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.444+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/240329559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c581a8e70 con 0x7f8c58109bc0 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.447+0000 7f8c65831740 1 Processor -- start 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.447+0000 7f8c4e7fc640 1 -- 172.21.15.33:0/240329559 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8c500054a0 con 0x7f8c58109bc0 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.447+0000 7f8c65831740 1 -- start start 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.447+0000 7f8c65831740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb375070 0x5630bb71a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.447+0000 7f8c65831740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb34c1b0 0x5630bb71a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.447+0000 7f8c65831740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb71ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.447+0000 7f8c65831740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5630bb691680 con 0x5630bb354390 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.447+0000 7f8c65831740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5630bb680c10 con 0x5630bb34c1b0 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.447+0000 7f8c65831740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5630bb684bc0 con 0x5630bb375070 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5c857640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb71ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5c857640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb71ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51982/0 (socket says 172.21.15.33:51982) 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5c857640 1 -- 172.21.15.33:0/3708059433 learned_addr learned my addr 172.21.15.33:0/3708059433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5d058640 1 --2- 172.21.15.33:0/3708059433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb34c1b0 0x5630bb71a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3708059433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb375070 0x5630bb71a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c4e7fc640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c440b4ca0 0x7f8c440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5c857640 1 -- 172.21.15.33:0/3708059433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb375070 msgr2=0x5630bb71a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3708059433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb375070 0x5630bb71a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5c857640 1 -- 172.21.15.33:0/3708059433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb34c1b0 msgr2=0x5630bb71a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3708059433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb34c1b0 0x5630bb71a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5c857640 1 -- 172.21.15.33:0/3708059433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630bb3e0650 con 0x5630bb354390 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5d859640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c440b4ca0 0x7f8c440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c4e7fc640 1 -- 172.21.15.33:0/240329559 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8c500e5a30 con 0x7f8c58109bc0 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3708059433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb71ad90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800cec0 tx=0x7f8c4800c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a473135e6dfe07 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.448+0000 7f8c437fe640 1 -- 172.21.15.33:0/3708059433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4801b070 con 0x5630bb354390 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.449+0000 7f8c5d859640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c440b4ca0 0x7f8c440b71b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8c500a9040 tx=0x7f8c50079040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.449+0000 7f8c437fe640 1 -- 172.21.15.33:0/3708059433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c4800ee40 con 0x5630bb354390 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.449+0000 7f8c437fe640 1 -- 172.21.15.33:0/3708059433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800f040 con 0x5630bb354390 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.449+0000 7f8c65831740 1 -- 172.21.15.33:0/3708059433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 msgr2=0x5630bb71ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.449+0000 7f8c65831740 1 --2- 172.21.15.33:0/3708059433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb71ad90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800cec0 tx=0x7f8c4800c3b0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.449+0000 7f8c65831740 1 -- 172.21.15.33:0/3708059433 shutdown_connections 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.449+0000 7f8c65831740 1 --2- 172.21.15.33:0/3708059433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb71ad90 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.449+0000 7f8c65831740 1 --2- 172.21.15.33:0/3708059433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb34c1b0 0x5630bb71a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.449+0000 7f8c65831740 1 --2- 172.21.15.33:0/3708059433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb375070 0x5630bb71a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.449+0000 7f8c65831740 1 -- 172.21.15.33:0/3708059433 >> 172.21.15.33:0/3708059433 conn(0x5630bb369460 msgr2=0x5630bb718200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.450+0000 7f8c65831740 1 -- 172.21.15.33:0/3708059433 shutdown_connections 2024-08-28T19:36:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.450+0000 7f8c65831740 1 -- 172.21.15.33:0/3708059433 wait complete. 2024-08-28T19:36:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.450+0000 7f8c65831740 1 -- start start 2024-08-28T19:36:52.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c65831740 1 Processor -- start 2024-08-28T19:36:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c65831740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb725a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c65831740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb725fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c65831740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb375070 0x5630bb731de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c65831740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5630bb4e3700 con 0x5630bb354390 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c65831740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5630bb607750 con 0x5630bb375070 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c65831740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5630bb728af0 con 0x5630bb34c1b0 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c65831740 10 client.0 _ll_register_callbacks cb 0x5630bb636e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c5d058640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb725fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c5d058640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb725fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51990/0 (socket says 172.21.15.33:51990) 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c5d058640 1 -- 172.21.15.33:0/900021083 learned_addr learned my addr 172.21.15.33:0/900021083 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.451+0000 7f8c5c857640 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb725a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c5c857640 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb375070 0x5630bb731de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c5d058640 1 -- 172.21.15.33:0/900021083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 msgr2=0x5630bb725a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c5d058640 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb725a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c5d058640 1 -- 172.21.15.33:0/900021083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb375070 msgr2=0x5630bb731de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c5d058640 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb375070 0x5630bb731de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c5d058640 1 -- 172.21.15.33:0/900021083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630bb640900 con 0x5630bb354390 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c5c857640 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb375070 0x5630bb731de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c5d058640 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb725fc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009900 tx=0x7f8c540316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88830e7b864db9c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c40ff9640 1 -- 172.21.15.33:0/900021083 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c54035040 con 0x5630bb354390 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c40ff9640 1 -- 172.21.15.33:0/900021083 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8c54031b10 con 0x5630bb354390 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c65831740 1 -- 172.21.15.33:0/900021083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5630bb6935d0 con 0x5630bb354390 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c40ff9640 1 -- 172.21.15.33:0/900021083 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8c54031d10 con 0x5630bb354390 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c65831740 10 client.16863 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.452+0000 7f8c65831740 1 -- 172.21.15.33:0/900021083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5630bb7348c0 con 0x5630bb354390 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.453+0000 7f8c40ff9640 1 -- 172.21.15.33:0/900021083 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5630bb6935d0 con 0x5630bb354390 2024-08-28T19:36:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.453+0000 7f8c40ff9640 1 -- 172.21.15.33:0/900021083 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8c54004750 con 0x5630bb354390 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.453+0000 7f8c65831740 10 client.16863 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.453+0000 7f8c65831740 10 client.16863 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.453+0000 7f8c65831740 20 client.16863 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.453+0000 7f8c65831740 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5630bb3339f0 0x5630bb737e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.453+0000 7f8c65831740 4 client.16863 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.453+0000 7f8c65831740 1 -- 172.21.15.33:0/900021083 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630bb68f070 con 0x5630bb3339f0 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.453+0000 7f8c5c857640 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5630bb3339f0 0x5630bb737e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.454+0000 7f8c5c857640 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5630bb3339f0 0x5630bb737e10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9132a712e45d8e0 server_cookie=e8e893ff56fa05c0 in_seq=0 out_seq=0 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.454+0000 7f8c40ff9640 10 client.16863 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.454+0000 7f8c40ff9640 1 -- 172.21.15.33:0/900021083 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630bb68f070 con 0x5630bb3339f0 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.454+0000 7f8c40ff9640 10 client.16863 handle_command_reply: tid=0 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.454+0000 7f8c65831740 1 client.16863 shutdown 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 1 -- 172.21.15.33:0/900021083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 msgr2=0x5630bb725fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb725fc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009900 tx=0x7f8c540316d0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 1 -- 172.21.15.33:0/900021083 shutdown_connections 2024-08-28T19:36:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb375070 0x5630bb731de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5630bb3339f0 0x5630bb737e10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb354390 0x5630bb725fc0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c40ff9640 0 client.16863 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:36:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 1 --2- 172.21.15.33:0/900021083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb725a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 1 -- 172.21.15.33:0/900021083 >> 172.21.15.33:0/900021083 conn(0x5630bb369460 msgr2=0x5630bb71d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 1 -- 172.21.15.33:0/900021083 shutdown_connections 2024-08-28T19:36:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 1 -- 172.21.15.33:0/900021083 wait complete. 2024-08-28T19:36:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.455+0000 7f8c65831740 20 client.16863 trim_cache size 0 max 16384 2024-08-28T19:36:52.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.468+0000 7f8c65831740 1 Processor -- start 2024-08-28T19:36:52.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.468+0000 7f8c65831740 1 -- start start 2024-08-28T19:36:52.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.468+0000 7f8c65831740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb71db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.468+0000 7f8c65831740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 0x5630bb731ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.468+0000 7f8c65831740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb717b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.468+0000 7f8c65831740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8c581b2e10 con 0x5630bb375070 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.468+0000 7f8c65831740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c581b4950 con 0x5630bb354390 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.468+0000 7f8c65831740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8c581b34e0 con 0x5630bb34c1b0 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5c857640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb717b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5c857640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb717b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51992/0 (socket says 172.21.15.33:51992) 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5c857640 1 -- 172.21.15.33:0/3536760451 learned_addr learned my addr 172.21.15.33:0/3536760451 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5d058640 1 --2- 172.21.15.33:0/3536760451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 0x5630bb731ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3536760451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb71db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5c857640 1 -- 172.21.15.33:0/3536760451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 msgr2=0x5630bb71db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3536760451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb71db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5c857640 1 -- 172.21.15.33:0/3536760451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 msgr2=0x5630bb731ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3536760451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 0x5630bb731ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5c857640 1 -- 172.21.15.33:0/3536760451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630bb726d40 con 0x5630bb375070 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5d058640 1 --2- 172.21.15.33:0/3536760451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 0x5630bb731ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3536760451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb717b20 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8c48019040 tx=0x7f8c480047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f1c2209c3b1f1d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:52.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c42ffd640 1 -- 172.21.15.33:0/3536760451 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48032070 con 0x5630bb375070 2024-08-28T19:36:52.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c42ffd640 1 -- 172.21.15.33:0/3536760451 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c4801c040 con 0x5630bb375070 2024-08-28T19:36:52.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.469+0000 7f8c42ffd640 1 -- 172.21.15.33:0/3536760451 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4801b040 con 0x5630bb375070 2024-08-28T19:36:52.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.470+0000 7f8c65831740 1 -- 172.21.15.33:0/3536760451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 msgr2=0x5630bb717b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:52.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.470+0000 7f8c65831740 1 --2- 172.21.15.33:0/3536760451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb717b20 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8c48019040 tx=0x7f8c480047d0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.470+0000 7f8c65831740 1 -- 172.21.15.33:0/3536760451 shutdown_connections 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.470+0000 7f8c65831740 1 --2- 172.21.15.33:0/3536760451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb717b20 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.470+0000 7f8c65831740 1 --2- 172.21.15.33:0/3536760451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 0x5630bb731ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.470+0000 7f8c65831740 1 --2- 172.21.15.33:0/3536760451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb71db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.470+0000 7f8c65831740 1 -- 172.21.15.33:0/3536760451 >> 172.21.15.33:0/3536760451 conn(0x5630bb369460 msgr2=0x5630bb71d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.470+0000 7f8c65831740 1 -- 172.21.15.33:0/3536760451 shutdown_connections 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.470+0000 7f8c65831740 1 -- 172.21.15.33:0/3536760451 wait complete. 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.471+0000 7f8c65831740 1 -- start start 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.471+0000 7f8c65831740 1 Processor -- start 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.471+0000 7f8c65831740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb729da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.471+0000 7f8c65831740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 0x5630bb72a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.471+0000 7f8c65831740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb72a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.471+0000 7f8c65831740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8c581b4280 con 0x5630bb375070 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.471+0000 7f8c65831740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c581b3bb0 con 0x5630bb354390 2024-08-28T19:36:52.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.471+0000 7f8c65831740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8c581b0df0 con 0x5630bb34c1b0 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.471+0000 7f8c65831740 10 client.0 _ll_register_callbacks cb 0x7f8c54005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5c857640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb72a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5c857640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb72a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52006/0 (socket says 172.21.15.33:52006) 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5c857640 1 -- 172.21.15.33:0/3850110656 learned_addr learned my addr 172.21.15.33:0/3850110656 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb729da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5d058640 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 0x5630bb72a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5c857640 1 -- 172.21.15.33:0/3850110656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 msgr2=0x5630bb729da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb729da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5c857640 1 -- 172.21.15.33:0/3850110656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 msgr2=0x5630bb72a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 0x5630bb72a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5c857640 1 -- 172.21.15.33:0/3850110656 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630bb7a1810 con 0x5630bb375070 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c5c857640 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb72a820 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800c290 tx=0x7f8c4800c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257ec809b7035901 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:52.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c40ff9640 1 -- 172.21.15.33:0/3850110656 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4801b070 con 0x5630bb375070 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c40ff9640 1 -- 172.21.15.33:0/3850110656 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f8c48005bc0 con 0x5630bb375070 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c65831740 1 -- 172.21.15.33:0/3850110656 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c4801c040 con 0x5630bb375070 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c40ff9640 1 -- 172.21.15.33:0/3850110656 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8c48041050 con 0x5630bb375070 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.472+0000 7f8c65831740 10 client.16869 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.473+0000 7f8c65831740 1 -- 172.21.15.33:0/3850110656 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5630bb7a2a90 con 0x5630bb375070 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.473+0000 7f8c40ff9640 1 -- 172.21.15.33:0/3850110656 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c4801c040 con 0x5630bb375070 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.473+0000 7f8c40ff9640 1 -- 172.21.15.33:0/3850110656 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8c48015070 con 0x5630bb375070 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.473+0000 7f8c65831740 10 client.16869 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.473+0000 7f8c65831740 10 client.16869 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.473+0000 7f8c65831740 20 client.16869 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.473+0000 7f8c65831740 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5630bb308da0 0x5630bb7a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.473+0000 7f8c65831740 4 client.16869 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:36:52.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.473+0000 7f8c65831740 1 -- 172.21.15.33:0/3850110656 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630bb68c7b0 con 0x5630bb308da0 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.473+0000 7f8c5d058640 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5630bb308da0 0x5630bb7a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c40ff9640 10 client.16869 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c5d058640 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5630bb308da0 0x5630bb7a4eb0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=599973da6ca5af2a server_cookie=5fcca3d96901123c in_seq=0 out_seq=0 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c40ff9640 1 -- 172.21.15.33:0/3850110656 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630bb68c7b0 con 0x5630bb308da0 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c40ff9640 10 client.16869 handle_command_reply: tid=0 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 client.16869 shutdown 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 -- 172.21.15.33:0/3850110656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 msgr2=0x5630bb72a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb72a820 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800c290 tx=0x7f8c4800c220 comp rx=0 tx=0).stop 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 -- 172.21.15.33:0/3850110656 shutdown_connections 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5630bb308da0 0x5630bb7a4eb0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c40ff9640 0 client.16869 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5630bb375070 0x5630bb72a820 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630bb354390 0x5630bb72a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 --2- 172.21.15.33:0/3850110656 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5630bb34c1b0 0x5630bb729da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 -- 172.21.15.33:0/3850110656 >> 172.21.15.33:0/3850110656 conn(0x5630bb369460 msgr2=0x5630bb7179e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 -- 172.21.15.33:0/3850110656 shutdown_connections 2024-08-28T19:36:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 1 -- 172.21.15.33:0/3850110656 wait complete. 2024-08-28T19:36:52.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.474+0000 7f8c65831740 20 client.16869 trim_cache size 0 max 16384 2024-08-28T19:36:52.481 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/240329559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c440b4ca0 msgr2=0x7f8c440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c440b4ca0 0x7f8c440b71b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8c500a9040 tx=0x7f8c50079040 comp rx=0 tx=0).stop 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/240329559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c58109bc0 msgr2=0x7f8c58075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c58109bc0 0x7f8c58075f30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000eaa0 tx=0x7f8c5000ef60 comp rx=0 tx=0).stop 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/240329559 shutdown_connections 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c58109bc0 0x7f8c58075f30 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c58109270 0x7f8c580759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8c440b4ca0 0x7f8c440b71b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 --2- 172.21.15.33:0/240329559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8c58103930 0x7f8c580754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/240329559 >> 172.21.15.33:0/240329559 conn(0x7f8c580ff3a0 msgr2=0x7f8c581017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:52.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/240329559 shutdown_connections 2024-08-28T19:36:52.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:52.475+0000 7f8c5f2bc640 1 -- 172.21.15.33:0/240329559 wait complete. 2024-08-28T19:36:53.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:53 smithi033 ceph-mon[18549]: pgmap v475: 129 pgs: 129 active+clean; 4.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-08-28T19:36:53.293 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:53 smithi122 ceph-mon[22174]: pgmap v475: 129 pgs: 129 active+clean; 4.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-08-28T19:36:53.322 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:36:53.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:53 smithi059 ceph-mon[22052]: pgmap v475: 129 pgs: 129 active+clean; 4.1 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-08-28T19:36:53.577 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:54.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.088+0000 7f4c28baf640 1 -- 172.21.15.33:0/2974199620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c24108b10 msgr2=0x7f4c2410f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:54.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.088+0000 7f4c28baf640 1 --2- 172.21.15.33:0/2974199620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c24108b10 0x7f4c2410f340 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009ca0 tx=0x7f4c1c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.088+0000 7f4c28baf640 1 -- 172.21.15.33:0/2974199620 shutdown_connections 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.088+0000 7f4c28baf640 1 --2- 172.21.15.33:0/2974199620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c24108b10 0x7f4c2410f340 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.088+0000 7f4c28baf640 1 --2- 172.21.15.33:0/2974199620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c241081c0 0x7f4c241085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.088+0000 7f4c28baf640 1 --2- 172.21.15.33:0/2974199620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c24102880 0x7f4c24102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.088+0000 7f4c28baf640 1 -- 172.21.15.33:0/2974199620 >> 172.21.15.33:0/2974199620 conn(0x7f4c24079510 msgr2=0x7f4c24079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.088+0000 7f4c28baf640 1 -- 172.21.15.33:0/2974199620 shutdown_connections 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.088+0000 7f4c28baf640 1 -- 172.21.15.33:0/2974199620 wait complete. 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.089+0000 7f4c28baf640 1 Processor -- start 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.089+0000 7f4c28baf640 1 -- start start 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.089+0000 7f4c28baf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c24102880 0x7f4c2419b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.089+0000 7f4c28baf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c241081c0 0x7f4c2419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.089+0000 7f4c28baf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c24108b10 0x7f4c2419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.089+0000 7f4c28baf640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241127e0 con 0x7f4c24102880 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.089+0000 7f4c28baf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4c24112660 con 0x7f4c241081c0 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.089+0000 7f4c28baf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c24112960 con 0x7f4c24108b10 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.089+0000 7f4c2259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c24102880 0x7f4c2419b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c2259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c24102880 0x7f4c2419b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52030/0 (socket says 172.21.15.33:52030) 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c2259c640 1 -- 172.21.15.33:0/3438083010 learned_addr learned my addr 172.21.15.33:0/3438083010 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c21d9b640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c241081c0 0x7f4c2419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c24108b10 0x7f4c2419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c2259c640 1 -- 172.21.15.33:0/3438083010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c24108b10 msgr2=0x7f4c2419ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c2259c640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c24108b10 0x7f4c2419ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c2259c640 1 -- 172.21.15.33:0/3438083010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c241081c0 msgr2=0x7f4c2419b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c2259c640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c241081c0 0x7f4c2419b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c2259c640 1 -- 172.21.15.33:0/3438083010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c241a6320 con 0x7f4c24102880 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c2259c640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c24102880 0x7f4c2419b010 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400d950 tx=0x7f4c1400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:54.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c137fe640 1 -- 172.21.15.33:0/3438083010 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14017070 con 0x7f4c24102880 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c137fe640 1 -- 172.21.15.33:0/3438083010 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c14009c30 con 0x7f4c24102880 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c28baf640 1 -- 172.21.15.33:0/3438083010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c241a6610 con 0x7f4c24102880 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c137fe640 1 -- 172.21.15.33:0/3438083010 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1400f620 con 0x7f4c24102880 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.090+0000 7f4c28baf640 1 -- 172.21.15.33:0/3438083010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c241a6b50 con 0x7f4c24102880 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.093+0000 7f4c2f124740 1 Processor -- start 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c2f124740 1 -- start start 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 0x56117fe8d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe8d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fac7390 0x56117fe8dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c2f124740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56117fe04680 con 0x56117fabf1b0 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c2f124740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56117fdf3c10 con 0x56117fac7390 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c2f124740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56117fdf7bc0 con 0x56117fae8070 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c137fe640 1 -- 172.21.15.33:0/3438083010 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4c14010460 con 0x7f4c24102880 2024-08-28T19:36:54.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c2259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe8d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c2259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe8d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52040/0 (socket says 172.21.15.33:52040) 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c2259c640 1 -- 172.21.15.33:0/398168030 learned_addr learned my addr 172.21.15.33:0/398168030 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/398168030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 0x56117fe8d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.094+0000 7f4c21d9b640 1 --2- 172.21.15.33:0/398168030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fac7390 0x56117fe8dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c2259c640 1 -- 172.21.15.33:0/398168030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 msgr2=0x56117fe8d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c2259c640 1 --2- 172.21.15.33:0/398168030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 0x56117fe8d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c2259c640 1 -- 172.21.15.33:0/398168030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fac7390 msgr2=0x56117fe8dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c2259c640 1 --2- 172.21.15.33:0/398168030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fac7390 0x56117fe8dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c2259c640 1 -- 172.21.15.33:0/398168030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56117fb53650 con 0x56117fabf1b0 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/398168030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 0x56117fe8d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c2259c640 1 --2- 172.21.15.33:0/398168030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe8d850 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4c140e2830 tx=0x7f4c140ebab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890268b4d648f9c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c10ff9640 1 -- 172.21.15.33:0/398168030 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c140e5d90 con 0x56117fabf1b0 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c10ff9640 1 -- 172.21.15.33:0/398168030 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c140e7520 con 0x56117fabf1b0 2024-08-28T19:36:54.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c10ff9640 1 -- 172.21.15.33:0/398168030 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c140f3b20 con 0x56117fabf1b0 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c137fe640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c0c0b4d20 0x7f4c0c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.095+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c0c0b4d20 0x7f4c0c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c137fe640 1 -- 172.21.15.33:0/3438083010 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4c140e5550 con 0x7f4c24102880 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c0c0b4d20 0x7f4c0c0b7230 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c006010 tx=0x7f4c1c02f410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c2f124740 1 -- 172.21.15.33:0/398168030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 msgr2=0x56117fe8d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c2f124740 1 --2- 172.21.15.33:0/398168030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe8d850 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4c140e2830 tx=0x7f4c140ebab0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c2f124740 1 -- 172.21.15.33:0/398168030 shutdown_connections 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c2f124740 1 --2- 172.21.15.33:0/398168030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fac7390 0x56117fe8dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c2f124740 1 --2- 172.21.15.33:0/398168030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe8d850 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c2f124740 1 --2- 172.21.15.33:0/398168030 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 0x56117fe8d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c2f124740 1 -- 172.21.15.33:0/398168030 >> 172.21.15.33:0/398168030 conn(0x56117fadc460 msgr2=0x56117fe8b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c2f124740 1 -- 172.21.15.33:0/398168030 shutdown_connections 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.096+0000 7f4c2f124740 1 -- 172.21.15.33:0/398168030 wait complete. 2024-08-28T19:36:54.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2f124740 1 -- start start 2024-08-28T19:36:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2f124740 1 Processor -- start 2024-08-28T19:36:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe98a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fac7390 0x56117fe98f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 0x56117fea4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2f124740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56117fc56700 con 0x56117fabf1b0 2024-08-28T19:36:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2f124740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56117fd7a750 con 0x56117fac7390 2024-08-28T19:36:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2f124740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56117fe9baf0 con 0x56117fae8070 2024-08-28T19:36:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2f124740 10 client.0 _ll_register_callbacks cb 0x56117fda9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:54.128 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:36:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe98a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe98a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52044/0 (socket says 172.21.15.33:52044) 2024-08-28T19:36:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2259c640 1 -- 172.21.15.33:0/37445990 learned_addr learned my addr 172.21.15.33:0/37445990 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c21d9b640 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fac7390 0x56117fe98f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 0x56117fea4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2259c640 1 -- 172.21.15.33:0/37445990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 msgr2=0x56117fea4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2259c640 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 0x56117fea4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2259c640 1 -- 172.21.15.33:0/37445990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fac7390 msgr2=0x56117fe98f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.097+0000 7f4c2259c640 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fac7390 0x56117fe98f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c2259c640 1 -- 172.21.15.33:0/37445990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56117fdb3900 con 0x56117fabf1b0 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c2259c640 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe98a40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4c140ab820 tx=0x7f4c140f3620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e5cf2fed78281 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c09ffb640 1 -- 172.21.15.33:0/37445990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14020030 con 0x56117fabf1b0 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c09ffb640 1 -- 172.21.15.33:0/37445990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4c140e2b70 con 0x56117fabf1b0 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c2f124740 1 -- 172.21.15.33:0/37445990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c140e7520 con 0x56117fabf1b0 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c09ffb640 1 -- 172.21.15.33:0/37445990 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4c140a7750 con 0x56117fabf1b0 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c2f124740 10 client.16881 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c2f124740 1 -- 172.21.15.33:0/37445990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56117fea7870 con 0x56117fabf1b0 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c09ffb640 1 -- 172.21.15.33:0/37445990 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c140e7520 con 0x56117fabf1b0 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c09ffb640 1 -- 172.21.15.33:0/37445990 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4c140abaf0 con 0x56117fabf1b0 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c2f124740 10 client.16881 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c2f124740 10 client.16881 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.098+0000 7f4c2f124740 20 client.16881 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.099+0000 7f4c2f124740 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56117faa69f0 0x56117feaabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.099+0000 7f4c2f124740 4 client.16881 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.099+0000 7f4c2f124740 1 -- 172.21.15.33:0/37445990 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56117fe065d0 con 0x56117faa69f0 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.099+0000 7f4c21d9b640 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56117faa69f0 0x56117feaabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.099+0000 7f4c21d9b640 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56117faa69f0 0x56117feaabd0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6bf4fba9919a327a server_cookie=7a63571cb64ccb2b in_seq=0 out_seq=0 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.099+0000 7f4c09ffb640 10 client.16881 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c09ffb640 1 -- 172.21.15.33:0/37445990 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56117fe065d0 con 0x56117faa69f0 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c09ffb640 10 client.16881 handle_command_reply: tid=0 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 client.16881 shutdown 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 -- 172.21.15.33:0/37445990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 msgr2=0x56117fe98a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe98a40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4c140ab820 tx=0x7f4c140f3620 comp rx=0 tx=0).stop 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 -- 172.21.15.33:0/37445990 shutdown_connections 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56117faa69f0 0x56117feaabd0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fae8070 0x56117fea4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fac7390 0x56117fe98f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c09ffb640 0 client.16881 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:36:54.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 --2- 172.21.15.33:0/37445990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117fe98a40 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 -- 172.21.15.33:0/37445990 >> 172.21.15.33:0/37445990 conn(0x56117fadc460 msgr2=0x56117fe904a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 -- 172.21.15.33:0/37445990 shutdown_connections 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 1 -- 172.21.15.33:0/37445990 wait complete. 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.100+0000 7f4c2f124740 20 client.16881 trim_cache size 0 max 16384 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c2f124740 1 Processor -- start 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c2f124740 1 -- start start 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fabf1b0 0x56117fe8ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 0x56117fe9a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fae8070 0x56117fea4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c2f124740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241b0b90 con 0x56117fae8070 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c2f124740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241b26d0 con 0x56117fabf1b0 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c2f124740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241b1260 con 0x56117fac7390 2024-08-28T19:36:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c22d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fae8070 0x56117fea4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c22d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fae8070 0x56117fea4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52054/0 (socket says 172.21.15.33:52054) 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c22d9d640 1 -- 172.21.15.33:0/3876702046 learned_addr learned my addr 172.21.15.33:0/3876702046 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c2259c640 1 --2- 172.21.15.33:0/3876702046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fabf1b0 0x56117fe8ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c21d9b640 1 --2- 172.21.15.33:0/3876702046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 0x56117fe9a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c22d9d640 1 -- 172.21.15.33:0/3876702046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 msgr2=0x56117fe9a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/3876702046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 0x56117fe9a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c22d9d640 1 -- 172.21.15.33:0/3876702046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fabf1b0 msgr2=0x56117fe8ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/3876702046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fabf1b0 0x56117fe8ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.114+0000 7f4c22d9d640 1 -- 172.21.15.33:0/3876702046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56117fe96f40 con 0x56117fae8070 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/3876702046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fae8070 0x56117fea4db0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c035000 tx=0x7f4c1c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ea7231a434fff9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c0bfff640 1 -- 172.21.15.33:0/3876702046 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c031c80 con 0x56117fae8070 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c0bfff640 1 -- 172.21.15.33:0/3876702046 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c1c036050 con 0x56117fae8070 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c0bfff640 1 -- 172.21.15.33:0/3876702046 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c030710 con 0x56117fae8070 2024-08-28T19:36:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c2f124740 1 -- 172.21.15.33:0/3876702046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fae8070 msgr2=0x56117fea4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c2f124740 1 --2- 172.21.15.33:0/3876702046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fae8070 0x56117fea4db0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c035000 tx=0x7f4c1c040000 comp rx=0 tx=0).stop 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c2f124740 1 -- 172.21.15.33:0/3876702046 shutdown_connections 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c2f124740 1 --2- 172.21.15.33:0/3876702046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fae8070 0x56117fea4db0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c2f124740 1 --2- 172.21.15.33:0/3876702046 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 0x56117fe9a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c2f124740 1 --2- 172.21.15.33:0/3876702046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fabf1b0 0x56117fe8ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.115+0000 7f4c2f124740 1 -- 172.21.15.33:0/3876702046 >> 172.21.15.33:0/3876702046 conn(0x56117fadc460 msgr2=0x56117fe99f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 1 -- 172.21.15.33:0/3876702046 shutdown_connections 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 1 -- 172.21.15.33:0/3876702046 wait complete. 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 1 -- start start 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 1 Processor -- start 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117ff094e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 0x56117ff09ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fae8070 0x56117ff14360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241b2000 con 0x56117fabf1b0 2024-08-28T19:36:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241b1930 con 0x56117fae8070 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241aeb70 con 0x56117fac7390 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2f124740 10 client.0 _ll_register_callbacks cb 0x7f4c18009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117ff094e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117ff094e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52066/0 (socket says 172.21.15.33:52066) 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.116+0000 7f4c2259c640 1 -- 172.21.15.33:0/2550984424 learned_addr learned my addr 172.21.15.33:0/2550984424 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c21d9b640 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 0x56117ff09ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fae8070 0x56117ff14360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c2259c640 1 -- 172.21.15.33:0/2550984424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 msgr2=0x56117ff09ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c2259c640 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 0x56117ff09ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c2259c640 1 -- 172.21.15.33:0/2550984424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fae8070 msgr2=0x56117ff14360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c2259c640 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fae8070 0x56117ff14360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c2259c640 1 -- 172.21.15.33:0/2550984424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56117ff149d0 con 0x56117fabf1b0 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c22d9d640 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fae8070 0x56117ff14360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c21d9b640 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 0x56117ff09ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c2259c640 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117ff094e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009e00 tx=0x7f4c1400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16127319523baa2a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c09ffb640 1 -- 172.21.15.33:0/2550984424 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14020030 con 0x56117fabf1b0 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c09ffb640 1 -- 172.21.15.33:0/2550984424 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4c140b4720 con 0x56117fabf1b0 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c2f124740 1 -- 172.21.15.33:0/2550984424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c1c036050 con 0x56117fabf1b0 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c09ffb640 1 -- 172.21.15.33:0/2550984424 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4c140ab000 con 0x56117fabf1b0 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c2f124740 10 client.16887 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c2f124740 1 -- 172.21.15.33:0/2550984424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56117ff15c50 con 0x56117fabf1b0 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.117+0000 7f4c09ffb640 1 -- 172.21.15.33:0/2550984424 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c1c036050 con 0x56117fabf1b0 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.118+0000 7f4c09ffb640 1 -- 172.21.15.33:0/2550984424 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4c140e5110 con 0x56117fabf1b0 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.118+0000 7f4c2f124740 10 client.16887 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.118+0000 7f4c2f124740 10 client.16887 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.118+0000 7f4c2f124740 20 client.16887 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.118+0000 7f4c2f124740 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56117fa7bda0 0x56117ff182b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.118+0000 7f4c2f124740 4 client.16887 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.118+0000 7f4c2f124740 1 -- 172.21.15.33:0/2550984424 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56117fe02070 con 0x56117fa7bda0 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.118+0000 7f4c21d9b640 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56117fa7bda0 0x56117ff182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.118+0000 7f4c09ffb640 10 client.16887 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.118+0000 7f4c21d9b640 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56117fa7bda0 0x56117ff182b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55478b92c31bef91 server_cookie=70bca4541ea0382a in_seq=0 out_seq=0 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c09ffb640 1 -- 172.21.15.33:0/2550984424 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56117fe02070 con 0x56117fa7bda0 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c09ffb640 10 client.16887 handle_command_reply: tid=0 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 client.16887 shutdown 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 -- 172.21.15.33:0/2550984424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 msgr2=0x56117ff094e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117ff094e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009e00 tx=0x7f4c1400bf60 comp rx=0 tx=0).stop 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 -- 172.21.15.33:0/2550984424 shutdown_connections 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56117fa7bda0 0x56117ff182b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56117fae8070 0x56117ff14360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56117fac7390 0x56117ff09ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 --2- 172.21.15.33:0/2550984424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56117fabf1b0 0x56117ff094e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 -- 172.21.15.33:0/2550984424 >> 172.21.15.33:0/2550984424 conn(0x56117fadc460 msgr2=0x56117fe8eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c09ffb640 0 client.16887 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 -- 172.21.15.33:0/2550984424 shutdown_connections 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 1 -- 172.21.15.33:0/2550984424 wait complete. 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c2f124740 20 client.16887 trim_cache size 0 max 16384 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c28baf640 1 -- 172.21.15.33:0/3438083010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c0c0b4d20 msgr2=0x7f4c0c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c28baf640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c0c0b4d20 0x7f4c0c0b7230 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c006010 tx=0x7f4c1c02f410 comp rx=0 tx=0).stop 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c28baf640 1 -- 172.21.15.33:0/3438083010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c24102880 msgr2=0x7f4c2419b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c28baf640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c24102880 0x7f4c2419b010 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400d950 tx=0x7f4c1400de10 comp rx=0 tx=0).stop 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c28baf640 1 -- 172.21.15.33:0/3438083010 shutdown_connections 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.119+0000 7f4c28baf640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4c0c0b4d20 0x7f4c0c0b7230 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.120+0000 7f4c28baf640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4c24108b10 0x7f4c2419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.120+0000 7f4c28baf640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c241081c0 0x7f4c2419b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.120+0000 7f4c28baf640 1 --2- 172.21.15.33:0/3438083010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c24102880 0x7f4c2419b010 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:54.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.120+0000 7f4c28baf640 1 -- 172.21.15.33:0/3438083010 >> 172.21.15.33:0/3438083010 conn(0x7f4c24079510 msgr2=0x7f4c241061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:54.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.120+0000 7f4c28baf640 1 -- 172.21.15.33:0/3438083010 shutdown_connections 2024-08-28T19:36:54.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:54.120+0000 7f4c28baf640 1 -- 172.21.15.33:0/3438083010 wait complete. 2024-08-28T19:36:54.874 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:36:55.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:55 smithi033 ceph-mon[18549]: pgmap v476: 129 pgs: 129 active+clean; 4.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-08-28T19:36:55.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:55 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:36:55.159 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:55.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:55 smithi059 ceph-mon[22052]: pgmap v476: 129 pgs: 129 active+clean; 4.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-08-28T19:36:55.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:55 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:36:55.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:55 smithi122 ceph-mon[22174]: pgmap v476: 129 pgs: 129 active+clean; 4.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-08-28T19:36:55.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:55 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:36:55.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.676+0000 7fd756863640 1 -- 172.21.15.33:0/1001073917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7501079e0 msgr2=0x7fd75010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:55.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.676+0000 7fd756863640 1 --2- 172.21.15.33:0/1001073917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7501079e0 0x7fd75010f2c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd748009ca0 tx=0x7fd74802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.676+0000 7fd756863640 1 -- 172.21.15.33:0/1001073917 shutdown_connections 2024-08-28T19:36:55.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.676+0000 7fd756863640 1 --2- 172.21.15.33:0/1001073917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7501079e0 0x7fd75010f2c0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.676+0000 7fd756863640 1 --2- 172.21.15.33:0/1001073917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd750107090 0x7fd7501074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.676+0000 7fd756863640 1 --2- 172.21.15.33:0/1001073917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7501083a0 0x7fd7501087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.676+0000 7fd756863640 1 -- 172.21.15.33:0/1001073917 >> 172.21.15.33:0/1001073917 conn(0x7fd7500775a0 msgr2=0x7fd7500779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.676+0000 7fd756863640 1 -- 172.21.15.33:0/1001073917 shutdown_connections 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.676+0000 7fd756863640 1 -- 172.21.15.33:0/1001073917 wait complete. 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.677+0000 7fd756863640 1 Processor -- start 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.677+0000 7fd756863640 1 -- start start 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.677+0000 7fd756863640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750107090 0x7fd75019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.677+0000 7fd756863640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7501079e0 0x7fd75019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.677+0000 7fd756863640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7501083a0 0x7fd75019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.677+0000 7fd756863640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd750112730 con 0x7fd7501083a0 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.677+0000 7fd756863640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7501125b0 con 0x7fd750107090 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.677+0000 7fd756863640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd7501128b0 con 0x7fd7501079e0 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd754e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7501083a0 0x7fd75019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd754e00640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7501083a0 0x7fd75019fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52080/0 (socket says 172.21.15.33:52080) 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd754e00640 1 -- 172.21.15.33:0/1444616442 learned_addr learned my addr 172.21.15.33:0/1444616442 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7501079e0 0x7fd75019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd74ffff640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750107090 0x7fd75019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd754e00640 1 -- 172.21.15.33:0/1444616442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7501079e0 msgr2=0x7fd75019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd754e00640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7501079e0 0x7fd75019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd754e00640 1 -- 172.21.15.33:0/1444616442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750107090 msgr2=0x7fd75019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd754e00640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750107090 0x7fd75019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd754e00640 1 -- 172.21.15.33:0/1444616442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7501a0140 con 0x7fd7501083a0 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd74ffff640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750107090 0x7fd75019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd754e00640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7501083a0 0x7fd75019fa10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd748005cc0 tx=0x7fd74802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd74d7fa640 1 -- 172.21.15.33:0/1444616442 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd748003bf0 con 0x7fd7501083a0 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd756863640 1 -- 172.21.15.33:0/1444616442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7501a03d0 con 0x7fd7501083a0 2024-08-28T19:36:55.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd74d7fa640 1 -- 172.21.15.33:0/1444616442 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd748003d90 con 0x7fd7501083a0 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd74d7fa640 1 -- 172.21.15.33:0/1444616442 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74802fbc0 con 0x7fd7501083a0 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.678+0000 7fd756863640 1 -- 172.21.15.33:0/1444616442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7501a6b90 con 0x7fd7501083a0 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.681+0000 7fd75cdd8740 1 Processor -- start 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.681+0000 7fd74d7fa640 1 -- 172.21.15.33:0/1444616442 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd74802fd60 con 0x7fd7501083a0 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.681+0000 7fd75cdd8740 1 -- start start 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845445070 0x5598457ea350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457ea890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845424390 0x5598457eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559845761680 con 0x559845445070 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559845750c10 con 0x55984541c1b0 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559845754bc0 con 0x559845424390 2024-08-28T19:36:55.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845445070 0x5598457ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845445070 0x5598457ea350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52090/0 (socket says 172.21.15.33:52090) 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74f7fe640 1 -- 172.21.15.33:0/766209854 learned_addr learned my addr 172.21.15.33:0/766209854 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74ffff640 1 --2- 172.21.15.33:0/766209854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457ea890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74f7fe640 1 -- 172.21.15.33:0/766209854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845424390 msgr2=0x5598457eadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/766209854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845424390 0x5598457eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74f7fe640 1 -- 172.21.15.33:0/766209854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 msgr2=0x5598457ea890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/766209854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457ea890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74f7fe640 1 -- 172.21.15.33:0/766209854 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598454b0650 con 0x559845445070 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74ffff640 1 --2- 172.21.15.33:0/766209854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457ea890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.682+0000 7fd74d7fa640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd73c0b4ca0 0x7fd73c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.683+0000 7fd74ffff640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd73c0b4ca0 0x7fd73c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.683+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/766209854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845445070 0x5598457ea350 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd73800bcf0 tx=0x7fd7380107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6ccfa22fb48c4f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:55.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.683+0000 7fd74d7fa640 1 -- 172.21.15.33:0/1444616442 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd748106df0 con 0x7fd7501083a0 2024-08-28T19:36:55.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.683+0000 7fd7467fc640 1 -- 172.21.15.33:0/766209854 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd738004030 con 0x559845445070 2024-08-28T19:36:55.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.683+0000 7fd7467fc640 1 -- 172.21.15.33:0/766209854 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7380054d0 con 0x559845445070 2024-08-28T19:36:55.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.683+0000 7fd7467fc640 1 -- 172.21.15.33:0/766209854 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd738004d00 con 0x559845445070 2024-08-28T19:36:55.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd75cdd8740 1 -- 172.21.15.33:0/766209854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845445070 msgr2=0x5598457ea350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/766209854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845445070 0x5598457ea350 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd73800bcf0 tx=0x7fd7380107a0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd74ffff640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd73c0b4ca0 0x7fd73c0b71b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd7400058c0 tx=0x7fd740005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd75cdd8740 1 -- 172.21.15.33:0/766209854 shutdown_connections 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/766209854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845424390 0x5598457eadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/766209854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457ea890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/766209854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845445070 0x5598457ea350 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd75cdd8740 1 -- 172.21.15.33:0/766209854 >> 172.21.15.33:0/766209854 conn(0x559845439460 msgr2=0x5598457e8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd75cdd8740 1 -- 172.21.15.33:0/766209854 shutdown_connections 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd75cdd8740 1 -- 172.21.15.33:0/766209854 wait complete. 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.684+0000 7fd75cdd8740 1 -- start start 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd75cdd8740 1 Processor -- start 2024-08-28T19:36:55.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457f6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 0x559845801e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5598455b3700 con 0x559845424390 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5598456d7750 con 0x55984541c1b0 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5598457f8b30 con 0x559845445070 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd75cdd8740 10 client.0 _ll_register_callbacks cb 0x559845706e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457f6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52094/0 (socket says 172.21.15.33:52094) 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd74f7fe640 1 -- 172.21.15.33:0/2339616276 learned_addr learned my addr 172.21.15.33:0/2339616276 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd754e00640 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 0x559845801e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd74ffff640 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd74f7fe640 1 -- 172.21.15.33:0/2339616276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 msgr2=0x559845801e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 0x559845801e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd74f7fe640 1 -- 172.21.15.33:0/2339616276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 msgr2=0x5598457f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.685+0000 7fd74f7fe640 1 -- 172.21.15.33:0/2339616276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559845710900 con 0x559845424390 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457f6040 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd7380047b0 tx=0x7fd738005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e166625a8c06018 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd72f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd72f7fe640 1 -- 172.21.15.33:0/2339616276 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73802a060 con 0x559845424390 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd72f7fe640 1 -- 172.21.15.33:0/2339616276 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd738004a60 con 0x559845424390 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd75cdd8740 1 -- 172.21.15.33:0/2339616276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7380054d0 con 0x559845424390 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd72f7fe640 1 -- 172.21.15.33:0/2339616276 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd738031050 con 0x559845424390 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd75cdd8740 10 client.16899 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd75cdd8740 1 -- 172.21.15.33:0/2339616276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559845804910 con 0x559845424390 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd72f7fe640 1 -- 172.21.15.33:0/2339616276 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7380054d0 con 0x559845424390 2024-08-28T19:36:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd72f7fe640 1 -- 172.21.15.33:0/2339616276 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd738011940 con 0x559845424390 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd75cdd8740 10 client.16899 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.686+0000 7fd75cdd8740 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.687+0000 7fd75cdd8740 20 client.16899 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.687+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598454039f0 0x559845807d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.687+0000 7fd75cdd8740 4 client.16899 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.687+0000 7fd75cdd8740 1 -- 172.21.15.33:0/2339616276 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598457635d0 con 0x5598454039f0 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.687+0000 7fd74ffff640 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598454039f0 0x559845807d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.687+0000 7fd74ffff640 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598454039f0 0x559845807d20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=963c894b67c3b7f9 server_cookie=5ad3737cf539bce5 in_seq=0 out_seq=0 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.687+0000 7fd72f7fe640 10 client.16899 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd72f7fe640 1 -- 172.21.15.33:0/2339616276 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598457635d0 con 0x5598454039f0 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd72f7fe640 10 client.16899 handle_command_reply: tid=0 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 client.16899 shutdown 2024-08-28T19:36:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 -- 172.21.15.33:0/2339616276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 msgr2=0x5598457f6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457f6040 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd7380047b0 tx=0x7fd738005750 comp rx=0 tx=0).stop 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 -- 172.21.15.33:0/2339616276 shutdown_connections 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 0x559845801e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598454039f0 0x559845807d20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457f6040 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/2339616276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 -- 172.21.15.33:0/2339616276 >> 172.21.15.33:0/2339616276 conn(0x559845439460 msgr2=0x5598457ed530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd72f7fe640 0 client.16899 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 -- 172.21.15.33:0/2339616276 shutdown_connections 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 1 -- 172.21.15.33:0/2339616276 wait complete. 2024-08-28T19:36:55.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.688+0000 7fd75cdd8740 20 client.16899 trim_cache size 0 max 16384 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd75cdd8740 1 Processor -- start 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd75cdd8740 1 -- start start 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457ed450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457ed990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 0x5598457f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd7501b0aa0 con 0x559845424390 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7501b25e0 con 0x55984541c1b0 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd7501b1170 con 0x559845445070 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457ed990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52106/0 (socket says 172.21.15.33:52106) 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd74f7fe640 1 -- 172.21.15.33:0/3759141211 learned_addr learned my addr 172.21.15.33:0/3759141211 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd74ffff640 1 --2- 172.21.15.33:0/3759141211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd754e00640 1 --2- 172.21.15.33:0/3759141211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 0x5598457f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.702+0000 7fd74f7fe640 1 -- 172.21.15.33:0/3759141211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 msgr2=0x5598457f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.703+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/3759141211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 0x5598457f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.703+0000 7fd74f7fe640 1 -- 172.21.15.33:0/3759141211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 msgr2=0x5598457ed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.703+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/3759141211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457ed450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.703+0000 7fd74f7fe640 1 -- 172.21.15.33:0/3759141211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598457ed1b0 con 0x559845424390 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.703+0000 7fd754e00640 1 --2- 172.21.15.33:0/3759141211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 0x5598457f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.703+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/3759141211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457ed990 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd738011e50 tx=0x7fd73801b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee07cf6f4d6bcb07 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.703+0000 7fd745ffb640 1 -- 172.21.15.33:0/3759141211 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73801f020 con 0x559845424390 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.703+0000 7fd745ffb640 1 -- 172.21.15.33:0/3759141211 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7380044f0 con 0x559845424390 2024-08-28T19:36:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.703+0000 7fd745ffb640 1 -- 172.21.15.33:0/3759141211 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73802a070 con 0x559845424390 2024-08-28T19:36:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.704+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3759141211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 msgr2=0x5598457ed990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.704+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/3759141211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457ed990 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd738011e50 tx=0x7fd73801b630 comp rx=0 tx=0).stop 2024-08-28T19:36:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.704+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3759141211 shutdown_connections 2024-08-28T19:36:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.704+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/3759141211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845445070 0x5598457f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.704+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/3759141211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559845424390 0x5598457ed990 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.704+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/3759141211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55984541c1b0 0x5598457ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.704+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3759141211 >> 172.21.15.33:0/3759141211 conn(0x559845439460 msgr2=0x5598457f4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.704+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3759141211 shutdown_connections 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.704+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3759141211 wait complete. 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.704+0000 7fd75cdd8740 1 -- start start 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd75cdd8740 1 Processor -- start 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55984541c1b0 0x559845808fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845424390 0x5598458094e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd75cdd8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559845445070 0x559845809a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd7501b1f10 con 0x55984541c1b0 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7501b1840 con 0x559845445070 2024-08-28T19:36:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd75cdd8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd7501aea80 con 0x559845424390 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd75cdd8740 10 client.0 _ll_register_callbacks cb 0x7fd73800bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd74ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55984541c1b0 0x559845808fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd74ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55984541c1b0 0x559845808fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52120/0 (socket says 172.21.15.33:52120) 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd74ffff640 1 -- 172.21.15.33:0/3393459148 learned_addr learned my addr 172.21.15.33:0/3393459148 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd754e00640 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559845445070 0x559845809a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845424390 0x5598458094e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd74ffff640 1 -- 172.21.15.33:0/3393459148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845424390 msgr2=0x5598458094e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd74ffff640 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845424390 0x5598458094e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd74ffff640 1 -- 172.21.15.33:0/3393459148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559845445070 msgr2=0x559845809a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd74ffff640 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559845445070 0x559845809a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.705+0000 7fd74ffff640 1 -- 172.21.15.33:0/3393459148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598458716a0 con 0x55984541c1b0 2024-08-28T19:36:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd74ffff640 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55984541c1b0 0x559845808fa0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x5598455b3760 tx=0x7fd7400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae020f5d5a9c31b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd72f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd72f7fe640 1 -- 172.21.15.33:0/3393459148 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd740035060 con 0x55984541c1b0 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd72f7fe640 1 -- 172.21.15.33:0/3393459148 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd7400035f0 con 0x55984541c1b0 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3393459148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7380044f0 con 0x55984541c1b0 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd72f7fe640 1 -- 172.21.15.33:0/3393459148 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd74003c050 con 0x55984541c1b0 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd75cdd8740 10 client.16905 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3393459148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559845872920 con 0x55984541c1b0 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd72f7fe640 1 -- 172.21.15.33:0/3393459148 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7380044f0 con 0x55984541c1b0 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd72f7fe640 1 -- 172.21.15.33:0/3393459148 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd740020ab0 con 0x55984541c1b0 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd75cdd8740 10 client.16905 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd75cdd8740 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.706+0000 7fd75cdd8740 20 client.16905 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.707+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598453d8da0 0x5598458750c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.707+0000 7fd75cdd8740 4 client.16905 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:36:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.707+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3393459148 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55984575f070 con 0x5598453d8da0 2024-08-28T19:36:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.707+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598453d8da0 0x5598458750c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.707+0000 7fd72f7fe640 10 client.16905 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.707+0000 7fd74f7fe640 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598453d8da0 0x5598458750c0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=354b1f0658980558 server_cookie=c3402635c41bc4bb in_seq=0 out_seq=0 2024-08-28T19:36:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.707+0000 7fd72f7fe640 1 -- 172.21.15.33:0/3393459148 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55984575f070 con 0x5598453d8da0 2024-08-28T19:36:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.707+0000 7fd72f7fe640 10 client.16905 handle_command_reply: tid=0 2024-08-28T19:36:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.707+0000 7fd75cdd8740 1 client.16905 shutdown 2024-08-28T19:36:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3393459148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55984541c1b0 msgr2=0x559845808fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55984541c1b0 0x559845808fa0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x5598455b3760 tx=0x7fd7400046c0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3393459148 shutdown_connections 2024-08-28T19:36:55.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559845445070 0x559845809a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559845424390 0x5598458094e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5598453d8da0 0x5598458750c0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 1 --2- 172.21.15.33:0/3393459148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55984541c1b0 0x559845808fa0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3393459148 >> 172.21.15.33:0/3393459148 conn(0x559845439460 msgr2=0x5598457ed450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:55.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd72f7fe640 0 client.16905 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:55.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3393459148 shutdown_connections 2024-08-28T19:36:55.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 1 -- 172.21.15.33:0/3393459148 wait complete. 2024-08-28T19:36:55.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd75cdd8740 20 client.16905 trim_cache size 0 max 16384 2024-08-28T19:36:55.716 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:36:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd756863640 1 -- 172.21.15.33:0/1444616442 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd73c0b4ca0 msgr2=0x7fd73c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd756863640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd73c0b4ca0 0x7fd73c0b71b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd7400058c0 tx=0x7fd740005850 comp rx=0 tx=0).stop 2024-08-28T19:36:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd756863640 1 -- 172.21.15.33:0/1444616442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7501083a0 msgr2=0x7fd75019fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd756863640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7501083a0 0x7fd75019fa10 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd748005cc0 tx=0x7fd74802f380 comp rx=0 tx=0).stop 2024-08-28T19:36:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd756863640 1 -- 172.21.15.33:0/1444616442 shutdown_connections 2024-08-28T19:36:55.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.708+0000 7fd756863640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7501083a0 0x7fd75019fa10 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.709+0000 7fd756863640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd73c0b4ca0 0x7fd73c0b71b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.709+0000 7fd756863640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd7501079e0 0x7fd75019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.709+0000 7fd756863640 1 --2- 172.21.15.33:0/1444616442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750107090 0x7fd75019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:55.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.709+0000 7fd756863640 1 -- 172.21.15.33:0/1444616442 >> 172.21.15.33:0/1444616442 conn(0x7fd7500775a0 msgr2=0x7fd750102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:55.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.709+0000 7fd756863640 1 -- 172.21.15.33:0/1444616442 shutdown_connections 2024-08-28T19:36:55.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:55.709+0000 7fd756863640 1 -- 172.21.15.33:0/1444616442 wait complete. 2024-08-28T19:36:56.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:36:56.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:36:56.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:36:56.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:36:56.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:36:56.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:36:56.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:36:56.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:36:56.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:36:57.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:57 smithi033 ceph-mon[18549]: pgmap v477: 129 pgs: 129 active+clean; 4.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-08-28T19:36:57.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:57 smithi059 ceph-mon[22052]: pgmap v477: 129 pgs: 129 active+clean; 4.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-08-28T19:36:57.537 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:36:57.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:36:57.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:57 smithi122 ceph-mon[22174]: pgmap v477: 129 pgs: 129 active+clean; 4.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-08-28T19:36:57.807 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:58.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.387+0000 7f958f419640 1 -- 172.21.15.33:0/3827466814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9588109be0 msgr2=0x7f9588110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:58.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.387+0000 7f958f419640 1 --2- 172.21.15.33:0/3827466814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9588109be0 0x7f9588110410 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f9580009ca0 tx=0x7f958002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.387+0000 7f958f419640 1 -- 172.21.15.33:0/3827466814 shutdown_connections 2024-08-28T19:36:58.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.387+0000 7f958f419640 1 --2- 172.21.15.33:0/3827466814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9588109be0 0x7f9588110410 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.387+0000 7f958f419640 1 --2- 172.21.15.33:0/3827466814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9588109290 0x7f95881096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.387+0000 7f958f419640 1 --2- 172.21.15.33:0/3827466814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9588103950 0x7f9588103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.387+0000 7f958f419640 1 -- 172.21.15.33:0/3827466814 >> 172.21.15.33:0/3827466814 conn(0x7f95880ff3a0 msgr2=0x7f95881017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:58.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.387+0000 7f958f419640 1 -- 172.21.15.33:0/3827466814 shutdown_connections 2024-08-28T19:36:58.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.387+0000 7f958f419640 1 -- 172.21.15.33:0/3827466814 wait complete. 2024-08-28T19:36:58.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958f419640 1 Processor -- start 2024-08-28T19:36:58.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958f419640 1 -- start start 2024-08-28T19:36:58.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958f419640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9588103950 0x7f958819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958f419640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9588109290 0x7f958819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958f419640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9588109be0 0x7f958819fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958f419640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9588113900 con 0x7f9588109be0 2024-08-28T19:36:58.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958f419640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9588113780 con 0x7f9588103950 2024-08-28T19:36:58.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958f419640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9588113a80 con 0x7f9588109290 2024-08-28T19:36:58.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958d9b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9588109be0 0x7f958819fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958d1b5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9588103950 0x7f958819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958d9b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9588109be0 0x7f958819fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55430/0 (socket says 172.21.15.33:55430) 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958d9b6640 1 -- 172.21.15.33:0/3262884591 learned_addr learned my addr 172.21.15.33:0/3262884591 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.388+0000 7f958d1b5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9588103950 0x7f958819a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:34608/0 (socket says 172.21.15.33:34608) 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f958c9b4640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9588109290 0x7f958819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f958d9b6640 1 -- 172.21.15.33:0/3262884591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9588109290 msgr2=0x7f958819a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f958d9b6640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9588109290 0x7f958819a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f958d9b6640 1 -- 172.21.15.33:0/3262884591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9588103950 msgr2=0x7f958819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f958d9b6640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9588103950 0x7f958819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f958d9b6640 1 -- 172.21.15.33:0/3262884591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95881a0200 con 0x7f9588109be0 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f958c9b4640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9588109290 0x7f958819a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:58.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f958d9b6640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9588109be0 0x7f958819fad0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9580005cc0 tx=0x7f958002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:58.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f957e7fc640 1 -- 172.21.15.33:0/3262884591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580003cf0 con 0x7f9588109be0 2024-08-28T19:36:58.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f957e7fc640 1 -- 172.21.15.33:0/3262884591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95800044f0 con 0x7f9588109be0 2024-08-28T19:36:58.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f958f419640 1 -- 172.21.15.33:0/3262884591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95881a0490 con 0x7f9588109be0 2024-08-28T19:36:58.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f957e7fc640 1 -- 172.21.15.33:0/3262884591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958002fc30 con 0x7f9588109be0 2024-08-28T19:36:58.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.389+0000 7f958f419640 1 -- 172.21.15.33:0/3262884591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95881a6c50 con 0x7f9588109be0 2024-08-28T19:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.392+0000 7f959598e740 1 Processor -- start 2024-08-28T19:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.392+0000 7f957e7fc640 1 -- 172.21.15.33:0/3262884591 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f95800305c0 con 0x7f9588109be0 2024-08-28T19:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.392+0000 7f959598e740 1 -- start start 2024-08-28T19:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f959598e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e007780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f959598e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 0x564c9e007cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f959598e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc40670 0x564c9e008200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f959598e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564c9df7d5f0 con 0x564c9dc61350 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f959598e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564c9df6cb80 con 0x564c9dc40670 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f959598e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564c9df70b30 con 0x564c9dc38490 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958c9b4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e007780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958c9b4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e007780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55434/0 (socket says 172.21.15.33:55434) 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958c9b4640 1 -- 172.21.15.33:0/3370201638 learned_addr learned my addr 172.21.15.33:0/3370201638 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f957e7fc640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95740b4ca0 0x7f95740b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958d1b5640 1 --2- 172.21.15.33:0/3370201638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 0x564c9e007cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958c9b4640 1 --2- 172.21.15.33:0/3370201638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc40670 0x564c9e008200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958c9b4640 1 -- 172.21.15.33:0/3370201638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 msgr2=0x564c9e007cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958c9b4640 1 --2- 172.21.15.33:0/3370201638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 0x564c9e007cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958c9b4640 1 -- 172.21.15.33:0/3370201638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc40670 msgr2=0x564c9e008200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958c9b4640 1 --2- 172.21.15.33:0/3370201638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc40670 0x564c9e008200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958c9b4640 1 -- 172.21.15.33:0/3370201638 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c9dccc930 con 0x564c9dc61350 2024-08-28T19:36:58.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958d9b6640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95740b4ca0 0x7f95740b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f958d1b5640 1 --2- 172.21.15.33:0/3370201638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 0x564c9e007cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:58.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.393+0000 7f957e7fc640 1 -- 172.21.15.33:0/3262884591 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9580106e00 con 0x7f9588109be0 2024-08-28T19:36:58.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.394+0000 7f958c9b4640 1 --2- 172.21.15.33:0/3370201638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e007780 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f957800ce70 tx=0x7f957800c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ec3876c52e9101 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:58.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.394+0000 7f95737fe640 1 -- 172.21.15.33:0/3370201638 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578004220 con 0x564c9dc61350 2024-08-28T19:36:58.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.394+0000 7f95737fe640 1 -- 172.21.15.33:0/3370201638 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9578016030 con 0x564c9dc61350 2024-08-28T19:36:58.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.394+0000 7f95737fe640 1 -- 172.21.15.33:0/3370201638 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95780037f0 con 0x564c9dc61350 2024-08-28T19:36:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 -- 172.21.15.33:0/3370201638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 msgr2=0x564c9e007780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 --2- 172.21.15.33:0/3370201638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e007780 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f957800ce70 tx=0x7f957800c600 comp rx=0 tx=0).stop 2024-08-28T19:36:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f958d9b6640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95740b4ca0 0x7f95740b71b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9580031a90 tx=0x7f95800f0040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 -- 172.21.15.33:0/3370201638 shutdown_connections 2024-08-28T19:36:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 --2- 172.21.15.33:0/3370201638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc40670 0x564c9e008200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 --2- 172.21.15.33:0/3370201638 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 0x564c9e007cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 --2- 172.21.15.33:0/3370201638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e007780 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 -- 172.21.15.33:0/3370201638 >> 172.21.15.33:0/3370201638 conn(0x564c9dc55740 msgr2=0x564c9e005670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 -- 172.21.15.33:0/3370201638 shutdown_connections 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 -- 172.21.15.33:0/3370201638 wait complete. 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 -- start start 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.395+0000 7f959598e740 1 Processor -- start 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f959598e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc38490 0x564c9e012fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f959598e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc40670 0x564c9e013520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f959598e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc61350 0x564c9e01f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f959598e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564c9ddcf890 con 0x564c9dc38490 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f959598e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564c9def3790 con 0x564c9dc61350 2024-08-28T19:36:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f959598e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564c9e015f60 con 0x564c9dc40670 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f959598e740 10 client.0 _ll_register_callbacks cb 0x564c9dc78ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f958c9b4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc38490 0x564c9e012fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f958c9b4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc38490 0x564c9e012fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55446/0 (socket says 172.21.15.33:55446) 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f958c9b4640 1 -- 172.21.15.33:0/4267405464 learned_addr learned my addr 172.21.15.33:0/4267405464 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f958d1b5640 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc40670 0x564c9e013520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f958c9b4640 1 -- 172.21.15.33:0/4267405464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc40670 msgr2=0x564c9e013520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f958c9b4640 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc40670 0x564c9e013520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f958c9b4640 1 -- 172.21.15.33:0/4267405464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc61350 msgr2=0x564c9e01f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f958c9b4640 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc61350 0x564c9e01f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.396+0000 7f958c9b4640 1 -- 172.21.15.33:0/4267405464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c9df2af30 con 0x564c9dc38490 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f958c9b4640 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc38490 0x564c9e012fc0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f957800c420 tx=0x7f9578010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41312a4380d80b7b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f9570ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f9570ff9640 1 -- 172.21.15.33:0/4267405464 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578004370 con 0x564c9dc38490 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f9570ff9640 1 -- 172.21.15.33:0/4267405464 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9578012660 con 0x564c9dc38490 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f959598e740 1 -- 172.21.15.33:0/4267405464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9578016030 con 0x564c9dc38490 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f9570ff9640 1 -- 172.21.15.33:0/4267405464 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9578012860 con 0x564c9dc38490 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f959598e740 10 client.16917 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f959598e740 1 -- 172.21.15.33:0/4267405464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564c9e021dd0 con 0x564c9dc38490 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f9570ff9640 1 -- 172.21.15.33:0/4267405464 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9578016030 con 0x564c9dc38490 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f9570ff9640 1 -- 172.21.15.33:0/4267405464 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f957801b470 con 0x564c9dc38490 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f959598e740 10 client.16917 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f959598e740 10 client.16917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f959598e740 20 client.16917 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f959598e740 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c9dc1fcd0 0x564c9e0251e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f959598e740 4 client.16917 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.397+0000 7f959598e740 1 -- 172.21.15.33:0/4267405464 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c9df7f540 con 0x564c9dc1fcd0 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.398+0000 7f958d1b5640 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c9dc1fcd0 0x564c9e0251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.398+0000 7f958d1b5640 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c9dc1fcd0 0x564c9e0251e0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89d03eb9e64da8ac server_cookie=72697fa00ecf81da in_seq=0 out_seq=0 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.398+0000 7f9570ff9640 10 client.16917 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f9570ff9640 1 -- 172.21.15.33:0/4267405464 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c9df7f540 con 0x564c9dc1fcd0 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f9570ff9640 10 client.16917 handle_command_reply: tid=0 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f959598e740 1 client.16917 shutdown 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f959598e740 1 -- 172.21.15.33:0/4267405464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc38490 msgr2=0x564c9e012fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f959598e740 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc38490 0x564c9e012fc0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f957800c420 tx=0x7f9578010ed0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f959598e740 1 -- 172.21.15.33:0/4267405464 shutdown_connections 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f959598e740 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc61350 0x564c9e01f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f959598e740 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc40670 0x564c9e013520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f959598e740 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c9dc1fcd0 0x564c9e0251e0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f959598e740 1 --2- 172.21.15.33:0/4267405464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc38490 0x564c9e012fc0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.399+0000 7f959598e740 1 -- 172.21.15.33:0/4267405464 >> 172.21.15.33:0/4267405464 conn(0x564c9dc55740 msgr2=0x564c9e00a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.400+0000 7f9570ff9640 0 client.16917 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.400+0000 7f959598e740 1 -- 172.21.15.33:0/4267405464 shutdown_connections 2024-08-28T19:36:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.400+0000 7f959598e740 1 -- 172.21.15.33:0/4267405464 wait complete. 2024-08-28T19:36:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.400+0000 7f959598e740 20 client.16917 trim_cache size 0 max 16384 2024-08-28T19:36:58.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f959598e740 1 Processor -- start 2024-08-28T19:36:58.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f959598e740 1 -- start start 2024-08-28T19:36:58.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f959598e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc38490 0x564c9e01f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f959598e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc40670 0x564c9e01f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f959598e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e0101b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f959598e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95881b0b80 con 0x564c9dc61350 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f959598e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95881b26c0 con 0x564c9dc38490 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f959598e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f95881b1250 con 0x564c9dc40670 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f958c9b4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e0101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f958c9b4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e0101b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55456/0 (socket says 172.21.15.33:55456) 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f958c9b4640 1 -- 172.21.15.33:0/490668735 learned_addr learned my addr 172.21.15.33:0/490668735 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f958c9b4640 1 --2- 172.21.15.33:0/490668735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc38490 0x564c9e01f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f958d1b5640 1 --2- 172.21.15.33:0/490668735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc40670 0x564c9e01f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f958c9b4640 1 -- 172.21.15.33:0/490668735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc40670 msgr2=0x564c9e01f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f958c9b4640 1 --2- 172.21.15.33:0/490668735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc40670 0x564c9e01f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f958c9b4640 1 -- 172.21.15.33:0/490668735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc38490 msgr2=0x564c9e01f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f958c9b4640 1 --2- 172.21.15.33:0/490668735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc38490 0x564c9e01f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.418+0000 7f958c9b4640 1 -- 172.21.15.33:0/490668735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c9e00a5e0 con 0x564c9dc61350 2024-08-28T19:36:58.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.419+0000 7f958c9b4640 1 --2- 172.21.15.33:0/490668735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e0101b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f957800cab0 tx=0x7f957801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c1f333a1877181 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:58.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.419+0000 7f9572ffd640 1 -- 172.21.15.33:0/490668735 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957803b070 con 0x564c9dc61350 2024-08-28T19:36:58.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.419+0000 7f9572ffd640 1 -- 172.21.15.33:0/490668735 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9578016040 con 0x564c9dc61350 2024-08-28T19:36:58.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.419+0000 7f9572ffd640 1 -- 172.21.15.33:0/490668735 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957801b470 con 0x564c9dc61350 2024-08-28T19:36:58.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 -- 172.21.15.33:0/490668735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 msgr2=0x564c9e0101b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:58.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 --2- 172.21.15.33:0/490668735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e0101b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f957800cab0 tx=0x7f957801d040 comp rx=0 tx=0).stop 2024-08-28T19:36:58.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 -- 172.21.15.33:0/490668735 shutdown_connections 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 --2- 172.21.15.33:0/490668735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc61350 0x564c9e0101b0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 --2- 172.21.15.33:0/490668735 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc40670 0x564c9e01f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 --2- 172.21.15.33:0/490668735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc38490 0x564c9e01f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 -- 172.21.15.33:0/490668735 >> 172.21.15.33:0/490668735 conn(0x564c9dc55740 msgr2=0x564c9e005600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 -- 172.21.15.33:0/490668735 shutdown_connections 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 -- 172.21.15.33:0/490668735 wait complete. 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 -- start start 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.420+0000 7f959598e740 1 Processor -- start 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f959598e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 0x564c9e028b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f959598e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc40670 0x564c9e026060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f959598e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc61350 0x564c9e026730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f959598e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95881b1ff0 con 0x564c9dc40670 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f959598e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95881b1920 con 0x564c9dc61350 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f959598e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f95881aeb60 con 0x564c9dc38490 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f959598e740 10 client.0 _ll_register_callbacks cb 0x7f957800ccd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958d1b5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc40670 0x564c9e026060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958d1b5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc40670 0x564c9e026060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55460/0 (socket says 172.21.15.33:55460) 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958d1b5640 1 -- 172.21.15.33:0/1814836402 learned_addr learned my addr 172.21.15.33:0/1814836402 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958c9b4640 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc61350 0x564c9e026730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958c9b4640 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 0x564c9e028b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958d1b5640 1 -- 172.21.15.33:0/1814836402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 msgr2=0x564c9e028b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958d1b5640 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 0x564c9e028b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958d1b5640 1 -- 172.21.15.33:0/1814836402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc61350 msgr2=0x564c9e026730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:58.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958d1b5640 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc61350 0x564c9e026730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958d1b5640 1 -- 172.21.15.33:0/1814836402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c9e08e960 con 0x564c9dc40670 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958c9b4640 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc61350 0x564c9e026730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f958d1b5640 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc40670 0x564c9e026060 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9584004810 tx=0x7f9584006a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5406c0b9c1862f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.421+0000 7f9570ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f9570ff9640 1 -- 172.21.15.33:0/1814836402 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584018c80 con 0x564c9dc40670 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f9570ff9640 1 -- 172.21.15.33:0/1814836402 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9584016430 con 0x564c9dc40670 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f959598e740 1 -- 172.21.15.33:0/1814836402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9578016040 con 0x564c9dc40670 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f9570ff9640 1 -- 172.21.15.33:0/1814836402 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f958402d050 con 0x564c9dc40670 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f959598e740 10 client.16923 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f959598e740 1 -- 172.21.15.33:0/1814836402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564c9e08fad0 con 0x564c9dc40670 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f9570ff9640 1 -- 172.21.15.33:0/1814836402 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9578016040 con 0x564c9dc40670 2024-08-28T19:36:58.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f9570ff9640 1 -- 172.21.15.33:0/1814836402 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f95840254a0 con 0x564c9dc40670 2024-08-28T19:36:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f959598e740 10 client.16923 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f959598e740 10 client.16923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f959598e740 20 client.16923 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f959598e740 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c9dbf5080 0x564c9e0922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f959598e740 4 client.16923 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:36:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.422+0000 7f959598e740 1 -- 172.21.15.33:0/1814836402 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564c9df7afe0 con 0x564c9dbf5080 2024-08-28T19:36:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.423+0000 7f958c9b4640 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c9dbf5080 0x564c9e0922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.423+0000 7f958c9b4640 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c9dbf5080 0x564c9e0922c0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313cd77bdddb73a6 server_cookie=20cb2bcc7224b1e7 in_seq=0 out_seq=0 2024-08-28T19:36:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.423+0000 7f9570ff9640 10 client.16923 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:58.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f9570ff9640 1 -- 172.21.15.33:0/1814836402 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564c9df7afe0 con 0x564c9dbf5080 2024-08-28T19:36:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f9570ff9640 10 client.16923 handle_command_reply: tid=0 2024-08-28T19:36:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 client.16923 shutdown 2024-08-28T19:36:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 -- 172.21.15.33:0/1814836402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc40670 msgr2=0x564c9e026060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:58.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc40670 0x564c9e026060 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9584004810 tx=0x7f9584006a60 comp rx=0 tx=0).stop 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 -- 172.21.15.33:0/1814836402 shutdown_connections 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c9dc61350 0x564c9e026730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c9dbf5080 0x564c9e0922c0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c9dc40670 0x564c9e026060 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 --2- 172.21.15.33:0/1814836402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c9dc38490 0x564c9e028b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 -- 172.21.15.33:0/1814836402 >> 172.21.15.33:0/1814836402 conn(0x564c9dc55740 msgr2=0x564c9e005600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f9570ff9640 0 client.16923 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 -- 172.21.15.33:0/1814836402 shutdown_connections 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 1 -- 172.21.15.33:0/1814836402 wait complete. 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.425+0000 7f959598e740 20 client.16923 trim_cache size 0 max 16384 2024-08-28T19:36:58.432 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:36:58.433 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:36:58.433 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "44f3a863-ce5b-4c51-b841-9de3d1e00689", 2024-08-28T19:36:58.433 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:36:58.433 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:36:58.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 -- 172.21.15.33:0/3262884591 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95740b4ca0 msgr2=0x7f95740b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95740b4ca0 0x7f95740b71b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9580031a90 tx=0x7f95800f0040 comp rx=0 tx=0).stop 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 -- 172.21.15.33:0/3262884591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9588109be0 msgr2=0x7f958819fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9588109be0 0x7f958819fad0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9580005cc0 tx=0x7f958002f470 comp rx=0 tx=0).stop 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 -- 172.21.15.33:0/3262884591 shutdown_connections 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9588109be0 0x7f958819fad0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95740b4ca0 0x7f95740b71b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9588109290 0x7f958819a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 --2- 172.21.15.33:0/3262884591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9588103950 0x7f958819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 -- 172.21.15.33:0/3262884591 >> 172.21.15.33:0/3262884591 conn(0x7f95880ff3a0 msgr2=0x7f95881017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 -- 172.21.15.33:0/3262884591 shutdown_connections 2024-08-28T19:36:58.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:58.426+0000 7f958f419640 1 -- 172.21.15.33:0/3262884591 wait complete. 2024-08-28T19:36:59.190 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:36:59.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:36:59 smithi033 ceph-mon[18549]: pgmap v478: 129 pgs: 129 active+clean; 4.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-08-28T19:36:59.452 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:36:59.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:36:59 smithi059 ceph-mon[22052]: pgmap v478: 129 pgs: 129 active+clean; 4.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-08-28T19:36:59.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:36:59 smithi122 ceph-mon[22174]: pgmap v478: 129 pgs: 129 active+clean; 4.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 KiB/s wr, 16 op/s 2024-08-28T19:36:59.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.963+0000 7fe4ce454640 1 -- 172.21.15.33:0/204380510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4c8105120 msgr2=0x7fe4c810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:59.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.963+0000 7fe4ce454640 1 --2- 172.21.15.33:0/204380510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4c8105120 0x7fe4c810d670 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009900 tx=0x7fe4bc02a410 comp rx=0 tx=0).stop 2024-08-28T19:36:59.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.963+0000 7fe4ce454640 1 -- 172.21.15.33:0/204380510 shutdown_connections 2024-08-28T19:36:59.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.963+0000 7fe4ce454640 1 --2- 172.21.15.33:0/204380510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c810dc00 0x7fe4c81100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.963+0000 7fe4ce454640 1 --2- 172.21.15.33:0/204380510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4c8105120 0x7fe4c810d670 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.963+0000 7fe4ce454640 1 --2- 172.21.15.33:0/204380510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c81047d0 0x7fe4c8104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.963+0000 7fe4ce454640 1 -- 172.21.15.33:0/204380510 >> 172.21.15.33:0/204380510 conn(0x7fe4c8079500 msgr2=0x7fe4c8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.963+0000 7fe4ce454640 1 -- 172.21.15.33:0/204380510 shutdown_connections 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.963+0000 7fe4ce454640 1 -- 172.21.15.33:0/204380510 wait complete. 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4ce454640 1 Processor -- start 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4ce454640 1 -- start start 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4ce454640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c81047d0 0x7fe4c819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4ce454640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c8105120 0x7fe4c819a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4ce454640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4c810dc00 0x7fe4c819fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4ce454640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c8113880 con 0x7fe4c810dc00 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4ce454640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c8113700 con 0x7fe4c8105120 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4ce454640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c8113a00 con 0x7fe4c81047d0 2024-08-28T19:36:59.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4cc9f1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4c810dc00 0x7fe4c819fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4cc9f1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4c810dc00 0x7fe4c819fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55480/0 (socket says 172.21.15.33:55480) 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4cc9f1640 1 -- 172.21.15.33:0/785802609 learned_addr learned my addr 172.21.15.33:0/785802609 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c8105120 0x7fe4c819a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.964+0000 7fe4c7fff640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c81047d0 0x7fe4c819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4cc9f1640 1 -- 172.21.15.33:0/785802609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c81047d0 msgr2=0x7fe4c819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4cc9f1640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c81047d0 0x7fe4c819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4cc9f1640 1 -- 172.21.15.33:0/785802609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c8105120 msgr2=0x7fe4c819a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4cc9f1640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c8105120 0x7fe4c819a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4cc9f1640 1 -- 172.21.15.33:0/785802609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c81a02c0 con 0x7fe4c810dc00 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4cc9f1640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4c810dc00 0x7fe4c819fb90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000b970 tx=0x7fe4c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4c57fa640 1 -- 172.21.15.33:0/785802609 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0019070 con 0x7fe4c810dc00 2024-08-28T19:36:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4ce454640 1 -- 172.21.15.33:0/785802609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c81a05b0 con 0x7fe4c810dc00 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4c57fa640 1 -- 172.21.15.33:0/785802609 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4c0014440 con 0x7fe4c810dc00 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4c57fa640 1 -- 172.21.15.33:0/785802609 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00075d0 con 0x7fe4c810dc00 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.965+0000 7fe4ce454640 1 -- 172.21.15.33:0/785802609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c81a6d10 con 0x7fe4c810dc00 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.968+0000 7fe4d49c9740 1 Processor -- start 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.968+0000 7fe4c57fa640 1 -- 172.21.15.33:0/785802609 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe4c001c070 con 0x7fe4c810dc00 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.968+0000 7fe4d49c9740 1 -- start start 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.968+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8da3070 0x5629f91482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.968+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d7a1b0 0x5629f9148800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.968+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f9148d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.968+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5629f90bf630 con 0x5629f8d82390 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.968+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5629f90aebc0 con 0x5629f8da3070 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.968+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5629f90b2b70 con 0x5629f8d7a1b0 2024-08-28T19:36:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f9148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f9148d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55492/0 (socket says 172.21.15.33:55492) 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c77fe640 1 -- 172.21.15.33:0/3227853237 learned_addr learned my addr 172.21.15.33:0/3227853237 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c7fff640 1 --2- 172.21.15.33:0/3227853237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d7a1b0 0x5629f9148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3227853237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8da3070 0x5629f91482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c57fa640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe4b00b4d20 0x7fe4b00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c77fe640 1 -- 172.21.15.33:0/3227853237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d7a1b0 msgr2=0x5629f9148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3227853237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d7a1b0 0x5629f9148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c77fe640 1 -- 172.21.15.33:0/3227853237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8da3070 msgr2=0x5629f91482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3227853237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8da3070 0x5629f91482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c77fe640 1 -- 172.21.15.33:0/3227853237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629f8e0e650 con 0x5629f8d82390 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4cc9f1640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe4b00b4d20 0x7fe4b00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c57fa640 1 -- 172.21.15.33:0/785802609 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe4c00e4ce0 con 0x7fe4c810dc00 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3227853237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f9148d40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe4c806b6b0 tx=0x7fe4bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ce53a96e755878 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.969+0000 7fe4ae7fc640 1 -- 172.21.15.33:0/3227853237 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc044020 con 0x5629f8d82390 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.970+0000 7fe4ae7fc640 1 -- 172.21.15.33:0/3227853237 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4bc031820 con 0x5629f8d82390 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.970+0000 7fe4ae7fc640 1 -- 172.21.15.33:0/3227853237 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc035070 con 0x5629f8d82390 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3227853237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 msgr2=0x5629f9148d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3227853237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f9148d40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe4c806b6b0 tx=0x7fe4bc000bc0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4cc9f1640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe4b00b4d20 0x7fe4b00b7230 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00e2190 tx=0x7fe4c0077330 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3227853237 shutdown_connections 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3227853237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f9148d40 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3227853237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d7a1b0 0x5629f9148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3227853237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8da3070 0x5629f91482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3227853237 >> 172.21.15.33:0/3227853237 conn(0x5629f8d97460 msgr2=0x5629f91461b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3227853237 shutdown_connections 2024-08-28T19:36:59.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3227853237 wait complete. 2024-08-28T19:36:59.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 -- start start 2024-08-28T19:36:59.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.971+0000 7fe4d49c9740 1 Processor -- start 2024-08-28T19:36:59.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8d7a1b0 0x5629f9157e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d82390 0x5629f91583b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f91640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5629f8f11700 con 0x5629f8da3070 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5629f9035700 con 0x5629f8d7a1b0 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5629f915ada0 con 0x5629f8d82390 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4d49c9740 10 client.0 _ll_register_callbacks cb 0x5629f9064dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f91640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f91640d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55494/0 (socket says 172.21.15.33:55494) 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c77fe640 1 -- 172.21.15.33:0/4026209682 learned_addr learned my addr 172.21.15.33:0/4026209682 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c7fff640 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d82390 0x5629f91583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8d7a1b0 0x5629f9157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c77fe640 1 -- 172.21.15.33:0/4026209682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d82390 msgr2=0x5629f91583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d82390 0x5629f91583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c77fe640 1 -- 172.21.15.33:0/4026209682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8d7a1b0 msgr2=0x5629f9157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8d7a1b0 0x5629f9157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c77fe640 1 -- 172.21.15.33:0/4026209682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629f906e8b0 con 0x5629f8da3070 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f91640d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009a20 tx=0x7fe4bc0054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d2c2ca969b3720 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.972+0000 7fe4a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4a77fe640 1 -- 172.21.15.33:0/4026209682 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc044070 con 0x5629f8da3070 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4a77fe640 1 -- 172.21.15.33:0/4026209682 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe4bc004e00 con 0x5629f8da3070 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4d49c9740 1 -- 172.21.15.33:0/4026209682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4bc031820 con 0x5629f8da3070 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4a77fe640 1 -- 172.21.15.33:0/4026209682 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe4bc035040 con 0x5629f8da3070 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4d49c9740 10 client.16935 fetch_fsmap learned FSMap version 28 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4d49c9740 1 -- 172.21.15.33:0/4026209682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629f9166b50 con 0x5629f8da3070 2024-08-28T19:36:59.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4a77fe640 1 -- 172.21.15.33:0/4026209682 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4bc031820 con 0x5629f8da3070 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4a77fe640 1 -- 172.21.15.33:0/4026209682 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe4bc03d900 con 0x5629f8da3070 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4d49c9740 10 client.16935 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4d49c9740 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4d49c9740 20 client.16935 populate_metadata read hostname 'smithi033' 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629f8d619f0 0x5629f9169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4d49c9740 4 client.16935 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4d49c9740 1 -- 172.21.15.33:0/4026209682 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629f90c1580 con 0x5629f8d619f0 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.973+0000 7fe4c7fff640 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629f8d619f0 0x5629f9169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.974+0000 7fe4a77fe640 10 client.16935 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.974+0000 7fe4c7fff640 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629f8d619f0 0x5629f9169eb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4abd5fb482ea5c7 server_cookie=55f84c5d68db4a4f in_seq=0 out_seq=0 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4a77fe640 1 -- 172.21.15.33:0/4026209682 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629f90c1580 con 0x5629f8d619f0 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4a77fe640 10 client.16935 handle_command_reply: tid=0 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4d49c9740 1 client.16935 shutdown 2024-08-28T19:36:59.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4d49c9740 1 -- 172.21.15.33:0/4026209682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 msgr2=0x5629f91640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f91640d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009a20 tx=0x7fe4bc0054a0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4d49c9740 1 -- 172.21.15.33:0/4026209682 shutdown_connections 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629f8d619f0 0x5629f9169eb0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f91640d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d82390 0x5629f91583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/4026209682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8d7a1b0 0x5629f9157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4d49c9740 1 -- 172.21.15.33:0/4026209682 >> 172.21.15.33:0/4026209682 conn(0x5629f8d97460 msgr2=0x5629f9149cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.975+0000 7fe4a77fe640 0 client.16935 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.976+0000 7fe4d49c9740 1 -- 172.21.15.33:0/4026209682 shutdown_connections 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.976+0000 7fe4d49c9740 1 -- 172.21.15.33:0/4026209682 wait complete. 2024-08-28T19:36:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.976+0000 7fe4d49c9740 20 client.16935 trim_cache size 0 max 16384 2024-08-28T19:36:59.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.993+0000 7fe4d49c9740 1 Processor -- start 2024-08-28T19:36:59.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.993+0000 7fe4d49c9740 1 -- start start 2024-08-28T19:36:59.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.993+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8d7a1b0 0x5629f9164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.993+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d82390 0x5629f9145b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.993+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f9146050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:36:59.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.993+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c81ae930 con 0x5629f8da3070 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.993+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c81b0470 con 0x5629f8d7a1b0 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.993+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c81af000 con 0x5629f8d82390 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f9146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f9146050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55500/0 (socket says 172.21.15.33:55500) 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c77fe640 1 -- 172.21.15.33:0/3657454611 learned_addr learned my addr 172.21.15.33:0/3657454611 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3657454611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8d7a1b0 0x5629f9164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c7fff640 1 --2- 172.21.15.33:0/3657454611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d82390 0x5629f9145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c77fe640 1 -- 172.21.15.33:0/3657454611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d82390 msgr2=0x5629f9145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3657454611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d82390 0x5629f9145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c77fe640 1 -- 172.21.15.33:0/3657454611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8d7a1b0 msgr2=0x5629f9164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:36:59.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3657454611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8d7a1b0 0x5629f9164040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:36:59.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c77fe640 1 -- 172.21.15.33:0/3657454611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629f914aa10 con 0x5629f8da3070 2024-08-28T19:36:59.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3657454611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f9146050 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc03df70 tx=0x7fe4bc040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b012c9ef02c66de2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:36:59.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4adffb640 1 -- 172.21.15.33:0/3657454611 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc044070 con 0x5629f8da3070 2024-08-28T19:36:59.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4adffb640 1 -- 172.21.15.33:0/3657454611 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4bc005510 con 0x5629f8da3070 2024-08-28T19:36:59.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.994+0000 7fe4adffb640 1 -- 172.21.15.33:0/3657454611 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc004ef0 con 0x5629f8da3070 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.995+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3657454611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 msgr2=0x5629f9146050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.995+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3657454611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f9146050 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc03df70 tx=0x7fe4bc040040 comp rx=0 tx=0).stop 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.995+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3657454611 shutdown_connections 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.995+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3657454611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8da3070 0x5629f9146050 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.995+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3657454611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d82390 0x5629f9145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.995+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3657454611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8d7a1b0 0x5629f9164040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.995+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3657454611 >> 172.21.15.33:0/3657454611 conn(0x5629f8d97460 msgr2=0x5629f91566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.995+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3657454611 shutdown_connections 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.995+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3657454611 wait complete. 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.995+0000 7fe4d49c9740 1 -- start start 2024-08-28T19:37:00.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4d49c9740 1 Processor -- start 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d7a1b0 0x5629f91cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f91cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4d49c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8da3070 0x5629f916b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c81afda0 con 0x5629f8d82390 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c81af6d0 con 0x5629f8da3070 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4d49c9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c81ac910 con 0x5629f8d7a1b0 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4d49c9740 10 client.0 _ll_register_callbacks cb 0x7fe4b800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f91cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f91cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55506/0 (socket says 172.21.15.33:55506) 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4c7fff640 1 -- 172.21.15.33:0/3058628941 learned_addr learned my addr 172.21.15.33:0/3058628941 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4c77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d7a1b0 0x5629f91cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8da3070 0x5629f916b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:00.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4c7fff640 1 -- 172.21.15.33:0/3058628941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d7a1b0 msgr2=0x5629f91cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4c7fff640 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d7a1b0 0x5629f91cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4c7fff640 1 -- 172.21.15.33:0/3058628941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8da3070 msgr2=0x5629f916b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.996+0000 7fe4c7fff640 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8da3070 0x5629f916b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.997+0000 7fe4c7fff640 1 -- 172.21.15.33:0/3058628941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629f916bf10 con 0x5629f8d82390 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.997+0000 7fe4c7fff640 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f91cced0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x5629f90bf690 tx=0x7fe4b800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdc1c9a1a45d104 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.997+0000 7fe4a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.997+0000 7fe4a77fe640 1 -- 172.21.15.33:0/3058628941 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8005220 con 0x5629f8d82390 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.997+0000 7fe4a77fe640 1 -- 172.21.15.33:0/3058628941 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe4b80053c0 con 0x5629f8d82390 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.997+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3058628941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4bc005510 con 0x5629f8d82390 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.997+0000 7fe4a77fe640 1 -- 172.21.15.33:0/3058628941 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe4b802f050 con 0x5629f8d82390 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.997+0000 7fe4d49c9740 10 client.16941 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.997+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3058628941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629f91d5290 con 0x5629f8d82390 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.997+0000 7fe4a77fe640 1 -- 172.21.15.33:0/3058628941 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4bc005510 con 0x5629f8d82390 2024-08-28T19:37:00.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.998+0000 7fe4a77fe640 1 -- 172.21.15.33:0/3058628941 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe4b8011560 con 0x5629f8d82390 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.998+0000 7fe4d49c9740 10 client.16941 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.998+0000 7fe4d49c9740 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.998+0000 7fe4d49c9740 20 client.16941 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.998+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629f8d36da0 0x5629f91d7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.998+0000 7fe4d49c9740 4 client.16941 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.998+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3058628941 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5629f90bd020 con 0x5629f8d36da0 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.998+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629f8d36da0 0x5629f91d7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.998+0000 7fe4c77fe640 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629f8d36da0 0x5629f91d7b00 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93429bf32710cfd6 server_cookie=1c02fd4f207d45de in_seq=0 out_seq=0 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.998+0000 7fe4a77fe640 10 client.16941 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4a77fe640 1 -- 172.21.15.33:0/3058628941 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x5629f90bd020 con 0x5629f8d36da0 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4a77fe640 10 client.16941 handle_command_reply: tid=0 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 client.16941 shutdown 2024-08-28T19:37:00.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3058628941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 msgr2=0x5629f91cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f91cced0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x5629f90bf690 tx=0x7fe4b800bf10 comp rx=0 tx=0).stop 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3058628941 shutdown_connections 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629f8da3070 0x5629f916b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629f8d36da0 0x5629f91d7b00 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629f8d82390 0x5629f91cced0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4a77fe640 0 client.16941 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 --2- 172.21.15.33:0/3058628941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629f8d7a1b0 0x5629f91cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3058628941 >> 172.21.15.33:0/3058628941 conn(0x5629f8d97460 msgr2=0x5629f91459d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3058628941 shutdown_connections 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 1 -- 172.21.15.33:0/3058628941 wait complete. 2024-08-28T19:37:00.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:36:59.999+0000 7fe4d49c9740 20 client.16941 trim_cache size 0 max 16384 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:00.006 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:00.007 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:37:00.008 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:00.009 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:00.010 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:00.011 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:00.011 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:00.011 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:37:00.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 -- 172.21.15.33:0/785802609 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe4b00b4d20 msgr2=0x7fe4b00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:00.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe4b00b4d20 0x7fe4b00b7230 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00e2190 tx=0x7fe4c0077330 comp rx=0 tx=0).stop 2024-08-28T19:37:00.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 -- 172.21.15.33:0/785802609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4c810dc00 msgr2=0x7fe4c819fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:00.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4c810dc00 0x7fe4c819fb90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000b970 tx=0x7fe4c000be30 comp rx=0 tx=0).stop 2024-08-28T19:37:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 -- 172.21.15.33:0/785802609 shutdown_connections 2024-08-28T19:37:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4c810dc00 0x7fe4c819fb90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c8105120 0x7fe4c819a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe4b00b4d20 0x7fe4b00b7230 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 --2- 172.21.15.33:0/785802609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe4c81047d0 0x7fe4c819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 -- 172.21.15.33:0/785802609 >> 172.21.15.33:0/785802609 conn(0x7fe4c8079500 msgr2=0x7fe4c8100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 -- 172.21.15.33:0/785802609 shutdown_connections 2024-08-28T19:37:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:00.000+0000 7fe4ce454640 1 -- 172.21.15.33:0/785802609 wait complete. 2024-08-28T19:37:00.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:00 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:37:00.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:00 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:00.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:00 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:37:00.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:00 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:00.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:00 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:37:00.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:00 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:37:00.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:00 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:00.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:00 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:37:00.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:00 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:00.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:00 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:37:00.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:00 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:37:00.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:00 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:00.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:00 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:37:00.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:00 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:00.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:00 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:37:00.831 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:37:00.831 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:37:01.086 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:01.373 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:01 smithi033 ceph-mon[18549]: pgmap v479: 129 pgs: 129 active+clean; 4.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-08-28T19:37:01.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:01 smithi059 ceph-mon[22052]: pgmap v479: 129 pgs: 129 active+clean; 4.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-08-28T19:37:01.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:01 smithi122 ceph-mon[22174]: pgmap v479: 129 pgs: 129 active+clean; 4.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-08-28T19:37:01.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.615+0000 7f11b9005640 1 -- 172.21.15.33:0/1363411309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b4108a90 msgr2=0x7f11b410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:01.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.615+0000 7f11b9005640 1 --2- 172.21.15.33:0/1363411309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b4108a90 0x7f11b410f2c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009ca0 tx=0x7f11ac02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.615+0000 7f11b9005640 1 -- 172.21.15.33:0/1363411309 shutdown_connections 2024-08-28T19:37:01.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.615+0000 7f11b9005640 1 --2- 172.21.15.33:0/1363411309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b4108a90 0x7f11b410f2c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.615+0000 7f11b9005640 1 --2- 172.21.15.33:0/1363411309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b4108140 0x7f11b4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.615+0000 7f11b9005640 1 --2- 172.21.15.33:0/1363411309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11b4102800 0x7f11b4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.615+0000 7f11b9005640 1 -- 172.21.15.33:0/1363411309 >> 172.21.15.33:0/1363411309 conn(0x7f11b40794d0 msgr2=0x7f11b40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:01.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.615+0000 7f11b9005640 1 -- 172.21.15.33:0/1363411309 shutdown_connections 2024-08-28T19:37:01.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.615+0000 7f11b9005640 1 -- 172.21.15.33:0/1363411309 wait complete. 2024-08-28T19:37:01.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.616+0000 7f11b9005640 1 Processor -- start 2024-08-28T19:37:01.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.616+0000 7f11b9005640 1 -- start start 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.616+0000 7f11b9005640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b4102800 0x7f11b410fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.616+0000 7f11b9005640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11b4108140 0x7f11b4110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.616+0000 7f11b9005640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b4108a90 0x7f11b41107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b9005640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f11b4113820 con 0x7f11b4108a90 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b9005640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f11b41136a0 con 0x7f11b4102800 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b9005640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f11b41139a0 con 0x7f11b4108140 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b359e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b4108a90 0x7f11b41107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b359e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b4108a90 0x7f11b41107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55514/0 (socket says 172.21.15.33:55514) 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b359e640 1 -- 172.21.15.33:0/1858096879 learned_addr learned my addr 172.21.15.33:0/1858096879 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b2d9d640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b4102800 0x7f11b410fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b259c640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11b4108140 0x7f11b4110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:01.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b359e640 1 -- 172.21.15.33:0/1858096879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11b4108140 msgr2=0x7f11b4110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b359e640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11b4108140 0x7f11b4110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b359e640 1 -- 172.21.15.33:0/1858096879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b4102800 msgr2=0x7f11b410fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b359e640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b4102800 0x7f11b410fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b359e640 1 -- 172.21.15.33:0/1858096879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b41a8430 con 0x7f11b4108a90 2024-08-28T19:37:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.617+0000 7f11b359e640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b4108a90 0x7f11b41107d0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0098d0 tx=0x7f11ac0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.618+0000 7f119bfff640 1 -- 172.21.15.33:0/1858096879 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac003b70 con 0x7f11b4108a90 2024-08-28T19:37:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.618+0000 7f119bfff640 1 -- 172.21.15.33:0/1858096879 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11ac003d10 con 0x7f11b4108a90 2024-08-28T19:37:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.618+0000 7f11b9005640 1 -- 172.21.15.33:0/1858096879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b41a86c0 con 0x7f11b4108a90 2024-08-28T19:37:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.618+0000 7f119bfff640 1 -- 172.21.15.33:0/1858096879 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac02fa20 con 0x7f11b4108a90 2024-08-28T19:37:01.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.618+0000 7f11b9005640 1 -- 172.21.15.33:0/1858096879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b41a8c00 con 0x7f11b4108a90 2024-08-28T19:37:01.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.619+0000 7f11b9005640 1 -- 172.21.15.33:0/1858096879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b4102c10 con 0x7f11b4108a90 2024-08-28T19:37:01.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.621+0000 7f119bfff640 1 -- 172.21.15.33:0/1858096879 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f11ac02fbe0 con 0x7f11b4108a90 2024-08-28T19:37:01.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.622+0000 7f119bfff640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f119c0b4ca0 0x7f119c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:01.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.622+0000 7f11b2d9d640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f119c0b4ca0 0x7f119c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:01.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.622+0000 7f119bfff640 1 -- 172.21.15.33:0/1858096879 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f11ac106d10 con 0x7f11b4108a90 2024-08-28T19:37:01.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.623+0000 7f11b2d9d640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f119c0b4ca0 0x7f119c0b71b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11a40058c0 tx=0x7f11a400a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:01.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.626+0000 7f119bfff640 1 -- 172.21.15.33:0/1858096879 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f11ac0cd7e0 con 0x7f11b4108a90 2024-08-28T19:37:01.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.845+0000 7f11b9005640 1 -- 172.21.15.33:0/1858096879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11b402e430 con 0x7f11b4108a90 2024-08-28T19:37:01.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.846+0000 7f119bfff640 1 -- 172.21.15.33:0/1858096879 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f11ac0cd0e0 con 0x7f11b4108a90 2024-08-28T19:37:01.847 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:37:01.847 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:37:01.847 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:37:01.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.848+0000 7f11b9005640 1 -- 172.21.15.33:0/1858096879 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f119c0b4ca0 msgr2=0x7f119c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:01.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.848+0000 7f11b9005640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f119c0b4ca0 0x7f119c0b71b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11a40058c0 tx=0x7f11a400a250 comp rx=0 tx=0).stop 2024-08-28T19:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.848+0000 7f11b9005640 1 -- 172.21.15.33:0/1858096879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b4108a90 msgr2=0x7f11b41107d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.848+0000 7f11b9005640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b4108a90 0x7f11b41107d0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0098d0 tx=0x7f11ac0317b0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.848+0000 7f11b9005640 1 -- 172.21.15.33:0/1858096879 shutdown_connections 2024-08-28T19:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.848+0000 7f11b9005640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b4108a90 0x7f11b41107d0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.848+0000 7f11b9005640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f119c0b4ca0 0x7f119c0b71b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.848+0000 7f11b9005640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11b4108140 0x7f11b4110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.848+0000 7f11b9005640 1 --2- 172.21.15.33:0/1858096879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b4102800 0x7f11b410fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.849+0000 7f11b9005640 1 -- 172.21.15.33:0/1858096879 >> 172.21.15.33:0/1858096879 conn(0x7f11b40794d0 msgr2=0x7f11b4104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.849+0000 7f11b9005640 1 -- 172.21.15.33:0/1858096879 shutdown_connections 2024-08-28T19:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:01.849+0000 7f11b9005640 1 -- 172.21.15.33:0/1858096879 wait complete. 2024-08-28T19:37:02.249 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:02 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1858096879' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:37:02.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:02 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1858096879' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:37:02.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:02 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1858096879' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:37:02.704 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:37:02.963 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:03.376 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:03 smithi033 ceph-mon[18549]: pgmap v480: 129 pgs: 129 active+clean; 4.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-08-28T19:37:03.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.467+0000 7f76ddeec640 1 -- 172.21.15.33:0/4279391249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d8108160 msgr2=0x7f76d8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:03.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.467+0000 7f76ddeec640 1 --2- 172.21.15.33:0/4279391249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d8108160 0x7f76d8108570 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009900 tx=0x7f76cc02a410 comp rx=0 tx=0).stop 2024-08-28T19:37:03.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.467+0000 7f76ddeec640 1 -- 172.21.15.33:0/4279391249 shutdown_connections 2024-08-28T19:37:03.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.467+0000 7f76ddeec640 1 --2- 172.21.15.33:0/4279391249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d8108ab0 0x7f76d810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.467+0000 7f76ddeec640 1 --2- 172.21.15.33:0/4279391249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d8108160 0x7f76d8108570 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.467+0000 7f76ddeec640 1 --2- 172.21.15.33:0/4279391249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76d8102820 0x7f76d8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.467+0000 7f76ddeec640 1 -- 172.21.15.33:0/4279391249 >> 172.21.15.33:0/4279391249 conn(0x7f76d80794e0 msgr2=0x7f76d80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:03.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.467+0000 7f76ddeec640 1 -- 172.21.15.33:0/4279391249 shutdown_connections 2024-08-28T19:37:03.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.467+0000 7f76ddeec640 1 -- 172.21.15.33:0/4279391249 wait complete. 2024-08-28T19:37:03.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.468+0000 7f76ddeec640 1 Processor -- start 2024-08-28T19:37:03.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.468+0000 7f76ddeec640 1 -- start start 2024-08-28T19:37:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.468+0000 7f76ddeec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d8102820 0x7f76d819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.468+0000 7f76ddeec640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d8108160 0x7f76d819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76ddeec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76d8108ab0 0x7f76d819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76ddeec640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f76d8112700 con 0x7f76d8102820 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76ddeec640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76d8112580 con 0x7f76d8108160 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76ddeec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f76d8112880 con 0x7f76d8108ab0 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d8102820 0x7f76d819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d8102820 0x7f76d819a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55532/0 (socket says 172.21.15.33:55532) 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d77fe640 1 -- 172.21.15.33:0/3075168233 learned_addr learned my addr 172.21.15.33:0/3075168233 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d7fff640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76d8108ab0 0x7f76d819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d6ffd640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d8108160 0x7f76d819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d77fe640 1 -- 172.21.15.33:0/3075168233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76d8108ab0 msgr2=0x7f76d819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d77fe640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76d8108ab0 0x7f76d819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d77fe640 1 -- 172.21.15.33:0/3075168233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d8108160 msgr2=0x7f76d819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d77fe640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d8108160 0x7f76d819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d77fe640 1 -- 172.21.15.33:0/3075168233 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d81a0190 con 0x7f76d8102820 2024-08-28T19:37:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d77fe640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d8102820 0x7f76d819a220 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f76c800d770 tx=0x7f76c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d4ff9640 1 -- 172.21.15.33:0/3075168233 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8017070 con 0x7f76d8102820 2024-08-28T19:37:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76ddeec640 1 -- 172.21.15.33:0/3075168233 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d81a0480 con 0x7f76d8102820 2024-08-28T19:37:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d4ff9640 1 -- 172.21.15.33:0/3075168233 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c80054d0 con 0x7f76d8102820 2024-08-28T19:37:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.469+0000 7f76d4ff9640 1 -- 172.21.15.33:0/3075168233 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8004c30 con 0x7f76d8102820 2024-08-28T19:37:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.470+0000 7f76ddeec640 1 -- 172.21.15.33:0/3075168233 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d81a6be0 con 0x7f76d8102820 2024-08-28T19:37:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76e4461740 1 Processor -- start 2024-08-28T19:37:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76e4461740 1 -- start start 2024-08-28T19:37:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76d4ff9640 1 -- 172.21.15.33:0/3075168233 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f76c8004e10 con 0x7f76d8102820 2024-08-28T19:37:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76e4461740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5852070 0x5632e5bf7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76e4461740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e58291b0 0x5632e5bf7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76e4461740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5831390 0x5632e5bf7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76e4461740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5632e5b6e680 con 0x5632e5831390 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76e4461740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5632e5b5dc10 con 0x5632e58291b0 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76e4461740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5632e5b61bc0 con 0x5632e5852070 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76d6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5831390 0x5632e5bf7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76d6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5831390 0x5632e5bf7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55540/0 (socket says 172.21.15.33:55540) 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76d6ffd640 1 -- 172.21.15.33:0/3845677584 learned_addr learned my addr 172.21.15.33:0/3845677584 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76d7fff640 1 --2- 172.21.15.33:0/3845677584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5852070 0x5632e5bf7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.473+0000 7f76d77fe640 1 --2- 172.21.15.33:0/3845677584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e58291b0 0x5632e5bf7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76d6ffd640 1 -- 172.21.15.33:0/3845677584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5852070 msgr2=0x5632e5bf7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76d6ffd640 1 --2- 172.21.15.33:0/3845677584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5852070 0x5632e5bf7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76d6ffd640 1 -- 172.21.15.33:0/3845677584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e58291b0 msgr2=0x5632e5bf7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76d6ffd640 1 --2- 172.21.15.33:0/3845677584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e58291b0 0x5632e5bf7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76d6ffd640 1 -- 172.21.15.33:0/3845677584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632e58bd650 con 0x5632e5831390 2024-08-28T19:37:03.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76d6ffd640 1 --2- 172.21.15.33:0/3845677584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5831390 0x5632e5bf7d90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009900 tx=0x7f76cc032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c908b6d91219446d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76d4ff9640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76c00b4ca0 0x7f76c00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76d7fff640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76c00b4ca0 0x7f76c00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76bdffb640 1 -- 172.21.15.33:0/3845677584 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc040070 con 0x5632e5831390 2024-08-28T19:37:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76bdffb640 1 -- 172.21.15.33:0/3845677584 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76cc032e50 con 0x5632e5831390 2024-08-28T19:37:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76bdffb640 1 -- 172.21.15.33:0/3845677584 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc035040 con 0x5632e5831390 2024-08-28T19:37:03.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.474+0000 7f76d4ff9640 1 -- 172.21.15.33:0/3075168233 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f76c80e5300 con 0x7f76d8102820 2024-08-28T19:37:03.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.475+0000 7f76e4461740 1 -- 172.21.15.33:0/3845677584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5831390 msgr2=0x5632e5bf7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:03.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.475+0000 7f76d7fff640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76c00b4ca0 0x7f76c00b71b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f76d0005fd0 tx=0x7f76d0009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:03.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.475+0000 7f76e4461740 1 --2- 172.21.15.33:0/3845677584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5831390 0x5632e5bf7d90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009900 tx=0x7f76cc032c60 comp rx=0 tx=0).stop 2024-08-28T19:37:03.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.475+0000 7f76e4461740 1 -- 172.21.15.33:0/3845677584 shutdown_connections 2024-08-28T19:37:03.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.475+0000 7f76e4461740 1 --2- 172.21.15.33:0/3845677584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5831390 0x5632e5bf7d90 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.475+0000 7f76e4461740 1 --2- 172.21.15.33:0/3845677584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e58291b0 0x5632e5bf7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.475+0000 7f76e4461740 1 --2- 172.21.15.33:0/3845677584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5852070 0x5632e5bf7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.475+0000 7f76e4461740 1 -- 172.21.15.33:0/3845677584 >> 172.21.15.33:0/3845677584 conn(0x5632e5846460 msgr2=0x5632e5bf5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.475+0000 7f76e4461740 1 -- 172.21.15.33:0/3845677584 shutdown_connections 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.475+0000 7f76e4461740 1 -- 172.21.15.33:0/3845677584 wait complete. 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76e4461740 1 -- start start 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76e4461740 1 Processor -- start 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76e4461740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e58291b0 0x5632e5c02a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76e4461740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 0x5632e5c02f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76e4461740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5852070 0x5632e5c0ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76e4461740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5632e59c0700 con 0x5632e5852070 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76e4461740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5632e5ae4750 con 0x5632e5831390 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76e4461740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5632e5c05a90 con 0x5632e58291b0 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76e4461740 10 client.0 _ll_register_callbacks cb 0x5632e5b13e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:03.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76d7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5852070 0x5632e5c0ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76d7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5852070 0x5632e5c0ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55556/0 (socket says 172.21.15.33:55556) 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.476+0000 7f76d7fff640 1 -- 172.21.15.33:0/2174066257 learned_addr learned my addr 172.21.15.33:0/2174066257 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76d6ffd640 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 0x5632e5c02f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76d77fe640 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e58291b0 0x5632e5c02a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76d7fff640 1 -- 172.21.15.33:0/2174066257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e58291b0 msgr2=0x5632e5c02a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76d7fff640 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e58291b0 0x5632e5c02a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76d7fff640 1 -- 172.21.15.33:0/2174066257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 msgr2=0x5632e5c02f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76d7fff640 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 0x5632e5c02f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76d7fff640 1 -- 172.21.15.33:0/2174066257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632e5b1d900 con 0x5632e5852070 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76d7fff640 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5852070 0x5632e5c0ed80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f76d0005c40 tx=0x7f76d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e994826a861569 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76b6ffd640 1 -- 172.21.15.33:0/2174066257 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d0020620 con 0x5632e5852070 2024-08-28T19:37:03.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76b6ffd640 1 -- 172.21.15.33:0/2174066257 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f76d00207c0 con 0x5632e5852070 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76e4461740 1 -- 172.21.15.33:0/2174066257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76cc032e50 con 0x5632e5852070 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76b6ffd640 1 -- 172.21.15.33:0/2174066257 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f76d0033050 con 0x5632e5852070 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76e4461740 10 client.16959 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.477+0000 7f76e4461740 1 -- 172.21.15.33:0/2174066257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5632e5c11830 con 0x5632e5852070 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.478+0000 7f76b6ffd640 1 -- 172.21.15.33:0/2174066257 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76cc032e50 con 0x5632e5852070 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.478+0000 7f76b6ffd640 1 -- 172.21.15.33:0/2174066257 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f76d000f040 con 0x5632e5852070 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.478+0000 7f76e4461740 10 client.16959 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.478+0000 7f76e4461740 10 client.16959 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.478+0000 7f76e4461740 20 client.16959 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.478+0000 7f76e4461740 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5632e58109f0 0x5632e5c14e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.478+0000 7f76e4461740 4 client.16959 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:03.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.478+0000 7f76e4461740 1 -- 172.21.15.33:0/2174066257 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632e5b705d0 con 0x5632e58109f0 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.478+0000 7f76d77fe640 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5632e58109f0 0x5632e5c14e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.478+0000 7f76d77fe640 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5632e58109f0 0x5632e5c14e10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d38ab749a1e70139 server_cookie=3bb172508ecafd4c in_seq=0 out_seq=0 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.479+0000 7f76b6ffd640 10 client.16959 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.479+0000 7f76b6ffd640 1 -- 172.21.15.33:0/2174066257 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632e5b705d0 con 0x5632e58109f0 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.479+0000 7f76b6ffd640 10 client.16959 handle_command_reply: tid=0 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.479+0000 7f76e4461740 1 client.16959 shutdown 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.479+0000 7f76e4461740 1 -- 172.21.15.33:0/2174066257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5852070 msgr2=0x5632e5c0ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.479+0000 7f76e4461740 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5852070 0x5632e5c0ed80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f76d0005c40 tx=0x7f76d0004a40 comp rx=0 tx=0).stop 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.480+0000 7f76e4461740 1 -- 172.21.15.33:0/2174066257 shutdown_connections 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.480+0000 7f76e4461740 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5632e58109f0 0x5632e5c14e10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.480+0000 7f76b6ffd640 0 client.16959 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.480+0000 7f76e4461740 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e5852070 0x5632e5c0ed80 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.480+0000 7f76e4461740 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 0x5632e5c02f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.480+0000 7f76e4461740 1 --2- 172.21.15.33:0/2174066257 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e58291b0 0x5632e5c02a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.480+0000 7f76e4461740 1 -- 172.21.15.33:0/2174066257 >> 172.21.15.33:0/2174066257 conn(0x5632e5846460 msgr2=0x5632e5bfa4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:03.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.480+0000 7f76e4461740 1 -- 172.21.15.33:0/2174066257 shutdown_connections 2024-08-28T19:37:03.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.480+0000 7f76e4461740 1 -- 172.21.15.33:0/2174066257 wait complete. 2024-08-28T19:37:03.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.480+0000 7f76e4461740 20 client.16959 trim_cache size 0 max 16384 2024-08-28T19:37:03.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76e4461740 1 Processor -- start 2024-08-28T19:37:03.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76e4461740 1 -- start start 2024-08-28T19:37:03.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76e4461740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58109f0 0x5632e5c048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76e4461740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e58291b0 0x5632e5c0ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76e4461740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5831390 0x5632e5c01990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76e4461740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81b0ad0 con 0x5632e58109f0 2024-08-28T19:37:03.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76e4461740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81b2610 con 0x5632e58291b0 2024-08-28T19:37:03.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76e4461740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81b11a0 con 0x5632e5831390 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76d77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58109f0 0x5632e5c048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76d77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58109f0 0x5632e5c048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55564/0 (socket says 172.21.15.33:55564) 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.493+0000 7f76d77fe640 1 -- 172.21.15.33:0/2324917917 learned_addr learned my addr 172.21.15.33:0/2324917917 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76d7fff640 1 --2- 172.21.15.33:0/2324917917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5831390 0x5632e5c01990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76d77fe640 1 -- 172.21.15.33:0/2324917917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5831390 msgr2=0x5632e5c01990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76d6ffd640 1 --2- 172.21.15.33:0/2324917917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e58291b0 0x5632e5c0ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76d77fe640 1 --2- 172.21.15.33:0/2324917917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5831390 0x5632e5c01990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76d77fe640 1 -- 172.21.15.33:0/2324917917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e58291b0 msgr2=0x5632e5c0ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76d77fe640 1 --2- 172.21.15.33:0/2324917917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e58291b0 0x5632e5c0ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76d77fe640 1 -- 172.21.15.33:0/2324917917 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632e5c03cc0 con 0x5632e58109f0 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76d7fff640 1 --2- 172.21.15.33:0/2324917917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5831390 0x5632e5c01990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76d77fe640 1 --2- 172.21.15.33:0/2324917917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58109f0 0x5632e5c048e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009610 tx=0x7f76c80e8e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe7dc36d6b88a6c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76bd7fa640 1 -- 172.21.15.33:0/2324917917 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8020040 con 0x5632e58109f0 2024-08-28T19:37:03.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76bd7fa640 1 -- 172.21.15.33:0/2324917917 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c80e2e50 con 0x5632e58109f0 2024-08-28T19:37:03.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.494+0000 7f76bd7fa640 1 -- 172.21.15.33:0/2324917917 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c80ab750 con 0x5632e58109f0 2024-08-28T19:37:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.495+0000 7f76e4461740 1 -- 172.21.15.33:0/2324917917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58109f0 msgr2=0x5632e5c048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.495+0000 7f76e4461740 1 --2- 172.21.15.33:0/2324917917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58109f0 0x5632e5c048e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009610 tx=0x7f76c80e8e50 comp rx=0 tx=0).stop 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.495+0000 7f76e4461740 1 -- 172.21.15.33:0/2324917917 shutdown_connections 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.495+0000 7f76e4461740 1 --2- 172.21.15.33:0/2324917917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e5831390 0x5632e5c01990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.495+0000 7f76e4461740 1 --2- 172.21.15.33:0/2324917917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e58291b0 0x5632e5c0ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.495+0000 7f76e4461740 1 --2- 172.21.15.33:0/2324917917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58109f0 0x5632e5c048e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.495+0000 7f76e4461740 1 -- 172.21.15.33:0/2324917917 >> 172.21.15.33:0/2324917917 conn(0x5632e5846460 msgr2=0x5632e5c01280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.495+0000 7f76e4461740 1 -- 172.21.15.33:0/2324917917 shutdown_connections 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.495+0000 7f76e4461740 1 -- 172.21.15.33:0/2324917917 wait complete. 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.495+0000 7f76e4461740 1 -- start start 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76e4461740 1 Processor -- start 2024-08-28T19:37:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76e4461740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e58109f0 0x5632e5c07380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76e4461740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58291b0 0x5632e5c078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76e4461740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 0x5632e5c7e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76e4461740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81b1f40 con 0x5632e58291b0 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76e4461740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81b1870 con 0x5632e5831390 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76e4461740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81aeab0 con 0x5632e58109f0 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76e4461740 10 client.0 _ll_register_callbacks cb 0x7f76d0009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58291b0 0x5632e5c078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58291b0 0x5632e5c078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55576/0 (socket says 172.21.15.33:55576) 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d6ffd640 1 -- 172.21.15.33:0/3979673356 learned_addr learned my addr 172.21.15.33:0/3979673356 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d77fe640 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e58109f0 0x5632e5c07380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d7fff640 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 0x5632e5c7e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d6ffd640 1 -- 172.21.15.33:0/3979673356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e58109f0 msgr2=0x5632e5c07380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d6ffd640 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e58109f0 0x5632e5c07380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d6ffd640 1 -- 172.21.15.33:0/3979673356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 msgr2=0x5632e5c7e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d6ffd640 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 0x5632e5c7e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d6ffd640 1 -- 172.21.15.33:0/3979673356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632e5c7ed10 con 0x5632e58291b0 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.496+0000 7f76d7fff640 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 0x5632e5c7e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76d6ffd640 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58291b0 0x5632e5c078c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f76cc005150 tx=0x7f76cc0050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbed36f355b3de8e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76b6ffd640 1 -- 172.21.15.33:0/3979673356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc052060 con 0x5632e58291b0 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76b6ffd640 1 -- 172.21.15.33:0/3979673356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f76cc0316a0 con 0x5632e58291b0 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76e4461740 1 -- 172.21.15.33:0/3979673356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76c80e2e50 con 0x5632e58291b0 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76b6ffd640 1 -- 172.21.15.33:0/3979673356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f76cc059050 con 0x5632e58291b0 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76e4461740 10 client.16965 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76e4461740 1 -- 172.21.15.33:0/3979673356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5632e5c7fe90 con 0x5632e58291b0 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76b6ffd640 1 -- 172.21.15.33:0/3979673356 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c80e2e50 con 0x5632e58291b0 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76b6ffd640 1 -- 172.21.15.33:0/3979673356 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f76cc003710 con 0x5632e58291b0 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76e4461740 10 client.16965 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76e4461740 10 client.16965 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76e4461740 20 client.16965 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76e4461740 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5632e5852070 0x5632e5c821e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76e4461740 4 client.16965 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.497+0000 7f76e4461740 1 -- 172.21.15.33:0/3979673356 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5632e5bf9ba0 con 0x5632e5852070 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.498+0000 7f76d77fe640 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5632e5852070 0x5632e5c821e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.498+0000 7f76d77fe640 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5632e5852070 0x5632e5c821e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b7a7ff528e39ceec server_cookie=4795e71d669a370e in_seq=0 out_seq=0 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.498+0000 7f76b6ffd640 10 client.16965 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:37:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.498+0000 7f76b6ffd640 1 -- 172.21.15.33:0/3979673356 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5632e5bf9ba0 con 0x5632e5852070 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.498+0000 7f76b6ffd640 10 client.16965 handle_command_reply: tid=0 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.498+0000 7f76e4461740 1 client.16965 shutdown 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 1 -- 172.21.15.33:0/3979673356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58291b0 msgr2=0x5632e5c078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58291b0 0x5632e5c078c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f76cc005150 tx=0x7f76cc0050e0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 1 -- 172.21.15.33:0/3979673356 shutdown_connections 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5632e5852070 0x5632e5c821e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5632e5831390 0x5632e5c7e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5632e58291b0 0x5632e5c078c0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 1 --2- 172.21.15.33:0/3979673356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5632e58109f0 0x5632e5c07380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76b6ffd640 0 client.16965 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 1 -- 172.21.15.33:0/3979673356 >> 172.21.15.33:0/3979673356 conn(0x5632e5846460 msgr2=0x5632e5c04620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 1 -- 172.21.15.33:0/3979673356 shutdown_connections 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 1 -- 172.21.15.33:0/3979673356 wait complete. 2024-08-28T19:37:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76e4461740 20 client.16965 trim_cache size 0 max 16384 2024-08-28T19:37:03.506 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:37:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.499+0000 7f76ddeec640 1 -- 172.21.15.33:0/3075168233 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76c00b4ca0 msgr2=0x7f76c00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76c00b4ca0 0x7f76c00b71b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f76d0005fd0 tx=0x7f76d0009600 comp rx=0 tx=0).stop 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 -- 172.21.15.33:0/3075168233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d8102820 msgr2=0x7f76d819a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d8102820 0x7f76d819a220 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f76c800d770 tx=0x7f76c800dc30 comp rx=0 tx=0).stop 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 -- 172.21.15.33:0/3075168233 shutdown_connections 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76c00b4ca0 0x7f76c00b71b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76d8108ab0 0x7f76d819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d8108160 0x7f76d819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 --2- 172.21.15.33:0/3075168233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d8102820 0x7f76d819a220 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 -- 172.21.15.33:0/3075168233 >> 172.21.15.33:0/3075168233 conn(0x7f76d80794e0 msgr2=0x7f76d806bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 -- 172.21.15.33:0/3075168233 shutdown_connections 2024-08-28T19:37:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:03.500+0000 7f76ddeec640 1 -- 172.21.15.33:0/3075168233 wait complete. 2024-08-28T19:37:03.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:03 smithi059 ceph-mon[22052]: pgmap v480: 129 pgs: 129 active+clean; 4.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-08-28T19:37:03.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:03 smithi122 ceph-mon[22174]: pgmap v480: 129 pgs: 129 active+clean; 4.4 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-08-28T19:37:04.398 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:37:04.653 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.129+0000 7f1a04950640 1 -- 172.21.15.33:0/3454851252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a00102810 msgr2=0x7f1a00102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.129+0000 7f1a04950640 1 --2- 172.21.15.33:0/3454851252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a00102810 0x7f1a00102c20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009900 tx=0x7f19f002a410 comp rx=0 tx=0).stop 2024-08-28T19:37:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.129+0000 7f1a04950640 1 -- 172.21.15.33:0/3454851252 shutdown_connections 2024-08-28T19:37:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.129+0000 7f1a04950640 1 --2- 172.21.15.33:0/3454851252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a00108aa0 0x7f1a0010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.129+0000 7f1a04950640 1 --2- 172.21.15.33:0/3454851252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a00108150 0x7f1a00108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.129+0000 7f1a04950640 1 --2- 172.21.15.33:0/3454851252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a00102810 0x7f1a00102c20 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.129+0000 7f1a04950640 1 -- 172.21.15.33:0/3454851252 >> 172.21.15.33:0/3454851252 conn(0x7f1a000794d0 msgr2=0x7f1a000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.130+0000 7f1a04950640 1 -- 172.21.15.33:0/3454851252 shutdown_connections 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.130+0000 7f1a04950640 1 -- 172.21.15.33:0/3454851252 wait complete. 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.130+0000 7f1a04950640 1 Processor -- start 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.130+0000 7f1a04950640 1 -- start start 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f1a04950640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a00102810 0x7f1a0019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f1a04950640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a00108150 0x7f1a0019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f1a04950640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a00108aa0 0x7f1a0019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f1a04950640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00113810 con 0x7f1a00108150 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f1a04950640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00113690 con 0x7f1a00108aa0 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f1a04950640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00113990 con 0x7f1a00102810 2024-08-28T19:37:05.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19f7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a00108150 0x7f1a0019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19f7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a00108150 0x7f1a0019a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55596/0 (socket says 172.21.15.33:55596) 2024-08-28T19:37:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19f7fff640 1 -- 172.21.15.33:0/721790887 learned_addr learned my addr 172.21.15.33:0/721790887 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19fe59c640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a00102810 0x7f1a0019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19fed9d640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a00108aa0 0x7f1a0019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19f7fff640 1 -- 172.21.15.33:0/721790887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a00102810 msgr2=0x7f1a0019a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19f7fff640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a00102810 0x7f1a0019a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19f7fff640 1 -- 172.21.15.33:0/721790887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a00108aa0 msgr2=0x7f1a0019fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19f7fff640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a00108aa0 0x7f1a0019fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19f7fff640 1 -- 172.21.15.33:0/721790887 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a001a01b0 con 0x7f1a00108150 2024-08-28T19:37:05.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.131+0000 7f19f7fff640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a00108150 0x7f1a0019a7e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f19e800d740 tx=0x7f19e800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.133+0000 7f19f77fe640 1 -- 172.21.15.33:0/721790887 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8017070 con 0x7f1a00108150 2024-08-28T19:37:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.133+0000 7f1a04950640 1 -- 172.21.15.33:0/721790887 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a001a04a0 con 0x7f1a00108150 2024-08-28T19:37:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.133+0000 7f19f77fe640 1 -- 172.21.15.33:0/721790887 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19e800de50 con 0x7f1a00108150 2024-08-28T19:37:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.133+0000 7f19f77fe640 1 -- 172.21.15.33:0/721790887 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8004ce0 con 0x7f1a00108150 2024-08-28T19:37:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.133+0000 7f1a04950640 1 -- 172.21.15.33:0/721790887 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a001a6c00 con 0x7f1a00108150 2024-08-28T19:37:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.136+0000 7f1a0aec5740 1 Processor -- start 2024-08-28T19:37:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.136+0000 7f1a0aec5740 1 -- start start 2024-08-28T19:37:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dc05070 0x55a77dfaa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19f77fe640 1 -- 172.21.15.33:0/721790887 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f19e8010460 con 0x7f1a00108150 2024-08-28T19:37:05.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbdc1b0 0x55a77dfaa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dbe4390 0x55a77dfaadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a77df21680 con 0x55a77dbe4390 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a77df10c10 con 0x55a77dbdc1b0 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a77df14bc0 con 0x55a77dc05070 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19f7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dbe4390 0x55a77dfaadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dc05070 0x55a77dfaa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dc05070 0x55a77dfaa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:53464/0 (socket says 172.21.15.33:53464) 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19f7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dbe4390 0x55a77dfaadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55608/0 (socket says 172.21.15.33:55608) 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19fed9d640 1 -- 172.21.15.33:0/1912160100 learned_addr learned my addr 172.21.15.33:0/1912160100 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19fe59c640 1 --2- 172.21.15.33:0/1912160100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbdc1b0 0x55a77dfaa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19fed9d640 1 -- 172.21.15.33:0/1912160100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbdc1b0 msgr2=0x55a77dfaa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:05.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19fed9d640 1 --2- 172.21.15.33:0/1912160100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbdc1b0 0x55a77dfaa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19fed9d640 1 -- 172.21.15.33:0/1912160100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dbe4390 msgr2=0x55a77dfaadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19fed9d640 1 --2- 172.21.15.33:0/1912160100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dbe4390 0x55a77dfaadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.137+0000 7f19fed9d640 1 -- 172.21.15.33:0/1912160100 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a77dc70650 con 0x55a77dc05070 2024-08-28T19:37:05.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.138+0000 7f19f77fe640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f19ec0b4ca0 0x7f19ec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.138+0000 7f19f77fe640 1 -- 172.21.15.33:0/721790887 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f19e80e5210 con 0x7f1a00108150 2024-08-28T19:37:05.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.138+0000 7f19fed9d640 1 --2- 172.21.15.33:0/1912160100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dc05070 0x55a77dfaa350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19f8010370 tx=0x7f19f8010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7496b0e3d0158dbe server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:05.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.138+0000 7f19fe59c640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f19ec0b4ca0 0x7f19ec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.139+0000 7f19f4ff9640 1 -- 172.21.15.33:0/1912160100 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8016070 con 0x55a77dc05070 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.139+0000 7f19f4ff9640 1 -- 172.21.15.33:0/1912160100 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19f8004d20 con 0x55a77dc05070 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.139+0000 7f19f4ff9640 1 -- 172.21.15.33:0/1912160100 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8005350 con 0x55a77dc05070 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f1a0aec5740 1 -- 172.21.15.33:0/1912160100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dc05070 msgr2=0x55a77dfaa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/1912160100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dc05070 0x55a77dfaa350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19f8010370 tx=0x7f19f8010830 comp rx=0 tx=0).stop 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f19fe59c640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f19ec0b4ca0 0x7f19ec0b71b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f19f0031440 tx=0x7f19f0009610 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f1a0aec5740 1 -- 172.21.15.33:0/1912160100 shutdown_connections 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/1912160100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dbe4390 0x55a77dfaadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/1912160100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbdc1b0 0x55a77dfaa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/1912160100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dc05070 0x55a77dfaa350 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f1a0aec5740 1 -- 172.21.15.33:0/1912160100 >> 172.21.15.33:0/1912160100 conn(0x55a77dbf9460 msgr2=0x55a77dfa8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f1a0aec5740 1 -- 172.21.15.33:0/1912160100 shutdown_connections 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f1a0aec5740 1 -- 172.21.15.33:0/1912160100 wait complete. 2024-08-28T19:37:05.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.140+0000 7f1a0aec5740 1 -- start start 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f1a0aec5740 1 Processor -- start 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfb5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfb60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a77dd73700 con 0x55a77dc05070 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a77de97750 con 0x55a77dbe4390 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a77dfb8b30 con 0x55a77dbdc1b0 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f1a0aec5740 10 client.0 _ll_register_callbacks cb 0x55a77dec6e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f19f7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfb60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55624/0 (socket says 172.21.15.33:55624) 2024-08-28T19:37:05.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f19fed9d640 1 -- 172.21.15.33:0/294910531 learned_addr learned my addr 172.21.15.33:0/294910531 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:05.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f19fe59c640 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfb5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f19fed9d640 1 -- 172.21.15.33:0/294910531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 msgr2=0x55a77dfb5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:05.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f19fed9d640 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfb5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f19fed9d640 1 -- 172.21.15.33:0/294910531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 msgr2=0x55a77dfb60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:05.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.141+0000 7f19fed9d640 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfb60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f19fed9d640 1 -- 172.21.15.33:0/294910531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a77ded0900 con 0x55a77dc05070 2024-08-28T19:37:05.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f19fe59c640 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfb5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:37:05.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f19f7fff640 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfb60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:37:05.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f19fed9d640 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc1e20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f19f8006010 tx=0x7f19f8004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7611fcbd5589c8a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f19e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f19e5ffb640 1 -- 172.21.15.33:0/294910531 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8029060 con 0x55a77dc05070 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f1a0aec5740 1 -- 172.21.15.33:0/294910531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19f8004d20 con 0x55a77dc05070 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f19e5ffb640 1 -- 172.21.15.33:0/294910531 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f19f8012a20 con 0x55a77dc05070 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f19e5ffb640 1 -- 172.21.15.33:0/294910531 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19f8030050 con 0x55a77dc05070 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f1a0aec5740 10 client.16977 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f1a0aec5740 1 -- 172.21.15.33:0/294910531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a77dfc4990 con 0x55a77dc05070 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.142+0000 7f19e5ffb640 1 -- 172.21.15.33:0/294910531 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19f8004d20 con 0x55a77dc05070 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.143+0000 7f19e5ffb640 1 -- 172.21.15.33:0/294910531 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f19f800f040 con 0x55a77dc05070 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.143+0000 7f1a0aec5740 10 client.16977 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.143+0000 7f1a0aec5740 10 client.16977 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.143+0000 7f1a0aec5740 20 client.16977 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:05.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.143+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a77dbc39f0 0x55a77dfc7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.143+0000 7f1a0aec5740 4 client.16977 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.143+0000 7f1a0aec5740 1 -- 172.21.15.33:0/294910531 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a77df235d0 con 0x55a77dbc39f0 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.143+0000 7f19fe59c640 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a77dbc39f0 0x55a77dfc7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.143+0000 7f19fe59c640 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a77dbc39f0 0x55a77dfc7d50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=70c3988caf9c3d6 server_cookie=a99a72810f3fd773 in_seq=0 out_seq=0 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.143+0000 7f19e5ffb640 10 client.16977 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f19e5ffb640 1 -- 172.21.15.33:0/294910531 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a77df235d0 con 0x55a77dbc39f0 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f19e5ffb640 10 client.16977 handle_command_reply: tid=0 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f1a0aec5740 1 client.16977 shutdown 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f1a0aec5740 1 -- 172.21.15.33:0/294910531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 msgr2=0x55a77dfc1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc1e20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f19f8006010 tx=0x7f19f8004c70 comp rx=0 tx=0).stop 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f1a0aec5740 1 -- 172.21.15.33:0/294910531 shutdown_connections 2024-08-28T19:37:05.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a77dbc39f0 0x55a77dfc7d50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc1e20 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfb60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/294910531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfb5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.144+0000 7f1a0aec5740 1 -- 172.21.15.33:0/294910531 >> 172.21.15.33:0/294910531 conn(0x55a77dbf9460 msgr2=0x55a77dfad530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:05.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.145+0000 7f19e5ffb640 0 client.16977 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:37:05.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.145+0000 7f1a0aec5740 1 -- 172.21.15.33:0/294910531 shutdown_connections 2024-08-28T19:37:05.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.145+0000 7f1a0aec5740 1 -- 172.21.15.33:0/294910531 wait complete. 2024-08-28T19:37:05.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.145+0000 7f1a0aec5740 20 client.16977 trim_cache size 0 max 16384 2024-08-28T19:37:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.158+0000 7f1a0aec5740 1 Processor -- start 2024-08-28T19:37:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.158+0000 7f1a0aec5740 1 -- start start 2024-08-28T19:37:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.158+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfaba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.158+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfc1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.158+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.158+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001ae8d0 con 0x55a77dc05070 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.158+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001b0410 con 0x55a77dbe4390 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.158+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001aefa0 con 0x55a77dbdc1b0 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55628/0 (socket says 172.21.15.33:55628) 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19fed9d640 1 -- 172.21.15.33:0/3062063796 learned_addr learned my addr 172.21.15.33:0/3062063796 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19fe59c640 1 --2- 172.21.15.33:0/3062063796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfaba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19fed9d640 1 -- 172.21.15.33:0/3062063796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 msgr2=0x55a77dfaba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19f7fff640 1 --2- 172.21.15.33:0/3062063796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfc1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19fed9d640 1 --2- 172.21.15.33:0/3062063796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfaba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19fed9d640 1 -- 172.21.15.33:0/3062063796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 msgr2=0x55a77dfc1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:05.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19fed9d640 1 --2- 172.21.15.33:0/3062063796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfc1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19fed9d640 1 -- 172.21.15.33:0/3062063796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a77dfac640 con 0x55a77dc05070 2024-08-28T19:37:05.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19f7fff640 1 --2- 172.21.15.33:0/3062063796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfc1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:05.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19fed9d640 1 --2- 172.21.15.33:0/3062063796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc22d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f19f8011010 tx=0x7f19f8009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a337ea46ce94ea server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:05.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19e7fff640 1 -- 172.21.15.33:0/3062063796 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8038020 con 0x55a77dc05070 2024-08-28T19:37:05.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19e7fff640 1 -- 172.21.15.33:0/3062063796 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19f801a800 con 0x55a77dc05070 2024-08-28T19:37:05.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.159+0000 7f19e7fff640 1 -- 172.21.15.33:0/3062063796 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8029070 con 0x55a77dc05070 2024-08-28T19:37:05.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.160+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3062063796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 msgr2=0x55a77dfc22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:05.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.160+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/3062063796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc22d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f19f8011010 tx=0x7f19f8009a00 comp rx=0 tx=0).stop 2024-08-28T19:37:05.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.160+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3062063796 shutdown_connections 2024-08-28T19:37:05.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.160+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/3062063796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77dfc22d0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.160+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/3062063796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfc1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.160+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/3062063796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfaba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.160+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3062063796 >> 172.21.15.33:0/3062063796 conn(0x55a77dbf9460 msgr2=0x55a77dfab380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.160+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3062063796 shutdown_connections 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.160+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3062063796 wait complete. 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.160+0000 7f1a0aec5740 1 -- start start 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f1a0aec5740 1 Processor -- start 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfc94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfc9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f1a0aec5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77e0314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001afd40 con 0x55a77dc05070 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001af670 con 0x55a77dbe4390 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f1a0aec5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a001ac8b0 con 0x55a77dbdc1b0 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f1a0aec5740 10 client.0 _ll_register_callbacks cb 0x7f19e80e8c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:05.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77e0314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77e0314d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55636/0 (socket says 172.21.15.33:55636) 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f19fed9d640 1 -- 172.21.15.33:0/3489005020 learned_addr learned my addr 172.21.15.33:0/3489005020 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f19f7fff640 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfc9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f19fe59c640 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfc94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f19fed9d640 1 -- 172.21.15.33:0/3489005020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 msgr2=0x55a77dfc94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f19fed9d640 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfc94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f19fed9d640 1 -- 172.21.15.33:0/3489005020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 msgr2=0x55a77dfc9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f19fed9d640 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfc9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.161+0000 7f19fed9d640 1 -- 172.21.15.33:0/3489005020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a77e031a40 con 0x55a77dc05070 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.162+0000 7f19fed9d640 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77e0314d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f19f8010870 tx=0x7f19f8009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d589cb203cc9c46c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.162+0000 7f19e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.162+0000 7f19e5ffb640 1 -- 172.21.15.33:0/3489005020 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8041020 con 0x55a77dc05070 2024-08-28T19:37:05.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.162+0000 7f19e5ffb640 1 -- 172.21.15.33:0/3489005020 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f19f801ad20 con 0x55a77dc05070 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.162+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3489005020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19f801a800 con 0x55a77dc05070 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.162+0000 7f19e5ffb640 1 -- 172.21.15.33:0/3489005020 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19f804c050 con 0x55a77dc05070 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.162+0000 7f1a0aec5740 10 client.16983 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.162+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3489005020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a77e032c30 con 0x55a77dc05070 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.162+0000 7f19e5ffb640 1 -- 172.21.15.33:0/3489005020 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19f801a800 con 0x55a77dc05070 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.162+0000 7f19e5ffb640 1 -- 172.21.15.33:0/3489005020 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f19f8004040 con 0x55a77dc05070 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.163+0000 7f1a0aec5740 10 client.16983 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.163+0000 7f1a0aec5740 10 client.16983 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.163+0000 7f1a0aec5740 20 client.16983 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.163+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a77db98da0 0x55a77e0352e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.163+0000 7f1a0aec5740 4 client.16983 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.163+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3489005020 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a77df1f070 con 0x55a77db98da0 2024-08-28T19:37:05.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.163+0000 7f19fe59c640 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a77db98da0 0x55a77e0352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.163+0000 7f19e5ffb640 10 client.16983 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.163+0000 7f19fe59c640 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a77db98da0 0x55a77e0352e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6e7cb9fec33cb8a4 server_cookie=616a47858b53a95 in_seq=0 out_seq=0 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f19e5ffb640 1 -- 172.21.15.33:0/3489005020 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a77df1f070 con 0x55a77db98da0 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f19e5ffb640 10 client.16983 handle_command_reply: tid=0 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 client.16983 shutdown 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3489005020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 msgr2=0x55a77e0314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77e0314d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f19f8010870 tx=0x7f19f8009cc0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3489005020 shutdown_connections 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a77db98da0 0x55a77e0352e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a77dc05070 0x55a77e0314d0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a77dbe4390 0x55a77dfc9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f19e5ffb640 0 client.16983 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:37:05.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 --2- 172.21.15.33:0/3489005020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a77dbdc1b0 0x55a77dfc94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3489005020 >> 172.21.15.33:0/3489005020 conn(0x55a77dbf9460 msgr2=0x55a77dfadb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:05.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3489005020 shutdown_connections 2024-08-28T19:37:05.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 1 -- 172.21.15.33:0/3489005020 wait complete. 2024-08-28T19:37:05.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a0aec5740 20 client.16983 trim_cache size 0 max 16384 2024-08-28T19:37:05.171 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:37:05.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a04950640 1 -- 172.21.15.33:0/721790887 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f19ec0b4ca0 msgr2=0x7f19ec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:05.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a04950640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f19ec0b4ca0 0x7f19ec0b71b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f19f0031440 tx=0x7f19f0009610 comp rx=0 tx=0).stop 2024-08-28T19:37:05.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a04950640 1 -- 172.21.15.33:0/721790887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a00108150 msgr2=0x7f1a0019a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:05.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.164+0000 7f1a04950640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a00108150 0x7f1a0019a7e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f19e800d740 tx=0x7f19e800dc00 comp rx=0 tx=0).stop 2024-08-28T19:37:05.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.165+0000 7f1a04950640 1 -- 172.21.15.33:0/721790887 shutdown_connections 2024-08-28T19:37:05.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.165+0000 7f1a04950640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a00108aa0 0x7f1a0019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.165+0000 7f1a04950640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a00108150 0x7f1a0019a7e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.165+0000 7f1a04950640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f19ec0b4ca0 0x7f19ec0b71b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.165+0000 7f1a04950640 1 --2- 172.21.15.33:0/721790887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a00102810 0x7f1a0019a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:05.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.165+0000 7f1a04950640 1 -- 172.21.15.33:0/721790887 >> 172.21.15.33:0/721790887 conn(0x7f1a000794d0 msgr2=0x7f1a00101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:05.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.165+0000 7f1a04950640 1 -- 172.21.15.33:0/721790887 shutdown_connections 2024-08-28T19:37:05.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:05.165+0000 7f1a04950640 1 -- 172.21.15.33:0/721790887 wait complete. 2024-08-28T19:37:05.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:05 smithi033 ceph-mon[18549]: pgmap v481: 129 pgs: 129 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 61 KiB/s wr, 33 op/s 2024-08-28T19:37:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:05 smithi059 ceph-mon[22052]: pgmap v481: 129 pgs: 129 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 61 KiB/s wr, 33 op/s 2024-08-28T19:37:05.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:05 smithi122 ceph-mon[22174]: pgmap v481: 129 pgs: 129 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 61 KiB/s wr, 33 op/s 2024-08-28T19:37:05.889 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:37:06.145 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.683+0000 7f4ecf547640 1 -- 172.21.15.33:0/1451557429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec810dc00 msgr2=0x7f4ec81100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.683+0000 7f4ecf547640 1 --2- 172.21.15.33:0/1451557429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec810dc00 0x7f4ec81100d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009ca0 tx=0x7f4ec002a8e0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.683+0000 7f4ecf547640 1 -- 172.21.15.33:0/1451557429 shutdown_connections 2024-08-28T19:37:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.683+0000 7f4ecf547640 1 --2- 172.21.15.33:0/1451557429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec810dc00 0x7f4ec81100d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.683+0000 7f4ecf547640 1 --2- 172.21.15.33:0/1451557429 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ec8105120 0x7f4ec810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.683+0000 7f4ecf547640 1 --2- 172.21.15.33:0/1451557429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec81047d0 0x7f4ec8104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.683+0000 7f4ecf547640 1 -- 172.21.15.33:0/1451557429 >> 172.21.15.33:0/1451557429 conn(0x7f4ec8079550 msgr2=0x7f4ec8079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.683+0000 7f4ecf547640 1 -- 172.21.15.33:0/1451557429 shutdown_connections 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.683+0000 7f4ecf547640 1 -- 172.21.15.33:0/1451557429 wait complete. 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.683+0000 7f4ecf547640 1 Processor -- start 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecf547640 1 -- start start 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecf547640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec81047d0 0x7f4ec8102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecf547640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec8105120 0x7f4ec8102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecf547640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ec810dc00 0x7f4ec8102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecf547640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec81138a0 con 0x7f4ec81047d0 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecf547640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec8113720 con 0x7f4ec8105120 2024-08-28T19:37:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecf547640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec8113a20 con 0x7f4ec810dc00 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecd2e3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec81047d0 0x7f4ec8102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecd2e3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec81047d0 0x7f4ec8102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55642/0 (socket says 172.21.15.33:55642) 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecd2e3640 1 -- 172.21.15.33:0/99025748 learned_addr learned my addr 172.21.15.33:0/99025748 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4eccae2640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec8105120 0x7f4ec8102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ec810dc00 0x7f4ec8102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecd2e3640 1 -- 172.21.15.33:0/99025748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ec810dc00 msgr2=0x7f4ec8102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ec810dc00 0x7f4ec8102f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecd2e3640 1 -- 172.21.15.33:0/99025748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec8105120 msgr2=0x7f4ec8102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec8105120 0x7f4ec8102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecd2e3640 1 -- 172.21.15.33:0/99025748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec81a84f0 con 0x7f4ec81047d0 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.684+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ec810dc00 0x7f4ec8102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.685+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec81047d0 0x7f4ec8102510 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c890 tx=0x7f4ec400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.685+0000 7f4ebe7fc640 1 -- 172.21.15.33:0/99025748 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4004220 con 0x7f4ec81047d0 2024-08-28T19:37:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.685+0000 7f4ebe7fc640 1 -- 172.21.15.33:0/99025748 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ec40043c0 con 0x7f4ec81047d0 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.685+0000 7f4ecf547640 1 -- 172.21.15.33:0/99025748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec81a87e0 con 0x7f4ec81047d0 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.685+0000 7f4ebe7fc640 1 -- 172.21.15.33:0/99025748 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4004a00 con 0x7f4ec81047d0 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.685+0000 7f4ecf547640 1 -- 172.21.15.33:0/99025748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec81a8da0 con 0x7f4ec81047d0 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ed5abc740 1 Processor -- start 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ed5abc740 1 -- start start 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ebe7fc640 1 -- 172.21.15.33:0/99025748 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4ec40079b0 con 0x7f4ec81047d0 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b07310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616727391b0 0x561672b07850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561672741390 0x561672b07d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561672a7e680 con 0x5616727391b0 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561672a6dc10 con 0x561672762070 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561672a71bc0 con 0x561672741390 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ecd2e3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616727391b0 0x561672b07850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ecd2e3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616727391b0 0x561672b07850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55652/0 (socket says 172.21.15.33:55652) 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ecd2e3640 1 -- 172.21.15.33:0/1349182058 learned_addr learned my addr 172.21.15.33:0/1349182058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.688+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/1349182058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b07310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4eccae2640 1 --2- 172.21.15.33:0/1349182058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561672741390 0x561672b07d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4ecd2e3640 1 -- 172.21.15.33:0/1349182058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561672741390 msgr2=0x561672b07d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/1349182058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561672741390 0x561672b07d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4ecd2e3640 1 -- 172.21.15.33:0/1349182058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 msgr2=0x561672b07310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/1349182058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b07310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4ecd2e3640 1 -- 172.21.15.33:0/1349182058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616727cd650 con 0x5616727391b0 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/1349182058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b07310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4ebe7fc640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4eb40b4ca0 0x7f4eb40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/1349182058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616727391b0 0x561672b07850 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40e2920 tx=0x7f4ec40ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8d9dc14eaab0e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4eb40b4ca0 0x7f4eb40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4ebe7fc640 1 -- 172.21.15.33:0/99025748 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4ec40e55b0 con 0x7f4ec81047d0 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4eb37fe640 1 -- 172.21.15.33:0/1349182058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40a7810 con 0x5616727391b0 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4eb37fe640 1 -- 172.21.15.33:0/1349182058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ec40ab460 con 0x5616727391b0 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.689+0000 7f4eb37fe640 1 -- 172.21.15.33:0/1349182058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40ab0c0 con 0x5616727391b0 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.690+0000 7f4ed5abc740 1 -- 172.21.15.33:0/1349182058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616727391b0 msgr2=0x561672b07850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.690+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/1349182058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616727391b0 0x561672b07850 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40e2920 tx=0x7f4ec40ed690 comp rx=0 tx=0).stop 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.690+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4eb40b4ca0 0x7f4eb40b71b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0005cc0 tx=0x7f4ec0009970 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.690+0000 7f4ed5abc740 1 -- 172.21.15.33:0/1349182058 shutdown_connections 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.690+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/1349182058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561672741390 0x561672b07d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.690+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/1349182058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5616727391b0 0x561672b07850 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.690+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/1349182058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b07310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.690+0000 7f4ed5abc740 1 -- 172.21.15.33:0/1349182058 >> 172.21.15.33:0/1349182058 conn(0x561672756460 msgr2=0x561672b05200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.690+0000 7f4ed5abc740 1 -- 172.21.15.33:0/1349182058 shutdown_connections 2024-08-28T19:37:06.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.690+0000 7f4ed5abc740 1 -- 172.21.15.33:0/1349182058 wait complete. 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ed5abc740 1 -- start start 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ed5abc740 1 Processor -- start 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616727391b0 0x561672b12a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561672741390 0x561672b12fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672762070 0x561672b1ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5616728d0700 con 0x561672762070 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5616729f4750 con 0x5616727391b0 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561672b15af0 con 0x561672741390 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ed5abc740 10 client.0 _ll_register_callbacks cb 0x561672a23e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ecdae4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672762070 0x561672b1ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ecdae4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672762070 0x561672b1ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55658/0 (socket says 172.21.15.33:55658) 2024-08-28T19:37:06.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ecdae4640 1 -- 172.21.15.33:0/3891194897 learned_addr learned my addr 172.21.15.33:0/3891194897 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616727391b0 0x561672b12a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.691+0000 7f4eccae2640 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561672741390 0x561672b12fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4ecdae4640 1 -- 172.21.15.33:0/3891194897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561672741390 msgr2=0x561672b12fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561672741390 0x561672b12fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4ecdae4640 1 -- 172.21.15.33:0/3891194897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616727391b0 msgr2=0x561672b12a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616727391b0 0x561672b12a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4ecdae4640 1 -- 172.21.15.33:0/3891194897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561672a2d900 con 0x561672762070 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672762070 0x561672b1ede0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0035000 tx=0x7f4ec00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac29e30d3373774 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4eb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/3891194897 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00305e0 con 0x561672762070 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/3891194897 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4ec0030780 con 0x561672762070 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4ed5abc740 1 -- 172.21.15.33:0/3891194897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ec40ab460 con 0x561672762070 2024-08-28T19:37:06.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/3891194897 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4ec00309c0 con 0x561672762070 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4ed5abc740 10 client.16995 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4ed5abc740 1 -- 172.21.15.33:0/3891194897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561672b217d0 con 0x561672762070 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.692+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/3891194897 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ec40ab460 con 0x561672762070 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.693+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/3891194897 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4ec004d070 con 0x561672762070 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.693+0000 7f4ed5abc740 10 client.16995 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.693+0000 7f4ed5abc740 10 client.16995 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.693+0000 7f4ed5abc740 20 client.16995 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.693+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5616727209f0 0x561672b24c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.693+0000 7f4ed5abc740 4 client.16995 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.693+0000 7f4ed5abc740 1 -- 172.21.15.33:0/3891194897 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561672a805d0 con 0x5616727209f0 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.693+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5616727209f0 0x561672b24c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.693+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5616727209f0 0x561672b24c60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=361854a016571109 server_cookie=2cd9d1e2ed5e85ec in_seq=0 out_seq=0 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.693+0000 7f4eb0ff9640 10 client.16995 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:37:06.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/3891194897 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561672a805d0 con 0x5616727209f0 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4eb0ff9640 10 client.16995 handle_command_reply: tid=0 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4ed5abc740 1 client.16995 shutdown 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4ed5abc740 1 -- 172.21.15.33:0/3891194897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672762070 msgr2=0x561672b1ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672762070 0x561672b1ede0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0035000 tx=0x7f4ec00095c0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4ed5abc740 1 -- 172.21.15.33:0/3891194897 shutdown_connections 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5616727209f0 0x561672b24c60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672762070 0x561672b1ede0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561672741390 0x561672b12fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/3891194897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616727391b0 0x561672b12a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4eb0ff9640 0 client.16995 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.694+0000 7f4ed5abc740 1 -- 172.21.15.33:0/3891194897 >> 172.21.15.33:0/3891194897 conn(0x561672756460 msgr2=0x561672b0a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:06.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.695+0000 7f4ed5abc740 1 -- 172.21.15.33:0/3891194897 shutdown_connections 2024-08-28T19:37:06.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.695+0000 7f4ed5abc740 1 -- 172.21.15.33:0/3891194897 wait complete. 2024-08-28T19:37:06.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.695+0000 7f4ed5abc740 20 client.16995 trim_cache size 0 max 16384 2024-08-28T19:37:06.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.708+0000 7f4ed5abc740 1 Processor -- start 2024-08-28T19:37:06.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.708+0000 7f4ed5abc740 1 -- start start 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.708+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 0x561672b0a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.708+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b0a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.708+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b0fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.708+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec81b2e50 con 0x561672741390 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.708+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec81b4990 con 0x561672762070 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.708+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec81b3520 con 0x5616727391b0 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eccae2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b0a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eccae2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b0a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55674/0 (socket says 172.21.15.33:55674) 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eccae2640 1 -- 172.21.15.33:0/2110427874 learned_addr learned my addr 172.21.15.33:0/2110427874 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b0fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 0x561672b0a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eccae2640 1 -- 172.21.15.33:0/2110427874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 msgr2=0x561672b0a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:06.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eccae2640 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 0x561672b0a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eccae2640 1 -- 172.21.15.33:0/2110427874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 msgr2=0x561672b0fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eccae2640 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b0fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eccae2640 1 -- 172.21.15.33:0/2110427874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561672b13d50 con 0x561672741390 2024-08-28T19:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 0x561672b0a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4ecdae4640 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b0fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eccae2640 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b0a950 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009aa0 tx=0x7f4eb8009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d617074fab712ab server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eb2ffd640 1 -- 172.21.15.33:0/2110427874 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb801b070 con 0x561672741390 2024-08-28T19:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eb2ffd640 1 -- 172.21.15.33:0/2110427874 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4eb8013bc0 con 0x561672741390 2024-08-28T19:37:06.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.709+0000 7f4eb2ffd640 1 -- 172.21.15.33:0/2110427874 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800f040 con 0x561672741390 2024-08-28T19:37:06.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.710+0000 7f4ed5abc740 1 -- 172.21.15.33:0/2110427874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 msgr2=0x561672b0a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.710+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b0a950 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009aa0 tx=0x7f4eb8009110 comp rx=0 tx=0).stop 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.710+0000 7f4ed5abc740 1 -- 172.21.15.33:0/2110427874 shutdown_connections 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.710+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b0fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.710+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b0a950 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.710+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/2110427874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 0x561672b0a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.710+0000 7f4ed5abc740 1 -- 172.21.15.33:0/2110427874 >> 172.21.15.33:0/2110427874 conn(0x561672756460 msgr2=0x561672b11310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.710+0000 7f4ed5abc740 1 -- 172.21.15.33:0/2110427874 shutdown_connections 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.710+0000 7f4ed5abc740 1 -- 172.21.15.33:0/2110427874 wait complete. 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4ed5abc740 1 -- start start 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4ed5abc740 1 Processor -- start 2024-08-28T19:37:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 0x561672b17220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b17800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4ed5abc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b8e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec81b42c0 con 0x561672741390 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec81b3bf0 con 0x561672762070 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4ed5abc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec81b0e30 con 0x5616727391b0 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4ed5abc740 10 client.0 _ll_register_callbacks cb 0x7f4ec0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4eccae2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b17800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4eccae2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b17800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55682/0 (socket says 172.21.15.33:55682) 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4eccae2640 1 -- 172.21.15.33:0/364035104 learned_addr learned my addr 172.21.15.33:0/364035104 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.711+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 0x561672b17220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eccae2640 1 -- 172.21.15.33:0/364035104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 msgr2=0x561672b17220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eccae2640 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 0x561672b17220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eccae2640 1 -- 172.21.15.33:0/364035104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 msgr2=0x561672b8e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eccae2640 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b8e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eccae2640 1 -- 172.21.15.33:0/364035104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561672b8eb60 con 0x561672741390 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 0x561672b17220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eccae2640 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b17800 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8016d20 tx=0x7f4eb8013a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffe667ecdfdf65d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/364035104 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb801b040 con 0x561672741390 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/364035104 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4eb8016460 con 0x561672741390 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4ed5abc740 1 -- 172.21.15.33:0/364035104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4eb8013bc0 con 0x561672741390 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/364035104 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4eb8016660 con 0x561672741390 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4ed5abc740 10 client.17001 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4ed5abc740 1 -- 172.21.15.33:0/364035104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561672b8fc80 con 0x561672741390 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.712+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/364035104 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4eb8013bc0 con 0x561672741390 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.713+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/364035104 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4eb8020cd0 con 0x561672741390 2024-08-28T19:37:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.713+0000 7f4ed5abc740 10 client.17001 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.713+0000 7f4ed5abc740 10 client.17001 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.713+0000 7f4ed5abc740 20 client.17001 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.713+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5616726f5da0 0x561672b92350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.713+0000 7f4ed5abc740 4 client.17001 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.713+0000 7f4ed5abc740 1 -- 172.21.15.33:0/364035104 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561672a7c070 con 0x5616726f5da0 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.713+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5616726f5da0 0x561672b92350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.713+0000 7f4ecd2e3640 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5616726f5da0 0x561672b92350 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3b72c7c5eb68d183 server_cookie=4987d3a7c29336f0 in_seq=0 out_seq=0 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.713+0000 7f4eb0ff9640 10 client.17001 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4eb0ff9640 1 -- 172.21.15.33:0/364035104 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561672a7c070 con 0x5616726f5da0 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4eb0ff9640 10 client.17001 handle_command_reply: tid=0 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 client.17001 shutdown 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 -- 172.21.15.33:0/364035104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 msgr2=0x561672b17800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b17800 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8016d20 tx=0x7f4eb8013a30 comp rx=0 tx=0).stop 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 -- 172.21.15.33:0/364035104 shutdown_connections 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561672762070 0x561672b8e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5616726f5da0 0x561672b92350 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4eb0ff9640 0 client.17001 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561672741390 0x561672b17800 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 --2- 172.21.15.33:0/364035104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5616727391b0 0x561672b17220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 -- 172.21.15.33:0/364035104 >> 172.21.15.33:0/364035104 conn(0x561672756460 msgr2=0x561672b0a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 -- 172.21.15.33:0/364035104 shutdown_connections 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 1 -- 172.21.15.33:0/364035104 wait complete. 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.714+0000 7f4ed5abc740 20 client.17001 trim_cache size 0 max 16384 2024-08-28T19:37:06.720 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:37:06.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 -- 172.21.15.33:0/99025748 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4eb40b4ca0 msgr2=0x7f4eb40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:06.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4eb40b4ca0 0x7f4eb40b71b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0005cc0 tx=0x7f4ec0009970 comp rx=0 tx=0).stop 2024-08-28T19:37:06.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 -- 172.21.15.33:0/99025748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec81047d0 msgr2=0x7f4ec8102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:06.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec81047d0 0x7f4ec8102510 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c890 tx=0x7f4ec400cc90 comp rx=0 tx=0).stop 2024-08-28T19:37:06.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 -- 172.21.15.33:0/99025748 shutdown_connections 2024-08-28T19:37:06.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4eb40b4ca0 0x7f4eb40b71b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4ec810dc00 0x7f4ec8102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec8105120 0x7f4ec8102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 --2- 172.21.15.33:0/99025748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec81047d0 0x7f4ec8102510 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 -- 172.21.15.33:0/99025748 >> 172.21.15.33:0/99025748 conn(0x7f4ec8079550 msgr2=0x7f4ec80ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 -- 172.21.15.33:0/99025748 shutdown_connections 2024-08-28T19:37:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:06.715+0000 7f4ecf547640 1 -- 172.21.15.33:0/99025748 wait complete. 2024-08-28T19:37:07.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:07 smithi033 ceph-mon[18549]: pgmap v482: 129 pgs: 129 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-08-28T19:37:07.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:07 smithi059 ceph-mon[22052]: pgmap v482: 129 pgs: 129 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-08-28T19:37:07.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:07 smithi122 ceph-mon[22174]: pgmap v482: 129 pgs: 129 active+clean; 4.6 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-08-28T19:37:07.595 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:37:07.851 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:08.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.384+0000 7f2c24cb8640 1 -- 172.21.15.33:0/249891160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c201058d0 msgr2=0x7f2c2010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.384+0000 7f2c24cb8640 1 --2- 172.21.15.33:0/249891160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c201058d0 0x7f2c2010f320 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009ca0 tx=0x7f2c1802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.384+0000 7f2c24cb8640 1 -- 172.21.15.33:0/249891160 shutdown_connections 2024-08-28T19:37:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.384+0000 7f2c24cb8640 1 --2- 172.21.15.33:0/249891160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c201058d0 0x7f2c2010f320 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.384+0000 7f2c24cb8640 1 --2- 172.21.15.33:0/249891160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c20104f80 0x7f2c20105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.384+0000 7f2c24cb8640 1 --2- 172.21.15.33:0/249891160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c20102fb0 0x7f2c201033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.384+0000 7f2c24cb8640 1 -- 172.21.15.33:0/249891160 >> 172.21.15.33:0/249891160 conn(0x7f2c20079d30 msgr2=0x7f2c2007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.384+0000 7f2c24cb8640 1 -- 172.21.15.33:0/249891160 shutdown_connections 2024-08-28T19:37:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.384+0000 7f2c24cb8640 1 -- 172.21.15.33:0/249891160 wait complete. 2024-08-28T19:37:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c24cb8640 1 Processor -- start 2024-08-28T19:37:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c24cb8640 1 -- start start 2024-08-28T19:37:08.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c24cb8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20102fb0 0x7f2c2019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c24cb8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c20104f80 0x7f2c2019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c24cb8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c201058d0 0x7f2c2019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c24cb8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2c20112770 con 0x7f2c20102fb0 2024-08-28T19:37:08.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c24cb8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c201125f0 con 0x7f2c201058d0 2024-08-28T19:37:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c24cb8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2c201128f0 con 0x7f2c20104f80 2024-08-28T19:37:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c1e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20102fb0 0x7f2c2019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c1e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20102fb0 0x7f2c2019a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52590/0 (socket says 172.21.15.33:52590) 2024-08-28T19:37:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c1e59c640 1 -- 172.21.15.33:0/4052336196 learned_addr learned my addr 172.21.15.33:0/4052336196 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c1ed9d640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c201058d0 0x7f2c2019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c20104f80 0x7f2c2019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c1e59c640 1 -- 172.21.15.33:0/4052336196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c20104f80 msgr2=0x7f2c2019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c20104f80 0x7f2c2019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c1e59c640 1 -- 172.21.15.33:0/4052336196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c201058d0 msgr2=0x7f2c2019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c201058d0 0x7f2c2019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.385+0000 7f2c1e59c640 1 -- 172.21.15.33:0/4052336196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c201a00a0 con 0x7f2c20102fb0 2024-08-28T19:37:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.386+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c20104f80 0x7f2c2019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.386+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20102fb0 0x7f2c2019a1f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000d950 tx=0x7f2c1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.386+0000 7f2c0f7fe640 1 -- 172.21.15.33:0/4052336196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10017070 con 0x7f2c20102fb0 2024-08-28T19:37:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.386+0000 7f2c24cb8640 1 -- 172.21.15.33:0/4052336196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c201a0390 con 0x7f2c20102fb0 2024-08-28T19:37:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.386+0000 7f2c0f7fe640 1 -- 172.21.15.33:0/4052336196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c10009c30 con 0x7f2c20102fb0 2024-08-28T19:37:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.386+0000 7f2c0f7fe640 1 -- 172.21.15.33:0/4052336196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000f620 con 0x7f2c20102fb0 2024-08-28T19:37:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.386+0000 7f2c24cb8640 1 -- 172.21.15.33:0/4052336196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c201a6bb0 con 0x7f2c20102fb0 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c2b22d740 1 Processor -- start 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c2b22d740 1 -- start start 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c0f7fe640 1 -- 172.21.15.33:0/4052336196 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2c10010460 con 0x7f2c20102fb0 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94726070 0x55bb94acb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94acb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94705390 0x55bb94acbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bb94a42680 con 0x55bb946fd1b0 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bb94a31c10 con 0x55bb94726070 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb94a35bc0 con 0x55bb94705390 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c1e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94acb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c1e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94acb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52592/0 (socket says 172.21.15.33:52592) 2024-08-28T19:37:08.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.389+0000 7f2c1e59c640 1 -- 172.21.15.33:0/533160685 learned_addr learned my addr 172.21.15.33:0/533160685 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c1ed9d640 1 --2- 172.21.15.33:0/533160685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94726070 0x55bb94acb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/533160685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94705390 0x55bb94acbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c1e59c640 1 -- 172.21.15.33:0/533160685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94705390 msgr2=0x55bb94acbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/533160685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94705390 0x55bb94acbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c1e59c640 1 -- 172.21.15.33:0/533160685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94726070 msgr2=0x55bb94acb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/533160685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94726070 0x55bb94acb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c1e59c640 1 -- 172.21.15.33:0/533160685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb94791650 con 0x55bb946fd1b0 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/533160685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94705390 0x55bb94acbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/533160685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94acb850 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2c100e2830 tx=0x7f2c100ebb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a843df8f5f20a7b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c0f7fe640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c080b4cd0 0x7f2c080b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c0cff9640 1 -- 172.21.15.33:0/533160685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c100f8070 con 0x55bb946fd1b0 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c1ed9d640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c080b4cd0 0x7f2c080b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c0f7fe640 1 -- 172.21.15.33:0/4052336196 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2c100e5420 con 0x7f2c20102fb0 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c0cff9640 1 -- 172.21.15.33:0/533160685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c100ab370 con 0x55bb946fd1b0 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.390+0000 7f2c0cff9640 1 -- 172.21.15.33:0/533160685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c100ab630 con 0x55bb946fd1b0 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.391+0000 7f2c2b22d740 1 -- 172.21.15.33:0/533160685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 msgr2=0x55bb94acb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.391+0000 7f2c1ed9d640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c080b4cd0 0x7f2c080b71e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2c18006010 tx=0x7f2c1802f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.391+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/533160685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94acb850 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2c100e2830 tx=0x7f2c100ebb20 comp rx=0 tx=0).stop 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.391+0000 7f2c2b22d740 1 -- 172.21.15.33:0/533160685 shutdown_connections 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.391+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/533160685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94705390 0x55bb94acbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.391+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/533160685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94acb850 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.391+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/533160685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94726070 0x55bb94acb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.391+0000 7f2c2b22d740 1 -- 172.21.15.33:0/533160685 >> 172.21.15.33:0/533160685 conn(0x55bb9471a460 msgr2=0x55bb94ac9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.392+0000 7f2c2b22d740 1 -- 172.21.15.33:0/533160685 shutdown_connections 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.392+0000 7f2c2b22d740 1 -- 172.21.15.33:0/533160685 wait complete. 2024-08-28T19:37:08.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.392+0000 7f2c2b22d740 1 -- start start 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.392+0000 7f2c2b22d740 1 Processor -- start 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.392+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94adaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.392+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94705390 0x55bb94adb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.392+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94ae7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bb94894700 con 0x55bb946fd1b0 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bb949b8750 con 0x55bb94705390 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb94adde50 con 0x55bb94726070 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94adaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94adaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52600/0 (socket says 172.21.15.33:52600) 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1e59c640 1 -- 172.21.15.33:0/1369058812 learned_addr learned my addr 172.21.15.33:0/1369058812 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c2b22d740 10 client.0 _ll_register_callbacks cb 0x55bb949e7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:08.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94705390 0x55bb94adb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1e59c640 1 -- 172.21.15.33:0/1369058812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 msgr2=0x55bb94ae7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1ed9d640 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94ae7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94ae7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1e59c640 1 -- 172.21.15.33:0/1369058812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94705390 msgr2=0x55bb94adb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94705390 0x55bb94adb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1e59c640 1 -- 172.21.15.33:0/1369058812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb949f1900 con 0x55bb946fd1b0 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94705390 0x55bb94adb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1ed9d640 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94ae7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94adaf40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2c100ab560 tx=0x7f2c1000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2150394cae835b15 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c05ffb640 1 -- 172.21.15.33:0/1369058812 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10020070 con 0x55bb946fd1b0 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c05ffb640 1 -- 172.21.15.33:0/1369058812 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2c100e5150 con 0x55bb946fd1b0 2024-08-28T19:37:08.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.393+0000 7f2c2b22d740 1 -- 172.21.15.33:0/1369058812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c100ab370 con 0x55bb946fd1b0 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c05ffb640 1 -- 172.21.15.33:0/1369058812 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2c100aafd0 con 0x55bb946fd1b0 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c2b22d740 10 client.17013 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c2b22d740 1 -- 172.21.15.33:0/1369058812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb94ae9cd0 con 0x55bb946fd1b0 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c05ffb640 1 -- 172.21.15.33:0/1369058812 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c100ab370 con 0x55bb946fd1b0 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c05ffb640 1 -- 172.21.15.33:0/1369058812 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2c100a7af0 con 0x55bb946fd1b0 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c2b22d740 10 client.17013 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c2b22d740 10 client.17013 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c2b22d740 20 client.17013 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55bb946e49f0 0x55bb94aed030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c2b22d740 4 client.17013 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.394+0000 7f2c2b22d740 1 -- 172.21.15.33:0/1369058812 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb94a445d0 con 0x55bb946e49f0 2024-08-28T19:37:08.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.395+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55bb946e49f0 0x55bb94aed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.395+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55bb946e49f0 0x55bb94aed030 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f2e5bab1c4f51a7 server_cookie=43e3ca90308189dc in_seq=0 out_seq=0 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.395+0000 7f2c05ffb640 10 client.17013 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c05ffb640 1 -- 172.21.15.33:0/1369058812 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb94a445d0 con 0x55bb946e49f0 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c05ffb640 10 client.17013 handle_command_reply: tid=0 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 client.17013 shutdown 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 -- 172.21.15.33:0/1369058812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 msgr2=0x55bb94adaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94adaf40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2c100ab560 tx=0x7f2c1000bf60 comp rx=0 tx=0).stop 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 -- 172.21.15.33:0/1369058812 shutdown_connections 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55bb946e49f0 0x55bb94aed030 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94ae7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb94705390 0x55bb94adb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c05ffb640 0 client.17013 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:37:08.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/1369058812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb946fd1b0 0x55bb94adaf40 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 -- 172.21.15.33:0/1369058812 >> 172.21.15.33:0/1369058812 conn(0x55bb9471a460 msgr2=0x55bb94ac77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:08.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 -- 172.21.15.33:0/1369058812 shutdown_connections 2024-08-28T19:37:08.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 1 -- 172.21.15.33:0/1369058812 wait complete. 2024-08-28T19:37:08.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.396+0000 7f2c2b22d740 20 client.17013 trim_cache size 0 max 16384 2024-08-28T19:37:08.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.409+0000 7f2c2b22d740 1 Processor -- start 2024-08-28T19:37:08.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.409+0000 7f2c2b22d740 1 -- start start 2024-08-28T19:37:08.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 0x55bb94accd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94adcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94ad8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2c201ae930 con 0x55bb94705390 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c201b0470 con 0x55bb946fd1b0 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2c201af000 con 0x55bb94726070 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94adcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94adcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52608/0 (socket says 172.21.15.33:52608) 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1dd9b640 1 -- 172.21.15.33:0/3126676431 learned_addr learned my addr 172.21.15.33:0/3126676431 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/3126676431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 0x55bb94accd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1ed9d640 1 --2- 172.21.15.33:0/3126676431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94ad8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1dd9b640 1 -- 172.21.15.33:0/3126676431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 msgr2=0x55bb94ad8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/3126676431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94ad8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1dd9b640 1 -- 172.21.15.33:0/3126676431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 msgr2=0x55bb94accd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/3126676431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 0x55bb94accd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1dd9b640 1 -- 172.21.15.33:0/3126676431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb94ace140 con 0x55bb94705390 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1ed9d640 1 --2- 172.21.15.33:0/3126676431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94ad8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/3126676431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94adcb70 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x55bb94ac49a0 tx=0x7f2c1400a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58efcb5cea62c1b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.410+0000 7f2c07fff640 1 -- 172.21.15.33:0/3126676431 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14004230 con 0x55bb94705390 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c07fff640 1 -- 172.21.15.33:0/3126676431 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c140043d0 con 0x55bb94705390 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c07fff640 1 -- 172.21.15.33:0/3126676431 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c140035f0 con 0x55bb94705390 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c2b22d740 1 -- 172.21.15.33:0/3126676431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 msgr2=0x55bb94adcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/3126676431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94adcb70 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x55bb94ac49a0 tx=0x7f2c1400a310 comp rx=0 tx=0).stop 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c2b22d740 1 -- 172.21.15.33:0/3126676431 shutdown_connections 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/3126676431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94ad8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/3126676431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94adcb70 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/3126676431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 0x55bb94accd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c2b22d740 1 -- 172.21.15.33:0/3126676431 >> 172.21.15.33:0/3126676431 conn(0x55bb9471a460 msgr2=0x55bb94adc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:08.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c2b22d740 1 -- 172.21.15.33:0/3126676431 shutdown_connections 2024-08-28T19:37:08.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.411+0000 7f2c2b22d740 1 -- 172.21.15.33:0/3126676431 wait complete. 2024-08-28T19:37:08.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c2b22d740 1 -- start start 2024-08-28T19:37:08.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c2b22d740 1 Processor -- start 2024-08-28T19:37:08.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 0x55bb94b4b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94b4bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c2b22d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94b4c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2c201afda0 con 0x55bb94705390 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c201af6d0 con 0x55bb946fd1b0 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c2b22d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2c201ac910 con 0x55bb94726070 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c2b22d740 10 client.0 _ll_register_callbacks cb 0x7f2c100f6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c1dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94b4bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c1dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94b4bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52618/0 (socket says 172.21.15.33:52618) 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c1dd9b640 1 -- 172.21.15.33:0/2100470319 learned_addr learned my addr 172.21.15.33:0/2100470319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 0x55bb94b4b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.412+0000 7f2c1ed9d640 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94b4c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c1dd9b640 1 -- 172.21.15.33:0/2100470319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 msgr2=0x55bb94b4c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94b4c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c1dd9b640 1 -- 172.21.15.33:0/2100470319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 msgr2=0x55bb94b4b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 0x55bb94b4b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c1dd9b640 1 -- 172.21.15.33:0/2100470319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb94b56940 con 0x55bb94705390 2024-08-28T19:37:08.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 0x55bb94b4b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:37:08.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c1dd9b640 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94b4bc80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2c14004f40 tx=0x7f2c14004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea38ffee5f74c8d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:08.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:08.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c05ffb640 1 -- 172.21.15.33:0/2100470319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14033060 con 0x55bb94705390 2024-08-28T19:37:08.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c05ffb640 1 -- 172.21.15.33:0/2100470319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2c140051e0 con 0x55bb94705390 2024-08-28T19:37:08.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c2b22d740 1 -- 172.21.15.33:0/2100470319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c140043d0 con 0x55bb94705390 2024-08-28T19:37:08.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c05ffb640 1 -- 172.21.15.33:0/2100470319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2c1403a050 con 0x55bb94705390 2024-08-28T19:37:08.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c2b22d740 10 client.17019 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:08.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.413+0000 7f2c2b22d740 1 -- 172.21.15.33:0/2100470319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb94b57b30 con 0x55bb94705390 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c05ffb640 1 -- 172.21.15.33:0/2100470319 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c140043d0 con 0x55bb94705390 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c05ffb640 1 -- 172.21.15.33:0/2100470319 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2c1401bb40 con 0x55bb94705390 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c2b22d740 10 client.17019 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c2b22d740 10 client.17019 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c2b22d740 20 client.17019 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55bb946b9da0 0x55bb94b5a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c2b22d740 4 client.17019 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c2b22d740 1 -- 172.21.15.33:0/2100470319 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bb94a40070 con 0x55bb946b9da0 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55bb946b9da0 0x55bb94b5a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c05ffb640 10 client.17019 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.414+0000 7f2c1e59c640 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55bb946b9da0 0x55bb94b5a320 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36b5eae0e7c7c375 server_cookie=19db1108130a607c in_seq=0 out_seq=0 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c05ffb640 1 -- 172.21.15.33:0/2100470319 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bb94a40070 con 0x55bb946b9da0 2024-08-28T19:37:08.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c05ffb640 10 client.17019 handle_command_reply: tid=0 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 client.17019 shutdown 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 -- 172.21.15.33:0/2100470319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 msgr2=0x55bb94b4bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94b4bc80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2c14004f40 tx=0x7f2c14004f70 comp rx=0 tx=0).stop 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 -- 172.21.15.33:0/2100470319 shutdown_connections 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55bb946b9da0 0x55bb94b5a320 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb94726070 0x55bb94b4c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb94705390 0x55bb94b4bc80 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 --2- 172.21.15.33:0/2100470319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb946fd1b0 0x55bb94b4b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 -- 172.21.15.33:0/2100470319 >> 172.21.15.33:0/2100470319 conn(0x55bb9471a460 msgr2=0x55bb94ad0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c05ffb640 0 client.17019 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 -- 172.21.15.33:0/2100470319 shutdown_connections 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 1 -- 172.21.15.33:0/2100470319 wait complete. 2024-08-28T19:37:08.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.415+0000 7f2c2b22d740 20 client.17019 trim_cache size 0 max 16384 2024-08-28T19:37:08.423 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:37:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 -- 172.21.15.33:0/4052336196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c080b4cd0 msgr2=0x7f2c080b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:08.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c080b4cd0 0x7f2c080b71e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2c18006010 tx=0x7f2c1802f310 comp rx=0 tx=0).stop 2024-08-28T19:37:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 -- 172.21.15.33:0/4052336196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20102fb0 msgr2=0x7f2c2019a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20102fb0 0x7f2c2019a1f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000d950 tx=0x7f2c1000de10 comp rx=0 tx=0).stop 2024-08-28T19:37:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 -- 172.21.15.33:0/4052336196 shutdown_connections 2024-08-28T19:37:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c201058d0 0x7f2c2019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c080b4cd0 0x7f2c080b71e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c20104f80 0x7f2c2019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 --2- 172.21.15.33:0/4052336196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20102fb0 0x7f2c2019a1f0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 -- 172.21.15.33:0/4052336196 >> 172.21.15.33:0/4052336196 conn(0x7f2c20079d30 msgr2=0x7f2c20106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 -- 172.21.15.33:0/4052336196 shutdown_connections 2024-08-28T19:37:08.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:08.416+0000 7f2c24cb8640 1 -- 172.21.15.33:0/4052336196 wait complete. 2024-08-28T19:37:09.111 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:37:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:09.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:09 smithi033 ceph-mon[18549]: pgmap v483: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-08-28T19:37:09.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:09 smithi059 ceph-mon[22052]: pgmap v483: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-08-28T19:37:09.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:09 smithi122 ceph-mon[22174]: pgmap v483: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 64 KiB/s wr, 32 op/s 2024-08-28T19:37:09.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 -- 172.21.15.33:0/1786835058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f225c108170 msgr2=0x7f225c108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 --2- 172.21.15.33:0/1786835058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f225c108170 0x7f225c108580 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f224c009900 tx=0x7f224c02a410 comp rx=0 tx=0).stop 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 -- 172.21.15.33:0/1786835058 shutdown_connections 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 --2- 172.21.15.33:0/1786835058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f225c108ac0 0x7f225c10f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 --2- 172.21.15.33:0/1786835058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f225c108170 0x7f225c108580 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 --2- 172.21.15.33:0/1786835058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f225c102880 0x7f225c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 -- 172.21.15.33:0/1786835058 >> 172.21.15.33:0/1786835058 conn(0x7f225c079500 msgr2=0x7f225c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 -- 172.21.15.33:0/1786835058 shutdown_connections 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 -- 172.21.15.33:0/1786835058 wait complete. 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 Processor -- start 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.845+0000 7f22634a4640 1 -- start start 2024-08-28T19:37:09.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f22634a4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f225c102880 0x7f225c19afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f22634a4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f225c108170 0x7f225c19b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f22634a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f225c108ac0 0x7f225c19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f22634a4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f225c112710 con 0x7f225c108ac0 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f22634a4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f225c112590 con 0x7f225c102880 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f22634a4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f225c112890 con 0x7f225c108170 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2261a41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f225c108ac0 0x7f225c19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2261a41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f225c108ac0 0x7f225c19ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52640/0 (socket says 172.21.15.33:52640) 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2261a41640 1 -- 172.21.15.33:0/425760623 learned_addr learned my addr 172.21.15.33:0/425760623 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2261240640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f225c102880 0x7f225c19afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2260a3f640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f225c108170 0x7f225c19b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2261a41640 1 -- 172.21.15.33:0/425760623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f225c108170 msgr2=0x7f225c19b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2261a41640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f225c108170 0x7f225c19b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2261a41640 1 -- 172.21.15.33:0/425760623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f225c102880 msgr2=0x7f225c19afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2261a41640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f225c102880 0x7f225c19afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2261a41640 1 -- 172.21.15.33:0/425760623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225c1a62d0 con 0x7f225c108ac0 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2260a3f640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f225c108170 0x7f225c19b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.846+0000 7f2261a41640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f225c108ac0 0x7f225c19ba40 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f225400eb10 tx=0x7f225400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.847+0000 7f22527fc640 1 -- 172.21.15.33:0/425760623 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254004b20 con 0x7f225c108ac0 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.847+0000 7f22527fc640 1 -- 172.21.15.33:0/425760623 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2254004cc0 con 0x7f225c108ac0 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.847+0000 7f22634a4640 1 -- 172.21.15.33:0/425760623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225c1a65c0 con 0x7f225c108ac0 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.847+0000 7f22527fc640 1 -- 172.21.15.33:0/425760623 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254010670 con 0x7f225c108ac0 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.847+0000 7f22634a4640 1 -- 172.21.15.33:0/425760623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225c1a6b20 con 0x7f225c108ac0 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2269a19740 1 Processor -- start 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f22527fc640 1 -- 172.21.15.33:0/425760623 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2254005020 con 0x7f225c108ac0 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2269a19740 1 -- start start 2024-08-28T19:37:09.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2269a19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e9c070 0x55bba7241310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2269a19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7241850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2269a19740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e7b390 0x55bba7241d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2269a19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bba71b8680 con 0x55bba6e731b0 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2269a19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bba71a7c10 con 0x55bba6e9c070 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2269a19740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bba71abbc0 con 0x55bba6e7b390 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2261240640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7241850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2261240640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7241850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52646/0 (socket says 172.21.15.33:52646) 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2261240640 1 -- 172.21.15.33:0/1297239790 learned_addr learned my addr 172.21.15.33:0/1297239790 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f2260a3f640 1 --2- 172.21.15.33:0/1297239790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e9c070 0x55bba7241310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.850+0000 7f22527fc640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22480b4d20 0x7f22480b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f2260a3f640 1 --2- 172.21.15.33:0/1297239790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e7b390 0x55bba7241d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f2261240640 1 -- 172.21.15.33:0/1297239790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e7b390 msgr2=0x55bba7241d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f2261240640 1 --2- 172.21.15.33:0/1297239790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e7b390 0x55bba7241d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f2261240640 1 -- 172.21.15.33:0/1297239790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e9c070 msgr2=0x55bba7241310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f2261240640 1 --2- 172.21.15.33:0/1297239790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e9c070 0x55bba7241310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f2261240640 1 -- 172.21.15.33:0/1297239790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bba6f07650 con 0x55bba6e731b0 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f2260a3f640 1 --2- 172.21.15.33:0/1297239790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e7b390 0x55bba7241d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f2261a41640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22480b4d20 0x7f22480b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f22527fc640 1 -- 172.21.15.33:0/425760623 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f22540e5e20 con 0x7f225c108ac0 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f2261240640 1 --2- 172.21.15.33:0/1297239790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7241850 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f225800bcb0 tx=0x7f22580107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3aeecffd3e3727 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f22477fe640 1 -- 172.21.15.33:0/1297239790 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258015850 con 0x55bba6e731b0 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f22477fe640 1 -- 172.21.15.33:0/1297239790 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2258020480 con 0x55bba6e731b0 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f22477fe640 1 -- 172.21.15.33:0/1297239790 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225801e5e0 con 0x55bba6e731b0 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.851+0000 7f2261a41640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22480b4d20 0x7f22480b7230 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f22540e3820 tx=0x7f2254068040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.852+0000 7f2269a19740 1 -- 172.21.15.33:0/1297239790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 msgr2=0x55bba7241850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:09.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.852+0000 7f2269a19740 1 --2- 172.21.15.33:0/1297239790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7241850 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f225800bcb0 tx=0x7f22580107a0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.852+0000 7f2269a19740 1 -- 172.21.15.33:0/1297239790 shutdown_connections 2024-08-28T19:37:09.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.852+0000 7f2269a19740 1 --2- 172.21.15.33:0/1297239790 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e7b390 0x55bba7241d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.852+0000 7f2269a19740 1 --2- 172.21.15.33:0/1297239790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7241850 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.852+0000 7f2269a19740 1 --2- 172.21.15.33:0/1297239790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e9c070 0x55bba7241310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.852+0000 7f2269a19740 1 -- 172.21.15.33:0/1297239790 >> 172.21.15.33:0/1297239790 conn(0x55bba6e90460 msgr2=0x55bba723f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:09.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.852+0000 7f2269a19740 1 -- 172.21.15.33:0/1297239790 shutdown_connections 2024-08-28T19:37:09.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.852+0000 7f2269a19740 1 -- 172.21.15.33:0/1297239790 wait complete. 2024-08-28T19:37:09.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2269a19740 1 -- start start 2024-08-28T19:37:09.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2269a19740 1 Processor -- start 2024-08-28T19:37:09.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2269a19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba724cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2269a19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba724d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2269a19740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e9c070 0x55bba7258de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2269a19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bba700a700 con 0x55bba6e731b0 2024-08-28T19:37:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2269a19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bba712e750 con 0x55bba6e7b390 2024-08-28T19:37:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2269a19740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bba724faf0 con 0x55bba6e9c070 2024-08-28T19:37:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2269a19740 10 client.0 _ll_register_callbacks cb 0x55bba715de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2260a3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba724cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2260a3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba724cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52648/0 (socket says 172.21.15.33:52648) 2024-08-28T19:37:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.853+0000 7f2260a3f640 1 -- 172.21.15.33:0/1999552143 learned_addr learned my addr 172.21.15.33:0/1999552143 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2261240640 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba724d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2260a3f640 1 -- 172.21.15.33:0/1999552143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e9c070 msgr2=0x55bba7258de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:09.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2260a3f640 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e9c070 0x55bba7258de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2260a3f640 1 -- 172.21.15.33:0/1999552143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 msgr2=0x55bba724d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2260a3f640 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba724d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2260a3f640 1 -- 172.21.15.33:0/1999552143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bba7167900 con 0x55bba6e731b0 2024-08-28T19:37:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2260a3f640 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba724cad0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f224c009900 tx=0x7f224c005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ac962d00bfd99f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2244ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2244ff9640 1 -- 172.21.15.33:0/1999552143 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c035040 con 0x55bba6e731b0 2024-08-28T19:37:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2244ff9640 1 -- 172.21.15.33:0/1999552143 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f224c004100 con 0x55bba6e731b0 2024-08-28T19:37:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2269a19740 1 -- 172.21.15.33:0/1999552143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2258020480 con 0x55bba6e731b0 2024-08-28T19:37:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2244ff9640 1 -- 172.21.15.33:0/1999552143 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f224c004300 con 0x55bba6e731b0 2024-08-28T19:37:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2269a19740 10 client.17031 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2269a19740 1 -- 172.21.15.33:0/1999552143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bba725b810 con 0x55bba6e731b0 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.854+0000 7f2244ff9640 1 -- 172.21.15.33:0/1999552143 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2258020480 con 0x55bba6e731b0 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.855+0000 7f2244ff9640 1 -- 172.21.15.33:0/1999552143 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f224c03a040 con 0x55bba6e731b0 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.855+0000 7f2269a19740 10 client.17031 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.855+0000 7f2269a19740 10 client.17031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.855+0000 7f2269a19740 20 client.17031 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.855+0000 7f2269a19740 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55bba6e5a9f0 0x55bba725ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.855+0000 7f2269a19740 4 client.17031 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.855+0000 7f2269a19740 1 -- 172.21.15.33:0/1999552143 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bba71ba5d0 con 0x55bba6e5a9f0 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.855+0000 7f2261240640 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55bba6e5a9f0 0x55bba725ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.856+0000 7f2261240640 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55bba6e5a9f0 0x55bba725ec50 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7cf9d23df6fa224 server_cookie=6a14e8e25d38ee08 in_seq=0 out_seq=0 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.856+0000 7f2244ff9640 10 client.17031 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:09.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.856+0000 7f2244ff9640 1 -- 172.21.15.33:0/1999552143 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bba71ba5d0 con 0x55bba6e5a9f0 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.856+0000 7f2244ff9640 10 client.17031 handle_command_reply: tid=0 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.856+0000 7f2269a19740 1 client.17031 shutdown 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 1 -- 172.21.15.33:0/1999552143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 msgr2=0x55bba724cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba724cad0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f224c009900 tx=0x7f224c005ec0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 1 -- 172.21.15.33:0/1999552143 shutdown_connections 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e9c070 0x55bba7258de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba724d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55bba6e5a9f0 0x55bba725ec50 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 1 --2- 172.21.15.33:0/1999552143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba724cad0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 1 -- 172.21.15.33:0/1999552143 >> 172.21.15.33:0/1999552143 conn(0x55bba6e90460 msgr2=0x55bba72444f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2244ff9640 0 client.17031 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 1 -- 172.21.15.33:0/1999552143 shutdown_connections 2024-08-28T19:37:09.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 1 -- 172.21.15.33:0/1999552143 wait complete. 2024-08-28T19:37:09.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.857+0000 7f2269a19740 20 client.17031 trim_cache size 0 max 16384 2024-08-28T19:37:09.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.870+0000 7f2269a19740 1 Processor -- start 2024-08-28T19:37:09.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.870+0000 7f2269a19740 1 -- start start 2024-08-28T19:37:09.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.870+0000 7f2269a19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7244b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.870+0000 7f2269a19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba7249cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.870+0000 7f2269a19740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e9c070 0x55bba724a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.870+0000 7f2269a19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f225c1ae980 con 0x55bba6e731b0 2024-08-28T19:37:09.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.870+0000 7f2269a19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f225c1b04c0 con 0x55bba6e7b390 2024-08-28T19:37:09.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.870+0000 7f2269a19740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f225c1af050 con 0x55bba6e9c070 2024-08-28T19:37:09.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2260a3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7244b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2260a3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7244b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52660/0 (socket says 172.21.15.33:52660) 2024-08-28T19:37:09.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2260a3f640 1 -- 172.21.15.33:0/3653365617 learned_addr learned my addr 172.21.15.33:0/3653365617 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:09.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2261240640 1 --2- 172.21.15.33:0/3653365617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba7249cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2260a3f640 1 --2- 172.21.15.33:0/3653365617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e9c070 0x55bba724a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2260a3f640 1 -- 172.21.15.33:0/3653365617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e9c070 msgr2=0x55bba724a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:09.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2260a3f640 1 --2- 172.21.15.33:0/3653365617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e9c070 0x55bba724a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2260a3f640 1 -- 172.21.15.33:0/3653365617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 msgr2=0x55bba7249cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:09.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2260a3f640 1 --2- 172.21.15.33:0/3653365617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba7249cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2260a3f640 1 -- 172.21.15.33:0/3653365617 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bba7245060 con 0x55bba6e731b0 2024-08-28T19:37:09.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2260a3f640 1 --2- 172.21.15.33:0/3653365617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7244b20 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f224c03d4b0 tx=0x7f224c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424101cceab7752b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:09.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2246ffd640 1 -- 172.21.15.33:0/3653365617 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c035070 con 0x55bba6e731b0 2024-08-28T19:37:09.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2246ffd640 1 -- 172.21.15.33:0/3653365617 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f224c03d7a0 con 0x55bba6e731b0 2024-08-28T19:37:09.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.871+0000 7f2246ffd640 1 -- 172.21.15.33:0/3653365617 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c003850 con 0x55bba6e731b0 2024-08-28T19:37:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.872+0000 7f2269a19740 1 -- 172.21.15.33:0/3653365617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 msgr2=0x55bba7244b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.872+0000 7f2269a19740 1 --2- 172.21.15.33:0/3653365617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7244b20 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f224c03d4b0 tx=0x7f224c005f30 comp rx=0 tx=0).stop 2024-08-28T19:37:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.872+0000 7f2269a19740 1 -- 172.21.15.33:0/3653365617 shutdown_connections 2024-08-28T19:37:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.872+0000 7f2269a19740 1 --2- 172.21.15.33:0/3653365617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e9c070 0x55bba724a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.872+0000 7f2269a19740 1 --2- 172.21.15.33:0/3653365617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba7249cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.872+0000 7f2269a19740 1 --2- 172.21.15.33:0/3653365617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e731b0 0x55bba7244b20 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.872+0000 7f2269a19740 1 -- 172.21.15.33:0/3653365617 >> 172.21.15.33:0/3653365617 conn(0x55bba6e90460 msgr2=0x55bba7244410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.872+0000 7f2269a19740 1 -- 172.21.15.33:0/3653365617 shutdown_connections 2024-08-28T19:37:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.872+0000 7f2269a19740 1 -- 172.21.15.33:0/3653365617 wait complete. 2024-08-28T19:37:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2269a19740 1 -- start start 2024-08-28T19:37:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2269a19740 1 Processor -- start 2024-08-28T19:37:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2269a19740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e731b0 0x55bba7251720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2269a19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba7251d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2269a19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e9c070 0x55bba72c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2269a19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f225c1afdf0 con 0x55bba6e9c070 2024-08-28T19:37:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2269a19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f225c1af720 con 0x55bba6e7b390 2024-08-28T19:37:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2269a19740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f225c1ac960 con 0x55bba6e731b0 2024-08-28T19:37:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2269a19740 10 client.0 _ll_register_callbacks cb 0x7f224c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2260a3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e9c070 0x55bba72c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2260a3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e9c070 0x55bba72c25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52676/0 (socket says 172.21.15.33:52676) 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.873+0000 7f2260a3f640 1 -- 172.21.15.33:0/133739909 learned_addr learned my addr 172.21.15.33:0/133739909 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2260a3f640 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e731b0 0x55bba7251720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2261240640 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba7251d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2260a3f640 1 -- 172.21.15.33:0/133739909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e731b0 msgr2=0x55bba7251720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2260a3f640 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e731b0 0x55bba7251720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2260a3f640 1 -- 172.21.15.33:0/133739909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 msgr2=0x55bba7251d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2260a3f640 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba7251d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2260a3f640 1 -- 172.21.15.33:0/133739909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bba72c2c50 con 0x55bba6e9c070 2024-08-28T19:37:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2260a3f640 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e9c070 0x55bba72c25e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f224c03d600 tx=0x7f224c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdac06fcfb50df97 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2244ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2244ff9640 1 -- 172.21.15.33:0/133739909 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c035030 con 0x55bba6e9c070 2024-08-28T19:37:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2244ff9640 1 -- 172.21.15.33:0/133739909 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f224c03db50 con 0x55bba6e9c070 2024-08-28T19:37:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2269a19740 1 -- 172.21.15.33:0/133739909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f224c03d7a0 con 0x55bba6e9c070 2024-08-28T19:37:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2244ff9640 1 -- 172.21.15.33:0/133739909 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f224c03dd50 con 0x55bba6e9c070 2024-08-28T19:37:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2269a19740 10 client.17037 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.874+0000 7f2269a19740 1 -- 172.21.15.33:0/133739909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bba72ca040 con 0x55bba6e9c070 2024-08-28T19:37:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2244ff9640 1 -- 172.21.15.33:0/133739909 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f224c03d7a0 con 0x55bba6e9c070 2024-08-28T19:37:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2244ff9640 1 -- 172.21.15.33:0/133739909 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f224c0049a0 con 0x55bba6e9c070 2024-08-28T19:37:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2269a19740 10 client.17037 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2269a19740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2269a19740 20 client.17037 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2269a19740 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55bba6e2fda0 0x55bba72cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2269a19740 4 client.17037 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2269a19740 1 -- 172.21.15.33:0/133739909 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bba71b6070 con 0x55bba6e2fda0 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2261240640 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55bba6e2fda0 0x55bba72cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2244ff9640 10 client.17037 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.875+0000 7f2261240640 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55bba6e2fda0 0x55bba72cc740 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f0e8fcf0dcd3267 server_cookie=e40e2de72d9a35d6 in_seq=0 out_seq=0 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2244ff9640 1 -- 172.21.15.33:0/133739909 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bba71b6070 con 0x55bba6e2fda0 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2244ff9640 10 client.17037 handle_command_reply: tid=0 2024-08-28T19:37:09.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 client.17037 shutdown 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 -- 172.21.15.33:0/133739909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e9c070 msgr2=0x55bba72c25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e9c070 0x55bba72c25e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f224c03d600 tx=0x7f224c031400 comp rx=0 tx=0).stop 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 -- 172.21.15.33:0/133739909 shutdown_connections 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55bba6e2fda0 0x55bba72cc740 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bba6e9c070 0x55bba72c25e0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bba6e7b390 0x55bba7251d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 --2- 172.21.15.33:0/133739909 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bba6e731b0 0x55bba7251720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 -- 172.21.15.33:0/133739909 >> 172.21.15.33:0/133739909 conn(0x55bba6e90460 msgr2=0x55bba72422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2244ff9640 0 client.17037 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 -- 172.21.15.33:0/133739909 shutdown_connections 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 1 -- 172.21.15.33:0/133739909 wait complete. 2024-08-28T19:37:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.876+0000 7f2269a19740 20 client.17037 trim_cache size 0 max 16384 2024-08-28T19:37:09.884 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:37:09.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 -- 172.21.15.33:0/425760623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22480b4d20 msgr2=0x7f22480b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:09.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22480b4d20 0x7f22480b7230 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f22540e3820 tx=0x7f2254068040 comp rx=0 tx=0).stop 2024-08-28T19:37:09.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 -- 172.21.15.33:0/425760623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f225c108ac0 msgr2=0x7f225c19ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:09.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f225c108ac0 0x7f225c19ba40 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f225400eb10 tx=0x7f225400c2d0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 -- 172.21.15.33:0/425760623 shutdown_connections 2024-08-28T19:37:09.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f225c108ac0 0x7f225c19ba40 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22480b4d20 0x7f22480b7230 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f225c108170 0x7f225c19b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 --2- 172.21.15.33:0/425760623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f225c102880 0x7f225c19afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:09.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 -- 172.21.15.33:0/425760623 >> 172.21.15.33:0/425760623 conn(0x7f225c079500 msgr2=0x7f225c105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:09.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 -- 172.21.15.33:0/425760623 shutdown_connections 2024-08-28T19:37:09.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:09.877+0000 7f22634a4640 1 -- 172.21.15.33:0/425760623 wait complete. 2024-08-28T19:37:11.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:11 smithi059 ceph-mon[22052]: pgmap v484: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-08-28T19:37:11.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:11 smithi122 ceph-mon[22174]: pgmap v484: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-08-28T19:37:11.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:11 smithi033 ceph-mon[18549]: pgmap v484: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-08-28T19:37:11.646 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:37:11.647 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:37:11.912 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:12.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.442+0000 7f47516ae640 1 -- 172.21.15.33:0/3483556196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c101d60 msgr2=0x7f474c102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:12.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.442+0000 7f47516ae640 1 --2- 172.21.15.33:0/3483556196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c101d60 0x7f474c102170 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f473c009900 tx=0x7f473c02a410 comp rx=0 tx=0).stop 2024-08-28T19:37:12.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.442+0000 7f47516ae640 1 -- 172.21.15.33:0/3483556196 shutdown_connections 2024-08-28T19:37:12.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.442+0000 7f47516ae640 1 --2- 172.21.15.33:0/3483556196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f474c109bf0 0x7f474c110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.442+0000 7f47516ae640 1 --2- 172.21.15.33:0/3483556196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f474c1092a0 0x7f474c1096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.442+0000 7f47516ae640 1 --2- 172.21.15.33:0/3483556196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c101d60 0x7f474c102170 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.442+0000 7f47516ae640 1 -- 172.21.15.33:0/3483556196 >> 172.21.15.33:0/3483556196 conn(0x7f474c079d30 msgr2=0x7f474c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:12.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.442+0000 7f47516ae640 1 -- 172.21.15.33:0/3483556196 shutdown_connections 2024-08-28T19:37:12.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.442+0000 7f47516ae640 1 -- 172.21.15.33:0/3483556196 wait complete. 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.442+0000 7f47516ae640 1 Processor -- start 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f47516ae640 1 -- start start 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f47516ae640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c101d60 0x7f474c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f47516ae640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f474c1092a0 0x7f474c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f47516ae640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f474c109bf0 0x7f474c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f47516ae640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f474c1138b0 con 0x7f474c101d60 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f47516ae640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f474c113730 con 0x7f474c109bf0 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f47516ae640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f474c113a30 con 0x7f474c1092a0 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f474affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c101d60 0x7f474c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f474affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c101d60 0x7f474c19a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52702/0 (socket says 172.21.15.33:52702) 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f474affd640 1 -- 172.21.15.33:0/3808345708 learned_addr learned my addr 172.21.15.33:0/3808345708 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:12.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f474b7fe640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f474c109bf0 0x7f474c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f474a7fc640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f474c1092a0 0x7f474c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f474affd640 1 -- 172.21.15.33:0/3808345708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f474c1092a0 msgr2=0x7f474c19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f474affd640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f474c1092a0 0x7f474c19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f474affd640 1 -- 172.21.15.33:0/3808345708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f474c109bf0 msgr2=0x7f474c19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f474affd640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f474c109bf0 0x7f474c19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.443+0000 7f474affd640 1 -- 172.21.15.33:0/3808345708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474c1a01f0 con 0x7f474c101d60 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.444+0000 7f474affd640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c101d60 0x7f474c19a280 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f473c005940 tx=0x7f473c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.444+0000 7f4733fff640 1 -- 172.21.15.33:0/3808345708 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c03f030 con 0x7f474c101d60 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.444+0000 7f4733fff640 1 -- 172.21.15.33:0/3808345708 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f473c003cb0 con 0x7f474c101d60 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.444+0000 7f47516ae640 1 -- 172.21.15.33:0/3808345708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f474c1a0480 con 0x7f474c101d60 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.444+0000 7f4733fff640 1 -- 172.21.15.33:0/3808345708 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c035070 con 0x7f474c101d60 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.444+0000 7f47516ae640 1 -- 172.21.15.33:0/3808345708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f474c1a6c40 con 0x7f474c101d60 2024-08-28T19:37:12.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.447+0000 7f4757c23740 1 Processor -- start 2024-08-28T19:37:12.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.447+0000 7f4757c23740 1 -- start start 2024-08-28T19:37:12.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.447+0000 7f4733fff640 1 -- 172.21.15.33:0/3808345708 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f473c042030 con 0x7f474c101d60 2024-08-28T19:37:12.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.447+0000 7f4757c23740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 0x563911181780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.447+0000 7f4757c23740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910db2490 0x563911181cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.447+0000 7f4757c23740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 0x563911182200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.447+0000 7f4757c23740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5639110f75f0 con 0x563910dba670 2024-08-28T19:37:12.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.447+0000 7f4757c23740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5639110e6b80 con 0x563910db2490 2024-08-28T19:37:12.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.447+0000 7f4757c23740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5639110eab30 con 0x563910ddb350 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 0x563911181780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910db2490 0x563911181cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 0x563911182200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 0x563911181780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:48340/0 (socket says 172.21.15.33:48340) 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474b7fe640 1 -- 172.21.15.33:0/3530490715 learned_addr learned my addr 172.21.15.33:0/3530490715 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474b7fe640 1 -- 172.21.15.33:0/3530490715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910db2490 msgr2=0x563911181cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474b7fe640 1 --2- 172.21.15.33:0/3530490715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910db2490 0x563911181cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474b7fe640 1 -- 172.21.15.33:0/3530490715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 msgr2=0x563911182200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474b7fe640 1 --2- 172.21.15.33:0/3530490715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 0x563911182200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474b7fe640 1 -- 172.21.15.33:0/3530490715 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563910e46930 con 0x563910ddb350 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474b7fe640 1 --2- 172.21.15.33:0/3530490715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 0x563911181780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4744009ee0 tx=0x7f4744010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4883fe298138057a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:12.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f4733fff640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47340b4ca0 0x7f47340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f474affd640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47340b4ca0 0x7f47340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.448+0000 7f47317fa640 1 -- 172.21.15.33:0/3530490715 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744016070 con 0x563910ddb350 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f47317fa640 1 -- 172.21.15.33:0/3530490715 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4744004d20 con 0x563910ddb350 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f47317fa640 1 -- 172.21.15.33:0/3530490715 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47440126b0 con 0x563910ddb350 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f4733fff640 1 -- 172.21.15.33:0/3808345708 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f473c106220 con 0x7f474c101d60 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f4757c23740 1 -- 172.21.15.33:0/3530490715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 msgr2=0x563911181780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f4757c23740 1 --2- 172.21.15.33:0/3530490715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 0x563911181780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4744009ee0 tx=0x7f4744010740 comp rx=0 tx=0).stop 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f474affd640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47340b4ca0 0x7f47340b71b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f473c1036d0 tx=0x7f473c109d70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f4757c23740 1 -- 172.21.15.33:0/3530490715 shutdown_connections 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f4757c23740 1 --2- 172.21.15.33:0/3530490715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 0x563911182200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f4757c23740 1 --2- 172.21.15.33:0/3530490715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910db2490 0x563911181cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f4757c23740 1 --2- 172.21.15.33:0/3530490715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 0x563911181780 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.449+0000 7f4757c23740 1 -- 172.21.15.33:0/3530490715 >> 172.21.15.33:0/3530490715 conn(0x563910dcf740 msgr2=0x56391117f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 1 -- 172.21.15.33:0/3530490715 shutdown_connections 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 1 -- 172.21.15.33:0/3530490715 wait complete. 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 1 -- start start 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 1 Processor -- start 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910db2490 0x56391118cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910dba670 0x56391118d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910ddb350 0x563911199250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563910f49890 con 0x563910ddb350 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56391106d790 con 0x563910db2490 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56391118ff60 con 0x563910dba670 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.450+0000 7f4757c23740 10 client.0 _ll_register_callbacks cb 0x563910df2ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910ddb350 0x563911199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910ddb350 0x563911199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52726/0 (socket says 172.21.15.33:52726) 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474b7fe640 1 -- 172.21.15.33:0/1509546980 learned_addr learned my addr 172.21.15.33:0/1509546980 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474a7fc640 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910dba670 0x56391118d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474b7fe640 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910db2490 0x56391118cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474b7fe640 1 -- 172.21.15.33:0/1509546980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910dba670 msgr2=0x56391118d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474b7fe640 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910dba670 0x56391118d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474b7fe640 1 -- 172.21.15.33:0/1509546980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910db2490 msgr2=0x56391118cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474b7fe640 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910db2490 0x56391118cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474b7fe640 1 -- 172.21.15.33:0/1509546980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639110a4f30 con 0x563910ddb350 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f474b7fe640 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910ddb350 0x563911199250 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f4744005cc0 tx=0x7f47440059c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14755eb6f9655c89 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f472eff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f472eff5640 1 -- 172.21.15.33:0/1509546980 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744016030 con 0x563910ddb350 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f472eff5640 1 -- 172.21.15.33:0/1509546980 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f47440129e0 con 0x563910ddb350 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.451+0000 7f4757c23740 1 -- 172.21.15.33:0/1509546980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4744004d20 con 0x563910ddb350 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f472eff5640 1 -- 172.21.15.33:0/1509546980 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4744012be0 con 0x563910ddb350 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f4757c23740 10 client.17049 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:12.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f4757c23740 1 -- 172.21.15.33:0/1509546980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56391119bd90 con 0x563910ddb350 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f472eff5640 1 -- 172.21.15.33:0/1509546980 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4744004d20 con 0x563910ddb350 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f472eff5640 1 -- 172.21.15.33:0/1509546980 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f474400f040 con 0x563910ddb350 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f4757c23740 10 client.17049 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f4757c23740 10 client.17049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f4757c23740 20 client.17049 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f4757c23740 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563910d99cd0 0x56391119f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f4757c23740 4 client.17049 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f4757c23740 1 -- 172.21.15.33:0/1509546980 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639110f9540 con 0x563910d99cd0 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.452+0000 7f474a7fc640 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563910d99cd0 0x56391119f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.453+0000 7f472eff5640 10 client.17049 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.453+0000 7f474a7fc640 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563910d99cd0 0x56391119f0f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9094a564db9cde0b server_cookie=c741361ff78f6220 in_seq=0 out_seq=0 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f472eff5640 1 -- 172.21.15.33:0/1509546980 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639110f9540 con 0x563910d99cd0 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f472eff5640 10 client.17049 handle_command_reply: tid=0 2024-08-28T19:37:12.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 client.17049 shutdown 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 -- 172.21.15.33:0/1509546980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910ddb350 msgr2=0x563911199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910ddb350 0x563911199250 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f4744005cc0 tx=0x7f47440059c0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 -- 172.21.15.33:0/1509546980 shutdown_connections 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563910d99cd0 0x56391119f0f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910ddb350 0x563911199250 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910dba670 0x56391118d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 --2- 172.21.15.33:0/1509546980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910db2490 0x56391118cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f472eff5640 0 client.17049 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 -- 172.21.15.33:0/1509546980 >> 172.21.15.33:0/1509546980 conn(0x563910dcf740 msgr2=0x563911184960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 -- 172.21.15.33:0/1509546980 shutdown_connections 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 1 -- 172.21.15.33:0/1509546980 wait complete. 2024-08-28T19:37:12.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.454+0000 7f4757c23740 20 client.17049 trim_cache size 0 max 16384 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f4757c23740 1 Processor -- start 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f4757c23740 1 -- start start 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f4757c23740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910db2490 0x56391118ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f4757c23740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910dba670 0x563911182ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f4757c23740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 0x563911199150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f4757c23740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f474c1b0b40 con 0x563910db2490 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f4757c23740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f474c1b2680 con 0x563910dba670 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f4757c23740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f474c1b1210 con 0x563910ddb350 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910db2490 0x56391118ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f474b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910db2490 0x56391118ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52742/0 (socket says 172.21.15.33:52742) 2024-08-28T19:37:12.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f474b7fe640 1 -- 172.21.15.33:0/1841165607 learned_addr learned my addr 172.21.15.33:0/1841165607 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f474a7fc640 1 --2- 172.21.15.33:0/1841165607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910dba670 0x563911182ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.472+0000 7f474b7fe640 1 -- 172.21.15.33:0/1841165607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 msgr2=0x563911199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.473+0000 7f474b7fe640 1 --2- 172.21.15.33:0/1841165607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 0x563911199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.473+0000 7f474b7fe640 1 -- 172.21.15.33:0/1841165607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910dba670 msgr2=0x563911182ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.473+0000 7f474b7fe640 1 --2- 172.21.15.33:0/1841165607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910dba670 0x563911182ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.473+0000 7f474b7fe640 1 -- 172.21.15.33:0/1841165607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391118e210 con 0x563910db2490 2024-08-28T19:37:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.473+0000 7f474b7fe640 1 --2- 172.21.15.33:0/1841165607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910db2490 0x56391118ee30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f4744002230 tx=0x7f4744005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d164c79d19d5f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.473+0000 7f4730ff9640 1 -- 172.21.15.33:0/1841165607 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474403a070 con 0x563910db2490 2024-08-28T19:37:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.473+0000 7f4730ff9640 1 -- 172.21.15.33:0/1841165607 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f474401aaa0 con 0x563910db2490 2024-08-28T19:37:12.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.473+0000 7f4730ff9640 1 -- 172.21.15.33:0/1841165607 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744016040 con 0x563910db2490 2024-08-28T19:37:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 -- 172.21.15.33:0/1841165607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910db2490 msgr2=0x56391118ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 --2- 172.21.15.33:0/1841165607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910db2490 0x56391118ee30 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f4744002230 tx=0x7f4744005950 comp rx=0 tx=0).stop 2024-08-28T19:37:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 -- 172.21.15.33:0/1841165607 shutdown_connections 2024-08-28T19:37:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 --2- 172.21.15.33:0/1841165607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910ddb350 0x563911199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 --2- 172.21.15.33:0/1841165607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910dba670 0x563911182ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 --2- 172.21.15.33:0/1841165607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910db2490 0x56391118ee30 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 -- 172.21.15.33:0/1841165607 >> 172.21.15.33:0/1841165607 conn(0x563910dcf740 msgr2=0x5639111827b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 -- 172.21.15.33:0/1841165607 shutdown_connections 2024-08-28T19:37:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 -- 172.21.15.33:0/1841165607 wait complete. 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 -- start start 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 Processor -- start 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.474+0000 7f4757c23740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910db2490 0x563911195760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f4757c23740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 0x563911193c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f4757c23740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910ddb350 0x5639111941d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f4757c23740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f474c1b1fb0 con 0x563910dba670 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f4757c23740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f474c1b18e0 con 0x563910ddb350 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f4757c23740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f474c1aeb20 con 0x563910db2490 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f4757c23740 10 client.0 _ll_register_callbacks cb 0x7f474000c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 0x563911193c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 0x563911193c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52754/0 (socket says 172.21.15.33:52754) 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474a7fc640 1 -- 172.21.15.33:0/387488260 learned_addr learned my addr 172.21.15.33:0/387488260 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474b7fe640 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910ddb350 0x5639111941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474a7fc640 1 -- 172.21.15.33:0/387488260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910db2490 msgr2=0x563911195760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474a7fc640 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910db2490 0x563911195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474a7fc640 1 -- 172.21.15.33:0/387488260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910ddb350 msgr2=0x5639111941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474a7fc640 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910ddb350 0x5639111941d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474a7fc640 1 -- 172.21.15.33:0/387488260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563911194740 con 0x563910dba670 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474b7fe640 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910ddb350 0x5639111941d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f474a7fc640 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 0x563911193c90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f47400058c0 tx=0x7f4740010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71778e46fa8a88c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f472eff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f472eff5640 1 -- 172.21.15.33:0/387488260 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4740004020 con 0x563910dba670 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f4757c23740 1 -- 172.21.15.33:0/387488260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f474401aaa0 con 0x563910dba670 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f472eff5640 1 -- 172.21.15.33:0/387488260 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f47400041c0 con 0x563910dba670 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.475+0000 7f472eff5640 1 -- 172.21.15.33:0/387488260 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f474002d050 con 0x563910dba670 2024-08-28T19:37:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f4757c23740 10 client.17055 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f4757c23740 1 -- 172.21.15.33:0/387488260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56391120a760 con 0x563910dba670 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f472eff5640 1 -- 172.21.15.33:0/387488260 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f474401aaa0 con 0x563910dba670 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f472eff5640 1 -- 172.21.15.33:0/387488260 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f47400038c0 con 0x563910dba670 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f4757c23740 10 client.17055 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f4757c23740 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f4757c23740 20 client.17055 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f4757c23740 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563910d6f080 0x56391120cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f4757c23740 4 client.17055 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f4757c23740 1 -- 172.21.15.33:0/387488260 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5639110f4fe0 con 0x563910d6f080 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.476+0000 7f474b7fe640 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563910d6f080 0x56391120cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.477+0000 7f472eff5640 10 client.17055 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.477+0000 7f474b7fe640 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563910d6f080 0x56391120cec0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=210abbc50b30bb23 server_cookie=21a9964582eba66b in_seq=0 out_seq=0 2024-08-28T19:37:12.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.478+0000 7f472eff5640 1 -- 172.21.15.33:0/387488260 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5639110f4fe0 con 0x563910d6f080 2024-08-28T19:37:12.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.478+0000 7f472eff5640 10 client.17055 handle_command_reply: tid=0 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.478+0000 7f4757c23740 1 client.17055 shutdown 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.478+0000 7f4757c23740 1 -- 172.21.15.33:0/387488260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 msgr2=0x563911193c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.478+0000 7f4757c23740 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 0x563911193c90 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f47400058c0 tx=0x7f4740010af0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f4757c23740 1 -- 172.21.15.33:0/387488260 shutdown_connections 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f4757c23740 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563910ddb350 0x5639111941d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f4757c23740 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563910d6f080 0x56391120cec0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f4757c23740 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563910dba670 0x563911193c90 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f4757c23740 1 --2- 172.21.15.33:0/387488260 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563910db2490 0x563911195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f472eff5640 0 client.17055 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f4757c23740 1 -- 172.21.15.33:0/387488260 >> 172.21.15.33:0/387488260 conn(0x563910dcf740 msgr2=0x563911183150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f4757c23740 1 -- 172.21.15.33:0/387488260 shutdown_connections 2024-08-28T19:37:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f4757c23740 1 -- 172.21.15.33:0/387488260 wait complete. 2024-08-28T19:37:12.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f4757c23740 20 client.17055 trim_cache size 0 max 16384 2024-08-28T19:37:12.484 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:37:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:37:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "09273d72-a1bf-43d9-9144-716a0371f2ac", 2024-08-28T19:37:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:37:12.484 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:37:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f47516ae640 1 -- 172.21.15.33:0/3808345708 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47340b4ca0 msgr2=0x7f47340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f47516ae640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47340b4ca0 0x7f47340b71b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f473c1036d0 tx=0x7f473c109d70 comp rx=0 tx=0).stop 2024-08-28T19:37:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f47516ae640 1 -- 172.21.15.33:0/3808345708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c101d60 msgr2=0x7f474c19a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f47516ae640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c101d60 0x7f474c19a280 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f473c005940 tx=0x7f473c0042f0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f47516ae640 1 -- 172.21.15.33:0/3808345708 shutdown_connections 2024-08-28T19:37:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f47516ae640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f474c109bf0 0x7f474c19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f47516ae640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47340b4ca0 0x7f47340b71b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f47516ae640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f474c1092a0 0x7f474c19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f47516ae640 1 --2- 172.21.15.33:0/3808345708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f474c101d60 0x7f474c19a280 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.479+0000 7f47516ae640 1 -- 172.21.15.33:0/3808345708 >> 172.21.15.33:0/3808345708 conn(0x7f474c079d30 msgr2=0x7f474c1072f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:12.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.480+0000 7f47516ae640 1 -- 172.21.15.33:0/3808345708 shutdown_connections 2024-08-28T19:37:12.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:12.480+0000 7f47516ae640 1 -- 172.21.15.33:0/3808345708 wait complete. 2024-08-28T19:37:13.266 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:37:13.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:13 smithi033 ceph-mon[18549]: pgmap v485: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-08-28T19:37:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:13 smithi059 ceph-mon[22052]: pgmap v485: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-08-28T19:37:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:13 smithi122 ceph-mon[22174]: pgmap v485: 129 pgs: 129 active+clean; 4.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-08-28T19:37:14.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.093+0000 7fbff5757640 1 -- 172.21.15.33:0/303508122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbff01050b0 msgr2=0x7fbff010d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.093+0000 7fbff5757640 1 --2- 172.21.15.33:0/303508122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbff01050b0 0x7fbff010d6f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009900 tx=0x7fbfe402a410 comp rx=0 tx=0).stop 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.093+0000 7fbff5757640 1 -- 172.21.15.33:0/303508122 shutdown_connections 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.093+0000 7fbff5757640 1 --2- 172.21.15.33:0/303508122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbff010dc30 0x7fbff01100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.093+0000 7fbff5757640 1 --2- 172.21.15.33:0/303508122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbff01050b0 0x7fbff010d6f0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.093+0000 7fbff5757640 1 --2- 172.21.15.33:0/303508122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff0104680 0x7fbff0104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.093+0000 7fbff5757640 1 -- 172.21.15.33:0/303508122 >> 172.21.15.33:0/303508122 conn(0x7fbff0079500 msgr2=0x7fbff0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.093+0000 7fbff5757640 1 -- 172.21.15.33:0/303508122 shutdown_connections 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.093+0000 7fbff5757640 1 -- 172.21.15.33:0/303508122 wait complete. 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.093+0000 7fbff5757640 1 Processor -- start 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbff5757640 1 -- start start 2024-08-28T19:37:14.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbff5757640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbff0104680 0x7fbff019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbff5757640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbff01050b0 0x7fbff019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbff5757640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff010dc30 0x7fbff019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbff5757640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbff0113840 con 0x7fbff01050b0 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbff5757640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbff01136c0 con 0x7fbff0104680 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbff5757640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbff01139c0 con 0x7fbff010dc30 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbfee7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbff01050b0 0x7fbff019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbfee7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbff01050b0 0x7fbff019a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52782/0 (socket says 172.21.15.33:52782) 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbfee7fc640 1 -- 172.21.15.33:0/1196178745 learned_addr learned my addr 172.21.15.33:0/1196178745 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbfeeffd640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbff0104680 0x7fbff019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff010dc30 0x7fbff019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbfee7fc640 1 -- 172.21.15.33:0/1196178745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff010dc30 msgr2=0x7fbff019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:14.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff010dc30 0x7fbff019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbfee7fc640 1 -- 172.21.15.33:0/1196178745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbff0104680 msgr2=0x7fbff019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbff0104680 0x7fbff019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.094+0000 7fbfee7fc640 1 -- 172.21.15.33:0/1196178745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff01a00e0 con 0x7fbff01050b0 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.095+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbff01050b0 0x7fbff019a7d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbfe402a930 tx=0x7fbfe4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.095+0000 7fbfd7fff640 1 -- 172.21.15.33:0/1196178745 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe403f030 con 0x7fbff01050b0 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.095+0000 7fbff5757640 1 -- 172.21.15.33:0/1196178745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff01a0370 con 0x7fbff01050b0 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.095+0000 7fbfd7fff640 1 -- 172.21.15.33:0/1196178745 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfe4003aa0 con 0x7fbff01050b0 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.095+0000 7fbfd7fff640 1 -- 172.21.15.33:0/1196178745 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4035070 con 0x7fbff01050b0 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.095+0000 7fbff5757640 1 -- 172.21.15.33:0/1196178745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff01a08a0 con 0x7fbff01050b0 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.097+0000 7fbfd7fff640 1 -- 172.21.15.33:0/1196178745 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbfe4042030 con 0x7fbff01050b0 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.098+0000 7fbffbccc740 1 Processor -- start 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.098+0000 7fbffbccc740 1 -- start start 2024-08-28T19:37:14.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.098+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfe6070 0x55b21c38b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.098+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfbd1b0 0x55b21c38b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.098+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c38bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.098+0000 7fbffbccc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b21c302630 con 0x55b21bfc5390 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.098+0000 7fbffbccc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b21c2f1bc0 con 0x55b21bfbd1b0 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.098+0000 7fbffbccc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b21c2f5b70 con 0x55b21bfe6070 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.098+0000 7fbfee7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c38bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.098+0000 7fbfee7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c38bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52796/0 (socket says 172.21.15.33:52796) 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfee7fc640 1 -- 172.21.15.33:0/4287780900 learned_addr learned my addr 172.21.15.33:0/4287780900 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfd7fff640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbfd80b4cd0 0x7fbfd80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfeeffd640 1 --2- 172.21.15.33:0/4287780900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfbd1b0 0x55b21c38b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/4287780900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfe6070 0x55b21c38b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbfd80b4cd0 0x7fbfd80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfd7fff640 1 -- 172.21.15.33:0/1196178745 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fbfe4105bc0 con 0x7fbff01050b0 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfee7fc640 1 -- 172.21.15.33:0/4287780900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfe6070 msgr2=0x55b21c38b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/4287780900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfe6070 0x55b21c38b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfee7fc640 1 -- 172.21.15.33:0/4287780900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfbd1b0 msgr2=0x55b21c38b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/4287780900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfbd1b0 0x55b21c38b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfee7fc640 1 -- 172.21.15.33:0/4287780900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b21c051650 con 0x55b21bfc5390 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/4287780900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfe6070 0x55b21c38b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/4287780900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c38bd40 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40c9220 tx=0x7fbfe4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab774b479c37a1a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbfd80b4cd0 0x7fbfd80b71e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8005fd0 tx=0x7fbfe8009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.099+0000 7fbfd57fa640 1 -- 172.21.15.33:0/4287780900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4049070 con 0x55b21bfc5390 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbfd57fa640 1 -- 172.21.15.33:0/4287780900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfe40cbfb0 con 0x55b21bfc5390 2024-08-28T19:37:14.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbfd57fa640 1 -- 172.21.15.33:0/4287780900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe41031e0 con 0x55b21bfc5390 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbffbccc740 1 -- 172.21.15.33:0/4287780900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 msgr2=0x55b21c38bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbffbccc740 1 --2- 172.21.15.33:0/4287780900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c38bd40 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40c9220 tx=0x7fbfe4000bc0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbffbccc740 1 -- 172.21.15.33:0/4287780900 shutdown_connections 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbffbccc740 1 --2- 172.21.15.33:0/4287780900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c38bd40 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbffbccc740 1 --2- 172.21.15.33:0/4287780900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfbd1b0 0x55b21c38b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbffbccc740 1 --2- 172.21.15.33:0/4287780900 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfe6070 0x55b21c38b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbffbccc740 1 -- 172.21.15.33:0/4287780900 >> 172.21.15.33:0/4287780900 conn(0x55b21bfda460 msgr2=0x55b21c3891b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbffbccc740 1 -- 172.21.15.33:0/4287780900 shutdown_connections 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.100+0000 7fbffbccc740 1 -- 172.21.15.33:0/4287780900 wait complete. 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbffbccc740 1 -- start start 2024-08-28T19:37:14.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbffbccc740 1 Processor -- start 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfbd1b0 0x55b21c396a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfc5390 0x55b21c396f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c3a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbffbccc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b21c154700 con 0x55b21bfe6070 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbffbccc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b21c278700 con 0x55b21bfbd1b0 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbffbccc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b21c302630 con 0x55b21bfc5390 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbffbccc740 10 client.0 _ll_register_callbacks cb 0x55b21c2a7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbfef7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c3a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbfef7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c3a2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52800/0 (socket says 172.21.15.33:52800) 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.101+0000 7fbfef7fe640 1 -- 172.21.15.33:0/813779660 learned_addr learned my addr 172.21.15.33:0/813779660 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfeeffd640 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfbd1b0 0x55b21c396a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfc5390 0x55b21c396f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfef7fe640 1 -- 172.21.15.33:0/813779660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfc5390 msgr2=0x55b21c396f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:14.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfc5390 0x55b21c396f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfef7fe640 1 -- 172.21.15.33:0/813779660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfbd1b0 msgr2=0x55b21c396a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfbd1b0 0x55b21c396a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfef7fe640 1 -- 172.21.15.33:0/813779660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b21c2b18b0 con 0x55b21bfe6070 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c3a2a00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800ff40 tx=0x7fbfe8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f7285f3d1bfa52 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfd2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/813779660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8010d60 con 0x55b21bfe6070 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/813779660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fbfe8004b20 con 0x55b21bfe6070 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbffbccc740 1 -- 172.21.15.33:0/813779660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfe40cbfb0 con 0x55b21bfe6070 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.102+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/813779660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbfe8031050 con 0x55b21bfe6070 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbffbccc740 10 client.17067 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbffbccc740 1 -- 172.21.15.33:0/813779660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b21c3a5520 con 0x55b21bfe6070 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/813779660 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfe40cbfb0 con 0x55b21bfe6070 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/813779660 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbfe800f040 con 0x55b21bfe6070 2024-08-28T19:37:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbffbccc740 10 client.17067 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbffbccc740 10 client.17067 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbffbccc740 20 client.17067 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbffbccc740 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b21bfa49f0 0x55b21c3a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbffbccc740 4 client.17067 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbffbccc740 1 -- 172.21.15.33:0/813779660 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b21c304580 con 0x55b21bfa49f0 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.103+0000 7fbfeeffd640 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b21bfa49f0 0x55b21c3a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.104+0000 7fbfd2ff5640 10 client.17067 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.104+0000 7fbfeeffd640 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b21bfa49f0 0x55b21c3a8a80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e04bfc8bb8361b08 server_cookie=ef8cbe59c41adbdf in_seq=0 out_seq=0 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.104+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/813779660 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b21c304580 con 0x55b21bfa49f0 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.104+0000 7fbfd2ff5640 10 client.17067 handle_command_reply: tid=0 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 client.17067 shutdown 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 -- 172.21.15.33:0/813779660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 msgr2=0x55b21c3a2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c3a2a00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800ff40 tx=0x7fbfe8004a40 comp rx=0 tx=0).stop 2024-08-28T19:37:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 -- 172.21.15.33:0/813779660 shutdown_connections 2024-08-28T19:37:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b21bfa49f0 0x55b21c3a8a80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c3a2a00 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfc5390 0x55b21c396f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 --2- 172.21.15.33:0/813779660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfbd1b0 0x55b21c396a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbfd2ff5640 0 client.17067 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 -- 172.21.15.33:0/813779660 >> 172.21.15.33:0/813779660 conn(0x55b21bfda460 msgr2=0x55b21c38e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 -- 172.21.15.33:0/813779660 shutdown_connections 2024-08-28T19:37:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 1 -- 172.21.15.33:0/813779660 wait complete. 2024-08-28T19:37:14.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.105+0000 7fbffbccc740 20 client.17067 trim_cache size 0 max 16384 2024-08-28T19:37:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.123+0000 7fbffbccc740 1 Processor -- start 2024-08-28T19:37:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.123+0000 7fbffbccc740 1 -- start start 2024-08-28T19:37:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.123+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfbd1b0 0x55b21c38ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.123+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfc5390 0x55b21c393c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.123+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c394150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.123+0000 7fbffbccc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbff01b0ad0 con 0x55b21bfe6070 2024-08-28T19:37:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.123+0000 7fbffbccc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbff01b2610 con 0x55b21bfc5390 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.123+0000 7fbffbccc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbff01b11a0 con 0x55b21bfbd1b0 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfef7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c394150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfef7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c394150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52812/0 (socket says 172.21.15.33:52812) 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfef7fe640 1 -- 172.21.15.33:0/836695483 learned_addr learned my addr 172.21.15.33:0/836695483 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfeeffd640 1 --2- 172.21.15.33:0/836695483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfbd1b0 0x55b21c38ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/836695483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfc5390 0x55b21c393c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfef7fe640 1 -- 172.21.15.33:0/836695483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfbd1b0 msgr2=0x55b21c38ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/836695483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfbd1b0 0x55b21c38ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfef7fe640 1 -- 172.21.15.33:0/836695483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfc5390 msgr2=0x55b21c393c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/836695483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfc5390 0x55b21c393c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfef7fe640 1 -- 172.21.15.33:0/836695483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b21c395980 con 0x55b21bfe6070 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/836695483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c394150 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8012440 tx=0x7fbfe8009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4f27923022cd22 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfd4ff9640 1 -- 172.21.15.33:0/836695483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8012c80 con 0x55b21bfe6070 2024-08-28T19:37:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfd4ff9640 1 -- 172.21.15.33:0/836695483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfe8028930 con 0x55b21bfe6070 2024-08-28T19:37:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.124+0000 7fbfd4ff9640 1 -- 172.21.15.33:0/836695483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe801f780 con 0x55b21bfe6070 2024-08-28T19:37:14.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.125+0000 7fbffbccc740 1 -- 172.21.15.33:0/836695483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 msgr2=0x55b21c394150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.125+0000 7fbffbccc740 1 --2- 172.21.15.33:0/836695483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c394150 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8012440 tx=0x7fbfe8009670 comp rx=0 tx=0).stop 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.125+0000 7fbffbccc740 1 -- 172.21.15.33:0/836695483 shutdown_connections 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.125+0000 7fbffbccc740 1 --2- 172.21.15.33:0/836695483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfe6070 0x55b21c394150 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.125+0000 7fbffbccc740 1 --2- 172.21.15.33:0/836695483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfc5390 0x55b21c393c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.125+0000 7fbffbccc740 1 --2- 172.21.15.33:0/836695483 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfbd1b0 0x55b21c38ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.125+0000 7fbffbccc740 1 -- 172.21.15.33:0/836695483 >> 172.21.15.33:0/836695483 conn(0x55b21bfda460 msgr2=0x55b21c38e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.125+0000 7fbffbccc740 1 -- 172.21.15.33:0/836695483 shutdown_connections 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.125+0000 7fbffbccc740 1 -- 172.21.15.33:0/836695483 wait complete. 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbffbccc740 1 -- start start 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbffbccc740 1 Processor -- start 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfbd1b0 0x55b21c39f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c39b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbffbccc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfe6070 0x55b21c39ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbffbccc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbff01b1f40 con 0x55b21bfc5390 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbffbccc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbff01b1870 con 0x55b21bfe6070 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbffbccc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbff01aeab0 con 0x55b21bfbd1b0 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbffbccc740 10 client.0 _ll_register_callbacks cb 0x7fbfe8009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbfee7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c39b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbfee7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c39b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52824/0 (socket says 172.21.15.33:52824) 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbfee7fc640 1 -- 172.21.15.33:0/2648528820 learned_addr learned my addr 172.21.15.33:0/2648528820 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.126+0000 7fbfef7fe640 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfe6070 0x55b21c39ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfeeffd640 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfbd1b0 0x55b21c39f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfee7fc640 1 -- 172.21.15.33:0/2648528820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfbd1b0 msgr2=0x55b21c39f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfbd1b0 0x55b21c39f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfee7fc640 1 -- 172.21.15.33:0/2648528820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfe6070 msgr2=0x55b21c39ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfe6070 0x55b21c39ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfee7fc640 1 -- 172.21.15.33:0/2648528820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b21c39c0a0 con 0x55b21bfc5390 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfee7fc640 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c39b4f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40c7fe0 tx=0x7fbfe40cb820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33a80961eb8a1fb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfd2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/2648528820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4049040 con 0x55b21bfc5390 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/2648528820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fbfe41031e0 con 0x55b21bfc5390 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbffbccc740 1 -- 172.21.15.33:0/2648528820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfe8028930 con 0x55b21bfc5390 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/2648528820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbfe41033e0 con 0x55b21bfc5390 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbffbccc740 10 client.17073 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbffbccc740 1 -- 172.21.15.33:0/2648528820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b21c4142d0 con 0x55b21bfc5390 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.127+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/2648528820 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfe8028930 con 0x55b21bfc5390 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.128+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/2648528820 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbfe40d03d0 con 0x55b21bfc5390 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.128+0000 7fbffbccc740 10 client.17073 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.128+0000 7fbffbccc740 10 client.17073 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.128+0000 7fbffbccc740 20 client.17073 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.128+0000 7fbffbccc740 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b21bf79da0 0x55b21c4167e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.128+0000 7fbffbccc740 4 client.17073 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.128+0000 7fbffbccc740 1 -- 172.21.15.33:0/2648528820 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b21c300020 con 0x55b21bf79da0 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.128+0000 7fbfeeffd640 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b21bf79da0 0x55b21c4167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbfeeffd640 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b21bf79da0 0x55b21c4167e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28f36d766761f50f server_cookie=b97b566a3ae245bc in_seq=0 out_seq=0 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbfd2ff5640 10 client.17073 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbfd2ff5640 1 -- 172.21.15.33:0/2648528820 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x55b21c300020 con 0x55b21bf79da0 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbfd2ff5640 10 client.17073 handle_command_reply: tid=0 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbffbccc740 1 client.17073 shutdown 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbffbccc740 1 -- 172.21.15.33:0/2648528820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 msgr2=0x55b21c39b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbffbccc740 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c39b4f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40c7fe0 tx=0x7fbfe40cb820 comp rx=0 tx=0).stop 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbffbccc740 1 -- 172.21.15.33:0/2648528820 shutdown_connections 2024-08-28T19:37:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbffbccc740 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b21bfe6070 0x55b21c39ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbffbccc740 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b21bf79da0 0x55b21c4167e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbffbccc740 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b21bfc5390 0x55b21c39b4f0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbffbccc740 1 --2- 172.21.15.33:0/2648528820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b21bfbd1b0 0x55b21c39f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbffbccc740 1 -- 172.21.15.33:0/2648528820 >> 172.21.15.33:0/2648528820 conn(0x55b21bfda460 msgr2=0x55b21c38c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbfd2ff5640 0 client.17073 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.129+0000 7fbffbccc740 1 -- 172.21.15.33:0/2648528820 shutdown_connections 2024-08-28T19:37:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbffbccc740 1 -- 172.21.15.33:0/2648528820 wait complete. 2024-08-28T19:37:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbffbccc740 20 client.17073 trim_cache size 0 max 16384 2024-08-28T19:37:14.135 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:37:14.135 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "09273d72-a1bf-43d9-9144-716a0371f2ac", 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:14.136 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:14.137 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:37:14.138 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:14.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:14.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:14.141 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:37:14.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 -- 172.21.15.33:0/1196178745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbfd80b4cd0 msgr2=0x7fbfd80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:14.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbfd80b4cd0 0x7fbfd80b71e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8005fd0 tx=0x7fbfe8009600 comp rx=0 tx=0).stop 2024-08-28T19:37:14.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 -- 172.21.15.33:0/1196178745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbff01050b0 msgr2=0x7fbff019a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:14.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbff01050b0 0x7fbff019a7d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbfe402a930 tx=0x7fbfe4004270 comp rx=0 tx=0).stop 2024-08-28T19:37:14.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 -- 172.21.15.33:0/1196178745 shutdown_connections 2024-08-28T19:37:14.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbfd80b4cd0 0x7fbfd80b71e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbff010dc30 0x7fbff019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbff01050b0 0x7fbff019a7d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 --2- 172.21.15.33:0/1196178745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbff0104680 0x7fbff019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:14.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 -- 172.21.15.33:0/1196178745 >> 172.21.15.33:0/1196178745 conn(0x7fbff0079500 msgr2=0x7fbff0100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:14.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 -- 172.21.15.33:0/1196178745 shutdown_connections 2024-08-28T19:37:14.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:14.130+0000 7fbff5757640 1 -- 172.21.15.33:0/1196178745 wait complete. 2024-08-28T19:37:14.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:14 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:37:14.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:14 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:14.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:14 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:37:14.381 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:14 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:14.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:14 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:37:14.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:14 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:14.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:14 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:37:14.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:14 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:14.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:14 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:37:14.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:14 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:14.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:14 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:37:14.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:14 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:37:15.003 INFO:tasks.cephfs.filesystem:scrub status for tag:09273d72-a1bf-43d9-9144-716a0371f2ac - {'path': '/', 'tag': '09273d72-a1bf-43d9-9144-716a0371f2ac', 'options': 'recursive,force'} 2024-08-28T19:37:15.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:15 smithi033 ceph-mon[18549]: pgmap v486: 129 pgs: 129 active+clean; 4.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 68 KiB/s wr, 34 op/s 2024-08-28T19:37:15.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:15 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:37:15.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:15 smithi059 ceph-mon[22052]: pgmap v486: 129 pgs: 129 active+clean; 4.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 68 KiB/s wr, 34 op/s 2024-08-28T19:37:15.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:15 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:37:15.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:15 smithi122 ceph-mon[22174]: pgmap v486: 129 pgs: 129 active+clean; 4.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 68 KiB/s wr, 34 op/s 2024-08-28T19:37:15.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:15 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:37:17.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:17 smithi059 ceph-mon[22052]: pgmap v487: 129 pgs: 129 active+clean; 4.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-08-28T19:37:17.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:17 smithi122 ceph-mon[22174]: pgmap v487: 129 pgs: 129 active+clean; 4.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-08-28T19:37:17.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:17 smithi033 ceph-mon[18549]: pgmap v487: 129 pgs: 129 active+clean; 4.9 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-08-28T19:37:19.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:19 smithi059 ceph-mon[22052]: pgmap v488: 129 pgs: 129 active+clean; 5.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 17 op/s 2024-08-28T19:37:19.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:19 smithi122 ceph-mon[22174]: pgmap v488: 129 pgs: 129 active+clean; 5.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 17 op/s 2024-08-28T19:37:19.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:19 smithi033 ceph-mon[18549]: pgmap v488: 129 pgs: 129 active+clean; 5.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 17 op/s 2024-08-28T19:37:21.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:21 smithi059 ceph-mon[22052]: pgmap v489: 129 pgs: 129 active+clean; 5.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-08-28T19:37:21.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:21 smithi122 ceph-mon[22174]: pgmap v489: 129 pgs: 129 active+clean; 5.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-08-28T19:37:21.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:21 smithi033 ceph-mon[18549]: pgmap v489: 129 pgs: 129 active+clean; 5.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-08-28T19:37:23.432 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:23 smithi033 ceph-mon[18549]: pgmap v490: 129 pgs: 129 active+clean; 5.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:23.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:23 smithi059 ceph-mon[22052]: pgmap v490: 129 pgs: 129 active+clean; 5.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:23.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:23 smithi122 ceph-mon[22174]: pgmap v490: 129 pgs: 129 active+clean; 5.1 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:25.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:25 smithi059 ceph-mon[22052]: pgmap v491: 129 pgs: 129 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 19 op/s 2024-08-28T19:37:25.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:25 smithi122 ceph-mon[22174]: pgmap v491: 129 pgs: 129 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 19 op/s 2024-08-28T19:37:25.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:25 smithi033 ceph-mon[18549]: pgmap v491: 129 pgs: 129 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 19 op/s 2024-08-28T19:37:27.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:27 smithi059 ceph-mon[22052]: pgmap v492: 129 pgs: 129 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:27.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:27 smithi122 ceph-mon[22174]: pgmap v492: 129 pgs: 129 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:27.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:27 smithi033 ceph-mon[18549]: pgmap v492: 129 pgs: 129 active+clean; 5.2 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:29.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:29 smithi059 ceph-mon[22052]: pgmap v493: 129 pgs: 129 active+clean; 5.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 17 op/s 2024-08-28T19:37:29.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:29 smithi122 ceph-mon[22174]: pgmap v493: 129 pgs: 129 active+clean; 5.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 17 op/s 2024-08-28T19:37:29.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:29 smithi033 ceph-mon[18549]: pgmap v493: 129 pgs: 129 active+clean; 5.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 17 op/s 2024-08-28T19:37:31.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:31 smithi059 ceph-mon[22052]: pgmap v494: 129 pgs: 129 active+clean; 5.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-08-28T19:37:31.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:31 smithi122 ceph-mon[22174]: pgmap v494: 129 pgs: 129 active+clean; 5.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-08-28T19:37:31.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:31 smithi033 ceph-mon[18549]: pgmap v494: 129 pgs: 129 active+clean; 5.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-08-28T19:37:33.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:33 smithi059 ceph-mon[22052]: pgmap v495: 129 pgs: 129 active+clean; 5.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:33.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:33 smithi122 ceph-mon[22174]: pgmap v495: 129 pgs: 129 active+clean; 5.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:33.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:33 smithi033 ceph-mon[18549]: pgmap v495: 129 pgs: 129 active+clean; 5.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:35.294 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-28T19:37:35.294 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-28T19:37:35.294 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:37:35.562 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:35.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:35 smithi033 ceph-mon[18549]: pgmap v496: 129 pgs: 129 active+clean; 5.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 19 op/s 2024-08-28T19:37:35.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:35 smithi059 ceph-mon[22052]: pgmap v496: 129 pgs: 129 active+clean; 5.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 19 op/s 2024-08-28T19:37:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:35 smithi122 ceph-mon[22174]: pgmap v496: 129 pgs: 129 active+clean; 5.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 19 op/s 2024-08-28T19:37:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.069+0000 7effb93a0640 1 -- 172.21.15.33:0/2456348486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effb4109bb0 msgr2=0x7effb41103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.069+0000 7effb93a0640 1 --2- 172.21.15.33:0/2456348486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effb4109bb0 0x7effb41103e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7effac009ca0 tx=0x7effac02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.070+0000 7effb93a0640 1 -- 172.21.15.33:0/2456348486 shutdown_connections 2024-08-28T19:37:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.070+0000 7effb93a0640 1 --2- 172.21.15.33:0/2456348486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effb4109bb0 0x7effb41103e0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.070+0000 7effb93a0640 1 --2- 172.21.15.33:0/2456348486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb4109260 0x7effb4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.070+0000 7effb93a0640 1 --2- 172.21.15.33:0/2456348486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb4103920 0x7effb4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.070+0000 7effb93a0640 1 -- 172.21.15.33:0/2456348486 >> 172.21.15.33:0/2456348486 conn(0x7effb40ff330 msgr2=0x7effb4101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.070+0000 7effb93a0640 1 -- 172.21.15.33:0/2456348486 shutdown_connections 2024-08-28T19:37:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.070+0000 7effb93a0640 1 -- 172.21.15.33:0/2456348486 wait complete. 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.070+0000 7effb93a0640 1 Processor -- start 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.070+0000 7effb93a0640 1 -- start start 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb93a0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb4103920 0x7effb419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb93a0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effb4109260 0x7effb419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb93a0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb4109bb0 0x7effb419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb93a0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7effb4113870 con 0x7effb4109260 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb93a0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7effb41136f0 con 0x7effb4103920 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb93a0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7effb41139f0 con 0x7effb4109bb0 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb27fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effb4109260 0x7effb419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb27fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effb4109260 0x7effb419a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49978/0 (socket says 172.21.15.33:49978) 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb27fc640 1 -- 172.21.15.33:0/1976750327 learned_addr learned my addr 172.21.15.33:0/1976750327 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb2ffd640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb4103920 0x7effb419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb37fe640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb4109bb0 0x7effb419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb27fc640 1 -- 172.21.15.33:0/1976750327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb4109bb0 msgr2=0x7effb419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb27fc640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb4109bb0 0x7effb419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb27fc640 1 -- 172.21.15.33:0/1976750327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb4103920 msgr2=0x7effb419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb27fc640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb4103920 0x7effb419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.071+0000 7effb27fc640 1 -- 172.21.15.33:0/1976750327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb41a0150 con 0x7effb4109260 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.072+0000 7effb27fc640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effb4109260 0x7effb419a780 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7effa800e9f0 tx=0x7effa800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.072+0000 7eff9bfff640 1 -- 172.21.15.33:0/1976750327 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa800ccc0 con 0x7effb4109260 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.072+0000 7effb93a0640 1 -- 172.21.15.33:0/1976750327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb41a0440 con 0x7effb4109260 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.072+0000 7eff9bfff640 1 -- 172.21.15.33:0/1976750327 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effa80108e0 con 0x7effb4109260 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.072+0000 7eff9bfff640 1 -- 172.21.15.33:0/1976750327 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8018860 con 0x7effb4109260 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.072+0000 7effb93a0640 1 -- 172.21.15.33:0/1976750327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb41a6ba0 con 0x7effb4109260 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.073+0000 7effb93a0640 1 -- 172.21.15.33:0/1976750327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb4103d30 con 0x7effb4109260 2024-08-28T19:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.075+0000 7eff9bfff640 1 -- 172.21.15.33:0/1976750327 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7effa8010430 con 0x7effb4109260 2024-08-28T19:37:36.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.076+0000 7eff9bfff640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff9c0b4ca0 0x7eff9c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:36.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.076+0000 7effb2ffd640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff9c0b4ca0 0x7eff9c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:36.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.076+0000 7eff9bfff640 1 -- 172.21.15.33:0/1976750327 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7effa80e5b20 con 0x7effb4109260 2024-08-28T19:37:36.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.076+0000 7effb2ffd640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff9c0b4ca0 0x7eff9c0b71b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7effa4009bd0 tx=0x7effa4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:36.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.080+0000 7eff9bfff640 1 -- 172.21.15.33:0/1976750327 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7effa80abf70 con 0x7effb4109260 2024-08-28T19:37:36.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.317+0000 7effb93a0640 1 -- 172.21.15.33:0/1976750327 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effb410b9a0 con 0x7effb4109260 2024-08-28T19:37:36.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.318+0000 7eff9bfff640 1 -- 172.21.15.33:0/1976750327 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7effa80b0730 con 0x7effb4109260 2024-08-28T19:37:36.320 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:37:36.321 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:37:36.321 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:37:36.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 -- 172.21.15.33:0/1976750327 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff9c0b4ca0 msgr2=0x7eff9c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:36.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff9c0b4ca0 0x7eff9c0b71b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7effa4009bd0 tx=0x7effa4005f90 comp rx=0 tx=0).stop 2024-08-28T19:37:36.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 -- 172.21.15.33:0/1976750327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effb4109260 msgr2=0x7effb419a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:36.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effb4109260 0x7effb419a780 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7effa800e9f0 tx=0x7effa800eeb0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 -- 172.21.15.33:0/1976750327 shutdown_connections 2024-08-28T19:37:36.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff9c0b4ca0 0x7eff9c0b71b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effb4109bb0 0x7effb419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effb4109260 0x7effb419a780 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 --2- 172.21.15.33:0/1976750327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effb4103920 0x7effb419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:36.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 -- 172.21.15.33:0/1976750327 >> 172.21.15.33:0/1976750327 conn(0x7effb40ff330 msgr2=0x7effb4102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:36.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 -- 172.21.15.33:0/1976750327 shutdown_connections 2024-08-28T19:37:36.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:36.321+0000 7effb93a0640 1 -- 172.21.15.33:0/1976750327 wait complete. 2024-08-28T19:37:36.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:36 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1976750327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:37:36.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:36 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1976750327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:37:36.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:36 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1976750327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:37:37.028 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-28T19:37:37.028 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-28T19:37:37.287 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:37.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:37 smithi033 ceph-mon[18549]: pgmap v497: 129 pgs: 129 active+clean; 5.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-08-28T19:37:37.695 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:37 smithi122 ceph-mon[22174]: pgmap v497: 129 pgs: 129 active+clean; 5.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-08-28T19:37:37.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:37 smithi059 ceph-mon[22052]: pgmap v497: 129 pgs: 129 active+clean; 5.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-08-28T19:37:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.796+0000 7f9d7b245640 1 -- 172.21.15.33:0/2005775593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d74104680 msgr2=0x7f9d74104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.796+0000 7f9d7b245640 1 --2- 172.21.15.33:0/2005775593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d74104680 0x7f9d74104a90 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009900 tx=0x7f9d6802a410 comp rx=0 tx=0).stop 2024-08-28T19:37:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.797+0000 7f9d7b245640 1 -- 172.21.15.33:0/2005775593 shutdown_connections 2024-08-28T19:37:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.797+0000 7f9d7b245640 1 --2- 172.21.15.33:0/2005775593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7410dc30 0x7f9d741100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.797+0000 7f9d7b245640 1 --2- 172.21.15.33:0/2005775593 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d741050b0 0x7f9d7410d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.797+0000 7f9d7b245640 1 --2- 172.21.15.33:0/2005775593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d74104680 0x7f9d74104a90 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.797+0000 7f9d7b245640 1 -- 172.21.15.33:0/2005775593 >> 172.21.15.33:0/2005775593 conn(0x7f9d74079660 msgr2=0x7f9d74079a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.797+0000 7f9d7b245640 1 -- 172.21.15.33:0/2005775593 shutdown_connections 2024-08-28T19:37:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.797+0000 7f9d7b245640 1 -- 172.21.15.33:0/2005775593 wait complete. 2024-08-28T19:37:37.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d7b245640 1 Processor -- start 2024-08-28T19:37:37.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d7b245640 1 -- start start 2024-08-28T19:37:37.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d7b245640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d74104680 0x7f9d7419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d7b245640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d741050b0 0x7f9d7419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d7b245640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7410dc30 0x7f9d7419f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d7b245640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74113840 con 0x7f9d7410dc30 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d7b245640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741136c0 con 0x7f9d74104680 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d7b245640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741139c0 con 0x7f9d741050b0 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d797e2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7410dc30 0x7f9d7419f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d797e2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7410dc30 0x7f9d7419f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50004/0 (socket says 172.21.15.33:50004) 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d797e2640 1 -- 172.21.15.33:0/2003350711 learned_addr learned my addr 172.21.15.33:0/2003350711 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d74104680 0x7f9d7419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.798+0000 7f9d73fff640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d741050b0 0x7f9d7419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d797e2640 1 -- 172.21.15.33:0/2003350711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d741050b0 msgr2=0x7f9d7419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d797e2640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d741050b0 0x7f9d7419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d797e2640 1 -- 172.21.15.33:0/2003350711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d74104680 msgr2=0x7f9d7419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d797e2640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d74104680 0x7f9d7419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d797e2640 1 -- 172.21.15.33:0/2003350711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d741a0060 con 0x7f9d7410dc30 2024-08-28T19:37:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d797e2640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7410dc30 0x7f9d7419f9f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00eaa0 tx=0x7f9d6c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d71ffb640 1 -- 172.21.15.33:0/2003350711 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c004d20 con 0x7f9d7410dc30 2024-08-28T19:37:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d7b245640 1 -- 172.21.15.33:0/2003350711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d741a0350 con 0x7f9d7410dc30 2024-08-28T19:37:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d71ffb640 1 -- 172.21.15.33:0/2003350711 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d6c005020 con 0x7f9d7410dc30 2024-08-28T19:37:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d71ffb640 1 -- 172.21.15.33:0/2003350711 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c0116b0 con 0x7f9d7410dc30 2024-08-28T19:37:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.799+0000 7f9d7b245640 1 -- 172.21.15.33:0/2003350711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d741a6b70 con 0x7f9d7410dc30 2024-08-28T19:37:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.802+0000 7f9d817ba740 1 Processor -- start 2024-08-28T19:37:37.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.802+0000 7f9d71ffb640 1 -- 172.21.15.33:0/2003350711 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9d6c011850 con 0x7f9d7410dc30 2024-08-28T19:37:37.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.802+0000 7f9d817ba740 1 -- start start 2024-08-28T19:37:37.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.802+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 0x563c1d09fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.802+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.802+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccd7b60 0x563c1d0a0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.802+0000 7f9d817ba740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563c1d014330 con 0x563c1cccf980 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.802+0000 7f9d817ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563c1d0038c0 con 0x563c1ccd7b60 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.802+0000 7f9d817ba740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563c1d007870 con 0x563c1ccf8840 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d78fe1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d78fe1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50020/0 (socket says 172.21.15.33:50020) 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d78fe1640 1 -- 172.21.15.33:0/2328935493 learned_addr learned my addr 172.21.15.33:0/2328935493 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d73fff640 1 --2- 172.21.15.33:0/2328935493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 0x563c1d09fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d73fff640 1 --2- 172.21.15.33:0/2328935493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccd7b60 0x563c1d0a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d71ffb640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d640b4cd0 0x7f9d640b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d78fe1640 1 -- 172.21.15.33:0/2328935493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 msgr2=0x563c1d09fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d797e2640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d640b4cd0 0x7f9d640b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/2328935493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 0x563c1d09fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d78fe1640 1 -- 172.21.15.33:0/2328935493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccd7b60 msgr2=0x563c1d0a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:37.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/2328935493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccd7b60 0x563c1d0a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d78fe1640 1 -- 172.21.15.33:0/2328935493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c1cfbbdf0 con 0x563c1cccf980 2024-08-28T19:37:37.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d73fff640 1 --2- 172.21.15.33:0/2328935493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 0x563c1d09fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:37:37.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d71ffb640 1 -- 172.21.15.33:0/2003350711 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9d6c0e5a60 con 0x7f9d7410dc30 2024-08-28T19:37:37.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.803+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/2328935493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0a01d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009900 tx=0x7f9d68032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1238c03ecec8238e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:37.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.804+0000 7f9d5effd640 1 -- 172.21.15.33:0/2328935493 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68040070 con 0x563c1cccf980 2024-08-28T19:37:37.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.804+0000 7f9d5effd640 1 -- 172.21.15.33:0/2328935493 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d680316a0 con 0x563c1cccf980 2024-08-28T19:37:37.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.804+0000 7f9d797e2640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d640b4cd0 0x7f9d640b71e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0a9070 tx=0x7f9d6c017000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:37.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.804+0000 7f9d5effd640 1 -- 172.21.15.33:0/2328935493 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68035040 con 0x563c1cccf980 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 -- 172.21.15.33:0/2328935493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 msgr2=0x563c1d0a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 --2- 172.21.15.33:0/2328935493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0a01d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009900 tx=0x7f9d68032e60 comp rx=0 tx=0).stop 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 -- 172.21.15.33:0/2328935493 shutdown_connections 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 --2- 172.21.15.33:0/2328935493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccd7b60 0x563c1d0a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 --2- 172.21.15.33:0/2328935493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0a01d0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 --2- 172.21.15.33:0/2328935493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 0x563c1d09fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 -- 172.21.15.33:0/2328935493 >> 172.21.15.33:0/2328935493 conn(0x563c1ccec990 msgr2=0x563c1d09db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 -- 172.21.15.33:0/2328935493 shutdown_connections 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 -- 172.21.15.33:0/2328935493 wait complete. 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 -- start start 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.805+0000 7f9d817ba740 1 Processor -- start 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0ab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccd7b60 0x563c1d0ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccf8840 0x563c1d0bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d817ba740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563c1ce667a0 con 0x563c1cccf980 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d817ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563c1cf8a240 con 0x563c1ccf8840 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d817ba740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563c1d0b2820 con 0x563c1ccd7b60 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d817ba740 10 client.0 _ll_register_callbacks cb 0x563c1cd10090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0ab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50024/0 (socket says 172.21.15.33:50024) 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d73fff640 1 -- 172.21.15.33:0/104159205 learned_addr learned my addr 172.21.15.33:0/104159205 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccd7b60 0x563c1d0ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d73fff640 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccf8840 0x563c1d0bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d73fff640 1 -- 172.21.15.33:0/104159205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccd7b60 msgr2=0x563c1d0ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d73fff640 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccd7b60 0x563c1d0ab9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d73fff640 1 -- 172.21.15.33:0/104159205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccf8840 msgr2=0x563c1d0bbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:37.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d73fff640 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccf8840 0x563c1d0bbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d73fff640 1 -- 172.21.15.33:0/104159205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c1cfc02b0 con 0x563c1cccf980 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d73fff640 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0ab490 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9d60012e10 tx=0x7f9d600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c0a2cd9efeded9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.806+0000 7f9d53fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d53fff640 1 -- 172.21.15.33:0/104159205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600122f0 con 0x563c1cccf980 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d53fff640 1 -- 172.21.15.33:0/104159205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9d600047a0 con 0x563c1cccf980 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d817ba740 1 -- 172.21.15.33:0/104159205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d680316a0 con 0x563c1cccf980 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d53fff640 1 -- 172.21.15.33:0/104159205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d60029050 con 0x563c1cccf980 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d817ba740 10 client.17091 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d817ba740 1 -- 172.21.15.33:0/104159205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c1cd72b90 con 0x563c1cccf980 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d53fff640 1 -- 172.21.15.33:0/104159205 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d680316a0 con 0x563c1cccf980 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d53fff640 1 -- 172.21.15.33:0/104159205 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9d6001d030 con 0x563c1cccf980 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d817ba740 10 client.17091 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d817ba740 10 client.17091 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:37:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d817ba740 20 client.17091 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d817ba740 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563c1ccb71c0 0x563c1d0c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d817ba740 4 client.17091 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.807+0000 7f9d817ba740 1 -- 172.21.15.33:0/104159205 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c1d016280 con 0x563c1ccb71c0 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.808+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563c1ccb71c0 0x563c1d0c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.808+0000 7f9d53fff640 10 client.17091 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.808+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563c1ccb71c0 0x563c1d0c19c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=786a8779522226a server_cookie=5cc2ab496ded857e in_seq=0 out_seq=0 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d53fff640 1 -- 172.21.15.33:0/104159205 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c1d016280 con 0x563c1ccb71c0 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d53fff640 10 client.17091 handle_command_reply: tid=0 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 client.17091 shutdown 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 -- 172.21.15.33:0/104159205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 msgr2=0x563c1d0ab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0ab490 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9d60012e10 tx=0x7f9d600046c0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 -- 172.21.15.33:0/104159205 shutdown_connections 2024-08-28T19:37:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccf8840 0x563c1d0bbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccd7b60 0x563c1d0ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563c1ccb71c0 0x563c1d0c19c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 --2- 172.21.15.33:0/104159205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1cccf980 0x563c1d0ab490 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d53fff640 0 client.17091 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 -- 172.21.15.33:0/104159205 >> 172.21.15.33:0/104159205 conn(0x563c1ccec990 msgr2=0x563c1d0a2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 -- 172.21.15.33:0/104159205 shutdown_connections 2024-08-28T19:37:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 1 -- 172.21.15.33:0/104159205 wait complete. 2024-08-28T19:37:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.809+0000 7f9d817ba740 20 client.17091 trim_cache size 0 max 16384 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d817ba740 1 Processor -- start 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d817ba740 1 -- start start 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1cccf980 0x563c1d0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccd7b60 0x563c1d0bba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 0x563c1d0bbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d817ba740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741ae860 con 0x563c1ccd7b60 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d817ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741b03a0 con 0x563c1cccf980 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d817ba740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741aef30 con 0x563c1ccf8840 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d78fe1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccd7b60 0x563c1d0bba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d78fe1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccd7b60 0x563c1d0bba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50032/0 (socket says 172.21.15.33:50032) 2024-08-28T19:37:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d78fe1640 1 -- 172.21.15.33:0/257637022 learned_addr learned my addr 172.21.15.33:0/257637022 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d73fff640 1 --2- 172.21.15.33:0/257637022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 0x563c1d0bbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d73fff640 1 --2- 172.21.15.33:0/257637022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1cccf980 0x563c1d0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d78fe1640 1 -- 172.21.15.33:0/257637022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 msgr2=0x563c1d0bbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/257637022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 0x563c1d0bbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d78fe1640 1 -- 172.21.15.33:0/257637022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1cccf980 msgr2=0x563c1d0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/257637022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1cccf980 0x563c1d0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.827+0000 7f9d78fe1640 1 -- 172.21.15.33:0/257637022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c1cfd3d90 con 0x563c1ccd7b60 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.828+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/257637022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccd7b60 0x563c1d0bba40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9d68005310 tx=0x7f9d68005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfb4fbaf0748b11 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.828+0000 7f9d5e7fc640 1 -- 172.21.15.33:0/257637022 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68051070 con 0x563c1ccd7b60 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.828+0000 7f9d5e7fc640 1 -- 172.21.15.33:0/257637022 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d680316a0 con 0x563c1ccd7b60 2024-08-28T19:37:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.828+0000 7f9d5e7fc640 1 -- 172.21.15.33:0/257637022 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d68035040 con 0x563c1ccd7b60 2024-08-28T19:37:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 -- 172.21.15.33:0/257637022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccd7b60 msgr2=0x563c1d0bba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 --2- 172.21.15.33:0/257637022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccd7b60 0x563c1d0bba40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9d68005310 tx=0x7f9d68005340 comp rx=0 tx=0).stop 2024-08-28T19:37:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 -- 172.21.15.33:0/257637022 shutdown_connections 2024-08-28T19:37:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 --2- 172.21.15.33:0/257637022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1ccf8840 0x563c1d0bbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 --2- 172.21.15.33:0/257637022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccd7b60 0x563c1d0bba40 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 --2- 172.21.15.33:0/257637022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1cccf980 0x563c1d0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 -- 172.21.15.33:0/257637022 >> 172.21.15.33:0/257637022 conn(0x563c1ccec990 msgr2=0x563c1d0ac9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 -- 172.21.15.33:0/257637022 shutdown_connections 2024-08-28T19:37:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 -- 172.21.15.33:0/257637022 wait complete. 2024-08-28T19:37:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 -- start start 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.829+0000 7f9d817ba740 1 Processor -- start 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1cccf980 0x563c1d0b8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccd7b60 0x563c1d0b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d817ba740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccf8840 0x563c1d0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d817ba740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741afcd0 con 0x563c1ccf8840 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d817ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741af600 con 0x563c1ccd7b60 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d817ba740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741ac840 con 0x563c1cccf980 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d817ba740 10 client.0 _ll_register_callbacks cb 0x7f9d6000acb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccf8840 0x563c1d0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccf8840 0x563c1d0b7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50044/0 (socket says 172.21.15.33:50044) 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d73fff640 1 -- 172.21.15.33:0/991333528 learned_addr learned my addr 172.21.15.33:0/991333528 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d73fff640 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1cccf980 0x563c1d0b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccd7b60 0x563c1d0b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d73fff640 1 -- 172.21.15.33:0/991333528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1cccf980 msgr2=0x563c1d0b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d73fff640 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1cccf980 0x563c1d0b8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d73fff640 1 -- 172.21.15.33:0/991333528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccd7b60 msgr2=0x563c1d0b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d73fff640 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccd7b60 0x563c1d0b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d73fff640 1 -- 172.21.15.33:0/991333528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c1d0b7540 con 0x563c1ccf8840 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d73fff640 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccf8840 0x563c1d0b7000 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000ada0 tx=0x7f9d600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cdf950e8213dbb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.830+0000 7f9d53fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d53fff640 1 -- 172.21.15.33:0/991333528 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6001ebb0 con 0x563c1ccf8840 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d53fff640 1 -- 172.21.15.33:0/991333528 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9d6001ed50 con 0x563c1ccf8840 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d817ba740 1 -- 172.21.15.33:0/991333528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d680316a0 con 0x563c1ccf8840 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d53fff640 1 -- 172.21.15.33:0/991333528 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d6003d8a0 con 0x563c1ccf8840 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d817ba740 10 client.17097 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d817ba740 1 -- 172.21.15.33:0/991333528 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c1d12d010 con 0x563c1ccf8840 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d53fff640 1 -- 172.21.15.33:0/991333528 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d680316a0 con 0x563c1ccf8840 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d53fff640 1 -- 172.21.15.33:0/991333528 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9d6001d070 con 0x563c1ccf8840 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d817ba740 10 client.17097 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d817ba740 10 client.17097 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d817ba740 20 client.17097 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d817ba740 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563c1cc8c570 0x563c1d12f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d817ba740 4 client.17097 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.831+0000 7f9d817ba740 1 -- 172.21.15.33:0/991333528 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x563c1d011d20 con 0x563c1cc8c570 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.832+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563c1cc8c570 0x563c1d12f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.832+0000 7f9d78fe1640 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563c1cc8c570 0x563c1d12f6d0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=589f0e5e0255a2ac server_cookie=b52989071f22f80a in_seq=0 out_seq=0 2024-08-28T19:37:37.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.832+0000 7f9d53fff640 10 client.17097 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d53fff640 1 -- 172.21.15.33:0/991333528 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563c1d011d20 con 0x563c1cc8c570 2024-08-28T19:37:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d53fff640 10 client.17097 handle_command_reply: tid=0 2024-08-28T19:37:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 client.17097 shutdown 2024-08-28T19:37:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 -- 172.21.15.33:0/991333528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccf8840 msgr2=0x563c1d0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccf8840 0x563c1d0b7000 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000ada0 tx=0x7f9d600046c0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 -- 172.21.15.33:0/991333528 shutdown_connections 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563c1cc8c570 0x563c1d12f6d0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c1ccf8840 0x563c1d0b7000 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c1ccd7b60 0x563c1d0b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d53fff640 0 client.17097 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 --2- 172.21.15.33:0/991333528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563c1cccf980 0x563c1d0b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 -- 172.21.15.33:0/991333528 >> 172.21.15.33:0/991333528 conn(0x563c1ccec990 msgr2=0x563c1d0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 -- 172.21.15.33:0/991333528 shutdown_connections 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 1 -- 172.21.15.33:0/991333528 wait complete. 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.846+0000 7f9d817ba740 20 client.17097 trim_cache size 0 max 16384 2024-08-28T19:37:37.849 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 14, 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "9de6fa5e": { 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 14, 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:37:37.850 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:37:37.851 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:37:37.851 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:37:37.851 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:37:37.851 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:37:37.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:37.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:37.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:37.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:37.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:37.851 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 -- 172.21.15.33:0/2003350711 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d640b4cd0 msgr2=0x7f9d640b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d640b4cd0 0x7f9d640b71e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0a9070 tx=0x7f9d6c017000 comp rx=0 tx=0).stop 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 -- 172.21.15.33:0/2003350711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7410dc30 msgr2=0x7f9d7419f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7410dc30 0x7f9d7419f9f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00eaa0 tx=0x7f9d6c00eea0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 -- 172.21.15.33:0/2003350711 shutdown_connections 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d7410dc30 0x7f9d7419f9f0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9d640b4cd0 0x7f9d640b71e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9d741050b0 0x7f9d7419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 --2- 172.21.15.33:0/2003350711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d74104680 0x7f9d7419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 -- 172.21.15.33:0/2003350711 >> 172.21.15.33:0/2003350711 conn(0x7f9d74079660 msgr2=0x7f9d740ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 -- 172.21.15.33:0/2003350711 shutdown_connections 2024-08-28T19:37:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:37.847+0000 7f9d7b245640 1 -- 172.21.15.33:0/2003350711 wait complete. 2024-08-28T19:37:38.686 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9de6fa5e', quiesce took 3.4 seconds. Will release after: 26.6 2024-08-28T19:37:39.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:39 smithi033 ceph-mon[18549]: pgmap v498: 129 pgs: 129 active+clean; 5.7 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-08-28T19:37:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:39 smithi059 ceph-mon[22052]: pgmap v498: 129 pgs: 129 active+clean; 5.7 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-08-28T19:37:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:39 smithi122 ceph-mon[22174]: pgmap v498: 129 pgs: 129 active+clean; 5.7 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-08-28T19:37:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:41 smithi033 ceph-mon[18549]: pgmap v499: 129 pgs: 129 active+clean; 5.7 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-08-28T19:37:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:41 smithi059 ceph-mon[22052]: pgmap v499: 129 pgs: 129 active+clean; 5.7 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-08-28T19:37:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:41 smithi122 ceph-mon[22174]: pgmap v499: 129 pgs: 129 active+clean; 5.7 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-08-28T19:37:43.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:43 smithi033 ceph-mon[18549]: pgmap v500: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:43.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:43 smithi059 ceph-mon[22052]: pgmap v500: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:43 smithi122 ceph-mon[22174]: pgmap v500: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-08-28T19:37:45.004 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:37:45.273 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:45.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:45 smithi033 ceph-mon[18549]: pgmap v501: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-08-28T19:37:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:45 smithi059 ceph-mon[22052]: pgmap v501: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-08-28T19:37:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:45 smithi122 ceph-mon[22174]: pgmap v501: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-08-28T19:37:45.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 -- 172.21.15.33:0/3641212281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d0108ac0 msgr2=0x7f82d010f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:45.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 --2- 172.21.15.33:0/3641212281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d0108ac0 0x7f82d010f2f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009ca0 tx=0x7f82c802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 -- 172.21.15.33:0/3641212281 shutdown_connections 2024-08-28T19:37:45.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 --2- 172.21.15.33:0/3641212281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d0108ac0 0x7f82d010f2f0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 --2- 172.21.15.33:0/3641212281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82d0108170 0x7f82d0108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 --2- 172.21.15.33:0/3641212281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d0102830 0x7f82d0102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 -- 172.21.15.33:0/3641212281 >> 172.21.15.33:0/3641212281 conn(0x7f82d00794d0 msgr2=0x7f82d00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:45.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 -- 172.21.15.33:0/3641212281 shutdown_connections 2024-08-28T19:37:45.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 -- 172.21.15.33:0/3641212281 wait complete. 2024-08-28T19:37:45.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 Processor -- start 2024-08-28T19:37:45.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.834+0000 7f82d82fe640 1 -- start start 2024-08-28T19:37:45.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d82fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d0102830 0x7f82d019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d82fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82d0108170 0x7f82d019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d82fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d0108ac0 0x7f82d019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d82fe640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f82d0113870 con 0x7f82d0102830 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d82fe640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82d01136f0 con 0x7f82d0108ac0 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d82fe640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82d01139f0 con 0x7f82d0108170 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d609a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d0102830 0x7f82d019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d609a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d0102830 0x7f82d019a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50276/0 (socket says 172.21.15.33:50276) 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d609a640 1 -- 172.21.15.33:0/1973953255 learned_addr learned my addr 172.21.15.33:0/1973953255 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d5899640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82d0108170 0x7f82d019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d689b640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d0108ac0 0x7f82d019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d609a640 1 -- 172.21.15.33:0/1973953255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82d0108170 msgr2=0x7f82d019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d609a640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82d0108170 0x7f82d019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d609a640 1 -- 172.21.15.33:0/1973953255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d0108ac0 msgr2=0x7f82d019fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d609a640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d0108ac0 0x7f82d019fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d609a640 1 -- 172.21.15.33:0/1973953255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d01a0150 con 0x7f82d0102830 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.835+0000 7f82d609a640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d0102830 0x7f82d019a2a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c920 tx=0x7f82cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:45.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.836+0000 7f82c77fe640 1 -- 172.21.15.33:0/1973953255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc007c70 con 0x7f82d0102830 2024-08-28T19:37:45.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.836+0000 7f82c77fe640 1 -- 172.21.15.33:0/1973953255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82cc007e10 con 0x7f82d0102830 2024-08-28T19:37:45.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.836+0000 7f82d82fe640 1 -- 172.21.15.33:0/1973953255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d01a0440 con 0x7f82d0102830 2024-08-28T19:37:45.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.836+0000 7f82c77fe640 1 -- 172.21.15.33:0/1973953255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc018820 con 0x7f82d0102830 2024-08-28T19:37:45.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.836+0000 7f82d82fe640 1 -- 172.21.15.33:0/1973953255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d01a6c60 con 0x7f82d0102830 2024-08-28T19:37:45.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.838+0000 7f82de873740 1 Processor -- start 2024-08-28T19:37:45.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82de873740 1 -- start start 2024-08-28T19:37:45.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82c77fe640 1 -- 172.21.15.33:0/1973953255 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f82cc00f450 con 0x7f82d0102830 2024-08-28T19:37:45.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82de873740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524ba882c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82de873740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524ba88800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82de873740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba88d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82de873740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56524b9ff630 con 0x56524b6c2390 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82de873740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56524b9eebc0 con 0x56524b6ba1b0 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82de873740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56524b9f2b70 con 0x56524b6e3070 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82d5899640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba88d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82d5899640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba88d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50288/0 (socket says 172.21.15.33:50288) 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82d5899640 1 -- 172.21.15.33:0/1812972576 learned_addr learned my addr 172.21.15.33:0/1812972576 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82d609a640 1 --2- 172.21.15.33:0/1812972576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524ba88800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.839+0000 7f82d689b640 1 --2- 172.21.15.33:0/1812972576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524ba882c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82d5899640 1 -- 172.21.15.33:0/1812972576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 msgr2=0x56524ba882c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82d5899640 1 --2- 172.21.15.33:0/1812972576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524ba882c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82d5899640 1 -- 172.21.15.33:0/1812972576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 msgr2=0x56524ba88800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:45.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82d5899640 1 --2- 172.21.15.33:0/1812972576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524ba88800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82d5899640 1 -- 172.21.15.33:0/1812972576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56524b74e650 con 0x56524b6c2390 2024-08-28T19:37:45.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82c77fe640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82bc0b4d50 0x7f82bc0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82d689b640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82bc0b4d50 0x7f82bc0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82d5899640 1 --2- 172.21.15.33:0/1812972576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba88d40 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f82c000dba0 tx=0x7f82c000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29d5ab286e949af server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:45.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82c77fe640 1 -- 172.21.15.33:0/1973953255 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f82cc0e5a10 con 0x7f82d0102830 2024-08-28T19:37:45.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82c4d9a640 1 -- 172.21.15.33:0/1812972576 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c000de90 con 0x56524b6c2390 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82c4d9a640 1 -- 172.21.15.33:0/1812972576 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82c00054d0 con 0x56524b6c2390 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.840+0000 7f82c4d9a640 1 -- 172.21.15.33:0/1812972576 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c00116a0 con 0x56524b6c2390 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.841+0000 7f82de873740 1 -- 172.21.15.33:0/1812972576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 msgr2=0x56524ba88d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.841+0000 7f82d689b640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82bc0b4d50 0x7f82bc0b7260 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f82c8005cc0 tx=0x7f82c8005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.841+0000 7f82de873740 1 --2- 172.21.15.33:0/1812972576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba88d40 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f82c000dba0 tx=0x7f82c000f730 comp rx=0 tx=0).stop 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.841+0000 7f82de873740 1 -- 172.21.15.33:0/1812972576 shutdown_connections 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.841+0000 7f82de873740 1 --2- 172.21.15.33:0/1812972576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba88d40 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.841+0000 7f82de873740 1 --2- 172.21.15.33:0/1812972576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524ba88800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.841+0000 7f82de873740 1 --2- 172.21.15.33:0/1812972576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524ba882c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.841+0000 7f82de873740 1 -- 172.21.15.33:0/1812972576 >> 172.21.15.33:0/1812972576 conn(0x56524b6d7460 msgr2=0x56524ba861b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:45.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.841+0000 7f82de873740 1 -- 172.21.15.33:0/1812972576 shutdown_connections 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.841+0000 7f82de873740 1 -- 172.21.15.33:0/1812972576 wait complete. 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82de873740 1 -- start start 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82de873740 1 Processor -- start 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82de873740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6ba1b0 0x56524ba986b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82de873740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6c2390 0x56524ba98c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82de873740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6e3070 0x56524ba9dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82de873740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56524b851700 con 0x56524b6e3070 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82de873740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56524b975700 con 0x56524b6c2390 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82de873740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56524ba96aa0 con 0x56524b6ba1b0 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82de873740 10 client.0 _ll_register_callbacks cb 0x56524b9a4dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82d689b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6e3070 0x56524ba9dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82d689b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6e3070 0x56524ba9dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50304/0 (socket says 172.21.15.33:50304) 2024-08-28T19:37:45.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82d689b640 1 -- 172.21.15.33:0/1805528775 learned_addr learned my addr 172.21.15.33:0/1805528775 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82d609a640 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6ba1b0 0x56524ba986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.842+0000 7f82d5899640 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6c2390 0x56524ba98c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82d689b640 1 -- 172.21.15.33:0/1805528775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6ba1b0 msgr2=0x56524ba986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82d689b640 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6ba1b0 0x56524ba986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82d689b640 1 -- 172.21.15.33:0/1805528775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6c2390 msgr2=0x56524ba98c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82d689b640 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6c2390 0x56524ba98c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82d689b640 1 -- 172.21.15.33:0/1805528775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56524b9ae8b0 con 0x56524b6e3070 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82d689b640 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6e3070 0x56524ba9dcb0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f82c80094c0 tx=0x7f82c802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d507e7b91fe0117b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82b9ffb640 1 -- 172.21.15.33:0/1805528775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8003c40 con 0x56524b6e3070 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82b9ffb640 1 -- 172.21.15.33:0/1805528775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f82c8003de0 con 0x56524b6e3070 2024-08-28T19:37:45.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82de873740 1 -- 172.21.15.33:0/1805528775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82c00054d0 con 0x56524b6e3070 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82b9ffb640 1 -- 172.21.15.33:0/1805528775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f82c8004040 con 0x56524b6e3070 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82de873740 10 client.17109 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82de873740 1 -- 172.21.15.33:0/1805528775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56524baa6c00 con 0x56524b6e3070 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.843+0000 7f82b9ffb640 1 -- 172.21.15.33:0/1805528775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82c00054d0 con 0x56524b6e3070 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.844+0000 7f82b9ffb640 1 -- 172.21.15.33:0/1805528775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f82c8051070 con 0x56524b6e3070 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.844+0000 7f82de873740 10 client.17109 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.844+0000 7f82de873740 10 client.17109 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.844+0000 7f82de873740 20 client.17109 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.844+0000 7f82de873740 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56524b6a19f0 0x56524baaa110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.844+0000 7f82de873740 4 client.17109 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.844+0000 7f82de873740 1 -- 172.21.15.33:0/1805528775 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56524ba01580 con 0x56524b6a19f0 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.844+0000 7f82d609a640 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56524b6a19f0 0x56524baaa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.844+0000 7f82b9ffb640 10 client.17109 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:45.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.844+0000 7f82d609a640 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56524b6a19f0 0x56524baaa110 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b73158eb34c6ffad server_cookie=1808ab2062137333 in_seq=0 out_seq=0 2024-08-28T19:37:45.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82b9ffb640 1 -- 172.21.15.33:0/1805528775 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56524ba01580 con 0x56524b6a19f0 2024-08-28T19:37:45.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82b9ffb640 10 client.17109 handle_command_reply: tid=0 2024-08-28T19:37:45.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 client.17109 shutdown 2024-08-28T19:37:45.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 -- 172.21.15.33:0/1805528775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6e3070 msgr2=0x56524ba9dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:45.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6e3070 0x56524ba9dcb0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f82c80094c0 tx=0x7f82c802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 -- 172.21.15.33:0/1805528775 shutdown_connections 2024-08-28T19:37:45.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56524b6a19f0 0x56524baaa110 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82b9ffb640 0 client.17109 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:45.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6e3070 0x56524ba9dcb0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6c2390 0x56524ba98c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 --2- 172.21.15.33:0/1805528775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6ba1b0 0x56524ba986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 -- 172.21.15.33:0/1805528775 >> 172.21.15.33:0/1805528775 conn(0x56524b6d7460 msgr2=0x56524ba8b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:45.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 -- 172.21.15.33:0/1805528775 shutdown_connections 2024-08-28T19:37:45.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.845+0000 7f82de873740 1 -- 172.21.15.33:0/1805528775 wait complete. 2024-08-28T19:37:45.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.846+0000 7f82de873740 20 client.17109 trim_cache size 0 max 16384 2024-08-28T19:37:45.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.863+0000 7f82de873740 1 Processor -- start 2024-08-28T19:37:45.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.863+0000 7f82de873740 1 -- start start 2024-08-28T19:37:45.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82de873740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524ba96cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82de873740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba971f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82de873740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524ba94fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82de873740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f82d01ae8b0 con 0x56524b6c2390 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82de873740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82d01b03f0 con 0x56524b6ba1b0 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82de873740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82d01aef80 con 0x56524b6e3070 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d5899640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d5899640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50308/0 (socket says 172.21.15.33:50308) 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d5899640 1 -- 172.21.15.33:0/2170404462 learned_addr learned my addr 172.21.15.33:0/2170404462 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d689b640 1 --2- 172.21.15.33:0/2170404462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524ba94fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d609a640 1 --2- 172.21.15.33:0/2170404462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524ba96cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d5899640 1 -- 172.21.15.33:0/2170404462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 msgr2=0x56524ba94fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d5899640 1 --2- 172.21.15.33:0/2170404462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524ba94fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d5899640 1 -- 172.21.15.33:0/2170404462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 msgr2=0x56524ba96cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:45.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d5899640 1 --2- 172.21.15.33:0/2170404462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524ba96cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d5899640 1 -- 172.21.15.33:0/2170404462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56524ba8c3d0 con 0x56524b6c2390 2024-08-28T19:37:45.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82d5899640 1 --2- 172.21.15.33:0/2170404462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba971f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f82c000dba0 tx=0x7f82c000d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1e1e4d4a372bde server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:45.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.864+0000 7f82bbfff640 1 -- 172.21.15.33:0/2170404462 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c002b070 con 0x56524b6c2390 2024-08-28T19:37:45.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82bbfff640 1 -- 172.21.15.33:0/2170404462 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82c000de90 con 0x56524b6c2390 2024-08-28T19:37:45.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82bbfff640 1 -- 172.21.15.33:0/2170404462 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0011440 con 0x56524b6c2390 2024-08-28T19:37:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82de873740 1 -- 172.21.15.33:0/2170404462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 msgr2=0x56524ba971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82de873740 1 --2- 172.21.15.33:0/2170404462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba971f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f82c000dba0 tx=0x7f82c000d840 comp rx=0 tx=0).stop 2024-08-28T19:37:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82de873740 1 -- 172.21.15.33:0/2170404462 shutdown_connections 2024-08-28T19:37:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82de873740 1 --2- 172.21.15.33:0/2170404462 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524ba94fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82de873740 1 --2- 172.21.15.33:0/2170404462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524ba971f0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82de873740 1 --2- 172.21.15.33:0/2170404462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524ba96cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82de873740 1 -- 172.21.15.33:0/2170404462 >> 172.21.15.33:0/2170404462 conn(0x56524b6d7460 msgr2=0x56524ba92f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82de873740 1 -- 172.21.15.33:0/2170404462 shutdown_connections 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.865+0000 7f82de873740 1 -- 172.21.15.33:0/2170404462 wait complete. 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82de873740 1 -- start start 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82de873740 1 Processor -- start 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82de873740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524baa21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82de873740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524baa26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82de873740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524bb13ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82de873740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f82d01afd20 con 0x56524b6c2390 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82de873740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f82d01af650 con 0x56524b6ba1b0 2024-08-28T19:37:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82de873740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f82d01ac890 con 0x56524b6e3070 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82de873740 10 client.0 _ll_register_callbacks cb 0x7f82c80093f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82d5899640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524baa26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82d5899640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524baa26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50318/0 (socket says 172.21.15.33:50318) 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82d5899640 1 -- 172.21.15.33:0/530416712 learned_addr learned my addr 172.21.15.33:0/530416712 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82d689b640 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524bb13ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.866+0000 7f82d609a640 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524baa21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82d5899640 1 -- 172.21.15.33:0/530416712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 msgr2=0x56524bb13ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82d5899640 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524bb13ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82d5899640 1 -- 172.21.15.33:0/530416712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 msgr2=0x56524baa21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82d5899640 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524baa21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82d5899640 1 -- 172.21.15.33:0/530416712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56524bb14020 con 0x56524b6c2390 2024-08-28T19:37:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82d689b640 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524bb13ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82d609a640 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524baa21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82d5899640 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524baa26f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f82c0010010 tx=0x7f82c0011650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7657551c65cdf15f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82b9ffb640 1 -- 172.21.15.33:0/530416712 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0033020 con 0x56524b6c2390 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82b9ffb640 1 -- 172.21.15.33:0/530416712 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f82c0011840 con 0x56524b6c2390 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82de873740 1 -- 172.21.15.33:0/530416712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82c000de90 con 0x56524b6c2390 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82b9ffb640 1 -- 172.21.15.33:0/530416712 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f82c003e050 con 0x56524b6c2390 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82de873740 10 client.17115 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82de873740 1 -- 172.21.15.33:0/530416712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56524bb15280 con 0x56524b6c2390 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.867+0000 7f82b9ffb640 1 -- 172.21.15.33:0/530416712 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82c000de90 con 0x56524b6c2390 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.868+0000 7f82b9ffb640 1 -- 172.21.15.33:0/530416712 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f82c002e030 con 0x56524b6c2390 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.868+0000 7f82de873740 10 client.17115 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.868+0000 7f82de873740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:45.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.868+0000 7f82de873740 20 client.17115 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.868+0000 7f82de873740 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56524b676da0 0x56524bb177c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.868+0000 7f82de873740 4 client.17115 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.868+0000 7f82de873740 1 -- 172.21.15.33:0/530416712 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56524ba8ab50 con 0x56524b676da0 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.868+0000 7f82d609a640 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56524b676da0 0x56524bb177c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.868+0000 7f82b9ffb640 10 client.17115 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.868+0000 7f82d609a640 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56524b676da0 0x56524bb177c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e35afa53466d6fb server_cookie=b8da6e6c35a83bab in_seq=0 out_seq=0 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82b9ffb640 1 -- 172.21.15.33:0/530416712 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x56524ba8ab50 con 0x56524b676da0 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82b9ffb640 10 client.17115 handle_command_reply: tid=0 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 client.17115 shutdown 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 -- 172.21.15.33:0/530416712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 msgr2=0x56524baa26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524baa26f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f82c0010010 tx=0x7f82c0011650 comp rx=0 tx=0).stop 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 -- 172.21.15.33:0/530416712 shutdown_connections 2024-08-28T19:37:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56524b6e3070 0x56524bb13ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56524b676da0 0x56524bb177c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56524b6c2390 0x56524baa26f0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 --2- 172.21.15.33:0/530416712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524b6ba1b0 0x56524baa21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82b9ffb640 0 client.17115 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 -- 172.21.15.33:0/530416712 >> 172.21.15.33:0/530416712 conn(0x56524b6d7460 msgr2=0x56524ba96cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 -- 172.21.15.33:0/530416712 shutdown_connections 2024-08-28T19:37:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 1 -- 172.21.15.33:0/530416712 wait complete. 2024-08-28T19:37:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82de873740 20 client.17115 trim_cache size 0 max 16384 2024-08-28T19:37:45.877 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:37:45.878 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:45.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:45.880 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:37:45.881 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:37:45.882 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:37:45.883 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:37:45.883 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:37:45.883 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:37:45.883 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:37:45.883 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:37:45.883 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:37:45.883 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:45.883 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:37:45.883 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:37:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82d82fe640 1 -- 172.21.15.33:0/1973953255 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82bc0b4d50 msgr2=0x7f82bc0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82d82fe640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82bc0b4d50 0x7f82bc0b7260 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f82c8005cc0 tx=0x7f82c8005c30 comp rx=0 tx=0).stop 2024-08-28T19:37:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82d82fe640 1 -- 172.21.15.33:0/1973953255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d0102830 msgr2=0x7f82d019a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.869+0000 7f82d82fe640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d0102830 0x7f82d019a2a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00c920 tx=0x7f82cc00cde0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.870+0000 7f82d82fe640 1 -- 172.21.15.33:0/1973953255 shutdown_connections 2024-08-28T19:37:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.870+0000 7f82d82fe640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d0108ac0 0x7f82d019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.870+0000 7f82d82fe640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f82bc0b4d50 0x7f82bc0b7260 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.870+0000 7f82d82fe640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f82d0108170 0x7f82d019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.870+0000 7f82d82fe640 1 --2- 172.21.15.33:0/1973953255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82d0102830 0x7f82d019a2a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.870+0000 7f82d82fe640 1 -- 172.21.15.33:0/1973953255 >> 172.21.15.33:0/1973953255 conn(0x7f82d00794d0 msgr2=0x7f82d0106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.870+0000 7f82d82fe640 1 -- 172.21.15.33:0/1973953255 shutdown_connections 2024-08-28T19:37:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:45.870+0000 7f82d82fe640 1 -- 172.21.15.33:0/1973953255 wait complete. 2024-08-28T19:37:46.731 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:37:46.732 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:37:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:47.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.490+0000 7f926cc55640 1 -- 172.21.15.33:0/8282139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9268109bf0 msgr2=0x7f9268110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:47.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.490+0000 7f926cc55640 1 --2- 172.21.15.33:0/8282139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9268109bf0 0x7f9268110420 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9260009ca0 tx=0x7f926002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:37:47.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.490+0000 7f926cc55640 1 -- 172.21.15.33:0/8282139 shutdown_connections 2024-08-28T19:37:47.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.490+0000 7f926cc55640 1 --2- 172.21.15.33:0/8282139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9268109bf0 0x7f9268110420 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:47.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.490+0000 7f926cc55640 1 --2- 172.21.15.33:0/8282139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f92681092a0 0x7f92681096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:47.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.490+0000 7f926cc55640 1 --2- 172.21.15.33:0/8282139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9268101d60 0x7f9268102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:47.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.490+0000 7f926cc55640 1 -- 172.21.15.33:0/8282139 >> 172.21.15.33:0/8282139 conn(0x7f9268079d30 msgr2=0x7f926807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:47.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.490+0000 7f926cc55640 1 -- 172.21.15.33:0/8282139 shutdown_connections 2024-08-28T19:37:47.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.490+0000 7f926cc55640 1 -- 172.21.15.33:0/8282139 wait complete. 2024-08-28T19:37:47.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.491+0000 7f926cc55640 1 Processor -- start 2024-08-28T19:37:47.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.491+0000 7f926cc55640 1 -- start start 2024-08-28T19:37:47.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.491+0000 7f926cc55640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9268101d60 0x7f9268102d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:47.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.491+0000 7f926cc55640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92681092a0 0x7f9268103240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:47.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.491+0000 7f926cc55640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9268109bf0 0x7f9268103780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:47.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.491+0000 7f926cc55640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f92681138b0 con 0x7f92681092a0 2024-08-28T19:37:47.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.491+0000 7f926cc55640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9268113730 con 0x7f9268101d60 2024-08-28T19:37:47.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.491+0000 7f926cc55640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9268113a30 con 0x7f9268109bf0 2024-08-28T19:37:47.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f9265d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92681092a0 0x7f9268103240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f9265d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92681092a0 0x7f9268103240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50344/0 (socket says 172.21.15.33:50344) 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f9265d9b640 1 -- 172.21.15.33:0/3545618766 learned_addr learned my addr 172.21.15.33:0/3545618766 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f926659c640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9268101d60 0x7f9268102d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f9266d9d640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9268109bf0 0x7f9268103780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f9265d9b640 1 -- 172.21.15.33:0/3545618766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9268109bf0 msgr2=0x7f9268103780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f9265d9b640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9268109bf0 0x7f9268103780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f9265d9b640 1 -- 172.21.15.33:0/3545618766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9268101d60 msgr2=0x7f9268102d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f9265d9b640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9268101d60 0x7f9268102d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f9265d9b640 1 -- 172.21.15.33:0/3545618766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92681a8500 con 0x7f92681092a0 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f9265d9b640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92681092a0 0x7f9268103240 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f925c00d750 tx=0x7f925c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f92577fe640 1 -- 172.21.15.33:0/3545618766 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c017070 con 0x7f92681092a0 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f92577fe640 1 -- 172.21.15.33:0/3545618766 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f925c0054d0 con 0x7f92681092a0 2024-08-28T19:37:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f926cc55640 1 -- 172.21.15.33:0/3545618766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92681a87f0 con 0x7f92681092a0 2024-08-28T19:37:47.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.492+0000 7f92577fe640 1 -- 172.21.15.33:0/3545618766 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c004c30 con 0x7f92681092a0 2024-08-28T19:37:47.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.493+0000 7f926cc55640 1 -- 172.21.15.33:0/3545618766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92681a8ce0 con 0x7f92681092a0 2024-08-28T19:37:47.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.494+0000 7f926cc55640 1 -- 172.21.15.33:0/3545618766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9268102170 con 0x7f92681092a0 2024-08-28T19:37:47.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.495+0000 7f92577fe640 1 -- 172.21.15.33:0/3545618766 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f925c004dd0 con 0x7f92681092a0 2024-08-28T19:37:47.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.496+0000 7f92577fe640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f92500b4ca0 0x7f92500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:47.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.496+0000 7f926659c640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f92500b4ca0 0x7f92500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:47.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.496+0000 7f92577fe640 1 -- 172.21.15.33:0/3545618766 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f925c0e52f0 con 0x7f92681092a0 2024-08-28T19:37:47.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.496+0000 7f926659c640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f92500b4ca0 0x7f92500b71b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9268104750 tx=0x7f925800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:47.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.500+0000 7f92577fe640 1 -- 172.21.15.33:0/3545618766 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f925c0abd90 con 0x7f92681092a0 2024-08-28T19:37:47.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:47 smithi033 ceph-mon[18549]: pgmap v502: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 11 op/s 2024-08-28T19:37:47.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.723+0000 7f926cc55640 1 -- 172.21.15.33:0/3545618766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f926802e430 con 0x7f92681092a0 2024-08-28T19:37:47.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.724+0000 7f92577fe640 1 -- 172.21.15.33:0/3545618766 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f925c0ab690 con 0x7f92681092a0 2024-08-28T19:37:47.726 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:37:47.726 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:37:47.726 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:37:47.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 -- 172.21.15.33:0/3545618766 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f92500b4ca0 msgr2=0x7f92500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:47.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f92500b4ca0 0x7f92500b71b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9268104750 tx=0x7f925800b390 comp rx=0 tx=0).stop 2024-08-28T19:37:47.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 -- 172.21.15.33:0/3545618766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92681092a0 msgr2=0x7f9268103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:47.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92681092a0 0x7f9268103240 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f925c00d750 tx=0x7f925c00dc10 comp rx=0 tx=0).stop 2024-08-28T19:37:47.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 -- 172.21.15.33:0/3545618766 shutdown_connections 2024-08-28T19:37:47.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f92500b4ca0 0x7f92500b71b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:47.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9268109bf0 0x7f9268103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:47.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92681092a0 0x7f9268103240 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:47.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 --2- 172.21.15.33:0/3545618766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9268101d60 0x7f9268102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:47.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 -- 172.21.15.33:0/3545618766 >> 172.21.15.33:0/3545618766 conn(0x7f9268079d30 msgr2=0x7f92681072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:47.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 -- 172.21.15.33:0/3545618766 shutdown_connections 2024-08-28T19:37:47.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:47.726+0000 7f926cc55640 1 -- 172.21.15.33:0/3545618766 wait complete. 2024-08-28T19:37:47.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:47 smithi059 ceph-mon[22052]: pgmap v502: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 11 op/s 2024-08-28T19:37:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:47 smithi122 ceph-mon[22174]: pgmap v502: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 11 op/s 2024-08-28T19:37:48.455 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:37:48.709 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:48.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:48 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3545618766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:37:48.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:48 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3545618766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:37:48.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:48 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3545618766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:37:49.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.156+0000 7f42af077640 1 -- 172.21.15.33:0/4276842397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a8109240 msgr2=0x7f42a8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:49.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.156+0000 7f42af077640 1 --2- 172.21.15.33:0/4276842397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a8109240 0x7f42a8109650 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4294009900 tx=0x7f429402a3f0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.156+0000 7f42af077640 1 -- 172.21.15.33:0/4276842397 shutdown_connections 2024-08-28T19:37:49.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.156+0000 7f42af077640 1 --2- 172.21.15.33:0/4276842397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42a8109b90 0x7f42a81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.156+0000 7f42af077640 1 --2- 172.21.15.33:0/4276842397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a8109240 0x7f42a8109650 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.156+0000 7f42af077640 1 --2- 172.21.15.33:0/4276842397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42a8103900 0x7f42a8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.156+0000 7f42af077640 1 -- 172.21.15.33:0/4276842397 >> 172.21.15.33:0/4276842397 conn(0x7f42a807b5f0 msgr2=0x7f42a807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:49.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.156+0000 7f42af077640 1 -- 172.21.15.33:0/4276842397 shutdown_connections 2024-08-28T19:37:49.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.156+0000 7f42af077640 1 -- 172.21.15.33:0/4276842397 wait complete. 2024-08-28T19:37:49.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42af077640 1 Processor -- start 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42af077640 1 -- start start 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42af077640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a8103900 0x7f42a819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42af077640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42a8109240 0x7f42a819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42af077640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42a8109b90 0x7f42a819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42af077640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f42a8113850 con 0x7f42a8103900 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42af077640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81136d0 con 0x7f42a8109b90 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42af077640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81139d0 con 0x7f42a8109240 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42ace13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a8103900 0x7f42a819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42ace13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a8103900 0x7f42a819a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41206/0 (socket says 172.21.15.33:41206) 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42ace13640 1 -- 172.21.15.33:0/682299867 learned_addr learned my addr 172.21.15.33:0/682299867 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:49.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42a7fff640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42a8109240 0x7f42a819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42ad614640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42a8109b90 0x7f42a819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.157+0000 7f42ace13640 1 -- 172.21.15.33:0/682299867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42a8109240 msgr2=0x7f42a819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42ace13640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42a8109240 0x7f42a819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42ace13640 1 -- 172.21.15.33:0/682299867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42a8109b90 msgr2=0x7f42a819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42ace13640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42a8109b90 0x7f42a819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42ace13640 1 -- 172.21.15.33:0/682299867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a81a01d0 con 0x7f42a8103900 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42a7fff640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42a8109240 0x7f42a819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42ad614640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42a8109b90 0x7f42a819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42ace13640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a8103900 0x7f42a819a320 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f429c00d950 tx=0x7f429c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42a5ffb640 1 -- 172.21.15.33:0/682299867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c017030 con 0x7f42a8103900 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42af077640 1 -- 172.21.15.33:0/682299867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a81a04c0 con 0x7f42a8103900 2024-08-28T19:37:49.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42a5ffb640 1 -- 172.21.15.33:0/682299867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f429c004020 con 0x7f42a8103900 2024-08-28T19:37:49.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42a5ffb640 1 -- 172.21.15.33:0/682299867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0047a0 con 0x7f42a8103900 2024-08-28T19:37:49.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.158+0000 7f42af077640 1 -- 172.21.15.33:0/682299867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a81a6ce0 con 0x7f42a8103900 2024-08-28T19:37:49.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42a5ffb640 1 -- 172.21.15.33:0/682299867 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f429c009a30 con 0x7f42a8103900 2024-08-28T19:37:49.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42b55ec740 1 Processor -- start 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42b55ec740 1 -- start start 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 0x558d4a123350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a123890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d5d390 0x558d4a123dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42b55ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558d4a09a680 con 0x558d49d551b0 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42b55ec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558d4a089c10 con 0x558d49d5d390 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42b55ec740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558d4a08dbc0 con 0x558d49d7e070 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42ace13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42ace13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a123890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41212/0 (socket says 172.21.15.33:41212) 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42ace13640 1 -- 172.21.15.33:0/435437922 learned_addr learned my addr 172.21.15.33:0/435437922 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42ad614640 1 --2- 172.21.15.33:0/435437922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 0x558d4a123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.161+0000 7f42a7fff640 1 --2- 172.21.15.33:0/435437922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d5d390 0x558d4a123dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f42ace13640 1 -- 172.21.15.33:0/435437922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 msgr2=0x558d4a123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f42ace13640 1 --2- 172.21.15.33:0/435437922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 0x558d4a123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f42ace13640 1 -- 172.21.15.33:0/435437922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d5d390 msgr2=0x558d4a123dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f42ace13640 1 --2- 172.21.15.33:0/435437922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d5d390 0x558d4a123dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f42ace13640 1 -- 172.21.15.33:0/435437922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d49de9650 con 0x558d49d551b0 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f42ad614640 1 --2- 172.21.15.33:0/435437922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 0x558d4a123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f42a5ffb640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42980b4cd0 0x7f42980b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f42ad614640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42980b4cd0 0x7f42980b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f42ace13640 1 --2- 172.21.15.33:0/435437922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a123890 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f429c0e2700 tx=0x7f429c0eb880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea670f667ed289f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f42a5ffb640 1 -- 172.21.15.33:0/682299867 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f429c0e5390 con 0x7f42a8103900 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f4292ffd640 1 -- 172.21.15.33:0/435437922 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0a75f0 con 0x558d49d551b0 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f4292ffd640 1 -- 172.21.15.33:0/435437922 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f429c0a5e50 con 0x558d49d551b0 2024-08-28T19:37:49.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.162+0000 7f4292ffd640 1 -- 172.21.15.33:0/435437922 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0aaea0 con 0x558d49d551b0 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.163+0000 7f42b55ec740 1 -- 172.21.15.33:0/435437922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 msgr2=0x558d4a123890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.163+0000 7f42ad614640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42980b4cd0 0x7f42980b71e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f42a0005cc0 tx=0x7f42a00084f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.163+0000 7f42b55ec740 1 --2- 172.21.15.33:0/435437922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a123890 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f429c0e2700 tx=0x7f429c0eb880 comp rx=0 tx=0).stop 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.163+0000 7f42b55ec740 1 -- 172.21.15.33:0/435437922 shutdown_connections 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.163+0000 7f42b55ec740 1 --2- 172.21.15.33:0/435437922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d5d390 0x558d4a123dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.163+0000 7f42b55ec740 1 --2- 172.21.15.33:0/435437922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a123890 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.163+0000 7f42b55ec740 1 --2- 172.21.15.33:0/435437922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 0x558d4a123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.163+0000 7f42b55ec740 1 -- 172.21.15.33:0/435437922 >> 172.21.15.33:0/435437922 conn(0x558d49d72460 msgr2=0x558d4a121240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.163+0000 7f42b55ec740 1 -- 172.21.15.33:0/435437922 shutdown_connections 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.163+0000 7f42b55ec740 1 -- 172.21.15.33:0/435437922 wait complete. 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42b55ec740 1 -- start start 2024-08-28T19:37:49.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42b55ec740 1 Processor -- start 2024-08-28T19:37:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d551b0 0x558d4a12eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d5d390 0x558d4a12eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d7e070 0x558d4a13ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42b55ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558d49eec700 con 0x558d49d7e070 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42b55ec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558d4a010750 con 0x558d49d551b0 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42b55ec740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558d4a131a70 con 0x558d49d5d390 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42b55ec740 10 client.0 _ll_register_callbacks cb 0x558d4a03fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42ad614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d7e070 0x558d4a13ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42ad614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d7e070 0x558d4a13ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41218/0 (socket says 172.21.15.33:41218) 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.164+0000 7f42ad614640 1 -- 172.21.15.33:0/1798592951 learned_addr learned my addr 172.21.15.33:0/1798592951 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42ace13640 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d551b0 0x558d4a12eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42a7fff640 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d5d390 0x558d4a12eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42ad614640 1 -- 172.21.15.33:0/1798592951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d5d390 msgr2=0x558d4a12eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:49.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42ad614640 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d5d390 0x558d4a12eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42ad614640 1 -- 172.21.15.33:0/1798592951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d551b0 msgr2=0x558d4a12eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42ad614640 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d551b0 0x558d4a12eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42ad614640 1 -- 172.21.15.33:0/1798592951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d4a049900 con 0x558d49d7e070 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42a7fff640 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d5d390 0x558d4a12eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42ad614640 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d7e070 0x558d4a13ad60 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f42a00086d0 tx=0x7f42a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e87c46bad1a52 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f4287fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f4287fff640 1 -- 172.21.15.33:0/1798592951 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a001d620 con 0x558d49d7e070 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f4287fff640 1 -- 172.21.15.33:0/1798592951 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f42a001d7c0 con 0x558d49d7e070 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42b55ec740 1 -- 172.21.15.33:0/1798592951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f429c0a5e50 con 0x558d49d7e070 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f4287fff640 1 -- 172.21.15.33:0/1798592951 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42a002e050 con 0x558d49d7e070 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42b55ec740 10 client.17133 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.165+0000 7f42b55ec740 1 -- 172.21.15.33:0/1798592951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d4a13d880 con 0x558d49d7e070 2024-08-28T19:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.166+0000 7f4287fff640 1 -- 172.21.15.33:0/1798592951 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f429c0a5e50 con 0x558d49d7e070 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.166+0000 7f4287fff640 1 -- 172.21.15.33:0/1798592951 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f42a001b870 con 0x558d49d7e070 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.166+0000 7f42b55ec740 10 client.17133 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.166+0000 7f42b55ec740 10 client.17133 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.166+0000 7f42b55ec740 20 client.17133 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.166+0000 7f42b55ec740 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558d49d3c9f0 0x558d4a140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.166+0000 7f42b55ec740 4 client.17133 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.166+0000 7f42b55ec740 1 -- 172.21.15.33:0/1798592951 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d4a09c5d0 con 0x558d49d3c9f0 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.166+0000 7f42ace13640 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558d49d3c9f0 0x558d4a140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.167+0000 7f42ace13640 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558d49d3c9f0 0x558d4a140dd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f95f6dd3eacc485 server_cookie=62f5ba03d9393d43 in_seq=0 out_seq=0 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.167+0000 7f4287fff640 10 client.17133 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.167+0000 7f4287fff640 1 -- 172.21.15.33:0/1798592951 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d4a09c5d0 con 0x558d49d3c9f0 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.167+0000 7f4287fff640 10 client.17133 handle_command_reply: tid=0 2024-08-28T19:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 client.17133 shutdown 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 -- 172.21.15.33:0/1798592951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d7e070 msgr2=0x558d4a13ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d7e070 0x558d4a13ad60 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f42a00086d0 tx=0x7f42a0004a40 comp rx=0 tx=0).stop 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 -- 172.21.15.33:0/1798592951 shutdown_connections 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558d49d3c9f0 0x558d4a140dd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d7e070 0x558d4a13ad60 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d5d390 0x558d4a12eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 --2- 172.21.15.33:0/1798592951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d551b0 0x558d4a12eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 -- 172.21.15.33:0/1798592951 >> 172.21.15.33:0/1798592951 conn(0x558d49d72460 msgr2=0x558d4a1264e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f4287fff640 0 client.17133 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 -- 172.21.15.33:0/1798592951 shutdown_connections 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 1 -- 172.21.15.33:0/1798592951 wait complete. 2024-08-28T19:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.168+0000 7f42b55ec740 20 client.17133 trim_cache size 0 max 16384 2024-08-28T19:37:49.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.181+0000 7f42b55ec740 1 Processor -- start 2024-08-28T19:37:49.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.181+0000 7f42b55ec740 1 -- start start 2024-08-28T19:37:49.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.181+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d551b0 0x558d4a12d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.181+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d5d390 0x558d4a12d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.181+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d7e070 0x558d4a126450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.181+0000 7f42b55ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81b0ce0 con 0x558d49d5d390 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.181+0000 7f42b55ec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81b2820 con 0x558d49d7e070 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.181+0000 7f42b55ec740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81b13b0 con 0x558d49d551b0 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42a7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d5d390 0x558d4a12d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42a7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d5d390 0x558d4a12d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41222/0 (socket says 172.21.15.33:41222) 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42a7fff640 1 -- 172.21.15.33:0/589548086 learned_addr learned my addr 172.21.15.33:0/589548086 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42ace13640 1 --2- 172.21.15.33:0/589548086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d551b0 0x558d4a12d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42ad614640 1 --2- 172.21.15.33:0/589548086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d7e070 0x558d4a126450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42a7fff640 1 -- 172.21.15.33:0/589548086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d551b0 msgr2=0x558d4a12d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42a7fff640 1 --2- 172.21.15.33:0/589548086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d551b0 0x558d4a12d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42a7fff640 1 -- 172.21.15.33:0/589548086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d7e070 msgr2=0x558d4a126450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42a7fff640 1 --2- 172.21.15.33:0/589548086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d7e070 0x558d4a126450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42a7fff640 1 -- 172.21.15.33:0/589548086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d4a12cfb0 con 0x558d49d5d390 2024-08-28T19:37:49.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42a7fff640 1 --2- 172.21.15.33:0/589548086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d5d390 0x558d4a12d870 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4294005ab0 tx=0x7f4294032e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1119ce49264008d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:49.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42927fc640 1 -- 172.21.15.33:0/589548086 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294040070 con 0x558d49d5d390 2024-08-28T19:37:49.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42927fc640 1 -- 172.21.15.33:0/589548086 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4294031760 con 0x558d49d5d390 2024-08-28T19:37:49.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.182+0000 7f42927fc640 1 -- 172.21.15.33:0/589548086 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294035040 con 0x558d49d5d390 2024-08-28T19:37:49.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.183+0000 7f42b55ec740 1 -- 172.21.15.33:0/589548086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d5d390 msgr2=0x558d4a12d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.183+0000 7f42b55ec740 1 --2- 172.21.15.33:0/589548086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d5d390 0x558d4a12d870 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4294005ab0 tx=0x7f4294032e80 comp rx=0 tx=0).stop 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.183+0000 7f42b55ec740 1 -- 172.21.15.33:0/589548086 shutdown_connections 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.183+0000 7f42b55ec740 1 --2- 172.21.15.33:0/589548086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d7e070 0x558d4a126450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.183+0000 7f42b55ec740 1 --2- 172.21.15.33:0/589548086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d5d390 0x558d4a12d870 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.183+0000 7f42b55ec740 1 --2- 172.21.15.33:0/589548086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d551b0 0x558d4a12d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.183+0000 7f42b55ec740 1 -- 172.21.15.33:0/589548086 >> 172.21.15.33:0/589548086 conn(0x558d49d72460 msgr2=0x558d4a129bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.183+0000 7f42b55ec740 1 -- 172.21.15.33:0/589548086 shutdown_connections 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.183+0000 7f42b55ec740 1 -- 172.21.15.33:0/589548086 wait complete. 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.183+0000 7f42b55ec740 1 -- start start 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42b55ec740 1 Processor -- start 2024-08-28T19:37:49.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a137240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d5d390 0x558d4a1326f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42b55ec740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 0x558d4a132c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42b55ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81b2150 con 0x558d49d551b0 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42b55ec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81b1a80 con 0x558d49d5d390 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42b55ec740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81aecc0 con 0x558d49d7e070 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42b55ec740 10 client.0 _ll_register_callbacks cb 0x7f42a0008410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42ace13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a137240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42ace13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a137240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41224/0 (socket says 172.21.15.33:41224) 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42ace13640 1 -- 172.21.15.33:0/4161529592 learned_addr learned my addr 172.21.15.33:0/4161529592 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42a7fff640 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d5d390 0x558d4a1326f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42ad614640 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 0x558d4a132c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42ace13640 1 -- 172.21.15.33:0/4161529592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 msgr2=0x558d4a132c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:49.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42ace13640 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 0x558d4a132c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42ace13640 1 -- 172.21.15.33:0/4161529592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d5d390 msgr2=0x558d4a1326f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42ace13640 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d5d390 0x558d4a1326f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.184+0000 7f42ace13640 1 -- 172.21.15.33:0/4161529592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d4a133170 con 0x558d49d551b0 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f42ace13640 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a137240 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f429c005fd0 tx=0x7f429c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4430dea2b80ecf04 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f4287fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f4287fff640 1 -- 172.21.15.33:0/4161529592 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0ab080 con 0x558d49d551b0 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f4287fff640 1 -- 172.21.15.33:0/4161529592 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f429c009d20 con 0x558d49d551b0 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f42b55ec740 1 -- 172.21.15.33:0/4161529592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4294031760 con 0x558d49d551b0 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f4287fff640 1 -- 172.21.15.33:0/4161529592 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f429c0ab500 con 0x558d49d551b0 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f42b55ec740 10 client.17139 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f42b55ec740 1 -- 172.21.15.33:0/4161529592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d4a1ab4a0 con 0x558d49d551b0 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f4287fff640 1 -- 172.21.15.33:0/4161529592 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4294031760 con 0x558d49d551b0 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f4287fff640 1 -- 172.21.15.33:0/4161529592 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f429c0e2a10 con 0x558d49d551b0 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f42b55ec740 10 client.17139 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:49.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f42b55ec740 10 client.17139 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f42b55ec740 20 client.17139 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.185+0000 7f42b55ec740 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558d49d11da0 0x558d4a1ad790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.186+0000 7f42b55ec740 4 client.17139 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.186+0000 7f42b55ec740 1 -- 172.21.15.33:0/4161529592 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558d4a098070 con 0x558d49d11da0 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.186+0000 7f42a7fff640 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558d49d11da0 0x558d4a1ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.186+0000 7f4287fff640 10 client.17139 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.186+0000 7f42a7fff640 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558d49d11da0 0x558d4a1ad790 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c25c2a7d5868aad server_cookie=57038c9ff82e1d in_seq=0 out_seq=0 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.186+0000 7f4287fff640 1 -- 172.21.15.33:0/4161529592 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558d4a098070 con 0x558d49d11da0 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.186+0000 7f4287fff640 10 client.17139 handle_command_reply: tid=0 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 client.17139 shutdown 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 -- 172.21.15.33:0/4161529592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 msgr2=0x558d4a137240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a137240 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f429c005fd0 tx=0x7f429c004730 comp rx=0 tx=0).stop 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 -- 172.21.15.33:0/4161529592 shutdown_connections 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558d49d11da0 0x558d4a1ad790 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f4287fff640 0 client.17139 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:37:49.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558d49d7e070 0x558d4a132c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d49d5d390 0x558d4a1326f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 --2- 172.21.15.33:0/4161529592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558d49d551b0 0x558d4a137240 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 -- 172.21.15.33:0/4161529592 >> 172.21.15.33:0/4161529592 conn(0x558d49d72460 msgr2=0x558d4a129bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:49.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 -- 172.21.15.33:0/4161529592 shutdown_connections 2024-08-28T19:37:49.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 1 -- 172.21.15.33:0/4161529592 wait complete. 2024-08-28T19:37:49.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.187+0000 7f42b55ec740 20 client.17139 trim_cache size 0 max 16384 2024-08-28T19:37:49.194 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:37:49.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 -- 172.21.15.33:0/682299867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42980b4cd0 msgr2=0x7f42980b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:49.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42980b4cd0 0x7f42980b71e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f42a0005cc0 tx=0x7f42a00084f0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 -- 172.21.15.33:0/682299867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a8103900 msgr2=0x7f42a819a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:49.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a8103900 0x7f42a819a320 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f429c00d950 tx=0x7f429c00de10 comp rx=0 tx=0).stop 2024-08-28T19:37:49.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 -- 172.21.15.33:0/682299867 shutdown_connections 2024-08-28T19:37:49.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42a8109b90 0x7f42a819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f42980b4cd0 0x7f42980b71e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42a8109240 0x7f42a819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 --2- 172.21.15.33:0/682299867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42a8103900 0x7f42a819a320 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 -- 172.21.15.33:0/682299867 >> 172.21.15.33:0/682299867 conn(0x7f42a807b5f0 msgr2=0x7f42a81053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 -- 172.21.15.33:0/682299867 shutdown_connections 2024-08-28T19:37:49.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:49.188+0000 7f42af077640 1 -- 172.21.15.33:0/682299867 wait complete. 2024-08-28T19:37:49.551 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:49 smithi033 ceph-mon[18549]: pgmap v503: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-08-28T19:37:49.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:49 smithi059 ceph-mon[22052]: pgmap v503: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-08-28T19:37:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:49 smithi122 ceph-mon[22174]: pgmap v503: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-08-28T19:37:50.103 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:37:50.359 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:50.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.958+0000 7f206990c640 1 -- 172.21.15.33:0/3107219727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2064102800 msgr2=0x7f2064102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:50.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.958+0000 7f206990c640 1 --2- 172.21.15.33:0/3107219727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2064102800 0x7f2064102c10 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2054009900 tx=0x7f205402a410 comp rx=0 tx=0).stop 2024-08-28T19:37:50.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.958+0000 7f206990c640 1 -- 172.21.15.33:0/3107219727 shutdown_connections 2024-08-28T19:37:50.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.958+0000 7f206990c640 1 --2- 172.21.15.33:0/3107219727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2064108a90 0x7f206410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.958+0000 7f206990c640 1 --2- 172.21.15.33:0/3107219727 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2064108140 0x7f2064108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.958+0000 7f206990c640 1 --2- 172.21.15.33:0/3107219727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2064102800 0x7f2064102c10 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.958+0000 7f206990c640 1 -- 172.21.15.33:0/3107219727 >> 172.21.15.33:0/3107219727 conn(0x7f20640794d0 msgr2=0x7f20640798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.958+0000 7f206990c640 1 -- 172.21.15.33:0/3107219727 shutdown_connections 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.958+0000 7f206990c640 1 -- 172.21.15.33:0/3107219727 wait complete. 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.959+0000 7f206990c640 1 Processor -- start 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.959+0000 7f206990c640 1 -- start start 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.959+0000 7f206990c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2064102800 0x7f206410fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.959+0000 7f206990c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2064108140 0x7f2064110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.959+0000 7f206990c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2064108a90 0x7f20641107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f206990c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2064113820 con 0x7f2064108a90 2024-08-28T19:37:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f206990c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20641136a0 con 0x7f2064108140 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f206990c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f20641139a0 con 0x7f2064102800 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f20637fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2064108a90 0x7f20641107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f20637fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2064108a90 0x7f20641107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41238/0 (socket says 172.21.15.33:41238) 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f20637fe640 1 -- 172.21.15.33:0/1468411138 learned_addr learned my addr 172.21.15.33:0/1468411138 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f205a7fc640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2064108140 0x7f2064110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f2062ffd640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2064102800 0x7f206410fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f20637fe640 1 -- 172.21.15.33:0/1468411138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2064102800 msgr2=0x7f206410fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f20637fe640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2064102800 0x7f206410fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f20637fe640 1 -- 172.21.15.33:0/1468411138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2064108140 msgr2=0x7f2064110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f20637fe640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2064108140 0x7f2064110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f20637fe640 1 -- 172.21.15.33:0/1468411138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20641a8440 con 0x7f2064108a90 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f20637fe640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2064108a90 0x7f20641107d0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f205c00cce0 tx=0x7f205c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f206890a640 1 -- 172.21.15.33:0/1468411138 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c00f450 con 0x7f2064108a90 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f206890a640 1 -- 172.21.15.33:0/1468411138 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c00faa0 con 0x7f2064108a90 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f206990c640 1 -- 172.21.15.33:0/1468411138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20641a8730 con 0x7f2064108a90 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f206890a640 1 -- 172.21.15.33:0/1468411138 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c018b70 con 0x7f2064108a90 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.960+0000 7f206990c640 1 -- 172.21.15.33:0/1468411138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20641a8cc0 con 0x7f2064108a90 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.963+0000 7f206fe81740 1 Processor -- start 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.963+0000 7f206890a640 1 -- 172.21.15.33:0/1468411138 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f205c00f5f0 con 0x7f2064108a90 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.963+0000 7f206fe81740 1 -- start start 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.963+0000 7f206fe81740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8f99310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.963+0000 7f206fe81740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8f99850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.963+0000 7f206fe81740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8f99d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.963+0000 7f206fe81740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5604d8f10680 con 0x5604d8bd3390 2024-08-28T19:37:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.963+0000 7f206fe81740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5604d8effc10 con 0x5604d8bcb1b0 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.963+0000 7f206fe81740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5604d8f03bc0 con 0x5604d8bf4070 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8f99d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8f99d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41248/0 (socket says 172.21.15.33:41248) 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 -- 172.21.15.33:0/472666814 learned_addr learned my addr 172.21.15.33:0/472666814 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 --2- 172.21.15.33:0/472666814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8f99310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f2062ffd640 1 --2- 172.21.15.33:0/472666814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8f99850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 -- 172.21.15.33:0/472666814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 msgr2=0x5604d8f99310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 --2- 172.21.15.33:0/472666814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8f99310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 -- 172.21.15.33:0/472666814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 msgr2=0x5604d8f99850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 --2- 172.21.15.33:0/472666814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8f99850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 -- 172.21.15.33:0/472666814 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604d8c5f650 con 0x5604d8bd3390 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f206890a640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f20500b4d20 0x7f20500b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f2062ffd640 1 --2- 172.21.15.33:0/472666814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8f99850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f206890a640 1 -- 172.21.15.33:0/1468411138 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f205c0e5b20 con 0x7f2064108a90 2024-08-28T19:37:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 --2- 172.21.15.33:0/472666814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8f99d90 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f204c011700 tx=0x7f204c00a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ba99c24ca2593 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f205a7fc640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f20500b4d20 0x7f20500b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f2059ffb640 1 -- 172.21.15.33:0/472666814 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c00f7c0 con 0x5604d8bd3390 2024-08-28T19:37:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f2059ffb640 1 -- 172.21.15.33:0/472666814 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c00fe10 con 0x5604d8bd3390 2024-08-28T19:37:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.964+0000 7f2059ffb640 1 -- 172.21.15.33:0/472666814 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c01c750 con 0x5604d8bd3390 2024-08-28T19:37:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f206fe81740 1 -- 172.21.15.33:0/472666814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 msgr2=0x5604d8f99d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f205a7fc640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f20500b4d20 0x7f20500b7230 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f204c01d000 tx=0x7f204c01ec70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f206fe81740 1 --2- 172.21.15.33:0/472666814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8f99d90 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f204c011700 tx=0x7f204c00a6a0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f206fe81740 1 -- 172.21.15.33:0/472666814 shutdown_connections 2024-08-28T19:37:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f206fe81740 1 --2- 172.21.15.33:0/472666814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8f99d90 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f206fe81740 1 --2- 172.21.15.33:0/472666814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8f99850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f206fe81740 1 --2- 172.21.15.33:0/472666814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8f99310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f206fe81740 1 -- 172.21.15.33:0/472666814 >> 172.21.15.33:0/472666814 conn(0x5604d8be8460 msgr2=0x5604d8f97200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f206fe81740 1 -- 172.21.15.33:0/472666814 shutdown_connections 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f206fe81740 1 -- 172.21.15.33:0/472666814 wait complete. 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.966+0000 7f206fe81740 1 -- start start 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f206fe81740 1 Processor -- start 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f206fe81740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8fa4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f206fe81740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fa4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f206fe81740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fb0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f206fe81740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5604d8d62700 con 0x5604d8bd3390 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f206fe81740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5604d8e86750 con 0x5604d8bcb1b0 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f206fe81740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5604d8fa7af0 con 0x5604d8bf4070 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f206fe81740 10 client.0 _ll_register_callbacks cb 0x5604d8eb5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f205a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fa4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f205a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fa4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41258/0 (socket says 172.21.15.33:41258) 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f205a7fc640 1 -- 172.21.15.33:0/1610049910 learned_addr learned my addr 172.21.15.33:0/1610049910 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f2062ffd640 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8fa4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f20637fe640 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fb0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f205a7fc640 1 -- 172.21.15.33:0/1610049910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 msgr2=0x5604d8fb0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.967+0000 7f205a7fc640 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fb0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f205a7fc640 1 -- 172.21.15.33:0/1610049910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 msgr2=0x5604d8fa4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f205a7fc640 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8fa4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f205a7fc640 1 -- 172.21.15.33:0/1610049910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604d8ebf900 con 0x5604d8bd3390 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f20637fe640 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fb0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f205a7fc640 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fa4f90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f204c01e790 tx=0x7f204c025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1994a59a75f03ea server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f2042ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:50.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f2042ffd640 1 -- 172.21.15.33:0/1610049910 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c036060 con 0x5604d8bd3390 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f2042ffd640 1 -- 172.21.15.33:0/1610049910 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f204c01c750 con 0x5604d8bd3390 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f206fe81740 1 -- 172.21.15.33:0/1610049910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f204c00fe10 con 0x5604d8bd3390 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f2042ffd640 1 -- 172.21.15.33:0/1610049910 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f204c03d050 con 0x5604d8bd3390 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f206fe81740 10 client.17151 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f206fe81740 1 -- 172.21.15.33:0/1610049910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5604d8fb37f0 con 0x5604d8bd3390 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.968+0000 7f2042ffd640 1 -- 172.21.15.33:0/1610049910 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c00fe10 con 0x5604d8bd3390 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.969+0000 7f2042ffd640 1 -- 172.21.15.33:0/1610049910 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f204c029450 con 0x5604d8bd3390 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.969+0000 7f206fe81740 10 client.17151 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.969+0000 7f206fe81740 10 client.17151 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.969+0000 7f206fe81740 20 client.17151 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.969+0000 7f206fe81740 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5604d8bb29f0 0x5604d8fb6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.969+0000 7f206fe81740 4 client.17151 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.969+0000 7f206fe81740 1 -- 172.21.15.33:0/1610049910 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604d8f125d0 con 0x5604d8bb29f0 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.969+0000 7f2062ffd640 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5604d8bb29f0 0x5604d8fb6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.970+0000 7f2062ffd640 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5604d8bb29f0 0x5604d8fb6c00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8e3d5bea03c7ad16 server_cookie=a66f9811b715a178 in_seq=0 out_seq=0 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.970+0000 7f2042ffd640 10 client.17151 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.970+0000 7f2042ffd640 1 -- 172.21.15.33:0/1610049910 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604d8f125d0 con 0x5604d8bb29f0 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.970+0000 7f2042ffd640 10 client.17151 handle_command_reply: tid=0 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.970+0000 7f206fe81740 1 client.17151 shutdown 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 1 -- 172.21.15.33:0/1610049910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 msgr2=0x5604d8fa4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fa4f90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f204c01e790 tx=0x7f204c025000 comp rx=0 tx=0).stop 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 1 -- 172.21.15.33:0/1610049910 shutdown_connections 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5604d8bb29f0 0x5604d8fb6c00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f2042ffd640 0 client.17151 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fb0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fa4f90 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 1 --2- 172.21.15.33:0/1610049910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8fa4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 1 -- 172.21.15.33:0/1610049910 >> 172.21.15.33:0/1610049910 conn(0x5604d8be8460 msgr2=0x5604d8f9c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:50.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 1 -- 172.21.15.33:0/1610049910 shutdown_connections 2024-08-28T19:37:50.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 1 -- 172.21.15.33:0/1610049910 wait complete. 2024-08-28T19:37:50.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.971+0000 7f206fe81740 20 client.17151 trim_cache size 0 max 16384 2024-08-28T19:37:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f206fe81740 1 Processor -- start 2024-08-28T19:37:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f206fe81740 1 -- start start 2024-08-28T19:37:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f206fe81740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8f9c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f206fe81740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fb0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f206fe81740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fa1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f206fe81740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b2ce0 con 0x5604d8bd3390 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f206fe81740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b4820 con 0x5604d8bcb1b0 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f206fe81740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b33b0 con 0x5604d8bf4070 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f205a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fb0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f205a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fb0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41262/0 (socket says 172.21.15.33:41262) 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.984+0000 7f205a7fc640 1 -- 172.21.15.33:0/3835345829 learned_addr learned my addr 172.21.15.33:0/3835345829 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f20637fe640 1 --2- 172.21.15.33:0/3835345829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fa1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f2062ffd640 1 --2- 172.21.15.33:0/3835345829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8f9c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f205a7fc640 1 -- 172.21.15.33:0/3835345829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 msgr2=0x5604d8fa1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f205a7fc640 1 --2- 172.21.15.33:0/3835345829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fa1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f205a7fc640 1 -- 172.21.15.33:0/3835345829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 msgr2=0x5604d8f9c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:50.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f205a7fc640 1 --2- 172.21.15.33:0/3835345829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8f9c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f205a7fc640 1 -- 172.21.15.33:0/3835345829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604d8f9b600 con 0x5604d8bd3390 2024-08-28T19:37:50.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f20637fe640 1 --2- 172.21.15.33:0/3835345829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fa1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:50.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f205a7fc640 1 --2- 172.21.15.33:0/3835345829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fb0ce0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f204c01ed50 tx=0x7f204c00faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb69d433f4465b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:50.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f20597fa640 1 -- 172.21.15.33:0/3835345829 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c036040 con 0x5604d8bd3390 2024-08-28T19:37:50.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f20597fa640 1 -- 172.21.15.33:0/3835345829 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c046070 con 0x5604d8bd3390 2024-08-28T19:37:50.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.985+0000 7f20597fa640 1 -- 172.21.15.33:0/3835345829 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c029450 con 0x5604d8bd3390 2024-08-28T19:37:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 -- 172.21.15.33:0/3835345829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 msgr2=0x5604d8fb0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 --2- 172.21.15.33:0/3835345829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fb0ce0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f204c01ed50 tx=0x7f204c00faa0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 -- 172.21.15.33:0/3835345829 shutdown_connections 2024-08-28T19:37:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 --2- 172.21.15.33:0/3835345829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fa1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 --2- 172.21.15.33:0/3835345829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bd3390 0x5604d8fb0ce0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 --2- 172.21.15.33:0/3835345829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bcb1b0 0x5604d8f9c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 -- 172.21.15.33:0/3835345829 >> 172.21.15.33:0/3835345829 conn(0x5604d8be8460 msgr2=0x5604d8f9c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 -- 172.21.15.33:0/3835345829 shutdown_connections 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 -- 172.21.15.33:0/3835345829 wait complete. 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 -- start start 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.986+0000 7f206fe81740 1 Processor -- start 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f206fe81740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bcb1b0 0x5604d8fad650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f206fe81740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bd3390 0x5604d8fa8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f206fe81740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fa91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f206fe81740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b4150 con 0x5604d8bcb1b0 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f206fe81740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b3a80 con 0x5604d8bd3390 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f206fe81740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f20641b0cc0 con 0x5604d8bf4070 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f2062ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bcb1b0 0x5604d8fad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f206fe81740 10 client.0 _ll_register_callbacks cb 0x7f204c00adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f2062ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bcb1b0 0x5604d8fad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41274/0 (socket says 172.21.15.33:41274) 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f2062ffd640 1 -- 172.21.15.33:0/3926674989 learned_addr learned my addr 172.21.15.33:0/3926674989 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f205a7fc640 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bd3390 0x5604d8fa8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f20637fe640 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fa91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f2062ffd640 1 -- 172.21.15.33:0/3926674989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 msgr2=0x5604d8fa91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f2062ffd640 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fa91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f2062ffd640 1 -- 172.21.15.33:0/3926674989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bd3390 msgr2=0x5604d8fa8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f2062ffd640 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bd3390 0x5604d8fa8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.987+0000 7f2062ffd640 1 -- 172.21.15.33:0/3926674989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604d8fa9910 con 0x5604d8bcb1b0 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f2062ffd640 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bcb1b0 0x5604d8fad650 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f2054009900 tx=0x7f2054004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ee1aa45c774b13 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f2042ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:50.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f2042ffd640 1 -- 172.21.15.33:0/3926674989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054035040 con 0x5604d8bcb1b0 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f2042ffd640 1 -- 172.21.15.33:0/3926674989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f20540316a0 con 0x5604d8bcb1b0 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f206fe81740 1 -- 172.21.15.33:0/3926674989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f204c046070 con 0x5604d8bcb1b0 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f2042ffd640 1 -- 172.21.15.33:0/3926674989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2054055050 con 0x5604d8bcb1b0 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f206fe81740 10 client.17157 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f206fe81740 1 -- 172.21.15.33:0/3926674989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5604d90214f0 con 0x5604d8bcb1b0 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f2042ffd640 1 -- 172.21.15.33:0/3926674989 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c046070 con 0x5604d8bcb1b0 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f2042ffd640 1 -- 172.21.15.33:0/3926674989 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f205403d450 con 0x5604d8bcb1b0 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f206fe81740 10 client.17157 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f206fe81740 10 client.17157 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f206fe81740 20 client.17157 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f206fe81740 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5604d8b87da0 0x5604d9023ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:50.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f206fe81740 4 client.17157 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.988+0000 7f206fe81740 1 -- 172.21.15.33:0/3926674989 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604d8f0e070 con 0x5604d8b87da0 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.989+0000 7f205a7fc640 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5604d8b87da0 0x5604d9023ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.989+0000 7f2042ffd640 10 client.17157 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.989+0000 7f205a7fc640 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5604d8b87da0 0x5604d9023ce0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8e85f6b63ffad058 server_cookie=13e76295a85555c8 in_seq=0 out_seq=0 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.989+0000 7f2042ffd640 1 -- 172.21.15.33:0/3926674989 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604d8f0e070 con 0x5604d8b87da0 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.989+0000 7f2042ffd640 10 client.17157 handle_command_reply: tid=0 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.989+0000 7f206fe81740 1 client.17157 shutdown 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 1 -- 172.21.15.33:0/3926674989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bcb1b0 msgr2=0x5604d8fad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bcb1b0 0x5604d8fad650 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f2054009900 tx=0x7f2054004130 comp rx=0 tx=0).stop 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 1 -- 172.21.15.33:0/3926674989 shutdown_connections 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5604d8b87da0 0x5604d9023ce0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f2042ffd640 0 client.17157 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:37:50.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604d8bf4070 0x5604d8fa91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604d8bd3390 0x5604d8fa8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 1 --2- 172.21.15.33:0/3926674989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604d8bcb1b0 0x5604d8fad650 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 1 -- 172.21.15.33:0/3926674989 >> 172.21.15.33:0/3926674989 conn(0x5604d8be8460 msgr2=0x5604d8f97170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 1 -- 172.21.15.33:0/3926674989 shutdown_connections 2024-08-28T19:37:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 1 -- 172.21.15.33:0/3926674989 wait complete. 2024-08-28T19:37:50.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.990+0000 7f206fe81740 20 client.17157 trim_cache size 0 max 16384 2024-08-28T19:37:50.998 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:37:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 -- 172.21.15.33:0/1468411138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f20500b4d20 msgr2=0x7f20500b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f20500b4d20 0x7f20500b7230 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f204c01d000 tx=0x7f204c01ec70 comp rx=0 tx=0).stop 2024-08-28T19:37:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 -- 172.21.15.33:0/1468411138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2064108a90 msgr2=0x7f20641107d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2064108a90 0x7f20641107d0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f205c00cce0 tx=0x7f205c00a620 comp rx=0 tx=0).stop 2024-08-28T19:37:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 -- 172.21.15.33:0/1468411138 shutdown_connections 2024-08-28T19:37:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2064108a90 0x7f20641107d0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2064108140 0x7f2064110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f20500b4d20 0x7f20500b7230 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 --2- 172.21.15.33:0/1468411138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2064102800 0x7f206410fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:50.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 -- 172.21.15.33:0/1468411138 >> 172.21.15.33:0/1468411138 conn(0x7f20640794d0 msgr2=0x7f2064101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 -- 172.21.15.33:0/1468411138 shutdown_connections 2024-08-28T19:37:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:50.991+0000 7f206990c640 1 -- 172.21.15.33:0/1468411138 wait complete. 2024-08-28T19:37:51.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:51 smithi059 ceph-mon[22052]: pgmap v504: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-08-28T19:37:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:51 smithi122 ceph-mon[22174]: pgmap v504: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-08-28T19:37:51.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:51 smithi033 ceph-mon[18549]: pgmap v504: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-08-28T19:37:52.033 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:37:52.295 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:52.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.786+0000 7fd9fc666640 1 -- 172.21.15.33:0/3790151436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9f4108140 msgr2=0x7fd9f4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:52.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.786+0000 7fd9fc666640 1 --2- 172.21.15.33:0/3790151436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9f4108140 0x7fd9f4108550 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009900 tx=0x7fd9e402a410 comp rx=0 tx=0).stop 2024-08-28T19:37:52.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.786+0000 7fd9fc666640 1 -- 172.21.15.33:0/3790151436 shutdown_connections 2024-08-28T19:37:52.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.786+0000 7fd9fc666640 1 --2- 172.21.15.33:0/3790151436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f4108a90 0x7fd9f410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.786+0000 7fd9fc666640 1 --2- 172.21.15.33:0/3790151436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9f4108140 0x7fd9f4108550 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.786+0000 7fd9fc666640 1 --2- 172.21.15.33:0/3790151436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f4102800 0x7fd9f4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.786+0000 7fd9fc666640 1 -- 172.21.15.33:0/3790151436 >> 172.21.15.33:0/3790151436 conn(0x7fd9f40794d0 msgr2=0x7fd9f40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:52.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.786+0000 7fd9fc666640 1 -- 172.21.15.33:0/3790151436 shutdown_connections 2024-08-28T19:37:52.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.786+0000 7fd9fc666640 1 -- 172.21.15.33:0/3790151436 wait complete. 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fc666640 1 Processor -- start 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fc666640 1 -- start start 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fc666640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9f4102800 0x7fd9f419b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fc666640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f4108140 0x7fd9f419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fc666640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f4108a90 0x7fd9f419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fc666640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f41126e0 con 0x7fd9f4102800 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fc666640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f4112560 con 0x7fd9f4108140 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fc666640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f4112860 con 0x7fd9f4108a90 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fa402640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9f4102800 0x7fd9f419b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fa402640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9f4102800 0x7fd9f419b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41294/0 (socket says 172.21.15.33:41294) 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.787+0000 7fd9fa402640 1 -- 172.21.15.33:0/3029443678 learned_addr learned my addr 172.21.15.33:0/3029443678 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:52.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f4108140 0x7fd9f419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9fac03640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f4108a90 0x7fd9f419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9fa402640 1 -- 172.21.15.33:0/3029443678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f4108a90 msgr2=0x7fd9f419ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9fa402640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f4108a90 0x7fd9f419ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9fa402640 1 -- 172.21.15.33:0/3029443678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f4108140 msgr2=0x7fd9f419b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9fa402640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f4108140 0x7fd9f419b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9fa402640 1 -- 172.21.15.33:0/3029443678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f41a62d0 con 0x7fd9f4102800 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9fac03640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f4108a90 0x7fd9f419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9fa402640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9f4102800 0x7fd9f419b010 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000e9f0 tx=0x7fd9f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9eb7fe640 1 -- 172.21.15.33:0/3029443678 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000cd80 con 0x7fd9f4102800 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9eb7fe640 1 -- 172.21.15.33:0/3029443678 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9f00054d0 con 0x7fd9f4102800 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9fc666640 1 -- 172.21.15.33:0/3029443678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f41a65c0 con 0x7fd9f4102800 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9eb7fe640 1 -- 172.21.15.33:0/3029443678 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0010690 con 0x7fd9f4102800 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.788+0000 7fd9fc666640 1 -- 172.21.15.33:0/3029443678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f41a6ad0 con 0x7fd9f4102800 2024-08-28T19:37:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.791+0000 7fd9eb7fe640 1 -- 172.21.15.33:0/3029443678 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd9f0004e90 con 0x7fd9f4102800 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.791+0000 7fda02bdb740 1 Processor -- start 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.791+0000 7fda02bdb740 1 -- start start 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.791+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6e2070 0x559d8ea87310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.791+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6b91b0 0x559d8ea87850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.791+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 0x559d8ea87d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.791+0000 7fda02bdb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559d8e9fe680 con 0x559d8e6e2070 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.791+0000 7fda02bdb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559d8e9edc10 con 0x559d8e6c1390 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.791+0000 7fda02bdb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559d8e9f1bc0 con 0x559d8e6b91b0 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fac03640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6e2070 0x559d8ea87310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fac03640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6e2070 0x559d8ea87310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41310/0 (socket says 172.21.15.33:41310) 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fac03640 1 -- 172.21.15.33:0/1449382740 learned_addr learned my addr 172.21.15.33:0/1449382740 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/1449382740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 0x559d8ea87d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9eb7fe640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd9e00b4d20 0x7fd9e00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fa402640 1 --2- 172.21.15.33:0/1449382740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6b91b0 0x559d8ea87850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fac03640 1 -- 172.21.15.33:0/1449382740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6b91b0 msgr2=0x559d8ea87850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fac03640 1 --2- 172.21.15.33:0/1449382740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6b91b0 0x559d8ea87850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fac03640 1 -- 172.21.15.33:0/1449382740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 msgr2=0x559d8ea87d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fac03640 1 --2- 172.21.15.33:0/1449382740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 0x559d8ea87d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fac03640 1 -- 172.21.15.33:0/1449382740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d8e74d650 con 0x559d8e6e2070 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/1449382740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 0x559d8ea87d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fac03640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd9e00b4d20 0x7fd9e00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9eb7fe640 1 -- 172.21.15.33:0/3029443678 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd9f00e5df0 con 0x7fd9f4102800 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.792+0000 7fd9fac03640 1 --2- 172.21.15.33:0/1449382740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6e2070 0x559d8ea87310 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00f4b0 tx=0x7fd9ec00f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e906c28bd189fdb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.793+0000 7fd9e8ff9640 1 -- 172.21.15.33:0/1449382740 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec018070 con 0x559d8e6e2070 2024-08-28T19:37:52.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.793+0000 7fd9e8ff9640 1 -- 172.21.15.33:0/1449382740 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9ec021070 con 0x559d8e6e2070 2024-08-28T19:37:52.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.793+0000 7fd9e8ff9640 1 -- 172.21.15.33:0/1449382740 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec025a50 con 0x559d8e6e2070 2024-08-28T19:37:52.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.793+0000 7fd9fac03640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd9e00b4d20 0x7fd9e00b7230 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec020000 tx=0x7fd9ec01e000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.793+0000 7fda02bdb740 1 -- 172.21.15.33:0/1449382740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6e2070 msgr2=0x559d8ea87310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.793+0000 7fda02bdb740 1 --2- 172.21.15.33:0/1449382740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6e2070 0x559d8ea87310 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00f4b0 tx=0x7fd9ec00f970 comp rx=0 tx=0).stop 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.793+0000 7fda02bdb740 1 -- 172.21.15.33:0/1449382740 shutdown_connections 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.793+0000 7fda02bdb740 1 --2- 172.21.15.33:0/1449382740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 0x559d8ea87d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.793+0000 7fda02bdb740 1 --2- 172.21.15.33:0/1449382740 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6b91b0 0x559d8ea87850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.793+0000 7fda02bdb740 1 --2- 172.21.15.33:0/1449382740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6e2070 0x559d8ea87310 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 -- 172.21.15.33:0/1449382740 >> 172.21.15.33:0/1449382740 conn(0x559d8e6d6460 msgr2=0x559d8ea85200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 -- 172.21.15.33:0/1449382740 shutdown_connections 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 -- 172.21.15.33:0/1449382740 wait complete. 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 -- start start 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 Processor -- start 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea92b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 0x559d8ea93080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6e2070 0x559d8ea9ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559d8e850700 con 0x559d8e6b91b0 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559d8e974750 con 0x559d8e6c1390 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559d8ea95af0 con 0x559d8e6e2070 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fda02bdb740 10 client.0 _ll_register_callbacks cb 0x559d8e9a3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fd9fa402640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.794+0000 7fd9fa402640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea92b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41326/0 (socket says 172.21.15.33:41326) 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9fa402640 1 -- 172.21.15.33:0/2461181424 learned_addr learned my addr 172.21.15.33:0/2461181424 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 0x559d8ea93080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9fac03640 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6e2070 0x559d8ea9ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9fa402640 1 -- 172.21.15.33:0/2461181424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6e2070 msgr2=0x559d8ea9ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9fa402640 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6e2070 0x559d8ea9ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9fa402640 1 -- 172.21.15.33:0/2461181424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 msgr2=0x559d8ea93080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9fa402640 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 0x559d8ea93080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9fa402640 1 -- 172.21.15.33:0/2461181424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d8e9ad900 con 0x559d8e6b91b0 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 0x559d8ea93080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9fa402640 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea92b00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00e3250 tx=0x7fd9f00abba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a350cb9e0d8f6a62 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9ddffb640 1 -- 172.21.15.33:0/2461181424 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0005180 con 0x559d8e6b91b0 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9ddffb640 1 -- 172.21.15.33:0/2461181424 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd9f00a8420 con 0x559d8e6b91b0 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fda02bdb740 1 -- 172.21.15.33:0/2461181424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9ec021070 con 0x559d8e6b91b0 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fd9ddffb640 1 -- 172.21.15.33:0/2461181424 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd9f00abca0 con 0x559d8e6b91b0 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fda02bdb740 10 client.17169 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.795+0000 7fda02bdb740 1 -- 172.21.15.33:0/2461181424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d8eaa1950 con 0x559d8e6b91b0 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.796+0000 7fd9ddffb640 1 -- 172.21.15.33:0/2461181424 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9ec021070 con 0x559d8e6b91b0 2024-08-28T19:37:52.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.796+0000 7fd9ddffb640 1 -- 172.21.15.33:0/2461181424 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd9f00a7b00 con 0x559d8e6b91b0 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.796+0000 7fda02bdb740 10 client.17169 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.796+0000 7fda02bdb740 10 client.17169 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.796+0000 7fda02bdb740 20 client.17169 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.796+0000 7fda02bdb740 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x559d8e6a09f0 0x559d8eaa4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.796+0000 7fda02bdb740 4 client.17169 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.796+0000 7fda02bdb740 1 -- 172.21.15.33:0/2461181424 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d8ea005d0 con 0x559d8e6a09f0 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.796+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x559d8e6a09f0 0x559d8eaa4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.797+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x559d8e6a09f0 0x559d8eaa4d40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c4273f8ec8fb8ae server_cookie=6c122ee58b42b5f0 in_seq=0 out_seq=0 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.797+0000 7fd9ddffb640 10 client.17169 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.797+0000 7fd9ddffb640 1 -- 172.21.15.33:0/2461181424 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d8ea005d0 con 0x559d8e6a09f0 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.797+0000 7fd9ddffb640 10 client.17169 handle_command_reply: tid=0 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.797+0000 7fda02bdb740 1 client.17169 shutdown 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 1 -- 172.21.15.33:0/2461181424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 msgr2=0x559d8ea92b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:52.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea92b00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00e3250 tx=0x7fd9f00abba0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 1 -- 172.21.15.33:0/2461181424 shutdown_connections 2024-08-28T19:37:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6e2070 0x559d8ea9ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6c1390 0x559d8ea93080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x559d8e6a09f0 0x559d8eaa4d40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 1 --2- 172.21.15.33:0/2461181424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea92b00 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fd9ddffb640 0 client.17169 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:37:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 1 -- 172.21.15.33:0/2461181424 >> 172.21.15.33:0/2461181424 conn(0x559d8e6d6460 msgr2=0x559d8ea8a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 1 -- 172.21.15.33:0/2461181424 shutdown_connections 2024-08-28T19:37:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 1 -- 172.21.15.33:0/2461181424 wait complete. 2024-08-28T19:37:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.798+0000 7fda02bdb740 20 client.17169 trim_cache size 0 max 16384 2024-08-28T19:37:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fda02bdb740 1 Processor -- start 2024-08-28T19:37:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fda02bdb740 1 -- start start 2024-08-28T19:37:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 0x559d8ea88d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea94730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6c1390 0x559d8ea9ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fda02bdb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f41b0aa0 con 0x559d8e6b91b0 2024-08-28T19:37:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fda02bdb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f41b25e0 con 0x559d8e6d6460 2024-08-28T19:37:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fda02bdb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f41b1170 con 0x559d8e6c1390 2024-08-28T19:37:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fd9f9c01640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea94730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fd9f9c01640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea94730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41338/0 (socket says 172.21.15.33:41338) 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fd9f9c01640 1 -- 172.21.15.33:0/2900692157 learned_addr learned my addr 172.21.15.33:0/2900692157 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fd9fa402640 1 --2- 172.21.15.33:0/2900692157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 0x559d8ea88d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fd9f9c01640 1 -- 172.21.15.33:0/2900692157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6c1390 msgr2=0x559d8ea9ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/2900692157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6c1390 0x559d8ea9ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fd9f9c01640 1 -- 172.21.15.33:0/2900692157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 msgr2=0x559d8ea88d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.812+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/2900692157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 0x559d8ea88d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.813+0000 7fd9f9c01640 1 -- 172.21.15.33:0/2900692157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d8ea934e0 con 0x559d8e6b91b0 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.813+0000 7fd9fa402640 1 --2- 172.21.15.33:0/2900692157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 0x559d8ea88d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.813+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/2900692157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea94730 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009850 tx=0x7fd9e4005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc8f856472ede6b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.813+0000 7fd9dffff640 1 -- 172.21.15.33:0/2900692157 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4035040 con 0x559d8e6b91b0 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.813+0000 7fd9dffff640 1 -- 172.21.15.33:0/2900692157 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9e40054f0 con 0x559d8e6b91b0 2024-08-28T19:37:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.813+0000 7fd9dffff640 1 -- 172.21.15.33:0/2900692157 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4004ba0 con 0x559d8e6b91b0 2024-08-28T19:37:52.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.814+0000 7fda02bdb740 1 -- 172.21.15.33:0/2900692157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 msgr2=0x559d8ea94730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:52.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.814+0000 7fda02bdb740 1 --2- 172.21.15.33:0/2900692157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea94730 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009850 tx=0x7fd9e4005a20 comp rx=0 tx=0).stop 2024-08-28T19:37:52.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.814+0000 7fda02bdb740 1 -- 172.21.15.33:0/2900692157 shutdown_connections 2024-08-28T19:37:52.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.814+0000 7fda02bdb740 1 --2- 172.21.15.33:0/2900692157 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6c1390 0x559d8ea9ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.814+0000 7fda02bdb740 1 --2- 172.21.15.33:0/2900692157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea94730 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.814+0000 7fda02bdb740 1 --2- 172.21.15.33:0/2900692157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 0x559d8ea88d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.814+0000 7fda02bdb740 1 -- 172.21.15.33:0/2900692157 >> 172.21.15.33:0/2900692157 conn(0x559d8ea8e450 msgr2=0x559d8ea94020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:52.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.814+0000 7fda02bdb740 1 -- 172.21.15.33:0/2900692157 shutdown_connections 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.814+0000 7fda02bdb740 1 -- 172.21.15.33:0/2900692157 wait complete. 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.814+0000 7fda02bdb740 1 -- start start 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fda02bdb740 1 Processor -- start 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea995a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6c1390 0x559d8ea99ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fda02bdb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 0x559d8eb0e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fda02bdb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f41b1f10 con 0x559d8e6b91b0 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fda02bdb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f41b1840 con 0x559d8e6d6460 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fda02bdb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f41aea80 con 0x559d8e6c1390 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fda02bdb740 10 client.0 _ll_register_callbacks cb 0x7fd9f00abf60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fa402640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fa402640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41352/0 (socket says 172.21.15.33:41352) 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fa402640 1 -- 172.21.15.33:0/1217477991 learned_addr learned my addr 172.21.15.33:0/1217477991 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fac03640 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 0x559d8eb0e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fa402640 1 -- 172.21.15.33:0/1217477991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6c1390 msgr2=0x559d8ea99ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6c1390 0x559d8ea99ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fa402640 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6c1390 0x559d8ea99ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fa402640 1 -- 172.21.15.33:0/1217477991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 msgr2=0x559d8eb0e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fa402640 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 0x559d8eb0e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fa402640 1 -- 172.21.15.33:0/1217477991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d8eb0ed00 con 0x559d8e6b91b0 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fac03640 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 0x559d8eb0e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9fa402640 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea995a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00e37f0 tx=0x7fd9f00e6170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41b40d2e2103076 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.815+0000 7fd9ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fd9ddffb640 1 -- 172.21.15.33:0/1217477991 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f00c5030 con 0x559d8e6b91b0 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fd9ddffb640 1 -- 172.21.15.33:0/1217477991 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fd9f00a8780 con 0x559d8e6b91b0 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fda02bdb740 1 -- 172.21.15.33:0/1217477991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9e40054f0 con 0x559d8e6b91b0 2024-08-28T19:37:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fd9ddffb640 1 -- 172.21.15.33:0/1217477991 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd9f0005180 con 0x559d8e6b91b0 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fda02bdb740 10 client.17175 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fda02bdb740 1 -- 172.21.15.33:0/1217477991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d8eb0fed0 con 0x559d8e6b91b0 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fd9ddffb640 1 -- 172.21.15.33:0/1217477991 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9e40054f0 con 0x559d8e6b91b0 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fd9ddffb640 1 -- 172.21.15.33:0/1217477991 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd9f00c1aa0 con 0x559d8e6b91b0 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fda02bdb740 10 client.17175 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fda02bdb740 10 client.17175 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fda02bdb740 20 client.17175 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fda02bdb740 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x559d8e6e2070 0x559d8eb126c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fda02bdb740 4 client.17175 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.816+0000 7fda02bdb740 1 -- 172.21.15.33:0/1217477991 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d8e9fc070 con 0x559d8e6e2070 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.817+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x559d8e6e2070 0x559d8eb126c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.817+0000 7fd9f9c01640 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x559d8e6e2070 0x559d8eb126c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1d2c1429fd49e7f server_cookie=ac6e59bfcfd5ef90 in_seq=0 out_seq=0 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.817+0000 7fd9ddffb640 10 client.17175 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:37:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.817+0000 7fd9ddffb640 1 -- 172.21.15.33:0/1217477991 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d8e9fc070 con 0x559d8e6e2070 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.817+0000 7fd9ddffb640 10 client.17175 handle_command_reply: tid=0 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.817+0000 7fda02bdb740 1 client.17175 shutdown 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 1 -- 172.21.15.33:0/1217477991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 msgr2=0x559d8ea995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea995a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00e37f0 tx=0x7fd9f00e6170 comp rx=0 tx=0).stop 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 1 -- 172.21.15.33:0/1217477991 shutdown_connections 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d8e6d6460 0x559d8eb0e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559d8e6c1390 0x559d8ea99ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x559d8e6e2070 0x559d8eb126c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 1 --2- 172.21.15.33:0/1217477991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559d8e6b91b0 0x559d8ea995a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 1 -- 172.21.15.33:0/1217477991 >> 172.21.15.33:0/1217477991 conn(0x559d8ea8e450 msgr2=0x559d8ea94890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9ddffb640 0 client.17175 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 1 -- 172.21.15.33:0/1217477991 shutdown_connections 2024-08-28T19:37:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 1 -- 172.21.15.33:0/1217477991 wait complete. 2024-08-28T19:37:52.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fda02bdb740 20 client.17175 trim_cache size 0 max 16384 2024-08-28T19:37:52.825 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:37:52.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 -- 172.21.15.33:0/3029443678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd9e00b4d20 msgr2=0x7fd9e00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd9e00b4d20 0x7fd9e00b7230 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec020000 tx=0x7fd9ec01e000 comp rx=0 tx=0).stop 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 -- 172.21.15.33:0/3029443678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9f4102800 msgr2=0x7fd9f419b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9f4102800 0x7fd9f419b010 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000e9f0 tx=0x7fd9f000edf0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 -- 172.21.15.33:0/3029443678 shutdown_connections 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd9e00b4d20 0x7fd9e00b7230 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd9f4108a90 0x7fd9f419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f4108140 0x7fd9f419b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 --2- 172.21.15.33:0/3029443678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9f4102800 0x7fd9f419b010 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 -- 172.21.15.33:0/3029443678 >> 172.21.15.33:0/3029443678 conn(0x7fd9f40794d0 msgr2=0x7fd9f41041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.818+0000 7fd9fc666640 1 -- 172.21.15.33:0/3029443678 shutdown_connections 2024-08-28T19:37:52.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:52.819+0000 7fd9fc666640 1 -- 172.21.15.33:0/3029443678 wait complete. 2024-08-28T19:37:53.693 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:53 smithi033 ceph-mon[18549]: pgmap v505: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-08-28T19:37:53.725 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:37:53.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:53 smithi059 ceph-mon[22052]: pgmap v505: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-08-28T19:37:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:53 smithi122 ceph-mon[22174]: pgmap v505: 129 pgs: 129 active+clean; 5.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-08-28T19:37:53.981 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.592+0000 7f66ae3ff640 1 -- 172.21.15.33:0/1084698556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a8104680 msgr2=0x7f66a8104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.592+0000 7f66ae3ff640 1 --2- 172.21.15.33:0/1084698556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a8104680 0x7f66a8104a90 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f6698009900 tx=0x7f669802a410 comp rx=0 tx=0).stop 2024-08-28T19:37:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.592+0000 7f66ae3ff640 1 -- 172.21.15.33:0/1084698556 shutdown_connections 2024-08-28T19:37:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.592+0000 7f66ae3ff640 1 --2- 172.21.15.33:0/1084698556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a810dc30 0x7f66a81100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.592+0000 7f66ae3ff640 1 --2- 172.21.15.33:0/1084698556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a81050b0 0x7f66a810d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.592+0000 7f66ae3ff640 1 --2- 172.21.15.33:0/1084698556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a8104680 0x7f66a8104a90 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.592+0000 7f66ae3ff640 1 -- 172.21.15.33:0/1084698556 >> 172.21.15.33:0/1084698556 conn(0x7f66a8079500 msgr2=0x7f66a8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.592+0000 7f66ae3ff640 1 -- 172.21.15.33:0/1084698556 shutdown_connections 2024-08-28T19:37:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.592+0000 7f66ae3ff640 1 -- 172.21.15.33:0/1084698556 wait complete. 2024-08-28T19:37:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.592+0000 7f66ae3ff640 1 Processor -- start 2024-08-28T19:37:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66ae3ff640 1 -- start start 2024-08-28T19:37:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66ae3ff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a8104680 0x7f66a8102590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66ae3ff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a81050b0 0x7f66a8102ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66ae3ff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a810dc30 0x7f66a8103010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66ae3ff640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8113860 con 0x7f66a81050b0 2024-08-28T19:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66ae3ff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81136e0 con 0x7f66a8104680 2024-08-28T19:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66ae3ff640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81139e0 con 0x7f66a810dc30 2024-08-28T19:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66a77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a81050b0 0x7f66a8102ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66a77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a81050b0 0x7f66a8102ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41364/0 (socket says 172.21.15.33:41364) 2024-08-28T19:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66a77fe640 1 -- 172.21.15.33:0/815306457 learned_addr learned my addr 172.21.15.33:0/815306457 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66a7fff640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a8104680 0x7f66a8102590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.593+0000 7f66ac99c640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a810dc30 0x7f66a8103010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66a77fe640 1 -- 172.21.15.33:0/815306457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a810dc30 msgr2=0x7f66a8103010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66a77fe640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a810dc30 0x7f66a8103010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66a77fe640 1 -- 172.21.15.33:0/815306457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a8104680 msgr2=0x7f66a8102590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66a77fe640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a8104680 0x7f66a8102590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66a77fe640 1 -- 172.21.15.33:0/815306457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a81a84c0 con 0x7f66a81050b0 2024-08-28T19:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66a7fff640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a8104680 0x7f66a8102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66a77fe640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a81050b0 0x7f66a8102ad0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f669c00d750 tx=0x7f669c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66a57fa640 1 -- 172.21.15.33:0/815306457 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c017070 con 0x7f66a81050b0 2024-08-28T19:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66ae3ff640 1 -- 172.21.15.33:0/815306457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a81a87b0 con 0x7f66a81050b0 2024-08-28T19:37:54.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66a57fa640 1 -- 172.21.15.33:0/815306457 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f669c0054d0 con 0x7f66a81050b0 2024-08-28T19:37:54.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66a57fa640 1 -- 172.21.15.33:0/815306457 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c004c30 con 0x7f66a81050b0 2024-08-28T19:37:54.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.594+0000 7f66ae3ff640 1 -- 172.21.15.33:0/815306457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a81a8cf0 con 0x7f66a81050b0 2024-08-28T19:37:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.597+0000 7f66b4974740 1 Processor -- start 2024-08-28T19:37:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.597+0000 7f66b4974740 1 -- start start 2024-08-28T19:37:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66b4974740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c9d070 0x55e312042350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66b4974740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 0x55e312042890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66b4974740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c7c390 0x55e312042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66b4974740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e311fb9680 con 0x55e311c7c390 2024-08-28T19:37:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66b4974740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e311fa8c10 con 0x55e311c741b0 2024-08-28T19:37:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66b4974740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e311facbc0 con 0x55e311c9d070 2024-08-28T19:37:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66ac99c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c9d070 0x55e312042350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66ac99c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c9d070 0x55e312042350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:50350/0 (socket says 172.21.15.33:50350) 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66ac99c640 1 -- 172.21.15.33:0/992504905 learned_addr learned my addr 172.21.15.33:0/992504905 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66a7fff640 1 --2- 172.21.15.33:0/992504905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 0x55e312042890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66a57fa640 1 -- 172.21.15.33:0/815306457 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f669c004dd0 con 0x7f66a81050b0 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66ac99c640 1 -- 172.21.15.33:0/992504905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 msgr2=0x55e312042890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66a77fe640 1 --2- 172.21.15.33:0/992504905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c7c390 0x55e312042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66ac99c640 1 --2- 172.21.15.33:0/992504905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 0x55e312042890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66ac99c640 1 -- 172.21.15.33:0/992504905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c7c390 msgr2=0x55e312042dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66ac99c640 1 --2- 172.21.15.33:0/992504905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c7c390 0x55e312042dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66ac99c640 1 -- 172.21.15.33:0/992504905 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e311d08650 con 0x55e311c9d070 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.598+0000 7f66a77fe640 1 --2- 172.21.15.33:0/992504905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c7c390 0x55e312042dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.599+0000 7f66ac99c640 1 --2- 172.21.15.33:0/992504905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c9d070 0x55e312042350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66a0007e50 tx=0x7f66a000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85cd2f062c61fe86 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:54.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.599+0000 7f66a57fa640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66900b4ca0 0x7f66900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.599+0000 7f668e7fc640 1 -- 172.21.15.33:0/992504905 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0014070 con 0x55e311c9d070 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.599+0000 7f668e7fc640 1 -- 172.21.15.33:0/992504905 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66a000ee90 con 0x55e311c9d070 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.599+0000 7f668e7fc640 1 -- 172.21.15.33:0/992504905 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a00053a0 con 0x55e311c9d070 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.599+0000 7f66a7fff640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66900b4ca0 0x7f66900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.599+0000 7f66a57fa640 1 -- 172.21.15.33:0/815306457 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f669c0e53a0 con 0x7f66a81050b0 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.600+0000 7f66b4974740 1 -- 172.21.15.33:0/992504905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c9d070 msgr2=0x55e312042350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.600+0000 7f66b4974740 1 --2- 172.21.15.33:0/992504905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c9d070 0x55e312042350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66a0007e50 tx=0x7f66a000e720 comp rx=0 tx=0).stop 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.600+0000 7f66a7fff640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66900b4ca0 0x7f66900b71b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6698009230 tx=0x7f6698005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.600+0000 7f66b4974740 1 -- 172.21.15.33:0/992504905 shutdown_connections 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.600+0000 7f66b4974740 1 --2- 172.21.15.33:0/992504905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c7c390 0x55e312042dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.600+0000 7f66b4974740 1 --2- 172.21.15.33:0/992504905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 0x55e312042890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.600+0000 7f66b4974740 1 --2- 172.21.15.33:0/992504905 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c9d070 0x55e312042350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.600+0000 7f66b4974740 1 -- 172.21.15.33:0/992504905 >> 172.21.15.33:0/992504905 conn(0x55e311c91460 msgr2=0x55e312040240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:54.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.600+0000 7f66b4974740 1 -- 172.21.15.33:0/992504905 shutdown_connections 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.600+0000 7f66b4974740 1 -- 172.21.15.33:0/992504905 wait complete. 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.601+0000 7f66b4974740 1 -- start start 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.601+0000 7f66b4974740 1 Processor -- start 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.601+0000 7f66b4974740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c741b0 0x55e31204daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.601+0000 7f66b4974740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 0x55e31204e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.601+0000 7f66b4974740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312059e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.601+0000 7f66b4974740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e311e0b700 con 0x55e311c9d070 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.601+0000 7f66b4974740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e311f2f750 con 0x55e311c7c390 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.601+0000 7f66b4974740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e312050b30 con 0x55e311c741b0 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66b4974740 10 client.0 _ll_register_callbacks cb 0x55e311f5ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66ac99c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312059e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66a7fff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c741b0 0x55e31204daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66ac99c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312059e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41382/0 (socket says 172.21.15.33:41382) 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66ac99c640 1 -- 172.21.15.33:0/405006857 learned_addr learned my addr 172.21.15.33:0/405006857 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66a77fe640 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 0x55e31204e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66ac99c640 1 -- 172.21.15.33:0/405006857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c741b0 msgr2=0x55e31204daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66ac99c640 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c741b0 0x55e31204daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66ac99c640 1 -- 172.21.15.33:0/405006857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 msgr2=0x55e31204e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66ac99c640 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 0x55e31204e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66ac99c640 1 -- 172.21.15.33:0/405006857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e311f68900 con 0x55e311c9d070 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66ac99c640 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312059e50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f66a0000f80 tx=0x7f66a0007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dfe300afe4390d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.602+0000 7f66877fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66877fe640 1 -- 172.21.15.33:0/405006857 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0027060 con 0x55e311c9d070 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66877fe640 1 -- 172.21.15.33:0/405006857 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f66a0003970 con 0x55e311c9d070 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66b4974740 1 -- 172.21.15.33:0/405006857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66a000ee90 con 0x55e311c9d070 2024-08-28T19:37:54.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66877fe640 1 -- 172.21.15.33:0/405006857 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66a002e050 con 0x55e311c9d070 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66b4974740 10 client.17184 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66b4974740 1 -- 172.21.15.33:0/405006857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e31205c8d0 con 0x55e311c9d070 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66877fe640 1 -- 172.21.15.33:0/405006857 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66a000ee90 con 0x55e311c9d070 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66877fe640 1 -- 172.21.15.33:0/405006857 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f66a0005120 con 0x55e311c9d070 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66b4974740 10 client.17184 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66b4974740 10 client.17184 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66b4974740 20 client.17184 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66b4974740 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e311c5b9f0 0x55e31205fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66b4974740 4 client.17184 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.603+0000 7f66b4974740 1 -- 172.21.15.33:0/405006857 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e311fbb5d0 con 0x55e311c5b9f0 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.604+0000 7f66a7fff640 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e311c5b9f0 0x55e31205fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.604+0000 7f66877fe640 10 client.17184 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.604+0000 7f66a7fff640 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e311c5b9f0 0x55e31205fce0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e402c719d4b355e3 server_cookie=ac00d16e236da54 in_seq=0 out_seq=0 2024-08-28T19:37:54.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66877fe640 1 -- 172.21.15.33:0/405006857 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e311fbb5d0 con 0x55e311c5b9f0 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66877fe640 10 client.17184 handle_command_reply: tid=0 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66b4974740 1 client.17184 shutdown 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66b4974740 1 -- 172.21.15.33:0/405006857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 msgr2=0x55e312059e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66b4974740 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312059e50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f66a0000f80 tx=0x7f66a0007b90 comp rx=0 tx=0).stop 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66b4974740 1 -- 172.21.15.33:0/405006857 shutdown_connections 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66b4974740 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e311c5b9f0 0x55e31205fce0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66b4974740 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312059e50 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66b4974740 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 0x55e31204e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66877fe640 0 client.17184 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66b4974740 1 --2- 172.21.15.33:0/405006857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c741b0 0x55e31204daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.605+0000 7f66b4974740 1 -- 172.21.15.33:0/405006857 >> 172.21.15.33:0/405006857 conn(0x55e311c91460 msgr2=0x55e3120454e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.606+0000 7f66b4974740 1 -- 172.21.15.33:0/405006857 shutdown_connections 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.606+0000 7f66b4974740 1 -- 172.21.15.33:0/405006857 wait complete. 2024-08-28T19:37:54.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.606+0000 7f66b4974740 20 client.17184 trim_cache size 0 max 16384 2024-08-28T19:37:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66b4974740 1 Processor -- start 2024-08-28T19:37:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66b4974740 1 -- start start 2024-08-28T19:37:54.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66b4974740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 0x55e31204e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66b4974740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c7c390 0x55e312045450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66b4974740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312045990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66b4974740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b2da0 con 0x55e311c9d070 2024-08-28T19:37:54.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66b4974740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b48e0 con 0x55e311c741b0 2024-08-28T19:37:54.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66b4974740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b3470 con 0x55e311c7c390 2024-08-28T19:37:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66ac99c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312045990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66ac99c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312045990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41394/0 (socket says 172.21.15.33:41394) 2024-08-28T19:37:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.632+0000 7f66ac99c640 1 -- 172.21.15.33:0/2448715576 learned_addr learned my addr 172.21.15.33:0/2448715576 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f66a7fff640 1 --2- 172.21.15.33:0/2448715576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 0x55e31204e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f66a77fe640 1 --2- 172.21.15.33:0/2448715576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c7c390 0x55e312045450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f66ac99c640 1 -- 172.21.15.33:0/2448715576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c7c390 msgr2=0x55e312045450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f66ac99c640 1 --2- 172.21.15.33:0/2448715576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c7c390 0x55e312045450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f66ac99c640 1 -- 172.21.15.33:0/2448715576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 msgr2=0x55e31204e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f66ac99c640 1 --2- 172.21.15.33:0/2448715576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 0x55e31204e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f66ac99c640 1 -- 172.21.15.33:0/2448715576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e31204edb0 con 0x55e311c9d070 2024-08-28T19:37:54.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f66a7fff640 1 --2- 172.21.15.33:0/2448715576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 0x55e31204e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:37:54.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f66ac99c640 1 --2- 172.21.15.33:0/2448715576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312045990 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f66a0007d20 tx=0x7f66a0007560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4540823d074c2a44 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:54.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f668dffb640 1 -- 172.21.15.33:0/2448715576 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0027070 con 0x55e311c9d070 2024-08-28T19:37:54.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f668dffb640 1 -- 172.21.15.33:0/2448715576 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66a0003e20 con 0x55e311c9d070 2024-08-28T19:37:54.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.633+0000 7f668dffb640 1 -- 172.21.15.33:0/2448715576 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0014070 con 0x55e311c9d070 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.634+0000 7f66b4974740 1 -- 172.21.15.33:0/2448715576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 msgr2=0x55e312045990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.634+0000 7f66b4974740 1 --2- 172.21.15.33:0/2448715576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312045990 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f66a0007d20 tx=0x7f66a0007560 comp rx=0 tx=0).stop 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.634+0000 7f66b4974740 1 -- 172.21.15.33:0/2448715576 shutdown_connections 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.634+0000 7f66b4974740 1 --2- 172.21.15.33:0/2448715576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312045990 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.634+0000 7f66b4974740 1 --2- 172.21.15.33:0/2448715576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c7c390 0x55e312045450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.634+0000 7f66b4974740 1 --2- 172.21.15.33:0/2448715576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c741b0 0x55e31204e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.634+0000 7f66b4974740 1 -- 172.21.15.33:0/2448715576 >> 172.21.15.33:0/2448715576 conn(0x55e311c91460 msgr2=0x55e31204da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.634+0000 7f66b4974740 1 -- 172.21.15.33:0/2448715576 shutdown_connections 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.634+0000 7f66b4974740 1 -- 172.21.15.33:0/2448715576 wait complete. 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.635+0000 7f66b4974740 1 -- start start 2024-08-28T19:37:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.635+0000 7f66b4974740 1 Processor -- start 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66b4974740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c741b0 0x55e312063470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66b4974740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 0x55e312060940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66b4974740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312060e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66b4974740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b4210 con 0x55e311c9d070 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66b4974740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b3b40 con 0x55e311c7c390 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66b4974740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b0d80 con 0x55e311c741b0 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66b4974740 10 client.0 _ll_register_callbacks cb 0x7f6698009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66ac99c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312060e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66ac99c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312060e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41402/0 (socket says 172.21.15.33:41402) 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66ac99c640 1 -- 172.21.15.33:0/2649660764 learned_addr learned my addr 172.21.15.33:0/2649660764 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66a7fff640 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c741b0 0x55e312063470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66a77fe640 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 0x55e312060940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66ac99c640 1 -- 172.21.15.33:0/2649660764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c741b0 msgr2=0x55e312063470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66ac99c640 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c741b0 0x55e312063470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66ac99c640 1 -- 172.21.15.33:0/2649660764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 msgr2=0x55e312060940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66ac99c640 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 0x55e312060940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66ac99c640 1 -- 172.21.15.33:0/2649660764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3120615c0 con 0x55e311c9d070 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66a77fe640 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 0x55e312060940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66ac99c640 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312060e80 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f66a0005690 tx=0x7f66a0004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f33917d686d9be server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.636+0000 7f66877fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66877fe640 1 -- 172.21.15.33:0/2649660764 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0027030 con 0x55e311c9d070 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66877fe640 1 -- 172.21.15.33:0/2649660764 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f66a0010b20 con 0x55e311c9d070 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66b4974740 1 -- 172.21.15.33:0/2649660764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66a0003e20 con 0x55e311c9d070 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66877fe640 1 -- 172.21.15.33:0/2649660764 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66a004c050 con 0x55e311c9d070 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66b4974740 10 client.17190 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66b4974740 1 -- 172.21.15.33:0/2649660764 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e3120ca310 con 0x55e311c9d070 2024-08-28T19:37:54.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66877fe640 1 -- 172.21.15.33:0/2649660764 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66a0003e20 con 0x55e311c9d070 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66877fe640 1 -- 172.21.15.33:0/2649660764 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f66a0004270 con 0x55e311c9d070 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66b4974740 10 client.17190 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66b4974740 10 client.17190 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66b4974740 20 client.17190 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66b4974740 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e311c30da0 0x55e3120cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66b4974740 4 client.17190 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.637+0000 7f66b4974740 1 -- 172.21.15.33:0/2649660764 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e311fb7070 con 0x55e311c30da0 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.638+0000 7f66a7fff640 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e311c30da0 0x55e3120cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.638+0000 7f66877fe640 10 client.17190 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.638+0000 7f66a7fff640 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e311c30da0 0x55e3120cc980 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eafbf2e75a247097 server_cookie=5982d9d1554a8d79 in_seq=0 out_seq=0 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.638+0000 7f66877fe640 1 -- 172.21.15.33:0/2649660764 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e311fb7070 con 0x55e311c30da0 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.638+0000 7f66877fe640 10 client.17190 handle_command_reply: tid=0 2024-08-28T19:37:54.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.638+0000 7f66b4974740 1 client.17190 shutdown 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 1 -- 172.21.15.33:0/2649660764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 msgr2=0x55e312060e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312060e80 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f66a0005690 tx=0x7f66a0004dd0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 1 -- 172.21.15.33:0/2649660764 shutdown_connections 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e311c30da0 0x55e3120cc980 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e311c9d070 0x55e312060e80 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e311c7c390 0x55e312060940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 1 --2- 172.21.15.33:0/2649660764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e311c741b0 0x55e312063470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 1 -- 172.21.15.33:0/2649660764 >> 172.21.15.33:0/2649660764 conn(0x55e311c91460 msgr2=0x55e312045450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66877fe640 0 client.17190 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 1 -- 172.21.15.33:0/2649660764 shutdown_connections 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 1 -- 172.21.15.33:0/2649660764 wait complete. 2024-08-28T19:37:54.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.639+0000 7f66b4974740 20 client.17190 trim_cache size 0 max 16384 2024-08-28T19:37:54.647 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:37:54.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 -- 172.21.15.33:0/815306457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66900b4ca0 msgr2=0x7f66900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:54.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66900b4ca0 0x7f66900b71b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6698009230 tx=0x7f6698005a20 comp rx=0 tx=0).stop 2024-08-28T19:37:54.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 -- 172.21.15.33:0/815306457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a81050b0 msgr2=0x7f66a8102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:54.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a81050b0 0x7f66a8102ad0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f669c00d750 tx=0x7f669c00dc10 comp rx=0 tx=0).stop 2024-08-28T19:37:54.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 -- 172.21.15.33:0/815306457 shutdown_connections 2024-08-28T19:37:54.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66900b4ca0 0x7f66900b71b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66a810dc30 0x7f66a8103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66a81050b0 0x7f66a8102ad0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 --2- 172.21.15.33:0/815306457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a8104680 0x7f66a8102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:54.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 -- 172.21.15.33:0/815306457 >> 172.21.15.33:0/815306457 conn(0x7f66a8079500 msgr2=0x7f66a81066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:54.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 -- 172.21.15.33:0/815306457 shutdown_connections 2024-08-28T19:37:54.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:54.640+0000 7f66ae3ff640 1 -- 172.21.15.33:0/815306457 wait complete. 2024-08-28T19:37:55.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:55 smithi033 ceph-mon[18549]: pgmap v506: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-08-28T19:37:55.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:55 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:37:55.672 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:37:55.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:55 smithi059 ceph-mon[22052]: pgmap v506: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-08-28T19:37:55.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:55 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:37:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:55 smithi122 ceph-mon[22174]: pgmap v506: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-08-28T19:37:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:55 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:37:55.936 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.542+0000 7fe5bff9d640 1 -- 172.21.15.33:0/1662482487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5b8075550 msgr2=0x7fe5b8075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.542+0000 7fe5bff9d640 1 --2- 172.21.15.33:0/1662482487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5b8075550 0x7fe5b8075960 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009900 tx=0x7fe5b402a410 comp rx=0 tx=0).stop 2024-08-28T19:37:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.542+0000 7fe5bff9d640 1 -- 172.21.15.33:0/1662482487 shutdown_connections 2024-08-28T19:37:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.542+0000 7fe5bff9d640 1 --2- 172.21.15.33:0/1662482487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5b810fe60 0x7fe5b81122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.542+0000 7fe5bff9d640 1 --2- 172.21.15.33:0/1662482487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8075ea0 0x7fe5b810f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.542+0000 7fe5bff9d640 1 --2- 172.21.15.33:0/1662482487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5b8075550 0x7fe5b8075960 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.542+0000 7fe5bff9d640 1 -- 172.21.15.33:0/1662482487 >> 172.21.15.33:0/1662482487 conn(0x7fe5b807b5f0 msgr2=0x7fe5b807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.542+0000 7fe5bff9d640 1 -- 172.21.15.33:0/1662482487 shutdown_connections 2024-08-28T19:37:56.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.542+0000 7fe5bff9d640 1 -- 172.21.15.33:0/1662482487 wait complete. 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bff9d640 1 Processor -- start 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bff9d640 1 -- start start 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bff9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5b8075550 0x7fe5b819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bff9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8075ea0 0x7fe5b819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bff9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5b810fe60 0x7fe5b81a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bff9d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b8115a10 con 0x7fe5b8075550 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bff9d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b8115890 con 0x7fe5b8075ea0 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bff9d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b8115b90 con 0x7fe5b810fe60 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bdd39640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5b8075550 0x7fe5b819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bdd39640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5b8075550 0x7fe5b819c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41414/0 (socket says 172.21.15.33:41414) 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bdd39640 1 -- 172.21.15.33:0/2536750160 learned_addr learned my addr 172.21.15.33:0/2536750160 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:56.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5be53a640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5b810fe60 0x7fe5b81a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.543+0000 7fe5bd538640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8075ea0 0x7fe5b819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5bdd39640 1 -- 172.21.15.33:0/2536750160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5b810fe60 msgr2=0x7fe5b81a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5bdd39640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5b810fe60 0x7fe5b81a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5bdd39640 1 -- 172.21.15.33:0/2536750160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8075ea0 msgr2=0x7fe5b819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5bdd39640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8075ea0 0x7fe5b819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5bdd39640 1 -- 172.21.15.33:0/2536750160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b81a2370 con 0x7fe5b8075550 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5bdd39640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5b8075550 0x7fe5b819c400 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4005940 tx=0x7fe5b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5aeffd640 1 -- 172.21.15.33:0/2536750160 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b403f030 con 0x7fe5b8075550 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5aeffd640 1 -- 172.21.15.33:0/2536750160 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5b4003aa0 con 0x7fe5b8075550 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5bff9d640 1 -- 172.21.15.33:0/2536750160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b81a2600 con 0x7fe5b8075550 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5aeffd640 1 -- 172.21.15.33:0/2536750160 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4035070 con 0x7fe5b8075550 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.544+0000 7fe5bff9d640 1 -- 172.21.15.33:0/2536750160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b81a8dc0 con 0x7fe5b8075550 2024-08-28T19:37:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5c6512740 1 Processor -- start 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5c6512740 1 -- start start 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5aeffd640 1 -- 172.21.15.33:0/2536750160 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe5b4042030 con 0x7fe5b8075550 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087d6070 0x55b608b7b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087ad1b0 0x55b608b7b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087b5390 0x55b608b7bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5c6512740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b608af2680 con 0x55b6087d6070 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5c6512740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b608ae1c10 con 0x55b6087b5390 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5c6512740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b608ae5bc0 con 0x55b6087ad1b0 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5be53a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087d6070 0x55b608b7b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5be53a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087d6070 0x55b608b7b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41418/0 (socket says 172.21.15.33:41418) 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.547+0000 7fe5be53a640 1 -- 172.21.15.33:0/3291019319 learned_addr learned my addr 172.21.15.33:0/3291019319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5bd538640 1 --2- 172.21.15.33:0/3291019319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087b5390 0x55b608b7bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5bdd39640 1 --2- 172.21.15.33:0/3291019319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087ad1b0 0x55b608b7b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5be53a640 1 -- 172.21.15.33:0/3291019319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087ad1b0 msgr2=0x55b608b7b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3291019319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087ad1b0 0x55b608b7b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5be53a640 1 -- 172.21.15.33:0/3291019319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087b5390 msgr2=0x55b608b7bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3291019319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087b5390 0x55b608b7bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5be53a640 1 -- 172.21.15.33:0/3291019319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b608841650 con 0x55b6087d6070 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5aeffd640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5a40b4d20 0x7fe5a40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3291019319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087d6070 0x55b608b7b310 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00039f0 tx=0x7fe5b0003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493713ba59053376 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5bdd39640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5a40b4d20 0x7fe5a40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5aeffd640 1 -- 172.21.15.33:0/2536750160 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe5b4105f70 con 0x7fe5b8075550 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.548+0000 7fe5a3fff640 1 -- 172.21.15.33:0/3291019319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b001a470 con 0x55b6087d6070 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.549+0000 7fe5a3fff640 1 -- 172.21.15.33:0/3291019319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5b0015070 con 0x55b6087d6070 2024-08-28T19:37:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.549+0000 7fe5a3fff640 1 -- 172.21.15.33:0/3291019319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00107e0 con 0x55b6087d6070 2024-08-28T19:37:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.549+0000 7fe5c6512740 1 -- 172.21.15.33:0/3291019319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087d6070 msgr2=0x55b608b7b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.549+0000 7fe5bdd39640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5a40b4d20 0x7fe5a40b7230 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55b608b79f90 tx=0x7fe5b4109a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.549+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3291019319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087d6070 0x55b608b7b310 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe5b00039f0 tx=0x7fe5b0003eb0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.550+0000 7fe5c6512740 1 -- 172.21.15.33:0/3291019319 shutdown_connections 2024-08-28T19:37:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.550+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3291019319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087b5390 0x55b608b7bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.550+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3291019319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087ad1b0 0x55b608b7b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.550+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3291019319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087d6070 0x55b608b7b310 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.550+0000 7fe5c6512740 1 -- 172.21.15.33:0/3291019319 >> 172.21.15.33:0/3291019319 conn(0x55b6087ca460 msgr2=0x55b608b79200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.550+0000 7fe5c6512740 1 -- 172.21.15.33:0/3291019319 shutdown_connections 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.550+0000 7fe5c6512740 1 -- 172.21.15.33:0/3291019319 wait complete. 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.550+0000 7fe5c6512740 1 -- start start 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.550+0000 7fe5c6512740 1 Processor -- start 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087ad1b0 0x55b608b86b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b870f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087d6070 0x55b608b92e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5c6512740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b608944700 con 0x55b6087b5390 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5c6512740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b608a68750 con 0x55b6087d6070 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5c6512740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b608b89af0 con 0x55b6087ad1b0 2024-08-28T19:37:56.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5c6512740 10 client.0 _ll_register_callbacks cb 0x55b608a97e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5bd538640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b870f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5bd538640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b870f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41422/0 (socket says 172.21.15.33:41422) 2024-08-28T19:37:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5bd538640 1 -- 172.21.15.33:0/1800087927 learned_addr learned my addr 172.21.15.33:0/1800087927 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5be53a640 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087d6070 0x55b608b92e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5be53a640 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087ad1b0 0x55b608b86b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5bd538640 1 -- 172.21.15.33:0/1800087927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087ad1b0 msgr2=0x55b608b86b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5bd538640 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087ad1b0 0x55b608b86b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5bd538640 1 -- 172.21.15.33:0/1800087927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087d6070 msgr2=0x55b608b92e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5bd538640 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087d6070 0x55b608b92e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5bd538640 1 -- 172.21.15.33:0/1800087927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b608aa1900 con 0x55b6087b5390 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5bd538640 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b870f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8012700 tx=0x7fe5a8012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76481f1c98c6554f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.551+0000 7fe5a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5a17fa640 1 -- 172.21.15.33:0/1800087927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8004260 con 0x55b6087b5390 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5a17fa640 1 -- 172.21.15.33:0/1800087927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe5a8004400 con 0x55b6087b5390 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5c6512740 1 -- 172.21.15.33:0/1800087927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5b0015070 con 0x55b6087b5390 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5a17fa640 1 -- 172.21.15.33:0/1800087927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5a8025050 con 0x55b6087b5390 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5c6512740 10 client.17202 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5c6512740 1 -- 172.21.15.33:0/1800087927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b608b959e0 con 0x55b6087b5390 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5a17fa640 1 -- 172.21.15.33:0/1800087927 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5b0015070 con 0x55b6087b5390 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5a17fa640 1 -- 172.21.15.33:0/1800087927 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe5a800f440 con 0x55b6087b5390 2024-08-28T19:37:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5c6512740 10 client.17202 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5c6512740 10 client.17202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5c6512740 20 client.17202 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5c6512740 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b6087949f0 0x55b608b98fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5c6512740 4 client.17202 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.552+0000 7fe5c6512740 1 -- 172.21.15.33:0/1800087927 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b608af45d0 con 0x55b6087949f0 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.553+0000 7fe5be53a640 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b6087949f0 0x55b608b98fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.553+0000 7fe5be53a640 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b6087949f0 0x55b608b98fa0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b39c90bf096a5a4 server_cookie=d8cd040e1459c4eb in_seq=0 out_seq=0 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.553+0000 7fe5a17fa640 10 client.17202 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5a17fa640 1 -- 172.21.15.33:0/1800087927 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b608af45d0 con 0x55b6087949f0 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5a17fa640 10 client.17202 handle_command_reply: tid=0 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 client.17202 shutdown 2024-08-28T19:37:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 -- 172.21.15.33:0/1800087927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 msgr2=0x55b608b870f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b870f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8012700 tx=0x7fe5a8012bc0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 -- 172.21.15.33:0/1800087927 shutdown_connections 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087d6070 0x55b608b92e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b6087949f0 0x55b608b98fa0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b870f0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 --2- 172.21.15.33:0/1800087927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087ad1b0 0x55b608b86b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5a17fa640 0 client.17202 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 -- 172.21.15.33:0/1800087927 >> 172.21.15.33:0/1800087927 conn(0x55b6087ca460 msgr2=0x55b608b7e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 -- 172.21.15.33:0/1800087927 shutdown_connections 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 1 -- 172.21.15.33:0/1800087927 wait complete. 2024-08-28T19:37:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.554+0000 7fe5c6512740 20 client.17202 trim_cache size 0 max 16384 2024-08-28T19:37:56.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5c6512740 1 Processor -- start 2024-08-28T19:37:56.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5c6512740 1 -- start start 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087ad1b0 0x55b608b87030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087b5390 0x55b608b7e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087d6070 0x55b608b7e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5c6512740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81b2ca0 con 0x55b6087ad1b0 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5c6512740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81b47e0 con 0x55b6087b5390 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5c6512740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81b3370 con 0x55b6087d6070 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5be53a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087ad1b0 0x55b608b87030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5be53a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087ad1b0 0x55b608b87030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41432/0 (socket says 172.21.15.33:41432) 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5be53a640 1 -- 172.21.15.33:0/3278332476 learned_addr learned my addr 172.21.15.33:0/3278332476 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5bd538640 1 --2- 172.21.15.33:0/3278332476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087b5390 0x55b608b7e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5be53a640 1 -- 172.21.15.33:0/3278332476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087d6070 msgr2=0x55b608b7e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3278332476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087d6070 0x55b608b7e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5be53a640 1 -- 172.21.15.33:0/3278332476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087b5390 msgr2=0x55b608b7e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:56.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3278332476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087b5390 0x55b608b7e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.568+0000 7fe5be53a640 1 -- 172.21.15.33:0/3278332476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b608b87570 con 0x55b6087ad1b0 2024-08-28T19:37:56.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.569+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3278332476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087ad1b0 0x55b608b87030 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0011f60 tx=0x7fe5b0003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16db0979b12a845d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:56.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.569+0000 7fe5a37fe640 1 -- 172.21.15.33:0/3278332476 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0004c00 con 0x55b6087ad1b0 2024-08-28T19:37:56.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.569+0000 7fe5a37fe640 1 -- 172.21.15.33:0/3278332476 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5b002d070 con 0x55b6087ad1b0 2024-08-28T19:37:56.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.569+0000 7fe5a37fe640 1 -- 172.21.15.33:0/3278332476 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00053b0 con 0x55b6087ad1b0 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 -- 172.21.15.33:0/3278332476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087ad1b0 msgr2=0x55b608b87030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3278332476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087ad1b0 0x55b608b87030 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0011f60 tx=0x7fe5b0003eb0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 -- 172.21.15.33:0/3278332476 shutdown_connections 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3278332476 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087d6070 0x55b608b7e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3278332476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087b5390 0x55b608b7e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3278332476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087ad1b0 0x55b608b87030 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 -- 172.21.15.33:0/3278332476 >> 172.21.15.33:0/3278332476 conn(0x55b6087ca460 msgr2=0x55b608b86920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 -- 172.21.15.33:0/3278332476 shutdown_connections 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 -- 172.21.15.33:0/3278332476 wait complete. 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 -- start start 2024-08-28T19:37:56.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.570+0000 7fe5c6512740 1 Processor -- start 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087ad1b0 0x55b608b8b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b8b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5c6512740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087d6070 0x55b608c029a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5c6512740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81b4110 con 0x55b6087b5390 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5c6512740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81b3a40 con 0x55b6087ad1b0 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5c6512740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b81b0c80 con 0x55b6087d6070 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5c6512740 10 client.0 _ll_register_callbacks cb 0x7fe5a80096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5bd538640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b8b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5bd538640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b8b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41440/0 (socket says 172.21.15.33:41440) 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5bd538640 1 -- 172.21.15.33:0/3223767628 learned_addr learned my addr 172.21.15.33:0/3223767628 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087d6070 0x55b608c029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087ad1b0 0x55b608b8b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5bd538640 1 -- 172.21.15.33:0/3223767628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087d6070 msgr2=0x55b608c029a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5bd538640 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087d6070 0x55b608c029a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5bd538640 1 -- 172.21.15.33:0/3223767628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087ad1b0 msgr2=0x55b608b8b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5bd538640 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087ad1b0 0x55b608b8b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5bd538640 1 -- 172.21.15.33:0/3223767628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b608c02ee0 con 0x55b6087b5390 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087ad1b0 0x55b608b8b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5bd538640 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b8b950 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x55b608b74a10 tx=0x7fe5a800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de32eea24af58a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.571+0000 7fe5a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5a17fa640 1 -- 172.21.15.33:0/3223767628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8022040 con 0x55b6087b5390 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5a17fa640 1 -- 172.21.15.33:0/3223767628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe5a800fa80 con 0x55b6087b5390 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5c6512740 1 -- 172.21.15.33:0/3223767628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5b002d070 con 0x55b6087b5390 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5a17fa640 1 -- 172.21.15.33:0/3223767628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5a803b050 con 0x55b6087b5390 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5c6512740 10 client.17208 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5c6512740 1 -- 172.21.15.33:0/3223767628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b608c04120 con 0x55b6087b5390 2024-08-28T19:37:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5a17fa640 1 -- 172.21.15.33:0/3223767628 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5b002d070 con 0x55b6087b5390 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5a17fa640 1 -- 172.21.15.33:0/3223767628 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe5a8003680 con 0x55b6087b5390 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5c6512740 10 client.17208 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5c6512740 10 client.17208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5c6512740 20 client.17208 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b608769da0 0x55b608c06910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5c6512740 4 client.17208 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.572+0000 7fe5c6512740 1 -- 172.21.15.33:0/3223767628 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b608af0070 con 0x55b608769da0 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b608769da0 0x55b608c06910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5be53a640 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b608769da0 0x55b608c06910 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15a11f5b339f3aca server_cookie=31eb1507b9b7e2d1 in_seq=0 out_seq=0 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5a17fa640 10 client.17208 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5a17fa640 1 -- 172.21.15.33:0/3223767628 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b608af0070 con 0x55b608769da0 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5a17fa640 10 client.17208 handle_command_reply: tid=0 2024-08-28T19:37:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5c6512740 1 client.17208 shutdown 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5c6512740 1 -- 172.21.15.33:0/3223767628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 msgr2=0x55b608b8b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b8b950 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x55b608b74a10 tx=0x7fe5a800f670 comp rx=0 tx=0).stop 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5c6512740 1 -- 172.21.15.33:0/3223767628 shutdown_connections 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b6087d6070 0x55b608c029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b608769da0 0x55b608c06910 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b6087b5390 0x55b608b8b950 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5c6512740 1 --2- 172.21.15.33:0/3223767628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6087ad1b0 0x55b608b8b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5a17fa640 0 client.17208 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.573+0000 7fe5c6512740 1 -- 172.21.15.33:0/3223767628 >> 172.21.15.33:0/3223767628 conn(0x55b6087ca460 msgr2=0x55b608b7c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5c6512740 1 -- 172.21.15.33:0/3223767628 shutdown_connections 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5c6512740 1 -- 172.21.15.33:0/3223767628 wait complete. 2024-08-28T19:37:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5c6512740 20 client.17208 trim_cache size 0 max 16384 2024-08-28T19:37:56.581 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:37:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5bff9d640 1 -- 172.21.15.33:0/2536750160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5a40b4d20 msgr2=0x7fe5a40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5bff9d640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5a40b4d20 0x7fe5a40b7230 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55b608b79f90 tx=0x7fe5b4109a20 comp rx=0 tx=0).stop 2024-08-28T19:37:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5bff9d640 1 -- 172.21.15.33:0/2536750160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5b8075550 msgr2=0x7fe5b819c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5bff9d640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5b8075550 0x7fe5b819c400 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4005940 tx=0x7fe5b4004270 comp rx=0 tx=0).stop 2024-08-28T19:37:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5bff9d640 1 -- 172.21.15.33:0/2536750160 shutdown_connections 2024-08-28T19:37:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5bff9d640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe5a40b4d20 0x7fe5a40b7230 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5bff9d640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5b810fe60 0x7fe5b81a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5bff9d640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8075ea0 0x7fe5b819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5bff9d640 1 --2- 172.21.15.33:0/2536750160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5b8075550 0x7fe5b819c400 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.574+0000 7fe5bff9d640 1 -- 172.21.15.33:0/2536750160 >> 172.21.15.33:0/2536750160 conn(0x7fe5b807b5f0 msgr2=0x7fe5b81099e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.575+0000 7fe5bff9d640 1 -- 172.21.15.33:0/2536750160 shutdown_connections 2024-08-28T19:37:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:56.575+0000 7fe5bff9d640 1 -- 172.21.15.33:0/2536750160 wait complete. 2024-08-28T19:37:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:37:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:37:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:37:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:37:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:37:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:37:56.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:37:56.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:37:56.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:37:57.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:57 smithi033 ceph-mon[18549]: pgmap v507: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-28T19:37:57.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:57 smithi059 ceph-mon[22052]: pgmap v507: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-28T19:37:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:57 smithi122 ceph-mon[22174]: pgmap v507: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-28T19:37:58.302 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:37:58.303 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:37:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:37:59.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.220+0000 7f62f3077640 1 -- 172.21.15.33:0/658232976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec108a90 msgr2=0x7f62ec10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:59.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.220+0000 7f62f3077640 1 --2- 172.21.15.33:0/658232976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec108a90 0x7f62ec10f2c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009ca0 tx=0x7f62e402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.220+0000 7f62f3077640 1 -- 172.21.15.33:0/658232976 shutdown_connections 2024-08-28T19:37:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.220+0000 7f62f3077640 1 --2- 172.21.15.33:0/658232976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec108a90 0x7f62ec10f2c0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.220+0000 7f62f3077640 1 --2- 172.21.15.33:0/658232976 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62ec108140 0x7f62ec108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.220+0000 7f62f3077640 1 --2- 172.21.15.33:0/658232976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62ec102800 0x7f62ec102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.220+0000 7f62f3077640 1 -- 172.21.15.33:0/658232976 >> 172.21.15.33:0/658232976 conn(0x7f62ec0794d0 msgr2=0x7f62ec0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.220+0000 7f62f3077640 1 -- 172.21.15.33:0/658232976 shutdown_connections 2024-08-28T19:37:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.220+0000 7f62f3077640 1 -- 172.21.15.33:0/658232976 wait complete. 2024-08-28T19:37:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62f3077640 1 Processor -- start 2024-08-28T19:37:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62f3077640 1 -- start start 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62f3077640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62ec102800 0x7f62ec19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62f3077640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec108140 0x7f62ec19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62f3077640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62ec108a90 0x7f62ec19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62f3077640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec112760 con 0x7f62ec108140 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62f3077640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1125e0 con 0x7f62ec108a90 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62f3077640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1128e0 con 0x7f62ec102800 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62ebfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec108140 0x7f62ec19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62ebfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec108140 0x7f62ec19a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48788/0 (socket says 172.21.15.33:48788) 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62ebfff640 1 -- 172.21.15.33:0/186844800 learned_addr learned my addr 172.21.15.33:0/186844800 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62f1614640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62ec108a90 0x7f62ec19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.221+0000 7f62f0e13640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62ec102800 0x7f62ec19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62ebfff640 1 -- 172.21.15.33:0/186844800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62ec102800 msgr2=0x7f62ec19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62ebfff640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62ec102800 0x7f62ec19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62ebfff640 1 -- 172.21.15.33:0/186844800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62ec108a90 msgr2=0x7f62ec19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62ebfff640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62ec108a90 0x7f62ec19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62ebfff640 1 -- 172.21.15.33:0/186844800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec1a01b0 con 0x7f62ec108140 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62f1614640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62ec108a90 0x7f62ec19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62f0e13640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62ec102800 0x7f62ec19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62ebfff640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec108140 0x7f62ec19a7e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f62d800b450 tx=0x7f62d800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62e9ffb640 1 -- 172.21.15.33:0/186844800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d8015020 con 0x7f62ec108140 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62e9ffb640 1 -- 172.21.15.33:0/186844800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d8011d40 con 0x7f62ec108140 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62f3077640 1 -- 172.21.15.33:0/186844800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ec1a04a0 con 0x7f62ec108140 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62e9ffb640 1 -- 172.21.15.33:0/186844800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d800f340 con 0x7f62ec108140 2024-08-28T19:37:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.222+0000 7f62f3077640 1 -- 172.21.15.33:0/186844800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ec1a6c00 con 0x7f62ec108140 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62f95ec740 1 Processor -- start 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62e9ffb640 1 -- 172.21.15.33:0/186844800 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f62d8018020 con 0x7f62ec108140 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62f95ec740 1 -- start start 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8184350 0x5595c852a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 0x5595c852acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c852b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62f95ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5595c84a05f0 con 0x5595c8163670 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62f95ec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5595c848fb80 con 0x5595c8184350 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62f95ec740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5595c8493b30 con 0x5595c815b490 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62ebfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c852b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62ebfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c852b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48790/0 (socket says 172.21.15.33:48790) 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62ebfff640 1 -- 172.21.15.33:0/1757531475 learned_addr learned my addr 172.21.15.33:0/1757531475 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62f1614640 1 --2- 172.21.15.33:0/1757531475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8184350 0x5595c852a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.226+0000 7f62f0e13640 1 --2- 172.21.15.33:0/1757531475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 0x5595c852acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62ebfff640 1 -- 172.21.15.33:0/1757531475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 msgr2=0x5595c852acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62ebfff640 1 --2- 172.21.15.33:0/1757531475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 0x5595c852acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62ebfff640 1 -- 172.21.15.33:0/1757531475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8184350 msgr2=0x5595c852a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62ebfff640 1 --2- 172.21.15.33:0/1757531475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8184350 0x5595c852a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62ebfff640 1 -- 172.21.15.33:0/1757531475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c81ef930 con 0x5595c8163670 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62e9ffb640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62dc0b4ca0 0x7f62dc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62ebfff640 1 --2- 172.21.15.33:0/1757531475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c852b200 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f62d80e26f0 tx=0x7f62d80eda10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73cc5405084736a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62f1614640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62dc0b4ca0 0x7f62dc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62e9ffb640 1 -- 172.21.15.33:0/186844800 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f62d80e5380 con 0x7f62ec108140 2024-08-28T19:37:59.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62d6ffd640 1 -- 172.21.15.33:0/1757531475 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d80a75e0 con 0x5595c8163670 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62d6ffd640 1 -- 172.21.15.33:0/1757531475 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d80ab230 con 0x5595c8163670 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.227+0000 7f62d6ffd640 1 -- 172.21.15.33:0/1757531475 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d80aae90 con 0x5595c8163670 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.228+0000 7f62f95ec740 1 -- 172.21.15.33:0/1757531475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 msgr2=0x5595c852b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.228+0000 7f62f95ec740 1 --2- 172.21.15.33:0/1757531475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c852b200 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f62d80e26f0 tx=0x7f62d80eda10 comp rx=0 tx=0).stop 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.228+0000 7f62f1614640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62dc0b4ca0 0x7f62dc0b71b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f62e4005cc0 tx=0x7f62e4005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.228+0000 7f62f95ec740 1 -- 172.21.15.33:0/1757531475 shutdown_connections 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.228+0000 7f62f95ec740 1 --2- 172.21.15.33:0/1757531475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c852b200 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.228+0000 7f62f95ec740 1 --2- 172.21.15.33:0/1757531475 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 0x5595c852acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.228+0000 7f62f95ec740 1 --2- 172.21.15.33:0/1757531475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8184350 0x5595c852a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.228+0000 7f62f95ec740 1 -- 172.21.15.33:0/1757531475 >> 172.21.15.33:0/1757531475 conn(0x5595c8178740 msgr2=0x5595c8528670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.228+0000 7f62f95ec740 1 -- 172.21.15.33:0/1757531475 shutdown_connections 2024-08-28T19:37:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.228+0000 7f62f95ec740 1 -- 172.21.15.33:0/1757531475 wait complete. 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f95ec740 1 -- start start 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f95ec740 1 Processor -- start 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c815b490 0x5595c8535ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8163670 0x5595c8536410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c8184350 0x5595c8542280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f95ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5595c82f2890 con 0x5595c815b490 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f95ec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5595c8416790 con 0x5595c8163670 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f95ec740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5595c8538f60 con 0x5595c8184350 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f0e13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c815b490 0x5595c8535ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f0e13640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c815b490 0x5595c8535ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48800/0 (socket says 172.21.15.33:48800) 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f0e13640 1 -- 172.21.15.33:0/2364824356 learned_addr learned my addr 172.21.15.33:0/2364824356 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62f95ec740 10 client.0 _ll_register_callbacks cb 0x5595c819bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.229+0000 7f62ebfff640 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8163670 0x5595c8536410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62f1614640 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c8184350 0x5595c8542280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62f0e13640 1 -- 172.21.15.33:0/2364824356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c8184350 msgr2=0x5595c8542280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62f0e13640 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c8184350 0x5595c8542280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62f0e13640 1 -- 172.21.15.33:0/2364824356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8163670 msgr2=0x5595c8536410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62f0e13640 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8163670 0x5595c8536410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62f0e13640 1 -- 172.21.15.33:0/2364824356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c844df30 con 0x5595c815b490 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62f0e13640 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c815b490 0x5595c8535ed0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f62e0011850 tx=0x7f62e0011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71df8d4650207a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62cbfff640 1 -- 172.21.15.33:0/2364824356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e000fe70 con 0x5595c815b490 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62cbfff640 1 -- 172.21.15.33:0/2364824356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f62e00193f0 con 0x5595c815b490 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62f95ec740 1 -- 172.21.15.33:0/2364824356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62d80ab230 con 0x5595c815b490 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62cbfff640 1 -- 172.21.15.33:0/2364824356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f62e0024050 con 0x5595c815b490 2024-08-28T19:37:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62f95ec740 10 client.17220 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.230+0000 7f62f95ec740 1 -- 172.21.15.33:0/2364824356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5595c8544da0 con 0x5595c815b490 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.231+0000 7f62cbfff640 1 -- 172.21.15.33:0/2364824356 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d80ab230 con 0x5595c815b490 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.231+0000 7f62cbfff640 1 -- 172.21.15.33:0/2364824356 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f62e0018030 con 0x5595c815b490 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.231+0000 7f62f95ec740 10 client.17220 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.231+0000 7f62f95ec740 10 client.17220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.231+0000 7f62f95ec740 20 client.17220 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.231+0000 7f62f95ec740 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5595c8142cd0 0x5595c8548390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.231+0000 7f62f95ec740 4 client.17220 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.231+0000 7f62f95ec740 1 -- 172.21.15.33:0/2364824356 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595c84a2540 con 0x5595c8142cd0 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.231+0000 7f62ebfff640 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5595c8142cd0 0x5595c8548390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.232+0000 7f62ebfff640 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5595c8142cd0 0x5595c8548390 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0391f29eb78e637 server_cookie=d18dd1e22568b8c4 in_seq=0 out_seq=0 2024-08-28T19:37:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.232+0000 7f62cbfff640 10 client.17220 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:59.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.232+0000 7f62cbfff640 1 -- 172.21.15.33:0/2364824356 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595c84a2540 con 0x5595c8142cd0 2024-08-28T19:37:59.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.232+0000 7f62cbfff640 10 client.17220 handle_command_reply: tid=0 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.232+0000 7f62f95ec740 1 client.17220 shutdown 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.232+0000 7f62f95ec740 1 -- 172.21.15.33:0/2364824356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c815b490 msgr2=0x5595c8535ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.232+0000 7f62f95ec740 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c815b490 0x5595c8535ed0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f62e0011850 tx=0x7f62e0011d10 comp rx=0 tx=0).stop 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.233+0000 7f62f95ec740 1 -- 172.21.15.33:0/2364824356 shutdown_connections 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.233+0000 7f62f95ec740 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c8184350 0x5595c8542280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.233+0000 7f62f95ec740 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8163670 0x5595c8536410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.233+0000 7f62f95ec740 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5595c8142cd0 0x5595c8548390 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.233+0000 7f62f95ec740 1 --2- 172.21.15.33:0/2364824356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c815b490 0x5595c8535ed0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.233+0000 7f62f95ec740 1 -- 172.21.15.33:0/2364824356 >> 172.21.15.33:0/2364824356 conn(0x5595c8178740 msgr2=0x5595c852d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.233+0000 7f62cbfff640 0 client.17220 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.233+0000 7f62f95ec740 1 -- 172.21.15.33:0/2364824356 shutdown_connections 2024-08-28T19:37:59.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.233+0000 7f62f95ec740 1 -- 172.21.15.33:0/2364824356 wait complete. 2024-08-28T19:37:59.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.233+0000 7f62f95ec740 20 client.17220 trim_cache size 0 max 16384 2024-08-28T19:37:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.250+0000 7f62f95ec740 1 Processor -- start 2024-08-28T19:37:59.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62f95ec740 1 -- start start 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c815b490 0x5595c852c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c8527ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c8184350 0x5595c85281e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62f95ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1b0be0 con 0x5595c8163670 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62f95ec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1b2720 con 0x5595c815b490 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62f95ec740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1b12b0 con 0x5595c8184350 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62ebfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c8527ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62ebfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c8527ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48806/0 (socket says 172.21.15.33:48806) 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62ebfff640 1 -- 172.21.15.33:0/3065792045 learned_addr learned my addr 172.21.15.33:0/3065792045 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62f0e13640 1 --2- 172.21.15.33:0/3065792045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c815b490 0x5595c852c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62f1614640 1 --2- 172.21.15.33:0/3065792045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c8184350 0x5595c85281e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62ebfff640 1 -- 172.21.15.33:0/3065792045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c8184350 msgr2=0x5595c85281e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:59.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62ebfff640 1 --2- 172.21.15.33:0/3065792045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c8184350 0x5595c85281e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62ebfff640 1 -- 172.21.15.33:0/3065792045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c815b490 msgr2=0x5595c852c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62ebfff640 1 --2- 172.21.15.33:0/3065792045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c815b490 0x5595c852c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62ebfff640 1 -- 172.21.15.33:0/3065792045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c85343d0 con 0x5595c8163670 2024-08-28T19:37:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.251+0000 7f62ebfff640 1 --2- 172.21.15.33:0/3065792045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c8527ca0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f62d80a8990 tx=0x7f62d80eda10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972b8f04fcc94d0d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62d67fc640 1 -- 172.21.15.33:0/3065792045 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d80ab070 con 0x5595c8163670 2024-08-28T19:37:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62d67fc640 1 -- 172.21.15.33:0/3065792045 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d80b4370 con 0x5595c8163670 2024-08-28T19:37:59.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62d67fc640 1 -- 172.21.15.33:0/3065792045 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d80ab4f0 con 0x5595c8163670 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62f95ec740 1 -- 172.21.15.33:0/3065792045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 msgr2=0x5595c8527ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62f95ec740 1 --2- 172.21.15.33:0/3065792045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c8527ca0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f62d80a8990 tx=0x7f62d80eda10 comp rx=0 tx=0).stop 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62f95ec740 1 -- 172.21.15.33:0/3065792045 shutdown_connections 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62f95ec740 1 --2- 172.21.15.33:0/3065792045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c8184350 0x5595c85281e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62f95ec740 1 --2- 172.21.15.33:0/3065792045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8163670 0x5595c8527ca0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62f95ec740 1 --2- 172.21.15.33:0/3065792045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c815b490 0x5595c852c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62f95ec740 1 -- 172.21.15.33:0/3065792045 >> 172.21.15.33:0/3065792045 conn(0x5595c8178740 msgr2=0x5595c852e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62f95ec740 1 -- 172.21.15.33:0/3065792045 shutdown_connections 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.252+0000 7f62f95ec740 1 -- 172.21.15.33:0/3065792045 wait complete. 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f95ec740 1 -- start start 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f95ec740 1 Processor -- start 2024-08-28T19:37:59.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 0x5595c853a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8163670 0x5595c853af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f95ec740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8184350 0x5595c85b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f95ec740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1b2050 con 0x5595c8184350 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f95ec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1b1980 con 0x5595c8163670 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f95ec740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec1aebc0 con 0x5595c815b490 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f95ec740 10 client.0 _ll_register_callbacks cb 0x7f62e000c830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f1614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8184350 0x5595c85b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f1614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8184350 0x5595c85b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48808/0 (socket says 172.21.15.33:48808) 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.253+0000 7f62f1614640 1 -- 172.21.15.33:0/4129124693 learned_addr learned my addr 172.21.15.33:0/4129124693 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f0e13640 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 0x5595c853a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62ebfff640 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8163670 0x5595c853af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f1614640 1 -- 172.21.15.33:0/4129124693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 msgr2=0x5595c853a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f1614640 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 0x5595c853a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f1614640 1 -- 172.21.15.33:0/4129124693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8163670 msgr2=0x5595c853af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f1614640 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8163670 0x5595c853af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f1614640 1 -- 172.21.15.33:0/4129124693 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c85b2380 con 0x5595c8184350 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f0e13640 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 0x5595c853a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f1614640 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8184350 0x5595c85b1d90 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f62e4035000 tx=0x7f62e40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507be76bab3e40ba server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62cbfff640 1 -- 172.21.15.33:0/4129124693 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4059060 con 0x5595c8184350 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62cbfff640 1 -- 172.21.15.33:0/4129124693 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f62e4004040 con 0x5595c8184350 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f95ec740 1 -- 172.21.15.33:0/4129124693 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62d80b4370 con 0x5595c8184350 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62cbfff640 1 -- 172.21.15.33:0/4129124693 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f62e4060050 con 0x5595c8184350 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f95ec740 10 client.17226 fetch_fsmap learned FSMap version 28 2024-08-28T19:37:59.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.254+0000 7f62f95ec740 1 -- 172.21.15.33:0/4129124693 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5595c85b3640 con 0x5595c8184350 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.255+0000 7f62cbfff640 1 -- 172.21.15.33:0/4129124693 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d80b4370 con 0x5595c8184350 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.255+0000 7f62cbfff640 1 -- 172.21.15.33:0/4129124693 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f62e402fba0 con 0x5595c8184350 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.255+0000 7f62f95ec740 10 client.17226 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.255+0000 7f62f95ec740 10 client.17226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.255+0000 7f62f95ec740 20 client.17226 populate_metadata read hostname 'smithi033' 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.255+0000 7f62f95ec740 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5595c8118080 0x5595c85b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.255+0000 7f62f95ec740 4 client.17226 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.255+0000 7f62f95ec740 1 -- 172.21.15.33:0/4129124693 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5595c849dfe0 con 0x5595c8118080 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.255+0000 7f62f0e13640 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5595c8118080 0x5595c85b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.256+0000 7f62f0e13640 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5595c8118080 0x5595c85b5e30 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbd29c10d0c141e3 server_cookie=f4b631f1f83d131a in_seq=0 out_seq=0 2024-08-28T19:37:59.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.256+0000 7f62cbfff640 10 client.17226 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:59.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62cbfff640 1 -- 172.21.15.33:0/4129124693 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5595c849dfe0 con 0x5595c8118080 2024-08-28T19:37:59.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62cbfff640 10 client.17226 handle_command_reply: tid=0 2024-08-28T19:37:59.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 client.17226 shutdown 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 -- 172.21.15.33:0/4129124693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8184350 msgr2=0x5595c85b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8184350 0x5595c85b1d90 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f62e4035000 tx=0x7f62e40095c0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 -- 172.21.15.33:0/4129124693 shutdown_connections 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5595c8118080 0x5595c85b5e30 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5595c8184350 0x5595c85b1d90 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595c8163670 0x5595c853af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 --2- 172.21.15.33:0/4129124693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5595c815b490 0x5595c853a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 -- 172.21.15.33:0/4129124693 >> 172.21.15.33:0/4129124693 conn(0x5595c8178740 msgr2=0x5595c8534750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62cbfff640 0 client.17226 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 -- 172.21.15.33:0/4129124693 shutdown_connections 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 1 -- 172.21.15.33:0/4129124693 wait complete. 2024-08-28T19:37:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.258+0000 7f62f95ec740 20 client.17226 trim_cache size 0 max 16384 2024-08-28T19:37:59.263 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:37:59.263 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:37:59.263 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73", 2024-08-28T19:37:59.263 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:37:59.263 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:37:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 -- 172.21.15.33:0/186844800 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62dc0b4ca0 msgr2=0x7f62dc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62dc0b4ca0 0x7f62dc0b71b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f62e4005cc0 tx=0x7f62e4005c30 comp rx=0 tx=0).stop 2024-08-28T19:37:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 -- 172.21.15.33:0/186844800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec108140 msgr2=0x7f62ec19a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:37:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec108140 0x7f62ec19a7e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f62d800b450 tx=0x7f62d800b910 comp rx=0 tx=0).stop 2024-08-28T19:37:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 -- 172.21.15.33:0/186844800 shutdown_connections 2024-08-28T19:37:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62ec108a90 0x7f62ec19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec108140 0x7f62ec19a7e0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62dc0b4ca0 0x7f62dc0b71b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 --2- 172.21.15.33:0/186844800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f62ec102800 0x7f62ec19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:37:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 -- 172.21.15.33:0/186844800 >> 172.21.15.33:0/186844800 conn(0x7f62ec0794d0 msgr2=0x7f62ec06af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:37:59.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 -- 172.21.15.33:0/186844800 shutdown_connections 2024-08-28T19:37:59.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:37:59.259+0000 7f62f3077640 1 -- 172.21.15.33:0/186844800 wait complete. 2024-08-28T19:37:59.734 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:37:59 smithi033 ceph-mon[18549]: pgmap v508: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-28T19:37:59.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:37:59 smithi059 ceph-mon[22052]: pgmap v508: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-28T19:37:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:37:59 smithi122 ceph-mon[22174]: pgmap v508: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-28T19:37:59.968 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:38:00.221 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:00.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:00 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:38:00.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:00 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:00.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:00 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:38:00.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:00 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.745+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1946617348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e4109280 msgr2=0x7f79e4109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.745+0000 7f79eb9bd640 1 --2- 172.21.15.33:0/1946617348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e4109280 0x7f79e4109690 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009900 tx=0x7f79d802a410 comp rx=0 tx=0).stop 2024-08-28T19:38:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.745+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1946617348 shutdown_connections 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.745+0000 7f79eb9bd640 1 --2- 172.21.15.33:0/1946617348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79e4109bd0 0x7f79e4110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.745+0000 7f79eb9bd640 1 --2- 172.21.15.33:0/1946617348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e4109280 0x7f79e4109690 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.745+0000 7f79eb9bd640 1 --2- 172.21.15.33:0/1946617348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e4103940 0x7f79e4103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.745+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1946617348 >> 172.21.15.33:0/1946617348 conn(0x7f79e40ff3d0 msgr2=0x7f79e4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.745+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1946617348 shutdown_connections 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.745+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1946617348 wait complete. 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79eb9bd640 1 Processor -- start 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79eb9bd640 1 -- start start 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79eb9bd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79e4103940 0x7f79e419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79eb9bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e4109280 0x7f79e419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79eb9bd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e4109bd0 0x7f79e419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79eb9bd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f79e4113890 con 0x7f79e4109bd0 2024-08-28T19:38:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79eb9bd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f79e4113710 con 0x7f79e4109280 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79eb9bd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f79e4113a10 con 0x7f79e4103940 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79e9f5a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e4109bd0 0x7f79e419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79e9f5a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e4109bd0 0x7f79e419faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48834/0 (socket says 172.21.15.33:48834) 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.746+0000 7f79e9f5a640 1 -- 172.21.15.33:0/1916305288 learned_addr learned my addr 172.21.15.33:0/1916305288 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e9759640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79e4103940 0x7f79e419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e8f58640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e4109280 0x7f79e419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e9f5a640 1 -- 172.21.15.33:0/1916305288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79e4103940 msgr2=0x7f79e419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e9f5a640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79e4103940 0x7f79e419a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e9f5a640 1 -- 172.21.15.33:0/1916305288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e4109280 msgr2=0x7f79e419a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e9f5a640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e4109280 0x7f79e419a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e9f5a640 1 -- 172.21.15.33:0/1916305288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e41a0110 con 0x7f79e4109bd0 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e9f5a640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e4109bd0 0x7f79e419faa0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00c970 tx=0x7f79dc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e27fc640 1 -- 172.21.15.33:0/1916305288 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc007bb0 con 0x7f79e4109bd0 2024-08-28T19:38:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1916305288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e41a0400 con 0x7f79e4109bd0 2024-08-28T19:38:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e27fc640 1 -- 172.21.15.33:0/1916305288 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79dc007d50 con 0x7f79e4109bd0 2024-08-28T19:38:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79e27fc640 1 -- 172.21.15.33:0/1916305288 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc018770 con 0x7f79e4109bd0 2024-08-28T19:38:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.747+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1916305288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e41a08c0 con 0x7f79e4109bd0 2024-08-28T19:38:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79f1f32740 1 Processor -- start 2024-08-28T19:38:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79e27fc640 1 -- 172.21.15.33:0/1916305288 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f79dc00f990 con 0x7f79e4109bd0 2024-08-28T19:38:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79f1f32740 1 -- start start 2024-08-28T19:38:00.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cd9070 0x5572f707e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb01b0 0x5572f707e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb8390 0x5572f707ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79f1f32740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5572f6ff5630 con 0x5572f6cb01b0 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79f1f32740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5572f6fe4bc0 con 0x5572f6cd9070 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79f1f32740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5572f6fe8b70 con 0x5572f6cb8390 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79e9759640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb01b0 0x5572f707e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.751+0000 7f79e9759640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb01b0 0x5572f707e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48844/0 (socket says 172.21.15.33:48844) 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e9759640 1 -- 172.21.15.33:0/3377909694 learned_addr learned my addr 172.21.15.33:0/3377909694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e8f58640 1 --2- 172.21.15.33:0/3377909694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb8390 0x5572f707ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e8f58640 1 --2- 172.21.15.33:0/3377909694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cd9070 0x5572f707e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e9759640 1 -- 172.21.15.33:0/3377909694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb8390 msgr2=0x5572f707ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e9759640 1 --2- 172.21.15.33:0/3377909694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb8390 0x5572f707ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e9759640 1 -- 172.21.15.33:0/3377909694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cd9070 msgr2=0x5572f707e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e9759640 1 --2- 172.21.15.33:0/3377909694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cd9070 0x5572f707e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e9759640 1 -- 172.21.15.33:0/3377909694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f6d44650 con 0x5572f6cb01b0 2024-08-28T19:38:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e8f58640 1 --2- 172.21.15.33:0/3377909694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cd9070 0x5572f707e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e27fc640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79cc0b4cd0 0x7f79cc0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e8f58640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79cc0b4cd0 0x7f79cc0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e27fc640 1 -- 172.21.15.33:0/1916305288 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f79dc0e5920 con 0x7f79e4109bd0 2024-08-28T19:38:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79e9759640 1 --2- 172.21.15.33:0/3377909694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb01b0 0x5572f707e840 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f79d400af40 tx=0x7f79d400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2abf5104442c25 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79cb7fe640 1 -- 172.21.15.33:0/3377909694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d401d070 con 0x5572f6cb01b0 2024-08-28T19:38:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79cb7fe640 1 -- 172.21.15.33:0/3377909694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79d4010db0 con 0x5572f6cb01b0 2024-08-28T19:38:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.752+0000 7f79cb7fe640 1 -- 172.21.15.33:0/3377909694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d4018d50 con 0x5572f6cb01b0 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.753+0000 7f79f1f32740 1 -- 172.21.15.33:0/3377909694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb01b0 msgr2=0x5572f707e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.753+0000 7f79e8f58640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79cc0b4cd0 0x7f79cc0b71e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009230 tx=0x7f79d8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.753+0000 7f79f1f32740 1 --2- 172.21.15.33:0/3377909694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb01b0 0x5572f707e840 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f79d400af40 tx=0x7f79d400f850 comp rx=0 tx=0).stop 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.753+0000 7f79f1f32740 1 -- 172.21.15.33:0/3377909694 shutdown_connections 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.753+0000 7f79f1f32740 1 --2- 172.21.15.33:0/3377909694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb8390 0x5572f707ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.753+0000 7f79f1f32740 1 --2- 172.21.15.33:0/3377909694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb01b0 0x5572f707e840 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.753+0000 7f79f1f32740 1 --2- 172.21.15.33:0/3377909694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cd9070 0x5572f707e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.753+0000 7f79f1f32740 1 -- 172.21.15.33:0/3377909694 >> 172.21.15.33:0/3377909694 conn(0x5572f6ccd460 msgr2=0x5572f707c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.753+0000 7f79f1f32740 1 -- 172.21.15.33:0/3377909694 shutdown_connections 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.753+0000 7f79f1f32740 1 -- 172.21.15.33:0/3377909694 wait complete. 2024-08-28T19:38:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.754+0000 7f79f1f32740 1 -- start start 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.754+0000 7f79f1f32740 1 Processor -- start 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.754+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cb01b0 0x5572f7089a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.754+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7089f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.754+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cd9070 0x5572f7095dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.754+0000 7f79f1f32740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5572f6e47700 con 0x5572f6cb8390 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.754+0000 7f79f1f32740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5572f6f6b700 con 0x5572f6cb01b0 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.754+0000 7f79f1f32740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5572f708cae0 con 0x5572f6cd9070 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79f1f32740 10 client.0 _ll_register_callbacks cb 0x5572f6f9adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e8f58640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7089f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e8f58640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7089f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48854/0 (socket says 172.21.15.33:48854) 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e8f58640 1 -- 172.21.15.33:0/2939771018 learned_addr learned my addr 172.21.15.33:0/2939771018 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e9f5a640 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cd9070 0x5572f7095dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e9759640 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cb01b0 0x5572f7089a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e8f58640 1 -- 172.21.15.33:0/2939771018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cd9070 msgr2=0x5572f7095dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e8f58640 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cd9070 0x5572f7095dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e8f58640 1 -- 172.21.15.33:0/2939771018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cb01b0 msgr2=0x5572f7089a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e8f58640 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cb01b0 0x5572f7089a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e8f58640 1 -- 172.21.15.33:0/2939771018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572f6fa48b0 con 0x5572f6cb8390 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79e8f58640 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7089f80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f79d8005ab0 tx=0x7f79d8009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3429fd3210b47f42 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79c8ff9640 1 -- 172.21.15.33:0/2939771018 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d804d030 con 0x5572f6cb8390 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79c8ff9640 1 -- 172.21.15.33:0/2939771018 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f79d8004310 con 0x5572f6cb8390 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.755+0000 7f79f1f32740 1 -- 172.21.15.33:0/2939771018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79d4010db0 con 0x5572f6cb8390 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79c8ff9640 1 -- 172.21.15.33:0/2939771018 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f79d805a050 con 0x5572f6cb8390 2024-08-28T19:38:00.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79f1f32740 10 client.17238 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79f1f32740 1 -- 172.21.15.33:0/2939771018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5572f7098790 con 0x5572f6cb8390 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79c8ff9640 1 -- 172.21.15.33:0/2939771018 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79d4010db0 con 0x5572f6cb8390 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79c8ff9640 1 -- 172.21.15.33:0/2939771018 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f79d803a040 con 0x5572f6cb8390 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79f1f32740 10 client.17238 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79f1f32740 10 client.17238 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79f1f32740 20 client.17238 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79f1f32740 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5572f6c979f0 0x5572f709bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79f1f32740 4 client.17238 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79f1f32740 1 -- 172.21.15.33:0/2939771018 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572f6ff7580 con 0x5572f6c979f0 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.756+0000 7f79e9759640 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5572f6c979f0 0x5572f709bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.757+0000 7f79e9759640 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5572f6c979f0 0x5572f709bd10 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4309c2015f1c733 server_cookie=18d6f134ab903374 in_seq=0 out_seq=0 2024-08-28T19:38:00.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.757+0000 7f79c8ff9640 10 client.17238 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:00.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79c8ff9640 1 -- 172.21.15.33:0/2939771018 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572f6ff7580 con 0x5572f6c979f0 2024-08-28T19:38:00.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79c8ff9640 10 client.17238 handle_command_reply: tid=0 2024-08-28T19:38:00.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 client.17238 shutdown 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 -- 172.21.15.33:0/2939771018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 msgr2=0x5572f7089f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7089f80 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f79d8005ab0 tx=0x7f79d8009680 comp rx=0 tx=0).stop 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 -- 172.21.15.33:0/2939771018 shutdown_connections 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cd9070 0x5572f7095dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5572f6c979f0 0x5572f709bd10 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79c8ff9640 0 client.17238 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7089f80 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 --2- 172.21.15.33:0/2939771018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cb01b0 0x5572f7089a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 -- 172.21.15.33:0/2939771018 >> 172.21.15.33:0/2939771018 conn(0x5572f6ccd460 msgr2=0x5572f70814e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 -- 172.21.15.33:0/2939771018 shutdown_connections 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 1 -- 172.21.15.33:0/2939771018 wait complete. 2024-08-28T19:38:00.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.758+0000 7f79f1f32740 20 client.17238 trim_cache size 0 max 16384 2024-08-28T19:38:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.776+0000 7f79f1f32740 1 Processor -- start 2024-08-28T19:38:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.776+0000 7f79f1f32740 1 -- start start 2024-08-28T19:38:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.776+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6c979f0 0x5572f707fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.776+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cb01b0 0x5572f7086c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.776+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7087170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.776+0000 7f79f1f32740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41b0a50 con 0x5572f6cb8390 2024-08-28T19:38:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.776+0000 7f79f1f32740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41b2590 con 0x5572f6cb01b0 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.776+0000 7f79f1f32740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41b1120 con 0x5572f6c979f0 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e9f5a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7087170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e9f5a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7087170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48868/0 (socket says 172.21.15.33:48868) 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e9f5a640 1 -- 172.21.15.33:0/3606607750 learned_addr learned my addr 172.21.15.33:0/3606607750 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e9759640 1 --2- 172.21.15.33:0/3606607750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6c979f0 0x5572f707fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e8f58640 1 --2- 172.21.15.33:0/3606607750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cb01b0 0x5572f7086c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e9f5a640 1 -- 172.21.15.33:0/3606607750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6c979f0 msgr2=0x5572f707fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e9f5a640 1 --2- 172.21.15.33:0/3606607750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6c979f0 0x5572f707fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e9f5a640 1 -- 172.21.15.33:0/3606607750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cb01b0 msgr2=0x5572f7086c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e9f5a640 1 --2- 172.21.15.33:0/3606607750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cb01b0 0x5572f7086c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e9f5a640 1 -- 172.21.15.33:0/3606607750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f708aae0 con 0x5572f6cb8390 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79e9f5a640 1 --2- 172.21.15.33:0/3606607750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7087170 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0e2d80 tx=0x7f79dc0ab540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d07a3332cbaa1f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79caffd640 1 -- 172.21.15.33:0/3606607750 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc0abcc0 con 0x5572f6cb8390 2024-08-28T19:38:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79caffd640 1 -- 172.21.15.33:0/3606607750 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79dc0b0530 con 0x5572f6cb8390 2024-08-28T19:38:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.777+0000 7f79caffd640 1 -- 172.21.15.33:0/3606607750 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc0b0330 con 0x5572f6cb8390 2024-08-28T19:38:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 -- 172.21.15.33:0/3606607750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 msgr2=0x5572f7087170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 --2- 172.21.15.33:0/3606607750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7087170 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0e2d80 tx=0x7f79dc0ab540 comp rx=0 tx=0).stop 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 -- 172.21.15.33:0/3606607750 shutdown_connections 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 --2- 172.21.15.33:0/3606607750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f7087170 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 --2- 172.21.15.33:0/3606607750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6cb01b0 0x5572f7086c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 --2- 172.21.15.33:0/3606607750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6c979f0 0x5572f707fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 -- 172.21.15.33:0/3606607750 >> 172.21.15.33:0/3606607750 conn(0x5572f6ccd460 msgr2=0x5572f707f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 -- 172.21.15.33:0/3606607750 shutdown_connections 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 -- 172.21.15.33:0/3606607750 wait complete. 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 -- start start 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.778+0000 7f79f1f32740 1 Processor -- start 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6c979f0 0x5572f7090020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb01b0 0x5572f7090560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79f1f32740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f71056e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79f1f32740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41b1ec0 con 0x5572f6cb8390 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79f1f32740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41b17f0 con 0x5572f6c979f0 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79f1f32740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41aea30 con 0x5572f6cb01b0 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79f1f32740 10 client.0 _ll_register_callbacks cb 0x7f79d8041050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e9f5a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f71056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e8f58640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb01b0 0x5572f7090560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e9f5a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f71056e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48878/0 (socket says 172.21.15.33:48878) 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e9f5a640 1 -- 172.21.15.33:0/4085780881 learned_addr learned my addr 172.21.15.33:0/4085780881 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e9759640 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6c979f0 0x5572f7090020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e8f58640 1 -- 172.21.15.33:0/4085780881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6c979f0 msgr2=0x5572f7090020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e8f58640 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6c979f0 0x5572f7090020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e8f58640 1 -- 172.21.15.33:0/4085780881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 msgr2=0x5572f71056e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e8f58640 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f71056e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e8f58640 1 -- 172.21.15.33:0/4085780881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572f7090de0 con 0x5572f6cb01b0 2024-08-28T19:38:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.779+0000 7f79e9f5a640 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f71056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.780+0000 7f79e8f58640 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb01b0 0x5572f7090560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f79d8005d00 tx=0x7f79d8032d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f154dc0c2f24c44 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.780+0000 7f79c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.780+0000 7f79c8ff9640 1 -- 172.21.15.33:0/4085780881 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d804d070 con 0x5572f6cb01b0 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.780+0000 7f79f1f32740 1 -- 172.21.15.33:0/4085780881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79dc0b0530 con 0x5572f6cb01b0 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.780+0000 7f79c8ff9640 1 -- 172.21.15.33:0/4085780881 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f79d8049b10 con 0x5572f6cb01b0 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.780+0000 7f79c8ff9640 1 -- 172.21.15.33:0/4085780881 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f79d8067050 con 0x5572f6cb01b0 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.780+0000 7f79f1f32740 10 client.26452 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.780+0000 7f79f1f32740 1 -- 172.21.15.33:0/4085780881 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5572f7106cd0 con 0x5572f6cb01b0 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.780+0000 7f79c8ff9640 1 -- 172.21.15.33:0/4085780881 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79dc0b0530 con 0x5572f6cb01b0 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.780+0000 7f79c8ff9640 1 -- 172.21.15.33:0/4085780881 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f79d803d450 con 0x5572f6cb01b0 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79f1f32740 10 client.26452 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79f1f32740 10 client.26452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:38:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79f1f32740 20 client.26452 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79f1f32740 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5572f6cd9070 0x5572f7109490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79f1f32740 4 client.26452 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79f1f32740 1 -- 172.21.15.33:0/4085780881 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5572f6ff3020 con 0x5572f6cd9070 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79e9759640 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5572f6cd9070 0x5572f7109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79e9759640 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5572f6cd9070 0x5572f7109490 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe7658621d73cb20 server_cookie=4845c217167d3061 in_seq=0 out_seq=0 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79c8ff9640 10 client.26452 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79c8ff9640 1 -- 172.21.15.33:0/4085780881 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x5572f6ff3020 con 0x5572f6cd9070 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79c8ff9640 10 client.26452 handle_command_reply: tid=0 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.781+0000 7f79f1f32740 1 client.26452 shutdown 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 1 -- 172.21.15.33:0/4085780881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb01b0 msgr2=0x5572f7090560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb01b0 0x5572f7090560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f79d8005d00 tx=0x7f79d8032d60 comp rx=0 tx=0).stop 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 1 -- 172.21.15.33:0/4085780881 shutdown_connections 2024-08-28T19:38:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5572f6cd9070 0x5572f7109490 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5572f6cb8390 0x5572f71056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5572f6cb01b0 0x5572f7090560 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79c8ff9640 0 client.26452 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 1 --2- 172.21.15.33:0/4085780881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572f6c979f0 0x5572f7090020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 1 -- 172.21.15.33:0/4085780881 >> 172.21.15.33:0/4085780881 conn(0x5572f6ccd460 msgr2=0x5572f708b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 1 -- 172.21.15.33:0/4085780881 shutdown_connections 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 1 -- 172.21.15.33:0/4085780881 wait complete. 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.782+0000 7f79f1f32740 20 client.26452 trim_cache size 0 max 16384 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:38:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73", 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:38:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:38:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:38:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:38:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1916305288 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79cc0b4cd0 msgr2=0x7f79cc0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79cc0b4cd0 0x7f79cc0b71e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009230 tx=0x7f79d8031400 comp rx=0 tx=0).stop 2024-08-28T19:38:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1916305288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e4109bd0 msgr2=0x7f79e419faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e4109bd0 0x7f79e419faa0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00c970 tx=0x7f79dc00ce30 comp rx=0 tx=0).stop 2024-08-28T19:38:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1916305288 shutdown_connections 2024-08-28T19:38:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e4109bd0 0x7f79e419faa0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e4109280 0x7f79e419a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f79cc0b4cd0 0x7f79cc0b71e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 --2- 172.21.15.33:0/1916305288 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f79e4103940 0x7f79e419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1916305288 >> 172.21.15.33:0/1916305288 conn(0x7f79e40ff3d0 msgr2=0x7f79e41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1916305288 shutdown_connections 2024-08-28T19:38:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:00.783+0000 7f79eb9bd640 1 -- 172.21.15.33:0/1916305288 wait complete. 2024-08-28T19:38:00.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:00 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:38:00.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:00 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:00.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:00 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:38:00.797 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:00 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:00.797 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:00 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:38:00.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:00 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:00.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:00 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:38:00.798 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:00 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:01.626 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:01 smithi033 ceph-mon[18549]: pgmap v509: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-28T19:38:01.655 INFO:tasks.cephfs.filesystem:scrub status for tag:a2873d41-eb7f-49e9-8acb-f43ef3f1ee73 - {'path': '/', 'tag': 'a2873d41-eb7f-49e9-8acb-f43ef3f1ee73', 'options': 'recursive,force'} 2024-08-28T19:38:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:01 smithi059 ceph-mon[22052]: pgmap v509: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-28T19:38:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:01 smithi122 ceph-mon[22174]: pgmap v509: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-28T19:38:03.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:03 smithi059 ceph-mon[22052]: pgmap v510: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-28T19:38:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:03 smithi122 ceph-mon[22174]: pgmap v510: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-28T19:38:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:03 smithi033 ceph-mon[18549]: pgmap v510: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-08-28T19:38:05.287 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:38:05.562 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:05.574 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:05 smithi033 ceph-mon[18549]: pgmap v511: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-08-28T19:38:05.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:05 smithi059 ceph-mon[22052]: pgmap v511: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-08-28T19:38:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:05 smithi122 ceph-mon[22174]: pgmap v511: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-08-28T19:38:06.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.111+0000 7f56fb178640 1 -- 172.21.15.33:0/3993552687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f41050b0 msgr2=0x7f56f410d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:06.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.111+0000 7f56fb178640 1 --2- 172.21.15.33:0/3993552687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f41050b0 0x7f56f410d6f0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009900 tx=0x7f56dc02a410 comp rx=0 tx=0).stop 2024-08-28T19:38:06.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.111+0000 7f56fb178640 1 -- 172.21.15.33:0/3993552687 shutdown_connections 2024-08-28T19:38:06.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.111+0000 7f56fb178640 1 --2- 172.21.15.33:0/3993552687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f410dc30 0x7f56f41100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:06.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.111+0000 7f56fb178640 1 --2- 172.21.15.33:0/3993552687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f41050b0 0x7f56f410d6f0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:06.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.111+0000 7f56fb178640 1 --2- 172.21.15.33:0/3993552687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f4104680 0x7f56f4104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:06.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.111+0000 7f56fb178640 1 -- 172.21.15.33:0/3993552687 >> 172.21.15.33:0/3993552687 conn(0x7f56f4079530 msgr2=0x7f56f4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.111+0000 7f56fb178640 1 -- 172.21.15.33:0/3993552687 shutdown_connections 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.111+0000 7f56fb178640 1 -- 172.21.15.33:0/3993552687 wait complete. 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.112+0000 7f56fb178640 1 Processor -- start 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.112+0000 7f56fb178640 1 -- start start 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.112+0000 7f56fb178640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f4104680 0x7f56f419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56fb178640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f41050b0 0x7f56f419c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56fb178640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f410dc30 0x7f56f41a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56fb178640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f56f4113840 con 0x7f56f410dc30 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56fb178640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56f41136c0 con 0x7f56f4104680 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56fb178640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f56f41139c0 con 0x7f56f41050b0 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f9715640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f410dc30 0x7f56f41a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f9715640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f410dc30 0x7f56f41a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48888/0 (socket says 172.21.15.33:48888) 2024-08-28T19:38:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f9715640 1 -- 172.21.15.33:0/3214052269 learned_addr learned my addr 172.21.15.33:0/3214052269 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f8f14640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f4104680 0x7f56f419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f3fff640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f41050b0 0x7f56f419c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f9715640 1 -- 172.21.15.33:0/3214052269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f41050b0 msgr2=0x7f56f419c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f9715640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f41050b0 0x7f56f419c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f9715640 1 -- 172.21.15.33:0/3214052269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f4104680 msgr2=0x7f56f419c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f9715640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f4104680 0x7f56f419c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f9715640 1 -- 172.21.15.33:0/3214052269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f41a2380 con 0x7f56f410dc30 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f9715640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f410dc30 0x7f56f41a1c50 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00d750 tx=0x7f56ec00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f1ffb640 1 -- 172.21.15.33:0/3214052269 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec017070 con 0x7f56f410dc30 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f1ffb640 1 -- 172.21.15.33:0/3214052269 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56ec0054d0 con 0x7f56f410dc30 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56fb178640 1 -- 172.21.15.33:0/3214052269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f41a2670 con 0x7f56f410dc30 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.113+0000 7f56f1ffb640 1 -- 172.21.15.33:0/3214052269 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec004c60 con 0x7f56f410dc30 2024-08-28T19:38:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.114+0000 7f56fb178640 1 -- 172.21.15.33:0/3214052269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f41a8dd0 con 0x7f56f410dc30 2024-08-28T19:38:06.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.115+0000 7f56fb178640 1 -- 172.21.15.33:0/3214052269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f4104a90 con 0x7f56f410dc30 2024-08-28T19:38:06.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.116+0000 7f56f1ffb640 1 -- 172.21.15.33:0/3214052269 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f56ec009bd0 con 0x7f56f410dc30 2024-08-28T19:38:06.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.117+0000 7f56f1ffb640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f56e00b4ca0 0x7f56e00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:06.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.117+0000 7f56f8f14640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f56e00b4ca0 0x7f56e00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:06.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.117+0000 7f56f1ffb640 1 -- 172.21.15.33:0/3214052269 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f56ec0e55c0 con 0x7f56f410dc30 2024-08-28T19:38:06.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.117+0000 7f56f8f14640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f56e00b4ca0 0x7f56e00b71b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f56e4005fd0 tx=0x7f56e4009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:06.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.120+0000 7f56f1ffb640 1 -- 172.21.15.33:0/3214052269 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f56ec0aba10 con 0x7f56f410dc30 2024-08-28T19:38:06.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.342+0000 7f56fb178640 1 -- 172.21.15.33:0/3214052269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56f41a9040 con 0x7f56f410dc30 2024-08-28T19:38:06.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.342+0000 7f56f1ffb640 1 -- 172.21.15.33:0/3214052269 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f56ec0b01d0 con 0x7f56f410dc30 2024-08-28T19:38:06.343 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:38:06.343 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:38:06.344 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:38:06.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 -- 172.21.15.33:0/3214052269 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f56e00b4ca0 msgr2=0x7f56e00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:06.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f56e00b4ca0 0x7f56e00b71b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f56e4005fd0 tx=0x7f56e4009680 comp rx=0 tx=0).stop 2024-08-28T19:38:06.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 -- 172.21.15.33:0/3214052269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f410dc30 msgr2=0x7f56f41a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:06.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f410dc30 0x7f56f41a1c50 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00d750 tx=0x7f56ec00dc10 comp rx=0 tx=0).stop 2024-08-28T19:38:06.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 -- 172.21.15.33:0/3214052269 shutdown_connections 2024-08-28T19:38:06.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56f410dc30 0x7f56f41a1c50 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:06.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f56e00b4ca0 0x7f56e00b71b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:06.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f56f41050b0 0x7f56f419c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:06.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 --2- 172.21.15.33:0/3214052269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f4104680 0x7f56f419c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:06.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 -- 172.21.15.33:0/3214052269 >> 172.21.15.33:0/3214052269 conn(0x7f56f4079530 msgr2=0x7f56f4100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:06.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 -- 172.21.15.33:0/3214052269 shutdown_connections 2024-08-28T19:38:06.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:06.345+0000 7f56fb178640 1 -- 172.21.15.33:0/3214052269 wait complete. 2024-08-28T19:38:06.641 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:06 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3214052269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:06.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:06 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3214052269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:06.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:06 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3214052269' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:07.196 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id 9de6fa5e --release --await' 2024-08-28T19:38:07.197 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id 9de6fa5e --release --await 2024-08-28T19:38:07.464 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:07.694 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:07 smithi122 ceph-mon[22174]: pgmap v512: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-28T19:38:07.762 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:07 smithi033 ceph-mon[18549]: pgmap v512: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-28T19:38:07.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:07 smithi059 ceph-mon[22052]: pgmap v512: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-28T19:38:08.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.031+0000 7effacc21640 1 -- 172.21.15.33:0/1997642894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa8102810 msgr2=0x7effa8102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.031+0000 7effacc21640 1 --2- 172.21.15.33:0/1997642894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa8102810 0x7effa8102c20 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7eff98009900 tx=0x7eff9802a410 comp rx=0 tx=0).stop 2024-08-28T19:38:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.031+0000 7effacc21640 1 -- 172.21.15.33:0/1997642894 shutdown_connections 2024-08-28T19:38:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.031+0000 7effacc21640 1 --2- 172.21.15.33:0/1997642894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa8108aa0 0x7effa810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.031+0000 7effacc21640 1 --2- 172.21.15.33:0/1997642894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8108150 0x7effa8108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.031+0000 7effacc21640 1 --2- 172.21.15.33:0/1997642894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa8102810 0x7effa8102c20 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.031+0000 7effacc21640 1 -- 172.21.15.33:0/1997642894 >> 172.21.15.33:0/1997642894 conn(0x7effa80794b0 msgr2=0x7effa80798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.031+0000 7effacc21640 1 -- 172.21.15.33:0/1997642894 shutdown_connections 2024-08-28T19:38:08.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.031+0000 7effacc21640 1 -- 172.21.15.33:0/1997642894 wait complete. 2024-08-28T19:38:08.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.032+0000 7effacc21640 1 Processor -- start 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.032+0000 7effacc21640 1 -- start start 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effacc21640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8102810 0x7effa8197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effacc21640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa8108150 0x7effa8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effacc21640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa8108aa0 0x7effa819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effacc21640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7effa8112770 con 0x7effa8108aa0 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effacc21640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7effa81125f0 con 0x7effa8102810 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effacc21640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7effa81128f0 con 0x7effa8108150 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effa6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa8108aa0 0x7effa819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effa6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa8108aa0 0x7effa819d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48908/0 (socket says 172.21.15.33:48908) 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effa6d9d640 1 -- 172.21.15.33:0/2137681229 learned_addr learned my addr 172.21.15.33:0/2137681229 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7eff9ffff640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa8108150 0x7effa8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effa659c640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8102810 0x7effa8197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effa6d9d640 1 -- 172.21.15.33:0/2137681229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa8108150 msgr2=0x7effa8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effa6d9d640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa8108150 0x7effa8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effa6d9d640 1 -- 172.21.15.33:0/2137681229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8102810 msgr2=0x7effa8197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effa6d9d640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8102810 0x7effa8197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effa6d9d640 1 -- 172.21.15.33:0/2137681229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa819de50 con 0x7effa8108aa0 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.033+0000 7effa6d9d640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa8108aa0 0x7effa819d720 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7effa000eaa0 tx=0x7effa000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.034+0000 7eff9f7fe640 1 -- 172.21.15.33:0/2137681229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa000cdb0 con 0x7effa8108aa0 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.034+0000 7eff9f7fe640 1 -- 172.21.15.33:0/2137681229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effa0005020 con 0x7effa8108aa0 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.034+0000 7effacc21640 1 -- 172.21.15.33:0/2137681229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa819e0e0 con 0x7effa8108aa0 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.034+0000 7eff9f7fe640 1 -- 172.21.15.33:0/2137681229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00116d0 con 0x7effa8108aa0 2024-08-28T19:38:08.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.034+0000 7effacc21640 1 -- 172.21.15.33:0/2137681229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa819e890 con 0x7effa8108aa0 2024-08-28T19:38:08.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.036+0000 7effb3196740 1 Processor -- start 2024-08-28T19:38:08.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.037+0000 7eff9f7fe640 1 -- 172.21.15.33:0/2137681229 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7effa00051d0 con 0x7effa8108aa0 2024-08-28T19:38:08.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.037+0000 7effb3196740 1 -- start start 2024-08-28T19:38:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.037+0000 7effb3196740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3df1520 0x5653e4196c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.037+0000 7effb3196740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dc8660 0x5653e41971c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.037+0000 7effb3196740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 0x5653e4197700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.037+0000 7effb3196740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5653e410da70 con 0x5653e3df1520 2024-08-28T19:38:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.037+0000 7effb3196740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5653e40fd000 con 0x5653e3dd0840 2024-08-28T19:38:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.037+0000 7effb3196740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5653e4100fb0 con 0x5653e3dc8660 2024-08-28T19:38:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.037+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3df1520 0x5653e4196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3df1520 0x5653e4196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48922/0 (socket says 172.21.15.33:48922) 2024-08-28T19:38:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9ffff640 1 -- 172.21.15.33:0/101086577 learned_addr learned my addr 172.21.15.33:0/101086577 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7effa659c640 1 --2- 172.21.15.33:0/101086577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dc8660 0x5653e41971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9ffff640 1 --2- 172.21.15.33:0/101086577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 0x5653e4197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9f7fe640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff940b4ca0 0x7eff940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9ffff640 1 -- 172.21.15.33:0/101086577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dc8660 msgr2=0x5653e41971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9ffff640 1 --2- 172.21.15.33:0/101086577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dc8660 0x5653e41971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9ffff640 1 -- 172.21.15.33:0/101086577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 msgr2=0x5653e4197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9ffff640 1 --2- 172.21.15.33:0/101086577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 0x5653e4197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7effa6d9d640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff940b4ca0 0x7eff940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9ffff640 1 -- 172.21.15.33:0/101086577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653e3e5cb00 con 0x5653e3df1520 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9f7fe640 1 -- 172.21.15.33:0/2137681229 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7effa00e5930 con 0x7effa8108aa0 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9ffff640 1 --2- 172.21.15.33:0/101086577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3df1520 0x5653e4196c80 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7eff90012750 tx=0x7eff9000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfedc14ac4c7798 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.038+0000 7eff9cff9640 1 -- 172.21.15.33:0/101086577 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff900120d0 con 0x5653e3df1520 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.039+0000 7effa6d9d640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff940b4ca0 0x7eff940b71b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7effa00e2de0 tx=0x7effa001ed30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.039+0000 7eff9cff9640 1 -- 172.21.15.33:0/101086577 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff90005020 con 0x5653e3df1520 2024-08-28T19:38:08.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.039+0000 7eff9cff9640 1 -- 172.21.15.33:0/101086577 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90004a00 con 0x5653e3df1520 2024-08-28T19:38:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.039+0000 7effb3196740 1 -- 172.21.15.33:0/101086577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3df1520 msgr2=0x5653e4196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.039+0000 7effb3196740 1 --2- 172.21.15.33:0/101086577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3df1520 0x5653e4196c80 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7eff90012750 tx=0x7eff9000b820 comp rx=0 tx=0).stop 2024-08-28T19:38:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.039+0000 7effb3196740 1 -- 172.21.15.33:0/101086577 shutdown_connections 2024-08-28T19:38:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.039+0000 7effb3196740 1 --2- 172.21.15.33:0/101086577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 0x5653e4197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.039+0000 7effb3196740 1 --2- 172.21.15.33:0/101086577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dc8660 0x5653e41971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.039+0000 7effb3196740 1 --2- 172.21.15.33:0/101086577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3df1520 0x5653e4196c80 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.039+0000 7effb3196740 1 -- 172.21.15.33:0/101086577 >> 172.21.15.33:0/101086577 conn(0x5653e3de5910 msgr2=0x5653e4194b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.040+0000 7effb3196740 1 -- 172.21.15.33:0/101086577 shutdown_connections 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.040+0000 7effb3196740 1 -- 172.21.15.33:0/101086577 wait complete. 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.040+0000 7effb3196740 1 -- start start 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.040+0000 7effb3196740 1 Processor -- start 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.040+0000 7effb3196740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.040+0000 7effb3196740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 0x5653e41a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.040+0000 7effb3196740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3df1520 0x5653e41ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7effb3196740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5653e41a5400 con 0x5653e3dc8660 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7effb3196740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5653e40be520 con 0x5653e3df1520 2024-08-28T19:38:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7effb3196740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5653e41a5580 con 0x5653e3dd0840 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7effb3196740 10 client.0 _ll_register_callbacks cb 0x5653e40f6c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41a27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48934/0 (socket says 172.21.15.33:48934) 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff9ffff640 1 -- 172.21.15.33:0/1230158933 learned_addr learned my addr 172.21.15.33:0/1230158933 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7effa659c640 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 0x5653e41a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff9ffff640 1 -- 172.21.15.33:0/1230158933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 msgr2=0x5653e41a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff9ffff640 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 0x5653e41a2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff9ffff640 1 -- 172.21.15.33:0/1230158933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3df1520 msgr2=0x5653e41ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff9ffff640 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3df1520 0x5653e41ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff9ffff640 1 -- 172.21.15.33:0/1230158933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653e3ed3960 con 0x5653e3dc8660 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7effa659c640 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 0x5653e41a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff9ffff640 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41a27e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7eff90005720 tx=0x7eff90012380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f7afd398936c6a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:08.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff8dffb640 1 -- 172.21.15.33:0/1230158933 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9000e750 con 0x5653e3dc8660 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7eff8dffb640 1 -- 172.21.15.33:0/1230158933 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7eff9000e8f0 con 0x5653e3dc8660 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.041+0000 7effb3196740 1 -- 172.21.15.33:0/1230158933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5653e409c9a0 con 0x5653e3dc8660 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7eff8dffb640 1 -- 172.21.15.33:0/1230158933 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff90030050 con 0x5653e3dc8660 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7effb3196740 10 client.17262 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7effb3196740 1 -- 172.21.15.33:0/1230158933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653e41b1540 con 0x5653e3dc8660 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7eff8dffb640 1 -- 172.21.15.33:0/1230158933 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5653e409c9a0 con 0x5653e3dc8660 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7eff8dffb640 1 -- 172.21.15.33:0/1230158933 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7eff90003bb0 con 0x5653e3dc8660 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7effb3196740 10 client.17262 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7effb3196740 10 client.17262 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7effb3196740 20 client.17262 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7effb3196740 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5653e3dafea0 0x5653e41b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7effb3196740 4 client.17262 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:08.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7effb3196740 1 -- 172.21.15.33:0/1230158933 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653e410f9c0 con 0x5653e3dafea0 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.042+0000 7effa659c640 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5653e3dafea0 0x5653e41b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.043+0000 7effa659c640 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5653e3dafea0 0x5653e41b4950 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caf0fcdf7b12d7c3 server_cookie=f8055a106ea64ad0 in_seq=0 out_seq=0 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.043+0000 7eff8dffb640 10 client.17262 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7eff8dffb640 1 -- 172.21.15.33:0/1230158933 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653e410f9c0 con 0x5653e3dafea0 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7eff8dffb640 10 client.17262 handle_command_reply: tid=0 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 client.17262 shutdown 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 -- 172.21.15.33:0/1230158933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 msgr2=0x5653e41a27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41a27e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7eff90005720 tx=0x7eff90012380 comp rx=0 tx=0).stop 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 -- 172.21.15.33:0/1230158933 shutdown_connections 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3df1520 0x5653e41ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 0x5653e41a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5653e3dafea0 0x5653e41b4950 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 --2- 172.21.15.33:0/1230158933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41a27e0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7eff8dffb640 0 client.17262 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:08.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 -- 172.21.15.33:0/1230158933 >> 172.21.15.33:0/1230158933 conn(0x5653e3de5910 msgr2=0x5653e4199e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:08.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 -- 172.21.15.33:0/1230158933 shutdown_connections 2024-08-28T19:38:08.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 1 -- 172.21.15.33:0/1230158933 wait complete. 2024-08-28T19:38:08.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.044+0000 7effb3196740 20 client.17262 trim_cache size 0 max 16384 2024-08-28T19:38:08.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.061+0000 7effb3196740 1 Processor -- start 2024-08-28T19:38:08.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.061+0000 7effb3196740 1 -- start start 2024-08-28T19:38:08.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7effb3196740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7effb3196740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 0x5653e41aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7effb3196740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3df1520 0x5653e419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7effb3196740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7effa81bf9e0 con 0x5653e3dc8660 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7effb3196740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7effa81c1520 con 0x5653e3dd0840 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7effb3196740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7effa81c00b0 con 0x5653e3df1520 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48938/0 (socket says 172.21.15.33:48938) 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff9ffff640 1 -- 172.21.15.33:0/2930263070 learned_addr learned my addr 172.21.15.33:0/2930263070 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7effa659c640 1 --2- 172.21.15.33:0/2930263070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 0x5653e41aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff9ffff640 1 --2- 172.21.15.33:0/2930263070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3df1520 0x5653e419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff9ffff640 1 -- 172.21.15.33:0/2930263070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3df1520 msgr2=0x5653e419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff9ffff640 1 --2- 172.21.15.33:0/2930263070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3df1520 0x5653e419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff9ffff640 1 -- 172.21.15.33:0/2930263070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 msgr2=0x5653e41aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:08.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff9ffff640 1 --2- 172.21.15.33:0/2930263070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 0x5653e41aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff9ffff640 1 -- 172.21.15.33:0/2930263070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653e419de70 con 0x5653e3dc8660 2024-08-28T19:38:08.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7effa659c640 1 --2- 172.21.15.33:0/2930263070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 0x5653e41aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:08.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff9ffff640 1 --2- 172.21.15.33:0/2930263070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41ae770 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7eff90001eb0 tx=0x7eff900122e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2110f6ce3d3366c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:08.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.062+0000 7eff8ffff640 1 -- 172.21.15.33:0/2930263070 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90005330 con 0x5653e3dc8660 2024-08-28T19:38:08.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7eff8ffff640 1 -- 172.21.15.33:0/2930263070 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff900054d0 con 0x5653e3dc8660 2024-08-28T19:38:08.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7eff8ffff640 1 -- 172.21.15.33:0/2930263070 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9000ed40 con 0x5653e3dc8660 2024-08-28T19:38:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7effb3196740 1 -- 172.21.15.33:0/2930263070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 msgr2=0x5653e41ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7effb3196740 1 --2- 172.21.15.33:0/2930263070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41ae770 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7eff90001eb0 tx=0x7eff900122e0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7effb3196740 1 -- 172.21.15.33:0/2930263070 shutdown_connections 2024-08-28T19:38:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7effb3196740 1 --2- 172.21.15.33:0/2930263070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3df1520 0x5653e419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7effb3196740 1 --2- 172.21.15.33:0/2930263070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3dd0840 0x5653e41aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7effb3196740 1 --2- 172.21.15.33:0/2930263070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41ae770 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7effb3196740 1 -- 172.21.15.33:0/2930263070 >> 172.21.15.33:0/2930263070 conn(0x5653e3de5910 msgr2=0x5653e41944b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7effb3196740 1 -- 172.21.15.33:0/2930263070 shutdown_connections 2024-08-28T19:38:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.063+0000 7effb3196740 1 -- 172.21.15.33:0/2930263070 wait complete. 2024-08-28T19:38:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7effb3196740 1 -- start start 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7effb3196740 1 Processor -- start 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7effb3196740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41aae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7effb3196740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 0x5653e41a6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7effb3196740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3df1520 0x5653e41a6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7effb3196740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7effa81c0e50 con 0x5653e3dc8660 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7effb3196740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7effa81c0780 con 0x5653e3df1520 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7effb3196740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7effa81bd9c0 con 0x5653e3dd0840 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7effb3196740 10 client.0 _ll_register_callbacks cb 0x7eff9000bd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41aae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48946/0 (socket says 172.21.15.33:48946) 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.064+0000 7eff9ffff640 1 -- 172.21.15.33:0/1791688454 learned_addr learned my addr 172.21.15.33:0/1791688454 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7effa659c640 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 0x5653e41a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff9ffff640 1 -- 172.21.15.33:0/1791688454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 msgr2=0x5653e41a6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:08.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff9ffff640 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 0x5653e41a6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff9ffff640 1 -- 172.21.15.33:0/1791688454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3df1520 msgr2=0x5653e41a6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff9ffff640 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3df1520 0x5653e41a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff9ffff640 1 -- 172.21.15.33:0/1791688454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653e41a6e90 con 0x5653e3dc8660 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff9ffff640 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41aae60 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7eff9000b4e0 tx=0x7eff9000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea799c8902451d40 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff8dffb640 1 -- 172.21.15.33:0/1791688454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90010b40 con 0x5653e3dc8660 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff8dffb640 1 -- 172.21.15.33:0/1791688454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7eff90010ce0 con 0x5653e3dc8660 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7effb3196740 1 -- 172.21.15.33:0/1791688454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff900054d0 con 0x5653e3dc8660 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff8dffb640 1 -- 172.21.15.33:0/1791688454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff9000e9a0 con 0x5653e3dc8660 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7effb3196740 10 client.17268 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:08.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7effb3196740 1 -- 172.21.15.33:0/1791688454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653e421f050 con 0x5653e3dc8660 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.065+0000 7eff8dffb640 1 -- 172.21.15.33:0/1791688454 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff900054d0 con 0x5653e3dc8660 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.066+0000 7eff8dffb640 1 -- 172.21.15.33:0/1791688454 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7eff90003c30 con 0x5653e3dc8660 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.066+0000 7effb3196740 10 client.17268 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.066+0000 7effb3196740 10 client.17268 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.066+0000 7effb3196740 20 client.17268 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.066+0000 7effb3196740 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5653e3d85250 0x5653e42216f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.066+0000 7effb3196740 4 client.17268 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9de6fa5e", "release": true, "await": true}] 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.066+0000 7effb3196740 1 -- 172.21.15.33:0/1791688454 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9de6fa5e", "release": true, "await": true}) -- 0x5653e410b460 con 0x5653e3d85250 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.066+0000 7effa659c640 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5653e3d85250 0x5653e42216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.066+0000 7effa659c640 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5653e3d85250 0x5653e42216f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0df57ec0a90848c server_cookie=36320ec8c809dbfe in_seq=0 out_seq=0 2024-08-28T19:38:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.066+0000 7eff8dffb640 10 client.17268 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:08.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.070+0000 7eff8dffb640 1 -- 172.21.15.33:0/1791688454 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5653e410b460 con 0x5653e3d85250 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.070+0000 7eff8dffb640 10 client.17268 handle_command_reply: tid=0 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.070+0000 7effb3196740 1 client.17268 shutdown 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 1 -- 172.21.15.33:0/1791688454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 msgr2=0x5653e41aae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41aae60 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7eff9000b4e0 tx=0x7eff9000b8c0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 1 -- 172.21.15.33:0/1791688454 shutdown_connections 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653e3df1520 0x5653e41a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5653e3dd0840 0x5653e41a6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5653e3d85250 0x5653e42216f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 1 --2- 172.21.15.33:0/1791688454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5653e3dc8660 0x5653e41aae60 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 1 -- 172.21.15.33:0/1791688454 >> 172.21.15.33:0/1791688454 conn(0x5653e3de5910 msgr2=0x5653e4194490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7eff8dffb640 0 client.17268 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 1 -- 172.21.15.33:0/1791688454 shutdown_connections 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 1 -- 172.21.15.33:0/1791688454 wait complete. 2024-08-28T19:38:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effb3196740 20 client.17268 trim_cache size 0 max 16384 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 16, 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout: "9de6fa5e": { 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 16, 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:38:08.074 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:08.075 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:38:08.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effacc21640 1 -- 172.21.15.33:0/2137681229 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff940b4ca0 msgr2=0x7eff940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:08.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effacc21640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff940b4ca0 0x7eff940b71b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7effa00e2de0 tx=0x7effa001ed30 comp rx=0 tx=0).stop 2024-08-28T19:38:08.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effacc21640 1 -- 172.21.15.33:0/2137681229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa8108aa0 msgr2=0x7effa819d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:08.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.071+0000 7effacc21640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa8108aa0 0x7effa819d720 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7effa000eaa0 tx=0x7effa000ef60 comp rx=0 tx=0).stop 2024-08-28T19:38:08.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.072+0000 7effacc21640 1 -- 172.21.15.33:0/2137681229 shutdown_connections 2024-08-28T19:38:08.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.072+0000 7effacc21640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa8108aa0 0x7effa819d720 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.072+0000 7effacc21640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff940b4ca0 0x7eff940b71b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.072+0000 7effacc21640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa8108150 0x7effa8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.072+0000 7effacc21640 1 --2- 172.21.15.33:0/2137681229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8102810 0x7effa8197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.072+0000 7effacc21640 1 -- 172.21.15.33:0/2137681229 >> 172.21.15.33:0/2137681229 conn(0x7effa80794b0 msgr2=0x7effa8101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.072+0000 7effacc21640 1 -- 172.21.15.33:0/2137681229 shutdown_connections 2024-08-28T19:38:08.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:08.072+0000 7effacc21640 1 -- 172.21.15.33:0/2137681229 wait complete. 2024-08-28T19:38:08.900 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9de6fa5e', total seconds elapsed: 33.6 2024-08-28T19:38:08.900 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-28T19:38:08.900 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:38:09.154 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:09.585 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:09 smithi033 ceph-mon[18549]: pgmap v513: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-28T19:38:09.585 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:09 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:38:09.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.675+0000 7f6b4fadf640 1 -- 172.21.15.33:0/825830794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b48108150 msgr2=0x7f6b48108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:09.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.675+0000 7f6b4fadf640 1 --2- 172.21.15.33:0/825830794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b48108150 0x7f6b48108560 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009900 tx=0x7f6b4402a410 comp rx=0 tx=0).stop 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.675+0000 7f6b4fadf640 1 -- 172.21.15.33:0/825830794 shutdown_connections 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.675+0000 7f6b4fadf640 1 --2- 172.21.15.33:0/825830794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b48108aa0 0x7f6b4810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.675+0000 7f6b4fadf640 1 --2- 172.21.15.33:0/825830794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b48108150 0x7f6b48108560 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.675+0000 7f6b4fadf640 1 --2- 172.21.15.33:0/825830794 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b48102810 0x7f6b48102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.675+0000 7f6b4fadf640 1 -- 172.21.15.33:0/825830794 >> 172.21.15.33:0/825830794 conn(0x7f6b480794d0 msgr2=0x7f6b480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.675+0000 7f6b4fadf640 1 -- 172.21.15.33:0/825830794 shutdown_connections 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.675+0000 7f6b4fadf640 1 -- 172.21.15.33:0/825830794 wait complete. 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4fadf640 1 Processor -- start 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4fadf640 1 -- start start 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4fadf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b48102810 0x7f6b48104e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4fadf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b48108150 0x7f6b481053d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4fadf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b48108aa0 0x7f6b48105910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4fadf640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6b48112750 con 0x7f6b48108aa0 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4fadf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6b481125d0 con 0x7f6b48108150 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4fadf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b481128d0 con 0x7f6b48102810 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4e07c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b48108aa0 0x7f6b48105910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4e07c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b48108aa0 0x7f6b48105910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34346/0 (socket says 172.21.15.33:34346) 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4e07c640 1 -- 172.21.15.33:0/1289511551 learned_addr learned my addr 172.21.15.33:0/1289511551 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4d07a640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b48108150 0x7f6b481053d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4d87b640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b48102810 0x7f6b48104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4e07c640 1 -- 172.21.15.33:0/1289511551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b48102810 msgr2=0x7f6b48104e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4e07c640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b48102810 0x7f6b48104e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4e07c640 1 -- 172.21.15.33:0/1289511551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b48108150 msgr2=0x7f6b481053d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4e07c640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b48108150 0x7f6b481053d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4e07c640 1 -- 172.21.15.33:0/1289511551 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b481a86a0 con 0x7f6b48108aa0 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.676+0000 7f6b4d87b640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b48102810 0x7f6b48104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.677+0000 7f6b4e07c640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b48108aa0 0x7f6b48105910 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000eaa0 tx=0x7f6b4000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.677+0000 7f6b3affd640 1 -- 172.21.15.33:0/1289511551 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000cdb0 con 0x7f6b48108aa0 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.677+0000 7f6b3affd640 1 -- 172.21.15.33:0/1289511551 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b40005020 con 0x7f6b48108aa0 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.677+0000 7f6b3affd640 1 -- 172.21.15.33:0/1289511551 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400116d0 con 0x7f6b48108aa0 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.677+0000 7f6b4fadf640 1 -- 172.21.15.33:0/1289511551 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b481a8990 con 0x7f6b48108aa0 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.677+0000 7f6b4fadf640 1 -- 172.21.15.33:0/1289511551 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b481a8ea0 con 0x7f6b48108aa0 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.678+0000 7f6b4fadf640 1 -- 172.21.15.33:0/1289511551 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b48103a90 con 0x7f6b48108aa0 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.680+0000 7f6b3affd640 1 -- 172.21.15.33:0/1289511551 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6b400051d0 con 0x7f6b48108aa0 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.680+0000 7f6b3affd640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b340b4d20 0x7f6b340b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.680+0000 7f6b4d87b640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b340b4d20 0x7f6b340b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:09.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.680+0000 7f6b3affd640 1 -- 172.21.15.33:0/1289511551 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f6b400e5e00 con 0x7f6b48108aa0 2024-08-28T19:38:09.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.681+0000 7f6b4d87b640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b340b4d20 0x7f6b340b7230 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6b481068e0 tx=0x7f6b3c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:09.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.683+0000 7f6b3affd640 1 -- 172.21.15.33:0/1289511551 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6b40016030 con 0x7f6b48108aa0 2024-08-28T19:38:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:09 smithi059 ceph-mon[22052]: pgmap v513: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-28T19:38:09.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:09 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:38:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:09 smithi122 ceph-mon[22174]: pgmap v513: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-28T19:38:09.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:09 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:38:09.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.908+0000 7f6b4fadf640 1 -- 172.21.15.33:0/1289511551 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b48102c20 con 0x7f6b48108aa0 2024-08-28T19:38:09.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.909+0000 7f6b3affd640 1 -- 172.21.15.33:0/1289511551 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f6b48102c20 con 0x7f6b48108aa0 2024-08-28T19:38:09.910 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:38:09.910 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:38:09.910 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:38:09.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 -- 172.21.15.33:0/1289511551 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b340b4d20 msgr2=0x7f6b340b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:09.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b340b4d20 0x7f6b340b7230 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6b481068e0 tx=0x7f6b3c008040 comp rx=0 tx=0).stop 2024-08-28T19:38:09.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 -- 172.21.15.33:0/1289511551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b48108aa0 msgr2=0x7f6b48105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:09.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b48108aa0 0x7f6b48105910 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000eaa0 tx=0x7f6b4000ef60 comp rx=0 tx=0).stop 2024-08-28T19:38:09.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 -- 172.21.15.33:0/1289511551 shutdown_connections 2024-08-28T19:38:09.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b48108aa0 0x7f6b48105910 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:09.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b48108150 0x7f6b481053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:09.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b340b4d20 0x7f6b340b7230 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:09.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 --2- 172.21.15.33:0/1289511551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b48102810 0x7f6b48104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:09.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 -- 172.21.15.33:0/1289511551 >> 172.21.15.33:0/1289511551 conn(0x7f6b480794d0 msgr2=0x7f6b480ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:09.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 -- 172.21.15.33:0/1289511551 shutdown_connections 2024-08-28T19:38:09.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:09.911+0000 7f6b4fadf640 1 -- 172.21.15.33:0/1289511551 wait complete. 2024-08-28T19:38:10.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:10 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1289511551' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-28T19:38:10.741 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-28T19:38:10.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:10 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1289511551' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:10.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:10 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1289511551' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:10.999 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:11.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.529+0000 7f1529333640 1 -- 172.21.15.33:0/527109424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1524108160 msgr2=0x7f1524108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:11.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.529+0000 7f1529333640 1 --2- 172.21.15.33:0/527109424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1524108160 0x7f1524108570 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f1518009900 tx=0x7f151802a410 comp rx=0 tx=0).stop 2024-08-28T19:38:11.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.529+0000 7f1529333640 1 -- 172.21.15.33:0/527109424 shutdown_connections 2024-08-28T19:38:11.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.529+0000 7f1529333640 1 --2- 172.21.15.33:0/527109424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1524108ab0 0x7f152410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.529+0000 7f1529333640 1 --2- 172.21.15.33:0/527109424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1524108160 0x7f1524108570 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.529+0000 7f1529333640 1 --2- 172.21.15.33:0/527109424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1524102820 0x7f1524102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.529+0000 7f1529333640 1 -- 172.21.15.33:0/527109424 >> 172.21.15.33:0/527109424 conn(0x7f1524079660 msgr2=0x7f1524079a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:11.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.530+0000 7f1529333640 1 -- 172.21.15.33:0/527109424 shutdown_connections 2024-08-28T19:38:11.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.530+0000 7f1529333640 1 -- 172.21.15.33:0/527109424 wait complete. 2024-08-28T19:38:11.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.530+0000 7f1529333640 1 Processor -- start 2024-08-28T19:38:11.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f1529333640 1 -- start start 2024-08-28T19:38:11.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f1529333640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1524102820 0x7f152410fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f1529333640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1524108160 0x7f1524110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f1529333640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1524108ab0 0x7f1524110840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f1529333640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1524113890 con 0x7f1524108ab0 2024-08-28T19:38:11.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f1529333640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1524113710 con 0x7f1524102820 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f1529333640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1524113a10 con 0x7f1524108160 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f15237fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1524108ab0 0x7f1524110840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f15237fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1524108ab0 0x7f1524110840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34370/0 (socket says 172.21.15.33:34370) 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f15237fe640 1 -- 172.21.15.33:0/3430616214 learned_addr learned my addr 172.21.15.33:0/3430616214 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f1522ffd640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1524102820 0x7f152410fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f15227fc640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1524108160 0x7f1524110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f15237fe640 1 -- 172.21.15.33:0/3430616214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1524108160 msgr2=0x7f1524110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f15237fe640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1524108160 0x7f1524110300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f15237fe640 1 -- 172.21.15.33:0/3430616214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1524102820 msgr2=0x7f152410fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f15237fe640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1524102820 0x7f152410fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.531+0000 7f15237fe640 1 -- 172.21.15.33:0/3430616214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15241a84c0 con 0x7f1524108ab0 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.532+0000 7f15237fe640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1524108ab0 0x7f1524110840 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f151c00eb10 tx=0x7f151c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.532+0000 7f150bfff640 1 -- 172.21.15.33:0/3430616214 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c004b20 con 0x7f1524108ab0 2024-08-28T19:38:11.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.532+0000 7f1529333640 1 -- 172.21.15.33:0/3430616214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15241a87b0 con 0x7f1524108ab0 2024-08-28T19:38:11.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.532+0000 7f150bfff640 1 -- 172.21.15.33:0/3430616214 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f151c004cc0 con 0x7f1524108ab0 2024-08-28T19:38:11.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.532+0000 7f150bfff640 1 -- 172.21.15.33:0/3430616214 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c010690 con 0x7f1524108ab0 2024-08-28T19:38:11.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.532+0000 7f1529333640 1 -- 172.21.15.33:0/3430616214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15241a8cc0 con 0x7f1524108ab0 2024-08-28T19:38:11.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f152f8a8740 1 Processor -- start 2024-08-28T19:38:11.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f150bfff640 1 -- 172.21.15.33:0/3430616214 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f151c005020 con 0x7f1524108ab0 2024-08-28T19:38:11.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f152f8a8740 1 -- start start 2024-08-28T19:38:11.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 0x5645c219fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 0x5645c21a0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f152f8a8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5645c2114330 con 0x5645c1dcf980 2024-08-28T19:38:11.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f152f8a8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5645c21038c0 con 0x5645c1dd7b60 2024-08-28T19:38:11.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f152f8a8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5645c2107870 con 0x5645c1df8840 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f1522ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f1522ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34384/0 (socket says 172.21.15.33:34384) 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f1522ffd640 1 -- 172.21.15.33:0/2461943709 learned_addr learned my addr 172.21.15.33:0/2461943709 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.535+0000 7f15227fc640 1 --2- 172.21.15.33:0/2461943709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 0x5645c219fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f15227fc640 1 --2- 172.21.15.33:0/2461943709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 0x5645c21a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f1522ffd640 1 -- 172.21.15.33:0/2461943709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 msgr2=0x5645c219fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f1522ffd640 1 --2- 172.21.15.33:0/2461943709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 0x5645c219fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f1522ffd640 1 -- 172.21.15.33:0/2461943709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 msgr2=0x5645c21a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f1522ffd640 1 --2- 172.21.15.33:0/2461943709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 0x5645c21a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f1522ffd640 1 -- 172.21.15.33:0/2461943709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645c20bbdf0 con 0x5645c1dcf980 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f15227fc640 1 --2- 172.21.15.33:0/2461943709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 0x5645c219fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f150bfff640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f150c0b4ca0 0x7f150c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f15227fc640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f150c0b4ca0 0x7f150c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f1522ffd640 1 --2- 172.21.15.33:0/2461943709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21a01d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1514009c20 tx=0x7f15140117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdba74a44199bb73 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:11.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f150bfff640 1 -- 172.21.15.33:0/3430616214 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f151c0e5f60 con 0x7f1524108ab0 2024-08-28T19:38:11.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f15097fa640 1 -- 172.21.15.33:0/2461943709 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514012450 con 0x5645c1dcf980 2024-08-28T19:38:11.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f15097fa640 1 -- 172.21.15.33:0/2461943709 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1514012aa0 con 0x5645c1dcf980 2024-08-28T19:38:11.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.536+0000 7f15097fa640 1 -- 172.21.15.33:0/2461943709 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151400fa80 con 0x5645c1dcf980 2024-08-28T19:38:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.537+0000 7f152f8a8740 1 -- 172.21.15.33:0/2461943709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 msgr2=0x5645c21a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.537+0000 7f15227fc640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f150c0b4ca0 0x7f150c0b71b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1518009230 tx=0x7f1518031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.537+0000 7f152f8a8740 1 --2- 172.21.15.33:0/2461943709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21a01d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1514009c20 tx=0x7f15140117b0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.537+0000 7f152f8a8740 1 -- 172.21.15.33:0/2461943709 shutdown_connections 2024-08-28T19:38:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.537+0000 7f152f8a8740 1 --2- 172.21.15.33:0/2461943709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 0x5645c21a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.537+0000 7f152f8a8740 1 --2- 172.21.15.33:0/2461943709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21a01d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.537+0000 7f152f8a8740 1 --2- 172.21.15.33:0/2461943709 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 0x5645c219fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.537+0000 7f152f8a8740 1 -- 172.21.15.33:0/2461943709 >> 172.21.15.33:0/2461943709 conn(0x5645c1dec990 msgr2=0x5645c219db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.537+0000 7f152f8a8740 1 -- 172.21.15.33:0/2461943709 shutdown_connections 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.537+0000 7f152f8a8740 1 -- 172.21.15.33:0/2461943709 wait complete. 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f152f8a8740 1 -- start start 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f152f8a8740 1 Processor -- start 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1dcf980 0x5645c21ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 0x5645c21ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1df8840 0x5645c21b7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f152f8a8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5645c1f667a0 con 0x5645c1df8840 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f152f8a8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5645c208a240 con 0x5645c1dd7b60 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f152f8a8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5645c21ae470 con 0x5645c1dcf980 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f152f8a8740 10 client.0 _ll_register_callbacks cb 0x5645c1e10090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f15237fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1df8840 0x5645c21b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f15237fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1df8840 0x5645c21b7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34396/0 (socket says 172.21.15.33:34396) 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f15237fe640 1 -- 172.21.15.33:0/2428589885 learned_addr learned my addr 172.21.15.33:0/2428589885 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f15227fc640 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 0x5645c21ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.538+0000 7f1522ffd640 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1dcf980 0x5645c21ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f15237fe640 1 -- 172.21.15.33:0/2428589885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1dcf980 msgr2=0x5645c21ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f15237fe640 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1dcf980 0x5645c21ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f15237fe640 1 -- 172.21.15.33:0/2428589885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 msgr2=0x5645c21ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f15237fe640 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 0x5645c21ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f15237fe640 1 -- 172.21.15.33:0/2428589885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645c20c02b0 con 0x5645c1df8840 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f15227fc640 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 0x5645c21ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f15237fe640 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1df8840 0x5645c21b7760 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f151c00cfb0 tx=0x7f151c0abd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23e18ec2cb7b26c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f1506ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:11.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f1506ff5640 1 -- 172.21.15.33:0/2428589885 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c0ac300 con 0x5645c1df8840 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f1506ff5640 1 -- 172.21.15.33:0/2428589885 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f151c005310 con 0x5645c1df8840 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f152f8a8740 1 -- 172.21.15.33:0/2428589885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1514012aa0 con 0x5645c1df8840 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f1506ff5640 1 -- 172.21.15.33:0/2428589885 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f151c0b0b70 con 0x5645c1df8840 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f152f8a8740 10 client.17286 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f152f8a8740 1 -- 172.21.15.33:0/2428589885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5645c1e72b90 con 0x5645c1df8840 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.539+0000 7f1506ff5640 1 -- 172.21.15.33:0/2428589885 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1514012aa0 con 0x5645c1df8840 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.540+0000 7f1506ff5640 1 -- 172.21.15.33:0/2428589885 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f151c0a7c70 con 0x5645c1df8840 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.540+0000 7f152f8a8740 10 client.17286 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.540+0000 7f152f8a8740 10 client.17286 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.540+0000 7f152f8a8740 20 client.17286 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.540+0000 7f152f8a8740 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5645c1db71c0 0x5645c21bd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.540+0000 7f152f8a8740 4 client.17286 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.540+0000 7f152f8a8740 1 -- 172.21.15.33:0/2428589885 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645c2116280 con 0x5645c1db71c0 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.540+0000 7f1522ffd640 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5645c1db71c0 0x5645c21bd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.540+0000 7f1506ff5640 10 client.17286 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.540+0000 7f1522ffd640 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5645c1db71c0 0x5645c21bd4e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bead0ac8aa8cc9e1 server_cookie=8db7910d664c3350 in_seq=0 out_seq=0 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f1506ff5640 1 -- 172.21.15.33:0/2428589885 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645c2116280 con 0x5645c1db71c0 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f1506ff5640 10 client.17286 handle_command_reply: tid=0 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 client.17286 shutdown 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 -- 172.21.15.33:0/2428589885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1df8840 msgr2=0x5645c21b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1df8840 0x5645c21b7760 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f151c00cfb0 tx=0x7f151c0abd10 comp rx=0 tx=0).stop 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 -- 172.21.15.33:0/2428589885 shutdown_connections 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5645c1db71c0 0x5645c21bd4e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1df8840 0x5645c21b7760 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dd7b60 0x5645c21ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f1506ff5640 0 client.17286 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:11.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 --2- 172.21.15.33:0/2428589885 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1dcf980 0x5645c21ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 -- 172.21.15.33:0/2428589885 >> 172.21.15.33:0/2428589885 conn(0x5645c1dec990 msgr2=0x5645c219c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:11.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 -- 172.21.15.33:0/2428589885 shutdown_connections 2024-08-28T19:38:11.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.541+0000 7f152f8a8740 1 -- 172.21.15.33:0/2428589885 wait complete. 2024-08-28T19:38:11.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.542+0000 7f152f8a8740 20 client.17286 trim_cache size 0 max 16384 2024-08-28T19:38:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f152f8a8740 1 Processor -- start 2024-08-28T19:38:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f152f8a8740 1 -- start start 2024-08-28T19:38:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21acf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1dd7b60 0x5645c21b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1df8840 0x5645c21a8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f152f8a8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f15241b2c90 con 0x5645c1dcf980 2024-08-28T19:38:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f152f8a8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f15241b47d0 con 0x5645c1df8840 2024-08-28T19:38:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f152f8a8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f15241b3360 con 0x5645c1dd7b60 2024-08-28T19:38:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f1522ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f1522ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21acf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34398/0 (socket says 172.21.15.33:34398) 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f1522ffd640 1 -- 172.21.15.33:0/51138137 learned_addr learned my addr 172.21.15.33:0/51138137 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f15227fc640 1 --2- 172.21.15.33:0/51138137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1dd7b60 0x5645c21b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f15237fe640 1 --2- 172.21.15.33:0/51138137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1df8840 0x5645c21a8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f1522ffd640 1 -- 172.21.15.33:0/51138137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1dd7b60 msgr2=0x5645c21b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.559+0000 7f1522ffd640 1 --2- 172.21.15.33:0/51138137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1dd7b60 0x5645c21b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.560+0000 7f1522ffd640 1 -- 172.21.15.33:0/51138137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1df8840 msgr2=0x5645c21a8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.560+0000 7f1522ffd640 1 --2- 172.21.15.33:0/51138137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1df8840 0x5645c21a8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.560+0000 7f1522ffd640 1 -- 172.21.15.33:0/51138137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645c20d3d90 con 0x5645c1dcf980 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.560+0000 7f1522ffd640 1 --2- 172.21.15.33:0/51138137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21acf90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x5645c219e910 tx=0x7f151400f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f11283322c23f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.560+0000 7f1508ff9640 1 -- 172.21.15.33:0/51138137 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514009800 con 0x5645c1dcf980 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.560+0000 7f1508ff9640 1 -- 172.21.15.33:0/51138137 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1514005560 con 0x5645c1dcf980 2024-08-28T19:38:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.560+0000 7f1508ff9640 1 -- 172.21.15.33:0/51138137 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140035f0 con 0x5645c1dcf980 2024-08-28T19:38:11.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 -- 172.21.15.33:0/51138137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 msgr2=0x5645c21acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:11.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 --2- 172.21.15.33:0/51138137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21acf90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x5645c219e910 tx=0x7f151400f660 comp rx=0 tx=0).stop 2024-08-28T19:38:11.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 -- 172.21.15.33:0/51138137 shutdown_connections 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 --2- 172.21.15.33:0/51138137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1df8840 0x5645c21a8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 --2- 172.21.15.33:0/51138137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1dd7b60 0x5645c21b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 --2- 172.21.15.33:0/51138137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dcf980 0x5645c21acf90 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 -- 172.21.15.33:0/51138137 >> 172.21.15.33:0/51138137 conn(0x5645c1dec990 msgr2=0x5645c21ac880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 -- 172.21.15.33:0/51138137 shutdown_connections 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 -- 172.21.15.33:0/51138137 wait complete. 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 -- start start 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.561+0000 7f152f8a8740 1 Processor -- start 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dcf980 0x5645c21b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dd7b60 0x5645c21ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f152f8a8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 0x5645c21aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f152f8a8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f15241b4100 con 0x5645c1dd7b60 2024-08-28T19:38:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f152f8a8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f15241b3a30 con 0x5645c1dcf980 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f152f8a8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f15241b0c70 con 0x5645c1df8840 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f152f8a8740 10 client.0 _ll_register_callbacks cb 0x7f151c0ac0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f15227fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dd7b60 0x5645c21ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f15227fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dd7b60 0x5645c21ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34404/0 (socket says 172.21.15.33:34404) 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f15227fc640 1 -- 172.21.15.33:0/3664277422 learned_addr learned my addr 172.21.15.33:0/3664277422 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f1522ffd640 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dcf980 0x5645c21b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f15237fe640 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 0x5645c21aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f15227fc640 1 -- 172.21.15.33:0/3664277422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 msgr2=0x5645c21aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f15227fc640 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 0x5645c21aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f15227fc640 1 -- 172.21.15.33:0/3664277422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dcf980 msgr2=0x5645c21b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f15227fc640 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dcf980 0x5645c21b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f15227fc640 1 -- 172.21.15.33:0/3664277422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645c21af150 con 0x5645c1dd7b60 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f15227fc640 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dd7b60 0x5645c21ae680 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f152406b670 tx=0x7f15180058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e0cbae63367e52 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.562+0000 7f1506ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f1506ff5640 1 -- 172.21.15.33:0/3664277422 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1518035040 con 0x5645c1dd7b60 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f1506ff5640 1 -- 172.21.15.33:0/3664277422 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f1518005240 con 0x5645c1dd7b60 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f152f8a8740 1 -- 172.21.15.33:0/3664277422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1514005560 con 0x5645c1dd7b60 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f1506ff5640 1 -- 172.21.15.33:0/3664277422 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f151805e050 con 0x5645c1dd7b60 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f152f8a8740 10 client.17292 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f152f8a8740 1 -- 172.21.15.33:0/3664277422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5645c2228be0 con 0x5645c1dd7b60 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f1506ff5640 1 -- 172.21.15.33:0/3664277422 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1514005560 con 0x5645c1dd7b60 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f1506ff5640 1 -- 172.21.15.33:0/3664277422 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f151803a040 con 0x5645c1dd7b60 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f152f8a8740 10 client.17292 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f152f8a8740 10 client.17292 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f152f8a8740 20 client.17292 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f152f8a8740 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5645c1d8c570 0x5645c222b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f152f8a8740 4 client.17292 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-28T19:38:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.563+0000 7f152f8a8740 1 -- 172.21.15.33:0/3664277422 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5645c2111d20 con 0x5645c1d8c570 2024-08-28T19:38:11.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.564+0000 7f1522ffd640 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5645c1d8c570 0x5645c222b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:11.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.564+0000 7f1506ff5640 10 client.17292 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:11.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.564+0000 7f1522ffd640 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5645c1d8c570 0x5645c222b440 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d652ed1ee352d44b server_cookie=f44d6bff3ca8c316 in_seq=0 out_seq=0 2024-08-28T19:38:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f1506ff5640 1 -- 172.21.15.33:0/3664277422 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5645c2111d20 con 0x5645c1d8c570 2024-08-28T19:38:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f1506ff5640 10 client.17292 handle_command_reply: tid=0 2024-08-28T19:38:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 client.17292 shutdown 2024-08-28T19:38:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 -- 172.21.15.33:0/3664277422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dd7b60 msgr2=0x5645c21ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dd7b60 0x5645c21ae680 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f152406b670 tx=0x7f15180058b0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 -- 172.21.15.33:0/3664277422 shutdown_connections 2024-08-28T19:38:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5645c1df8840 0x5645c21aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5645c1d8c570 0x5645c222b440 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645c1dd7b60 0x5645c21ae680 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 --2- 172.21.15.33:0/3664277422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645c1dcf980 0x5645c21b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 -- 172.21.15.33:0/3664277422 >> 172.21.15.33:0/3664277422 conn(0x5645c1dec990 msgr2=0x5645c219c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f1506ff5640 0 client.17292 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 -- 172.21.15.33:0/3664277422 shutdown_connections 2024-08-28T19:38:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 1 -- 172.21.15.33:0/3664277422 wait complete. 2024-08-28T19:38:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.581+0000 7f152f8a8740 20 client.17292 trim_cache size 0 max 16384 2024-08-28T19:38:11.583 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 18, 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "6e2f1042": { 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 18, 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-08-28T19:38:11.584 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:38:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:38:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:38:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:38:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:38:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:38:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:11.585 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:11.586 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:11.586 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:38:11.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 -- 172.21.15.33:0/3430616214 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f150c0b4ca0 msgr2=0x7f150c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:11.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f150c0b4ca0 0x7f150c0b71b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1518009230 tx=0x7f1518031400 comp rx=0 tx=0).stop 2024-08-28T19:38:11.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 -- 172.21.15.33:0/3430616214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1524108ab0 msgr2=0x7f1524110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:11.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1524108ab0 0x7f1524110840 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f151c00eb10 tx=0x7f151c00c2d0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 -- 172.21.15.33:0/3430616214 shutdown_connections 2024-08-28T19:38:11.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1524108ab0 0x7f1524110840 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f150c0b4ca0 0x7f150c0b71b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1524108160 0x7f1524110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 --2- 172.21.15.33:0/3430616214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1524102820 0x7f152410fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:11.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 -- 172.21.15.33:0/3430616214 >> 172.21.15.33:0/3430616214 conn(0x7f1524079660 msgr2=0x7f15241061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:11.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 -- 172.21.15.33:0/3430616214 shutdown_connections 2024-08-28T19:38:11.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:11.582+0000 7f1529333640 1 -- 172.21.15.33:0/3430616214 wait complete. 2024-08-28T19:38:11.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:11 smithi059 ceph-mon[22052]: pgmap v514: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-28T19:38:11.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:11 smithi122 ceph-mon[22174]: pgmap v514: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-28T19:38:11.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:11 smithi033 ceph-mon[18549]: pgmap v514: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-28T19:38:12.473 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6e2f1042', quiesce took 3.6 seconds. Will release after: 26.4 2024-08-28T19:38:13.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:13 smithi059 ceph-mon[22052]: pgmap v515: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-28T19:38:13.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:13 smithi122 ceph-mon[22174]: pgmap v515: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-28T19:38:13.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:13 smithi033 ceph-mon[18549]: pgmap v515: 129 pgs: 129 active+clean; 5.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-28T19:38:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:15 smithi059 ceph-mon[22052]: pgmap v516: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 36 KiB/s wr, 28 op/s 2024-08-28T19:38:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:15 smithi122 ceph-mon[22174]: pgmap v516: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 36 KiB/s wr, 28 op/s 2024-08-28T19:38:15.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:15 smithi033 ceph-mon[18549]: pgmap v516: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 36 KiB/s wr, 28 op/s 2024-08-28T19:38:17.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:17 smithi059 ceph-mon[22052]: pgmap v517: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-08-28T19:38:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:17 smithi122 ceph-mon[22174]: pgmap v517: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-08-28T19:38:17.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:17 smithi033 ceph-mon[18549]: pgmap v517: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-08-28T19:38:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:19 smithi059 ceph-mon[22052]: pgmap v518: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-28T19:38:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:19 smithi122 ceph-mon[22174]: pgmap v518: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-28T19:38:19.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:19 smithi033 ceph-mon[18549]: pgmap v518: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-28T19:38:21.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:21 smithi059 ceph-mon[22052]: pgmap v519: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-28T19:38:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:21 smithi122 ceph-mon[22174]: pgmap v519: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-28T19:38:21.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:21 smithi033 ceph-mon[18549]: pgmap v519: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-28T19:38:23.698 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:23 smithi033 ceph-mon[18549]: pgmap v520: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-08-28T19:38:23.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:23 smithi059 ceph-mon[22052]: pgmap v520: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-08-28T19:38:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:23 smithi122 ceph-mon[22174]: pgmap v520: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-08-28T19:38:25.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:25 smithi059 ceph-mon[22052]: pgmap v521: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-28T19:38:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:25 smithi122 ceph-mon[22174]: pgmap v521: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-28T19:38:25.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:25 smithi033 ceph-mon[18549]: pgmap v521: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-28T19:38:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:27 smithi059 ceph-mon[22052]: pgmap v522: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-08-28T19:38:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:27 smithi122 ceph-mon[22174]: pgmap v522: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-08-28T19:38:27.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:27 smithi033 ceph-mon[18549]: pgmap v522: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-08-28T19:38:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:29 smithi059 ceph-mon[22052]: pgmap v523: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-08-28T19:38:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:29 smithi122 ceph-mon[22174]: pgmap v523: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-08-28T19:38:29.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:29 smithi033 ceph-mon[18549]: pgmap v523: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-08-28T19:38:31.656 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:38:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:31 smithi059 ceph-mon[22052]: pgmap v524: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:38:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:31 smithi122 ceph-mon[22174]: pgmap v524: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:38:31.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:31 smithi033 ceph-mon[18549]: pgmap v524: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:38:31.933 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.416+0000 7f9661dd8640 1 -- 172.21.15.33:0/1975611722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f965c109b90 msgr2=0x7f965c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.416+0000 7f9661dd8640 1 --2- 172.21.15.33:0/1975611722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f965c109b90 0x7f965c1103c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f9654009ca0 tx=0x7f965402a8e0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.416+0000 7f9661dd8640 1 -- 172.21.15.33:0/1975611722 shutdown_connections 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.416+0000 7f9661dd8640 1 --2- 172.21.15.33:0/1975611722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f965c109b90 0x7f965c1103c0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.416+0000 7f9661dd8640 1 --2- 172.21.15.33:0/1975611722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f965c109240 0x7f965c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.416+0000 7f9661dd8640 1 --2- 172.21.15.33:0/1975611722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965c103900 0x7f965c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.416+0000 7f9661dd8640 1 -- 172.21.15.33:0/1975611722 >> 172.21.15.33:0/1975611722 conn(0x7f965c07b5f0 msgr2=0x7f965c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.416+0000 7f9661dd8640 1 -- 172.21.15.33:0/1975611722 shutdown_connections 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.416+0000 7f9661dd8640 1 -- 172.21.15.33:0/1975611722 wait complete. 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.416+0000 7f9661dd8640 1 Processor -- start 2024-08-28T19:38:32.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f9661dd8640 1 -- start start 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f9661dd8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f965c103900 0x7f965c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f9661dd8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f965c109240 0x7f965c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f9661dd8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965c109b90 0x7f965c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f9661dd8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f965c113890 con 0x7f965c103900 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f9661dd8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f965c113710 con 0x7f965c109b90 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f9661dd8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f965c113a10 con 0x7f965c109240 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f965c103900 0x7f965c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f965c103900 0x7f965c19a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57832/0 (socket says 172.21.15.33:57832) 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965b7fe640 1 -- 172.21.15.33:0/3150956485 learned_addr learned my addr 172.21.15.33:0/3150956485 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965affd640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f965c109240 0x7f965c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965bfff640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965c109b90 0x7f965c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965b7fe640 1 -- 172.21.15.33:0/3150956485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f965c109240 msgr2=0x7f965c19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965b7fe640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f965c109240 0x7f965c19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965b7fe640 1 -- 172.21.15.33:0/3150956485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965c109b90 msgr2=0x7f965c19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965b7fe640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965c109b90 0x7f965c19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965b7fe640 1 -- 172.21.15.33:0/3150956485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c1a01b0 con 0x7f965c103900 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965affd640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f965c109240 0x7f965c19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.417+0000 7f965bfff640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965c109b90 0x7f965c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.418+0000 7f965b7fe640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f965c103900 0x7f965c19a240 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f964c00d950 tx=0x7f964c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.418+0000 7f9658ff9640 1 -- 172.21.15.33:0/3150956485 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c017070 con 0x7f965c103900 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.418+0000 7f9658ff9640 1 -- 172.21.15.33:0/3150956485 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f964c009c30 con 0x7f965c103900 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.418+0000 7f9661dd8640 1 -- 172.21.15.33:0/3150956485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965c1a04a0 con 0x7f965c103900 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.418+0000 7f9658ff9640 1 -- 172.21.15.33:0/3150956485 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c00f620 con 0x7f965c103900 2024-08-28T19:38:32.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.418+0000 7f9661dd8640 1 -- 172.21.15.33:0/3150956485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965c1a6c00 con 0x7f965c103900 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.420+0000 7f966834d740 1 Processor -- start 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.420+0000 7f9658ff9640 1 -- 172.21.15.33:0/3150956485 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f964c010460 con 0x7f965c103900 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f966834d740 1 -- start start 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f966834d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cede2070 0x55b7cf1872c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f966834d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedb91b0 0x55b7cf187800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f966834d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedc1390 0x55b7cf187d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f966834d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b7cf0fe630 con 0x55b7cedb91b0 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f966834d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b7cf0edbc0 con 0x55b7cedc1390 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f966834d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b7cf0f1b70 con 0x55b7cede2070 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f965b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedb91b0 0x55b7cf187800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f965b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedb91b0 0x55b7cf187800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57834/0 (socket says 172.21.15.33:57834) 2024-08-28T19:38:32.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f965b7fe640 1 -- 172.21.15.33:0/3856182839 learned_addr learned my addr 172.21.15.33:0/3856182839 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:32.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f965affd640 1 --2- 172.21.15.33:0/3856182839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedc1390 0x55b7cf187d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f965bfff640 1 --2- 172.21.15.33:0/3856182839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cede2070 0x55b7cf1872c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f965b7fe640 1 -- 172.21.15.33:0/3856182839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cede2070 msgr2=0x55b7cf1872c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:32.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f965b7fe640 1 --2- 172.21.15.33:0/3856182839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cede2070 0x55b7cf1872c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f965b7fe640 1 -- 172.21.15.33:0/3856182839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedc1390 msgr2=0x55b7cf187d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:32.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f965b7fe640 1 --2- 172.21.15.33:0/3856182839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedc1390 0x55b7cf187d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f9658ff9640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f96440b4ca0 0x7f96440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.421+0000 7f965b7fe640 1 -- 172.21.15.33:0/3856182839 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7cee4d650 con 0x55b7cedb91b0 2024-08-28T19:38:32.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.422+0000 7f965bfff640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f96440b4ca0 0x7f96440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.422+0000 7f965b7fe640 1 --2- 172.21.15.33:0/3856182839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedb91b0 0x55b7cf187800 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f964c0e2910 tx=0x7f964c0a8050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fea3c09f66fd176 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.422+0000 7f9658ff9640 1 -- 172.21.15.33:0/3150956485 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f964c0e55a0 con 0x7f965c103900 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.422+0000 7f9641ffb640 1 -- 172.21.15.33:0/3856182839 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c020070 con 0x55b7cedb91b0 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.422+0000 7f9641ffb640 1 -- 172.21.15.33:0/3856182839 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f964c0ab450 con 0x55b7cedb91b0 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.422+0000 7f9641ffb640 1 -- 172.21.15.33:0/3856182839 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c0ab0b0 con 0x55b7cedb91b0 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f966834d740 1 -- 172.21.15.33:0/3856182839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedb91b0 msgr2=0x55b7cf187800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f965bfff640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f96440b4ca0 0x7f96440b71b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f96540094e0 tx=0x7f9654009810 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f966834d740 1 --2- 172.21.15.33:0/3856182839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedb91b0 0x55b7cf187800 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f964c0e2910 tx=0x7f964c0a8050 comp rx=0 tx=0).stop 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f966834d740 1 -- 172.21.15.33:0/3856182839 shutdown_connections 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f966834d740 1 --2- 172.21.15.33:0/3856182839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedc1390 0x55b7cf187d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f966834d740 1 --2- 172.21.15.33:0/3856182839 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedb91b0 0x55b7cf187800 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f966834d740 1 --2- 172.21.15.33:0/3856182839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cede2070 0x55b7cf1872c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f966834d740 1 -- 172.21.15.33:0/3856182839 >> 172.21.15.33:0/3856182839 conn(0x55b7cedd6460 msgr2=0x55b7cf1851b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f966834d740 1 -- 172.21.15.33:0/3856182839 shutdown_connections 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f966834d740 1 -- 172.21.15.33:0/3856182839 wait complete. 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.423+0000 7f966834d740 1 -- start start 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f966834d740 1 Processor -- start 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f966834d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedb91b0 0x55b7cf192ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f966834d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedc1390 0x55b7cf193030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f966834d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f966834d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b7cef50700 con 0x55b7cede2070 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f966834d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b7cf074700 con 0x55b7cedc1390 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f966834d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b7cf195aa0 con 0x55b7cedb91b0 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f966834d740 10 client.0 _ll_register_callbacks cb 0x55b7cf0a3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f965bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f965bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57848/0 (socket says 172.21.15.33:57848) 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f965bfff640 1 -- 172.21.15.33:0/774973287 learned_addr learned my addr 172.21.15.33:0/774973287 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f965b7fe640 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedb91b0 0x55b7cf192ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f965affd640 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedc1390 0x55b7cf193030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f965bfff640 1 -- 172.21.15.33:0/774973287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedb91b0 msgr2=0x55b7cf192ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f965bfff640 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedb91b0 0x55b7cf192ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f965bfff640 1 -- 172.21.15.33:0/774973287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedc1390 msgr2=0x55b7cf193030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f965bfff640 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedc1390 0x55b7cf193030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.424+0000 7f965bfff640 1 -- 172.21.15.33:0/774973287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7cf0ad8b0 con 0x55b7cede2070 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.425+0000 7f965bfff640 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19ed90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f9654003bf0 tx=0x7f96540095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c420c4af7624d51 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.425+0000 7f963affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.425+0000 7f963affd640 1 -- 172.21.15.33:0/774973287 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540047c0 con 0x55b7cede2070 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.425+0000 7f963affd640 1 -- 172.21.15.33:0/774973287 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f96540305e0 con 0x55b7cede2070 2024-08-28T19:38:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.425+0000 7f966834d740 1 -- 172.21.15.33:0/774973287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f964c0ab450 con 0x55b7cede2070 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.425+0000 7f963affd640 1 -- 172.21.15.33:0/774973287 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9654030820 con 0x55b7cede2070 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.425+0000 7f966834d740 10 client.17304 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.425+0000 7f966834d740 1 -- 172.21.15.33:0/774973287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b7cf1a1900 con 0x55b7cede2070 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.425+0000 7f963affd640 1 -- 172.21.15.33:0/774973287 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f964c0ab450 con 0x55b7cede2070 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.426+0000 7f963affd640 1 -- 172.21.15.33:0/774973287 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9654049750 con 0x55b7cede2070 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.426+0000 7f966834d740 10 client.17304 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.426+0000 7f966834d740 10 client.17304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.426+0000 7f966834d740 20 client.17304 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.426+0000 7f966834d740 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b7ceda09f0 0x55b7cf1a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.426+0000 7f966834d740 4 client.17304 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.426+0000 7f966834d740 1 -- 172.21.15.33:0/774973287 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7cf100580 con 0x55b7ceda09f0 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.426+0000 7f965b7fe640 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b7ceda09f0 0x55b7cf1a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.426+0000 7f963affd640 10 client.17304 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.426+0000 7f965b7fe640 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b7ceda09f0 0x55b7cf1a4e80 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afe8a60fe63cf241 server_cookie=2a5f8dd7a534f58e in_seq=0 out_seq=0 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f963affd640 1 -- 172.21.15.33:0/774973287 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7cf100580 con 0x55b7ceda09f0 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f963affd640 10 client.17304 handle_command_reply: tid=0 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 client.17304 shutdown 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 -- 172.21.15.33:0/774973287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 msgr2=0x55b7cf19ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19ed90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f9654003bf0 tx=0x7f96540095c0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 -- 172.21.15.33:0/774973287 shutdown_connections 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b7ceda09f0 0x55b7cf1a4e80 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19ed90 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedc1390 0x55b7cf193030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 --2- 172.21.15.33:0/774973287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedb91b0 0x55b7cf192ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 -- 172.21.15.33:0/774973287 >> 172.21.15.33:0/774973287 conn(0x55b7cedd6460 msgr2=0x55b7cf1882f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f963affd640 0 client.17304 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:32.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 -- 172.21.15.33:0/774973287 shutdown_connections 2024-08-28T19:38:32.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.427+0000 7f966834d740 1 -- 172.21.15.33:0/774973287 wait complete. 2024-08-28T19:38:32.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.428+0000 7f966834d740 20 client.17304 trim_cache size 0 max 16384 2024-08-28T19:38:32.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.445+0000 7f966834d740 1 Processor -- start 2024-08-28T19:38:32.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.445+0000 7f966834d740 1 -- start start 2024-08-28T19:38:32.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.445+0000 7f966834d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 0x55b7cf185220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.445+0000 7f966834d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedc1390 0x55b7cf19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.445+0000 7f966834d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.445+0000 7f966834d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f965c1b0ba0 con 0x55b7cede2070 2024-08-28T19:38:32.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.445+0000 7f966834d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f965c1b26e0 con 0x55b7cedb91b0 2024-08-28T19:38:32.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f966834d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f965c1b1270 con 0x55b7cedc1390 2024-08-28T19:38:32.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57850/0 (socket says 172.21.15.33:57850) 2024-08-28T19:38:32.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965bfff640 1 -- 172.21.15.33:0/3496470018 learned_addr learned my addr 172.21.15.33:0/3496470018 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:32.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965affd640 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedc1390 0x55b7cf19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965b7fe640 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 0x55b7cf185220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965bfff640 1 -- 172.21.15.33:0/3496470018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedc1390 msgr2=0x55b7cf19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:32.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965bfff640 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedc1390 0x55b7cf19ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965bfff640 1 -- 172.21.15.33:0/3496470018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 msgr2=0x55b7cf185220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:32.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965bfff640 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 0x55b7cf185220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965bfff640 1 -- 172.21.15.33:0/3496470018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7cf191a10 con 0x55b7cede2070 2024-08-28T19:38:32.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965affd640 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedc1390 0x55b7cf19ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:32.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965b7fe640 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 0x55b7cf185220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:32.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f965bfff640 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19f1d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f9654009a60 tx=0x7f965402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2406dc10ec98b685 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:32.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f96417fa640 1 -- 172.21.15.33:0/3496470018 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654062070 con 0x55b7cede2070 2024-08-28T19:38:32.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f96417fa640 1 -- 172.21.15.33:0/3496470018 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9654036040 con 0x55b7cede2070 2024-08-28T19:38:32.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.446+0000 7f96417fa640 1 -- 172.21.15.33:0/3496470018 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654049680 con 0x55b7cede2070 2024-08-28T19:38:32.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.447+0000 7f966834d740 1 -- 172.21.15.33:0/3496470018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 msgr2=0x55b7cf19f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.447+0000 7f966834d740 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19f1d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f9654009a60 tx=0x7f965402a8e0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.447+0000 7f966834d740 1 -- 172.21.15.33:0/3496470018 shutdown_connections 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.447+0000 7f966834d740 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cede2070 0x55b7cf19f1d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.447+0000 7f966834d740 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cedc1390 0x55b7cf19ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.447+0000 7f966834d740 1 --2- 172.21.15.33:0/3496470018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 0x55b7cf185220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.447+0000 7f966834d740 1 -- 172.21.15.33:0/3496470018 >> 172.21.15.33:0/3496470018 conn(0x55b7cedd6460 msgr2=0x55b7cf184b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.447+0000 7f966834d740 1 -- 172.21.15.33:0/3496470018 shutdown_connections 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.447+0000 7f966834d740 1 -- 172.21.15.33:0/3496470018 wait complete. 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.448+0000 7f966834d740 1 -- start start 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.448+0000 7f966834d740 1 Processor -- start 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.448+0000 7f966834d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 0x55b7cf19b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.448+0000 7f966834d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedc1390 0x55b7cf196c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.448+0000 7f966834d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cede2070 0x55b7cf197370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.448+0000 7f966834d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f965c1b2010 con 0x55b7cedc1390 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.448+0000 7f966834d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f965c1b1940 con 0x55b7cedb91b0 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.448+0000 7f966834d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f965c1aeb80 con 0x55b7cede2070 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f966834d740 10 client.0 _ll_register_callbacks cb 0x7f9654009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedc1390 0x55b7cf196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedc1390 0x55b7cf196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57860/0 (socket says 172.21.15.33:57860) 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965affd640 1 -- 172.21.15.33:0/2640004005 learned_addr learned my addr 172.21.15.33:0/2640004005 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965b7fe640 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 0x55b7cf19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965bfff640 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cede2070 0x55b7cf197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965affd640 1 -- 172.21.15.33:0/2640004005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cede2070 msgr2=0x55b7cf197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965affd640 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cede2070 0x55b7cf197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965affd640 1 -- 172.21.15.33:0/2640004005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 msgr2=0x55b7cf19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965affd640 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 0x55b7cf19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965affd640 1 -- 172.21.15.33:0/2640004005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7cf20e840 con 0x55b7cedc1390 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f965affd640 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedc1390 0x55b7cf196c60 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f96500145d0 tx=0x7f9650014a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56756f5d162d2f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f963affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f963affd640 1 -- 172.21.15.33:0/2640004005 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650016900 con 0x55b7cedc1390 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f963affd640 1 -- 172.21.15.33:0/2640004005 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f9650016aa0 con 0x55b7cedc1390 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.449+0000 7f966834d740 1 -- 172.21.15.33:0/2640004005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9654036040 con 0x55b7cedc1390 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f963affd640 1 -- 172.21.15.33:0/2640004005 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9650029050 con 0x55b7cedc1390 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f966834d740 10 client.17310 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f966834d740 1 -- 172.21.15.33:0/2640004005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b7cf20f920 con 0x55b7cedc1390 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f963affd640 1 -- 172.21.15.33:0/2640004005 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9654036040 con 0x55b7cedc1390 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f963affd640 1 -- 172.21.15.33:0/2640004005 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f96500153c0 con 0x55b7cedc1390 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f966834d740 10 client.17310 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:32.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f966834d740 10 client.17310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f966834d740 20 client.17310 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f966834d740 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b7ced75da0 0x55b7cf212190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f966834d740 4 client.17310 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f966834d740 1 -- 172.21.15.33:0/2640004005 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b7cf0fc020 con 0x55b7ced75da0 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.450+0000 7f965b7fe640 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b7ced75da0 0x55b7cf212190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f963affd640 10 client.17310 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f965b7fe640 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b7ced75da0 0x55b7cf212190 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60cdf666e0a158ab server_cookie=d414aab56157a2ff in_seq=0 out_seq=0 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f963affd640 1 -- 172.21.15.33:0/2640004005 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55b7cf0fc020 con 0x55b7ced75da0 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f963affd640 10 client.17310 handle_command_reply: tid=0 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 client.17310 shutdown 2024-08-28T19:38:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 -- 172.21.15.33:0/2640004005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedc1390 msgr2=0x55b7cf196c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedc1390 0x55b7cf196c60 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f96500145d0 tx=0x7f9650014a90 comp rx=0 tx=0).stop 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 -- 172.21.15.33:0/2640004005 shutdown_connections 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b7cede2070 0x55b7cf197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b7ced75da0 0x55b7cf212190 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f963affd640 0 client.17310 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7cedc1390 0x55b7cf196c60 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 --2- 172.21.15.33:0/2640004005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7cedb91b0 0x55b7cf19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 -- 172.21.15.33:0/2640004005 >> 172.21.15.33:0/2640004005 conn(0x55b7cedd6460 msgr2=0x55b7cf1881f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 -- 172.21.15.33:0/2640004005 shutdown_connections 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 1 -- 172.21.15.33:0/2640004005 wait complete. 2024-08-28T19:38:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.451+0000 7f966834d740 20 client.17310 trim_cache size 0 max 16384 2024-08-28T19:38:32.460 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:38:32.460 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:38:32.460 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:38:32.460 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:38:32.460 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:38:32.460 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:38:32.460 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:32.460 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:32.460 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:32.460 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:38:32.461 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:32.462 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:32.462 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:32.462 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:32.462 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:32.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:32.462 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:38:32.462 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:38:32.462 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:32.462 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:32.462 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:32.463 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:38:32.464 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:38:32.464 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:32.464 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:32.464 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:32.464 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:32.464 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:32.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:32.464 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:38:32.464 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:38:32.465 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:32.465 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:32.465 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:32.465 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:32.465 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:32.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:32.465 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:38:32.465 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:38:32.465 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:32.465 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:32.466 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:32.466 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:32.466 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:32.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:32.466 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:38:32.466 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:38:32.466 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:32.466 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:32.466 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:32.467 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:32.467 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:32.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:32.467 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:38:32.467 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:38:32.467 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:32.467 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:32.467 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:32.467 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:32.467 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:32.468 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:32.468 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:32.468 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:38:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 -- 172.21.15.33:0/3150956485 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f96440b4ca0 msgr2=0x7f96440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f96440b4ca0 0x7f96440b71b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f96540094e0 tx=0x7f9654009810 comp rx=0 tx=0).stop 2024-08-28T19:38:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 -- 172.21.15.33:0/3150956485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f965c103900 msgr2=0x7f965c19a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f965c103900 0x7f965c19a240 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f964c00d950 tx=0x7f964c00de10 comp rx=0 tx=0).stop 2024-08-28T19:38:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 -- 172.21.15.33:0/3150956485 shutdown_connections 2024-08-28T19:38:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965c109b90 0x7f965c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f96440b4ca0 0x7f96440b71b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f965c109240 0x7f965c19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 --2- 172.21.15.33:0/3150956485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f965c103900 0x7f965c19a240 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 -- 172.21.15.33:0/3150956485 >> 172.21.15.33:0/3150956485 conn(0x7f965c07b5f0 msgr2=0x7f965c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:32.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 -- 172.21.15.33:0/3150956485 shutdown_connections 2024-08-28T19:38:32.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:32.452+0000 7f9661dd8640 1 -- 172.21.15.33:0/3150956485 wait complete. 2024-08-28T19:38:33.251 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:38:33.252 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:33.773 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:33 smithi033 ceph-mon[18549]: pgmap v525: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:38:33.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:33 smithi059 ceph-mon[22052]: pgmap v525: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:38:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:33 smithi122 ceph-mon[22174]: pgmap v525: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:38:34.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.030+0000 7fdee3f9c640 1 -- 172.21.15.33:0/2307451745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdedc108180 msgr2=0x7fdedc108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:34.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.030+0000 7fdee3f9c640 1 --2- 172.21.15.33:0/2307451745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdedc108180 0x7fdedc108590 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009900 tx=0x7fdecc02a410 comp rx=0 tx=0).stop 2024-08-28T19:38:34.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.030+0000 7fdee3f9c640 1 -- 172.21.15.33:0/2307451745 shutdown_connections 2024-08-28T19:38:34.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.030+0000 7fdee3f9c640 1 --2- 172.21.15.33:0/2307451745 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc108ad0 0x7fdedc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:34.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.030+0000 7fdee3f9c640 1 --2- 172.21.15.33:0/2307451745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdedc108180 0x7fdedc108590 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:34.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.030+0000 7fdee3f9c640 1 --2- 172.21.15.33:0/2307451745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdedc102840 0x7fdedc102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:34.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.030+0000 7fdee3f9c640 1 -- 172.21.15.33:0/2307451745 >> 172.21.15.33:0/2307451745 conn(0x7fdedc079580 msgr2=0x7fdedc079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:34.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.030+0000 7fdee3f9c640 1 -- 172.21.15.33:0/2307451745 shutdown_connections 2024-08-28T19:38:34.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.030+0000 7fdee3f9c640 1 -- 172.21.15.33:0/2307451745 wait complete. 2024-08-28T19:38:34.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee3f9c640 1 Processor -- start 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee3f9c640 1 -- start start 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee3f9c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc102840 0x7fdedc199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee3f9c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdedc108180 0x7fdedc1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee3f9c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdedc108ad0 0x7fdedc19e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee3f9c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc112700 con 0x7fdedc108ad0 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee3f9c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc112580 con 0x7fdedc108180 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee3f9c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc112880 con 0x7fdedc102840 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee2539640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdedc108ad0 0x7fdedc19e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee2539640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdedc108ad0 0x7fdedc19e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57880/0 (socket says 172.21.15.33:57880) 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee2539640 1 -- 172.21.15.33:0/3595238596 learned_addr learned my addr 172.21.15.33:0/3595238596 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee1537640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdedc108180 0x7fdedc1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee1d38640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc102840 0x7fdedc199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:34.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee2539640 1 -- 172.21.15.33:0/3595238596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc102840 msgr2=0x7fdedc199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee2539640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc102840 0x7fdedc199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee2539640 1 -- 172.21.15.33:0/3595238596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdedc108180 msgr2=0x7fdedc1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.031+0000 7fdee2539640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdedc108180 0x7fdedc1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.032+0000 7fdee2539640 1 -- 172.21.15.33:0/3595238596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc19f0a0 con 0x7fdedc108ad0 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.032+0000 7fdee2539640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdedc108ad0 0x7fdedc19e970 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fded400cad0 tx=0x7fded400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.032+0000 7fded2ffd640 1 -- 172.21.15.33:0/3595238596 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded400ae20 con 0x7fdedc108ad0 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.032+0000 7fded2ffd640 1 -- 172.21.15.33:0/3595238596 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded4005020 con 0x7fdedc108ad0 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.032+0000 7fdee3f9c640 1 -- 172.21.15.33:0/3595238596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdedc19f390 con 0x7fdedc108ad0 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.032+0000 7fded2ffd640 1 -- 172.21.15.33:0/3595238596 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded400f6b0 con 0x7fdedc108ad0 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.032+0000 7fdee3f9c640 1 -- 172.21.15.33:0/3595238596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdedc06b5c0 con 0x7fdedc108ad0 2024-08-28T19:38:34.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.033+0000 7fdee3f9c640 1 -- 172.21.15.33:0/3595238596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdedc103ac0 con 0x7fdedc108ad0 2024-08-28T19:38:34.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.034+0000 7fded2ffd640 1 -- 172.21.15.33:0/3595238596 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fded40051d0 con 0x7fdedc108ad0 2024-08-28T19:38:34.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.035+0000 7fded2ffd640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdec80b4ca0 0x7fdec80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:34.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.035+0000 7fdee1d38640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdec80b4ca0 0x7fdec80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:34.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.035+0000 7fded2ffd640 1 -- 172.21.15.33:0/3595238596 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fded40e5e20 con 0x7fdedc108ad0 2024-08-28T19:38:34.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.036+0000 7fdee1d38640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdec80b4ca0 0x7fdec80b71b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fded80058c0 tx=0x7fded800a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:34.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.038+0000 7fded2ffd640 1 -- 172.21.15.33:0/3595238596 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fded4014030 con 0x7fdedc108ad0 2024-08-28T19:38:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.263+0000 7fdee3f9c640 1 -- 172.21.15.33:0/3595238596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdedc102c50 con 0x7fdedc108ad0 2024-08-28T19:38:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.264+0000 7fded2ffd640 1 -- 172.21.15.33:0/3595238596 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fdedc102c50 con 0x7fdedc108ad0 2024-08-28T19:38:34.267 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:38:34.267 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:38:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:38:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 -- 172.21.15.33:0/3595238596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdec80b4ca0 msgr2=0x7fdec80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdec80b4ca0 0x7fdec80b71b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fded80058c0 tx=0x7fded800a4c0 comp rx=0 tx=0).stop 2024-08-28T19:38:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 -- 172.21.15.33:0/3595238596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdedc108ad0 msgr2=0x7fdedc19e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdedc108ad0 0x7fdedc19e970 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fded400cad0 tx=0x7fded400cf90 comp rx=0 tx=0).stop 2024-08-28T19:38:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 -- 172.21.15.33:0/3595238596 shutdown_connections 2024-08-28T19:38:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdedc108ad0 0x7fdedc19e970 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdedc108180 0x7fdedc1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdec80b4ca0 0x7fdec80b71b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 --2- 172.21.15.33:0/3595238596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdedc102840 0x7fdedc199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 -- 172.21.15.33:0/3595238596 >> 172.21.15.33:0/3595238596 conn(0x7fdedc079580 msgr2=0x7fdedc105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 -- 172.21.15.33:0/3595238596 shutdown_connections 2024-08-28T19:38:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:34.266+0000 7fdee3f9c640 1 -- 172.21.15.33:0/3595238596 wait complete. 2024-08-28T19:38:34.621 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:34 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3595238596' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:34.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:34 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3595238596' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:34.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:34 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3595238596' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:34.967 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:38:35.222 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:35.626 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:35 smithi033 ceph-mon[18549]: pgmap v526: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:38:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:35 smithi059 ceph-mon[22052]: pgmap v526: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:38:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:35 smithi122 ceph-mon[22174]: pgmap v526: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-28T19:38:35.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.801+0000 7f2da06d8640 1 -- 172.21.15.33:0/4227338842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d98105880 msgr2=0x7f2d9810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:35.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.801+0000 7f2da06d8640 1 --2- 172.21.15.33:0/4227338842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d98105880 0x7f2d9810f2d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009ca0 tx=0x7f2d9002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.801+0000 7f2da06d8640 1 -- 172.21.15.33:0/4227338842 shutdown_connections 2024-08-28T19:38:35.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.801+0000 7f2da06d8640 1 --2- 172.21.15.33:0/4227338842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d98105880 0x7f2d9810f2d0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.801+0000 7f2da06d8640 1 --2- 172.21.15.33:0/4227338842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d98104f30 0x7f2d98105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.801+0000 7f2da06d8640 1 --2- 172.21.15.33:0/4227338842 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d98102f60 0x7f2d98103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.801+0000 7f2da06d8640 1 -- 172.21.15.33:0/4227338842 >> 172.21.15.33:0/4227338842 conn(0x7f2d98077a00 msgr2=0x7f2d98077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:35.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.801+0000 7f2da06d8640 1 -- 172.21.15.33:0/4227338842 shutdown_connections 2024-08-28T19:38:35.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.801+0000 7f2da06d8640 1 -- 172.21.15.33:0/4227338842 wait complete. 2024-08-28T19:38:35.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2da06d8640 1 Processor -- start 2024-08-28T19:38:35.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2da06d8640 1 -- start start 2024-08-28T19:38:35.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2da06d8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d98102f60 0x7f2d9819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2da06d8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d98104f30 0x7f2d9819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2da06d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d98105880 0x7f2d9819fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2da06d8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2d98113840 con 0x7f2d98104f30 2024-08-28T19:38:35.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2da06d8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d981136c0 con 0x7f2d98105880 2024-08-28T19:38:35.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2da06d8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2d981139c0 con 0x7f2d98102f60 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2d9dc73640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d98104f30 0x7f2d9819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2d9dc73640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d98104f30 0x7f2d9819a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57896/0 (socket says 172.21.15.33:57896) 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2d9dc73640 1 -- 172.21.15.33:0/1486372401 learned_addr learned my addr 172.21.15.33:0/1486372401 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2d9e474640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d98102f60 0x7f2d9819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d98105880 0x7f2d9819fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2d9dc73640 1 -- 172.21.15.33:0/1486372401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d98102f60 msgr2=0x7f2d9819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d98102f60 0x7f2d9819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2d9dc73640 1 -- 172.21.15.33:0/1486372401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d98105880 msgr2=0x7f2d9819fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d98105880 0x7f2d9819fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.802+0000 7f2d9dc73640 1 -- 172.21.15.33:0/1486372401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d981a01c0 con 0x7f2d98104f30 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.803+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d98104f30 0x7f2d9819a7f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c970 tx=0x7f2d8800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.803+0000 7f2d8f7fe640 1 -- 172.21.15.33:0/1486372401 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d88007bb0 con 0x7f2d98104f30 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.803+0000 7f2da06d8640 1 -- 172.21.15.33:0/1486372401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d981a04b0 con 0x7f2d98104f30 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.803+0000 7f2d8f7fe640 1 -- 172.21.15.33:0/1486372401 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d88007d50 con 0x7f2d98104f30 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.803+0000 7f2d8f7fe640 1 -- 172.21.15.33:0/1486372401 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800f450 con 0x7f2d98104f30 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.803+0000 7f2da06d8640 1 -- 172.21.15.33:0/1486372401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d981a6c10 con 0x7f2d98104f30 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.805+0000 7f2da6c4d740 1 Processor -- start 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.805+0000 7f2da6c4d740 1 -- start start 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d8f7fe640 1 -- 172.21.15.33:0/1486372401 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2d88004f20 con 0x7f2d98104f30 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6aa070 0x55639ba4f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba4f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 0x55639ba4fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55639b9c6680 con 0x55639b6811b0 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55639b9b5c10 con 0x55639b689390 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55639b9b9bc0 con 0x55639b6aa070 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9e474640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba4f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9e474640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba4f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57912/0 (socket says 172.21.15.33:57912) 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9e474640 1 -- 172.21.15.33:0/164362797 learned_addr learned my addr 172.21.15.33:0/164362797 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/164362797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6aa070 0x55639ba4f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/164362797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 0x55639ba4fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9e474640 1 -- 172.21.15.33:0/164362797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6aa070 msgr2=0x55639ba4f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9e474640 1 --2- 172.21.15.33:0/164362797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6aa070 0x55639ba4f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9e474640 1 -- 172.21.15.33:0/164362797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 msgr2=0x55639ba4fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9e474640 1 --2- 172.21.15.33:0/164362797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 0x55639ba4fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9e474640 1 -- 172.21.15.33:0/164362797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639b715650 con 0x55639b6811b0 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/164362797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 0x55639ba4fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.806+0000 7f2d8f7fe640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2d840b4ca0 0x7f2d840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.807+0000 7f2d9e474640 1 --2- 172.21.15.33:0/164362797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba4f850 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009d20 tx=0x7f2d94011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7862b72b5045f8ce server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.807+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2d840b4ca0 0x7f2d840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.807+0000 7f2d8f7fe640 1 -- 172.21.15.33:0/1486372401 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2d880e5860 con 0x7f2d98104f30 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.807+0000 7f2d8cff9640 1 -- 172.21.15.33:0/164362797 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9401e070 con 0x55639b6811b0 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.807+0000 7f2d8cff9640 1 -- 172.21.15.33:0/164362797 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d94019ae0 con 0x55639b6811b0 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.807+0000 7f2d8cff9640 1 -- 172.21.15.33:0/164362797 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400ea80 con 0x55639b6811b0 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 -- 172.21.15.33:0/164362797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 msgr2=0x55639ba4f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2d840b4ca0 0x7f2d840b71b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2d900094e0 tx=0x7f2d9002f3a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:35.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/164362797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba4f850 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009d20 tx=0x7f2d94011810 comp rx=0 tx=0).stop 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 -- 172.21.15.33:0/164362797 shutdown_connections 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/164362797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 0x55639ba4fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/164362797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba4f850 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/164362797 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6aa070 0x55639ba4f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 -- 172.21.15.33:0/164362797 >> 172.21.15.33:0/164362797 conn(0x55639b69e460 msgr2=0x55639ba4d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 -- 172.21.15.33:0/164362797 shutdown_connections 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 -- 172.21.15.33:0/164362797 wait complete. 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 -- start start 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.808+0000 7f2da6c4d740 1 Processor -- start 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6811b0 0x55639ba5aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 0x55639ba5afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6aa070 0x55639ba66e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55639b818700 con 0x55639b6aa070 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55639b93c750 con 0x55639b689390 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55639ba5daf0 con 0x55639b6811b0 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2da6c4d740 10 client.0 _ll_register_callbacks cb 0x55639b96be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9ec75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6aa070 0x55639ba66e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9ec75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6aa070 0x55639ba66e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57928/0 (socket says 172.21.15.33:57928) 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9ec75640 1 -- 172.21.15.33:0/1444936951 learned_addr learned my addr 172.21.15.33:0/1444936951 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9e474640 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6811b0 0x55639ba5aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 0x55639ba5afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9ec75640 1 -- 172.21.15.33:0/1444936951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6811b0 msgr2=0x55639ba5aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6811b0 0x55639ba5aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9ec75640 1 -- 172.21.15.33:0/1444936951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 msgr2=0x55639ba5afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 0x55639ba5afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9ec75640 1 -- 172.21.15.33:0/1444936951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55639b975900 con 0x55639b6aa070 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9e474640 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6811b0 0x55639ba5aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 0x55639ba5afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6aa070 0x55639ba66e10 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f2d90031700 tx=0x7f2d900095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2463ecd7a77697 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.809+0000 7f2d81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2d81ffb640 1 -- 172.21.15.33:0/1444936951 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9004f070 con 0x55639b6aa070 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2d81ffb640 1 -- 172.21.15.33:0/1444936951 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2d90004240 con 0x55639b6aa070 2024-08-28T19:38:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1444936951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d94019ae0 con 0x55639b6aa070 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2d81ffb640 1 -- 172.21.15.33:0/1444936951 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2d90004440 con 0x55639b6aa070 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2da6c4d740 10 client.17328 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1444936951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55639ba697d0 con 0x55639b6aa070 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2d81ffb640 1 -- 172.21.15.33:0/1444936951 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d94019ae0 con 0x55639b6aa070 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2d81ffb640 1 -- 172.21.15.33:0/1444936951 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2d90044040 con 0x55639b6aa070 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2da6c4d740 10 client.17328 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2da6c4d740 10 client.17328 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2da6c4d740 20 client.17328 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55639b6689f0 0x55639ba6cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2da6c4d740 4 client.17328 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.810+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1444936951 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55639b9c85d0 con 0x55639b6689f0 2024-08-28T19:38:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.811+0000 7f2d9e474640 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55639b6689f0 0x55639ba6cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.811+0000 7f2d9e474640 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55639b6689f0 0x55639ba6cd30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c421ab85ec8710f server_cookie=6a317e0805ce3b7c in_seq=0 out_seq=0 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.811+0000 7f2d81ffb640 10 client.17328 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2d81ffb640 1 -- 172.21.15.33:0/1444936951 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55639b9c85d0 con 0x55639b6689f0 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2d81ffb640 10 client.17328 handle_command_reply: tid=0 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 client.17328 shutdown 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1444936951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6aa070 msgr2=0x55639ba66e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6aa070 0x55639ba66e10 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f2d90031700 tx=0x7f2d900095c0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1444936951 shutdown_connections 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55639b6689f0 0x55639ba6cd30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6aa070 0x55639ba66e10 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b689390 0x55639ba5afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2d81ffb640 0 client.17328 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/1444936951 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b6811b0 0x55639ba5aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1444936951 >> 172.21.15.33:0/1444936951 conn(0x55639b69e460 msgr2=0x55639ba524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1444936951 shutdown_connections 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1444936951 wait complete. 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.812+0000 7f2da6c4d740 20 client.17328 trim_cache size 0 max 16384 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2da6c4d740 1 Processor -- start 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2da6c4d740 1 -- start start 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6689f0 0x55639ba66d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6811b0 0x55639ba52410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 0x55639ba52950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2d981b0b40 con 0x55639b6689f0 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d981b2680 con 0x55639b6811b0 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2d981b1210 con 0x55639b689390 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9e474640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6689f0 0x55639ba66d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9e474640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6689f0 0x55639ba66d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57944/0 (socket says 172.21.15.33:57944) 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9e474640 1 -- 172.21.15.33:0/1837839534 learned_addr learned my addr 172.21.15.33:0/1837839534 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 0x55639ba52950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9e474640 1 -- 172.21.15.33:0/1837839534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 msgr2=0x55639ba52950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9e474640 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 0x55639ba52950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9e474640 1 -- 172.21.15.33:0/1837839534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6811b0 msgr2=0x55639ba52410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6811b0 0x55639ba52410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9e474640 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6811b0 0x55639ba52410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9e474640 1 -- 172.21.15.33:0/1837839534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55639ba58f60 con 0x55639b6689f0 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 0x55639ba52950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6811b0 0x55639ba52410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.826+0000 7f2d9e474640 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6689f0 0x55639ba66d10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2d9401afd0 tx=0x7f2d940097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6b886bc7e57585 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.827+0000 7f2d83fff640 1 -- 172.21.15.33:0/1837839534 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d94032070 con 0x55639b6689f0 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.827+0000 7f2d83fff640 1 -- 172.21.15.33:0/1837839534 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d9401f040 con 0x55639b6689f0 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.827+0000 7f2d83fff640 1 -- 172.21.15.33:0/1837839534 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9401e040 con 0x55639b6689f0 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1837839534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6689f0 msgr2=0x55639ba66d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6689f0 0x55639ba66d10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2d9401afd0 tx=0x7f2d940097c0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1837839534 shutdown_connections 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 0x55639ba52950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6811b0 0x55639ba52410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/1837839534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6689f0 0x55639ba66d10 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1837839534 >> 172.21.15.33:0/1837839534 conn(0x55639b69e460 msgr2=0x55639ba592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1837839534 shutdown_connections 2024-08-28T19:38:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 -- 172.21.15.33:0/1837839534 wait complete. 2024-08-28T19:38:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 -- start start 2024-08-28T19:38:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 Processor -- start 2024-08-28T19:38:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6689f0 0x55639ba5efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba5f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 0x55639bad6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2d981b1fb0 con 0x55639b6811b0 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d981b18e0 con 0x55639b6689f0 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2d981aeb20 con 0x55639b689390 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2da6c4d740 10 client.0 _ll_register_callbacks cb 0x7f2d94005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.828+0000 7f2d9dc73640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba5f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9dc73640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba5f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57952/0 (socket says 172.21.15.33:57952) 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9dc73640 1 -- 172.21.15.33:0/4073260855 learned_addr learned my addr 172.21.15.33:0/4073260855 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9e474640 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6689f0 0x55639ba5efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 0x55639bad6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9dc73640 1 -- 172.21.15.33:0/4073260855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 msgr2=0x55639bad6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 0x55639bad6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9dc73640 1 -- 172.21.15.33:0/4073260855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6689f0 msgr2=0x55639ba5efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6689f0 0x55639ba5efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9dc73640 1 -- 172.21.15.33:0/4073260855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55639ba5fd40 con 0x55639b6811b0 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9e474640 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6689f0 0x55639ba5efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9ec75640 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 0x55639bad6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d9dc73640 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba5f520 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f2d880ab900 tx=0x7f2d880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e2d0093c05533f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d81ffb640 1 -- 172.21.15.33:0/4073260855 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8801d040 con 0x55639b6811b0 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d81ffb640 1 -- 172.21.15.33:0/4073260855 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f2d880b0170 con 0x55639b6811b0 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2da6c4d740 1 -- 172.21.15.33:0/4073260855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d9401f040 con 0x55639b6811b0 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d81ffb640 1 -- 172.21.15.33:0/4073260855 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2d880abc00 con 0x55639b6811b0 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2da6c4d740 10 client.17334 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2da6c4d740 1 -- 172.21.15.33:0/4073260855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55639bad7b80 con 0x55639b6811b0 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.829+0000 7f2d81ffb640 1 -- 172.21.15.33:0/4073260855 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d9401f040 con 0x55639b6811b0 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.830+0000 7f2d81ffb640 1 -- 172.21.15.33:0/4073260855 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2d880cece0 con 0x55639b6811b0 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.830+0000 7f2da6c4d740 10 client.17334 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.830+0000 7f2da6c4d740 10 client.17334 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.830+0000 7f2da6c4d740 20 client.17334 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.830+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55639b6aa070 0x55639bada260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.830+0000 7f2da6c4d740 4 client.17334 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.830+0000 7f2da6c4d740 1 -- 172.21.15.33:0/4073260855 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55639b9c4070 con 0x55639b6aa070 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.830+0000 7f2d9e474640 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55639b6aa070 0x55639bada260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.830+0000 7f2d81ffb640 10 client.17334 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:38:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.830+0000 7f2d9e474640 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55639b6aa070 0x55639bada260 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6423a961b1fd89a5 server_cookie=1e61e596e0c90377 in_seq=0 out_seq=0 2024-08-28T19:38:35.888 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:38:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2d81ffb640 1 -- 172.21.15.33:0/4073260855 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55639b9c4070 con 0x55639b6aa070 2024-08-28T19:38:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2d81ffb640 10 client.17334 handle_command_reply: tid=0 2024-08-28T19:38:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 client.17334 shutdown 2024-08-28T19:38:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 -- 172.21.15.33:0/4073260855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 msgr2=0x55639ba5f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba5f520 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f2d880ab900 tx=0x7f2d880048f0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 -- 172.21.15.33:0/4073260855 shutdown_connections 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55639b6aa070 0x55639bada260 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55639b689390 0x55639bad6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55639b6811b0 0x55639ba5f520 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2d81ffb640 0 client.17334 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 --2- 172.21.15.33:0/4073260855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55639b6689f0 0x55639ba5efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 -- 172.21.15.33:0/4073260855 >> 172.21.15.33:0/4073260855 conn(0x55639b69e460 msgr2=0x55639ba52410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 -- 172.21.15.33:0/4073260855 shutdown_connections 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 1 -- 172.21.15.33:0/4073260855 wait complete. 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.831+0000 7f2da6c4d740 20 client.17334 trim_cache size 0 max 16384 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 -- 172.21.15.33:0/1486372401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2d840b4ca0 msgr2=0x7f2d840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2d840b4ca0 0x7f2d840b71b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2d900094e0 tx=0x7f2d9002f3a0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 -- 172.21.15.33:0/1486372401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d98104f30 msgr2=0x7f2d9819a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d98104f30 0x7f2d9819a7f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c970 tx=0x7f2d8800ce30 comp rx=0 tx=0).stop 2024-08-28T19:38:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 -- 172.21.15.33:0/1486372401 shutdown_connections 2024-08-28T19:38:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d98105880 0x7f2d9819fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d98104f30 0x7f2d9819a7f0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2d840b4ca0 0x7f2d840b71b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 --2- 172.21.15.33:0/1486372401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2d98102f60 0x7f2d9819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 -- 172.21.15.33:0/1486372401 >> 172.21.15.33:0/1486372401 conn(0x7f2d98077a00 msgr2=0x7f2d981061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:35.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 -- 172.21.15.33:0/1486372401 shutdown_connections 2024-08-28T19:38:35.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:35.832+0000 7f2da06d8640 1 -- 172.21.15.33:0/1486372401 wait complete. 2024-08-28T19:38:36.653 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:38:36.907 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:37.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.404+0000 7fe77f387640 1 -- 172.21.15.33:0/2138547940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe778102370 msgr2=0x7fe778102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:37.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.404+0000 7fe77f387640 1 --2- 172.21.15.33:0/2138547940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe778102370 0x7fe778102780 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe768009ca0 tx=0x7fe76802a950 comp rx=0 tx=0).stop 2024-08-28T19:38:37.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.404+0000 7fe77f387640 1 -- 172.21.15.33:0/2138547940 shutdown_connections 2024-08-28T19:38:37.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.404+0000 7fe77f387640 1 --2- 172.21.15.33:0/2138547940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77810ff20 0x7fe778112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.404+0000 7fe77f387640 1 --2- 172.21.15.33:0/2138547940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe778102cc0 0x7fe77810f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.404+0000 7fe77f387640 1 --2- 172.21.15.33:0/2138547940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe778102370 0x7fe778102780 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.404+0000 7fe77f387640 1 -- 172.21.15.33:0/2138547940 >> 172.21.15.33:0/2138547940 conn(0x7fe7780794d0 msgr2=0x7fe7780798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.404+0000 7fe77f387640 1 -- 172.21.15.33:0/2138547940 shutdown_connections 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.404+0000 7fe77f387640 1 -- 172.21.15.33:0/2138547940 wait complete. 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77f387640 1 Processor -- start 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77f387640 1 -- start start 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77f387640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe778102370 0x7fe77819c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77f387640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe778102cc0 0x7fe77819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77f387640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77810ff20 0x7fe7781a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77f387640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe778115a10 con 0x7fe778102cc0 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77f387640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe778115890 con 0x7fe77810ff20 2024-08-28T19:38:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77f387640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe778115b90 con 0x7fe778102370 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77c922640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe778102cc0 0x7fe77819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77c922640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe778102cc0 0x7fe77819ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57970/0 (socket says 172.21.15.33:57970) 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77c922640 1 -- 172.21.15.33:0/4126531668 learned_addr learned my addr 172.21.15.33:0/4126531668 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77d123640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe778102370 0x7fe77819c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.405+0000 7fe77d924640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77810ff20 0x7fe7781a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe77c922640 1 -- 172.21.15.33:0/4126531668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe778102370 msgr2=0x7fe77819c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe77c922640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe778102370 0x7fe77819c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe77c922640 1 -- 172.21.15.33:0/4126531668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77810ff20 msgr2=0x7fe7781a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe77c922640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77810ff20 0x7fe7781a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe77c922640 1 -- 172.21.15.33:0/4126531668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7781a23d0 con 0x7fe778102cc0 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe77c922640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe778102cc0 0x7fe77819ca00 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00d770 tx=0x7fe76c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe7767fc640 1 -- 172.21.15.33:0/4126531668 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c017070 con 0x7fe778102cc0 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe7767fc640 1 -- 172.21.15.33:0/4126531668 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe76c0054d0 con 0x7fe778102cc0 2024-08-28T19:38:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe77f387640 1 -- 172.21.15.33:0/4126531668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7781a26c0 con 0x7fe778102cc0 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe7767fc640 1 -- 172.21.15.33:0/4126531668 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c004c30 con 0x7fe778102cc0 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.406+0000 7fe77f387640 1 -- 172.21.15.33:0/4126531668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7781a8e20 con 0x7fe778102cc0 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.409+0000 7fe7858fc740 1 Processor -- start 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.409+0000 7fe7858fc740 1 -- start start 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 0x556f5eac1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6f31b0 0x556f5eac1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe7767fc640 1 -- 172.21.15.33:0/4126531668 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe76c004e10 con 0x7fe778102cc0 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e6fb390 0x556f5eac1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe7858fc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556f5ea38680 con 0x556f5e6f31b0 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe7858fc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556f5ea27c10 con 0x556f5e71c070 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe7858fc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556f5ea2bbc0 con 0x556f5e6fb390 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77d123640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6f31b0 0x556f5eac1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77d123640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6f31b0 0x556f5eac1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57972/0 (socket says 172.21.15.33:57972) 2024-08-28T19:38:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77d123640 1 -- 172.21.15.33:0/3120256529 learned_addr learned my addr 172.21.15.33:0/3120256529 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77d924640 1 --2- 172.21.15.33:0/3120256529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 0x556f5eac1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77c922640 1 --2- 172.21.15.33:0/3120256529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e6fb390 0x556f5eac1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77d123640 1 -- 172.21.15.33:0/3120256529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e6fb390 msgr2=0x556f5eac1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77d123640 1 --2- 172.21.15.33:0/3120256529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e6fb390 0x556f5eac1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77d123640 1 -- 172.21.15.33:0/3120256529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 msgr2=0x556f5eac1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77d123640 1 --2- 172.21.15.33:0/3120256529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 0x556f5eac1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77d123640 1 -- 172.21.15.33:0/3120256529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5e787650 con 0x556f5e6f31b0 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.410+0000 7fe77d924640 1 --2- 172.21.15.33:0/3120256529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 0x556f5eac1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.411+0000 7fe77d123640 1 --2- 172.21.15.33:0/3120256529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6f31b0 0x556f5eac1850 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe768009ca0 tx=0x7fe76802fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703aad0a77841fe6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.411+0000 7fe75f7fe640 1 -- 172.21.15.33:0/3120256529 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768048070 con 0x556f5e6f31b0 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.411+0000 7fe75f7fe640 1 -- 172.21.15.33:0/3120256529 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe768003e20 con 0x556f5e6f31b0 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.411+0000 7fe75f7fe640 1 -- 172.21.15.33:0/3120256529 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768034040 con 0x556f5e6f31b0 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.411+0000 7fe7767fc640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7600b4d20 0x7fe7600b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.411+0000 7fe77d924640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7600b4d20 0x7fe7600b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.411+0000 7fe7767fc640 1 -- 172.21.15.33:0/4126531668 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe76c0e5280 con 0x7fe778102cc0 2024-08-28T19:38:37.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe7858fc740 1 -- 172.21.15.33:0/3120256529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6f31b0 msgr2=0x556f5eac1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:37.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe77d924640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7600b4d20 0x7fe7600b7230 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe77000b890 tx=0x7fe77000b2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:37.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe7858fc740 1 --2- 172.21.15.33:0/3120256529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6f31b0 0x556f5eac1850 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe768009ca0 tx=0x7fe76802fdf0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe7858fc740 1 -- 172.21.15.33:0/3120256529 shutdown_connections 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe7858fc740 1 --2- 172.21.15.33:0/3120256529 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e6fb390 0x556f5eac1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe7858fc740 1 --2- 172.21.15.33:0/3120256529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6f31b0 0x556f5eac1850 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe7858fc740 1 --2- 172.21.15.33:0/3120256529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 0x556f5eac1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe7858fc740 1 -- 172.21.15.33:0/3120256529 >> 172.21.15.33:0/3120256529 conn(0x556f5e710460 msgr2=0x556f5eabf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe7858fc740 1 -- 172.21.15.33:0/3120256529 shutdown_connections 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe7858fc740 1 -- 172.21.15.33:0/3120256529 wait complete. 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.412+0000 7fe7858fc740 1 -- start start 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe7858fc740 1 Processor -- start 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e6f31b0 0x556f5eacca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5eaccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e71c070 0x556f5ead8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe7858fc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556f5e88a700 con 0x556f5e6fb390 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe7858fc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556f5e9ae750 con 0x556f5e6f31b0 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe7858fc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556f5eacfa90 con 0x556f5e71c070 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe7858fc740 10 client.0 _ll_register_callbacks cb 0x556f5e9dde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe77c922640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5eaccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe77c922640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5eaccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57980/0 (socket says 172.21.15.33:57980) 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe77c922640 1 -- 172.21.15.33:0/1796404190 learned_addr learned my addr 172.21.15.33:0/1796404190 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe77d924640 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e71c070 0x556f5ead8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.413+0000 7fe77d123640 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e6f31b0 0x556f5eacca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe77c922640 1 -- 172.21.15.33:0/1796404190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e71c070 msgr2=0x556f5ead8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe77c922640 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e71c070 0x556f5ead8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe77c922640 1 -- 172.21.15.33:0/1796404190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e6f31b0 msgr2=0x556f5eacca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe77c922640 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e6f31b0 0x556f5eacca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe77c922640 1 -- 172.21.15.33:0/1796404190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f5e9e7900 con 0x556f5e6fb390 2024-08-28T19:38:37.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe77c922640 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5eaccfd0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0e26e0 tx=0x7fe76c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a104c4d8fc1ea415 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe75cff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe75cff9640 1 -- 172.21.15.33:0/1796404190 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c020050 con 0x556f5e6fb390 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe75cff9640 1 -- 172.21.15.33:0/1796404190 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe76c0a7960 con 0x556f5e6fb390 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe7858fc740 1 -- 172.21.15.33:0/1796404190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe768003e20 con 0x556f5e6fb390 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe75cff9640 1 -- 172.21.15.33:0/1796404190 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe76c0aae40 con 0x556f5e6fb390 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe7858fc740 10 client.17346 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe7858fc740 1 -- 172.21.15.33:0/1796404190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556f5eadb8e0 con 0x556f5e6fb390 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.414+0000 7fe75cff9640 1 -- 172.21.15.33:0/1796404190 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe768003e20 con 0x556f5e6fb390 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.415+0000 7fe75cff9640 1 -- 172.21.15.33:0/1796404190 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe76c0b44b0 con 0x556f5e6fb390 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.415+0000 7fe7858fc740 10 client.17346 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.415+0000 7fe7858fc740 10 client.17346 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.415+0000 7fe7858fc740 20 client.17346 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.415+0000 7fe7858fc740 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556f5e6da9f0 0x556f5eadedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.415+0000 7fe7858fc740 4 client.17346 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.415+0000 7fe7858fc740 1 -- 172.21.15.33:0/1796404190 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f5ea3a5d0 con 0x556f5e6da9f0 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.415+0000 7fe77d123640 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556f5e6da9f0 0x556f5eadedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.415+0000 7fe77d123640 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556f5e6da9f0 0x556f5eadedb0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e11e65e0a0ef0d72 server_cookie=4449f1a6140918a1 in_seq=0 out_seq=0 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.415+0000 7fe75cff9640 10 client.17346 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe75cff9640 1 -- 172.21.15.33:0/1796404190 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f5ea3a5d0 con 0x556f5e6da9f0 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe75cff9640 10 client.17346 handle_command_reply: tid=0 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe7858fc740 1 client.17346 shutdown 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe7858fc740 1 -- 172.21.15.33:0/1796404190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 msgr2=0x556f5eaccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe7858fc740 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5eaccfd0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0e26e0 tx=0x7fe76c00b480 comp rx=0 tx=0).stop 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe7858fc740 1 -- 172.21.15.33:0/1796404190 shutdown_connections 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe7858fc740 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556f5e6da9f0 0x556f5eadedb0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe7858fc740 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e71c070 0x556f5ead8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe7858fc740 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5eaccfd0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe75cff9640 0 client.17346 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:38:37.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe7858fc740 1 --2- 172.21.15.33:0/1796404190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e6f31b0 0x556f5eacca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.416+0000 7fe7858fc740 1 -- 172.21.15.33:0/1796404190 >> 172.21.15.33:0/1796404190 conn(0x556f5e710460 msgr2=0x556f5eac44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:37.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.417+0000 7fe7858fc740 1 -- 172.21.15.33:0/1796404190 shutdown_connections 2024-08-28T19:38:37.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.417+0000 7fe7858fc740 1 -- 172.21.15.33:0/1796404190 wait complete. 2024-08-28T19:38:37.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.417+0000 7fe7858fc740 20 client.17346 trim_cache size 0 max 16384 2024-08-28T19:38:37.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe7858fc740 1 Processor -- start 2024-08-28T19:38:37.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe7858fc740 1 -- start start 2024-08-28T19:38:37.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e6f31b0 0x556f5eac4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 0x556f5eabeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe7858fc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe7781b2cf0 con 0x556f5e6fb390 2024-08-28T19:38:37.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe7858fc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe7781b4830 con 0x556f5e71c070 2024-08-28T19:38:37.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe7858fc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe7781b33c0 con 0x556f5e6f31b0 2024-08-28T19:38:37.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe77c922640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe77c922640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57982/0 (socket says 172.21.15.33:57982) 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.430+0000 7fe77c922640 1 -- 172.21.15.33:0/475462469 learned_addr learned my addr 172.21.15.33:0/475462469 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe77d924640 1 --2- 172.21.15.33:0/475462469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 0x556f5eabeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe77d123640 1 --2- 172.21.15.33:0/475462469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e6f31b0 0x556f5eac4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe77c922640 1 -- 172.21.15.33:0/475462469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e6f31b0 msgr2=0x556f5eac4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe77c922640 1 --2- 172.21.15.33:0/475462469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e6f31b0 0x556f5eac4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe77c922640 1 -- 172.21.15.33:0/475462469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 msgr2=0x556f5eabeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe77c922640 1 --2- 172.21.15.33:0/475462469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 0x556f5eabeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe77c922640 1 -- 172.21.15.33:0/475462469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5eabfaf0 con 0x556f5e6fb390 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe77c922640 1 --2- 172.21.15.33:0/475462469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead8cb0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009610 tx=0x7fe76c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cda924ff032a8a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe75effd640 1 -- 172.21.15.33:0/475462469 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c020070 con 0x556f5e6fb390 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe75effd640 1 -- 172.21.15.33:0/475462469 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe76c0b4280 con 0x556f5e6fb390 2024-08-28T19:38:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.431+0000 7fe75effd640 1 -- 172.21.15.33:0/475462469 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0a7960 con 0x556f5e6fb390 2024-08-28T19:38:37.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 -- 172.21.15.33:0/475462469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 msgr2=0x556f5ead8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:37.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 --2- 172.21.15.33:0/475462469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead8cb0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009610 tx=0x7fe76c009e90 comp rx=0 tx=0).stop 2024-08-28T19:38:37.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 -- 172.21.15.33:0/475462469 shutdown_connections 2024-08-28T19:38:37.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 --2- 172.21.15.33:0/475462469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e71c070 0x556f5eabeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 --2- 172.21.15.33:0/475462469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead8cb0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 --2- 172.21.15.33:0/475462469 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e6f31b0 0x556f5eac4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 -- 172.21.15.33:0/475462469 >> 172.21.15.33:0/475462469 conn(0x556f5e710460 msgr2=0x556f5eac4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 -- 172.21.15.33:0/475462469 shutdown_connections 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 -- 172.21.15.33:0/475462469 wait complete. 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 -- start start 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.432+0000 7fe7858fc740 1 Processor -- start 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e6f31b0 0x556f5ead1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe7858fc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e71c070 0x556f5eb48610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe7858fc740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe7781b4160 con 0x556f5e6fb390 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe7858fc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe7781b3a90 con 0x556f5e6f31b0 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe7858fc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe7781b0cd0 con 0x556f5e71c070 2024-08-28T19:38:37.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe7858fc740 10 client.0 _ll_register_callbacks cb 0x7fe76c0e8ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77c922640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77c922640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57998/0 (socket says 172.21.15.33:57998) 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77c922640 1 -- 172.21.15.33:0/3369789163 learned_addr learned my addr 172.21.15.33:0/3369789163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77d123640 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e6f31b0 0x556f5ead1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77d924640 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e71c070 0x556f5eb48610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77c922640 1 -- 172.21.15.33:0/3369789163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e71c070 msgr2=0x556f5eb48610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77c922640 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e71c070 0x556f5eb48610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77c922640 1 -- 172.21.15.33:0/3369789163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e6f31b0 msgr2=0x556f5ead1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77c922640 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e6f31b0 0x556f5ead1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77c922640 1 -- 172.21.15.33:0/3369789163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f5eb48c80 con 0x556f5e6fb390 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe77c922640 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead1b40 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0ab660 tx=0x7fe76c0d2400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd67e761eb72d7cd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.433+0000 7fe75cff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:37.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe75cff9640 1 -- 172.21.15.33:0/3369789163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c020070 con 0x556f5e6fb390 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe75cff9640 1 -- 172.21.15.33:0/3369789163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fe76c0aa930 con 0x556f5e6fb390 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe7858fc740 1 -- 172.21.15.33:0/3369789163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556f5ea36070 con 0x556f5e6fb390 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe75cff9640 1 -- 172.21.15.33:0/3369789163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe76c005680 con 0x556f5e6fb390 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe7858fc740 10 client.17352 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe7858fc740 1 -- 172.21.15.33:0/3369789163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556f5eb48c80 con 0x556f5e6fb390 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe75cff9640 1 -- 172.21.15.33:0/3369789163 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556f5ea36070 con 0x556f5e6fb390 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe75cff9640 1 -- 172.21.15.33:0/3369789163 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe76c0ce0b0 con 0x556f5e6fb390 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe7858fc740 10 client.17352 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe7858fc740 10 client.17352 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe7858fc740 20 client.17352 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe7858fc740 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556f5e6afda0 0x556f5eb4c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:37.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe7858fc740 4 client.17352 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.434+0000 7fe7858fc740 1 -- 172.21.15.33:0/3369789163 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f5ea337b0 con 0x556f5e6afda0 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe77d123640 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556f5e6afda0 0x556f5eb4c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe77d123640 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556f5e6afda0 0x556f5eb4c250 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=737ef76adb5104a5 server_cookie=43bc2a92de2e91ec in_seq=0 out_seq=0 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe75cff9640 10 client.17352 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe75cff9640 1 -- 172.21.15.33:0/3369789163 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f5ea337b0 con 0x556f5e6afda0 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe75cff9640 10 client.17352 handle_command_reply: tid=0 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe7858fc740 1 client.17352 shutdown 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe7858fc740 1 -- 172.21.15.33:0/3369789163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 msgr2=0x556f5ead1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe7858fc740 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead1b40 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0ab660 tx=0x7fe76c0d2400 comp rx=0 tx=0).stop 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe7858fc740 1 -- 172.21.15.33:0/3369789163 shutdown_connections 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe7858fc740 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556f5e6afda0 0x556f5eb4c250 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe7858fc740 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556f5e71c070 0x556f5eb48610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe7858fc740 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556f5e6fb390 0x556f5ead1b40 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe7858fc740 1 --2- 172.21.15.33:0/3369789163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f5e6f31b0 0x556f5ead1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe75cff9640 0 client.17352 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:38:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.435+0000 7fe7858fc740 1 -- 172.21.15.33:0/3369789163 >> 172.21.15.33:0/3369789163 conn(0x556f5e710460 msgr2=0x556f5eabea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe7858fc740 1 -- 172.21.15.33:0/3369789163 shutdown_connections 2024-08-28T19:38:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe7858fc740 1 -- 172.21.15.33:0/3369789163 wait complete. 2024-08-28T19:38:37.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe7858fc740 20 client.17352 trim_cache size 0 max 16384 2024-08-28T19:38:37.443 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:38:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 -- 172.21.15.33:0/4126531668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7600b4d20 msgr2=0x7fe7600b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7600b4d20 0x7fe7600b7230 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe77000b890 tx=0x7fe77000b2e0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 -- 172.21.15.33:0/4126531668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe778102cc0 msgr2=0x7fe77819ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe778102cc0 0x7fe77819ca00 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00d770 tx=0x7fe76c00dc30 comp rx=0 tx=0).stop 2024-08-28T19:38:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 -- 172.21.15.33:0/4126531668 shutdown_connections 2024-08-28T19:38:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77810ff20 0x7fe7781a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe778102cc0 0x7fe77819ca00 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe7600b4d20 0x7fe7600b7230 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 --2- 172.21.15.33:0/4126531668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe778102370 0x7fe77819c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 -- 172.21.15.33:0/4126531668 >> 172.21.15.33:0/4126531668 conn(0x7fe7780794d0 msgr2=0x7fe778109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.436+0000 7fe77f387640 1 -- 172.21.15.33:0/4126531668 shutdown_connections 2024-08-28T19:38:37.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:37.437+0000 7fe77f387640 1 -- 172.21.15.33:0/4126531668 wait complete. 2024-08-28T19:38:37.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:37 smithi033 ceph-mon[18549]: pgmap v527: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:38:37.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:37 smithi059 ceph-mon[22052]: pgmap v527: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:38:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:37 smithi122 ceph-mon[22174]: pgmap v527: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:38:38.155 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:38:38.414 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:38.874 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:38:38.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.905+0000 7f4e85c85640 1 -- 172.21.15.33:0/409026865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e80109c60 msgr2=0x7f4e80110490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:38.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.905+0000 7f4e85c85640 1 --2- 172.21.15.33:0/409026865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e80109c60 0x7f4e80110490 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f4e78009ca0 tx=0x7f4e7802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.905+0000 7f4e85c85640 1 -- 172.21.15.33:0/409026865 shutdown_connections 2024-08-28T19:38:38.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.905+0000 7f4e85c85640 1 --2- 172.21.15.33:0/409026865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e80109c60 0x7f4e80110490 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.905+0000 7f4e85c85640 1 --2- 172.21.15.33:0/409026865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e80109310 0x7f4e80109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.905+0000 7f4e85c85640 1 --2- 172.21.15.33:0/409026865 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e801039d0 0x7f4e80103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.905+0000 7f4e85c85640 1 -- 172.21.15.33:0/409026865 >> 172.21.15.33:0/409026865 conn(0x7f4e8007b670 msgr2=0x7f4e8007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:38.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.906+0000 7f4e85c85640 1 -- 172.21.15.33:0/409026865 shutdown_connections 2024-08-28T19:38:38.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.906+0000 7f4e85c85640 1 -- 172.21.15.33:0/409026865 wait complete. 2024-08-28T19:38:38.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.906+0000 7f4e85c85640 1 Processor -- start 2024-08-28T19:38:38.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.906+0000 7f4e85c85640 1 -- start start 2024-08-28T19:38:38.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e85c85640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e801039d0 0x7f4e8019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e85c85640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e80109310 0x7f4e8019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e85c85640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e80109c60 0x7f4e8019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e85c85640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4e80113880 con 0x7f4e801039d0 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e85c85640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4e80113700 con 0x7f4e80109c60 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e85c85640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4e80113a00 con 0x7f4e80109310 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e801039d0 0x7f4e8019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e801039d0 0x7f4e8019a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53200/0 (socket says 172.21.15.33:53200) 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7f7fe640 1 -- 172.21.15.33:0/3395423823 learned_addr learned my addr 172.21.15.33:0/3395423823 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e80109c60 0x7f4e8019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7effd640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e80109310 0x7f4e8019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7f7fe640 1 -- 172.21.15.33:0/3395423823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e80109310 msgr2=0x7f4e8019a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e80109310 0x7f4e8019a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7f7fe640 1 -- 172.21.15.33:0/3395423823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e80109c60 msgr2=0x7f4e8019fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e80109c60 0x7f4e8019fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7f7fe640 1 -- 172.21.15.33:0/3395423823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e801a0280 con 0x7f4e801039d0 2024-08-28T19:38:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.907+0000 7f4e7effd640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e80109310 0x7f4e8019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:38.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.908+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e801039d0 0x7f4e8019a310 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000d770 tx=0x7f4e7000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:38.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.908+0000 7f4e7cff9640 1 -- 172.21.15.33:0/3395423823 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70017070 con 0x7f4e801039d0 2024-08-28T19:38:38.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.908+0000 7f4e7cff9640 1 -- 172.21.15.33:0/3395423823 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e700054d0 con 0x7f4e801039d0 2024-08-28T19:38:38.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.908+0000 7f4e7cff9640 1 -- 172.21.15.33:0/3395423823 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70004c30 con 0x7f4e801039d0 2024-08-28T19:38:38.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.908+0000 7f4e85c85640 1 -- 172.21.15.33:0/3395423823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e801a0570 con 0x7f4e801039d0 2024-08-28T19:38:38.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.908+0000 7f4e85c85640 1 -- 172.21.15.33:0/3395423823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e801a6cd0 con 0x7f4e801039d0 2024-08-28T19:38:38.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.911+0000 7f4e8c1fa740 1 Processor -- start 2024-08-28T19:38:38.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.911+0000 7f4e8c1fa740 1 -- start start 2024-08-28T19:38:38.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.911+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6d4070 0x55d24ea79310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.911+0000 7f4e7cff9640 1 -- 172.21.15.33:0/3395423823 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4e70010460 con 0x7f4e801039d0 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.911+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 0x55d24ea79850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.911+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6b3390 0x55d24ea79d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.911+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d24e9f0680 con 0x55d24e6b3390 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.911+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d24e9dfc10 con 0x55d24e6ab1b0 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.911+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d24e9e3bc0 con 0x55d24e6d4070 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6b3390 0x55d24ea79d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6b3390 0x55d24ea79d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53202/0 (socket says 172.21.15.33:53202) 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7effd640 1 -- 172.21.15.33:0/2600936800 learned_addr learned my addr 172.21.15.33:0/2600936800 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/2600936800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6d4070 0x55d24ea79310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/2600936800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 0x55d24ea79850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7effd640 1 -- 172.21.15.33:0/2600936800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6d4070 msgr2=0x55d24ea79310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7effd640 1 --2- 172.21.15.33:0/2600936800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6d4070 0x55d24ea79310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7effd640 1 -- 172.21.15.33:0/2600936800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 msgr2=0x55d24ea79850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7effd640 1 --2- 172.21.15.33:0/2600936800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 0x55d24ea79850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7effd640 1 -- 172.21.15.33:0/2600936800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24e73f650 con 0x55d24e6b3390 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/2600936800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 0x55d24ea79850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.912+0000 7f4e7effd640 1 --2- 172.21.15.33:0/2600936800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6b3390 0x55d24ea79d90 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400bc60 tx=0x7f4e7400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f995a583b8f8364e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.913+0000 7f4e65ffb640 1 -- 172.21.15.33:0/2600936800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74015070 con 0x55d24e6b3390 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.913+0000 7f4e65ffb640 1 -- 172.21.15.33:0/2600936800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e7401a910 con 0x55d24e6b3390 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.913+0000 7f4e7cff9640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e680b4ca0 0x7f4e680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.913+0000 7f4e65ffb640 1 -- 172.21.15.33:0/2600936800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74011900 con 0x55d24e6b3390 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.913+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e680b4ca0 0x7f4e680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.913+0000 7f4e7cff9640 1 -- 172.21.15.33:0/3395423823 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4e700e53d0 con 0x7f4e801039d0 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/2600936800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6b3390 msgr2=0x55d24ea79d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e680b4ca0 0x7f4e680b71b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4e7802f500 tx=0x7f4e7802f370 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/2600936800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6b3390 0x55d24ea79d90 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400bc60 tx=0x7f4e7400f730 comp rx=0 tx=0).stop 2024-08-28T19:38:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/2600936800 shutdown_connections 2024-08-28T19:38:38.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/2600936800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6b3390 0x55d24ea79d90 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/2600936800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 0x55d24ea79850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/2600936800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6d4070 0x55d24ea79310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/2600936800 >> 172.21.15.33:0/2600936800 conn(0x55d24e6c8460 msgr2=0x55d24ea77200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:38.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/2600936800 shutdown_connections 2024-08-28T19:38:38.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/2600936800 wait complete. 2024-08-28T19:38:38.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 -- start start 2024-08-28T19:38:38.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.914+0000 7f4e8c1fa740 1 Processor -- start 2024-08-28T19:38:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 0x55d24ea84a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 0x55d24ea84f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea90de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d24e842700 con 0x55d24e6d4070 2024-08-28T19:38:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d24e966750 con 0x55d24e6b3390 2024-08-28T19:38:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d24ea87af0 con 0x55d24e6ab1b0 2024-08-28T19:38:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e8c1fa740 10 client.0 _ll_register_callbacks cb 0x55d24e995e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea90de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea90de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53218/0 (socket says 172.21.15.33:53218) 2024-08-28T19:38:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7ffff640 1 -- 172.21.15.33:0/345543804 learned_addr learned my addr 172.21.15.33:0/345543804 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 0x55d24ea84a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7effd640 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 0x55d24ea84f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7f7fe640 1 -- 172.21.15.33:0/345543804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 msgr2=0x55d24ea84f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 0x55d24ea84f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7f7fe640 1 -- 172.21.15.33:0/345543804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 msgr2=0x55d24ea90de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea90de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7f7fe640 1 -- 172.21.15.33:0/345543804 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d24e99f900 con 0x55d24e6ab1b0 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.915+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea90de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.916+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 0x55d24ea84a30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e700e27d0 tx=0x7f4e700ab540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=926ac8207748dca0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.916+0000 7f4e5effd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:38:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.916+0000 7f4e5effd640 1 -- 172.21.15.33:0/345543804 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70020070 con 0x55d24e6ab1b0 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.916+0000 7f4e5effd640 1 -- 172.21.15.33:0/345543804 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4e700e5160 con 0x55d24e6ab1b0 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.916+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/345543804 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e7401a910 con 0x55d24e6ab1b0 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.916+0000 7f4e5effd640 1 -- 172.21.15.33:0/345543804 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e700b43d0 con 0x55d24e6ab1b0 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.916+0000 7f4e8c1fa740 10 client.26548 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.916+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/345543804 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d24ea93860 con 0x55d24e6ab1b0 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.916+0000 7f4e5effd640 1 -- 172.21.15.33:0/345543804 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e7401a910 con 0x55d24e6ab1b0 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.916+0000 7f4e5effd640 1 -- 172.21.15.33:0/345543804 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4e700b4600 con 0x55d24e6ab1b0 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.917+0000 7f4e8c1fa740 10 client.26548 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.917+0000 7f4e8c1fa740 10 client.26548 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.917+0000 7f4e8c1fa740 20 client.26548 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.917+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d24e6929f0 0x55d24ea96c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.917+0000 7f4e8c1fa740 4 client.26548 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.917+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/345543804 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d24e9f25d0 con 0x55d24e6929f0 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.917+0000 7f4e7effd640 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d24e6929f0 0x55d24ea96c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.917+0000 7f4e7effd640 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d24e6929f0 0x55d24ea96c20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=53bab859c050b480 server_cookie=8c964aa78ba7a6ab in_seq=0 out_seq=0 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.917+0000 7f4e5effd640 10 client.26548 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e5effd640 1 -- 172.21.15.33:0/345543804 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d24e9f25d0 con 0x55d24e6929f0 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e5effd640 10 client.26548 handle_command_reply: tid=0 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 client.26548 shutdown 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/345543804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 msgr2=0x55d24ea84a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 0x55d24ea84a30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e700e27d0 tx=0x7f4e700ab540 comp rx=0 tx=0).stop 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/345543804 shutdown_connections 2024-08-28T19:38:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d24e6929f0 0x55d24ea96c20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea90de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 0x55d24ea84f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/345543804 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 0x55d24ea84a30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e5effd640 0 client.26548 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:38:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/345543804 >> 172.21.15.33:0/345543804 conn(0x55d24e6c8460 msgr2=0x55d24ea7c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/345543804 shutdown_connections 2024-08-28T19:38:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.918+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/345543804 wait complete. 2024-08-28T19:38:38.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.919+0000 7f4e8c1fa740 20 client.26548 trim_cache size 0 max 16384 2024-08-28T19:38:38.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e8c1fa740 1 Processor -- start 2024-08-28T19:38:38.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e8c1fa740 1 -- start start 2024-08-28T19:38:38.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 0x55d24ea7aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6b3390 0x55d24ea90ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea81c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801b0b00 con 0x55d24e6d4070 2024-08-28T19:38:38.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801b2640 con 0x55d24e6ab1b0 2024-08-28T19:38:38.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801b11d0 con 0x55d24e6b3390 2024-08-28T19:38:38.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e7ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea81c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e7ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea81c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53224/0 (socket says 172.21.15.33:53224) 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e7ffff640 1 -- 172.21.15.33:0/1761549661 learned_addr learned my addr 172.21.15.33:0/1761549661 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e7effd640 1 --2- 172.21.15.33:0/1761549661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6b3390 0x55d24ea90ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.932+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/1761549661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 0x55d24ea7aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.933+0000 7f4e7ffff640 1 -- 172.21.15.33:0/1761549661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6b3390 msgr2=0x55d24ea90ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.933+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/1761549661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6b3390 0x55d24ea90ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.933+0000 7f4e7ffff640 1 -- 172.21.15.33:0/1761549661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 msgr2=0x55d24ea7aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.933+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/1761549661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 0x55d24ea7aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.933+0000 7f4e7ffff640 1 -- 172.21.15.33:0/1761549661 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24ea727e0 con 0x55d24e6d4070 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.933+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/1761549661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea81c20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4e78005e30 tx=0x7f4e78044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38adc977d0556220 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.933+0000 7f4e657fa640 1 -- 172.21.15.33:0/1761549661 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78004040 con 0x55d24e6d4070 2024-08-28T19:38:38.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.933+0000 7f4e657fa640 1 -- 172.21.15.33:0/1761549661 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e78036050 con 0x55d24e6d4070 2024-08-28T19:38:38.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.933+0000 7f4e657fa640 1 -- 172.21.15.33:0/1761549661 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7802fe40 con 0x55d24e6d4070 2024-08-28T19:38:38.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.934+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/1761549661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 msgr2=0x55d24ea81c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.934+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/1761549661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea81c20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4e78005e30 tx=0x7f4e78044000 comp rx=0 tx=0).stop 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.934+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/1761549661 shutdown_connections 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.934+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/1761549661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea81c20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.934+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/1761549661 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6b3390 0x55d24ea90ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.934+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/1761549661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6ab1b0 0x55d24ea7aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.934+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/1761549661 >> 172.21.15.33:0/1761549661 conn(0x55d24e6c8460 msgr2=0x55d24ea7a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.934+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/1761549661 shutdown_connections 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.934+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/1761549661 wait complete. 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e8c1fa740 1 -- start start 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e8c1fa740 1 Processor -- start 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 0x55d24ea8d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 0x55d24ea897e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e8c1fa740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea89d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801b1f70 con 0x55d24e6d4070 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801b18a0 con 0x55d24e6b3390 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e8c1fa740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4e801aeae0 con 0x55d24e6ab1b0 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e8c1fa740 10 client.0 _ll_register_callbacks cb 0x7f4e700046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e7ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea89d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e7ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea89d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53238/0 (socket says 172.21.15.33:53238) 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e7ffff640 1 -- 172.21.15.33:0/3974558474 learned_addr learned my addr 172.21.15.33:0/3974558474 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.935+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 0x55d24ea8d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e7effd640 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 0x55d24ea897e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e7ffff640 1 -- 172.21.15.33:0/3974558474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 msgr2=0x55d24ea8d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 0x55d24ea8d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e7ffff640 1 -- 172.21.15.33:0/3974558474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 msgr2=0x55d24ea897e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 0x55d24ea897e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e7ffff640 1 -- 172.21.15.33:0/3974558474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d24ea8a260 con 0x55d24e6d4070 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e7effd640 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 0x55d24ea897e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e7ffff640 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea89d20 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4e78003fd0 tx=0x7f4e7802f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3a55c196bf70bd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e5effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e5effd640 1 -- 172.21.15.33:0/3974558474 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78004000 con 0x55d24e6d4070 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e5effd640 1 -- 172.21.15.33:0/3974558474 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f4e780041a0 con 0x55d24e6d4070 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/3974558474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e78036050 con 0x55d24e6d4070 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e5effd640 1 -- 172.21.15.33:0/3974558474 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e78066050 con 0x55d24e6d4070 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e8c1fa740 10 client.17370 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.936+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/3974558474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d24eb02280 con 0x55d24e6d4070 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.937+0000 7f4e5effd640 1 -- 172.21.15.33:0/3974558474 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e78036050 con 0x55d24e6d4070 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.937+0000 7f4e5effd640 1 -- 172.21.15.33:0/3974558474 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4e78030cb0 con 0x55d24e6d4070 2024-08-28T19:38:38.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.937+0000 7f4e8c1fa740 10 client.17370 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.937+0000 7f4e8c1fa740 10 client.17370 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.937+0000 7f4e8c1fa740 20 client.17370 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.937+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d24e667da0 0x55d24eb04aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.937+0000 7f4e8c1fa740 4 client.17370 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.937+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/3974558474 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d24e9ee070 con 0x55d24e667da0 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.937+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d24e667da0 0x55d24eb04aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e7f7fe640 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d24e667da0 0x55d24eb04aa0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=92c237274e5f8a00 server_cookie=5007a3a88af5e0e5 in_seq=0 out_seq=0 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e5effd640 10 client.17370 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e5effd640 1 -- 172.21.15.33:0/3974558474 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d24e9ee070 con 0x55d24e667da0 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e5effd640 10 client.17370 handle_command_reply: tid=0 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 client.17370 shutdown 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/3974558474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 msgr2=0x55d24ea89d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:38.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea89d20 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4e78003fd0 tx=0x7f4e7802f660 comp rx=0 tx=0).stop 2024-08-28T19:38:38.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/3974558474 shutdown_connections 2024-08-28T19:38:38.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55d24e667da0 0x55d24eb04aa0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d24e6d4070 0x55d24ea89d20 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e5effd640 0 client.17370 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:38:38.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24e6b3390 0x55d24ea897e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 --2- 172.21.15.33:0/3974558474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d24e6ab1b0 0x55d24ea8d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/3974558474 >> 172.21.15.33:0/3974558474 conn(0x55d24e6c8460 msgr2=0x55d24ea85cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:38.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/3974558474 shutdown_connections 2024-08-28T19:38:38.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.938+0000 7f4e8c1fa740 1 -- 172.21.15.33:0/3974558474 wait complete. 2024-08-28T19:38:38.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e8c1fa740 20 client.17370 trim_cache size 0 max 16384 2024-08-28T19:38:38.946 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:38:38.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 -- 172.21.15.33:0/3395423823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e680b4ca0 msgr2=0x7f4e680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:38.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e680b4ca0 0x7f4e680b71b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4e7802f500 tx=0x7f4e7802f370 comp rx=0 tx=0).stop 2024-08-28T19:38:38.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 -- 172.21.15.33:0/3395423823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e801039d0 msgr2=0x7f4e8019a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:38.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e801039d0 0x7f4e8019a310 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000d770 tx=0x7f4e7000dc30 comp rx=0 tx=0).stop 2024-08-28T19:38:38.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 -- 172.21.15.33:0/3395423823 shutdown_connections 2024-08-28T19:38:38.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e80109c60 0x7f4e8019fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4e680b4ca0 0x7f4e680b71b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e80109310 0x7f4e8019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 --2- 172.21.15.33:0/3395423823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e801039d0 0x7f4e8019a310 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:38.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 -- 172.21.15.33:0/3395423823 >> 172.21.15.33:0/3395423823 conn(0x7f4e8007b670 msgr2=0x7f4e80107450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:38.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 -- 172.21.15.33:0/3395423823 shutdown_connections 2024-08-28T19:38:38.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:38.939+0000 7f4e85c85640 1 -- 172.21.15.33:0/3395423823 wait complete. 2024-08-28T19:38:39.601 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:39 smithi033 ceph-mon[18549]: pgmap v528: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:38:39.636 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:38:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:39.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:39 smithi059 ceph-mon[22052]: pgmap v528: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:38:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:39 smithi122 ceph-mon[22174]: pgmap v528: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-28T19:38:40.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.154+0000 7fc58b732640 1 -- 172.21.15.33:0/2721927163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc584108140 msgr2=0x7fc584108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:40.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.154+0000 7fc58b732640 1 --2- 172.21.15.33:0/2721927163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc584108140 0x7fc584108550 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc574009900 tx=0x7fc57402a3f0 comp rx=0 tx=0).stop 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.154+0000 7fc58b732640 1 -- 172.21.15.33:0/2721927163 shutdown_connections 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.154+0000 7fc58b732640 1 --2- 172.21.15.33:0/2721927163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc584108a90 0x7fc58410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.154+0000 7fc58b732640 1 --2- 172.21.15.33:0/2721927163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc584108140 0x7fc584108550 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.154+0000 7fc58b732640 1 --2- 172.21.15.33:0/2721927163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc584102800 0x7fc584102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.154+0000 7fc58b732640 1 -- 172.21.15.33:0/2721927163 >> 172.21.15.33:0/2721927163 conn(0x7fc5840794d0 msgr2=0x7fc5840798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.154+0000 7fc58b732640 1 -- 172.21.15.33:0/2721927163 shutdown_connections 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.154+0000 7fc58b732640 1 -- 172.21.15.33:0/2721927163 wait complete. 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc58b732640 1 Processor -- start 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc58b732640 1 -- start start 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc58b732640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc584102800 0x7fc58419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:40.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc58b732640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc584108140 0x7fc58419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc58b732640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc584108a90 0x7fc58419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc58b732640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc584112740 con 0x7fc584102800 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc58b732640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841125c0 con 0x7fc584108a90 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc58b732640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841128c0 con 0x7fc584108140 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc5894ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc584102800 0x7fc58419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc5894ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc584102800 0x7fc58419a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53266/0 (socket says 172.21.15.33:53266) 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.155+0000 7fc5894ce640 1 -- 172.21.15.33:0/165666925 learned_addr learned my addr 172.21.15.33:0/165666925 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc588ccd640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc584108140 0x7fc58419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc589ccf640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc584108a90 0x7fc58419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc5894ce640 1 -- 172.21.15.33:0/165666925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc584108140 msgr2=0x7fc58419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc5894ce640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc584108140 0x7fc58419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc5894ce640 1 -- 172.21.15.33:0/165666925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc584108a90 msgr2=0x7fc58419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:40.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc5894ce640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc584108a90 0x7fc58419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc5894ce640 1 -- 172.21.15.33:0/165666925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5841a00d0 con 0x7fc584102800 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc5894ce640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc584102800 0x7fc58419a220 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fc58000cce0 tx=0x7fc58000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc57a7fc640 1 -- 172.21.15.33:0/165666925 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58000f650 con 0x7fc584102800 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc58b732640 1 -- 172.21.15.33:0/165666925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5841a03c0 con 0x7fc584102800 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc57a7fc640 1 -- 172.21.15.33:0/165666925 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc58000fca0 con 0x7fc584102800 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc57a7fc640 1 -- 172.21.15.33:0/165666925 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580018b40 con 0x7fc584102800 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.156+0000 7fc58b732640 1 -- 172.21.15.33:0/165666925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5841a6be0 con 0x7fc584102800 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.157+0000 7fc58b732640 1 -- 172.21.15.33:0/165666925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc584102c10 con 0x7fc584102800 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.159+0000 7fc57a7fc640 1 -- 172.21.15.33:0/165666925 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc580018ce0 con 0x7fc584102800 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.160+0000 7fc57a7fc640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5700b4cd0 0x7fc5700b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.160+0000 7fc588ccd640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5700b4cd0 0x7fc5700b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.160+0000 7fc57a7fc640 1 -- 172.21.15.33:0/165666925 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fc5800e5f40 con 0x7fc584102800 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.160+0000 7fc588ccd640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5700b4cd0 0x7fc5700b71e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc574000c00 tx=0x7fc574031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:40.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.163+0000 7fc57a7fc640 1 -- 172.21.15.33:0/165666925 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc580014030 con 0x7fc584102800 2024-08-28T19:38:40.210 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:40.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.391+0000 7fc58b732640 1 -- 172.21.15.33:0/165666925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc58419b350 con 0x7fc584102800 2024-08-28T19:38:40.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.391+0000 7fc57a7fc640 1 -- 172.21.15.33:0/165666925 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fc5800aca70 con 0x7fc584102800 2024-08-28T19:38:40.394 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:38:40.394 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:38:40.394 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:38:40.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 -- 172.21.15.33:0/165666925 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5700b4cd0 msgr2=0x7fc5700b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5700b4cd0 0x7fc5700b71e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc574000c00 tx=0x7fc574031400 comp rx=0 tx=0).stop 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 -- 172.21.15.33:0/165666925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc584102800 msgr2=0x7fc58419a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc584102800 0x7fc58419a220 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fc58000cce0 tx=0x7fc58000a620 comp rx=0 tx=0).stop 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 -- 172.21.15.33:0/165666925 shutdown_connections 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc584108a90 0x7fc58419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc5700b4cd0 0x7fc5700b71e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc584108140 0x7fc58419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 --2- 172.21.15.33:0/165666925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc584102800 0x7fc58419a220 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 -- 172.21.15.33:0/165666925 >> 172.21.15.33:0/165666925 conn(0x7fc5840794d0 msgr2=0x7fc584103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 -- 172.21.15.33:0/165666925 shutdown_connections 2024-08-28T19:38:40.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:40.394+0000 7fc58b732640 1 -- 172.21.15.33:0/165666925 wait complete. 2024-08-28T19:38:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:40 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/165666925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:40 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/165666925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:40.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:40 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/165666925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:38:41.074 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id 6e2f1042 --release --await' 2024-08-28T19:38:41.075 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id 6e2f1042 --release --await 2024-08-28T19:38:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.347+0000 7fcfb643f640 1 -- 172.21.15.33:0/1896883259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb0108b10 msgr2=0x7fcfb010f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.347+0000 7fcfb643f640 1 --2- 172.21.15.33:0/1896883259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb0108b10 0x7fcfb010f340 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009ca0 tx=0x7fcfa802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.347+0000 7fcfb643f640 1 -- 172.21.15.33:0/1896883259 shutdown_connections 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.347+0000 7fcfb643f640 1 --2- 172.21.15.33:0/1896883259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb0108b10 0x7fcfb010f340 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.347+0000 7fcfb643f640 1 --2- 172.21.15.33:0/1896883259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb01081c0 0x7fcfb01085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.347+0000 7fcfb643f640 1 --2- 172.21.15.33:0/1896883259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb0102880 0x7fcfb0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.347+0000 7fcfb643f640 1 -- 172.21.15.33:0/1896883259 >> 172.21.15.33:0/1896883259 conn(0x7fcfb0079510 msgr2=0x7fcfb0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.348+0000 7fcfb643f640 1 -- 172.21.15.33:0/1896883259 shutdown_connections 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.348+0000 7fcfb643f640 1 -- 172.21.15.33:0/1896883259 wait complete. 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.348+0000 7fcfb643f640 1 Processor -- start 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.348+0000 7fcfb643f640 1 -- start start 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfb643f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb0102880 0x7fcfb010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfb643f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb01081c0 0x7fcfb0110360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfb643f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb0108b10 0x7fcfb01108a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfb643f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb01138f0 con 0x7fcfb0102880 2024-08-28T19:38:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfb643f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb0113770 con 0x7fcfb0108b10 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfb643f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb0113a70 con 0x7fcfb01081c0 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfaffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb0102880 0x7fcfb010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfaffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb0102880 0x7fcfb010fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53284/0 (socket says 172.21.15.33:53284) 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfaffff640 1 -- 172.21.15.33:0/1608421949 learned_addr learned my addr 172.21.15.33:0/1608421949 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb01081c0 0x7fcfb0110360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb0108b10 0x7fcfb01108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfaffff640 1 -- 172.21.15.33:0/1608421949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb01081c0 msgr2=0x7fcfb0110360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfaffff640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb01081c0 0x7fcfb0110360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfaffff640 1 -- 172.21.15.33:0/1608421949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb0108b10 msgr2=0x7fcfb01108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfaffff640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb0108b10 0x7fcfb01108a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.349+0000 7fcfaffff640 1 -- 172.21.15.33:0/1608421949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb01a84d0 con 0x7fcfb0102880 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.350+0000 7fcfaffff640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb0102880 0x7fcfb010fe20 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000c920 tx=0x7fcfa000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.350+0000 7fcfad7fa640 1 -- 172.21.15.33:0/1608421949 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0007c70 con 0x7fcfb0102880 2024-08-28T19:38:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.350+0000 7fcfad7fa640 1 -- 172.21.15.33:0/1608421949 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa0007e10 con 0x7fcfb0102880 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.350+0000 7fcfb643f640 1 -- 172.21.15.33:0/1608421949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb01a87c0 con 0x7fcfb0102880 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.350+0000 7fcfad7fa640 1 -- 172.21.15.33:0/1608421949 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0018820 con 0x7fcfb0102880 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.350+0000 7fcfb643f640 1 -- 172.21.15.33:0/1608421949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb01a8d00 con 0x7fcfb0102880 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.352+0000 7fcfbc9b4740 1 Processor -- start 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfbc9b4740 1 -- start start 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfad7fa640 1 -- 172.21.15.33:0/1608421949 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcfa000f450 con 0x7fcfb0102880 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e658216310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e481b0 0x55e658216850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e50390 0x55e658216d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e65818d680 con 0x55e657e71070 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e65817cc10 con 0x55e657e481b0 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e658180bc0 con 0x55e657e50390 2024-08-28T19:38:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfb49dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e658216310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfb49dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e658216310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53294/0 (socket says 172.21.15.33:53294) 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfb49dc640 1 -- 172.21.15.33:0/1175251380 learned_addr learned my addr 172.21.15.33:0/1175251380 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/1175251380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e50390 0x55e658216d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfaffff640 1 --2- 172.21.15.33:0/1175251380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e481b0 0x55e658216850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfb49dc640 1 -- 172.21.15.33:0/1175251380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e50390 msgr2=0x55e658216d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/1175251380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e50390 0x55e658216d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfb49dc640 1 -- 172.21.15.33:0/1175251380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e481b0 msgr2=0x55e658216850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/1175251380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e481b0 0x55e658216850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfb49dc640 1 -- 172.21.15.33:0/1175251380 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e657edc650 con 0x55e657e71070 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.353+0000 7fcfaffff640 1 --2- 172.21.15.33:0/1175251380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e481b0 0x55e658216850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.354+0000 7fcfad7fa640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf980b4ca0 0x7fcf980b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.354+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/1175251380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e658216310 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fcfa802f4c0 tx=0x7fcfa8031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a5a0e28335c76c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:41.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.354+0000 7fcfaffff640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf980b4ca0 0x7fcf980b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.354+0000 7fcf967fc640 1 -- 172.21.15.33:0/1175251380 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8031450 con 0x55e657e71070 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.354+0000 7fcfad7fa640 1 -- 172.21.15.33:0/1608421949 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcfa00e5940 con 0x7fcfb0102880 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.354+0000 7fcf967fc640 1 -- 172.21.15.33:0/1175251380 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa8036030 con 0x55e657e71070 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.354+0000 7fcf967fc640 1 -- 172.21.15.33:0/1175251380 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80043c0 con 0x55e657e71070 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/1175251380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 msgr2=0x55e658216310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfaffff640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf980b4ca0 0x7fcf980b71b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00e2df0 tx=0x7fcfa00e7040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/1175251380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e658216310 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fcfa802f4c0 tx=0x7fcfa8031af0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/1175251380 shutdown_connections 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/1175251380 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e50390 0x55e658216d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/1175251380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e481b0 0x55e658216850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/1175251380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e658216310 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/1175251380 >> 172.21.15.33:0/1175251380 conn(0x55e657e65460 msgr2=0x55e658214200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/1175251380 shutdown_connections 2024-08-28T19:38:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/1175251380 wait complete. 2024-08-28T19:38:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.355+0000 7fcfbc9b4740 1 -- start start 2024-08-28T19:38:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfbc9b4740 1 Processor -- start 2024-08-28T19:38:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 0x55e658221ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e50390 0x55e658221ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 0x55e65822dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e657fdf700 con 0x55e657e50390 2024-08-28T19:38:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e658103750 con 0x55e657e71070 2024-08-28T19:38:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e658224910 con 0x55e657e481b0 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfbc9b4740 10 client.0 _ll_register_callbacks cb 0x55e658132e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfaf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e50390 0x55e658221ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfaf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e50390 0x55e658221ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53308/0 (socket says 172.21.15.33:53308) 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfaf7fe640 1 -- 172.21.15.33:0/2911601659 learned_addr learned my addr 172.21.15.33:0/2911601659 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 0x55e65822dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 0x55e658221ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfaf7fe640 1 -- 172.21.15.33:0/2911601659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 msgr2=0x55e658221ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 0x55e658221ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfaf7fe640 1 -- 172.21.15.33:0/2911601659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 msgr2=0x55e65822dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 0x55e65822dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfaf7fe640 1 -- 172.21.15.33:0/2911601659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e65813c900 con 0x55e657e50390 2024-08-28T19:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.356+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 0x55e65822dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.357+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e50390 0x55e658221ff0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4010720 tx=0x7fcfa4010be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70872d4db374b92 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.357+0000 7fcf8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.357+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/2911601659 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400fc50 con 0x55e657e50390 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.357+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/2911601659 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcfa400fdf0 con 0x55e657e50390 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.357+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/2911601659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfa8036030 con 0x55e657e50390 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.357+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/2911601659 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcfa4024050 con 0x55e657e50390 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.357+0000 7fcfbc9b4740 10 client.17388 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.357+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/2911601659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e658230730 con 0x55e657e50390 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.357+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/2911601659 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa8036030 con 0x55e657e50390 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.358+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/2911601659 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcfa400e5e0 con 0x55e657e50390 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.358+0000 7fcfbc9b4740 10 client.17388 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.358+0000 7fcfbc9b4740 10 client.17388 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.358+0000 7fcfbc9b4740 20 client.17388 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.358+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e657e2f9f0 0x55e658233cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.358+0000 7fcfbc9b4740 4 client.17388 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.358+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/2911601659 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e65818f5d0 con 0x55e657e2f9f0 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.358+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e657e2f9f0 0x55e658233cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.359+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e657e2f9f0 0x55e658233cd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=267c7b62531f7b1a server_cookie=1417d399002acb7d in_seq=0 out_seq=0 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.359+0000 7fcf8f7fe640 10 client.17388 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.359+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/2911601659 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e65818f5d0 con 0x55e657e2f9f0 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.359+0000 7fcf8f7fe640 10 client.17388 handle_command_reply: tid=0 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.359+0000 7fcfbc9b4740 1 client.17388 shutdown 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/2911601659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e50390 msgr2=0x55e658221ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e50390 0x55e658221ff0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4010720 tx=0x7fcfa4010be0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/2911601659 shutdown_connections 2024-08-28T19:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e657e2f9f0 0x55e658233cd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 0x55e65822dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e50390 0x55e658221ff0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/2911601659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 0x55e658221ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/2911601659 >> 172.21.15.33:0/2911601659 conn(0x55e657e65460 msgr2=0x55e6582194f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcf8f7fe640 0 client.17388 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/2911601659 shutdown_connections 2024-08-28T19:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/2911601659 wait complete. 2024-08-28T19:38:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.360+0000 7fcfbc9b4740 20 client.17388 trim_cache size 0 max 16384 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfbc9b4740 1 Processor -- start 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfbc9b4740 1 -- start start 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e481b0 0x55e658219b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 0x55e65822db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e04da0 0x55e65822e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb01b2c00 con 0x55e657e481b0 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb01b4740 con 0x55e657e71070 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb01b32d0 con 0x55e657e04da0 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfb49dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e481b0 0x55e658219b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfb49dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e481b0 0x55e658219b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53322/0 (socket says 172.21.15.33:53322) 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfb49dc640 1 -- 172.21.15.33:0/779646118 learned_addr learned my addr 172.21.15.33:0/779646118 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/779646118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 0x55e65822db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/779646118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e04da0 0x55e65822e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfb49dc640 1 -- 172.21.15.33:0/779646118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e04da0 msgr2=0x55e65822e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/779646118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e04da0 0x55e65822e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfb49dc640 1 -- 172.21.15.33:0/779646118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 msgr2=0x55e65822db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.374+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/779646118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 0x55e65822db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.375+0000 7fcfb49dc640 1 -- 172.21.15.33:0/779646118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e657e2fc20 con 0x55e657e481b0 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.375+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/779646118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 0x55e65822db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.375+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/779646118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e481b0 0x55e658219b20 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009dc0 tx=0x7fcfa8031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1311fdf2b8271675 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.375+0000 7fcf95ffb640 1 -- 172.21.15.33:0/779646118 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8031450 con 0x55e657e481b0 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.375+0000 7fcf95ffb640 1 -- 172.21.15.33:0/779646118 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa8036070 con 0x55e657e481b0 2024-08-28T19:38:41.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.375+0000 7fcf95ffb640 1 -- 172.21.15.33:0/779646118 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa802f5c0 con 0x55e657e481b0 2024-08-28T19:38:41.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.376+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/779646118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e481b0 msgr2=0x55e658219b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:41.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.376+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/779646118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e481b0 0x55e658219b20 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009dc0 tx=0x7fcfa8031af0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.376+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/779646118 shutdown_connections 2024-08-28T19:38:41.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.376+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/779646118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e04da0 0x55e65822e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.376+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/779646118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e71070 0x55e65822db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.376+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/779646118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e481b0 0x55e658219b20 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.376+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/779646118 >> 172.21.15.33:0/779646118 conn(0x55e657e65460 msgr2=0x55e658219410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:41.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.376+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/779646118 shutdown_connections 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.376+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/779646118 wait complete. 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.377+0000 7fcfbc9b4740 1 -- start start 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.377+0000 7fcfbc9b4740 1 Processor -- start 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.377+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e04da0 0x55e65822a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.377+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 0x55e658225ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.377+0000 7fcfbc9b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e6582261f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.377+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb01b4070 con 0x55e657e71070 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.377+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb01b39a0 con 0x55e657e04da0 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.377+0000 7fcfbc9b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb01b0be0 con 0x55e657e481b0 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.377+0000 7fcfbc9b4740 10 client.0 _ll_register_callbacks cb 0x7fcfa400a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.377+0000 7fcfb49dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e6582261f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcfb49dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e6582261f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53324/0 (socket says 172.21.15.33:53324) 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcfb49dc640 1 -- 172.21.15.33:0/3507793579 learned_addr learned my addr 172.21.15.33:0/3507793579 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 0x55e658225ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e04da0 0x55e65822a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcfaf7fe640 1 -- 172.21.15.33:0/3507793579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e04da0 msgr2=0x55e65822a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e04da0 0x55e65822a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcfaf7fe640 1 -- 172.21.15.33:0/3507793579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 msgr2=0x55e6582261f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e6582261f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcfaf7fe640 1 -- 172.21.15.33:0/3507793579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e65829d670 con 0x55e657e481b0 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcfaf7fe640 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 0x55e658225ae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009000 tx=0x7fcfa400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2734d5b55ea210d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcf8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.378+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/3507793579 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa402c020 con 0x55e657e481b0 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/3507793579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfa8036070 con 0x55e657e481b0 2024-08-28T19:38:41.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/3507793579 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7fcfa400e3b0 con 0x55e657e481b0 2024-08-28T19:38:41.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/3507793579 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcfa4034050 con 0x55e657e481b0 2024-08-28T19:38:41.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcfbc9b4740 10 client.26572 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:41.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/3507793579 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e65829e7f0 con 0x55e657e481b0 2024-08-28T19:38:41.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/3507793579 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa8036070 con 0x55e657e481b0 2024-08-28T19:38:41.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/3507793579 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcfa4004660 con 0x55e657e481b0 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcfbc9b4740 10 client.26572 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcfbc9b4740 10 client.26572 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcfbc9b4740 20 client.26572 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e65829efc0 0x55e6582a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.379+0000 7fcfbc9b4740 4 client.26572 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.380+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/3507793579 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e65818b070 con 0x55e65829efc0 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.380+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e65829efc0 0x55e6582a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.380+0000 7fcfb49dc640 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e65829efc0 0x55e6582a13e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=736bfd099fb4bfe2 server_cookie=6c46b2fffa0a754f in_seq=0 out_seq=0 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.380+0000 7fcf8f7fe640 10 client.26572 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.380+0000 7fcf8f7fe640 1 -- 172.21.15.33:0/3507793579 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e65818b070 con 0x55e65829efc0 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.380+0000 7fcf8f7fe640 10 client.26572 handle_command_reply: tid=0 2024-08-28T19:38:41.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.380+0000 7fcfbc9b4740 1 client.26572 shutdown 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/3507793579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 msgr2=0x55e658225ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 0x55e658225ae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009000 tx=0x7fcfa400ef20 comp rx=0 tx=0).stop 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/3507793579 shutdown_connections 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e65829efc0 0x55e6582a13e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e657e71070 0x55e6582261f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e657e481b0 0x55e658225ae0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 1 --2- 172.21.15.33:0/3507793579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e657e04da0 0x55e65822a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/3507793579 >> 172.21.15.33:0/3507793579 conn(0x55e657e65460 msgr2=0x55e658220330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcf8f7fe640 0 client.26572 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/3507793579 shutdown_connections 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 1 -- 172.21.15.33:0/3507793579 wait complete. 2024-08-28T19:38:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.381+0000 7fcfbc9b4740 20 client.26572 trim_cache size 0 max 16384 2024-08-28T19:38:41.389 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 -- 172.21.15.33:0/1608421949 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf980b4ca0 msgr2=0x7fcf980b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf980b4ca0 0x7fcf980b71b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00e2df0 tx=0x7fcfa00e7040 comp rx=0 tx=0).stop 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 -- 172.21.15.33:0/1608421949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb0102880 msgr2=0x7fcfb010fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb0102880 0x7fcfb010fe20 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000c920 tx=0x7fcfa000cde0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 -- 172.21.15.33:0/1608421949 shutdown_connections 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb0108b10 0x7fcfb01108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf980b4ca0 0x7fcf980b71b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb01081c0 0x7fcfb0110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 --2- 172.21.15.33:0/1608421949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb0102880 0x7fcfb010fe20 secure :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000c920 tx=0x7fcfa000cde0 comp rx=0 tx=0).stop 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 -- 172.21.15.33:0/1608421949 >> 172.21.15.33:0/1608421949 conn(0x7fcfb0079510 msgr2=0x7fcfb01061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 -- 172.21.15.33:0/1608421949 shutdown_connections 2024-08-28T19:38:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:41.382+0000 7fcfb643f640 1 -- 172.21.15.33:0/1608421949 wait complete. 2024-08-28T19:38:41.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:41 smithi033 ceph-mon[18549]: pgmap v529: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:38:41.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:41 smithi059 ceph-mon[22052]: pgmap v529: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:38:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:41 smithi122 ceph-mon[22174]: pgmap v529: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-28T19:38:42.074 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:38:42.097 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.638+0000 7f5be8958640 1 -- 172.21.15.33:0/1002431887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be4104640 msgr2=0x7f5be4104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.638+0000 7f5be8958640 1 --2- 172.21.15.33:0/1002431887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be4104640 0x7f5be4104a50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009900 tx=0x7f5bd402a410 comp rx=0 tx=0).stop 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.638+0000 7f5be8958640 1 -- 172.21.15.33:0/1002431887 shutdown_connections 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.638+0000 7f5be8958640 1 --2- 172.21.15.33:0/1002431887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be410dbf0 0x7f5be41100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.638+0000 7f5be8958640 1 --2- 172.21.15.33:0/1002431887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be4105070 0x7f5be410d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.638+0000 7f5be8958640 1 --2- 172.21.15.33:0/1002431887 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be4104640 0x7f5be4104a50 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.638+0000 7f5be8958640 1 -- 172.21.15.33:0/1002431887 >> 172.21.15.33:0/1002431887 conn(0x7f5be40794e0 msgr2=0x7f5be40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.638+0000 7f5be8958640 1 -- 172.21.15.33:0/1002431887 shutdown_connections 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.638+0000 7f5be8958640 1 -- 172.21.15.33:0/1002431887 wait complete. 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be8958640 1 Processor -- start 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be8958640 1 -- start start 2024-08-28T19:38:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be8958640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be4104640 0x7f5be419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be8958640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be4105070 0x7f5be419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be8958640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be410dbf0 0x7f5be419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be8958640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4113830 con 0x7f5be4104640 2024-08-28T19:38:42.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be8958640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41136b0 con 0x7f5be410dbf0 2024-08-28T19:38:42.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be8958640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41139b0 con 0x7f5be4105070 2024-08-28T19:38:42.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be4104640 0x7f5be419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be4104640 0x7f5be419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53330/0 (socket says 172.21.15.33:53330) 2024-08-28T19:38:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.639+0000 7f5be259c640 1 -- 172.21.15.33:0/953481662 learned_addr learned my addr 172.21.15.33:0/953481662 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be2d9d640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be410dbf0 0x7f5be419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be4105070 0x7f5be419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be259c640 1 -- 172.21.15.33:0/953481662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be4105070 msgr2=0x7f5be419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be259c640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be4105070 0x7f5be419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be259c640 1 -- 172.21.15.33:0/953481662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be410dbf0 msgr2=0x7f5be419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be259c640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be410dbf0 0x7f5be419fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be259c640 1 -- 172.21.15.33:0/953481662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be41a01f0 con 0x7f5be4104640 2024-08-28T19:38:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be4105070 0x7f5be419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:42.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be259c640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be4104640 0x7f5be419a280 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4032fd0 tx=0x7f5bd4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5bd37fe640 1 -- 172.21.15.33:0/953481662 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd403f030 con 0x7f5be4104640 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be8958640 1 -- 172.21.15.33:0/953481662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be41a0480 con 0x7f5be4104640 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5bd37fe640 1 -- 172.21.15.33:0/953481662 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd4004490 con 0x7f5be4104640 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5bd37fe640 1 -- 172.21.15.33:0/953481662 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4035070 con 0x7f5be4104640 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.640+0000 7f5be8958640 1 -- 172.21.15.33:0/953481662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be41a6c40 con 0x7f5be4104640 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.643+0000 7f5beeecd740 1 Processor -- start 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.643+0000 7f5bd37fe640 1 -- 172.21.15.33:0/953481662 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5bd4042030 con 0x7f5be4104640 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.643+0000 7f5beeecd740 1 -- start start 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.643+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df4b520 0x55671e2f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.643+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df22660 0x55671e2f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.643+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2f1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5beeecd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55671e267a70 con 0x55671df4b520 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5beeecd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55671e257000 con 0x55671df22660 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5beeecd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55671e25afb0 con 0x55671df2a840 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df4b520 0x55671e2f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df4b520 0x55671e2f0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53336/0 (socket says 172.21.15.33:53336) 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be2d9d640 1 -- 172.21.15.33:0/3946986405 learned_addr learned my addr 172.21.15.33:0/3946986405 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be259c640 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df22660 0x55671e2f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be2d9d640 1 -- 172.21.15.33:0/3946986405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 msgr2=0x55671e2f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be2d9d640 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5bd37fe640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5bcc0b4d20 0x7f5bcc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be2d9d640 1 -- 172.21.15.33:0/3946986405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df22660 msgr2=0x55671e2f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be2d9d640 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df22660 0x55671e2f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be2d9d640 1 -- 172.21.15.33:0/3946986405 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671dfb6b00 con 0x55671df4b520 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be259c640 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df22660 0x55671e2f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be2d9d640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5bcc0b4d20 0x7f5bcc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5bd37fe640 1 -- 172.21.15.33:0/953481662 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5bd4105cf0 con 0x7f5be4104640 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.644+0000 7f5be2d9d640 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df4b520 0x55671e2f0c80 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009f70 tx=0x7f5bdc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6837c296aa5b1d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.645+0000 7f5bd0ff9640 1 -- 172.21.15.33:0/3946986405 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc022070 con 0x55671df4b520 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.645+0000 7f5bd0ff9640 1 -- 172.21.15.33:0/3946986405 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bdc0113e0 con 0x55671df4b520 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.645+0000 7f5bd0ff9640 1 -- 172.21.15.33:0/3946986405 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc016070 con 0x55671df4b520 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 -- 172.21.15.33:0/3946986405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df4b520 msgr2=0x55671e2f0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df4b520 0x55671e2f0c80 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009f70 tx=0x7f5bdc010800 comp rx=0 tx=0).stop 2024-08-28T19:38:42.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5be2d9d640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5bcc0b4d20 0x7f5bcc0b7230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc01f000 tx=0x7f5bdc022000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 -- 172.21.15.33:0/3946986405 shutdown_connections 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df22660 0x55671e2f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 --2- 172.21.15.33:0/3946986405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df4b520 0x55671e2f0c80 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 -- 172.21.15.33:0/3946986405 >> 172.21.15.33:0/3946986405 conn(0x55671df3f910 msgr2=0x55671e2eeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 -- 172.21.15.33:0/3946986405 shutdown_connections 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 -- 172.21.15.33:0/3946986405 wait complete. 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 -- start start 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 Processor -- start 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2fc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.646+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e3088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5beeecd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55671e2ff460 con 0x55671df22660 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5beeecd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55671e218520 con 0x55671df4b520 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5beeecd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55671e2ff5e0 con 0x55671df2a840 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5beeecd740 10 client.0 _ll_register_callbacks cb 0x55671e250c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2fc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2fc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53340/0 (socket says 172.21.15.33:53340) 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be259c640 1 -- 172.21.15.33:0/487520922 learned_addr learned my addr 172.21.15.33:0/487520922 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be2d9d640 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e3088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be259c640 1 -- 172.21.15.33:0/487520922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 msgr2=0x55671e2fcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be259c640 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2fcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be259c640 1 -- 172.21.15.33:0/487520922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 msgr2=0x55671e3088d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be259c640 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e3088d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be259c640 1 -- 172.21.15.33:0/487520922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55671e02d960 con 0x55671df22660 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5be259c640 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2fc890 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4031440 tx=0x7f5bd4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452793373dc7006e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5bc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/487520922 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40f0070 con 0x55671df22660 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/487520922 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5bd40c8320 con 0x55671df22660 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.647+0000 7f5beeecd740 1 -- 172.21.15.33:0/487520922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55671e1f69a0 con 0x55671df22660 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/487520922 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5bd4049070 con 0x55671df22660 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5beeecd740 10 client.17406 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5beeecd740 1 -- 172.21.15.33:0/487520922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55671e30b4e0 con 0x55671df22660 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/487520922 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55671e1f69a0 con 0x55671df22660 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/487520922 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5bd403bc20 con 0x55671df22660 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5beeecd740 10 client.17406 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:42.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5beeecd740 10 client.17406 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:38:42.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5beeecd740 20 client.17406 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:42.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5beeecd740 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55671df09ea0 0x55671e30e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5beeecd740 4 client.17406 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:42.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5beeecd740 1 -- 172.21.15.33:0/487520922 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55671e2699c0 con 0x55671df09ea0 2024-08-28T19:38:42.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.648+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55671df09ea0 0x55671e30e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.649+0000 7f5bc9ffb640 10 client.17406 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:42.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.649+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55671df09ea0 0x55671e30e940 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e62ee5cc892ce4b server_cookie=43cb5a10a7dfc668 in_seq=0 out_seq=0 2024-08-28T19:38:42.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/487520922 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55671e2699c0 con 0x55671df09ea0 2024-08-28T19:38:42.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5bc9ffb640 10 client.17406 handle_command_reply: tid=0 2024-08-28T19:38:42.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5beeecd740 1 client.17406 shutdown 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5beeecd740 1 -- 172.21.15.33:0/487520922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 msgr2=0x55671e2fc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5beeecd740 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2fc890 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4031440 tx=0x7f5bd4009260 comp rx=0 tx=0).stop 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5beeecd740 1 -- 172.21.15.33:0/487520922 shutdown_connections 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5beeecd740 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e3088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5beeecd740 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5beeecd740 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55671df09ea0 0x55671e30e940 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5beeecd740 1 --2- 172.21.15.33:0/487520922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2fc890 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.650+0000 7f5beeecd740 1 -- 172.21.15.33:0/487520922 >> 172.21.15.33:0/487520922 conn(0x55671df3f910 msgr2=0x55671e2f3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.651+0000 7f5bc9ffb640 0 client.17406 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.651+0000 7f5beeecd740 1 -- 172.21.15.33:0/487520922 shutdown_connections 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.651+0000 7f5beeecd740 1 -- 172.21.15.33:0/487520922 wait complete. 2024-08-28T19:38:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.651+0000 7f5beeecd740 20 client.17406 trim_cache size 0 max 16384 2024-08-28T19:38:42.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5beeecd740 1 Processor -- start 2024-08-28T19:38:42.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5beeecd740 1 -- start start 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2faf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2ee160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e2ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5beeecd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b0b70 con 0x55671df22660 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5beeecd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b26b0 con 0x55671df4b520 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5beeecd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b1240 con 0x55671df2a840 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5be259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2faf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5be259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2faf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53342/0 (socket says 172.21.15.33:53342) 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5be259c640 1 -- 172.21.15.33:0/3889088012 learned_addr learned my addr 172.21.15.33:0/3889088012 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/3889088012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.669+0000 7f5be2d9d640 1 --2- 172.21.15.33:0/3889088012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e2ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.670+0000 7f5be259c640 1 -- 172.21.15.33:0/3889088012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 msgr2=0x55671e2ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:42.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.670+0000 7f5be259c640 1 --2- 172.21.15.33:0/3889088012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2ee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.670+0000 7f5be259c640 1 -- 172.21.15.33:0/3889088012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 msgr2=0x55671e2ee6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:42.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.670+0000 7f5be259c640 1 --2- 172.21.15.33:0/3889088012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e2ee6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.670+0000 7f5be259c640 1 -- 172.21.15.33:0/3889088012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671e2f7f20 con 0x55671df22660 2024-08-28T19:38:42.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.670+0000 7f5be259c640 1 --2- 172.21.15.33:0/3889088012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2faf10 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f5bd41036f0 tx=0x7f5bd40cbee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86068abc16e4e51 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:42.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.670+0000 7f5bcbfff640 1 -- 172.21.15.33:0/3889088012 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40f0030 con 0x55671df22660 2024-08-28T19:38:42.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.670+0000 7f5bcbfff640 1 -- 172.21.15.33:0/3889088012 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd40cbba0 con 0x55671df22660 2024-08-28T19:38:42.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.670+0000 7f5bcbfff640 1 -- 172.21.15.33:0/3889088012 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40cc2f0 con 0x55671df22660 2024-08-28T19:38:42.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.671+0000 7f5beeecd740 1 -- 172.21.15.33:0/3889088012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 msgr2=0x55671e2faf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.671+0000 7f5beeecd740 1 --2- 172.21.15.33:0/3889088012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2faf10 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f5bd41036f0 tx=0x7f5bd40cbee0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.671+0000 7f5beeecd740 1 -- 172.21.15.33:0/3889088012 shutdown_connections 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.671+0000 7f5beeecd740 1 --2- 172.21.15.33:0/3889088012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e2ee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.671+0000 7f5beeecd740 1 --2- 172.21.15.33:0/3889088012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e2ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.671+0000 7f5beeecd740 1 --2- 172.21.15.33:0/3889088012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e2faf10 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.671+0000 7f5beeecd740 1 -- 172.21.15.33:0/3889088012 >> 172.21.15.33:0/3889088012 conn(0x55671df3f910 msgr2=0x55671e2fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.671+0000 7f5beeecd740 1 -- 172.21.15.33:0/3889088012 shutdown_connections 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.671+0000 7f5beeecd740 1 -- 172.21.15.33:0/3889088012 wait complete. 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.672+0000 7f5beeecd740 1 -- start start 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.672+0000 7f5beeecd740 1 Processor -- start 2024-08-28T19:38:42.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.672+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e301240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.672+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e3017e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.672+0000 7f5beeecd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e372380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.672+0000 7f5beeecd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b1fe0 con 0x55671df22660 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.672+0000 7f5beeecd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b1910 con 0x55671df4b520 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.672+0000 7f5beeecd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41aeb50 con 0x55671df2a840 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.672+0000 7f5be259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e301240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5beeecd740 10 client.0 _ll_register_callbacks cb 0x7f5bd4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e301240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53354/0 (socket says 172.21.15.33:53354) 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be259c640 1 -- 172.21.15.33:0/2330632401 learned_addr learned my addr 172.21.15.33:0/2330632401 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e3017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be2d9d640 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e372380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be259c640 1 -- 172.21.15.33:0/2330632401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 msgr2=0x55671e3017e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be259c640 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e3017e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be259c640 1 -- 172.21.15.33:0/2330632401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 msgr2=0x55671e372380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be259c640 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e372380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be259c640 1 -- 172.21.15.33:0/2330632401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55671e3729f0 con 0x55671df22660 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be2d9d640 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e372380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5be259c640 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e301240 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40cbd90 tx=0x7f5bd4009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e1aa190f48aa7e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5bc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/2330632401 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40f0020 con 0x55671df22660 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/2330632401 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5bd40d5130 con 0x55671df22660 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.673+0000 7f5beeecd740 1 -- 172.21.15.33:0/2330632401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd40cbba0 con 0x55671df22660 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/2330632401 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5bd40d0930 con 0x55671df22660 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5beeecd740 10 client.17412 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5beeecd740 1 -- 172.21.15.33:0/2330632401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55671e3729f0 con 0x55671df22660 2024-08-28T19:38:42.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/2330632401 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd40cbba0 con 0x55671df22660 2024-08-28T19:38:42.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/2330632401 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5bd40cad60 con 0x55671df22660 2024-08-28T19:38:42.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5beeecd740 10 client.17412 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:42.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5beeecd740 10 client.17412 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:38:42.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5beeecd740 20 client.17412 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:42.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5beeecd740 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55671dedf250 0x55671e37c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:42.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5beeecd740 4 client.17412 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6e2f1042", "release": true, "await": true}] 2024-08-28T19:38:42.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.674+0000 7f5beeecd740 1 -- 172.21.15.33:0/2330632401 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6e2f1042", "release": true, "await": true}) -- 0x55671e265460 con 0x55671dedf250 2024-08-28T19:38:42.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.675+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55671dedf250 0x55671e37c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:42.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.675+0000 7f5bc9ffb640 10 client.17412 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:42.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.675+0000 7f5be1d9b640 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55671dedf250 0x55671e37c180 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e32dda38a1efb8ff server_cookie=9e57137ed4280dac in_seq=0 out_seq=0 2024-08-28T19:38:42.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.679+0000 7f5bc9ffb640 1 -- 172.21.15.33:0/2330632401 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55671e265460 con 0x55671dedf250 2024-08-28T19:38:42.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.679+0000 7f5bc9ffb640 10 client.17412 handle_command_reply: tid=0 2024-08-28T19:38:42.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.679+0000 7f5beeecd740 1 client.17412 shutdown 2024-08-28T19:38:42.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.679+0000 7f5beeecd740 1 -- 172.21.15.33:0/2330632401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 msgr2=0x55671e301240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:42.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.679+0000 7f5beeecd740 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e301240 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40cbd90 tx=0x7f5bd4009650 comp rx=0 tx=0).stop 2024-08-28T19:38:42.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.680+0000 7f5beeecd740 1 -- 172.21.15.33:0/2330632401 shutdown_connections 2024-08-28T19:38:42.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.680+0000 7f5beeecd740 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55671df4b520 0x55671e372380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.680+0000 7f5beeecd740 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55671df2a840 0x55671e3017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.680+0000 7f5beeecd740 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55671dedf250 0x55671e37c180 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.680+0000 7f5beeecd740 1 --2- 172.21.15.33:0/2330632401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55671df22660 0x55671e301240 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.680+0000 7f5bc9ffb640 0 client.17412 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:42.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.680+0000 7f5beeecd740 1 -- 172.21.15.33:0/2330632401 >> 172.21.15.33:0/2330632401 conn(0x55671df3f910 msgr2=0x55671e2fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:42.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.680+0000 7f5beeecd740 1 -- 172.21.15.33:0/2330632401 shutdown_connections 2024-08-28T19:38:42.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.680+0000 7f5beeecd740 1 -- 172.21.15.33:0/2330632401 wait complete. 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.680+0000 7f5beeecd740 20 client.17412 trim_cache size 0 max 16384 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 20, 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stdout: "6e2f1042": { 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 20, 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:38:42.683 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:42.684 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:42.685 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:42.685 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:38:42.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 -- 172.21.15.33:0/953481662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5bcc0b4d20 msgr2=0x7f5bcc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:42.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5bcc0b4d20 0x7f5bcc0b7230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc01f000 tx=0x7f5bdc022000 comp rx=0 tx=0).stop 2024-08-28T19:38:42.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 -- 172.21.15.33:0/953481662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be4104640 msgr2=0x7f5be419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:42.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be4104640 0x7f5be419a280 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4032fd0 tx=0x7f5bd4004270 comp rx=0 tx=0).stop 2024-08-28T19:38:42.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 -- 172.21.15.33:0/953481662 shutdown_connections 2024-08-28T19:38:42.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be410dbf0 0x7f5be419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5bcc0b4d20 0x7f5bcc0b7230 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5be4105070 0x7f5be419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 --2- 172.21.15.33:0/953481662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be4104640 0x7f5be419a280 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:42.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 -- 172.21.15.33:0/953481662 >> 172.21.15.33:0/953481662 conn(0x7f5be40794e0 msgr2=0x7f5be40ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:42.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 -- 172.21.15.33:0/953481662 shutdown_connections 2024-08-28T19:38:42.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:42.681+0000 7f5be8958640 1 -- 172.21.15.33:0/953481662 wait complete. 2024-08-28T19:38:42.696 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:43.385 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6e2f1042', total seconds elapsed: 34.5 2024-08-28T19:38:43.565 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:43 smithi033 ceph-mon[18549]: pgmap v530: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:38:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:43 smithi059 ceph-mon[22052]: pgmap v530: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:38:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:43 smithi122 ceph-mon[22174]: pgmap v530: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-28T19:38:43.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.928+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3355472539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a04102820 msgr2=0x7f8a04102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.928+0000 7f8a08d4b640 1 --2- 172.21.15.33:0/3355472539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a04102820 0x7f8a04102c30 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009900 tx=0x7f89f402a410 comp rx=0 tx=0).stop 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.929+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3355472539 shutdown_connections 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.929+0000 7f8a08d4b640 1 --2- 172.21.15.33:0/3355472539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a04108ab0 0x7f8a0410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.929+0000 7f8a08d4b640 1 --2- 172.21.15.33:0/3355472539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a04108160 0x7f8a04108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.929+0000 7f8a08d4b640 1 --2- 172.21.15.33:0/3355472539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a04102820 0x7f8a04102c30 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.929+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3355472539 >> 172.21.15.33:0/3355472539 conn(0x7f8a040794e0 msgr2=0x7f8a040798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.929+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3355472539 shutdown_connections 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.929+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3355472539 wait complete. 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.929+0000 7f8a08d4b640 1 Processor -- start 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a08d4b640 1 -- start start 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a08d4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a04102820 0x7f8a0419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a08d4b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a04108160 0x7f8a0419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a08d4b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a04108ab0 0x7f8a0419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a08d4b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8a04112730 con 0x7f8a04108ab0 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a08d4b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a041125b0 con 0x7f8a04108160 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a08d4b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a041128b0 con 0x7f8a04102820 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a02d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a04108ab0 0x7f8a0419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a02d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a04108ab0 0x7f8a0419fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53374/0 (socket says 172.21.15.33:53374) 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a02d9d640 1 -- 172.21.15.33:0/3561481245 learned_addr learned my addr 172.21.15.33:0/3561481245 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a0259c640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a04102820 0x7f8a0419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a04108160 0x7f8a0419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a02d9d640 1 -- 172.21.15.33:0/3561481245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a04102820 msgr2=0x7f8a0419a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a02d9d640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a04102820 0x7f8a0419a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a02d9d640 1 -- 172.21.15.33:0/3561481245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a04108160 msgr2=0x7f8a0419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a02d9d640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a04108160 0x7f8a0419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a02d9d640 1 -- 172.21.15.33:0/3561481245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a041a01a0 con 0x7f8a04108ab0 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.930+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a04108160 0x7f8a0419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.931+0000 7f8a02d9d640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a04108ab0 0x7f8a0419fa70 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00eaa0 tx=0x7f89fc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.931+0000 7f89f37fe640 1 -- 172.21.15.33:0/3561481245 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00cdb0 con 0x7f8a04108ab0 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.931+0000 7f89f37fe640 1 -- 172.21.15.33:0/3561481245 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89fc005020 con 0x7f8a04108ab0 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.931+0000 7f89f37fe640 1 -- 172.21.15.33:0/3561481245 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0116d0 con 0x7f8a04108ab0 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.931+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3561481245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a041a0490 con 0x7f8a04108ab0 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.931+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3561481245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a041a6bf0 con 0x7f8a04108ab0 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.933+0000 7f8a0f2c0740 1 Processor -- start 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.933+0000 7f89f37fe640 1 -- 172.21.15.33:0/3561481245 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f89fc0051d0 con 0x7f8a04108ab0 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a0f2c0740 1 -- start start 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603361070 0x560603706350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5606033381b0 0x560603706890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560603340390 0x560603706dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56060367d680 con 0x560603361070 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56060366cc10 con 0x5606033381b0 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560603670bc0 con 0x560603340390 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a01d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603361070 0x560603706350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a01d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603361070 0x560603706350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53386/0 (socket says 172.21.15.33:53386) 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a01d9b640 1 -- 172.21.15.33:0/1306695316 learned_addr learned my addr 172.21.15.33:0/1306695316 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f89f37fe640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89ec0b4ca0 0x7f89ec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a0259c640 1 --2- 172.21.15.33:0/1306695316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5606033381b0 0x560603706890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a02d9d640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89ec0b4ca0 0x7f89ec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a01d9b640 1 -- 172.21.15.33:0/1306695316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560603340390 msgr2=0x560603706dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/1306695316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560603340390 0x560603706dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a01d9b640 1 -- 172.21.15.33:0/1306695316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5606033381b0 msgr2=0x560603706890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/1306695316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5606033381b0 0x560603706890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.934+0000 7f8a01d9b640 1 -- 172.21.15.33:0/1306695316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606033cc650 con 0x560603361070 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.935+0000 7f89f37fe640 1 -- 172.21.15.33:0/3561481245 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f89fc0e5a90 con 0x7f8a04108ab0 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.935+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/1306695316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603361070 0x560603706350 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f89f800bda0 tx=0x7f89f8011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae428c426d3d7bb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.935+0000 7f8a02d9d640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89ec0b4ca0 0x7f89ec0b71b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009270 tx=0x7f89fc070c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.935+0000 7f89f0ff9640 1 -- 172.21.15.33:0/1306695316 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8011e60 con 0x560603361070 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.935+0000 7f89f0ff9640 1 -- 172.21.15.33:0/1306695316 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f80047a0 con 0x560603361070 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.935+0000 7f89f0ff9640 1 -- 172.21.15.33:0/1306695316 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8012650 con 0x560603361070 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.936+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1306695316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603361070 msgr2=0x560603706350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.936+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/1306695316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603361070 0x560603706350 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f89f800bda0 tx=0x7f89f8011750 comp rx=0 tx=0).stop 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.936+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1306695316 shutdown_connections 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.936+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/1306695316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560603340390 0x560603706dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.936+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/1306695316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5606033381b0 0x560603706890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.936+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/1306695316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603361070 0x560603706350 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.936+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1306695316 >> 172.21.15.33:0/1306695316 conn(0x560603355460 msgr2=0x560603704240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.936+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1306695316 shutdown_connections 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.936+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1306695316 wait complete. 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.936+0000 7f8a0f2c0740 1 -- start start 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0f2c0740 1 Processor -- start 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 0x560603711b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603340390 0x560603712070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603361070 0x56060371de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5606034cf700 con 0x560603340390 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5606035f3750 con 0x560603361070 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560603714b30 con 0x5606033381b0 2024-08-28T19:38:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603340390 0x560603712070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0f2c0740 10 client.0 _ll_register_callbacks cb 0x560603622e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603340390 0x560603712070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53402/0 (socket says 172.21.15.33:53402) 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0259c640 1 -- 172.21.15.33:0/1601400274 learned_addr learned my addr 172.21.15.33:0/1601400274 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603361070 0x56060371de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 0x560603711b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0259c640 1 -- 172.21.15.33:0/1601400274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 msgr2=0x560603711b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0259c640 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 0x560603711b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0259c640 1 -- 172.21.15.33:0/1601400274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603361070 msgr2=0x56060371de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0259c640 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603361070 0x56060371de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.937+0000 7f8a0259c640 1 -- 172.21.15.33:0/1601400274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56060362c900 con 0x560603340390 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f8a0259c640 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603340390 0x560603712070 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f89f402a930 tx=0x7f89f40316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb93fec45429f615 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f89e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f89e9ffb640 1 -- 172.21.15.33:0/1601400274 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4035040 con 0x560603340390 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1601400274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89f80047a0 con 0x560603340390 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f89e9ffb640 1 -- 172.21.15.33:0/1601400274 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f89f4004040 con 0x560603340390 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f89e9ffb640 1 -- 172.21.15.33:0/1601400274 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89f404f050 con 0x560603340390 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f8a0f2c0740 10 client.17424 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1601400274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560603720930 con 0x560603340390 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f89e9ffb640 1 -- 172.21.15.33:0/1601400274 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f80047a0 con 0x560603340390 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f89e9ffb640 1 -- 172.21.15.33:0/1601400274 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f89f4004750 con 0x560603340390 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f8a0f2c0740 10 client.17424 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f8a0f2c0740 10 client.17424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f8a0f2c0740 20 client.17424 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.938+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56060331f9f0 0x560603723ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.939+0000 7f8a0f2c0740 4 client.17424 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.939+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1601400274 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56060367f5d0 con 0x56060331f9f0 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.939+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56060331f9f0 0x560603723ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.939+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56060331f9f0 0x560603723ec0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9054a2c487c3f9e4 server_cookie=52d93c8e1cc986a0 in_seq=0 out_seq=0 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.939+0000 7f89e9ffb640 10 client.17424 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f89e9ffb640 1 -- 172.21.15.33:0/1601400274 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56060367f5d0 con 0x56060331f9f0 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f89e9ffb640 10 client.17424 handle_command_reply: tid=0 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 client.17424 shutdown 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1601400274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603340390 msgr2=0x560603712070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603340390 0x560603712070 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f89f402a930 tx=0x7f89f40316d0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1601400274 shutdown_connections 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603361070 0x56060371de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56060331f9f0 0x560603723ec0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f89e9ffb640 0 client.17424 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560603340390 0x560603712070 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/1601400274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 0x560603711b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1601400274 >> 172.21.15.33:0/1601400274 conn(0x560603355460 msgr2=0x560603709530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:43.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1601400274 shutdown_connections 2024-08-28T19:38:43.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/1601400274 wait complete. 2024-08-28T19:38:43.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.940+0000 7f8a0f2c0740 20 client.17424 trim_cache size 0 max 16384 2024-08-28T19:38:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0f2c0740 1 Processor -- start 2024-08-28T19:38:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0f2c0740 1 -- start start 2024-08-28T19:38:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56060331f9f0 0x5606037042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5606033381b0 0x56060371dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603340390 0x56060371e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8a041b0a70 con 0x5606033381b0 2024-08-28T19:38:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a041b25b0 con 0x560603340390 2024-08-28T19:38:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a041b1140 con 0x56060331f9f0 2024-08-28T19:38:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5606033381b0 0x56060371dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5606033381b0 0x56060371dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53408/0 (socket says 172.21.15.33:53408) 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a0259c640 1 -- 172.21.15.33:0/3719803592 learned_addr learned my addr 172.21.15.33:0/3719803592 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.954+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/3719803592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603340390 0x56060371e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.955+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/3719803592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56060331f9f0 0x5606037042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.955+0000 7f8a0259c640 1 -- 172.21.15.33:0/3719803592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56060331f9f0 msgr2=0x5606037042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.955+0000 7f8a0259c640 1 --2- 172.21.15.33:0/3719803592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56060331f9f0 0x5606037042b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.955+0000 7f8a0259c640 1 -- 172.21.15.33:0/3719803592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603340390 msgr2=0x56060371e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.955+0000 7f8a0259c640 1 --2- 172.21.15.33:0/3719803592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603340390 0x56060371e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.955+0000 7f8a0259c640 1 -- 172.21.15.33:0/3719803592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560603708640 con 0x5606033381b0 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.955+0000 7f8a0259c640 1 --2- 172.21.15.33:0/3719803592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5606033381b0 0x56060371dd20 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f89f4000c00 tx=0x7f89f4032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e80f21ded42592 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.955+0000 7f89ebfff640 1 -- 172.21.15.33:0/3719803592 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4035030 con 0x5606033381b0 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.955+0000 7f89ebfff640 1 -- 172.21.15.33:0/3719803592 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f4031740 con 0x5606033381b0 2024-08-28T19:38:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.955+0000 7f89ebfff640 1 -- 172.21.15.33:0/3719803592 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4005610 con 0x5606033381b0 2024-08-28T19:38:43.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/3719803592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5606033381b0 msgr2=0x56060371dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/3719803592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5606033381b0 0x56060371dd20 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f89f4000c00 tx=0x7f89f4032f00 comp rx=0 tx=0).stop 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/3719803592 shutdown_connections 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/3719803592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603340390 0x56060371e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/3719803592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5606033381b0 0x56060371dd20 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/3719803592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56060331f9f0 0x5606037042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/3719803592 >> 172.21.15.33:0/3719803592 conn(0x560603355460 msgr2=0x560603703ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/3719803592 shutdown_connections 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/3719803592 wait complete. 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 -- start start 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.956+0000 7f8a0f2c0740 1 Processor -- start 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56060331f9f0 0x56060371a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 0x560603715c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a0f2c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603340390 0x560603716340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8a041b1ee0 con 0x56060331f9f0 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a041b1810 con 0x560603340390 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a0f2c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8a041aea50 con 0x5606033381b0 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a0f2c0740 10 client.0 _ll_register_callbacks cb 0x7f89f4005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a01d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56060331f9f0 0x56060371a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a01d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56060331f9f0 0x56060371a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53416/0 (socket says 172.21.15.33:53416) 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a01d9b640 1 -- 172.21.15.33:0/695233617 learned_addr learned my addr 172.21.15.33:0/695233617 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a0259c640 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 0x560603715c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603340390 0x560603716340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a01d9b640 1 -- 172.21.15.33:0/695233617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 msgr2=0x560603715c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 0x560603715c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a01d9b640 1 -- 172.21.15.33:0/695233617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603340390 msgr2=0x560603716340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:43.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603340390 0x560603716340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a01d9b640 1 -- 172.21.15.33:0/695233617 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56060378d8c0 con 0x56060331f9f0 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a0259c640 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 0x560603715c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f8a01d9b640 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56060331f9f0 0x56060371a730 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f89f8011cd0 tx=0x7f89f4032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a507ba8028ae1f78 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.957+0000 7f89e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f89e9ffb640 1 -- 172.21.15.33:0/695233617 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8012600 con 0x56060331f9f0 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f89e9ffb640 1 -- 172.21.15.33:0/695233617 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f89f80127a0 con 0x56060331f9f0 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/695233617 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89f4031740 con 0x56060331f9f0 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f89e9ffb640 1 -- 172.21.15.33:0/695233617 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89f80129a0 con 0x56060331f9f0 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f8a0f2c0740 10 client.17430 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/695233617 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56060378ea40 con 0x56060331f9f0 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f89e9ffb640 1 -- 172.21.15.33:0/695233617 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f4031740 con 0x56060331f9f0 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f89e9ffb640 1 -- 172.21.15.33:0/695233617 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f89f8029bd0 con 0x56060331f9f0 2024-08-28T19:38:43.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f8a0f2c0740 10 client.17430 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f8a0f2c0740 10 client.17430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f8a0f2c0740 20 client.17430 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560603361070 0x5606037910a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f8a0f2c0740 4 client.17430 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.958+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/695233617 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56060367b070 con 0x560603361070 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.959+0000 7f8a0259c640 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560603361070 0x5606037910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.959+0000 7f89e9ffb640 10 client.17430 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.959+0000 7f8a0259c640 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560603361070 0x5606037910a0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6947c5fd2911665e server_cookie=b85ee5ebdb190487 in_seq=0 out_seq=0 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.959+0000 7f89e9ffb640 1 -- 172.21.15.33:0/695233617 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56060367b070 con 0x560603361070 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.959+0000 7f89e9ffb640 10 client.17430 handle_command_reply: tid=0 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.959+0000 7f8a0f2c0740 1 client.17430 shutdown 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/695233617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56060331f9f0 msgr2=0x56060371a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56060331f9f0 0x56060371a730 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f89f8011cd0 tx=0x7f89f4032c60 comp rx=0 tx=0).stop 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/695233617 shutdown_connections 2024-08-28T19:38:43.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560603340390 0x560603716340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5606033381b0 0x560603715c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560603361070 0x5606037910a0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 1 --2- 172.21.15.33:0/695233617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56060331f9f0 0x56060371a730 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/695233617 >> 172.21.15.33:0/695233617 conn(0x560603355460 msgr2=0x560603703a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:43.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f89e9ffb640 0 client.17430 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:43.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/695233617 shutdown_connections 2024-08-28T19:38:43.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 1 -- 172.21.15.33:0/695233617 wait complete. 2024-08-28T19:38:43.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a0f2c0740 20 client.17430 trim_cache size 0 max 16384 2024-08-28T19:38:43.967 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:38:43.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3561481245 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89ec0b4ca0 msgr2=0x7f89ec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:43.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a08d4b640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89ec0b4ca0 0x7f89ec0b71b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009270 tx=0x7f89fc070c80 comp rx=0 tx=0).stop 2024-08-28T19:38:43.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3561481245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a04108ab0 msgr2=0x7f8a0419fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:43.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a08d4b640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a04108ab0 0x7f8a0419fa70 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00eaa0 tx=0x7f89fc00ef60 comp rx=0 tx=0).stop 2024-08-28T19:38:43.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3561481245 shutdown_connections 2024-08-28T19:38:43.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a08d4b640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a04108ab0 0x7f8a0419fa70 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a08d4b640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a04108160 0x7f8a0419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a08d4b640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89ec0b4ca0 0x7f89ec0b71b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a08d4b640 1 --2- 172.21.15.33:0/3561481245 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a04102820 0x7f8a0419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:43.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.960+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3561481245 >> 172.21.15.33:0/3561481245 conn(0x7f8a040794e0 msgr2=0x7f8a04101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:43.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.961+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3561481245 shutdown_connections 2024-08-28T19:38:43.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:43.961+0000 7f8a08d4b640 1 -- 172.21.15.33:0/3561481245 wait complete. 2024-08-28T19:38:45.677 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:38:45.677 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:38:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:45 smithi059 ceph-mon[22052]: pgmap v531: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-28T19:38:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:45 smithi122 ceph-mon[22174]: pgmap v531: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-28T19:38:45.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:45 smithi033 ceph-mon[18549]: pgmap v531: 129 pgs: 129 active+clean; 5.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-28T19:38:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:46.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.462+0000 7f081c708640 1 -- 172.21.15.33:0/2466920125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0814105040 msgr2=0x7f081410d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:46.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.462+0000 7f081c708640 1 --2- 172.21.15.33:0/2466920125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0814105040 0x7f081410d6d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f0808009900 tx=0x7f080802a410 comp rx=0 tx=0).stop 2024-08-28T19:38:46.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.462+0000 7f081c708640 1 -- 172.21.15.33:0/2466920125 shutdown_connections 2024-08-28T19:38:46.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.462+0000 7f081c708640 1 --2- 172.21.15.33:0/2466920125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f081410dc10 0x7f08141100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.462+0000 7f081c708640 1 --2- 172.21.15.33:0/2466920125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0814105040 0x7f081410d6d0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.462+0000 7f081c708640 1 --2- 172.21.15.33:0/2466920125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0814104660 0x7f0814104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.462+0000 7f081c708640 1 -- 172.21.15.33:0/2466920125 >> 172.21.15.33:0/2466920125 conn(0x7f0814079530 msgr2=0x7f0814079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:46.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.462+0000 7f081c708640 1 -- 172.21.15.33:0/2466920125 shutdown_connections 2024-08-28T19:38:46.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.462+0000 7f081c708640 1 -- 172.21.15.33:0/2466920125 wait complete. 2024-08-28T19:38:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081c708640 1 Processor -- start 2024-08-28T19:38:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081c708640 1 -- start start 2024-08-28T19:38:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081c708640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0814104660 0x7f081419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081c708640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814105040 0x7f081419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081c708640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081410dc10 0x7f081419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081c708640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0814113850 con 0x7f0814104660 2024-08-28T19:38:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081c708640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08141136d0 con 0x7f0814105040 2024-08-28T19:38:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081c708640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f08141139d0 con 0x7f081410dc10 2024-08-28T19:38:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081a4a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0814104660 0x7f081419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081a4a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0814104660 0x7f081419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53442/0 (socket says 172.21.15.33:53442) 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081a4a4640 1 -- 172.21.15.33:0/2795083397 learned_addr learned my addr 172.21.15.33:0/2795083397 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081aca5640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081410dc10 0x7f081419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f0819ca3640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814105040 0x7f081419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081a4a4640 1 -- 172.21.15.33:0/2795083397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081410dc10 msgr2=0x7f081419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.463+0000 7f081a4a4640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081410dc10 0x7f081419fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.464+0000 7f081a4a4640 1 -- 172.21.15.33:0/2795083397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814105040 msgr2=0x7f081419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.464+0000 7f081a4a4640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814105040 0x7f081419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.464+0000 7f081a4a4640 1 -- 172.21.15.33:0/2795083397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08141a01f0 con 0x7f0814104660 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.464+0000 7f0819ca3640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814105040 0x7f081419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.464+0000 7f081a4a4640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0814104660 0x7f081419a280 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f080c00eb90 tx=0x7f080c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.464+0000 7f08137fe640 1 -- 172.21.15.33:0/2795083397 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c004d20 con 0x7f0814104660 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.464+0000 7f08137fe640 1 -- 172.21.15.33:0/2795083397 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f080c00ee90 con 0x7f0814104660 2024-08-28T19:38:46.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.464+0000 7f081c708640 1 -- 172.21.15.33:0/2795083397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08141a04e0 con 0x7f0814104660 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.464+0000 7f08137fe640 1 -- 172.21.15.33:0/2795083397 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c010670 con 0x7f0814104660 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.464+0000 7f081c708640 1 -- 172.21.15.33:0/2795083397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08141a6c40 con 0x7f0814104660 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f0822c7d740 1 Processor -- start 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f08137fe640 1 -- 172.21.15.33:0/2795083397 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f080c005020 con 0x7f0814104660 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f0822c7d740 1 -- start start 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 0x55a1ea112780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea112cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d4b670 0x55a1ea113200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f0822c7d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a1ea0885f0 con 0x55a1e9d43490 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f0822c7d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a1ea077b80 con 0x55a1e9d6c350 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f0822c7d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a1ea07bb30 con 0x55a1e9d4b670 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f081a4a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea112cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f081a4a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea112cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53448/0 (socket says 172.21.15.33:53448) 2024-08-28T19:38:46.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f081a4a4640 1 -- 172.21.15.33:0/1018983770 learned_addr learned my addr 172.21.15.33:0/1018983770 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:46.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.467+0000 7f081aca5640 1 --2- 172.21.15.33:0/1018983770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 0x55a1ea112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f0819ca3640 1 --2- 172.21.15.33:0/1018983770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d4b670 0x55a1ea113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f08137fe640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07fc0b4ca0 0x7f07fc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f081a4a4640 1 -- 172.21.15.33:0/1018983770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d4b670 msgr2=0x55a1ea113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:46.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f081a4a4640 1 --2- 172.21.15.33:0/1018983770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d4b670 0x55a1ea113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f081a4a4640 1 -- 172.21.15.33:0/1018983770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 msgr2=0x55a1ea112780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:46.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f081a4a4640 1 --2- 172.21.15.33:0/1018983770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 0x55a1ea112780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f08137fe640 1 -- 172.21.15.33:0/2795083397 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f080c0e5f90 con 0x7f0814104660 2024-08-28T19:38:46.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f081a4a4640 1 -- 172.21.15.33:0/1018983770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1e9dd7930 con 0x55a1e9d43490 2024-08-28T19:38:46.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f081aca5640 1 --2- 172.21.15.33:0/1018983770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 0x55a1ea112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:38:46.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f081aca5640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07fc0b4ca0 0x7f07fc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f081a4a4640 1 --2- 172.21.15.33:0/1018983770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea112cc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f080c0e3300 tx=0x7f080c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6205dce6d5bd7aeb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:46.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f0810ff9640 1 -- 172.21.15.33:0/1018983770 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c0a81f0 con 0x55a1e9d43490 2024-08-28T19:38:46.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f081aca5640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07fc0b4ca0 0x7f07fc0b71b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f08040058c0 tx=0x7f08040046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:46.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f0810ff9640 1 -- 172.21.15.33:0/1018983770 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f080c0abe40 con 0x55a1e9d43490 2024-08-28T19:38:46.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.468+0000 7f0810ff9640 1 -- 172.21.15.33:0/1018983770 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c0abaa0 con 0x55a1e9d43490 2024-08-28T19:38:46.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.469+0000 7f0822c7d740 1 -- 172.21.15.33:0/1018983770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 msgr2=0x55a1ea112cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:46.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.469+0000 7f0822c7d740 1 --2- 172.21.15.33:0/1018983770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea112cc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f080c0e3300 tx=0x7f080c00cf90 comp rx=0 tx=0).stop 2024-08-28T19:38:46.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.469+0000 7f0822c7d740 1 -- 172.21.15.33:0/1018983770 shutdown_connections 2024-08-28T19:38:46.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.469+0000 7f0822c7d740 1 --2- 172.21.15.33:0/1018983770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d4b670 0x55a1ea113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.469+0000 7f0822c7d740 1 --2- 172.21.15.33:0/1018983770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea112cc0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.469+0000 7f0822c7d740 1 --2- 172.21.15.33:0/1018983770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 0x55a1ea112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.469+0000 7f0822c7d740 1 -- 172.21.15.33:0/1018983770 >> 172.21.15.33:0/1018983770 conn(0x55a1e9d60740 msgr2=0x55a1ea110670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:46.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.469+0000 7f0822c7d740 1 -- 172.21.15.33:0/1018983770 shutdown_connections 2024-08-28T19:38:46.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.469+0000 7f0822c7d740 1 -- 172.21.15.33:0/1018983770 wait complete. 2024-08-28T19:38:46.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f0822c7d740 1 -- start start 2024-08-28T19:38:46.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f0822c7d740 1 Processor -- start 2024-08-28T19:38:46.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea11df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d4b670 0x55a1ea11e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 0x55a1ea12a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f0822c7d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a1e9eda890 con 0x55a1e9d43490 2024-08-28T19:38:46.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f0822c7d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a1e9ffe790 con 0x55a1e9d4b670 2024-08-28T19:38:46.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f0822c7d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a1ea120f00 con 0x55a1e9d6c350 2024-08-28T19:38:46.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f0822c7d740 10 client.0 _ll_register_callbacks cb 0x55a1e9d83ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:46.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f081a4a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea11df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f081a4a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea11df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53456/0 (socket says 172.21.15.33:53456) 2024-08-28T19:38:46.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.470+0000 7f081a4a4640 1 -- 172.21.15.33:0/1400150569 learned_addr learned my addr 172.21.15.33:0/1400150569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:46.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f0819ca3640 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d4b670 0x55a1ea11e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f081a4a4640 1 -- 172.21.15.33:0/1400150569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 msgr2=0x55a1ea12a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:46.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f081aca5640 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 0x55a1ea12a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f081a4a4640 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 0x55a1ea12a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f081a4a4640 1 -- 172.21.15.33:0/1400150569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d4b670 msgr2=0x55a1ea11e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:46.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f081a4a4640 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d4b670 0x55a1ea11e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f081a4a4640 1 -- 172.21.15.33:0/1400150569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1ea035f30 con 0x55a1e9d43490 2024-08-28T19:38:46.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f0819ca3640 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d4b670 0x55a1ea11e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:38:46.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f081a4a4640 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea11df40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f080c0a95a0 tx=0x7f080c0e3820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519f8829bacc3477 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:46.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f07f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:46.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f07f9ffb640 1 -- 172.21.15.33:0/1400150569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c0abc80 con 0x55a1e9d43490 2024-08-28T19:38:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f07f9ffb640 1 -- 172.21.15.33:0/1400150569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f080c0b53c0 con 0x55a1e9d43490 2024-08-28T19:38:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f0822c7d740 1 -- 172.21.15.33:0/1400150569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f080c0abe40 con 0x55a1e9d43490 2024-08-28T19:38:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f07f9ffb640 1 -- 172.21.15.33:0/1400150569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f080c0ac100 con 0x55a1e9d43490 2024-08-28T19:38:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f0822c7d740 10 client.17442 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f0822c7d740 1 -- 172.21.15.33:0/1400150569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a1ea12cce0 con 0x55a1e9d43490 2024-08-28T19:38:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.471+0000 7f07f9ffb640 1 -- 172.21.15.33:0/1400150569 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f080c0abe40 con 0x55a1e9d43490 2024-08-28T19:38:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.472+0000 7f07f9ffb640 1 -- 172.21.15.33:0/1400150569 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f080c0e9140 con 0x55a1e9d43490 2024-08-28T19:38:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.472+0000 7f0822c7d740 10 client.17442 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.472+0000 7f0822c7d740 10 client.17442 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:38:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.472+0000 7f0822c7d740 20 client.17442 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.472+0000 7f0822c7d740 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1e9d2acd0 0x55a1ea130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.472+0000 7f0822c7d740 4 client.17442 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.472+0000 7f0822c7d740 1 -- 172.21.15.33:0/1400150569 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1ea08a540 con 0x55a1e9d2acd0 2024-08-28T19:38:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.472+0000 7f0819ca3640 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1e9d2acd0 0x55a1ea130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.472+0000 7f0819ca3640 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1e9d2acd0 0x55a1ea130040 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d94b1620bc0ab7eb server_cookie=b4cde5849ff9ec73 in_seq=0 out_seq=0 2024-08-28T19:38:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.472+0000 7f07f9ffb640 10 client.17442 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f07f9ffb640 1 -- 172.21.15.33:0/1400150569 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1ea08a540 con 0x55a1e9d2acd0 2024-08-28T19:38:46.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f07f9ffb640 10 client.17442 handle_command_reply: tid=0 2024-08-28T19:38:46.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 client.17442 shutdown 2024-08-28T19:38:46.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 -- 172.21.15.33:0/1400150569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 msgr2=0x55a1ea11df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:46.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea11df40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f080c0a95a0 tx=0x7f080c0e3820 comp rx=0 tx=0).stop 2024-08-28T19:38:46.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 -- 172.21.15.33:0/1400150569 shutdown_connections 2024-08-28T19:38:46.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 0x55a1ea12a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d4b670 0x55a1ea11e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1e9d2acd0 0x55a1ea130040 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 --2- 172.21.15.33:0/1400150569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d43490 0x55a1ea11df40 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f07f9ffb640 0 client.17442 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 -- 172.21.15.33:0/1400150569 >> 172.21.15.33:0/1400150569 conn(0x55a1e9d60740 msgr2=0x55a1ea115910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 -- 172.21.15.33:0/1400150569 shutdown_connections 2024-08-28T19:38:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.473+0000 7f0822c7d740 1 -- 172.21.15.33:0/1400150569 wait complete. 2024-08-28T19:38:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.474+0000 7f0822c7d740 20 client.17442 trim_cache size 0 max 16384 2024-08-28T19:38:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.491+0000 7f0822c7d740 1 Processor -- start 2024-08-28T19:38:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.491+0000 7f0822c7d740 1 -- start start 2024-08-28T19:38:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d43490 0x55a1ea11b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea11b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 0x55a1ea133070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0822c7d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f08141b2e10 con 0x55a1e9d4b670 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0822c7d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08141b4950 con 0x55a1e9d6c350 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0822c7d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f08141b34e0 con 0x55a1e9d43490 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0819ca3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea11b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0819ca3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea11b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53464/0 (socket says 172.21.15.33:53464) 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0819ca3640 1 -- 172.21.15.33:0/22239788 learned_addr learned my addr 172.21.15.33:0/22239788 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f081a4a4640 1 --2- 172.21.15.33:0/22239788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d43490 0x55a1ea11b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f081aca5640 1 --2- 172.21.15.33:0/22239788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 0x55a1ea133070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0819ca3640 1 -- 172.21.15.33:0/22239788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d43490 msgr2=0x55a1ea11b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0819ca3640 1 --2- 172.21.15.33:0/22239788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d43490 0x55a1ea11b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0819ca3640 1 -- 172.21.15.33:0/22239788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 msgr2=0x55a1ea133070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0819ca3640 1 --2- 172.21.15.33:0/22239788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 0x55a1ea133070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0819ca3640 1 -- 172.21.15.33:0/22239788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1ea11cea0 con 0x55a1e9d4b670 2024-08-28T19:38:46.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.492+0000 7f0819ca3640 1 --2- 172.21.15.33:0/22239788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea11b670 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f0808005f70 tx=0x7f0808004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffdb972753e8b3f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:46.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.493+0000 7f07fbfff640 1 -- 172.21.15.33:0/22239788 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808049070 con 0x55a1e9d4b670 2024-08-28T19:38:46.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.493+0000 7f07fbfff640 1 -- 172.21.15.33:0/22239788 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0808009540 con 0x55a1e9d4b670 2024-08-28T19:38:46.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.493+0000 7f07fbfff640 1 -- 172.21.15.33:0/22239788 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808035040 con 0x55a1e9d4b670 2024-08-28T19:38:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 -- 172.21.15.33:0/22239788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 msgr2=0x55a1ea11b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 --2- 172.21.15.33:0/22239788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea11b670 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f0808005f70 tx=0x7f0808004260 comp rx=0 tx=0).stop 2024-08-28T19:38:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 -- 172.21.15.33:0/22239788 shutdown_connections 2024-08-28T19:38:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 --2- 172.21.15.33:0/22239788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d6c350 0x55a1ea133070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 --2- 172.21.15.33:0/22239788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea11b670 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 --2- 172.21.15.33:0/22239788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d43490 0x55a1ea11b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 -- 172.21.15.33:0/22239788 >> 172.21.15.33:0/22239788 conn(0x55a1e9d60740 msgr2=0x55a1ea1190f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 -- 172.21.15.33:0/22239788 shutdown_connections 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 -- 172.21.15.33:0/22239788 wait complete. 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 -- start start 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.494+0000 7f0822c7d740 1 Processor -- start 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d43490 0x55a1ea1337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea131ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0822c7d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 0x55a1ea1321e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0822c7d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f08141b4280 con 0x55a1e9d4b670 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0822c7d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08141b3bb0 con 0x55a1e9d43490 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0822c7d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f08141b0df0 con 0x55a1e9d6c350 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0822c7d740 10 client.0 _ll_register_callbacks cb 0x7f0804009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0819ca3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea131ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0819ca3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea131ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53476/0 (socket says 172.21.15.33:53476) 2024-08-28T19:38:46.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0819ca3640 1 -- 172.21.15.33:0/2908594910 learned_addr learned my addr 172.21.15.33:0/2908594910 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f081a4a4640 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d43490 0x55a1ea1337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f081aca5640 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 0x55a1ea1321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0819ca3640 1 -- 172.21.15.33:0/2908594910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 msgr2=0x55a1ea1321e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0819ca3640 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 0x55a1ea1321e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0819ca3640 1 -- 172.21.15.33:0/2908594910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d43490 msgr2=0x55a1ea1337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0819ca3640 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d43490 0x55a1ea1337c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0819ca3640 1 -- 172.21.15.33:0/2908594910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1ea1328d0 con 0x55a1e9d4b670 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f081aca5640 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 0x55a1ea1321e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0819ca3640 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea131ca0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f0808031440 tx=0x7f0808032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b664e12dd8666994 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f07f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f07f9ffb640 1 -- 172.21.15.33:0/2908594910 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808035070 con 0x55a1e9d4b670 2024-08-28T19:38:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f07f9ffb640 1 -- 172.21.15.33:0/2908594910 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f0808005280 con 0x55a1e9d4b670 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.495+0000 7f0822c7d740 1 -- 172.21.15.33:0/2908594910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0808009540 con 0x55a1e9d4b670 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f07f9ffb640 1 -- 172.21.15.33:0/2908594910 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0808049070 con 0x55a1e9d4b670 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f0822c7d740 10 client.17448 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f0822c7d740 1 -- 172.21.15.33:0/2908594910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a1ea19b6b0 con 0x55a1e9d4b670 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f07f9ffb640 1 -- 172.21.15.33:0/2908594910 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0808009540 con 0x55a1e9d4b670 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f07f9ffb640 1 -- 172.21.15.33:0/2908594910 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0808003680 con 0x55a1e9d4b670 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f0822c7d740 10 client.17448 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f0822c7d740 10 client.17448 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f0822c7d740 20 client.17448 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f0822c7d740 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1e9d00080 0x55a1ea19ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f0822c7d740 4 client.17448 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f0822c7d740 1 -- 172.21.15.33:0/2908594910 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a1ea085fe0 con 0x55a1e9d00080 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.496+0000 7f081a4a4640 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1e9d00080 0x55a1ea19ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.497+0000 7f07f9ffb640 10 client.17448 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:46.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.497+0000 7f081a4a4640 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1e9d00080 0x55a1ea19ddc0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f6f9fa6f5331fc server_cookie=a5f0a55c1c3097ff in_seq=0 out_seq=0 2024-08-28T19:38:46.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f07f9ffb640 1 -- 172.21.15.33:0/2908594910 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a1ea085fe0 con 0x55a1e9d00080 2024-08-28T19:38:46.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f07f9ffb640 10 client.17448 handle_command_reply: tid=0 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 client.17448 shutdown 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 -- 172.21.15.33:0/2908594910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 msgr2=0x55a1ea131ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea131ca0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f0808031440 tx=0x7f0808032f20 comp rx=0 tx=0).stop 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 -- 172.21.15.33:0/2908594910 shutdown_connections 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a1e9d6c350 0x55a1ea1321e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1e9d00080 0x55a1ea19ddc0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a1e9d4b670 0x55a1ea131ca0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 --2- 172.21.15.33:0/2908594910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a1e9d43490 0x55a1ea1337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f07f9ffb640 0 client.17448 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 -- 172.21.15.33:0/2908594910 >> 172.21.15.33:0/2908594910 conn(0x55a1e9d60740 msgr2=0x55a1ea113790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 -- 172.21.15.33:0/2908594910 shutdown_connections 2024-08-28T19:38:46.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 1 -- 172.21.15.33:0/2908594910 wait complete. 2024-08-28T19:38:46.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.499+0000 7f0822c7d740 20 client.17448 trim_cache size 0 max 16384 2024-08-28T19:38:46.506 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:38:46.506 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:38:46.506 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "c6a79f9d-3c60-486c-b1ff-16bb65314e80", 2024-08-28T19:38:46.506 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:38:46.506 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:38:46.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 -- 172.21.15.33:0/2795083397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07fc0b4ca0 msgr2=0x7f07fc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:46.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07fc0b4ca0 0x7f07fc0b71b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f08040058c0 tx=0x7f08040046c0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 -- 172.21.15.33:0/2795083397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0814104660 msgr2=0x7f081419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:46.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0814104660 0x7f081419a280 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f080c00eb90 tx=0x7f080c00c6a0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 -- 172.21.15.33:0/2795083397 shutdown_connections 2024-08-28T19:38:46.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f07fc0b4ca0 0x7f07fc0b71b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f081410dc10 0x7f081419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814105040 0x7f081419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 --2- 172.21.15.33:0/2795083397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0814104660 0x7f081419a280 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:46.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 -- 172.21.15.33:0/2795083397 >> 172.21.15.33:0/2795083397 conn(0x7f0814079530 msgr2=0x7f0814100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:46.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 -- 172.21.15.33:0/2795083397 shutdown_connections 2024-08-28T19:38:46.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:46.500+0000 7f081c708640 1 -- 172.21.15.33:0/2795083397 wait complete. 2024-08-28T19:38:47.270 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:38:47.522 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:38:47.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:47 smithi059 ceph-mon[22052]: pgmap v532: 129 pgs: 129 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-28T19:38:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:47 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:38:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:47 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:47 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:38:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:47 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:47.788 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:47 smithi033 ceph-mon[18549]: pgmap v532: 129 pgs: 129 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-28T19:38:47.788 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:47 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:38:47.788 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:47 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:47.788 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:47 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:38:47.788 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:47 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:47 smithi122 ceph-mon[22174]: pgmap v532: 129 pgs: 129 active+clean; 5.9 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-28T19:38:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:47 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:38:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:47 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:47 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:38:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:47 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:38:48.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.021+0000 7f5da2eda640 1 -- 172.21.15.33:0/4193416666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c10dbd0 msgr2=0x7f5d9c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.021+0000 7f5da2eda640 1 --2- 172.21.15.33:0/4193416666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c10dbd0 0x7f5d9c1100c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009900 tx=0x7f5d8c02a3f0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.021+0000 7f5da2eda640 1 -- 172.21.15.33:0/4193416666 shutdown_connections 2024-08-28T19:38:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.021+0000 7f5da2eda640 1 --2- 172.21.15.33:0/4193416666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c10dbd0 0x7f5d9c1100c0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.021+0000 7f5da2eda640 1 --2- 172.21.15.33:0/4193416666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d9c1050c0 0x7f5d9c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.021+0000 7f5da2eda640 1 --2- 172.21.15.33:0/4193416666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c104770 0x7f5d9c104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.021+0000 7f5da2eda640 1 -- 172.21.15.33:0/4193416666 >> 172.21.15.33:0/4193416666 conn(0x7f5d9c0794e0 msgr2=0x7f5d9c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.021+0000 7f5da2eda640 1 -- 172.21.15.33:0/4193416666 shutdown_connections 2024-08-28T19:38:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.021+0000 7f5da2eda640 1 -- 172.21.15.33:0/4193416666 wait complete. 2024-08-28T19:38:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da2eda640 1 Processor -- start 2024-08-28T19:38:48.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da2eda640 1 -- start start 2024-08-28T19:38:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da2eda640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d9c104770 0x7f5d9c1024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da2eda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c1050c0 0x7f5d9c1029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da2eda640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c10dbd0 0x7f5d9c102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da2eda640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c113880 con 0x7f5d9c10dbd0 2024-08-28T19:38:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da2eda640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c113700 con 0x7f5d9c1050c0 2024-08-28T19:38:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da2eda640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c113a00 con 0x7f5d9c104770 2024-08-28T19:38:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da1477640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c10dbd0 0x7f5d9c102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da1477640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c10dbd0 0x7f5d9c102f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53490/0 (socket says 172.21.15.33:53490) 2024-08-28T19:38:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.022+0000 7f5da1477640 1 -- 172.21.15.33:0/4174038578 learned_addr learned my addr 172.21.15.33:0/4174038578 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5da0c76640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d9c104770 0x7f5d9c1024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c1050c0 0x7f5d9c1029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5da1477640 1 -- 172.21.15.33:0/4174038578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d9c104770 msgr2=0x7f5d9c1024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5da1477640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d9c104770 0x7f5d9c1024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5da1477640 1 -- 172.21.15.33:0/4174038578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c1050c0 msgr2=0x7f5d9c1029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5da1477640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c1050c0 0x7f5d9c1029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5da1477640 1 -- 172.21.15.33:0/4174038578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c1a8390 con 0x7f5d9c10dbd0 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5da1477640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c10dbd0 0x7f5d9c102f30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c02a910 tx=0x7f5d8c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5d99ffb640 1 -- 172.21.15.33:0/4174038578 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c03f070 con 0x7f5d9c10dbd0 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5d99ffb640 1 -- 172.21.15.33:0/4174038578 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d8c031d60 con 0x7f5d9c10dbd0 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5da2eda640 1 -- 172.21.15.33:0/4174038578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c1a8620 con 0x7f5d9c10dbd0 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5d99ffb640 1 -- 172.21.15.33:0/4174038578 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c035030 con 0x7f5d9c10dbd0 2024-08-28T19:38:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.023+0000 7f5da2eda640 1 -- 172.21.15.33:0/4174038578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c1a8b50 con 0x7f5d9c10dbd0 2024-08-28T19:38:48.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.026+0000 7f5da944f740 1 Processor -- start 2024-08-28T19:38:48.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.026+0000 7f5d99ffb640 1 -- 172.21.15.33:0/4174038578 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5d8c042070 con 0x7f5d9c10dbd0 2024-08-28T19:38:48.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.026+0000 7f5da944f740 1 -- start start 2024-08-28T19:38:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da944f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bd32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da944f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bd3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da944f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e480d390 0x55a3e4bd3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da944f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a3e4b4a630 con 0x55a3e48051b0 2024-08-28T19:38:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da944f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a3e4b39bc0 con 0x55a3e482e070 2024-08-28T19:38:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da944f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a3e4b3db70 con 0x55a3e480d390 2024-08-28T19:38:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da0c76640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bd3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da0c76640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bd3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53494/0 (socket says 172.21.15.33:53494) 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da0c76640 1 -- 172.21.15.33:0/2443419686 learned_addr learned my addr 172.21.15.33:0/2443419686 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/2443419686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bd32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/2443419686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e480d390 0x55a3e4bd3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5d99ffb640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d840b4d20 0x7f5d840b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da0c76640 1 -- 172.21.15.33:0/2443419686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e480d390 msgr2=0x55a3e4bd3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da0c76640 1 --2- 172.21.15.33:0/2443419686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e480d390 0x55a3e4bd3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da0c76640 1 -- 172.21.15.33:0/2443419686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 msgr2=0x55a3e4bd32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da0c76640 1 --2- 172.21.15.33:0/2443419686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bd32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da0c76640 1 -- 172.21.15.33:0/2443419686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e4899650 con 0x55a3e48051b0 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.027+0000 7f5da1477640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d840b4d20 0x7f5d840b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.028+0000 7f5d99ffb640 1 -- 172.21.15.33:0/4174038578 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5d8c106320 con 0x7f5d9c10dbd0 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.028+0000 7f5da0c76640 1 --2- 172.21.15.33:0/2443419686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bd3800 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f5d94007e70 tx=0x7f5d9400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde4f2572c33f5d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.028+0000 7f5d82ffd640 1 -- 172.21.15.33:0/2443419686 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94014070 con 0x55a3e48051b0 2024-08-28T19:38:48.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.028+0000 7f5d82ffd640 1 -- 172.21.15.33:0/2443419686 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d9400ee70 con 0x55a3e48051b0 2024-08-28T19:38:48.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.028+0000 7f5d82ffd640 1 -- 172.21.15.33:0/2443419686 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94005360 con 0x55a3e48051b0 2024-08-28T19:38:48.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 -- 172.21.15.33:0/2443419686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 msgr2=0x55a3e4bd3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:48.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da1477640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d840b4d20 0x7f5d840b7230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c1037d0 tx=0x7f5d8c0988c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:48.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 --2- 172.21.15.33:0/2443419686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bd3800 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f5d94007e70 tx=0x7f5d9400e720 comp rx=0 tx=0).stop 2024-08-28T19:38:48.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 -- 172.21.15.33:0/2443419686 shutdown_connections 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 --2- 172.21.15.33:0/2443419686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e480d390 0x55a3e4bd3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 --2- 172.21.15.33:0/2443419686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bd3800 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 --2- 172.21.15.33:0/2443419686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bd32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 -- 172.21.15.33:0/2443419686 >> 172.21.15.33:0/2443419686 conn(0x55a3e4822460 msgr2=0x55a3e4bd11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 -- 172.21.15.33:0/2443419686 shutdown_connections 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 -- 172.21.15.33:0/2443419686 wait complete. 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 -- start start 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.029+0000 7f5da944f740 1 Processor -- start 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5da944f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bdea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5da944f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e480d390 0x55a3e4bdef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5da944f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5da944f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a3e499c700 con 0x55a3e48051b0 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5da944f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a3e4ac0700 con 0x55a3e482e070 2024-08-28T19:38:48.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5da944f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a3e4be1aa0 con 0x55a3e480d390 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5da944f740 10 client.0 _ll_register_callbacks cb 0x55a3e4aefdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5d9bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bdea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5d9bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bdea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53506/0 (socket says 172.21.15.33:53506) 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5d9bfff640 1 -- 172.21.15.33:0/106252950 learned_addr learned my addr 172.21.15.33:0/106252950 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5da0c76640 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e480d390 0x55a3e4bdef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5d9bfff640 1 -- 172.21.15.33:0/106252950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e480d390 msgr2=0x55a3e4bdef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e480d390 0x55a3e4bdef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5d9bfff640 1 -- 172.21.15.33:0/106252950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 msgr2=0x55a3e4bead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.030+0000 7f5d9bfff640 1 -- 172.21.15.33:0/106252950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e4af98b0 con 0x55a3e48051b0 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bdea50 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000e400 tx=0x7f5d90013f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b4b2f16bceb81a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5d7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:48.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5d7bfff640 1 -- 172.21.15.33:0/106252950 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90005020 con 0x55a3e48051b0 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5d7bfff640 1 -- 172.21.15.33:0/106252950 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5d900051c0 con 0x55a3e48051b0 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5da944f740 1 -- 172.21.15.33:0/106252950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d9400ee70 con 0x55a3e48051b0 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5d7bfff640 1 -- 172.21.15.33:0/106252950 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d900053c0 con 0x55a3e48051b0 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5da944f740 10 client.17460 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5da944f740 1 -- 172.21.15.33:0/106252950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a3e4bed890 con 0x55a3e48051b0 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5d7bfff640 1 -- 172.21.15.33:0/106252950 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d9400ee70 con 0x55a3e48051b0 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5d7bfff640 1 -- 172.21.15.33:0/106252950 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5d9001e480 con 0x55a3e48051b0 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5da944f740 10 client.17460 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5da944f740 10 client.17460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5da944f740 20 client.17460 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5da944f740 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3e47ec9f0 0x55a3e4bf0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5da944f740 4 client.17460 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:38:48.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.031+0000 7f5da944f740 1 -- 172.21.15.33:0/106252950 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3e4b4c580 con 0x55a3e47ec9f0 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.032+0000 7f5da0c76640 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3e47ec9f0 0x55a3e4bf0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.032+0000 7f5d7bfff640 10 client.17460 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.032+0000 7f5da0c76640 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3e47ec9f0 0x55a3e4bf0e30 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95bff1c68236dc07 server_cookie=4d1b4887c001a35b in_seq=0 out_seq=0 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5d7bfff640 1 -- 172.21.15.33:0/106252950 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a3e4b4c580 con 0x55a3e47ec9f0 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5d7bfff640 10 client.17460 handle_command_reply: tid=0 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 client.17460 shutdown 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 -- 172.21.15.33:0/106252950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 msgr2=0x55a3e4bdea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bdea50 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000e400 tx=0x7f5d90013f20 comp rx=0 tx=0).stop 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 -- 172.21.15.33:0/106252950 shutdown_connections 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e480d390 0x55a3e4bdef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3e47ec9f0 0x55a3e4bf0e30 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 --2- 172.21.15.33:0/106252950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e48051b0 0x55a3e4bdea50 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 -- 172.21.15.33:0/106252950 >> 172.21.15.33:0/106252950 conn(0x55a3e4822460 msgr2=0x55a3e4bd64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:48.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5d7bfff640 0 client.17460 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:48.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 -- 172.21.15.33:0/106252950 shutdown_connections 2024-08-28T19:38:48.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 1 -- 172.21.15.33:0/106252950 wait complete. 2024-08-28T19:38:48.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.033+0000 7f5da944f740 20 client.17460 trim_cache size 0 max 16384 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da944f740 1 Processor -- start 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da944f740 1 -- start start 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da944f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e48051b0 0x55a3e4bcc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da944f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4bd63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da944f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bd6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da944f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1b2c80 con 0x55a3e480d390 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da944f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1b47c0 con 0x55a3e482e070 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da944f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1b3350 con 0x55a3e48051b0 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da0c76640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4bd63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da0c76640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4bd63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53522/0 (socket says 172.21.15.33:53522) 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5da0c76640 1 -- 172.21.15.33:0/3786695360 learned_addr learned my addr 172.21.15.33:0/3786695360 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:48.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.051+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/3786695360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e48051b0 0x55a3e4bcc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.052+0000 7f5da0c76640 1 -- 172.21.15.33:0/3786695360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e48051b0 msgr2=0x55a3e4bcc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.052+0000 7f5da0c76640 1 --2- 172.21.15.33:0/3786695360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e48051b0 0x55a3e4bcc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.052+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/3786695360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bd6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.052+0000 7f5da0c76640 1 -- 172.21.15.33:0/3786695360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 msgr2=0x55a3e4bd6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.052+0000 7f5da0c76640 1 --2- 172.21.15.33:0/3786695360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bd6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.052+0000 7f5da0c76640 1 -- 172.21.15.33:0/3786695360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e4bdfd10 con 0x55a3e480d390 2024-08-28T19:38:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.052+0000 7f5da0c76640 1 --2- 172.21.15.33:0/3786695360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4bd63c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f5d94007e70 tx=0x7f5d94010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1560eba7c69b6e25 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.052+0000 7f5d827fc640 1 -- 172.21.15.33:0/3786695360 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94014040 con 0x55a3e480d390 2024-08-28T19:38:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.052+0000 7f5d827fc640 1 -- 172.21.15.33:0/3786695360 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d94007a40 con 0x55a3e480d390 2024-08-28T19:38:48.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.052+0000 7f5d827fc640 1 -- 172.21.15.33:0/3786695360 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d940042a0 con 0x55a3e480d390 2024-08-28T19:38:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 -- 172.21.15.33:0/3786695360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 msgr2=0x55a3e4bd63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 --2- 172.21.15.33:0/3786695360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4bd63c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f5d94007e70 tx=0x7f5d94010f60 comp rx=0 tx=0).stop 2024-08-28T19:38:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 -- 172.21.15.33:0/3786695360 shutdown_connections 2024-08-28T19:38:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 --2- 172.21.15.33:0/3786695360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e482e070 0x55a3e4bd6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 --2- 172.21.15.33:0/3786695360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4bd63c0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 --2- 172.21.15.33:0/3786695360 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e48051b0 0x55a3e4bcc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 -- 172.21.15.33:0/3786695360 >> 172.21.15.33:0/3786695360 conn(0x55a3e4822460 msgr2=0x55a3e4bdd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 -- 172.21.15.33:0/3786695360 shutdown_connections 2024-08-28T19:38:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 -- 172.21.15.33:0/3786695360 wait complete. 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 -- start start 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.053+0000 7f5da944f740 1 Processor -- start 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da944f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e48051b0 0x55a3e4be7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da944f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4be2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da944f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e482e070 0x55a3e4be3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da944f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1b40f0 con 0x55a3e480d390 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da944f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1b3a20 con 0x55a3e48051b0 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da944f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c1b0c60 con 0x55a3e482e070 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da944f740 10 client.0 _ll_register_callbacks cb 0x7f5d90013050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da0c76640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4be2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da0c76640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4be2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53532/0 (socket says 172.21.15.33:53532) 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da0c76640 1 -- 172.21.15.33:0/554050964 learned_addr learned my addr 172.21.15.33:0/554050964 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:38:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e48051b0 0x55a3e4be7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e482e070 0x55a3e4be3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da0c76640 1 -- 172.21.15.33:0/554050964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e482e070 msgr2=0x55a3e4be3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da0c76640 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e482e070 0x55a3e4be3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da0c76640 1 -- 172.21.15.33:0/554050964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e48051b0 msgr2=0x55a3e4be7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da0c76640 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e48051b0 0x55a3e4be7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.054+0000 7f5da0c76640 1 -- 172.21.15.33:0/554050964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e4c5a830 con 0x55a3e480d390 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.055+0000 7f5da0c76640 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4be2c50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5d94007e40 tx=0x7f5d94003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3506f144e178c6a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.055+0000 7f5d7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.055+0000 7f5d7bfff640 1 -- 172.21.15.33:0/554050964 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94003d60 con 0x55a3e480d390 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.055+0000 7f5d7bfff640 1 -- 172.21.15.33:0/554050964 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9365+0+0 (secure 0 0 0) 0x7f5d94010640 con 0x55a3e480d390 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.055+0000 7f5da944f740 1 -- 172.21.15.33:0/554050964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d94007a40 con 0x55a3e480d390 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.055+0000 7f5d7bfff640 1 -- 172.21.15.33:0/554050964 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d94010860 con 0x55a3e480d390 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.055+0000 7f5da944f740 10 client.17466 fetch_fsmap learned FSMap version 28 2024-08-28T19:38:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.055+0000 7f5da944f740 1 -- 172.21.15.33:0/554050964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a3e4c5b9d0 con 0x55a3e480d390 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.055+0000 7f5d7bfff640 1 -- 172.21.15.33:0/554050964 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d94007a40 con 0x55a3e480d390 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.056+0000 7f5d7bfff640 1 -- 172.21.15.33:0/554050964 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5d9402a020 con 0x55a3e480d390 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.056+0000 7f5da944f740 10 client.17466 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.056+0000 7f5da944f740 10 client.17466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.056+0000 7f5da944f740 20 client.17466 populate_metadata read hostname 'smithi033' 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.056+0000 7f5da944f740 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3e47c1da0 0x55a3e4c5deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.056+0000 7f5da944f740 4 client.17466 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.056+0000 7f5da944f740 1 -- 172.21.15.33:0/554050964 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a3e4b48020 con 0x55a3e47c1da0 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.056+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3e47c1da0 0x55a3e4c5deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.056+0000 7f5d9bfff640 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3e47c1da0 0x55a3e4c5deb0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f92d30102a5ff5 server_cookie=156a7a152d40a256 in_seq=0 out_seq=0 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.056+0000 7f5d7bfff640 10 client.17466 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5d7bfff640 1 -- 172.21.15.33:0/554050964 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55a3e4b48020 con 0x55a3e47c1da0 2024-08-28T19:38:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5d7bfff640 10 client.17466 handle_command_reply: tid=0 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 client.17466 shutdown 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 -- 172.21.15.33:0/554050964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 msgr2=0x55a3e4be2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4be2c50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5d94007e40 tx=0x7f5d94003970 comp rx=0 tx=0).stop 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 -- 172.21.15.33:0/554050964 shutdown_connections 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a3e482e070 0x55a3e4be3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a3e47c1da0 0x55a3e4c5deb0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a3e480d390 0x55a3e4be2c50 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 --2- 172.21.15.33:0/554050964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3e48051b0 0x55a3e4be7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 -- 172.21.15.33:0/554050964 >> 172.21.15.33:0/554050964 conn(0x55a3e4822460 msgr2=0x55a3e4bd63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5d7bfff640 0 client.17466 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 -- 172.21.15.33:0/554050964 shutdown_connections 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 1 -- 172.21.15.33:0/554050964 wait complete. 2024-08-28T19:38:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.057+0000 7f5da944f740 20 client.17466 trim_cache size 0 max 16384 2024-08-28T19:38:48.064 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:38:48.064 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:38:48.064 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:38:48.064 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:38:48.064 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.064 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "c6a79f9d-3c60-486c-b1ff-16bb65314e80", 2024-08-28T19:38:48.064 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:38:48.064 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:48.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:38:48.066 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.068 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.069 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:38:48.070 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:38:48.071 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:38:48.071 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:38:48.071 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:38:48.071 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:38:48.071 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:38:48.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:48.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:38:48.071 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 -- 172.21.15.33:0/4174038578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d840b4d20 msgr2=0x7f5d840b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d840b4d20 0x7f5d840b7230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c1037d0 tx=0x7f5d8c0988c0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 -- 172.21.15.33:0/4174038578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c10dbd0 msgr2=0x7f5d9c102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c10dbd0 0x7f5d9c102f30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c02a910 tx=0x7f5d8c003cd0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 -- 172.21.15.33:0/4174038578 shutdown_connections 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c10dbd0 0x7f5d9c102f30 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c1050c0 0x7f5d9c1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5d840b4d20 0x7f5d840b7230 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 --2- 172.21.15.33:0/4174038578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5d9c104770 0x7f5d9c1024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 -- 172.21.15.33:0/4174038578 >> 172.21.15.33:0/4174038578 conn(0x7f5d9c0794e0 msgr2=0x7f5d9c0ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 -- 172.21.15.33:0/4174038578 shutdown_connections 2024-08-28T19:38:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:38:48.058+0000 7f5da2eda640 1 -- 172.21.15.33:0/4174038578 wait complete. 2024-08-28T19:38:48.874 INFO:tasks.cephfs.filesystem:scrub status for tag:c6a79f9d-3c60-486c-b1ff-16bb65314e80 - {'path': '/', 'tag': 'c6a79f9d-3c60-486c-b1ff-16bb65314e80', 'options': 'recursive,force'} 2024-08-28T19:38:49.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:49 smithi059 ceph-mon[22052]: pgmap v533: 129 pgs: 129 active+clean; 6.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-08-28T19:38:49.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:49 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:38:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:49 smithi122 ceph-mon[22174]: pgmap v533: 129 pgs: 129 active+clean; 6.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-08-28T19:38:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:49 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:38:49.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:49 smithi033 ceph-mon[18549]: pgmap v533: 129 pgs: 129 active+clean; 6.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-08-28T19:38:49.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:49 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:38:51.751 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.751 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:127/600: open fd = 3 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:128/600: open fd = 3 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:129/600: open fd = 3 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.752 INFO:tasks.workunit.client.0.smithi033.stdout:130/600: open fd = 3 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:131/600: open fd = 3 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:132/600: open fd = 3 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:133/600: open fd = 3 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.753 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:134/600: open fd = 3 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:135/600: open fd = 3 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:136/600: open fd = 3 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:137/600: open fd = 3 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.754 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:138/600: open fd = 3 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:139/600: open fd = 3 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:140/600: open fd = 3 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.755 INFO:tasks.workunit.client.0.smithi033.stdout:141/600: open fd = 3 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:142/600: open fd = 3 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:143/600: open fd = 3 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:144/600: open fd = 3 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.756 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:145/600: open fd = 3 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:146/600: open fd = 3 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:147/600: open fd = 3 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.757 INFO:tasks.workunit.client.0.smithi033.stdout:148/600: open fd = 3 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:149/600: open fd = 3 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:150/600: open fd = 3 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:151/600: open fd = 3 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.758 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:152/600: open fd = 3 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:153/600: open fd = 3 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:154/600: open fd = 3 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:155/600: open fd = 3 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.759 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:156/600: open fd = 3 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:157/600: open fd = 3 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:158/600: open fd = 3 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.760 INFO:tasks.workunit.client.0.smithi033.stdout:159/600: open fd = 3 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:160/600: open fd = 3 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:161/600: open fd = 3 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:162/600: open fd = 3 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.761 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.762 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.762 INFO:tasks.workunit.client.0.smithi033.stdout:163/600: open fd = 3 2024-08-28T19:38:51.762 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.762 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.762 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.762 INFO:tasks.workunit.client.0.smithi033.stdout:164/600: open fd = 3 2024-08-28T19:38:51.762 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.762 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.762 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.762 INFO:tasks.workunit.client.0.smithi033.stdout:165/600: open fd = 3 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:166/600: open fd = 3 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:167/600: open fd = 3 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:168/600: open fd = 3 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.763 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:169/600: open fd = 3 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:170/600: open fd = 3 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:171/600: open fd = 3 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.764 INFO:tasks.workunit.client.0.smithi033.stdout:172/600: open fd = 3 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:173/600: open fd = 3 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:174/600: open fd = 3 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.765 INFO:tasks.workunit.client.0.smithi033.stdout:175/600: open fd = 3 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:176/600: open fd = 3 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:177/600: open fd = 3 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:178/600: open fd = 3 2024-08-28T19:38:51.766 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:179/600: open fd = 3 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:180/600: open fd = 3 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:181/600: open fd = 3 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.767 INFO:tasks.workunit.client.0.smithi033.stdout:182/600: open fd = 3 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:183/600: open fd = 3 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:184/600: open fd = 3 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:185/600: open fd = 3 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.768 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:186/600: open fd = 3 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:187/600: open fd = 3 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:188/600: open fd = 3 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.769 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:38:51.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:51 smithi059 ceph-mon[22052]: pgmap v534: 129 pgs: 129 active+clean; 6.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-08-28T19:38:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:51 smithi122 ceph-mon[22174]: pgmap v534: 129 pgs: 129 active+clean; 6.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-08-28T19:38:51.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:51 smithi033 ceph-mon[18549]: pgmap v534: 129 pgs: 129 active+clean; 6.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-08-28T19:38:53.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:53 smithi059 ceph-mon[22052]: pgmap v535: 129 pgs: 129 active+clean; 6.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-28T19:38:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:53 smithi122 ceph-mon[22174]: pgmap v535: 129 pgs: 129 active+clean; 6.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-28T19:38:53.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:53 smithi033 ceph-mon[18549]: pgmap v535: 129 pgs: 129 active+clean; 6.1 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-28T19:38:55.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:55 smithi059 ceph-mon[22052]: pgmap v536: 129 pgs: 129 active+clean; 6.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-08-28T19:38:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:55 smithi122 ceph-mon[22174]: pgmap v536: 129 pgs: 129 active+clean; 6.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-08-28T19:38:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:55 smithi033 ceph-mon[18549]: pgmap v536: 129 pgs: 129 active+clean; 6.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 KiB/s wr, 16 op/s 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:38:56.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:38:56.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:56 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:38:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:38:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:38:56.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:56 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:38:56.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:38:56.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T19:38:56.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:38:56.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:38:56.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:56 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:38:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:57 smithi059 ceph-mon[22052]: pgmap v537: 129 pgs: 129 active+clean; 6.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-08-28T19:38:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:57 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-08-28T19:38:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:57 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi033 to 177.0M 2024-08-28T19:38:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:57 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-08-28T19:38:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:57 smithi059 ceph-mon[22052]: Unable to set osd_memory_target on smithi059 to 185701376: error parsing value: Value '185701376' is below minimum 939524096 2024-08-28T19:38:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:57 smithi059 ceph-mon[22052]: Unable to set osd_memory_target on smithi033 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-28T19:38:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:57 smithi059 ceph-mon[22052]: Unable to set osd_memory_target on smithi122 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-08-28T19:38:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:57 smithi122 ceph-mon[22174]: pgmap v537: 129 pgs: 129 active+clean; 6.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-08-28T19:38:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:57 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-08-28T19:38:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:57 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi033 to 177.0M 2024-08-28T19:38:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:57 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-08-28T19:38:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:57 smithi122 ceph-mon[22174]: Unable to set osd_memory_target on smithi059 to 185701376: error parsing value: Value '185701376' is below minimum 939524096 2024-08-28T19:38:57.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:57 smithi122 ceph-mon[22174]: Unable to set osd_memory_target on smithi033 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-28T19:38:57.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:57 smithi122 ceph-mon[22174]: Unable to set osd_memory_target on smithi122 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-08-28T19:38:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:57 smithi033 ceph-mon[18549]: pgmap v537: 129 pgs: 129 active+clean; 6.3 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-08-28T19:38:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:57 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-08-28T19:38:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:57 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi033 to 177.0M 2024-08-28T19:38:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:57 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-08-28T19:38:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:57 smithi033 ceph-mon[18549]: Unable to set osd_memory_target on smithi059 to 185701376: error parsing value: Value '185701376' is below minimum 939524096 2024-08-28T19:38:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:57 smithi033 ceph-mon[18549]: Unable to set osd_memory_target on smithi033 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-28T19:38:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:57 smithi033 ceph-mon[18549]: Unable to set osd_memory_target on smithi122 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-08-28T19:38:59.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:38:59 smithi059 ceph-mon[22052]: pgmap v538: 129 pgs: 129 active+clean; 6.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 48 KiB/s wr, 17 op/s 2024-08-28T19:38:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:38:59 smithi122 ceph-mon[22174]: pgmap v538: 129 pgs: 129 active+clean; 6.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 48 KiB/s wr, 17 op/s 2024-08-28T19:38:59.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:38:59 smithi033 ceph-mon[18549]: pgmap v538: 129 pgs: 129 active+clean; 6.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 48 KiB/s wr, 17 op/s 2024-08-28T19:39:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:01 smithi059 ceph-mon[22052]: pgmap v539: 129 pgs: 129 active+clean; 6.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-08-28T19:39:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:01 smithi122 ceph-mon[22174]: pgmap v539: 129 pgs: 129 active+clean; 6.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-08-28T19:39:01.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:01 smithi033 ceph-mon[18549]: pgmap v539: 129 pgs: 129 active+clean; 6.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-08-28T19:39:03.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:03 smithi059 ceph-mon[22052]: pgmap v540: 129 pgs: 129 active+clean; 6.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-08-28T19:39:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:03 smithi122 ceph-mon[22174]: pgmap v540: 129 pgs: 129 active+clean; 6.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-08-28T19:39:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:03 smithi033 ceph-mon[18549]: pgmap v540: 129 pgs: 129 active+clean; 6.5 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-08-28T19:39:05.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:05 smithi059 ceph-mon[22052]: pgmap v541: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 95 KiB/s wr, 35 op/s 2024-08-28T19:39:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:05 smithi059 ceph-mon[22052]: osdmap e85: 12 total, 12 up, 12 in 2024-08-28T19:39:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:05 smithi122 ceph-mon[22174]: pgmap v541: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 95 KiB/s wr, 35 op/s 2024-08-28T19:39:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:05 smithi122 ceph-mon[22174]: osdmap e85: 12 total, 12 up, 12 in 2024-08-28T19:39:05.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:05 smithi033 ceph-mon[18549]: pgmap v541: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 95 KiB/s wr, 35 op/s 2024-08-28T19:39:05.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:05 smithi033 ceph-mon[18549]: osdmap e85: 12 total, 12 up, 12 in 2024-08-28T19:39:07.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:07 smithi059 ceph-mon[22052]: pgmap v543: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 95 KiB/s wr, 36 op/s 2024-08-28T19:39:07.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:07 smithi122 ceph-mon[22174]: pgmap v543: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 95 KiB/s wr, 36 op/s 2024-08-28T19:39:07.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:07 smithi033 ceph-mon[18549]: pgmap v543: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 95 KiB/s wr, 36 op/s 2024-08-28T19:39:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:09 smithi122 ceph-mon[22174]: pgmap v544: 129 pgs: 129 active+clean; 6.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:39:09.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:09 smithi033 ceph-mon[18549]: pgmap v544: 129 pgs: 129 active+clean; 6.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:39:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:09 smithi059 ceph-mon[22052]: pgmap v544: 129 pgs: 129 active+clean; 6.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:39:11.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:11 smithi122 ceph-mon[22174]: pgmap v545: 129 pgs: 129 active+clean; 6.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:39:11.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:11 smithi033 ceph-mon[18549]: pgmap v545: 129 pgs: 129 active+clean; 6.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:39:12.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:11 smithi059 ceph-mon[22052]: pgmap v545: 129 pgs: 129 active+clean; 6.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:39:13.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:13 smithi122 ceph-mon[22174]: pgmap v546: 129 pgs: 129 active+clean; 6.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:39:13.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:13 smithi033 ceph-mon[18549]: pgmap v546: 129 pgs: 129 active+clean; 6.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:39:14.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:13 smithi059 ceph-mon[22052]: pgmap v546: 129 pgs: 129 active+clean; 6.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:39:15.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:15 smithi033 ceph-mon[18549]: pgmap v547: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:15.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:15 smithi033 ceph-mon[18549]: osdmap e86: 12 total, 12 up, 12 in 2024-08-28T19:39:15.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:15 smithi059 ceph-mon[22052]: pgmap v547: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:15 smithi059 ceph-mon[22052]: osdmap e86: 12 total, 12 up, 12 in 2024-08-28T19:39:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:15 smithi122 ceph-mon[22174]: pgmap v547: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:15 smithi122 ceph-mon[22174]: osdmap e86: 12 total, 12 up, 12 in 2024-08-28T19:39:17.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:17 smithi033 ceph-mon[18549]: pgmap v549: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:17.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:17 smithi059 ceph-mon[22052]: pgmap v549: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:17 smithi122 ceph-mon[22174]: pgmap v549: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:18.875 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:39:19.144 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:39:19.583 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:19 smithi033 ceph-mon[18549]: pgmap v550: 129 pgs: 129 active+clean; 7.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:19.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.677+0000 7f969892a640 1 -- 172.21.15.33:0/1613539496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9694108160 msgr2=0x7f9694108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:19.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.677+0000 7f969892a640 1 --2- 172.21.15.33:0/1613539496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9694108160 0x7f9694108570 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f9688009900 tx=0x7f968802a410 comp rx=0 tx=0).stop 2024-08-28T19:39:19.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.677+0000 7f969892a640 1 -- 172.21.15.33:0/1613539496 shutdown_connections 2024-08-28T19:39:19.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.677+0000 7f969892a640 1 --2- 172.21.15.33:0/1613539496 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9694108ab0 0x7f969410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.677+0000 7f969892a640 1 --2- 172.21.15.33:0/1613539496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9694108160 0x7f9694108570 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.677+0000 7f969892a640 1 --2- 172.21.15.33:0/1613539496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9694102820 0x7f9694102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.677+0000 7f969892a640 1 -- 172.21.15.33:0/1613539496 >> 172.21.15.33:0/1613539496 conn(0x7f9694079510 msgr2=0x7f9694079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.677+0000 7f969892a640 1 -- 172.21.15.33:0/1613539496 shutdown_connections 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.677+0000 7f969892a640 1 -- 172.21.15.33:0/1613539496 wait complete. 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f969892a640 1 Processor -- start 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f969892a640 1 -- start start 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f969892a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9694102820 0x7f9694199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f969892a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9694108160 0x7f96941997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f969892a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9694108ab0 0x7f969419ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f969892a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9694112740 con 0x7f9694108ab0 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f969892a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f96941125c0 con 0x7f9694108160 2024-08-28T19:39:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f969892a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f96941128c0 con 0x7f9694102820 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f9692d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9694108ab0 0x7f969419ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f9692d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9694108ab0 0x7f969419ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50082/0 (socket says 172.21.15.33:50082) 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f969259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9694102820 0x7f9694199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f9692d9d640 1 -- 172.21.15.33:0/1106500862 learned_addr learned my addr 172.21.15.33:0/1106500862 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f9691d9b640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9694108160 0x7f96941997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f9692d9d640 1 -- 172.21.15.33:0/1106500862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9694102820 msgr2=0x7f9694199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.678+0000 7f9692d9d640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9694102820 0x7f9694199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.679+0000 7f9692d9d640 1 -- 172.21.15.33:0/1106500862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9694108160 msgr2=0x7f96941997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.679+0000 7f9692d9d640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9694108160 0x7f96941997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.679+0000 7f9692d9d640 1 -- 172.21.15.33:0/1106500862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969419f1a0 con 0x7f9694108ab0 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.679+0000 7f969259c640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9694102820 0x7f9694199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.679+0000 7f9692d9d640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9694108ab0 0x7f969419ea70 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f968c00eaa0 tx=0x7f968c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.679+0000 7f96837fe640 1 -- 172.21.15.33:0/1106500862 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c00cdb0 con 0x7f9694108ab0 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.679+0000 7f969892a640 1 -- 172.21.15.33:0/1106500862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969419f490 con 0x7f9694108ab0 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.679+0000 7f96837fe640 1 -- 172.21.15.33:0/1106500862 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f968c005020 con 0x7f9694108ab0 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.679+0000 7f96837fe640 1 -- 172.21.15.33:0/1106500862 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c0116d0 con 0x7f9694108ab0 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.679+0000 7f969892a640 1 -- 172.21.15.33:0/1106500862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96941a5bf0 con 0x7f9694108ab0 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f969ee9f740 1 Processor -- start 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f96837fe640 1 -- 172.21.15.33:0/1106500862 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f968c0054a0 con 0x7f9694108ab0 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f969ee9f740 1 -- start start 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989e6070 0x563898d8b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989bd1b0 0x563898d8b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989c5390 0x563898d8bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f969ee9f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563898d02630 con 0x5638989e6070 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f969ee9f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563898cf1bc0 con 0x5638989bd1b0 2024-08-28T19:39:19.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f969ee9f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563898cf5b70 con 0x5638989c5390 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f9691d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989e6070 0x563898d8b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f9691d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989e6070 0x563898d8b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50098/0 (socket says 172.21.15.33:50098) 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.682+0000 7f9691d9b640 1 -- 172.21.15.33:0/413987879 learned_addr learned my addr 172.21.15.33:0/413987879 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f96837fe640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f967c0b4ca0 0x7f967c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f969259c640 1 --2- 172.21.15.33:0/413987879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989bd1b0 0x563898d8b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9691d9b640 1 -- 172.21.15.33:0/413987879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989c5390 msgr2=0x563898d8bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9691d9b640 1 --2- 172.21.15.33:0/413987879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989c5390 0x563898d8bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9691d9b640 1 -- 172.21.15.33:0/413987879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989bd1b0 msgr2=0x563898d8b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9691d9b640 1 --2- 172.21.15.33:0/413987879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989bd1b0 0x563898d8b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9691d9b640 1 -- 172.21.15.33:0/413987879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563898a51650 con 0x5638989e6070 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f969259c640 1 --2- 172.21.15.33:0/413987879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989bd1b0 0x563898d8b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9692d9d640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f967c0b4ca0 0x7f967c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f96837fe640 1 -- 172.21.15.33:0/1106500862 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f968c0e5960 con 0x7f9694108ab0 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9691d9b640 1 --2- 172.21.15.33:0/413987879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989e6070 0x563898d8b2c0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f9688009900 tx=0x7f9688032d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ca2fbe50e2a8a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9680ff9640 1 -- 172.21.15.33:0/413987879 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688035040 con 0x5638989e6070 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9692d9d640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f967c0b4ca0 0x7f967c0b71b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f968c077fd0 tx=0x7f968c079040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9680ff9640 1 -- 172.21.15.33:0/413987879 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96880316a0 con 0x5638989e6070 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.683+0000 7f9680ff9640 1 -- 172.21.15.33:0/413987879 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688004750 con 0x5638989e6070 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.684+0000 7f969ee9f740 1 -- 172.21.15.33:0/413987879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989e6070 msgr2=0x563898d8b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.684+0000 7f969ee9f740 1 --2- 172.21.15.33:0/413987879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989e6070 0x563898d8b2c0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f9688009900 tx=0x7f9688032d40 comp rx=0 tx=0).stop 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.684+0000 7f969ee9f740 1 -- 172.21.15.33:0/413987879 shutdown_connections 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.684+0000 7f969ee9f740 1 --2- 172.21.15.33:0/413987879 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989c5390 0x563898d8bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.684+0000 7f969ee9f740 1 --2- 172.21.15.33:0/413987879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989bd1b0 0x563898d8b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.684+0000 7f969ee9f740 1 --2- 172.21.15.33:0/413987879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989e6070 0x563898d8b2c0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.684+0000 7f969ee9f740 1 -- 172.21.15.33:0/413987879 >> 172.21.15.33:0/413987879 conn(0x5638989da460 msgr2=0x563898d891b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:19.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.684+0000 7f969ee9f740 1 -- 172.21.15.33:0/413987879 shutdown_connections 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.684+0000 7f969ee9f740 1 -- 172.21.15.33:0/413987879 wait complete. 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f969ee9f740 1 -- start start 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f969ee9f740 1 Processor -- start 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989bd1b0 0x563898d96ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989c5390 0x563898d97020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989e6070 0x563898da4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f969ee9f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563898b54700 con 0x5638989bd1b0 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f969ee9f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563898c78700 con 0x5638989c5390 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f969ee9f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563898d9bc50 con 0x5638989e6070 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f969ee9f740 10 client.0 _ll_register_callbacks cb 0x563898ca7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f9691d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989bd1b0 0x563898d96ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f9691d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989bd1b0 0x563898d96ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50108/0 (socket says 172.21.15.33:50108) 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.685+0000 7f9691d9b640 1 -- 172.21.15.33:0/1924543782 learned_addr learned my addr 172.21.15.33:0/1924543782 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f969259c640 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989c5390 0x563898d97020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9691d9b640 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989e6070 0x563898da4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9691d9b640 1 -- 172.21.15.33:0/1924543782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989e6070 msgr2=0x563898da4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9691d9b640 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989e6070 0x563898da4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9691d9b640 1 -- 172.21.15.33:0/1924543782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989c5390 msgr2=0x563898d97020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9691d9b640 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989c5390 0x563898d97020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9691d9b640 1 -- 172.21.15.33:0/1924543782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563898cb18b0 con 0x5638989bd1b0 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f969259c640 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989c5390 0x563898d97020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:39:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9691d9b640 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989bd1b0 0x563898d96ae0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f9688032fd0 tx=0x7f9688005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32ce5a5e4816b07 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9679ffb640 1 -- 172.21.15.33:0/1924543782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688004ad0 con 0x5638989bd1b0 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f969ee9f740 1 -- 172.21.15.33:0/1924543782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96880316a0 con 0x5638989bd1b0 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9679ffb640 1 -- 172.21.15.33:0/1924543782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f9688004c70 con 0x5638989bd1b0 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9679ffb640 1 -- 172.21.15.33:0/1924543782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9688005610 con 0x5638989bd1b0 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f969ee9f740 10 client.17478 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f969ee9f740 1 -- 172.21.15.33:0/1924543782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563898da7ab0 con 0x5638989bd1b0 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.686+0000 7f9679ffb640 1 -- 172.21.15.33:0/1924543782 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96880316a0 con 0x5638989bd1b0 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.687+0000 7f9679ffb640 1 -- 172.21.15.33:0/1924543782 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f96880453f0 con 0x5638989bd1b0 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.687+0000 7f969ee9f740 10 client.17478 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.687+0000 7f969ee9f740 10 client.17478 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:39:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.687+0000 7f969ee9f740 20 client.17478 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.687+0000 7f969ee9f740 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5638989a49f0 0x563898daae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.687+0000 7f969ee9f740 4 client.17478 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.687+0000 7f969ee9f740 1 -- 172.21.15.33:0/1924543782 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563898d04580 con 0x5638989a49f0 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.687+0000 7f969259c640 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5638989a49f0 0x563898daae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f9679ffb640 10 client.17478 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f969259c640 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5638989a49f0 0x563898daae10 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44f350e1f0ba54a7 server_cookie=7ef69b7ae4daad08 in_seq=0 out_seq=0 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f9679ffb640 1 -- 172.21.15.33:0/1924543782 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563898d04580 con 0x5638989a49f0 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f9679ffb640 10 client.17478 handle_command_reply: tid=0 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f969ee9f740 1 client.17478 shutdown 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f969ee9f740 1 -- 172.21.15.33:0/1924543782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989bd1b0 msgr2=0x563898d96ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f969ee9f740 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989bd1b0 0x563898d96ae0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f9688032fd0 tx=0x7f9688005300 comp rx=0 tx=0).stop 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f969ee9f740 1 -- 172.21.15.33:0/1924543782 shutdown_connections 2024-08-28T19:39:19.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f969ee9f740 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989e6070 0x563898da4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f969ee9f740 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989c5390 0x563898d97020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.688+0000 7f969ee9f740 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5638989a49f0 0x563898daae10 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.689+0000 7f969ee9f740 1 --2- 172.21.15.33:0/1924543782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989bd1b0 0x563898d96ae0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.689+0000 7f969ee9f740 1 -- 172.21.15.33:0/1924543782 >> 172.21.15.33:0/1924543782 conn(0x5638989da460 msgr2=0x563898d8e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:19.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.689+0000 7f9679ffb640 0 client.17478 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:19.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.689+0000 7f969ee9f740 1 -- 172.21.15.33:0/1924543782 shutdown_connections 2024-08-28T19:39:19.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.689+0000 7f969ee9f740 1 -- 172.21.15.33:0/1924543782 wait complete. 2024-08-28T19:39:19.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.689+0000 7f969ee9f740 20 client.17478 trim_cache size 0 max 16384 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969ee9f740 1 Processor -- start 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969ee9f740 1 -- start start 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 0x563898d8ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898d93cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 0x563898d94210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969ee9f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96941aea10 con 0x5638989c5390 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969ee9f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f96941b0550 con 0x5638989e6070 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969ee9f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f96941af0e0 con 0x5638989bd1b0 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898d93cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898d93cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50112/0 (socket says 172.21.15.33:50112) 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f969259c640 1 -- 172.21.15.33:0/354118444 learned_addr learned my addr 172.21.15.33:0/354118444 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:19.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.707+0000 7f9691d9b640 1 --2- 172.21.15.33:0/354118444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 0x563898d8ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f9691d9b640 1 --2- 172.21.15.33:0/354118444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 0x563898d94210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f969259c640 1 -- 172.21.15.33:0/354118444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 msgr2=0x563898d8ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f969259c640 1 --2- 172.21.15.33:0/354118444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 0x563898d8ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f969259c640 1 -- 172.21.15.33:0/354118444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 msgr2=0x563898d94210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f969259c640 1 --2- 172.21.15.33:0/354118444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 0x563898d94210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f969259c640 1 -- 172.21.15.33:0/354118444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563898d8e120 con 0x5638989c5390 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f9691d9b640 1 --2- 172.21.15.33:0/354118444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 0x563898d94210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f969259c640 1 --2- 172.21.15.33:0/354118444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898d93cd0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f96840058c0 tx=0x7f9684013990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56a450e521128f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f967bfff640 1 -- 172.21.15.33:0/354118444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684021040 con 0x5638989c5390 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f967bfff640 1 -- 172.21.15.33:0/354118444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96840054d0 con 0x5638989c5390 2024-08-28T19:39:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.708+0000 7f967bfff640 1 -- 172.21.15.33:0/354118444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684004e00 con 0x5638989c5390 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.709+0000 7f969ee9f740 1 -- 172.21.15.33:0/354118444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 msgr2=0x563898d93cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.709+0000 7f969ee9f740 1 --2- 172.21.15.33:0/354118444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898d93cd0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f96840058c0 tx=0x7f9684013990 comp rx=0 tx=0).stop 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.709+0000 7f969ee9f740 1 -- 172.21.15.33:0/354118444 shutdown_connections 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.709+0000 7f969ee9f740 1 --2- 172.21.15.33:0/354118444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 0x563898d94210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.709+0000 7f969ee9f740 1 --2- 172.21.15.33:0/354118444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898d93cd0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.709+0000 7f969ee9f740 1 --2- 172.21.15.33:0/354118444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 0x563898d8ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.709+0000 7f969ee9f740 1 -- 172.21.15.33:0/354118444 >> 172.21.15.33:0/354118444 conn(0x5638989da460 msgr2=0x563898d8e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.709+0000 7f969ee9f740 1 -- 172.21.15.33:0/354118444 shutdown_connections 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.709+0000 7f969ee9f740 1 -- 172.21.15.33:0/354118444 wait complete. 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.709+0000 7f969ee9f740 1 -- start start 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969ee9f740 1 Processor -- start 2024-08-28T19:39:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 0x563898dabf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898dac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969ee9f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 0x563898dac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969ee9f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96941afe80 con 0x5638989c5390 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969ee9f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f96941af7b0 con 0x5638989e6070 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969ee9f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f96941aca10 con 0x5638989bd1b0 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969ee9f740 10 client.0 _ll_register_callbacks cb 0x7f9688005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898dac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898dac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50118/0 (socket says 172.21.15.33:50118) 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969259c640 1 -- 172.21.15.33:0/324172632 learned_addr learned my addr 172.21.15.33:0/324172632 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f9691d9b640 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 0x563898dac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f9691d9b640 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 0x563898dabf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969259c640 1 -- 172.21.15.33:0/324172632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 msgr2=0x563898dabf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969259c640 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 0x563898dabf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969259c640 1 -- 172.21.15.33:0/324172632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 msgr2=0x563898dac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969259c640 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 0x563898dac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f969259c640 1 -- 172.21.15.33:0/324172632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563898e146c0 con 0x5638989c5390 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.710+0000 7f9691d9b640 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 0x563898dabf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f969259c640 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898dac4b0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f9684000c00 tx=0x7f96840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ffad9b91c11671 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f9679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f9679ffb640 1 -- 172.21.15.33:0/324172632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684034060 con 0x5638989c5390 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f969ee9f740 1 -- 172.21.15.33:0/324172632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96840054d0 con 0x5638989c5390 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f9679ffb640 1 -- 172.21.15.33:0/324172632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f9684004230 con 0x5638989c5390 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f9679ffb640 1 -- 172.21.15.33:0/324172632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f968403b050 con 0x5638989c5390 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f969ee9f740 10 client.17484 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f969ee9f740 1 -- 172.21.15.33:0/324172632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563898e158c0 con 0x5638989c5390 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f9679ffb640 1 -- 172.21.15.33:0/324172632 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96840054d0 con 0x5638989c5390 2024-08-28T19:39:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f9679ffb640 1 -- 172.21.15.33:0/324172632 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f968400f8d0 con 0x5638989c5390 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f969ee9f740 10 client.17484 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f969ee9f740 10 client.17484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f969ee9f740 20 client.17484 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f969ee9f740 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563898979da0 0x563898e17fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f969ee9f740 4 client.17484 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.711+0000 7f969ee9f740 1 -- 172.21.15.33:0/324172632 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563898d00020 con 0x563898979da0 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.712+0000 7f9691d9b640 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563898979da0 0x563898e17fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.712+0000 7f9691d9b640 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563898979da0 0x563898e17fc0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35063d8b054ca4de server_cookie=2627c40460cd5f97 in_seq=0 out_seq=0 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.712+0000 7f9679ffb640 10 client.17484 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.712+0000 7f9679ffb640 1 -- 172.21.15.33:0/324172632 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x563898d00020 con 0x563898979da0 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.712+0000 7f9679ffb640 10 client.17484 handle_command_reply: tid=0 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.712+0000 7f969ee9f740 1 client.17484 shutdown 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 1 -- 172.21.15.33:0/324172632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 msgr2=0x563898dac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898dac4b0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f9684000c00 tx=0x7f96840047c0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 1 -- 172.21.15.33:0/324172632 shutdown_connections 2024-08-28T19:39:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638989e6070 0x563898dac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563898979da0 0x563898e17fc0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5638989c5390 0x563898dac4b0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 1 --2- 172.21.15.33:0/324172632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5638989bd1b0 0x563898dabf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f9679ffb640 0 client.17484 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 1 -- 172.21.15.33:0/324172632 >> 172.21.15.33:0/324172632 conn(0x5638989da460 msgr2=0x563898d97da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 1 -- 172.21.15.33:0/324172632 shutdown_connections 2024-08-28T19:39:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 1 -- 172.21.15.33:0/324172632 wait complete. 2024-08-28T19:39:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969ee9f740 20 client.17484 trim_cache size 0 max 16384 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:19.719 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.721 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.722 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.723 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:19.724 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:19.725 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:19.725 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:19.725 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:39:19.725 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:39:19.725 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:39:19.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969892a640 1 -- 172.21.15.33:0/1106500862 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f967c0b4ca0 msgr2=0x7f967c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:19.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969892a640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f967c0b4ca0 0x7f967c0b71b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f968c077fd0 tx=0x7f968c079040 comp rx=0 tx=0).stop 2024-08-28T19:39:19.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969892a640 1 -- 172.21.15.33:0/1106500862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9694108ab0 msgr2=0x7f969419ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:19.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969892a640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9694108ab0 0x7f969419ea70 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f968c00eaa0 tx=0x7f968c00ef60 comp rx=0 tx=0).stop 2024-08-28T19:39:19.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969892a640 1 -- 172.21.15.33:0/1106500862 shutdown_connections 2024-08-28T19:39:19.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969892a640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9694108ab0 0x7f969419ea70 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969892a640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9694108160 0x7f96941997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969892a640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f967c0b4ca0 0x7f967c0b71b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969892a640 1 --2- 172.21.15.33:0/1106500862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9694102820 0x7f9694199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:19.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.713+0000 7f969892a640 1 -- 172.21.15.33:0/1106500862 >> 172.21.15.33:0/1106500862 conn(0x7f9694079510 msgr2=0x7f96941062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:19.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.714+0000 7f969892a640 1 -- 172.21.15.33:0/1106500862 shutdown_connections 2024-08-28T19:39:19.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:19.714+0000 7f969892a640 1 -- 172.21.15.33:0/1106500862 wait complete. 2024-08-28T19:39:19.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:19 smithi059 ceph-mon[22052]: pgmap v550: 129 pgs: 129 active+clean; 7.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:19 smithi122 ceph-mon[22174]: pgmap v550: 129 pgs: 129 active+clean; 7.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:20.544 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:39:20.544 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:39:20.806 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:39:21.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.335+0000 7f43ecf76640 1 -- 172.21.15.33:0/1061080253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43e8108af0 msgr2=0x7f43e810f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:21.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.335+0000 7f43ecf76640 1 --2- 172.21.15.33:0/1061080253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43e8108af0 0x7f43e810f320 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009ca0 tx=0x7f43e002a8e0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.335+0000 7f43ecf76640 1 -- 172.21.15.33:0/1061080253 shutdown_connections 2024-08-28T19:39:21.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.335+0000 7f43ecf76640 1 --2- 172.21.15.33:0/1061080253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43e8108af0 0x7f43e810f320 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.335+0000 7f43ecf76640 1 --2- 172.21.15.33:0/1061080253 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43e81081a0 0x7f43e81085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.335+0000 7f43ecf76640 1 --2- 172.21.15.33:0/1061080253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e8102f30 0x7f43e8103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.335+0000 7f43ecf76640 1 -- 172.21.15.33:0/1061080253 >> 172.21.15.33:0/1061080253 conn(0x7f43e8079d30 msgr2=0x7f43e807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:21.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.335+0000 7f43ecf76640 1 -- 172.21.15.33:0/1061080253 shutdown_connections 2024-08-28T19:39:21.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.335+0000 7f43ecf76640 1 -- 172.21.15.33:0/1061080253 wait complete. 2024-08-28T19:39:21.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43ecf76640 1 Processor -- start 2024-08-28T19:39:21.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43ecf76640 1 -- start start 2024-08-28T19:39:21.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43ecf76640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43e8102f30 0x7f43e819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:21.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43ecf76640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43e81081a0 0x7f43e819a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43ecf76640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e8108af0 0x7f43e819fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43ecf76640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f43e81138f0 con 0x7f43e81081a0 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43ecf76640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43e8113770 con 0x7f43e8108af0 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43ecf76640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f43e8113a70 con 0x7f43e8102f30 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43e5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43e81081a0 0x7f43e819a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43e5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43e81081a0 0x7f43e819a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50136/0 (socket says 172.21.15.33:50136) 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43e5d9b640 1 -- 172.21.15.33:0/1952536027 learned_addr learned my addr 172.21.15.33:0/1952536027 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43e659c640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43e8102f30 0x7f43e819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43e6d9d640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e8108af0 0x7f43e819fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43e5d9b640 1 -- 172.21.15.33:0/1952536027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43e8102f30 msgr2=0x7f43e819a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:21.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43e5d9b640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43e8102f30 0x7f43e819a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43e5d9b640 1 -- 172.21.15.33:0/1952536027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e8108af0 msgr2=0x7f43e819fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43e5d9b640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e8108af0 0x7f43e819fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.336+0000 7f43e5d9b640 1 -- 172.21.15.33:0/1952536027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e81a0230 con 0x7f43e81081a0 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.337+0000 7f43e5d9b640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43e81081a0 0x7f43e819a860 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f43dc006fd0 tx=0x7f43dc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.337+0000 7f43d77fe640 1 -- 172.21.15.33:0/1952536027 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc011830 con 0x7f43e81081a0 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.337+0000 7f43ecf76640 1 -- 172.21.15.33:0/1952536027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e81a0520 con 0x7f43e81081a0 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.337+0000 7f43d77fe640 1 -- 172.21.15.33:0/1952536027 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43dc016070 con 0x7f43e81081a0 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.337+0000 7f43d77fe640 1 -- 172.21.15.33:0/1952536027 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc010e00 con 0x7f43e81081a0 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.337+0000 7f43ecf76640 1 -- 172.21.15.33:0/1952536027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e81a6c80 con 0x7f43e81081a0 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.338+0000 7f43ecf76640 1 -- 172.21.15.33:0/1952536027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e8103340 con 0x7f43e81081a0 2024-08-28T19:39:21.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.340+0000 7f43d77fe640 1 -- 172.21.15.33:0/1952536027 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f43dc0119d0 con 0x7f43e81081a0 2024-08-28T19:39:21.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.341+0000 7f43d77fe640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43d00b4ca0 0x7f43d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:21.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.341+0000 7f43e659c640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43d00b4ca0 0x7f43d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:21.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.341+0000 7f43d77fe640 1 -- 172.21.15.33:0/1952536027 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f43dc0e5460 con 0x7f43e81081a0 2024-08-28T19:39:21.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.341+0000 7f43e659c640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43d00b4ca0 0x7f43d00b71b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f43d800bbe0 tx=0x7f43d800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:21.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.344+0000 7f43d77fe640 1 -- 172.21.15.33:0/1952536027 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f43dc0abf50 con 0x7f43e81081a0 2024-08-28T19:39:21.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.567+0000 7f43ecf76640 1 -- 172.21.15.33:0/1952536027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43e819b3f0 con 0x7f43e81081a0 2024-08-28T19:39:21.568 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:21 smithi033 ceph-mon[18549]: pgmap v551: 129 pgs: 129 active+clean; 7.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:21.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.568+0000 7f43d77fe640 1 -- 172.21.15.33:0/1952536027 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f43dc0ab850 con 0x7f43e81081a0 2024-08-28T19:39:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:39:21.569 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:39:21.570 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:39:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 -- 172.21.15.33:0/1952536027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43d00b4ca0 msgr2=0x7f43d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43d00b4ca0 0x7f43d00b71b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f43d800bbe0 tx=0x7f43d800b390 comp rx=0 tx=0).stop 2024-08-28T19:39:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 -- 172.21.15.33:0/1952536027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43e81081a0 msgr2=0x7f43e819a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43e81081a0 0x7f43e819a860 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f43dc006fd0 tx=0x7f43dc00b8e0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 -- 172.21.15.33:0/1952536027 shutdown_connections 2024-08-28T19:39:21.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43e8108af0 0x7f43e819fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43e81081a0 0x7f43e819a860 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43d00b4ca0 0x7f43d00b71b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 --2- 172.21.15.33:0/1952536027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f43e8102f30 0x7f43e819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:21.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 -- 172.21.15.33:0/1952536027 >> 172.21.15.33:0/1952536027 conn(0x7f43e8079d30 msgr2=0x7f43e8106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:21.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 -- 172.21.15.33:0/1952536027 shutdown_connections 2024-08-28T19:39:21.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:21.570+0000 7f43ecf76640 1 -- 172.21.15.33:0/1952536027 wait complete. 2024-08-28T19:39:21.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:21 smithi059 ceph-mon[22052]: pgmap v551: 129 pgs: 129 active+clean; 7.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:21 smithi122 ceph-mon[22174]: pgmap v551: 129 pgs: 129 active+clean; 7.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:22.288 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:39:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:39:22.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:22 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1952536027' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:39:22.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:22 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1952536027' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:39:22.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:22 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1952536027' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:39:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.045+0000 7f80b1fc9640 1 -- 172.21.15.33:0/2802178127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ac108ab0 msgr2=0x7f80ac10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.045+0000 7f80b1fc9640 1 --2- 172.21.15.33:0/2802178127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ac108ab0 0x7f80ac10f2e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009ca0 tx=0x7f80a402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.045+0000 7f80b1fc9640 1 -- 172.21.15.33:0/2802178127 shutdown_connections 2024-08-28T19:39:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.045+0000 7f80b1fc9640 1 --2- 172.21.15.33:0/2802178127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ac108ab0 0x7f80ac10f2e0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.045+0000 7f80b1fc9640 1 --2- 172.21.15.33:0/2802178127 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80ac108160 0x7f80ac108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.045+0000 7f80b1fc9640 1 --2- 172.21.15.33:0/2802178127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac102820 0x7f80ac102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.045+0000 7f80b1fc9640 1 -- 172.21.15.33:0/2802178127 >> 172.21.15.33:0/2802178127 conn(0x7f80ac0794e0 msgr2=0x7f80ac0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.045+0000 7f80b1fc9640 1 -- 172.21.15.33:0/2802178127 shutdown_connections 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.045+0000 7f80b1fc9640 1 -- 172.21.15.33:0/2802178127 wait complete. 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80b1fc9640 1 Processor -- start 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80b1fc9640 1 -- start start 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80b1fc9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac102820 0x7f80ac19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80b1fc9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ac108160 0x7f80ac19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80b1fc9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80ac108ab0 0x7f80ac19fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80b1fc9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac112780 con 0x7f80ac108160 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80b1fc9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac112600 con 0x7f80ac102820 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80b1fc9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac112900 con 0x7f80ac108ab0 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80a2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ac108160 0x7f80ac19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80a2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ac108160 0x7f80ac19a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50154/0 (socket says 172.21.15.33:50154) 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.046+0000 7f80a2ffd640 1 -- 172.21.15.33:0/500135579 learned_addr learned my addr 172.21.15.33:0/500135579 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac102820 0x7f80ac19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80abfff640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80ac108ab0 0x7f80ac19fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80a2ffd640 1 -- 172.21.15.33:0/500135579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80ac108ab0 msgr2=0x7f80ac19fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80ac108ab0 0x7f80ac19fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80a2ffd640 1 -- 172.21.15.33:0/500135579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac102820 msgr2=0x7f80ac19a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac102820 0x7f80ac19a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80a2ffd640 1 -- 172.21.15.33:0/500135579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ac1a0190 con 0x7f80ac108160 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80abfff640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80ac108ab0 0x7f80ac19fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ac108160 0x7f80ac19a7c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f809400b450 tx=0x7f809400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80a97fa640 1 -- 172.21.15.33:0/500135579 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8094015020 con 0x7f80ac108160 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80a97fa640 1 -- 172.21.15.33:0/500135579 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8094011d40 con 0x7f80ac108160 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80b1fc9640 1 -- 172.21.15.33:0/500135579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ac1a0480 con 0x7f80ac108160 2024-08-28T19:39:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80a97fa640 1 -- 172.21.15.33:0/500135579 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809400f340 con 0x7f80ac108160 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.047+0000 7f80b1fc9640 1 -- 172.21.15.33:0/500135579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ac1a6c60 con 0x7f80ac108160 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80b853e740 1 Processor -- start 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80b853e740 1 -- start start 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80a97fa640 1 -- 172.21.15.33:0/500135579 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8094018020 con 0x7f80ac108160 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80b853e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3efd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80b853e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b2f1b0 0x5589a3efd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80b853e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b37390 0x5589a3efdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80b853e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5589a3e74680 con 0x5589a3b58070 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80b853e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5589a3e63c10 con 0x5589a3b37390 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80b853e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5589a3e67bc0 con 0x5589a3b2f1b0 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80abfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3efd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80abfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3efd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50162/0 (socket says 172.21.15.33:50162) 2024-08-28T19:39:23.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.050+0000 7f80abfff640 1 -- 172.21.15.33:0/2195133003 learned_addr learned my addr 172.21.15.33:0/2195133003 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/2195133003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b2f1b0 0x5589a3efd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/2195133003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b37390 0x5589a3efdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80abfff640 1 -- 172.21.15.33:0/2195133003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b2f1b0 msgr2=0x5589a3efd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80abfff640 1 --2- 172.21.15.33:0/2195133003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b2f1b0 0x5589a3efd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80abfff640 1 -- 172.21.15.33:0/2195133003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b37390 msgr2=0x5589a3efdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80abfff640 1 --2- 172.21.15.33:0/2195133003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b37390 0x5589a3efdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80abfff640 1 -- 172.21.15.33:0/2195133003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a3bc3650 con 0x5589a3b58070 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80a97fa640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80980b4d20 0x7f80980b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80abfff640 1 --2- 172.21.15.33:0/2195133003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3efd310 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f80a4006010 tx=0x7f80a4009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac3af49ff44388e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80980b4d20 0x7f80980b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80a97fa640 1 -- 172.21.15.33:0/500135579 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f80940e52d0 con 0x7f80ac108160 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80a1ffb640 1 -- 172.21.15.33:0/2195133003 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4031d70 con 0x5589a3b58070 2024-08-28T19:39:23.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80a1ffb640 1 -- 172.21.15.33:0/2195133003 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a4036070 con 0x5589a3b58070 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.051+0000 7f80a1ffb640 1 -- 172.21.15.33:0/2195133003 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a40042a0 con 0x5589a3b58070 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.052+0000 7f80b853e740 1 -- 172.21.15.33:0/2195133003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 msgr2=0x5589a3efd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.052+0000 7f80b853e740 1 --2- 172.21.15.33:0/2195133003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3efd310 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f80a4006010 tx=0x7f80a4009880 comp rx=0 tx=0).stop 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.052+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80980b4d20 0x7f80980b7230 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f809c005fd0 tx=0x7f809c005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.052+0000 7f80b853e740 1 -- 172.21.15.33:0/2195133003 shutdown_connections 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.052+0000 7f80b853e740 1 --2- 172.21.15.33:0/2195133003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b37390 0x5589a3efdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.052+0000 7f80b853e740 1 --2- 172.21.15.33:0/2195133003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b2f1b0 0x5589a3efd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.052+0000 7f80b853e740 1 --2- 172.21.15.33:0/2195133003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3efd310 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.052+0000 7f80b853e740 1 -- 172.21.15.33:0/2195133003 >> 172.21.15.33:0/2195133003 conn(0x5589a3b4c460 msgr2=0x5589a3efb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.052+0000 7f80b853e740 1 -- 172.21.15.33:0/2195133003 shutdown_connections 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.052+0000 7f80b853e740 1 -- 172.21.15.33:0/2195133003 wait complete. 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80b853e740 1 -- start start 2024-08-28T19:39:23.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80b853e740 1 Processor -- start 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80b853e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f08b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80b853e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f09070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80b853e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 0x5589a3f14db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80b853e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5589a3cc6700 con 0x5589a3b37390 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80b853e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5589a3dea750 con 0x5589a3b2f1b0 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80b853e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5589a3f0ba90 con 0x5589a3b58070 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80b853e740 10 client.0 _ll_register_callbacks cb 0x5589a3e19e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80a2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f09070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80a2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f09070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50172/0 (socket says 172.21.15.33:50172) 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80a2ffd640 1 -- 172.21.15.33:0/1558965487 learned_addr learned my addr 172.21.15.33:0/1558965487 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.053+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f08b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80abfff640 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 0x5589a3f14db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80a2ffd640 1 -- 172.21.15.33:0/1558965487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 msgr2=0x5589a3f14db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 0x5589a3f14db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80a2ffd640 1 -- 172.21.15.33:0/1558965487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 msgr2=0x5589a3f08b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f08b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80a2ffd640 1 -- 172.21.15.33:0/1558965487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a3e23900 con 0x5589a3b37390 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80abfff640 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 0x5589a3f14db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f09070 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f809400be10 tx=0x7f80940107e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4088fd5cc140db08 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f808affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f808affd640 1 -- 172.21.15.33:0/1558965487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80940b4280 con 0x5589a3b37390 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f808affd640 1 -- 172.21.15.33:0/1558965487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f80940e8d60 con 0x5589a3b37390 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80b853e740 1 -- 172.21.15.33:0/1558965487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80a4036070 con 0x5589a3b37390 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f808affd640 1 -- 172.21.15.33:0/1558965487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80940ab130 con 0x5589a3b37390 2024-08-28T19:39:23.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80b853e740 10 client.17502 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f80b853e740 1 -- 172.21.15.33:0/1558965487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5589a3f178f0 con 0x5589a3b37390 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.054+0000 7f808affd640 1 -- 172.21.15.33:0/1558965487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a4036070 con 0x5589a3b37390 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.055+0000 7f808affd640 1 -- 172.21.15.33:0/1558965487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f80940aa880 con 0x5589a3b37390 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.055+0000 7f80b853e740 10 client.17502 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.055+0000 7f80b853e740 10 client.17502 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.055+0000 7f80b853e740 20 client.17502 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.055+0000 7f80b853e740 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5589a3b169f0 0x5589a3f1ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.055+0000 7f80b853e740 4 client.17502 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.055+0000 7f80b853e740 1 -- 172.21.15.33:0/1558965487 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589a3e765d0 con 0x5589a3b169f0 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.055+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5589a3b169f0 0x5589a3f1ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.055+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5589a3b169f0 0x5589a3f1ae30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=60eac6e6a7a71dc9 server_cookie=cd7eec93d9c3820f in_seq=0 out_seq=0 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.055+0000 7f808affd640 10 client.17502 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:39:23.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f808affd640 1 -- 172.21.15.33:0/1558965487 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589a3e765d0 con 0x5589a3b169f0 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f808affd640 10 client.17502 handle_command_reply: tid=0 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f80b853e740 1 client.17502 shutdown 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f80b853e740 1 -- 172.21.15.33:0/1558965487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 msgr2=0x5589a3f09070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f80b853e740 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f09070 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f809400be10 tx=0x7f80940107e0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f80b853e740 1 -- 172.21.15.33:0/1558965487 shutdown_connections 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f80b853e740 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5589a3b169f0 0x5589a3f1ae30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f80b853e740 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 0x5589a3f14db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f80b853e740 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f09070 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f808affd640 0 client.17502 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f80b853e740 1 --2- 172.21.15.33:0/1558965487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f08b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f80b853e740 1 -- 172.21.15.33:0/1558965487 >> 172.21.15.33:0/1558965487 conn(0x5589a3b4c460 msgr2=0x5589a3f004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.056+0000 7f80b853e740 1 -- 172.21.15.33:0/1558965487 shutdown_connections 2024-08-28T19:39:23.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.057+0000 7f80b853e740 1 -- 172.21.15.33:0/1558965487 wait complete. 2024-08-28T19:39:23.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.057+0000 7f80b853e740 20 client.17502 trim_cache size 0 max 16384 2024-08-28T19:39:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80b853e740 1 Processor -- start 2024-08-28T19:39:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80b853e740 1 -- start start 2024-08-28T19:39:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80b853e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f07a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80b853e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b37390 0x5589a3f00b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80b853e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3f05d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80b853e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1b0cc0 con 0x5589a3b58070 2024-08-28T19:39:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80b853e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1b2800 con 0x5589a3b2f1b0 2024-08-28T19:39:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80b853e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1b1390 con 0x5589a3b37390 2024-08-28T19:39:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80abfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3f05d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80abfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3f05d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50176/0 (socket says 172.21.15.33:50176) 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80abfff640 1 -- 172.21.15.33:0/3354240514 learned_addr learned my addr 172.21.15.33:0/3354240514 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/3354240514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f07a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/3354240514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b37390 0x5589a3f00b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80abfff640 1 -- 172.21.15.33:0/3354240514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b37390 msgr2=0x5589a3f00b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80abfff640 1 --2- 172.21.15.33:0/3354240514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b37390 0x5589a3f00b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80abfff640 1 -- 172.21.15.33:0/3354240514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 msgr2=0x5589a3f07a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80abfff640 1 --2- 172.21.15.33:0/3354240514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f07a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80abfff640 1 -- 172.21.15.33:0/3354240514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a3f00170 con 0x5589a3b58070 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.070+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/3354240514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f07a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.071+0000 7f80abfff640 1 --2- 172.21.15.33:0/3354240514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3f05d20 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009b20 tx=0x7f80a402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e545e92d8c8b6cf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.071+0000 7f80a17fa640 1 -- 172.21.15.33:0/3354240514 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4051070 con 0x5589a3b58070 2024-08-28T19:39:23.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.071+0000 7f80a17fa640 1 -- 172.21.15.33:0/3354240514 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a4036070 con 0x5589a3b58070 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.071+0000 7f80a17fa640 1 -- 172.21.15.33:0/3354240514 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4004290 con 0x5589a3b58070 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 -- 172.21.15.33:0/3354240514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 msgr2=0x5589a3f05d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 --2- 172.21.15.33:0/3354240514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3f05d20 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009b20 tx=0x7f80a402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 -- 172.21.15.33:0/3354240514 shutdown_connections 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 --2- 172.21.15.33:0/3354240514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b58070 0x5589a3f05d20 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 --2- 172.21.15.33:0/3354240514 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b37390 0x5589a3f00b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 --2- 172.21.15.33:0/3354240514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f07a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 -- 172.21.15.33:0/3354240514 >> 172.21.15.33:0/3354240514 conn(0x5589a3b4c460 msgr2=0x5589a3f00410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 -- 172.21.15.33:0/3354240514 shutdown_connections 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 -- 172.21.15.33:0/3354240514 wait complete. 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 -- start start 2024-08-28T19:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.072+0000 7f80b853e740 1 Processor -- start 2024-08-28T19:39:23.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80b853e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f0cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80b853e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f0d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80b853e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 0x5589a3f847f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80b853e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1b2130 con 0x5589a3b37390 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80b853e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1b1a60 con 0x5589a3b2f1b0 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80b853e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac1aecc0 con 0x5589a3b58070 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80b853e740 10 client.0 _ll_register_callbacks cb 0x7f80940103e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80a2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f0d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80a2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f0d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50184/0 (socket says 172.21.15.33:50184) 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80a2ffd640 1 -- 172.21.15.33:0/2648577479 learned_addr learned my addr 172.21.15.33:0/2648577479 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f0cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80abfff640 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 0x5589a3f847f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80a2ffd640 1 -- 172.21.15.33:0/2648577479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 msgr2=0x5589a3f847f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 0x5589a3f847f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80a2ffd640 1 -- 172.21.15.33:0/2648577479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 msgr2=0x5589a3f0cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f0cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80a2ffd640 1 -- 172.21.15.33:0/2648577479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a3f0dd00 con 0x5589a3b37390 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f0cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f80a2ffd640 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f0d4d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f80940104b0 tx=0x7f80940ab4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e720d6f39d807c1a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f808affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.073+0000 7f808affd640 1 -- 172.21.15.33:0/2648577479 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80940b4990 con 0x5589a3b37390 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f808affd640 1 -- 172.21.15.33:0/2648577479 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f8094011aa0 con 0x5589a3b37390 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f80b853e740 1 -- 172.21.15.33:0/2648577479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80a4036070 con 0x5589a3b37390 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f808affd640 1 -- 172.21.15.33:0/2648577479 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80940aad90 con 0x5589a3b37390 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f80b853e740 10 client.17508 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f80b853e740 1 -- 172.21.15.33:0/2648577479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5589a3f85d10 con 0x5589a3b37390 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f808affd640 1 -- 172.21.15.33:0/2648577479 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a4036070 con 0x5589a3b37390 2024-08-28T19:39:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f808affd640 1 -- 172.21.15.33:0/2648577479 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f80940ce0b0 con 0x5589a3b37390 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f80b853e740 10 client.17508 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f80b853e740 10 client.17508 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f80b853e740 20 client.17508 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f80b853e740 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5589a3aebda0 0x5589a3f88460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f80b853e740 4 client.17508 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.074+0000 7f80b853e740 1 -- 172.21.15.33:0/2648577479 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589a3e72070 con 0x5589a3aebda0 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5589a3aebda0 0x5589a3f88460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f808affd640 10 client.17508 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80ab7fe640 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5589a3aebda0 0x5589a3f88460 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7e714f34884ace44 server_cookie=d4326c13a3e4a249 in_seq=0 out_seq=0 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f808affd640 1 -- 172.21.15.33:0/2648577479 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589a3e72070 con 0x5589a3aebda0 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f808affd640 10 client.17508 handle_command_reply: tid=0 2024-08-28T19:39:23.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80b853e740 1 client.17508 shutdown 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80b853e740 1 -- 172.21.15.33:0/2648577479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 msgr2=0x5589a3f0d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80b853e740 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f0d4d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f80940104b0 tx=0x7f80940ab4c0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80b853e740 1 -- 172.21.15.33:0/2648577479 shutdown_connections 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80b853e740 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5589a3aebda0 0x5589a3f88460 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80b853e740 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5589a3b58070 0x5589a3f847f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80b853e740 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5589a3b37390 0x5589a3f0d4d0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f808affd640 0 client.17508 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80b853e740 1 --2- 172.21.15.33:0/2648577479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5589a3b2f1b0 0x5589a3f0cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.075+0000 7f80b853e740 1 -- 172.21.15.33:0/2648577479 >> 172.21.15.33:0/2648577479 conn(0x5589a3b4c460 msgr2=0x5589a3efe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b853e740 1 -- 172.21.15.33:0/2648577479 shutdown_connections 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b853e740 1 -- 172.21.15.33:0/2648577479 wait complete. 2024-08-28T19:39:23.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b853e740 20 client.17508 trim_cache size 0 max 16384 2024-08-28T19:39:23.083 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:39:23.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b1fc9640 1 -- 172.21.15.33:0/500135579 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80980b4d20 msgr2=0x7f80980b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b1fc9640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80980b4d20 0x7f80980b7230 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f809c005fd0 tx=0x7f809c005c50 comp rx=0 tx=0).stop 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b1fc9640 1 -- 172.21.15.33:0/500135579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ac108160 msgr2=0x7f80ac19a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b1fc9640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ac108160 0x7f80ac19a7c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f809400b450 tx=0x7f809400b910 comp rx=0 tx=0).stop 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b1fc9640 1 -- 172.21.15.33:0/500135579 shutdown_connections 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b1fc9640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f80980b4d20 0x7f80980b7230 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b1fc9640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80ac108ab0 0x7f80ac19fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b1fc9640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ac108160 0x7f80ac19a7c0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b1fc9640 1 --2- 172.21.15.33:0/500135579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80ac102820 0x7f80ac19a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.076+0000 7f80b1fc9640 1 -- 172.21.15.33:0/500135579 >> 172.21.15.33:0/500135579 conn(0x7f80ac0794e0 msgr2=0x7f80ac06bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.077+0000 7f80b1fc9640 1 -- 172.21.15.33:0/500135579 shutdown_connections 2024-08-28T19:39:23.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:23.077+0000 7f80b1fc9640 1 -- 172.21.15.33:0/500135579 wait complete. 2024-08-28T19:39:23.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:23 smithi059 ceph-mon[22052]: pgmap v552: 129 pgs: 129 active+clean; 7.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:23.792 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:23 smithi033 ceph-mon[18549]: pgmap v552: 129 pgs: 129 active+clean; 7.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:23 smithi122 ceph-mon[22174]: pgmap v552: 129 pgs: 129 active+clean; 7.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-08-28T19:39:23.819 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:39:24.074 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:39:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.554+0000 7f1754507640 1 -- 172.21.15.33:0/3588068172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f174c108a90 msgr2=0x7f174c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.554+0000 7f1754507640 1 --2- 172.21.15.33:0/3588068172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f174c108a90 0x7f174c10f2c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1744009ca0 tx=0x7f174402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.554+0000 7f1754507640 1 -- 172.21.15.33:0/3588068172 shutdown_connections 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.554+0000 7f1754507640 1 --2- 172.21.15.33:0/3588068172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f174c108a90 0x7f174c10f2c0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.554+0000 7f1754507640 1 --2- 172.21.15.33:0/3588068172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c108140 0x7f174c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.554+0000 7f1754507640 1 --2- 172.21.15.33:0/3588068172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f174c102800 0x7f174c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.554+0000 7f1754507640 1 -- 172.21.15.33:0/3588068172 >> 172.21.15.33:0/3588068172 conn(0x7f174c0794d0 msgr2=0x7f174c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.554+0000 7f1754507640 1 -- 172.21.15.33:0/3588068172 shutdown_connections 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.554+0000 7f1754507640 1 -- 172.21.15.33:0/3588068172 wait complete. 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.555+0000 7f1754507640 1 Processor -- start 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.555+0000 7f1754507640 1 -- start start 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.555+0000 7f1754507640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f174c102800 0x7f174c19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.555+0000 7f1754507640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c108140 0x7f174c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.555+0000 7f1754507640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f174c108a90 0x7f174c19fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.555+0000 7f1754507640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1126f0 con 0x7f174c108a90 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.555+0000 7f1754507640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f174c112570 con 0x7f174c108140 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.555+0000 7f1754507640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f174c112870 con 0x7f174c102800 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1752aa4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f174c108a90 0x7f174c19fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1752aa4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f174c108a90 0x7f174c19fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50216/0 (socket says 172.21.15.33:50216) 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1752aa4640 1 -- 172.21.15.33:0/154873824 learned_addr learned my addr 172.21.15.33:0/154873824 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f17522a3640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f174c102800 0x7f174c19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1751aa2640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c108140 0x7f174c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1752aa4640 1 -- 172.21.15.33:0/154873824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f174c102800 msgr2=0x7f174c19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1752aa4640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f174c102800 0x7f174c19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1752aa4640 1 -- 172.21.15.33:0/154873824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c108140 msgr2=0x7f174c19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1752aa4640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c108140 0x7f174c19a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1752aa4640 1 -- 172.21.15.33:0/154873824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c1a0120 con 0x7f174c108a90 2024-08-28T19:39:24.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1751aa2640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c108140 0x7f174c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1752aa4640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f174c108a90 0x7f174c19fab0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f1744005cc0 tx=0x7f174402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f17437fe640 1 -- 172.21.15.33:0/154873824 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744003bf0 con 0x7f174c108a90 2024-08-28T19:39:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1754507640 1 -- 172.21.15.33:0/154873824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c1a03b0 con 0x7f174c108a90 2024-08-28T19:39:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f17437fe640 1 -- 172.21.15.33:0/154873824 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1744003d90 con 0x7f174c108a90 2024-08-28T19:39:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f17437fe640 1 -- 172.21.15.33:0/154873824 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174402fbc0 con 0x7f174c108a90 2024-08-28T19:39:24.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.556+0000 7f1754507640 1 -- 172.21.15.33:0/154873824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c1a08f0 con 0x7f174c108a90 2024-08-28T19:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.559+0000 7f175aa7c740 1 Processor -- start 2024-08-28T19:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.559+0000 7f17437fe640 1 -- 172.21.15.33:0/154873824 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f174402fd60 con 0x7f174c108a90 2024-08-28T19:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.559+0000 7f175aa7c740 1 -- start start 2024-08-28T19:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d4f070 0x5567920f4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x5567920f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f175aa7c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55679206b680 con 0x556791d261b0 2024-08-28T19:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f175aa7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55679205ac10 con 0x556791d4f070 2024-08-28T19:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f175aa7c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55679205ebc0 con 0x556791d2e390 2024-08-28T19:39:24.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17522a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17522a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50226/0 (socket says 172.21.15.33:50226) 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17522a3640 1 -- 172.21.15.33:0/3497085100 learned_addr learned my addr 172.21.15.33:0/3497085100 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f1751aa2640 1 --2- 172.21.15.33:0/3497085100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d4f070 0x5567920f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f1751aa2640 1 --2- 172.21.15.33:0/3497085100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x5567920f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17437fe640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17380b4cd0 0x7f17380b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17522a3640 1 -- 172.21.15.33:0/3497085100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 msgr2=0x5567920f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17522a3640 1 --2- 172.21.15.33:0/3497085100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x5567920f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17522a3640 1 -- 172.21.15.33:0/3497085100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d4f070 msgr2=0x5567920f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17522a3640 1 --2- 172.21.15.33:0/3497085100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d4f070 0x5567920f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17522a3640 1 -- 172.21.15.33:0/3497085100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556791dba650 con 0x556791d261b0 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f1752aa4640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17380b4cd0 0x7f17380b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17437fe640 1 -- 172.21.15.33:0/154873824 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f1744106d20 con 0x7f174c108a90 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.560+0000 7f17522a3640 1 --2- 172.21.15.33:0/3497085100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f4850 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f174800cc60 tx=0x7f174800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dc8b00b8e424ea server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.561+0000 7f1740ff9640 1 -- 172.21.15.33:0/3497085100 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748014070 con 0x556791d261b0 2024-08-28T19:39:24.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.561+0000 7f1752aa4640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17380b4cd0 0x7f17380b71e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1744104180 tx=0x7f17440b4040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.561+0000 7f1740ff9640 1 -- 172.21.15.33:0/3497085100 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17480047a0 con 0x556791d261b0 2024-08-28T19:39:24.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.561+0000 7f1740ff9640 1 -- 172.21.15.33:0/3497085100 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748010690 con 0x556791d261b0 2024-08-28T19:39:24.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 -- 172.21.15.33:0/3497085100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 msgr2=0x5567920f4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:24.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 --2- 172.21.15.33:0/3497085100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f4850 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f174800cc60 tx=0x7f174800e720 comp rx=0 tx=0).stop 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 -- 172.21.15.33:0/3497085100 shutdown_connections 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 --2- 172.21.15.33:0/3497085100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x5567920f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 --2- 172.21.15.33:0/3497085100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f4850 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 --2- 172.21.15.33:0/3497085100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d4f070 0x5567920f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 -- 172.21.15.33:0/3497085100 >> 172.21.15.33:0/3497085100 conn(0x556791d43460 msgr2=0x5567920f2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 -- 172.21.15.33:0/3497085100 shutdown_connections 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 -- 172.21.15.33:0/3497085100 wait complete. 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 -- start start 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.562+0000 7f175aa7c740 1 Processor -- start 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d261b0 0x5567920ffaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d2e390 0x5567920fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d4f070 0x55679210bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f175aa7c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556791ebd700 con 0x556791d2e390 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f175aa7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556791fe1750 con 0x556791d261b0 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f175aa7c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556792102af0 con 0x556791d4f070 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f175aa7c740 10 client.0 _ll_register_callbacks cb 0x556792010e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f17522a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d2e390 0x5567920fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f17522a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d2e390 0x5567920fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50232/0 (socket says 172.21.15.33:50232) 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f17522a3640 1 -- 172.21.15.33:0/847977220 learned_addr learned my addr 172.21.15.33:0/847977220 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f1751aa2640 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d261b0 0x5567920ffaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f1751aa2640 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d4f070 0x55679210bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f17522a3640 1 -- 172.21.15.33:0/847977220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d4f070 msgr2=0x55679210bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f17522a3640 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d4f070 0x55679210bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f17522a3640 1 -- 172.21.15.33:0/847977220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d261b0 msgr2=0x5567920ffaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f17522a3640 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d261b0 0x5567920ffaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f17522a3640 1 -- 172.21.15.33:0/847977220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679201a900 con 0x556791d2e390 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f1751aa2640 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d261b0 0x5567920ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f17522a3640 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d2e390 0x5567920fffe0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f1748005230 tx=0x7f1748005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36aa75560751a83b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.563+0000 7f1735ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f1735ffb640 1 -- 172.21.15.33:0/847977220 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748014070 con 0x556791d2e390 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f1735ffb640 1 -- 172.21.15.33:0/847977220 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f1748004020 con 0x556791d2e390 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f175aa7c740 1 -- 172.21.15.33:0/847977220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17480047a0 con 0x556791d2e390 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f1735ffb640 1 -- 172.21.15.33:0/847977220 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1748005610 con 0x556791d2e390 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f175aa7c740 10 client.17520 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f175aa7c740 1 -- 172.21.15.33:0/847977220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55679210e8a0 con 0x556791d2e390 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f1735ffb640 1 -- 172.21.15.33:0/847977220 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17480047a0 con 0x556791d2e390 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f1735ffb640 1 -- 172.21.15.33:0/847977220 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1748022460 con 0x556791d2e390 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f175aa7c740 10 client.17520 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:24.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f175aa7c740 10 client.17520 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f175aa7c740 20 client.17520 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f175aa7c740 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556791d0d9f0 0x556792111cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f175aa7c740 4 client.17520 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.564+0000 7f175aa7c740 1 -- 172.21.15.33:0/847977220 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55679206d5d0 con 0x556791d0d9f0 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.565+0000 7f1751aa2640 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556791d0d9f0 0x556792111cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.565+0000 7f1735ffb640 10 client.17520 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.565+0000 7f1751aa2640 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556791d0d9f0 0x556792111cb0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=767577e6da519f87 server_cookie=6a71b0497214472d in_seq=0 out_seq=0 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f1735ffb640 1 -- 172.21.15.33:0/847977220 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55679206d5d0 con 0x556791d0d9f0 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f1735ffb640 10 client.17520 handle_command_reply: tid=0 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 client.17520 shutdown 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 -- 172.21.15.33:0/847977220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d2e390 msgr2=0x5567920fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d2e390 0x5567920fffe0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f1748005230 tx=0x7f1748005260 comp rx=0 tx=0).stop 2024-08-28T19:39:24.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 -- 172.21.15.33:0/847977220 shutdown_connections 2024-08-28T19:39:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556791d0d9f0 0x556792111cb0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f1735ffb640 0 client.17520 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:39:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d4f070 0x55679210bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d2e390 0x5567920fffe0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 --2- 172.21.15.33:0/847977220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d261b0 0x5567920ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 -- 172.21.15.33:0/847977220 >> 172.21.15.33:0/847977220 conn(0x556791d43460 msgr2=0x5567920f74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 -- 172.21.15.33:0/847977220 shutdown_connections 2024-08-28T19:39:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 1 -- 172.21.15.33:0/847977220 wait complete. 2024-08-28T19:39:24.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.566+0000 7f175aa7c740 20 client.17520 trim_cache size 0 max 16384 2024-08-28T19:39:24.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.579+0000 7f175aa7c740 1 Processor -- start 2024-08-28T19:39:24.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.579+0000 7f175aa7c740 1 -- start start 2024-08-28T19:39:24.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d0d9f0 0x5567920f7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x5567920fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f175aa7c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b0d00 con 0x556791d261b0 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f175aa7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b2840 con 0x556791d0d9f0 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f175aa7c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b13d0 con 0x556791d2e390 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f17522a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f17522a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50240/0 (socket says 172.21.15.33:50240) 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f17522a3640 1 -- 172.21.15.33:0/1571315235 learned_addr learned my addr 172.21.15.33:0/1571315235 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f1751aa2640 1 --2- 172.21.15.33:0/1571315235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x5567920fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f1751aa2640 1 --2- 172.21.15.33:0/1571315235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d0d9f0 0x5567920f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f17522a3640 1 -- 172.21.15.33:0/1571315235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 msgr2=0x5567920fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f17522a3640 1 --2- 172.21.15.33:0/1571315235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x5567920fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f17522a3640 1 -- 172.21.15.33:0/1571315235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d0d9f0 msgr2=0x5567920f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:24.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f17522a3640 1 --2- 172.21.15.33:0/1571315235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d0d9f0 0x5567920f7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f17522a3640 1 -- 172.21.15.33:0/1571315235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567920f2af0 con 0x556791d261b0 2024-08-28T19:39:24.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f1751aa2640 1 --2- 172.21.15.33:0/1571315235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x5567920fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:39:24.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.580+0000 7f17522a3640 1 --2- 172.21.15.33:0/1571315235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f7950 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f1748022830 tx=0x7f1748005350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d19f90ed3f55ce6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:24.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f1737fff640 1 -- 172.21.15.33:0/1571315235 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748014040 con 0x556791d261b0 2024-08-28T19:39:24.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f1737fff640 1 -- 172.21.15.33:0/1571315235 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f174800c830 con 0x556791d261b0 2024-08-28T19:39:24.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f1737fff640 1 -- 172.21.15.33:0/1571315235 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17480108e0 con 0x556791d261b0 2024-08-28T19:39:24.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f175aa7c740 1 -- 172.21.15.33:0/1571315235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 msgr2=0x5567920f7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:24.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f175aa7c740 1 --2- 172.21.15.33:0/1571315235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f7950 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f1748022830 tx=0x7f1748005350 comp rx=0 tx=0).stop 2024-08-28T19:39:24.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f175aa7c740 1 -- 172.21.15.33:0/1571315235 shutdown_connections 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f175aa7c740 1 --2- 172.21.15.33:0/1571315235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x5567920fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f175aa7c740 1 --2- 172.21.15.33:0/1571315235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x5567920f7950 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f175aa7c740 1 --2- 172.21.15.33:0/1571315235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d0d9f0 0x5567920f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f175aa7c740 1 -- 172.21.15.33:0/1571315235 >> 172.21.15.33:0/1571315235 conn(0x556791d43460 msgr2=0x5567920fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f175aa7c740 1 -- 172.21.15.33:0/1571315235 shutdown_connections 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.581+0000 7f175aa7c740 1 -- 172.21.15.33:0/1571315235 wait complete. 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f175aa7c740 1 -- start start 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f175aa7c740 1 Processor -- start 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d0d9f0 0x5567921043e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x556792104920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f175aa7c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x55679217b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f175aa7c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b2170 con 0x556791d261b0 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f175aa7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b1aa0 con 0x556791d0d9f0 2024-08-28T19:39:24.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f175aa7c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1aed00 con 0x556791d2e390 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f175aa7c740 10 client.0 _ll_register_callbacks cb 0x7f173c00e950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f17522a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x556792104920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f17522a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x556792104920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50254/0 (socket says 172.21.15.33:50254) 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f17522a3640 1 -- 172.21.15.33:0/2236424335 learned_addr learned my addr 172.21.15.33:0/2236424335 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f1751aa2640 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d0d9f0 0x5567921043e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.582+0000 7f1751aa2640 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x55679217b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f17522a3640 1 -- 172.21.15.33:0/2236424335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 msgr2=0x55679217b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f17522a3640 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x55679217b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f17522a3640 1 -- 172.21.15.33:0/2236424335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d0d9f0 msgr2=0x5567921043e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f17522a3640 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d0d9f0 0x5567921043e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f17522a3640 1 -- 172.21.15.33:0/2236424335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679217ba50 con 0x556791d261b0 2024-08-28T19:39:24.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f1751aa2640 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x55679217b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f17522a3640 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x556792104920 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f1748022620 tx=0x7f1748022680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906a6add33745a8f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f1735ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f1735ffb640 1 -- 172.21.15.33:0/2236424335 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748014040 con 0x556791d261b0 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f1735ffb640 1 -- 172.21.15.33:0/2236424335 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f174803a850 con 0x556791d261b0 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f175aa7c740 1 -- 172.21.15.33:0/2236424335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f174800c830 con 0x556791d261b0 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f1735ffb640 1 -- 172.21.15.33:0/2236424335 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f174804b050 con 0x556791d261b0 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f175aa7c740 10 client.17526 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f175aa7c740 1 -- 172.21.15.33:0/2236424335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55679217cc60 con 0x556791d261b0 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.583+0000 7f1735ffb640 1 -- 172.21.15.33:0/2236424335 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f174800c830 con 0x556791d261b0 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.584+0000 7f1735ffb640 1 -- 172.21.15.33:0/2236424335 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1748010740 con 0x556791d261b0 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.584+0000 7f175aa7c740 10 client.17526 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.584+0000 7f175aa7c740 10 client.17526 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:39:24.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.584+0000 7f175aa7c740 20 client.17526 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.584+0000 7f175aa7c740 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556791d4f070 0x55679217f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.584+0000 7f175aa7c740 4 client.17526 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.584+0000 7f175aa7c740 1 -- 172.21.15.33:0/2236424335 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556792069070 con 0x556791d4f070 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.584+0000 7f1751aa2640 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556791d4f070 0x55679217f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.584+0000 7f1751aa2640 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556791d4f070 0x55679217f2e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=37901cc3ce6158f3 server_cookie=b39382e764a312cf in_seq=0 out_seq=0 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.584+0000 7f1735ffb640 10 client.17526 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f1735ffb640 1 -- 172.21.15.33:0/2236424335 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556792069070 con 0x556791d4f070 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f1735ffb640 10 client.17526 handle_command_reply: tid=0 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 client.17526 shutdown 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 -- 172.21.15.33:0/2236424335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 msgr2=0x556792104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x556792104920 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f1748022620 tx=0x7f1748022680 comp rx=0 tx=0).stop 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 -- 172.21.15.33:0/2236424335 shutdown_connections 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x556791d4f070 0x55679217f2e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556791d2e390 0x55679217b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556791d261b0 0x556792104920 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 --2- 172.21.15.33:0/2236424335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556791d0d9f0 0x5567921043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 -- 172.21.15.33:0/2236424335 >> 172.21.15.33:0/2236424335 conn(0x556791d43460 msgr2=0x5567920fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f1735ffb640 0 client.17526 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:39:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 -- 172.21.15.33:0/2236424335 shutdown_connections 2024-08-28T19:39:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 1 -- 172.21.15.33:0/2236424335 wait complete. 2024-08-28T19:39:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.585+0000 7f175aa7c740 20 client.17526 trim_cache size 0 max 16384 2024-08-28T19:39:24.591 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:39:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 -- 172.21.15.33:0/154873824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17380b4cd0 msgr2=0x7f17380b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17380b4cd0 0x7f17380b71e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1744104180 tx=0x7f17440b4040 comp rx=0 tx=0).stop 2024-08-28T19:39:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 -- 172.21.15.33:0/154873824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f174c108a90 msgr2=0x7f174c19fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f174c108a90 0x7f174c19fab0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f1744005cc0 tx=0x7f174402f380 comp rx=0 tx=0).stop 2024-08-28T19:39:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 -- 172.21.15.33:0/154873824 shutdown_connections 2024-08-28T19:39:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f174c108a90 0x7f174c19fab0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174c108140 0x7f174c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17380b4cd0 0x7f17380b71e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 --2- 172.21.15.33:0/154873824 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f174c102800 0x7f174c19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:24.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 -- 172.21.15.33:0/154873824 >> 172.21.15.33:0/154873824 conn(0x7f174c0794d0 msgr2=0x7f174c0ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:24.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 -- 172.21.15.33:0/154873824 shutdown_connections 2024-08-28T19:39:24.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:24.586+0000 7f1754507640 1 -- 172.21.15.33:0/154873824 wait complete. 2024-08-28T19:39:25.384 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:39:25.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:25 smithi033 ceph-mon[18549]: pgmap v553: 129 pgs: 129 active+clean; 7.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-08-28T19:39:25.642 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:39:25.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:25 smithi059 ceph-mon[22052]: pgmap v553: 129 pgs: 129 active+clean; 7.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-08-28T19:39:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:25 smithi122 ceph-mon[22174]: pgmap v553: 129 pgs: 129 active+clean; 7.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-08-28T19:39:26.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.141+0000 7fcce4cd0640 1 -- 172.21.15.33:0/339309757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce0109240 msgr2=0x7fcce0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:26.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.141+0000 7fcce4cd0640 1 --2- 172.21.15.33:0/339309757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce0109240 0x7fcce0109650 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009900 tx=0x7fccd402a410 comp rx=0 tx=0).stop 2024-08-28T19:39:26.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.142+0000 7fcce4cd0640 1 -- 172.21.15.33:0/339309757 shutdown_connections 2024-08-28T19:39:26.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.142+0000 7fcce4cd0640 1 --2- 172.21.15.33:0/339309757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce0109b90 0x7fcce01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.142+0000 7fcce4cd0640 1 --2- 172.21.15.33:0/339309757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce0109240 0x7fcce0109650 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.142+0000 7fcce4cd0640 1 --2- 172.21.15.33:0/339309757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcce0103900 0x7fcce0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.142+0000 7fcce4cd0640 1 -- 172.21.15.33:0/339309757 >> 172.21.15.33:0/339309757 conn(0x7fcce007b5f0 msgr2=0x7fcce007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:26.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.142+0000 7fcce4cd0640 1 -- 172.21.15.33:0/339309757 shutdown_connections 2024-08-28T19:39:26.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.142+0000 7fcce4cd0640 1 -- 172.21.15.33:0/339309757 wait complete. 2024-08-28T19:39:26.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.142+0000 7fcce4cd0640 1 Processor -- start 2024-08-28T19:39:26.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.142+0000 7fcce4cd0640 1 -- start start 2024-08-28T19:39:26.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fcce4cd0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcce0103900 0x7fcce019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fcce4cd0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce0109240 0x7fcce019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fcce4cd0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce0109b90 0x7fcce019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fcce4cd0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcce0113870 con 0x7fcce0109240 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fcce4cd0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01136f0 con 0x7fcce0109b90 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fcce4cd0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01139f0 con 0x7fcce0103900 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccddd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce0109240 0x7fcce019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccddd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce0109240 0x7fcce019a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50266/0 (socket says 172.21.15.33:50266) 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccddd9b640 1 -- 172.21.15.33:0/1039117560 learned_addr learned my addr 172.21.15.33:0/1039117560 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccded9d640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce0109b90 0x7fcce019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccde59c640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcce0103900 0x7fcce019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccddd9b640 1 -- 172.21.15.33:0/1039117560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcce0103900 msgr2=0x7fcce019a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:26.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccddd9b640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcce0103900 0x7fcce019a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccddd9b640 1 -- 172.21.15.33:0/1039117560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce0109b90 msgr2=0x7fcce019fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccddd9b640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce0109b90 0x7fcce019fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccddd9b640 1 -- 172.21.15.33:0/1039117560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce01a0270 con 0x7fcce0109240 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fccddd9b640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce0109240 0x7fcce019a8a0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fccd402a930 tx=0x7fccd4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.143+0000 7fcccf7fe640 1 -- 172.21.15.33:0/1039117560 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd403f030 con 0x7fcce0109240 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.144+0000 7fcce4cd0640 1 -- 172.21.15.33:0/1039117560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce01a0500 con 0x7fcce0109240 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.144+0000 7fcccf7fe640 1 -- 172.21.15.33:0/1039117560 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd4003aa0 con 0x7fcce0109240 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.144+0000 7fcccf7fe640 1 -- 172.21.15.33:0/1039117560 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4035070 con 0x7fcce0109240 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.144+0000 7fcce4cd0640 1 -- 172.21.15.33:0/1039117560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce01a6cc0 con 0x7fcce0109240 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.146+0000 7fcceb245740 1 Processor -- start 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.146+0000 7fcceb245740 1 -- start start 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fcccf7fe640 1 -- 172.21.15.33:0/1039117560 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fccd4042030 con 0x7fcce0109240 2024-08-28T19:39:26.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fcceb245740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a978310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fcceb245740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 0x55c45a978850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fcceb245740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5b2390 0x55c45a978d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fcceb245740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c45a8ef680 con 0x55c45a5d3070 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fcceb245740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c45a8dec10 con 0x55c45a5b2390 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fcceb245740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c45a8e2bc0 con 0x55c45a5aa1b0 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fccded9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a978310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fccded9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a978310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50270/0 (socket says 172.21.15.33:50270) 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fccded9d640 1 -- 172.21.15.33:0/16531251 learned_addr learned my addr 172.21.15.33:0/16531251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fccde59c640 1 --2- 172.21.15.33:0/16531251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 0x55c45a978850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fccddd9b640 1 --2- 172.21.15.33:0/16531251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5b2390 0x55c45a978d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fccded9d640 1 -- 172.21.15.33:0/16531251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 msgr2=0x55c45a978850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fccded9d640 1 --2- 172.21.15.33:0/16531251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 0x55c45a978850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fccded9d640 1 -- 172.21.15.33:0/16531251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5b2390 msgr2=0x55c45a978d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:26.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fccded9d640 1 --2- 172.21.15.33:0/16531251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5b2390 0x55c45a978d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.147+0000 7fccded9d640 1 -- 172.21.15.33:0/16531251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c45a63e650 con 0x55c45a5d3070 2024-08-28T19:39:26.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.148+0000 7fcccf7fe640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fccc80b4ca0 0x7fccc80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.148+0000 7fccded9d640 1 --2- 172.21.15.33:0/16531251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a978310 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fccd8010370 tx=0x7fccd8010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103c8015a7085905 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:26.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.148+0000 7fccde59c640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fccc80b4ca0 0x7fccc80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.148+0000 7fcccf7fe640 1 -- 172.21.15.33:0/1039117560 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7fccd4105f30 con 0x7fcce0109240 2024-08-28T19:39:26.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.148+0000 7fccccff9640 1 -- 172.21.15.33:0/16531251 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8016070 con 0x55c45a5d3070 2024-08-28T19:39:26.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.148+0000 7fccccff9640 1 -- 172.21.15.33:0/16531251 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd8004d20 con 0x55c45a5d3070 2024-08-28T19:39:26.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.148+0000 7fccccff9640 1 -- 172.21.15.33:0/16531251 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8005350 con 0x55c45a5d3070 2024-08-28T19:39:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fcceb245740 1 -- 172.21.15.33:0/16531251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 msgr2=0x55c45a978310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fcceb245740 1 --2- 172.21.15.33:0/16531251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a978310 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fccd8010370 tx=0x7fccd8010830 comp rx=0 tx=0).stop 2024-08-28T19:39:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fccde59c640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fccc80b4ca0 0x7fccc80b71b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55c45a976f90 tx=0x7fccd0009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fcceb245740 1 -- 172.21.15.33:0/16531251 shutdown_connections 2024-08-28T19:39:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fcceb245740 1 --2- 172.21.15.33:0/16531251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5b2390 0x55c45a978d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fcceb245740 1 --2- 172.21.15.33:0/16531251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 0x55c45a978850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fcceb245740 1 --2- 172.21.15.33:0/16531251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a978310 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fcceb245740 1 -- 172.21.15.33:0/16531251 >> 172.21.15.33:0/16531251 conn(0x55c45a5c7460 msgr2=0x55c45a976200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fcceb245740 1 -- 172.21.15.33:0/16531251 shutdown_connections 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fcceb245740 1 -- 172.21.15.33:0/16531251 wait complete. 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.149+0000 7fcceb245740 1 -- start start 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fcceb245740 1 Processor -- start 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fcceb245740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5aa1b0 0x55c45a983b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fcceb245740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a984070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fcceb245740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5d3070 0x55c45a98fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fcceb245740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c45a741700 con 0x55c45a5b2390 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fcceb245740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c45a865750 con 0x55c45a5aa1b0 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fcceb245740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c45a986af0 con 0x55c45a5d3070 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fcceb245740 10 client.0 _ll_register_callbacks cb 0x55c45a894e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccddd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a984070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccddd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a984070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50276/0 (socket says 172.21.15.33:50276) 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccddd9b640 1 -- 172.21.15.33:0/1604729352 learned_addr learned my addr 172.21.15.33:0/1604729352 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccde59c640 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5aa1b0 0x55c45a983b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccded9d640 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5d3070 0x55c45a98fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccddd9b640 1 -- 172.21.15.33:0/1604729352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5d3070 msgr2=0x55c45a98fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccddd9b640 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5d3070 0x55c45a98fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccddd9b640 1 -- 172.21.15.33:0/1604729352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5aa1b0 msgr2=0x55c45a983b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccddd9b640 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5aa1b0 0x55c45a983b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccddd9b640 1 -- 172.21.15.33:0/1604729352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c45a89e900 con 0x55c45a5b2390 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.150+0000 7fccded9d640 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5d3070 0x55c45a98fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fccddd9b640 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a984070 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fccd4031440 tx=0x7fccd4031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f93b7157775216 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fccc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fccc5ffb640 1 -- 172.21.15.33:0/1604729352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4049070 con 0x55c45a5b2390 2024-08-28T19:39:26.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fccc5ffb640 1 -- 172.21.15.33:0/1604729352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7fccd403bcc0 con 0x55c45a5b2390 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fcceb245740 1 -- 172.21.15.33:0/1604729352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccd8004d20 con 0x55c45a5b2390 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fccc5ffb640 1 -- 172.21.15.33:0/1604729352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fccd40cc050 con 0x55c45a5b2390 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fcceb245740 10 client.17538 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fcceb245740 1 -- 172.21.15.33:0/1604729352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c45a992950 con 0x55c45a5b2390 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fccc5ffb640 1 -- 172.21.15.33:0/1604729352 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd8004d20 con 0x55c45a5b2390 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fccc5ffb640 1 -- 172.21.15.33:0/1604729352 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fccd40cc4e0 con 0x55c45a5b2390 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fcceb245740 10 client.17538 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fcceb245740 10 client.17538 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fcceb245740 20 client.17538 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fcceb245740 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45a5919f0 0x55c45a995d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fcceb245740 4 client.17538 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.151+0000 7fcceb245740 1 -- 172.21.15.33:0/1604729352 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c45a8f15d0 con 0x55c45a5919f0 2024-08-28T19:39:26.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.152+0000 7fccde59c640 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45a5919f0 0x55c45a995d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.152+0000 7fccde59c640 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45a5919f0 0x55c45a995d20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=97b5b0ae53f0c51a server_cookie=63ca5b41e5329409 in_seq=0 out_seq=0 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.152+0000 7fccc5ffb640 10 client.17538 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fccc5ffb640 1 -- 172.21.15.33:0/1604729352 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c45a8f15d0 con 0x55c45a5919f0 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fccc5ffb640 10 client.17538 handle_command_reply: tid=0 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 client.17538 shutdown 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 -- 172.21.15.33:0/1604729352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 msgr2=0x55c45a984070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a984070 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fccd4031440 tx=0x7fccd4031a10 comp rx=0 tx=0).stop 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 -- 172.21.15.33:0/1604729352 shutdown_connections 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5d3070 0x55c45a98fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45a5919f0 0x55c45a995d20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a984070 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 --2- 172.21.15.33:0/1604729352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5aa1b0 0x55c45a983b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fccc5ffb640 0 client.17538 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:39:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 -- 172.21.15.33:0/1604729352 >> 172.21.15.33:0/1604729352 conn(0x55c45a5c7460 msgr2=0x55c45a97b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 -- 172.21.15.33:0/1604729352 shutdown_connections 2024-08-28T19:39:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 1 -- 172.21.15.33:0/1604729352 wait complete. 2024-08-28T19:39:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.153+0000 7fcceb245740 20 client.17538 trim_cache size 0 max 16384 2024-08-28T19:39:26.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.174+0000 7fcceb245740 1 Processor -- start 2024-08-28T19:39:26.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.174+0000 7fcceb245740 1 -- start start 2024-08-28T19:39:26.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fcceb245740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5aa1b0 0x55c45a982a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fcceb245740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5b2390 0x55c45a97bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fcceb245740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a980d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fcceb245740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01b0c90 con 0x55c45a5d3070 2024-08-28T19:39:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fcceb245740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01b27d0 con 0x55c45a5aa1b0 2024-08-28T19:39:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fcceb245740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01b1360 con 0x55c45a5b2390 2024-08-28T19:39:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccded9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a980d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccded9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a980d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50280/0 (socket says 172.21.15.33:50280) 2024-08-28T19:39:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccded9d640 1 -- 172.21.15.33:0/1545559137 learned_addr learned my addr 172.21.15.33:0/1545559137 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:26.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccddd9b640 1 --2- 172.21.15.33:0/1545559137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5b2390 0x55c45a97bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccde59c640 1 --2- 172.21.15.33:0/1545559137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5aa1b0 0x55c45a982a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccded9d640 1 -- 172.21.15.33:0/1545559137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5b2390 msgr2=0x55c45a97bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccded9d640 1 --2- 172.21.15.33:0/1545559137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5b2390 0x55c45a97bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccded9d640 1 -- 172.21.15.33:0/1545559137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5aa1b0 msgr2=0x55c45a982a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccded9d640 1 --2- 172.21.15.33:0/1545559137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5aa1b0 0x55c45a982a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccded9d640 1 -- 172.21.15.33:0/1545559137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c45a97b170 con 0x55c45a5d3070 2024-08-28T19:39:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccded9d640 1 --2- 172.21.15.33:0/1545559137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a980d20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fccd8000f80 tx=0x7fccd8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a068e7c60cf002f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccc7fff640 1 -- 172.21.15.33:0/1545559137 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8016040 con 0x55c45a5d3070 2024-08-28T19:39:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccc7fff640 1 -- 172.21.15.33:0/1545559137 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd80055c0 con 0x55c45a5d3070 2024-08-28T19:39:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.175+0000 7fccc7fff640 1 -- 172.21.15.33:0/1545559137 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8012930 con 0x55c45a5d3070 2024-08-28T19:39:26.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.176+0000 7fcceb245740 1 -- 172.21.15.33:0/1545559137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 msgr2=0x55c45a980d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:26.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.176+0000 7fcceb245740 1 --2- 172.21.15.33:0/1545559137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a980d20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fccd8000f80 tx=0x7fccd8005bd0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.176+0000 7fcceb245740 1 -- 172.21.15.33:0/1545559137 shutdown_connections 2024-08-28T19:39:26.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.176+0000 7fcceb245740 1 --2- 172.21.15.33:0/1545559137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5d3070 0x55c45a980d20 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.176+0000 7fcceb245740 1 --2- 172.21.15.33:0/1545559137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5b2390 0x55c45a97bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.176+0000 7fcceb245740 1 --2- 172.21.15.33:0/1545559137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5aa1b0 0x55c45a982a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.176+0000 7fcceb245740 1 -- 172.21.15.33:0/1545559137 >> 172.21.15.33:0/1545559137 conn(0x55c45a5c7460 msgr2=0x55c45a97b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.176+0000 7fcceb245740 1 -- 172.21.15.33:0/1545559137 shutdown_connections 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.176+0000 7fcceb245740 1 -- 172.21.15.33:0/1545559137 wait complete. 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fcceb245740 1 -- start start 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fcceb245740 1 Processor -- start 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fcceb245740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 0x55c45a9f9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fcceb245740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a9fa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fcceb245740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5d3070 0x55c45a98bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fcceb245740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01b2100 con 0x55c45a5b2390 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fcceb245740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01b1a30 con 0x55c45a5d3070 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fcceb245740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01aec90 con 0x55c45a5aa1b0 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fcceb245740 10 client.0 _ll_register_callbacks cb 0x7fccd4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:26.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fccddd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a9fa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fccddd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a9fa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50286/0 (socket says 172.21.15.33:50286) 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fccddd9b640 1 -- 172.21.15.33:0/2953979833 learned_addr learned my addr 172.21.15.33:0/2953979833 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fccded9d640 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5d3070 0x55c45a98bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.177+0000 7fccde59c640 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 0x55c45a9f9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccddd9b640 1 -- 172.21.15.33:0/2953979833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 msgr2=0x55c45a9f9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccddd9b640 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 0x55c45a9f9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccddd9b640 1 -- 172.21.15.33:0/2953979833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5d3070 msgr2=0x55c45a98bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccddd9b640 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5d3070 0x55c45a98bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccddd9b640 1 -- 172.21.15.33:0/2953979833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c45a98c2e0 con 0x55c45a5b2390 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccded9d640 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5d3070 0x55c45a98bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccde59c640 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 0x55c45a9f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccddd9b640 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a9fa420 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fccd40b5040 tx=0x7fccd403bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcabf8b30a0858f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccc5ffb640 1 -- 172.21.15.33:0/2953979833 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4049040 con 0x55c45a5b2390 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccc5ffb640 1 -- 172.21.15.33:0/2953979833 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7fccd40d5320 con 0x55c45a5b2390 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fcceb245740 1 -- 172.21.15.33:0/2953979833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccd80055c0 con 0x55c45a5b2390 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccc5ffb640 1 -- 172.21.15.33:0/2953979833 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fccd40cb9f0 con 0x55c45a5b2390 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fcceb245740 10 client.17544 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fcceb245740 1 -- 172.21.15.33:0/2953979833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c45aa053b0 con 0x55c45a5b2390 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.178+0000 7fccc5ffb640 1 -- 172.21.15.33:0/2953979833 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd80055c0 con 0x55c45a5b2390 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fccc5ffb640 1 -- 172.21.15.33:0/2953979833 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fccd40e1b90 con 0x55c45a5b2390 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fcceb245740 10 client.17544 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fcceb245740 10 client.17544 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fcceb245740 20 client.17544 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fcceb245740 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45a566da0 0x55c45aa079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:26.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fcceb245740 4 client.17544 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fcceb245740 1 -- 172.21.15.33:0/2953979833 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c45a8ed070 con 0x55c45a566da0 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fccde59c640 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45a566da0 0x55c45aa079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fccde59c640 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45a566da0 0x55c45aa079a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad9a560328a32521 server_cookie=94dc03229d35f3b5 in_seq=0 out_seq=0 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fccc5ffb640 10 client.17544 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fccc5ffb640 1 -- 172.21.15.33:0/2953979833 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c45a8ed070 con 0x55c45a566da0 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.179+0000 7fccc5ffb640 10 client.17544 handle_command_reply: tid=0 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 client.17544 shutdown 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 -- 172.21.15.33:0/2953979833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 msgr2=0x55c45a9fa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a9fa420 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fccd40b5040 tx=0x7fccd403bef0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 -- 172.21.15.33:0/2953979833 shutdown_connections 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45a5d3070 0x55c45a98bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45a566da0 0x55c45aa079a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45a5b2390 0x55c45a9fa420 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 --2- 172.21.15.33:0/2953979833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45a5aa1b0 0x55c45a9f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 -- 172.21.15.33:0/2953979833 >> 172.21.15.33:0/2953979833 conn(0x55c45a5c7460 msgr2=0x55c45a979280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:26.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fccc5ffb640 0 client.17544 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:39:26.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 -- 172.21.15.33:0/2953979833 shutdown_connections 2024-08-28T19:39:26.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 1 -- 172.21.15.33:0/2953979833 wait complete. 2024-08-28T19:39:26.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.180+0000 7fcceb245740 20 client.17544 trim_cache size 0 max 16384 2024-08-28T19:39:26.187 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:39:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 -- 172.21.15.33:0/1039117560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fccc80b4ca0 msgr2=0x7fccc80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fccc80b4ca0 0x7fccc80b71b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55c45a976f90 tx=0x7fccd0009110 comp rx=0 tx=0).stop 2024-08-28T19:39:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 -- 172.21.15.33:0/1039117560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce0109240 msgr2=0x7fcce019a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce0109240 0x7fcce019a8a0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fccd402a930 tx=0x7fccd4004270 comp rx=0 tx=0).stop 2024-08-28T19:39:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 -- 172.21.15.33:0/1039117560 shutdown_connections 2024-08-28T19:39:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce0109b90 0x7fcce019fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcce0109240 0x7fcce019a8a0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fccc80b4ca0 0x7fccc80b71b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 --2- 172.21.15.33:0/1039117560 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcce0103900 0x7fcce019a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:26.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 -- 172.21.15.33:0/1039117560 >> 172.21.15.33:0/1039117560 conn(0x7fcce007b5f0 msgr2=0x7fcce0107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:26.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 -- 172.21.15.33:0/1039117560 shutdown_connections 2024-08-28T19:39:26.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:26.181+0000 7fcce4cd0640 1 -- 172.21.15.33:0/1039117560 wait complete. 2024-08-28T19:39:26.850 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:39:27.106 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:39:27.533 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:27 smithi033 ceph-mon[18549]: pgmap v554: 129 pgs: 129 active+clean; 7.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-08-28T19:39:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 -- 172.21.15.33:0/1852881632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9474104750 msgr2=0x7f9474104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 --2- 172.21.15.33:0/1852881632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9474104750 0x7f9474104b60 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9464009900 tx=0x7f946402a410 comp rx=0 tx=0).stop 2024-08-28T19:39:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 -- 172.21.15.33:0/1852881632 shutdown_connections 2024-08-28T19:39:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 --2- 172.21.15.33:0/1852881632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f947410dbb0 0x7f94741100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 --2- 172.21.15.33:0/1852881632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94741050a0 0x7f947410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 --2- 172.21.15.33:0/1852881632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9474104750 0x7f9474104b60 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 -- 172.21.15.33:0/1852881632 >> 172.21.15.33:0/1852881632 conn(0x7f94740794d0 msgr2=0x7f94740798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 -- 172.21.15.33:0/1852881632 shutdown_connections 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 -- 172.21.15.33:0/1852881632 wait complete. 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 Processor -- start 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.625+0000 7f94797d2640 1 -- start start 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94797d2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9474104750 0x7f947419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94797d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94741050a0 0x7f947419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94797d2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947410dbb0 0x7f947419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94797d2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9474113830 con 0x7f94741050a0 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94797d2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94741136b0 con 0x7f947410dbb0 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94797d2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94741139b0 con 0x7f9474104750 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94727fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94741050a0 0x7f947419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94727fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94741050a0 0x7f947419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50310/0 (socket says 172.21.15.33:50310) 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94727fc640 1 -- 172.21.15.33:0/531248239 learned_addr learned my addr 172.21.15.33:0/531248239 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f9472ffd640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9474104750 0x7f947419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94737fe640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947410dbb0 0x7f947419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94727fc640 1 -- 172.21.15.33:0/531248239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9474104750 msgr2=0x7f947419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94727fc640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9474104750 0x7f947419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94727fc640 1 -- 172.21.15.33:0/531248239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947410dbb0 msgr2=0x7f947419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94727fc640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947410dbb0 0x7f947419fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94727fc640 1 -- 172.21.15.33:0/531248239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94741a0290 con 0x7f94741050a0 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.626+0000 7f94737fe640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947410dbb0 0x7f947419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.627+0000 7f94727fc640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94741050a0 0x7f947419a8c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f946800c970 tx=0x7f946800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.627+0000 7f945bfff640 1 -- 172.21.15.33:0/531248239 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468007bb0 con 0x7f94741050a0 2024-08-28T19:39:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.627+0000 7f945bfff640 1 -- 172.21.15.33:0/531248239 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9468007d50 con 0x7f94741050a0 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.627+0000 7f94797d2640 1 -- 172.21.15.33:0/531248239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94741a0580 con 0x7f94741050a0 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.627+0000 7f945bfff640 1 -- 172.21.15.33:0/531248239 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946800f450 con 0x7f94741050a0 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.627+0000 7f94797d2640 1 -- 172.21.15.33:0/531248239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94741a6ce0 con 0x7f94741050a0 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.629+0000 7f945bfff640 1 -- 172.21.15.33:0/531248239 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9468004eb0 con 0x7f94741050a0 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.629+0000 7f947fd47740 1 Processor -- start 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f947fd47740 1 -- start start 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f947fd47740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a295070 0x56412a63a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f947fd47740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a26c1b0 0x56412a63a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f947fd47740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a274390 0x56412a63ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f947fd47740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56412a5b1680 con 0x56412a26c1b0 2024-08-28T19:39:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f947fd47740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56412a5a0c10 con 0x56412a274390 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f947fd47740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56412a5a4bc0 con 0x56412a295070 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f9472ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a26c1b0 0x56412a63a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f9472ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a26c1b0 0x56412a63a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50312/0 (socket says 172.21.15.33:50312) 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f9472ffd640 1 -- 172.21.15.33:0/3558206240 learned_addr learned my addr 172.21.15.33:0/3558206240 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f94737fe640 1 --2- 172.21.15.33:0/3558206240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a295070 0x56412a63a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f94727fc640 1 --2- 172.21.15.33:0/3558206240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a274390 0x56412a63ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f945bfff640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f945c0b4ca0 0x7f945c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f9472ffd640 1 -- 172.21.15.33:0/3558206240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a295070 msgr2=0x56412a63a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f9472ffd640 1 --2- 172.21.15.33:0/3558206240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a295070 0x56412a63a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f9472ffd640 1 -- 172.21.15.33:0/3558206240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a274390 msgr2=0x56412a63ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f94737fe640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f945c0b4ca0 0x7f945c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f9472ffd640 1 --2- 172.21.15.33:0/3558206240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a274390 0x56412a63ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f9472ffd640 1 -- 172.21.15.33:0/3558206240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412a300650 con 0x56412a26c1b0 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.630+0000 7f94727fc640 1 --2- 172.21.15.33:0/3558206240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a274390 0x56412a63ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.631+0000 7f945bfff640 1 -- 172.21.15.33:0/531248239 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f94680e55e0 con 0x7f94741050a0 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.631+0000 7f9472ffd640 1 --2- 172.21.15.33:0/3558206240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a26c1b0 0x56412a63a850 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f947406ba00 tx=0x7f9464031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bec68230ba16801 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.631+0000 7f94737fe640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f945c0b4ca0 0x7f945c0b71b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f946c0127f0 tx=0x7f946c004ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.631+0000 7f94597fa640 1 -- 172.21.15.33:0/3558206240 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9464040070 con 0x56412a26c1b0 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.631+0000 7f94597fa640 1 -- 172.21.15.33:0/3558206240 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94640316a0 con 0x56412a26c1b0 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.631+0000 7f94597fa640 1 -- 172.21.15.33:0/3558206240 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9464035040 con 0x56412a26c1b0 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.632+0000 7f947fd47740 1 -- 172.21.15.33:0/3558206240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a26c1b0 msgr2=0x56412a63a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.632+0000 7f947fd47740 1 --2- 172.21.15.33:0/3558206240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a26c1b0 0x56412a63a850 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f947406ba00 tx=0x7f9464031de0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.632+0000 7f947fd47740 1 -- 172.21.15.33:0/3558206240 shutdown_connections 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.632+0000 7f947fd47740 1 --2- 172.21.15.33:0/3558206240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a274390 0x56412a63ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.632+0000 7f947fd47740 1 --2- 172.21.15.33:0/3558206240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a26c1b0 0x56412a63a850 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.632+0000 7f947fd47740 1 --2- 172.21.15.33:0/3558206240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a295070 0x56412a63a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.632+0000 7f947fd47740 1 -- 172.21.15.33:0/3558206240 >> 172.21.15.33:0/3558206240 conn(0x56412a289460 msgr2=0x56412a638200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.632+0000 7f947fd47740 1 -- 172.21.15.33:0/3558206240 shutdown_connections 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.632+0000 7f947fd47740 1 -- 172.21.15.33:0/3558206240 wait complete. 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.632+0000 7f947fd47740 1 -- start start 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f947fd47740 1 Processor -- start 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f947fd47740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 0x56412a6459d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f947fd47740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a274390 0x56412a645f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f947fd47740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a651de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f947fd47740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56412a403700 con 0x56412a295070 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f947fd47740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56412a527750 con 0x56412a26c1b0 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f947fd47740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56412a648a90 con 0x56412a274390 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f947fd47740 10 client.0 _ll_register_callbacks cb 0x56412a556e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f94737fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a651de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f94737fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a651de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50322/0 (socket says 172.21.15.33:50322) 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f94737fe640 1 -- 172.21.15.33:0/2458357165 learned_addr learned my addr 172.21.15.33:0/2458357165 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f9472ffd640 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 0x56412a6459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f94727fc640 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a274390 0x56412a645f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f94737fe640 1 -- 172.21.15.33:0/2458357165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a274390 msgr2=0x56412a645f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f94737fe640 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a274390 0x56412a645f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f94737fe640 1 -- 172.21.15.33:0/2458357165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 msgr2=0x56412a6459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f94737fe640 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 0x56412a6459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.633+0000 7f94737fe640 1 -- 172.21.15.33:0/2458357165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56412a560900 con 0x56412a295070 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.634+0000 7f94737fe640 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a651de0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f946c005ca0 tx=0x7f946c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9624a1afa555f0c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.634+0000 7f9456ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.634+0000 7f9456ff5640 1 -- 172.21.15.33:0/2458357165 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c018070 con 0x56412a295070 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.634+0000 7f9456ff5640 1 -- 172.21.15.33:0/2458357165 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f946c003970 con 0x56412a295070 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.634+0000 7f947fd47740 1 -- 172.21.15.33:0/2458357165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94640316a0 con 0x56412a295070 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.634+0000 7f9456ff5640 1 -- 172.21.15.33:0/2458357165 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f946c02f050 con 0x56412a295070 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.634+0000 7f947fd47740 10 client.17556 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.634+0000 7f947fd47740 1 -- 172.21.15.33:0/2458357165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56412a654800 con 0x56412a295070 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.634+0000 7f9456ff5640 1 -- 172.21.15.33:0/2458357165 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94640316a0 con 0x56412a295070 2024-08-28T19:39:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.635+0000 7f9456ff5640 1 -- 172.21.15.33:0/2458357165 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f946c027400 con 0x56412a295070 2024-08-28T19:39:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.635+0000 7f947fd47740 10 client.17556 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.635+0000 7f947fd47740 10 client.17556 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:39:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.635+0000 7f947fd47740 20 client.17556 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.635+0000 7f947fd47740 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56412a2539f0 0x56412a657d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.635+0000 7f947fd47740 4 client.17556 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:39:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.635+0000 7f947fd47740 1 -- 172.21.15.33:0/2458357165 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56412a5b35d0 con 0x56412a2539f0 2024-08-28T19:39:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.635+0000 7f9472ffd640 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56412a2539f0 0x56412a657d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.635+0000 7f9456ff5640 10 client.17556 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.635+0000 7f9472ffd640 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56412a2539f0 0x56412a657d50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b25f81ddef12e854 server_cookie=40cd50a94ba114eb in_seq=0 out_seq=0 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f9456ff5640 1 -- 172.21.15.33:0/2458357165 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56412a5b35d0 con 0x56412a2539f0 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f9456ff5640 10 client.17556 handle_command_reply: tid=0 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 client.17556 shutdown 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 -- 172.21.15.33:0/2458357165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 msgr2=0x56412a651de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a651de0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f946c005ca0 tx=0x7f946c004a40 comp rx=0 tx=0).stop 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 -- 172.21.15.33:0/2458357165 shutdown_connections 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56412a2539f0 0x56412a657d50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a651de0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a274390 0x56412a645f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 --2- 172.21.15.33:0/2458357165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 0x56412a6459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 -- 172.21.15.33:0/2458357165 >> 172.21.15.33:0/2458357165 conn(0x56412a289460 msgr2=0x56412a63d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:27.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f9456ff5640 0 client.17556 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:39:27.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 -- 172.21.15.33:0/2458357165 shutdown_connections 2024-08-28T19:39:27.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.636+0000 7f947fd47740 1 -- 172.21.15.33:0/2458357165 wait complete. 2024-08-28T19:39:27.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.637+0000 7f947fd47740 20 client.17556 trim_cache size 0 max 16384 2024-08-28T19:39:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f947fd47740 1 Processor -- start 2024-08-28T19:39:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f947fd47740 1 -- start start 2024-08-28T19:39:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f947fd47740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a26c1b0 0x56412a63db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f947fd47740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a274390 0x56412a651ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f947fd47740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a295070 0x56412a637b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f947fd47740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f94741b0d30 con 0x56412a274390 2024-08-28T19:39:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f947fd47740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94741b2870 con 0x56412a295070 2024-08-28T19:39:27.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f947fd47740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94741b1400 con 0x56412a26c1b0 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f94727fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a274390 0x56412a651ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f94727fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a274390 0x56412a651ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50326/0 (socket says 172.21.15.33:50326) 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f94727fc640 1 -- 172.21.15.33:0/947161004 learned_addr learned my addr 172.21.15.33:0/947161004 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f9472ffd640 1 --2- 172.21.15.33:0/947161004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a26c1b0 0x56412a63db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f94737fe640 1 --2- 172.21.15.33:0/947161004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a295070 0x56412a637b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f94727fc640 1 -- 172.21.15.33:0/947161004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a26c1b0 msgr2=0x56412a63db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f94727fc640 1 --2- 172.21.15.33:0/947161004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a26c1b0 0x56412a63db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f94727fc640 1 -- 172.21.15.33:0/947161004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a295070 msgr2=0x56412a637b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f94727fc640 1 --2- 172.21.15.33:0/947161004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a295070 0x56412a637b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f94727fc640 1 -- 172.21.15.33:0/947161004 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412a643ed0 con 0x56412a274390 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.650+0000 7f94737fe640 1 --2- 172.21.15.33:0/947161004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a295070 0x56412a637b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.651+0000 7f94727fc640 1 --2- 172.21.15.33:0/947161004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a274390 0x56412a651ce0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f94680e2f90 tx=0x7f94680a80b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23774b66cc11e6ce server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:27.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.651+0000 7f9458ff9640 1 -- 172.21.15.33:0/947161004 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946801d040 con 0x56412a274390 2024-08-28T19:39:27.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.651+0000 7f9458ff9640 1 -- 172.21.15.33:0/947161004 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94680e5030 con 0x56412a274390 2024-08-28T19:39:27.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.651+0000 7f9458ff9640 1 -- 172.21.15.33:0/947161004 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94680b01a0 con 0x56412a274390 2024-08-28T19:39:27.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 -- 172.21.15.33:0/947161004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a274390 msgr2=0x56412a651ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 --2- 172.21.15.33:0/947161004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a274390 0x56412a651ce0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f94680e2f90 tx=0x7f94680a80b0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 -- 172.21.15.33:0/947161004 shutdown_connections 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 --2- 172.21.15.33:0/947161004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a295070 0x56412a637b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 --2- 172.21.15.33:0/947161004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a274390 0x56412a651ce0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 --2- 172.21.15.33:0/947161004 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a26c1b0 0x56412a63db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 -- 172.21.15.33:0/947161004 >> 172.21.15.33:0/947161004 conn(0x56412a289460 msgr2=0x56412a63d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 -- 172.21.15.33:0/947161004 shutdown_connections 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 -- 172.21.15.33:0/947161004 wait complete. 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 -- start start 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 Processor -- start 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 0x56412a64a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a274390 0x56412a64aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a6c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f94741b21a0 con 0x56412a295070 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94741b1ad0 con 0x56412a26c1b0 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94741aed30 con 0x56412a274390 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.652+0000 7f947fd47740 10 client.0 _ll_register_callbacks cb 0x7f946c00ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f94737fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a6c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f94737fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a6c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50332/0 (socket says 172.21.15.33:50332) 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f94737fe640 1 -- 172.21.15.33:0/41911685 learned_addr learned my addr 172.21.15.33:0/41911685 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f9472ffd640 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 0x56412a64a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f94727fc640 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a274390 0x56412a64aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f94737fe640 1 -- 172.21.15.33:0/41911685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a274390 msgr2=0x56412a64aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f94737fe640 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a274390 0x56412a64aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f94737fe640 1 -- 172.21.15.33:0/41911685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 msgr2=0x56412a64a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f94737fe640 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 0x56412a64a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f94737fe640 1 -- 172.21.15.33:0/41911685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56412a6c1d00 con 0x56412a295070 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f9472ffd640 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 0x56412a64a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f94737fe640 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a6c1710 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f946c027850 tx=0x7f946c00f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af14007b580a16fa server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f9456ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f9456ff5640 1 -- 172.21.15.33:0/41911685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c018040 con 0x56412a295070 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f9456ff5640 1 -- 172.21.15.33:0/41911685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f946c035440 con 0x56412a295070 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.653+0000 7f947fd47740 1 -- 172.21.15.33:0/41911685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94680e5030 con 0x56412a295070 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f9456ff5640 1 -- 172.21.15.33:0/41911685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f946c035640 con 0x56412a295070 2024-08-28T19:39:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f947fd47740 10 client.17562 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f947fd47740 1 -- 172.21.15.33:0/41911685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56412a6c2ed0 con 0x56412a295070 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f9456ff5640 1 -- 172.21.15.33:0/41911685 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94680e5030 con 0x56412a295070 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f9456ff5640 1 -- 172.21.15.33:0/41911685 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f946c0337e0 con 0x56412a295070 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f947fd47740 10 client.17562 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f947fd47740 10 client.17562 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f947fd47740 20 client.17562 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f947fd47740 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56412a228da0 0x56412a6c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f947fd47740 4 client.17562 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f947fd47740 1 -- 172.21.15.33:0/41911685 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56412a5af070 con 0x56412a228da0 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.654+0000 7f9472ffd640 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56412a228da0 0x56412a6c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f9456ff5640 10 client.17562 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:39:27.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f9472ffd640 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56412a228da0 0x56412a6c56e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99925e504a94ddd7 server_cookie=db703e77de6ce844 in_seq=0 out_seq=0 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f9456ff5640 1 -- 172.21.15.33:0/41911685 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56412a5af070 con 0x56412a228da0 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f9456ff5640 10 client.17562 handle_command_reply: tid=0 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 client.17562 shutdown 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 -- 172.21.15.33:0/41911685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 msgr2=0x56412a6c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a6c1710 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f946c027850 tx=0x7f946c00f8d0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 -- 172.21.15.33:0/41911685 shutdown_connections 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56412a228da0 0x56412a6c56e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56412a295070 0x56412a6c1710 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56412a274390 0x56412a64aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 --2- 172.21.15.33:0/41911685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56412a26c1b0 0x56412a64a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f9456ff5640 0 client.17562 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:39:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 -- 172.21.15.33:0/41911685 >> 172.21.15.33:0/41911685 conn(0x56412a289460 msgr2=0x56412a637b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:27.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 -- 172.21.15.33:0/41911685 shutdown_connections 2024-08-28T19:39:27.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 1 -- 172.21.15.33:0/41911685 wait complete. 2024-08-28T19:39:27.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.655+0000 7f947fd47740 20 client.17562 trim_cache size 0 max 16384 2024-08-28T19:39:27.663 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:39:27.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 -- 172.21.15.33:0/531248239 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f945c0b4ca0 msgr2=0x7f945c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:27.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f945c0b4ca0 0x7f945c0b71b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f946c0127f0 tx=0x7f946c004ab0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 -- 172.21.15.33:0/531248239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94741050a0 msgr2=0x7f947419a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:27.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94741050a0 0x7f947419a8c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f946800c970 tx=0x7f946800ce30 comp rx=0 tx=0).stop 2024-08-28T19:39:27.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 -- 172.21.15.33:0/531248239 shutdown_connections 2024-08-28T19:39:27.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947410dbb0 0x7f947419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94741050a0 0x7f947419a8c0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f945c0b4ca0 0x7f945c0b71b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 --2- 172.21.15.33:0/531248239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9474104750 0x7f947419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 -- 172.21.15.33:0/531248239 >> 172.21.15.33:0/531248239 conn(0x7f94740794d0 msgr2=0x7f94740ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 -- 172.21.15.33:0/531248239 shutdown_connections 2024-08-28T19:39:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:27.656+0000 7f94797d2640 1 -- 172.21.15.33:0/531248239 wait complete. 2024-08-28T19:39:27.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:27 smithi059 ceph-mon[22052]: pgmap v554: 129 pgs: 129 active+clean; 7.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-08-28T19:39:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:27 smithi122 ceph-mon[22174]: pgmap v554: 129 pgs: 129 active+clean; 7.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-08-28T19:39:28.386 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:39:29.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.183+0000 7f384cb4d640 1 -- 172.21.15.33:0/1444388869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38481050b0 msgr2=0x7f384810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:29.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.183+0000 7f384cb4d640 1 --2- 172.21.15.33:0/1444388869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38481050b0 0x7f384810d600 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f383c009900 tx=0x7f383c02a410 comp rx=0 tx=0).stop 2024-08-28T19:39:29.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.183+0000 7f384cb4d640 1 -- 172.21.15.33:0/1444388869 shutdown_connections 2024-08-28T19:39:29.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.183+0000 7f384cb4d640 1 --2- 172.21.15.33:0/1444388869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f384810dbc0 0x7f38481100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.183+0000 7f384cb4d640 1 --2- 172.21.15.33:0/1444388869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38481050b0 0x7f384810d600 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.183+0000 7f384cb4d640 1 --2- 172.21.15.33:0/1444388869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3848104760 0x7f3848104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.183+0000 7f384cb4d640 1 -- 172.21.15.33:0/1444388869 >> 172.21.15.33:0/1444388869 conn(0x7f38480794b0 msgr2=0x7f38480798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.183+0000 7f384cb4d640 1 -- 172.21.15.33:0/1444388869 shutdown_connections 2024-08-28T19:39:29.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.183+0000 7f384cb4d640 1 -- 172.21.15.33:0/1444388869 wait complete. 2024-08-28T19:39:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.184+0000 7f384cb4d640 1 Processor -- start 2024-08-28T19:39:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.184+0000 7f384cb4d640 1 -- start start 2024-08-28T19:39:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.184+0000 7f384cb4d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3848104760 0x7f384819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.184+0000 7f384cb4d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38481050b0 0x7f384819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.184+0000 7f384cb4d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f384810dbc0 0x7f384819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f384cb4d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3848113800 con 0x7f384810dbc0 2024-08-28T19:39:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f384cb4d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3848113680 con 0x7f38481050b0 2024-08-28T19:39:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f384cb4d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3848113980 con 0x7f3848104760 2024-08-28T19:39:29.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f3846d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f384810dbc0 0x7f384819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f3846d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f384810dbc0 0x7f384819fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56774/0 (socket says 172.21.15.33:56774) 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f3846d9d640 1 -- 172.21.15.33:0/958695511 learned_addr learned my addr 172.21.15.33:0/958695511 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f3845d9b640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38481050b0 0x7f384819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f384659c640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3848104760 0x7f384819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f3846d9d640 1 -- 172.21.15.33:0/958695511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3848104760 msgr2=0x7f384819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f3846d9d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3848104760 0x7f384819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f3846d9d640 1 -- 172.21.15.33:0/958695511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38481050b0 msgr2=0x7f384819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f3846d9d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38481050b0 0x7f384819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f3846d9d640 1 -- 172.21.15.33:0/958695511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38481a01a0 con 0x7f384810dbc0 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f384659c640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3848104760 0x7f384819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:39:29.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f3846d9d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f384810dbc0 0x7f384819fa70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f384000eaa0 tx=0x7f384000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f38377fe640 1 -- 172.21.15.33:0/958695511 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384000cdb0 con 0x7f384810dbc0 2024-08-28T19:39:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f384cb4d640 1 -- 172.21.15.33:0/958695511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38481a0490 con 0x7f384810dbc0 2024-08-28T19:39:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f38377fe640 1 -- 172.21.15.33:0/958695511 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3840005020 con 0x7f384810dbc0 2024-08-28T19:39:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.185+0000 7f38377fe640 1 -- 172.21.15.33:0/958695511 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38400116d0 con 0x7f384810dbc0 2024-08-28T19:39:29.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.186+0000 7f384cb4d640 1 -- 172.21.15.33:0/958695511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38481a6bf0 con 0x7f384810dbc0 2024-08-28T19:39:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.188+0000 7f38530c2740 1 Processor -- start 2024-08-28T19:39:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.188+0000 7f38377fe640 1 -- 172.21.15.33:0/958695511 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f38400051d0 con 0x7f384810dbc0 2024-08-28T19:39:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f38530c2740 1 -- start start 2024-08-28T19:39:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f38530c2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470a6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f38530c2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946cd81b0 0x5609470a6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f38530c2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f38530c2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56094701d680 con 0x560946ce0390 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f38530c2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56094700cc10 con 0x560946d01070 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f38530c2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560947010bc0 con 0x560946cd81b0 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f3845d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f3845d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470a6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56782/0 (socket says 172.21.15.33:56782) 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f3845d9b640 1 -- 172.21.15.33:0/2188784079 learned_addr learned my addr 172.21.15.33:0/2188784079 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f384659c640 1 --2- 172.21.15.33:0/2188784079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946cd81b0 0x5609470a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.189+0000 7f3845d9b640 1 --2- 172.21.15.33:0/2188784079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f3845d9b640 1 -- 172.21.15.33:0/2188784079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946cd81b0 msgr2=0x5609470a6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f3845d9b640 1 --2- 172.21.15.33:0/2188784079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946cd81b0 0x5609470a6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f3845d9b640 1 -- 172.21.15.33:0/2188784079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 msgr2=0x5609470a6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:29.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f3845d9b640 1 --2- 172.21.15.33:0/2188784079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470a6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f38377fe640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38300b4ca0 0x7f38300b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f3845d9b640 1 -- 172.21.15.33:0/2188784079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560946d6c650 con 0x560946ce0390 2024-08-28T19:39:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f3846d9d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38300b4ca0 0x7f38300b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f3845d9b640 1 --2- 172.21.15.33:0/2188784079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470a6d90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f384806b690 tx=0x7f383c005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44182c520de68a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f38377fe640 1 -- 172.21.15.33:0/958695511 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f38400e5b90 con 0x7f384810dbc0 2024-08-28T19:39:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f3834ff9640 1 -- 172.21.15.33:0/2188784079 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c043020 con 0x560946ce0390 2024-08-28T19:39:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f3834ff9640 1 -- 172.21.15.33:0/2188784079 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f383c031dd0 con 0x560946ce0390 2024-08-28T19:39:29.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.190+0000 7f3834ff9640 1 -- 172.21.15.33:0/2188784079 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c035040 con 0x560946ce0390 2024-08-28T19:39:29.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.191+0000 7f38530c2740 1 -- 172.21.15.33:0/2188784079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 msgr2=0x5609470a6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.191+0000 7f3846d9d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38300b4ca0 0x7f38300b71b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f38400e2ff0 tx=0x7f3840079380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.191+0000 7f38530c2740 1 --2- 172.21.15.33:0/2188784079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470a6d90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f384806b690 tx=0x7f383c005d90 comp rx=0 tx=0).stop 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.191+0000 7f38530c2740 1 -- 172.21.15.33:0/2188784079 shutdown_connections 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.191+0000 7f38530c2740 1 --2- 172.21.15.33:0/2188784079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470a6d90 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.191+0000 7f38530c2740 1 --2- 172.21.15.33:0/2188784079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946cd81b0 0x5609470a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.191+0000 7f38530c2740 1 --2- 172.21.15.33:0/2188784079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470a6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.191+0000 7f38530c2740 1 -- 172.21.15.33:0/2188784079 >> 172.21.15.33:0/2188784079 conn(0x560946cf5460 msgr2=0x5609470a4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.191+0000 7f38530c2740 1 -- 172.21.15.33:0/2188784079 shutdown_connections 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.191+0000 7f38530c2740 1 -- 172.21.15.33:0/2188784079 wait complete. 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f38530c2740 1 -- start start 2024-08-28T19:39:29.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f38530c2740 1 Processor -- start 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f38530c2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946cd81b0 0x5609470b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f38530c2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f38530c2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f38530c2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560946e6f700 con 0x560946ce0390 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f38530c2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560946f93750 con 0x560946d01070 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f38530c2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5609470b4a90 con 0x560946cd81b0 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f384659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f38530c2740 10 client.0 _ll_register_callbacks cb 0x560946fc2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f384659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56796/0 (socket says 172.21.15.33:56796) 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f384659c640 1 -- 172.21.15.33:0/3687107925 learned_addr learned my addr 172.21.15.33:0/3687107925 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f3845d9b640 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946cd81b0 0x5609470b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.192+0000 7f3845d9b640 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f384659c640 1 -- 172.21.15.33:0/3687107925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946cd81b0 msgr2=0x5609470b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f384659c640 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946cd81b0 0x5609470b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f384659c640 1 -- 172.21.15.33:0/3687107925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 msgr2=0x5609470bddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f384659c640 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470bddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f384659c640 1 -- 172.21.15.33:0/3687107925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560946fcc900 con 0x560946ce0390 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f384659c640 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470b1f70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f3838011a30 tx=0x7f3838011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2ece3e991239c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f382dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f382dffb640 1 -- 172.21.15.33:0/3687107925 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383800fdf0 con 0x560946ce0390 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f382dffb640 1 -- 172.21.15.33:0/3687107925 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f3838004020 con 0x560946ce0390 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f38530c2740 1 -- 172.21.15.33:0/3687107925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f383c031dd0 con 0x560946ce0390 2024-08-28T19:39:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f382dffb640 1 -- 172.21.15.33:0/3687107925 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3838004220 con 0x560946ce0390 2024-08-28T19:39:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f38530c2740 10 client.17574 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f38530c2740 1 -- 172.21.15.33:0/3687107925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5609470c0870 con 0x560946ce0390 2024-08-28T19:39:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.193+0000 7f382dffb640 1 -- 172.21.15.33:0/3687107925 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f383c031dd0 con 0x560946ce0390 2024-08-28T19:39:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.194+0000 7f382dffb640 1 -- 172.21.15.33:0/3687107925 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f383801b400 con 0x560946ce0390 2024-08-28T19:39:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.194+0000 7f38530c2740 10 client.17574 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.194+0000 7f38530c2740 10 client.17574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:39:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.194+0000 7f38530c2740 20 client.17574 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.194+0000 7f38530c2740 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560946cbf9f0 0x5609470c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.194+0000 7f38530c2740 4 client.17574 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:39:29.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.194+0000 7f38530c2740 1 -- 172.21.15.33:0/3687107925 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56094701f5d0 con 0x560946cbf9f0 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.194+0000 7f3845d9b640 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560946cbf9f0 0x5609470c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.195+0000 7f3845d9b640 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560946cbf9f0 0x5609470c3e10 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=474bfaec7d5edd98 server_cookie=abd0179c263e6485 in_seq=0 out_seq=0 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.195+0000 7f382dffb640 10 client.17574 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.195+0000 7f382dffb640 1 -- 172.21.15.33:0/3687107925 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56094701f5d0 con 0x560946cbf9f0 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.195+0000 7f382dffb640 10 client.17574 handle_command_reply: tid=0 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.195+0000 7f38530c2740 1 client.17574 shutdown 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 1 -- 172.21.15.33:0/3687107925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 msgr2=0x5609470b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470b1f70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f3838011a30 tx=0x7f3838011ef0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 1 -- 172.21.15.33:0/3687107925 shutdown_connections 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560946cbf9f0 0x5609470c3e10 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946ce0390 0x5609470b1f70 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 1 --2- 172.21.15.33:0/3687107925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946cd81b0 0x5609470b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 1 -- 172.21.15.33:0/3687107925 >> 172.21.15.33:0/3687107925 conn(0x560946cf5460 msgr2=0x5609470a94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:29.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f382dffb640 0 client.17574 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:29.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 1 -- 172.21.15.33:0/3687107925 shutdown_connections 2024-08-28T19:39:29.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 1 -- 172.21.15.33:0/3687107925 wait complete. 2024-08-28T19:39:29.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.196+0000 7f38530c2740 20 client.17574 trim_cache size 0 max 16384 2024-08-28T19:39:29.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f38530c2740 1 Processor -- start 2024-08-28T19:39:29.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f38530c2740 1 -- start start 2024-08-28T19:39:29.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f38530c2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f38530c2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946ce0390 0x5609470bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f38530c2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470be1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f38530c2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f38481b0be0 con 0x560946cd81b0 2024-08-28T19:39:29.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f38530c2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38481b2720 con 0x560946d01070 2024-08-28T19:39:29.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f38530c2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f38481b12b0 con 0x560946ce0390 2024-08-28T19:39:29.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f3845d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f3845d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56806/0 (socket says 172.21.15.33:56806) 2024-08-28T19:39:29.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.209+0000 7f3845d9b640 1 -- 172.21.15.33:0/1542945166 learned_addr learned my addr 172.21.15.33:0/1542945166 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:29.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.210+0000 7f3845d9b640 1 -- 172.21.15.33:0/1542945166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946ce0390 msgr2=0x5609470bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:29.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.210+0000 7f3845d9b640 1 --2- 172.21.15.33:0/1542945166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946ce0390 0x5609470bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.210+0000 7f3845d9b640 1 -- 172.21.15.33:0/1542945166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 msgr2=0x5609470be1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:29.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.210+0000 7f3845d9b640 1 --2- 172.21.15.33:0/1542945166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470be1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.210+0000 7f3845d9b640 1 -- 172.21.15.33:0/1542945166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609470b4170 con 0x560946cd81b0 2024-08-28T19:39:29.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.210+0000 7f3845d9b640 1 --2- 172.21.15.33:0/1542945166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b1ef0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f383c009900 tx=0x7f383c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3e93a363a40a7f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:29.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.210+0000 7f382ffff640 1 -- 172.21.15.33:0/1542945166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c043070 con 0x560946cd81b0 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.210+0000 7f382ffff640 1 -- 172.21.15.33:0/1542945166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f383c0317a0 con 0x560946cd81b0 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.210+0000 7f382ffff640 1 -- 172.21.15.33:0/1542945166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c035040 con 0x560946cd81b0 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 -- 172.21.15.33:0/1542945166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 msgr2=0x5609470b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 --2- 172.21.15.33:0/1542945166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b1ef0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f383c009900 tx=0x7f383c032f90 comp rx=0 tx=0).stop 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 -- 172.21.15.33:0/1542945166 shutdown_connections 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 --2- 172.21.15.33:0/1542945166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946d01070 0x5609470be1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 --2- 172.21.15.33:0/1542945166 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946ce0390 0x5609470bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 --2- 172.21.15.33:0/1542945166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b1ef0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 -- 172.21.15.33:0/1542945166 >> 172.21.15.33:0/1542945166 conn(0x560946cf5460 msgr2=0x5609470b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 -- 172.21.15.33:0/1542945166 shutdown_connections 2024-08-28T19:39:29.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 -- 172.21.15.33:0/1542945166 wait complete. 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 -- start start 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 Processor -- start 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.211+0000 7f38530c2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946ce0390 0x5609470b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f38530c2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946d01070 0x5609470b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f38530c2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f38481b2050 con 0x560946cd81b0 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f38530c2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38481b1980 con 0x560946ce0390 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f38530c2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f38481aebe0 con 0x560946d01070 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f38530c2740 10 client.0 _ll_register_callbacks cb 0x7f383800c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f3845d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f3845d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56818/0 (socket says 172.21.15.33:56818) 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f3845d9b640 1 -- 172.21.15.33:0/1516605615 learned_addr learned my addr 172.21.15.33:0/1516605615 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f384659c640 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946ce0390 0x5609470b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f3845d9b640 1 -- 172.21.15.33:0/1516605615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946d01070 msgr2=0x5609470b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f3845d9b640 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946d01070 0x5609470b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f3845d9b640 1 -- 172.21.15.33:0/1516605615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946ce0390 msgr2=0x5609470b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f3845d9b640 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946ce0390 0x5609470b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f3845d9b640 1 -- 172.21.15.33:0/1516605615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56094712d9b0 con 0x560946cd81b0 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f3845d9b640 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b5ef0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f383c033000 tx=0x7f383c0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289897c8d1c82665 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f382dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f382dffb640 1 -- 172.21.15.33:0/1516605615 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c035040 con 0x560946cd81b0 2024-08-28T19:39:29.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f382dffb640 1 -- 172.21.15.33:0/1516605615 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f383c03d660 con 0x560946cd81b0 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.212+0000 7f38530c2740 1 -- 172.21.15.33:0/1516605615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f383c0317a0 con 0x560946cd81b0 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f382dffb640 1 -- 172.21.15.33:0/1516605615 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f383c043040 con 0x560946cd81b0 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f38530c2740 10 client.17580 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f38530c2740 1 -- 172.21.15.33:0/1516605615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56094712ec30 con 0x560946cd81b0 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f382dffb640 1 -- 172.21.15.33:0/1516605615 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f383c0317a0 con 0x560946cd81b0 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f382dffb640 1 -- 172.21.15.33:0/1516605615 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f383c03a040 con 0x560946cd81b0 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f38530c2740 10 client.17580 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f38530c2740 10 client.17580 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f38530c2740 20 client.17580 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f38530c2740 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560946c94da0 0x560947130fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f38530c2740 4 client.17580 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f38530c2740 1 -- 172.21.15.33:0/1516605615 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56094701b070 con 0x560946c94da0 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.213+0000 7f384659c640 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560946c94da0 0x560947130fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f382dffb640 10 client.17580 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f384659c640 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560946c94da0 0x560947130fa0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eddbf40fcf7c82bf server_cookie=a2e3e5f4348f08ce in_seq=0 out_seq=0 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f382dffb640 1 -- 172.21.15.33:0/1516605615 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56094701b070 con 0x560946c94da0 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f382dffb640 10 client.17580 handle_command_reply: tid=0 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 client.17580 shutdown 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 -- 172.21.15.33:0/1516605615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 msgr2=0x5609470b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b5ef0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f383c033000 tx=0x7f383c0056d0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 -- 172.21.15.33:0/1516605615 shutdown_connections 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560946d01070 0x5609470b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560946ce0390 0x5609470b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560946c94da0 0x560947130fa0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 --2- 172.21.15.33:0/1516605615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560946cd81b0 0x5609470b5ef0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 -- 172.21.15.33:0/1516605615 >> 172.21.15.33:0/1516605615 conn(0x560946cf5460 msgr2=0x5609470a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:29.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f382dffb640 0 client.17580 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:29.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 -- 172.21.15.33:0/1516605615 shutdown_connections 2024-08-28T19:39:29.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.214+0000 7f38530c2740 1 -- 172.21.15.33:0/1516605615 wait complete. 2024-08-28T19:39:29.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f38530c2740 20 client.17580 trim_cache size 0 max 16384 2024-08-28T19:39:29.222 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:39:29.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 -- 172.21.15.33:0/958695511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38300b4ca0 msgr2=0x7f38300b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:29.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38300b4ca0 0x7f38300b71b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f38400e2ff0 tx=0x7f3840079380 comp rx=0 tx=0).stop 2024-08-28T19:39:29.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 -- 172.21.15.33:0/958695511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f384810dbc0 msgr2=0x7f384819fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:29.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f384810dbc0 0x7f384819fa70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f384000eaa0 tx=0x7f384000ef60 comp rx=0 tx=0).stop 2024-08-28T19:39:29.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 -- 172.21.15.33:0/958695511 shutdown_connections 2024-08-28T19:39:29.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f384810dbc0 0x7f384819fa70 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38481050b0 0x7f384819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38300b4ca0 0x7f38300b71b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 --2- 172.21.15.33:0/958695511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3848104760 0x7f384819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 -- 172.21.15.33:0/958695511 >> 172.21.15.33:0/958695511 conn(0x7f38480794b0 msgr2=0x7f3848107700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 -- 172.21.15.33:0/958695511 shutdown_connections 2024-08-28T19:39:29.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:29.215+0000 7f384cb4d640 1 -- 172.21.15.33:0/958695511 wait complete. 2024-08-28T19:39:29.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:29 smithi059 ceph-mon[22052]: pgmap v555: 129 pgs: 129 active+clean; 7.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-08-28T19:39:29.783 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:29 smithi033 ceph-mon[18549]: pgmap v555: 129 pgs: 129 active+clean; 7.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-08-28T19:39:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:29 smithi122 ceph-mon[22174]: pgmap v555: 129 pgs: 129 active+clean; 7.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-08-28T19:39:30.910 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:39:30.911 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:39:31.177 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:39:31.627 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:31 smithi033 ceph-mon[18549]: pgmap v556: 129 pgs: 129 active+clean; 7.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-08-28T19:39:31.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.720+0000 7f32befd0640 1 -- 172.21.15.33:0/4070369197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32b8109290 msgr2=0x7f32b81096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:31.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.720+0000 7f32befd0640 1 --2- 172.21.15.33:0/4070369197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32b8109290 0x7f32b81096a0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009900 tx=0x7f32a402a410 comp rx=0 tx=0).stop 2024-08-28T19:39:31.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 -- 172.21.15.33:0/4070369197 shutdown_connections 2024-08-28T19:39:31.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 --2- 172.21.15.33:0/4070369197 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b8109be0 0x7f32b8110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 --2- 172.21.15.33:0/4070369197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32b8109290 0x7f32b81096a0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 --2- 172.21.15.33:0/4070369197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8103950 0x7f32b8103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 -- 172.21.15.33:0/4070369197 >> 172.21.15.33:0/4070369197 conn(0x7f32b80ff3a0 msgr2=0x7f32b81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:31.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 -- 172.21.15.33:0/4070369197 shutdown_connections 2024-08-28T19:39:31.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 -- 172.21.15.33:0/4070369197 wait complete. 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 Processor -- start 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 -- start start 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32b8103950 0x7f32b819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.721+0000 7f32befd0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8109290 0x7f32b819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32befd0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b8109be0 0x7f32b819fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32befd0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32b81138a0 con 0x7f32b8103950 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32befd0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32b8113720 con 0x7f32b8109290 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32befd0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f32b8113a20 con 0x7f32b8109be0 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bcd6c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32b8103950 0x7f32b819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bcd6c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32b8103950 0x7f32b819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56834/0 (socket says 172.21.15.33:56834) 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bcd6c640 1 -- 172.21.15.33:0/3236432020 learned_addr learned my addr 172.21.15.33:0/3236432020 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bd56d640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b8109be0 0x7f32b819fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32b7fff640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8109290 0x7f32b819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bcd6c640 1 -- 172.21.15.33:0/3236432020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b8109be0 msgr2=0x7f32b819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b8109be0 0x7f32b819fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bcd6c640 1 -- 172.21.15.33:0/3236432020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8109290 msgr2=0x7f32b819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8109290 0x7f32b819a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bcd6c640 1 -- 172.21.15.33:0/3236432020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b81a01e0 con 0x7f32b8103950 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bd56d640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b8109be0 0x7f32b819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32b7fff640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8109290 0x7f32b819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32b8103950 0x7f32b819a270 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00d950 tx=0x7f32ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32b5ffb640 1 -- 172.21.15.33:0/3236432020 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac017030 con 0x7f32b8103950 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32b5ffb640 1 -- 172.21.15.33:0/3236432020 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32ac004020 con 0x7f32b8103950 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32befd0640 1 -- 172.21.15.33:0/3236432020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b81a04d0 con 0x7f32b8103950 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.722+0000 7f32b5ffb640 1 -- 172.21.15.33:0/3236432020 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0047a0 con 0x7f32b8103950 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.723+0000 7f32befd0640 1 -- 172.21.15.33:0/3236432020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b81a6c30 con 0x7f32b8103950 2024-08-28T19:39:31.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32c5545740 1 Processor -- start 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32c5545740 1 -- start start 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32b5ffb640 1 -- 172.21.15.33:0/3236432020 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f32ac009a30 con 0x7f32b8103950 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32c5545740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d5ec780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32c5545740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d21d490 0x557f9d5eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32c5545740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5ed200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32c5545740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557f9d5625f0 con 0x557f9d225670 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32c5545740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557f9d551b80 con 0x557f9d21d490 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32c5545740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557f9d555b30 con 0x557f9d246350 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32b7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32b7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5ed200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56838/0 (socket says 172.21.15.33:56838) 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32b7fff640 1 -- 172.21.15.33:0/59197654 learned_addr learned my addr 172.21.15.33:0/59197654 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/59197654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d21d490 0x557f9d5eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.726+0000 7f32bd56d640 1 --2- 172.21.15.33:0/59197654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d5ec780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32b7fff640 1 -- 172.21.15.33:0/59197654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 msgr2=0x557f9d5ec780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:31.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32b7fff640 1 --2- 172.21.15.33:0/59197654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d5ec780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32b7fff640 1 -- 172.21.15.33:0/59197654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d21d490 msgr2=0x557f9d5eccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:31.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32b7fff640 1 --2- 172.21.15.33:0/59197654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d21d490 0x557f9d5eccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32b7fff640 1 -- 172.21.15.33:0/59197654 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f9d2b1930 con 0x557f9d225670 2024-08-28T19:39:31.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32b5ffb640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32a80b4ca0 0x7f32a80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32bd56d640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32a80b4ca0 0x7f32a80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32b7fff640 1 --2- 172.21.15.33:0/59197654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5ed200 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f32a4000c00 tx=0x7f32a4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b468d90dcd63ae4b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:31.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32b5ffb640 1 -- 172.21.15.33:0/3236432020 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f32ac0e54b0 con 0x7f32b8103950 2024-08-28T19:39:31.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32a2ffd640 1 -- 172.21.15.33:0/59197654 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a403f070 con 0x557f9d225670 2024-08-28T19:39:31.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32a2ffd640 1 -- 172.21.15.33:0/59197654 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32a40316a0 con 0x557f9d225670 2024-08-28T19:39:31.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.727+0000 7f32a2ffd640 1 -- 172.21.15.33:0/59197654 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4035070 con 0x557f9d225670 2024-08-28T19:39:31.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.728+0000 7f32c5545740 1 -- 172.21.15.33:0/59197654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 msgr2=0x557f9d5ed200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:31.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.728+0000 7f32bd56d640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32a80b4ca0 0x7f32a80b71b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f32b0005fd0 tx=0x7f32b00085b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:31.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.728+0000 7f32c5545740 1 --2- 172.21.15.33:0/59197654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5ed200 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f32a4000c00 tx=0x7f32a4032ce0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.728+0000 7f32c5545740 1 -- 172.21.15.33:0/59197654 shutdown_connections 2024-08-28T19:39:31.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.728+0000 7f32c5545740 1 --2- 172.21.15.33:0/59197654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5ed200 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.728+0000 7f32c5545740 1 --2- 172.21.15.33:0/59197654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d21d490 0x557f9d5eccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.728+0000 7f32c5545740 1 --2- 172.21.15.33:0/59197654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d5ec780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.728+0000 7f32c5545740 1 -- 172.21.15.33:0/59197654 >> 172.21.15.33:0/59197654 conn(0x557f9d23a740 msgr2=0x557f9d5ea670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:31.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.728+0000 7f32c5545740 1 -- 172.21.15.33:0/59197654 shutdown_connections 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.728+0000 7f32c5545740 1 -- 172.21.15.33:0/59197654 wait complete. 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.729+0000 7f32c5545740 1 -- start start 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.729+0000 7f32c5545740 1 Processor -- start 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.729+0000 7f32c5545740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d21d490 0x557f9d5f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.729+0000 7f32c5545740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5f8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.729+0000 7f32c5545740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d6041f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.729+0000 7f32c5545740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557f9d3b4890 con 0x557f9d225670 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.729+0000 7f32c5545740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557f9d4d8790 con 0x557f9d21d490 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.729+0000 7f32c5545740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557f9d5faf00 con 0x557f9d246350 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.729+0000 7f32c5545740 10 client.0 _ll_register_callbacks cb 0x557f9d25dba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.729+0000 7f32b7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32b7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5f8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56852/0 (socket says 172.21.15.33:56852) 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32b7fff640 1 -- 172.21.15.33:0/1815451737 learned_addr learned my addr 172.21.15.33:0/1815451737 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32bd56d640 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d6041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d21d490 0x557f9d5f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32b7fff640 1 -- 172.21.15.33:0/1815451737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 msgr2=0x557f9d6041f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32b7fff640 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d6041f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32b7fff640 1 -- 172.21.15.33:0/1815451737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d21d490 msgr2=0x557f9d5f7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32b7fff640 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d21d490 0x557f9d5f7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32b7fff640 1 -- 172.21.15.33:0/1815451737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f9d50ff30 con 0x557f9d225670 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32bd56d640 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d6041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32b7fff640 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5f8380 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f32a40092a0 tx=0x7f32a40314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30af82d162adba4c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f3297fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f3297fff640 1 -- 172.21.15.33:0/1815451737 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a403f030 con 0x557f9d225670 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f3297fff640 1 -- 172.21.15.33:0/1815451737 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f32a4004250 con 0x557f9d225670 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.730+0000 7f32c5545740 1 -- 172.21.15.33:0/1815451737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32a40316a0 con 0x557f9d225670 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f3297fff640 1 -- 172.21.15.33:0/1815451737 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f32a4054050 con 0x557f9d225670 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f32c5545740 10 client.17592 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:31.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f32c5545740 1 -- 172.21.15.33:0/1815451737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f9d606c10 con 0x557f9d225670 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f3297fff640 1 -- 172.21.15.33:0/1815451737 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32a40316a0 con 0x557f9d225670 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f3297fff640 1 -- 172.21.15.33:0/1815451737 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f32a403b460 con 0x557f9d225670 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f32c5545740 10 client.17592 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f32c5545740 10 client.17592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f32c5545740 20 client.17592 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f32c5545740 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9d204cd0 0x557f9d609f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f32c5545740 4 client.17592 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f32c5545740 1 -- 172.21.15.33:0/1815451737 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f9d564540 con 0x557f9d204cd0 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.731+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9d204cd0 0x557f9d609f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.732+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9d204cd0 0x557f9d609f70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643f464d5b456854 server_cookie=510d3979b23d235b in_seq=0 out_seq=0 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.732+0000 7f3297fff640 10 client.17592 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f3297fff640 1 -- 172.21.15.33:0/1815451737 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f9d564540 con 0x557f9d204cd0 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f3297fff640 10 client.17592 handle_command_reply: tid=0 2024-08-28T19:39:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 client.17592 shutdown 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 -- 172.21.15.33:0/1815451737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 msgr2=0x557f9d5f8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5f8380 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f32a40092a0 tx=0x7f32a40314a0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 -- 172.21.15.33:0/1815451737 shutdown_connections 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d6041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9d204cd0 0x557f9d609f70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d225670 0x557f9d5f8380 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 --2- 172.21.15.33:0/1815451737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d21d490 0x557f9d5f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f3297fff640 0 client.17592 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 -- 172.21.15.33:0/1815451737 >> 172.21.15.33:0/1815451737 conn(0x557f9d23a740 msgr2=0x557f9d5ef910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 -- 172.21.15.33:0/1815451737 shutdown_connections 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 1 -- 172.21.15.33:0/1815451737 wait complete. 2024-08-28T19:39:31.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.733+0000 7f32c5545740 20 client.17592 trim_cache size 0 max 16384 2024-08-28T19:39:31.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32c5545740 1 Processor -- start 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32c5545740 1 -- start start 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32c5545740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d21d490 0x557f9d5f8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32c5545740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d225670 0x557f9d5f2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32c5545740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d246350 0x557f9d604160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32c5545740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32b81b0cc0 con 0x557f9d246350 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32c5545740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32b81b2800 con 0x557f9d225670 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32c5545740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f32b81b1390 con 0x557f9d21d490 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32bd56d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d246350 0x557f9d604160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32bd56d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d246350 0x557f9d604160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56854/0 (socket says 172.21.15.33:56854) 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32bd56d640 1 -- 172.21.15.33:0/253129646 learned_addr learned my addr 172.21.15.33:0/253129646 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.751+0000 7f32b7fff640 1 --2- 172.21.15.33:0/253129646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d225670 0x557f9d5f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.752+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/253129646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d21d490 0x557f9d5f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.752+0000 7f32bd56d640 1 -- 172.21.15.33:0/253129646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d21d490 msgr2=0x557f9d5f8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:31.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.752+0000 7f32bd56d640 1 --2- 172.21.15.33:0/253129646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d21d490 0x557f9d5f8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.752+0000 7f32bd56d640 1 -- 172.21.15.33:0/253129646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d225670 msgr2=0x557f9d5f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.752+0000 7f32bd56d640 1 --2- 172.21.15.33:0/253129646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d225670 0x557f9d5f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.752+0000 7f32bd56d640 1 -- 172.21.15.33:0/253129646 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f9d5eea70 con 0x557f9d246350 2024-08-28T19:39:31.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.752+0000 7f32bd56d640 1 --2- 172.21.15.33:0/253129646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d246350 0x557f9d604160 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f32b001c5a0 tx=0x7f32b0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4248858a45768a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.752+0000 7f32a27fc640 1 -- 172.21.15.33:0/253129646 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b001a8f0 con 0x557f9d246350 2024-08-28T19:39:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.752+0000 7f32a27fc640 1 -- 172.21.15.33:0/253129646 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32b0026450 con 0x557f9d246350 2024-08-28T19:39:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.752+0000 7f32a27fc640 1 -- 172.21.15.33:0/253129646 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b001d650 con 0x557f9d246350 2024-08-28T19:39:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.753+0000 7f32c5545740 1 -- 172.21.15.33:0/253129646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d246350 msgr2=0x557f9d604160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.753+0000 7f32c5545740 1 --2- 172.21.15.33:0/253129646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d246350 0x557f9d604160 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f32b001c5a0 tx=0x7f32b0013000 comp rx=0 tx=0).stop 2024-08-28T19:39:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.753+0000 7f32c5545740 1 -- 172.21.15.33:0/253129646 shutdown_connections 2024-08-28T19:39:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.753+0000 7f32c5545740 1 --2- 172.21.15.33:0/253129646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d246350 0x557f9d604160 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.753+0000 7f32c5545740 1 --2- 172.21.15.33:0/253129646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d225670 0x557f9d5f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.753+0000 7f32c5545740 1 --2- 172.21.15.33:0/253129646 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d21d490 0x557f9d5f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.753+0000 7f32c5545740 1 -- 172.21.15.33:0/253129646 >> 172.21.15.33:0/253129646 conn(0x557f9d23a740 msgr2=0x557f9d5f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.753+0000 7f32c5545740 1 -- 172.21.15.33:0/253129646 shutdown_connections 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.753+0000 7f32c5545740 1 -- 172.21.15.33:0/253129646 wait complete. 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.753+0000 7f32c5545740 1 -- start start 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32c5545740 1 Processor -- start 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32c5545740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d21d490 0x557f9d60b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32c5545740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d225670 0x557f9d60be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32c5545740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d66d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32c5545740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f32b81b2130 con 0x557f9d21d490 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32c5545740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32b81b1a60 con 0x557f9d225670 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32c5545740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f32b81aecc0 con 0x557f9d246350 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32c5545740 10 client.0 _ll_register_callbacks cb 0x7f32ac0e8ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32bcd6c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d21d490 0x557f9d60b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32bcd6c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d21d490 0x557f9d60b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56868/0 (socket says 172.21.15.33:56868) 2024-08-28T19:39:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32bcd6c640 1 -- 172.21.15.33:0/883979901 learned_addr learned my addr 172.21.15.33:0/883979901 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32bd56d640 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d66d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32b7fff640 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d225670 0x557f9d60be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32bcd6c640 1 -- 172.21.15.33:0/883979901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 msgr2=0x557f9d66d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d66d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.754+0000 7f32bcd6c640 1 -- 172.21.15.33:0/883979901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d225670 msgr2=0x557f9d60be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d225670 0x557f9d60be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f32bcd6c640 1 -- 172.21.15.33:0/883979901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f9d66dda0 con 0x557f9d21d490 2024-08-28T19:39:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f32bcd6c640 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d21d490 0x557f9d60b8c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0a7880 tx=0x7f32ac009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11ed6c65ad52049 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:31.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f3297fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f3297fff640 1 -- 172.21.15.33:0/883979901 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0aaf70 con 0x557f9d21d490 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f3297fff640 1 -- 172.21.15.33:0/883979901 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f32ac0e2ae0 con 0x557f9d21d490 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f32c5545740 1 -- 172.21.15.33:0/883979901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32b0026450 con 0x557f9d21d490 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f3297fff640 1 -- 172.21.15.33:0/883979901 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f32ac0ab310 con 0x557f9d21d490 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f32c5545740 10 client.17598 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f32c5545740 1 -- 172.21.15.33:0/883979901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f9d675140 con 0x557f9d21d490 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f3297fff640 1 -- 172.21.15.33:0/883979901 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32b0026450 con 0x557f9d21d490 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f3297fff640 1 -- 172.21.15.33:0/883979901 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f32ac0a7a90 con 0x557f9d21d490 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f32c5545740 10 client.17598 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.755+0000 7f32c5545740 10 client.17598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.756+0000 7f32c5545740 20 client.17598 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.756+0000 7f32c5545740 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9d1da080 0x557f9d6778b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.756+0000 7f32c5545740 4 client.17598 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:39:31.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.756+0000 7f32c5545740 1 -- 172.21.15.33:0/883979901 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557f9d55ffe0 con 0x557f9d1da080 2024-08-28T19:39:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.756+0000 7f32b7fff640 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9d1da080 0x557f9d6778b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.756+0000 7f32b7fff640 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9d1da080 0x557f9d6778b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d816bd071950a72a server_cookie=bb5b6d22714900d8 in_seq=0 out_seq=0 2024-08-28T19:39:31.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.756+0000 7f3297fff640 10 client.17598 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f3297fff640 1 -- 172.21.15.33:0/883979901 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557f9d55ffe0 con 0x557f9d1da080 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f3297fff640 10 client.17598 handle_command_reply: tid=0 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f32c5545740 1 client.17598 shutdown 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f32c5545740 1 -- 172.21.15.33:0/883979901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d21d490 msgr2=0x557f9d60b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f32c5545740 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d21d490 0x557f9d60b8c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0a7880 tx=0x7f32ac009f50 comp rx=0 tx=0).stop 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f32c5545740 1 -- 172.21.15.33:0/883979901 shutdown_connections 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f32c5545740 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9d246350 0x557f9d66d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f32c5545740 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9d225670 0x557f9d60be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f32c5545740 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9d1da080 0x557f9d6778b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f32c5545740 1 --2- 172.21.15.33:0/883979901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9d21d490 0x557f9d60b8c0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f32c5545740 1 -- 172.21.15.33:0/883979901 >> 172.21.15.33:0/883979901 conn(0x557f9d23a740 msgr2=0x557f9d5ed7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:31.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.758+0000 7f3297fff640 0 client.17598 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:31.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32c5545740 1 -- 172.21.15.33:0/883979901 shutdown_connections 2024-08-28T19:39:31.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32c5545740 1 -- 172.21.15.33:0/883979901 wait complete. 2024-08-28T19:39:31.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32c5545740 20 client.17598 trim_cache size 0 max 16384 2024-08-28T19:39:31.764 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:39:31.764 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:39:31.764 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "d306a83e-11d8-47b7-8d28-659371ebb837", 2024-08-28T19:39:31.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:39:31.764 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:39:31.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32befd0640 1 -- 172.21.15.33:0/3236432020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32a80b4ca0 msgr2=0x7f32a80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:31.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32befd0640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32a80b4ca0 0x7f32a80b71b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f32b0005fd0 tx=0x7f32b00085b0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32befd0640 1 -- 172.21.15.33:0/3236432020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32b8103950 msgr2=0x7f32b819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:31.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32befd0640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32b8103950 0x7f32b819a270 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00d950 tx=0x7f32ac00de10 comp rx=0 tx=0).stop 2024-08-28T19:39:31.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32befd0640 1 -- 172.21.15.33:0/3236432020 shutdown_connections 2024-08-28T19:39:31.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32befd0640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f32a80b4ca0 0x7f32a80b71b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32befd0640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32b8109be0 0x7f32b819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32befd0640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8109290 0x7f32b819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.759+0000 7f32befd0640 1 --2- 172.21.15.33:0/3236432020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32b8103950 0x7f32b819a270 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:31.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.760+0000 7f32befd0640 1 -- 172.21.15.33:0/3236432020 >> 172.21.15.33:0/3236432020 conn(0x7f32b80ff3a0 msgr2=0x7f32b81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:31.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.760+0000 7f32befd0640 1 -- 172.21.15.33:0/3236432020 shutdown_connections 2024-08-28T19:39:31.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:31.760+0000 7f32befd0640 1 -- 172.21.15.33:0/3236432020 wait complete. 2024-08-28T19:39:31.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:31 smithi059 ceph-mon[22052]: pgmap v556: 129 pgs: 129 active+clean; 7.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-08-28T19:39:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:31 smithi122 ceph-mon[22174]: pgmap v556: 129 pgs: 129 active+clean; 7.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-08-28T19:39:32.486 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:39:32.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:32 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:39:32.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:32 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:39:32.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:32 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:39:32.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:32 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:39:32.739 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:39:32.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:32 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:39:32.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:32 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:39:32.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:32 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:39:32.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:32 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:39:32.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:32 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:39:32.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:32 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:39:32.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:32 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:39:32.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:32 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:39:33.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.270+0000 7f6b57840640 1 -- 172.21.15.33:0/4054542278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50108ad0 msgr2=0x7f6b5010f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.270+0000 7f6b57840640 1 --2- 172.21.15.33:0/4054542278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50108ad0 0x7f6b5010f300 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009ca0 tx=0x7f6b4802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.270+0000 7f6b57840640 1 -- 172.21.15.33:0/4054542278 shutdown_connections 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.270+0000 7f6b57840640 1 --2- 172.21.15.33:0/4054542278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50108ad0 0x7f6b5010f300 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.270+0000 7f6b57840640 1 --2- 172.21.15.33:0/4054542278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b50108180 0x7f6b50108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.270+0000 7f6b57840640 1 --2- 172.21.15.33:0/4054542278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b50102840 0x7f6b50102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.270+0000 7f6b57840640 1 -- 172.21.15.33:0/4054542278 >> 172.21.15.33:0/4054542278 conn(0x7f6b50079580 msgr2=0x7f6b50079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.270+0000 7f6b57840640 1 -- 172.21.15.33:0/4054542278 shutdown_connections 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.270+0000 7f6b57840640 1 -- 172.21.15.33:0/4054542278 wait complete. 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b57840640 1 Processor -- start 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b57840640 1 -- start start 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b57840640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50102840 0x7f6b50104ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b57840640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b50108180 0x7f6b50105400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b57840640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b50108ad0 0x7f6b50105940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b57840640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50112750 con 0x7f6b50102840 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b57840640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501125d0 con 0x7f6b50108ad0 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b57840640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501128d0 con 0x7f6b50108180 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b555dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50102840 0x7f6b50104ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b555dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50102840 0x7f6b50104ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56882/0 (socket says 172.21.15.33:56882) 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.271+0000 7f6b555dc640 1 -- 172.21.15.33:0/922118433 learned_addr learned my addr 172.21.15.33:0/922118433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b50108180 0x7f6b50105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b55ddd640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b50108ad0 0x7f6b50105940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b555dc640 1 -- 172.21.15.33:0/922118433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b50108180 msgr2=0x7f6b50105400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b555dc640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b50108180 0x7f6b50105400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b555dc640 1 -- 172.21.15.33:0/922118433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b50108ad0 msgr2=0x7f6b50105940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b555dc640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b50108ad0 0x7f6b50105940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b555dc640 1 -- 172.21.15.33:0/922118433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b501a8400 con 0x7f6b50102840 2024-08-28T19:39:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b55ddd640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b50108ad0 0x7f6b50105940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b555dc640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50102840 0x7f6b50104ec0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00c950 tx=0x7f6b4c00ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b467fc640 1 -- 172.21.15.33:0/922118433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c007c70 con 0x7f6b50102840 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b467fc640 1 -- 172.21.15.33:0/922118433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b4c007e10 con 0x7f6b50102840 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b57840640 1 -- 172.21.15.33:0/922118433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b501a86f0 con 0x7f6b50102840 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b467fc640 1 -- 172.21.15.33:0/922118433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0187f0 con 0x7f6b50102840 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.272+0000 7f6b57840640 1 -- 172.21.15.33:0/922118433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b501a8c30 con 0x7f6b50102840 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b5ddb5740 1 Processor -- start 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b5ddb5740 1 -- start start 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b467fc640 1 -- 172.21.15.33:0/922118433 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6b4c018990 con 0x7f6b50102840 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47931b0 0x5629d4b61800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b61d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5629d4ad8630 con 0x5629d479b390 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5629d4ac7bc0 con 0x5629d47931b0 2024-08-28T19:39:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5629d4acbb70 con 0x5629d47bc070 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b54ddb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b61d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b54ddb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b61d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56896/0 (socket says 172.21.15.33:56896) 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.275+0000 7f6b54ddb640 1 -- 172.21.15.33:0/3169964431 learned_addr learned my addr 172.21.15.33:0/3169964431 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b55ddd640 1 --2- 172.21.15.33:0/3169964431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b555dc640 1 --2- 172.21.15.33:0/3169964431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47931b0 0x5629d4b61800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b54ddb640 1 -- 172.21.15.33:0/3169964431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 msgr2=0x5629d4b612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/3169964431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b54ddb640 1 -- 172.21.15.33:0/3169964431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47931b0 msgr2=0x5629d4b61800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/3169964431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47931b0 0x5629d4b61800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b54ddb640 1 -- 172.21.15.33:0/3169964431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629d4827650 con 0x5629d479b390 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/3169964431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b61d40 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000b6c0 tx=0x7f6b4000bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9588fede56716f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b467fc640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b3c0b4ca0 0x7f6b3c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b3b7fe640 1 -- 172.21.15.33:0/3169964431 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40003bd0 con 0x5629d479b390 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b3b7fe640 1 -- 172.21.15.33:0/3169964431 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b40015070 con 0x5629d479b390 2024-08-28T19:39:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b3b7fe640 1 -- 172.21.15.33:0/3169964431 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40004cb0 con 0x5629d479b390 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b55ddd640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b3c0b4ca0 0x7f6b3c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.276+0000 7f6b467fc640 1 -- 172.21.15.33:0/922118433 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f6b4c0e5a50 con 0x7f6b50102840 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.277+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/3169964431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 msgr2=0x5629d4b61d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.277+0000 7f6b55ddd640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b3c0b4ca0 0x7f6b3c0b71b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6b4802f500 tx=0x7f6b4802f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.277+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/3169964431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b61d40 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000b6c0 tx=0x7f6b4000bb80 comp rx=0 tx=0).stop 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.277+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/3169964431 shutdown_connections 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.277+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/3169964431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b61d40 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.277+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/3169964431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47931b0 0x5629d4b61800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.277+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/3169964431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.277+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/3169964431 >> 172.21.15.33:0/3169964431 conn(0x5629d47b0460 msgr2=0x5629d4b5f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.277+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/3169964431 shutdown_connections 2024-08-28T19:39:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.277+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/3169964431 wait complete. 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b5ddb5740 1 -- start start 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b5ddb5740 1 Processor -- start 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47931b0 0x5629d4b6c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b6cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b78dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5629d492a700 con 0x5629d479b390 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5629d4a4e700 con 0x5629d47931b0 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5629d4b6faa0 con 0x5629d47bc070 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b5ddb5740 10 client.0 _ll_register_callbacks cb 0x5629d4a7ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b54ddb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b6cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b54ddb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b6cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56898/0 (socket says 172.21.15.33:56898) 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.278+0000 7f6b54ddb640 1 -- 172.21.15.33:0/403099006 learned_addr learned my addr 172.21.15.33:0/403099006 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:33.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b55ddd640 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b78dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b555dc640 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47931b0 0x5629d4b6c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b54ddb640 1 -- 172.21.15.33:0/403099006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 msgr2=0x5629d4b78dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b78dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b54ddb640 1 -- 172.21.15.33:0/403099006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47931b0 msgr2=0x5629d4b6c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47931b0 0x5629d4b6c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b54ddb640 1 -- 172.21.15.33:0/403099006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629d4a878b0 con 0x5629d479b390 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b6cf20 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f6b40003e00 tx=0x7f6b40003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af79a91c7ab738ec server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b38ff9640 1 -- 172.21.15.33:0/403099006 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40028060 con 0x5629d479b390 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b38ff9640 1 -- 172.21.15.33:0/403099006 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f6b40011850 con 0x5629d479b390 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/403099006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b40015070 con 0x5629d479b390 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b38ff9640 1 -- 172.21.15.33:0/403099006 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6b4002f050 con 0x5629d479b390 2024-08-28T19:39:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b5ddb5740 10 client.17610 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.279+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/403099006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629d4b7b840 con 0x5629d479b390 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b38ff9640 1 -- 172.21.15.33:0/403099006 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b40015070 con 0x5629d479b390 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b38ff9640 1 -- 172.21.15.33:0/403099006 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6b40022070 con 0x5629d479b390 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b5ddb5740 10 client.17610 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b5ddb5740 10 client.17610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b5ddb5740 20 client.17610 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629d477a9f0 0x5629d4b7ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b5ddb5740 4 client.17610 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/403099006 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629d4ada580 con 0x5629d477a9f0 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b555dc640 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629d477a9f0 0x5629d4b7ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b38ff9640 10 client.17610 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.280+0000 7f6b555dc640 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629d477a9f0 0x5629d4b7ec50 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e398ed4d0bafb49 server_cookie=41ec4f347ad80ce5 in_seq=0 out_seq=0 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b38ff9640 1 -- 172.21.15.33:0/403099006 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629d4ada580 con 0x5629d477a9f0 2024-08-28T19:39:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b38ff9640 10 client.17610 handle_command_reply: tid=0 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b5ddb5740 1 client.17610 shutdown 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/403099006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 msgr2=0x5629d4b6cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b6cf20 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f6b40003e00 tx=0x7f6b40003e30 comp rx=0 tx=0).stop 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/403099006 shutdown_connections 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b78dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629d477a9f0 0x5629d4b7ec50 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d479b390 0x5629d4b6cf20 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/403099006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47931b0 0x5629d4b6c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b38ff9640 0 client.17610 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.281+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/403099006 >> 172.21.15.33:0/403099006 conn(0x5629d47b0460 msgr2=0x5629d4b64450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.282+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/403099006 shutdown_connections 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.282+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/403099006 wait complete. 2024-08-28T19:39:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.282+0000 7f6b5ddb5740 20 client.17610 trim_cache size 0 max 16384 2024-08-28T19:39:33.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.299+0000 7f6b5ddb5740 1 Processor -- start 2024-08-28T19:39:33.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.299+0000 7f6b5ddb5740 1 -- start start 2024-08-28T19:39:33.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b64ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d479b390 0x5629d4b78d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47bc070 0x5629d4b5ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501b2ce0 con 0x5629d47931b0 2024-08-28T19:39:33.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501b4820 con 0x5629d47bc070 2024-08-28T19:39:33.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501b33b0 con 0x5629d479b390 2024-08-28T19:39:33.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b555dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b64ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b555dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b64ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56914/0 (socket says 172.21.15.33:56914) 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b555dc640 1 -- 172.21.15.33:0/1608625048 learned_addr learned my addr 172.21.15.33:0/1608625048 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/1608625048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d479b390 0x5629d4b78d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b55ddd640 1 --2- 172.21.15.33:0/1608625048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47bc070 0x5629d4b5ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b555dc640 1 -- 172.21.15.33:0/1608625048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d479b390 msgr2=0x5629d4b78d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b555dc640 1 --2- 172.21.15.33:0/1608625048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d479b390 0x5629d4b78d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b555dc640 1 -- 172.21.15.33:0/1608625048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47bc070 msgr2=0x5629d4b5ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b555dc640 1 --2- 172.21.15.33:0/1608625048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47bc070 0x5629d4b5ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b555dc640 1 -- 172.21.15.33:0/1608625048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629d4b67610 con 0x5629d47931b0 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b55ddd640 1 --2- 172.21.15.33:0/1608625048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47bc070 0x5629d4b5ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b555dc640 1 --2- 172.21.15.33:0/1608625048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b64ad0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c007590 tx=0x7f6b4c00fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbce41ecd5849aa server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b3affd640 1 -- 172.21.15.33:0/1608625048 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0abda0 con 0x5629d47931b0 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b3affd640 1 -- 172.21.15.33:0/1608625048 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b4c0b0610 con 0x5629d47931b0 2024-08-28T19:39:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.300+0000 7f6b3affd640 1 -- 172.21.15.33:0/1608625048 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0e3210 con 0x5629d47931b0 2024-08-28T19:39:33.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.301+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/1608625048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 msgr2=0x5629d4b64ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:33.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.301+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/1608625048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b64ad0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c007590 tx=0x7f6b4c00fef0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.301+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/1608625048 shutdown_connections 2024-08-28T19:39:33.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.301+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/1608625048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d47bc070 0x5629d4b5ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.301+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/1608625048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d479b390 0x5629d4b78d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.301+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/1608625048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b64ad0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.301+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/1608625048 >> 172.21.15.33:0/1608625048 conn(0x5629d47b0460 msgr2=0x5629d4b643c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.301+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/1608625048 shutdown_connections 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.301+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/1608625048 wait complete. 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b5ddb5740 1 -- start start 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b5ddb5740 1 Processor -- start 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b7fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d479b390 0x5629d4b80190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b5ddb5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b806d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501b4150 con 0x5629d47931b0 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501b3a80 con 0x5629d479b390 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b5ddb5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6b501b0ce0 con 0x5629d47bc070 2024-08-28T19:39:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b5ddb5740 10 client.0 _ll_register_callbacks cb 0x7f6b400044f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b555dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b7fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b555dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b7fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56920/0 (socket says 172.21.15.33:56920) 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.302+0000 7f6b555dc640 1 -- 172.21.15.33:0/2520781057 learned_addr learned my addr 172.21.15.33:0/2520781057 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b55ddd640 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b806d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d479b390 0x5629d4b80190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b555dc640 1 -- 172.21.15.33:0/2520781057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 msgr2=0x5629d4b806d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b555dc640 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b806d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b555dc640 1 -- 172.21.15.33:0/2520781057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d479b390 msgr2=0x5629d4b80190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b555dc640 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d479b390 0x5629d4b80190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b555dc640 1 -- 172.21.15.33:0/2520781057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629d4be83d0 con 0x5629d47931b0 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d479b390 0x5629d4b80190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b555dc640 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b7fc50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0abaa0 tx=0x7f6b4c00fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca41203a4a545eb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:39:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b38ff9640 1 -- 172.21.15.33:0/2520781057 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0b50c0 con 0x5629d47931b0 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b38ff9640 1 -- 172.21.15.33:0/2520781057 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9453+0+0 (secure 0 0 0) 0x7f6b4c0a8390 con 0x5629d47931b0 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/2520781057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b4c0b0610 con 0x5629d47931b0 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b38ff9640 1 -- 172.21.15.33:0/2520781057 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6b4c0b0240 con 0x5629d47931b0 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b5ddb5740 10 client.17616 fetch_fsmap learned FSMap version 28 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.303+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/2520781057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629d4be95a0 con 0x5629d47931b0 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b38ff9640 1 -- 172.21.15.33:0/2520781057 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b4c0b0610 con 0x5629d47931b0 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b38ff9640 1 -- 172.21.15.33:0/2520781057 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6b4c0930c0 con 0x5629d47931b0 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b5ddb5740 10 client.17616 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b5ddb5740 10 client.17616 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b5ddb5740 20 client.17616 populate_metadata read hostname 'smithi033' 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629d474fda0 0x5629d4bebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b5ddb5740 4 client.17616 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/2520781057 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5629d4ad6020 con 0x5629d474fda0 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629d474fda0 0x5629d4bebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:39:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b38ff9640 10 client.17616 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.304+0000 7f6b54ddb640 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629d474fda0 0x5629d4bebcf0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1694be4a245f3834 server_cookie=284d1779194c609d in_seq=0 out_seq=0 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b38ff9640 1 -- 172.21.15.33:0/2520781057 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x5629d4ad6020 con 0x5629d474fda0 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b38ff9640 10 client.17616 handle_command_reply: tid=0 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 client.17616 shutdown 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/2520781057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 msgr2=0x5629d4b7fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b7fc50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0abaa0 tx=0x7f6b4c00fd50 comp rx=0 tx=0).stop 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/2520781057 shutdown_connections 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5629d47bc070 0x5629d4b806d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629d479b390 0x5629d4b80190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5629d474fda0 0x5629d4bebcf0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 --2- 172.21.15.33:0/2520781057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5629d47931b0 0x5629d4b7fc50 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/2520781057 >> 172.21.15.33:0/2520781057 conn(0x5629d47b0460 msgr2=0x5629d4b5e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b38ff9640 0 client.17616 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/2520781057 shutdown_connections 2024-08-28T19:39:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 1 -- 172.21.15.33:0/2520781057 wait complete. 2024-08-28T19:39:33.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.305+0000 7f6b5ddb5740 20 client.17616 trim_cache size 0 max 16384 2024-08-28T19:39:33.312 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:39:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:39:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:39:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:39:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "d306a83e-11d8-47b7-8d28-659371ebb837", 2024-08-28T19:39:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:39:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:39:33.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.313 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.314 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.315 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:39:33.316 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:39:33.317 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:39:33.318 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:39:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:39:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:39:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:39:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:39:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:39:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:39:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:39:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:39:33.319 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 -- 172.21.15.33:0/922118433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b3c0b4ca0 msgr2=0x7f6b3c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b3c0b4ca0 0x7f6b3c0b71b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6b4802f500 tx=0x7f6b4802f310 comp rx=0 tx=0).stop 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 -- 172.21.15.33:0/922118433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50102840 msgr2=0x7f6b50104ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50102840 0x7f6b50104ec0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00c950 tx=0x7f6b4c00ce10 comp rx=0 tx=0).stop 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 -- 172.21.15.33:0/922118433 shutdown_connections 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b50108ad0 0x7f6b50105940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6b3c0b4ca0 0x7f6b3c0b71b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6b50108180 0x7f6b50105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 --2- 172.21.15.33:0/922118433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b50102840 0x7f6b50104ec0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 -- 172.21.15.33:0/922118433 >> 172.21.15.33:0/922118433 conn(0x7f6b50079580 msgr2=0x7f6b5006b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 -- 172.21.15.33:0/922118433 shutdown_connections 2024-08-28T19:39:33.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:39:33.306+0000 7f6b57840640 1 -- 172.21.15.33:0/922118433 wait complete. 2024-08-28T19:39:33.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:33 smithi033 ceph-mon[18549]: pgmap v557: 129 pgs: 129 active+clean; 7.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-08-28T19:39:33.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:33 smithi059 ceph-mon[22052]: pgmap v557: 129 pgs: 129 active+clean; 7.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-08-28T19:39:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:33 smithi122 ceph-mon[22174]: pgmap v557: 129 pgs: 129 active+clean; 7.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-08-28T19:39:34.136 INFO:tasks.cephfs.filesystem:scrub status for tag:d306a83e-11d8-47b7-8d28-659371ebb837 - {'path': '/', 'tag': 'd306a83e-11d8-47b7-8d28-659371ebb837', 'options': 'recursive,force'} 2024-08-28T19:39:34.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:34 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:39:34.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:34 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:39:34.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:34 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:39:35.683 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:35 smithi059 ceph-mon[22052]: pgmap v558: 129 pgs: 129 active+clean; 7.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-08-28T19:39:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:35 smithi122 ceph-mon[22174]: pgmap v558: 129 pgs: 129 active+clean; 7.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-08-28T19:39:35.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:35 smithi033 ceph-mon[18549]: pgmap v558: 129 pgs: 129 active+clean; 7.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-08-28T19:39:37.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:37 smithi059 ceph-mon[22052]: pgmap v559: 129 pgs: 129 active+clean; 7.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-08-28T19:39:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:37 smithi122 ceph-mon[22174]: pgmap v559: 129 pgs: 129 active+clean; 7.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-08-28T19:39:37.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:37 smithi033 ceph-mon[18549]: pgmap v559: 129 pgs: 129 active+clean; 7.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-08-28T19:39:39.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:39 smithi059 ceph-mon[22052]: pgmap v560: 129 pgs: 129 active+clean; 8.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-08-28T19:39:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:39 smithi122 ceph-mon[22174]: pgmap v560: 129 pgs: 129 active+clean; 8.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-08-28T19:39:39.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:39 smithi033 ceph-mon[18549]: pgmap v560: 129 pgs: 129 active+clean; 8.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-08-28T19:39:41.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:41 smithi059 ceph-mon[22052]: pgmap v561: 129 pgs: 129 active+clean; 8.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-08-28T19:39:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:41 smithi122 ceph-mon[22174]: pgmap v561: 129 pgs: 129 active+clean; 8.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-08-28T19:39:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:41 smithi033 ceph-mon[18549]: pgmap v561: 129 pgs: 129 active+clean; 8.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-08-28T19:39:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:43 smithi059 ceph-mon[22052]: pgmap v562: 129 pgs: 129 active+clean; 8.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-08-28T19:39:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:43 smithi122 ceph-mon[22174]: pgmap v562: 129 pgs: 129 active+clean; 8.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-08-28T19:39:43.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:43 smithi033 ceph-mon[18549]: pgmap v562: 129 pgs: 129 active+clean; 8.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-08-28T19:39:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:45 smithi059 ceph-mon[22052]: pgmap v563: 129 pgs: 129 active+clean; 8.3 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-08-28T19:39:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:45 smithi122 ceph-mon[22174]: pgmap v563: 129 pgs: 129 active+clean; 8.3 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-08-28T19:39:45.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:45 smithi033 ceph-mon[18549]: pgmap v563: 129 pgs: 129 active+clean; 8.3 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-08-28T19:39:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:47 smithi059 ceph-mon[22052]: pgmap v564: 129 pgs: 129 active+clean; 8.3 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-08-28T19:39:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:47 smithi122 ceph-mon[22174]: pgmap v564: 129 pgs: 129 active+clean; 8.3 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-08-28T19:39:47.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:47 smithi033 ceph-mon[18549]: pgmap v564: 129 pgs: 129 active+clean; 8.3 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-08-28T19:39:49.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:49 smithi059 ceph-mon[22052]: pgmap v565: 129 pgs: 129 active+clean; 8.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 17 op/s 2024-08-28T19:39:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:49 smithi122 ceph-mon[22174]: pgmap v565: 129 pgs: 129 active+clean; 8.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 17 op/s 2024-08-28T19:39:49.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:49 smithi033 ceph-mon[18549]: pgmap v565: 129 pgs: 129 active+clean; 8.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 17 op/s 2024-08-28T19:39:51.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:51 smithi059 ceph-mon[22052]: pgmap v566: 129 pgs: 129 active+clean; 8.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-08-28T19:39:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:51 smithi122 ceph-mon[22174]: pgmap v566: 129 pgs: 129 active+clean; 8.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-08-28T19:39:51.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:51 smithi033 ceph-mon[18549]: pgmap v566: 129 pgs: 129 active+clean; 8.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-08-28T19:39:53.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:53 smithi059 ceph-mon[22052]: pgmap v567: 129 pgs: 129 active+clean; 8.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-08-28T19:39:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:53 smithi122 ceph-mon[22174]: pgmap v567: 129 pgs: 129 active+clean; 8.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-08-28T19:39:53.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:53 smithi033 ceph-mon[18549]: pgmap v567: 129 pgs: 129 active+clean; 8.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-08-28T19:39:54.275 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.275 INFO:tasks.workunit.client.0.smithi033.stdout:189/600: open fd = 3 2024-08-28T19:39:54.275 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.275 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.275 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.275 INFO:tasks.workunit.client.0.smithi033.stdout:190/600: open fd = 3 2024-08-28T19:39:54.275 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.275 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:191/600: open fd = 3 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:192/600: open fd = 3 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:193/600: open fd = 3 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.276 INFO:tasks.workunit.client.0.smithi033.stdout:194/600: open fd = 3 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:195/600: open fd = 3 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:196/600: open fd = 3 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:197/600: open fd = 3 2024-08-28T19:39:54.277 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:198/600: open fd = 3 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:199/600: open fd = 3 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:200/600: open fd = 3 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.278 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:201/600: open fd = 3 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:202/600: open fd = 3 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:203/600: open fd = 3 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:204/600: open fd = 3 2024-08-28T19:39:54.279 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:205/600: open fd = 3 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:206/600: open fd = 3 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:207/600: open fd = 3 2024-08-28T19:39:54.280 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:208/600: open fd = 3 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:209/600: open fd = 3 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:210/600: open fd = 3 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.281 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:211/600: open fd = 3 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:212/600: open fd = 3 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:213/600: open fd = 3 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:214/600: open fd = 3 2024-08-28T19:39:54.282 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:215/600: open fd = 3 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:216/600: open fd = 3 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:217/600: open fd = 3 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.283 INFO:tasks.workunit.client.0.smithi033.stdout:218/600: open fd = 3 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:219/600: open fd = 3 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:220/600: open fd = 3 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:221/600: open fd = 3 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.284 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:222/600: open fd = 3 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:223/600: open fd = 3 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:224/600: open fd = 3 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.285 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:225/600: open fd = 3 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:226/600: open fd = 3 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:227/600: open fd = 3 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:228/600: open fd = 3 2024-08-28T19:39:54.286 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:229/600: open fd = 3 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:230/600: open fd = 3 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:231/600: open fd = 3 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:232/600: open fd = 3 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:233/600: open fd = 3 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:234/600: open fd = 3 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.288 INFO:tasks.workunit.client.0.smithi033.stdout:235/600: open fd = 3 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:236/600: open fd = 3 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:237/600: open fd = 3 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:238/600: open fd = 3 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.289 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:239/600: open fd = 3 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:240/600: open fd = 3 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:241/600: open fd = 3 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.290 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:242/600: open fd = 3 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:243/600: open fd = 3 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:244/600: open fd = 3 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:245/600: open fd = 3 2024-08-28T19:39:54.291 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:246/600: open fd = 3 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:247/600: open fd = 3 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:248/600: open fd = 3 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.292 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.293 INFO:tasks.workunit.client.0.smithi033.stdout:249/600: open fd = 3 2024-08-28T19:39:54.293 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.293 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.293 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:39:54.293 INFO:tasks.workunit.client.0.smithi033.stdout:250/600: open fd = 3 2024-08-28T19:39:54.293 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:54.293 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:39:55.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:55 smithi059 ceph-mon[22052]: pgmap v568: 129 pgs: 129 active+clean; 8.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 18 op/s 2024-08-28T19:39:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:55 smithi122 ceph-mon[22174]: pgmap v568: 129 pgs: 129 active+clean; 8.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 18 op/s 2024-08-28T19:39:55.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:55 smithi033 ceph-mon[18549]: pgmap v568: 129 pgs: 129 active+clean; 8.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 18 op/s 2024-08-28T19:39:57.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:57 smithi059 ceph-mon[22052]: pgmap v569: 129 pgs: 129 active+clean; 8.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-08-28T19:39:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:57 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:39:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:57 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:39:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:57 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:39:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:57 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:39:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:57 smithi122 ceph-mon[22174]: pgmap v569: 129 pgs: 129 active+clean; 8.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-08-28T19:39:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:57 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:39:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:57 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:39:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:57 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:39:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:57 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:39:57.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:57 smithi033 ceph-mon[18549]: pgmap v569: 129 pgs: 129 active+clean; 8.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-08-28T19:39:57.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:57 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:39:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:57 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:39:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:57 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:39:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:57 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:39:59.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:39:59 smithi059 ceph-mon[22052]: pgmap v570: 129 pgs: 129 active+clean; 8.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-08-28T19:39:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:39:59 smithi122 ceph-mon[22174]: pgmap v570: 129 pgs: 129 active+clean; 8.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-08-28T19:39:59.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:39:59 smithi033 ceph-mon[18549]: pgmap v570: 129 pgs: 129 active+clean; 8.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-08-28T19:40:00.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:00 smithi059 ceph-mon[22052]: overall HEALTH_OK 2024-08-28T19:40:00.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:00 smithi122 ceph-mon[22174]: overall HEALTH_OK 2024-08-28T19:40:00.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:00 smithi033 ceph-mon[18549]: overall HEALTH_OK 2024-08-28T19:40:01.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:01 smithi059 ceph-mon[22052]: pgmap v571: 129 pgs: 129 active+clean; 8.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-08-28T19:40:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:01 smithi122 ceph-mon[22174]: pgmap v571: 129 pgs: 129 active+clean; 8.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-08-28T19:40:01.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:01 smithi033 ceph-mon[18549]: pgmap v571: 129 pgs: 129 active+clean; 8.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-08-28T19:40:03.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:03 smithi059 ceph-mon[22052]: pgmap v572: 129 pgs: 129 active+clean; 8.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-08-28T19:40:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:03 smithi122 ceph-mon[22174]: pgmap v572: 129 pgs: 129 active+clean; 8.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-08-28T19:40:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:03 smithi033 ceph-mon[18549]: pgmap v572: 129 pgs: 129 active+clean; 8.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-08-28T19:40:04.138 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:40:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.971+0000 7f3e82e95640 1 -- 172.21.15.33:0/3051464695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e7c1050b0 msgr2=0x7f3e7c10d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.971+0000 7f3e82e95640 1 --2- 172.21.15.33:0/3051464695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e7c1050b0 0x7f3e7c10d600 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009900 tx=0x7f3e6802a3f0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.971+0000 7f3e82e95640 1 -- 172.21.15.33:0/3051464695 shutdown_connections 2024-08-28T19:40:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.971+0000 7f3e82e95640 1 --2- 172.21.15.33:0/3051464695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7c10dbc0 0x7f3e7c1100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.971+0000 7f3e82e95640 1 --2- 172.21.15.33:0/3051464695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e7c1050b0 0x7f3e7c10d600 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.971+0000 7f3e82e95640 1 --2- 172.21.15.33:0/3051464695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7c104760 0x7f3e7c104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.971+0000 7f3e82e95640 1 -- 172.21.15.33:0/3051464695 >> 172.21.15.33:0/3051464695 conn(0x7f3e7c0794d0 msgr2=0x7f3e7c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.971+0000 7f3e82e95640 1 -- 172.21.15.33:0/3051464695 shutdown_connections 2024-08-28T19:40:04.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.971+0000 7f3e82e95640 1 -- 172.21.15.33:0/3051464695 wait complete. 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.972+0000 7f3e82e95640 1 Processor -- start 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.972+0000 7f3e82e95640 1 -- start start 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.972+0000 7f3e82e95640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e7c104760 0x7f3e7c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e82e95640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7c1050b0 0x7f3e7c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e82e95640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7c10dbc0 0x7f3e7c19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e82e95640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c113800 con 0x7f3e7c104760 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e82e95640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c113680 con 0x7f3e7c1050b0 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e82e95640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c113980 con 0x7f3e7c10dbc0 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e80c31640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e7c104760 0x7f3e7c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e80c31640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e7c104760 0x7f3e7c19a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55288/0 (socket says 172.21.15.33:55288) 2024-08-28T19:40:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e80c31640 1 -- 172.21.15.33:0/1595594401 learned_addr learned my addr 172.21.15.33:0/1595594401 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7c1050b0 0x7f3e7c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e81432640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7c10dbc0 0x7f3e7c19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e80c31640 1 -- 172.21.15.33:0/1595594401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7c10dbc0 msgr2=0x7f3e7c19fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e80c31640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7c10dbc0 0x7f3e7c19fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e80c31640 1 -- 172.21.15.33:0/1595594401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7c1050b0 msgr2=0x7f3e7c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e80c31640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7c1050b0 0x7f3e7c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e80c31640 1 -- 172.21.15.33:0/1595594401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c1a0100 con 0x7f3e7c104760 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7c1050b0 0x7f3e7c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.973+0000 7f3e80c31640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e7c104760 0x7f3e7c19a250 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000d950 tx=0x7f3e7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.974+0000 7f3e79ffb640 1 -- 172.21.15.33:0/1595594401 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70017070 con 0x7f3e7c104760 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.974+0000 7f3e82e95640 1 -- 172.21.15.33:0/1595594401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e7c1a03f0 con 0x7f3e7c104760 2024-08-28T19:40:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.974+0000 7f3e79ffb640 1 -- 172.21.15.33:0/1595594401 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e70009c30 con 0x7f3e7c104760 2024-08-28T19:40:04.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.974+0000 7f3e79ffb640 1 -- 172.21.15.33:0/1595594401 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000f620 con 0x7f3e7c104760 2024-08-28T19:40:04.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.974+0000 7f3e82e95640 1 -- 172.21.15.33:0/1595594401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e7c1a6c10 con 0x7f3e7c104760 2024-08-28T19:40:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e8940a740 1 Processor -- start 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e8940a740 1 -- start start 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e79ffb640 1 -- 172.21.15.33:0/1595594401 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3e7001a070 con 0x7f3e7c104760 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017b1070 0x556001b56300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 0x556001b56840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b56d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e8940a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556001acd630 con 0x5560017b1070 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e8940a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556001abcbc0 con 0x5560017881b0 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e8940a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556001ac0b70 con 0x556001790390 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e81432640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017b1070 0x556001b56300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e81432640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017b1070 0x556001b56300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55294/0 (socket says 172.21.15.33:55294) 2024-08-28T19:40:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e81432640 1 -- 172.21.15.33:0/2021080062 learned_addr learned my addr 172.21.15.33:0/2021080062 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e80c31640 1 --2- 172.21.15.33:0/2021080062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 0x556001b56840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.977+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/2021080062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b56d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e7bfff640 1 -- 172.21.15.33:0/2021080062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 msgr2=0x556001b56840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/2021080062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 0x556001b56840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e7bfff640 1 -- 172.21.15.33:0/2021080062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017b1070 msgr2=0x556001b56300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/2021080062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017b1070 0x556001b56300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e7bfff640 1 -- 172.21.15.33:0/2021080062 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55600181c650 con 0x556001790390 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e79ffb640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e6c0b4d50 0x7f3e6c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e81432640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e6c0b4d50 0x7f3e6c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e79ffb640 1 -- 172.21.15.33:0/1595594401 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7f3e700e52e0 con 0x7f3e7c104760 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/2021080062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b56d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e6802a910 tx=0x7f3e68000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59d7d107685aa56c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:04.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e66ffd640 1 -- 172.21.15.33:0/2021080062 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68040070 con 0x556001790390 2024-08-28T19:40:04.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e66ffd640 1 -- 172.21.15.33:0/2021080062 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e68005040 con 0x556001790390 2024-08-28T19:40:04.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.978+0000 7f3e66ffd640 1 -- 172.21.15.33:0/2021080062 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68035040 con 0x556001790390 2024-08-28T19:40:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.979+0000 7f3e8940a740 1 -- 172.21.15.33:0/2021080062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 msgr2=0x556001b56d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.979+0000 7f3e81432640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e6c0b4d50 0x7f3e6c0b7260 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3e74010540 tx=0x7f3e74007520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.979+0000 7f3e8940a740 1 --2- 172.21.15.33:0/2021080062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b56d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e6802a910 tx=0x7f3e68000bc0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.979+0000 7f3e8940a740 1 -- 172.21.15.33:0/2021080062 shutdown_connections 2024-08-28T19:40:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.979+0000 7f3e8940a740 1 --2- 172.21.15.33:0/2021080062 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b56d80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.979+0000 7f3e8940a740 1 --2- 172.21.15.33:0/2021080062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 0x556001b56840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.979+0000 7f3e8940a740 1 --2- 172.21.15.33:0/2021080062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017b1070 0x556001b56300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.979+0000 7f3e8940a740 1 -- 172.21.15.33:0/2021080062 >> 172.21.15.33:0/2021080062 conn(0x5560017a5460 msgr2=0x556001b541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.980+0000 7f3e8940a740 1 -- 172.21.15.33:0/2021080062 shutdown_connections 2024-08-28T19:40:04.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.980+0000 7f3e8940a740 1 -- 172.21.15.33:0/2021080062 wait complete. 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.980+0000 7f3e8940a740 1 -- start start 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.980+0000 7f3e8940a740 1 Processor -- start 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 0x556001b65e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b66350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017b1070 0x556001b72110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e8940a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55600191f700 con 0x556001790390 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e8940a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556001a43700 con 0x5560017881b0 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e8940a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556001b68de0 con 0x5560017b1070 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e8940a740 10 client.0 _ll_register_callbacks cb 0x556001a72dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e80c31640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 0x556001b65e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e81432640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017b1070 0x556001b72110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b66350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e80c31640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 0x556001b65e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:33288/0 (socket says 172.21.15.33:33288) 2024-08-28T19:40:04.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e81432640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017b1070 0x556001b72110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:55264/0 (socket says 172.21.15.33:55264) 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e80c31640 1 -- 172.21.15.33:0/3483763899 learned_addr learned my addr 172.21.15.33:0/3483763899 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e7bfff640 1 -- 172.21.15.33:0/3483763899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017b1070 msgr2=0x556001b72110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017b1070 0x556001b72110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e7bfff640 1 -- 172.21.15.33:0/3483763899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 msgr2=0x556001b65e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 0x556001b65e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e7bfff640 1 -- 172.21.15.33:0/3483763899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556001a7c8b0 con 0x556001790390 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b66350 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f3e6802a910 tx=0x7f3e68031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc826bce3ae0a3bf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.981+0000 7f3e5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3483763899 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68035070 con 0x556001790390 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3483763899 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7f3e68004030 con 0x556001790390 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e8940a740 1 -- 172.21.15.33:0/3483763899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e68005040 con 0x556001790390 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3483763899 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3e68058050 con 0x556001790390 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e8940a740 10 client.17628 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:04.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e8940a740 1 -- 172.21.15.33:0/3483763899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556001b74b40 con 0x556001790390 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3483763899 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e68004230 con 0x556001790390 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3483763899 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3e680037f0 con 0x556001790390 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e8940a740 10 client.17628 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e8940a740 10 client.17628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e8940a740 20 client.17628 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55600176f9f0 0x556001b77ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e8940a740 4 client.17628 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.982+0000 7f3e8940a740 1 -- 172.21.15.33:0/3483763899 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3e68005040 con 0x55600176f9f0 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.983+0000 7f3e80c31640 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55600176f9f0 0x556001b77ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.983+0000 7f3e5bfff640 10 client.17628 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.983+0000 7f3e80c31640 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55600176f9f0 0x556001b77ea0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2df7ac2c06b2fb2b server_cookie=dbc884a223d8f068 in_seq=0 out_seq=0 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3483763899 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f3e68005040 con 0x55600176f9f0 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e5bfff640 10 client.17628 handle_command_reply: tid=0 2024-08-28T19:40:04.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e8940a740 1 client.17628 shutdown 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e8940a740 1 -- 172.21.15.33:0/3483763899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 msgr2=0x556001b66350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b66350 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f3e6802a910 tx=0x7f3e68031760 comp rx=0 tx=0).stop 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e8940a740 1 -- 172.21.15.33:0/3483763899 shutdown_connections 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017b1070 0x556001b72110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55600176f9f0 0x556001b77ea0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b66350 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3483763899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017881b0 0x556001b65e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e5bfff640 0 client.17628 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.984+0000 7f3e8940a740 1 -- 172.21.15.33:0/3483763899 >> 172.21.15.33:0/3483763899 conn(0x5560017a5460 msgr2=0x556001b527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.985+0000 7f3e8940a740 1 -- 172.21.15.33:0/3483763899 shutdown_connections 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.985+0000 7f3e8940a740 1 -- 172.21.15.33:0/3483763899 wait complete. 2024-08-28T19:40:04.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:04.985+0000 7f3e8940a740 20 client.17628 trim_cache size 0 max 16384 2024-08-28T19:40:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.002+0000 7f3e8940a740 1 Processor -- start 2024-08-28T19:40:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.002+0000 7f3e8940a740 1 -- start start 2024-08-28T19:40:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017881b0 0x556001b54260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017b1070 0x556001b72080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e8940a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1ae940 con 0x556001790390 2024-08-28T19:40:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e8940a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1b0480 con 0x5560017b1070 2024-08-28T19:40:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e8940a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1af010 con 0x5560017881b0 2024-08-28T19:40:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:05.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55314/0 (socket says 172.21.15.33:55314) 2024-08-28T19:40:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e7bfff640 1 -- 172.21.15.33:0/45613338 learned_addr learned my addr 172.21.15.33:0/45613338 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e81432640 1 --2- 172.21.15.33:0/45613338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017b1070 0x556001b72080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e80c31640 1 --2- 172.21.15.33:0/45613338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017881b0 0x556001b54260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e7bfff640 1 -- 172.21.15.33:0/45613338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017881b0 msgr2=0x556001b54260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/45613338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017881b0 0x556001b54260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e7bfff640 1 -- 172.21.15.33:0/45613338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017b1070 msgr2=0x556001b72080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/45613338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017b1070 0x556001b72080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.003+0000 7f3e7bfff640 1 -- 172.21.15.33:0/45613338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556001b616a0 con 0x556001790390 2024-08-28T19:40:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.004+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/45613338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b529e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3e68032af0 tx=0x7f3e68031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbeb1d55c1fc9cdf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.004+0000 7f3e667fc640 1 -- 172.21.15.33:0/45613338 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68060070 con 0x556001790390 2024-08-28T19:40:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.004+0000 7f3e667fc640 1 -- 172.21.15.33:0/45613338 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e68004290 con 0x556001790390 2024-08-28T19:40:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.004+0000 7f3e667fc640 1 -- 172.21.15.33:0/45613338 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68035040 con 0x556001790390 2024-08-28T19:40:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 -- 172.21.15.33:0/45613338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 msgr2=0x556001b529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 --2- 172.21.15.33:0/45613338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b529e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3e68032af0 tx=0x7f3e68031400 comp rx=0 tx=0).stop 2024-08-28T19:40:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 -- 172.21.15.33:0/45613338 shutdown_connections 2024-08-28T19:40:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 --2- 172.21.15.33:0/45613338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017b1070 0x556001b72080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 --2- 172.21.15.33:0/45613338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556001790390 0x556001b529e0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 --2- 172.21.15.33:0/45613338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5560017881b0 0x556001b54260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 -- 172.21.15.33:0/45613338 >> 172.21.15.33:0/45613338 conn(0x5560017a5460 msgr2=0x556001b53b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 -- 172.21.15.33:0/45613338 shutdown_connections 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 -- 172.21.15.33:0/45613338 wait complete. 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 -- start start 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.005+0000 7f3e8940a740 1 Processor -- start 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017881b0 0x556001b79570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b79ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e8940a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017b1070 0x556001be1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e8940a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1afdb0 con 0x5560017881b0 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e8940a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1af6e0 con 0x5560017b1070 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e8940a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1ac940 con 0x556001790390 2024-08-28T19:40:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e8940a740 10 client.0 _ll_register_callbacks cb 0x7f3e74007960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b79ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e7bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b79ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:55280/0 (socket says 172.21.15.33:55280) 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e7bfff640 1 -- 172.21.15.33:0/3006107171 learned_addr learned my addr 172.21.15.33:0/3006107171 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e80c31640 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017881b0 0x556001b79570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e81432640 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017b1070 0x556001be1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e80c31640 1 -- 172.21.15.33:0/3006107171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 msgr2=0x556001b79ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e80c31640 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b79ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e80c31640 1 -- 172.21.15.33:0/3006107171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017b1070 msgr2=0x556001be1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e80c31640 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017b1070 0x556001be1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e80c31640 1 -- 172.21.15.33:0/3006107171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556001b530c0 con 0x5560017881b0 2024-08-28T19:40:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.006+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b79ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:40:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e80c31640 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017881b0 0x556001b79570 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3e700e2690 tx=0x7f3e70005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5f0f9bf8790e80 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3006107171 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70021040 con 0x5560017881b0 2024-08-28T19:40:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3006107171 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7f3e70009de0 con 0x5560017881b0 2024-08-28T19:40:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e8940a740 1 -- 172.21.15.33:0/3006107171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e68004290 con 0x5560017881b0 2024-08-28T19:40:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3006107171 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3e700aadf0 con 0x5560017881b0 2024-08-28T19:40:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e8940a740 10 client.17634 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:05.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e8940a740 1 -- 172.21.15.33:0/3006107171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556001be2be0 con 0x5560017881b0 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3006107171 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e68004290 con 0x5560017881b0 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3006107171 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3e700ce0b0 con 0x5560017881b0 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e8940a740 10 client.17634 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e8940a740 10 client.17634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e8940a740 20 client.17634 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.007+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556001744da0 0x556001be5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.008+0000 7f3e8940a740 4 client.17634 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.008+0000 7f3e8940a740 1 -- 172.21.15.33:0/3006107171 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556001acf580 con 0x556001744da0 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.008+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556001744da0 0x556001be5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.008+0000 7f3e7bfff640 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556001744da0 0x556001be5300 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60411f98a5ffd68f server_cookie=4fe740ef6f14ac4a in_seq=0 out_seq=0 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.008+0000 7f3e5bfff640 10 client.17634 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.008+0000 7f3e5bfff640 1 -- 172.21.15.33:0/3006107171 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x556001acf580 con 0x556001744da0 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.008+0000 7f3e5bfff640 10 client.17634 handle_command_reply: tid=0 2024-08-28T19:40:05.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 client.17634 shutdown 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 -- 172.21.15.33:0/3006107171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017881b0 msgr2=0x556001b79570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017881b0 0x556001b79570 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3e700e2690 tx=0x7f3e70005f30 comp rx=0 tx=0).stop 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 -- 172.21.15.33:0/3006107171 shutdown_connections 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560017b1070 0x556001be1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556001790390 0x556001b79ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556001744da0 0x556001be5300 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 --2- 172.21.15.33:0/3006107171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5560017881b0 0x556001b79570 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e5bfff640 0 client.17634 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 -- 172.21.15.33:0/3006107171 >> 172.21.15.33:0/3006107171 conn(0x5560017a5460 msgr2=0x556001b57330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 -- 172.21.15.33:0/3006107171 shutdown_connections 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 1 -- 172.21.15.33:0/3006107171 wait complete. 2024-08-28T19:40:05.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.009+0000 7f3e8940a740 20 client.17634 trim_cache size 0 max 16384 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:40:05.014 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.015 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.016 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.017 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.018 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.019 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:05.020 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:05.021 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:05.021 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:05.021 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:05.021 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:05.021 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:05.021 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:40:05.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 -- 172.21.15.33:0/1595594401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e6c0b4d50 msgr2=0x7f3e6c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e6c0b4d50 0x7f3e6c0b7260 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3e74010540 tx=0x7f3e74007520 comp rx=0 tx=0).stop 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 -- 172.21.15.33:0/1595594401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e7c104760 msgr2=0x7f3e7c19a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e7c104760 0x7f3e7c19a250 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000d950 tx=0x7f3e7000de10 comp rx=0 tx=0).stop 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 -- 172.21.15.33:0/1595594401 shutdown_connections 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3e6c0b4d50 0x7f3e6c0b7260 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e7c10dbc0 0x7f3e7c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7c1050b0 0x7f3e7c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 --2- 172.21.15.33:0/1595594401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e7c104760 0x7f3e7c19a250 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 -- 172.21.15.33:0/1595594401 >> 172.21.15.33:0/1595594401 conn(0x7f3e7c0794d0 msgr2=0x7f3e7c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 -- 172.21.15.33:0/1595594401 shutdown_connections 2024-08-28T19:40:05.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:05.010+0000 7f3e82e95640 1 -- 172.21.15.33:0/1595594401 wait complete. 2024-08-28T19:40:05.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:05 smithi059 ceph-mon[22052]: pgmap v573: 129 pgs: 129 active+clean; 9.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 35 op/s 2024-08-28T19:40:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:05 smithi059 ceph-mon[22052]: osdmap e87: 12 total, 12 up, 12 in 2024-08-28T19:40:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:05 smithi122 ceph-mon[22174]: pgmap v573: 129 pgs: 129 active+clean; 9.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 35 op/s 2024-08-28T19:40:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:05 smithi122 ceph-mon[22174]: osdmap e87: 12 total, 12 up, 12 in 2024-08-28T19:40:05.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:05 smithi033 ceph-mon[18549]: pgmap v573: 129 pgs: 129 active+clean; 9.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 35 op/s 2024-08-28T19:40:05.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:05 smithi033 ceph-mon[18549]: osdmap e87: 12 total, 12 up, 12 in 2024-08-28T19:40:05.928 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:40:05.928 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:40:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.667+0000 7f9f1c558640 1 -- 172.21.15.33:0/2691574862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f14108170 msgr2=0x7f9f14108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.667+0000 7f9f1c558640 1 --2- 172.21.15.33:0/2691574862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f14108170 0x7f9f14108580 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009900 tx=0x7f9f0802a410 comp rx=0 tx=0).stop 2024-08-28T19:40:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.667+0000 7f9f1c558640 1 -- 172.21.15.33:0/2691574862 shutdown_connections 2024-08-28T19:40:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.667+0000 7f9f1c558640 1 --2- 172.21.15.33:0/2691574862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f14108ac0 0x7f9f1410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.667+0000 7f9f1c558640 1 --2- 172.21.15.33:0/2691574862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f14108170 0x7f9f14108580 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.667+0000 7f9f1c558640 1 --2- 172.21.15.33:0/2691574862 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f14102880 0x7f9f14102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.667+0000 7f9f1c558640 1 -- 172.21.15.33:0/2691574862 >> 172.21.15.33:0/2691574862 conn(0x7f9f14079530 msgr2=0x7f9f14079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.667+0000 7f9f1c558640 1 -- 172.21.15.33:0/2691574862 shutdown_connections 2024-08-28T19:40:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.667+0000 7f9f1c558640 1 -- 172.21.15.33:0/2691574862 wait complete. 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1c558640 1 Processor -- start 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1c558640 1 -- start start 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1c558640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f14102880 0x7f9f140ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1c558640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f14108170 0x7f9f140ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1c558640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f14108ac0 0x7f9f140ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1c558640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9f141127a0 con 0x7f9f14102880 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1c558640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9f14112620 con 0x7f9f14108170 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1c558640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9f14112920 con 0x7f9f14108ac0 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1a2f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f14102880 0x7f9f140ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1a2f4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f14102880 0x7f9f140ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55332/0 (socket says 172.21.15.33:55332) 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.668+0000 7f9f1a2f4640 1 -- 172.21.15.33:0/2844374189 learned_addr learned my addr 172.21.15.33:0/2844374189 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f19af3640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f14108170 0x7f9f140ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f1aaf5640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f14108ac0 0x7f9f140ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f1a2f4640 1 -- 172.21.15.33:0/2844374189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f14108ac0 msgr2=0x7f9f140ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f1a2f4640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f14108ac0 0x7f9f140ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f1a2f4640 1 -- 172.21.15.33:0/2844374189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f14108170 msgr2=0x7f9f140ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f1a2f4640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f14108170 0x7f9f140ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f1a2f4640 1 -- 172.21.15.33:0/2844374189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f141a8660 con 0x7f9f14102880 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f1aaf5640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f14108ac0 0x7f9f140ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f1a2f4640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f14102880 0x7f9f140ff410 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000b4a0 tx=0x7f9f1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f077fe640 1 -- 172.21.15.33:0/2844374189 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10014070 con 0x7f9f14102880 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f077fe640 1 -- 172.21.15.33:0/2844374189 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f10010ac0 con 0x7f9f14102880 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f077fe640 1 -- 172.21.15.33:0/2844374189 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10017c30 con 0x7f9f14102880 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f1c558640 1 -- 172.21.15.33:0/2844374189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f141a8950 con 0x7f9f14102880 2024-08-28T19:40:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.669+0000 7f9f1c558640 1 -- 172.21.15.33:0/2844374189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f141a8eb0 con 0x7f9f14102880 2024-08-28T19:40:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.670+0000 7f9f1c558640 1 -- 172.21.15.33:0/2844374189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f14102c90 con 0x7f9f14102880 2024-08-28T19:40:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.672+0000 7f9f077fe640 1 -- 172.21.15.33:0/2844374189 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9f10017070 con 0x7f9f14102880 2024-08-28T19:40:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.673+0000 7f9f077fe640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9f000b4d20 0x7f9f000b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.673+0000 7f9f19af3640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9f000b4d20 0x7f9f000b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.673+0000 7f9f077fe640 1 -- 172.21.15.33:0/2844374189 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7f9f100e4fd0 con 0x7f9f14102880 2024-08-28T19:40:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.674+0000 7f9f19af3640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9f000b4d20 0x7f9f000b7230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009230 tx=0x7f9f08031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.676+0000 7f9f077fe640 1 -- 172.21.15.33:0/2844374189 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9f100ab960 con 0x7f9f14102880 2024-08-28T19:40:06.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.897+0000 7f9f1c558640 1 -- 172.21.15.33:0/2844374189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f14100710 con 0x7f9f14102880 2024-08-28T19:40:06.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.897+0000 7f9f077fe640 1 -- 172.21.15.33:0/2844374189 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f9f14100710 con 0x7f9f14102880 2024-08-28T19:40:06.898 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:40:06.898 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:40:06.899 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:40:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.899+0000 7f9f1c558640 1 -- 172.21.15.33:0/2844374189 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9f000b4d20 msgr2=0x7f9f000b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.899+0000 7f9f1c558640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9f000b4d20 0x7f9f000b7230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009230 tx=0x7f9f08031400 comp rx=0 tx=0).stop 2024-08-28T19:40:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.899+0000 7f9f1c558640 1 -- 172.21.15.33:0/2844374189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f14102880 msgr2=0x7f9f140ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.899+0000 7f9f1c558640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f14102880 0x7f9f140ff410 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000b4a0 tx=0x7f9f1000b960 comp rx=0 tx=0).stop 2024-08-28T19:40:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.900+0000 7f9f1c558640 1 -- 172.21.15.33:0/2844374189 shutdown_connections 2024-08-28T19:40:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.900+0000 7f9f1c558640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9f000b4d20 0x7f9f000b7230 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.900+0000 7f9f1c558640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f14108ac0 0x7f9f140ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.900+0000 7f9f1c558640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f14108170 0x7f9f140ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.900+0000 7f9f1c558640 1 --2- 172.21.15.33:0/2844374189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f14102880 0x7f9f140ff410 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.900+0000 7f9f1c558640 1 -- 172.21.15.33:0/2844374189 >> 172.21.15.33:0/2844374189 conn(0x7f9f14079530 msgr2=0x7f9f14101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:06.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.900+0000 7f9f1c558640 1 -- 172.21.15.33:0/2844374189 shutdown_connections 2024-08-28T19:40:06.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:06.900+0000 7f9f1c558640 1 -- 172.21.15.33:0/2844374189 wait complete. 2024-08-28T19:40:07.547 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:07 smithi033 ceph-mon[18549]: pgmap v575: 129 pgs: 129 active+clean; 9.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 99 KiB/s wr, 35 op/s 2024-08-28T19:40:07.547 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:07 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2844374189' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:07.579 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:40:07.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:07 smithi059 ceph-mon[22052]: pgmap v575: 129 pgs: 129 active+clean; 9.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 99 KiB/s wr, 35 op/s 2024-08-28T19:40:07.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:07 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2844374189' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:07.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:07 smithi122 ceph-mon[22174]: pgmap v575: 129 pgs: 129 active+clean; 9.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 99 KiB/s wr, 35 op/s 2024-08-28T19:40:07.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:07 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2844374189' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:07.836 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:08.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.327+0000 7f8ee647f640 1 -- 172.21.15.33:0/1576010684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee0103900 msgr2=0x7f8ee0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:08.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.327+0000 7f8ee647f640 1 --2- 172.21.15.33:0/1576010684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee0103900 0x7f8ee0103d10 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009900 tx=0x7f8ed002a410 comp rx=0 tx=0).stop 2024-08-28T19:40:08.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.327+0000 7f8ee647f640 1 -- 172.21.15.33:0/1576010684 shutdown_connections 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.327+0000 7f8ee647f640 1 --2- 172.21.15.33:0/1576010684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee0109b90 0x7f8ee01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.327+0000 7f8ee647f640 1 --2- 172.21.15.33:0/1576010684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee0109240 0x7f8ee0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.327+0000 7f8ee647f640 1 --2- 172.21.15.33:0/1576010684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee0103900 0x7f8ee0103d10 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.327+0000 7f8ee647f640 1 -- 172.21.15.33:0/1576010684 >> 172.21.15.33:0/1576010684 conn(0x7f8ee007b5f0 msgr2=0x7f8ee007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.328+0000 7f8ee647f640 1 -- 172.21.15.33:0/1576010684 shutdown_connections 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.328+0000 7f8ee647f640 1 -- 172.21.15.33:0/1576010684 wait complete. 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.328+0000 7f8ee647f640 1 Processor -- start 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.328+0000 7f8ee647f640 1 -- start start 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee647f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee0103900 0x7f8ee019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee647f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee0109240 0x7f8ee019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee647f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee0109b90 0x7f8ee019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee647f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01138b0 con 0x7f8ee0109b90 2024-08-28T19:40:08.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee647f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0113730 con 0x7f8ee0109240 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee647f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0113a30 con 0x7f8ee0103900 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee4a1c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee0109b90 0x7f8ee019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee4a1c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee0109b90 0x7f8ee019fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55356/0 (socket says 172.21.15.33:55356) 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee4a1c640 1 -- 172.21.15.33:0/3006087836 learned_addr learned my addr 172.21.15.33:0/3006087836 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee0109240 0x7f8ee019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8edffff640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee0103900 0x7f8ee019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee4a1c640 1 -- 172.21.15.33:0/3006087836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee0103900 msgr2=0x7f8ee019a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee4a1c640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee0103900 0x7f8ee019a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee4a1c640 1 -- 172.21.15.33:0/3006087836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee0109240 msgr2=0x7f8ee019a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee4a1c640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee0109240 0x7f8ee019a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.329+0000 7f8ee4a1c640 1 -- 172.21.15.33:0/3006087836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee01a0270 con 0x7f8ee0109b90 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.330+0000 7f8ee4a1c640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee0109b90 0x7f8ee019fb40 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800b970 tx=0x7f8ed800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.330+0000 7f8edd7fa640 1 -- 172.21.15.33:0/3006087836 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8019070 con 0x7f8ee0109b90 2024-08-28T19:40:08.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.330+0000 7f8edd7fa640 1 -- 172.21.15.33:0/3006087836 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed8014440 con 0x7f8ee0109b90 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.330+0000 7f8edd7fa640 1 -- 172.21.15.33:0/3006087836 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80075d0 con 0x7f8ee0109b90 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.330+0000 7f8ee647f640 1 -- 172.21.15.33:0/3006087836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee01a0560 con 0x7f8ee0109b90 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.330+0000 7f8ee647f640 1 -- 172.21.15.33:0/3006087836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee01a6cc0 con 0x7f8ee0109b90 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.332+0000 7f8eec9f4740 1 Processor -- start 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.332+0000 7f8edd7fa640 1 -- 172.21.15.33:0/3006087836 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8ed801c070 con 0x7f8ee0109b90 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.332+0000 7f8eec9f4740 1 -- start start 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 0x562ef84b7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84b7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef80f1390 0x562ef84b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562ef842e680 con 0x562ef80e91b0 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562ef841dc10 con 0x562ef8112070 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ef8421bc0 con 0x562ef80f1390 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84b7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55358/0 (socket says 172.21.15.33:55358) 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edffff640 1 -- 172.21.15.33:0/3022081480 learned_addr learned my addr 172.21.15.33:0/3022081480 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/3022081480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef80f1390 0x562ef84b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/3022081480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 0x562ef84b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edffff640 1 -- 172.21.15.33:0/3022081480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef80f1390 msgr2=0x562ef84b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edffff640 1 --2- 172.21.15.33:0/3022081480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef80f1390 0x562ef84b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edffff640 1 -- 172.21.15.33:0/3022081480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 msgr2=0x562ef84b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edffff640 1 --2- 172.21.15.33:0/3022081480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 0x562ef84b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edffff640 1 -- 172.21.15.33:0/3022081480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef817d650 con 0x562ef80e91b0 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.333+0000 7f8edd7fa640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4ca0 0x7f8ec80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.334+0000 7f8edffff640 1 --2- 172.21.15.33:0/3022081480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84b7850 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009900 tx=0x7f8ed0032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4ef717f7471067 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.334+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4ca0 0x7f8ec80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.334+0000 7f8edd7fa640 1 -- 172.21.15.33:0/3006087836 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7f8ed80e4e90 con 0x7f8ee0109b90 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.334+0000 7f8ec67fc640 1 -- 172.21.15.33:0/3022081480 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0040070 con 0x562ef80e91b0 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.334+0000 7f8ec67fc640 1 -- 172.21.15.33:0/3022081480 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed00316a0 con 0x562ef80e91b0 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.334+0000 7f8ec67fc640 1 -- 172.21.15.33:0/3022081480 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0035040 con 0x562ef80e91b0 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8eec9f4740 1 -- 172.21.15.33:0/3022081480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 msgr2=0x562ef84b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/3022081480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84b7850 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009900 tx=0x7f8ed0032e60 comp rx=0 tx=0).stop 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4ca0 0x7f8ec80b71b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4005d00 tx=0x7f8ed400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8eec9f4740 1 -- 172.21.15.33:0/3022081480 shutdown_connections 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/3022081480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef80f1390 0x562ef84b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/3022081480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84b7850 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/3022081480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 0x562ef84b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8eec9f4740 1 -- 172.21.15.33:0/3022081480 >> 172.21.15.33:0/3022081480 conn(0x562ef8106460 msgr2=0x562ef84b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8eec9f4740 1 -- 172.21.15.33:0/3022081480 shutdown_connections 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8eec9f4740 1 -- 172.21.15.33:0/3022081480 wait complete. 2024-08-28T19:40:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.335+0000 7f8eec9f4740 1 -- start start 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8eec9f4740 1 Processor -- start 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef80f1390 0x562ef84c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 0x562ef84cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562ef8280700 con 0x562ef80e91b0 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562ef83a4750 con 0x562ef8112070 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562ef84c5a90 con 0x562ef80f1390 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8edffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8eec9f4740 10 client.0 _ll_register_callbacks cb 0x562ef83d3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8edffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55372/0 (socket says 172.21.15.33:55372) 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8edffff640 1 -- 172.21.15.33:0/130917114 learned_addr learned my addr 172.21.15.33:0/130917114 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8ee4a1c640 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 0x562ef84cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef80f1390 0x562ef84c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8edffff640 1 -- 172.21.15.33:0/130917114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef80f1390 msgr2=0x562ef84c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8edffff640 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef80f1390 0x562ef84c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8edffff640 1 -- 172.21.15.33:0/130917114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 msgr2=0x562ef84cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8edffff640 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 0x562ef84cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8edffff640 1 -- 172.21.15.33:0/130917114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef83dd900 con 0x562ef80e91b0 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8ee4a1c640 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 0x562ef84cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8edffff640 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84c2a70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0031a80 tx=0x7f8ed002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477c420d3fb90eae server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.336+0000 7f8ebf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/130917114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0035040 con 0x562ef80e91b0 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/130917114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7f8ed0004230 con 0x562ef80e91b0 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8eec9f4740 1 -- 172.21.15.33:0/130917114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ed00316a0 con 0x562ef80e91b0 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/130917114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ed0056050 con 0x562ef80e91b0 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8eec9f4740 10 client.17652 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8eec9f4740 1 -- 172.21.15.33:0/130917114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ef84d1830 con 0x562ef80e91b0 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/130917114 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed00316a0 con 0x562ef80e91b0 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/130917114 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8ed0004750 con 0x562ef80e91b0 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8eec9f4740 10 client.17652 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8eec9f4740 10 client.17652 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8eec9f4740 20 client.17652 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562ef80d09f0 0x562ef84d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8eec9f4740 4 client.17652 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.337+0000 7f8eec9f4740 1 -- 172.21.15.33:0/130917114 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ef84305d0 con 0x562ef80d09f0 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.338+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562ef80d09f0 0x562ef84d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.338+0000 7f8ebf7fe640 10 client.17652 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.338+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562ef80d09f0 0x562ef84d4b90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e9bc549d6fc0cfeb server_cookie=d537e6733d192316 in_seq=0 out_seq=0 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/130917114 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ef84305d0 con 0x562ef80d09f0 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8ebf7fe640 10 client.17652 handle_command_reply: tid=0 2024-08-28T19:40:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 client.17652 shutdown 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 -- 172.21.15.33:0/130917114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 msgr2=0x562ef84c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84c2a70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0031a80 tx=0x7f8ed002a410 comp rx=0 tx=0).stop 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 -- 172.21.15.33:0/130917114 shutdown_connections 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562ef80d09f0 0x562ef84d4b90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef8112070 0x562ef84cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef80f1390 0x562ef84c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/130917114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80e91b0 0x562ef84c2a70 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8ebf7fe640 0 client.17652 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 -- 172.21.15.33:0/130917114 >> 172.21.15.33:0/130917114 conn(0x562ef8106460 msgr2=0x562ef84ba4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 -- 172.21.15.33:0/130917114 shutdown_connections 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 1 -- 172.21.15.33:0/130917114 wait complete. 2024-08-28T19:40:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.339+0000 7f8eec9f4740 20 client.17652 trim_cache size 0 max 16384 2024-08-28T19:40:08.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.353+0000 7f8eec9f4740 1 Processor -- start 2024-08-28T19:40:08.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.353+0000 7f8eec9f4740 1 -- start start 2024-08-28T19:40:08.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.353+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 0x562ef84bab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.353+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.353+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 0x562ef84c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.353+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01b0d70 con 0x562ef80f1390 2024-08-28T19:40:08.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.353+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01b28b0 con 0x562ef80e91b0 2024-08-28T19:40:08.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.353+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01b1440 con 0x562ef8112070 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.353+0000 7f8edf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8edf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84bfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55380/0 (socket says 172.21.15.33:55380) 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8edf7fe640 1 -- 172.21.15.33:0/3422236927 learned_addr learned my addr 172.21.15.33:0/3422236927 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8edffff640 1 --2- 172.21.15.33:0/3422236927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 0x562ef84bab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8ee4a1c640 1 --2- 172.21.15.33:0/3422236927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 0x562ef84c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8edf7fe640 1 -- 172.21.15.33:0/3422236927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 msgr2=0x562ef84c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/3422236927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 0x562ef84c01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8edf7fe640 1 -- 172.21.15.33:0/3422236927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 msgr2=0x562ef84bab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/3422236927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 0x562ef84bab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8edf7fe640 1 -- 172.21.15.33:0/3422236927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef84c5620 con 0x562ef80f1390 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/3422236927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84bfc60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x562ef84c5a90 tx=0x7f8ed4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e34a42e6b3d0aa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8ec5ffb640 1 -- 172.21.15.33:0/3422236927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed402d070 con 0x562ef80f1390 2024-08-28T19:40:08.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8ec5ffb640 1 -- 172.21.15.33:0/3422236927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed4021110 con 0x562ef80f1390 2024-08-28T19:40:08.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.354+0000 7f8ec5ffb640 1 -- 172.21.15.33:0/3422236927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed401fd60 con 0x562ef80f1390 2024-08-28T19:40:08.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.355+0000 7f8eec9f4740 1 -- 172.21.15.33:0/3422236927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 msgr2=0x562ef84bfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:08.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.355+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/3422236927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84bfc60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x562ef84c5a90 tx=0x7f8ed4014040 comp rx=0 tx=0).stop 2024-08-28T19:40:08.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.355+0000 7f8eec9f4740 1 -- 172.21.15.33:0/3422236927 shutdown_connections 2024-08-28T19:40:08.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.355+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/3422236927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 0x562ef84c01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.355+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/3422236927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84bfc60 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.355+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/3422236927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 0x562ef84bab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.355+0000 7f8eec9f4740 1 -- 172.21.15.33:0/3422236927 >> 172.21.15.33:0/3422236927 conn(0x562ef8106460 msgr2=0x562ef84ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.355+0000 7f8eec9f4740 1 -- 172.21.15.33:0/3422236927 shutdown_connections 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.355+0000 7f8eec9f4740 1 -- 172.21.15.33:0/3422236927 wait complete. 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8eec9f4740 1 -- start start 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8eec9f4740 1 Processor -- start 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 0x562ef84d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8eec9f4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 0x562ef85384d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01b21e0 con 0x562ef80f1390 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01b1b10 con 0x562ef80e91b0 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8eec9f4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01aed70 con 0x562ef8112070 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8eec9f4740 10 client.0 _ll_register_callbacks cb 0x7f8ed0032db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8edf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8edf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84d6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55382/0 (socket says 172.21.15.33:55382) 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.356+0000 7f8edf7fe640 1 -- 172.21.15.33:0/687073378 learned_addr learned my addr 172.21.15.33:0/687073378 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8edffff640 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 0x562ef84d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8ee4a1c640 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 0x562ef85384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8edf7fe640 1 -- 172.21.15.33:0/687073378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 msgr2=0x562ef85384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 0x562ef85384d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8edf7fe640 1 -- 172.21.15.33:0/687073378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 msgr2=0x562ef84d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 0x562ef84d6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8edf7fe640 1 -- 172.21.15.33:0/687073378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef8538b40 con 0x562ef80f1390 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8ee4a1c640 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 0x562ef85384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8edffff640 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 0x562ef84d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8edf7fe640 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84d6d40 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4003be0 tx=0x7f8ed4022f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdba4659a9dc3a6a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8ebf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/687073378 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed402d070 con 0x562ef80f1390 2024-08-28T19:40:08.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/687073378 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7f8ed4027040 con 0x562ef80f1390 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8eec9f4740 1 -- 172.21.15.33:0/687073378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ed4021110 con 0x562ef80f1390 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/687073378 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ed4005050 con 0x562ef80f1390 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8eec9f4740 10 client.17658 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8eec9f4740 1 -- 172.21.15.33:0/687073378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ef853ff60 con 0x562ef80f1390 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.357+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/687073378 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed4021110 con 0x562ef80f1390 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.358+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/687073378 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8ed40046c0 con 0x562ef80f1390 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.358+0000 7f8eec9f4740 10 client.17658 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.358+0000 7f8eec9f4740 10 client.17658 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.358+0000 7f8eec9f4740 20 client.17658 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.358+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562ef80a5da0 0x562ef85426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.358+0000 7f8eec9f4740 4 client.17658 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.358+0000 7f8eec9f4740 1 -- 172.21.15.33:0/687073378 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ef842c070 con 0x562ef80a5da0 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.358+0000 7f8edffff640 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562ef80a5da0 0x562ef85426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.358+0000 7f8edffff640 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562ef80a5da0 0x562ef85426f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e9556426a4f2681b server_cookie=dc7ab4d18602ebb4 in_seq=0 out_seq=0 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.358+0000 7f8ebf7fe640 10 client.17658 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8ebf7fe640 1 -- 172.21.15.33:0/687073378 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ef842c070 con 0x562ef80a5da0 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8ebf7fe640 10 client.17658 handle_command_reply: tid=0 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 client.17658 shutdown 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 -- 172.21.15.33:0/687073378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 msgr2=0x562ef84d6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84d6d40 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4003be0 tx=0x7f8ed4022f90 comp rx=0 tx=0).stop 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 -- 172.21.15.33:0/687073378 shutdown_connections 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562ef80a5da0 0x562ef85426f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ef8112070 0x562ef85384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ef80f1390 0x562ef84d6d40 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8ebf7fe640 0 client.17658 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 --2- 172.21.15.33:0/687073378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ef80e91b0 0x562ef84d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 -- 172.21.15.33:0/687073378 >> 172.21.15.33:0/687073378 conn(0x562ef8106460 msgr2=0x562ef84b8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:08.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 -- 172.21.15.33:0/687073378 shutdown_connections 2024-08-28T19:40:08.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 1 -- 172.21.15.33:0/687073378 wait complete. 2024-08-28T19:40:08.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.359+0000 7f8eec9f4740 20 client.17658 trim_cache size 0 max 16384 2024-08-28T19:40:08.365 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 -- 172.21.15.33:0/3006087836 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4ca0 msgr2=0x7f8ec80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4ca0 0x7f8ec80b71b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4005d00 tx=0x7f8ed400b390 comp rx=0 tx=0).stop 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 -- 172.21.15.33:0/3006087836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee0109b90 msgr2=0x7f8ee019fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee0109b90 0x7f8ee019fb40 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800b970 tx=0x7f8ed800be30 comp rx=0 tx=0).stop 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 -- 172.21.15.33:0/3006087836 shutdown_connections 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ee0109b90 0x7f8ee019fb40 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee0109240 0x7f8ee019a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8ec80b4ca0 0x7f8ec80b71b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 --2- 172.21.15.33:0/3006087836 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ee0103900 0x7f8ee019a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 -- 172.21.15.33:0/3006087836 >> 172.21.15.33:0/3006087836 conn(0x7f8ee007b5f0 msgr2=0x7f8ee0107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 -- 172.21.15.33:0/3006087836 shutdown_connections 2024-08-28T19:40:08.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:08.360+0000 7f8ee647f640 1 -- 172.21.15.33:0/3006087836 wait complete. 2024-08-28T19:40:09.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:40:09.411 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:09.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:09 smithi059 ceph-mon[22052]: pgmap v576: 129 pgs: 129 active+clean; 9.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 96 KiB/s wr, 35 op/s 2024-08-28T19:40:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:09 smithi122 ceph-mon[22174]: pgmap v576: 129 pgs: 129 active+clean; 9.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 96 KiB/s wr, 35 op/s 2024-08-28T19:40:09.845 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:09 smithi033 ceph-mon[18549]: pgmap v576: 129 pgs: 129 active+clean; 9.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 96 KiB/s wr, 35 op/s 2024-08-28T19:40:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.938+0000 7fd47f67c640 1 -- 172.21.15.33:0/1372457493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd478102390 msgr2=0x7fd4781027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.938+0000 7fd47f67c640 1 --2- 172.21.15.33:0/1372457493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd478102390 0x7fd4781027a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd474009ca0 tx=0x7fd47402a950 comp rx=0 tx=0).stop 2024-08-28T19:40:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.938+0000 7fd47f67c640 1 -- 172.21.15.33:0/1372457493 shutdown_connections 2024-08-28T19:40:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.938+0000 7fd47f67c640 1 --2- 172.21.15.33:0/1372457493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd47810ff40 0x7fd478112360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.938+0000 7fd47f67c640 1 --2- 172.21.15.33:0/1372457493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478102ce0 0x7fd47810fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.938+0000 7fd47f67c640 1 --2- 172.21.15.33:0/1372457493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd478102390 0x7fd4781027a0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.938+0000 7fd47f67c640 1 -- 172.21.15.33:0/1372457493 >> 172.21.15.33:0/1372457493 conn(0x7fd4780794e0 msgr2=0x7fd4780798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.938+0000 7fd47f67c640 1 -- 172.21.15.33:0/1372457493 shutdown_connections 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.938+0000 7fd47f67c640 1 -- 172.21.15.33:0/1372457493 wait complete. 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47f67c640 1 Processor -- start 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47f67c640 1 -- start start 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47f67c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd478102390 0x7fd47819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47f67c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478102ce0 0x7fd47819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47f67c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd47810ff40 0x7fd4781a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47f67c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd478115a50 con 0x7fd47810ff40 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47f67c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781158d0 con 0x7fd478102390 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47f67c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd478115bd0 con 0x7fd478102ce0 2024-08-28T19:40:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47dc19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd47810ff40 0x7fd4781a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47dc19640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd47810ff40 0x7fd4781a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44496/0 (socket says 172.21.15.33:44496) 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47dc19640 1 -- 172.21.15.33:0/1998097383 learned_addr learned my addr 172.21.15.33:0/1998097383 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.939+0000 7fd47d418640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd478102390 0x7fd47819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd47cc17640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478102ce0 0x7fd47819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd47dc19640 1 -- 172.21.15.33:0/1998097383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478102ce0 msgr2=0x7fd47819ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd47dc19640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478102ce0 0x7fd47819ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd47dc19640 1 -- 172.21.15.33:0/1998097383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd478102390 msgr2=0x7fd47819c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd47dc19640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd478102390 0x7fd47819c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd47dc19640 1 -- 172.21.15.33:0/1998097383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4781a23f0 con 0x7fd47810ff40 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd47dc19640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd47810ff40 0x7fd4781a1cc0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd47000d750 tx=0x7fd47000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:09.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd46e7fc640 1 -- 172.21.15.33:0/1998097383 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470017070 con 0x7fd47810ff40 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd46e7fc640 1 -- 172.21.15.33:0/1998097383 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4700054d0 con 0x7fd47810ff40 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd47f67c640 1 -- 172.21.15.33:0/1998097383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4781a26e0 con 0x7fd47810ff40 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd46e7fc640 1 -- 172.21.15.33:0/1998097383 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470004c60 con 0x7fd47810ff40 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.940+0000 7fd47f67c640 1 -- 172.21.15.33:0/1998097383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4781a8e40 con 0x7fd47810ff40 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.943+0000 7fd485bf1740 1 Processor -- start 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.943+0000 7fd46e7fc640 1 -- 172.21.15.33:0/1998097383 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd470009bd0 con 0x7fd47810ff40 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.943+0000 7fd485bf1740 1 -- start start 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.943+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x561773144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.943+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x561773144850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.943+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d7e390 0x561773144d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.943+0000 7fd485bf1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5617730bb680 con 0x561772d9f070 2024-08-28T19:40:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.943+0000 7fd485bf1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5617730aac10 con 0x561772d761b0 2024-08-28T19:40:09.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.943+0000 7fd485bf1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5617730aebc0 con 0x561772d7e390 2024-08-28T19:40:09.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47cc17640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x561773144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47cc17640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x561773144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44506/0 (socket says 172.21.15.33:44506) 2024-08-28T19:40:09.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47cc17640 1 -- 172.21.15.33:0/1200534664 learned_addr learned my addr 172.21.15.33:0/1200534664 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:09.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47d418640 1 --2- 172.21.15.33:0/1200534664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x561773144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47cc17640 1 --2- 172.21.15.33:0/1200534664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d7e390 0x561773144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd46e7fc640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd4640b4d20 0x7fd4640b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47cc17640 1 -- 172.21.15.33:0/1200534664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d7e390 msgr2=0x561773144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:09.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47cc17640 1 --2- 172.21.15.33:0/1200534664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d7e390 0x561773144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47cc17640 1 -- 172.21.15.33:0/1200534664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 msgr2=0x561773144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47cc17640 1 --2- 172.21.15.33:0/1200534664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x561773144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47cc17640 1 -- 172.21.15.33:0/1200534664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561772e0a650 con 0x561772d9f070 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47d418640 1 --2- 172.21.15.33:0/1200534664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x561773144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47dc19640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd4640b4d20 0x7fd4640b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd46e7fc640 1 -- 172.21.15.33:0/1998097383 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7fd4700e52f0 con 0x7fd47810ff40 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd47cc17640 1 --2- 172.21.15.33:0/1200534664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x561773144310 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd468009e90 tx=0x7fd468009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edb490f21c66e49 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.944+0000 7fd4637fe640 1 -- 172.21.15.33:0/1200534664 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46801c070 con 0x561772d9f070 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.945+0000 7fd4637fe640 1 -- 172.21.15.33:0/1200534664 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd468010040 con 0x561772d9f070 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.945+0000 7fd4637fe640 1 -- 172.21.15.33:0/1200534664 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4680146a0 con 0x561772d9f070 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.945+0000 7fd485bf1740 1 -- 172.21.15.33:0/1200534664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 msgr2=0x561773144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.945+0000 7fd47dc19640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd4640b4d20 0x7fd4640b7230 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd4700ab2e0 tx=0x7fd470078a80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.945+0000 7fd485bf1740 1 --2- 172.21.15.33:0/1200534664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x561773144310 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd468009e90 tx=0x7fd468009420 comp rx=0 tx=0).stop 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 -- 172.21.15.33:0/1200534664 shutdown_connections 2024-08-28T19:40:09.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 --2- 172.21.15.33:0/1200534664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d7e390 0x561773144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 --2- 172.21.15.33:0/1200534664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x561773144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 --2- 172.21.15.33:0/1200534664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x561773144310 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 -- 172.21.15.33:0/1200534664 >> 172.21.15.33:0/1200534664 conn(0x561772d93460 msgr2=0x561773142200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 -- 172.21.15.33:0/1200534664 shutdown_connections 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 -- 172.21.15.33:0/1200534664 wait complete. 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 -- start start 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 Processor -- start 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x56177314fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d7e390 0x561773150040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x56177315be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561772f0d700 con 0x561772d9f070 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.946+0000 7fd485bf1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561773031750 con 0x561772d761b0 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd485bf1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561773152af0 con 0x561772d7e390 2024-08-28T19:40:09.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd485bf1740 10 client.0 _ll_register_callbacks cb 0x561773060e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47cc17640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x56177315be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47cc17640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x56177315be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44520/0 (socket says 172.21.15.33:44520) 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47cc17640 1 -- 172.21.15.33:0/138285128 learned_addr learned my addr 172.21.15.33:0/138285128 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47d418640 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d7e390 0x561773150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47cc17640 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x56177314fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47cc17640 1 -- 172.21.15.33:0/138285128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d7e390 msgr2=0x561773150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47cc17640 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d7e390 0x561773150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47cc17640 1 -- 172.21.15.33:0/138285128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 msgr2=0x56177314fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47cc17640 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x56177314fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47cc17640 1 -- 172.21.15.33:0/138285128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177306a900 con 0x561772d9f070 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd47cc17640 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x56177315be10 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fd46801a040 tx=0x7fd468017f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9030a1b790d204fd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd460ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd460ff9640 1 -- 172.21.15.33:0/138285128 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468029070 con 0x561772d9f070 2024-08-28T19:40:09.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd485bf1740 1 -- 172.21.15.33:0/138285128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd468010040 con 0x561772d9f070 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.947+0000 7fd460ff9640 1 -- 172.21.15.33:0/138285128 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7fd468017a50 con 0x561772d9f070 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd460ff9640 1 -- 172.21.15.33:0/138285128 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd46801c040 con 0x561772d9f070 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd485bf1740 10 client.17670 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd485bf1740 1 -- 172.21.15.33:0/138285128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56177315e900 con 0x561772d9f070 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd460ff9640 1 -- 172.21.15.33:0/138285128 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd468010040 con 0x561772d9f070 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd460ff9640 1 -- 172.21.15.33:0/138285128 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd468022040 con 0x561772d9f070 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd485bf1740 10 client.17670 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd485bf1740 10 client.17670 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd485bf1740 20 client.17670 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd485bf1740 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x561772d5d9f0 0x561773161c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd485bf1740 4 client.17670 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd485bf1740 1 -- 172.21.15.33:0/138285128 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617730bd5d0 con 0x561772d5d9f0 2024-08-28T19:40:09.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.948+0000 7fd47d418640 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x561772d5d9f0 0x561773161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.949+0000 7fd47d418640 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x561772d5d9f0 0x561773161c60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a59e526fe3fc04 server_cookie=a03e718b4629a4bd in_seq=0 out_seq=0 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.949+0000 7fd460ff9640 10 client.17670 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd460ff9640 1 -- 172.21.15.33:0/138285128 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5617730bd5d0 con 0x561772d5d9f0 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd460ff9640 10 client.17670 handle_command_reply: tid=0 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 client.17670 shutdown 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 -- 172.21.15.33:0/138285128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 msgr2=0x56177315be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x56177315be10 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fd46801a040 tx=0x7fd468017f90 comp rx=0 tx=0).stop 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 -- 172.21.15.33:0/138285128 shutdown_connections 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x561772d5d9f0 0x561773161c60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d9f070 0x56177315be10 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d7e390 0x561773150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd460ff9640 0 client.17670 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:40:09.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 --2- 172.21.15.33:0/138285128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x56177314fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 -- 172.21.15.33:0/138285128 >> 172.21.15.33:0/138285128 conn(0x561772d93460 msgr2=0x5617731474f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:09.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 -- 172.21.15.33:0/138285128 shutdown_connections 2024-08-28T19:40:09.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 1 -- 172.21.15.33:0/138285128 wait complete. 2024-08-28T19:40:09.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.950+0000 7fd485bf1740 20 client.17670 trim_cache size 0 max 16384 2024-08-28T19:40:09.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.963+0000 7fd485bf1740 1 Processor -- start 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.963+0000 7fd485bf1740 1 -- start start 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x56177314e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x561773142270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d9f070 0x56177315bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd485bf1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781b3010 con 0x561772d7e390 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd485bf1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781b4b50 con 0x561772d761b0 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd485bf1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781b36e0 con 0x561772d9f070 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47d418640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x561773142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47d418640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x561773142270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44530/0 (socket says 172.21.15.33:44530) 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47d418640 1 -- 172.21.15.33:0/4025140762 learned_addr learned my addr 172.21.15.33:0/4025140762 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47cc17640 1 --2- 172.21.15.33:0/4025140762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d9f070 0x56177315bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47cc17640 1 --2- 172.21.15.33:0/4025140762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x56177314e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47d418640 1 -- 172.21.15.33:0/4025140762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d9f070 msgr2=0x56177315bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:09.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47d418640 1 --2- 172.21.15.33:0/4025140762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d9f070 0x56177315bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47d418640 1 -- 172.21.15.33:0/4025140762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 msgr2=0x56177314e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:09.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47d418640 1 --2- 172.21.15.33:0/4025140762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x56177314e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47d418640 1 -- 172.21.15.33:0/4025140762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561773147170 con 0x561772d7e390 2024-08-28T19:40:09.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47cc17640 1 --2- 172.21.15.33:0/4025140762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x56177314e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:40:09.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.964+0000 7fd47d418640 1 --2- 172.21.15.33:0/4025140762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x561773142270 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fd474009a60 tx=0x7fd47402fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64934ee474272ad server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:09.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd462ffd640 1 -- 172.21.15.33:0/4025140762 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474034040 con 0x561772d7e390 2024-08-28T19:40:09.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd462ffd640 1 -- 172.21.15.33:0/4025140762 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd474003e20 con 0x561772d7e390 2024-08-28T19:40:09.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd462ffd640 1 -- 172.21.15.33:0/4025140762 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4740046f0 con 0x561772d7e390 2024-08-28T19:40:09.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd485bf1740 1 -- 172.21.15.33:0/4025140762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 msgr2=0x561773142270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:09.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd485bf1740 1 --2- 172.21.15.33:0/4025140762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x561773142270 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fd474009a60 tx=0x7fd47402fbe0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd485bf1740 1 -- 172.21.15.33:0/4025140762 shutdown_connections 2024-08-28T19:40:09.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd485bf1740 1 --2- 172.21.15.33:0/4025140762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d9f070 0x56177315bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd485bf1740 1 --2- 172.21.15.33:0/4025140762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x561773142270 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd485bf1740 1 --2- 172.21.15.33:0/4025140762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x56177314e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd485bf1740 1 -- 172.21.15.33:0/4025140762 >> 172.21.15.33:0/4025140762 conn(0x561772d93460 msgr2=0x561773141b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.965+0000 7fd485bf1740 1 -- 172.21.15.33:0/4025140762 shutdown_connections 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.966+0000 7fd485bf1740 1 -- 172.21.15.33:0/4025140762 wait complete. 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.966+0000 7fd485bf1740 1 -- start start 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.966+0000 7fd485bf1740 1 Processor -- start 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.966+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x561773154060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.966+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x5617731545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.966+0000 7fd485bf1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d9f070 0x5617731cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.966+0000 7fd485bf1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781b4480 con 0x561772d7e390 2024-08-28T19:40:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.966+0000 7fd485bf1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781b3db0 con 0x561772d761b0 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.966+0000 7fd485bf1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd4781b1010 con 0x561772d9f070 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd485bf1740 10 client.0 _ll_register_callbacks cb 0x7fd46801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47d418640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x5617731545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47d418640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x5617731545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44540/0 (socket says 172.21.15.33:44540) 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47d418640 1 -- 172.21.15.33:0/2709450926 learned_addr learned my addr 172.21.15.33:0/2709450926 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47cc17640 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x561773154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47cc17640 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d9f070 0x5617731cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47d418640 1 -- 172.21.15.33:0/2709450926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d9f070 msgr2=0x5617731cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47d418640 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d9f070 0x5617731cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47d418640 1 -- 172.21.15.33:0/2709450926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 msgr2=0x561773154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47d418640 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x561773154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47d418640 1 -- 172.21.15.33:0/2709450926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561773154e40 con 0x561772d7e390 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47cc17640 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x561773154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd47d418640 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x5617731545a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fd47402fd70 tx=0x7fd47402f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd64edc0e4d94c40 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd460ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd460ff9640 1 -- 172.21.15.33:0/2709450926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474034040 con 0x561772d7e390 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd460ff9640 1 -- 172.21.15.33:0/2709450926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7fd474003b70 con 0x561772d7e390 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd485bf1740 1 -- 172.21.15.33:0/2709450926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd474003e20 con 0x561772d7e390 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.967+0000 7fd460ff9640 1 -- 172.21.15.33:0/2709450926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd47405f050 con 0x561772d7e390 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd485bf1740 10 client.17676 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd485bf1740 1 -- 172.21.15.33:0/2709450926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5617731ccb10 con 0x561772d7e390 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd460ff9640 1 -- 172.21.15.33:0/2709450926 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd474003e20 con 0x561772d7e390 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd460ff9640 1 -- 172.21.15.33:0/2709450926 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd474046650 con 0x561772d7e390 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd485bf1740 10 client.17676 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd485bf1740 10 client.17676 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd485bf1740 20 client.17676 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:09.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd485bf1740 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x561772d32da0 0x5617731cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd485bf1740 4 client.17676 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd485bf1740 1 -- 172.21.15.33:0/2709450926 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5617730b9070 con 0x561772d32da0 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.968+0000 7fd47cc17640 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x561772d32da0 0x5617731cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd460ff9640 10 client.17676 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd47cc17640 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x561772d32da0 0x5617731cf190 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e9eba530b3a95399 server_cookie=cf881d06a4361cbe in_seq=0 out_seq=0 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd460ff9640 1 -- 172.21.15.33:0/2709450926 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5617730b9070 con 0x561772d32da0 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd460ff9640 10 client.17676 handle_command_reply: tid=0 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 client.17676 shutdown 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 -- 172.21.15.33:0/2709450926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 msgr2=0x5617731545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x5617731545a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fd47402fd70 tx=0x7fd47402f490 comp rx=0 tx=0).stop 2024-08-28T19:40:09.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 -- 172.21.15.33:0/2709450926 shutdown_connections 2024-08-28T19:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x561772d32da0 0x5617731cf190 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561772d9f070 0x5617731cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561772d7e390 0x5617731545a0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd460ff9640 0 client.17676 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 --2- 172.21.15.33:0/2709450926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561772d761b0 0x561773154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 -- 172.21.15.33:0/2709450926 >> 172.21.15.33:0/2709450926 conn(0x561772d93460 msgr2=0x561773147410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 -- 172.21.15.33:0/2709450926 shutdown_connections 2024-08-28T19:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 1 -- 172.21.15.33:0/2709450926 wait complete. 2024-08-28T19:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.969+0000 7fd485bf1740 20 client.17676 trim_cache size 0 max 16384 2024-08-28T19:40:09.977 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:40:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 -- 172.21.15.33:0/1998097383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd4640b4d20 msgr2=0x7fd4640b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd4640b4d20 0x7fd4640b7230 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd4700ab2e0 tx=0x7fd470078a80 comp rx=0 tx=0).stop 2024-08-28T19:40:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 -- 172.21.15.33:0/1998097383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd47810ff40 msgr2=0x7fd4781a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd47810ff40 0x7fd4781a1cc0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd47000d750 tx=0x7fd47000dc10 comp rx=0 tx=0).stop 2024-08-28T19:40:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 -- 172.21.15.33:0/1998097383 shutdown_connections 2024-08-28T19:40:09.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd47810ff40 0x7fd4781a1cc0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd4640b4d20 0x7fd4640b7230 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd478102ce0 0x7fd47819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 --2- 172.21.15.33:0/1998097383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd478102390 0x7fd47819c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 -- 172.21.15.33:0/1998097383 >> 172.21.15.33:0/1998097383 conn(0x7fd4780794e0 msgr2=0x7fd478109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 -- 172.21.15.33:0/1998097383 shutdown_connections 2024-08-28T19:40:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:09.970+0000 7fd47f67c640 1 -- 172.21.15.33:0/1998097383 wait complete. 2024-08-28T19:40:10.662 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:40:10.915 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.430+0000 7fd323c4e640 1 -- 172.21.15.33:0/1382822313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd31c101e20 msgr2=0x7fd31c102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.430+0000 7fd323c4e640 1 --2- 172.21.15.33:0/1382822313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd31c101e20 0x7fd31c102230 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fd318009900 tx=0x7fd31802a410 comp rx=0 tx=0).stop 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.430+0000 7fd323c4e640 1 -- 172.21.15.33:0/1382822313 shutdown_connections 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.430+0000 7fd323c4e640 1 --2- 172.21.15.33:0/1382822313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd31c1069c0 0x7fd31c110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.430+0000 7fd323c4e640 1 --2- 172.21.15.33:0/1382822313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd31c106070 0x7fd31c106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.430+0000 7fd323c4e640 1 --2- 172.21.15.33:0/1382822313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd31c101e20 0x7fd31c102230 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.430+0000 7fd323c4e640 1 -- 172.21.15.33:0/1382822313 >> 172.21.15.33:0/1382822313 conn(0x7fd31c079d30 msgr2=0x7fd31c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.430+0000 7fd323c4e640 1 -- 172.21.15.33:0/1382822313 shutdown_connections 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.430+0000 7fd323c4e640 1 -- 172.21.15.33:0/1382822313 wait complete. 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd323c4e640 1 Processor -- start 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd323c4e640 1 -- start start 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd323c4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd31c101e20 0x7fd31c19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd323c4e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd31c106070 0x7fd31c19a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd323c4e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd31c1069c0 0x7fd31c19fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd323c4e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c1138b0 con 0x7fd31c106070 2024-08-28T19:40:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd323c4e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c113730 con 0x7fd31c101e20 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd323c4e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c113a30 con 0x7fd31c1069c0 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3211e9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd31c106070 0x7fd31c19a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3211e9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd31c106070 0x7fd31c19a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44554/0 (socket says 172.21.15.33:44554) 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3211e9640 1 -- 172.21.15.33:0/40300227 learned_addr learned my addr 172.21.15.33:0/40300227 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3221eb640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd31c1069c0 0x7fd31c19fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3219ea640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd31c101e20 0x7fd31c19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3211e9640 1 -- 172.21.15.33:0/40300227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd31c1069c0 msgr2=0x7fd31c19fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3211e9640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd31c1069c0 0x7fd31c19fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3211e9640 1 -- 172.21.15.33:0/40300227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd31c101e20 msgr2=0x7fd31c19a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3211e9640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd31c101e20 0x7fd31c19a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3211e9640 1 -- 172.21.15.33:0/40300227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c1a0230 con 0x7fd31c106070 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.431+0000 7fd3219ea640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd31c101e20 0x7fd31c19a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.432+0000 7fd3211e9640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd31c106070 0x7fd31c19a860 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00e9c0 tx=0x7fd30c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.432+0000 7fd312ffd640 1 -- 172.21.15.33:0/40300227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00ccc0 con 0x7fd31c106070 2024-08-28T19:40:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.432+0000 7fd323c4e640 1 -- 172.21.15.33:0/40300227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c1a0520 con 0x7fd31c106070 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.432+0000 7fd312ffd640 1 -- 172.21.15.33:0/40300227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd30c0054d0 con 0x7fd31c106070 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.432+0000 7fd312ffd640 1 -- 172.21.15.33:0/40300227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c010430 con 0x7fd31c106070 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.432+0000 7fd323c4e640 1 -- 172.21.15.33:0/40300227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c1a6c80 con 0x7fd31c106070 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.434+0000 7fd32a1c3740 1 Processor -- start 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd32a1c3740 1 -- start start 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd312ffd640 1 -- 172.21.15.33:0/40300227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd30c005020 con 0x7fd31c106070 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cda070 0x55af3107f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb11b0 0x55af3107f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb9390 0x55af3107fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55af30ff6680 con 0x55af30cb11b0 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55af30fe5c10 con 0x55af30cb9390 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55af30fe9bc0 con 0x55af30cda070 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd3219ea640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb11b0 0x55af3107f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd3219ea640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb11b0 0x55af3107f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44560/0 (socket says 172.21.15.33:44560) 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd3219ea640 1 -- 172.21.15.33:0/2703890293 learned_addr learned my addr 172.21.15.33:0/2703890293 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd3221eb640 1 --2- 172.21.15.33:0/2703890293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cda070 0x55af3107f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd3211e9640 1 --2- 172.21.15.33:0/2703890293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb9390 0x55af3107fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd3219ea640 1 -- 172.21.15.33:0/2703890293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cda070 msgr2=0x55af3107f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd3219ea640 1 --2- 172.21.15.33:0/2703890293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cda070 0x55af3107f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd3219ea640 1 -- 172.21.15.33:0/2703890293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb9390 msgr2=0x55af3107fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd3219ea640 1 --2- 172.21.15.33:0/2703890293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb9390 0x55af3107fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.435+0000 7fd3219ea640 1 -- 172.21.15.33:0/2703890293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af30d45650 con 0x55af30cb11b0 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.436+0000 7fd3219ea640 1 --2- 172.21.15.33:0/2703890293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb11b0 0x55af3107f850 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd31c06b8b0 tx=0x7fd318032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866026788b7d1db6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.436+0000 7fd312ffd640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd3080b4ca0 0x7fd3080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.436+0000 7fd307fff640 1 -- 172.21.15.33:0/2703890293 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31803f070 con 0x55af30cb11b0 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.436+0000 7fd307fff640 1 -- 172.21.15.33:0/2703890293 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd318005de0 con 0x55af30cb11b0 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.436+0000 7fd307fff640 1 -- 172.21.15.33:0/2703890293 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd318035070 con 0x55af30cb11b0 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.436+0000 7fd3221eb640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd3080b4ca0 0x7fd3080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.436+0000 7fd312ffd640 1 -- 172.21.15.33:0/40300227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7fd30c0e5d10 con 0x7fd31c106070 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 -- 172.21.15.33:0/2703890293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb11b0 msgr2=0x55af3107f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd3221eb640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd3080b4ca0 0x7fd3080b71b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd314005fd0 tx=0x7fd314009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/2703890293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb11b0 0x55af3107f850 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd31c06b8b0 tx=0x7fd318032d50 comp rx=0 tx=0).stop 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 -- 172.21.15.33:0/2703890293 shutdown_connections 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/2703890293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb9390 0x55af3107fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/2703890293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb11b0 0x55af3107f850 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/2703890293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cda070 0x55af3107f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 -- 172.21.15.33:0/2703890293 >> 172.21.15.33:0/2703890293 conn(0x55af30cce460 msgr2=0x55af3107d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 -- 172.21.15.33:0/2703890293 shutdown_connections 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 -- 172.21.15.33:0/2703890293 wait complete. 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 -- start start 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.437+0000 7fd32a1c3740 1 Processor -- start 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb11b0 0x55af3108aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cda070 0x55af31096de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55af30e48700 con 0x55af30cb9390 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55af30f6c750 con 0x55af30cda070 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55af3108da90 con 0x55af30cb11b0 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd32a1c3740 10 client.0 _ll_register_callbacks cb 0x55af30f9be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd3211e9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd3211e9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44568/0 (socket says 172.21.15.33:44568) 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd3211e9640 1 -- 172.21.15.33:0/147938189 learned_addr learned my addr 172.21.15.33:0/147938189 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd3221eb640 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cda070 0x55af31096de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd3219ea640 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb11b0 0x55af3108aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd3211e9640 1 -- 172.21.15.33:0/147938189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb11b0 msgr2=0x55af3108aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd3211e9640 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb11b0 0x55af3108aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd3211e9640 1 -- 172.21.15.33:0/147938189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cda070 msgr2=0x55af31096de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd3211e9640 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cda070 0x55af31096de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.438+0000 7fd3211e9640 1 -- 172.21.15.33:0/147938189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af30fa5900 con 0x55af30cb9390 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.439+0000 7fd3211e9640 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108afc0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0e30c0 tx=0x7fd30c005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7f00610febc47 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.439+0000 7fd3057fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.439+0000 7fd3057fa640 1 -- 172.21.15.33:0/147938189 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0ab950 con 0x55af30cb9390 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.439+0000 7fd3057fa640 1 -- 172.21.15.33:0/147938189 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7fd30c0a8290 con 0x55af30cb9390 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.439+0000 7fd32a1c3740 1 -- 172.21.15.33:0/147938189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af30ff85d0 con 0x55af30cb9390 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.439+0000 7fd3057fa640 1 -- 172.21.15.33:0/147938189 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd30c0ab770 con 0x55af30cb9390 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.439+0000 7fd32a1c3740 10 client.17688 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.439+0000 7fd32a1c3740 1 -- 172.21.15.33:0/147938189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af31099910 con 0x55af30cb9390 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.439+0000 7fd3057fa640 1 -- 172.21.15.33:0/147938189 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55af30ff85d0 con 0x55af30cb9390 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.440+0000 7fd3057fa640 1 -- 172.21.15.33:0/147938189 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd30c097190 con 0x55af30cb9390 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.440+0000 7fd32a1c3740 10 client.17688 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.440+0000 7fd32a1c3740 10 client.17688 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:40:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.440+0000 7fd32a1c3740 20 client.17688 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.440+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55af30c989f0 0x55af3109ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.440+0000 7fd32a1c3740 4 client.17688 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.440+0000 7fd32a1c3740 1 -- 172.21.15.33:0/147938189 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af30ff4070 con 0x55af30c989f0 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.440+0000 7fd3219ea640 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55af30c989f0 0x55af3109ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.440+0000 7fd3057fa640 10 client.17688 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.440+0000 7fd3219ea640 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55af30c989f0 0x55af3109ce30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2988dee48ba00974 server_cookie=7140d12067c1d14f in_seq=0 out_seq=0 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd3057fa640 1 -- 172.21.15.33:0/147938189 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af30ff4070 con 0x55af30c989f0 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd3057fa640 10 client.17688 handle_command_reply: tid=0 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd32a1c3740 1 client.17688 shutdown 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd32a1c3740 1 -- 172.21.15.33:0/147938189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 msgr2=0x55af3108afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108afc0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0e30c0 tx=0x7fd30c005f10 comp rx=0 tx=0).stop 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd32a1c3740 1 -- 172.21.15.33:0/147938189 shutdown_connections 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cda070 0x55af31096de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55af30c989f0 0x55af3109ce30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108afc0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/147938189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb11b0 0x55af3108aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd3057fa640 0 client.17688 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:40:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd32a1c3740 1 -- 172.21.15.33:0/147938189 >> 172.21.15.33:0/147938189 conn(0x55af30cce460 msgr2=0x55af310824a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.441+0000 7fd32a1c3740 1 -- 172.21.15.33:0/147938189 shutdown_connections 2024-08-28T19:40:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.442+0000 7fd32a1c3740 1 -- 172.21.15.33:0/147938189 wait complete. 2024-08-28T19:40:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.442+0000 7fd32a1c3740 20 client.17688 trim_cache size 0 max 16384 2024-08-28T19:40:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd32a1c3740 1 Processor -- start 2024-08-28T19:40:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd32a1c3740 1 -- start start 2024-08-28T19:40:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb11b0 0x55af31082b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb9390 0x55af31087c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cda070 0x55af310881b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c1b0df0 con 0x55af30cda070 2024-08-28T19:40:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c1b2930 con 0x55af30cb11b0 2024-08-28T19:40:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c1b14c0 con 0x55af30cb9390 2024-08-28T19:40:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd3221eb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cda070 0x55af310881b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd3221eb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cda070 0x55af310881b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44576/0 (socket says 172.21.15.33:44576) 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd3221eb640 1 -- 172.21.15.33:0/351858369 learned_addr learned my addr 172.21.15.33:0/351858369 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd3211e9640 1 --2- 172.21.15.33:0/351858369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb9390 0x55af31087c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.455+0000 7fd3219ea640 1 --2- 172.21.15.33:0/351858369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb11b0 0x55af31082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.456+0000 7fd3221eb640 1 -- 172.21.15.33:0/351858369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb9390 msgr2=0x55af31087c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.456+0000 7fd3221eb640 1 --2- 172.21.15.33:0/351858369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb9390 0x55af31087c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.456+0000 7fd3221eb640 1 -- 172.21.15.33:0/351858369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb11b0 msgr2=0x55af31082b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.456+0000 7fd3221eb640 1 --2- 172.21.15.33:0/351858369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb11b0 0x55af31082b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.456+0000 7fd3221eb640 1 -- 172.21.15.33:0/351858369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af31081ba0 con 0x55af30cda070 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.456+0000 7fd3219ea640 1 --2- 172.21.15.33:0/351858369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb11b0 0x55af31082b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.456+0000 7fd3221eb640 1 --2- 172.21.15.33:0/351858369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cda070 0x55af310881b0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fd314003e40 tx=0x7fd314016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c653a9d2241f938 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.456+0000 7fd3077fe640 1 -- 172.21.15.33:0/351858369 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314004b20 con 0x55af30cda070 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.456+0000 7fd3077fe640 1 -- 172.21.15.33:0/351858369 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd314004cc0 con 0x55af30cda070 2024-08-28T19:40:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.456+0000 7fd3077fe640 1 -- 172.21.15.33:0/351858369 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314005040 con 0x55af30cda070 2024-08-28T19:40:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 -- 172.21.15.33:0/351858369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cda070 msgr2=0x55af310881b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/351858369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cda070 0x55af310881b0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fd314003e40 tx=0x7fd314016000 comp rx=0 tx=0).stop 2024-08-28T19:40:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 -- 172.21.15.33:0/351858369 shutdown_connections 2024-08-28T19:40:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/351858369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cda070 0x55af310881b0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/351858369 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb9390 0x55af31087c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/351858369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cb11b0 0x55af31082b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 -- 172.21.15.33:0/351858369 >> 172.21.15.33:0/351858369 conn(0x55af30cce460 msgr2=0x55af31082410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 -- 172.21.15.33:0/351858369 shutdown_connections 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 -- 172.21.15.33:0/351858369 wait complete. 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 -- start start 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.457+0000 7fd32a1c3740 1 Processor -- start 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb11b0 0x55af3108f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd32a1c3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cda070 0x55af31100950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c1b2260 con 0x55af30cb9390 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c1b1b90 con 0x55af30cda070 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd32a1c3740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c1aedf0 con 0x55af30cb11b0 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd32a1c3740 10 client.0 _ll_register_callbacks cb 0x7fd30c0e9550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd3211e9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd3211e9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44582/0 (socket says 172.21.15.33:44582) 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd3211e9640 1 -- 172.21.15.33:0/1115958293 learned_addr learned my addr 172.21.15.33:0/1115958293 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd3219ea640 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb11b0 0x55af3108f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd3221eb640 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cda070 0x55af31100950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd3211e9640 1 -- 172.21.15.33:0/1115958293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb11b0 msgr2=0x55af3108f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd3211e9640 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb11b0 0x55af3108f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd3211e9640 1 -- 172.21.15.33:0/1115958293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cda070 msgr2=0x55af31100950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd3211e9640 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cda070 0x55af31100950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.458+0000 7fd3211e9640 1 -- 172.21.15.33:0/1115958293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af31100fc0 con 0x55af30cb9390 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.459+0000 7fd3211e9640 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108fe40 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00c6a0 tx=0x7fd30c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f0dc242646616f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.459+0000 7fd3057fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.459+0000 7fd3057fa640 1 -- 172.21.15.33:0/1115958293 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0ab950 con 0x55af30cb9390 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.459+0000 7fd3057fa640 1 -- 172.21.15.33:0/1115958293 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7fd30c0b50a0 con 0x55af30cb9390 2024-08-28T19:40:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.459+0000 7fd32a1c3740 1 -- 172.21.15.33:0/1115958293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd314004cc0 con 0x55af30cb9390 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.459+0000 7fd3057fa640 1 -- 172.21.15.33:0/1115958293 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd30c005310 con 0x55af30cb9390 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd32a1c3740 10 client.17694 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd32a1c3740 1 -- 172.21.15.33:0/1115958293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af31108320 con 0x55af30cb9390 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd3057fa640 1 -- 172.21.15.33:0/1115958293 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd314004cc0 con 0x55af30cb9390 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd3057fa640 1 -- 172.21.15.33:0/1115958293 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd30c0a7970 con 0x55af30cb9390 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd32a1c3740 10 client.17694 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd32a1c3740 10 client.17694 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd32a1c3740 20 client.17694 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55af30c6dda0 0x55af3110a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd32a1c3740 4 client.17694 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd32a1c3740 1 -- 172.21.15.33:0/1115958293 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55af30ff17b0 con 0x55af30c6dda0 2024-08-28T19:40:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.460+0000 7fd3219ea640 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55af30c6dda0 0x55af3110a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.461+0000 7fd3057fa640 10 client.17694 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:40:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.461+0000 7fd3219ea640 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55af30c6dda0 0x55af3110a8f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d36bc71f4433bc2 server_cookie=820ceb1bb40d5964 in_seq=0 out_seq=0 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.461+0000 7fd3057fa640 1 -- 172.21.15.33:0/1115958293 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55af30ff17b0 con 0x55af30c6dda0 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.461+0000 7fd3057fa640 10 client.17694 handle_command_reply: tid=0 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.461+0000 7fd32a1c3740 1 client.17694 shutdown 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 1 -- 172.21.15.33:0/1115958293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 msgr2=0x55af3108fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108fe40 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00c6a0 tx=0x7fd30c00c840 comp rx=0 tx=0).stop 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 1 -- 172.21.15.33:0/1115958293 shutdown_connections 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af30cda070 0x55af31100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55af30c6dda0 0x55af3110a8f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af30cb9390 0x55af3108fe40 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 1 --2- 172.21.15.33:0/1115958293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af30cb11b0 0x55af3108f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd3057fa640 0 client.17694 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 1 -- 172.21.15.33:0/1115958293 >> 172.21.15.33:0/1115958293 conn(0x55af30cce460 msgr2=0x55af31080340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 1 -- 172.21.15.33:0/1115958293 shutdown_connections 2024-08-28T19:40:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 1 -- 172.21.15.33:0/1115958293 wait complete. 2024-08-28T19:40:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.462+0000 7fd32a1c3740 20 client.17694 trim_cache size 0 max 16384 2024-08-28T19:40:11.467 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 -- 172.21.15.33:0/40300227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd3080b4ca0 msgr2=0x7fd3080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd3080b4ca0 0x7fd3080b71b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd314005fd0 tx=0x7fd314009500 comp rx=0 tx=0).stop 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 -- 172.21.15.33:0/40300227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd31c106070 msgr2=0x7fd31c19a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd31c106070 0x7fd31c19a860 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00e9c0 tx=0x7fd30c00ee80 comp rx=0 tx=0).stop 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 -- 172.21.15.33:0/40300227 shutdown_connections 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd3080b4ca0 0x7fd3080b71b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd31c1069c0 0x7fd31c19fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd31c106070 0x7fd31c19a860 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 --2- 172.21.15.33:0/40300227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd31c101e20 0x7fd31c19a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 -- 172.21.15.33:0/40300227 >> 172.21.15.33:0/40300227 conn(0x7fd31c079d30 msgr2=0x7fd31c107300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 -- 172.21.15.33:0/40300227 shutdown_connections 2024-08-28T19:40:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:11.463+0000 7fd323c4e640 1 -- 172.21.15.33:0/40300227 wait complete. 2024-08-28T19:40:11.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:11 smithi033 ceph-mon[18549]: pgmap v577: 129 pgs: 129 active+clean; 9.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:40:11.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:11 smithi059 ceph-mon[22052]: pgmap v577: 129 pgs: 129 active+clean; 9.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:40:11.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:11 smithi122 ceph-mon[22174]: pgmap v577: 129 pgs: 129 active+clean; 9.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-08-28T19:40:12.214 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:40:12.468 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:13.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 -- 172.21.15.33:0/3511874933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c102d70 msgr2=0x7f7c4c10fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:13.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 --2- 172.21.15.33:0/3511874933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c102d70 0x7f7c4c10fa90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009900 tx=0x7f7c3c02a480 comp rx=0 tx=0).stop 2024-08-28T19:40:13.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 -- 172.21.15.33:0/3511874933 shutdown_connections 2024-08-28T19:40:13.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 --2- 172.21.15.33:0/3511874933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c4c10ffd0 0x7f7c4c1123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 --2- 172.21.15.33:0/3511874933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c102d70 0x7f7c4c10fa90 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 --2- 172.21.15.33:0/3511874933 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c4c102420 0x7f7c4c102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 -- 172.21.15.33:0/3511874933 >> 172.21.15.33:0/3511874933 conn(0x7f7c4c079470 msgr2=0x7f7c4c079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 -- 172.21.15.33:0/3511874933 shutdown_connections 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 -- 172.21.15.33:0/3511874933 wait complete. 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 Processor -- start 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:12.999+0000 7f7c53517640 1 -- start start 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c53517640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c4c102420 0x7f7c4c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c53517640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c102d70 0x7f7c4c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c53517640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c4c10ffd0 0x7f7c4c1a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c53517640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c115ac0 con 0x7f7c4c102d70 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c53517640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c115940 con 0x7f7c4c102420 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c53517640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c115c40 con 0x7f7c4c10ffd0 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c50ab2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c102d70 0x7f7c4c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c50ab2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c102d70 0x7f7c4c19cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44602/0 (socket says 172.21.15.33:44602) 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c50ab2640 1 -- 172.21.15.33:0/1507689227 learned_addr learned my addr 172.21.15.33:0/1507689227 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c51ab4640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c4c10ffd0 0x7f7c4c1a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c512b3640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c4c102420 0x7f7c4c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c50ab2640 1 -- 172.21.15.33:0/1507689227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c4c10ffd0 msgr2=0x7f7c4c1a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c4c10ffd0 0x7f7c4c1a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c50ab2640 1 -- 172.21.15.33:0/1507689227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c4c102420 msgr2=0x7f7c4c19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c4c102420 0x7f7c4c19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c50ab2640 1 -- 172.21.15.33:0/1507689227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c1a2460 con 0x7f7c4c102d70 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.000+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c102d70 0x7f7c4c19cb50 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c005940 tx=0x7f7c3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.001+0000 7f7c427fc640 1 -- 172.21.15.33:0/1507689227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c03f030 con 0x7f7c4c102d70 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.001+0000 7f7c427fc640 1 -- 172.21.15.33:0/1507689227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c3c003cb0 con 0x7f7c4c102d70 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.001+0000 7f7c427fc640 1 -- 172.21.15.33:0/1507689227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c035070 con 0x7f7c4c102d70 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.001+0000 7f7c53517640 1 -- 172.21.15.33:0/1507689227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c1a26f0 con 0x7f7c4c102d70 2024-08-28T19:40:13.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.001+0000 7f7c53517640 1 -- 172.21.15.33:0/1507689227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c1a2bd0 con 0x7f7c4c102d70 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.003+0000 7f7c59a8c740 1 Processor -- start 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.003+0000 7f7c59a8c740 1 -- start start 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 0x55fd4b9f7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b6291b0 0x55fd4b9f7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b631390 0x55fd4b9f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fd4b96e680 con 0x55fd4b631390 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fd4b95dc10 con 0x55fd4b6291b0 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fd4b961bc0 con 0x55fd4b652070 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c427fc640 1 -- 172.21.15.33:0/1507689227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7c3c042030 con 0x7f7c4c102d70 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c50ab2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b631390 0x55fd4b9f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c50ab2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b631390 0x55fd4b9f7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44610/0 (socket says 172.21.15.33:44610) 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c50ab2640 1 -- 172.21.15.33:0/2189174043 learned_addr learned my addr 172.21.15.33:0/2189174043 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c51ab4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 0x55fd4b9f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c512b3640 1 --2- 172.21.15.33:0/2189174043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b6291b0 0x55fd4b9f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c50ab2640 1 -- 172.21.15.33:0/2189174043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 msgr2=0x55fd4b9f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/2189174043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 0x55fd4b9f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c50ab2640 1 -- 172.21.15.33:0/2189174043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b6291b0 msgr2=0x55fd4b9f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/2189174043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b6291b0 0x55fd4b9f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c50ab2640 1 -- 172.21.15.33:0/2189174043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4b6bd650 con 0x55fd4b631390 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.004+0000 7f7c51ab4640 1 --2- 172.21.15.33:0/2189174043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 0x55fd4b9f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.005+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/2189174043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b631390 0x55fd4b9f7d90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c103160 tx=0x7f7c3c10e220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5897665c95264db5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.005+0000 7f7c427fc640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c380b4cd0 0x7f7c380b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.005+0000 7f7c377fe640 1 -- 172.21.15.33:0/2189174043 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0c87e0 con 0x55fd4b631390 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.005+0000 7f7c51ab4640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c380b4cd0 0x7f7c380b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.005+0000 7f7c377fe640 1 -- 172.21.15.33:0/2189174043 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c3c113070 con 0x55fd4b631390 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.005+0000 7f7c377fe640 1 -- 172.21.15.33:0/2189174043 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0cbae0 con 0x55fd4b631390 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.005+0000 7f7c427fc640 1 -- 172.21.15.33:0/1507689227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7f7c3c105ea0 con 0x7f7c4c102d70 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2189174043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b631390 msgr2=0x55fd4b9f7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:13.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2189174043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b631390 0x55fd4b9f7d90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c103160 tx=0x7f7c3c10e220 comp rx=0 tx=0).stop 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c51ab4640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c380b4cd0 0x7f7c380b71e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7c44010540 tx=0x7f7c44007520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2189174043 shutdown_connections 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2189174043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b631390 0x55fd4b9f7d90 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2189174043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b6291b0 0x55fd4b9f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2189174043 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 0x55fd4b9f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2189174043 >> 172.21.15.33:0/2189174043 conn(0x55fd4b646460 msgr2=0x55fd4b9f5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2189174043 shutdown_connections 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2189174043 wait complete. 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 -- start start 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.006+0000 7f7c59a8c740 1 Processor -- start 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba029a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b631390 0x55fd4ba02ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b652070 0x55fd4ba0eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fd4b7c0700 con 0x55fd4b6291b0 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fd4b8e4750 con 0x55fd4b652070 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fd4ba058b0 con 0x55fd4b631390 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c59a8c740 10 client.0 _ll_register_callbacks cb 0x55fd4b913e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c512b3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c512b3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba029a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44620/0 (socket says 172.21.15.33:44620) 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c512b3640 1 -- 172.21.15.33:0/2229098502 learned_addr learned my addr 172.21.15.33:0/2229098502 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b631390 0x55fd4ba02ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c51ab4640 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b652070 0x55fd4ba0eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c512b3640 1 -- 172.21.15.33:0/2229098502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b631390 msgr2=0x55fd4ba02ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c512b3640 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b631390 0x55fd4ba02ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c512b3640 1 -- 172.21.15.33:0/2229098502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b652070 msgr2=0x55fd4ba0eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:13.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c512b3640 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b652070 0x55fd4ba0eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.007+0000 7f7c512b3640 1 -- 172.21.15.33:0/2229098502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd4b91d900 con 0x55fd4b6291b0 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c512b3640 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba029a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800bf00 tx=0x7f7c48012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaa71521f44cb24 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c34ff9640 1 -- 172.21.15.33:0/2229098502 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c480108a0 con 0x55fd4b6291b0 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c34ff9640 1 -- 172.21.15.33:0/2229098502 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7f7c48010a40 con 0x55fd4b6291b0 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2229098502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c3c113070 con 0x55fd4b6291b0 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c34ff9640 1 -- 172.21.15.33:0/2229098502 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c48010c40 con 0x55fd4b6291b0 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c59a8c740 10 client.17706 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2229098502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd4ba11560 con 0x55fd4b6291b0 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c34ff9640 1 -- 172.21.15.33:0/2229098502 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c3c113070 con 0x55fd4b6291b0 2024-08-28T19:40:13.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c34ff9640 1 -- 172.21.15.33:0/2229098502 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7c48019070 con 0x55fd4b6291b0 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c59a8c740 10 client.17706 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c59a8c740 10 client.17706 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c59a8c740 20 client.17706 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55fd4b6109f0 0x55fd4ba14b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c59a8c740 4 client.17706 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.008+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2229098502 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd4b9705d0 con 0x55fd4b6109f0 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.009+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55fd4b6109f0 0x55fd4ba14b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.009+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55fd4b6109f0 0x55fd4ba14b00 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97fb8a89269ccfb0 server_cookie=dd4b05995b909e5a in_seq=0 out_seq=0 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.009+0000 7f7c34ff9640 10 client.17706 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c34ff9640 1 -- 172.21.15.33:0/2229098502 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd4b9705d0 con 0x55fd4b6109f0 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c34ff9640 10 client.17706 handle_command_reply: tid=0 2024-08-28T19:40:13.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 client.17706 shutdown 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2229098502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 msgr2=0x55fd4ba029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba029a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800bf00 tx=0x7f7c48012820 comp rx=0 tx=0).stop 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2229098502 shutdown_connections 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55fd4b6109f0 0x55fd4ba14b00 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b652070 0x55fd4ba0eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b631390 0x55fd4ba02ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2229098502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba029a0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c34ff9640 0 client.17706 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2229098502 >> 172.21.15.33:0/2229098502 conn(0x55fd4b646460 msgr2=0x55fd4b9fa4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2229098502 shutdown_connections 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2229098502 wait complete. 2024-08-28T19:40:13.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.010+0000 7f7c59a8c740 20 client.17706 trim_cache size 0 max 16384 2024-08-28T19:40:13.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c59a8c740 1 Processor -- start 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c59a8c740 1 -- start start 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba0e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b631390 0x55fd4b9ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 0x55fd4ba000d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1b2f00 con 0x55fd4b6291b0 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1b4a40 con 0x55fd4b631390 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1b35d0 con 0x55fd4b652070 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c512b3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba0e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c512b3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba0e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44622/0 (socket says 172.21.15.33:44622) 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c512b3640 1 -- 172.21.15.33:0/2580338237 learned_addr learned my addr 172.21.15.33:0/2580338237 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/2580338237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b631390 0x55fd4b9ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c51ab4640 1 --2- 172.21.15.33:0/2580338237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 0x55fd4ba000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c512b3640 1 -- 172.21.15.33:0/2580338237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 msgr2=0x55fd4ba000d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c512b3640 1 --2- 172.21.15.33:0/2580338237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 0x55fd4ba000d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c512b3640 1 -- 172.21.15.33:0/2580338237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b631390 msgr2=0x55fd4b9ffb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c512b3640 1 --2- 172.21.15.33:0/2580338237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b631390 0x55fd4b9ffb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.024+0000 7f7c512b3640 1 -- 172.21.15.33:0/2580338237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4b9ef340 con 0x55fd4b6291b0 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.025+0000 7f7c512b3640 1 --2- 172.21.15.33:0/2580338237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba0e9d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f7c4801a5b0 tx=0x7f7c4801a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c96785e431785cb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.025+0000 7f7c36ffd640 1 -- 172.21.15.33:0/2580338237 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c480106a0 con 0x55fd4b6291b0 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.025+0000 7f7c36ffd640 1 -- 172.21.15.33:0/2580338237 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c4802e070 con 0x55fd4b6291b0 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.025+0000 7f7c36ffd640 1 -- 172.21.15.33:0/2580338237 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c480296e0 con 0x55fd4b6291b0 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.025+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2580338237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 msgr2=0x55fd4ba0e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.026+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2580338237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba0e9d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f7c4801a5b0 tx=0x7f7c4801a460 comp rx=0 tx=0).stop 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.026+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2580338237 shutdown_connections 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.026+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2580338237 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b652070 0x55fd4ba000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.026+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2580338237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b631390 0x55fd4b9ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.026+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/2580338237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b6291b0 0x55fd4ba0e9d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.026+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2580338237 >> 172.21.15.33:0/2580338237 conn(0x55fd4b646460 msgr2=0x55fd4ba01220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:13.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.026+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2580338237 shutdown_connections 2024-08-28T19:40:13.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.026+0000 7f7c59a8c740 1 -- 172.21.15.33:0/2580338237 wait complete. 2024-08-28T19:40:13.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.026+0000 7f7c59a8c740 1 -- start start 2024-08-28T19:40:13.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.026+0000 7f7c59a8c740 1 Processor -- start 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b6291b0 0x55fd4ba06d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b631390 0x55fd4ba07250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c59a8c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b652070 0x55fd4ba7e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1b4370 con 0x55fd4b652070 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1b3ca0 con 0x55fd4b631390 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c59a8c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1b0f00 con 0x55fd4b6291b0 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c59a8c740 10 client.0 _ll_register_callbacks cb 0x7f7c4800b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c51ab4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b652070 0x55fd4ba7e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c51ab4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b652070 0x55fd4ba7e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44630/0 (socket says 172.21.15.33:44630) 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c51ab4640 1 -- 172.21.15.33:0/3498015640 learned_addr learned my addr 172.21.15.33:0/3498015640 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:13.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c512b3640 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b6291b0 0x55fd4ba06d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c50ab2640 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b631390 0x55fd4ba07250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c51ab4640 1 -- 172.21.15.33:0/3498015640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b6291b0 msgr2=0x55fd4ba06d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c51ab4640 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b6291b0 0x55fd4ba06d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c51ab4640 1 -- 172.21.15.33:0/3498015640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b631390 msgr2=0x55fd4ba07250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c51ab4640 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b631390 0x55fd4ba07250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c51ab4640 1 -- 172.21.15.33:0/3498015640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd4ba07af0 con 0x55fd4b652070 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c51ab4640 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b652070 0x55fd4ba7e4c0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400fe30 tx=0x7f7c44015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1018c04b51c2dad server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.027+0000 7f7c34ff9640 1 -- 172.21.15.33:0/3498015640 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400fe60 con 0x55fd4b652070 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c59a8c740 1 -- 172.21.15.33:0/3498015640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c4802e070 con 0x55fd4b652070 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c34ff9640 1 -- 172.21.15.33:0/3498015640 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9541+0+0 (secure 0 0 0) 0x7f7c44003970 con 0x55fd4b652070 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c34ff9640 1 -- 172.21.15.33:0/3498015640 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c44032050 con 0x55fd4b652070 2024-08-28T19:40:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c59a8c740 10 client.17712 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c59a8c740 1 -- 172.21.15.33:0/3498015640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd4ba7fb00 con 0x55fd4b652070 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c34ff9640 1 -- 172.21.15.33:0/3498015640 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c4802e070 con 0x55fd4b652070 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c34ff9640 1 -- 172.21.15.33:0/3498015640 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7c4401b600 con 0x55fd4b652070 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c59a8c740 10 client.17712 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c59a8c740 10 client.17712 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c59a8c740 20 client.17712 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55fd4b5e5da0 0x55fd4ba822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c59a8c740 4 client.17712 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c59a8c740 1 -- 172.21.15.33:0/3498015640 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd4b96c070 con 0x55fd4b5e5da0 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.028+0000 7f7c512b3640 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55fd4b5e5da0 0x55fd4ba822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c512b3640 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55fd4b5e5da0 0x55fd4ba822c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f48b627003ad915a server_cookie=17e191a7d4bd6cb6 in_seq=0 out_seq=0 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c34ff9640 10 client.17712 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c34ff9640 1 -- 172.21.15.33:0/3498015640 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd4b96c070 con 0x55fd4b5e5da0 2024-08-28T19:40:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c34ff9640 10 client.17712 handle_command_reply: tid=0 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 client.17712 shutdown 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 -- 172.21.15.33:0/3498015640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b652070 msgr2=0x55fd4ba7e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b652070 0x55fd4ba7e4c0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400fe30 tx=0x7f7c44015000 comp rx=0 tx=0).stop 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 -- 172.21.15.33:0/3498015640 shutdown_connections 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55fd4b5e5da0 0x55fd4ba822c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd4b652070 0x55fd4ba7e4c0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd4b631390 0x55fd4ba07250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 --2- 172.21.15.33:0/3498015640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd4b6291b0 0x55fd4ba06d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c34ff9640 0 client.17712 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 -- 172.21.15.33:0/3498015640 >> 172.21.15.33:0/3498015640 conn(0x55fd4b646460 msgr2=0x55fd4ba011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 -- 172.21.15.33:0/3498015640 shutdown_connections 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.029+0000 7f7c59a8c740 1 -- 172.21.15.33:0/3498015640 wait complete. 2024-08-28T19:40:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c59a8c740 20 client.17712 trim_cache size 0 max 16384 2024-08-28T19:40:13.036 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:40:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 -- 172.21.15.33:0/1507689227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c380b4cd0 msgr2=0x7f7c380b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c380b4cd0 0x7f7c380b71e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7c44010540 tx=0x7f7c44007520 comp rx=0 tx=0).stop 2024-08-28T19:40:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 -- 172.21.15.33:0/1507689227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c102d70 msgr2=0x7f7c4c19cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c102d70 0x7f7c4c19cb50 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c005940 tx=0x7f7c3c0042f0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 -- 172.21.15.33:0/1507689227 shutdown_connections 2024-08-28T19:40:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c380b4cd0 0x7f7c380b71e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c4c10ffd0 0x7f7c4c1a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4c102d70 0x7f7c4c19cb50 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 --2- 172.21.15.33:0/1507689227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c4c102420 0x7f7c4c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 -- 172.21.15.33:0/1507689227 >> 172.21.15.33:0/1507689227 conn(0x7f7c4c079470 msgr2=0x7f7c4c108ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 -- 172.21.15.33:0/1507689227 shutdown_connections 2024-08-28T19:40:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:13.030+0000 7f7c53517640 1 -- 172.21.15.33:0/1507689227 wait complete. 2024-08-28T19:40:13.745 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:13 smithi033 ceph-mon[18549]: pgmap v578: 129 pgs: 129 active+clean; 9.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 121 KiB/s wr, 38 op/s 2024-08-28T19:40:13.773 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:40:13.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:13 smithi059 ceph-mon[22052]: pgmap v578: 129 pgs: 129 active+clean; 9.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 121 KiB/s wr, 38 op/s 2024-08-28T19:40:13.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:13 smithi122 ceph-mon[22174]: pgmap v578: 129 pgs: 129 active+clean; 9.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 121 KiB/s wr, 38 op/s 2024-08-28T19:40:14.026 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.570+0000 7f6e3caf9640 1 -- 172.21.15.33:0/2037102834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e38109240 msgr2=0x7f6e38109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.570+0000 7f6e3caf9640 1 --2- 172.21.15.33:0/2037102834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e38109240 0x7f6e38109650 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009900 tx=0x7f6e2c02a410 comp rx=0 tx=0).stop 2024-08-28T19:40:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.571+0000 7f6e3caf9640 1 -- 172.21.15.33:0/2037102834 shutdown_connections 2024-08-28T19:40:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.571+0000 7f6e3caf9640 1 --2- 172.21.15.33:0/2037102834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38109b90 0x7f6e381103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.571+0000 7f6e3caf9640 1 --2- 172.21.15.33:0/2037102834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e38109240 0x7f6e38109650 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.571+0000 7f6e3caf9640 1 --2- 172.21.15.33:0/2037102834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e38103900 0x7f6e38103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.571+0000 7f6e3caf9640 1 -- 172.21.15.33:0/2037102834 >> 172.21.15.33:0/2037102834 conn(0x7f6e3807b5f0 msgr2=0x7f6e3807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.571+0000 7f6e3caf9640 1 -- 172.21.15.33:0/2037102834 shutdown_connections 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.571+0000 7f6e3caf9640 1 -- 172.21.15.33:0/2037102834 wait complete. 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.571+0000 7f6e3caf9640 1 Processor -- start 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e3caf9640 1 -- start start 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e3caf9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e38103900 0x7f6e3819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e3caf9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e38109240 0x7f6e3819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e3caf9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38109b90 0x7f6e3819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e3caf9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38113870 con 0x7f6e38109240 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e3caf9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381136f0 con 0x7f6e38109b90 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e3caf9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381139f0 con 0x7f6e38103900 2024-08-28T19:40:14.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e35d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e38109240 0x7f6e3819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e35d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e38109240 0x7f6e3819a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44644/0 (socket says 172.21.15.33:44644) 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e35d9b640 1 -- 172.21.15.33:0/3640743616 learned_addr learned my addr 172.21.15.33:0/3640743616 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e3659c640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e38103900 0x7f6e3819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e36d9d640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38109b90 0x7f6e3819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e35d9b640 1 -- 172.21.15.33:0/3640743616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e38103900 msgr2=0x7f6e3819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e38103900 0x7f6e3819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e35d9b640 1 -- 172.21.15.33:0/3640743616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38109b90 msgr2=0x7f6e3819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38109b90 0x7f6e3819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e35d9b640 1 -- 172.21.15.33:0/3640743616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e381a0210 con 0x7f6e38109240 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.572+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e38109240 0x7f6e3819a840 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c02a930 tx=0x7f6e2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.573+0000 7f6e277fe640 1 -- 172.21.15.33:0/3640743616 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c03f030 con 0x7f6e38109240 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.573+0000 7f6e3caf9640 1 -- 172.21.15.33:0/3640743616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e381a04a0 con 0x7f6e38109240 2024-08-28T19:40:14.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.573+0000 7f6e277fe640 1 -- 172.21.15.33:0/3640743616 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e2c003aa0 con 0x7f6e38109240 2024-08-28T19:40:14.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.573+0000 7f6e277fe640 1 -- 172.21.15.33:0/3640743616 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c035070 con 0x7f6e38109240 2024-08-28T19:40:14.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.573+0000 7f6e3caf9640 1 -- 172.21.15.33:0/3640743616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e381a6c60 con 0x7f6e38109240 2024-08-28T19:40:14.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.575+0000 7f6e4306e740 1 Processor -- start 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e277fe640 1 -- 172.21.15.33:0/3640743616 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6e2c042030 con 0x7f6e38109240 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e4306e740 1 -- start start 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee75070 0x55ea1f21a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee54390 0x55ea1f21ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e4306e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ea1f191680 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e4306e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ea1f180c10 con 0x55ea1ee54390 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e4306e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ea1f184bc0 con 0x55ea1ee75070 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e3659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e3659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44654/0 (socket says 172.21.15.33:44654) 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e3659c640 1 -- 172.21.15.33:0/2207999730 learned_addr learned my addr 172.21.15.33:0/2207999730 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:14.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/2207999730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee54390 0x55ea1f21ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.576+0000 7f6e36d9d640 1 --2- 172.21.15.33:0/2207999730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee75070 0x55ea1f21a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e3659c640 1 -- 172.21.15.33:0/2207999730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee75070 msgr2=0x55ea1f21a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e3659c640 1 --2- 172.21.15.33:0/2207999730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee75070 0x55ea1f21a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e3659c640 1 -- 172.21.15.33:0/2207999730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee54390 msgr2=0x55ea1f21ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e3659c640 1 --2- 172.21.15.33:0/2207999730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee54390 0x55ea1f21ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e3659c640 1 -- 172.21.15.33:0/2207999730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea1eee0650 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/2207999730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee54390 0x55ea1f21ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e277fe640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6e200b4ca0 0x7f6e200b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e36d9d640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6e200b4ca0 0x7f6e200b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e3659c640 1 --2- 172.21.15.33:0/2207999730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21a850 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800bd80 tx=0x7f6e280107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7837ff6b6abad1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e277fe640 1 -- 172.21.15.33:0/3640743616 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f6e2c105d10 con 0x7f6e38109240 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e24ff9640 1 -- 172.21.15.33:0/2207999730 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28005220 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e24ff9640 1 -- 172.21.15.33:0/2207999730 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e28004c50 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.577+0000 7f6e24ff9640 1 -- 172.21.15.33:0/2207999730 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e280117c0 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.578+0000 7f6e4306e740 1 -- 172.21.15.33:0/2207999730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 msgr2=0x55ea1f21a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.578+0000 7f6e36d9d640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6e200b4ca0 0x7f6e200b71b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000a450 tx=0x7f6e3000d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.578+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2207999730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21a850 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800bd80 tx=0x7f6e280107a0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.578+0000 7f6e4306e740 1 -- 172.21.15.33:0/2207999730 shutdown_connections 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.578+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2207999730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee54390 0x55ea1f21ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.578+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2207999730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21a850 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.578+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2207999730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee75070 0x55ea1f21a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.578+0000 7f6e4306e740 1 -- 172.21.15.33:0/2207999730 >> 172.21.15.33:0/2207999730 conn(0x55ea1ee69460 msgr2=0x55ea1f218200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.578+0000 7f6e4306e740 1 -- 172.21.15.33:0/2207999730 shutdown_connections 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.578+0000 7f6e4306e740 1 -- 172.21.15.33:0/2207999730 wait complete. 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e4306e740 1 -- start start 2024-08-28T19:40:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e4306e740 1 Processor -- start 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f229e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee54390 0x55ea1f22a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 0x55ea1f236180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e4306e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ea1efe3700 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e4306e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ea1f107750 con 0x55ea1ee75070 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e4306e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ea1f22ce20 con 0x55ea1ee54390 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e4306e740 10 client.0 _ll_register_callbacks cb 0x55ea1f136e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e3659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f229e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e3659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f229e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44664/0 (socket says 172.21.15.33:44664) 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e3659c640 1 -- 172.21.15.33:0/2322584816 learned_addr learned my addr 172.21.15.33:0/2322584816 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e36d9d640 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 0x55ea1f236180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.579+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee54390 0x55ea1f22a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e3659c640 1 -- 172.21.15.33:0/2322584816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee54390 msgr2=0x55ea1f22a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e3659c640 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee54390 0x55ea1f22a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e3659c640 1 -- 172.21.15.33:0/2322584816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 msgr2=0x55ea1f236180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e3659c640 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 0x55ea1f236180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e3659c640 1 -- 172.21.15.33:0/2322584816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea1f140900 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e36d9d640 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 0x55ea1f236180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e3659c640 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f229e70 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f6e28005750 tx=0x7f6e280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8880650d290c56c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2322584816 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28029060 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2322584816 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f6e28005010 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e4306e740 1 -- 172.21.15.33:0/2322584816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e28004c50 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2322584816 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6e2800be70 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e4306e740 10 client.17724 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.580+0000 7f6e4306e740 1 -- 172.21.15.33:0/2322584816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea1f238bb0 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.581+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2322584816 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e28004c50 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.581+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2322584816 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6e280039b0 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.581+0000 7f6e4306e740 10 client.17724 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.581+0000 7f6e4306e740 10 client.17724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:40:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.581+0000 7f6e4306e740 20 client.17724 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.581+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ea1ee339f0 0x55ea1f23bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.581+0000 7f6e4306e740 4 client.17724 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.581+0000 7f6e4306e740 1 -- 172.21.15.33:0/2322584816 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea1f1935d0 con 0x55ea1ee339f0 2024-08-28T19:40:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.581+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ea1ee339f0 0x55ea1f23bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.582+0000 7f6e1dffb640 10 client.17724 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.582+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ea1ee339f0 0x55ea1f23bfc0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f06878a6f3fc112 server_cookie=13aae7efa416ef8e in_seq=0 out_seq=0 2024-08-28T19:40:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.582+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2322584816 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea1f1935d0 con 0x55ea1ee339f0 2024-08-28T19:40:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.582+0000 7f6e1dffb640 10 client.17724 handle_command_reply: tid=0 2024-08-28T19:40:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.582+0000 7f6e4306e740 1 client.17724 shutdown 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.582+0000 7f6e4306e740 1 -- 172.21.15.33:0/2322584816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 msgr2=0x55ea1f229e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.582+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f229e70 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f6e28005750 tx=0x7f6e280048f0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.583+0000 7f6e4306e740 1 -- 172.21.15.33:0/2322584816 shutdown_connections 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.583+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 0x55ea1f236180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.583+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee54390 0x55ea1f22a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.583+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ea1ee339f0 0x55ea1f23bfc0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.583+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2322584816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f229e70 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.583+0000 7f6e4306e740 1 -- 172.21.15.33:0/2322584816 >> 172.21.15.33:0/2322584816 conn(0x55ea1ee69460 msgr2=0x55ea1f21d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.583+0000 7f6e1dffb640 0 client.17724 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.583+0000 7f6e4306e740 1 -- 172.21.15.33:0/2322584816 shutdown_connections 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.583+0000 7f6e4306e740 1 -- 172.21.15.33:0/2322584816 wait complete. 2024-08-28T19:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.583+0000 7f6e4306e740 20 client.17724 trim_cache size 0 max 16384 2024-08-28T19:40:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e4306e740 1 Processor -- start 2024-08-28T19:40:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e4306e740 1 -- start start 2024-08-28T19:40:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f21d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 0x55ea1f227060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e4306e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381aeaa0 con 0x55ea1ee54390 2024-08-28T19:40:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e4306e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381b05e0 con 0x55ea1ee75070 2024-08-28T19:40:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e4306e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381af170 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e35d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f21d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e35d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f21d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44680/0 (socket says 172.21.15.33:44680) 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.596+0000 7f6e35d9b640 1 -- 172.21.15.33:0/1900291396 learned_addr learned my addr 172.21.15.33:0/1900291396 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e3659c640 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e36d9d640 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 0x55ea1f227060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e35d9b640 1 -- 172.21.15.33:0/1900291396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee4c1b0 msgr2=0x55ea1f21d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e35d9b640 1 -- 172.21.15.33:0/1900291396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 msgr2=0x55ea1f227060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 0x55ea1f227060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e35d9b640 1 -- 172.21.15.33:0/1900291396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea1f2135a0 con 0x55ea1ee54390 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e36d9d640 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 0x55ea1f227060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e3659c640 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f21d9e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0c9380 tx=0x7f6e2c03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8617a24d5ae4a658 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e1ffff640 1 -- 172.21.15.33:0/1900291396 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c049040 con 0x55ea1ee54390 2024-08-28T19:40:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e1ffff640 1 -- 172.21.15.33:0/1900291396 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e2c0d5380 con 0x55ea1ee54390 2024-08-28T19:40:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.597+0000 7f6e1ffff640 1 -- 172.21.15.33:0/1900291396 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0cc370 con 0x55ea1ee54390 2024-08-28T19:40:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 -- 172.21.15.33:0/1900291396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 msgr2=0x55ea1f21d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f21d9e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0c9380 tx=0x7f6e2c03b6b0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 -- 172.21.15.33:0/1900291396 shutdown_connections 2024-08-28T19:40:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee75070 0x55ea1f227060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f21d9e0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 --2- 172.21.15.33:0/1900291396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f21d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 -- 172.21.15.33:0/1900291396 >> 172.21.15.33:0/1900291396 conn(0x55ea1ee69460 msgr2=0x55ea1f2286f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 -- 172.21.15.33:0/1900291396 shutdown_connections 2024-08-28T19:40:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 -- 172.21.15.33:0/1900291396 wait complete. 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 -- start start 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.598+0000 7f6e4306e740 1 Processor -- start 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f23d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f23d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e4306e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee75070 0x55ea1f23db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e4306e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381aff10 con 0x55ea1ee54390 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e4306e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381af840 con 0x55ea1ee4c1b0 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e4306e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381acaa0 con 0x55ea1ee75070 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e4306e740 10 client.0 _ll_register_callbacks cb 0x7f6e2800bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e3659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f23d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e35d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f23d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e3659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f23d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:49770/0 (socket says 172.21.15.33:49770) 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e35d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f23d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44686/0 (socket says 172.21.15.33:44686) 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e3659c640 1 -- 172.21.15.33:0/2587609655 learned_addr learned my addr 172.21.15.33:0/2587609655 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e36d9d640 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee75070 0x55ea1f23db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e35d9b640 1 -- 172.21.15.33:0/2587609655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee75070 msgr2=0x55ea1f23db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee75070 0x55ea1f23db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e35d9b640 1 -- 172.21.15.33:0/2587609655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee4c1b0 msgr2=0x55ea1f23d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f23d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e35d9b640 1 -- 172.21.15.33:0/2587609655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea1f2a5870 con 0x55ea1ee54390 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e3659c640 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f23d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e35d9b640 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f23d640 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c103120 tx=0x7f6e2c005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7832322a6e300352 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.599+0000 7f6e1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2587609655 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c049070 con 0x55ea1ee54390 2024-08-28T19:40:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2587609655 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f6e2c0cc370 con 0x55ea1ee54390 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e4306e740 1 -- 172.21.15.33:0/2587609655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e2c0d5380 con 0x55ea1ee54390 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2587609655 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6e2c0cc570 con 0x55ea1ee54390 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e4306e740 10 client.17730 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e4306e740 1 -- 172.21.15.33:0/2587609655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea1f2a69b0 con 0x55ea1ee54390 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2587609655 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e2c0d5380 con 0x55ea1ee54390 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2587609655 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6e2c0b71d0 con 0x55ea1ee54390 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e4306e740 10 client.17730 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e4306e740 10 client.17730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e4306e740 20 client.17730 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ea1ee08da0 0x55ea1f2a9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e4306e740 4 client.17730 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e4306e740 1 -- 172.21.15.33:0/2587609655 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea1f18f070 con 0x55ea1ee08da0 2024-08-28T19:40:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.600+0000 7f6e3659c640 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ea1ee08da0 0x55ea1f2a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e3659c640 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ea1ee08da0 0x55ea1f2a9080 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80986462276d79c7 server_cookie=9b204145d8bc1ae6 in_seq=0 out_seq=0 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e1dffb640 10 client.17730 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e1dffb640 1 -- 172.21.15.33:0/2587609655 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea1f18f070 con 0x55ea1ee08da0 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e1dffb640 10 client.17730 handle_command_reply: tid=0 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 client.17730 shutdown 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 -- 172.21.15.33:0/2587609655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 msgr2=0x55ea1f23d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f23d640 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c103120 tx=0x7f6e2c005a40 comp rx=0 tx=0).stop 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 -- 172.21.15.33:0/2587609655 shutdown_connections 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ea1ee75070 0x55ea1f23db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ea1ee08da0 0x55ea1f2a9080 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ea1ee54390 0x55ea1f23d640 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 --2- 172.21.15.33:0/2587609655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea1ee4c1b0 0x55ea1f23d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 -- 172.21.15.33:0/2587609655 >> 172.21.15.33:0/2587609655 conn(0x55ea1ee69460 msgr2=0x55ea1f2282c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e1dffb640 0 client.17730 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:14.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 -- 172.21.15.33:0/2587609655 shutdown_connections 2024-08-28T19:40:14.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.601+0000 7f6e4306e740 1 -- 172.21.15.33:0/2587609655 wait complete. 2024-08-28T19:40:14.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e4306e740 20 client.17730 trim_cache size 0 max 16384 2024-08-28T19:40:14.609 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 -- 172.21.15.33:0/3640743616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6e200b4ca0 msgr2=0x7f6e200b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6e200b4ca0 0x7f6e200b71b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000a450 tx=0x7f6e3000d040 comp rx=0 tx=0).stop 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 -- 172.21.15.33:0/3640743616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e38109240 msgr2=0x7f6e3819a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e38109240 0x7f6e3819a840 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c02a930 tx=0x7f6e2c004270 comp rx=0 tx=0).stop 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 -- 172.21.15.33:0/3640743616 shutdown_connections 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38109b90 0x7f6e3819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e38109240 0x7f6e3819a840 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6e200b4ca0 0x7f6e200b71b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 --2- 172.21.15.33:0/3640743616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e38103900 0x7f6e3819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 -- 172.21.15.33:0/3640743616 >> 172.21.15.33:0/3640743616 conn(0x7f6e3807b5f0 msgr2=0x7f6e38107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:14.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 -- 172.21.15.33:0/3640743616 shutdown_connections 2024-08-28T19:40:14.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:14.602+0000 7f6e3caf9640 1 -- 172.21.15.33:0/3640743616 wait complete. 2024-08-28T19:40:15.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:15 smithi033 ceph-mon[18549]: pgmap v579: 129 pgs: 129 active+clean; 9.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-08-28T19:40:15.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:15 smithi033 ceph-mon[18549]: osdmap e88: 12 total, 12 up, 12 in 2024-08-28T19:40:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:15 smithi059 ceph-mon[22052]: pgmap v579: 129 pgs: 129 active+clean; 9.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-08-28T19:40:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:15 smithi059 ceph-mon[22052]: osdmap e88: 12 total, 12 up, 12 in 2024-08-28T19:40:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:15 smithi122 ceph-mon[22174]: pgmap v579: 129 pgs: 129 active+clean; 9.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-08-28T19:40:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:15 smithi122 ceph-mon[22174]: osdmap e88: 12 total, 12 up, 12 in 2024-08-28T19:40:16.292 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:40:16.293 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:40:16.555 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.079+0000 7fa4a268a640 1 -- 172.21.15.33:0/1821967498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa49c104750 msgr2=0x7fa49c104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.079+0000 7fa4a268a640 1 --2- 172.21.15.33:0/1821967498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa49c104750 0x7fa49c104b60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009900 tx=0x7fa48c02a410 comp rx=0 tx=0).stop 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.079+0000 7fa4a268a640 1 -- 172.21.15.33:0/1821967498 shutdown_connections 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.079+0000 7fa4a268a640 1 --2- 172.21.15.33:0/1821967498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c10dbb0 0x7fa49c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.079+0000 7fa4a268a640 1 --2- 172.21.15.33:0/1821967498 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c1050a0 0x7fa49c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.079+0000 7fa4a268a640 1 --2- 172.21.15.33:0/1821967498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa49c104750 0x7fa49c104b60 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.079+0000 7fa4a268a640 1 -- 172.21.15.33:0/1821967498 >> 172.21.15.33:0/1821967498 conn(0x7fa49c0794d0 msgr2=0x7fa49c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.079+0000 7fa4a268a640 1 -- 172.21.15.33:0/1821967498 shutdown_connections 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.079+0000 7fa4a268a640 1 -- 172.21.15.33:0/1821967498 wait complete. 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa4a268a640 1 Processor -- start 2024-08-28T19:40:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa4a268a640 1 -- start start 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa4a268a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c104750 0x7fa49c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa4a268a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa49c1050a0 0x7fa49c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa4a268a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c10dbb0 0x7fa49c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa4a268a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c113810 con 0x7fa49c1050a0 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa4a268a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c113690 con 0x7fa49c104750 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa4a268a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c113990 con 0x7fa49c10dbb0 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa493fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa49c1050a0 0x7fa49c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa493fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa49c1050a0 0x7fa49c19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44690/0 (socket says 172.21.15.33:44690) 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.080+0000 7fa493fff640 1 -- 172.21.15.33:0/4221781569 learned_addr learned my addr 172.21.15.33:0/4221781569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa49bfff640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c104750 0x7fa49c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa493fff640 1 -- 172.21.15.33:0/4221781569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c10dbb0 msgr2=0x7fa49c19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c10dbb0 0x7fa49c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa493fff640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c10dbb0 0x7fa49c19fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa493fff640 1 -- 172.21.15.33:0/4221781569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c104750 msgr2=0x7fa49c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa493fff640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c104750 0x7fa49c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa493fff640 1 -- 172.21.15.33:0/4221781569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c1a0130 con 0x7fa49c1050a0 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa49bfff640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c104750 0x7fa49c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa493fff640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa49c1050a0 0x7fa49c19a820 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c8c0 tx=0x7fa48400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa499ffb640 1 -- 172.21.15.33:0/4221781569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484007bb0 con 0x7fa49c1050a0 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa499ffb640 1 -- 172.21.15.33:0/4221781569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa484007d50 con 0x7fa49c1050a0 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa4a268a640 1 -- 172.21.15.33:0/4221781569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c1a0420 con 0x7fa49c1050a0 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa499ffb640 1 -- 172.21.15.33:0/4221781569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840187c0 con 0x7fa49c1050a0 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.081+0000 7fa4a268a640 1 -- 172.21.15.33:0/4221781569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c1a6c40 con 0x7fa49c1050a0 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.084+0000 7fa499ffb640 1 -- 172.21.15.33:0/4221781569 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa48400fa20 con 0x7fa49c1050a0 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.084+0000 7fa4a8bff740 1 Processor -- start 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.084+0000 7fa4a8bff740 1 -- start start 2024-08-28T19:40:17.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.084+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dbce350 0x563d6df74780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.084+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dba5490 0x563d6df74cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbad670 0x563d6df75200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563d6deea5f0 con 0x563d6dba5490 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563d6ded9b80 con 0x563d6dbce350 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563d6deddb30 con 0x563d6dbad670 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa49bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dba5490 0x563d6df74cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa49bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dba5490 0x563d6df74cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44706/0 (socket says 172.21.15.33:44706) 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa49bfff640 1 -- 172.21.15.33:0/1533650387 learned_addr learned my addr 172.21.15.33:0/1533650387 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/1533650387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dbce350 0x563d6df74780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa493fff640 1 --2- 172.21.15.33:0/1533650387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbad670 0x563d6df75200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa499ffb640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4880b4d50 0x7fa4880b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa49bfff640 1 -- 172.21.15.33:0/1533650387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbad670 msgr2=0x563d6df75200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa49bfff640 1 --2- 172.21.15.33:0/1533650387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbad670 0x563d6df75200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa49bfff640 1 -- 172.21.15.33:0/1533650387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dbce350 msgr2=0x563d6df74780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa49bfff640 1 --2- 172.21.15.33:0/1533650387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dbce350 0x563d6df74780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa49bfff640 1 -- 172.21.15.33:0/1533650387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6dc39930 con 0x563d6dba5490 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4880b4d50 0x7fa4880b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa499ffb640 1 -- 172.21.15.33:0/4221781569 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7fa4840e59e0 con 0x7fa49c1050a0 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.085+0000 7fa49bfff640 1 --2- 172.21.15.33:0/1533650387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dba5490 0x563d6df74cc0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa48c006010 tx=0x7fa48c032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6501e03f284cbf10 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.086+0000 7fa4927fc640 1 -- 172.21.15.33:0/1533650387 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c03f070 con 0x563d6dba5490 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.086+0000 7fa4927fc640 1 -- 172.21.15.33:0/1533650387 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa48c0316a0 con 0x563d6dba5490 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.086+0000 7fa4927fc640 1 -- 172.21.15.33:0/1533650387 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c035070 con 0x563d6dba5490 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.086+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1533650387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dba5490 msgr2=0x563d6df74cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.086+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4880b4d50 0x7fa4880b7260 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa49400bd70 tx=0x7fa494004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.086+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/1533650387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dba5490 0x563d6df74cc0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa48c006010 tx=0x7fa48c032e70 comp rx=0 tx=0).stop 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.087+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1533650387 shutdown_connections 2024-08-28T19:40:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.087+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/1533650387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbad670 0x563d6df75200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.087+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/1533650387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dba5490 0x563d6df74cc0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.087+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/1533650387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dbce350 0x563d6df74780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.087+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1533650387 >> 172.21.15.33:0/1533650387 conn(0x563d6dbc2740 msgr2=0x563d6df72670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.087+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1533650387 shutdown_connections 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.087+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1533650387 wait complete. 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.087+0000 7fa4a8bff740 1 -- start start 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.087+0000 7fa4a8bff740 1 Processor -- start 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dba5490 0x563d6df842c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbad670 0x563d6df84800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df90590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563d6dd3c890 con 0x563d6dbce350 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563d6de60790 con 0x563d6dba5490 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563d6df87260 con 0x563d6dbad670 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a8bff740 10 client.0 _ll_register_callbacks cb 0x563d6dbe5ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a0c27640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df90590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a0c27640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df90590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44710/0 (socket says 172.21.15.33:44710) 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a0c27640 1 -- 172.21.15.33:0/1056591708 learned_addr learned my addr 172.21.15.33:0/1056591708 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa49bfff640 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dba5490 0x563d6df842c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa493fff640 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbad670 0x563d6df84800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a0c27640 1 -- 172.21.15.33:0/1056591708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbad670 msgr2=0x563d6df84800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbad670 0x563d6df84800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a0c27640 1 -- 172.21.15.33:0/1056591708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dba5490 msgr2=0x563d6df842c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dba5490 0x563d6df842c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a0c27640 1 -- 172.21.15.33:0/1056591708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6de97f30 con 0x563d6dbce350 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df90590 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa494011e10 tx=0x7fa494004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aee9b2fa2643238 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.088+0000 7fa47b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa47b7fe640 1 -- 172.21.15.33:0/1056591708 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49401c430 con 0x563d6dbce350 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa47b7fe640 1 -- 172.21.15.33:0/1056591708 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7fa49401c5d0 con 0x563d6dbce350 2024-08-28T19:40:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1056591708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa48c0316a0 con 0x563d6dbce350 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa47b7fe640 1 -- 172.21.15.33:0/1056591708 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa49402e050 con 0x563d6dbce350 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa4a8bff740 10 client.17742 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1056591708 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563d6df93070 con 0x563d6dbce350 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa47b7fe640 1 -- 172.21.15.33:0/1056591708 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa48c0316a0 con 0x563d6dbce350 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa47b7fe640 1 -- 172.21.15.33:0/1056591708 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa49401d8c0 con 0x563d6dbce350 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa4a8bff740 10 client.17742 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa4a8bff740 10 client.17742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa4a8bff740 20 client.17742 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563d6db8ccd0 0x563d6df96690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa4a8bff740 4 client.17742 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.089+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1056591708 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d6deec540 con 0x563d6db8ccd0 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.090+0000 7fa49bfff640 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563d6db8ccd0 0x563d6df96690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.090+0000 7fa49bfff640 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563d6db8ccd0 0x563d6df96690 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c415cbefd5abdb5a server_cookie=5af603da2f175090 in_seq=0 out_seq=0 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.090+0000 7fa47b7fe640 10 client.17742 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa47b7fe640 1 -- 172.21.15.33:0/1056591708 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d6deec540 con 0x563d6db8ccd0 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa47b7fe640 10 client.17742 handle_command_reply: tid=0 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 client.17742 shutdown 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1056591708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 msgr2=0x563d6df90590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df90590 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa494011e10 tx=0x7fa494004ab0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1056591708 shutdown_connections 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563d6db8ccd0 0x563d6df96690 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df90590 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbad670 0x563d6df84800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa47b7fe640 0 client.17742 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/1056591708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dba5490 0x563d6df842c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1056591708 >> 172.21.15.33:0/1056591708 conn(0x563d6dbc2740 msgr2=0x563d6df70c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1056591708 shutdown_connections 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 1 -- 172.21.15.33:0/1056591708 wait complete. 2024-08-28T19:40:17.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.091+0000 7fa4a8bff740 20 client.17742 trim_cache size 0 max 16384 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a8bff740 1 Processor -- start 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a8bff740 1 -- start start 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dba5490 0x563d6df7a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dbad670 0x563d6df814b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df819f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c1aeab0 con 0x563d6dbce350 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c1b05f0 con 0x563d6dbad670 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c1af180 con 0x563d6dba5490 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a0c27640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df819f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a0c27640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df819f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44722/0 (socket says 172.21.15.33:44722) 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.109+0000 7fa4a0c27640 1 -- 172.21.15.33:0/946460092 learned_addr learned my addr 172.21.15.33:0/946460092 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa49bfff640 1 --2- 172.21.15.33:0/946460092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dba5490 0x563d6df7a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa493fff640 1 --2- 172.21.15.33:0/946460092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dbad670 0x563d6df814b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa4a0c27640 1 -- 172.21.15.33:0/946460092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dba5490 msgr2=0x563d6df7a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/946460092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dba5490 0x563d6df7a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa4a0c27640 1 -- 172.21.15.33:0/946460092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dbad670 msgr2=0x563d6df814b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/946460092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dbad670 0x563d6df814b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa4a0c27640 1 -- 172.21.15.33:0/946460092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6df75570 con 0x563d6dbce350 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/946460092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df819f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa494010d30 tx=0x7fa494011820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf7376780d3bf9f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa491ffb640 1 -- 172.21.15.33:0/946460092 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49401d430 con 0x563d6dbce350 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa491ffb640 1 -- 172.21.15.33:0/946460092 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa494036070 con 0x563d6dbce350 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.110+0000 7fa491ffb640 1 -- 172.21.15.33:0/946460092 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49403bab0 con 0x563d6dbce350 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.111+0000 7fa4a8bff740 1 -- 172.21.15.33:0/946460092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 msgr2=0x563d6df819f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.111+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/946460092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df819f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa494010d30 tx=0x7fa494011820 comp rx=0 tx=0).stop 2024-08-28T19:40:17.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.111+0000 7fa4a8bff740 1 -- 172.21.15.33:0/946460092 shutdown_connections 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.111+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/946460092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbce350 0x563d6df819f0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.111+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/946460092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dbad670 0x563d6df814b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.111+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/946460092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dba5490 0x563d6df7a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.111+0000 7fa4a8bff740 1 -- 172.21.15.33:0/946460092 >> 172.21.15.33:0/946460092 conn(0x563d6dbc2740 msgr2=0x563d6df79920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.111+0000 7fa4a8bff740 1 -- 172.21.15.33:0/946460092 shutdown_connections 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.111+0000 7fa4a8bff740 1 -- 172.21.15.33:0/946460092 wait complete. 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.111+0000 7fa4a8bff740 1 -- start start 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa4a8bff740 1 Processor -- start 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dba5490 0x563d6df8cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbad670 0x563d6df89060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa4a8bff740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbce350 0x563d6df895a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c1aff20 con 0x563d6dbad670 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c1af850 con 0x563d6dba5490 2024-08-28T19:40:17.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa4a8bff740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c1acab0 con 0x563d6dbce350 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa4a8bff740 10 client.0 _ll_register_callbacks cb 0x7fa49400b560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa493fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbad670 0x563d6df89060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa493fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbad670 0x563d6df89060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44738/0 (socket says 172.21.15.33:44738) 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa493fff640 1 -- 172.21.15.33:0/486982421 learned_addr learned my addr 172.21.15.33:0/486982421 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa4a0c27640 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbce350 0x563d6df895a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa49bfff640 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dba5490 0x563d6df8cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa493fff640 1 -- 172.21.15.33:0/486982421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbce350 msgr2=0x563d6df895a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa493fff640 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbce350 0x563d6df895a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa493fff640 1 -- 172.21.15.33:0/486982421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dba5490 msgr2=0x563d6df8cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa493fff640 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dba5490 0x563d6df8cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.112+0000 7fa493fff640 1 -- 172.21.15.33:0/486982421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6df89c10 con 0x563d6dbad670 2024-08-28T19:40:17.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa493fff640 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbad670 0x563d6df89060 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fa4840aba30 tx=0x7fa4840932e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e468d41baafb6ea server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa47b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa47b7fe640 1 -- 172.21.15.33:0/486982421 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840ac430 con 0x563d6dbad670 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa47b7fe640 1 -- 172.21.15.33:0/486982421 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7fa4840ac1a0 con 0x563d6dbad670 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa4a8bff740 1 -- 172.21.15.33:0/486982421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa494036070 con 0x563d6dbad670 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa47b7fe640 1 -- 172.21.15.33:0/486982421 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4840abd30 con 0x563d6dbad670 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa4a8bff740 10 client.17748 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa4a8bff740 1 -- 172.21.15.33:0/486982421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563d6e001ea0 con 0x563d6dbad670 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa47b7fe640 1 -- 172.21.15.33:0/486982421 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa494036070 con 0x563d6dbad670 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa47b7fe640 1 -- 172.21.15.33:0/486982421 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa4840b4bc0 con 0x563d6dbad670 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa4a8bff740 10 client.17748 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa4a8bff740 10 client.17748 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa4a8bff740 20 client.17748 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563d6db62080 0x563d6e0046b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa4a8bff740 4 client.17748 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:40:17.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.113+0000 7fa4a8bff740 1 -- 172.21.15.33:0/486982421 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563d6df76de0 con 0x563d6db62080 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.114+0000 7fa49bfff640 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563d6db62080 0x563d6e0046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.114+0000 7fa49bfff640 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563d6db62080 0x563d6e0046b0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb7361251a13c758 server_cookie=dc7bf555aa635f83 in_seq=0 out_seq=0 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.114+0000 7fa47b7fe640 10 client.17748 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.116+0000 7fa47b7fe640 1 -- 172.21.15.33:0/486982421 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563d6df76de0 con 0x563d6db62080 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa47b7fe640 10 client.17748 handle_command_reply: tid=0 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 client.17748 shutdown 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 -- 172.21.15.33:0/486982421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbad670 msgr2=0x563d6df89060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbad670 0x563d6df89060 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fa4840aba30 tx=0x7fa4840932e0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 -- 172.21.15.33:0/486982421 shutdown_connections 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563d6dbce350 0x563d6df895a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563d6db62080 0x563d6e0046b0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.159 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:40:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:40:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "d4f12ae3-5311-4fb9-b959-e7df483556b2", 2024-08-28T19:40:17.160 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:40:17.160 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:40:17.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563d6dbad670 0x563d6df89060 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 --2- 172.21.15.33:0/486982421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d6dba5490 0x563d6df8cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 -- 172.21.15.33:0/486982421 >> 172.21.15.33:0/486982421 conn(0x563d6dbc2740 msgr2=0x563d6df85770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:17.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa47b7fe640 0 client.17748 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:17.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 -- 172.21.15.33:0/486982421 shutdown_connections 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 1 -- 172.21.15.33:0/486982421 wait complete. 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.117+0000 7fa4a8bff740 20 client.17748 trim_cache size 0 max 16384 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 -- 172.21.15.33:0/4221781569 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4880b4d50 msgr2=0x7fa4880b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4880b4d50 0x7fa4880b7260 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa49400bd70 tx=0x7fa494004a40 comp rx=0 tx=0).stop 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 -- 172.21.15.33:0/4221781569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa49c1050a0 msgr2=0x7fa49c19a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa49c1050a0 0x7fa49c19a820 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c8c0 tx=0x7fa48400cd80 comp rx=0 tx=0).stop 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 -- 172.21.15.33:0/4221781569 shutdown_connections 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa4880b4d50 0x7fa4880b7260 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa49c10dbb0 0x7fa49c19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa49c1050a0 0x7fa49c19a820 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 --2- 172.21.15.33:0/4221781569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c104750 0x7fa49c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 -- 172.21.15.33:0/4221781569 >> 172.21.15.33:0/4221781569 conn(0x7fa49c0794d0 msgr2=0x7fa49c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:17.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 -- 172.21.15.33:0/4221781569 shutdown_connections 2024-08-28T19:40:17.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:17.118+0000 7fa4a268a640 1 -- 172.21.15.33:0/4221781569 wait complete. 2024-08-28T19:40:17.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:17 smithi059 ceph-mon[22052]: pgmap v581: 129 pgs: 129 active+clean; 9.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-08-28T19:40:17.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:17 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:40:17.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:17 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:40:17.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:17 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:40:17.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:17 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:40:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:17 smithi122 ceph-mon[22174]: pgmap v581: 129 pgs: 129 active+clean; 9.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-08-28T19:40:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:17 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:40:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:17 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:40:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:17 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:40:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:17 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:40:17.815 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:17 smithi033 ceph-mon[18549]: pgmap v581: 129 pgs: 129 active+clean; 9.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-08-28T19:40:17.816 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:17 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:40:17.816 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:17 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:40:17.816 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:17 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:40:17.816 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:17 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:40:17.845 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:40:18.099 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:18.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.612+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/1536975124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e68102800 msgr2=0x7f9e68102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:18.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.612+0000 7f9e6ddaa640 1 --2- 172.21.15.33:0/1536975124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e68102800 0x7f9e68102c10 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009900 tx=0x7f9e5802a410 comp rx=0 tx=0).stop 2024-08-28T19:40:18.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.612+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/1536975124 shutdown_connections 2024-08-28T19:40:18.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.612+0000 7f9e6ddaa640 1 --2- 172.21.15.33:0/1536975124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e68108a90 0x7f9e6810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.612+0000 7f9e6ddaa640 1 --2- 172.21.15.33:0/1536975124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e68108140 0x7f9e68108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.612+0000 7f9e6ddaa640 1 --2- 172.21.15.33:0/1536975124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e68102800 0x7f9e68102c10 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.612+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/1536975124 >> 172.21.15.33:0/1536975124 conn(0x7f9e680794d0 msgr2=0x7f9e680798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:18.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.612+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/1536975124 shutdown_connections 2024-08-28T19:40:18.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.612+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/1536975124 wait complete. 2024-08-28T19:40:18.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.613+0000 7f9e6ddaa640 1 Processor -- start 2024-08-28T19:40:18.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.613+0000 7f9e6ddaa640 1 -- start start 2024-08-28T19:40:18.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.613+0000 7f9e6ddaa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e68102800 0x7f9e6819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.613+0000 7f9e6ddaa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e68108140 0x7f9e6819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.613+0000 7f9e6ddaa640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e68108a90 0x7f9e6819fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.613+0000 7f9e6ddaa640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9e68113860 con 0x7f9e68108140 2024-08-28T19:40:18.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.613+0000 7f9e6ddaa640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9e681136e0 con 0x7f9e68102800 2024-08-28T19:40:18.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.613+0000 7f9e6ddaa640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9e681139e0 con 0x7f9e68108a90 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.613+0000 7f9e66ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e68108140 0x7f9e6819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e66ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e68108140 0x7f9e6819a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43358/0 (socket says 172.21.15.33:43358) 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e66ffd640 1 -- 172.21.15.33:0/2190789439 learned_addr learned my addr 172.21.15.33:0/2190789439 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e677fe640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e68102800 0x7f9e6819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e67fff640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e68108a90 0x7f9e6819fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e66ffd640 1 -- 172.21.15.33:0/2190789439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e68108a90 msgr2=0x7f9e6819fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e68108a90 0x7f9e6819fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e66ffd640 1 -- 172.21.15.33:0/2190789439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e68102800 msgr2=0x7f9e6819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e68102800 0x7f9e6819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e66ffd640 1 -- 172.21.15.33:0/2190789439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e681a01c0 con 0x7f9e68108140 2024-08-28T19:40:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e677fe640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e68102800 0x7f9e6819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e67fff640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e68108a90 0x7f9e6819fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e68108140 0x7f9e6819a7f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00d770 tx=0x7f9e5c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e64ff9640 1 -- 172.21.15.33:0/2190789439 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c017070 con 0x7f9e68108140 2024-08-28T19:40:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e64ff9640 1 -- 172.21.15.33:0/2190789439 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e5c009c30 con 0x7f9e68108140 2024-08-28T19:40:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/2190789439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e681a04b0 con 0x7f9e68108140 2024-08-28T19:40:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e64ff9640 1 -- 172.21.15.33:0/2190789439 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00f620 con 0x7f9e68108140 2024-08-28T19:40:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.614+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/2190789439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e681a6c90 con 0x7f9e68108140 2024-08-28T19:40:18.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.617+0000 7f9e7431f740 1 Processor -- start 2024-08-28T19:40:18.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.617+0000 7f9e64ff9640 1 -- 172.21.15.33:0/2190789439 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9e5c01a070 con 0x7f9e68108140 2024-08-28T19:40:18.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.617+0000 7f9e7431f740 1 -- start start 2024-08-28T19:40:18.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.617+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f9874c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.617+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 0x557f9874c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.617+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f98386390 0x557f9874cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.617+0000 7f9e7431f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557f986c3630 con 0x557f983a7070 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.617+0000 7f9e7431f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557f986b2bc0 con 0x557f98386390 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.617+0000 7f9e7431f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557f986b6b70 con 0x557f9837e1b0 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.617+0000 7f9e67fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f9874c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e67fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f9874c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43360/0 (socket says 172.21.15.33:43360) 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e67fff640 1 -- 172.21.15.33:0/2009733463 learned_addr learned my addr 172.21.15.33:0/2009733463 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e677fe640 1 --2- 172.21.15.33:0/2009733463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 0x557f9874c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/2009733463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f98386390 0x557f9874cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e64ff9640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9e500b4d20 0x7f9e500b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e67fff640 1 -- 172.21.15.33:0/2009733463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 msgr2=0x557f9874c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e67fff640 1 --2- 172.21.15.33:0/2009733463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 0x557f9874c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e67fff640 1 -- 172.21.15.33:0/2009733463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f98386390 msgr2=0x557f9874cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:18.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e67fff640 1 --2- 172.21.15.33:0/2009733463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f98386390 0x557f9874cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e67fff640 1 -- 172.21.15.33:0/2009733463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f98412650 con 0x557f983a7070 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e64ff9640 1 -- 172.21.15.33:0/2190789439 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f9e5c0e5450 con 0x7f9e68108140 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e67fff640 1 --2- 172.21.15.33:0/2009733463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f9874c2c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f9e60007f30 tx=0x7f9e6000c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f5c7df1456b0dd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e67fff640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9e500b4d20 0x7f9e500b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e4dffb640 1 -- 172.21.15.33:0/2009733463 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60014070 con 0x557f983a7070 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e4dffb640 1 -- 172.21.15.33:0/2009733463 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e6000fc50 con 0x557f983a7070 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.618+0000 7f9e4dffb640 1 -- 172.21.15.33:0/2009733463 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000e7b0 con 0x557f983a7070 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.619+0000 7f9e7431f740 1 -- 172.21.15.33:0/2009733463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 msgr2=0x557f9874c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.619+0000 7f9e67fff640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9e500b4d20 0x7f9e500b7230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9e60016000 tx=0x7f9e6000eae0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.619+0000 7f9e7431f740 1 --2- 172.21.15.33:0/2009733463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f9874c2c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f9e60007f30 tx=0x7f9e6000c750 comp rx=0 tx=0).stop 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.619+0000 7f9e7431f740 1 -- 172.21.15.33:0/2009733463 shutdown_connections 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.619+0000 7f9e7431f740 1 --2- 172.21.15.33:0/2009733463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f98386390 0x557f9874cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.619+0000 7f9e7431f740 1 --2- 172.21.15.33:0/2009733463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 0x557f9874c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.619+0000 7f9e7431f740 1 --2- 172.21.15.33:0/2009733463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f9874c2c0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.619+0000 7f9e7431f740 1 -- 172.21.15.33:0/2009733463 >> 172.21.15.33:0/2009733463 conn(0x557f9839b460 msgr2=0x557f9874a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.620+0000 7f9e7431f740 1 -- 172.21.15.33:0/2009733463 shutdown_connections 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.620+0000 7f9e7431f740 1 -- 172.21.15.33:0/2009733463 wait complete. 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.620+0000 7f9e7431f740 1 -- start start 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.620+0000 7f9e7431f740 1 Processor -- start 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.620+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 0x557f987579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.620+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f98386390 0x557f98757f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f98763d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e7431f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557f98515700 con 0x557f983a7070 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e7431f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557f98639700 con 0x557f98386390 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e7431f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557f9875aaa0 con 0x557f9837e1b0 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e7431f740 10 client.0 _ll_register_callbacks cb 0x557f98668dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:18.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e677fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 0x557f987579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e677fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 0x557f987579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:52760/0 (socket says 172.21.15.33:52760) 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e677fe640 1 -- 172.21.15.33:0/336859428 learned_addr learned my addr 172.21.15.33:0/336859428 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e67fff640 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f98763d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f98386390 0x557f98757f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e677fe640 1 -- 172.21.15.33:0/336859428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f98386390 msgr2=0x557f98757f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e677fe640 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f98386390 0x557f98757f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e677fe640 1 -- 172.21.15.33:0/336859428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 msgr2=0x557f98763d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e677fe640 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f98763d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e677fe640 1 -- 172.21.15.33:0/336859428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f986728b0 con 0x557f9837e1b0 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e67fff640 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f98763d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e677fe640 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 0x557f987579c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009230 tx=0x7f9e580316d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7e1a2119d2a975d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.621+0000 7f9e46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e46ffd640 1 -- 172.21.15.33:0/336859428 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e58040070 con 0x557f9837e1b0 2024-08-28T19:40:18.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e7431f740 1 -- 172.21.15.33:0/336859428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e6000fc50 con 0x557f9837e1b0 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e46ffd640 1 -- 172.21.15.33:0/336859428 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f9e58004250 con 0x557f9837e1b0 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e46ffd640 1 -- 172.21.15.33:0/336859428 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9e5804d050 con 0x557f9837e1b0 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e7431f740 10 client.26830 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e7431f740 1 -- 172.21.15.33:0/336859428 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f98766860 con 0x557f9837e1b0 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e46ffd640 1 -- 172.21.15.33:0/336859428 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e6000fc50 con 0x557f9837e1b0 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e46ffd640 1 -- 172.21.15.33:0/336859428 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9e580049f0 con 0x557f9837e1b0 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e7431f740 10 client.26830 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e7431f740 10 client.26830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e7431f740 20 client.26830 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e7431f740 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f983659f0 0x557f98769ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e7431f740 4 client.26830 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.622+0000 7f9e7431f740 1 -- 172.21.15.33:0/336859428 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f986c5580 con 0x557f983659f0 2024-08-28T19:40:18.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.623+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f983659f0 0x557f98769ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.623+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f983659f0 0x557f98769ce0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=312641fec8d5466d server_cookie=5892791b0e513441 in_seq=0 out_seq=0 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.623+0000 7f9e46ffd640 10 client.26830 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e46ffd640 1 -- 172.21.15.33:0/336859428 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f986c5580 con 0x557f983659f0 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e46ffd640 10 client.26830 handle_command_reply: tid=0 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 client.26830 shutdown 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 -- 172.21.15.33:0/336859428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 msgr2=0x557f987579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 0x557f987579c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009230 tx=0x7f9e580316d0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 -- 172.21.15.33:0/336859428 shutdown_connections 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f983659f0 0x557f98769ce0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f983a7070 0x557f98763d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f98386390 0x557f98757f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 --2- 172.21.15.33:0/336859428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f9837e1b0 0x557f987579c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e46ffd640 0 client.26830 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:18.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 -- 172.21.15.33:0/336859428 >> 172.21.15.33:0/336859428 conn(0x557f9839b460 msgr2=0x557f9874f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:18.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 -- 172.21.15.33:0/336859428 shutdown_connections 2024-08-28T19:40:18.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 1 -- 172.21.15.33:0/336859428 wait complete. 2024-08-28T19:40:18.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.624+0000 7f9e7431f740 20 client.26830 trim_cache size 0 max 16384 2024-08-28T19:40:18.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e7431f740 1 Processor -- start 2024-08-28T19:40:18.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e7431f740 1 -- start start 2024-08-28T19:40:18.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9837e1b0 0x557f9874da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f98386390 0x557f98749780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f983a7070 0x557f98749cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e7431f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9e681b0dd0 con 0x557f9837e1b0 2024-08-28T19:40:18.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e7431f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9e681b2910 con 0x557f983a7070 2024-08-28T19:40:18.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e7431f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9e681b14a0 con 0x557f98386390 2024-08-28T19:40:18.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e677fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9837e1b0 0x557f9874da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e677fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9837e1b0 0x557f9874da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43376/0 (socket says 172.21.15.33:43376) 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e677fe640 1 -- 172.21.15.33:0/1874257757 learned_addr learned my addr 172.21.15.33:0/1874257757 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/1874257757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f98386390 0x557f98749780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e677fe640 1 -- 172.21.15.33:0/1874257757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f98386390 msgr2=0x557f98749780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e677fe640 1 --2- 172.21.15.33:0/1874257757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f98386390 0x557f98749780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e67fff640 1 --2- 172.21.15.33:0/1874257757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f983a7070 0x557f98749cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e677fe640 1 -- 172.21.15.33:0/1874257757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f983a7070 msgr2=0x557f98749cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e677fe640 1 --2- 172.21.15.33:0/1874257757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f983a7070 0x557f98749cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e677fe640 1 -- 172.21.15.33:0/1874257757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f98756920 con 0x557f9837e1b0 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.642+0000 7f9e67fff640 1 --2- 172.21.15.33:0/1874257757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f983a7070 0x557f98749cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:18.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.643+0000 7f9e677fe640 1 --2- 172.21.15.33:0/1874257757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9837e1b0 0x557f9874da00 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f9e58031440 tx=0x7f9e5802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b11241f1870ed06 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:18.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.643+0000 7f9e4d7fa640 1 -- 172.21.15.33:0/1874257757 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e58040070 con 0x557f9837e1b0 2024-08-28T19:40:18.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.643+0000 7f9e4d7fa640 1 -- 172.21.15.33:0/1874257757 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e58004b70 con 0x557f9837e1b0 2024-08-28T19:40:18.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.643+0000 7f9e4d7fa640 1 -- 172.21.15.33:0/1874257757 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e58035040 con 0x557f9837e1b0 2024-08-28T19:40:18.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 -- 172.21.15.33:0/1874257757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9837e1b0 msgr2=0x557f9874da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:18.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 --2- 172.21.15.33:0/1874257757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9837e1b0 0x557f9874da00 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f9e58031440 tx=0x7f9e5802a410 comp rx=0 tx=0).stop 2024-08-28T19:40:18.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 -- 172.21.15.33:0/1874257757 shutdown_connections 2024-08-28T19:40:18.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 --2- 172.21.15.33:0/1874257757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f983a7070 0x557f98749cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 --2- 172.21.15.33:0/1874257757 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f98386390 0x557f98749780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 --2- 172.21.15.33:0/1874257757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f9837e1b0 0x557f9874da00 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 -- 172.21.15.33:0/1874257757 >> 172.21.15.33:0/1874257757 conn(0x557f9839b460 msgr2=0x557f9874d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:18.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 -- 172.21.15.33:0/1874257757 shutdown_connections 2024-08-28T19:40:18.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 -- 172.21.15.33:0/1874257757 wait complete. 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 -- start start 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.644+0000 7f9e7431f740 1 Processor -- start 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9837e1b0 0x557f9875be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f98386390 0x557f9875c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e7431f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f983a7070 0x557f9875c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e7431f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9e681b2240 con 0x557f98386390 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e7431f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9e681b1b70 con 0x557f9837e1b0 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e7431f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9e681aedd0 con 0x557f983a7070 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e7431f740 10 client.0 _ll_register_callbacks cb 0x7f9e58005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e66ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f98386390 0x557f9875c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e66ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f98386390 0x557f9875c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43382/0 (socket says 172.21.15.33:43382) 2024-08-28T19:40:18.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e66ffd640 1 -- 172.21.15.33:0/92055647 learned_addr learned my addr 172.21.15.33:0/92055647 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e677fe640 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9837e1b0 0x557f9875be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e67fff640 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f983a7070 0x557f9875c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e66ffd640 1 -- 172.21.15.33:0/92055647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f983a7070 msgr2=0x557f9875c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f983a7070 0x557f9875c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e66ffd640 1 -- 172.21.15.33:0/92055647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9837e1b0 msgr2=0x557f9875be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9837e1b0 0x557f9875be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e66ffd640 1 -- 172.21.15.33:0/92055647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f987d38b0 con 0x557f98386390 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e67fff640 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f983a7070 0x557f9875c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e66ffd640 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f98386390 0x557f9875c380 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0a8a10 tx=0x7f9e5c0e7960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10da903cb6fcf9ed server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e46ffd640 1 -- 172.21.15.33:0/92055647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c021040 con 0x557f98386390 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e46ffd640 1 -- 172.21.15.33:0/92055647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f9e5c0e2a80 con 0x557f98386390 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.645+0000 7f9e7431f740 1 -- 172.21.15.33:0/92055647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e58004b70 con 0x557f98386390 2024-08-28T19:40:18.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e46ffd640 1 -- 172.21.15.33:0/92055647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9e5c0ab2b0 con 0x557f98386390 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e7431f740 10 client.17766 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e7431f740 1 -- 172.21.15.33:0/92055647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f987d4ab0 con 0x557f98386390 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e46ffd640 1 -- 172.21.15.33:0/92055647 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e58004b70 con 0x557f98386390 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e46ffd640 1 -- 172.21.15.33:0/92055647 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9e5c0a7a30 con 0x557f98386390 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e7431f740 10 client.17766 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e7431f740 10 client.17766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e7431f740 20 client.17766 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e7431f740 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9833ada0 0x557f987d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e7431f740 4 client.17766 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e7431f740 1 -- 172.21.15.33:0/92055647 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557f986c1020 con 0x557f9833ada0 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.646+0000 7f9e677fe640 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9833ada0 0x557f987d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:18.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e46ffd640 10 client.17766 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e677fe640 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9833ada0 0x557f987d71a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5846eaca4ea6df2f server_cookie=f4301967b2eb5cad in_seq=0 out_seq=0 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e46ffd640 1 -- 172.21.15.33:0/92055647 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x557f986c1020 con 0x557f9833ada0 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e46ffd640 10 client.17766 handle_command_reply: tid=0 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e7431f740 1 client.17766 shutdown 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e7431f740 1 -- 172.21.15.33:0/92055647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f98386390 msgr2=0x557f9875c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e7431f740 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f98386390 0x557f9875c380 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0a8a10 tx=0x7f9e5c0e7960 comp rx=0 tx=0).stop 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e7431f740 1 -- 172.21.15.33:0/92055647 shutdown_connections 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e7431f740 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557f983a7070 0x557f9875c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e7431f740 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557f9833ada0 0x557f987d71a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e7431f740 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f98386390 0x557f9875c380 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e7431f740 1 --2- 172.21.15.33:0/92055647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f9837e1b0 0x557f9875be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e7431f740 1 -- 172.21.15.33:0/92055647 >> 172.21.15.33:0/92055647 conn(0x557f9839b460 msgr2=0x557f98758e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:18.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.647+0000 7f9e46ffd640 0 client.17766 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:18.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e7431f740 1 -- 172.21.15.33:0/92055647 shutdown_connections 2024-08-28T19:40:18.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e7431f740 1 -- 172.21.15.33:0/92055647 wait complete. 2024-08-28T19:40:18.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e7431f740 20 client.17766 trim_cache size 0 max 16384 2024-08-28T19:40:18.655 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:40:18.655 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:40:18.655 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:40:18.655 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:40:18.655 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "d4f12ae3-5311-4fb9-b959-e7df483556b2", 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.656 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:40:18.658 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.660 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:40:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:40:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:40:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.663 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:18.664 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/2190789439 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9e500b4d20 msgr2=0x7f9e500b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9e500b4d20 0x7f9e500b7230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9e60016000 tx=0x7f9e6000eae0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/2190789439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e68108140 msgr2=0x7f9e6819a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e68108140 0x7f9e6819a7f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c00d770 tx=0x7f9e5c00dc30 comp rx=0 tx=0).stop 2024-08-28T19:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/2190789439 shutdown_connections 2024-08-28T19:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9e500b4d20 0x7f9e500b7230 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9e68108a90 0x7f9e6819fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e68108140 0x7f9e6819a7f0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 --2- 172.21.15.33:0/2190789439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e68102800 0x7f9e6819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/2190789439 >> 172.21.15.33:0/2190789439 conn(0x7f9e680794d0 msgr2=0x7f9e68101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:18.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.648+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/2190789439 shutdown_connections 2024-08-28T19:40:18.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:18.649+0000 7f9e6ddaa640 1 -- 172.21.15.33:0/2190789439 wait complete. 2024-08-28T19:40:19.486 INFO:tasks.cephfs.filesystem:scrub status for tag:d4f12ae3-5311-4fb9-b959-e7df483556b2 - {'path': '/', 'tag': 'd4f12ae3-5311-4fb9-b959-e7df483556b2', 'options': 'recursive,force'} 2024-08-28T19:40:19.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:19 smithi033 ceph-mon[18549]: pgmap v582: 129 pgs: 129 active+clean; 9.8 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-08-28T19:40:19.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:19 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:40:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:19 smithi059 ceph-mon[22052]: pgmap v582: 129 pgs: 129 active+clean; 9.8 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-08-28T19:40:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:19 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:40:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:19 smithi122 ceph-mon[22174]: pgmap v582: 129 pgs: 129 active+clean; 9.8 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-08-28T19:40:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:19 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:40:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:21 smithi059 ceph-mon[22052]: pgmap v583: 129 pgs: 129 active+clean; 9.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-08-28T19:40:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:21 smithi122 ceph-mon[22174]: pgmap v583: 129 pgs: 129 active+clean; 9.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-08-28T19:40:21.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:21 smithi033 ceph-mon[18549]: pgmap v583: 129 pgs: 129 active+clean; 9.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-08-28T19:40:23.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:23 smithi033 ceph-mon[18549]: pgmap v584: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 16 op/s 2024-08-28T19:40:23.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:23 smithi059 ceph-mon[22052]: pgmap v584: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 16 op/s 2024-08-28T19:40:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:23 smithi122 ceph-mon[22174]: pgmap v584: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 16 op/s 2024-08-28T19:40:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:25 smithi059 ceph-mon[22052]: pgmap v585: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-08-28T19:40:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:25 smithi122 ceph-mon[22174]: pgmap v585: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-08-28T19:40:25.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:25 smithi033 ceph-mon[18549]: pgmap v585: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-08-28T19:40:27.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:27 smithi059 ceph-mon[22052]: pgmap v586: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 14 op/s 2024-08-28T19:40:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:27 smithi122 ceph-mon[22174]: pgmap v586: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 14 op/s 2024-08-28T19:40:27.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:27 smithi033 ceph-mon[18549]: pgmap v586: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 14 op/s 2024-08-28T19:40:29.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:29 smithi059 ceph-mon[22052]: pgmap v587: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-08-28T19:40:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:29 smithi122 ceph-mon[22174]: pgmap v587: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-08-28T19:40:29.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:29 smithi033 ceph-mon[18549]: pgmap v587: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-08-28T19:40:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:31 smithi059 ceph-mon[22052]: pgmap v588: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-08-28T19:40:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:31 smithi122 ceph-mon[22174]: pgmap v588: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-08-28T19:40:31.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:31 smithi033 ceph-mon[18549]: pgmap v588: 129 pgs: 129 active+clean; 10 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-08-28T19:40:33.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:33 smithi059 ceph-mon[22052]: pgmap v589: 129 pgs: 129 active+clean; 10 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 56 KiB/s wr, 15 op/s 2024-08-28T19:40:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:33 smithi122 ceph-mon[22174]: pgmap v589: 129 pgs: 129 active+clean; 10 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 56 KiB/s wr, 15 op/s 2024-08-28T19:40:33.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:33 smithi033 ceph-mon[18549]: pgmap v589: 129 pgs: 129 active+clean; 10 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 56 KiB/s wr, 15 op/s 2024-08-28T19:40:34.815 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.5 2024-08-28T19:40:34.815 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:40:35.085 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:35.547 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:35 smithi033 ceph-mon[18549]: pgmap v590: 129 pgs: 129 active+clean; 10 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 35 KiB/s wr, 15 op/s 2024-08-28T19:40:35.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.639+0000 7fddcc7ec640 1 -- 172.21.15.33:0/2022699411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc4108140 msgr2=0x7fddc4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:35.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.639+0000 7fddcc7ec640 1 --2- 172.21.15.33:0/2022699411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc4108140 0x7fddc4108550 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009900 tx=0x7fddb402a410 comp rx=0 tx=0).stop 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.639+0000 7fddcc7ec640 1 -- 172.21.15.33:0/2022699411 shutdown_connections 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.639+0000 7fddcc7ec640 1 --2- 172.21.15.33:0/2022699411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4108a90 0x7fddc410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.639+0000 7fddcc7ec640 1 --2- 172.21.15.33:0/2022699411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc4108140 0x7fddc4108550 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.639+0000 7fddcc7ec640 1 --2- 172.21.15.33:0/2022699411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc4102800 0x7fddc4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.639+0000 7fddcc7ec640 1 -- 172.21.15.33:0/2022699411 >> 172.21.15.33:0/2022699411 conn(0x7fddc40794d0 msgr2=0x7fddc40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.639+0000 7fddcc7ec640 1 -- 172.21.15.33:0/2022699411 shutdown_connections 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.639+0000 7fddcc7ec640 1 -- 172.21.15.33:0/2022699411 wait complete. 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.639+0000 7fddcc7ec640 1 Processor -- start 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddcc7ec640 1 -- start start 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddcc7ec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc4102800 0x7fddc419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddcc7ec640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4108140 0x7fddc419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddcc7ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc4108a90 0x7fddc41a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddcc7ec640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4113820 con 0x7fddc4102800 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddcc7ec640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41136a0 con 0x7fddc4108140 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddcc7ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fddc41139a0 con 0x7fddc4108a90 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddca588640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc4102800 0x7fddc419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddca588640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc4102800 0x7fddc419c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35874/0 (socket says 172.21.15.33:35874) 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddca588640 1 -- 172.21.15.33:0/1757241003 learned_addr learned my addr 172.21.15.33:0/1757241003 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddc9d87640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4108140 0x7fddc419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddcad89640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc4108a90 0x7fddc41a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddca588640 1 -- 172.21.15.33:0/1757241003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc4108a90 msgr2=0x7fddc41a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddca588640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc4108a90 0x7fddc41a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddca588640 1 -- 172.21.15.33:0/1757241003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4108140 msgr2=0x7fddc419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddca588640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4108140 0x7fddc419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddca588640 1 -- 172.21.15.33:0/1757241003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc41a23e0 con 0x7fddc4102800 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.640+0000 7fddca588640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc4102800 0x7fddc419c530 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fddc000d950 tx=0x7fddc000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.641+0000 7fddbb7fe640 1 -- 172.21.15.33:0/1757241003 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc0017030 con 0x7fddc4102800 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.641+0000 7fddbb7fe640 1 -- 172.21.15.33:0/1757241003 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc0004020 con 0x7fddc4102800 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.641+0000 7fddbb7fe640 1 -- 172.21.15.33:0/1757241003 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc00047a0 con 0x7fddc4102800 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.641+0000 7fddcc7ec640 1 -- 172.21.15.33:0/1757241003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc41a26d0 con 0x7fddc4102800 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.641+0000 7fddcc7ec640 1 -- 172.21.15.33:0/1757241003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc41a2b90 con 0x7fddc4102800 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.642+0000 7fddcc7ec640 1 -- 172.21.15.33:0/1757241003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc4103a80 con 0x7fddc4102800 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.643+0000 7fddbb7fe640 1 -- 172.21.15.33:0/1757241003 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fddc0009a30 con 0x7fddc4102800 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.644+0000 7fddbb7fe640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fddb00b4d50 0x7fddb00b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.644+0000 7fddc9d87640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fddb00b4d50 0x7fddb00b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:35.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.645+0000 7fddbb7fe640 1 -- 172.21.15.33:0/1757241003 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7fddc00e58a0 con 0x7fddc4102800 2024-08-28T19:40:35.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.645+0000 7fddc9d87640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fddb00b4d50 0x7fddb00b7260 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fddb4000c00 tx=0x7fddb4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:35.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.648+0000 7fddbb7fe640 1 -- 172.21.15.33:0/1757241003 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fddc00ac310 con 0x7fddc4102800 2024-08-28T19:40:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:35 smithi059 ceph-mon[22052]: pgmap v590: 129 pgs: 129 active+clean; 10 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 35 KiB/s wr, 15 op/s 2024-08-28T19:40:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:35 smithi122 ceph-mon[22174]: pgmap v590: 129 pgs: 129 active+clean; 10 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 35 KiB/s wr, 15 op/s 2024-08-28T19:40:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.876+0000 7fddcc7ec640 1 -- 172.21.15.33:0/1757241003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddc4102c10 con 0x7fddc4102800 2024-08-28T19:40:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.877+0000 7fddbb7fe640 1 -- 172.21.15.33:0/1757241003 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fddc4102c10 con 0x7fddc4102800 2024-08-28T19:40:35.879 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:40:35.879 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:40:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 -- 172.21.15.33:0/1757241003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fddb00b4d50 msgr2=0x7fddb00b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fddb00b4d50 0x7fddb00b7260 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fddb4000c00 tx=0x7fddb4031400 comp rx=0 tx=0).stop 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 -- 172.21.15.33:0/1757241003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc4102800 msgr2=0x7fddc419c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc4102800 0x7fddc419c530 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fddc000d950 tx=0x7fddc000de10 comp rx=0 tx=0).stop 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 -- 172.21.15.33:0/1757241003 shutdown_connections 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fddb00b4d50 0x7fddb00b7260 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fddc4108a90 0x7fddc41a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4108140 0x7fddc419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 --2- 172.21.15.33:0/1757241003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc4102800 0x7fddc419c530 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 -- 172.21.15.33:0/1757241003 >> 172.21.15.33:0/1757241003 conn(0x7fddc40794d0 msgr2=0x7fddc4104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 -- 172.21.15.33:0/1757241003 shutdown_connections 2024-08-28T19:40:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:35.880+0000 7fddcc7ec640 1 -- 172.21.15.33:0/1757241003 wait complete. 2024-08-28T19:40:36.628 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:36 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1757241003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:36.665 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 139.5 --await-for 45.0' 2024-08-28T19:40:36.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 139.5 --await-for 45.0 2024-08-28T19:40:36.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:36 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1757241003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:36.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:36 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1757241003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:36.920 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:37.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.475+0000 7f7f9195a640 1 -- 172.21.15.33:0/3181349850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c102df0 msgr2=0x7f7f8c10fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:37.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.475+0000 7f7f9195a640 1 --2- 172.21.15.33:0/3181349850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c102df0 0x7f7f8c10fb10 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009900 tx=0x7f7f8002a510 comp rx=0 tx=0).stop 2024-08-28T19:40:37.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.475+0000 7f7f9195a640 1 -- 172.21.15.33:0/3181349850 shutdown_connections 2024-08-28T19:40:37.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.475+0000 7f7f9195a640 1 --2- 172.21.15.33:0/3181349850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c110050 0x7f7f8c112470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.475+0000 7f7f9195a640 1 --2- 172.21.15.33:0/3181349850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c102df0 0x7f7f8c10fb10 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.475+0000 7f7f9195a640 1 --2- 172.21.15.33:0/3181349850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8c1024a0 0x7f7f8c1028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.475+0000 7f7f9195a640 1 -- 172.21.15.33:0/3181349850 >> 172.21.15.33:0/3181349850 conn(0x7f7f8c079610 msgr2=0x7f7f8c079a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:37.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.475+0000 7f7f9195a640 1 -- 172.21.15.33:0/3181349850 shutdown_connections 2024-08-28T19:40:37.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.475+0000 7f7f9195a640 1 -- 172.21.15.33:0/3181349850 wait complete. 2024-08-28T19:40:37.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f9195a640 1 Processor -- start 2024-08-28T19:40:37.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f9195a640 1 -- start start 2024-08-28T19:40:37.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f9195a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c1024a0 0x7f7f8c19c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f9195a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c102df0 0x7f7f8c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f9195a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8c110050 0x7f7f8c1a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f9195a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c115aa0 con 0x7f7f8c102df0 2024-08-28T19:40:37.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f9195a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c115920 con 0x7f7f8c110050 2024-08-28T19:40:37.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f9195a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c115c20 con 0x7f7f8c1024a0 2024-08-28T19:40:37.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f8a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c102df0 0x7f7f8c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f8a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c102df0 0x7f7f8c19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35888/0 (socket says 172.21.15.33:35888) 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/2437680366 learned_addr learned my addr 172.21.15.33:0/2437680366 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.476+0000 7f7f8b7fe640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8c110050 0x7f7f8c1a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f8affd640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c1024a0 0x7f7f8c19c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/2437680366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c1024a0 msgr2=0x7f7f8c19c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c1024a0 0x7f7f8c19c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/2437680366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8c110050 msgr2=0x7f7f8c1a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8c110050 0x7f7f8c1a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/2437680366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c1a22c0 con 0x7f7f8c102df0 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c102df0 0x7f7f8c19c9b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7f80006010 tx=0x7f7f800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f90958640 1 -- 172.21.15.33:0/2437680366 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8003f030 con 0x7f7f8c102df0 2024-08-28T19:40:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f90958640 1 -- 172.21.15.33:0/2437680366 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f80003800 con 0x7f7f8c102df0 2024-08-28T19:40:37.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f9195a640 1 -- 172.21.15.33:0/2437680366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8c1a2550 con 0x7f7f8c102df0 2024-08-28T19:40:37.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f90958640 1 -- 172.21.15.33:0/2437680366 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80035070 con 0x7f7f8c102df0 2024-08-28T19:40:37.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.477+0000 7f7f9195a640 1 -- 172.21.15.33:0/2437680366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8c1a8dd0 con 0x7f7f8c102df0 2024-08-28T19:40:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.480+0000 7f7f97ecf740 1 Processor -- start 2024-08-28T19:40:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.480+0000 7f7f97ecf740 1 -- start start 2024-08-28T19:40:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.480+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eb21840 0x560d4eec8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.480+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eaf8980 0x560d4eec91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.480+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eec9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.480+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560d4ee3d330 con 0x560d4eb00b60 2024-08-28T19:40:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.480+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560d4ee2c8c0 con 0x560d4eb21840 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.480+0000 7f7f90958640 1 -- 172.21.15.33:0/2437680366 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7f80032310 con 0x7f7f8c102df0 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.480+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560d4ee30870 con 0x560d4eaf8980 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eec9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eec9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35890/0 (socket says 172.21.15.33:35890) 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/994229314 learned_addr learned my addr 172.21.15.33:0/994229314 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8affd640 1 --2- 172.21.15.33:0/994229314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eaf8980 0x560d4eec91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8b7fe640 1 --2- 172.21.15.33:0/994229314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eb21840 0x560d4eec8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/994229314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eaf8980 msgr2=0x560d4eec91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/994229314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eaf8980 0x560d4eec91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/994229314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eb21840 msgr2=0x560d4eec8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/994229314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eb21840 0x560d4eec8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/994229314 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d4ede4df0 con 0x560d4eb00b60 2024-08-28T19:40:37.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/994229314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eec9710 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f7f80103410 tx=0x7f7f8010e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc1ba59305cc122 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.481+0000 7f7f90958640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f740b4d50 0x7f7f740b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.482+0000 7f7f8b7fe640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f740b4d50 0x7f7f740b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.482+0000 7f7f71ffb640 1 -- 172.21.15.33:0/994229314 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f800c8a90 con 0x560d4eb00b60 2024-08-28T19:40:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.482+0000 7f7f71ffb640 1 -- 172.21.15.33:0/994229314 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f80113030 con 0x560d4eb00b60 2024-08-28T19:40:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.482+0000 7f7f71ffb640 1 -- 172.21.15.33:0/994229314 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f800cbbb0 con 0x560d4eb00b60 2024-08-28T19:40:37.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.482+0000 7f7f90958640 1 -- 172.21.15.33:0/2437680366 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f7f801060f0 con 0x7f7f8c102df0 2024-08-28T19:40:37.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 -- 172.21.15.33:0/994229314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 msgr2=0x560d4eec9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:37.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/994229314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eec9710 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f7f80103410 tx=0x7f7f8010e540 comp rx=0 tx=0).stop 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f8b7fe640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f740b4d50 0x7f7f740b7260 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400a400 tx=0x7f7f8400d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 -- 172.21.15.33:0/994229314 shutdown_connections 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/994229314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eec9710 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/994229314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eaf8980 0x560d4eec91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/994229314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eb21840 0x560d4eec8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 -- 172.21.15.33:0/994229314 >> 172.21.15.33:0/994229314 conn(0x560d4eb15990 msgr2=0x560d4eec6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 -- 172.21.15.33:0/994229314 shutdown_connections 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 -- 172.21.15.33:0/994229314 wait complete. 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 -- start start 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.483+0000 7f7f97ecf740 1 Processor -- start 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eaf8980 0x560d4eed4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eed4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eb21840 0x560d4eee0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560d4ec8f7a0 con 0x560d4eb00b60 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560d4edb3240 con 0x560d4eaf8980 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560d4eed7230 con 0x560d4eb21840 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eed4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f97ecf740 10 client.0 _ll_register_callbacks cb 0x560d4eb39090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eed4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35902/0 (socket says 172.21.15.33:35902) 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/827020742 learned_addr learned my addr 172.21.15.33:0/827020742 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8affd640 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eaf8980 0x560d4eed4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8b7fe640 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eb21840 0x560d4eee0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/827020742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eb21840 msgr2=0x560d4eee0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eb21840 0x560d4eee0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/827020742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eaf8980 msgr2=0x560d4eed4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eaf8980 0x560d4eed4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/827020742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d4ede92b0 con 0x560d4eb00b60 2024-08-28T19:40:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eed4890 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7f80103550 tx=0x7f7f80106450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4ff94f85b27142 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.484+0000 7f7f6affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f6affd640 1 -- 172.21.15.33:0/827020742 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80049070 con 0x560d4eb00b60 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f6affd640 1 -- 172.21.15.33:0/827020742 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f7f800039b0 con 0x560d4eb00b60 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f97ecf740 1 -- 172.21.15.33:0/827020742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f80113030 con 0x560d4eb00b60 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f6affd640 1 -- 172.21.15.33:0/827020742 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7f800cbd90 con 0x560d4eb00b60 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f97ecf740 10 client.17784 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f97ecf740 1 -- 172.21.15.33:0/827020742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d4eb9bb90 con 0x560d4eb00b60 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f6affd640 1 -- 172.21.15.33:0/827020742 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f80113030 con 0x560d4eb00b60 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f6affd640 1 -- 172.21.15.33:0/827020742 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7f800ef0e0 con 0x560d4eb00b60 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f97ecf740 10 client.17784 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f97ecf740 10 client.17784 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f97ecf740 20 client.17784 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560d4eae01c0 0x560d4eee6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f97ecf740 4 client.17784 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.485+0000 7f7f97ecf740 1 -- 172.21.15.33:0/827020742 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d4ee3f280 con 0x560d4eae01c0 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.486+0000 7f7f8affd640 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560d4eae01c0 0x560d4eee6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.486+0000 7f7f8affd640 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560d4eae01c0 0x560d4eee6040 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a3ccfb55416c2a server_cookie=3a41967866f93ce in_seq=0 out_seq=0 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.486+0000 7f7f6affd640 10 client.17784 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f6affd640 1 -- 172.21.15.33:0/827020742 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d4ee3f280 con 0x560d4eae01c0 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f6affd640 10 client.17784 handle_command_reply: tid=0 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 client.17784 shutdown 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 -- 172.21.15.33:0/827020742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 msgr2=0x560d4eed4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eed4890 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7f80103550 tx=0x7f7f80106450 comp rx=0 tx=0).stop 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 -- 172.21.15.33:0/827020742 shutdown_connections 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eb21840 0x560d4eee0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560d4eae01c0 0x560d4eee6040 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f6affd640 0 client.17784 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:37.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eb00b60 0x560d4eed4890 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/827020742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eaf8980 0x560d4eed4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 -- 172.21.15.33:0/827020742 >> 172.21.15.33:0/827020742 conn(0x560d4eb15990 msgr2=0x560d4eec5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:37.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 -- 172.21.15.33:0/827020742 shutdown_connections 2024-08-28T19:40:37.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 1 -- 172.21.15.33:0/827020742 wait complete. 2024-08-28T19:40:37.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.487+0000 7f7f97ecf740 20 client.17784 trim_cache size 0 max 16384 2024-08-28T19:40:37.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.504+0000 7f7f97ecf740 1 Processor -- start 2024-08-28T19:40:37.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f97ecf740 1 -- start start 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eae01c0 0x560d4eeca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eaf8980 0x560d4eed6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eb00b60 0x560d4eee0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1b2d80 con 0x560d4eae01c0 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1b48c0 con 0x560d4eb00b60 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1b3450 con 0x560d4eaf8980 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eae01c0 0x560d4eeca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eae01c0 0x560d4eeca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35916/0 (socket says 172.21.15.33:35916) 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8affd640 1 -- 172.21.15.33:0/854733414 learned_addr learned my addr 172.21.15.33:0/854733414 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/854733414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eaf8980 0x560d4eed6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8b7fe640 1 --2- 172.21.15.33:0/854733414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eb00b60 0x560d4eee0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8affd640 1 -- 172.21.15.33:0/854733414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eaf8980 msgr2=0x560d4eed6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8affd640 1 --2- 172.21.15.33:0/854733414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eaf8980 0x560d4eed6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8affd640 1 -- 172.21.15.33:0/854733414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eb00b60 msgr2=0x560d4eee0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8affd640 1 --2- 172.21.15.33:0/854733414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eb00b60 0x560d4eee0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8affd640 1 -- 172.21.15.33:0/854733414 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d4edfcd90 con 0x560d4eae01c0 2024-08-28T19:40:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.505+0000 7f7f8affd640 1 --2- 172.21.15.33:0/854733414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eae01c0 0x560d4eeca330 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x560d4eec7910 tx=0x7f7f7c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8708837663bdb829 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.506+0000 7f7f717fa640 1 -- 172.21.15.33:0/854733414 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c024610 con 0x560d4eae01c0 2024-08-28T19:40:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.506+0000 7f7f717fa640 1 -- 172.21.15.33:0/854733414 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f7c024c60 con 0x560d4eae01c0 2024-08-28T19:40:37.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.506+0000 7f7f717fa640 1 -- 172.21.15.33:0/854733414 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c01ee20 con 0x560d4eae01c0 2024-08-28T19:40:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.506+0000 7f7f97ecf740 1 -- 172.21.15.33:0/854733414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eae01c0 msgr2=0x560d4eeca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.506+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/854733414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eae01c0 0x560d4eeca330 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x560d4eec7910 tx=0x7f7f7c00a2d0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.506+0000 7f7f97ecf740 1 -- 172.21.15.33:0/854733414 shutdown_connections 2024-08-28T19:40:37.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.506+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/854733414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eb00b60 0x560d4eee0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.506+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/854733414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eaf8980 0x560d4eed6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.506+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/854733414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eae01c0 0x560d4eeca330 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.507+0000 7f7f97ecf740 1 -- 172.21.15.33:0/854733414 >> 172.21.15.33:0/854733414 conn(0x560d4eb15990 msgr2=0x560d4eed2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.507+0000 7f7f97ecf740 1 -- 172.21.15.33:0/854733414 shutdown_connections 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.507+0000 7f7f97ecf740 1 -- 172.21.15.33:0/854733414 wait complete. 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.507+0000 7f7f97ecf740 1 -- start start 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.507+0000 7f7f97ecf740 1 Processor -- start 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.507+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eae01c0 0x560d4eed8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.507+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eaf8980 0x560d4eed9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f97ecf740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eb00b60 0x560d4ef499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1b41f0 con 0x560d4eaf8980 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1b3b20 con 0x560d4eae01c0 2024-08-28T19:40:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f97ecf740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c1b0d80 con 0x560d4eb00b60 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f97ecf740 10 client.0 _ll_register_callbacks cb 0x7f7f84009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eaf8980 0x560d4eed9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eae01c0 0x560d4eed8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eaf8980 0x560d4eed9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35926/0 (socket says 172.21.15.33:35926) 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/1929093400 learned_addr learned my addr 172.21.15.33:0/1929093400 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8b7fe640 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eb00b60 0x560d4ef499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/1929093400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eb00b60 msgr2=0x560d4ef499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eb00b60 0x560d4ef499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/1929093400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eae01c0 msgr2=0x560d4eed8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eae01c0 0x560d4eed8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8a7fc640 1 -- 172.21.15.33:0/1929093400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d4ef4a040 con 0x560d4eaf8980 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f8a7fc640 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eaf8980 0x560d4eed9590 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7f800ccb40 tx=0x7f7f801063f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e282796840a954 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f6affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f6affd640 1 -- 172.21.15.33:0/1929093400 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80049070 con 0x560d4eaf8980 2024-08-28T19:40:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f6affd640 1 -- 172.21.15.33:0/1929093400 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f7f800d5040 con 0x560d4eaf8980 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.508+0000 7f7f97ecf740 1 -- 172.21.15.33:0/1929093400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f7c024c60 con 0x560d4eaf8980 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f6affd640 1 -- 172.21.15.33:0/1929093400 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7f800cbf80 con 0x560d4eaf8980 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f97ecf740 10 client.17790 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f97ecf740 1 -- 172.21.15.33:0/1929093400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d4ef4a040 con 0x560d4eaf8980 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f6affd640 1 -- 172.21.15.33:0/1929093400 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f7c024c60 con 0x560d4eaf8980 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f6affd640 1 -- 172.21.15.33:0/1929093400 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7f800ef0d0 con 0x560d4eaf8980 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f97ecf740 10 client.17790 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f97ecf740 10 client.17790 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f97ecf740 20 client.17790 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560d4eb21840 0x560d4ef53880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f97ecf740 4 client.17790 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.5, "await_for": 45.0}] 2024-08-28T19:40:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f97ecf740 1 -- 172.21.15.33:0/1929093400 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.5, "await_for": 45.0}) -- 0x560d4ee3ad20 con 0x560d4eb21840 2024-08-28T19:40:37.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.509+0000 7f7f8affd640 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560d4eb21840 0x560d4ef53880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:37.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.510+0000 7f7f6affd640 10 client.17790 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:37.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.510+0000 7f7f8affd640 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560d4eb21840 0x560d4ef53880 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb0645dcc59315ea server_cookie=4343b5ba97924301 in_seq=0 out_seq=0 2024-08-28T19:40:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.522+0000 7f7f6affd640 1 -- 172.21.15.33:0/1929093400 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560d4ee3ad20 con 0x560d4eb21840 2024-08-28T19:40:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f6affd640 10 client.17790 handle_command_reply: tid=0 2024-08-28T19:40:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 client.17790 shutdown 2024-08-28T19:40:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 -- 172.21.15.33:0/1929093400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eaf8980 msgr2=0x560d4eed9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eaf8980 0x560d4eed9590 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7f800ccb40 tx=0x7f7f801063f0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 -- 172.21.15.33:0/1929093400 shutdown_connections 2024-08-28T19:40:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d4eb00b60 0x560d4ef499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560d4eb21840 0x560d4ef53880 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d4eaf8980 0x560d4eed9590 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 --2- 172.21.15.33:0/1929093400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d4eae01c0 0x560d4eed8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 -- 172.21.15.33:0/1929093400 >> 172.21.15.33:0/1929093400 conn(0x560d4eb15990 msgr2=0x560d4eed5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f6affd640 0 client.17790 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 -- 172.21.15.33:0/1929093400 shutdown_connections 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 1 -- 172.21.15.33:0/1929093400 wait complete. 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.523+0000 7f7f97ecf740 20 client.17790 trim_cache size 0 max 16384 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:40:37.526 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 22, 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "bfc46141": { 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 22, 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 139.5, 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:40:37.527 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:40:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:40:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:40:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:40:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:40:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:37.528 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:37.528 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:40:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 -- 172.21.15.33:0/2437680366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f740b4d50 msgr2=0x7f7f740b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f740b4d50 0x7f7f740b7260 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400a400 tx=0x7f7f8400d040 comp rx=0 tx=0).stop 2024-08-28T19:40:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 -- 172.21.15.33:0/2437680366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c102df0 msgr2=0x7f7f8c19c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c102df0 0x7f7f8c19c9b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7f80006010 tx=0x7f7f800042f0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 -- 172.21.15.33:0/2437680366 shutdown_connections 2024-08-28T19:40:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8c110050 0x7f7f8c1a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f8c102df0 0x7f7f8c19c9b0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7f740b4d50 0x7f7f740b7260 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 --2- 172.21.15.33:0/2437680366 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f8c1024a0 0x7f7f8c19c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 -- 172.21.15.33:0/2437680366 >> 172.21.15.33:0/2437680366 conn(0x7f7f8c079610 msgr2=0x7f7f8c111390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 -- 172.21.15.33:0/2437680366 shutdown_connections 2024-08-28T19:40:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:37.524+0000 7f7f9195a640 1 -- 172.21.15.33:0/2437680366 wait complete. 2024-08-28T19:40:37.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:37 smithi033 ceph-mon[18549]: pgmap v591: 129 pgs: 129 active+clean; 10 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-08-28T19:40:37.694 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:37 smithi122 ceph-mon[22174]: pgmap v591: 129 pgs: 129 active+clean; 10 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-08-28T19:40:37.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:37 smithi059 ceph-mon[22052]: pgmap v591: 129 pgs: 129 active+clean; 10 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-08-28T19:40:38.344 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bfc46141', quiesce took 3.5 seconds. Will release after: 16.0 2024-08-28T19:40:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:39 smithi059 ceph-mon[22052]: pgmap v592: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-08-28T19:40:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:39 smithi122 ceph-mon[22174]: pgmap v592: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-08-28T19:40:39.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:39 smithi033 ceph-mon[18549]: pgmap v592: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-08-28T19:40:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:41 smithi059 ceph-mon[22052]: pgmap v593: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-08-28T19:40:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:41 smithi122 ceph-mon[22174]: pgmap v593: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-08-28T19:40:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:41 smithi033 ceph-mon[18549]: pgmap v593: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-08-28T19:40:43.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:43 smithi059 ceph-mon[22052]: pgmap v594: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 14 op/s 2024-08-28T19:40:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:43 smithi122 ceph-mon[22174]: pgmap v594: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 14 op/s 2024-08-28T19:40:43.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:43 smithi033 ceph-mon[18549]: pgmap v594: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 14 op/s 2024-08-28T19:40:45.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:45 smithi059 ceph-mon[22052]: pgmap v595: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-28T19:40:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:45 smithi122 ceph-mon[22174]: pgmap v595: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-28T19:40:45.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:45 smithi033 ceph-mon[18549]: pgmap v595: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-08-28T19:40:47.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:47 smithi059 ceph-mon[22052]: pgmap v596: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-08-28T19:40:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:47 smithi122 ceph-mon[22174]: pgmap v596: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-08-28T19:40:47.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:47 smithi033 ceph-mon[18549]: pgmap v596: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-08-28T19:40:49.487 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:40:49.755 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:49.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:49 smithi059 ceph-mon[22052]: pgmap v597: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-08-28T19:40:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:49 smithi122 ceph-mon[22174]: pgmap v597: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-08-28T19:40:49.876 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:49 smithi033 ceph-mon[18549]: pgmap v597: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-08-28T19:40:50.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.217+0000 7f1de0f44640 1 -- 172.21.15.33:0/3997131045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ddc1081c0 msgr2=0x7f1ddc1085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.217+0000 7f1de0f44640 1 --2- 172.21.15.33:0/3997131045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ddc1081c0 0x7f1ddc1085d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009900 tx=0x7f1dd002a410 comp rx=0 tx=0).stop 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.217+0000 7f1de0f44640 1 -- 172.21.15.33:0/3997131045 shutdown_connections 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.217+0000 7f1de0f44640 1 --2- 172.21.15.33:0/3997131045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc108b10 0x7f1ddc10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.217+0000 7f1de0f44640 1 --2- 172.21.15.33:0/3997131045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ddc1081c0 0x7f1ddc1085d0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.217+0000 7f1de0f44640 1 --2- 172.21.15.33:0/3997131045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc102880 0x7f1ddc102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.217+0000 7f1de0f44640 1 -- 172.21.15.33:0/3997131045 >> 172.21.15.33:0/3997131045 conn(0x7f1ddc079450 msgr2=0x7f1ddc079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.217+0000 7f1de0f44640 1 -- 172.21.15.33:0/3997131045 shutdown_connections 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.218+0000 7f1de0f44640 1 -- 172.21.15.33:0/3997131045 wait complete. 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.218+0000 7f1de0f44640 1 Processor -- start 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.218+0000 7f1de0f44640 1 -- start start 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1de0f44640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc102880 0x7f1ddc19b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1de0f44640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ddc1081c0 0x7f1ddc19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1de0f44640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc108b10 0x7f1ddc19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1de0f44640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc112810 con 0x7f1ddc1081c0 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1de0f44640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc112690 con 0x7f1ddc102880 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1de0f44640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc112990 con 0x7f1ddc108b10 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dd9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ddc1081c0 0x7f1ddc19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dd9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ddc1081c0 0x7f1ddc19b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42784/0 (socket says 172.21.15.33:42784) 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/1817155332 learned_addr learned my addr 172.21.15.33:0/1817155332 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dda59c640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc102880 0x7f1ddc19b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1ddad9d640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc108b10 0x7f1ddc19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/1817155332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc108b10 msgr2=0x7f1ddc19bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc108b10 0x7f1ddc19bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/1817155332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc102880 msgr2=0x7f1ddc19b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc102880 0x7f1ddc19b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/1817155332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc1a63f0 con 0x7f1ddc1081c0 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1ddad9d640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc108b10 0x7f1ddc19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ddc1081c0 0x7f1ddc19b6a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f1dd002a930 tx=0x7f1dd0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dcb7fe640 1 -- 172.21.15.33:0/1817155332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd003f030 con 0x7f1ddc1081c0 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dcb7fe640 1 -- 172.21.15.33:0/1817155332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dd0003aa0 con 0x7f1ddc1081c0 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1de0f44640 1 -- 172.21.15.33:0/1817155332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ddc1a6680 con 0x7f1ddc1081c0 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.219+0000 7f1dcb7fe640 1 -- 172.21.15.33:0/1817155332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0035070 con 0x7f1ddc1081c0 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.220+0000 7f1de0f44640 1 -- 172.21.15.33:0/1817155332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ddc1a6b60 con 0x7f1ddc1081c0 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.222+0000 7f1de74b9740 1 Processor -- start 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.222+0000 7f1dcb7fe640 1 -- 172.21.15.33:0/1817155332 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1dd0042030 con 0x7f1ddc1081c0 2024-08-28T19:40:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.222+0000 7f1de74b9740 1 -- start start 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc022c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f8341b0 0x55a30fc02800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc02d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1de74b9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a30fb79630 con 0x55a30f83c390 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1de74b9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a30fb68bc0 con 0x55a30f85d070 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1de74b9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a30fb6cb70 con 0x55a30f8341b0 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dd9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc02d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dd9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc02d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42790/0 (socket says 172.21.15.33:42790) 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/3649801752 learned_addr learned my addr 172.21.15.33:0/3649801752 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dda59c640 1 --2- 172.21.15.33:0/3649801752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f8341b0 0x55a30fc02800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1ddad9d640 1 --2- 172.21.15.33:0/3649801752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dcb7fe640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1dc40b4cd0 0x7f1dc40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/3649801752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f8341b0 msgr2=0x55a30fc02800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/3649801752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f8341b0 0x55a30fc02800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/3649801752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 msgr2=0x55a30fc022c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/3649801752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc022c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/3649801752 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a30f8c8650 con 0x55a30f83c390 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1ddad9d640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1dc40b4cd0 0x7f1dc40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.223+0000 7f1dcb7fe640 1 -- 172.21.15.33:0/1817155332 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f1dd01060a0 con 0x7f1ddc1081c0 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.224+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/3649801752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc02d40 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f1dd01033c0 tx=0x7f1dd0090cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccf94330cdaa460 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.224+0000 7f1dc8ff9640 1 -- 172.21.15.33:0/3649801752 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00cc1c0 con 0x55a30f83c390 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.224+0000 7f1dc8ff9640 1 -- 172.21.15.33:0/3649801752 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dd00ed910 con 0x55a30f83c390 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.224+0000 7f1dc8ff9640 1 -- 172.21.15.33:0/3649801752 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00cbb60 con 0x55a30f83c390 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 -- 172.21.15.33:0/3649801752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 msgr2=0x55a30fc02d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 --2- 172.21.15.33:0/3649801752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc02d40 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f1dd01033c0 tx=0x7f1dd0090cf0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1ddad9d640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1dc40b4cd0 0x7f1dc40b71e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400f4f0 tx=0x7f1dd4004b50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 -- 172.21.15.33:0/3649801752 shutdown_connections 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 --2- 172.21.15.33:0/3649801752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc02d40 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 --2- 172.21.15.33:0/3649801752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f8341b0 0x55a30fc02800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 --2- 172.21.15.33:0/3649801752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 -- 172.21.15.33:0/3649801752 >> 172.21.15.33:0/3649801752 conn(0x55a30f851460 msgr2=0x55a30fc001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 -- 172.21.15.33:0/3649801752 shutdown_connections 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 -- 172.21.15.33:0/3649801752 wait complete. 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 -- start start 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.225+0000 7f1de74b9740 1 Processor -- start 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f83c390 0x55a30fc0df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc19a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1de74b9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a30f9cb700 con 0x55a30f8341b0 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1de74b9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a30faef700 con 0x55a30f85d070 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1de74b9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a30fc10860 con 0x55a30f83c390 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1de74b9740 10 client.0 _ll_register_callbacks cb 0x55a30fb1edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dda59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dda59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42792/0 (socket says 172.21.15.33:42792) 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dda59c640 1 -- 172.21.15.33:0/2409322720 learned_addr learned my addr 172.21.15.33:0/2409322720 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f83c390 0x55a30fc0df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1ddad9d640 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc19a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dda59c640 1 -- 172.21.15.33:0/2409322720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f83c390 msgr2=0x55a30fc0df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dda59c640 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f83c390 0x55a30fc0df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dda59c640 1 -- 172.21.15.33:0/2409322720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 msgr2=0x55a30fc19a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dda59c640 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc19a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dda59c640 1 -- 172.21.15.33:0/2409322720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a30fb288b0 con 0x55a30f8341b0 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1ddad9d640 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc19a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dda59c640 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0da10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00bec0 tx=0x7f1dcc012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4352453d8f37c7ee server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.226+0000 7f1dc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/2409322720 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc005220 con 0x55a30f8341b0 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/2409322720 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f1dcc0053c0 con 0x55a30f8341b0 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1de74b9740 1 -- 172.21.15.33:0/2409322720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd00ed910 con 0x55a30f8341b0 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/2409322720 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1dcc0055c0 con 0x55a30f8341b0 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1de74b9740 10 client.17802 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1de74b9740 1 -- 172.21.15.33:0/2409322720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a30fc1c560 con 0x55a30f8341b0 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/2409322720 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dd00ed910 con 0x55a30f8341b0 2024-08-28T19:40:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/2409322720 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1dcc019070 con 0x55a30f8341b0 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1de74b9740 10 client.17802 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1de74b9740 10 client.17802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1de74b9740 20 client.17802 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1de74b9740 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a30f81b9f0 0x55a30fc1fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1de74b9740 4 client.17802 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.227+0000 7f1de74b9740 1 -- 172.21.15.33:0/2409322720 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a30fb7b580 con 0x55a30f81b9f0 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.228+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a30f81b9f0 0x55a30fc1fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.228+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a30f81b9f0 0x55a30fc1fae0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5da381fbbcf60fa server_cookie=8f1280b45337effa in_seq=0 out_seq=0 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.228+0000 7f1dc1ffb640 10 client.17802 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/2409322720 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a30fb7b580 con 0x55a30f81b9f0 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1dc1ffb640 10 client.17802 handle_command_reply: tid=0 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 client.17802 shutdown 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 -- 172.21.15.33:0/2409322720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 msgr2=0x55a30fc0da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0da10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00bec0 tx=0x7f1dcc012820 comp rx=0 tx=0).stop 2024-08-28T19:40:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 -- 172.21.15.33:0/2409322720 shutdown_connections 2024-08-28T19:40:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc19a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f83c390 0x55a30fc0df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a30f81b9f0 0x55a30fc1fae0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 --2- 172.21.15.33:0/2409322720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0da10 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 -- 172.21.15.33:0/2409322720 >> 172.21.15.33:0/2409322720 conn(0x55a30f851460 msgr2=0x55a30fc032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1dc1ffb640 0 client.17802 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 -- 172.21.15.33:0/2409322720 shutdown_connections 2024-08-28T19:40:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 1 -- 172.21.15.33:0/2409322720 wait complete. 2024-08-28T19:40:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.229+0000 7f1de74b9740 20 client.17802 trim_cache size 0 max 16384 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1de74b9740 1 Processor -- start 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1de74b9740 1 -- start start 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f83c390 0x55a30fc19980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc19ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1de74b9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc1b0ca0 con 0x55a30f8341b0 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1de74b9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc1b27e0 con 0x55a30f85d070 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1de74b9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc1b1370 con 0x55a30f83c390 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1dda59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1dda59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42796/0 (socket says 172.21.15.33:42796) 2024-08-28T19:40:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.247+0000 7f1dda59c640 1 -- 172.21.15.33:0/3974128650 learned_addr learned my addr 172.21.15.33:0/3974128650 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/3974128650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f83c390 0x55a30fc19980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1ddad9d640 1 --2- 172.21.15.33:0/3974128650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc19ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1dda59c640 1 -- 172.21.15.33:0/3974128650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f83c390 msgr2=0x55a30fc19980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1dda59c640 1 --2- 172.21.15.33:0/3974128650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f83c390 0x55a30fc19980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1dda59c640 1 -- 172.21.15.33:0/3974128650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 msgr2=0x55a30fc19ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1dda59c640 1 --2- 172.21.15.33:0/3974128650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc19ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1dda59c640 1 -- 172.21.15.33:0/3974128650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a30fc00aa0 con 0x55a30f8341b0 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1ddad9d640 1 --2- 172.21.15.33:0/3974128650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc19ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1dda59c640 1 --2- 172.21.15.33:0/3974128650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0ded0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00be90 tx=0x7f1dcc00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778c6adf694c19d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1dc3fff640 1 -- 172.21.15.33:0/3974128650 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc010960 con 0x55a30f8341b0 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1dc3fff640 1 -- 172.21.15.33:0/3974128650 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dcc02d070 con 0x55a30f8341b0 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.248+0000 7f1dc3fff640 1 -- 172.21.15.33:0/3974128650 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc01a650 con 0x55a30f8341b0 2024-08-28T19:40:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 -- 172.21.15.33:0/3974128650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 msgr2=0x55a30fc0ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 --2- 172.21.15.33:0/3974128650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0ded0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00be90 tx=0x7f1dcc00bab0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 -- 172.21.15.33:0/3974128650 shutdown_connections 2024-08-28T19:40:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 --2- 172.21.15.33:0/3974128650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f85d070 0x55a30fc19ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 --2- 172.21.15.33:0/3974128650 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f83c390 0x55a30fc19980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 --2- 172.21.15.33:0/3974128650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f8341b0 0x55a30fc0ded0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 -- 172.21.15.33:0/3974128650 >> 172.21.15.33:0/3974128650 conn(0x55a30f851460 msgr2=0x55a30fc0d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 -- 172.21.15.33:0/3974128650 shutdown_connections 2024-08-28T19:40:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 -- 172.21.15.33:0/3974128650 wait complete. 2024-08-28T19:40:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 -- start start 2024-08-28T19:40:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.249+0000 7f1de74b9740 1 Processor -- start 2024-08-28T19:40:50.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f8341b0 0x55a30fc11b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc12090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1de74b9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f85d070 0x55a30fc125d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1de74b9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc1b2110 con 0x55a30f83c390 2024-08-28T19:40:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1de74b9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc1b1a40 con 0x55a30f8341b0 2024-08-28T19:40:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1de74b9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc1aeca0 con 0x55a30f85d070 2024-08-28T19:40:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1de74b9740 10 client.0 _ll_register_callbacks cb 0x7f1dcc00b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dd9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc12090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dd9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc12090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42806/0 (socket says 172.21.15.33:42806) 2024-08-28T19:40:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/1537821399 learned_addr learned my addr 172.21.15.33:0/1537821399 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dda59c640 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f8341b0 0x55a30fc11b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1ddad9d640 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f85d070 0x55a30fc125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/1537821399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f85d070 msgr2=0x55a30fc125d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f85d070 0x55a30fc125d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/1537821399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f8341b0 msgr2=0x55a30fc11b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f8341b0 0x55a30fc11b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dd9d9b640 1 -- 172.21.15.33:0/1537821399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a30fc89650 con 0x55a30f83c390 2024-08-28T19:40:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dd9d9b640 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc12090 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00d51e0 tx=0x7f1dd0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3fd762d3af719 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/1537821399 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0049030 con 0x55a30f83c390 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/1537821399 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f1dd0003c50 con 0x55a30f83c390 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.250+0000 7f1de74b9740 1 -- 172.21.15.33:0/1537821399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dcc02d070 con 0x55a30f83c390 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/1537821399 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1dd00cbd40 con 0x55a30f83c390 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1de74b9740 10 client.17808 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1de74b9740 1 -- 172.21.15.33:0/1537821399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a30fc8a830 con 0x55a30f83c390 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/1537821399 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dcc02d070 con 0x55a30f83c390 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/1537821399 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1dd0109940 con 0x55a30f83c390 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1de74b9740 10 client.17808 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1de74b9740 10 client.17808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1de74b9740 20 client.17808 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1de74b9740 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a30f7f0da0 0x55a30fc8ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1de74b9740 4 client.17808 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1de74b9740 1 -- 172.21.15.33:0/1537821399 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a30fb77020 con 0x55a30f7f0da0 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.251+0000 7f1dda59c640 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a30f7f0da0 0x55a30fc8ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1dda59c640 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a30f7f0da0 0x55a30fc8ccf0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f45a3374ca74855 server_cookie=64cdea27025953eb in_seq=0 out_seq=0 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1dc1ffb640 10 client.17808 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1dc1ffb640 1 -- 172.21.15.33:0/1537821399 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x55a30fb77020 con 0x55a30f7f0da0 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1dc1ffb640 10 client.17808 handle_command_reply: tid=0 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 client.17808 shutdown 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 -- 172.21.15.33:0/1537821399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 msgr2=0x55a30fc12090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc12090 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00d51e0 tx=0x7f1dd0000bc0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 -- 172.21.15.33:0/1537821399 shutdown_connections 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a30f85d070 0x55a30fc125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a30f7f0da0 0x55a30fc8ccf0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1dc1ffb640 0 client.17808 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a30f83c390 0x55a30fc12090 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 --2- 172.21.15.33:0/1537821399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a30f8341b0 0x55a30fc11b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 -- 172.21.15.33:0/1537821399 >> 172.21.15.33:0/1537821399 conn(0x55a30f851460 msgr2=0x55a30fbffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 -- 172.21.15.33:0/1537821399 shutdown_connections 2024-08-28T19:40:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.252+0000 7f1de74b9740 1 -- 172.21.15.33:0/1537821399 wait complete. 2024-08-28T19:40:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de74b9740 20 client.17808 trim_cache size 0 max 16384 2024-08-28T19:40:50.261 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:40:50.261 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:40:50.261 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.262 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:40:50.263 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.264 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:40:50.266 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.268 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:50.269 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:40:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 -- 172.21.15.33:0/1817155332 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1dc40b4cd0 msgr2=0x7f1dc40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1dc40b4cd0 0x7f1dc40b71e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400f4f0 tx=0x7f1dd4004b50 comp rx=0 tx=0).stop 2024-08-28T19:40:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 -- 172.21.15.33:0/1817155332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ddc1081c0 msgr2=0x7f1ddc19b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ddc1081c0 0x7f1ddc19b6a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f1dd002a930 tx=0x7f1dd0004270 comp rx=0 tx=0).stop 2024-08-28T19:40:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 -- 172.21.15.33:0/1817155332 shutdown_connections 2024-08-28T19:40:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1dc40b4cd0 0x7f1dc40b71e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1ddc108b10 0x7f1ddc19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ddc1081c0 0x7f1ddc19b6a0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 --2- 172.21.15.33:0/1817155332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc102880 0x7f1ddc19b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 -- 172.21.15.33:0/1817155332 >> 172.21.15.33:0/1817155332 conn(0x7f1ddc079450 msgr2=0x7f1ddc104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 -- 172.21.15.33:0/1817155332 shutdown_connections 2024-08-28T19:40:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:50.253+0000 7f1de0f44640 1 -- 172.21.15.33:0/1817155332 wait complete. 2024-08-28T19:40:51.212 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:40:51.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:40:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:51.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:51 smithi033 ceph-mon[18549]: pgmap v598: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-08-28T19:40:51.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:51 smithi059 ceph-mon[22052]: pgmap v598: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-08-28T19:40:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:51 smithi122 ceph-mon[22174]: pgmap v598: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-08-28T19:40:51.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.967+0000 7fa41b010640 1 -- 172.21.15.33:0/3442217974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa414108160 msgr2=0x7fa414108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.967+0000 7fa41b010640 1 --2- 172.21.15.33:0/3442217974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa414108160 0x7fa414108570 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fa408009900 tx=0x7fa40802a410 comp rx=0 tx=0).stop 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.967+0000 7fa41b010640 1 -- 172.21.15.33:0/3442217974 shutdown_connections 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.967+0000 7fa41b010640 1 --2- 172.21.15.33:0/3442217974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa414108ab0 0x7fa41410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.967+0000 7fa41b010640 1 --2- 172.21.15.33:0/3442217974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa414108160 0x7fa414108570 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.967+0000 7fa41b010640 1 --2- 172.21.15.33:0/3442217974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa414102820 0x7fa414102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.967+0000 7fa41b010640 1 -- 172.21.15.33:0/3442217974 >> 172.21.15.33:0/3442217974 conn(0x7fa4140794e0 msgr2=0x7fa4140798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.967+0000 7fa41b010640 1 -- 172.21.15.33:0/3442217974 shutdown_connections 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.967+0000 7fa41b010640 1 -- 172.21.15.33:0/3442217974 wait complete. 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.968+0000 7fa41b010640 1 Processor -- start 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.968+0000 7fa41b010640 1 -- start start 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.968+0000 7fa41b010640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa414102820 0x7fa41419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.968+0000 7fa41b010640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa414108160 0x7fa41419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.968+0000 7fa41b010640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa414108ab0 0x7fa41419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.968+0000 7fa41b010640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa414113860 con 0x7fa414102820 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.968+0000 7fa41b010640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141136e0 con 0x7fa414108160 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.968+0000 7fa41b010640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141139e0 con 0x7fa414108ab0 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa418dac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa414102820 0x7fa41419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa418dac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa414102820 0x7fa41419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42828/0 (socket says 172.21.15.33:42828) 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa418dac640 1 -- 172.21.15.33:0/3814301574 learned_addr learned my addr 172.21.15.33:0/3814301574 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa413fff640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa414108160 0x7fa41419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa4195ad640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa414108ab0 0x7fa41419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa418dac640 1 -- 172.21.15.33:0/3814301574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa414108ab0 msgr2=0x7fa41419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa418dac640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa414108ab0 0x7fa41419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa418dac640 1 -- 172.21.15.33:0/3814301574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa414108160 msgr2=0x7fa41419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa418dac640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa414108160 0x7fa41419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa418dac640 1 -- 172.21.15.33:0/3814301574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4141a0380 con 0x7fa414102820 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa418dac640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa414102820 0x7fa41419a410 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c890 tx=0x7fa40400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa411ffb640 1 -- 172.21.15.33:0/3814301574 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404004220 con 0x7fa414102820 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa411ffb640 1 -- 172.21.15.33:0/3814301574 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4040043c0 con 0x7fa414102820 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa411ffb640 1 -- 172.21.15.33:0/3814301574 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404004a00 con 0x7fa414102820 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.969+0000 7fa41b010640 1 -- 172.21.15.33:0/3814301574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4141a0670 con 0x7fa414102820 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.970+0000 7fa41b010640 1 -- 172.21.15.33:0/3814301574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4141a6dd0 con 0x7fa414102820 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.971+0000 7fa41b010640 1 -- 172.21.15.33:0/3814301574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa414103aa0 con 0x7fa414102820 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.972+0000 7fa411ffb640 1 -- 172.21.15.33:0/3814301574 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa4040079b0 con 0x7fa414102820 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.973+0000 7fa411ffb640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3fc0b4ca0 0x7fa3fc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.973+0000 7fa413fff640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3fc0b4ca0 0x7fa3fc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.973+0000 7fa411ffb640 1 -- 172.21.15.33:0/3814301574 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7fa4040e5670 con 0x7fa414102820 2024-08-28T19:40:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.974+0000 7fa413fff640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3fc0b4ca0 0x7fa3fc0b71b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa408000c00 tx=0x7fa408031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:51.978+0000 7fa411ffb640 1 -- 172.21.15.33:0/3814301574 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa404014030 con 0x7fa414102820 2024-08-28T19:40:52.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.205+0000 7fa41b010640 1 -- 172.21.15.33:0/3814301574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa41410a8a0 con 0x7fa414102820 2024-08-28T19:40:52.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.206+0000 7fa411ffb640 1 -- 172.21.15.33:0/3814301574 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fa4040ac0c0 con 0x7fa414102820 2024-08-28T19:40:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:40:52.208 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:40:52.209 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:40:52.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.208+0000 7fa41b010640 1 -- 172.21.15.33:0/3814301574 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3fc0b4ca0 msgr2=0x7fa3fc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:52.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.208+0000 7fa41b010640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3fc0b4ca0 0x7fa3fc0b71b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa408000c00 tx=0x7fa408031400 comp rx=0 tx=0).stop 2024-08-28T19:40:52.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.208+0000 7fa41b010640 1 -- 172.21.15.33:0/3814301574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa414102820 msgr2=0x7fa41419a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:52.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.208+0000 7fa41b010640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa414102820 0x7fa41419a410 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c890 tx=0x7fa40400cd50 comp rx=0 tx=0).stop 2024-08-28T19:40:52.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.208+0000 7fa41b010640 1 -- 172.21.15.33:0/3814301574 shutdown_connections 2024-08-28T19:40:52.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.208+0000 7fa41b010640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa3fc0b4ca0 0x7fa3fc0b71b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:52.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.208+0000 7fa41b010640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa414108ab0 0x7fa41419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:52.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.208+0000 7fa41b010640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa414108160 0x7fa41419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:52.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.208+0000 7fa41b010640 1 --2- 172.21.15.33:0/3814301574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa414102820 0x7fa41419a410 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:52.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.209+0000 7fa41b010640 1 -- 172.21.15.33:0/3814301574 >> 172.21.15.33:0/3814301574 conn(0x7fa4140794e0 msgr2=0x7fa414105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:52.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.209+0000 7fa41b010640 1 -- 172.21.15.33:0/3814301574 shutdown_connections 2024-08-28T19:40:52.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:52.209+0000 7fa41b010640 1 -- 172.21.15.33:0/3814301574 wait complete. 2024-08-28T19:40:52.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:52 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3814301574' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:52.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:52 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3814301574' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:52.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:52 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3814301574' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:53.000 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:40:53.256 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:53.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:53 smithi033 ceph-mon[18549]: pgmap v599: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-08-28T19:40:53.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:53 smithi059 ceph-mon[22052]: pgmap v599: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-08-28T19:40:53.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.782+0000 7f29ce9c1640 1 -- 172.21.15.33:0/4145194854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c810dbb0 msgr2=0x7f29c81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:53.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.782+0000 7f29ce9c1640 1 --2- 172.21.15.33:0/4145194854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c810dbb0 0x7f29c81100a0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009ca0 tx=0x7f29c002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.782+0000 7f29ce9c1640 1 -- 172.21.15.33:0/4145194854 shutdown_connections 2024-08-28T19:40:53.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.782+0000 7f29ce9c1640 1 --2- 172.21.15.33:0/4145194854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c810dbb0 0x7f29c81100a0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.782+0000 7f29ce9c1640 1 --2- 172.21.15.33:0/4145194854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c81050a0 0x7f29c810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.782+0000 7f29ce9c1640 1 --2- 172.21.15.33:0/4145194854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c8104750 0x7f29c8104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.782+0000 7f29ce9c1640 1 -- 172.21.15.33:0/4145194854 >> 172.21.15.33:0/4145194854 conn(0x7f29c80794d0 msgr2=0x7f29c80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.782+0000 7f29ce9c1640 1 -- 172.21.15.33:0/4145194854 shutdown_connections 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.782+0000 7f29ce9c1640 1 -- 172.21.15.33:0/4145194854 wait complete. 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29ce9c1640 1 Processor -- start 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29ce9c1640 1 -- start start 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29ce9c1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c8104750 0x7f29c819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29ce9c1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c81050a0 0x7f29c819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29ce9c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c810dbb0 0x7f29c819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29ce9c1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29c8113810 con 0x7f29c8104750 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29ce9c1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29c8113690 con 0x7f29c810dbb0 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29ce9c1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f29c8113990 con 0x7f29c81050a0 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c8104750 0x7f29c819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c8104750 0x7f29c819a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42852/0 (socket says 172.21.15.33:42852) 2024-08-28T19:40:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.783+0000 7f29c7fff640 1 -- 172.21.15.33:0/1994210153 learned_addr learned my addr 172.21.15.33:0/1994210153 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29bffff640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c81050a0 0x7f29c819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29c7fff640 1 -- 172.21.15.33:0/1994210153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c81050a0 msgr2=0x7f29c819a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29c7fff640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c81050a0 0x7f29c819a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29c7fff640 1 -- 172.21.15.33:0/1994210153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c810dbb0 msgr2=0x7f29c819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29c7fff640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c810dbb0 0x7f29c819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29c7fff640 1 -- 172.21.15.33:0/1994210153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c81a01f0 con 0x7f29c8104750 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29c7fff640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c8104750 0x7f29c819a280 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f29b800d950 tx=0x7f29b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29c5ffb640 1 -- 172.21.15.33:0/1994210153 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8017020 con 0x7f29c8104750 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29c5ffb640 1 -- 172.21.15.33:0/1994210153 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b8009c30 con 0x7f29c8104750 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29ce9c1640 1 -- 172.21.15.33:0/1994210153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c81a04e0 con 0x7f29c8104750 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29c5ffb640 1 -- 172.21.15.33:0/1994210153 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b800f6b0 con 0x7f29c8104750 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.784+0000 7f29ce9c1640 1 -- 172.21.15.33:0/1994210153 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c81a6c40 con 0x7f29c8104750 2024-08-28T19:40:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29c5ffb640 1 -- 172.21.15.33:0/1994210153 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f29b801a020 con 0x7f29c8104750 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29d4f36740 1 Processor -- start 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29d4f36740 1 -- start start 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 0x561540459720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400871b0 0x561540459c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x56154045a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29d4f36740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5615403cc680 con 0x56154008f390 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29d4f36740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5615403bbc10 con 0x5615400871b0 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29d4f36740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5615403bfbc0 con 0x5615400b0070 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x56154045a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x56154045a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42868/0 (socket says 172.21.15.33:42868) 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.787+0000 7f29bffff640 1 -- 172.21.15.33:0/199492124 learned_addr learned my addr 172.21.15.33:0/199492124 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29c5ffb640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29b40b4d20 0x7f29b40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29c7fff640 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400871b0 0x561540459c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29ccf5e640 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 0x561540459720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29bffff640 1 -- 172.21.15.33:0/199492124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 msgr2=0x561540459720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29bffff640 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 0x561540459720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29bffff640 1 -- 172.21.15.33:0/199492124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400871b0 msgr2=0x561540459c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29bffff640 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400871b0 0x561540459c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29bffff640 1 -- 172.21.15.33:0/199492124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56154011b650 con 0x56154008f390 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29ccf5e640 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 0x561540459720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29c7fff640 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400871b0 0x561540459c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29ccf5e640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29b40b4d20 0x7f29b40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29c5ffb640 1 -- 172.21.15.33:0/1994210153 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f29b80e54b0 con 0x7f29c8104750 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29bffff640 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x56154045a1a0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f29b000caa0 tx=0x7f29b000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b65a126ccd9a328 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29be7fc640 1 -- 172.21.15.33:0/199492124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0010430 con 0x56154008f390 2024-08-28T19:40:53.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29be7fc640 1 -- 172.21.15.33:0/199492124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b0010a80 con 0x56154008f390 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.788+0000 7f29be7fc640 1 -- 172.21.15.33:0/199492124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b001aa50 con 0x56154008f390 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.789+0000 7f29d4f36740 1 -- 172.21.15.33:0/199492124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 msgr2=0x56154045a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.789+0000 7f29d4f36740 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x56154045a1a0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f29b000caa0 tx=0x7f29b000cf60 comp rx=0 tx=0).stop 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.789+0000 7f29ccf5e640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29b40b4d20 0x7f29b40b7230 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009ca0 tx=0x7f29c00095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.789+0000 7f29d4f36740 1 -- 172.21.15.33:0/199492124 shutdown_connections 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.789+0000 7f29d4f36740 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x56154045a1a0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.789+0000 7f29d4f36740 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400871b0 0x561540459c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.789+0000 7f29d4f36740 1 --2- 172.21.15.33:0/199492124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 0x561540459720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.789+0000 7f29d4f36740 1 -- 172.21.15.33:0/199492124 >> 172.21.15.33:0/199492124 conn(0x5615400a4460 msgr2=0x561540457610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.789+0000 7f29d4f36740 1 -- 172.21.15.33:0/199492124 shutdown_connections 2024-08-28T19:40:53.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.789+0000 7f29d4f36740 1 -- 172.21.15.33:0/199492124 wait complete. 2024-08-28T19:40:53.796 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:53 smithi122 ceph-mon[22174]: pgmap v599: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-08-28T19:40:53.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29d4f36740 1 -- start start 2024-08-28T19:40:53.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29d4f36740 1 Processor -- start 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x561540464e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56154008f390 0x5615404653c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 0x5615404711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29d4f36740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56154021e700 con 0x5615400871b0 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29d4f36740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561540342750 con 0x56154008f390 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29d4f36740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561540467f00 con 0x5615400b0070 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29d4f36740 10 client.0 _ll_register_callbacks cb 0x561540371e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x561540464e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x561540464e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42874/0 (socket says 172.21.15.33:42874) 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29c7fff640 1 -- 172.21.15.33:0/255938992 learned_addr learned my addr 172.21.15.33:0/255938992 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.790+0000 7f29ccf5e640 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 0x5615404711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29bffff640 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56154008f390 0x5615404653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29c7fff640 1 -- 172.21.15.33:0/255938992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 msgr2=0x5615404711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29c7fff640 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 0x5615404711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29c7fff640 1 -- 172.21.15.33:0/255938992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56154008f390 msgr2=0x5615404653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29c7fff640 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56154008f390 0x5615404653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29c7fff640 1 -- 172.21.15.33:0/255938992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56154037b900 con 0x5615400871b0 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29bffff640 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56154008f390 0x5615404653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29c7fff640 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x561540464e80 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f29b80a8b10 tx=0x7f29b80ab730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812ce78c5179e283 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29a77fe640 1 -- 172.21.15.33:0/255938992 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b80b0110 con 0x5615400871b0 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29a77fe640 1 -- 172.21.15.33:0/255938992 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f29b80acbd0 con 0x5615400871b0 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29d4f36740 1 -- 172.21.15.33:0/255938992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29b0010a80 con 0x5615400871b0 2024-08-28T19:40:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29a77fe640 1 -- 172.21.15.33:0/255938992 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29b80ab3b0 con 0x5615400871b0 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29d4f36740 10 client.17826 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29d4f36740 1 -- 172.21.15.33:0/255938992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561540473c20 con 0x5615400871b0 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.791+0000 7f29a77fe640 1 -- 172.21.15.33:0/255938992 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b0010a80 con 0x5615400871b0 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.792+0000 7f29a77fe640 1 -- 172.21.15.33:0/255938992 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f29b8024060 con 0x5615400871b0 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.792+0000 7f29d4f36740 10 client.17826 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.792+0000 7f29d4f36740 10 client.17826 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.792+0000 7f29d4f36740 20 client.17826 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.792+0000 7f29d4f36740 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x56154006e9f0 0x5615404770f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.792+0000 7f29d4f36740 4 client.17826 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.792+0000 7f29d4f36740 1 -- 172.21.15.33:0/255938992 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615403ce5d0 con 0x56154006e9f0 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.792+0000 7f29bffff640 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x56154006e9f0 0x5615404770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.792+0000 7f29a77fe640 10 client.17826 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.792+0000 7f29bffff640 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x56154006e9f0 0x5615404770f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cfc814fcf296edc1 server_cookie=3171509c470218c1 in_seq=0 out_seq=0 2024-08-28T19:40:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29a77fe640 1 -- 172.21.15.33:0/255938992 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615403ce5d0 con 0x56154006e9f0 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29a77fe640 10 client.17826 handle_command_reply: tid=0 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29d4f36740 1 client.17826 shutdown 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29d4f36740 1 -- 172.21.15.33:0/255938992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 msgr2=0x561540464e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29d4f36740 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x561540464e80 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f29b80a8b10 tx=0x7f29b80ab730 comp rx=0 tx=0).stop 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29d4f36740 1 -- 172.21.15.33:0/255938992 shutdown_connections 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29d4f36740 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x56154006e9f0 0x5615404770f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29d4f36740 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400b0070 0x5615404711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29d4f36740 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56154008f390 0x5615404653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29a77fe640 0 client.17826 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29d4f36740 1 --2- 172.21.15.33:0/255938992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x561540464e80 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.793+0000 7f29d4f36740 1 -- 172.21.15.33:0/255938992 >> 172.21.15.33:0/255938992 conn(0x5615400a4460 msgr2=0x56154045c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.794+0000 7f29d4f36740 1 -- 172.21.15.33:0/255938992 shutdown_connections 2024-08-28T19:40:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.794+0000 7f29d4f36740 1 -- 172.21.15.33:0/255938992 wait complete. 2024-08-28T19:40:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.794+0000 7f29d4f36740 20 client.17826 trim_cache size 0 max 16384 2024-08-28T19:40:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29d4f36740 1 Processor -- start 2024-08-28T19:40:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29d4f36740 1 -- start start 2024-08-28T19:40:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400871b0 0x5615404710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x561540462070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 0x5615404625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29d4f36740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29c81aea80 con 0x56154008f390 2024-08-28T19:40:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29d4f36740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29c81b05c0 con 0x5615400b0070 2024-08-28T19:40:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29d4f36740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f29c81af150 con 0x5615400871b0 2024-08-28T19:40:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x561540462070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29bffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x561540462070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42886/0 (socket says 172.21.15.33:42886) 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.807+0000 7f29bffff640 1 -- 172.21.15.33:0/1528974294 learned_addr learned my addr 172.21.15.33:0/1528974294 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29ccf5e640 1 --2- 172.21.15.33:0/1528974294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 0x5615404625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29bffff640 1 -- 172.21.15.33:0/1528974294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400871b0 msgr2=0x5615404710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29c7fff640 1 --2- 172.21.15.33:0/1528974294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400871b0 0x5615404710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29bffff640 1 --2- 172.21.15.33:0/1528974294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400871b0 0x5615404710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29bffff640 1 -- 172.21.15.33:0/1528974294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 msgr2=0x5615404625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29bffff640 1 --2- 172.21.15.33:0/1528974294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 0x5615404625b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29bffff640 1 -- 172.21.15.33:0/1528974294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561540477460 con 0x56154008f390 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29ccf5e640 1 --2- 172.21.15.33:0/1528974294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 0x5615404625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29bffff640 1 --2- 172.21.15.33:0/1528974294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x561540462070 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f29b000c350 tx=0x7f29b000c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351a2446ba1f8b4b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29bdffb640 1 -- 172.21.15.33:0/1528974294 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0005450 con 0x56154008f390 2024-08-28T19:40:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29bdffb640 1 -- 172.21.15.33:0/1528974294 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b00055f0 con 0x56154008f390 2024-08-28T19:40:53.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.808+0000 7f29bdffb640 1 -- 172.21.15.33:0/1528974294 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b001a760 con 0x56154008f390 2024-08-28T19:40:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.809+0000 7f29d4f36740 1 -- 172.21.15.33:0/1528974294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 msgr2=0x561540462070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.809+0000 7f29d4f36740 1 --2- 172.21.15.33:0/1528974294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x561540462070 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f29b000c350 tx=0x7f29b000c400 comp rx=0 tx=0).stop 2024-08-28T19:40:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.809+0000 7f29d4f36740 1 -- 172.21.15.33:0/1528974294 shutdown_connections 2024-08-28T19:40:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.809+0000 7f29d4f36740 1 --2- 172.21.15.33:0/1528974294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 0x5615404625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.809+0000 7f29d4f36740 1 --2- 172.21.15.33:0/1528974294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56154008f390 0x561540462070 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.809+0000 7f29d4f36740 1 --2- 172.21.15.33:0/1528974294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5615400871b0 0x5615404710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.809+0000 7f29d4f36740 1 -- 172.21.15.33:0/1528974294 >> 172.21.15.33:0/1528974294 conn(0x5615400a4460 msgr2=0x561540463700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.809+0000 7f29d4f36740 1 -- 172.21.15.33:0/1528974294 shutdown_connections 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.809+0000 7f29d4f36740 1 -- 172.21.15.33:0/1528974294 wait complete. 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.809+0000 7f29d4f36740 1 -- start start 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29d4f36740 1 Processor -- start 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x5615404694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56154008f390 0x561540469a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29d4f36740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 0x5615404e0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29d4f36740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29c81afef0 con 0x5615400871b0 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29d4f36740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29c81af820 con 0x5615400b0070 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29d4f36740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f29c81aca80 con 0x56154008f390 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29d4f36740 10 client.0 _ll_register_callbacks cb 0x7f29b80e2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:53.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x5615404694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x5615404694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42890/0 (socket says 172.21.15.33:42890) 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29bffff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56154008f390 0x561540469a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29c7fff640 1 -- 172.21.15.33:0/1003559810 learned_addr learned my addr 172.21.15.33:0/1003559810 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.810+0000 7f29ccf5e640 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 0x5615404e0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29c7fff640 1 -- 172.21.15.33:0/1003559810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56154008f390 msgr2=0x561540469a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29c7fff640 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56154008f390 0x561540469a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29c7fff640 1 -- 172.21.15.33:0/1003559810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 msgr2=0x5615404e0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29c7fff640 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 0x5615404e0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29c7fff640 1 -- 172.21.15.33:0/1003559810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615404e0fa0 con 0x5615400871b0 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29bffff640 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56154008f390 0x561540469a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29c7fff640 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x5615404694d0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000c00 tx=0x7f29b80aae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ead8a18ec0ff1b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:53.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29a77fe640 1 -- 172.21.15.33:0/1003559810 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b80ab010 con 0x5615400871b0 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29a77fe640 1 -- 172.21.15.33:0/1003559810 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f29b8010670 con 0x5615400871b0 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29d4f36740 1 -- 172.21.15.33:0/1003559810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29b00055f0 con 0x5615400871b0 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29a77fe640 1 -- 172.21.15.33:0/1003559810 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29b8009de0 con 0x5615400871b0 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29d4f36740 10 client.17832 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29d4f36740 1 -- 172.21.15.33:0/1003559810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5615404e2000 con 0x5615400871b0 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.811+0000 7f29a77fe640 1 -- 172.21.15.33:0/1003559810 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b00055f0 con 0x5615400871b0 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.812+0000 7f29a77fe640 1 -- 172.21.15.33:0/1003559810 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f29b80aa570 con 0x5615400871b0 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.812+0000 7f29d4f36740 10 client.17832 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.812+0000 7f29d4f36740 10 client.17832 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.812+0000 7f29d4f36740 20 client.17832 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.812+0000 7f29d4f36740 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x561540043da0 0x5615404e4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.812+0000 7f29d4f36740 4 client.17832 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.812+0000 7f29d4f36740 1 -- 172.21.15.33:0/1003559810 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5615403ca070 con 0x561540043da0 2024-08-28T19:40:53.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.812+0000 7f29bffff640 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x561540043da0 0x5615404e4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.812+0000 7f29a77fe640 10 client.17832 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.812+0000 7f29bffff640 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x561540043da0 0x5615404e4600 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=44a2382ad9a348c8 server_cookie=faa86d8a24c15cc9 in_seq=0 out_seq=0 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29a77fe640 1 -- 172.21.15.33:0/1003559810 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5615403ca070 con 0x561540043da0 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29a77fe640 10 client.17832 handle_command_reply: tid=0 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 client.17832 shutdown 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 -- 172.21.15.33:0/1003559810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 msgr2=0x5615404694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x5615404694d0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000c00 tx=0x7f29b80aae30 comp rx=0 tx=0).stop 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 -- 172.21.15.33:0/1003559810 shutdown_connections 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x561540043da0 0x5615404e4600 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5615400b0070 0x5615404e0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56154008f390 0x561540469a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 --2- 172.21.15.33:0/1003559810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5615400871b0 0x5615404694d0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29a77fe640 0 client.17832 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:40:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 -- 172.21.15.33:0/1003559810 >> 172.21.15.33:0/1003559810 conn(0x5615400a4460 msgr2=0x56154045a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 -- 172.21.15.33:0/1003559810 shutdown_connections 2024-08-28T19:40:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 1 -- 172.21.15.33:0/1003559810 wait complete. 2024-08-28T19:40:53.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.813+0000 7f29d4f36740 20 client.17832 trim_cache size 0 max 16384 2024-08-28T19:40:53.819 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:40:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 -- 172.21.15.33:0/1994210153 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29b40b4d20 msgr2=0x7f29b40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29b40b4d20 0x7f29b40b7230 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009ca0 tx=0x7f29c00095c0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 -- 172.21.15.33:0/1994210153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c8104750 msgr2=0x7f29c819a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c8104750 0x7f29c819a280 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f29b800d950 tx=0x7f29b800de10 comp rx=0 tx=0).stop 2024-08-28T19:40:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 -- 172.21.15.33:0/1994210153 shutdown_connections 2024-08-28T19:40:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c810dbb0 0x7f29c819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29b40b4d20 0x7f29b40b7230 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c81050a0 0x7f29c819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 --2- 172.21.15.33:0/1994210153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29c8104750 0x7f29c819a280 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:53.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 -- 172.21.15.33:0/1994210153 >> 172.21.15.33:0/1994210153 conn(0x7f29c80794d0 msgr2=0x7f29c81005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 -- 172.21.15.33:0/1994210153 shutdown_connections 2024-08-28T19:40:53.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:53.814+0000 7f29ce9c1640 1 -- 172.21.15.33:0/1994210153 wait complete. 2024-08-28T19:40:54.345 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:40:54.647 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:40:54.699 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:55.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.194+0000 7f3f5c899640 1 -- 172.21.15.33:0/345760692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f58103940 msgr2=0x7f3f58103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.194+0000 7f3f5c899640 1 --2- 172.21.15.33:0/345760692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f58103940 0x7f3f58103d50 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009900 tx=0x7f3f4802a410 comp rx=0 tx=0).stop 2024-08-28T19:40:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.194+0000 7f3f5c899640 1 -- 172.21.15.33:0/345760692 shutdown_connections 2024-08-28T19:40:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.194+0000 7f3f5c899640 1 --2- 172.21.15.33:0/345760692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f58109bd0 0x7f3f58110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.194+0000 7f3f5c899640 1 --2- 172.21.15.33:0/345760692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f58109280 0x7f3f58109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.194+0000 7f3f5c899640 1 --2- 172.21.15.33:0/345760692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f58103940 0x7f3f58103d50 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.194+0000 7f3f5c899640 1 -- 172.21.15.33:0/345760692 >> 172.21.15.33:0/345760692 conn(0x7f3f580ff3d0 msgr2=0x7f3f58101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.194+0000 7f3f5c899640 1 -- 172.21.15.33:0/345760692 shutdown_connections 2024-08-28T19:40:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.194+0000 7f3f5c899640 1 -- 172.21.15.33:0/345760692 wait complete. 2024-08-28T19:40:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.195+0000 7f3f5c899640 1 Processor -- start 2024-08-28T19:40:55.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.195+0000 7f3f5c899640 1 -- start start 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f5c899640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f58103940 0x7f3f580754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f5c899640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f58109280 0x7f3f580759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f5c899640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f58109bd0 0x7f3f58075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f5c899640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3f58113890 con 0x7f3f58109280 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f5c899640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3f58113710 con 0x7f3f58103940 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f5c899640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3f58113a10 con 0x7f3f58109bd0 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f55d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f58109280 0x7f3f580759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f55d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f58109280 0x7f3f580759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42916/0 (socket says 172.21.15.33:42916) 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f55d9b640 1 -- 172.21.15.33:0/1624755717 learned_addr learned my addr 172.21.15.33:0/1624755717 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f5659c640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f58103940 0x7f3f580754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f56d9d640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f58109bd0 0x7f3f58075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f55d9b640 1 -- 172.21.15.33:0/1624755717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f58109bd0 msgr2=0x7f3f58075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f55d9b640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f58109bd0 0x7f3f58075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f55d9b640 1 -- 172.21.15.33:0/1624755717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f58103940 msgr2=0x7f3f580754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f55d9b640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f58103940 0x7f3f580754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.196+0000 7f3f55d9b640 1 -- 172.21.15.33:0/1624755717 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f581a8520 con 0x7f3f58109280 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.197+0000 7f3f55d9b640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f58109280 0x7f3f580759f0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00e9f0 tx=0x7f3f4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.197+0000 7f3f477fe640 1 -- 172.21.15.33:0/1624755717 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00ccc0 con 0x7f3f58109280 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.197+0000 7f3f477fe640 1 -- 172.21.15.33:0/1624755717 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f4c0108e0 con 0x7f3f58109280 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.197+0000 7f3f5c899640 1 -- 172.21.15.33:0/1624755717 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f581a8810 con 0x7f3f58109280 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.197+0000 7f3f477fe640 1 -- 172.21.15.33:0/1624755717 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c018860 con 0x7f3f58109280 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.197+0000 7f3f5c899640 1 -- 172.21.15.33:0/1624755717 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f581a8da0 con 0x7f3f58109280 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.198+0000 7f3f5c899640 1 -- 172.21.15.33:0/1624755717 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f58103d50 con 0x7f3f58109280 2024-08-28T19:40:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.200+0000 7f3f477fe640 1 -- 172.21.15.33:0/1624755717 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3f4c010430 con 0x7f3f58109280 2024-08-28T19:40:55.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.201+0000 7f3f477fe640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f400b4d20 0x7f3f400b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.201+0000 7f3f5659c640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f400b4d20 0x7f3f400b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.201+0000 7f3f477fe640 1 -- 172.21.15.33:0/1624755717 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f3f4c0e6090 con 0x7f3f58109280 2024-08-28T19:40:55.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.202+0000 7f3f5659c640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f400b4d20 0x7f3f400b7230 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3f48000c00 tx=0x7f3f48031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:55.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.206+0000 7f3f477fe640 1 -- 172.21.15.33:0/1624755717 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3f4c0acae0 con 0x7f3f58109280 2024-08-28T19:40:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:55.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.444+0000 7f3f5c899640 1 -- 172.21.15.33:0/1624755717 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f5810b9a0 con 0x7f3f58109280 2024-08-28T19:40:55.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.445+0000 7f3f477fe640 1 -- 172.21.15.33:0/1624755717 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f3f4c0ac3e0 con 0x7f3f58109280 2024-08-28T19:40:55.446 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:40:55.446 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:40:55.446 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:40:55.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.447+0000 7f3f5c899640 1 -- 172.21.15.33:0/1624755717 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f400b4d20 msgr2=0x7f3f400b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.447+0000 7f3f5c899640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f400b4d20 0x7f3f400b7230 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3f48000c00 tx=0x7f3f48031400 comp rx=0 tx=0).stop 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.447+0000 7f3f5c899640 1 -- 172.21.15.33:0/1624755717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f58109280 msgr2=0x7f3f580759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.447+0000 7f3f5c899640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f58109280 0x7f3f580759f0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00e9f0 tx=0x7f3f4c00eeb0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.448+0000 7f3f5c899640 1 -- 172.21.15.33:0/1624755717 shutdown_connections 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.448+0000 7f3f5c899640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f400b4d20 0x7f3f400b7230 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.448+0000 7f3f5c899640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f58109bd0 0x7f3f58075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.448+0000 7f3f5c899640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f58109280 0x7f3f580759f0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.448+0000 7f3f5c899640 1 --2- 172.21.15.33:0/1624755717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f58103940 0x7f3f580754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.448+0000 7f3f5c899640 1 -- 172.21.15.33:0/1624755717 >> 172.21.15.33:0/1624755717 conn(0x7f3f580ff3d0 msgr2=0x7f3f581017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.448+0000 7f3f5c899640 1 -- 172.21.15.33:0/1624755717 shutdown_connections 2024-08-28T19:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.448+0000 7f3f5c899640 1 -- 172.21.15.33:0/1624755717 wait complete. 2024-08-28T19:40:55.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:55 smithi059 ceph-mon[22052]: pgmap v600: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-08-28T19:40:55.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:55 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1624755717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:55.783 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:55 smithi033 ceph-mon[18549]: pgmap v600: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-08-28T19:40:55.783 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:55 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1624755717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:55 smithi122 ceph-mon[22174]: pgmap v600: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-08-28T19:40:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:55 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1624755717' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:40:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.875+0000 7fefb8a44640 1 -- 172.21.15.33:0/1296114534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb410dc30 msgr2=0x7fefb4110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.875+0000 7fefb8a44640 1 --2- 172.21.15.33:0/1296114534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb410dc30 0x7fefb4110120 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fefac009ca0 tx=0x7fefac02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.875+0000 7fefb8a44640 1 -- 172.21.15.33:0/1296114534 shutdown_connections 2024-08-28T19:40:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.875+0000 7fefb8a44640 1 --2- 172.21.15.33:0/1296114534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb410dc30 0x7fefb4110120 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.875+0000 7fefb8a44640 1 --2- 172.21.15.33:0/1296114534 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb4105120 0x7fefb410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.875+0000 7fefb8a44640 1 --2- 172.21.15.33:0/1296114534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb41047d0 0x7fefb4104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.875+0000 7fefb8a44640 1 -- 172.21.15.33:0/1296114534 >> 172.21.15.33:0/1296114534 conn(0x7fefb4079510 msgr2=0x7fefb4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.876+0000 7fefb8a44640 1 -- 172.21.15.33:0/1296114534 shutdown_connections 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.876+0000 7fefb8a44640 1 -- 172.21.15.33:0/1296114534 wait complete. 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.876+0000 7fefb8a44640 1 Processor -- start 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb8a44640 1 -- start start 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb8a44640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb41047d0 0x7fefb4102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb8a44640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb4105120 0x7fefb4102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb8a44640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb410dc30 0x7fefb4102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb8a44640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41138b0 con 0x7fefb410dc30 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb8a44640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fefb4113730 con 0x7fefb4105120 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb8a44640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fefb4113a30 con 0x7fefb41047d0 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb410dc30 0x7fefb4102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb410dc30 0x7fefb4102f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42932/0 (socket says 172.21.15.33:42932) 2024-08-28T19:40:55.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb2d9d640 1 -- 172.21.15.33:0/1617220124 learned_addr learned my addr 172.21.15.33:0/1617220124 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb259c640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb41047d0 0x7fefb4102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb4105120 0x7fefb4102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb2d9d640 1 -- 172.21.15.33:0/1617220124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb41047d0 msgr2=0x7fefb4102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb2d9d640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb41047d0 0x7fefb4102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb2d9d640 1 -- 172.21.15.33:0/1617220124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb4105120 msgr2=0x7fefb4102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb2d9d640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb4105120 0x7fefb4102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.877+0000 7fefb2d9d640 1 -- 172.21.15.33:0/1617220124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb41a8500 con 0x7fefb410dc30 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.878+0000 7fefb2d9d640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb410dc30 0x7fefb4102f90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fefac0098d0 tx=0x7fefac0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.878+0000 7fefabfff640 1 -- 172.21.15.33:0/1617220124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac003b70 con 0x7fefb410dc30 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.878+0000 7fefabfff640 1 -- 172.21.15.33:0/1617220124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefac003d10 con 0x7fefb410dc30 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.878+0000 7fefb8a44640 1 -- 172.21.15.33:0/1617220124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb41a8790 con 0x7fefb410dc30 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.878+0000 7fefabfff640 1 -- 172.21.15.33:0/1617220124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac02fa20 con 0x7fefb410dc30 2024-08-28T19:40:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.878+0000 7fefb8a44640 1 -- 172.21.15.33:0/1617220124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb41a8cd0 con 0x7fefb410dc30 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.881+0000 7fefbefb9740 1 Processor -- start 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.881+0000 7fefabfff640 1 -- 172.21.15.33:0/1617220124 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fefac02fc20 con 0x7fefb410dc30 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.881+0000 7fefbefb9740 1 -- start start 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 0x559f176c0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefbefb9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559f17637680 con 0x559f172fa390 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefbefb9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559f17626c10 con 0x559f172f21b0 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefbefb9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559f1762abc0 con 0x559f1731b070 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefa9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefa9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42946/0 (socket says 172.21.15.33:42946) 2024-08-28T19:40:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefa9d9b640 1 -- 172.21.15.33:0/3408721204 learned_addr learned my addr 172.21.15.33:0/3408721204 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/3408721204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 0x559f176c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefb259c640 1 --2- 172.21.15.33:0/3408721204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefabfff640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefa00b4ca0 0x7fefa00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefa9d9b640 1 -- 172.21.15.33:0/3408721204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 msgr2=0x559f176c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/3408721204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 0x559f176c0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefa9d9b640 1 -- 172.21.15.33:0/3408721204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 msgr2=0x559f176c0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/3408721204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176c0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefa9d9b640 1 -- 172.21.15.33:0/3408721204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f17386650 con 0x559f172fa390 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefb259c640 1 --2- 172.21.15.33:0/3408721204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefb2d9d640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefa00b4ca0 0x7fefa00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefabfff640 1 -- 172.21.15.33:0/1617220124 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7fefac106df0 con 0x7fefb410dc30 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.882+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/3408721204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c0d90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fef9c014960 tx=0x7fef9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb17240eec40080 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.883+0000 7fefa8d99640 1 -- 172.21.15.33:0/3408721204 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c0142d0 con 0x559f172fa390 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.883+0000 7fefa8d99640 1 -- 172.21.15.33:0/3408721204 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef9c0054d0 con 0x559f172fa390 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.883+0000 7fefa8d99640 1 -- 172.21.15.33:0/3408721204 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c004d50 con 0x559f172fa390 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 -- 172.21.15.33:0/3408721204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 msgr2=0x559f176c0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefb2d9d640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefa00b4ca0 0x7fefa00b71b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fefac104250 tx=0x7fefac099450 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 --2- 172.21.15.33:0/3408721204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c0d90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fef9c014960 tx=0x7fef9c00c490 comp rx=0 tx=0).stop 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 -- 172.21.15.33:0/3408721204 shutdown_connections 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 --2- 172.21.15.33:0/3408721204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c0d90 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 --2- 172.21.15.33:0/3408721204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176c0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 --2- 172.21.15.33:0/3408721204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 0x559f176c0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 -- 172.21.15.33:0/3408721204 >> 172.21.15.33:0/3408721204 conn(0x559f1730f460 msgr2=0x559f176be200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 -- 172.21.15.33:0/3408721204 shutdown_connections 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 -- 172.21.15.33:0/3408721204 wait complete. 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 -- start start 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 Processor -- start 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.884+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 0x559f176d7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefbefb9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559f17489700 con 0x559f172fa390 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefbefb9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559f175ad750 con 0x559f172f21b0 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefbefb9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559f176ceaf0 con 0x559f1731b070 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefbefb9740 10 client.0 _ll_register_callbacks cb 0x559f175dce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefb259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefb259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42954/0 (socket says 172.21.15.33:42954) 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefb259c640 1 -- 172.21.15.33:0/2860929965 learned_addr learned my addr 172.21.15.33:0/2860929965 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 0x559f176d7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefb259c640 1 -- 172.21.15.33:0/2860929965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 msgr2=0x559f176d7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefb259c640 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 0x559f176d7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefb259c640 1 -- 172.21.15.33:0/2860929965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 msgr2=0x559f176cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefb259c640 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefb259c640 1 -- 172.21.15.33:0/2860929965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f175e6900 con 0x559f172fa390 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 0x559f176d7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefb259c640 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176cbfa0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fefa4012700 tx=0x7fefa4012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0071da6e63d76f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fef99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fef99ffb640 1 -- 172.21.15.33:0/2860929965 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4004020 con 0x559f172fa390 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fef99ffb640 1 -- 172.21.15.33:0/2860929965 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7fefa40041c0 con 0x559f172fa390 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.885+0000 7fefbefb9740 1 -- 172.21.15.33:0/2860929965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef9c0054d0 con 0x559f172fa390 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fef99ffb640 1 -- 172.21.15.33:0/2860929965 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fefa40043c0 con 0x559f172fa390 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fefbefb9740 10 client.17850 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fefbefb9740 1 -- 172.21.15.33:0/2860929965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559f176da900 con 0x559f172fa390 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fef99ffb640 1 -- 172.21.15.33:0/2860929965 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef9c0054d0 con 0x559f172fa390 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fef99ffb640 1 -- 172.21.15.33:0/2860929965 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fefa4003b20 con 0x559f172fa390 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fefbefb9740 10 client.17850 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fefbefb9740 10 client.17850 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fefbefb9740 20 client.17850 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fefbefb9740 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x559f172d99f0 0x559f176dde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fefbefb9740 4 client.17850 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fefbefb9740 1 -- 172.21.15.33:0/2860929965 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f176395d0 con 0x559f172d99f0 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.886+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x559f172d99f0 0x559f176dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.887+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x559f172d99f0 0x559f176dde10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6518551bac975c64 server_cookie=4decbb5f2a511cfd in_seq=0 out_seq=0 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.887+0000 7fef99ffb640 10 client.17850 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.887+0000 7fef99ffb640 1 -- 172.21.15.33:0/2860929965 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f176395d0 con 0x559f172d99f0 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fef99ffb640 10 client.17850 handle_command_reply: tid=0 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 client.17850 shutdown 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 -- 172.21.15.33:0/2860929965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 msgr2=0x559f176cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176cbfa0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fefa4012700 tx=0x7fefa4012bc0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 -- 172.21.15.33:0/2860929965 shutdown_connections 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x559f172d99f0 0x559f176dde10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f1731b070 0x559f176d7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176cbfa0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 --2- 172.21.15.33:0/2860929965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fef99ffb640 0 client.17850 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:40:55.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 -- 172.21.15.33:0/2860929965 >> 172.21.15.33:0/2860929965 conn(0x559f1730f460 msgr2=0x559f176c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:55.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 -- 172.21.15.33:0/2860929965 shutdown_connections 2024-08-28T19:40:55.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 1 -- 172.21.15.33:0/2860929965 wait complete. 2024-08-28T19:40:55.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.888+0000 7fefbefb9740 20 client.17850 trim_cache size 0 max 16384 2024-08-28T19:40:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefbefb9740 1 Processor -- start 2024-08-28T19:40:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefbefb9740 1 -- start start 2024-08-28T19:40:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f172d99f0 0x559f176c3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176c3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefbefb9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41b2d70 con 0x559f172fa390 2024-08-28T19:40:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefbefb9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41b48b0 con 0x559f172f21b0 2024-08-28T19:40:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefbefb9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41b3440 con 0x559f172d99f0 2024-08-28T19:40:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefa9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefa9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42958/0 (socket says 172.21.15.33:42958) 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefa9d9b640 1 -- 172.21.15.33:0/1534235701 learned_addr learned my addr 172.21.15.33:0/1534235701 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.901+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/1534235701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f172d99f0 0x559f176c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.902+0000 7fefb259c640 1 --2- 172.21.15.33:0/1534235701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.902+0000 7fefa9d9b640 1 -- 172.21.15.33:0/1534235701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f172d99f0 msgr2=0x559f176c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.902+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/1534235701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f172d99f0 0x559f176c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.902+0000 7fefa9d9b640 1 -- 172.21.15.33:0/1534235701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 msgr2=0x559f176c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.902+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/1534235701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.902+0000 7fefa9d9b640 1 -- 172.21.15.33:0/1534235701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f176b95a0 con 0x559f172fa390 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.902+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/1534235701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c8c50 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0057c0 tx=0x7fef9c004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae55831426cddfcb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.902+0000 7fef9bfff640 1 -- 172.21.15.33:0/1534235701 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c004640 con 0x559f172fa390 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.902+0000 7fef9bfff640 1 -- 172.21.15.33:0/1534235701 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef9c032070 con 0x559f172fa390 2024-08-28T19:40:55.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.902+0000 7fef9bfff640 1 -- 172.21.15.33:0/1534235701 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c0054d0 con 0x559f172fa390 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.903+0000 7fefbefb9740 1 -- 172.21.15.33:0/1534235701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 msgr2=0x559f176c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.903+0000 7fefbefb9740 1 --2- 172.21.15.33:0/1534235701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c8c50 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0057c0 tx=0x7fef9c004990 comp rx=0 tx=0).stop 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.903+0000 7fefbefb9740 1 -- 172.21.15.33:0/1534235701 shutdown_connections 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.903+0000 7fefbefb9740 1 --2- 172.21.15.33:0/1534235701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172fa390 0x559f176c8c50 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.903+0000 7fefbefb9740 1 --2- 172.21.15.33:0/1534235701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172f21b0 0x559f176c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.903+0000 7fefbefb9740 1 --2- 172.21.15.33:0/1534235701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f172d99f0 0x559f176c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.903+0000 7fefbefb9740 1 -- 172.21.15.33:0/1534235701 >> 172.21.15.33:0/1534235701 conn(0x559f1730f460 msgr2=0x559f176ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.903+0000 7fefbefb9740 1 -- 172.21.15.33:0/1534235701 shutdown_connections 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.903+0000 7fefbefb9740 1 -- 172.21.15.33:0/1534235701 wait complete. 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.903+0000 7fefbefb9740 1 -- start start 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefbefb9740 1 Processor -- start 2024-08-28T19:40:55.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172d99f0 0x559f176cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f172f21b0 0x559f176d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefbefb9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172fa390 0x559f177477d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefbefb9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41b41e0 con 0x559f172d99f0 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefbefb9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41b3b10 con 0x559f172fa390 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefbefb9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41b0d70 con 0x559f172f21b0 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefbefb9740 10 client.0 _ll_register_callbacks cb 0x7fefa40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefa9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172d99f0 0x559f176cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefa9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172d99f0 0x559f176cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42968/0 (socket says 172.21.15.33:42968) 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefa9d9b640 1 -- 172.21.15.33:0/3481445607 learned_addr learned my addr 172.21.15.33:0/3481445607 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefb259c640 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f172f21b0 0x559f176d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefa9d9b640 1 -- 172.21.15.33:0/3481445607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f172f21b0 msgr2=0x559f176d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:55.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f172f21b0 0x559f176d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefa9d9b640 1 -- 172.21.15.33:0/3481445607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172fa390 msgr2=0x559f177477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172fa390 0x559f177477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.904+0000 7fefa9d9b640 1 -- 172.21.15.33:0/3481445607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f176d0d30 con 0x559f172d99f0 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fefa9d9b640 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172d99f0 0x559f176cffe0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00cfe0 tx=0x7fef9c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5455076fe39823d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fef99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fef99ffb640 1 -- 172.21.15.33:0/3481445607 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9c005450 con 0x559f172d99f0 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fef99ffb640 1 -- 172.21.15.33:0/3481445607 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7fef9c004ac0 con 0x559f172d99f0 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fefbefb9740 1 -- 172.21.15.33:0/3481445607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef9c032070 con 0x559f172d99f0 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fef99ffb640 1 -- 172.21.15.33:0/3481445607 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef9c0055f0 con 0x559f172d99f0 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fefbefb9740 10 client.17856 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fefbefb9740 1 -- 172.21.15.33:0/3481445607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559f17748cd0 con 0x559f172d99f0 2024-08-28T19:40:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fef99ffb640 1 -- 172.21.15.33:0/3481445607 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef9c032070 con 0x559f172d99f0 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fef99ffb640 1 -- 172.21.15.33:0/3481445607 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fef9c036070 con 0x559f172d99f0 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fefbefb9740 10 client.17856 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fefbefb9740 10 client.17856 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fefbefb9740 20 client.17856 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fefbefb9740 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x559f1731b070 0x559f1774b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fefbefb9740 4 client.17856 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.905+0000 7fefbefb9740 1 -- 172.21.15.33:0/3481445607 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f17635070 con 0x559f1731b070 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.906+0000 7fefb259c640 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x559f1731b070 0x559f1774b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.906+0000 7fefb259c640 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x559f1731b070 0x559f1774b230 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cfdb7e866734cc14 server_cookie=23d62d58f52162a in_seq=0 out_seq=0 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.906+0000 7fef99ffb640 10 client.17856 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fef99ffb640 1 -- 172.21.15.33:0/3481445607 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f17635070 con 0x559f1731b070 2024-08-28T19:40:55.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fef99ffb640 10 client.17856 handle_command_reply: tid=0 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 client.17856 shutdown 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 -- 172.21.15.33:0/3481445607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172d99f0 msgr2=0x559f176cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172d99f0 0x559f176cffe0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fef9c00cfe0 tx=0x7fef9c0046d0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 -- 172.21.15.33:0/3481445607 shutdown_connections 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x559f1731b070 0x559f1774b230 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f172fa390 0x559f177477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559f172f21b0 0x559f176d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fef99ffb640 0 client.17856 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 --2- 172.21.15.33:0/3481445607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559f172d99f0 0x559f176cffe0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 -- 172.21.15.33:0/3481445607 >> 172.21.15.33:0/3481445607 conn(0x559f1730f460 msgr2=0x559f176c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 -- 172.21.15.33:0/3481445607 shutdown_connections 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 1 -- 172.21.15.33:0/3481445607 wait complete. 2024-08-28T19:40:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.907+0000 7fefbefb9740 20 client.17856 trim_cache size 0 max 16384 2024-08-28T19:40:55.916 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:40:55.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 -- 172.21.15.33:0/1617220124 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefa00b4ca0 msgr2=0x7fefa00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefa00b4ca0 0x7fefa00b71b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fefac104250 tx=0x7fefac099450 comp rx=0 tx=0).stop 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 -- 172.21.15.33:0/1617220124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb410dc30 msgr2=0x7fefb4102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb410dc30 0x7fefb4102f90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fefac0098d0 tx=0x7fefac0317b0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 -- 172.21.15.33:0/1617220124 shutdown_connections 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb410dc30 0x7fefb4102f90 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb4105120 0x7fefb4102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fefa00b4ca0 0x7fefa00b71b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 --2- 172.21.15.33:0/1617220124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fefb41047d0 0x7fefb4102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 -- 172.21.15.33:0/1617220124 >> 172.21.15.33:0/1617220124 conn(0x7fefb4079510 msgr2=0x7fefb4100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 -- 172.21.15.33:0/1617220124 shutdown_connections 2024-08-28T19:40:55.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:55.908+0000 7fefb8a44640 1 -- 172.21.15.33:0/1617220124 wait complete. 2024-08-28T19:40:56.799 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id bfc46141 --release --await' 2024-08-28T19:40:56.800 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id bfc46141 --release --await 2024-08-28T19:40:57.298 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:40:57.337 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:57.596 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:57 smithi033 ceph-mon[18549]: pgmap v601: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-28T19:40:57.596 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:57 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:40:57.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:57 smithi059 ceph-mon[22052]: pgmap v601: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-28T19:40:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:57 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:40:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:57 smithi122 ceph-mon[22174]: pgmap v601: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-28T19:40:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:57 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:40:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.837+0000 7f94a7373640 1 -- 172.21.15.33:0/4088410234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94a0108ab0 msgr2=0x7f94a010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.837+0000 7f94a7373640 1 --2- 172.21.15.33:0/4088410234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94a0108ab0 0x7f94a010f2e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f9498009900 tx=0x7f949802a410 comp rx=0 tx=0).stop 2024-08-28T19:40:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.838+0000 7f94a7373640 1 -- 172.21.15.33:0/4088410234 shutdown_connections 2024-08-28T19:40:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.838+0000 7f94a7373640 1 --2- 172.21.15.33:0/4088410234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94a0108ab0 0x7f94a010f2e0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.838+0000 7f94a7373640 1 --2- 172.21.15.33:0/4088410234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94a0108160 0x7f94a0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.838+0000 7f94a7373640 1 --2- 172.21.15.33:0/4088410234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a0102820 0x7f94a0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.838+0000 7f94a7373640 1 -- 172.21.15.33:0/4088410234 >> 172.21.15.33:0/4088410234 conn(0x7f94a00794e0 msgr2=0x7f94a00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:57.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.838+0000 7f94a7373640 1 -- 172.21.15.33:0/4088410234 shutdown_connections 2024-08-28T19:40:57.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.838+0000 7f94a7373640 1 -- 172.21.15.33:0/4088410234 wait complete. 2024-08-28T19:40:57.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.838+0000 7f94a7373640 1 Processor -- start 2024-08-28T19:40:57.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.838+0000 7f94a7373640 1 -- start start 2024-08-28T19:40:57.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a7373640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94a0102820 0x7f94a019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a7373640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94a0108160 0x7f94a019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a7373640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a0108ab0 0x7f94a019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a7373640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f94a0112730 con 0x7f94a0102820 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a7373640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94a01125b0 con 0x7f94a0108ab0 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a7373640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94a01128b0 con 0x7f94a0108160 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a510f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94a0102820 0x7f94a019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a510f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94a0102820 0x7f94a019a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42984/0 (socket says 172.21.15.33:42984) 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a510f640 1 -- 172.21.15.33:0/821656180 learned_addr learned my addr 172.21.15.33:0/821656180 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a5910640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a0108ab0 0x7f94a019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a490e640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94a0108160 0x7f94a019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a510f640 1 -- 172.21.15.33:0/821656180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94a0108160 msgr2=0x7f94a019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a510f640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94a0108160 0x7f94a019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a510f640 1 -- 172.21.15.33:0/821656180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a0108ab0 msgr2=0x7f94a019fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:57.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a510f640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a0108ab0 0x7f94a019fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a510f640 1 -- 172.21.15.33:0/821656180 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a01a0080 con 0x7f94a0102820 2024-08-28T19:40:57.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.839+0000 7f94a510f640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94a0102820 0x7f94a019a1d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f949c00cce0 tx=0x7f949c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:57.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.840+0000 7f94967fc640 1 -- 172.21.15.33:0/821656180 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c00f650 con 0x7f94a0102820 2024-08-28T19:40:57.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.840+0000 7f94a7373640 1 -- 172.21.15.33:0/821656180 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a01a0370 con 0x7f94a0102820 2024-08-28T19:40:57.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.840+0000 7f94967fc640 1 -- 172.21.15.33:0/821656180 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f949c00fca0 con 0x7f94a0102820 2024-08-28T19:40:57.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.840+0000 7f94967fc640 1 -- 172.21.15.33:0/821656180 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c018b40 con 0x7f94a0102820 2024-08-28T19:40:57.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.840+0000 7f94a7373640 1 -- 172.21.15.33:0/821656180 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a01a6b90 con 0x7f94a0102820 2024-08-28T19:40:57.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.842+0000 7f94ad8e8740 1 Processor -- start 2024-08-28T19:40:57.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.842+0000 7f94967fc640 1 -- 172.21.15.33:0/821656180 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f949c018ce0 con 0x7f94a0102820 2024-08-28T19:40:57.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.842+0000 7f94ad8e8740 1 -- start start 2024-08-28T19:40:57.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d654c520 0x55b8d68f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d6523660 0x55b8d68f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d68f2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b8d6868a70 con 0x55b8d652b840 2024-08-28T19:40:57.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b8d6858000 con 0x55b8d654c520 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b8d685bfb0 con 0x55b8d6523660 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a490e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d68f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a490e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d68f2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42986/0 (socket says 172.21.15.33:42986) 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a490e640 1 -- 172.21.15.33:0/3851054417 learned_addr learned my addr 172.21.15.33:0/3851054417 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a510f640 1 --2- 172.21.15.33:0/3851054417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d6523660 0x55b8d68f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a5910640 1 --2- 172.21.15.33:0/3851054417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d654c520 0x55b8d68f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a490e640 1 -- 172.21.15.33:0/3851054417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d6523660 msgr2=0x55b8d68f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a490e640 1 --2- 172.21.15.33:0/3851054417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d6523660 0x55b8d68f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a490e640 1 -- 172.21.15.33:0/3851054417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d654c520 msgr2=0x55b8d68f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a490e640 1 --2- 172.21.15.33:0/3851054417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d654c520 0x55b8d68f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a490e640 1 -- 172.21.15.33:0/3851054417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8d65b7b00 con 0x55b8d652b840 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94967fc640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f948c0b4d50 0x7f948c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.843+0000 7f94a490e640 1 --2- 172.21.15.33:0/3851054417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d68f2700 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f949000abb0 tx=0x7f949000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8e2235fc9af855 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:57.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.844+0000 7f94a5910640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f948c0b4d50 0x7f948c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.844+0000 7f948b7fe640 1 -- 172.21.15.33:0/3851054417 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949001d070 con 0x55b8d652b840 2024-08-28T19:40:57.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.844+0000 7f948b7fe640 1 -- 172.21.15.33:0/3851054417 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9490018af0 con 0x55b8d652b840 2024-08-28T19:40:57.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.844+0000 7f948b7fe640 1 -- 172.21.15.33:0/3851054417 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9490010a90 con 0x55b8d652b840 2024-08-28T19:40:57.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.844+0000 7f94967fc640 1 -- 172.21.15.33:0/821656180 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f949c0e5c50 con 0x7f94a0102820 2024-08-28T19:40:57.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 -- 172.21.15.33:0/3851054417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 msgr2=0x55b8d68f2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:57.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/3851054417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d68f2700 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f949000abb0 tx=0x7f949000f790 comp rx=0 tx=0).stop 2024-08-28T19:40:57.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94a5910640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f948c0b4d50 0x7f948c0b7260 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9498006010 tx=0x7f94980058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:57.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 -- 172.21.15.33:0/3851054417 shutdown_connections 2024-08-28T19:40:57.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/3851054417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d68f2700 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/3851054417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d6523660 0x55b8d68f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/3851054417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d654c520 0x55b8d68f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 -- 172.21.15.33:0/3851054417 >> 172.21.15.33:0/3851054417 conn(0x55b8d6540910 msgr2=0x55b8d68efb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 -- 172.21.15.33:0/3851054417 shutdown_connections 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 -- 172.21.15.33:0/3851054417 wait complete. 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 -- start start 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.845+0000 7f94ad8e8740 1 Processor -- start 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68fd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d652b840 0x55b8d68fddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 0x55b8d6909930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b8d6900460 con 0x55b8d6523660 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b8d6819520 con 0x55b8d652b840 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b8d69005e0 con 0x55b8d654c520 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94ad8e8740 10 client.0 _ll_register_callbacks cb 0x55b8d6851c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a510f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68fd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a510f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68fd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43002/0 (socket says 172.21.15.33:43002) 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a510f640 1 -- 172.21.15.33:0/30620789 learned_addr learned my addr 172.21.15.33:0/30620789 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a490e640 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d652b840 0x55b8d68fddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a5910640 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 0x55b8d6909930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a510f640 1 -- 172.21.15.33:0/30620789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 msgr2=0x55b8d6909930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a510f640 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 0x55b8d6909930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a510f640 1 -- 172.21.15.33:0/30620789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d652b840 msgr2=0x55b8d68fddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a510f640 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d652b840 0x55b8d68fddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a510f640 1 -- 172.21.15.33:0/30620789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8d662e960 con 0x55b8d6523660 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.846+0000 7f94a5910640 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 0x55b8d6909930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.847+0000 7f94a510f640 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68fd880 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f949c00ab20 tx=0x7f949c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b701099c6e3aa5a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.847+0000 7f9488ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.847+0000 7f9488ff9640 1 -- 172.21.15.33:0/30620789 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0ab8f0 con 0x55b8d6523660 2024-08-28T19:40:57.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.847+0000 7f9488ff9640 1 -- 172.21.15.33:0/30620789 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f949c0b4e30 con 0x55b8d6523660 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.847+0000 7f94ad8e8740 1 -- 172.21.15.33:0/30620789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b8d67f79a0 con 0x55b8d6523660 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.847+0000 7f9488ff9640 1 -- 172.21.15.33:0/30620789 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f949c0ab710 con 0x55b8d6523660 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.847+0000 7f94ad8e8740 10 client.17868 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.847+0000 7f94ad8e8740 1 -- 172.21.15.33:0/30620789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b8d6910ac0 con 0x55b8d6523660 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.847+0000 7f9488ff9640 1 -- 172.21.15.33:0/30620789 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b8d67f79a0 con 0x55b8d6523660 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.847+0000 7f9488ff9640 1 -- 172.21.15.33:0/30620789 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f949c0b0480 con 0x55b8d6523660 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.848+0000 7f94ad8e8740 10 client.17868 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.848+0000 7f94ad8e8740 10 client.17868 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.848+0000 7f94ad8e8740 20 client.17868 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.848+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b8d650aea0 0x55b8d6913f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.848+0000 7f94ad8e8740 4 client.17868 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:57.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.848+0000 7f94ad8e8740 1 -- 172.21.15.33:0/30620789 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8d686a9c0 con 0x55b8d650aea0 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.848+0000 7f94a490e640 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b8d650aea0 0x55b8d6913f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.848+0000 7f94a490e640 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b8d650aea0 0x55b8d6913f00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1abb300b03b1e140 server_cookie=cbb4f54afbd7aa1f in_seq=0 out_seq=0 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.848+0000 7f9488ff9640 10 client.17868 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f9488ff9640 1 -- 172.21.15.33:0/30620789 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b8d686a9c0 con 0x55b8d650aea0 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f9488ff9640 10 client.17868 handle_command_reply: tid=0 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 client.17868 shutdown 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 -- 172.21.15.33:0/30620789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 msgr2=0x55b8d68fd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68fd880 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f949c00ab20 tx=0x7f949c00cf50 comp rx=0 tx=0).stop 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 -- 172.21.15.33:0/30620789 shutdown_connections 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 0x55b8d6909930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d652b840 0x55b8d68fddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b8d650aea0 0x55b8d6913f00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/30620789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68fd880 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f9488ff9640 0 client.17868 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 -- 172.21.15.33:0/30620789 >> 172.21.15.33:0/30620789 conn(0x55b8d6540910 msgr2=0x55b8d68f4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 -- 172.21.15.33:0/30620789 shutdown_connections 2024-08-28T19:40:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 1 -- 172.21.15.33:0/30620789 wait complete. 2024-08-28T19:40:57.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.849+0000 7f94ad8e8740 20 client.17868 trim_cache size 0 max 16384 2024-08-28T19:40:57.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94ad8e8740 1 Processor -- start 2024-08-28T19:40:57.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94ad8e8740 1 -- start start 2024-08-28T19:40:57.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d652b840 0x55b8d68f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 0x55b8d68ef160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f94a01ae890 con 0x55b8d6523660 2024-08-28T19:40:57.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94a01b03d0 con 0x55b8d652b840 2024-08-28T19:40:57.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94a01aef60 con 0x55b8d654c520 2024-08-28T19:40:57.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94a510f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94a510f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68f6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43008/0 (socket says 172.21.15.33:43008) 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94a510f640 1 -- 172.21.15.33:0/725341022 learned_addr learned my addr 172.21.15.33:0/725341022 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94a5910640 1 --2- 172.21.15.33:0/725341022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 0x55b8d68ef160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.872+0000 7f94a490e640 1 --2- 172.21.15.33:0/725341022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d652b840 0x55b8d68f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.873+0000 7f94a510f640 1 -- 172.21.15.33:0/725341022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 msgr2=0x55b8d68ef160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.873+0000 7f94a510f640 1 --2- 172.21.15.33:0/725341022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 0x55b8d68ef160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.873+0000 7f94a510f640 1 -- 172.21.15.33:0/725341022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d652b840 msgr2=0x55b8d68f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.873+0000 7f94a510f640 1 --2- 172.21.15.33:0/725341022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d652b840 0x55b8d68f72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.873+0000 7f94a510f640 1 -- 172.21.15.33:0/725341022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8d68f8f10 con 0x55b8d6523660 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.873+0000 7f94a5910640 1 --2- 172.21.15.33:0/725341022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 0x55b8d68ef160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.873+0000 7f94a510f640 1 --2- 172.21.15.33:0/725341022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68f6d90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f949c01b000 tx=0x7f949c007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad73957448e64eb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.873+0000 7f948affd640 1 -- 172.21.15.33:0/725341022 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0d2070 con 0x55b8d6523660 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.873+0000 7f948affd640 1 -- 172.21.15.33:0/725341022 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f949c0ac6a0 con 0x55b8d6523660 2024-08-28T19:40:57.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.873+0000 7f948affd640 1 -- 172.21.15.33:0/725341022 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0b0810 con 0x55b8d6523660 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.874+0000 7f94ad8e8740 1 -- 172.21.15.33:0/725341022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 msgr2=0x55b8d68f6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.874+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/725341022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68f6d90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f949c01b000 tx=0x7f949c007940 comp rx=0 tx=0).stop 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.874+0000 7f94ad8e8740 1 -- 172.21.15.33:0/725341022 shutdown_connections 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.874+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/725341022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d654c520 0x55b8d68ef160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.874+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/725341022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d652b840 0x55b8d68f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.874+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/725341022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d6523660 0x55b8d68f6d90 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.874+0000 7f94ad8e8740 1 -- 172.21.15.33:0/725341022 >> 172.21.15.33:0/725341022 conn(0x55b8d6540910 msgr2=0x55b8d68fbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.874+0000 7f94ad8e8740 1 -- 172.21.15.33:0/725341022 shutdown_connections 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.874+0000 7f94ad8e8740 1 -- 172.21.15.33:0/725341022 wait complete. 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.874+0000 7f94ad8e8740 1 -- start start 2024-08-28T19:40:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94ad8e8740 1 Processor -- start 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d6523660 0x55b8d6901c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d69021b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94ad8e8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d654c520 0x55b8d697d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f94a01afd00 con 0x55b8d652b840 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94a01af630 con 0x55b8d654c520 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94ad8e8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94a01ac890 con 0x55b8d6523660 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94ad8e8740 10 client.0 _ll_register_callbacks cb 0x7f949c007f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94a490e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d69021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94a490e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d69021b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43014/0 (socket says 172.21.15.33:43014) 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94a490e640 1 -- 172.21.15.33:0/311357392 learned_addr learned my addr 172.21.15.33:0/311357392 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94a5910640 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d654c520 0x55b8d697d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.875+0000 7f94a510f640 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d6523660 0x55b8d6901c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f94a490e640 1 -- 172.21.15.33:0/311357392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d6523660 msgr2=0x55b8d6901c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f94a490e640 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d6523660 0x55b8d6901c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f94a490e640 1 -- 172.21.15.33:0/311357392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d654c520 msgr2=0x55b8d697d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f94a490e640 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d654c520 0x55b8d697d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f94a490e640 1 -- 172.21.15.33:0/311357392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8d697ddd0 con 0x55b8d652b840 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f94a490e640 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d69021b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f949000a650 tx=0x7f9490010670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d92c28be60c966 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f9488ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f9488ff9640 1 -- 172.21.15.33:0/311357392 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949001d040 con 0x55b8d652b840 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f94ad8e8740 1 -- 172.21.15.33:0/311357392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f949c0ac6a0 con 0x55b8d652b840 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f9488ff9640 1 -- 172.21.15.33:0/311357392 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f949000fc90 con 0x55b8d652b840 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f9488ff9640 1 -- 172.21.15.33:0/311357392 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f949003b050 con 0x55b8d652b840 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f94ad8e8740 10 client.17874 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.876+0000 7f94ad8e8740 1 -- 172.21.15.33:0/311357392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b8d697ef60 con 0x55b8d652b840 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.877+0000 7f9488ff9640 1 -- 172.21.15.33:0/311357392 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f949c0ac6a0 con 0x55b8d652b840 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.877+0000 7f9488ff9640 1 -- 172.21.15.33:0/311357392 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9490004660 con 0x55b8d652b840 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.877+0000 7f94ad8e8740 10 client.17874 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.877+0000 7f94ad8e8740 10 client.17874 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.877+0000 7f94ad8e8740 20 client.17874 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.877+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b8d64e0250 0x55b8d6981410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.877+0000 7f94ad8e8740 4 client.17874 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bfc46141", "release": true, "await": true}] 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.877+0000 7f94ad8e8740 1 -- 172.21.15.33:0/311357392 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bfc46141", "release": true, "await": true}) -- 0x55b8d6866460 con 0x55b8d64e0250 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.877+0000 7f94a510f640 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b8d64e0250 0x55b8d6981410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.877+0000 7f9488ff9640 10 client.17874 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:57.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.878+0000 7f94a510f640 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b8d64e0250 0x55b8d6981410 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b65f88239a611fc server_cookie=f751b890cf155cbd in_seq=0 out_seq=0 2024-08-28T19:40:57.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f9488ff9640 1 -- 172.21.15.33:0/311357392 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b8d6866460 con 0x55b8d64e0250 2024-08-28T19:40:57.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f9488ff9640 10 client.17874 handle_command_reply: tid=0 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 client.17874 shutdown 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 -- 172.21.15.33:0/311357392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 msgr2=0x55b8d69021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d69021b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f949000a650 tx=0x7f9490010670 comp rx=0 tx=0).stop 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 -- 172.21.15.33:0/311357392 shutdown_connections 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8d654c520 0x55b8d697d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b8d64e0250 0x55b8d6981410 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b8d652b840 0x55b8d69021b0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 --2- 172.21.15.33:0/311357392 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8d6523660 0x55b8d6901c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 -- 172.21.15.33:0/311357392 >> 172.21.15.33:0/311357392 conn(0x55b8d6540910 msgr2=0x55b8d68f6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f9488ff9640 0 client.17874 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 -- 172.21.15.33:0/311357392 shutdown_connections 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 1 -- 172.21.15.33:0/311357392 wait complete. 2024-08-28T19:40:57.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.881+0000 7f94ad8e8740 20 client.17874 trim_cache size 0 max 16384 2024-08-28T19:40:57.885 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:40:57.885 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:40:57.885 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:40:57.885 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 24, 2024-08-28T19:40:57.885 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:40:57.885 INFO:teuthology.orchestra.run.smithi033.stdout: "bfc46141": { 2024-08-28T19:40:57.885 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 24, 2024-08-28T19:40:57.885 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:40:57.885 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:40:57.885 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 139.5, 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:57.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:40:57.887 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:40:57.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 -- 172.21.15.33:0/821656180 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f948c0b4d50 msgr2=0x7f948c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:57.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f948c0b4d50 0x7f948c0b7260 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9498006010 tx=0x7f94980058d0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 -- 172.21.15.33:0/821656180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94a0102820 msgr2=0x7f94a019a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:57.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94a0102820 0x7f94a019a1d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f949c00cce0 tx=0x7f949c00a620 comp rx=0 tx=0).stop 2024-08-28T19:40:57.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 -- 172.21.15.33:0/821656180 shutdown_connections 2024-08-28T19:40:57.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a0108ab0 0x7f94a019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f948c0b4d50 0x7f948c0b7260 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94a0108160 0x7f94a019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 --2- 172.21.15.33:0/821656180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94a0102820 0x7f94a019a1d0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:57.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 -- 172.21.15.33:0/821656180 >> 172.21.15.33:0/821656180 conn(0x7f94a00794e0 msgr2=0x7f94a006bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:57.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 -- 172.21.15.33:0/821656180 shutdown_connections 2024-08-28T19:40:57.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:57.882+0000 7f94a7373640 1 -- 172.21.15.33:0/821656180 wait complete. 2024-08-28T19:40:58.136 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:40:58.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:58 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:40:58.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:58 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:40:58.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:58 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:40:58.694 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bfc46141', total seconds elapsed: 23.9 2024-08-28T19:40:58.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:58 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:40:58.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:58 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:40:58.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:58 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:40:58.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:58 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:40:58.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:58 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:40:58.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:58 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:40:59.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.161+0000 7f085ab8d640 1 -- 172.21.15.33:0/2784201295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08541081c0 msgr2=0x7f08541085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:59.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.161+0000 7f085ab8d640 1 --2- 172.21.15.33:0/2784201295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08541081c0 0x7f08541085d0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f0848009900 tx=0x7f084802a410 comp rx=0 tx=0).stop 2024-08-28T19:40:59.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.161+0000 7f085ab8d640 1 -- 172.21.15.33:0/2784201295 shutdown_connections 2024-08-28T19:40:59.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.161+0000 7f085ab8d640 1 --2- 172.21.15.33:0/2784201295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0854108b10 0x7f085410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.161+0000 7f085ab8d640 1 --2- 172.21.15.33:0/2784201295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08541081c0 0x7f08541085d0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.161+0000 7f085ab8d640 1 --2- 172.21.15.33:0/2784201295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0854102880 0x7f0854102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.161+0000 7f085ab8d640 1 -- 172.21.15.33:0/2784201295 >> 172.21.15.33:0/2784201295 conn(0x7f0854079510 msgr2=0x7f0854079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:59.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.161+0000 7f085ab8d640 1 -- 172.21.15.33:0/2784201295 shutdown_connections 2024-08-28T19:40:59.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.161+0000 7f085ab8d640 1 -- 172.21.15.33:0/2784201295 wait complete. 2024-08-28T19:40:59.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f085ab8d640 1 Processor -- start 2024-08-28T19:40:59.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f085ab8d640 1 -- start start 2024-08-28T19:40:59.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f085ab8d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0854102880 0x7f085419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f085ab8d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08541081c0 0x7f085419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f085ab8d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0854108b10 0x7f085419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f085ab8d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f08541127f0 con 0x7f08541081c0 2024-08-28T19:40:59.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f085ab8d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0854112670 con 0x7f0854108b10 2024-08-28T19:40:59.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f085ab8d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0854112970 con 0x7f0854102880 2024-08-28T19:40:59.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f0853fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08541081c0 0x7f085419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f0853fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08541081c0 0x7f085419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53710/0 (socket says 172.21.15.33:53710) 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f0853fff640 1 -- 172.21.15.33:0/4264535828 learned_addr learned my addr 172.21.15.33:0/4264535828 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f085912a640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0854108b10 0x7f085419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f0858929640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0854102880 0x7f085419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f0853fff640 1 -- 172.21.15.33:0/4264535828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0854102880 msgr2=0x7f085419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f0853fff640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0854102880 0x7f085419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f0853fff640 1 -- 172.21.15.33:0/4264535828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0854108b10 msgr2=0x7f085419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.162+0000 7f0853fff640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0854108b10 0x7f085419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.163+0000 7f0853fff640 1 -- 172.21.15.33:0/4264535828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08541a02a0 con 0x7f08541081c0 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.163+0000 7f0858929640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0854102880 0x7f085419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.163+0000 7f0853fff640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08541081c0 0x7f085419a8d0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f084802a930 tx=0x7f0848004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.163+0000 7f0851ffb640 1 -- 172.21.15.33:0/4264535828 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084803f030 con 0x7f08541081c0 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.163+0000 7f0851ffb640 1 -- 172.21.15.33:0/4264535828 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0848003aa0 con 0x7f08541081c0 2024-08-28T19:40:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.163+0000 7f085ab8d640 1 -- 172.21.15.33:0/4264535828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08541a0530 con 0x7f08541081c0 2024-08-28T19:40:59.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.163+0000 7f0851ffb640 1 -- 172.21.15.33:0/4264535828 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848035070 con 0x7f08541081c0 2024-08-28T19:40:59.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.163+0000 7f085ab8d640 1 -- 172.21.15.33:0/4264535828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08541a6cf0 con 0x7f08541081c0 2024-08-28T19:40:59.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0861102740 1 Processor -- start 2024-08-28T19:40:59.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0861102740 1 -- start start 2024-08-28T19:40:59.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0851ffb640 1 -- 172.21.15.33:0/4264535828 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0848042030 con 0x7f08541081c0 2024-08-28T19:40:59.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0861102740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5f0a070 0x564de62af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0861102740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5ee11b0 0x564de62af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0861102740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee9390 0x564de62afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0861102740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564de6226680 con 0x564de5f0a070 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0861102740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564de6215c10 con 0x564de5ee11b0 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0861102740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564de6219bc0 con 0x564de5ee9390 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f085912a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5f0a070 0x564de62af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f085912a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5f0a070 0x564de62af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53714/0 (socket says 172.21.15.33:53714) 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f085912a640 1 -- 172.21.15.33:0/2100394624 learned_addr learned my addr 172.21.15.33:0/2100394624 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0858929640 1 --2- 172.21.15.33:0/2100394624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5ee11b0 0x564de62af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f0853fff640 1 --2- 172.21.15.33:0/2100394624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee9390 0x564de62afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.166+0000 7f085912a640 1 -- 172.21.15.33:0/2100394624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee9390 msgr2=0x564de62afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f085912a640 1 --2- 172.21.15.33:0/2100394624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee9390 0x564de62afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f085912a640 1 -- 172.21.15.33:0/2100394624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5ee11b0 msgr2=0x564de62af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f085912a640 1 --2- 172.21.15.33:0/2100394624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5ee11b0 0x564de62af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f085912a640 1 -- 172.21.15.33:0/2100394624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564de5f75650 con 0x564de5f0a070 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f0851ffb640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f083c0b4ca0 0x7f083c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f085912a640 1 --2- 172.21.15.33:0/2100394624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5f0a070 0x564de62af350 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f084c009f20 tx=0x7f084c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5089743c1e37a68d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f0858929640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f083c0b4ca0 0x7f083c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f0851ffb640 1 -- 172.21.15.33:0/4264535828 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f0848105e70 con 0x7f08541081c0 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f083affd640 1 -- 172.21.15.33:0/2100394624 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c01a070 con 0x564de5f0a070 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f083affd640 1 -- 172.21.15.33:0/2100394624 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f084c0158c0 con 0x564de5f0a070 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.167+0000 7f083affd640 1 -- 172.21.15.33:0/2100394624 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c00a820 con 0x564de5f0a070 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0861102740 1 -- 172.21.15.33:0/2100394624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5f0a070 msgr2=0x564de62af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0861102740 1 --2- 172.21.15.33:0/2100394624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5f0a070 0x564de62af350 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f084c009f20 tx=0x7f084c00c8b0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0858929640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f083c0b4ca0 0x7f083c0b71b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x564de62adfd0 tx=0x7f08440094a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0861102740 1 -- 172.21.15.33:0/2100394624 shutdown_connections 2024-08-28T19:40:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0861102740 1 --2- 172.21.15.33:0/2100394624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee9390 0x564de62afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0861102740 1 --2- 172.21.15.33:0/2100394624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5ee11b0 0x564de62af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0861102740 1 --2- 172.21.15.33:0/2100394624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5f0a070 0x564de62af350 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0861102740 1 -- 172.21.15.33:0/2100394624 >> 172.21.15.33:0/2100394624 conn(0x564de5efe460 msgr2=0x564de62ad240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0861102740 1 -- 172.21.15.33:0/2100394624 shutdown_connections 2024-08-28T19:40:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0861102740 1 -- 172.21.15.33:0/2100394624 wait complete. 2024-08-28T19:40:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.168+0000 7f0861102740 1 -- start start 2024-08-28T19:40:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0861102740 1 Processor -- start 2024-08-28T19:40:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0861102740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 0x564de62baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0861102740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62baff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0861102740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5f0a070 0x564de62c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0861102740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564de6078700 con 0x564de5ee9390 2024-08-28T19:40:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0861102740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564de619c750 con 0x564de5f0a070 2024-08-28T19:40:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0861102740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564de62bdb30 con 0x564de5ee11b0 2024-08-28T19:40:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0861102740 10 client.0 _ll_register_callbacks cb 0x564de61cbe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0853fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62baff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0853fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62baff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53720/0 (socket says 172.21.15.33:53720) 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0853fff640 1 -- 172.21.15.33:0/2347253375 learned_addr learned my addr 172.21.15.33:0/2347253375 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f0858929640 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 0x564de62baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.169+0000 7f085912a640 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5f0a070 0x564de62c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0853fff640 1 -- 172.21.15.33:0/2347253375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 msgr2=0x564de62baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0853fff640 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 0x564de62baab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0853fff640 1 -- 172.21.15.33:0/2347253375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5f0a070 msgr2=0x564de62c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0853fff640 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5f0a070 0x564de62c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0853fff640 1 -- 172.21.15.33:0/2347253375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564de61d5900 con 0x564de5ee9390 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0853fff640 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62baff0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f0848031440 tx=0x7f0848003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959f58c5ca7f6041 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0833fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0833fff640 1 -- 172.21.15.33:0/2347253375 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848049070 con 0x564de5ee9390 2024-08-28T19:40:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0833fff640 1 -- 172.21.15.33:0/2347253375 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f08480c8450 con 0x564de5ee9390 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0861102740 1 -- 172.21.15.33:0/2347253375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f084c0158c0 con 0x564de5ee9390 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0833fff640 1 -- 172.21.15.33:0/2347253375 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f08480cbcd0 con 0x564de5ee9390 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0861102740 10 client.17886 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0861102740 1 -- 172.21.15.33:0/2347253375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564de62c98f0 con 0x564de5ee9390 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.170+0000 7f0833fff640 1 -- 172.21.15.33:0/2347253375 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f084c0158c0 con 0x564de5ee9390 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.171+0000 7f0833fff640 1 -- 172.21.15.33:0/2347253375 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f08480cc420 con 0x564de5ee9390 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.171+0000 7f0861102740 10 client.17886 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.171+0000 7f0861102740 10 client.17886 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.171+0000 7f0861102740 20 client.17886 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.171+0000 7f0861102740 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x564de5ec89f0 0x564de62ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.171+0000 7f0861102740 4 client.17886 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.171+0000 7f0861102740 1 -- 172.21.15.33:0/2347253375 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564de62285d0 con 0x564de5ec89f0 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.171+0000 7f0858929640 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x564de5ec89f0 0x564de62ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.171+0000 7f0833fff640 10 client.17886 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.171+0000 7f0858929640 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x564de5ec89f0 0x564de62ccd60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c55f16cf362bdfc7 server_cookie=c0596faede03e9bb in_seq=0 out_seq=0 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0833fff640 1 -- 172.21.15.33:0/2347253375 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564de62285d0 con 0x564de5ec89f0 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0833fff640 10 client.17886 handle_command_reply: tid=0 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 client.17886 shutdown 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 -- 172.21.15.33:0/2347253375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 msgr2=0x564de62baff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62baff0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f0848031440 tx=0x7f0848003f50 comp rx=0 tx=0).stop 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 -- 172.21.15.33:0/2347253375 shutdown_connections 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5f0a070 0x564de62c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x564de5ec89f0 0x564de62ccd60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62baff0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 --2- 172.21.15.33:0/2347253375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 0x564de62baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 -- 172.21.15.33:0/2347253375 >> 172.21.15.33:0/2347253375 conn(0x564de5efe460 msgr2=0x564de62b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0833fff640 0 client.17886 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 -- 172.21.15.33:0/2347253375 shutdown_connections 2024-08-28T19:40:59.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.172+0000 7f0861102740 1 -- 172.21.15.33:0/2347253375 wait complete. 2024-08-28T19:40:59.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.173+0000 7f0861102740 20 client.17886 trim_cache size 0 max 16384 2024-08-28T19:40:59.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0861102740 1 Processor -- start 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0861102740 1 -- start start 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0861102740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee11b0 0x564de62b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0861102740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5ee9390 0x564de62c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0861102740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5f0a070 0x564de62acb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0861102740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f08541b0d00 con 0x564de5ee11b0 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0861102740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08541b2840 con 0x564de5ee9390 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0861102740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f08541b13d0 con 0x564de5f0a070 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0858929640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee11b0 0x564de62b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0858929640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee11b0 0x564de62b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53732/0 (socket says 172.21.15.33:53732) 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0858929640 1 -- 172.21.15.33:0/861177240 learned_addr learned my addr 172.21.15.33:0/861177240 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:59.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f085912a640 1 --2- 172.21.15.33:0/861177240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5f0a070 0x564de62acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.186+0000 7f0853fff640 1 --2- 172.21.15.33:0/861177240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5ee9390 0x564de62c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.187+0000 7f0858929640 1 -- 172.21.15.33:0/861177240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5f0a070 msgr2=0x564de62acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:59.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.187+0000 7f0858929640 1 --2- 172.21.15.33:0/861177240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5f0a070 0x564de62acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.187+0000 7f0858929640 1 -- 172.21.15.33:0/861177240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5ee9390 msgr2=0x564de62c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:59.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.187+0000 7f0858929640 1 --2- 172.21.15.33:0/861177240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5ee9390 0x564de62c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.187+0000 7f0858929640 1 -- 172.21.15.33:0/861177240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564de62bd1f0 con 0x564de5ee11b0 2024-08-28T19:40:59.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.187+0000 7f0858929640 1 --2- 172.21.15.33:0/861177240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee11b0 0x564de62b2b60 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f0844012820 tx=0x7f0844014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9bc6db4fcd220 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:59.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.187+0000 7f083a7fc640 1 -- 172.21.15.33:0/861177240 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084402e070 con 0x564de5ee11b0 2024-08-28T19:40:59.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.187+0000 7f083a7fc640 1 -- 172.21.15.33:0/861177240 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0844021df0 con 0x564de5ee11b0 2024-08-28T19:40:59.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.187+0000 7f083a7fc640 1 -- 172.21.15.33:0/861177240 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084401f800 con 0x564de5ee11b0 2024-08-28T19:40:59.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 -- 172.21.15.33:0/861177240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee11b0 msgr2=0x564de62b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:59.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 --2- 172.21.15.33:0/861177240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee11b0 0x564de62b2b60 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f0844012820 tx=0x7f0844014000 comp rx=0 tx=0).stop 2024-08-28T19:40:59.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 -- 172.21.15.33:0/861177240 shutdown_connections 2024-08-28T19:40:59.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 --2- 172.21.15.33:0/861177240 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5f0a070 0x564de62acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 --2- 172.21.15.33:0/861177240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5ee9390 0x564de62c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 --2- 172.21.15.33:0/861177240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee11b0 0x564de62b2b60 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 -- 172.21.15.33:0/861177240 >> 172.21.15.33:0/861177240 conn(0x564de5efe460 msgr2=0x564de62b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 -- 172.21.15.33:0/861177240 shutdown_connections 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 -- 172.21.15.33:0/861177240 wait complete. 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 -- start start 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.188+0000 7f0861102740 1 Processor -- start 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0861102740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 0x564de62bf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0861102740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0861102740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5f0a070 0x564de6334a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0861102740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f08541b2170 con 0x564de5ee9390 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0861102740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08541b1aa0 con 0x564de5f0a070 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0861102740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f08541aed00 con 0x564de5ee11b0 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0861102740 10 client.0 _ll_register_callbacks cb 0x7f0848005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:40:59.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0853fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0853fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62bfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53746/0 (socket says 172.21.15.33:53746) 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0853fff640 1 -- 172.21.15.33:0/2331153786 learned_addr learned my addr 172.21.15.33:0/2331153786 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f0858929640 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 0x564de62bf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.189+0000 7f085912a640 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5f0a070 0x564de6334a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0858929640 1 -- 172.21.15.33:0/2331153786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5f0a070 msgr2=0x564de6334a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0858929640 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5f0a070 0x564de6334a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0858929640 1 -- 172.21.15.33:0/2331153786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 msgr2=0x564de62bfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0858929640 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62bfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0858929640 1 -- 172.21.15.33:0/2331153786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564de63350e0 con 0x564de5ee11b0 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0853fff640 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0858929640 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 0x564de62bf6c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0844009750 tx=0x7f0844005f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ebc5724a30a3569 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0833fff640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0833fff640 1 -- 172.21.15.33:0/2331153786 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844037060 con 0x564de5ee11b0 2024-08-28T19:40:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0861102740 1 -- 172.21.15.33:0/2331153786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0844021df0 con 0x564de5ee11b0 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0833fff640 1 -- 172.21.15.33:0/2331153786 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f0844021940 con 0x564de5ee11b0 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0833fff640 1 -- 172.21.15.33:0/2331153786 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f084403e050 con 0x564de5ee11b0 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0861102740 10 client.26929 fetch_fsmap learned FSMap version 28 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.190+0000 7f0861102740 1 -- 172.21.15.33:0/2331153786 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564de633c400 con 0x564de5ee11b0 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.191+0000 7f0833fff640 1 -- 172.21.15.33:0/2331153786 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0844021df0 con 0x564de5ee11b0 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.191+0000 7f0833fff640 1 -- 172.21.15.33:0/2331153786 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f084400f040 con 0x564de5ee11b0 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.191+0000 7f0861102740 10 client.26929 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.191+0000 7f0861102740 10 client.26929 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.191+0000 7f0861102740 20 client.26929 populate_metadata read hostname 'smithi033' 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.191+0000 7f0861102740 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x564de5e9dda0 0x564de633eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.191+0000 7f0861102740 4 client.26929 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.191+0000 7f0861102740 1 -- 172.21.15.33:0/2331153786 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564de6224070 con 0x564de5e9dda0 2024-08-28T19:40:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.191+0000 7f0853fff640 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x564de5e9dda0 0x564de633eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:40:59.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.191+0000 7f0833fff640 10 client.26929 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:40:59.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0853fff640 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x564de5e9dda0 0x564de633eb50 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=910b77d34ba43df6 server_cookie=1d83e08a84062776 in_seq=0 out_seq=0 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0833fff640 1 -- 172.21.15.33:0/2331153786 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564de6224070 con 0x564de5e9dda0 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0833fff640 10 client.26929 handle_command_reply: tid=0 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 client.26929 shutdown 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 -- 172.21.15.33:0/2331153786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 msgr2=0x564de62bf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 0x564de62bf6c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0844009750 tx=0x7f0844005f30 comp rx=0 tx=0).stop 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 -- 172.21.15.33:0/2331153786 shutdown_connections 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564de5f0a070 0x564de6334a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x564de5e9dda0 0x564de633eb50 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564de5ee9390 0x564de62bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 --2- 172.21.15.33:0/2331153786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564de5ee11b0 0x564de62bf6c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0833fff640 0 client.26929 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:40:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 -- 172.21.15.33:0/2331153786 >> 172.21.15.33:0/2331153786 conn(0x564de5efe460 msgr2=0x564de62aca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 -- 172.21.15.33:0/2331153786 shutdown_connections 2024-08-28T19:40:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 1 -- 172.21.15.33:0/2331153786 wait complete. 2024-08-28T19:40:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.192+0000 7f0861102740 20 client.26929 trim_cache size 0 max 16384 2024-08-28T19:40:59.198 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:40:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 -- 172.21.15.33:0/4264535828 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f083c0b4ca0 msgr2=0x7f083c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f083c0b4ca0 0x7f083c0b71b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x564de62adfd0 tx=0x7f08440094a0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 -- 172.21.15.33:0/4264535828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08541081c0 msgr2=0x7f085419a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:40:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08541081c0 0x7f085419a8d0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f084802a930 tx=0x7f0848004270 comp rx=0 tx=0).stop 2024-08-28T19:40:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 -- 172.21.15.33:0/4264535828 shutdown_connections 2024-08-28T19:40:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0854108b10 0x7f085419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08541081c0 0x7f085419a8d0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f083c0b4ca0 0x7f083c0b71b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 --2- 172.21.15.33:0/4264535828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0854102880 0x7f085419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:40:59.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 -- 172.21.15.33:0/4264535828 >> 172.21.15.33:0/4264535828 conn(0x7f0854079510 msgr2=0x7f085406bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:40:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 -- 172.21.15.33:0/4264535828 shutdown_connections 2024-08-28T19:40:59.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:40:59.193+0000 7f085ab8d640 1 -- 172.21.15.33:0/4264535828 wait complete. 2024-08-28T19:40:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:40:59 smithi059 ceph-mon[22052]: pgmap v602: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-08-28T19:40:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:40:59 smithi122 ceph-mon[22174]: pgmap v602: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-08-28T19:40:59.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:40:59 smithi033 ceph-mon[18549]: pgmap v602: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-08-28T19:40:59.885 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:41:00.142 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:00.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.654+0000 7f059d4b9640 1 -- 172.21.15.33:0/1756239784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0598109b90 msgr2=0x7f05981103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:00.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.654+0000 7f059d4b9640 1 --2- 172.21.15.33:0/1756239784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0598109b90 0x7f05981103c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f0590009ca0 tx=0x7f059002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.654+0000 7f059d4b9640 1 -- 172.21.15.33:0/1756239784 shutdown_connections 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.654+0000 7f059d4b9640 1 --2- 172.21.15.33:0/1756239784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0598109b90 0x7f05981103c0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.654+0000 7f059d4b9640 1 --2- 172.21.15.33:0/1756239784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0598109240 0x7f0598109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.654+0000 7f059d4b9640 1 --2- 172.21.15.33:0/1756239784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0598103900 0x7f0598103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.654+0000 7f059d4b9640 1 -- 172.21.15.33:0/1756239784 >> 172.21.15.33:0/1756239784 conn(0x7f059807b5f0 msgr2=0x7f059807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.654+0000 7f059d4b9640 1 -- 172.21.15.33:0/1756239784 shutdown_connections 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.654+0000 7f059d4b9640 1 -- 172.21.15.33:0/1756239784 wait complete. 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.655+0000 7f059d4b9640 1 Processor -- start 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.655+0000 7f059d4b9640 1 -- start start 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.655+0000 7f059d4b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0598103900 0x7f059819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.655+0000 7f059d4b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0598109240 0x7f059819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f059d4b9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0598109b90 0x7f059819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f059d4b9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0598113850 con 0x7f0598109b90 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f059d4b9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f05981136d0 con 0x7f0598103900 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f059d4b9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05981139d0 con 0x7f0598109240 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f05977fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0598109b90 0x7f059819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f05977fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0598109b90 0x7f059819fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53760/0 (socket says 172.21.15.33:53760) 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f0596ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0598103900 0x7f059819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f05977fe640 1 -- 172.21.15.33:0/612037872 learned_addr learned my addr 172.21.15.33:0/612037872 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f05967fc640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0598109240 0x7f059819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f05977fe640 1 -- 172.21.15.33:0/612037872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0598109240 msgr2=0x7f059819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f05977fe640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0598109240 0x7f059819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f05977fe640 1 -- 172.21.15.33:0/612037872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0598103900 msgr2=0x7f059819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f05977fe640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0598103900 0x7f059819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f05977fe640 1 -- 172.21.15.33:0/612037872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05981a0190 con 0x7f0598109b90 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f0596ffd640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0598103900 0x7f059819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f05977fe640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0598109b90 0x7f059819fa60 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f0590005cc0 tx=0x7f0590031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.656+0000 7f057ffff640 1 -- 172.21.15.33:0/612037872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0590003b70 con 0x7f0598109b90 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.657+0000 7f059d4b9640 1 -- 172.21.15.33:0/612037872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05981a0420 con 0x7f0598109b90 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.657+0000 7f057ffff640 1 -- 172.21.15.33:0/612037872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05900318f0 con 0x7f0598109b90 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.657+0000 7f057ffff640 1 -- 172.21.15.33:0/612037872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059002f950 con 0x7f0598109b90 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.657+0000 7f059d4b9640 1 -- 172.21.15.33:0/612037872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05981a6be0 con 0x7f0598109b90 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.659+0000 7f05a3a2e740 1 Processor -- start 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.659+0000 7f057ffff640 1 -- 172.21.15.33:0/612037872 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f059002fb50 con 0x7f0598109b90 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.659+0000 7f05a3a2e740 1 -- start start 2024-08-28T19:41:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.659+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b783070 0x56251bb28310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.659+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b75a1b0 0x56251bb28850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.659+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb28d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.659+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56251ba9f680 con 0x56251b762390 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.659+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56251ba8ec10 con 0x56251b783070 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.659+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56251ba92bc0 con 0x56251b75a1b0 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05967fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb28d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05967fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb28d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53766/0 (socket says 172.21.15.33:53766) 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05967fc640 1 -- 172.21.15.33:0/2777077989 learned_addr learned my addr 172.21.15.33:0/2777077989 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f0596ffd640 1 --2- 172.21.15.33:0/2777077989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b75a1b0 0x56251bb28850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05967fc640 1 --2- 172.21.15.33:0/2777077989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b783070 0x56251bb28310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05967fc640 1 -- 172.21.15.33:0/2777077989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b75a1b0 msgr2=0x56251bb28850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f057ffff640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05800b4ca0 0x7f05800b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05967fc640 1 --2- 172.21.15.33:0/2777077989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b75a1b0 0x56251bb28850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05967fc640 1 -- 172.21.15.33:0/2777077989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b783070 msgr2=0x56251bb28310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05967fc640 1 --2- 172.21.15.33:0/2777077989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b783070 0x56251bb28310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05967fc640 1 -- 172.21.15.33:0/2777077989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56251b7ee650 con 0x56251b762390 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05977fe640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05800b4ca0 0x7f05800b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f05967fc640 1 --2- 172.21.15.33:0/2777077989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb28d90 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f058c009fb0 tx=0x7f058c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d3dc2564e69265 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f057ffff640 1 -- 172.21.15.33:0/612037872 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f0590106a20 con 0x7f0598109b90 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.660+0000 7f057d7fa640 1 -- 172.21.15.33:0/2777077989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c004050 con 0x56251b762390 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.661+0000 7f057d7fa640 1 -- 172.21.15.33:0/2777077989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f058c0041f0 con 0x56251b762390 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.661+0000 7f057d7fa640 1 -- 172.21.15.33:0/2777077989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c01d5e0 con 0x56251b762390 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.661+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2777077989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 msgr2=0x56251bb28d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.661+0000 7f05977fe640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05800b4ca0 0x7f05800b71b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f05900ccd00 tx=0x7f059009a320 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:00.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.661+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/2777077989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb28d90 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f058c009fb0 tx=0x7f058c005850 comp rx=0 tx=0).stop 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.661+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2777077989 shutdown_connections 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.661+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/2777077989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb28d90 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.661+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/2777077989 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b75a1b0 0x56251bb28850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.661+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/2777077989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b783070 0x56251bb28310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.661+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2777077989 >> 172.21.15.33:0/2777077989 conn(0x56251b777460 msgr2=0x56251bb26200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2777077989 shutdown_connections 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2777077989 wait complete. 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 1 -- start start 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 1 Processor -- start 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b75a1b0 0x56251bb33a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb33f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 0x56251bb3fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56251b8f1700 con 0x56251b762390 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56251ba15750 con 0x56251b75a1b0 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56251bb36af0 con 0x56251b783070 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f05a3a2e740 10 client.0 _ll_register_callbacks cb 0x56251ba44e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f0596ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb33f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f0596ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb33f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53772/0 (socket says 172.21.15.33:53772) 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.662+0000 7f0596ffd640 1 -- 172.21.15.33:0/1899375458 learned_addr learned my addr 172.21.15.33:0/1899375458 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f05967fc640 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 0x56251bb3fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f05967fc640 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b75a1b0 0x56251bb33a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f0596ffd640 1 -- 172.21.15.33:0/1899375458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 msgr2=0x56251bb3fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:00.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f0596ffd640 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 0x56251bb3fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f0596ffd640 1 -- 172.21.15.33:0/1899375458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b75a1b0 msgr2=0x56251bb33a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f0596ffd640 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b75a1b0 0x56251bb33a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f0596ffd640 1 -- 172.21.15.33:0/1899375458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56251ba4e900 con 0x56251b762390 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f05967fc640 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 0x56251bb3fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f0596ffd640 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb33f40 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f0588012d20 tx=0x7f058800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67725bf5ec1f2977 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f057aff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f057aff5640 1 -- 172.21.15.33:0/1899375458 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588012110 con 0x56251b762390 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f057aff5640 1 -- 172.21.15.33:0/1899375458 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f0588004050 con 0x56251b762390 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f05a3a2e740 1 -- 172.21.15.33:0/1899375458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f058c0041f0 con 0x56251b762390 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f057aff5640 1 -- 172.21.15.33:0/1899375458 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0588025050 con 0x56251b762390 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f05a3a2e740 10 client.17904 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.663+0000 7f05a3a2e740 1 -- 172.21.15.33:0/1899375458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56251bb428f0 con 0x56251b762390 2024-08-28T19:41:00.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.664+0000 7f057aff5640 1 -- 172.21.15.33:0/1899375458 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f058c0041f0 con 0x56251b762390 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.664+0000 7f057aff5640 1 -- 172.21.15.33:0/1899375458 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0588010430 con 0x56251b762390 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.664+0000 7f05a3a2e740 10 client.17904 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.664+0000 7f05a3a2e740 10 client.17904 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.664+0000 7f05a3a2e740 20 client.17904 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.664+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56251b7419f0 0x56251bb45e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.664+0000 7f05a3a2e740 4 client.17904 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.664+0000 7f05a3a2e740 1 -- 172.21.15.33:0/1899375458 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56251baa15d0 con 0x56251b7419f0 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.664+0000 7f05967fc640 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56251b7419f0 0x56251bb45e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.665+0000 7f05967fc640 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56251b7419f0 0x56251bb45e00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=be9d984ebe81448d server_cookie=ad909fcbad96128c in_seq=0 out_seq=0 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.665+0000 7f057aff5640 10 client.17904 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f057aff5640 1 -- 172.21.15.33:0/1899375458 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56251baa15d0 con 0x56251b7419f0 2024-08-28T19:41:00.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f057aff5640 10 client.17904 handle_command_reply: tid=0 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 client.17904 shutdown 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 -- 172.21.15.33:0/1899375458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 msgr2=0x56251bb33f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb33f40 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f0588012d20 tx=0x7f058800f790 comp rx=0 tx=0).stop 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 -- 172.21.15.33:0/1899375458 shutdown_connections 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56251b7419f0 0x56251bb45e00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 0x56251bb3fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb33f40 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/1899375458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b75a1b0 0x56251bb33a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 -- 172.21.15.33:0/1899375458 >> 172.21.15.33:0/1899375458 conn(0x56251b777460 msgr2=0x56251bb2b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f057aff5640 0 client.17904 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 -- 172.21.15.33:0/1899375458 shutdown_connections 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 1 -- 172.21.15.33:0/1899375458 wait complete. 2024-08-28T19:41:00.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.666+0000 7f05a3a2e740 20 client.17904 trim_cache size 0 max 16384 2024-08-28T19:41:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.680+0000 7f05a3a2e740 1 Processor -- start 2024-08-28T19:41:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.680+0000 7f05a3a2e740 1 -- start start 2024-08-28T19:41:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b75a1b0 0x56251bb3fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb30bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 0x56251bb31130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f05981b0be0 con 0x56251b762390 2024-08-28T19:41:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f05981b2720 con 0x56251b75a1b0 2024-08-28T19:41:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05981b12b0 con 0x56251b783070 2024-08-28T19:41:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f0596ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb30bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f0596ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb30bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53786/0 (socket says 172.21.15.33:53786) 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f0596ffd640 1 -- 172.21.15.33:0/3383629124 learned_addr learned my addr 172.21.15.33:0/3383629124 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f05967fc640 1 --2- 172.21.15.33:0/3383629124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b75a1b0 0x56251bb3fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f05967fc640 1 --2- 172.21.15.33:0/3383629124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 0x56251bb31130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f0596ffd640 1 -- 172.21.15.33:0/3383629124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 msgr2=0x56251bb31130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f0596ffd640 1 --2- 172.21.15.33:0/3383629124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 0x56251bb31130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f0596ffd640 1 -- 172.21.15.33:0/3383629124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b75a1b0 msgr2=0x56251bb3fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f0596ffd640 1 --2- 172.21.15.33:0/3383629124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b75a1b0 0x56251bb3fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f0596ffd640 1 -- 172.21.15.33:0/3383629124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56251bb34aa0 con 0x56251b762390 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.681+0000 7f0596ffd640 1 --2- 172.21.15.33:0/3383629124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb30bf0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f0588000c00 tx=0x7f058800fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a023056a35e78017 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.682+0000 7f057cff9640 1 -- 172.21.15.33:0/3383629124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880104f0 con 0x56251b762390 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.682+0000 7f057cff9640 1 -- 172.21.15.33:0/3383629124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0588005560 con 0x56251b762390 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.682+0000 7f057cff9640 1 -- 172.21.15.33:0/3383629124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880039b0 con 0x56251b762390 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 -- 172.21.15.33:0/3383629124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 msgr2=0x56251bb30bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/3383629124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb30bf0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f0588000c00 tx=0x7f058800fd30 comp rx=0 tx=0).stop 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 -- 172.21.15.33:0/3383629124 shutdown_connections 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/3383629124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b783070 0x56251bb31130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/3383629124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b762390 0x56251bb30bf0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/3383629124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b75a1b0 0x56251bb3fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 -- 172.21.15.33:0/3383629124 >> 172.21.15.33:0/3383629124 conn(0x56251b777460 msgr2=0x56251bb32280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 -- 172.21.15.33:0/3383629124 shutdown_connections 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 -- 172.21.15.33:0/3383629124 wait complete. 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 -- start start 2024-08-28T19:41:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.683+0000 7f05a3a2e740 1 Processor -- start 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b75a1b0 0x56251bb38570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b762390 0x56251bb38af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f05a3a2e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b783070 0x56251bbaf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f05981b2050 con 0x56251b783070 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f05981b1980 con 0x56251b762390 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f05a3a2e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05981aebe0 con 0x56251b75a1b0 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f05a3a2e740 10 client.0 _ll_register_callbacks cb 0x7f0588009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f0596ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b762390 0x56251bb38af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f0596ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b762390 0x56251bb38af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:39078/0 (socket says 172.21.15.33:39078) 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f0596ffd640 1 -- 172.21.15.33:0/2875121724 learned_addr learned my addr 172.21.15.33:0/2875121724 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f05967fc640 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b783070 0x56251bbaf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f05967fc640 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b75a1b0 0x56251bb38570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f0596ffd640 1 -- 172.21.15.33:0/2875121724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b75a1b0 msgr2=0x56251bb38570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f0596ffd640 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b75a1b0 0x56251bb38570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f0596ffd640 1 -- 172.21.15.33:0/2875121724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b783070 msgr2=0x56251bbaf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f0596ffd640 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b783070 0x56251bbaf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f0596ffd640 1 -- 172.21.15.33:0/2875121724 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56251bbafdd0 con 0x56251b762390 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.684+0000 7f05967fc640 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b783070 0x56251bbaf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.685+0000 7f0596ffd640 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b762390 0x56251bb38af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05880109f0 tx=0x7f0588010880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9a026729bfbc86f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.685+0000 7f057aff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.685+0000 7f057aff5640 1 -- 172.21.15.33:0/2875121724 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880050d0 con 0x56251b762390 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.685+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2875121724 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0588005560 con 0x56251b762390 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.685+0000 7f057aff5640 1 -- 172.21.15.33:0/2875121724 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f058802f040 con 0x56251b762390 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.685+0000 7f057aff5640 1 -- 172.21.15.33:0/2875121724 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f058803c050 con 0x56251b762390 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.685+0000 7f05a3a2e740 10 client.27026 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.685+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2875121724 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56251bbb1050 con 0x56251b762390 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f057aff5640 1 -- 172.21.15.33:0/2875121724 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0588005560 con 0x56251b762390 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f057aff5640 1 -- 172.21.15.33:0/2875121724 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0588033480 con 0x56251b762390 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f05a3a2e740 10 client.27026 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f05a3a2e740 10 client.27026 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f05a3a2e740 20 client.27026 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56251b716da0 0x56251bbb36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f05a3a2e740 4 client.27026 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2875121724 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56251ba9d070 con 0x56251b716da0 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f05967fc640 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56251b716da0 0x56251bbb36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f057aff5640 10 client.27026 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.686+0000 7f05967fc640 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56251b716da0 0x56251bbb36d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4c7b22a01e51374c server_cookie=5b70e7e2354d535e in_seq=0 out_seq=0 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f057aff5640 1 -- 172.21.15.33:0/2875121724 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56251ba9d070 con 0x56251b716da0 2024-08-28T19:41:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f057aff5640 10 client.27026 handle_command_reply: tid=0 2024-08-28T19:41:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 client.27026 shutdown 2024-08-28T19:41:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2875121724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b762390 msgr2=0x56251bb38af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b762390 0x56251bb38af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05880109f0 tx=0x7f0588010880 comp rx=0 tx=0).stop 2024-08-28T19:41:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2875121724 shutdown_connections 2024-08-28T19:41:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x56251b716da0 0x56251bbb36d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56251b783070 0x56251bbaf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56251b762390 0x56251bb38af0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 --2- 172.21.15.33:0/2875121724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56251b75a1b0 0x56251bb38570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f057aff5640 0 client.27026 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:41:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2875121724 >> 172.21.15.33:0/2875121724 conn(0x56251b777460 msgr2=0x56251bb29340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2875121724 shutdown_connections 2024-08-28T19:41:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 1 -- 172.21.15.33:0/2875121724 wait complete. 2024-08-28T19:41:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.687+0000 7f05a3a2e740 20 client.27026 trim_cache size 0 max 16384 2024-08-28T19:41:00.696 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:41:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 -- 172.21.15.33:0/612037872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05800b4ca0 msgr2=0x7f05800b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05800b4ca0 0x7f05800b71b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f05900ccd00 tx=0x7f059009a320 comp rx=0 tx=0).stop 2024-08-28T19:41:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 -- 172.21.15.33:0/612037872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0598109b90 msgr2=0x7f059819fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0598109b90 0x7f059819fa60 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f0590005cc0 tx=0x7f0590031700 comp rx=0 tx=0).stop 2024-08-28T19:41:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 -- 172.21.15.33:0/612037872 shutdown_connections 2024-08-28T19:41:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0598109b90 0x7f059819fa60 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05800b4ca0 0x7f05800b71b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0598109240 0x7f059819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 --2- 172.21.15.33:0/612037872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0598103900 0x7f059819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 -- 172.21.15.33:0/612037872 >> 172.21.15.33:0/612037872 conn(0x7f059807b5f0 msgr2=0x7f0598105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 -- 172.21.15.33:0/612037872 shutdown_connections 2024-08-28T19:41:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:00.688+0000 7f059d4b9640 1 -- 172.21.15.33:0/612037872 wait complete. 2024-08-28T19:41:01.337 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:41:01.590 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:01.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:01 smithi033 ceph-mon[18549]: pgmap v603: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-28T19:41:01.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:01 smithi059 ceph-mon[22052]: pgmap v603: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-28T19:41:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:01 smithi122 ceph-mon[22174]: pgmap v603: 129 pgs: 129 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-28T19:41:02.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.095+0000 7f405ffc0640 1 -- 172.21.15.33:0/3097841083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4058109bb0 msgr2=0x7f40581103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:02.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.095+0000 7f405ffc0640 1 --2- 172.21.15.33:0/3097841083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4058109bb0 0x7f40581103e0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f4050009ca0 tx=0x7f405002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.095+0000 7f405ffc0640 1 -- 172.21.15.33:0/3097841083 shutdown_connections 2024-08-28T19:41:02.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.095+0000 7f405ffc0640 1 --2- 172.21.15.33:0/3097841083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4058109bb0 0x7f40581103e0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.095+0000 7f405ffc0640 1 --2- 172.21.15.33:0/3097841083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4058109260 0x7f4058109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.095+0000 7f405ffc0640 1 --2- 172.21.15.33:0/3097841083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4058103920 0x7f4058103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.095+0000 7f405ffc0640 1 -- 172.21.15.33:0/3097841083 >> 172.21.15.33:0/3097841083 conn(0x7f40580ff3b0 msgr2=0x7f4058101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.095+0000 7f405ffc0640 1 -- 172.21.15.33:0/3097841083 shutdown_connections 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.095+0000 7f405ffc0640 1 -- 172.21.15.33:0/3097841083 wait complete. 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405ffc0640 1 Processor -- start 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405ffc0640 1 -- start start 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405ffc0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4058103920 0x7f40580754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405ffc0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4058109260 0x7f40580759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405ffc0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4058109bb0 0x7f4058075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405ffc0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4058113870 con 0x7f4058103920 2024-08-28T19:41:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405ffc0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f40581136f0 con 0x7f4058109260 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405ffc0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f40581139f0 con 0x7f4058109bb0 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405dd5c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4058103920 0x7f40580754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405dd5c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4058103920 0x7f40580754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53818/0 (socket says 172.21.15.33:53818) 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405dd5c640 1 -- 172.21.15.33:0/730119571 learned_addr learned my addr 172.21.15.33:0/730119571 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405e55d640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4058109bb0 0x7f4058075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405d55b640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4058109260 0x7f40580759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405dd5c640 1 -- 172.21.15.33:0/730119571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4058109bb0 msgr2=0x7f4058075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405dd5c640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4058109bb0 0x7f4058075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405dd5c640 1 -- 172.21.15.33:0/730119571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4058109260 msgr2=0x7f40580759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405dd5c640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4058109260 0x7f40580759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405dd5c640 1 -- 172.21.15.33:0/730119571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40581a8560 con 0x7f4058103920 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.096+0000 7f405e55d640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4058109bb0 0x7f4058075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.097+0000 7f405dd5c640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4058103920 0x7f40580754b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f405400d770 tx=0x7f405400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.097+0000 7f404effd640 1 -- 172.21.15.33:0/730119571 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054017070 con 0x7f4058103920 2024-08-28T19:41:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.097+0000 7f404effd640 1 -- 172.21.15.33:0/730119571 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40540054d0 con 0x7f4058103920 2024-08-28T19:41:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.097+0000 7f405ffc0640 1 -- 172.21.15.33:0/730119571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40581a8850 con 0x7f4058103920 2024-08-28T19:41:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.097+0000 7f404effd640 1 -- 172.21.15.33:0/730119571 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054004c30 con 0x7f4058103920 2024-08-28T19:41:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.097+0000 7f405ffc0640 1 -- 172.21.15.33:0/730119571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40581a8d90 con 0x7f4058103920 2024-08-28T19:41:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f4066535740 1 Processor -- start 2024-08-28T19:41:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f4066535740 1 -- start start 2024-08-28T19:41:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f404effd640 1 -- 172.21.15.33:0/730119571 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4054004e10 con 0x7f4058103920 2024-08-28T19:41:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f4066535740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f4066535740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f4066535740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 0x56040a1b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f4066535740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56040a12c680 con 0x560409de71b0 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f4066535740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56040a11bc10 con 0x560409def390 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f4066535740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56040a11fbc0 con 0x560409e10070 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f405dd5c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f405d55b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 0x56040a1b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f405dd5c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53822/0 (socket says 172.21.15.33:53822) 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f405dd5c640 1 -- 172.21.15.33:0/1071046373 learned_addr learned my addr 172.21.15.33:0/1071046373 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.100+0000 7f405e55d640 1 --2- 172.21.15.33:0/1071046373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f405dd5c640 1 -- 172.21.15.33:0/1071046373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 msgr2=0x56040a1b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:02.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f405dd5c640 1 --2- 172.21.15.33:0/1071046373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f405dd5c640 1 -- 172.21.15.33:0/1071046373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 msgr2=0x56040a1b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f405dd5c640 1 --2- 172.21.15.33:0/1071046373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 0x56040a1b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f405dd5c640 1 -- 172.21.15.33:0/1071046373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560409e7b650 con 0x560409de71b0 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f405d55b640 1 --2- 172.21.15.33:0/1071046373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 0x56040a1b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f404effd640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40440b4d20 0x7f40440b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f405dd5c640 1 --2- 172.21.15.33:0/1071046373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1b5890 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f40540e2740 tx=0x7f40540eba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a53962ae203d346 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f405e55d640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40440b4d20 0x7f40440b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f404effd640 1 -- 172.21.15.33:0/730119571 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f40540e5420 con 0x7f4058103920 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f4043fff640 1 -- 172.21.15.33:0/1071046373 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40540a7630 con 0x560409de71b0 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f4043fff640 1 -- 172.21.15.33:0/1071046373 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40540ab280 con 0x560409de71b0 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.101+0000 7f4043fff640 1 -- 172.21.15.33:0/1071046373 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40540aaee0 con 0x560409de71b0 2024-08-28T19:41:02.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.102+0000 7f4066535740 1 -- 172.21.15.33:0/1071046373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 msgr2=0x56040a1b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.102+0000 7f405e55d640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40440b4d20 0x7f40440b7230 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4050004af0 tx=0x7f4050005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.102+0000 7f4066535740 1 --2- 172.21.15.33:0/1071046373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1b5890 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f40540e2740 tx=0x7f40540eba90 comp rx=0 tx=0).stop 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.102+0000 7f4066535740 1 -- 172.21.15.33:0/1071046373 shutdown_connections 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.102+0000 7f4066535740 1 --2- 172.21.15.33:0/1071046373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 0x56040a1b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.102+0000 7f4066535740 1 --2- 172.21.15.33:0/1071046373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1b5890 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.102+0000 7f4066535740 1 --2- 172.21.15.33:0/1071046373 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.102+0000 7f4066535740 1 -- 172.21.15.33:0/1071046373 >> 172.21.15.33:0/1071046373 conn(0x560409e04460 msgr2=0x56040a1b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.102+0000 7f4066535740 1 -- 172.21.15.33:0/1071046373 shutdown_connections 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.102+0000 7f4066535740 1 -- 172.21.15.33:0/1071046373 wait complete. 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.103+0000 7f4066535740 1 -- start start 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.103+0000 7f4066535740 1 Processor -- start 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.103+0000 7f4066535740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409de71b0 0x56040a1c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f4066535740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1c1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f4066535740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f4066535740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560409f7e700 con 0x560409def390 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f4066535740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56040a0a2750 con 0x560409de71b0 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f4066535740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56040a1c3b30 con 0x560409e10070 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f4066535740 10 client.0 _ll_register_callbacks cb 0x56040a0d1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405d55b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405d55b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1c1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53828/0 (socket says 172.21.15.33:53828) 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405d55b640 1 -- 172.21.15.33:0/2774602971 learned_addr learned my addr 172.21.15.33:0/2774602971 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405dd5c640 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409de71b0 0x56040a1c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405e55d640 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405d55b640 1 -- 172.21.15.33:0/2774602971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 msgr2=0x56040a1cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405d55b640 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405d55b640 1 -- 172.21.15.33:0/2774602971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409de71b0 msgr2=0x56040a1c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:02.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405d55b640 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409de71b0 0x56040a1c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405d55b640 1 -- 172.21.15.33:0/2774602971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56040a0db900 con 0x560409def390 2024-08-28T19:41:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f405d55b640 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1c1010 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f404800d980 tx=0x7f404800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc17fb46a499bfb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f40417fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.104+0000 7f40417fa640 1 -- 172.21.15.33:0/2774602971 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048005020 con 0x560409def390 2024-08-28T19:41:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f40417fa640 1 -- 172.21.15.33:0/2774602971 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f40480051c0 con 0x560409def390 2024-08-28T19:41:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f4066535740 1 -- 172.21.15.33:0/2774602971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40540ab280 con 0x560409def390 2024-08-28T19:41:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f40417fa640 1 -- 172.21.15.33:0/2774602971 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40480053c0 con 0x560409def390 2024-08-28T19:41:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f4066535740 10 client.17922 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f4066535740 1 -- 172.21.15.33:0/2774602971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56040a1cf9c0 con 0x560409def390 2024-08-28T19:41:02.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f40417fa640 1 -- 172.21.15.33:0/2774602971 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40540ab280 con 0x560409def390 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f40417fa640 1 -- 172.21.15.33:0/2774602971 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4048019030 con 0x560409def390 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f4066535740 10 client.17922 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f4066535740 10 client.17922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f4066535740 20 client.17922 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f4066535740 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560409dce9f0 0x56040a1d2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f4066535740 4 client.17922 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.105+0000 7f4066535740 1 -- 172.21.15.33:0/2774602971 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56040a12e5d0 con 0x560409dce9f0 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.106+0000 7f405dd5c640 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560409dce9f0 0x56040a1d2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.106+0000 7f40417fa640 10 client.17922 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.106+0000 7f405dd5c640 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560409dce9f0 0x56040a1d2e90 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20a2a6972a44116c server_cookie=eac044ccbecc4b8b in_seq=0 out_seq=0 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f40417fa640 1 -- 172.21.15.33:0/2774602971 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56040a12e5d0 con 0x560409dce9f0 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f40417fa640 10 client.17922 handle_command_reply: tid=0 2024-08-28T19:41:02.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 client.17922 shutdown 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 -- 172.21.15.33:0/2774602971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 msgr2=0x56040a1c1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1c1010 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f404800d980 tx=0x7f404800de40 comp rx=0 tx=0).stop 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 -- 172.21.15.33:0/2774602971 shutdown_connections 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560409dce9f0 0x56040a1d2e90 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1c1010 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 --2- 172.21.15.33:0/2774602971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409de71b0 0x56040a1c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f40417fa640 0 client.17922 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 -- 172.21.15.33:0/2774602971 >> 172.21.15.33:0/2774602971 conn(0x560409e04460 msgr2=0x56040a1b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 -- 172.21.15.33:0/2774602971 shutdown_connections 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 1 -- 172.21.15.33:0/2774602971 wait complete. 2024-08-28T19:41:02.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.107+0000 7f4066535740 20 client.17922 trim_cache size 0 max 16384 2024-08-28T19:41:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f4066535740 1 Processor -- start 2024-08-28T19:41:02.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f4066535740 1 -- start start 2024-08-28T19:41:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f4066535740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409de71b0 0x56040a1c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f4066535740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f4066535740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409e10070 0x56040a1cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f4066535740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f40581b2f00 con 0x560409def390 2024-08-28T19:41:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f4066535740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f40581b4a40 con 0x560409e10070 2024-08-28T19:41:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f4066535740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f40581b35d0 con 0x560409de71b0 2024-08-28T19:41:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405d55b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405d55b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53836/0 (socket says 172.21.15.33:53836) 2024-08-28T19:41:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405d55b640 1 -- 172.21.15.33:0/98561802 learned_addr learned my addr 172.21.15.33:0/98561802 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:02.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405dd5c640 1 --2- 172.21.15.33:0/98561802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409de71b0 0x56040a1c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405e55d640 1 --2- 172.21.15.33:0/98561802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409e10070 0x56040a1cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405d55b640 1 -- 172.21.15.33:0/98561802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409de71b0 msgr2=0x56040a1c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405d55b640 1 --2- 172.21.15.33:0/98561802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409de71b0 0x56040a1c0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405d55b640 1 -- 172.21.15.33:0/98561802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409e10070 msgr2=0x56040a1cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405d55b640 1 --2- 172.21.15.33:0/98561802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409e10070 0x56040a1cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405d55b640 1 -- 172.21.15.33:0/98561802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56040a1bb700 con 0x560409def390 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405e55d640 1 --2- 172.21.15.33:0/98561802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409e10070 0x56040a1cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.121+0000 7f405d55b640 1 --2- 172.21.15.33:0/98561802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1ccd20 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f4048006010 tx=0x7f4048005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baca920c274d69e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.122+0000 7f40437fe640 1 -- 172.21.15.33:0/98561802 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404802b020 con 0x560409def390 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.122+0000 7f40437fe640 1 -- 172.21.15.33:0/98561802 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4048011440 con 0x560409def390 2024-08-28T19:41:02.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.122+0000 7f40437fe640 1 -- 172.21.15.33:0/98561802 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048027b60 con 0x560409def390 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.122+0000 7f4066535740 1 -- 172.21.15.33:0/98561802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 msgr2=0x56040a1ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.122+0000 7f4066535740 1 --2- 172.21.15.33:0/98561802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1ccd20 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f4048006010 tx=0x7f4048005970 comp rx=0 tx=0).stop 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.122+0000 7f4066535740 1 -- 172.21.15.33:0/98561802 shutdown_connections 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.122+0000 7f4066535740 1 --2- 172.21.15.33:0/98561802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409e10070 0x56040a1cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.122+0000 7f4066535740 1 --2- 172.21.15.33:0/98561802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409def390 0x56040a1ccd20 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.122+0000 7f4066535740 1 --2- 172.21.15.33:0/98561802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409de71b0 0x56040a1c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.123+0000 7f4066535740 1 -- 172.21.15.33:0/98561802 >> 172.21.15.33:0/98561802 conn(0x560409e04460 msgr2=0x56040a1c0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.123+0000 7f4066535740 1 -- 172.21.15.33:0/98561802 shutdown_connections 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.123+0000 7f4066535740 1 -- 172.21.15.33:0/98561802 wait complete. 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.123+0000 7f4066535740 1 -- start start 2024-08-28T19:41:02.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.123+0000 7f4066535740 1 Processor -- start 2024-08-28T19:41:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.123+0000 7f4066535740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.123+0000 7f4066535740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 0x56040a1c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.123+0000 7f4066535740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f4066535740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f40581b4370 con 0x560409de71b0 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f4066535740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f40581b3ca0 con 0x560409def390 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f4066535740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f40581b0f00 con 0x560409e10070 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f4066535740 10 client.0 _ll_register_callbacks cb 0x7f40480043f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405dd5c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405dd5c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53840/0 (socket says 172.21.15.33:53840) 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405dd5c640 1 -- 172.21.15.33:0/1240941813 learned_addr learned my addr 172.21.15.33:0/1240941813 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405e55d640 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405d55b640 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 0x56040a1c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405dd5c640 1 -- 172.21.15.33:0/1240941813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 msgr2=0x56040a1c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:02.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405dd5c640 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405dd5c640 1 -- 172.21.15.33:0/1240941813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 msgr2=0x56040a1c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405dd5c640 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 0x56040a1c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405dd5c640 1 -- 172.21.15.33:0/1240941813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56040a23c950 con 0x560409de71b0 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405e55d640 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405d55b640 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 0x56040a1c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f405dd5c640 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1c4e60 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f40540e2880 tx=0x7f40540e8f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa4ea9269b82b54 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f40417fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f40417fa640 1 -- 172.21.15.33:0/1240941813 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054020040 con 0x560409de71b0 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f40417fa640 1 -- 172.21.15.33:0/1240941813 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9453+0+0 (secure 0 0 0) 0x7f40540a7d60 con 0x560409de71b0 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.124+0000 7f4066535740 1 -- 172.21.15.33:0/1240941813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4048011440 con 0x560409de71b0 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f40417fa640 1 -- 172.21.15.33:0/1240941813 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40540ab0c0 con 0x560409de71b0 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f4066535740 10 client.17928 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f4066535740 1 -- 172.21.15.33:0/1240941813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56040a23db40 con 0x560409de71b0 2024-08-28T19:41:02.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f40417fa640 1 -- 172.21.15.33:0/1240941813 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4048011440 con 0x560409de71b0 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f40417fa640 1 -- 172.21.15.33:0/1240941813 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f40540b4ce0 con 0x560409de71b0 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f4066535740 10 client.17928 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f4066535740 10 client.17928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f4066535740 20 client.17928 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f4066535740 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560409da3da0 0x56040a23fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f4066535740 4 client.17928 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f4066535740 1 -- 172.21.15.33:0/1240941813 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56040a12a070 con 0x560409da3da0 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.125+0000 7f405d55b640 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560409da3da0 0x56040a23fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f40417fa640 10 client.17928 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f405d55b640 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560409da3da0 0x56040a23fe50 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e0c801ed52eaf80 server_cookie=4eb67d8122faa1a0 in_seq=0 out_seq=0 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f40417fa640 1 -- 172.21.15.33:0/1240941813 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56040a12a070 con 0x560409da3da0 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f40417fa640 10 client.17928 handle_command_reply: tid=0 2024-08-28T19:41:02.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 client.17928 shutdown 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 -- 172.21.15.33:0/1240941813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 msgr2=0x56040a1c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1c4e60 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f40540e2880 tx=0x7f40540e8f70 comp rx=0 tx=0).stop 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 -- 172.21.15.33:0/1240941813 shutdown_connections 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560409e10070 0x56040a1c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560409def390 0x56040a1c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560409da3da0 0x56040a23fe50 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 --2- 172.21.15.33:0/1240941813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560409de71b0 0x56040a1c4e60 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f40417fa640 0 client.17928 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 -- 172.21.15.33:0/1240941813 >> 172.21.15.33:0/1240941813 conn(0x560409e04460 msgr2=0x56040a1b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 -- 172.21.15.33:0/1240941813 shutdown_connections 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 1 -- 172.21.15.33:0/1240941813 wait complete. 2024-08-28T19:41:02.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.126+0000 7f4066535740 20 client.17928 trim_cache size 0 max 16384 2024-08-28T19:41:02.134 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:41:02.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 -- 172.21.15.33:0/730119571 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40440b4d20 msgr2=0x7f40440b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:02.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40440b4d20 0x7f40440b7230 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4050004af0 tx=0x7f4050005c30 comp rx=0 tx=0).stop 2024-08-28T19:41:02.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 -- 172.21.15.33:0/730119571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4058103920 msgr2=0x7f40580754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:02.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4058103920 0x7f40580754b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f405400d770 tx=0x7f405400dc30 comp rx=0 tx=0).stop 2024-08-28T19:41:02.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 -- 172.21.15.33:0/730119571 shutdown_connections 2024-08-28T19:41:02.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40440b4d20 0x7f40440b7230 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4058109bb0 0x7f4058075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4058109260 0x7f40580759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 --2- 172.21.15.33:0/730119571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4058103920 0x7f40580754b0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:02.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 -- 172.21.15.33:0/730119571 >> 172.21.15.33:0/730119571 conn(0x7f40580ff3b0 msgr2=0x7f4058106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:02.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 -- 172.21.15.33:0/730119571 shutdown_connections 2024-08-28T19:41:02.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:02.127+0000 7f405ffc0640 1 -- 172.21.15.33:0/730119571 wait complete. 2024-08-28T19:41:03.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:03 smithi059 ceph-mon[22052]: pgmap v604: 129 pgs: 129 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-08-28T19:41:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:03 smithi122 ceph-mon[22174]: pgmap v604: 129 pgs: 129 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-08-28T19:41:03.857 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:41:03.858 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:41:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:03 smithi033 ceph-mon[18549]: pgmap v604: 129 pgs: 129 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-08-28T19:41:04.126 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:04.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.622+0000 7f597c1a9640 1 -- 172.21.15.33:0/2513968506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59741024b0 msgr2=0x7f59741079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:04.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.622+0000 7f597c1a9640 1 --2- 172.21.15.33:0/2513968506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59741024b0 0x7f59741079c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f5964009900 tx=0x7f596402a410 comp rx=0 tx=0).stop 2024-08-28T19:41:04.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.622+0000 7f597c1a9640 1 -- 172.21.15.33:0/2513968506 shutdown_connections 2024-08-28T19:41:04.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.622+0000 7f597c1a9640 1 --2- 172.21.15.33:0/2513968506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597410c5f0 0x7f597410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.622+0000 7f597c1a9640 1 --2- 172.21.15.33:0/2513968506 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59741024b0 0x7f59741079c0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.622+0000 7f597c1a9640 1 --2- 172.21.15.33:0/2513968506 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5974069e80 0x7f5974107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.622+0000 7f597c1a9640 1 -- 172.21.15.33:0/2513968506 >> 172.21.15.33:0/2513968506 conn(0x7f59740775a0 msgr2=0x7f59740779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:04.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.622+0000 7f597c1a9640 1 -- 172.21.15.33:0/2513968506 shutdown_connections 2024-08-28T19:41:04.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.622+0000 7f597c1a9640 1 -- 172.21.15.33:0/2513968506 wait complete. 2024-08-28T19:41:04.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f597c1a9640 1 Processor -- start 2024-08-28T19:41:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f597c1a9640 1 -- start start 2024-08-28T19:41:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f597c1a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5974069e80 0x7f597419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f597c1a9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59741024b0 0x7f597419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f597c1a9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597410c5f0 0x7f597419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f597c1a9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5974113840 con 0x7f59741024b0 2024-08-28T19:41:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f597c1a9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f59741136c0 con 0x7f597410c5f0 2024-08-28T19:41:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f597c1a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f59741139c0 con 0x7f5974069e80 2024-08-28T19:41:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f5979744640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59741024b0 0x7f597419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f5979744640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59741024b0 0x7f597419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53868/0 (socket says 172.21.15.33:53868) 2024-08-28T19:41:04.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f5979744640 1 -- 172.21.15.33:0/1914073223 learned_addr learned my addr 172.21.15.33:0/1914073223 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.623+0000 7f5979f45640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5974069e80 0x7f597419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f5979744640 1 -- 172.21.15.33:0/1914073223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5974069e80 msgr2=0x7f597419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f5979744640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5974069e80 0x7f597419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f597a746640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597410c5f0 0x7f597419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f5979744640 1 -- 172.21.15.33:0/1914073223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597410c5f0 msgr2=0x7f597419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f5979744640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597410c5f0 0x7f597419fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f5979744640 1 -- 172.21.15.33:0/1914073223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59741a01e0 con 0x7f59741024b0 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f5979f45640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5974069e80 0x7f597419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f5979744640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59741024b0 0x7f597419a8d0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f5964032fd0 tx=0x7f5964004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f596affd640 1 -- 172.21.15.33:0/1914073223 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596403f030 con 0x7f59741024b0 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f596affd640 1 -- 172.21.15.33:0/1914073223 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5964004490 con 0x7f59741024b0 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f597c1a9640 1 -- 172.21.15.33:0/1914073223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59741a0470 con 0x7f59741024b0 2024-08-28T19:41:04.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f596affd640 1 -- 172.21.15.33:0/1914073223 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964035070 con 0x7f59741024b0 2024-08-28T19:41:04.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.624+0000 7f597c1a9640 1 -- 172.21.15.33:0/1914073223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59741a09a0 con 0x7f59741024b0 2024-08-28T19:41:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f598271e740 1 Processor -- start 2024-08-28T19:41:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f598271e740 1 -- start start 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f596affd640 1 -- 172.21.15.33:0/1914073223 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5964042030 con 0x7f59741024b0 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f598271e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f380780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f598271e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb1490 0x55713f380cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f598271e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb9670 0x55713f381200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f598271e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55713f2f65f0 con 0x55713efda350 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f598271e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55713f2e5b80 con 0x55713efb1490 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f598271e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55713f2e9b30 con 0x55713efb9670 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f597a746640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f380780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f597a746640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f380780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53882/0 (socket says 172.21.15.33:53882) 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f597a746640 1 -- 172.21.15.33:0/4294039318 learned_addr learned my addr 172.21.15.33:0/4294039318 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.627+0000 7f5979f45640 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb1490 0x55713f380cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f5979744640 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb9670 0x55713f381200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f597a746640 1 -- 172.21.15.33:0/4294039318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb9670 msgr2=0x55713f381200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f597a746640 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb9670 0x55713f381200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f597a746640 1 -- 172.21.15.33:0/4294039318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb1490 msgr2=0x55713f380cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f597a746640 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb1490 0x55713f380cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f597a746640 1 -- 172.21.15.33:0/4294039318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713f045930 con 0x55713efda350 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f5979f45640 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb1490 0x55713f380cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f5979744640 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb9670 0x55713f381200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f596affd640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f59600b4d50 0x7f59600b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f597a746640 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f380780 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f596c009d70 tx=0x7f596c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da37d20e24a39405 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f5979f45640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f59600b4d50 0x7f59600b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f596affd640 1 -- 172.21.15.33:0/1914073223 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9541+0+0 (secure 0 0 0) 0x7f5964105b90 con 0x7f59741024b0 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f595ffff640 1 -- 172.21.15.33:0/4294039318 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c003970 con 0x55713efda350 2024-08-28T19:41:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f595ffff640 1 -- 172.21.15.33:0/4294039318 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f596c004030 con 0x55713efda350 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.628+0000 7f595ffff640 1 -- 172.21.15.33:0/4294039318 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c011770 con 0x55713efda350 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.629+0000 7f598271e740 1 -- 172.21.15.33:0/4294039318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 msgr2=0x55713f380780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.629+0000 7f598271e740 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f380780 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f596c009d70 tx=0x7f596c00f730 comp rx=0 tx=0).stop 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.629+0000 7f5979f45640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f59600b4d50 0x7f59600b7260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5970005fd0 tx=0x7f5970005f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.629+0000 7f598271e740 1 -- 172.21.15.33:0/4294039318 shutdown_connections 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.629+0000 7f598271e740 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb9670 0x55713f381200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.629+0000 7f598271e740 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb1490 0x55713f380cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.629+0000 7f598271e740 1 --2- 172.21.15.33:0/4294039318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f380780 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.629+0000 7f598271e740 1 -- 172.21.15.33:0/4294039318 >> 172.21.15.33:0/4294039318 conn(0x55713efce740 msgr2=0x55713f37e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.629+0000 7f598271e740 1 -- 172.21.15.33:0/4294039318 shutdown_connections 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.629+0000 7f598271e740 1 -- 172.21.15.33:0/4294039318 wait complete. 2024-08-28T19:41:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.630+0000 7f598271e740 1 -- start start 2024-08-28T19:41:04.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.630+0000 7f598271e740 1 Processor -- start 2024-08-28T19:41:04.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.630+0000 7f598271e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb1490 0x55713f38c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.630+0000 7f598271e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 0x55713f38c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.630+0000 7f598271e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f398250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.630+0000 7f598271e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55713f148890 con 0x55713efda350 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.630+0000 7f598271e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55713f26c790 con 0x55713efb9670 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.630+0000 7f598271e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55713f38ef60 con 0x55713efb1490 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f597a746640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f398250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f598271e740 10 client.0 _ll_register_callbacks cb 0x55713eff1ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f597a746640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f398250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53886/0 (socket says 172.21.15.33:53886) 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f597a746640 1 -- 172.21.15.33:0/2948730102 learned_addr learned my addr 172.21.15.33:0/2948730102 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f5979f45640 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb1490 0x55713f38c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f5979744640 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 0x55713f38c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f597a746640 1 -- 172.21.15.33:0/2948730102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb1490 msgr2=0x55713f38c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f597a746640 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb1490 0x55713f38c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f597a746640 1 -- 172.21.15.33:0/2948730102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 msgr2=0x55713f38c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f597a746640 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 0x55713f38c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f597a746640 1 -- 172.21.15.33:0/2948730102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713f2a3f30 con 0x55713efda350 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f5979744640 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 0x55713f38c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f597a746640 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f398250 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f596c009d40 tx=0x7f596c00ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bd9fc85394d2de server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f595d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f595d7fa640 1 -- 172.21.15.33:0/2948730102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c02a060 con 0x55713efda350 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f595d7fa640 1 -- 172.21.15.33:0/2948730102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9541+0+0 (secure 0 0 0) 0x7f596c0044f0 con 0x55713efda350 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.631+0000 7f598271e740 1 -- 172.21.15.33:0/2948730102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f596c004030 con 0x55713efda350 2024-08-28T19:41:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f595d7fa640 1 -- 172.21.15.33:0/2948730102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f596c031050 con 0x55713efda350 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f598271e740 10 client.17940 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f598271e740 1 -- 172.21.15.33:0/2948730102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55713f39ada0 con 0x55713efda350 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f595d7fa640 1 -- 172.21.15.33:0/2948730102 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f596c004030 con 0x55713efda350 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f595d7fa640 1 -- 172.21.15.33:0/2948730102 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f596c011c40 con 0x55713efda350 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f598271e740 10 client.17940 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f598271e740 10 client.17940 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f598271e740 20 client.17940 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f598271e740 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55713ef98cd0 0x55713f39e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f598271e740 4 client.17940 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f598271e740 1 -- 172.21.15.33:0/2948730102 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55713f2f8540 con 0x55713ef98cd0 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.632+0000 7f5979f45640 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55713ef98cd0 0x55713f39e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.633+0000 7f595d7fa640 10 client.17940 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.633+0000 7f5979f45640 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55713ef98cd0 0x55713f39e1b0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c9c895a1f89c522 server_cookie=6923395c6a8a9e54 in_seq=0 out_seq=0 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f595d7fa640 1 -- 172.21.15.33:0/2948730102 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55713f2f8540 con 0x55713ef98cd0 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f595d7fa640 10 client.17940 handle_command_reply: tid=0 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 client.17940 shutdown 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 -- 172.21.15.33:0/2948730102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 msgr2=0x55713f398250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f398250 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f596c009d40 tx=0x7f596c00ff80 comp rx=0 tx=0).stop 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 -- 172.21.15.33:0/2948730102 shutdown_connections 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55713ef98cd0 0x55713f39e1b0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efda350 0x55713f398250 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 0x55713f38c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f595d7fa640 0 client.17940 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 --2- 172.21.15.33:0/2948730102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb1490 0x55713f38c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 -- 172.21.15.33:0/2948730102 >> 172.21.15.33:0/2948730102 conn(0x55713efce740 msgr2=0x55713f383960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 -- 172.21.15.33:0/2948730102 shutdown_connections 2024-08-28T19:41:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 1 -- 172.21.15.33:0/2948730102 wait complete. 2024-08-28T19:41:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.634+0000 7f598271e740 20 client.17940 trim_cache size 0 max 16384 2024-08-28T19:41:04.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.654+0000 7f598271e740 1 Processor -- start 2024-08-28T19:41:04.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.654+0000 7f598271e740 1 -- start start 2024-08-28T19:41:04.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f598271e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713ef98cd0 0x55713f3877e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f598271e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb1490 0x55713f383f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f598271e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb9670 0x55713f3981c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f598271e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f59741b0db0 con 0x55713efb9670 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f598271e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f59741b28f0 con 0x55713ef98cd0 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f598271e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f59741b1480 con 0x55713efb1490 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f597a746640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb9670 0x55713f3981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f597a746640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb9670 0x55713f3981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53898/0 (socket says 172.21.15.33:53898) 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f597a746640 1 -- 172.21.15.33:0/3621569750 learned_addr learned my addr 172.21.15.33:0/3621569750 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f5979744640 1 --2- 172.21.15.33:0/3621569750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb1490 0x55713f383f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f5979f45640 1 --2- 172.21.15.33:0/3621569750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713ef98cd0 0x55713f3877e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f597a746640 1 -- 172.21.15.33:0/3621569750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb1490 msgr2=0x55713f383f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f597a746640 1 --2- 172.21.15.33:0/3621569750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb1490 0x55713f383f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f597a746640 1 -- 172.21.15.33:0/3621569750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713ef98cd0 msgr2=0x55713f3877e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:04.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f597a746640 1 --2- 172.21.15.33:0/3621569750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713ef98cd0 0x55713f3877e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f597a746640 1 -- 172.21.15.33:0/3621569750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713f38af90 con 0x55713efb9670 2024-08-28T19:41:04.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.655+0000 7f597a746640 1 --2- 172.21.15.33:0/3621569750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb9670 0x55713f3981c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f596c000f80 tx=0x7f596c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438fe7b8ab2db0bb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:04.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.656+0000 7f595f7fe640 1 -- 172.21.15.33:0/3621569750 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c02a040 con 0x55713efb9670 2024-08-28T19:41:04.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.656+0000 7f595f7fe640 1 -- 172.21.15.33:0/3621569750 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f596c0044f0 con 0x55713efb9670 2024-08-28T19:41:04.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.656+0000 7f595f7fe640 1 -- 172.21.15.33:0/3621569750 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c004c90 con 0x55713efb9670 2024-08-28T19:41:04.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 -- 172.21.15.33:0/3621569750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb9670 msgr2=0x55713f3981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:04.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 --2- 172.21.15.33:0/3621569750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb9670 0x55713f3981c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f596c000f80 tx=0x7f596c00f730 comp rx=0 tx=0).stop 2024-08-28T19:41:04.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 -- 172.21.15.33:0/3621569750 shutdown_connections 2024-08-28T19:41:04.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 --2- 172.21.15.33:0/3621569750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb9670 0x55713f3981c0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 --2- 172.21.15.33:0/3621569750 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713efb1490 0x55713f383f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 --2- 172.21.15.33:0/3621569750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713ef98cd0 0x55713f3877e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 -- 172.21.15.33:0/3621569750 >> 172.21.15.33:0/3621569750 conn(0x55713efce740 msgr2=0x55713f383880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 -- 172.21.15.33:0/3621569750 shutdown_connections 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 -- 172.21.15.33:0/3621569750 wait complete. 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 -- start start 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.657+0000 7f598271e740 1 Processor -- start 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f598271e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713ef98cd0 0x55713f39fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f598271e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb1490 0x55713f3a0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f598271e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 0x55713f401900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f598271e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f59741b2220 con 0x55713efb1490 2024-08-28T19:41:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f598271e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f59741b1b50 con 0x55713efb9670 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f598271e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f59741aedb0 con 0x55713ef98cd0 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f598271e740 10 client.0 _ll_register_callbacks cb 0x7f596c009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979744640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb1490 0x55713f3a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979f45640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713ef98cd0 0x55713f39fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979744640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb1490 0x55713f3a0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53900/0 (socket says 172.21.15.33:53900) 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979744640 1 -- 172.21.15.33:0/3590402353 learned_addr learned my addr 172.21.15.33:0/3590402353 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f597a746640 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 0x55713f401900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979f45640 1 -- 172.21.15.33:0/3590402353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 msgr2=0x55713f401900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979f45640 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 0x55713f401900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979f45640 1 -- 172.21.15.33:0/3590402353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb1490 msgr2=0x55713f3a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979f45640 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb1490 0x55713f3a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979f45640 1 -- 172.21.15.33:0/3590402353 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713f401f70 con 0x55713ef98cd0 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979744640 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb1490 0x55713f3a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f5979f45640 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713ef98cd0 0x55713f39fa90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55713f148890 tx=0x7f59700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeadb77063195efb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.658+0000 7f595d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f595d7fa640 1 -- 172.21.15.33:0/3590402353 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970034060 con 0x55713ef98cd0 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f598271e740 1 -- 172.21.15.33:0/3590402353 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f596c0044f0 con 0x55713ef98cd0 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f595d7fa640 1 -- 172.21.15.33:0/3590402353 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9541+0+0 (secure 0 0 0) 0x7f597001fd90 con 0x55713ef98cd0 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f595d7fa640 1 -- 172.21.15.33:0/3590402353 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f597003b050 con 0x55713ef98cd0 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f598271e740 10 client.26974 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f598271e740 1 -- 172.21.15.33:0/3590402353 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55713f409340 con 0x55713ef98cd0 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f595d7fa640 1 -- 172.21.15.33:0/3590402353 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f596c0044f0 con 0x55713ef98cd0 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f595d7fa640 1 -- 172.21.15.33:0/3590402353 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f597001e420 con 0x55713ef98cd0 2024-08-28T19:41:04.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f598271e740 10 client.26974 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f598271e740 10 client.26974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.659+0000 7f598271e740 20 client.26974 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.660+0000 7f598271e740 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55713efda350 0x55713f40bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.660+0000 7f598271e740 4 client.26974 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:41:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.660+0000 7f598271e740 1 -- 172.21.15.33:0/3590402353 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55713f2f3fe0 con 0x55713efda350 2024-08-28T19:41:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.660+0000 7f5979744640 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55713efda350 0x55713f40bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.660+0000 7f595d7fa640 10 client.26974 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.660+0000 7f5979744640 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55713efda350 0x55713f40bae0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2d2e5d67c95e7b6 server_cookie=fbc1bedceab01742 in_seq=0 out_seq=0 2024-08-28T19:41:04.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f595d7fa640 1 -- 172.21.15.33:0/3590402353 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55713f2f3fe0 con 0x55713efda350 2024-08-28T19:41:04.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f595d7fa640 10 client.26974 handle_command_reply: tid=0 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f598271e740 1 client.26974 shutdown 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f598271e740 1 -- 172.21.15.33:0/3590402353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713ef98cd0 msgr2=0x55713f39fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f598271e740 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713ef98cd0 0x55713f39fa90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55713f148890 tx=0x7f59700046c0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f598271e740 1 -- 172.21.15.33:0/3590402353 shutdown_connections 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f598271e740 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713efb9670 0x55713f401900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f598271e740 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55713efda350 0x55713f40bae0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f598271e740 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713efb1490 0x55713f3a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f598271e740 1 --2- 172.21.15.33:0/3590402353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55713ef98cd0 0x55713f39fa90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f598271e740 1 -- 172.21.15.33:0/3590402353 >> 172.21.15.33:0/3590402353 conn(0x55713efce740 msgr2=0x55713f381740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f595d7fa640 0 client.26974 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.662+0000 7f598271e740 1 -- 172.21.15.33:0/3590402353 shutdown_connections 2024-08-28T19:41:04.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f598271e740 1 -- 172.21.15.33:0/3590402353 wait complete. 2024-08-28T19:41:04.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f598271e740 20 client.26974 trim_cache size 0 max 16384 2024-08-28T19:41:04.668 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:41:04.668 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:41:04.668 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "accb3403-fa32-4006-9838-9a16020a6c42", 2024-08-28T19:41:04.668 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:41:04.668 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:41:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f597c1a9640 1 -- 172.21.15.33:0/1914073223 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f59600b4d50 msgr2=0x7f59600b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f597c1a9640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f59600b4d50 0x7f59600b7260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5970005fd0 tx=0x7f5970005f40 comp rx=0 tx=0).stop 2024-08-28T19:41:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f597c1a9640 1 -- 172.21.15.33:0/1914073223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59741024b0 msgr2=0x7f597419a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f597c1a9640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59741024b0 0x7f597419a8d0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f5964032fd0 tx=0x7f5964004270 comp rx=0 tx=0).stop 2024-08-28T19:41:04.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f597c1a9640 1 -- 172.21.15.33:0/1914073223 shutdown_connections 2024-08-28T19:41:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f597c1a9640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597410c5f0 0x7f597419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f597c1a9640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59741024b0 0x7f597419a8d0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f597c1a9640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f59600b4d50 0x7f59600b7260 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f597c1a9640 1 --2- 172.21.15.33:0/1914073223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5974069e80 0x7f597419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.663+0000 7f597c1a9640 1 -- 172.21.15.33:0/1914073223 >> 172.21.15.33:0/1914073223 conn(0x7f59740775a0 msgr2=0x7f5974105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.664+0000 7f597c1a9640 1 -- 172.21.15.33:0/1914073223 shutdown_connections 2024-08-28T19:41:04.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:04.664+0000 7f597c1a9640 1 -- 172.21.15.33:0/1914073223 wait complete. 2024-08-28T19:41:05.392 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:41:05.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:05 smithi033 ceph-mon[18549]: pgmap v605: 129 pgs: 129 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 62 KiB/s wr, 30 op/s 2024-08-28T19:41:05.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:05 smithi033 ceph-mon[18549]: osdmap e89: 12 total, 12 up, 12 in 2024-08-28T19:41:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:05 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:41:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:05 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:05 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:41:05.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:05 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:05.690 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:05 smithi122 ceph-mon[22174]: pgmap v605: 129 pgs: 129 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 62 KiB/s wr, 30 op/s 2024-08-28T19:41:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:05 smithi122 ceph-mon[22174]: osdmap e89: 12 total, 12 up, 12 in 2024-08-28T19:41:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:05 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:41:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:05 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:05 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:41:05.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:05 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:05 smithi059 ceph-mon[22052]: pgmap v605: 129 pgs: 129 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 62 KiB/s wr, 30 op/s 2024-08-28T19:41:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:05 smithi059 ceph-mon[22052]: osdmap e89: 12 total, 12 up, 12 in 2024-08-28T19:41:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:05 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:41:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:05 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:05 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:41:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:05 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.167+0000 7fc9adf5c640 1 -- 172.21.15.33:0/1270069957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9a8102820 msgr2=0x7fc9a8102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.167+0000 7fc9adf5c640 1 --2- 172.21.15.33:0/1270069957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9a8102820 0x7fc9a8102c30 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fc998009900 tx=0x7fc99802a410 comp rx=0 tx=0).stop 2024-08-28T19:41:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.168+0000 7fc9adf5c640 1 -- 172.21.15.33:0/1270069957 shutdown_connections 2024-08-28T19:41:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.168+0000 7fc9adf5c640 1 --2- 172.21.15.33:0/1270069957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a8108ab0 0x7fc9a810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.168+0000 7fc9adf5c640 1 --2- 172.21.15.33:0/1270069957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a8108160 0x7fc9a8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.168+0000 7fc9adf5c640 1 --2- 172.21.15.33:0/1270069957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9a8102820 0x7fc9a8102c30 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.168+0000 7fc9adf5c640 1 -- 172.21.15.33:0/1270069957 >> 172.21.15.33:0/1270069957 conn(0x7fc9a80794e0 msgr2=0x7fc9a80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.168+0000 7fc9adf5c640 1 -- 172.21.15.33:0/1270069957 shutdown_connections 2024-08-28T19:41:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.168+0000 7fc9adf5c640 1 -- 172.21.15.33:0/1270069957 wait complete. 2024-08-28T19:41:06.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.168+0000 7fc9adf5c640 1 Processor -- start 2024-08-28T19:41:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.168+0000 7fc9adf5c640 1 -- start start 2024-08-28T19:41:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9adf5c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a8102820 0x7fc9a81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9adf5c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a8108160 0x7fc9a8199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9adf5c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9a8108ab0 0x7fc9a819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9adf5c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a81127b0 con 0x7fc9a8108ab0 2024-08-28T19:41:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9adf5c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8112630 con 0x7fc9a8102820 2024-08-28T19:41:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9adf5c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8112930 con 0x7fc9a8108160 2024-08-28T19:41:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9a8108ab0 0x7fc9a819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9a8108ab0 0x7fc9a819ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53922/0 (socket says 172.21.15.33:53922) 2024-08-28T19:41:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a7fff640 1 -- 172.21.15.33:0/3249494465 learned_addr learned my addr 172.21.15.33:0/3249494465 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc99effd640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a8108160 0x7fc9a8199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a8102820 0x7fc9a81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a7fff640 1 -- 172.21.15.33:0/3249494465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a8108160 msgr2=0x7fc9a8199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a7fff640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a8108160 0x7fc9a8199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a7fff640 1 -- 172.21.15.33:0/3249494465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a8102820 msgr2=0x7fc9a81991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a7fff640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a8102820 0x7fc9a81991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a7fff640 1 -- 172.21.15.33:0/3249494465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a819f130 con 0x7fc9a8108ab0 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a7fff640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9a8108ab0 0x7fc9a819ea00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000b970 tx=0x7fc9a000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a57fa640 1 -- 172.21.15.33:0/3249494465 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0019070 con 0x7fc9a8108ab0 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.169+0000 7fc9a57fa640 1 -- 172.21.15.33:0/3249494465 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9a0014440 con 0x7fc9a8108ab0 2024-08-28T19:41:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.170+0000 7fc9a57fa640 1 -- 172.21.15.33:0/3249494465 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00075d0 con 0x7fc9a8108ab0 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.170+0000 7fc9adf5c640 1 -- 172.21.15.33:0/3249494465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a819f420 con 0x7fc9a8108ab0 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.170+0000 7fc9adf5c640 1 -- 172.21.15.33:0/3249494465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a81a5b80 con 0x7fc9a8108ab0 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.172+0000 7fc9b44d1740 1 Processor -- start 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.172+0000 7fc9a57fa640 1 -- 172.21.15.33:0/3249494465 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc9a001c070 con 0x7fc9a8108ab0 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.172+0000 7fc9b44d1740 1 -- start start 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.172+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962c13070 0x555962fbad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.172+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bea1b0 0x555962fb82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.172+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 0x555962fb8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.172+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555962f2f630 con 0x555962bea1b0 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.172+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555962f1ebc0 con 0x555962c13070 2024-08-28T19:41:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.172+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555962f22b70 con 0x555962bf2390 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bea1b0 0x555962fb82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bea1b0 0x555962fb82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53932/0 (socket says 172.21.15.33:53932) 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a77fe640 1 -- 172.21.15.33:0/3343677266 learned_addr learned my addr 172.21.15.33:0/3343677266 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc99effd640 1 --2- 172.21.15.33:0/3343677266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962c13070 0x555962fbad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc99effd640 1 --2- 172.21.15.33:0/3343677266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 0x555962fb8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a57fa640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9940b4ca0 0x7fc9940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a77fe640 1 -- 172.21.15.33:0/3343677266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 msgr2=0x555962fb8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/3343677266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 0x555962fb8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a77fe640 1 -- 172.21.15.33:0/3343677266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962c13070 msgr2=0x555962fbad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/3343677266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962c13070 0x555962fbad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a77fe640 1 -- 172.21.15.33:0/3343677266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555962c7e650 con 0x555962bea1b0 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a7fff640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9940b4ca0 0x7fc9940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/3343677266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bea1b0 0x555962fb82c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc99802a930 tx=0x7fc998032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe14ed7a279c534 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:06.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc9a57fa640 1 -- 172.21.15.33:0/3249494465 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9541+0+0 (secure 0 0 0) 0x7fc9a00e4e90 con 0x7fc9a8108ab0 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.173+0000 7fc99dffb640 1 -- 172.21.15.33:0/3343677266 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99803f070 con 0x555962bea1b0 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.174+0000 7fc99dffb640 1 -- 172.21.15.33:0/3343677266 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9980316a0 con 0x555962bea1b0 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.174+0000 7fc99dffb640 1 -- 172.21.15.33:0/3343677266 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998035070 con 0x555962bea1b0 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.174+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3343677266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bea1b0 msgr2=0x555962fb82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.174+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/3343677266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bea1b0 0x555962fb82c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc99802a930 tx=0x7fc998032ce0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.174+0000 7fc9a7fff640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9940b4ca0 0x7fc9940b71b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00e2290 tx=0x7fc9a00ce050 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.174+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3343677266 shutdown_connections 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.175+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/3343677266 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 0x555962fb8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.175+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/3343677266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bea1b0 0x555962fb82c0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.175+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/3343677266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962c13070 0x555962fbad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.175+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3343677266 >> 172.21.15.33:0/3343677266 conn(0x555962c07460 msgr2=0x555962fb61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.175+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3343677266 shutdown_connections 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.175+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3343677266 wait complete. 2024-08-28T19:41:06.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.175+0000 7fc9b44d1740 1 -- start start 2024-08-28T19:41:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.175+0000 7fc9b44d1740 1 Processor -- start 2024-08-28T19:41:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fc7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fc8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962c13070 0x555962fd4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555962d81700 con 0x555962bf2390 2024-08-28T19:41:06.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555962ea5700 con 0x555962bea1b0 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555962fcadc0 con 0x555962c13070 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9b44d1740 10 client.0 _ll_register_callbacks cb 0x555962ed4dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fc8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fc8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53936/0 (socket says 172.21.15.33:53936) 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9a77fe640 1 -- 172.21.15.33:0/3394053415 learned_addr learned my addr 172.21.15.33:0/3394053415 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc99effd640 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962c13070 0x555962fd4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc99effd640 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fc7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9a77fe640 1 -- 172.21.15.33:0/3394053415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962c13070 msgr2=0x555962fd4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962c13070 0x555962fd4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9a77fe640 1 -- 172.21.15.33:0/3394053415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 msgr2=0x555962fc7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fc7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9a77fe640 1 -- 172.21.15.33:0/3394053415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555962ede8b0 con 0x555962bf2390 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fc8490 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc998005270 tx=0x7fc998005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b8cfc723c04413 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc986ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc986ffd640 1 -- 172.21.15.33:0/3394053415 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99804b060 con 0x555962bf2390 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc986ffd640 1 -- 172.21.15.33:0/3394053415 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9541+0+0 (secure 0 0 0) 0x7fc998004440 con 0x555962bf2390 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.176+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3394053415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9980316a0 con 0x555962bf2390 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc986ffd640 1 -- 172.21.15.33:0/3394053415 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc998052050 con 0x555962bf2390 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc9b44d1740 10 client.17958 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3394053415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555962fd6b40 con 0x555962bf2390 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc986ffd640 1 -- 172.21.15.33:0/3394053415 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9980316a0 con 0x555962bf2390 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc986ffd640 1 -- 172.21.15.33:0/3394053415 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc998004a30 con 0x555962bf2390 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc9b44d1740 10 client.17958 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc9b44d1740 10 client.17958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc9b44d1740 20 client.17958 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555962bd19f0 0x555962fd9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc9b44d1740 4 client.17958 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.177+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3394053415 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555962f31580 con 0x555962bd19f0 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.178+0000 7fc99effd640 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555962bd19f0 0x555962fd9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.178+0000 7fc986ffd640 10 client.17958 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.178+0000 7fc99effd640 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555962bd19f0 0x555962fd9ea0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cb3cbd80d4977a6 server_cookie=359f0e1e64346a9e in_seq=0 out_seq=0 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc986ffd640 1 -- 172.21.15.33:0/3394053415 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555962f31580 con 0x555962bd19f0 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc986ffd640 10 client.17958 handle_command_reply: tid=0 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 client.17958 shutdown 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3394053415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 msgr2=0x555962fc8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fc8490 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc998005270 tx=0x7fc998005f00 comp rx=0 tx=0).stop 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3394053415 shutdown_connections 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962c13070 0x555962fd4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555962bd19f0 0x555962fd9ea0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fc8490 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/3394053415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fc7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc986ffd640 0 client.17958 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:06.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3394053415 >> 172.21.15.33:0/3394053415 conn(0x555962c07460 msgr2=0x555962fb9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:06.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3394053415 shutdown_connections 2024-08-28T19:41:06.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 1 -- 172.21.15.33:0/3394053415 wait complete. 2024-08-28T19:41:06.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.179+0000 7fc9b44d1740 20 client.17958 trim_cache size 0 max 16384 2024-08-28T19:41:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9b44d1740 1 Processor -- start 2024-08-28T19:41:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9b44d1740 1 -- start start 2024-08-28T19:41:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fbe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fd40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962c13070 0x555962fb9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a81aebb0 con 0x555962bf2390 2024-08-28T19:41:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a81b06f0 con 0x555962bea1b0 2024-08-28T19:41:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a81af280 con 0x555962c13070 2024-08-28T19:41:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fd40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fd40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53950/0 (socket says 172.21.15.33:53950) 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc9a77fe640 1 -- 172.21.15.33:0/2359102425 learned_addr learned my addr 172.21.15.33:0/2359102425 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.197+0000 7fc99effd640 1 --2- 172.21.15.33:0/2359102425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fbe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.198+0000 7fc99effd640 1 --2- 172.21.15.33:0/2359102425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962c13070 0x555962fb9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.198+0000 7fc9a77fe640 1 -- 172.21.15.33:0/2359102425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962c13070 msgr2=0x555962fb9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.198+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/2359102425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962c13070 0x555962fb9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.198+0000 7fc9a77fe640 1 -- 172.21.15.33:0/2359102425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 msgr2=0x555962fbe400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.198+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/2359102425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fbe400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.198+0000 7fc9a77fe640 1 -- 172.21.15.33:0/2359102425 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555962fb1550 con 0x555962bf2390 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.198+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/2359102425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fd40c0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc99802a930 tx=0x7fc998005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a8945206a33ac2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.198+0000 7fc99d7fa640 1 -- 172.21.15.33:0/2359102425 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998000e60 con 0x555962bf2390 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.198+0000 7fc99d7fa640 1 -- 172.21.15.33:0/2359102425 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc998004b70 con 0x555962bf2390 2024-08-28T19:41:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.198+0000 7fc99d7fa640 1 -- 172.21.15.33:0/2359102425 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99803f030 con 0x555962bf2390 2024-08-28T19:41:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 -- 172.21.15.33:0/2359102425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 msgr2=0x555962fd40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/2359102425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fd40c0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc99802a930 tx=0x7fc998005780 comp rx=0 tx=0).stop 2024-08-28T19:41:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 -- 172.21.15.33:0/2359102425 shutdown_connections 2024-08-28T19:41:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/2359102425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962c13070 0x555962fb9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/2359102425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962bf2390 0x555962fd40c0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/2359102425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fbe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 -- 172.21.15.33:0/2359102425 >> 172.21.15.33:0/2359102425 conn(0x555962c07460 msgr2=0x555962fb92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 -- 172.21.15.33:0/2359102425 shutdown_connections 2024-08-28T19:41:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 -- 172.21.15.33:0/2359102425 wait complete. 2024-08-28T19:41:06.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 -- start start 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.199+0000 7fc9b44d1740 1 Processor -- start 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fdb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 0x555962fdbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9b44d1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962c13070 0x555963043620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a81b0020 con 0x555962c13070 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a81af950 con 0x555962bea1b0 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9b44d1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a81acbb0 con 0x555962bf2390 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9b44d1740 10 client.0 _ll_register_callbacks cb 0x7fc99000b7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc99effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962c13070 0x555963043620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc99effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962c13070 0x555963043620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53958/0 (socket says 172.21.15.33:53958) 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9a77fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 0x555962fdbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc99effd640 1 -- 172.21.15.33:0/1286620549 learned_addr learned my addr 172.21.15.33:0/1286620549 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc99effd640 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fdb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9a77fe640 1 -- 172.21.15.33:0/1286620549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 msgr2=0x555962fdb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fdb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9a77fe640 1 -- 172.21.15.33:0/1286620549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962c13070 msgr2=0x555963043620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962c13070 0x555963043620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9a77fe640 1 -- 172.21.15.33:0/1286620549 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555963043c90 con 0x555962bf2390 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc99effd640 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962c13070 0x555963043620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc9a77fe640 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 0x555962fdbd20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc998004e50 tx=0x7fc998009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeca95ebb14a9fa6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.200+0000 7fc986ffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc986ffd640 1 -- 172.21.15.33:0/1286620549 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99803f070 con 0x555962bf2390 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc9b44d1740 1 -- 172.21.15.33:0/1286620549 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc998004b70 con 0x555962bf2390 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc986ffd640 1 -- 172.21.15.33:0/1286620549 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9541+0+0 (secure 0 0 0) 0x7fc9980046c0 con 0x555962bf2390 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc986ffd640 1 -- 172.21.15.33:0/1286620549 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc99806a050 con 0x555962bf2390 2024-08-28T19:41:06.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc9b44d1740 10 client.26989 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc9b44d1740 1 -- 172.21.15.33:0/1286620549 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555963044f20 con 0x555962bf2390 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc986ffd640 1 -- 172.21.15.33:0/1286620549 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc998004b70 con 0x555962bf2390 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc986ffd640 1 -- 172.21.15.33:0/1286620549 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc998003aa0 con 0x555962bf2390 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc9b44d1740 10 client.26989 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc9b44d1740 10 client.26989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc9b44d1740 20 client.26989 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555962ba6da0 0x5559630475f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc9b44d1740 4 client.26989 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.201+0000 7fc9b44d1740 1 -- 172.21.15.33:0/1286620549 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555962f2d020 con 0x555962ba6da0 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.202+0000 7fc99effd640 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555962ba6da0 0x5559630475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.202+0000 7fc986ffd640 10 client.26989 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.202+0000 7fc99effd640 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555962ba6da0 0x5559630475f0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b5b491c5ecd77ec server_cookie=6258df1767daeec5 in_seq=0 out_seq=0 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.202+0000 7fc986ffd640 1 -- 172.21.15.33:0/1286620549 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x555962f2d020 con 0x555962ba6da0 2024-08-28T19:41:06.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.202+0000 7fc986ffd640 10 client.26989 handle_command_reply: tid=0 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.202+0000 7fc9b44d1740 1 client.26989 shutdown 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 1 -- 172.21.15.33:0/1286620549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 msgr2=0x555962fdbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 0x555962fdbd20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc998004e50 tx=0x7fc998009780 comp rx=0 tx=0).stop 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 1 -- 172.21.15.33:0/1286620549 shutdown_connections 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555962ba6da0 0x5559630475f0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555962c13070 0x555963043620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555962bf2390 0x555962fdbd20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc986ffd640 0 client.26989 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 1 --2- 172.21.15.33:0/1286620549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555962bea1b0 0x555962fdb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 1 -- 172.21.15.33:0/1286620549 >> 172.21.15.33:0/1286620549 conn(0x555962c07460 msgr2=0x555962fb92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 1 -- 172.21.15.33:0/1286620549 shutdown_connections 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 1 -- 172.21.15.33:0/1286620549 wait complete. 2024-08-28T19:41:06.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9b44d1740 20 client.26989 trim_cache size 0 max 16384 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "accb3403-fa32-4006-9838-9a16020a6c42", 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:41:06.209 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:41:06.211 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:41:06.213 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:41:06.217 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:06.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:06.219 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:06.219 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:06.219 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:41:06.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9adf5c640 1 -- 172.21.15.33:0/3249494465 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9940b4ca0 msgr2=0x7fc9940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:06.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9adf5c640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9940b4ca0 0x7fc9940b71b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00e2290 tx=0x7fc9a00ce050 comp rx=0 tx=0).stop 2024-08-28T19:41:06.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9adf5c640 1 -- 172.21.15.33:0/3249494465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9a8108ab0 msgr2=0x7fc9a819ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:06.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9adf5c640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9a8108ab0 0x7fc9a819ea00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000b970 tx=0x7fc9a000be30 comp rx=0 tx=0).stop 2024-08-28T19:41:06.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9adf5c640 1 -- 172.21.15.33:0/3249494465 shutdown_connections 2024-08-28T19:41:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9adf5c640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9a8108ab0 0x7fc9a819ea00 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.203+0000 7fc9adf5c640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9940b4ca0 0x7fc9940b71b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.204+0000 7fc9adf5c640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9a8108160 0x7fc9a8199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.204+0000 7fc9adf5c640 1 --2- 172.21.15.33:0/3249494465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a8102820 0x7fc9a81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.204+0000 7fc9adf5c640 1 -- 172.21.15.33:0/3249494465 >> 172.21.15.33:0/3249494465 conn(0x7fc9a80794e0 msgr2=0x7fc9a81011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.204+0000 7fc9adf5c640 1 -- 172.21.15.33:0/3249494465 shutdown_connections 2024-08-28T19:41:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:06.204+0000 7fc9adf5c640 1 -- 172.21.15.33:0/3249494465 wait complete. 2024-08-28T19:41:07.035 INFO:tasks.cephfs.filesystem:scrub status for tag:accb3403-fa32-4006-9838-9a16020a6c42 - {'path': '/', 'tag': 'accb3403-fa32-4006-9838-9a16020a6c42', 'options': 'recursive,force'} 2024-08-28T19:41:07.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:07 smithi122 ceph-mon[22174]: pgmap v607: 129 pgs: 129 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 32 op/s 2024-08-28T19:41:07.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:07 smithi033 ceph-mon[18549]: pgmap v607: 129 pgs: 129 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 32 op/s 2024-08-28T19:41:08.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:07 smithi059 ceph-mon[22052]: pgmap v607: 129 pgs: 129 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 74 KiB/s wr, 32 op/s 2024-08-28T19:41:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:09 smithi122 ceph-mon[22174]: pgmap v608: 129 pgs: 129 active+clean; 11 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 99 KiB/s wr, 35 op/s 2024-08-28T19:41:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:09 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:41:09.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:09 smithi033 ceph-mon[18549]: pgmap v608: 129 pgs: 129 active+clean; 11 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 99 KiB/s wr, 35 op/s 2024-08-28T19:41:09.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:09 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:41:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:09 smithi059 ceph-mon[22052]: pgmap v608: 129 pgs: 129 active+clean; 11 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 99 KiB/s wr, 35 op/s 2024-08-28T19:41:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:09 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:41:11.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:11 smithi033 ceph-mon[18549]: pgmap v609: 129 pgs: 129 active+clean; 11 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 99 KiB/s wr, 35 op/s 2024-08-28T19:41:12.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:11 smithi059 ceph-mon[22052]: pgmap v609: 129 pgs: 129 active+clean; 11 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 99 KiB/s wr, 35 op/s 2024-08-28T19:41:12.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:11 smithi122 ceph-mon[22174]: pgmap v609: 129 pgs: 129 active+clean; 11 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 99 KiB/s wr, 35 op/s 2024-08-28T19:41:13.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:13 smithi033 ceph-mon[18549]: pgmap v610: 129 pgs: 129 active+clean; 11 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-08-28T19:41:14.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:13 smithi059 ceph-mon[22052]: pgmap v610: 129 pgs: 129 active+clean; 11 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-08-28T19:41:14.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:13 smithi122 ceph-mon[22174]: pgmap v610: 129 pgs: 129 active+clean; 11 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-08-28T19:41:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:15 smithi059 ceph-mon[22052]: pgmap v611: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-08-28T19:41:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:15 smithi059 ceph-mon[22052]: osdmap e90: 12 total, 12 up, 12 in 2024-08-28T19:41:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:15 smithi122 ceph-mon[22174]: pgmap v611: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-08-28T19:41:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:15 smithi122 ceph-mon[22174]: osdmap e90: 12 total, 12 up, 12 in 2024-08-28T19:41:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:15 smithi033 ceph-mon[18549]: pgmap v611: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-08-28T19:41:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:15 smithi033 ceph-mon[18549]: osdmap e90: 12 total, 12 up, 12 in 2024-08-28T19:41:17.039 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:251/600: open fd = 3 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:252/600: open fd = 3 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:253/600: open fd = 3 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.040 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:254/600: open fd = 3 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:255/600: open fd = 3 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:256/600: open fd = 3 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:257/600: open fd = 3 2024-08-28T19:41:17.041 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:258/600: open fd = 3 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:259/600: open fd = 3 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:260/600: open fd = 3 2024-08-28T19:41:17.042 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.043 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.043 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.043 INFO:tasks.workunit.client.0.smithi033.stdout:261/600: open fd = 3 2024-08-28T19:41:17.043 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.043 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.043 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.043 INFO:tasks.workunit.client.0.smithi033.stdout:262/600: open fd = 3 2024-08-28T19:41:17.043 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.043 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.043 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:263/600: open fd = 3 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:264/600: open fd = 3 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:265/600: open fd = 3 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.044 INFO:tasks.workunit.client.0.smithi033.stdout:266/600: open fd = 3 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:267/600: open fd = 3 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:268/600: open fd = 3 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:269/600: open fd = 3 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.045 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:270/600: open fd = 3 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:271/600: open fd = 3 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:272/600: open fd = 3 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:273/600: open fd = 3 2024-08-28T19:41:17.046 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:274/600: open fd = 3 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:275/600: open fd = 3 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:276/600: open fd = 3 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.047 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:277/600: open fd = 3 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:278/600: open fd = 3 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:279/600: open fd = 3 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.048 INFO:tasks.workunit.client.0.smithi033.stdout:280/600: open fd = 3 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:281/600: open fd = 3 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:282/600: open fd = 3 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:283/600: open fd = 3 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.049 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:284/600: open fd = 3 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:285/600: open fd = 3 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:286/600: open fd = 3 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:287/600: open fd = 3 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.050 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:288/600: open fd = 3 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:289/600: open fd = 3 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:290/600: open fd = 3 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:291/600: open fd = 3 2024-08-28T19:41:17.051 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:292/600: open fd = 3 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:293/600: open fd = 3 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:294/600: open fd = 3 2024-08-28T19:41:17.052 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:295/600: open fd = 3 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:296/600: open fd = 3 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:297/600: open fd = 3 2024-08-28T19:41:17.053 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:298/600: open fd = 3 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:299/600: open fd = 3 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:300/600: open fd = 3 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:301/600: open fd = 3 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:302/600: open fd = 3 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:303/600: open fd = 3 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:304/600: open fd = 3 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:305/600: open fd = 3 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:306/600: open fd = 3 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:307/600: open fd = 3 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:308/600: open fd = 3 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:309/600: open fd = 3 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:310/600: open fd = 3 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:311/600: open fd = 3 2024-08-28T19:41:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:41:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:312/600: open fd = 3 2024-08-28T19:41:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:41:17.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:17 smithi059 ceph-mon[22052]: pgmap v613: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-08-28T19:41:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:17 smithi122 ceph-mon[22174]: pgmap v613: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-08-28T19:41:17.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:17 smithi033 ceph-mon[18549]: pgmap v613: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-08-28T19:41:19.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:19 smithi059 ceph-mon[22052]: pgmap v614: 129 pgs: 129 active+clean; 12 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:19 smithi122 ceph-mon[22174]: pgmap v614: 129 pgs: 129 active+clean; 12 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:19.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:19 smithi033 ceph-mon[18549]: pgmap v614: 129 pgs: 129 active+clean; 12 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:21 smithi059 ceph-mon[22052]: pgmap v615: 129 pgs: 129 active+clean; 12 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:21 smithi122 ceph-mon[22174]: pgmap v615: 129 pgs: 129 active+clean; 12 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:21.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:21 smithi033 ceph-mon[18549]: pgmap v615: 129 pgs: 129 active+clean; 12 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:23.682 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:23 smithi033 ceph-mon[18549]: pgmap v616: 129 pgs: 129 active+clean; 12 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:23.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:23 smithi059 ceph-mon[22052]: pgmap v616: 129 pgs: 129 active+clean; 12 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:23 smithi122 ceph-mon[22174]: pgmap v616: 129 pgs: 129 active+clean; 12 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:25.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:25 smithi059 ceph-mon[22052]: pgmap v617: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:25 smithi122 ceph-mon[22174]: pgmap v617: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:25.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:25 smithi033 ceph-mon[18549]: pgmap v617: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-08-28T19:41:27.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:27 smithi059 ceph-mon[22052]: pgmap v618: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-08-28T19:41:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:27 smithi122 ceph-mon[22174]: pgmap v618: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-08-28T19:41:27.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:27 smithi033 ceph-mon[18549]: pgmap v618: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-08-28T19:41:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:29 smithi059 ceph-mon[22052]: pgmap v619: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 65 KiB/s wr, 17 op/s 2024-08-28T19:41:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:29 smithi122 ceph-mon[22174]: pgmap v619: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 65 KiB/s wr, 17 op/s 2024-08-28T19:41:29.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:29 smithi033 ceph-mon[18549]: pgmap v619: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 65 KiB/s wr, 17 op/s 2024-08-28T19:41:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:31 smithi059 ceph-mon[22052]: pgmap v620: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-08-28T19:41:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:31 smithi122 ceph-mon[22174]: pgmap v620: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-08-28T19:41:31.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:31 smithi033 ceph-mon[18549]: pgmap v620: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-08-28T19:41:33.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:33 smithi059 ceph-mon[22052]: pgmap v621: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 15 op/s 2024-08-28T19:41:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:33 smithi122 ceph-mon[22174]: pgmap v621: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 15 op/s 2024-08-28T19:41:33.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:33 smithi033 ceph-mon[18549]: pgmap v621: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 15 op/s 2024-08-28T19:41:34.910 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 12.4 2024-08-28T19:41:34.910 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:41:35.184 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:35.602 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:35 smithi033 ceph-mon[18549]: pgmap v622: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-08-28T19:41:35.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.694+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1278187376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bd4109260 msgr2=0x7f9bd4109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:35.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.694+0000 7f9bd9ee8640 1 --2- 172.21.15.33:0/1278187376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bd4109260 0x7f9bd4109670 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009900 tx=0x7f9bbc02a410 comp rx=0 tx=0).stop 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.694+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1278187376 shutdown_connections 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.694+0000 7f9bd9ee8640 1 --2- 172.21.15.33:0/1278187376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd4109bb0 0x7f9bd41103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.694+0000 7f9bd9ee8640 1 --2- 172.21.15.33:0/1278187376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bd4109260 0x7f9bd4109670 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.694+0000 7f9bd9ee8640 1 --2- 172.21.15.33:0/1278187376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bd4103920 0x7f9bd4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.694+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1278187376 >> 172.21.15.33:0/1278187376 conn(0x7f9bd40ff3b0 msgr2=0x7f9bd4101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.694+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1278187376 shutdown_connections 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.694+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1278187376 wait complete. 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.695+0000 7f9bd9ee8640 1 Processor -- start 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.695+0000 7f9bd9ee8640 1 -- start start 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.695+0000 7f9bd9ee8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bd4103920 0x7f9bd419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bd9ee8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bd4109260 0x7f9bd419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:35.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bd9ee8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd4109bb0 0x7f9bd419fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bd9ee8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd41138c0 con 0x7f9bd4109260 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bd9ee8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd4113740 con 0x7f9bd4109bb0 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bd9ee8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd4113a40 con 0x7f9bd4103920 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bcbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bd4109260 0x7f9bd419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bcbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bd4109260 0x7f9bd419a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59384/0 (socket says 172.21.15.33:59384) 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bcbfff640 1 -- 172.21.15.33:0/1720753136 learned_addr learned my addr 172.21.15.33:0/1720753136 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bd37fe640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bd4103920 0x7f9bd419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bd3fff640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd4109bb0 0x7f9bd419fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bcbfff640 1 -- 172.21.15.33:0/1720753136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bd4103920 msgr2=0x7f9bd419a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bcbfff640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bd4103920 0x7f9bd419a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bcbfff640 1 -- 172.21.15.33:0/1720753136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd4109bb0 msgr2=0x7f9bd419fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:35.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bcbfff640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd4109bb0 0x7f9bd419fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bcbfff640 1 -- 172.21.15.33:0/1720753136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd41a0100 con 0x7f9bd4109260 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bd3fff640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd4109bb0 0x7f9bd419fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bcbfff640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bd4109260 0x7f9bd419a7f0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc005ab0 tx=0x7f9bbc003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.696+0000 7f9bd17fa640 1 -- 172.21.15.33:0/1720753136 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc03f070 con 0x7f9bd4109260 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.697+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1720753136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd41a0390 con 0x7f9bd4109260 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.697+0000 7f9bd17fa640 1 -- 172.21.15.33:0/1720753136 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bbc031d60 con 0x7f9bd4109260 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.697+0000 7f9bd17fa640 1 -- 172.21.15.33:0/1720753136 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc035030 con 0x7f9bd4109260 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.697+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1720753136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd41a0870 con 0x7f9bd4109260 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.698+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1720753136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd4104ba0 con 0x7f9bd4109260 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.699+0000 7f9bd17fa640 1 -- 172.21.15.33:0/1720753136 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9bbc042070 con 0x7f9bd4109260 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.700+0000 7f9bd17fa640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9bc00b4cd0 0x7f9bc00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.700+0000 7f9bd37fe640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9bc00b4cd0 0x7f9bc00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.700+0000 7f9bd17fa640 1 -- 172.21.15.33:0/1720753136 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f9bbc1060c0 con 0x7f9bd4109260 2024-08-28T19:41:35.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.701+0000 7f9bd37fe640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9bc00b4cd0 0x7f9bc00b71e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400bbe0 tx=0x7f9bc400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:35.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.704+0000 7f9bd17fa640 1 -- 172.21.15.33:0/1720753136 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9bbc0ccb10 con 0x7f9bd4109260 2024-08-28T19:41:35.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:35 smithi059 ceph-mon[22052]: pgmap v622: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-08-28T19:41:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:35 smithi122 ceph-mon[22174]: pgmap v622: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 KiB/s wr, 16 op/s 2024-08-28T19:41:35.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.942+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1720753136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bd410b9b0 con 0x7f9bd4109260 2024-08-28T19:41:35.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.942+0000 7f9bd17fa640 1 -- 172.21.15.33:0/1720753136 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f9bbc0cc410 con 0x7f9bd4109260 2024-08-28T19:41:35.944 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:41:35.944 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:41:35.945 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:41:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1720753136 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9bc00b4cd0 msgr2=0x7f9bc00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9bc00b4cd0 0x7f9bc00b71e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400bbe0 tx=0x7f9bc400b390 comp rx=0 tx=0).stop 2024-08-28T19:41:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1720753136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bd4109260 msgr2=0x7f9bd419a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bd4109260 0x7f9bd419a7f0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc005ab0 tx=0x7f9bbc003cd0 comp rx=0 tx=0).stop 2024-08-28T19:41:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1720753136 shutdown_connections 2024-08-28T19:41:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd4109bb0 0x7f9bd419fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:35.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bd4109260 0x7f9bd419a7f0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9bc00b4cd0 0x7f9bc00b71e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 --2- 172.21.15.33:0/1720753136 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9bd4103920 0x7f9bd419a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1720753136 >> 172.21.15.33:0/1720753136 conn(0x7f9bd40ff3b0 msgr2=0x7f9bd41017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1720753136 shutdown_connections 2024-08-28T19:41:35.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:35.945+0000 7f9bd9ee8640 1 -- 172.21.15.33:0/1720753136 wait complete. 2024-08-28T19:41:36.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:36 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1720753136' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:36.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:36 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1720753136' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:36.858 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:36 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1720753136' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:36.895 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 132.4 --await-for 45.0' 2024-08-28T19:41:36.895 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 132.4 --await-for 45.0 2024-08-28T19:41:37.036 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:41:37.155 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:37.605 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:37 smithi033 ceph-mon[18549]: pgmap v623: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-08-28T19:41:37.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.706+0000 7fcfbb039640 1 -- 172.21.15.33:0/4024981440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb4108180 msgr2=0x7fcfb4108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.706+0000 7fcfbb039640 1 --2- 172.21.15.33:0/4024981440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb4108180 0x7fcfb4108590 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009900 tx=0x7fcfa802a410 comp rx=0 tx=0).stop 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.706+0000 7fcfbb039640 1 -- 172.21.15.33:0/4024981440 shutdown_connections 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.706+0000 7fcfbb039640 1 --2- 172.21.15.33:0/4024981440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb4108ad0 0x7fcfb410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.706+0000 7fcfbb039640 1 --2- 172.21.15.33:0/4024981440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb4108180 0x7fcfb4108590 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.706+0000 7fcfbb039640 1 --2- 172.21.15.33:0/4024981440 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb4102840 0x7fcfb4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.706+0000 7fcfbb039640 1 -- 172.21.15.33:0/4024981440 >> 172.21.15.33:0/4024981440 conn(0x7fcfb40794f0 msgr2=0x7fcfb4079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.706+0000 7fcfbb039640 1 -- 172.21.15.33:0/4024981440 shutdown_connections 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.706+0000 7fcfbb039640 1 -- 172.21.15.33:0/4024981440 wait complete. 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfbb039640 1 Processor -- start 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfbb039640 1 -- start start 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfbb039640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb4102840 0x7fcfb4199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfbb039640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb4108180 0x7fcfb4199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfbb039640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb4108ad0 0x7fcfb419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfbb039640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb4112760 con 0x7fcfb4102840 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfbb039640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb41125e0 con 0x7fcfb4108180 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfbb039640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb41128e0 con 0x7fcfb4108ad0 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfb8dd5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb4102840 0x7fcfb4199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfb8dd5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb4102840 0x7fcfb4199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59402/0 (socket says 172.21.15.33:59402) 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfb8dd5640 1 -- 172.21.15.33:0/3673364519 learned_addr learned my addr 172.21.15.33:0/3673364519 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.707+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb4108180 0x7fcfb4199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb95d6640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb4108ad0 0x7fcfb419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb8dd5640 1 -- 172.21.15.33:0/3673364519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb4108ad0 msgr2=0x7fcfb419e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb4108ad0 0x7fcfb419e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb8dd5640 1 -- 172.21.15.33:0/3673364519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb4108180 msgr2=0x7fcfb4199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb4108180 0x7fcfb4199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb8dd5640 1 -- 172.21.15.33:0/3673364519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb419f0e0 con 0x7fcfb4102840 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb4108180 0x7fcfb4199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb4102840 0x7fcfb4199170 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400eb90 tx=0x7fcfa400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb1ffb640 1 -- 172.21.15.33:0/3673364519 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4004d20 con 0x7fcfb4102840 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfbb039640 1 -- 172.21.15.33:0/3673364519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb419f3d0 con 0x7fcfb4102840 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb1ffb640 1 -- 172.21.15.33:0/3673364519 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa400ee90 con 0x7fcfb4102840 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfb1ffb640 1 -- 172.21.15.33:0/3673364519 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4010670 con 0x7fcfb4102840 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.708+0000 7fcfbb039640 1 -- 172.21.15.33:0/3673364519 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb41a5b30 con 0x7fcfb4102840 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfb1ffb640 1 -- 172.21.15.33:0/3673364519 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcfa4005020 con 0x7fcfb4102840 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfc15ae740 1 Processor -- start 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfc15ae740 1 -- start start 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b664f840 0x5644b69f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b69f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5644b696b330 con 0x5644b662eb60 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5644b695a8c0 con 0x5644b664f840 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5644b695e870 con 0x5644b6626980 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59414/0 (socket says 172.21.15.33:59414) 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2445531143 learned_addr learned my addr 172.21.15.33:0/2445531143 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfb95d6640 1 --2- 172.21.15.33:0/2445531143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b664f840 0x5644b69f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfb1ffb640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf9c0b4ca0 0x7fcf9c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.711+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/2445531143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b69f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcfb95d6640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf9c0b4ca0 0x7fcf9c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2445531143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 msgr2=0x5644b69f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/2445531143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b69f71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2445531143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b664f840 msgr2=0x5644b69f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/2445531143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b664f840 0x5644b69f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2445531143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644b6912df0 con 0x5644b662eb60 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/2445531143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b69f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcfb1ffb640 1 -- 172.21.15.33:0/3673364519 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fcfa40e60c0 con 0x7fcfb4102840 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/2445531143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f7710 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8031440 tx=0x7fcfa8032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ea9a8d58e8d593 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcfb95d6640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf9c0b4ca0 0x7fcf9c0b71b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005fd0 tx=0x7fcfac004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcf9affd640 1 -- 172.21.15.33:0/2445531143 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa803f070 con 0x5644b662eb60 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcf9affd640 1 -- 172.21.15.33:0/2445531143 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa80316a0 con 0x5644b662eb60 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.712+0000 7fcf9affd640 1 -- 172.21.15.33:0/2445531143 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8035070 con 0x5644b662eb60 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.713+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2445531143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 msgr2=0x5644b69f7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.713+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2445531143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f7710 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8031440 tx=0x7fcfa8032c50 comp rx=0 tx=0).stop 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.713+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2445531143 shutdown_connections 2024-08-28T19:41:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.713+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2445531143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f7710 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.713+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2445531143 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b69f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.713+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2445531143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b664f840 0x5644b69f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.713+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2445531143 >> 172.21.15.33:0/2445531143 conn(0x5644b6643990 msgr2=0x5644b69f4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.713+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2445531143 shutdown_connections 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.713+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2445531143 wait complete. 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.713+0000 7fcfc15ae740 1 -- start start 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfc15ae740 1 Processor -- start 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b6626980 0x5644b6a04590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b6a04ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b664f840 0x5644b6a108a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5644b67bd7a0 con 0x5644b662eb60 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5644b68e1240 con 0x5644b6626980 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5644b6a07540 con 0x5644b664f840 2024-08-28T19:41:37.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfc15ae740 10 client.0 _ll_register_callbacks cb 0x5644b6667090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b6a04ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b6a04ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59424/0 (socket says 172.21.15.33:59424) 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfb3fff640 1 -- 172.21.15.33:0/476916592 learned_addr learned my addr 172.21.15.33:0/476916592 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfb95d6640 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b664f840 0x5644b6a108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b6626980 0x5644b6a04590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfb3fff640 1 -- 172.21.15.33:0/476916592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b664f840 msgr2=0x5644b6a108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.714+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b664f840 0x5644b6a108a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcfb3fff640 1 -- 172.21.15.33:0/476916592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b6626980 msgr2=0x5644b6a04590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b6626980 0x5644b6a04590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcfb3fff640 1 -- 172.21.15.33:0/476916592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644b69172b0 con 0x5644b662eb60 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b6626980 0x5644b6a04590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:37.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b6a04ad0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8005f60 tx=0x7fcfa80315e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2633f8ada3849f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcf93fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcf93fff640 1 -- 172.21.15.33:0/476916592 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa803f070 con 0x5644b662eb60 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcf93fff640 1 -- 172.21.15.33:0/476916592 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fcfa8004440 con 0x5644b662eb60 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcfc15ae740 1 -- 172.21.15.33:0/476916592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfa80316a0 con 0x5644b662eb60 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcf93fff640 1 -- 172.21.15.33:0/476916592 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcfa8054050 con 0x5644b662eb60 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcfc15ae740 10 client.17982 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcfc15ae740 1 -- 172.21.15.33:0/476916592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5644b66c9b90 con 0x5644b662eb60 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcf93fff640 1 -- 172.21.15.33:0/476916592 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa80316a0 con 0x5644b662eb60 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.715+0000 7fcf93fff640 1 -- 172.21.15.33:0/476916592 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcfa80049b0 con 0x5644b662eb60 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.716+0000 7fcfc15ae740 10 client.17982 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.716+0000 7fcfc15ae740 10 client.17982 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.716+0000 7fcfc15ae740 20 client.17982 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:37.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.716+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5644b660e1c0 0x5644b6a16480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.716+0000 7fcfc15ae740 4 client.17982 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.716+0000 7fcfc15ae740 1 -- 172.21.15.33:0/476916592 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644b696d280 con 0x5644b660e1c0 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.716+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5644b660e1c0 0x5644b6a16480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.716+0000 7fcf93fff640 10 client.17982 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.716+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5644b660e1c0 0x5644b6a16480 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca31eb1ffdec423 server_cookie=a8c485c959474167 in_seq=0 out_seq=0 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcf93fff640 1 -- 172.21.15.33:0/476916592 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644b696d280 con 0x5644b660e1c0 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcf93fff640 10 client.17982 handle_command_reply: tid=0 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcfc15ae740 1 client.17982 shutdown 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcfc15ae740 1 -- 172.21.15.33:0/476916592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 msgr2=0x5644b6a04ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b6a04ad0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8005f60 tx=0x7fcfa80315e0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcfc15ae740 1 -- 172.21.15.33:0/476916592 shutdown_connections 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b664f840 0x5644b6a108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5644b660e1c0 0x5644b6a16480 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b6a04ad0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/476916592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b6626980 0x5644b6a04590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcf93fff640 0 client.17982 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:37.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.717+0000 7fcfc15ae740 1 -- 172.21.15.33:0/476916592 >> 172.21.15.33:0/476916592 conn(0x5644b6643990 msgr2=0x5644b69f3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:37.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.718+0000 7fcfc15ae740 1 -- 172.21.15.33:0/476916592 shutdown_connections 2024-08-28T19:41:37.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.718+0000 7fcfc15ae740 1 -- 172.21.15.33:0/476916592 wait complete. 2024-08-28T19:41:37.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.718+0000 7fcfc15ae740 20 client.17982 trim_cache size 0 max 16384 2024-08-28T19:41:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfc15ae740 1 Processor -- start 2024-08-28T19:41:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfc15ae740 1 -- start start 2024-08-28T19:41:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b6a10810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b664f840 0x5644b6a01780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb41ae9e0 con 0x5644b662eb60 2024-08-28T19:41:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb41b0520 con 0x5644b664f840 2024-08-28T19:41:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb41af0b0 con 0x5644b6626980 2024-08-28T19:41:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59428/0 (socket says 172.21.15.33:59428) 2024-08-28T19:41:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2727073503 learned_addr learned my addr 172.21.15.33:0/2727073503 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/2727073503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b6a10810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.737+0000 7fcfb95d6640 1 --2- 172.21.15.33:0/2727073503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b664f840 0x5644b6a01780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.738+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2727073503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 msgr2=0x5644b6a10810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:37.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.738+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/2727073503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b6a10810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.738+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2727073503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b664f840 msgr2=0x5644b6a01780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.738+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/2727073503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b664f840 0x5644b6a01780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.738+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2727073503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644b692ad90 con 0x5644b662eb60 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.738+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/2727073503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b6a10810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.738+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/2727073503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f83d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8052040 tx=0x7fcfa8032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb793cd73b31b0e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.738+0000 7fcf9a7fc640 1 -- 172.21.15.33:0/2727073503 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa805f070 con 0x5644b662eb60 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.738+0000 7fcf9a7fc640 1 -- 172.21.15.33:0/2727073503 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa804b070 con 0x5644b662eb60 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.738+0000 7fcf9a7fc640 1 -- 172.21.15.33:0/2727073503 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa803f070 con 0x5644b662eb60 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.739+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2727073503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 msgr2=0x5644b69f83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.739+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2727073503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f83d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8052040 tx=0x7fcfa8032c50 comp rx=0 tx=0).stop 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.739+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2727073503 shutdown_connections 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.739+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2727073503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b664f840 0x5644b6a01780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.739+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2727073503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b662eb60 0x5644b69f83d0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.739+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2727073503 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b6a10810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.739+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2727073503 >> 172.21.15.33:0/2727073503 conn(0x5644b6643990 msgr2=0x5644b69f7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.739+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2727073503 shutdown_connections 2024-08-28T19:41:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.739+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2727073503 wait complete. 2024-08-28T19:41:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.740+0000 7fcfc15ae740 1 -- start start 2024-08-28T19:41:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.740+0000 7fcfc15ae740 1 Processor -- start 2024-08-28T19:41:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.740+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b6a194c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.740+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b662eb60 0x5644b6a19a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.740+0000 7fcfc15ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b664f840 0x5644b6a14470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.740+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb41afe50 con 0x5644b664f840 2024-08-28T19:41:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.740+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb41af780 con 0x5644b662eb60 2024-08-28T19:41:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.740+0000 7fcfc15ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb41ac9e0 con 0x5644b6626980 2024-08-28T19:41:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.740+0000 7fcfc15ae740 10 client.0 _ll_register_callbacks cb 0x7fcfa8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b662eb60 0x5644b6a19a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b662eb60 0x5644b6a19a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:39760/0 (socket says 172.21.15.33:39760) 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb8dd5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b6a194c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2947726829 learned_addr learned my addr 172.21.15.33:0/2947726829 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb95d6640 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b664f840 0x5644b6a14470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2947726829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 msgr2=0x5644b6a194c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b6a194c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2947726829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b664f840 msgr2=0x5644b6a14470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b664f840 0x5644b6a14470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb3fff640 1 -- 172.21.15.33:0/2947726829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644b6a149b0 con 0x5644b662eb60 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcfb3fff640 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b662eb60 0x5644b6a19a20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8004d50 tx=0x7fcfa802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fd697b103a916b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.741+0000 7fcf93fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.742+0000 7fcf93fff640 1 -- 172.21.15.33:0/2947726829 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa805f070 con 0x5644b662eb60 2024-08-28T19:41:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.742+0000 7fcf93fff640 1 -- 172.21.15.33:0/2947726829 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fcfa80316a0 con 0x5644b662eb60 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.742+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2947726829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfa804b070 con 0x5644b662eb60 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.742+0000 7fcf93fff640 1 -- 172.21.15.33:0/2947726829 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcfa803f040 con 0x5644b662eb60 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.742+0000 7fcfc15ae740 10 client.27086 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.742+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2947726829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5644b6a7f2e0 con 0x5644b662eb60 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.742+0000 7fcf93fff640 1 -- 172.21.15.33:0/2947726829 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa804b070 con 0x5644b662eb60 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.743+0000 7fcf93fff640 1 -- 172.21.15.33:0/2947726829 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcfa805bc90 con 0x5644b662eb60 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.743+0000 7fcfc15ae740 10 client.27086 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.743+0000 7fcfc15ae740 10 client.27086 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.743+0000 7fcfc15ae740 20 client.27086 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.743+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5644b65e3570 0x5644b6a819e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.743+0000 7fcfc15ae740 4 client.27086 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 132.4, "await_for": 45.0}] 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.743+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2947726829 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 132.4, "await_for": 45.0}) -- 0x5644b6968d20 con 0x5644b65e3570 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.743+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5644b65e3570 0x5644b6a819e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.743+0000 7fcfb8dd5640 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5644b65e3570 0x5644b6a819e0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1128c2f9518e5be0 server_cookie=dd8bb7f68989c47e in_seq=0 out_seq=0 2024-08-28T19:41:37.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.743+0000 7fcf93fff640 10 client.27086 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:37.759 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:37.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcf93fff640 1 -- 172.21.15.33:0/2947726829 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5644b6968d20 con 0x5644b65e3570 2024-08-28T19:41:37.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcf93fff640 10 client.27086 handle_command_reply: tid=0 2024-08-28T19:41:37.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 client.27086 shutdown 2024-08-28T19:41:37.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2947726829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b662eb60 msgr2=0x5644b6a19a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:37.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b662eb60 0x5644b6a19a20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8004d50 tx=0x7fcfa802a410 comp rx=0 tx=0).stop 2024-08-28T19:41:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2947726829 shutdown_connections 2024-08-28T19:41:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5644b65e3570 0x5644b6a819e0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5644b664f840 0x5644b6a14470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5644b662eb60 0x5644b6a19a20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 --2- 172.21.15.33:0/2947726829 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5644b6626980 0x5644b6a194c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcf93fff640 0 client.27086 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2947726829 >> 172.21.15.33:0/2947726829 conn(0x5644b6643990 msgr2=0x5644b6a02e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2947726829 shutdown_connections 2024-08-28T19:41:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 1 -- 172.21.15.33:0/2947726829 wait complete. 2024-08-28T19:41:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.759+0000 7fcfc15ae740 20 client.27086 trim_cache size 0 max 16384 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 26, 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "bbc98890": { 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 26, 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 132.4, 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:37.764 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:41:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 -- 172.21.15.33:0/3673364519 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf9c0b4ca0 msgr2=0x7fcf9c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf9c0b4ca0 0x7fcf9c0b71b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005fd0 tx=0x7fcfac004730 comp rx=0 tx=0).stop 2024-08-28T19:41:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 -- 172.21.15.33:0/3673364519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb4102840 msgr2=0x7fcfb4199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb4102840 0x7fcfb4199170 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400eb90 tx=0x7fcfa400c6a0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 -- 172.21.15.33:0/3673364519 shutdown_connections 2024-08-28T19:41:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf9c0b4ca0 0x7fcf9c0b71b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcfb4108ad0 0x7fcfb419e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb4108180 0x7fcfb4199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 --2- 172.21.15.33:0/3673364519 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfb4102840 0x7fcfb4199170 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 -- 172.21.15.33:0/3673364519 >> 172.21.15.33:0/3673364519 conn(0x7fcfb40794f0 msgr2=0x7fcfb41041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 -- 172.21.15.33:0/3673364519 shutdown_connections 2024-08-28T19:41:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:37.760+0000 7fcfbb039640 1 -- 172.21.15.33:0/3673364519 wait complete. 2024-08-28T19:41:37.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:37 smithi059 ceph-mon[22052]: pgmap v623: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-08-28T19:41:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:37 smithi122 ceph-mon[22174]: pgmap v623: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-08-28T19:41:39.003 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bbc98890', quiesce took 4.1 seconds. Will release after: 8.3 2024-08-28T19:41:39.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 -- 172.21.15.33:0/1953582812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9518109b90 msgr2=0x7f95181103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 --2- 172.21.15.33:0/1953582812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9518109b90 0x7f95181103c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f9510009ca0 tx=0x7f951002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 -- 172.21.15.33:0/1953582812 shutdown_connections 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 --2- 172.21.15.33:0/1953582812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9518109b90 0x7f95181103c0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 --2- 172.21.15.33:0/1953582812 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9518109240 0x7f9518109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 --2- 172.21.15.33:0/1953582812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9518103900 0x7f9518103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 -- 172.21.15.33:0/1953582812 >> 172.21.15.33:0/1953582812 conn(0x7f951807b5f0 msgr2=0x7f951807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 -- 172.21.15.33:0/1953582812 shutdown_connections 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 -- 172.21.15.33:0/1953582812 wait complete. 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 Processor -- start 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.220+0000 7f952029d640 1 -- start start 2024-08-28T19:41:39.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f952029d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9518103900 0x7f951819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f952029d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9518109240 0x7f951819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f952029d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9518109b90 0x7f951819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f952029d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9518113850 con 0x7f9518103900 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f952029d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95181136d0 con 0x7f9518109240 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f952029d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f95181139d0 con 0x7f9518109b90 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951e039640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9518103900 0x7f951819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951e039640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9518103900 0x7f951819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51916/0 (socket says 172.21.15.33:51916) 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951e039640 1 -- 172.21.15.33:0/1111246596 learned_addr learned my addr 172.21.15.33:0/1111246596 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951d838640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9518109240 0x7f951819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951e83a640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9518109b90 0x7f951819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951e039640 1 -- 172.21.15.33:0/1111246596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9518109b90 msgr2=0x7f951819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:39.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951e039640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9518109b90 0x7f951819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951e039640 1 -- 172.21.15.33:0/1111246596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9518109240 msgr2=0x7f951819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:39.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951e039640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9518109240 0x7f951819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951e039640 1 -- 172.21.15.33:0/1111246596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95181a0170 con 0x7f9518103900 2024-08-28T19:41:39.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.221+0000 7f951e039640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9518103900 0x7f951819a200 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f951400d950 tx=0x7f951400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:39.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.222+0000 7f950f7fe640 1 -- 172.21.15.33:0/1111246596 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514017070 con 0x7f9518103900 2024-08-28T19:41:39.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.222+0000 7f950f7fe640 1 -- 172.21.15.33:0/1111246596 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9514009c30 con 0x7f9518103900 2024-08-28T19:41:39.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.222+0000 7f952029d640 1 -- 172.21.15.33:0/1111246596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95181a0460 con 0x7f9518103900 2024-08-28T19:41:39.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.222+0000 7f950f7fe640 1 -- 172.21.15.33:0/1111246596 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951400f620 con 0x7f9518103900 2024-08-28T19:41:39.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.222+0000 7f952029d640 1 -- 172.21.15.33:0/1111246596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95181a6bc0 con 0x7f9518103900 2024-08-28T19:41:39.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.224+0000 7f9526812740 1 Processor -- start 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.224+0000 7f950f7fe640 1 -- 172.21.15.33:0/1111246596 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9514010460 con 0x7f9518103900 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.224+0000 7f9526812740 1 -- start start 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f9526812740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068b0070 0x55d806c552c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f9526812740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c55800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f9526812740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d80688f390 0x55d806c55d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f9526812740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d806bcc630 con 0x55d8068871b0 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f9526812740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d806bbbbc0 con 0x55d8068b0070 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f9526812740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d806bbfb70 con 0x55d80688f390 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f951e039640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c55800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f951e039640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c55800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51920/0 (socket says 172.21.15.33:51920) 2024-08-28T19:41:39.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f951e039640 1 -- 172.21.15.33:0/1555413196 learned_addr learned my addr 172.21.15.33:0/1555413196 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f951e83a640 1 --2- 172.21.15.33:0/1555413196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068b0070 0x55d806c552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f951d838640 1 --2- 172.21.15.33:0/1555413196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d80688f390 0x55d806c55d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.225+0000 7f950f7fe640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4d20 0x7f95040b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f951e039640 1 -- 172.21.15.33:0/1555413196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d80688f390 msgr2=0x55d806c55d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f951e039640 1 --2- 172.21.15.33:0/1555413196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d80688f390 0x55d806c55d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f951e039640 1 -- 172.21.15.33:0/1555413196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068b0070 msgr2=0x55d806c552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f951e039640 1 --2- 172.21.15.33:0/1555413196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068b0070 0x55d806c552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f951e039640 1 -- 172.21.15.33:0/1555413196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80691b650 con 0x55d8068871b0 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f951e83a640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4d20 0x7f95040b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f950f7fe640 1 -- 172.21.15.33:0/1111246596 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f95140e5460 con 0x7f9518103900 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f951e039640 1 --2- 172.21.15.33:0/1555413196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c55800 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f95140e26f0 tx=0x7f95140701b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8973a34be875a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f950cd9a640 1 -- 172.21.15.33:0/1555413196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95140ab150 con 0x55d8068871b0 2024-08-28T19:41:39.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f951e83a640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4d20 0x7f95040b7230 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f951002f500 tx=0x7f951002a8c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:39.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f950cd9a640 1 -- 172.21.15.33:0/1555413196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95140ab310 con 0x55d8068871b0 2024-08-28T19:41:39.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.226+0000 7f950cd9a640 1 -- 172.21.15.33:0/1555413196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95140aaf70 con 0x55d8068871b0 2024-08-28T19:41:39.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 -- 172.21.15.33:0/1555413196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 msgr2=0x55d806c55800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:39.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 --2- 172.21.15.33:0/1555413196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c55800 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f95140e26f0 tx=0x7f95140701b0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 -- 172.21.15.33:0/1555413196 shutdown_connections 2024-08-28T19:41:39.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 --2- 172.21.15.33:0/1555413196 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d80688f390 0x55d806c55d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 --2- 172.21.15.33:0/1555413196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c55800 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 --2- 172.21.15.33:0/1555413196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068b0070 0x55d806c552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 -- 172.21.15.33:0/1555413196 >> 172.21.15.33:0/1555413196 conn(0x55d8068a4460 msgr2=0x55d806c531b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:39.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 -- 172.21.15.33:0/1555413196 shutdown_connections 2024-08-28T19:41:39.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 -- 172.21.15.33:0/1555413196 wait complete. 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 -- start start 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.228+0000 7f9526812740 1 Processor -- start 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f9526812740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068871b0 0x55d806c609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f9526812740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d80688f390 0x55d806c60f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f9526812740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068b0070 0x55d806c6cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f9526812740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d806a1e700 con 0x55d8068b0070 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f9526812740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d806b42700 con 0x55d8068871b0 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f9526812740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d806c63a40 con 0x55d80688f390 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f9526812740 10 client.0 _ll_register_callbacks cb 0x55d806b71dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f951e83a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068b0070 0x55d806c6cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f951e83a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068b0070 0x55d806c6cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51924/0 (socket says 172.21.15.33:51924) 2024-08-28T19:41:39.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f951e83a640 1 -- 172.21.15.33:0/1141413023 learned_addr learned my addr 172.21.15.33:0/1141413023 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f951e039640 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068871b0 0x55d806c609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f951d838640 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d80688f390 0x55d806c60f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f951e83a640 1 -- 172.21.15.33:0/1141413023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d80688f390 msgr2=0x55d806c60f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f951e83a640 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d80688f390 0x55d806c60f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f951e83a640 1 -- 172.21.15.33:0/1141413023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068871b0 msgr2=0x55d806c609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f951e83a640 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068871b0 0x55d806c609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.229+0000 7f951e83a640 1 -- 172.21.15.33:0/1141413023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d806b7b8b0 con 0x55d8068b0070 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f951e83a640 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068b0070 0x55d806c6cd30 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f9510035000 tx=0x7f95100095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1127aeaac3da51ae server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9501ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9501ffb640 1 -- 172.21.15.33:0/1141413023 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9510045070 con 0x55d8068b0070 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9501ffb640 1 -- 172.21.15.33:0/1141413023 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f9510004450 con 0x55d8068b0070 2024-08-28T19:41:39.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9526812740 1 -- 172.21.15.33:0/1141413023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95140ab310 con 0x55d8068b0070 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9501ffb640 1 -- 172.21.15.33:0/1141413023 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f951005d050 con 0x55d8068b0070 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9526812740 10 client.18000 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9526812740 1 -- 172.21.15.33:0/1141413023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d806c6f780 con 0x55d8068b0070 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9501ffb640 1 -- 172.21.15.33:0/1141413023 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95140ab310 con 0x55d8068b0070 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9501ffb640 1 -- 172.21.15.33:0/1141413023 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f95100305c0 con 0x55d8068b0070 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9526812740 10 client.18000 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.230+0000 7f9526812740 10 client.18000 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.231+0000 7f9526812740 20 client.18000 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.231+0000 7f9526812740 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d80686e9f0 0x55d806c72c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.231+0000 7f9526812740 4 client.18000 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.231+0000 7f9526812740 1 -- 172.21.15.33:0/1141413023 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d806bce580 con 0x55d80686e9f0 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.231+0000 7f951e039640 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d80686e9f0 0x55d806c72c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.231+0000 7f9501ffb640 10 client.18000 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.231+0000 7f951e039640 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d80686e9f0 0x55d806c72c90 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43d7207731cd9395 server_cookie=673b21169907c623 in_seq=0 out_seq=0 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9501ffb640 1 -- 172.21.15.33:0/1141413023 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d806bce580 con 0x55d80686e9f0 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9501ffb640 10 client.18000 handle_command_reply: tid=0 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9526812740 1 client.18000 shutdown 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9526812740 1 -- 172.21.15.33:0/1141413023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068b0070 msgr2=0x55d806c6cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9526812740 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068b0070 0x55d806c6cd30 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f9510035000 tx=0x7f95100095c0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9526812740 1 -- 172.21.15.33:0/1141413023 shutdown_connections 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9526812740 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d80686e9f0 0x55d806c72c90 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9526812740 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068b0070 0x55d806c6cd30 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9526812740 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d80688f390 0x55d806c60f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9526812740 1 --2- 172.21.15.33:0/1141413023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068871b0 0x55d806c609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9526812740 1 -- 172.21.15.33:0/1141413023 >> 172.21.15.33:0/1141413023 conn(0x55d8068a4460 msgr2=0x55d806c58450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:39.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.232+0000 7f9501ffb640 0 client.18000 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.233+0000 7f9526812740 1 -- 172.21.15.33:0/1141413023 shutdown_connections 2024-08-28T19:41:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.233+0000 7f9526812740 1 -- 172.21.15.33:0/1141413023 wait complete. 2024-08-28T19:41:39.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.233+0000 7f9526812740 20 client.18000 trim_cache size 0 max 16384 2024-08-28T19:41:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.250+0000 7f9526812740 1 Processor -- start 2024-08-28T19:41:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.250+0000 7f9526812740 1 -- start start 2024-08-28T19:41:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.250+0000 7f9526812740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c6cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.250+0000 7f9526812740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d80688f390 0x55d806c52b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.250+0000 7f9526812740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8068b0070 0x55d806c53050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.250+0000 7f9526812740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95181b0d40 con 0x55d8068871b0 2024-08-28T19:41:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.250+0000 7f9526812740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95181b2880 con 0x55d80688f390 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.250+0000 7f9526812740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f95181b1410 con 0x55d8068b0070 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.250+0000 7f951e039640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c6cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951e039640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c6cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51934/0 (socket says 172.21.15.33:51934) 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951e039640 1 -- 172.21.15.33:0/1577768918 learned_addr learned my addr 172.21.15.33:0/1577768918 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951e83a640 1 --2- 172.21.15.33:0/1577768918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8068b0070 0x55d806c53050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951d838640 1 --2- 172.21.15.33:0/1577768918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d80688f390 0x55d806c52b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951e039640 1 -- 172.21.15.33:0/1577768918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8068b0070 msgr2=0x55d806c53050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951e039640 1 --2- 172.21.15.33:0/1577768918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8068b0070 0x55d806c53050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951e039640 1 -- 172.21.15.33:0/1577768918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d80688f390 msgr2=0x55d806c52b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951e039640 1 --2- 172.21.15.33:0/1577768918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d80688f390 0x55d806c52b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951e039640 1 -- 172.21.15.33:0/1577768918 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d806c63670 con 0x55d8068871b0 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951d838640 1 --2- 172.21.15.33:0/1577768918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d80688f390 0x55d806c52b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:41:39.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f951e039640 1 --2- 172.21.15.33:0/1577768918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c6cc30 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f95140ab500 tx=0x7f9514010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe16707cee2abbb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f9503fff640 1 -- 172.21.15.33:0/1577768918 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514020040 con 0x55d8068871b0 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f9503fff640 1 -- 172.21.15.33:0/1577768918 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95140ab310 con 0x55d8068871b0 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.251+0000 7f9503fff640 1 -- 172.21.15.33:0/1577768918 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95140affc0 con 0x55d8068871b0 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.252+0000 7f9526812740 1 -- 172.21.15.33:0/1577768918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 msgr2=0x55d806c6cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.252+0000 7f9526812740 1 --2- 172.21.15.33:0/1577768918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c6cc30 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f95140ab500 tx=0x7f9514010cb0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.252+0000 7f9526812740 1 -- 172.21.15.33:0/1577768918 shutdown_connections 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.252+0000 7f9526812740 1 --2- 172.21.15.33:0/1577768918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8068b0070 0x55d806c53050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.252+0000 7f9526812740 1 --2- 172.21.15.33:0/1577768918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d80688f390 0x55d806c52b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.252+0000 7f9526812740 1 --2- 172.21.15.33:0/1577768918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d8068871b0 0x55d806c6cc30 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.252+0000 7f9526812740 1 -- 172.21.15.33:0/1577768918 >> 172.21.15.33:0/1577768918 conn(0x55d8068a4460 msgr2=0x55d806c5f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.252+0000 7f9526812740 1 -- 172.21.15.33:0/1577768918 shutdown_connections 2024-08-28T19:41:39.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.252+0000 7f9526812740 1 -- 172.21.15.33:0/1577768918 wait complete. 2024-08-28T19:41:39.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.252+0000 7f9526812740 1 -- start start 2024-08-28T19:41:39.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f9526812740 1 Processor -- start 2024-08-28T19:41:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f9526812740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8068871b0 0x55d806c69200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f9526812740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80688f390 0x55d806cd6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f9526812740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068b0070 0x55d806cd7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f9526812740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95181b21b0 con 0x55d80688f390 2024-08-28T19:41:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f9526812740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95181b1ae0 con 0x55d8068b0070 2024-08-28T19:41:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f9526812740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f95181aed40 con 0x55d8068871b0 2024-08-28T19:41:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f9526812740 10 client.0 _ll_register_callbacks cb 0x7f9510031cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f951d838640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80688f390 0x55d806cd6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f951d838640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80688f390 0x55d806cd6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51946/0 (socket says 172.21.15.33:51946) 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f951d838640 1 -- 172.21.15.33:0/3547885401 learned_addr learned my addr 172.21.15.33:0/3547885401 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f951e83a640 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068b0070 0x55d806cd7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f951e039640 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8068871b0 0x55d806c69200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f951d838640 1 -- 172.21.15.33:0/3547885401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8068871b0 msgr2=0x55d806c69200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f951d838640 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8068871b0 0x55d806c69200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f951d838640 1 -- 172.21.15.33:0/3547885401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068b0070 msgr2=0x55d806cd7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f951d838640 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068b0070 0x55d806cd7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.253+0000 7f951d838640 1 -- 172.21.15.33:0/3547885401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d806cd7a70 con 0x55d80688f390 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f951d838640 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80688f390 0x55d806cd6ff0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f951806c790 tx=0x7f9508010c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e888d28bbb4dff7b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9501ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9501ffb640 1 -- 172.21.15.33:0/3547885401 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508023060 con 0x55d80688f390 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9501ffb640 1 -- 172.21.15.33:0/3547885401 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f9508004460 con 0x55d80688f390 2024-08-28T19:41:39.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9526812740 1 -- 172.21.15.33:0/3547885401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95140ab310 con 0x55d80688f390 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9501ffb640 1 -- 172.21.15.33:0/3547885401 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f950802a050 con 0x55d80688f390 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9526812740 10 client.18006 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9526812740 1 -- 172.21.15.33:0/3547885401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d806ce2640 con 0x55d80688f390 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9501ffb640 1 -- 172.21.15.33:0/3547885401 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95140ab310 con 0x55d80688f390 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9501ffb640 1 -- 172.21.15.33:0/3547885401 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9508003c20 con 0x55d80688f390 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9526812740 10 client.18006 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9526812740 10 client.18006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9526812740 20 client.18006 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9526812740 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d806843da0 0x55d806ce4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9526812740 4 client.18006 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.254+0000 7f9526812740 1 -- 172.21.15.33:0/3547885401 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d806bca020 con 0x55d806843da0 2024-08-28T19:41:39.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.255+0000 7f951e039640 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d806843da0 0x55d806ce4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.255+0000 7f951e039640 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d806843da0 0x55d806ce4e00 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=506d741d42100220 server_cookie=923b54efa19f7d45 in_seq=0 out_seq=0 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.255+0000 7f9501ffb640 10 client.18006 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.255+0000 7f9501ffb640 1 -- 172.21.15.33:0/3547885401 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x55d806bca020 con 0x55d806843da0 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.255+0000 7f9501ffb640 10 client.18006 handle_command_reply: tid=0 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.255+0000 7f9526812740 1 client.18006 shutdown 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 1 -- 172.21.15.33:0/3547885401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80688f390 msgr2=0x55d806cd6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80688f390 0x55d806cd6ff0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f951806c790 tx=0x7f9508010c60 comp rx=0 tx=0).stop 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 1 -- 172.21.15.33:0/3547885401 shutdown_connections 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d8068b0070 0x55d806cd7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d806843da0 0x55d806ce4e00 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d80688f390 0x55d806cd6ff0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 1 --2- 172.21.15.33:0/3547885401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d8068871b0 0x55d806c69200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 1 -- 172.21.15.33:0/3547885401 >> 172.21.15.33:0/3547885401 conn(0x55d8068a4460 msgr2=0x55d806c52990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:39.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9501ffb640 0 client.18006 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:39.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 1 -- 172.21.15.33:0/3547885401 shutdown_connections 2024-08-28T19:41:39.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 1 -- 172.21.15.33:0/3547885401 wait complete. 2024-08-28T19:41:39.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f9526812740 20 client.18006 trim_cache size 0 max 16384 2024-08-28T19:41:39.264 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:41:39.264 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:41:39.264 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:41:39.264 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:41:39.264 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:41:39.264 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.265 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:41:39.266 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:41:39.268 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.269 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.270 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.272 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:39.273 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:41:39.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 -- 172.21.15.33:0/1111246596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4d20 msgr2=0x7f95040b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:39.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4d20 0x7f95040b7230 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f951002f500 tx=0x7f951002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 -- 172.21.15.33:0/1111246596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9518103900 msgr2=0x7f951819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:39.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9518103900 0x7f951819a200 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f951400d950 tx=0x7f951400de10 comp rx=0 tx=0).stop 2024-08-28T19:41:39.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 -- 172.21.15.33:0/1111246596 shutdown_connections 2024-08-28T19:41:39.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95040b4d20 0x7f95040b7230 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9518109b90 0x7f951819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9518109240 0x7f951819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 --2- 172.21.15.33:0/1111246596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9518103900 0x7f951819a200 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 -- 172.21.15.33:0/1111246596 >> 172.21.15.33:0/1111246596 conn(0x7f951807b5f0 msgr2=0x7f9518107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.256+0000 7f952029d640 1 -- 172.21.15.33:0/1111246596 shutdown_connections 2024-08-28T19:41:39.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:39.257+0000 7f952029d640 1 -- 172.21.15.33:0/1111246596 wait complete. 2024-08-28T19:41:39.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:39 smithi033 ceph-mon[18549]: pgmap v624: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 17 op/s 2024-08-28T19:41:39.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:39 smithi059 ceph-mon[22052]: pgmap v624: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 17 op/s 2024-08-28T19:41:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:39 smithi122 ceph-mon[22174]: pgmap v624: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 17 op/s 2024-08-28T19:41:40.046 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:41:40.047 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:41:40.306 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:40.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.826+0000 7f57a369c640 1 -- 172.21.15.33:0/3228425249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f579c109b90 msgr2=0x7f579c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:40.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.826+0000 7f57a369c640 1 --2- 172.21.15.33:0/3228425249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f579c109b90 0x7f579c1103c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f5794009ca0 tx=0x7f579402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:41:40.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.826+0000 7f57a369c640 1 -- 172.21.15.33:0/3228425249 shutdown_connections 2024-08-28T19:41:40.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.826+0000 7f57a369c640 1 --2- 172.21.15.33:0/3228425249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f579c109b90 0x7f579c1103c0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:40.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.826+0000 7f57a369c640 1 --2- 172.21.15.33:0/3228425249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c109240 0x7f579c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:40.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.826+0000 7f57a369c640 1 --2- 172.21.15.33:0/3228425249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f579c103900 0x7f579c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:40.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.826+0000 7f57a369c640 1 -- 172.21.15.33:0/3228425249 >> 172.21.15.33:0/3228425249 conn(0x7f579c07b5f0 msgr2=0x7f579c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:40.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.826+0000 7f57a369c640 1 -- 172.21.15.33:0/3228425249 shutdown_connections 2024-08-28T19:41:40.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.826+0000 7f57a369c640 1 -- 172.21.15.33:0/3228425249 wait complete. 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.827+0000 7f57a369c640 1 Processor -- start 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.827+0000 7f57a369c640 1 -- start start 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.827+0000 7f57a369c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c103900 0x7f579c19a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.827+0000 7f57a369c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f579c109240 0x7f579c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a369c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f579c109b90 0x7f579c19fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a369c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f579c113850 con 0x7f579c109240 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a369c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f579c1136d0 con 0x7f579c103900 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a369c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f579c1139d0 con 0x7f579c109b90 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a0c37640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f579c109240 0x7f579c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a0c37640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f579c109240 0x7f579c19a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51976/0 (socket says 172.21.15.33:51976) 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a0c37640 1 -- 172.21.15.33:0/2451496104 learned_addr learned my addr 172.21.15.33:0/2451496104 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a1c39640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f579c109b90 0x7f579c19fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a1438640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c103900 0x7f579c19a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a0c37640 1 -- 172.21.15.33:0/2451496104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f579c109b90 msgr2=0x7f579c19fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a0c37640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f579c109b90 0x7f579c19fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a0c37640 1 -- 172.21.15.33:0/2451496104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c103900 msgr2=0x7f579c19a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a0c37640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c103900 0x7f579c19a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a0c37640 1 -- 172.21.15.33:0/2451496104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c1a0150 con 0x7f579c109240 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a1438640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c103900 0x7f579c19a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a0c37640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f579c109240 0x7f579c19a780 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f578c00d740 tx=0x7f578c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57927fc640 1 -- 172.21.15.33:0/2451496104 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c017070 con 0x7f579c109240 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a369c640 1 -- 172.21.15.33:0/2451496104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579c1a0440 con 0x7f579c109240 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57927fc640 1 -- 172.21.15.33:0/2451496104 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f578c00de50 con 0x7f579c109240 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57927fc640 1 -- 172.21.15.33:0/2451496104 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c00f620 con 0x7f579c109240 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.828+0000 7f57a369c640 1 -- 172.21.15.33:0/2451496104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579c1a6ba0 con 0x7f579c109240 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.830+0000 7f57a369c640 1 -- 172.21.15.33:0/2451496104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f579c103d10 con 0x7f579c109240 2024-08-28T19:41:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.831+0000 7f57927fc640 1 -- 172.21.15.33:0/2451496104 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f578c01a070 con 0x7f579c109240 2024-08-28T19:41:40.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.832+0000 7f57927fc640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57880b4ca0 0x7f57880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:40.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.832+0000 7f57a1438640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57880b4ca0 0x7f57880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:40.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.832+0000 7f57927fc640 1 -- 172.21.15.33:0/2451496104 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f578c0e5450 con 0x7f579c109240 2024-08-28T19:41:40.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.832+0000 7f57a1438640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57880b4ca0 0x7f57880b71b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5798009b40 tx=0x7f5798005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:40.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:40.836+0000 7f57927fc640 1 -- 172.21.15.33:0/2451496104 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f578c0abe40 con 0x7f579c109240 2024-08-28T19:41:41.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.060+0000 7f57a369c640 1 -- 172.21.15.33:0/2451496104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f579c02e430 con 0x7f579c109240 2024-08-28T19:41:41.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.061+0000 7f57927fc640 1 -- 172.21.15.33:0/2451496104 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f578c0b4380 con 0x7f579c109240 2024-08-28T19:41:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:41:41.063 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:41:41.063 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:41:41.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.063+0000 7f57a369c640 1 -- 172.21.15.33:0/2451496104 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57880b4ca0 msgr2=0x7f57880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.063+0000 7f57a369c640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57880b4ca0 0x7f57880b71b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5798009b40 tx=0x7f5798005e50 comp rx=0 tx=0).stop 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.063+0000 7f57a369c640 1 -- 172.21.15.33:0/2451496104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f579c109240 msgr2=0x7f579c19a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.063+0000 7f57a369c640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f579c109240 0x7f579c19a780 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f578c00d740 tx=0x7f578c00dc00 comp rx=0 tx=0).stop 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.064+0000 7f57a369c640 1 -- 172.21.15.33:0/2451496104 shutdown_connections 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.064+0000 7f57a369c640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f57880b4ca0 0x7f57880b71b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.064+0000 7f57a369c640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f579c109b90 0x7f579c19fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.064+0000 7f57a369c640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f579c109240 0x7f579c19a780 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.064+0000 7f57a369c640 1 --2- 172.21.15.33:0/2451496104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c103900 0x7f579c19a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.064+0000 7f57a369c640 1 -- 172.21.15.33:0/2451496104 >> 172.21.15.33:0/2451496104 conn(0x7f579c07b5f0 msgr2=0x7f579c107250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.064+0000 7f57a369c640 1 -- 172.21.15.33:0/2451496104 shutdown_connections 2024-08-28T19:41:41.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:41.064+0000 7f57a369c640 1 -- 172.21.15.33:0/2451496104 wait complete. 2024-08-28T19:41:41.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:41 smithi033 ceph-mon[18549]: pgmap v625: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-08-28T19:41:41.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:41 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2451496104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:41.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:41 smithi059 ceph-mon[22052]: pgmap v625: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-08-28T19:41:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:41 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2451496104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:41 smithi122 ceph-mon[22174]: pgmap v625: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 14 op/s 2024-08-28T19:41:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:41 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2451496104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:41.827 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:41:42.084 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:42.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.557+0000 7f5902fc1640 1 -- 172.21.15.33:0/1847286703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58fc109b90 msgr2=0x7f58fc1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.557+0000 7f5902fc1640 1 --2- 172.21.15.33:0/1847286703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58fc109b90 0x7f58fc1103c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f58f4009ca0 tx=0x7f58f402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.557+0000 7f5902fc1640 1 -- 172.21.15.33:0/1847286703 shutdown_connections 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.557+0000 7f5902fc1640 1 --2- 172.21.15.33:0/1847286703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58fc109b90 0x7f58fc1103c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.557+0000 7f5902fc1640 1 --2- 172.21.15.33:0/1847286703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58fc109240 0x7f58fc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.557+0000 7f5902fc1640 1 --2- 172.21.15.33:0/1847286703 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58fc103900 0x7f58fc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.557+0000 7f5902fc1640 1 -- 172.21.15.33:0/1847286703 >> 172.21.15.33:0/1847286703 conn(0x7f58fc07b5f0 msgr2=0x7f58fc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.557+0000 7f5902fc1640 1 -- 172.21.15.33:0/1847286703 shutdown_connections 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.557+0000 7f5902fc1640 1 -- 172.21.15.33:0/1847286703 wait complete. 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5902fc1640 1 Processor -- start 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5902fc1640 1 -- start start 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5902fc1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58fc103900 0x7f58fc19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5902fc1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58fc109240 0x7f58fc19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5902fc1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58fc109b90 0x7f58fc19f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5902fc1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc113850 con 0x7f58fc103900 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5902fc1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1136d0 con 0x7f58fc109b90 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5902fc1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1139d0 con 0x7f58fc109240 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5900d5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58fc103900 0x7f58fc19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5900d5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58fc103900 0x7f58fc19a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51996/0 (socket says 172.21.15.33:51996) 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5900d5d640 1 -- 172.21.15.33:0/1875362515 learned_addr learned my addr 172.21.15.33:0/1875362515 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f590155e640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58fc109b90 0x7f58fc19f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f58f3fff640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58fc109240 0x7f58fc19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5900d5d640 1 -- 172.21.15.33:0/1875362515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58fc109240 msgr2=0x7f58fc19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5900d5d640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58fc109240 0x7f58fc19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5900d5d640 1 -- 172.21.15.33:0/1875362515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58fc109b90 msgr2=0x7f58fc19f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5900d5d640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58fc109b90 0x7f58fc19f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5900d5d640 1 -- 172.21.15.33:0/1875362515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc1a0050 con 0x7f58fc103900 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f590155e640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58fc109b90 0x7f58fc19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f58f3fff640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58fc109240 0x7f58fc19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.558+0000 7f5900d5d640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58fc103900 0x7f58fc19a1a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f58f800d950 tx=0x7f58f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.559+0000 7f58f1ffb640 1 -- 172.21.15.33:0/1875362515 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8017070 con 0x7f58fc103900 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.559+0000 7f5902fc1640 1 -- 172.21.15.33:0/1875362515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58fc1a0340 con 0x7f58fc103900 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.559+0000 7f58f1ffb640 1 -- 172.21.15.33:0/1875362515 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58f8009c30 con 0x7f58fc103900 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.559+0000 7f58f1ffb640 1 -- 172.21.15.33:0/1875362515 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f800f620 con 0x7f58fc103900 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.559+0000 7f5902fc1640 1 -- 172.21.15.33:0/1875362515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58fc1a6b60 con 0x7f58fc103900 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.562+0000 7f5909536740 1 Processor -- start 2024-08-28T19:41:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.562+0000 7f5909536740 1 -- start start 2024-08-28T19:41:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.562+0000 7f58f1ffb640 1 -- 172.21.15.33:0/1875362515 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f58f8010460 con 0x7f58fc103900 2024-08-28T19:41:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.562+0000 7f5909536740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56084175a070 0x560841aff310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.562+0000 7f5909536740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841aff850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.562+0000 7f5909536740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560841739390 0x560841affd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5909536740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560841a76680 con 0x5608417311b0 2024-08-28T19:41:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5909536740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560841a65c10 con 0x560841739390 2024-08-28T19:41:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5909536740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560841a69bc0 con 0x56084175a070 2024-08-28T19:41:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5900d5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841aff850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5900d5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841aff850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52006/0 (socket says 172.21.15.33:52006) 2024-08-28T19:41:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5900d5d640 1 -- 172.21.15.33:0/948019551 learned_addr learned my addr 172.21.15.33:0/948019551 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f590155e640 1 --2- 172.21.15.33:0/948019551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56084175a070 0x560841aff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f58f3fff640 1 --2- 172.21.15.33:0/948019551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560841739390 0x560841affd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5900d5d640 1 -- 172.21.15.33:0/948019551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56084175a070 msgr2=0x560841aff310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5900d5d640 1 --2- 172.21.15.33:0/948019551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56084175a070 0x560841aff310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5900d5d640 1 -- 172.21.15.33:0/948019551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560841739390 msgr2=0x560841affd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5900d5d640 1 --2- 172.21.15.33:0/948019551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560841739390 0x560841affd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5900d5d640 1 -- 172.21.15.33:0/948019551 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608417c5650 con 0x5608417311b0 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f590155e640 1 --2- 172.21.15.33:0/948019551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56084175a070 0x560841aff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f58f1ffb640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f58e40b4cd0 0x7f58e40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f5900d5d640 1 --2- 172.21.15.33:0/948019551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841aff850 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f58f80e28d0 tx=0x7f58f80ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac9a3ffad3834ca server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f590155e640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f58e40b4cd0 0x7f58e40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f58f1ffb640 1 -- 172.21.15.33:0/1875362515 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f58f80e55b0 con 0x7f58fc103900 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.563+0000 7f58e2ffd640 1 -- 172.21.15.33:0/948019551 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80a77c0 con 0x5608417311b0 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f58e2ffd640 1 -- 172.21.15.33:0/948019551 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58f80a7080 con 0x5608417311b0 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f58e2ffd640 1 -- 172.21.15.33:0/948019551 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80ab070 con 0x5608417311b0 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f5909536740 1 -- 172.21.15.33:0/948019551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 msgr2=0x560841aff850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f590155e640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f58e40b4cd0 0x7f58e40b71e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f58f402f500 tx=0x7f58f402f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f5909536740 1 --2- 172.21.15.33:0/948019551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841aff850 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f58f80e28d0 tx=0x7f58f80ed690 comp rx=0 tx=0).stop 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f5909536740 1 -- 172.21.15.33:0/948019551 shutdown_connections 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f5909536740 1 --2- 172.21.15.33:0/948019551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560841739390 0x560841affd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f5909536740 1 --2- 172.21.15.33:0/948019551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841aff850 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f5909536740 1 --2- 172.21.15.33:0/948019551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56084175a070 0x560841aff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f5909536740 1 -- 172.21.15.33:0/948019551 >> 172.21.15.33:0/948019551 conn(0x56084174e460 msgr2=0x560841afd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.564+0000 7f5909536740 1 -- 172.21.15.33:0/948019551 shutdown_connections 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.565+0000 7f5909536740 1 -- 172.21.15.33:0/948019551 wait complete. 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.565+0000 7f5909536740 1 -- start start 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.565+0000 7f5909536740 1 Processor -- start 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.565+0000 7f5909536740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 0x560841b0aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.565+0000 7f5909536740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560841739390 0x560841b0af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.565+0000 7f5909536740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56084175a070 0x560841b16e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.565+0000 7f5909536740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5608418c8700 con 0x560841739390 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.565+0000 7f5909536740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5608419ec750 con 0x56084175a070 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.565+0000 7f5909536740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560841b0daf0 con 0x5608417311b0 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f5909536740 10 client.0 _ll_register_callbacks cb 0x560841a1be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58f3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560841739390 0x560841b0af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58f3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560841739390 0x560841b0af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52014/0 (socket says 172.21.15.33:52014) 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58f3fff640 1 -- 172.21.15.33:0/1507686474 learned_addr learned my addr 172.21.15.33:0/1507686474 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f5900d5d640 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 0x560841b0aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f590155e640 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56084175a070 0x560841b16e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58f3fff640 1 -- 172.21.15.33:0/1507686474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 msgr2=0x560841b0aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58f3fff640 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 0x560841b0aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58f3fff640 1 -- 172.21.15.33:0/1507686474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56084175a070 msgr2=0x560841b16e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58f3fff640 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56084175a070 0x560841b16e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58f3fff640 1 -- 172.21.15.33:0/1507686474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560841a25900 con 0x560841739390 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58f3fff640 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560841739390 0x560841b0af90 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00f410 tx=0x7f58ec00f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e15b5b6ce449301 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58dbfff640 1 -- 172.21.15.33:0/1507686474 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec004220 con 0x560841739390 2024-08-28T19:41:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f58dbfff640 1 -- 172.21.15.33:0/1507686474 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f58ec0043c0 con 0x560841739390 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.566+0000 7f5909536740 1 -- 172.21.15.33:0/1507686474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58f80a7080 con 0x560841739390 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f58dbfff640 1 -- 172.21.15.33:0/1507686474 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f58ec011710 con 0x560841739390 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f5909536740 10 client.18024 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f5909536740 1 -- 172.21.15.33:0/1507686474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560841b198f0 con 0x560841739390 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f58dbfff640 1 -- 172.21.15.33:0/1507686474 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58f80a7080 con 0x560841739390 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f58dbfff640 1 -- 172.21.15.33:0/1507686474 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f58ec003c40 con 0x560841739390 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f5909536740 10 client.18024 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f5909536740 10 client.18024 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f5909536740 20 client.18024 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f5909536740 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5608417189f0 0x560841b1ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f5909536740 4 client.18024 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f5909536740 1 -- 172.21.15.33:0/1507686474 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560841a785d0 con 0x5608417189f0 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.567+0000 7f5900d5d640 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5608417189f0 0x560841b1ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.568+0000 7f5900d5d640 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5608417189f0 0x560841b1ce10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3936957e7847b00d server_cookie=71b7a081d638a878 in_seq=0 out_seq=0 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.568+0000 7f58dbfff640 10 client.18024 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f58dbfff640 1 -- 172.21.15.33:0/1507686474 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560841a785d0 con 0x5608417189f0 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f58dbfff640 10 client.18024 handle_command_reply: tid=0 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 client.18024 shutdown 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 -- 172.21.15.33:0/1507686474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560841739390 msgr2=0x560841b0af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560841739390 0x560841b0af90 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00f410 tx=0x7f58ec00f8d0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 -- 172.21.15.33:0/1507686474 shutdown_connections 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5608417189f0 0x560841b1ce10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56084175a070 0x560841b16e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560841739390 0x560841b0af90 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 --2- 172.21.15.33:0/1507686474 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 0x560841b0aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 -- 172.21.15.33:0/1507686474 >> 172.21.15.33:0/1507686474 conn(0x56084174e460 msgr2=0x560841b024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f58dbfff640 0 client.18024 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:41:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 -- 172.21.15.33:0/1507686474 shutdown_connections 2024-08-28T19:41:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 1 -- 172.21.15.33:0/1507686474 wait complete. 2024-08-28T19:41:42.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.569+0000 7f5909536740 20 client.18024 trim_cache size 0 max 16384 2024-08-28T19:41:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.582+0000 7f5909536740 1 Processor -- start 2024-08-28T19:41:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.582+0000 7f5909536740 1 -- start start 2024-08-28T19:41:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f5909536740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 0x560841b02b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f5909536740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560841739390 0x560841b16d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f5909536740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56084175a070 0x560841b17270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f5909536740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1b0b90 con 0x56084175a070 2024-08-28T19:41:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f5909536740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1b26d0 con 0x560841739390 2024-08-28T19:41:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f5909536740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1b1260 con 0x5608417311b0 2024-08-28T19:41:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f590155e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56084175a070 0x560841b17270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f590155e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56084175a070 0x560841b17270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52030/0 (socket says 172.21.15.33:52030) 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f590155e640 1 -- 172.21.15.33:0/3102368575 learned_addr learned my addr 172.21.15.33:0/3102368575 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f5900d5d640 1 --2- 172.21.15.33:0/3102368575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 0x560841b02b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f58f3fff640 1 --2- 172.21.15.33:0/3102368575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560841739390 0x560841b16d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f590155e640 1 -- 172.21.15.33:0/3102368575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 msgr2=0x560841b02b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f590155e640 1 --2- 172.21.15.33:0/3102368575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 0x560841b02b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f590155e640 1 -- 172.21.15.33:0/3102368575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560841739390 msgr2=0x560841b16d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f590155e640 1 --2- 172.21.15.33:0/3102368575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560841739390 0x560841b16d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f590155e640 1 -- 172.21.15.33:0/3102368575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560841afdb70 con 0x56084175a070 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f5900d5d640 1 --2- 172.21.15.33:0/3102368575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 0x560841b02b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f590155e640 1 --2- 172.21.15.33:0/3102368575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56084175a070 0x560841b17270 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f58f4031f90 tx=0x7f58f403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c4fe4ff915c14a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.583+0000 7f58e27fc640 1 -- 172.21.15.33:0/3102368575 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f402f660 con 0x56084175a070 2024-08-28T19:41:42.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f58e27fc640 1 -- 172.21.15.33:0/3102368575 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58f4036070 con 0x56084175a070 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f58e27fc640 1 -- 172.21.15.33:0/3102368575 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4030c20 con 0x56084175a070 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f5909536740 1 -- 172.21.15.33:0/3102368575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56084175a070 msgr2=0x560841b17270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f5909536740 1 --2- 172.21.15.33:0/3102368575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56084175a070 0x560841b17270 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f58f4031f90 tx=0x7f58f403f000 comp rx=0 tx=0).stop 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f5909536740 1 -- 172.21.15.33:0/3102368575 shutdown_connections 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f5909536740 1 --2- 172.21.15.33:0/3102368575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56084175a070 0x560841b17270 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f5909536740 1 --2- 172.21.15.33:0/3102368575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560841739390 0x560841b16d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f5909536740 1 --2- 172.21.15.33:0/3102368575 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5608417311b0 0x560841b02b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f5909536740 1 -- 172.21.15.33:0/3102368575 >> 172.21.15.33:0/3102368575 conn(0x56084174e460 msgr2=0x560841b02410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f5909536740 1 -- 172.21.15.33:0/3102368575 shutdown_connections 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.584+0000 7f5909536740 1 -- 172.21.15.33:0/3102368575 wait complete. 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5909536740 1 -- start start 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5909536740 1 Processor -- start 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5909536740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841b0edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5909536740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560841739390 0x560841b0f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5909536740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56084175a070 0x560841b0f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5909536740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1b2000 con 0x5608417311b0 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5909536740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1b1930 con 0x56084175a070 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5909536740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1aeb90 con 0x560841739390 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5909536740 10 client.0 _ll_register_callbacks cb 0x7f58ec00a3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5900d5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841b0edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5900d5d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841b0edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52032/0 (socket says 172.21.15.33:52032) 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.585+0000 7f5900d5d640 1 -- 172.21.15.33:0/315656845 learned_addr learned my addr 172.21.15.33:0/315656845 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f58f3fff640 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560841739390 0x560841b0f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f590155e640 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56084175a070 0x560841b0f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f5900d5d640 1 -- 172.21.15.33:0/315656845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560841739390 msgr2=0x560841b0f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f5900d5d640 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560841739390 0x560841b0f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f5900d5d640 1 -- 172.21.15.33:0/315656845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56084175a070 msgr2=0x560841b0f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f5900d5d640 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56084175a070 0x560841b0f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f5900d5d640 1 -- 172.21.15.33:0/315656845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560841b86810 con 0x5608417311b0 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f5900d5d640 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841b0edd0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f58f800bfd0 tx=0x7f58f800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed775fa23a75508b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f58dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f58dbfff640 1 -- 172.21.15.33:0/315656845 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8020040 con 0x5608417311b0 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f58dbfff640 1 -- 172.21.15.33:0/315656845 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f58f80eb730 con 0x5608417311b0 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f5909536740 1 -- 172.21.15.33:0/315656845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58f4036070 con 0x5608417311b0 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f58dbfff640 1 -- 172.21.15.33:0/315656845 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f58f80ab250 con 0x5608417311b0 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f5909536740 10 client.18030 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.586+0000 7f5909536740 1 -- 172.21.15.33:0/315656845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560841b87a70 con 0x5608417311b0 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f58dbfff640 1 -- 172.21.15.33:0/315656845 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58f4036070 con 0x5608417311b0 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f58dbfff640 1 -- 172.21.15.33:0/315656845 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f58f80a7b90 con 0x5608417311b0 2024-08-28T19:41:42.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f5909536740 10 client.18030 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f5909536740 10 client.18030 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f5909536740 20 client.18030 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f5909536740 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5608416edda0 0x560841b89d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f5909536740 4 client.18030 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f5909536740 1 -- 172.21.15.33:0/315656845 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560841a74070 con 0x5608416edda0 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f58f3fff640 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5608416edda0 0x560841b89d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f58dbfff640 10 client.18030 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.587+0000 7f58f3fff640 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5608416edda0 0x560841b89d50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d0a54c1665bae883 server_cookie=c9247cc550683ec1 in_seq=0 out_seq=0 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f58dbfff640 1 -- 172.21.15.33:0/315656845 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560841a74070 con 0x5608416edda0 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f58dbfff640 10 client.18030 handle_command_reply: tid=0 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 client.18030 shutdown 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 -- 172.21.15.33:0/315656845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 msgr2=0x560841b0edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841b0edd0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f58f800bfd0 tx=0x7f58f800bf60 comp rx=0 tx=0).stop 2024-08-28T19:41:42.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 -- 172.21.15.33:0/315656845 shutdown_connections 2024-08-28T19:41:42.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5608416edda0 0x560841b89d50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56084175a070 0x560841b0f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560841739390 0x560841b0f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 --2- 172.21.15.33:0/315656845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5608417311b0 0x560841b0edd0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 -- 172.21.15.33:0/315656845 >> 172.21.15.33:0/315656845 conn(0x56084174e460 msgr2=0x560841afc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:42.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f58dbfff640 0 client.18030 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:41:42.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 -- 172.21.15.33:0/315656845 shutdown_connections 2024-08-28T19:41:42.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 1 -- 172.21.15.33:0/315656845 wait complete. 2024-08-28T19:41:42.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.588+0000 7f5909536740 20 client.18030 trim_cache size 0 max 16384 2024-08-28T19:41:42.597 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:41:42.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 -- 172.21.15.33:0/1875362515 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f58e40b4cd0 msgr2=0x7f58e40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:42.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f58e40b4cd0 0x7f58e40b71e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f58f402f500 tx=0x7f58f402f310 comp rx=0 tx=0).stop 2024-08-28T19:41:42.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 -- 172.21.15.33:0/1875362515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58fc103900 msgr2=0x7f58fc19a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:42.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58fc103900 0x7f58fc19a1a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f58f800d950 tx=0x7f58f800de10 comp rx=0 tx=0).stop 2024-08-28T19:41:42.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 -- 172.21.15.33:0/1875362515 shutdown_connections 2024-08-28T19:41:42.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58fc109b90 0x7f58fc19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f58e40b4cd0 0x7f58e40b71e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58fc109240 0x7f58fc19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 --2- 172.21.15.33:0/1875362515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58fc103900 0x7f58fc19a1a0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:42.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 -- 172.21.15.33:0/1875362515 >> 172.21.15.33:0/1875362515 conn(0x7f58fc07b5f0 msgr2=0x7f58fc1051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:42.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 -- 172.21.15.33:0/1875362515 shutdown_connections 2024-08-28T19:41:42.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:42.589+0000 7f5902fc1640 1 -- 172.21.15.33:0/1875362515 wait complete. 2024-08-28T19:41:43.418 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:41:43.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:43 smithi033 ceph-mon[18549]: pgmap v626: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 49 KiB/s wr, 14 op/s 2024-08-28T19:41:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:43.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:43 smithi059 ceph-mon[22052]: pgmap v626: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 49 KiB/s wr, 14 op/s 2024-08-28T19:41:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:43 smithi122 ceph-mon[22174]: pgmap v626: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 49 KiB/s wr, 14 op/s 2024-08-28T19:41:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.225+0000 7fd81b2ae640 1 -- 172.21.15.33:0/3273156409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd814101e20 msgr2=0x7fd814102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.225+0000 7fd81b2ae640 1 --2- 172.21.15.33:0/3273156409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd814101e20 0x7fd814102230 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd810009900 tx=0x7fd81002a410 comp rx=0 tx=0).stop 2024-08-28T19:41:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.225+0000 7fd81b2ae640 1 -- 172.21.15.33:0/3273156409 shutdown_connections 2024-08-28T19:41:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.225+0000 7fd81b2ae640 1 --2- 172.21.15.33:0/3273156409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd814109c50 0x7fd814110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.225+0000 7fd81b2ae640 1 --2- 172.21.15.33:0/3273156409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814109300 0x7fd814109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.225+0000 7fd81b2ae640 1 --2- 172.21.15.33:0/3273156409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd814101e20 0x7fd814102230 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.225+0000 7fd81b2ae640 1 -- 172.21.15.33:0/3273156409 >> 172.21.15.33:0/3273156409 conn(0x7fd814079c60 msgr2=0x7fd81407a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:44.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.225+0000 7fd81b2ae640 1 -- 172.21.15.33:0/3273156409 shutdown_connections 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.225+0000 7fd81b2ae640 1 -- 172.21.15.33:0/3273156409 wait complete. 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.226+0000 7fd81b2ae640 1 Processor -- start 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.226+0000 7fd81b2ae640 1 -- start start 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.226+0000 7fd81b2ae640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814101e20 0x7fd81419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.226+0000 7fd81b2ae640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd814109300 0x7fd81419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.226+0000 7fd81b2ae640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd814109c50 0x7fd81419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.226+0000 7fd81b2ae640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141139d0 con 0x7fd814109c50 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.226+0000 7fd81b2ae640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd814113850 con 0x7fd814101e20 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.226+0000 7fd81b2ae640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd814113b50 con 0x7fd814109300 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81984b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd814109c50 0x7fd81419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81984b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd814109c50 0x7fd81419fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52046/0 (socket says 172.21.15.33:52046) 2024-08-28T19:41:44.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81984b640 1 -- 172.21.15.33:0/942119218 learned_addr learned my addr 172.21.15.33:0/942119218 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81904a640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814101e20 0x7fd81419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd818849640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd814109300 0x7fd81419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81984b640 1 -- 172.21.15.33:0/942119218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd814109300 msgr2=0x7fd81419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81984b640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd814109300 0x7fd81419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81984b640 1 -- 172.21.15.33:0/942119218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814101e20 msgr2=0x7fd81419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81984b640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814101e20 0x7fd81419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81984b640 1 -- 172.21.15.33:0/942119218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8141a0310 con 0x7fd814109c50 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81984b640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd814109c50 0x7fd81419fbe0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00b970 tx=0x7fd80c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd80a7fc640 1 -- 172.21.15.33:0/942119218 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c019070 con 0x7fd814109c50 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd80a7fc640 1 -- 172.21.15.33:0/942119218 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd80c014440 con 0x7fd814109c50 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81b2ae640 1 -- 172.21.15.33:0/942119218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8141a0600 con 0x7fd814109c50 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd80a7fc640 1 -- 172.21.15.33:0/942119218 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0075d0 con 0x7fd814109c50 2024-08-28T19:41:44.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.227+0000 7fd81b2ae640 1 -- 172.21.15.33:0/942119218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8141a6d60 con 0x7fd814109c50 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.230+0000 7fd821823740 1 Processor -- start 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.230+0000 7fd80a7fc640 1 -- 172.21.15.33:0/942119218 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd80c01c070 con 0x7fd814109c50 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.230+0000 7fd821823740 1 -- start start 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.230+0000 7fd821823740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x55593709e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd821823740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 0x55593709e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd821823740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd8390 0x55593709ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd821823740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555937015680 con 0x555936cf9070 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd821823740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555937004c10 con 0x555936cd8390 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd821823740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555937008bc0 con 0x555936cd01b0 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd818849640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x55593709e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd818849640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x55593709e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52060/0 (socket says 172.21.15.33:52060) 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd818849640 1 -- 172.21.15.33:0/362127290 learned_addr learned my addr 172.21.15.33:0/362127290 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:44.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd81904a640 1 --2- 172.21.15.33:0/362127290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 0x55593709e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd818849640 1 --2- 172.21.15.33:0/362127290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd8390 0x55593709ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd80a7fc640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8000b4d20 0x7fd8000b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd818849640 1 -- 172.21.15.33:0/362127290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 msgr2=0x55593709e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd818849640 1 --2- 172.21.15.33:0/362127290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 0x55593709e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd818849640 1 -- 172.21.15.33:0/362127290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd8390 msgr2=0x55593709ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd818849640 1 --2- 172.21.15.33:0/362127290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd8390 0x55593709ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd818849640 1 -- 172.21.15.33:0/362127290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555936d64650 con 0x555936cf9070 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd81904a640 1 --2- 172.21.15.33:0/362127290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 0x55593709e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd81984b640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8000b4d20 0x7fd8000b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.231+0000 7fd80a7fc640 1 -- 172.21.15.33:0/942119218 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fd80c0e4e10 con 0x7fd814109c50 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.232+0000 7fd818849640 1 --2- 172.21.15.33:0/362127290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x55593709e310 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fd804006aa0 tx=0x7fd80400b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2453178d071693 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.232+0000 7fd7ff7fe640 1 -- 172.21.15.33:0/362127290 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8040173f0 con 0x555936cf9070 2024-08-28T19:41:44.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.232+0000 7fd7ff7fe640 1 -- 172.21.15.33:0/362127290 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd804010040 con 0x555936cf9070 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.232+0000 7fd7ff7fe640 1 -- 172.21.15.33:0/362127290 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8040168a0 con 0x555936cf9070 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 -- 172.21.15.33:0/362127290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 msgr2=0x55593709e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 --2- 172.21.15.33:0/362127290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x55593709e310 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fd804006aa0 tx=0x7fd80400b400 comp rx=0 tx=0).stop 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd81984b640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8000b4d20 0x7fd8000b7230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0e27c0 tx=0x7fd80c004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 -- 172.21.15.33:0/362127290 shutdown_connections 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 --2- 172.21.15.33:0/362127290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd8390 0x55593709ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 --2- 172.21.15.33:0/362127290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 0x55593709e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 --2- 172.21.15.33:0/362127290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x55593709e310 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 -- 172.21.15.33:0/362127290 >> 172.21.15.33:0/362127290 conn(0x555936ced460 msgr2=0x55593709c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 -- 172.21.15.33:0/362127290 shutdown_connections 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 -- 172.21.15.33:0/362127290 wait complete. 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 -- start start 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.233+0000 7fd821823740 1 Processor -- start 2024-08-28T19:41:44.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd821823740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 0x5559370a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd821823740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd8390 0x5559370a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd821823740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd821823740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555936e67700 con 0x555936cf9070 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd821823740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555936f8b750 con 0x555936cd8390 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd821823740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5559370aca90 con 0x555936cd01b0 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd821823740 10 client.0 _ll_register_callbacks cb 0x555936fbae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd818849640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd818849640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370b5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52072/0 (socket says 172.21.15.33:52072) 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd818849640 1 -- 172.21.15.33:0/3893806711 learned_addr learned my addr 172.21.15.33:0/3893806711 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd818849640 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 0x5559370a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd81904a640 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd8390 0x5559370a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd818849640 1 -- 172.21.15.33:0/3893806711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 msgr2=0x5559370a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd818849640 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 0x5559370a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd818849640 1 -- 172.21.15.33:0/3893806711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd8390 msgr2=0x5559370a9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd818849640 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd8390 0x5559370a9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd818849640 1 -- 172.21.15.33:0/3893806711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555936fc4900 con 0x555936cf9070 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd818849640 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370b5d80 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fd80400ffd0 tx=0x7fd8040164e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e10402b0188edeb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.234+0000 7fd7fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3893806711 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804029070 con 0x555936cf9070 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3893806711 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fd804017800 con 0x555936cf9070 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd821823740 1 -- 172.21.15.33:0/3893806711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd804010040 con 0x555936cf9070 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3893806711 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd804035050 con 0x555936cf9070 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd821823740 10 client.18042 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:44.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd821823740 1 -- 172.21.15.33:0/3893806711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5559370b8820 con 0x555936cf9070 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3893806711 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd804010040 con 0x555936cf9070 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3893806711 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd8040258f0 con 0x555936cf9070 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd821823740 10 client.18042 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd821823740 10 client.18042 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd821823740 20 client.18042 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd821823740 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555936cb79f0 0x5559370bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd821823740 4 client.18042 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.235+0000 7fd821823740 1 -- 172.21.15.33:0/3893806711 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559370175d0 con 0x555936cb79f0 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.236+0000 7fd81904a640 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555936cb79f0 0x5559370bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.236+0000 7fd7fcff9640 10 client.18042 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:41:44.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.236+0000 7fd81904a640 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555936cb79f0 0x5559370bbb80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=53c63156a28aa17 server_cookie=d1bd04f85a33494 in_seq=0 out_seq=0 2024-08-28T19:41:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3893806711 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5559370175d0 con 0x555936cb79f0 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd7fcff9640 10 client.18042 handle_command_reply: tid=0 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd821823740 1 client.18042 shutdown 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd821823740 1 -- 172.21.15.33:0/3893806711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 msgr2=0x5559370b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd821823740 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370b5d80 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fd80400ffd0 tx=0x7fd8040164e0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd821823740 1 -- 172.21.15.33:0/3893806711 shutdown_connections 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd821823740 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555936cb79f0 0x5559370bbb80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd821823740 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370b5d80 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd821823740 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd8390 0x5559370a9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd7fcff9640 0 client.18042 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd821823740 1 --2- 172.21.15.33:0/3893806711 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd01b0 0x5559370a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.237+0000 7fd821823740 1 -- 172.21.15.33:0/3893806711 >> 172.21.15.33:0/3893806711 conn(0x555936ced460 msgr2=0x5559370a14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:44.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.238+0000 7fd821823740 1 -- 172.21.15.33:0/3893806711 shutdown_connections 2024-08-28T19:41:44.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.238+0000 7fd821823740 1 -- 172.21.15.33:0/3893806711 wait complete. 2024-08-28T19:41:44.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.238+0000 7fd821823740 20 client.18042 trim_cache size 0 max 16384 2024-08-28T19:41:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.251+0000 7fd821823740 1 Processor -- start 2024-08-28T19:41:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.251+0000 7fd821823740 1 -- start start 2024-08-28T19:41:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.251+0000 7fd821823740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd01b0 0x5559370b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.251+0000 7fd821823740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd8390 0x5559370b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.251+0000 7fd821823740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370a1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.251+0000 7fd821823740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141b0c90 con 0x555936cf9070 2024-08-28T19:41:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.251+0000 7fd821823740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141b27d0 con 0x555936cd01b0 2024-08-28T19:41:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.251+0000 7fd821823740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141b1360 con 0x555936cd8390 2024-08-28T19:41:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.251+0000 7fd818849640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.251+0000 7fd818849640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52080/0 (socket says 172.21.15.33:52080) 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd818849640 1 -- 172.21.15.33:0/4121293827 learned_addr learned my addr 172.21.15.33:0/4121293827 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd818849640 1 --2- 172.21.15.33:0/4121293827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd01b0 0x5559370b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd81904a640 1 --2- 172.21.15.33:0/4121293827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd8390 0x5559370b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd818849640 1 -- 172.21.15.33:0/4121293827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd8390 msgr2=0x5559370b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd818849640 1 --2- 172.21.15.33:0/4121293827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd8390 0x5559370b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd818849640 1 -- 172.21.15.33:0/4121293827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd01b0 msgr2=0x5559370b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd818849640 1 --2- 172.21.15.33:0/4121293827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd01b0 0x5559370b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd818849640 1 -- 172.21.15.33:0/4121293827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559370ac620 con 0x555936cf9070 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd818849640 1 --2- 172.21.15.33:0/4121293827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370a1410 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fd804007fd0 tx=0x7fd80400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812ef813e0880030 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd7feffd640 1 -- 172.21.15.33:0/4121293827 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804029040 con 0x555936cf9070 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd7feffd640 1 -- 172.21.15.33:0/4121293827 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd80400b150 con 0x555936cf9070 2024-08-28T19:41:44.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.252+0000 7fd7feffd640 1 -- 172.21.15.33:0/4121293827 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804024a50 con 0x555936cf9070 2024-08-28T19:41:44.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.253+0000 7fd821823740 1 -- 172.21.15.33:0/4121293827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 msgr2=0x5559370a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:44.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.253+0000 7fd821823740 1 --2- 172.21.15.33:0/4121293827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370a1410 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fd804007fd0 tx=0x7fd80400bfd0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.253+0000 7fd821823740 1 -- 172.21.15.33:0/4121293827 shutdown_connections 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.253+0000 7fd821823740 1 --2- 172.21.15.33:0/4121293827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x5559370a1410 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.253+0000 7fd821823740 1 --2- 172.21.15.33:0/4121293827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd8390 0x5559370b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.253+0000 7fd821823740 1 --2- 172.21.15.33:0/4121293827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd01b0 0x5559370b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.253+0000 7fd821823740 1 -- 172.21.15.33:0/4121293827 >> 172.21.15.33:0/4121293827 conn(0x555936ced460 msgr2=0x5559370a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.253+0000 7fd821823740 1 -- 172.21.15.33:0/4121293827 shutdown_connections 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.253+0000 7fd821823740 1 -- 172.21.15.33:0/4121293827 wait complete. 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.253+0000 7fd821823740 1 -- start start 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd821823740 1 Processor -- start 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd821823740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd01b0 0x55593711e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd821823740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd8390 0x55593711e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd821823740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x555937129420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd821823740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141b2100 con 0x555936cf9070 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd821823740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141b1a30 con 0x555936cd01b0 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd821823740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141aec90 con 0x555936cd8390 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd821823740 10 client.0 _ll_register_callbacks cb 0x7fd80400bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd818849640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x555937129420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd818849640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x555937129420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52086/0 (socket says 172.21.15.33:52086) 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd818849640 1 -- 172.21.15.33:0/3696891555 learned_addr learned my addr 172.21.15.33:0/3696891555 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd818849640 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd01b0 0x55593711e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.254+0000 7fd81904a640 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd8390 0x55593711e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd818849640 1 -- 172.21.15.33:0/3696891555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd8390 msgr2=0x55593711e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd818849640 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd8390 0x55593711e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd818849640 1 -- 172.21.15.33:0/3696891555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd01b0 msgr2=0x55593711e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:44.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd818849640 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd01b0 0x55593711e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd818849640 1 -- 172.21.15.33:0/3696891555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55593711f180 con 0x555936cf9070 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd818849640 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x555937129420 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x555936fbae50 tx=0x7fd804006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6d248f6543c9e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd7fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3696891555 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804029040 con 0x555936cf9070 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3696891555 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fd804024e10 con 0x555936cf9070 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd821823740 1 -- 172.21.15.33:0/3696891555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd80400b150 con 0x555936cf9070 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3696891555 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd804016e50 con 0x555936cf9070 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd821823740 10 client.18048 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd821823740 1 -- 172.21.15.33:0/3696891555 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55593712a980 con 0x555936cf9070 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.255+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3696891555 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd80400b150 con 0x555936cf9070 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.256+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3696891555 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd804017600 con 0x555936cf9070 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.256+0000 7fd821823740 10 client.18048 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:44.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.256+0000 7fd821823740 10 client.18048 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.256+0000 7fd821823740 20 client.18048 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.256+0000 7fd821823740 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555936c8cda0 0x55593712d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.256+0000 7fd821823740 4 client.18048 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.256+0000 7fd821823740 1 -- 172.21.15.33:0/3696891555 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555937013070 con 0x555936c8cda0 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.256+0000 7fd81904a640 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555936c8cda0 0x55593712d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.256+0000 7fd81904a640 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555936c8cda0 0x55593712d1f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3134353ef05756fb server_cookie=3fa0ff81c74a2625 in_seq=0 out_seq=0 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.256+0000 7fd7fcff9640 10 client.18048 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd7fcff9640 1 -- 172.21.15.33:0/3696891555 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555937013070 con 0x555936c8cda0 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd7fcff9640 10 client.18048 handle_command_reply: tid=0 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 client.18048 shutdown 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 -- 172.21.15.33:0/3696891555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 msgr2=0x555937129420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x555937129420 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x555936fbae50 tx=0x7fd804006a30 comp rx=0 tx=0).stop 2024-08-28T19:41:44.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 -- 172.21.15.33:0/3696891555 shutdown_connections 2024-08-28T19:41:44.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x555936c8cda0 0x55593712d1f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555936cf9070 0x555937129420 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd7fcff9640 0 client.18048 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:41:44.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555936cd8390 0x55593711e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 --2- 172.21.15.33:0/3696891555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555936cd01b0 0x55593711e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 -- 172.21.15.33:0/3696891555 >> 172.21.15.33:0/3696891555 conn(0x555936ced460 msgr2=0x5559370a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:44.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 -- 172.21.15.33:0/3696891555 shutdown_connections 2024-08-28T19:41:44.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 1 -- 172.21.15.33:0/3696891555 wait complete. 2024-08-28T19:41:44.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.257+0000 7fd821823740 20 client.18048 trim_cache size 0 max 16384 2024-08-28T19:41:44.264 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:41:44.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 -- 172.21.15.33:0/942119218 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8000b4d20 msgr2=0x7fd8000b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:44.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8000b4d20 0x7fd8000b7230 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0e27c0 tx=0x7fd80c004a40 comp rx=0 tx=0).stop 2024-08-28T19:41:44.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 -- 172.21.15.33:0/942119218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd814109c50 msgr2=0x7fd81419fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:44.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd814109c50 0x7fd81419fbe0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00b970 tx=0x7fd80c00be30 comp rx=0 tx=0).stop 2024-08-28T19:41:44.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 -- 172.21.15.33:0/942119218 shutdown_connections 2024-08-28T19:41:44.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd814109c50 0x7fd81419fbe0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8000b4d20 0x7fd8000b7230 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd814109300 0x7fd81419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 --2- 172.21.15.33:0/942119218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814101e20 0x7fd81419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:44.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 -- 172.21.15.33:0/942119218 >> 172.21.15.33:0/942119218 conn(0x7fd814079c60 msgr2=0x7fd814107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:44.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 -- 172.21.15.33:0/942119218 shutdown_connections 2024-08-28T19:41:44.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:44.258+0000 7fd81b2ae640 1 -- 172.21.15.33:0/942119218 wait complete. 2024-08-28T19:41:45.138 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:41:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:45 smithi059 ceph-mon[22052]: pgmap v627: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-08-28T19:41:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:45 smithi122 ceph-mon[22174]: pgmap v627: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-08-28T19:41:45.797 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:45 smithi033 ceph-mon[18549]: pgmap v627: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-08-28T19:41:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.888+0000 7f222646d640 1 -- 172.21.15.33:0/2096704987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2220104620 msgr2=0x7f2220104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.888+0000 7f222646d640 1 --2- 172.21.15.33:0/2096704987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2220104620 0x7f2220104a30 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f2210009900 tx=0x7f221002a410 comp rx=0 tx=0).stop 2024-08-28T19:41:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.888+0000 7f222646d640 1 -- 172.21.15.33:0/2096704987 shutdown_connections 2024-08-28T19:41:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.888+0000 7f222646d640 1 --2- 172.21.15.33:0/2096704987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f222010dbd0 0x7f22201100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.888+0000 7f222646d640 1 --2- 172.21.15.33:0/2096704987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2220105050 0x7f222010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.888+0000 7f222646d640 1 --2- 172.21.15.33:0/2096704987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2220104620 0x7f2220104a30 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.888+0000 7f222646d640 1 -- 172.21.15.33:0/2096704987 >> 172.21.15.33:0/2096704987 conn(0x7f22200794d0 msgr2=0x7f22200798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.888+0000 7f222646d640 1 -- 172.21.15.33:0/2096704987 shutdown_connections 2024-08-28T19:41:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.888+0000 7f222646d640 1 -- 172.21.15.33:0/2096704987 wait complete. 2024-08-28T19:41:45.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f222646d640 1 Processor -- start 2024-08-28T19:41:45.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f222646d640 1 -- start start 2024-08-28T19:41:45.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f222646d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2220104620 0x7f2220198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f222646d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2220105050 0x7f2220199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f222646d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f222010dbd0 0x7f222019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f222646d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f22201137f0 con 0x7f222010dbd0 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f222646d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2220113670 con 0x7f2220105050 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f222646d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2220113970 con 0x7f2220104620 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f2224a0a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f222010dbd0 0x7f222019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f2224a0a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f222010dbd0 0x7f222019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52108/0 (socket says 172.21.15.33:52108) 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.889+0000 7f2224a0a640 1 -- 172.21.15.33:0/3686018297 learned_addr learned my addr 172.21.15.33:0/3686018297 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f221f7fe640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2220105050 0x7f2220199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f221ffff640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2220104620 0x7f2220198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f2224a0a640 1 -- 172.21.15.33:0/3686018297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2220104620 msgr2=0x7f2220198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f2224a0a640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2220104620 0x7f2220198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f2224a0a640 1 -- 172.21.15.33:0/3686018297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2220105050 msgr2=0x7f2220199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f2224a0a640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2220105050 0x7f2220199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f2224a0a640 1 -- 172.21.15.33:0/3686018297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2220199a50 con 0x7f222010dbd0 2024-08-28T19:41:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f2224a0a640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f222010dbd0 0x7f222019fd20 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f221800eaa0 tx=0x7f221800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f221d7fa640 1 -- 172.21.15.33:0/3686018297 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218004d20 con 0x7f222010dbd0 2024-08-28T19:41:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f222646d640 1 -- 172.21.15.33:0/3686018297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22201a0320 con 0x7f222010dbd0 2024-08-28T19:41:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f221d7fa640 1 -- 172.21.15.33:0/3686018297 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2218005020 con 0x7f222010dbd0 2024-08-28T19:41:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f221d7fa640 1 -- 172.21.15.33:0/3686018297 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22180116b0 con 0x7f222010dbd0 2024-08-28T19:41:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.890+0000 7f222646d640 1 -- 172.21.15.33:0/3686018297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22201a0810 con 0x7f222010dbd0 2024-08-28T19:41:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.893+0000 7f222c9e2740 1 Processor -- start 2024-08-28T19:41:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.893+0000 7f221d7fa640 1 -- 172.21.15.33:0/3686018297 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f22180051d0 con 0x7f222010dbd0 2024-08-28T19:41:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.893+0000 7f222c9e2740 1 -- start start 2024-08-28T19:41:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.893+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655cf070 0x55b965974310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.893+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b965974850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.893+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b965974d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.893+0000 7f222c9e2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b9658eb680 con 0x55b9655ae390 2024-08-28T19:41:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.893+0000 7f222c9e2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b9658dac10 con 0x55b9655a61b0 2024-08-28T19:41:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.893+0000 7f222c9e2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b9658debc0 con 0x55b9655cf070 2024-08-28T19:41:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.893+0000 7f221f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b965974d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b965974d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52120/0 (socket says 172.21.15.33:52120) 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221f7fe640 1 -- 172.21.15.33:0/4089530601 learned_addr learned my addr 172.21.15.33:0/4089530601 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221f7fe640 1 --2- 172.21.15.33:0/4089530601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655cf070 0x55b965974310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221ffff640 1 --2- 172.21.15.33:0/4089530601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b965974850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221d7fa640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22080b4ca0 0x7f22080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221f7fe640 1 -- 172.21.15.33:0/4089530601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655cf070 msgr2=0x55b965974310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221f7fe640 1 --2- 172.21.15.33:0/4089530601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655cf070 0x55b965974310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221f7fe640 1 -- 172.21.15.33:0/4089530601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 msgr2=0x55b965974850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221f7fe640 1 --2- 172.21.15.33:0/4089530601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b965974850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221f7fe640 1 -- 172.21.15.33:0/4089530601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96563a650 con 0x55b9655ae390 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f2224a0a640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22080b4ca0 0x7f22080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221d7fa640 1 -- 172.21.15.33:0/3686018297 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f22180e5b60 con 0x7f222010dbd0 2024-08-28T19:41:45.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f221f7fe640 1 --2- 172.21.15.33:0/4089530601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b965974d90 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f22140117b0 tx=0x7f221400a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4c6c2b0773a3f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.894+0000 7f22067fc640 1 -- 172.21.15.33:0/4089530601 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214005020 con 0x55b9655ae390 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f22067fc640 1 -- 172.21.15.33:0/4089530601 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22140047a0 con 0x55b9655ae390 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f22067fc640 1 -- 172.21.15.33:0/4089530601 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221400fa20 con 0x55b9655ae390 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f222c9e2740 1 -- 172.21.15.33:0/4089530601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 msgr2=0x55b965974d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f2224a0a640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22080b4ca0 0x7f22080b71b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f22180e2fc0 tx=0x7f2218075020 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f222c9e2740 1 --2- 172.21.15.33:0/4089530601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b965974d90 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f22140117b0 tx=0x7f221400a720 comp rx=0 tx=0).stop 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f222c9e2740 1 -- 172.21.15.33:0/4089530601 shutdown_connections 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f222c9e2740 1 --2- 172.21.15.33:0/4089530601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b965974d90 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f222c9e2740 1 --2- 172.21.15.33:0/4089530601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b965974850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f222c9e2740 1 --2- 172.21.15.33:0/4089530601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655cf070 0x55b965974310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f222c9e2740 1 -- 172.21.15.33:0/4089530601 >> 172.21.15.33:0/4089530601 conn(0x55b9655c3460 msgr2=0x55b965972200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.895+0000 7f222c9e2740 1 -- 172.21.15.33:0/4089530601 shutdown_connections 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.896+0000 7f222c9e2740 1 -- 172.21.15.33:0/4089530601 wait complete. 2024-08-28T19:41:45.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.896+0000 7f222c9e2740 1 -- start start 2024-08-28T19:41:45.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.896+0000 7f222c9e2740 1 Processor -- start 2024-08-28T19:41:45.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.896+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655a61b0 0x55b96597fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.896+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655ae390 0x55b965980000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.896+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b96598bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.896+0000 7f222c9e2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b96573d700 con 0x55b9655cf070 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.896+0000 7f222c9e2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b965861750 con 0x55b9655ae390 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.896+0000 7f222c9e2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b965982af0 con 0x55b9655a61b0 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.896+0000 7f222c9e2740 10 client.0 _ll_register_callbacks cb 0x55b965890e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b96598bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b96598bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52136/0 (socket says 172.21.15.33:52136) 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221f7fe640 1 -- 172.21.15.33:0/2888709487 learned_addr learned my addr 172.21.15.33:0/2888709487 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655a61b0 0x55b96597fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221ffff640 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655ae390 0x55b965980000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221f7fe640 1 -- 172.21.15.33:0/2888709487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655a61b0 msgr2=0x55b96597fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655a61b0 0x55b96597fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221f7fe640 1 -- 172.21.15.33:0/2888709487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655ae390 msgr2=0x55b965980000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:45.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655ae390 0x55b965980000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221f7fe640 1 -- 172.21.15.33:0/2888709487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b96589a900 con 0x55b9655cf070 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221ffff640 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655ae390 0x55b965980000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b96598bde0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f2214001eb0 tx=0x7f2214013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b957f2549470153b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f21ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2888709487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2214005460 con 0x55b9655cf070 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f222c9e2740 1 -- 172.21.15.33:0/2888709487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22140047a0 con 0x55b9655cf070 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.897+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2888709487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f221400f7c0 con 0x55b9655cf070 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2888709487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2214034050 con 0x55b9655cf070 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f222c9e2740 10 client.18060 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f222c9e2740 1 -- 172.21.15.33:0/2888709487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b96598e8f0 con 0x55b9655cf070 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2888709487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22140047a0 con 0x55b9655cf070 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2888709487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f221401e930 con 0x55b9655cf070 2024-08-28T19:41:45.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f222c9e2740 10 client.18060 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f222c9e2740 10 client.18060 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f222c9e2740 20 client.18060 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55b96558d9f0 0x55b965991c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f222c9e2740 4 client.18060 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f222c9e2740 1 -- 172.21.15.33:0/2888709487 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9658ed5d0 con 0x55b96558d9f0 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.898+0000 7f221ffff640 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55b96558d9f0 0x55b965991c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.899+0000 7f221ffff640 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55b96558d9f0 0x55b965991c50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=971f6c01c35ca523 server_cookie=5950fc9ec2afc52d in_seq=0 out_seq=0 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.899+0000 7f21ff7fe640 10 client.18060 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2888709487 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b9658ed5d0 con 0x55b96558d9f0 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f21ff7fe640 10 client.18060 handle_command_reply: tid=0 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 client.18060 shutdown 2024-08-28T19:41:45.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 -- 172.21.15.33:0/2888709487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 msgr2=0x55b96598bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b96598bde0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f2214001eb0 tx=0x7f2214013040 comp rx=0 tx=0).stop 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 -- 172.21.15.33:0/2888709487 shutdown_connections 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55b96558d9f0 0x55b965991c50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b96598bde0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655ae390 0x55b965980000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2888709487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655a61b0 0x55b96597fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 -- 172.21.15.33:0/2888709487 >> 172.21.15.33:0/2888709487 conn(0x55b9655c3460 msgr2=0x55b9659774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f21ff7fe640 0 client.18060 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 -- 172.21.15.33:0/2888709487 shutdown_connections 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 1 -- 172.21.15.33:0/2888709487 wait complete. 2024-08-28T19:41:45.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.900+0000 7f222c9e2740 20 client.18060 trim_cache size 0 max 16384 2024-08-28T19:41:45.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.913+0000 7f222c9e2740 1 Processor -- start 2024-08-28T19:41:45.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f222c9e2740 1 -- start start 2024-08-28T19:41:45.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b9659816f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b96597ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655cf070 0x55b96597d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f222c9e2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f22201bf920 con 0x55b9655ae390 2024-08-28T19:41:45.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f222c9e2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f22201c1460 con 0x55b9655a61b0 2024-08-28T19:41:45.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f222c9e2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22201bfff0 con 0x55b9655cf070 2024-08-28T19:41:45.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b96597ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b96597ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52148/0 (socket says 172.21.15.33:52148) 2024-08-28T19:41:45.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221ffff640 1 -- 172.21.15.33:0/2450866192 learned_addr learned my addr 172.21.15.33:0/2450866192 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:45.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2450866192 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655cf070 0x55b96597d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2450866192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b9659816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221ffff640 1 -- 172.21.15.33:0/2450866192 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655cf070 msgr2=0x55b96597d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:45.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221ffff640 1 --2- 172.21.15.33:0/2450866192 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655cf070 0x55b96597d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221ffff640 1 -- 172.21.15.33:0/2450866192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 msgr2=0x55b9659816f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:45.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221ffff640 1 --2- 172.21.15.33:0/2450866192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b9659816f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221ffff640 1 -- 172.21.15.33:0/2450866192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96596c3d0 con 0x55b9655ae390 2024-08-28T19:41:45.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2450866192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b9659816f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:45.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.914+0000 7f221ffff640 1 --2- 172.21.15.33:0/2450866192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b96597ccb0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f2210009230 tx=0x7f2210009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c10aad92474a66 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:45.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f2205ffb640 1 -- 172.21.15.33:0/2450866192 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210035040 con 0x55b9655ae390 2024-08-28T19:41:45.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f2205ffb640 1 -- 172.21.15.33:0/2450866192 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22100054f0 con 0x55b9655ae390 2024-08-28T19:41:45.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f2205ffb640 1 -- 172.21.15.33:0/2450866192 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210004e10 con 0x55b9655ae390 2024-08-28T19:41:45.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f222c9e2740 1 -- 172.21.15.33:0/2450866192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 msgr2=0x55b96597ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:45.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2450866192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b96597ccb0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f2210009230 tx=0x7f2210009640 comp rx=0 tx=0).stop 2024-08-28T19:41:45.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f222c9e2740 1 -- 172.21.15.33:0/2450866192 shutdown_connections 2024-08-28T19:41:45.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2450866192 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655cf070 0x55b96597d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2450866192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655ae390 0x55b96597ccb0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2450866192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b9659816f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f222c9e2740 1 -- 172.21.15.33:0/2450866192 >> 172.21.15.33:0/2450866192 conn(0x55b9655c3460 msgr2=0x55b965980fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:45.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.915+0000 7f222c9e2740 1 -- 172.21.15.33:0/2450866192 shutdown_connections 2024-08-28T19:41:45.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.916+0000 7f222c9e2740 1 -- 172.21.15.33:0/2450866192 wait complete. 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.916+0000 7f222c9e2740 1 -- start start 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.916+0000 7f222c9e2740 1 Processor -- start 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.916+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b9659854d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.916+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655ae390 0x55b965985a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.916+0000 7f222c9e2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b9659fa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.916+0000 7f222c9e2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f22201c0d90 con 0x55b9655cf070 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.916+0000 7f222c9e2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f22201c06c0 con 0x55b9655a61b0 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.916+0000 7f222c9e2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f22201bd920 con 0x55b9655ae390 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.916+0000 7f222c9e2740 10 client.0 _ll_register_callbacks cb 0x7f2210009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b9659fa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b9659fa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52152/0 (socket says 172.21.15.33:52152) 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221f7fe640 1 -- 172.21.15.33:0/2950292313 learned_addr learned my addr 172.21.15.33:0/2950292313 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:45.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221ffff640 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655ae390 0x55b965985a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b9659854d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221f7fe640 1 -- 172.21.15.33:0/2950292313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655ae390 msgr2=0x55b965985a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655ae390 0x55b965985a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221f7fe640 1 -- 172.21.15.33:0/2950292313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 msgr2=0x55b9659854d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b9659854d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221f7fe640 1 -- 172.21.15.33:0/2950292313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9659faa40 con 0x55b9655cf070 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f221f7fe640 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b9659fa480 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f2214001eb0 tx=0x7f221400ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4bd35e3917984b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f21ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2950292313 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221400aa70 con 0x55b9655cf070 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2950292313 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f2214011030 con 0x55b9655cf070 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f222c9e2740 1 -- 172.21.15.33:0/2950292313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22100054f0 con 0x55b9655cf070 2024-08-28T19:41:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2950292313 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2214044050 con 0x55b9655cf070 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f222c9e2740 10 client.18066 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.917+0000 7f222c9e2740 1 -- 172.21.15.33:0/2950292313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b9659fbcc0 con 0x55b9655cf070 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.918+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2950292313 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22100054f0 con 0x55b9655cf070 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.918+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2950292313 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f221400f820 con 0x55b9655cf070 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.918+0000 7f222c9e2740 10 client.18066 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.918+0000 7f222c9e2740 10 client.18066 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.918+0000 7f222c9e2740 20 client.18066 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.918+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55b965562da0 0x55b9659fe3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.918+0000 7f222c9e2740 4 client.18066 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.918+0000 7f222c9e2740 1 -- 172.21.15.33:0/2950292313 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9658e9070 con 0x55b965562da0 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.918+0000 7f221ffff640 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55b965562da0 0x55b9659fe3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f21ff7fe640 10 client.18066 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f221ffff640 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55b965562da0 0x55b9659fe3d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6e9092bdf1197a7 server_cookie=81cf2281848a8ea1 in_seq=0 out_seq=0 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f21ff7fe640 1 -- 172.21.15.33:0/2950292313 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9658e9070 con 0x55b965562da0 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f21ff7fe640 10 client.18066 handle_command_reply: tid=0 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 client.18066 shutdown 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 -- 172.21.15.33:0/2950292313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 msgr2=0x55b9659fa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b9659fa480 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f2214001eb0 tx=0x7f221400ad30 comp rx=0 tx=0).stop 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 -- 172.21.15.33:0/2950292313 shutdown_connections 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55b965562da0 0x55b9659fe3d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9655cf070 0x55b9659fa480 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9655ae390 0x55b965985a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f21ff7fe640 0 client.18066 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:41:45.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 --2- 172.21.15.33:0/2950292313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9655a61b0 0x55b9659854d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 -- 172.21.15.33:0/2950292313 >> 172.21.15.33:0/2950292313 conn(0x55b9655c3460 msgr2=0x55b965975d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 -- 172.21.15.33:0/2950292313 shutdown_connections 2024-08-28T19:41:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 1 -- 172.21.15.33:0/2950292313 wait complete. 2024-08-28T19:41:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.919+0000 7f222c9e2740 20 client.18066 trim_cache size 0 max 16384 2024-08-28T19:41:45.929 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:41:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 -- 172.21.15.33:0/3686018297 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22080b4ca0 msgr2=0x7f22080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22080b4ca0 0x7f22080b71b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f22180e2fc0 tx=0x7f2218075020 comp rx=0 tx=0).stop 2024-08-28T19:41:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 -- 172.21.15.33:0/3686018297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f222010dbd0 msgr2=0x7f222019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f222010dbd0 0x7f222019fd20 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f221800eaa0 tx=0x7f221800eea0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 -- 172.21.15.33:0/3686018297 shutdown_connections 2024-08-28T19:41:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f222010dbd0 0x7f222019fd20 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2220105050 0x7f2220199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f22080b4ca0 0x7f22080b71b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 --2- 172.21.15.33:0/3686018297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2220104620 0x7f2220198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 -- 172.21.15.33:0/3686018297 >> 172.21.15.33:0/3686018297 conn(0x7f22200794d0 msgr2=0x7f2220100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:45.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 -- 172.21.15.33:0/3686018297 shutdown_connections 2024-08-28T19:41:45.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:45.920+0000 7f222646d640 1 -- 172.21.15.33:0/3686018297 wait complete. 2024-08-28T19:41:46.702 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:41:46.959 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:47.304 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:41:47.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.434+0000 7f80b94af640 1 -- 172.21.15.33:0/1497284945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80b4108140 msgr2=0x7f80b4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:47.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.434+0000 7f80b94af640 1 --2- 172.21.15.33:0/1497284945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80b4108140 0x7f80b4108550 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009900 tx=0x7f80a802a410 comp rx=0 tx=0).stop 2024-08-28T19:41:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.435+0000 7f80b94af640 1 -- 172.21.15.33:0/1497284945 shutdown_connections 2024-08-28T19:41:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.435+0000 7f80b94af640 1 --2- 172.21.15.33:0/1497284945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b4108a90 0x7f80b410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.435+0000 7f80b94af640 1 --2- 172.21.15.33:0/1497284945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80b4108140 0x7f80b4108550 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.435+0000 7f80b94af640 1 --2- 172.21.15.33:0/1497284945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b4102800 0x7f80b4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.435+0000 7f80b94af640 1 -- 172.21.15.33:0/1497284945 >> 172.21.15.33:0/1497284945 conn(0x7f80b40794d0 msgr2=0x7f80b40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.435+0000 7f80b94af640 1 -- 172.21.15.33:0/1497284945 shutdown_connections 2024-08-28T19:41:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.435+0000 7f80b94af640 1 -- 172.21.15.33:0/1497284945 wait complete. 2024-08-28T19:41:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.435+0000 7f80b94af640 1 Processor -- start 2024-08-28T19:41:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.435+0000 7f80b94af640 1 -- start start 2024-08-28T19:41:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b94af640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b4102800 0x7f80b4198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b94af640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80b4108140 0x7f80b4199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b94af640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b4108a90 0x7f80b41998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b94af640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f80b41126e0 con 0x7f80b4108140 2024-08-28T19:41:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b94af640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4112560 con 0x7f80b4108a90 2024-08-28T19:41:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b94af640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4112860 con 0x7f80b4102800 2024-08-28T19:41:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b27fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80b4108140 0x7f80b4199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b2ffd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b4102800 0x7f80b4198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b27fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80b4108140 0x7f80b4199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52170/0 (socket says 172.21.15.33:52170) 2024-08-28T19:41:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b27fc640 1 -- 172.21.15.33:0/4188490282 learned_addr learned my addr 172.21.15.33:0/4188490282 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b37fe640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b4108a90 0x7f80b41998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b2ffd640 1 -- 172.21.15.33:0/4188490282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b4108a90 msgr2=0x7f80b41998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b4108a90 0x7f80b41998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b2ffd640 1 -- 172.21.15.33:0/4188490282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80b4108140 msgr2=0x7f80b4199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80b4108140 0x7f80b4199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.436+0000 7f80b2ffd640 1 -- 172.21.15.33:0/4188490282 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b41a84f0 con 0x7f80b4102800 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.437+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b4102800 0x7f80b4198e40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f80a400e9f0 tx=0x7f80a400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.437+0000 7f809bfff640 1 -- 172.21.15.33:0/4188490282 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a400ccc0 con 0x7f80b4102800 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.437+0000 7f80b94af640 1 -- 172.21.15.33:0/4188490282 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b41a87e0 con 0x7f80b4102800 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.437+0000 7f80b94af640 1 -- 172.21.15.33:0/4188490282 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b41a8d20 con 0x7f80b4102800 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.437+0000 7f809bfff640 1 -- 172.21.15.33:0/4188490282 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a4005020 con 0x7f80b4102800 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.437+0000 7f809bfff640 1 -- 172.21.15.33:0/4188490282 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4004a00 con 0x7f80b4102800 2024-08-28T19:41:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80bfa24740 1 Processor -- start 2024-08-28T19:41:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80bfa24740 1 -- start start 2024-08-28T19:41:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4882070 0x557ef4c27310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef48591b0 0x557ef4c27850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4861390 0x557ef4c27d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80bfa24740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557ef4b9e680 con 0x557ef4861390 2024-08-28T19:41:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80bfa24740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557ef4b8dc10 con 0x557ef4882070 2024-08-28T19:41:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80bfa24740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557ef4b91bc0 con 0x557ef48591b0 2024-08-28T19:41:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80b27fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4861390 0x557ef4c27d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80b27fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4861390 0x557ef4c27d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52176/0 (socket says 172.21.15.33:52176) 2024-08-28T19:41:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80b37fe640 1 --2- 172.21.15.33:0/3620642151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4882070 0x557ef4c27310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.440+0000 7f80b27fc640 1 -- 172.21.15.33:0/3620642151 learned_addr learned my addr 172.21.15.33:0/3620642151 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:47.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.441+0000 7f80b27fc640 1 -- 172.21.15.33:0/3620642151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef48591b0 msgr2=0x557ef4c27850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-28T19:41:47.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.441+0000 7f80b27fc640 1 --2- 172.21.15.33:0/3620642151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef48591b0 0x557ef4c27850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.441+0000 7f80b27fc640 1 -- 172.21.15.33:0/3620642151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4882070 msgr2=0x557ef4c27310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.441+0000 7f80b27fc640 1 --2- 172.21.15.33:0/3620642151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4882070 0x557ef4c27310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.441+0000 7f80b27fc640 1 -- 172.21.15.33:0/3620642151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ef48ed650 con 0x557ef4861390 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.441+0000 7f80b27fc640 1 --2- 172.21.15.33:0/3620642151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4861390 0x557ef4c27d90 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009230 tx=0x7f80a8031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84707b9dd7fd81a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.442+0000 7f80997fa640 1 -- 172.21.15.33:0/3620642151 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8040070 con 0x557ef4861390 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.442+0000 7f80997fa640 1 -- 172.21.15.33:0/3620642151 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a80316a0 con 0x557ef4861390 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.442+0000 7f80997fa640 1 -- 172.21.15.33:0/3620642151 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8035040 con 0x557ef4861390 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.442+0000 7f809bfff640 1 -- 172.21.15.33:0/4188490282 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f80a4004ba0 con 0x7f80b4102800 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f809bfff640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f809c0b4ca0 0x7f809c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80bfa24740 1 -- 172.21.15.33:0/3620642151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4861390 msgr2=0x557ef4c27d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80bfa24740 1 --2- 172.21.15.33:0/3620642151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4861390 0x557ef4c27d90 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009230 tx=0x7f80a8031bc0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80b37fe640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f809c0b4ca0 0x7f809c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80bfa24740 1 -- 172.21.15.33:0/3620642151 shutdown_connections 2024-08-28T19:41:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80bfa24740 1 --2- 172.21.15.33:0/3620642151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4861390 0x557ef4c27d90 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80bfa24740 1 --2- 172.21.15.33:0/3620642151 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef48591b0 0x557ef4c27850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f809bfff640 1 -- 172.21.15.33:0/4188490282 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f80a40e5650 con 0x7f80b4102800 2024-08-28T19:41:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80bfa24740 1 --2- 172.21.15.33:0/3620642151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4882070 0x557ef4c27310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80bfa24740 1 -- 172.21.15.33:0/3620642151 >> 172.21.15.33:0/3620642151 conn(0x557ef4876460 msgr2=0x557ef4c25200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80bfa24740 1 -- 172.21.15.33:0/3620642151 shutdown_connections 2024-08-28T19:41:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80bfa24740 1 -- 172.21.15.33:0/3620642151 wait complete. 2024-08-28T19:41:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.443+0000 7f80b37fe640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f809c0b4ca0 0x7f809c0b71b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005fd0 tx=0x7f80ac009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80bfa24740 1 -- start start 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80bfa24740 1 Processor -- start 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 0x557ef4c32a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 0x557ef4c32f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c3ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80bfa24740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557ef49f0700 con 0x557ef4882070 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80bfa24740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557ef4b14750 con 0x557ef48591b0 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80bfa24740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557ef4c35a90 con 0x557ef4861390 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80bfa24740 10 client.0 _ll_register_callbacks cb 0x557ef4b43e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80b37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c3ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80b37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c3ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52182/0 (socket says 172.21.15.33:52182) 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.444+0000 7f80b37fe640 1 -- 172.21.15.33:0/1653639488 learned_addr learned my addr 172.21.15.33:0/1653639488 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80b27fc640 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 0x557ef4c32f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 0x557ef4c32a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80b37fe640 1 -- 172.21.15.33:0/1653639488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 msgr2=0x557ef4c32f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80b37fe640 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 0x557ef4c32f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80b37fe640 1 -- 172.21.15.33:0/1653639488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 msgr2=0x557ef4c32a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80b37fe640 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 0x557ef4c32a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80b37fe640 1 -- 172.21.15.33:0/1653639488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ef4b4d900 con 0x557ef4882070 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80b27fc640 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 0x557ef4c32f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80b37fe640 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c3ee10 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f80ac011dc0 tx=0x7f80ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9f849b46f8faff server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f8096ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f8096ff5640 1 -- 172.21.15.33:0/1653639488 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac020620 con 0x557ef4882070 2024-08-28T19:41:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f8096ff5640 1 -- 172.21.15.33:0/1653639488 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f80ac0207c0 con 0x557ef4882070 2024-08-28T19:41:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80bfa24740 1 -- 172.21.15.33:0/1653639488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80a80316a0 con 0x557ef4882070 2024-08-28T19:41:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f8096ff5640 1 -- 172.21.15.33:0/1653639488 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80ac033050 con 0x557ef4882070 2024-08-28T19:41:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80bfa24740 10 client.18078 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.445+0000 7f80bfa24740 1 -- 172.21.15.33:0/1653639488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557ef4c41890 con 0x557ef4882070 2024-08-28T19:41:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.446+0000 7f8096ff5640 1 -- 172.21.15.33:0/1653639488 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a80316a0 con 0x557ef4882070 2024-08-28T19:41:47.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.446+0000 7f8096ff5640 1 -- 172.21.15.33:0/1653639488 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f80ac00f040 con 0x557ef4882070 2024-08-28T19:41:47.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.446+0000 7f80bfa24740 10 client.18078 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:47.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.446+0000 7f80bfa24740 10 client.18078 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:41:47.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.446+0000 7f80bfa24740 20 client.18078 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:47.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.446+0000 7f80bfa24740 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x557ef48409f0 0x557ef4c44e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.446+0000 7f80bfa24740 4 client.18078 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:47.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.446+0000 7f80bfa24740 1 -- 172.21.15.33:0/1653639488 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ef4ba05d0 con 0x557ef48409f0 2024-08-28T19:41:47.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.446+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x557ef48409f0 0x557ef4c44e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.447+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x557ef48409f0 0x557ef4c44e70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1194696106d36cb9 server_cookie=57f17b7ffe0193ce in_seq=0 out_seq=0 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.447+0000 7f8096ff5640 10 client.18078 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f8096ff5640 1 -- 172.21.15.33:0/1653639488 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557ef4ba05d0 con 0x557ef48409f0 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f8096ff5640 10 client.18078 handle_command_reply: tid=0 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 client.18078 shutdown 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 -- 172.21.15.33:0/1653639488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 msgr2=0x557ef4c3ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c3ee10 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f80ac011dc0 tx=0x7f80ac004a40 comp rx=0 tx=0).stop 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 -- 172.21.15.33:0/1653639488 shutdown_connections 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x557ef48409f0 0x557ef4c44e70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c3ee10 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 0x557ef4c32f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f8096ff5640 0 client.18078 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:41:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 --2- 172.21.15.33:0/1653639488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 0x557ef4c32a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 -- 172.21.15.33:0/1653639488 >> 172.21.15.33:0/1653639488 conn(0x557ef4876460 msgr2=0x557ef4c2a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 -- 172.21.15.33:0/1653639488 shutdown_connections 2024-08-28T19:41:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 1 -- 172.21.15.33:0/1653639488 wait complete. 2024-08-28T19:41:47.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.448+0000 7f80bfa24740 20 client.18078 trim_cache size 0 max 16384 2024-08-28T19:41:47.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.461+0000 7f80bfa24740 1 Processor -- start 2024-08-28T19:41:47.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.461+0000 7f80bfa24740 1 -- start start 2024-08-28T19:41:47.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.462+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 0x557ef4c2ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.462+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 0x557ef4c2fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.462+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c30150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.462+0000 7f80bfa24740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f80a000ff60 con 0x557ef4882070 2024-08-28T19:41:47.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.462+0000 7f80bfa24740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f80a0011aa0 con 0x557ef48591b0 2024-08-28T19:41:47.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.462+0000 7f80bfa24740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f80a0010630 con 0x557ef4861390 2024-08-28T19:41:47.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.462+0000 7f80b2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 0x557ef4c2ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.462+0000 7f80b2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 0x557ef4c2ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:47690/0 (socket says 172.21.15.33:47690) 2024-08-28T19:41:47.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.462+0000 7f80b2ffd640 1 -- 172.21.15.33:0/2078900093 learned_addr learned my addr 172.21.15.33:0/2078900093 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:47.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.462+0000 7f80b27fc640 1 --2- 172.21.15.33:0/2078900093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 0x557ef4c2fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.463+0000 7f80b37fe640 1 --2- 172.21.15.33:0/2078900093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c30150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.463+0000 7f80b2ffd640 1 -- 172.21.15.33:0/2078900093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 msgr2=0x557ef4c2fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:47.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.463+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/2078900093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 0x557ef4c2fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.463+0000 7f80b2ffd640 1 -- 172.21.15.33:0/2078900093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 msgr2=0x557ef4c30150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:47.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.463+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/2078900093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c30150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.463+0000 7f80b2ffd640 1 -- 172.21.15.33:0/2078900093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ef4c29600 con 0x557ef48591b0 2024-08-28T19:41:47.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.463+0000 7f80b37fe640 1 --2- 172.21.15.33:0/2078900093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c30150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:47.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.463+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/2078900093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 0x557ef4c2ab20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f80a40a7a20 tx=0x7f80a400e940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83d1c335f189625e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:47.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.467+0000 7f8098ff9640 1 -- 172.21.15.33:0/2078900093 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a401c040 con 0x557ef48591b0 2024-08-28T19:41:47.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.467+0000 7f8098ff9640 1 -- 172.21.15.33:0/2078900093 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a40ac0a0 con 0x557ef48591b0 2024-08-28T19:41:47.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.467+0000 7f8098ff9640 1 -- 172.21.15.33:0/2078900093 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a40b4830 con 0x557ef48591b0 2024-08-28T19:41:47.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.468+0000 7f80bfa24740 1 -- 172.21.15.33:0/2078900093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 msgr2=0x557ef4c2ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:47.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.468+0000 7f80bfa24740 1 --2- 172.21.15.33:0/2078900093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 0x557ef4c2ab20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f80a40a7a20 tx=0x7f80a400e940 comp rx=0 tx=0).stop 2024-08-28T19:41:47.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.468+0000 7f80bfa24740 1 -- 172.21.15.33:0/2078900093 shutdown_connections 2024-08-28T19:41:47.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.468+0000 7f80bfa24740 1 --2- 172.21.15.33:0/2078900093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef4882070 0x557ef4c30150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.468+0000 7f80bfa24740 1 --2- 172.21.15.33:0/2078900093 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4861390 0x557ef4c2fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.468+0000 7f80bfa24740 1 --2- 172.21.15.33:0/2078900093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef48591b0 0x557ef4c2ab20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.468+0000 7f80bfa24740 1 -- 172.21.15.33:0/2078900093 >> 172.21.15.33:0/2078900093 conn(0x557ef4876460 msgr2=0x557ef4c2a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:47.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.468+0000 7f80bfa24740 1 -- 172.21.15.33:0/2078900093 shutdown_connections 2024-08-28T19:41:47.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.468+0000 7f80bfa24740 1 -- 172.21.15.33:0/2078900093 wait complete. 2024-08-28T19:41:47.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.468+0000 7f80bfa24740 1 -- start start 2024-08-28T19:41:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80bfa24740 1 Processor -- start 2024-08-28T19:41:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef48591b0 0x557ef4c3b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4861390 0x557ef4c37770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80bfa24740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4882070 0x557ef4c37cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80bfa24740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f80a00113d0 con 0x557ef48591b0 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80bfa24740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f80a0010d00 con 0x557ef4861390 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80bfa24740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f80a000df60 con 0x557ef4882070 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80bfa24740 10 client.0 _ll_register_callbacks cb 0x7f80ac011a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80b2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef48591b0 0x557ef4c3b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80b2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef48591b0 0x557ef4c3b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52200/0 (socket says 172.21.15.33:52200) 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80b2ffd640 1 -- 172.21.15.33:0/725800505 learned_addr learned my addr 172.21.15.33:0/725800505 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80b37fe640 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4882070 0x557ef4c37cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.469+0000 7f80b27fc640 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4861390 0x557ef4c37770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f80b2ffd640 1 -- 172.21.15.33:0/725800505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4882070 msgr2=0x557ef4c37cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4882070 0x557ef4c37cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f80b2ffd640 1 -- 172.21.15.33:0/725800505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4861390 msgr2=0x557ef4c37770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4861390 0x557ef4c37770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f80b2ffd640 1 -- 172.21.15.33:0/725800505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ef4c381f0 con 0x557ef48591b0 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f80b37fe640 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4882070 0x557ef4c37cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f80b27fc640 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4861390 0x557ef4c37770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f80b2ffd640 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef48591b0 0x557ef4c3b2b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f80a40a8c10 tx=0x7f80a40e2eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e907489e16f014 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f8096ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f8096ff5640 1 -- 172.21.15.33:0/725800505 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a40ca030 con 0x557ef48591b0 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f8096ff5640 1 -- 172.21.15.33:0/725800505 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f80a40a7f90 con 0x557ef48591b0 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.470+0000 7f80bfa24740 1 -- 172.21.15.33:0/725800505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80a40ac0a0 con 0x557ef48591b0 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f8096ff5640 1 -- 172.21.15.33:0/725800505 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80a40b4cc0 con 0x557ef48591b0 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f80bfa24740 10 client.18084 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f80bfa24740 1 -- 172.21.15.33:0/725800505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557ef4cb04d0 con 0x557ef48591b0 2024-08-28T19:41:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f8096ff5640 1 -- 172.21.15.33:0/725800505 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a40ac0a0 con 0x557ef48591b0 2024-08-28T19:41:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f8096ff5640 1 -- 172.21.15.33:0/725800505 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f80a4091360 con 0x557ef48591b0 2024-08-28T19:41:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f80bfa24740 10 client.18084 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f80bfa24740 10 client.18084 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:41:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f80bfa24740 20 client.18084 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f80bfa24740 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x557ef4815da0 0x557ef4cb2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f80bfa24740 4 client.18084 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:41:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f80bfa24740 1 -- 172.21.15.33:0/725800505 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ef4b9c070 con 0x557ef4815da0 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.471+0000 7f80b27fc640 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x557ef4815da0 0x557ef4cb2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.472+0000 7f80b27fc640 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x557ef4815da0 0x557ef4cb2aa0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=805ac57f0d4f62ea server_cookie=d70e57cd8116f6fc in_seq=0 out_seq=0 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.472+0000 7f8096ff5640 10 client.18084 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.472+0000 7f8096ff5640 1 -- 172.21.15.33:0/725800505 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ef4b9c070 con 0x557ef4815da0 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.472+0000 7f8096ff5640 10 client.18084 handle_command_reply: tid=0 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.472+0000 7f80bfa24740 1 client.18084 shutdown 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.472+0000 7f80bfa24740 1 -- 172.21.15.33:0/725800505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef48591b0 msgr2=0x557ef4c3b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.472+0000 7f80bfa24740 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef48591b0 0x557ef4c3b2b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f80a40a8c10 tx=0x7f80a40e2eb0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.472+0000 7f80bfa24740 1 -- 172.21.15.33:0/725800505 shutdown_connections 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.472+0000 7f80bfa24740 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x557ef4815da0 0x557ef4cb2aa0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80bfa24740 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557ef4882070 0x557ef4c37cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80bfa24740 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef4861390 0x557ef4c37770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80bfa24740 1 --2- 172.21.15.33:0/725800505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557ef48591b0 0x557ef4c3b2b0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80bfa24740 1 -- 172.21.15.33:0/725800505 >> 172.21.15.33:0/725800505 conn(0x557ef4876460 msgr2=0x557ef4c282d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f8096ff5640 0 client.18084 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:41:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80bfa24740 1 -- 172.21.15.33:0/725800505 shutdown_connections 2024-08-28T19:41:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80bfa24740 1 -- 172.21.15.33:0/725800505 wait complete. 2024-08-28T19:41:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80bfa24740 20 client.18084 trim_cache size 0 max 16384 2024-08-28T19:41:47.478 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80b94af640 1 -- 172.21.15.33:0/4188490282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f809c0b4ca0 msgr2=0x7f809c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80b94af640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f809c0b4ca0 0x7f809c0b71b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005fd0 tx=0x7f80ac009600 comp rx=0 tx=0).stop 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80b94af640 1 -- 172.21.15.33:0/4188490282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b4102800 msgr2=0x7f80b4198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.473+0000 7f80b94af640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b4102800 0x7f80b4198e40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f80a400e9f0 tx=0x7f80a400eeb0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.474+0000 7f80b94af640 1 -- 172.21.15.33:0/4188490282 shutdown_connections 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.474+0000 7f80b94af640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b4108a90 0x7f80b41998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.474+0000 7f80b94af640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80b4108140 0x7f80b4199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.474+0000 7f80b94af640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f809c0b4ca0 0x7f809c0b71b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.474+0000 7f80b94af640 1 --2- 172.21.15.33:0/4188490282 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f80b4102800 0x7f80b4198e40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.474+0000 7f80b94af640 1 -- 172.21.15.33:0/4188490282 >> 172.21.15.33:0/4188490282 conn(0x7f80b40794d0 msgr2=0x7f80b4105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.474+0000 7f80b94af640 1 -- 172.21.15.33:0/4188490282 shutdown_connections 2024-08-28T19:41:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:47.474+0000 7f80b94af640 1 -- 172.21.15.33:0/4188490282 wait complete. 2024-08-28T19:41:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:47 smithi059 ceph-mon[22052]: pgmap v628: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:41:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:47 smithi122 ceph-mon[22174]: pgmap v628: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:41:47.846 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:47 smithi033 ceph-mon[18549]: pgmap v628: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:41:48.285 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:41:48.331 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:48.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.842+0000 7f6454239640 1 -- 172.21.15.33:0/220331630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f644c103900 msgr2=0x7f644c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:48.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.842+0000 7f6454239640 1 --2- 172.21.15.33:0/220331630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f644c103900 0x7f644c103d10 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f6448009900 tx=0x7f644802a410 comp rx=0 tx=0).stop 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.843+0000 7f6454239640 1 -- 172.21.15.33:0/220331630 shutdown_connections 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.843+0000 7f6454239640 1 --2- 172.21.15.33:0/220331630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c109b90 0x7f644c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.843+0000 7f6454239640 1 --2- 172.21.15.33:0/220331630 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f644c109240 0x7f644c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.843+0000 7f6454239640 1 --2- 172.21.15.33:0/220331630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f644c103900 0x7f644c103d10 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.843+0000 7f6454239640 1 -- 172.21.15.33:0/220331630 >> 172.21.15.33:0/220331630 conn(0x7f644c07b5f0 msgr2=0x7f644c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.843+0000 7f6454239640 1 -- 172.21.15.33:0/220331630 shutdown_connections 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.843+0000 7f6454239640 1 -- 172.21.15.33:0/220331630 wait complete. 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.843+0000 7f6454239640 1 Processor -- start 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.843+0000 7f6454239640 1 -- start start 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6454239640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f644c103900 0x7f644c19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:48.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6454239640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c109240 0x7f644c19a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6454239640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f644c109b90 0x7f644c19fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6454239640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f644c113850 con 0x7f644c103900 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6454239640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1136d0 con 0x7f644c109240 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6454239640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1139d0 con 0x7f644c109b90 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6451fd5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f644c103900 0x7f644c19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6451fd5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f644c103900 0x7f644c19a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49668/0 (socket says 172.21.15.33:49668) 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6451fd5640 1 -- 172.21.15.33:0/3216673322 learned_addr learned my addr 172.21.15.33:0/3216673322 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f64527d6640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f644c109b90 0x7f644c19fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f64517d4640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c109240 0x7f644c19a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6451fd5640 1 -- 172.21.15.33:0/3216673322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f644c109b90 msgr2=0x7f644c19fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:48.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6451fd5640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f644c109b90 0x7f644c19fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:48.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6451fd5640 1 -- 172.21.15.33:0/3216673322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c109240 msgr2=0x7f644c19a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:48.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6451fd5640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c109240 0x7f644c19a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:48.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6451fd5640 1 -- 172.21.15.33:0/3216673322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c1a0170 con 0x7f644c103900 2024-08-28T19:41:48.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6451fd5640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f644c103900 0x7f644c19a2c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f6448005940 tx=0x7f64480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:48.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.844+0000 7f6442ffd640 1 -- 172.21.15.33:0/3216673322 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644803f030 con 0x7f644c103900 2024-08-28T19:41:48.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.845+0000 7f6454239640 1 -- 172.21.15.33:0/3216673322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c1a0400 con 0x7f644c103900 2024-08-28T19:41:48.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.845+0000 7f6442ffd640 1 -- 172.21.15.33:0/3216673322 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6448003cb0 con 0x7f644c103900 2024-08-28T19:41:48.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.845+0000 7f6442ffd640 1 -- 172.21.15.33:0/3216673322 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448035070 con 0x7f644c103900 2024-08-28T19:41:48.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.845+0000 7f6454239640 1 -- 172.21.15.33:0/3216673322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1a08e0 con 0x7f644c103900 2024-08-28T19:41:48.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.845+0000 7f6454239640 1 -- 172.21.15.33:0/3216673322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c103d10 con 0x7f644c103900 2024-08-28T19:41:48.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.847+0000 7f6442ffd640 1 -- 172.21.15.33:0/3216673322 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6448042030 con 0x7f644c103900 2024-08-28T19:41:48.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.848+0000 7f6442ffd640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64380b4cd0 0x7f64380b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:48.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.848+0000 7f64517d4640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64380b4cd0 0x7f64380b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:48.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.848+0000 7f6442ffd640 1 -- 172.21.15.33:0/3216673322 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f6448106180 con 0x7f644c103900 2024-08-28T19:41:48.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.848+0000 7f64517d4640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64380b4cd0 0x7f64380b71e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f643c005fd0 tx=0x7f643c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:48.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:48.851+0000 7f6442ffd640 1 -- 172.21.15.33:0/3216673322 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f64480ccbd0 con 0x7f644c103900 2024-08-28T19:41:48.902 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:49.085 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.083+0000 7f6454239640 1 -- 172.21.15.33:0/3216673322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f644c19b3f0 con 0x7f644c103900 2024-08-28T19:41:49.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.084+0000 7f6442ffd640 1 -- 172.21.15.33:0/3216673322 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f64480cc4d0 con 0x7f644c103900 2024-08-28T19:41:49.086 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:41:49.086 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:41:49.087 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:41:49.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 -- 172.21.15.33:0/3216673322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64380b4cd0 msgr2=0x7f64380b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:49.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64380b4cd0 0x7f64380b71e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f643c005fd0 tx=0x7f643c005850 comp rx=0 tx=0).stop 2024-08-28T19:41:49.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 -- 172.21.15.33:0/3216673322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f644c103900 msgr2=0x7f644c19a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:49.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f644c103900 0x7f644c19a2c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f6448005940 tx=0x7f64480042f0 comp rx=0 tx=0).stop 2024-08-28T19:41:49.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 -- 172.21.15.33:0/3216673322 shutdown_connections 2024-08-28T19:41:49.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64380b4cd0 0x7f64380b71e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:49.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f644c109b90 0x7f644c19fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:49.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c109240 0x7f644c19a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:49.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 --2- 172.21.15.33:0/3216673322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f644c103900 0x7f644c19a2c0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:49.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 -- 172.21.15.33:0/3216673322 >> 172.21.15.33:0/3216673322 conn(0x7f644c07b5f0 msgr2=0x7f644c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:49.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 -- 172.21.15.33:0/3216673322 shutdown_connections 2024-08-28T19:41:49.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:49.087+0000 7f6454239640 1 -- 172.21.15.33:0/3216673322 wait complete. 2024-08-28T19:41:49.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:49 smithi059 ceph-mon[22052]: pgmap v629: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-08-28T19:41:49.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:49 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3216673322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:49 smithi122 ceph-mon[22174]: pgmap v629: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-08-28T19:41:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:49 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3216673322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:49.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:49 smithi033 ceph-mon[18549]: pgmap v629: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-08-28T19:41:49.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:49 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3216673322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:49.960 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id bbc98890 --release --await' 2024-08-28T19:41:49.961 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id bbc98890 --release --await 2024-08-28T19:41:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.116+0000 7fd614fac640 1 -- 172.21.15.33:0/1199363841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6101050e0 msgr2=0x7fd61010d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.116+0000 7fd614fac640 1 --2- 172.21.15.33:0/1199363841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6101050e0 0x7fd61010d630 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fd604009900 tx=0x7fd60402a410 comp rx=0 tx=0).stop 2024-08-28T19:41:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.116+0000 7fd614fac640 1 -- 172.21.15.33:0/1199363841 shutdown_connections 2024-08-28T19:41:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.116+0000 7fd614fac640 1 --2- 172.21.15.33:0/1199363841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd61010dbf0 0x7fd6101100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.116+0000 7fd614fac640 1 --2- 172.21.15.33:0/1199363841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6101050e0 0x7fd61010d630 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.116+0000 7fd614fac640 1 --2- 172.21.15.33:0/1199363841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd610104790 0x7fd610104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.116+0000 7fd614fac640 1 -- 172.21.15.33:0/1199363841 >> 172.21.15.33:0/1199363841 conn(0x7fd6100794f0 msgr2=0x7fd610079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.116+0000 7fd614fac640 1 -- 172.21.15.33:0/1199363841 shutdown_connections 2024-08-28T19:41:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.116+0000 7fd614fac640 1 -- 172.21.15.33:0/1199363841 wait complete. 2024-08-28T19:41:50.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd614fac640 1 Processor -- start 2024-08-28T19:41:50.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd614fac640 1 -- start start 2024-08-28T19:41:50.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd614fac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd610104790 0x7fd6101024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd614fac640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6101050e0 0x7fd610102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd614fac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61010dbf0 0x7fd610102f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd614fac640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd610113850 con 0x7fd610104790 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd614fac640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101136d0 con 0x7fd6101050e0 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd614fac640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101139d0 con 0x7fd61010dbf0 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd60e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd610104790 0x7fd6101024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd60e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd610104790 0x7fd6101024d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49680/0 (socket says 172.21.15.33:49680) 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd60e59c640 1 -- 172.21.15.33:0/373227873 learned_addr learned my addr 172.21.15.33:0/373227873 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6101050e0 0x7fd610102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.117+0000 7fd60ed9d640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61010dbf0 0x7fd610102f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd60e59c640 1 -- 172.21.15.33:0/373227873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61010dbf0 msgr2=0x7fd610102f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd60e59c640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61010dbf0 0x7fd610102f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd60e59c640 1 -- 172.21.15.33:0/373227873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6101050e0 msgr2=0x7fd610102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd60e59c640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6101050e0 0x7fd610102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd60e59c640 1 -- 172.21.15.33:0/373227873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6101a8560 con 0x7fd610104790 2024-08-28T19:41:50.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd60e59c640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd610104790 0x7fd6101024d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fd60000c970 tx=0x7fd60000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:50.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd5ff7fe640 1 -- 172.21.15.33:0/373227873 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd600007bb0 con 0x7fd610104790 2024-08-28T19:41:50.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd614fac640 1 -- 172.21.15.33:0/373227873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6101a8850 con 0x7fd610104790 2024-08-28T19:41:50.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd5ff7fe640 1 -- 172.21.15.33:0/373227873 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd600007d50 con 0x7fd610104790 2024-08-28T19:41:50.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd5ff7fe640 1 -- 172.21.15.33:0/373227873 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60000f450 con 0x7fd610104790 2024-08-28T19:41:50.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.118+0000 7fd614fac640 1 -- 172.21.15.33:0/373227873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6101a8d10 con 0x7fd610104790 2024-08-28T19:41:50.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.121+0000 7fd5ff7fe640 1 -- 172.21.15.33:0/373227873 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd600004f60 con 0x7fd610104790 2024-08-28T19:41:50.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.122+0000 7fd5ff7fe640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5f80b4ca0 0x7fd5f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.122+0000 7fd61b521740 1 Processor -- start 2024-08-28T19:41:50.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.122+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5f80b4ca0 0x7fd5f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.122+0000 7fd5ff7fe640 1 -- 172.21.15.33:0/373227873 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fd6000e5750 con 0x7fd610104790 2024-08-28T19:41:50.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.122+0000 7fd61b521740 1 -- start start 2024-08-28T19:41:50.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.122+0000 7fd61b521740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce40310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.122+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5f80b4ca0 0x7fd5f80b71b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd604009230 tx=0x7fd604031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.122+0000 7fd61b521740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce40850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.122+0000 7fd61b521740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce40d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd61b521740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56094cdb7680 con 0x56094ca721b0 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd61b521740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56094cda6c10 con 0x56094ca9b070 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd61b521740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56094cdaabc0 con 0x56094ca7a390 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce40850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce40850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49682/0 (socket says 172.21.15.33:49682) 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60dd9b640 1 -- 172.21.15.33:0/1861260495 learned_addr learned my addr 172.21.15.33:0/1861260495 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60ed9d640 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce40d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60e59c640 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce40310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60dd9b640 1 -- 172.21.15.33:0/1861260495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 msgr2=0x56094ce40d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce40d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60dd9b640 1 -- 172.21.15.33:0/1861260495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 msgr2=0x56094ce40310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce40310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60dd9b640 1 -- 172.21.15.33:0/1861260495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094cb06650 con 0x56094ca721b0 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60ed9d640 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce40d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60e59c640 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce40310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce40850 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fd604033000 tx=0x7fd60403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e91596d16c8fe4a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.123+0000 7fd5fcff9640 1 -- 172.21.15.33:0/1861260495 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60404b070 con 0x56094ca721b0 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.124+0000 7fd5fcff9640 1 -- 172.21.15.33:0/1861260495 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd604031830 con 0x56094ca721b0 2024-08-28T19:41:50.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.124+0000 7fd5fcff9640 1 -- 172.21.15.33:0/1861260495 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604035050 con 0x56094ca721b0 2024-08-28T19:41:50.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.124+0000 7fd61b521740 1 -- 172.21.15.33:0/1861260495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 msgr2=0x56094ce40850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:50.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.124+0000 7fd61b521740 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce40850 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fd604033000 tx=0x7fd60403c000 comp rx=0 tx=0).stop 2024-08-28T19:41:50.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.124+0000 7fd61b521740 1 -- 172.21.15.33:0/1861260495 shutdown_connections 2024-08-28T19:41:50.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce40d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce40850 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 --2- 172.21.15.33:0/1861260495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce40310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 -- 172.21.15.33:0/1861260495 >> 172.21.15.33:0/1861260495 conn(0x56094ca8f460 msgr2=0x56094ce3e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 -- 172.21.15.33:0/1861260495 shutdown_connections 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 -- 172.21.15.33:0/1861260495 wait complete. 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 -- start start 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 Processor -- start 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce4baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce4c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.125+0000 7fd61b521740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce57d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd61b521740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56094cc09700 con 0x56094ca721b0 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd61b521740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56094cd2d750 con 0x56094ca9b070 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd61b521740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56094ce4ea90 con 0x56094ca7a390 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd61b521740 10 client.0 _ll_register_callbacks cb 0x56094cd5ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:50.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce4baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce4baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49698/0 (socket says 172.21.15.33:49698) 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60e59c640 1 -- 172.21.15.33:0/3129546851 learned_addr learned my addr 172.21.15.33:0/3129546851 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60ed9d640 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce57d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce4c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60e59c640 1 -- 172.21.15.33:0/3129546851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 msgr2=0x56094ce4c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60e59c640 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce4c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60e59c640 1 -- 172.21.15.33:0/3129546851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 msgr2=0x56094ce57d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60e59c640 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce57d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60e59c640 1 -- 172.21.15.33:0/3129546851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56094cd66900 con 0x56094ca721b0 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd60e59c640 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce4baf0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd60001e000 tx=0x7fd6000a7290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c90449b14d1d397 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.126+0000 7fd5f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:50.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3129546851 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60001d040 con 0x56094ca721b0 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3129546851 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fd6000e52d0 con 0x56094ca721b0 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd61b521740 1 -- 172.21.15.33:0/3129546851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd604031830 con 0x56094ca721b0 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3129546851 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd6000aba40 con 0x56094ca721b0 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd61b521740 10 client.18102 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd61b521740 1 -- 172.21.15.33:0/3129546851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56094ce5a8d0 con 0x56094ca721b0 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3129546851 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd604031830 con 0x56094ca721b0 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3129546851 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd6000ceb20 con 0x56094ca721b0 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd61b521740 10 client.18102 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd61b521740 10 client.18102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd61b521740 20 client.18102 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd61b521740 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56094ca599f0 0x56094ce5dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd61b521740 4 client.18102 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.127+0000 7fd61b521740 1 -- 172.21.15.33:0/3129546851 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56094cdb95d0 con 0x56094ca599f0 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.128+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56094ca599f0 0x56094ce5dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.128+0000 7fd5f5ffb640 10 client.18102 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.128+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56094ca599f0 0x56094ce5dd40 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d921aeff0065203 server_cookie=99919bf866e9a866 in_seq=0 out_seq=0 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3129546851 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56094cdb95d0 con 0x56094ca599f0 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd5f5ffb640 10 client.18102 handle_command_reply: tid=0 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 client.18102 shutdown 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 -- 172.21.15.33:0/3129546851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 msgr2=0x56094ce4baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce4baf0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd60001e000 tx=0x7fd6000a7290 comp rx=0 tx=0).stop 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 -- 172.21.15.33:0/3129546851 shutdown_connections 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce57d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce4c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56094ca599f0 0x56094ce5dd40 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 --2- 172.21.15.33:0/3129546851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce4baf0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd5f5ffb640 0 client.18102 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 -- 172.21.15.33:0/3129546851 >> 172.21.15.33:0/3129546851 conn(0x56094ca8f460 msgr2=0x56094ce434f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 -- 172.21.15.33:0/3129546851 shutdown_connections 2024-08-28T19:41:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 1 -- 172.21.15.33:0/3129546851 wait complete. 2024-08-28T19:41:50.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.129+0000 7fd61b521740 20 client.18102 trim_cache size 0 max 16384 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd61b521740 1 Processor -- start 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd61b521740 1 -- start start 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd61b521740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce41d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd61b521740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce48ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd61b521740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce49220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd61b521740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101b2dc0 con 0x56094ca721b0 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd61b521740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101b4900 con 0x56094ca9b070 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd61b521740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101b3490 con 0x56094ca7a390 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd60e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce41d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd60e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce41d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49712/0 (socket says 172.21.15.33:49712) 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd60e59c640 1 -- 172.21.15.33:0/730631518 learned_addr learned my addr 172.21.15.33:0/730631518 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:50.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/730631518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce48ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd60ed9d640 1 --2- 172.21.15.33:0/730631518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce49220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd60e59c640 1 -- 172.21.15.33:0/730631518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 msgr2=0x56094ce48ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd60e59c640 1 --2- 172.21.15.33:0/730631518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce48ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd60e59c640 1 -- 172.21.15.33:0/730631518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 msgr2=0x56094ce49220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd60e59c640 1 --2- 172.21.15.33:0/730631518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce49220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.143+0000 7fd60e59c640 1 -- 172.21.15.33:0/730631518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094ce4cdb0 con 0x56094ca721b0 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.144+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/730631518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce48ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.144+0000 7fd60e59c640 1 --2- 172.21.15.33:0/730631518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce41d00 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd6000cee90 tx=0x7fd6000ab940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a9ddb437909160 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.144+0000 7fd5f7fff640 1 -- 172.21.15.33:0/730631518 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6000b4d60 con 0x56094ca721b0 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.144+0000 7fd5f7fff640 1 -- 172.21.15.33:0/730631518 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6000e52d0 con 0x56094ca721b0 2024-08-28T19:41:50.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.144+0000 7fd5f7fff640 1 -- 172.21.15.33:0/730631518 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd600057ab0 con 0x56094ca721b0 2024-08-28T19:41:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.145+0000 7fd61b521740 1 -- 172.21.15.33:0/730631518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 msgr2=0x56094ce41d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.145+0000 7fd61b521740 1 --2- 172.21.15.33:0/730631518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce41d00 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd6000cee90 tx=0x7fd6000ab940 comp rx=0 tx=0).stop 2024-08-28T19:41:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.145+0000 7fd61b521740 1 -- 172.21.15.33:0/730631518 shutdown_connections 2024-08-28T19:41:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.145+0000 7fd61b521740 1 --2- 172.21.15.33:0/730631518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca9b070 0x56094ce49220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.145+0000 7fd61b521740 1 --2- 172.21.15.33:0/730631518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca7a390 0x56094ce48ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.145+0000 7fd61b521740 1 --2- 172.21.15.33:0/730631518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce41d00 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.145+0000 7fd61b521740 1 -- 172.21.15.33:0/730631518 >> 172.21.15.33:0/730631518 conn(0x56094ca8f460 msgr2=0x56094ce43a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:50.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.145+0000 7fd61b521740 1 -- 172.21.15.33:0/730631518 shutdown_connections 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.145+0000 7fd61b521740 1 -- 172.21.15.33:0/730631518 wait complete. 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.145+0000 7fd61b521740 1 -- start start 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd61b521740 1 Processor -- start 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd61b521740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce52450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd61b521740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca7a390 0x56094ce52990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd61b521740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca9b070 0x56094cec76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd61b521740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101b4230 con 0x56094ca721b0 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd61b521740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101b3b60 con 0x56094ca7a390 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd61b521740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6101b0dc0 con 0x56094ca9b070 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd61b521740 10 client.0 _ll_register_callbacks cb 0x7fd60000c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd60e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce52450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd60dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca7a390 0x56094ce52990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd60e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce52450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49722/0 (socket says 172.21.15.33:49722) 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd60e59c640 1 -- 172.21.15.33:0/3835855938 learned_addr learned my addr 172.21.15.33:0/3835855938 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd60ed9d640 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca9b070 0x56094cec76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd60dd9b640 1 -- 172.21.15.33:0/3835855938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca9b070 msgr2=0x56094cec76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca9b070 0x56094cec76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd60dd9b640 1 -- 172.21.15.33:0/3835855938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 msgr2=0x56094ce52450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce52450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.146+0000 7fd60dd9b640 1 -- 172.21.15.33:0/3835855938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56094cec7c70 con 0x56094ca7a390 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.147+0000 7fd60dd9b640 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca7a390 0x56094ce52990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd604006010 tx=0x7fd6040039f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60a220dce5b0009a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.147+0000 7fd5f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.147+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3835855938 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60403f040 con 0x56094ca7a390 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.147+0000 7fd61b521740 1 -- 172.21.15.33:0/3835855938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6000e52d0 con 0x56094ca7a390 2024-08-28T19:41:50.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.147+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3835855938 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fd60405c630 con 0x56094ca7a390 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.147+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3835855938 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd60406c050 con 0x56094ca7a390 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.147+0000 7fd61b521740 10 client.27182 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.147+0000 7fd61b521740 1 -- 172.21.15.33:0/3835855938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56094cec8ed0 con 0x56094ca7a390 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.147+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3835855938 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6000e52d0 con 0x56094ca7a390 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.148+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3835855938 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd6040639f0 con 0x56094ca7a390 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.148+0000 7fd61b521740 10 client.27182 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.148+0000 7fd61b521740 10 client.27182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.148+0000 7fd61b521740 20 client.27182 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.148+0000 7fd61b521740 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56094ca2eda0 0x56094cecb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.148+0000 7fd61b521740 4 client.27182 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.148+0000 7fd61b521740 1 -- 172.21.15.33:0/3835855938 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56094cdb5070 con 0x56094ca2eda0 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.148+0000 7fd60e59c640 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56094ca2eda0 0x56094cecb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.148+0000 7fd60e59c640 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56094ca2eda0 0x56094cecb270 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e02b7acf0c7f5a0 server_cookie=36681b257ffcc472 in_seq=0 out_seq=0 2024-08-28T19:41:50.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.148+0000 7fd5f5ffb640 10 client.27182 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:50.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd5f5ffb640 1 -- 172.21.15.33:0/3835855938 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56094cdb5070 con 0x56094ca2eda0 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd5f5ffb640 10 client.27182 handle_command_reply: tid=0 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 client.27182 shutdown 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 -- 172.21.15.33:0/3835855938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca7a390 msgr2=0x56094ce52990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca7a390 0x56094ce52990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd604006010 tx=0x7fd6040039f0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 -- 172.21.15.33:0/3835855938 shutdown_connections 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56094ca9b070 0x56094cec76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56094ca7a390 0x56094ce52990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56094ca2eda0 0x56094cecb270 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 --2- 172.21.15.33:0/3835855938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56094ca721b0 0x56094ce52450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd5f5ffb640 0 client.27182 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 -- 172.21.15.33:0/3835855938 >> 172.21.15.33:0/3835855938 conn(0x56094ca8f460 msgr2=0x56094ce43a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 -- 172.21.15.33:0/3835855938 shutdown_connections 2024-08-28T19:41:50.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 1 -- 172.21.15.33:0/3835855938 wait complete. 2024-08-28T19:41:50.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.149+0000 7fd61b521740 20 client.27182 trim_cache size 0 max 16384 2024-08-28T19:41:50.156 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:41:50.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 -- 172.21.15.33:0/373227873 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5f80b4ca0 msgr2=0x7fd5f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5f80b4ca0 0x7fd5f80b71b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd604009230 tx=0x7fd604031400 comp rx=0 tx=0).stop 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 -- 172.21.15.33:0/373227873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd610104790 msgr2=0x7fd6101024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd610104790 0x7fd6101024d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fd60000c970 tx=0x7fd60000ce30 comp rx=0 tx=0).stop 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 -- 172.21.15.33:0/373227873 shutdown_connections 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5f80b4ca0 0x7fd5f80b71b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd61010dbf0 0x7fd610102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6101050e0 0x7fd610102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 --2- 172.21.15.33:0/373227873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd610104790 0x7fd6101024d0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 -- 172.21.15.33:0/373227873 >> 172.21.15.33:0/373227873 conn(0x7fd6100794f0 msgr2=0x7fd610100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 -- 172.21.15.33:0/373227873 shutdown_connections 2024-08-28T19:41:50.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:50.150+0000 7fd614fac640 1 -- 172.21.15.33:0/373227873 wait complete. 2024-08-28T19:41:50.991 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:51.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.475+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/3617476355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c9c109240 msgr2=0x7f7c9c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:51.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.475+0000 7f7ca1d7b640 1 --2- 172.21.15.33:0/3617476355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c9c109240 0x7f7c9c109650 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009900 tx=0x7f7c8402a410 comp rx=0 tx=0).stop 2024-08-28T19:41:51.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.475+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/3617476355 shutdown_connections 2024-08-28T19:41:51.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.475+0000 7f7ca1d7b640 1 --2- 172.21.15.33:0/3617476355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c109b90 0x7f7c9c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.475+0000 7f7ca1d7b640 1 --2- 172.21.15.33:0/3617476355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c9c109240 0x7f7c9c109650 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.475+0000 7f7ca1d7b640 1 --2- 172.21.15.33:0/3617476355 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c9c103900 0x7f7c9c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.475+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/3617476355 >> 172.21.15.33:0/3617476355 conn(0x7f7c9c07b5f0 msgr2=0x7f7c9c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:51.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.475+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/3617476355 shutdown_connections 2024-08-28T19:41:51.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.475+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/3617476355 wait complete. 2024-08-28T19:41:51.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.476+0000 7f7ca1d7b640 1 Processor -- start 2024-08-28T19:41:51.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.476+0000 7f7ca1d7b640 1 -- start start 2024-08-28T19:41:51.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.476+0000 7f7ca1d7b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103900 0x7f7c9c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.476+0000 7f7ca1d7b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c9c109240 0x7f7c9c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.476+0000 7f7ca1d7b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c9c109b90 0x7f7c9c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.476+0000 7f7ca1d7b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c113850 con 0x7f7c9c109b90 2024-08-28T19:41:51.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.476+0000 7f7ca1d7b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1136d0 con 0x7f7c9c103900 2024-08-28T19:41:51.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.476+0000 7f7ca1d7b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1139d0 con 0x7f7c9c109240 2024-08-28T19:41:51.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c9c109b90 0x7f7c9c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c9c109b90 0x7f7c9c19fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49742/0 (socket says 172.21.15.33:49742) 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9bfff640 1 -- 172.21.15.33:0/1144432147 learned_addr learned my addr 172.21.15.33:0/1144432147 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103900 0x7f7c9c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c9c109240 0x7f7c9c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9bfff640 1 -- 172.21.15.33:0/1144432147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c9c109240 msgr2=0x7f7c9c19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9bfff640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c9c109240 0x7f7c9c19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9bfff640 1 -- 172.21.15.33:0/1144432147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103900 msgr2=0x7f7c9c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9bfff640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103900 0x7f7c9c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9bfff640 1 -- 172.21.15.33:0/1144432147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c1a01b0 con 0x7f7c9c109b90 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103900 0x7f7c9c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c9bfff640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c9c109b90 0x7f7c9c19fa80 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400eb10 tx=0x7f7c9400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c997fa640 1 -- 172.21.15.33:0/1144432147 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94004b20 con 0x7f7c9c109b90 2024-08-28T19:41:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c997fa640 1 -- 172.21.15.33:0/1144432147 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c94004cc0 con 0x7f7c9c109b90 2024-08-28T19:41:51.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/1144432147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c1a04a0 con 0x7f7c9c109b90 2024-08-28T19:41:51.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.477+0000 7f7c997fa640 1 -- 172.21.15.33:0/1144432147 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94010670 con 0x7f7c9c109b90 2024-08-28T19:41:51.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.478+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/1144432147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c1a6c00 con 0x7f7c9c109b90 2024-08-28T19:41:51.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.480+0000 7f7ca82f0740 1 Processor -- start 2024-08-28T19:41:51.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.480+0000 7f7c997fa640 1 -- 172.21.15.33:0/1144432147 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7c94005020 con 0x7f7c9c109b90 2024-08-28T19:41:51.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.480+0000 7f7ca82f0740 1 -- start start 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa4bf520 0x55c8fa864c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa496660 0x55c8fa8651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa865700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa7dba70 con 0x55c8fa49e840 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa7cb000 con 0x55c8fa496660 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa7cefb0 con 0x55c8fa4bf520 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c92ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa865700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c92ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa865700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49748/0 (socket says 172.21.15.33:49748) 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c92ffd640 1 -- 172.21.15.33:0/515859761 learned_addr learned my addr 172.21.15.33:0/515859761 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/515859761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa4bf520 0x55c8fa864c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/515859761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa496660 0x55c8fa8651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c92ffd640 1 -- 172.21.15.33:0/515859761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa4bf520 msgr2=0x55c8fa864c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:51.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/515859761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa4bf520 0x55c8fa864c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c92ffd640 1 -- 172.21.15.33:0/515859761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa496660 msgr2=0x55c8fa8651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/515859761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa496660 0x55c8fa8651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c997fa640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c880b4d20 0x7f7c880b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c92ffd640 1 -- 172.21.15.33:0/515859761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8fa52ab00 con 0x55c8fa49e840 2024-08-28T19:41:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.481+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/515859761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa865700 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f7c840057c0 tx=0x7f7c84000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5147081fd7b21338 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.482+0000 7f7c997fa640 1 -- 172.21.15.33:0/1144432147 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f7c940e5d90 con 0x7f7c9c109b90 2024-08-28T19:41:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.482+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c880b4d20 0x7f7c880b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.482+0000 7f7c91ffb640 1 -- 172.21.15.33:0/515859761 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84035070 con 0x55c8fa49e840 2024-08-28T19:41:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.482+0000 7f7c91ffb640 1 -- 172.21.15.33:0/515859761 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c84005030 con 0x55c8fa49e840 2024-08-28T19:41:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.482+0000 7f7c91ffb640 1 -- 172.21.15.33:0/515859761 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84004cb0 con 0x55c8fa49e840 2024-08-28T19:41:51.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7ca82f0740 1 -- 172.21.15.33:0/515859761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 msgr2=0x55c8fa865700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:51.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/515859761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa865700 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f7c840057c0 tx=0x7f7c84000bc0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c880b4d20 0x7f7c880b7230 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7c84004fd0 tx=0x7f7c84003640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:51.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7ca82f0740 1 -- 172.21.15.33:0/515859761 shutdown_connections 2024-08-28T19:41:51.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/515859761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa865700 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/515859761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa496660 0x55c8fa8651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/515859761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa4bf520 0x55c8fa864c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7ca82f0740 1 -- 172.21.15.33:0/515859761 >> 172.21.15.33:0/515859761 conn(0x55c8fa4b3910 msgr2=0x55c8fa862b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7ca82f0740 1 -- 172.21.15.33:0/515859761 shutdown_connections 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7ca82f0740 1 -- 172.21.15.33:0/515859761 wait complete. 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.483+0000 7f7ca82f0740 1 -- start start 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7ca82f0740 1 Processor -- start 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa8707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa49e840 0x55c8fa870cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa4bf520 0x55c8fa87c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa873400 con 0x55c8fa496660 2024-08-28T19:41:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa78c520 con 0x55c8fa49e840 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c8fa873580 con 0x55c8fa4bf520 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7ca82f0740 10 client.0 _ll_register_callbacks cb 0x55c8fa7c4c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7c9b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa8707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7c9b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa8707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49750/0 (socket says 172.21.15.33:49750) 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7c9b7fe640 1 -- 172.21.15.33:0/776969505 learned_addr learned my addr 172.21.15.33:0/776969505 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa49e840 0x55c8fa870cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7c9bfff640 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa4bf520 0x55c8fa87c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7c9b7fe640 1 -- 172.21.15.33:0/776969505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa4bf520 msgr2=0x55c8fa87c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.484+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa4bf520 0x55c8fa87c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7c9b7fe640 1 -- 172.21.15.33:0/776969505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa49e840 msgr2=0x55c8fa870cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa49e840 0x55c8fa870cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7c9b7fe640 1 -- 172.21.15.33:0/776969505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8fa5a1960 con 0x55c8fa496660 2024-08-28T19:41:51.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa8707b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0118c0 tx=0x7f7c8c011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d67ef592f8ab84 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7c7affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7c7affd640 1 -- 172.21.15.33:0/776969505 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c010b40 con 0x55c8fa496660 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7c7affd640 1 -- 172.21.15.33:0/776969505 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f7c8c010ce0 con 0x55c8fa496660 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7ca82f0740 1 -- 172.21.15.33:0/776969505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c8fa76a9a0 con 0x55c8fa496660 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7c7affd640 1 -- 172.21.15.33:0/776969505 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c8c025050 con 0x55c8fa496660 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7ca82f0740 10 client.18120 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7ca82f0740 1 -- 172.21.15.33:0/776969505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8fa87f540 con 0x55c8fa496660 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.485+0000 7f7c7affd640 1 -- 172.21.15.33:0/776969505 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c8fa76a9a0 con 0x55c8fa496660 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.486+0000 7f7c7affd640 1 -- 172.21.15.33:0/776969505 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7c8c00f4e0 con 0x55c8fa496660 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.486+0000 7f7ca82f0740 10 client.18120 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.486+0000 7f7ca82f0740 10 client.18120 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.486+0000 7f7ca82f0740 20 client.18120 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:51.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.486+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c8fa47dea0 0x55c8fa882ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.486+0000 7f7ca82f0740 4 client.18120 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:51.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.486+0000 7f7ca82f0740 1 -- 172.21.15.33:0/776969505 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8fa7dd9c0 con 0x55c8fa47dea0 2024-08-28T19:41:51.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.486+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c8fa47dea0 0x55c8fa882ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.486+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c8fa47dea0 0x55c8fa882ac0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7703329489d05ebf server_cookie=d21e8847dc93a4d5 in_seq=0 out_seq=0 2024-08-28T19:41:51.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.486+0000 7f7c7affd640 10 client.18120 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:51.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7c7affd640 1 -- 172.21.15.33:0/776969505 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8fa7dd9c0 con 0x55c8fa47dea0 2024-08-28T19:41:51.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7c7affd640 10 client.18120 handle_command_reply: tid=0 2024-08-28T19:41:51.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7ca82f0740 1 client.18120 shutdown 2024-08-28T19:41:51.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7ca82f0740 1 -- 172.21.15.33:0/776969505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 msgr2=0x55c8fa8707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:51.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa8707b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0118c0 tx=0x7f7c8c011cc0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7ca82f0740 1 -- 172.21.15.33:0/776969505 shutdown_connections 2024-08-28T19:41:51.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa4bf520 0x55c8fa87c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa49e840 0x55c8fa870cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c8fa47dea0 0x55c8fa882ac0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/776969505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa8707b0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7ca82f0740 1 -- 172.21.15.33:0/776969505 >> 172.21.15.33:0/776969505 conn(0x55c8fa4b3910 msgr2=0x55c8fa867e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:51.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.487+0000 7f7c7affd640 0 client.18120 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:51.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.488+0000 7f7ca82f0740 1 -- 172.21.15.33:0/776969505 shutdown_connections 2024-08-28T19:41:51.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.488+0000 7f7ca82f0740 1 -- 172.21.15.33:0/776969505 wait complete. 2024-08-28T19:41:51.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.488+0000 7f7ca82f0740 20 client.18120 trim_cache size 0 max 16384 2024-08-28T19:41:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7ca82f0740 1 Processor -- start 2024-08-28T19:41:51.508 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:51 smithi033 ceph-mon[18549]: pgmap v630: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.9 KiB/s wr, 10 op/s 2024-08-28T19:41:51.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7ca82f0740 1 -- start start 2024-08-28T19:41:51.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa86d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa49e840 0x55c8fa86dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 0x55c8fa888280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1b2ed0 con 0x55c8fa496660 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1b4a10 con 0x55c8fa4bf520 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1b35a0 con 0x55c8fa49e840 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7c9b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa86d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7c9b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa86d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49752/0 (socket says 172.21.15.33:49752) 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.506+0000 7f7c9b7fe640 1 -- 172.21.15.33:0/726646820 learned_addr learned my addr 172.21.15.33:0/726646820 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c9bfff640 1 --2- 172.21.15.33:0/726646820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 0x55c8fa888280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/726646820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa49e840 0x55c8fa86dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c9b7fe640 1 -- 172.21.15.33:0/726646820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa49e840 msgr2=0x55c8fa86dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/726646820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa49e840 0x55c8fa86dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c9b7fe640 1 -- 172.21.15.33:0/726646820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 msgr2=0x55c8fa888280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/726646820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 0x55c8fa888280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c9b7fe640 1 -- 172.21.15.33:0/726646820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8fa871870 con 0x55c8fa496660 2024-08-28T19:41:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/726646820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa86d7a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c000c00 tx=0x7f7c8c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3cc35255861b34 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c917fa640 1 -- 172.21.15.33:0/726646820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c02d020 con 0x55c8fa496660 2024-08-28T19:41:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c917fa640 1 -- 172.21.15.33:0/726646820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c8c00fc30 con 0x55c8fa496660 2024-08-28T19:41:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.507+0000 7f7c917fa640 1 -- 172.21.15.33:0/726646820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c005030 con 0x55c8fa496660 2024-08-28T19:41:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.508+0000 7f7ca82f0740 1 -- 172.21.15.33:0/726646820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 msgr2=0x55c8fa86d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.508+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/726646820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa86d7a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c000c00 tx=0x7f7c8c010800 comp rx=0 tx=0).stop 2024-08-28T19:41:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.508+0000 7f7ca82f0740 1 -- 172.21.15.33:0/726646820 shutdown_connections 2024-08-28T19:41:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.508+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/726646820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 0x55c8fa888280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.508+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/726646820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa49e840 0x55c8fa86dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.508+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/726646820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa496660 0x55c8fa86d7a0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.508+0000 7f7ca82f0740 1 -- 172.21.15.33:0/726646820 >> 172.21.15.33:0/726646820 conn(0x55c8fa4b3910 msgr2=0x55c8fa870790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.508+0000 7f7ca82f0740 1 -- 172.21.15.33:0/726646820 shutdown_connections 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.508+0000 7f7ca82f0740 1 -- 172.21.15.33:0/726646820 wait complete. 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.509+0000 7f7ca82f0740 1 -- start start 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.509+0000 7f7ca82f0740 1 Processor -- start 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.509+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa496660 0x55c8fa878810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.509+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa878d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.509+0000 7f7ca82f0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 0x55c8fa8737c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.509+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1b4340 con 0x55c8fa49e840 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.509+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1b3c70 con 0x55c8fa4bf520 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.509+0000 7f7ca82f0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1b0ed0 con 0x55c8fa496660 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.509+0000 7f7ca82f0740 10 client.0 _ll_register_callbacks cb 0x7f7c8c00bcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:51.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.509+0000 7f7c92ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa878d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c92ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa878d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49764/0 (socket says 172.21.15.33:49764) 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c92ffd640 1 -- 172.21.15.33:0/2581064048 learned_addr learned my addr 172.21.15.33:0/2581064048 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa496660 0x55c8fa878810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c9bfff640 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 0x55c8fa8737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c92ffd640 1 -- 172.21.15.33:0/2581064048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa496660 msgr2=0x55c8fa878810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa496660 0x55c8fa878810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c92ffd640 1 -- 172.21.15.33:0/2581064048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 msgr2=0x55c8fa8737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 0x55c8fa8737c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c92ffd640 1 -- 172.21.15.33:0/2581064048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8fa879560 con 0x55c8fa49e840 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c9bfff640 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 0x55c8fa8737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c92ffd640 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa878d50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f7c840037e0 tx=0x7f7c84041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d2e9af5e8cb04 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c7affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:51.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c7affd640 1 -- 172.21.15.33:0/2581064048 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84035040 con 0x55c8fa49e840 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7ca82f0740 1 -- 172.21.15.33:0/2581064048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c8c00fc30 con 0x55c8fa49e840 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.510+0000 7f7c7affd640 1 -- 172.21.15.33:0/2581064048 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f7c84005210 con 0x55c8fa49e840 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7c7affd640 1 -- 172.21.15.33:0/2581064048 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c84070050 con 0x55c8fa49e840 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7ca82f0740 10 client.18126 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7ca82f0740 1 -- 172.21.15.33:0/2581064048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8fa8eda50 con 0x55c8fa49e840 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7c7affd640 1 -- 172.21.15.33:0/2581064048 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c8c00fc30 con 0x55c8fa49e840 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7c7affd640 1 -- 172.21.15.33:0/2581064048 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7c84004b70 con 0x55c8fa49e840 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7ca82f0740 10 client.18126 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7ca82f0740 10 client.18126 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7ca82f0740 20 client.18126 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c8fa453250 0x55c8fa8efda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7ca82f0740 4 client.18126 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bbc98890", "release": true, "await": true}] 2024-08-28T19:41:51.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7ca82f0740 1 -- 172.21.15.33:0/2581064048 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bbc98890", "release": true, "await": true}) -- 0x55c8fa7d9460 con 0x55c8fa453250 2024-08-28T19:41:51.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.511+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c8fa453250 0x55c8fa8efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:51.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.512+0000 7f7c7affd640 10 client.18126 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:51.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.512+0000 7f7c9b7fe640 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c8fa453250 0x55c8fa8efda0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da41698a0fed9041 server_cookie=4d44aee17b59478a in_seq=0 out_seq=0 2024-08-28T19:41:51.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7c7affd640 1 -- 172.21.15.33:0/2581064048 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c8fa7d9460 con 0x55c8fa453250 2024-08-28T19:41:51.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7c7affd640 10 client.18126 handle_command_reply: tid=0 2024-08-28T19:41:51.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7ca82f0740 1 client.18126 shutdown 2024-08-28T19:41:51.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7ca82f0740 1 -- 172.21.15.33:0/2581064048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 msgr2=0x55c8fa878d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:51.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa878d50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f7c840037e0 tx=0x7f7c84041000 comp rx=0 tx=0).stop 2024-08-28T19:41:51.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7ca82f0740 1 -- 172.21.15.33:0/2581064048 shutdown_connections 2024-08-28T19:41:51.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8fa4bf520 0x55c8fa8737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c8fa453250 0x55c8fa8efda0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c8fa49e840 0x55c8fa878d50 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7ca82f0740 1 --2- 172.21.15.33:0/2581064048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c8fa496660 0x55c8fa878810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7c7affd640 0 client.18126 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:51.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.515+0000 7f7ca82f0740 1 -- 172.21.15.33:0/2581064048 >> 172.21.15.33:0/2581064048 conn(0x55c8fa4b3910 msgr2=0x55c8fa870790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:51.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.516+0000 7f7ca82f0740 1 -- 172.21.15.33:0/2581064048 shutdown_connections 2024-08-28T19:41:51.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.516+0000 7f7ca82f0740 1 -- 172.21.15.33:0/2581064048 wait complete. 2024-08-28T19:41:51.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.516+0000 7f7ca82f0740 20 client.18126 trim_cache size 0 max 16384 2024-08-28T19:41:51.520 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:41:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 28, 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "bbc98890": { 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 28, 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 132.4, 2024-08-28T19:41:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:51.522 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:41:51.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.516+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/1144432147 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c880b4d20 msgr2=0x7f7c880b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:51.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.516+0000 7f7ca1d7b640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c880b4d20 0x7f7c880b7230 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7c84004fd0 tx=0x7f7c84003640 comp rx=0 tx=0).stop 2024-08-28T19:41:51.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.516+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/1144432147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c9c109b90 msgr2=0x7f7c9c19fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:51.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.516+0000 7f7ca1d7b640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c9c109b90 0x7f7c9c19fa80 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400eb10 tx=0x7f7c9400c2d0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.516+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/1144432147 shutdown_connections 2024-08-28T19:41:51.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.516+0000 7f7ca1d7b640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c9c109b90 0x7f7c9c19fa80 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.517+0000 7f7ca1d7b640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7c880b4d20 0x7f7c880b7230 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.517+0000 7f7ca1d7b640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7c9c109240 0x7f7c9c19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.517+0000 7f7ca1d7b640 1 --2- 172.21.15.33:0/1144432147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103900 0x7f7c9c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:51.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.517+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/1144432147 >> 172.21.15.33:0/1144432147 conn(0x7f7c9c07b5f0 msgr2=0x7f7c9c107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:51.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.517+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/1144432147 shutdown_connections 2024-08-28T19:41:51.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:51.517+0000 7f7ca1d7b640 1 -- 172.21.15.33:0/1144432147 wait complete. 2024-08-28T19:41:51.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:51 smithi059 ceph-mon[22052]: pgmap v630: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.9 KiB/s wr, 10 op/s 2024-08-28T19:41:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:51 smithi122 ceph-mon[22174]: pgmap v630: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.9 KiB/s wr, 10 op/s 2024-08-28T19:41:51.940 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:41:51.940 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:41:52.478 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bbc98890', total seconds elapsed: 17.6 2024-08-28T19:41:52.529 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:53.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.038+0000 7feb9123f640 1 -- 172.21.15.33:0/2951464742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb8c104780 msgr2=0x7feb8c104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:53.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.038+0000 7feb9123f640 1 --2- 172.21.15.33:0/2951464742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb8c104780 0x7feb8c104b90 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009900 tx=0x7feb7c02a410 comp rx=0 tx=0).stop 2024-08-28T19:41:53.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.038+0000 7feb9123f640 1 -- 172.21.15.33:0/2951464742 shutdown_connections 2024-08-28T19:41:53.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.038+0000 7feb9123f640 1 --2- 172.21.15.33:0/2951464742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb8c10dbe0 0x7feb8c1100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.038+0000 7feb9123f640 1 --2- 172.21.15.33:0/2951464742 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb8c1050d0 0x7feb8c10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.038+0000 7feb9123f640 1 --2- 172.21.15.33:0/2951464742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb8c104780 0x7feb8c104b90 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.038+0000 7feb9123f640 1 -- 172.21.15.33:0/2951464742 >> 172.21.15.33:0/2951464742 conn(0x7feb8c0794f0 msgr2=0x7feb8c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.038+0000 7feb9123f640 1 -- 172.21.15.33:0/2951464742 shutdown_connections 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.038+0000 7feb9123f640 1 -- 172.21.15.33:0/2951464742 wait complete. 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.039+0000 7feb9123f640 1 Processor -- start 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.039+0000 7feb9123f640 1 -- start start 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb9123f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb8c104780 0x7feb8c1024c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb9123f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb8c1050d0 0x7feb8c102a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb9123f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb8c10dbe0 0x7feb8c102f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb9123f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c113860 con 0x7feb8c10dbe0 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb9123f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c1136e0 con 0x7feb8c104780 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb9123f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c1139e0 con 0x7feb8c1050d0 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8b59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb8c10dbe0 0x7feb8c102f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8b59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb8c10dbe0 0x7feb8c102f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49774/0 (socket says 172.21.15.33:49774) 2024-08-28T19:41:53.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8b59e640 1 -- 172.21.15.33:0/2130541697 learned_addr learned my addr 172.21.15.33:0/2130541697 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb8c104780 0x7feb8c1024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8a59c640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb8c1050d0 0x7feb8c102a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8b59e640 1 -- 172.21.15.33:0/2130541697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb8c1050d0 msgr2=0x7feb8c102a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8b59e640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb8c1050d0 0x7feb8c102a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8b59e640 1 -- 172.21.15.33:0/2130541697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb8c104780 msgr2=0x7feb8c1024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8b59e640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb8c104780 0x7feb8c1024c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8b59e640 1 -- 172.21.15.33:0/2130541697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c1a8570 con 0x7feb8c10dbe0 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb8c104780 0x7feb8c1024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8a59c640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb8c1050d0 0x7feb8c102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb8b59e640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb8c10dbe0 0x7feb8c102f40 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7feb8400cad0 tx=0x7feb8400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb73fff640 1 -- 172.21.15.33:0/2130541697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8400ae20 con 0x7feb8c10dbe0 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb73fff640 1 -- 172.21.15.33:0/2130541697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb84005020 con 0x7feb8c10dbe0 2024-08-28T19:41:53.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb9123f640 1 -- 172.21.15.33:0/2130541697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c1a8860 con 0x7feb8c10dbe0 2024-08-28T19:41:53.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.040+0000 7feb73fff640 1 -- 172.21.15.33:0/2130541697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8400f6b0 con 0x7feb8c10dbe0 2024-08-28T19:41:53.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.041+0000 7feb9123f640 1 -- 172.21.15.33:0/2130541697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c1a8d50 con 0x7feb8c10dbe0 2024-08-28T19:41:53.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.044+0000 7feb977b4740 1 Processor -- start 2024-08-28T19:41:53.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.044+0000 7feb73fff640 1 -- 172.21.15.33:0/2130541697 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7feb840051d0 con 0x7feb8c10dbe0 2024-08-28T19:41:53.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.044+0000 7feb977b4740 1 -- start start 2024-08-28T19:41:53.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.044+0000 7feb977b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fdd350 0x55c867383780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.044+0000 7feb977b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c867383cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.044+0000 7feb977b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fbc670 0x55c867384200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.044+0000 7feb977b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c8672f95f0 con 0x55c866fb4490 2024-08-28T19:41:53.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.044+0000 7feb977b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c8672e8b80 con 0x55c866fdd350 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.044+0000 7feb977b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c8672ecb30 con 0x55c866fbc670 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c867383cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c867383cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49776/0 (socket says 172.21.15.33:49776) 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8ad9d640 1 -- 172.21.15.33:0/1675623566 learned_addr learned my addr 172.21.15.33:0/1675623566 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8a59c640 1 --2- 172.21.15.33:0/1675623566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fdd350 0x55c867383780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8a59c640 1 --2- 172.21.15.33:0/1675623566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fbc670 0x55c867384200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb73fff640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feb740b4ca0 0x7feb740b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8ad9d640 1 -- 172.21.15.33:0/1675623566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fbc670 msgr2=0x55c867384200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/1675623566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fbc670 0x55c867384200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8ad9d640 1 -- 172.21.15.33:0/1675623566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fdd350 msgr2=0x55c867383780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/1675623566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fdd350 0x55c867383780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8ad9d640 1 -- 172.21.15.33:0/1675623566 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c867048930 con 0x55c866fb4490 2024-08-28T19:41:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8a59c640 1 --2- 172.21.15.33:0/1675623566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fbc670 0x55c867384200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8b59e640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feb740b4ca0 0x7feb740b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb73fff640 1 -- 172.21.15.33:0/2130541697 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7feb840e5a10 con 0x7feb8c10dbe0 2024-08-28T19:41:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.045+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/1675623566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c867383cc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7feb7c031440 tx=0x7feb7c032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e508e6e9c6930f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.046+0000 7feb717fa640 1 -- 172.21.15.33:0/1675623566 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c03f070 con 0x55c866fb4490 2024-08-28T19:41:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.046+0000 7feb717fa640 1 -- 172.21.15.33:0/1675623566 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb7c0316a0 con 0x55c866fb4490 2024-08-28T19:41:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.046+0000 7feb717fa640 1 -- 172.21.15.33:0/1675623566 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c035070 con 0x55c866fb4490 2024-08-28T19:41:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.046+0000 7feb977b4740 1 -- 172.21.15.33:0/1675623566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 msgr2=0x55c867383cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.046+0000 7feb8b59e640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feb740b4ca0 0x7feb740b71b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7feb840a8fd0 tx=0x7feb840a7c20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:53.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.046+0000 7feb977b4740 1 --2- 172.21.15.33:0/1675623566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c867383cc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7feb7c031440 tx=0x7feb7c032e60 comp rx=0 tx=0).stop 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 -- 172.21.15.33:0/1675623566 shutdown_connections 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 --2- 172.21.15.33:0/1675623566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fbc670 0x55c867384200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 --2- 172.21.15.33:0/1675623566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c867383cc0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 --2- 172.21.15.33:0/1675623566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fdd350 0x55c867383780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 -- 172.21.15.33:0/1675623566 >> 172.21.15.33:0/1675623566 conn(0x55c866fd1740 msgr2=0x55c867381670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 -- 172.21.15.33:0/1675623566 shutdown_connections 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 -- 172.21.15.33:0/1675623566 wait complete. 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 -- start start 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 Processor -- start 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c86738f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fbc670 0x55c86738f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fdd350 0x55c86739b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c86714b890 con 0x55c866fb4490 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c86726f790 con 0x55c866fbc670 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.047+0000 7feb977b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c867391f00 con 0x55c866fdd350 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c86738f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb977b4740 10 client.0 _ll_register_callbacks cb 0x55c866ff4ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c86738f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49782/0 (socket says 172.21.15.33:49782) 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8a59c640 1 -- 172.21.15.33:0/2476825997 learned_addr learned my addr 172.21.15.33:0/2476825997 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fbc670 0x55c86738f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8a59c640 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fdd350 0x55c86739b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8a59c640 1 -- 172.21.15.33:0/2476825997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fdd350 msgr2=0x55c86739b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8a59c640 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fdd350 0x55c86739b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8a59c640 1 -- 172.21.15.33:0/2476825997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fbc670 msgr2=0x55c86738f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8a59c640 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fbc670 0x55c86738f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8a59c640 1 -- 172.21.15.33:0/2476825997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8672a6f30 con 0x55c866fb4490 2024-08-28T19:41:53.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb8a59c640 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c86738f000 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7feb80012a40 tx=0x7feb80016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7943d91245b2fb7b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb6eff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb6eff5640 1 -- 172.21.15.33:0/2476825997 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80005020 con 0x55c866fb4490 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb6eff5640 1 -- 172.21.15.33:0/2476825997 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7feb800051c0 con 0x55c866fb4490 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.048+0000 7feb977b4740 1 -- 172.21.15.33:0/2476825997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb7c0316a0 con 0x55c866fb4490 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb6eff5640 1 -- 172.21.15.33:0/2476825997 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feb80025050 con 0x55c866fb4490 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb977b4740 10 client.18138 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb977b4740 1 -- 172.21.15.33:0/2476825997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c86739ddf0 con 0x55c866fb4490 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb6eff5640 1 -- 172.21.15.33:0/2476825997 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb7c0316a0 con 0x55c866fb4490 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb6eff5640 1 -- 172.21.15.33:0/2476825997 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feb8000f480 con 0x55c866fb4490 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb977b4740 10 client.18138 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb977b4740 10 client.18138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:53.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb977b4740 20 client.18138 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb977b4740 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c866f9bcd0 0x55c8673a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb977b4740 4 client.18138 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb977b4740 1 -- 172.21.15.33:0/2476825997 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8672fb540 con 0x55c866f9bcd0 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.049+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c866f9bcd0 0x55c8673a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.050+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c866f9bcd0 0x55c8673a12d0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95427999a9731784 server_cookie=33bbfc8aa69297e6 in_seq=0 out_seq=0 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.050+0000 7feb6eff5640 10 client.18138 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.050+0000 7feb6eff5640 1 -- 172.21.15.33:0/2476825997 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8672fb540 con 0x55c866f9bcd0 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.050+0000 7feb6eff5640 10 client.18138 handle_command_reply: tid=0 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 client.18138 shutdown 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 -- 172.21.15.33:0/2476825997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 msgr2=0x55c86738f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c86738f000 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7feb80012a40 tx=0x7feb80016040 comp rx=0 tx=0).stop 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 -- 172.21.15.33:0/2476825997 shutdown_connections 2024-08-28T19:41:53.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fdd350 0x55c86739b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fbc670 0x55c86738f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c866f9bcd0 0x55c8673a12d0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 --2- 172.21.15.33:0/2476825997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fb4490 0x55c86738f000 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb6eff5640 0 client.18138 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:53.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 -- 172.21.15.33:0/2476825997 >> 172.21.15.33:0/2476825997 conn(0x55c866fd1740 msgr2=0x55c867386960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:53.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 -- 172.21.15.33:0/2476825997 shutdown_connections 2024-08-28T19:41:53.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 1 -- 172.21.15.33:0/2476825997 wait complete. 2024-08-28T19:41:53.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.051+0000 7feb977b4740 20 client.18138 trim_cache size 0 max 16384 2024-08-28T19:41:53.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb977b4740 1 Processor -- start 2024-08-28T19:41:53.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb977b4740 1 -- start start 2024-08-28T19:41:53.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb977b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866f9bcd0 0x55c867386f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb977b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fb4490 0x55c86738c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb977b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fbc670 0x55c86738c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb977b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c1b2e70 con 0x55c866f9bcd0 2024-08-28T19:41:53.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb977b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c1b49b0 con 0x55c866fb4490 2024-08-28T19:41:53.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb977b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c1b3540 con 0x55c866fbc670 2024-08-28T19:41:53.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb8a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866f9bcd0 0x55c867386f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb8a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866f9bcd0 0x55c867386f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49796/0 (socket says 172.21.15.33:49796) 2024-08-28T19:41:53.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb8a59c640 1 -- 172.21.15.33:0/2566204632 learned_addr learned my addr 172.21.15.33:0/2566204632 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:53.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb8a59c640 1 -- 172.21.15.33:0/2566204632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fbc670 msgr2=0x55c86738c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:53.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb8a59c640 1 --2- 172.21.15.33:0/2566204632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fbc670 0x55c86738c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb8a59c640 1 -- 172.21.15.33:0/2566204632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fb4490 msgr2=0x55c86738c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:53.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb8a59c640 1 --2- 172.21.15.33:0/2566204632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fb4490 0x55c86738c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.069+0000 7feb8a59c640 1 -- 172.21.15.33:0/2566204632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c867385a70 con 0x55c866f9bcd0 2024-08-28T19:41:53.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.070+0000 7feb8a59c640 1 --2- 172.21.15.33:0/2566204632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866f9bcd0 0x55c867386f90 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7feb80012a10 tx=0x7feb80004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9916200e952310 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:53.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.070+0000 7feb70ff9640 1 -- 172.21.15.33:0/2566204632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8000fea0 con 0x55c866f9bcd0 2024-08-28T19:41:53.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.070+0000 7feb70ff9640 1 -- 172.21.15.33:0/2566204632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb8000f480 con 0x55c866f9bcd0 2024-08-28T19:41:53.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.070+0000 7feb70ff9640 1 -- 172.21.15.33:0/2566204632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80005070 con 0x55c866f9bcd0 2024-08-28T19:41:53.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 -- 172.21.15.33:0/2566204632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866f9bcd0 msgr2=0x55c867386f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:53.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 --2- 172.21.15.33:0/2566204632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866f9bcd0 0x55c867386f90 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7feb80012a10 tx=0x7feb80004680 comp rx=0 tx=0).stop 2024-08-28T19:41:53.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 -- 172.21.15.33:0/2566204632 shutdown_connections 2024-08-28T19:41:53.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 --2- 172.21.15.33:0/2566204632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fbc670 0x55c86738c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 --2- 172.21.15.33:0/2566204632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fb4490 0x55c86738c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 --2- 172.21.15.33:0/2566204632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866f9bcd0 0x55c867386f90 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 -- 172.21.15.33:0/2566204632 >> 172.21.15.33:0/2566204632 conn(0x55c866fd1740 msgr2=0x55c867386880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:53.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 -- 172.21.15.33:0/2566204632 shutdown_connections 2024-08-28T19:41:53.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 -- 172.21.15.33:0/2566204632 wait complete. 2024-08-28T19:41:53.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 -- start start 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.071+0000 7feb977b4740 1 Processor -- start 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb977b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fb4490 0x55c8673940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb977b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fbc670 0x55c867394630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb977b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fdd350 0x55c867394b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb977b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c1b42e0 con 0x55c866fbc670 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb977b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c1b3c10 con 0x55c866fb4490 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb977b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c1b0e70 con 0x55c866fdd350 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb977b4740 10 client.0 _ll_register_callbacks cb 0x7feb8000c8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fbc670 0x55c867394630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fbc670 0x55c867394630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49798/0 (socket says 172.21.15.33:49798) 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8ad9d640 1 -- 172.21.15.33:0/3106693394 learned_addr learned my addr 172.21.15.33:0/3106693394 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8a59c640 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fb4490 0x55c8673940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8a59c640 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fdd350 0x55c867394b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8ad9d640 1 -- 172.21.15.33:0/3106693394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fdd350 msgr2=0x55c867394b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fdd350 0x55c867394b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8ad9d640 1 -- 172.21.15.33:0/3106693394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fb4490 msgr2=0x55c8673940f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fb4490 0x55c8673940f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8ad9d640 1 -- 172.21.15.33:0/3106693394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c86740bca0 con 0x55c866fbc670 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8a59c640 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fb4490 0x55c8673940f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb8ad9d640 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fbc670 0x55c867394630 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7feb7c031a90 tx=0x7feb7c032de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddb3d79d1d7a0bb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.072+0000 7feb6eff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb6eff5640 1 -- 172.21.15.33:0/3106693394 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c03f030 con 0x55c866fbc670 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb977b4740 1 -- 172.21.15.33:0/3106693394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb8000f480 con 0x55c866fbc670 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb6eff5640 1 -- 172.21.15.33:0/3106693394 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7feb7c031b10 con 0x55c866fbc670 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb6eff5640 1 -- 172.21.15.33:0/3106693394 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feb7c05e050 con 0x55c866fbc670 2024-08-28T19:41:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb977b4740 10 client.18144 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb977b4740 1 -- 172.21.15.33:0/3106693394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c86740cf10 con 0x55c866fbc670 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb6eff5640 1 -- 172.21.15.33:0/3106693394 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb8000f480 con 0x55c866fbc670 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb6eff5640 1 -- 172.21.15.33:0/3106693394 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feb7c055450 con 0x55c866fbc670 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb977b4740 10 client.18144 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb977b4740 10 client.18144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb977b4740 20 client.18144 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb977b4740 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c866f71080 0x55c86740f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb977b4740 4 client.18144 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.073+0000 7feb977b4740 1 -- 172.21.15.33:0/3106693394 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c8672f6fe0 con 0x55c866f71080 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.074+0000 7feb8a59c640 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c866f71080 0x55c86740f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.074+0000 7feb6eff5640 10 client.18144 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:53.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.074+0000 7feb8a59c640 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c866f71080 0x55c86740f1b0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f54d553d7aff7a9 server_cookie=e6d6864080b98f10 in_seq=0 out_seq=0 2024-08-28T19:41:53.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb6eff5640 1 -- 172.21.15.33:0/3106693394 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c8672f6fe0 con 0x55c866f71080 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb6eff5640 10 client.18144 handle_command_reply: tid=0 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 client.18144 shutdown 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 -- 172.21.15.33:0/3106693394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fbc670 msgr2=0x55c867394630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fbc670 0x55c867394630 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7feb7c031a90 tx=0x7feb7c032de0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 -- 172.21.15.33:0/3106693394 shutdown_connections 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c866fdd350 0x55c867394b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c866f71080 0x55c86740f1b0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c866fbc670 0x55c867394630 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 --2- 172.21.15.33:0/3106693394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c866fb4490 0x55c8673940f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb6eff5640 0 client.18144 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 -- 172.21.15.33:0/3106693394 >> 172.21.15.33:0/3106693394 conn(0x55c866fd1740 msgr2=0x55c867384750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:53.081 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 -- 172.21.15.33:0/3106693394 shutdown_connections 2024-08-28T19:41:53.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 1 -- 172.21.15.33:0/3106693394 wait complete. 2024-08-28T19:41:53.082 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.076+0000 7feb977b4740 20 client.18144 trim_cache size 0 max 16384 2024-08-28T19:41:53.082 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:41:53.082 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:41:53.082 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4", 2024-08-28T19:41:53.082 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:41:53.082 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:41:53.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 -- 172.21.15.33:0/2130541697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feb740b4ca0 msgr2=0x7feb740b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:53.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feb740b4ca0 0x7feb740b71b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7feb840a8fd0 tx=0x7feb840a7c20 comp rx=0 tx=0).stop 2024-08-28T19:41:53.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 -- 172.21.15.33:0/2130541697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb8c10dbe0 msgr2=0x7feb8c102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:53.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb8c10dbe0 0x7feb8c102f40 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7feb8400cad0 tx=0x7feb8400cf90 comp rx=0 tx=0).stop 2024-08-28T19:41:53.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 -- 172.21.15.33:0/2130541697 shutdown_connections 2024-08-28T19:41:53.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb8c10dbe0 0x7feb8c102f40 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7feb740b4ca0 0x7feb740b71b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7feb8c1050d0 0x7feb8c102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 --2- 172.21.15.33:0/2130541697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb8c104780 0x7feb8c1024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:53.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 -- 172.21.15.33:0/2130541697 >> 172.21.15.33:0/2130541697 conn(0x7feb8c0794f0 msgr2=0x7feb8c1005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:53.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 -- 172.21.15.33:0/2130541697 shutdown_connections 2024-08-28T19:41:53.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:53.077+0000 7feb9123f640 1 -- 172.21.15.33:0/2130541697 wait complete. 2024-08-28T19:41:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:53 smithi033 ceph-mon[18549]: pgmap v631: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-08-28T19:41:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:53 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:41:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:53 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:53 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:41:53.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:53 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:53.738 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:41:53.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:53 smithi059 ceph-mon[22052]: pgmap v631: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-08-28T19:41:53.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:53 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:41:53.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:53 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:53.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:53 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:41:53.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:53 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:53 smithi122 ceph-mon[22174]: pgmap v631: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-08-28T19:41:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:53 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:41:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:53 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:53 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:41:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:53 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:41:54.002 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:54.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.518+0000 7f6220ca7640 1 -- 172.21.15.33:0/3936428809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c103910 msgr2=0x7f621c103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:54.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.518+0000 7f6220ca7640 1 --2- 172.21.15.33:0/3936428809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c103910 0x7f621c103d20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f620c009ca0 tx=0x7f620c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.518+0000 7f6220ca7640 1 -- 172.21.15.33:0/3936428809 shutdown_connections 2024-08-28T19:41:54.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.518+0000 7f6220ca7640 1 --2- 172.21.15.33:0/3936428809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f621c109ba0 0x7f621c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.518+0000 7f6220ca7640 1 --2- 172.21.15.33:0/3936428809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f621c109250 0x7f621c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.518+0000 7f6220ca7640 1 --2- 172.21.15.33:0/3936428809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c103910 0x7f621c103d20 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.518+0000 7f6220ca7640 1 -- 172.21.15.33:0/3936428809 >> 172.21.15.33:0/3936428809 conn(0x7f621c0ff380 msgr2=0x7f621c1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:54.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.518+0000 7f6220ca7640 1 -- 172.21.15.33:0/3936428809 shutdown_connections 2024-08-28T19:41:54.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.518+0000 7f6220ca7640 1 -- 172.21.15.33:0/3936428809 wait complete. 2024-08-28T19:41:54.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.519+0000 7f6220ca7640 1 Processor -- start 2024-08-28T19:41:54.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.519+0000 7f6220ca7640 1 -- start start 2024-08-28T19:41:54.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.519+0000 7f6220ca7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f621c103910 0x7f621c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.519+0000 7f6220ca7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c109250 0x7f621c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.519+0000 7f6220ca7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f621c109ba0 0x7f621c19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.519+0000 7f6220ca7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f621c113860 con 0x7f621c109250 2024-08-28T19:41:54.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.519+0000 7f6220ca7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1136e0 con 0x7f621c103910 2024-08-28T19:41:54.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.519+0000 7f6220ca7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1139e0 con 0x7f621c109ba0 2024-08-28T19:41:54.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6219d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c109250 0x7f621c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6219d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c109250 0x7f621c19a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49808/0 (socket says 172.21.15.33:49808) 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6219d9b640 1 -- 172.21.15.33:0/3076422290 learned_addr learned my addr 172.21.15.33:0/3076422290 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f621a59c640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f621c103910 0x7f621c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f621ad9d640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f621c109ba0 0x7f621c19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6219d9b640 1 -- 172.21.15.33:0/3076422290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f621c109ba0 msgr2=0x7f621c19fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6219d9b640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f621c109ba0 0x7f621c19fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6219d9b640 1 -- 172.21.15.33:0/3076422290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f621c103910 msgr2=0x7f621c19a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6219d9b640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f621c103910 0x7f621c19a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6219d9b640 1 -- 172.21.15.33:0/3076422290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c1a01c0 con 0x7f621c109250 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f621ad9d640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f621c109ba0 0x7f621c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:54.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6219d9b640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c109250 0x7f621c19a7f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f620400d950 tx=0x7f620400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:54.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f62137fe640 1 -- 172.21.15.33:0/3076422290 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204017070 con 0x7f621c109250 2024-08-28T19:41:54.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f62137fe640 1 -- 172.21.15.33:0/3076422290 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6204009c30 con 0x7f621c109250 2024-08-28T19:41:54.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6220ca7640 1 -- 172.21.15.33:0/3076422290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621c1a04b0 con 0x7f621c109250 2024-08-28T19:41:54.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f62137fe640 1 -- 172.21.15.33:0/3076422290 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62040047a0 con 0x7f621c109250 2024-08-28T19:41:54.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.520+0000 7f6220ca7640 1 -- 172.21.15.33:0/3076422290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621c1a6c10 con 0x7f621c109250 2024-08-28T19:41:54.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.523+0000 7f622721c740 1 Processor -- start 2024-08-28T19:41:54.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.523+0000 7f622721c740 1 -- start start 2024-08-28T19:41:54.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f62137fe640 1 -- 172.21.15.33:0/3076422290 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6204004940 con 0x7f621c109250 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f622721c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f622721c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c668800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f622721c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c668d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f622721c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55796c5df630 con 0x55796c2c3070 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f622721c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55796c5cebc0 con 0x55796c2a2390 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f622721c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55796c5d2b70 con 0x55796c29a1b0 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f621ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f621ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6682c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49822/0 (socket says 172.21.15.33:49822) 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f621ad9d640 1 -- 172.21.15.33:0/1788049339 learned_addr learned my addr 172.21.15.33:0/1788049339 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f621a59c640 1 --2- 172.21.15.33:0/1788049339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c668800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f6219d9b640 1 --2- 172.21.15.33:0/1788049339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c668d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f621ad9d640 1 -- 172.21.15.33:0/1788049339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 msgr2=0x55796c668800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f621ad9d640 1 --2- 172.21.15.33:0/1788049339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c668800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f621ad9d640 1 -- 172.21.15.33:0/1788049339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 msgr2=0x55796c668d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f621ad9d640 1 --2- 172.21.15.33:0/1788049339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c668d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f621ad9d640 1 -- 172.21.15.33:0/1788049339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796c32e650 con 0x55796c2c3070 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.524+0000 7f6219d9b640 1 --2- 172.21.15.33:0/1788049339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c668d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.525+0000 7f621ad9d640 1 --2- 172.21.15.33:0/1788049339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6682c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f621400bca0 tx=0x7f621400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc7518e3a5d0315 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.525+0000 7f62137fe640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62080b4ca0 0x7f62080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.525+0000 7f6210ff9640 1 -- 172.21.15.33:0/1788049339 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214015070 con 0x55796c2c3070 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.525+0000 7f621a59c640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62080b4ca0 0x7f62080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.525+0000 7f6210ff9640 1 -- 172.21.15.33:0/1788049339 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62140054d0 con 0x55796c2c3070 2024-08-28T19:41:54.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.525+0000 7f6210ff9640 1 -- 172.21.15.33:0/1788049339 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62140116a0 con 0x55796c2c3070 2024-08-28T19:41:54.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.525+0000 7f62137fe640 1 -- 172.21.15.33:0/3076422290 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f62040e5640 con 0x7f621c109250 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.526+0000 7f622721c740 1 -- 172.21.15.33:0/1788049339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 msgr2=0x55796c6682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.526+0000 7f621a59c640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62080b4ca0 0x7f62080b71b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55796c666f40 tx=0x7f620c009410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.526+0000 7f622721c740 1 --2- 172.21.15.33:0/1788049339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6682c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f621400bca0 tx=0x7f621400f730 comp rx=0 tx=0).stop 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.526+0000 7f622721c740 1 -- 172.21.15.33:0/1788049339 shutdown_connections 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.526+0000 7f622721c740 1 --2- 172.21.15.33:0/1788049339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c668d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.526+0000 7f622721c740 1 --2- 172.21.15.33:0/1788049339 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c668800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.526+0000 7f622721c740 1 --2- 172.21.15.33:0/1788049339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6682c0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.526+0000 7f622721c740 1 -- 172.21.15.33:0/1788049339 >> 172.21.15.33:0/1788049339 conn(0x55796c2b7460 msgr2=0x55796c6661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.526+0000 7f622721c740 1 -- 172.21.15.33:0/1788049339 shutdown_connections 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.526+0000 7f622721c740 1 -- 172.21.15.33:0/1788049339 wait complete. 2024-08-28T19:41:54.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f622721c740 1 -- start start 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f622721c740 1 Processor -- start 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f622721c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c673ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f622721c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c674020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f622721c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c67fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f622721c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55796c431700 con 0x55796c2c3070 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f622721c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55796c555700 con 0x55796c2a2390 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f622721c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55796c676aa0 con 0x55796c29a1b0 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f622721c740 10 client.0 _ll_register_callbacks cb 0x55796c584dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f621ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c67fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f621ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c67fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49826/0 (socket says 172.21.15.33:49826) 2024-08-28T19:41:54.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f621ad9d640 1 -- 172.21.15.33:0/2973192289 learned_addr learned my addr 172.21.15.33:0/2973192289 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f6219d9b640 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c674020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f621a59c640 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c673ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f621ad9d640 1 -- 172.21.15.33:0/2973192289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 msgr2=0x55796c673ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f621ad9d640 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c673ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f621ad9d640 1 -- 172.21.15.33:0/2973192289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 msgr2=0x55796c674020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f621ad9d640 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c674020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.527+0000 7f621ad9d640 1 -- 172.21.15.33:0/2973192289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796c58e8b0 con 0x55796c2c3070 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f621ad9d640 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c67fdc0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f6214004c00 tx=0x7f621400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb4abd59428f17b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f6201ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f6201ffb640 1 -- 172.21.15.33:0/2973192289 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214028060 con 0x55796c2c3070 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f6201ffb640 1 -- 172.21.15.33:0/2973192289 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f6214004e00 con 0x55796c2c3070 2024-08-28T19:41:54.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f622721c740 1 -- 172.21.15.33:0/2973192289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62140054d0 con 0x55796c2c3070 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f6201ffb640 1 -- 172.21.15.33:0/2973192289 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f621402f050 con 0x55796c2c3070 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f622721c740 10 client.18156 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f622721c740 1 -- 172.21.15.33:0/2973192289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55796c682900 con 0x55796c2c3070 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f6201ffb640 1 -- 172.21.15.33:0/2973192289 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62140054d0 con 0x55796c2c3070 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f6201ffb640 1 -- 172.21.15.33:0/2973192289 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6214011bf0 con 0x55796c2c3070 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.528+0000 7f622721c740 10 client.18156 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.529+0000 7f622721c740 10 client.18156 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.529+0000 7f622721c740 20 client.18156 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.529+0000 7f622721c740 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55796c2819f0 0x55796c685d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.529+0000 7f622721c740 4 client.18156 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:54.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.529+0000 7f622721c740 1 -- 172.21.15.33:0/2973192289 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55796c5e1580 con 0x55796c2819f0 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.529+0000 7f621a59c640 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55796c2819f0 0x55796c685d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.529+0000 7f6201ffb640 10 client.18156 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.529+0000 7f621a59c640 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55796c2819f0 0x55796c685d10 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be5d3de6bda3ea3b server_cookie=f884fc6fe3a2196e in_seq=0 out_seq=0 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f6201ffb640 1 -- 172.21.15.33:0/2973192289 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55796c5e1580 con 0x55796c2819f0 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f6201ffb640 10 client.18156 handle_command_reply: tid=0 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f622721c740 1 client.18156 shutdown 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f622721c740 1 -- 172.21.15.33:0/2973192289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 msgr2=0x55796c67fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f622721c740 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c67fdc0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f6214004c00 tx=0x7f621400b7e0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f622721c740 1 -- 172.21.15.33:0/2973192289 shutdown_connections 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f622721c740 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55796c2819f0 0x55796c685d10 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f622721c740 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c67fdc0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f622721c740 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c674020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f6201ffb640 0 client.18156 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:54.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f622721c740 1 --2- 172.21.15.33:0/2973192289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c673ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.530+0000 7f622721c740 1 -- 172.21.15.33:0/2973192289 >> 172.21.15.33:0/2973192289 conn(0x55796c2b7460 msgr2=0x55796c66b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:54.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.531+0000 7f622721c740 1 -- 172.21.15.33:0/2973192289 shutdown_connections 2024-08-28T19:41:54.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.531+0000 7f622721c740 1 -- 172.21.15.33:0/2973192289 wait complete. 2024-08-28T19:41:54.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.531+0000 7f622721c740 20 client.18156 trim_cache size 0 max 16384 2024-08-28T19:41:54.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.548+0000 7f622721c740 1 Processor -- start 2024-08-28T19:41:54.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.548+0000 7f622721c740 1 -- start start 2024-08-28T19:41:54.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.548+0000 7f622721c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c673fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.548+0000 7f622721c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2a2390 0x55796c66b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.548+0000 7f622721c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2c3070 0x55796c66b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f622721c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1b0cb0 con 0x55796c2a2390 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f622721c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1b27f0 con 0x55796c2c3070 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f622721c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1b1380 con 0x55796c29a1b0 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6219d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2a2390 0x55796c66b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6219d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2a2390 0x55796c66b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49838/0 (socket says 172.21.15.33:49838) 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6219d9b640 1 -- 172.21.15.33:0/2027227601 learned_addr learned my addr 172.21.15.33:0/2027227601 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f621a59c640 1 --2- 172.21.15.33:0/2027227601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c673fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f621ad9d640 1 --2- 172.21.15.33:0/2027227601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2c3070 0x55796c66b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6219d9b640 1 -- 172.21.15.33:0/2027227601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 msgr2=0x55796c673fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:54.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6219d9b640 1 --2- 172.21.15.33:0/2027227601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c673fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6219d9b640 1 -- 172.21.15.33:0/2027227601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2c3070 msgr2=0x55796c66b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:54.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6219d9b640 1 --2- 172.21.15.33:0/2027227601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2c3070 0x55796c66b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6219d9b640 1 -- 172.21.15.33:0/2027227601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796c66a5b0 con 0x55796c2a2390 2024-08-28T19:41:54.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f621ad9d640 1 --2- 172.21.15.33:0/2027227601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2c3070 0x55796c66b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:54.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6219d9b640 1 --2- 172.21.15.33:0/2027227601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2a2390 0x55796c66b3c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f620400bfd0 tx=0x7f62040ab760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c9cb88517e217b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:54.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6203fff640 1 -- 172.21.15.33:0/2027227601 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62040eb040 con 0x55796c2a2390 2024-08-28T19:41:54.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6203fff640 1 -- 172.21.15.33:0/2027227601 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62040ab4a0 con 0x55796c2a2390 2024-08-28T19:41:54.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.549+0000 7f6203fff640 1 -- 172.21.15.33:0/2027227601 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62040b0200 con 0x55796c2a2390 2024-08-28T19:41:54.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.550+0000 7f622721c740 1 -- 172.21.15.33:0/2027227601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2a2390 msgr2=0x55796c66b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:54.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.550+0000 7f622721c740 1 --2- 172.21.15.33:0/2027227601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2a2390 0x55796c66b3c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f620400bfd0 tx=0x7f62040ab760 comp rx=0 tx=0).stop 2024-08-28T19:41:54.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.550+0000 7f622721c740 1 -- 172.21.15.33:0/2027227601 shutdown_connections 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.550+0000 7f622721c740 1 --2- 172.21.15.33:0/2027227601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2c3070 0x55796c66b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.550+0000 7f622721c740 1 --2- 172.21.15.33:0/2027227601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2a2390 0x55796c66b3c0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.550+0000 7f622721c740 1 --2- 172.21.15.33:0/2027227601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c673fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.550+0000 7f622721c740 1 -- 172.21.15.33:0/2027227601 >> 172.21.15.33:0/2027227601 conn(0x55796c2b7460 msgr2=0x55796c673890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.550+0000 7f622721c740 1 -- 172.21.15.33:0/2027227601 shutdown_connections 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.550+0000 7f622721c740 1 -- 172.21.15.33:0/2027227601 wait complete. 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.550+0000 7f622721c740 1 -- start start 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f622721c740 1 Processor -- start 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f622721c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c687730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f622721c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c687cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f622721c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6e9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f622721c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1b2120 con 0x55796c2c3070 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f622721c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1b1a50 con 0x55796c2a2390 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f622721c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1aecb0 con 0x55796c29a1b0 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f622721c740 10 client.0 _ll_register_callbacks cb 0x7f620c009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f621ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6e9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f621ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6e9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49848/0 (socket says 172.21.15.33:49848) 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f621ad9d640 1 -- 172.21.15.33:0/2324945973 learned_addr learned my addr 172.21.15.33:0/2324945973 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f621a59c640 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c687730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f6219d9b640 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c687cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f621ad9d640 1 -- 172.21.15.33:0/2324945973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 msgr2=0x55796c687730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:54.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f621ad9d640 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c687730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f621ad9d640 1 -- 172.21.15.33:0/2324945973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 msgr2=0x55796c687cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f621ad9d640 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c687cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f621ad9d640 1 -- 172.21.15.33:0/2324945973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796c6e9bb0 con 0x55796c2c3070 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.551+0000 7f6219d9b640 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c687cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f621ad9d640 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6e9540 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6214004cd0 tx=0x7f621400bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b040372f4ed00436 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f6201ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f6201ffb640 1 -- 172.21.15.33:0/2324945973 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214037070 con 0x55796c2c3070 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f6201ffb640 1 -- 172.21.15.33:0/2324945973 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f62140048d0 con 0x55796c2c3070 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f622721c740 1 -- 172.21.15.33:0/2324945973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62040ab4a0 con 0x55796c2c3070 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f6201ffb640 1 -- 172.21.15.33:0/2324945973 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6214043050 con 0x55796c2c3070 2024-08-28T19:41:54.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f622721c740 10 client.18162 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f622721c740 1 -- 172.21.15.33:0/2324945973 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55796c6f0f00 con 0x55796c2c3070 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f6201ffb640 1 -- 172.21.15.33:0/2324945973 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62040ab4a0 con 0x55796c2c3070 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f6201ffb640 1 -- 172.21.15.33:0/2324945973 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6214005150 con 0x55796c2c3070 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f622721c740 10 client.18162 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f622721c740 10 client.18162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f622721c740 20 client.18162 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f622721c740 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55796c256da0 0x55796c6f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f622721c740 4 client.18162 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.552+0000 7f622721c740 1 -- 172.21.15.33:0/2324945973 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55796c5dd020 con 0x55796c256da0 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.553+0000 7f621a59c640 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55796c256da0 0x55796c6f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.553+0000 7f621a59c640 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55796c256da0 0x55796c6f35a0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a539830230c953e server_cookie=461fcca98aed3406 in_seq=0 out_seq=0 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.553+0000 7f6201ffb640 10 client.18162 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.553+0000 7f6201ffb640 1 -- 172.21.15.33:0/2324945973 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x55796c5dd020 con 0x55796c256da0 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f6201ffb640 10 client.18162 handle_command_reply: tid=0 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 client.18162 shutdown 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 -- 172.21.15.33:0/2324945973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 msgr2=0x55796c6e9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6e9540 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6214004cd0 tx=0x7f621400bba0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 -- 172.21.15.33:0/2324945973 shutdown_connections 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55796c256da0 0x55796c6f35a0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55796c2c3070 0x55796c6e9540 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55796c2a2390 0x55796c687cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 --2- 172.21.15.33:0/2324945973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55796c29a1b0 0x55796c687730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 -- 172.21.15.33:0/2324945973 >> 172.21.15.33:0/2324945973 conn(0x55796c2b7460 msgr2=0x55796c66b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:54.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f6201ffb640 0 client.18162 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:41:54.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 -- 172.21.15.33:0/2324945973 shutdown_connections 2024-08-28T19:41:54.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 1 -- 172.21.15.33:0/2324945973 wait complete. 2024-08-28T19:41:54.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f622721c740 20 client.18162 trim_cache size 0 max 16384 2024-08-28T19:41:54.562 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:41:54.562 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:41:54.562 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:41:54.562 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.563 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.564 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:41:54.565 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.566 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:41:54.567 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.568 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.569 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.570 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.571 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:41:54.572 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:41:54.573 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:41:54.573 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:41:54.573 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:41:54.573 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:41:54.573 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:54.573 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:41:54.573 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f6220ca7640 1 -- 172.21.15.33:0/3076422290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62080b4ca0 msgr2=0x7f62080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f6220ca7640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62080b4ca0 0x7f62080b71b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55796c666f40 tx=0x7f620c009410 comp rx=0 tx=0).stop 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f6220ca7640 1 -- 172.21.15.33:0/3076422290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c109250 msgr2=0x7f621c19a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.554+0000 7f6220ca7640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c109250 0x7f621c19a7f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f620400d950 tx=0x7f620400de10 comp rx=0 tx=0).stop 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.555+0000 7f6220ca7640 1 -- 172.21.15.33:0/3076422290 shutdown_connections 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.555+0000 7f6220ca7640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62080b4ca0 0x7f62080b71b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.555+0000 7f6220ca7640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f621c109ba0 0x7f621c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.555+0000 7f6220ca7640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f621c109250 0x7f621c19a7f0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.555+0000 7f6220ca7640 1 --2- 172.21.15.33:0/3076422290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f621c103910 0x7f621c19a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.555+0000 7f6220ca7640 1 -- 172.21.15.33:0/3076422290 >> 172.21.15.33:0/3076422290 conn(0x7f621c0ff380 msgr2=0x7f621c1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:54.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.555+0000 7f6220ca7640 1 -- 172.21.15.33:0/3076422290 shutdown_connections 2024-08-28T19:41:54.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:54.555+0000 7f6220ca7640 1 -- 172.21.15.33:0/3076422290 wait complete. 2024-08-28T19:41:54.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:54 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:41:54.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:54 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:41:54.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:54 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:41:55.401 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:41:55.401 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:41:55.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:55 smithi033 ceph-mon[18549]: pgmap v632: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.4 KiB/s wr, 12 op/s 2024-08-28T19:41:55.661 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:55.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:55 smithi059 ceph-mon[22052]: pgmap v632: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.4 KiB/s wr, 12 op/s 2024-08-28T19:41:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:55 smithi122 ceph-mon[22174]: pgmap v632: 129 pgs: 129 active+clean; 13 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.4 KiB/s wr, 12 op/s 2024-08-28T19:41:56.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.140+0000 7eff14ebb640 1 -- 172.21.15.33:0/1863639528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff1010bde0 msgr2=0x7eff10112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:56.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.140+0000 7eff14ebb640 1 --2- 172.21.15.33:0/1863639528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff1010bde0 0x7eff10112610 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7eff00009900 tx=0x7eff0002a410 comp rx=0 tx=0).stop 2024-08-28T19:41:56.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.140+0000 7eff14ebb640 1 -- 172.21.15.33:0/1863639528 shutdown_connections 2024-08-28T19:41:56.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.140+0000 7eff14ebb640 1 --2- 172.21.15.33:0/1863639528 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff1010bde0 0x7eff10112610 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.140+0000 7eff14ebb640 1 --2- 172.21.15.33:0/1863639528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff1010b490 0x7eff1010b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.140+0000 7eff14ebb640 1 --2- 172.21.15.33:0/1863639528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff10105b50 0x7eff10105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.140+0000 7eff14ebb640 1 -- 172.21.15.33:0/1863639528 >> 172.21.15.33:0/1863639528 conn(0x7eff10101560 msgr2=0x7eff101039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.140+0000 7eff14ebb640 1 -- 172.21.15.33:0/1863639528 shutdown_connections 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.140+0000 7eff14ebb640 1 -- 172.21.15.33:0/1863639528 wait complete. 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.141+0000 7eff14ebb640 1 Processor -- start 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.141+0000 7eff14ebb640 1 -- start start 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff14ebb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff10105b50 0x7eff1019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff14ebb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff1010b490 0x7eff1019ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff14ebb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1010bde0 0x7eff101a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff14ebb640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7eff10115aa0 con 0x7eff1010b490 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff14ebb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff10115920 con 0x7eff10105b50 2024-08-28T19:41:56.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff14ebb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7eff10115c20 con 0x7eff1010bde0 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff1010b490 0x7eff1019ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff1010b490 0x7eff1019ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49874/0 (socket says 172.21.15.33:49874) 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0dd9b640 1 -- 172.21.15.33:0/3121982590 learned_addr learned my addr 172.21.15.33:0/3121982590 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0ed9d640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1010bde0 0x7eff101a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0e59c640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff10105b50 0x7eff1019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0dd9b640 1 -- 172.21.15.33:0/3121982590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1010bde0 msgr2=0x7eff101a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0dd9b640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1010bde0 0x7eff101a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0dd9b640 1 -- 172.21.15.33:0/3121982590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff10105b50 msgr2=0x7eff1019c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0dd9b640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff10105b50 0x7eff1019c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0dd9b640 1 -- 172.21.15.33:0/3121982590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff101a2400 con 0x7eff1010b490 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7eff0dd9b640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff1010b490 0x7eff1019ca30 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7eff0400d950 tx=0x7eff0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:56.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.142+0000 7efeff7fe640 1 -- 172.21.15.33:0/3121982590 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff04017070 con 0x7eff1010b490 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.143+0000 7efeff7fe640 1 -- 172.21.15.33:0/3121982590 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff04009c30 con 0x7eff1010b490 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.143+0000 7eff14ebb640 1 -- 172.21.15.33:0/3121982590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff101a26f0 con 0x7eff1010b490 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.143+0000 7efeff7fe640 1 -- 172.21.15.33:0/3121982590 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff040047a0 con 0x7eff1010b490 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.143+0000 7eff14ebb640 1 -- 172.21.15.33:0/3121982590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff101a8e50 con 0x7eff1010b490 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.144+0000 7eff14ebb640 1 -- 172.21.15.33:0/3121982590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff10105f60 con 0x7eff1010b490 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.145+0000 7efeff7fe640 1 -- 172.21.15.33:0/3121982590 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7eff04004020 con 0x7eff1010b490 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.146+0000 7efeff7fe640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef80b4d20 0x7efef80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.147+0000 7eff0e59c640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef80b4d20 0x7efef80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.147+0000 7efeff7fe640 1 -- 172.21.15.33:0/3121982590 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7eff040e57f0 con 0x7eff1010b490 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.147+0000 7eff0e59c640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef80b4d20 0x7efef80b7230 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7eff08005fd0 tx=0x7eff08009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.150+0000 7efeff7fe640 1 -- 172.21.15.33:0/3121982590 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7eff04020020 con 0x7eff1010b490 2024-08-28T19:41:56.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.374+0000 7eff14ebb640 1 -- 172.21.15.33:0/3121982590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff1019d5c0 con 0x7eff1010b490 2024-08-28T19:41:56.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.375+0000 7efeff7fe640 1 -- 172.21.15.33:0/3121982590 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7eff1019d5c0 con 0x7eff1010b490 2024-08-28T19:41:56.376 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:41:56.376 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:41:56.376 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:41:56.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 -- 172.21.15.33:0/3121982590 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef80b4d20 msgr2=0x7efef80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef80b4d20 0x7efef80b7230 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7eff08005fd0 tx=0x7eff08009680 comp rx=0 tx=0).stop 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 -- 172.21.15.33:0/3121982590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff1010b490 msgr2=0x7eff1019ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff1010b490 0x7eff1019ca30 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7eff0400d950 tx=0x7eff0400de10 comp rx=0 tx=0).stop 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 -- 172.21.15.33:0/3121982590 shutdown_connections 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef80b4d20 0x7efef80b7230 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff1010bde0 0x7eff101a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff1010b490 0x7eff1019ca30 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 --2- 172.21.15.33:0/3121982590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff10105b50 0x7eff1019c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 -- 172.21.15.33:0/3121982590 >> 172.21.15.33:0/3121982590 conn(0x7eff10101560 msgr2=0x7eff10108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 -- 172.21.15.33:0/3121982590 shutdown_connections 2024-08-28T19:41:56.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:56.378+0000 7eff14ebb640 1 -- 172.21.15.33:0/3121982590 wait complete. 2024-08-28T19:41:56.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:56 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3121982590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:56.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:56 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3121982590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:56.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:56 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3121982590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:41:57.141 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:41:57.394 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:57.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:57 smithi059 ceph-mon[22052]: pgmap v633: 129 pgs: 129 active+clean; 13 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.4 KiB/s wr, 9 op/s 2024-08-28T19:41:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:57 smithi122 ceph-mon[22174]: pgmap v633: 129 pgs: 129 active+clean; 13 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.4 KiB/s wr, 9 op/s 2024-08-28T19:41:57.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:57 smithi033 ceph-mon[18549]: pgmap v633: 129 pgs: 129 active+clean; 13 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.4 KiB/s wr, 9 op/s 2024-08-28T19:41:57.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.921+0000 7f2655942640 1 -- 172.21.15.33:0/3205257734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2650102800 msgr2=0x7f2650102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:57.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.921+0000 7f2655942640 1 --2- 172.21.15.33:0/3205257734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2650102800 0x7f2650102c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2640009ca0 tx=0x7f264002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.921+0000 7f2655942640 1 -- 172.21.15.33:0/3205257734 shutdown_connections 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.921+0000 7f2655942640 1 --2- 172.21.15.33:0/3205257734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2650108a90 0x7f265010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.921+0000 7f2655942640 1 --2- 172.21.15.33:0/3205257734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2650108140 0x7f2650108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.921+0000 7f2655942640 1 --2- 172.21.15.33:0/3205257734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2650102800 0x7f2650102c10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.921+0000 7f2655942640 1 -- 172.21.15.33:0/3205257734 >> 172.21.15.33:0/3205257734 conn(0x7f26500794d0 msgr2=0x7f26500798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.921+0000 7f2655942640 1 -- 172.21.15.33:0/3205257734 shutdown_connections 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.921+0000 7f2655942640 1 -- 172.21.15.33:0/3205257734 wait complete. 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f2655942640 1 Processor -- start 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f2655942640 1 -- start start 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f2655942640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2650102800 0x7f265019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f2655942640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2650108140 0x7f265019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f2655942640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2650108a90 0x7f265019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f2655942640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2650113820 con 0x7f2650102800 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f2655942640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26501136a0 con 0x7f2650108140 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f2655942640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26501139a0 con 0x7f2650108a90 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f264effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2650102800 0x7f265019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f264effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2650102800 0x7f265019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49898/0 (socket says 172.21.15.33:49898) 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.922+0000 7f264effd640 1 -- 172.21.15.33:0/3885865581 learned_addr learned my addr 172.21.15.33:0/3885865581 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f264e7fc640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2650108140 0x7f265019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f264f7fe640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2650108a90 0x7f265019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f264effd640 1 -- 172.21.15.33:0/3885865581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2650108a90 msgr2=0x7f265019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f264effd640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2650108a90 0x7f265019fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f264effd640 1 -- 172.21.15.33:0/3885865581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2650108140 msgr2=0x7f265019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f264effd640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2650108140 0x7f265019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f264effd640 1 -- 172.21.15.33:0/3885865581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26501a01e0 con 0x7f2650102800 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f264effd640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2650102800 0x7f265019a270 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f264002ade0 tx=0x7f2640031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f2654940640 1 -- 172.21.15.33:0/3885865581 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640003b70 con 0x7f2650102800 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f2655942640 1 -- 172.21.15.33:0/3885865581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26501a0470 con 0x7f2650102800 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f2654940640 1 -- 172.21.15.33:0/3885865581 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2640003d10 con 0x7f2650102800 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f2654940640 1 -- 172.21.15.33:0/3885865581 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264002fa80 con 0x7f2650102800 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.923+0000 7f2655942640 1 -- 172.21.15.33:0/3885865581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26501a6c30 con 0x7f2650102800 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f265beb7740 1 Processor -- start 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f265beb7740 1 -- start start 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f2654940640 1 -- 172.21.15.33:0/3885865581 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f264002fc20 con 0x7f2650102800 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f265beb7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 0x555cc60fd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f265beb7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc60fd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f265beb7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d37390 0x555cc60fdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f265beb7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555cc6074680 con 0x555cc5d2f1b0 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f265beb7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555cc6063c10 con 0x555cc5d37390 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f265beb7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555cc6067bc0 con 0x555cc5d58070 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f264effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc60fd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 0x555cc60fd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 0x555cc60fd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:49546/0 (socket says 172.21.15.33:49546) 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f264f7fe640 1 -- 172.21.15.33:0/1622781372 learned_addr learned my addr 172.21.15.33:0/1622781372 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.926+0000 7f264e7fc640 1 --2- 172.21.15.33:0/1622781372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d37390 0x555cc60fdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f264f7fe640 1 -- 172.21.15.33:0/1622781372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d37390 msgr2=0x555cc60fdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f264f7fe640 1 --2- 172.21.15.33:0/1622781372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d37390 0x555cc60fdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f264f7fe640 1 -- 172.21.15.33:0/1622781372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 msgr2=0x555cc60fd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f264f7fe640 1 --2- 172.21.15.33:0/1622781372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc60fd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f264f7fe640 1 -- 172.21.15.33:0/1622781372 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc5dc3650 con 0x555cc5d58070 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f264f7fe640 1 --2- 172.21.15.33:0/1622781372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 0x555cc60fd310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2648009c10 tx=0x7f2648011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a66cedbd59272788 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f2654940640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f263c0b4ca0 0x7f263c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f264effd640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f263c0b4ca0 0x7f263c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f2654940640 1 -- 172.21.15.33:0/3885865581 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f2640106ae0 con 0x7f2650102800 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f2645ffb640 1 -- 172.21.15.33:0/1622781372 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648004230 con 0x555cc5d58070 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f2645ffb640 1 -- 172.21.15.33:0/1622781372 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26480043d0 con 0x555cc5d58070 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.927+0000 7f2645ffb640 1 -- 172.21.15.33:0/1622781372 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648019680 con 0x555cc5d58070 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f265beb7740 1 -- 172.21.15.33:0/1622781372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 msgr2=0x555cc60fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f265beb7740 1 --2- 172.21.15.33:0/1622781372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 0x555cc60fd310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2648009c10 tx=0x7f2648011810 comp rx=0 tx=0).stop 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f264effd640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f263c0b4ca0 0x7f263c0b71b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2640103f40 tx=0x7f26400b4040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f265beb7740 1 -- 172.21.15.33:0/1622781372 shutdown_connections 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f265beb7740 1 --2- 172.21.15.33:0/1622781372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d37390 0x555cc60fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f265beb7740 1 --2- 172.21.15.33:0/1622781372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc60fd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f265beb7740 1 --2- 172.21.15.33:0/1622781372 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 0x555cc60fd310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f265beb7740 1 -- 172.21.15.33:0/1622781372 >> 172.21.15.33:0/1622781372 conn(0x555cc5d4c460 msgr2=0x555cc60fb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f265beb7740 1 -- 172.21.15.33:0/1622781372 shutdown_connections 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f265beb7740 1 -- 172.21.15.33:0/1622781372 wait complete. 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.928+0000 7f265beb7740 1 -- start start 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f265beb7740 1 Processor -- start 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f265beb7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc6108ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f265beb7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d37390 0x555cc6109000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f265beb7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 0x555cc6114de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f265beb7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555cc5ec6700 con 0x555cc5d2f1b0 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f265beb7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555cc5fea750 con 0x555cc5d37390 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f265beb7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555cc610baf0 con 0x555cc5d58070 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f265beb7740 10 client.0 _ll_register_callbacks cb 0x555cc6019e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc6108ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc6108ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49908/0 (socket says 172.21.15.33:49908) 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f264f7fe640 1 -- 172.21.15.33:0/376544318 learned_addr learned my addr 172.21.15.33:0/376544318 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f264e7fc640 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d37390 0x555cc6109000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.929+0000 7f264f7fe640 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 0x555cc6114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f264f7fe640 1 -- 172.21.15.33:0/376544318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 msgr2=0x555cc6114de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f264f7fe640 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 0x555cc6114de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f264f7fe640 1 -- 172.21.15.33:0/376544318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d37390 msgr2=0x555cc6109000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f264f7fe640 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d37390 0x555cc6109000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f264f7fe640 1 -- 172.21.15.33:0/376544318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc6023900 con 0x555cc5d2f1b0 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f264f7fe640 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc6108ac0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f2648003870 tx=0x7f2648003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d40d6b722a06464 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f262effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f262effd640 1 -- 172.21.15.33:0/376544318 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648005220 con 0x555cc5d2f1b0 2024-08-28T19:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f262effd640 1 -- 172.21.15.33:0/376544318 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f26480053c0 con 0x555cc5d2f1b0 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f265beb7740 1 -- 172.21.15.33:0/376544318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26480043d0 con 0x555cc5d2f1b0 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f262effd640 1 -- 172.21.15.33:0/376544318 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2648003ba0 con 0x555cc5d2f1b0 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f265beb7740 10 client.18180 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f265beb7740 1 -- 172.21.15.33:0/376544318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555cc61178f0 con 0x555cc5d2f1b0 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.930+0000 7f262effd640 1 -- 172.21.15.33:0/376544318 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26480043d0 con 0x555cc5d2f1b0 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.931+0000 7f262effd640 1 -- 172.21.15.33:0/376544318 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2648025070 con 0x555cc5d2f1b0 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.931+0000 7f265beb7740 10 client.18180 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.931+0000 7f265beb7740 10 client.18180 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.931+0000 7f265beb7740 20 client.18180 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.931+0000 7f265beb7740 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x555cc5d169f0 0x555cc611ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.931+0000 7f265beb7740 4 client.18180 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.931+0000 7f265beb7740 1 -- 172.21.15.33:0/376544318 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cc60765d0 con 0x555cc5d169f0 2024-08-28T19:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.931+0000 7f264e7fc640 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x555cc5d169f0 0x555cc611ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.931+0000 7f262effd640 10 client.18180 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.931+0000 7f264e7fc640 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x555cc5d169f0 0x555cc611ac50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=52ea1f58c5b8f660 server_cookie=d0277e946133fa6e in_seq=0 out_seq=0 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.932+0000 7f262effd640 1 -- 172.21.15.33:0/376544318 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555cc60765d0 con 0x555cc5d169f0 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.932+0000 7f262effd640 10 client.18180 handle_command_reply: tid=0 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.932+0000 7f265beb7740 1 client.18180 shutdown 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 1 -- 172.21.15.33:0/376544318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 msgr2=0x555cc6108ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc6108ac0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f2648003870 tx=0x7f2648003e30 comp rx=0 tx=0).stop 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 1 -- 172.21.15.33:0/376544318 shutdown_connections 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x555cc5d169f0 0x555cc611ac50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d58070 0x555cc6114de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d37390 0x555cc6109000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 1 --2- 172.21.15.33:0/376544318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc6108ac0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 1 -- 172.21.15.33:0/376544318 >> 172.21.15.33:0/376544318 conn(0x555cc5d4c460 msgr2=0x555cc61004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:57.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f262effd640 0 client.18180 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:41:57.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 1 -- 172.21.15.33:0/376544318 shutdown_connections 2024-08-28T19:41:57.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 1 -- 172.21.15.33:0/376544318 wait complete. 2024-08-28T19:41:57.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.933+0000 7f265beb7740 20 client.18180 trim_cache size 0 max 16384 2024-08-28T19:41:57.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.946+0000 7f265beb7740 1 Processor -- start 2024-08-28T19:41:57.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.946+0000 7f265beb7740 1 -- start start 2024-08-28T19:41:57.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f265beb7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc60fb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f265beb7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 0x555cc6114ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f265beb7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d58070 0x555cc6115220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f265beb7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f26501b0c50 con 0x555cc5d2f1b0 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f265beb7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26501b2790 con 0x555cc5d58070 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f265beb7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26501b1320 con 0x555cc5d37390 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc60fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc60fb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49912/0 (socket says 172.21.15.33:49912) 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f264f7fe640 1 -- 172.21.15.33:0/2458062486 learned_addr learned my addr 172.21.15.33:0/2458062486 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f264e7fc640 1 --2- 172.21.15.33:0/2458062486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 0x555cc6114ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f264f7fe640 1 -- 172.21.15.33:0/2458062486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 msgr2=0x555cc6114ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f264f7fe640 1 --2- 172.21.15.33:0/2458062486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 0x555cc6114ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f264f7fe640 1 -- 172.21.15.33:0/2458062486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d58070 msgr2=0x555cc6115220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f264f7fe640 1 --2- 172.21.15.33:0/2458062486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d58070 0x555cc6115220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f264f7fe640 1 -- 172.21.15.33:0/2458062486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc60fff50 con 0x555cc5d2f1b0 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f264f7fe640 1 --2- 172.21.15.33:0/2458062486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc60fb300 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f2648014040 tx=0x7f2648009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe993163fc96a64 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f26457fa640 1 -- 172.21.15.33:0/2458062486 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648011d10 con 0x555cc5d2f1b0 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f26457fa640 1 -- 172.21.15.33:0/2458062486 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2648020040 con 0x555cc5d2f1b0 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.947+0000 7f26457fa640 1 -- 172.21.15.33:0/2458062486 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264801ae00 con 0x555cc5d2f1b0 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.948+0000 7f265beb7740 1 -- 172.21.15.33:0/2458062486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 msgr2=0x555cc60fb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.948+0000 7f265beb7740 1 --2- 172.21.15.33:0/2458062486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc60fb300 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f2648014040 tx=0x7f2648009f80 comp rx=0 tx=0).stop 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.948+0000 7f265beb7740 1 -- 172.21.15.33:0/2458062486 shutdown_connections 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.948+0000 7f265beb7740 1 --2- 172.21.15.33:0/2458062486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d58070 0x555cc6115220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.948+0000 7f265beb7740 1 --2- 172.21.15.33:0/2458062486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 0x555cc6114ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.948+0000 7f265beb7740 1 --2- 172.21.15.33:0/2458062486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d2f1b0 0x555cc60fb300 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.948+0000 7f265beb7740 1 -- 172.21.15.33:0/2458062486 >> 172.21.15.33:0/2458062486 conn(0x555cc5d4c460 msgr2=0x555cc60fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.948+0000 7f265beb7740 1 -- 172.21.15.33:0/2458062486 shutdown_connections 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.948+0000 7f265beb7740 1 -- 172.21.15.33:0/2458062486 wait complete. 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f265beb7740 1 -- start start 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f265beb7740 1 Processor -- start 2024-08-28T19:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f265beb7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d2f1b0 0x555cc610cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f265beb7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 0x555cc610d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f265beb7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d58070 0x555cc610d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f265beb7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f26501b20c0 con 0x555cc5d58070 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f265beb7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26501b19f0 con 0x555cc5d2f1b0 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f265beb7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26501aec50 con 0x555cc5d37390 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f265beb7740 10 client.0 _ll_register_callbacks cb 0x7f264010a500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d58070 0x555cc610d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d2f1b0 0x555cc610cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f264e7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 0x555cc610d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d2f1b0 0x555cc610cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:44436/0 (socket says 172.21.15.33:44436) 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f264f7fe640 1 -- 172.21.15.33:0/3050107741 learned_addr learned my addr 172.21.15.33:0/3050107741 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.949+0000 7f264e7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 0x555cc610d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:49556/0 (socket says 172.21.15.33:49556) 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f264e7fc640 1 -- 172.21.15.33:0/3050107741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d2f1b0 msgr2=0x555cc610cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:57.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f264e7fc640 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d2f1b0 0x555cc610cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f264e7fc640 1 -- 172.21.15.33:0/3050107741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d58070 msgr2=0x555cc610d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f264e7fc640 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d58070 0x555cc610d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f264e7fc640 1 -- 172.21.15.33:0/3050107741 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc6184680 con 0x555cc5d37390 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f264e7fc640 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 0x555cc610d400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x555cc611b1c0 tx=0x7f263800bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cbbbdf3a07a8cb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f262effd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f262effd640 1 -- 172.21.15.33:0/3050107741 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638005220 con 0x555cc5d37390 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f265beb7740 1 -- 172.21.15.33:0/3050107741 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2648020040 con 0x555cc5d37390 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f262effd640 1 -- 172.21.15.33:0/3050107741 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7f26380053c0 con 0x555cc5d37390 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f262effd640 1 -- 172.21.15.33:0/3050107741 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2638003e50 con 0x555cc5d37390 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f265beb7740 10 client.27184 fetch_fsmap learned FSMap version 28 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f265beb7740 1 -- 172.21.15.33:0/3050107741 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555cc6185960 con 0x555cc5d37390 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.950+0000 7f262effd640 1 -- 172.21.15.33:0/3050107741 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2648020040 con 0x555cc5d37390 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.951+0000 7f262effd640 1 -- 172.21.15.33:0/3050107741 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2638011690 con 0x555cc5d37390 2024-08-28T19:41:57.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.951+0000 7f265beb7740 10 client.27184 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.951+0000 7f265beb7740 10 client.27184 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.951+0000 7f265beb7740 20 client.27184 populate_metadata read hostname 'smithi033' 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.951+0000 7f265beb7740 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x555cc5cebda0 0x555cc6188150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.951+0000 7f265beb7740 4 client.27184 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.951+0000 7f265beb7740 1 -- 172.21.15.33:0/3050107741 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555cc6072070 con 0x555cc5cebda0 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.951+0000 7f264f7fe640 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x555cc5cebda0 0x555cc6188150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.951+0000 7f262effd640 10 client.27184 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.951+0000 7f264f7fe640 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x555cc5cebda0 0x555cc6188150 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2aa5480ce7a629cd server_cookie=e78c4297b4a285f0 in_seq=0 out_seq=0 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f262effd640 1 -- 172.21.15.33:0/3050107741 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555cc6072070 con 0x555cc5cebda0 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f262effd640 10 client.27184 handle_command_reply: tid=0 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 client.27184 shutdown 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 -- 172.21.15.33:0/3050107741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 msgr2=0x555cc610d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:57.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 0x555cc610d400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x555cc611b1c0 tx=0x7f263800bf70 comp rx=0 tx=0).stop 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 -- 172.21.15.33:0/3050107741 shutdown_connections 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x555cc5cebda0 0x555cc6188150 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555cc5d58070 0x555cc610d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f262effd640 0 client.27184 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cc5d37390 0x555cc610d400 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 --2- 172.21.15.33:0/3050107741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555cc5d2f1b0 0x555cc610cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 -- 172.21.15.33:0/3050107741 >> 172.21.15.33:0/3050107741 conn(0x555cc5d4c460 msgr2=0x555cc6109f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 -- 172.21.15.33:0/3050107741 shutdown_connections 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 1 -- 172.21.15.33:0/3050107741 wait complete. 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f265beb7740 20 client.27184 trim_cache size 0 max 16384 2024-08-28T19:41:57.964 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:41:57.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f2655942640 1 -- 172.21.15.33:0/3885865581 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f263c0b4ca0 msgr2=0x7f263c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:57.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.952+0000 7f2655942640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f263c0b4ca0 0x7f263c0b71b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2640103f40 tx=0x7f26400b4040 comp rx=0 tx=0).stop 2024-08-28T19:41:57.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.953+0000 7f2655942640 1 -- 172.21.15.33:0/3885865581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2650102800 msgr2=0x7f265019a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:41:57.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.953+0000 7f2655942640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2650102800 0x7f265019a270 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f264002ade0 tx=0x7f2640031770 comp rx=0 tx=0).stop 2024-08-28T19:41:57.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.953+0000 7f2655942640 1 -- 172.21.15.33:0/3885865581 shutdown_connections 2024-08-28T19:41:57.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.953+0000 7f2655942640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f263c0b4ca0 0x7f263c0b71b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.953+0000 7f2655942640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2650108a90 0x7f265019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.953+0000 7f2655942640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2650108140 0x7f265019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.953+0000 7f2655942640 1 --2- 172.21.15.33:0/3885865581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2650102800 0x7f265019a270 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:41:57.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.953+0000 7f2655942640 1 -- 172.21.15.33:0/3885865581 >> 172.21.15.33:0/3885865581 conn(0x7f26500794d0 msgr2=0x7f26501011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:41:57.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.953+0000 7f2655942640 1 -- 172.21.15.33:0/3885865581 shutdown_connections 2024-08-28T19:41:57.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:41:57.953+0000 7f2655942640 1 -- 172.21.15.33:0/3885865581 wait complete. 2024-08-28T19:41:58.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:58 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:41:58.717 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:41:58.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:58 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:41:58.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:58 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:41:59.587 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:41:59.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:59 smithi033 ceph-mon[18549]: pgmap v634: 129 pgs: 129 active+clean; 13 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-08-28T19:41:59.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:59 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:59 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:59 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:41:59 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:59 smithi059 ceph-mon[22052]: pgmap v634: 129 pgs: 129 active+clean; 13 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-08-28T19:41:59.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:59 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:59 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:59 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:41:59 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:59 smithi122 ceph-mon[22174]: pgmap v634: 129 pgs: 129 active+clean; 13 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-08-28T19:41:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:59 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:59 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:59 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:41:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:41:59 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:42:00.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.135+0000 7fb2cee9c640 1 -- 172.21.15.33:0/1406754525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2c8103900 msgr2=0x7fb2c8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.135+0000 7fb2cee9c640 1 --2- 172.21.15.33:0/1406754525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2c8103900 0x7fb2c8103d10 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009900 tx=0x7fb2b802a410 comp rx=0 tx=0).stop 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.135+0000 7fb2cee9c640 1 -- 172.21.15.33:0/1406754525 shutdown_connections 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.135+0000 7fb2cee9c640 1 --2- 172.21.15.33:0/1406754525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c8109b90 0x7fb2c81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.135+0000 7fb2cee9c640 1 --2- 172.21.15.33:0/1406754525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2c8109240 0x7fb2c8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.135+0000 7fb2cee9c640 1 --2- 172.21.15.33:0/1406754525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2c8103900 0x7fb2c8103d10 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.135+0000 7fb2cee9c640 1 -- 172.21.15.33:0/1406754525 >> 172.21.15.33:0/1406754525 conn(0x7fb2c807b5f0 msgr2=0x7fb2c807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.135+0000 7fb2cee9c640 1 -- 172.21.15.33:0/1406754525 shutdown_connections 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.135+0000 7fb2cee9c640 1 -- 172.21.15.33:0/1406754525 wait complete. 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2cee9c640 1 Processor -- start 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2cee9c640 1 -- start start 2024-08-28T19:42:00.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2cee9c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2c8103900 0x7fb2c80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2cee9c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2c8109240 0x7fb2c80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2cee9c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c8109b90 0x7fb2c8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2cee9c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c8113850 con 0x7fb2c8103900 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2cee9c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c81136d0 con 0x7fb2c8109b90 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2cee9c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c81139d0 con 0x7fb2c8109240 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2ccc38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2c8103900 0x7fb2c80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2ccc38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2c8103900 0x7fb2c80754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46058/0 (socket says 172.21.15.33:46058) 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2ccc38640 1 -- 172.21.15.33:0/2912719275 learned_addr learned my addr 172.21.15.33:0/2912719275 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2cd439640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c8109b90 0x7fb2c8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.136+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2c8109240 0x7fb2c80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2ccc38640 1 -- 172.21.15.33:0/2912719275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2c8109240 msgr2=0x7fb2c80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2c8109240 0x7fb2c80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2ccc38640 1 -- 172.21.15.33:0/2912719275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c8109b90 msgr2=0x7fb2c8075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:00.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c8109b90 0x7fb2c8075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2ccc38640 1 -- 172.21.15.33:0/2912719275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c81a8560 con 0x7fb2c8103900 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2c8103900 0x7fb2c80754b0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8005940 tx=0x7fb2b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2c5ffb640 1 -- 172.21.15.33:0/2912719275 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b803f030 con 0x7fb2c8103900 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2c5ffb640 1 -- 172.21.15.33:0/2912719275 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b8003cb0 con 0x7fb2c8103900 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2cee9c640 1 -- 172.21.15.33:0/2912719275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c81a87f0 con 0x7fb2c8103900 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2c5ffb640 1 -- 172.21.15.33:0/2912719275 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8035070 con 0x7fb2c8103900 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.137+0000 7fb2cee9c640 1 -- 172.21.15.33:0/2912719275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c81a8cd0 con 0x7fb2c8103900 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2c5ffb640 1 -- 172.21.15.33:0/2912719275 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb2b8042030 con 0x7fb2c8103900 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2d5411740 1 Processor -- start 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2d5411740 1 -- start start 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d37f4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 0x55b4d37f4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2d5411740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b4d376b680 con 0x55b4d342e390 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2d5411740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b4d375ac10 con 0x55b4d344f070 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2d5411740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b4d375ebc0 con 0x55b4d34261b0 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2cd439640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d37f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.140+0000 7fb2c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2cd439640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d37f4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:53500/0 (socket says 172.21.15.33:53500) 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2cd439640 1 -- 172.21.15.33:0/2245003124 learned_addr learned my addr 172.21.15.33:0/2245003124 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2c5ffb640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2b00b4ca0 0x7fb2b00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/2245003124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 0x55b4d37f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2cd439640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2b00b4ca0 0x7fb2b00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2c7fff640 1 -- 172.21.15.33:0/2245003124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 msgr2=0x55b4d37f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/2245003124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 0x55b4d37f4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2c7fff640 1 -- 172.21.15.33:0/2245003124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 msgr2=0x55b4d37f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:00.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/2245003124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d37f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2c7fff640 1 -- 172.21.15.33:0/2245003124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4d34ba650 con 0x55b4d342e390 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2c5ffb640 1 -- 172.21.15.33:0/2912719275 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fb2b8106250 con 0x7fb2c8103900 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/2245003124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37f4d90 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0058c0 tx=0x7fb2bc00e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806bdd3e5166fd31 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2aeffd640 1 -- 172.21.15.33:0/2245003124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc004020 con 0x55b4d342e390 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2aeffd640 1 -- 172.21.15.33:0/2245003124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2bc0041c0 con 0x55b4d342e390 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.141+0000 7fb2aeffd640 1 -- 172.21.15.33:0/2245003124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc010670 con 0x55b4d342e390 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.142+0000 7fb2d5411740 1 -- 172.21.15.33:0/2245003124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 msgr2=0x55b4d37f4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.142+0000 7fb2d5411740 1 --2- 172.21.15.33:0/2245003124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37f4d90 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0058c0 tx=0x7fb2bc00e350 comp rx=0 tx=0).stop 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.142+0000 7fb2cd439640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2b00b4ca0 0x7fb2b00b71b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009370 tx=0x7fb2c0004ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.142+0000 7fb2d5411740 1 -- 172.21.15.33:0/2245003124 shutdown_connections 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.142+0000 7fb2d5411740 1 --2- 172.21.15.33:0/2245003124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37f4d90 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.142+0000 7fb2d5411740 1 --2- 172.21.15.33:0/2245003124 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 0x55b4d37f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.142+0000 7fb2d5411740 1 --2- 172.21.15.33:0/2245003124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d37f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.142+0000 7fb2d5411740 1 -- 172.21.15.33:0/2245003124 >> 172.21.15.33:0/2245003124 conn(0x55b4d3443460 msgr2=0x55b4d37f2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.142+0000 7fb2d5411740 1 -- 172.21.15.33:0/2245003124 shutdown_connections 2024-08-28T19:42:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.142+0000 7fb2d5411740 1 -- 172.21.15.33:0/2245003124 wait complete. 2024-08-28T19:42:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.143+0000 7fb2d5411740 1 -- start start 2024-08-28T19:42:00.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.143+0000 7fb2d5411740 1 Processor -- start 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.143+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d34261b0 0x55b4d37ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.143+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 0x55b4d37fff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.143+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d344f070 0x55b4d380bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.143+0000 7fb2d5411740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b4d35bd700 con 0x55b4d344f070 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.143+0000 7fb2d5411740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b4d36e1750 con 0x55b4d34261b0 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.143+0000 7fb2d5411740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b4d3802af0 con 0x55b4d342e390 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2d5411740 10 client.0 _ll_register_callbacks cb 0x55b4d3710e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2cd439640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d344f070 0x55b4d380bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2cd439640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d344f070 0x55b4d380bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46084/0 (socket says 172.21.15.33:46084) 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2cd439640 1 -- 172.21.15.33:0/1132191163 learned_addr learned my addr 172.21.15.33:0/1132191163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d34261b0 0x55b4d37ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 0x55b4d37fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2cd439640 1 -- 172.21.15.33:0/1132191163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 msgr2=0x55b4d37fff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2cd439640 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 0x55b4d37fff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2cd439640 1 -- 172.21.15.33:0/1132191163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d34261b0 msgr2=0x55b4d37ffa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2cd439640 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d34261b0 0x55b4d37ffa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2cd439640 1 -- 172.21.15.33:0/1132191163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4d371a900 con 0x55b4d344f070 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d34261b0 0x55b4d37ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2cd439640 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d344f070 0x55b4d380bde0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0011b80 tx=0x7fb2c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf090b96d9c96af server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1132191163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0024070 con 0x55b4d344f070 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1132191163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fb2c0010c10 con 0x55b4d344f070 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.144+0000 7fb2d5411740 1 -- 172.21.15.33:0/1132191163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2bc0041c0 con 0x55b4d344f070 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1132191163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb2c0019070 con 0x55b4d344f070 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2d5411740 10 client.18198 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2d5411740 1 -- 172.21.15.33:0/1132191163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4d380e8c0 con 0x55b4d344f070 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1132191163 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2bc0041c0 con 0x55b4d344f070 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1132191163 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb2c00123f0 con 0x55b4d344f070 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2d5411740 10 client.18198 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2d5411740 10 client.18198 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2d5411740 20 client.18198 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55b4d340d9f0 0x55b4d3811de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2d5411740 4 client.18198 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2d5411740 1 -- 172.21.15.33:0/1132191163 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4d376d5d0 con 0x55b4d340d9f0 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.145+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55b4d340d9f0 0x55b4d3811de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.146+0000 7fb2a7fff640 10 client.18198 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.146+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55b4d340d9f0 0x55b4d3811de0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=87ada72a94bf6880 server_cookie=d1dda7c096ed66e7 in_seq=0 out_seq=0 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.146+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1132191163 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4d376d5d0 con 0x55b4d340d9f0 2024-08-28T19:42:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.146+0000 7fb2a7fff640 10 client.18198 handle_command_reply: tid=0 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 client.18198 shutdown 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 -- 172.21.15.33:0/1132191163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d344f070 msgr2=0x55b4d380bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d344f070 0x55b4d380bde0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0011b80 tx=0x7fb2c0004a40 comp rx=0 tx=0).stop 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 -- 172.21.15.33:0/1132191163 shutdown_connections 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55b4d340d9f0 0x55b4d3811de0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d344f070 0x55b4d380bde0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 0x55b4d37fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1132191163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d34261b0 0x55b4d37ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 -- 172.21.15.33:0/1132191163 >> 172.21.15.33:0/1132191163 conn(0x55b4d3443460 msgr2=0x55b4d37f74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2a7fff640 0 client.18198 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 -- 172.21.15.33:0/1132191163 shutdown_connections 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 1 -- 172.21.15.33:0/1132191163 wait complete. 2024-08-28T19:42:00.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.147+0000 7fb2d5411740 20 client.18198 trim_cache size 0 max 16384 2024-08-28T19:42:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.162+0000 7fb2d5411740 1 Processor -- start 2024-08-28T19:42:00.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.162+0000 7fb2d5411740 1 -- start start 2024-08-28T19:42:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.162+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 0x55b4d37ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.162+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.162+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d37f7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.162+0000 7fb2d5411740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c81b2ec0 con 0x55b4d342e390 2024-08-28T19:42:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.162+0000 7fb2d5411740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c81b4a00 con 0x55b4d344f070 2024-08-28T19:42:00.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.162+0000 7fb2d5411740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c81b3590 con 0x55b4d34261b0 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2ccc38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 0x55b4d37ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2ccc38640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 0x55b4d37ff7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:44194/0 (socket says 172.21.15.33:44194) 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2c7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37ffd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46100/0 (socket says 172.21.15.33:46100) 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2ccc38640 1 -- 172.21.15.33:0/4137148456 learned_addr learned my addr 172.21.15.33:0/4137148456 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2cd439640 1 --2- 172.21.15.33:0/4137148456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d37f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2c7fff640 1 -- 172.21.15.33:0/4137148456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 msgr2=0x55b4d37ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/4137148456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 0x55b4d37ff7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2c7fff640 1 -- 172.21.15.33:0/4137148456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 msgr2=0x55b4d37f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/4137148456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d37f7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2c7fff640 1 -- 172.21.15.33:0/4137148456 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4d380c580 con 0x55b4d342e390 2024-08-28T19:42:00.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/4137148456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 0x55b4d37ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2cd439640 1 --2- 172.21.15.33:0/4137148456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d37f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/4137148456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37ffd20 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc003e90 tx=0x7fb2bc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860bbf3ec26466 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2ae7fc640 1 -- 172.21.15.33:0/4137148456 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc02b070 con 0x55b4d342e390 2024-08-28T19:42:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2ae7fc640 1 -- 172.21.15.33:0/4137148456 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2bc00ee60 con 0x55b4d342e390 2024-08-28T19:42:00.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.163+0000 7fb2ae7fc640 1 -- 172.21.15.33:0/4137148456 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0038e0 con 0x55b4d342e390 2024-08-28T19:42:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.164+0000 7fb2d5411740 1 -- 172.21.15.33:0/4137148456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 msgr2=0x55b4d37ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.164+0000 7fb2d5411740 1 --2- 172.21.15.33:0/4137148456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37ffd20 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc003e90 tx=0x7fb2bc00ed70 comp rx=0 tx=0).stop 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.164+0000 7fb2d5411740 1 -- 172.21.15.33:0/4137148456 shutdown_connections 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.164+0000 7fb2d5411740 1 --2- 172.21.15.33:0/4137148456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d37f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.164+0000 7fb2d5411740 1 --2- 172.21.15.33:0/4137148456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d342e390 0x55b4d37ffd20 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.164+0000 7fb2d5411740 1 --2- 172.21.15.33:0/4137148456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d34261b0 0x55b4d37ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.164+0000 7fb2d5411740 1 -- 172.21.15.33:0/4137148456 >> 172.21.15.33:0/4137148456 conn(0x55b4d3443460 msgr2=0x55b4d37fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.164+0000 7fb2d5411740 1 -- 172.21.15.33:0/4137148456 shutdown_connections 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.165+0000 7fb2d5411740 1 -- 172.21.15.33:0/4137148456 wait complete. 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.165+0000 7fb2d5411740 1 -- start start 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.165+0000 7fb2d5411740 1 Processor -- start 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.165+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d34261b0 0x55b4d3808250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.165+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 0x55b4d3803750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.165+0000 7fb2d5411740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d3803c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.165+0000 7fb2d5411740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c81b4330 con 0x55b4d34261b0 2024-08-28T19:42:00.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.165+0000 7fb2d5411740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c81b3c60 con 0x55b4d344f070 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.165+0000 7fb2d5411740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c81b0ec0 con 0x55b4d342e390 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2d5411740 10 client.0 _ll_register_callbacks cb 0x7fb2c00092c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2ccc38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d34261b0 0x55b4d3808250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2cd439640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d3803c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2ccc38640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d34261b0 0x55b4d3808250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46106/0 (socket says 172.21.15.33:46106) 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2cd439640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d3803c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:53518/0 (socket says 172.21.15.33:53518) 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2ccc38640 1 -- 172.21.15.33:0/1616852689 learned_addr learned my addr 172.21.15.33:0/1616852689 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 0x55b4d3803750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2c7fff640 1 -- 172.21.15.33:0/1616852689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 msgr2=0x55b4d3803c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d3803c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2c7fff640 1 -- 172.21.15.33:0/1616852689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d34261b0 msgr2=0x55b4d3808250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d34261b0 0x55b4d3808250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2c7fff640 1 -- 172.21.15.33:0/1616852689 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4d38041d0 con 0x55b4d342e390 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2cd439640 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d3803c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d34261b0 0x55b4d3808250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2c7fff640 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 0x55b4d3803750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00e390 tx=0x7fb2bc004520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1311e340aa76075b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.166+0000 7fb2a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1616852689 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc034060 con 0x55b4d342e390 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1616852689 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fb2bc005230 con 0x55b4d342e390 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2d5411740 1 -- 172.21.15.33:0/1616852689 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2bc00ee60 con 0x55b4d342e390 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1616852689 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb2bc03b050 con 0x55b4d342e390 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2d5411740 10 client.27199 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2d5411740 1 -- 172.21.15.33:0/1616852689 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b4d387c400 con 0x55b4d342e390 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1616852689 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2bc00ee60 con 0x55b4d342e390 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1616852689 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb2bc004760 con 0x55b4d342e390 2024-08-28T19:42:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2d5411740 10 client.27199 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2d5411740 10 client.27199 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2d5411740 20 client.27199 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55b4d33e2da0 0x55b4d387e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2d5411740 4 client.27199 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.167+0000 7fb2d5411740 1 -- 172.21.15.33:0/1616852689 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b4d3769070 con 0x55b4d33e2da0 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55b4d33e2da0 0x55b4d387e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2a7fff640 10 client.27199 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2ccc38640 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55b4d33e2da0 0x55b4d387e880 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=64f8a51e6c600622 server_cookie=481a25a4b8d35f9b in_seq=0 out_seq=0 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2a7fff640 1 -- 172.21.15.33:0/1616852689 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b4d3769070 con 0x55b4d33e2da0 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2a7fff640 10 client.27199 handle_command_reply: tid=0 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2d5411740 1 client.27199 shutdown 2024-08-28T19:42:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2d5411740 1 -- 172.21.15.33:0/1616852689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 msgr2=0x55b4d3803750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 0x55b4d3803750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00e390 tx=0x7fb2bc004520 comp rx=0 tx=0).stop 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2d5411740 1 -- 172.21.15.33:0/1616852689 shutdown_connections 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55b4d33e2da0 0x55b4d387e880 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b4d344f070 0x55b4d3803c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4d342e390 0x55b4d3803750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2d5411740 1 --2- 172.21.15.33:0/1616852689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b4d34261b0 0x55b4d3808250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2d5411740 1 -- 172.21.15.33:0/1616852689 >> 172.21.15.33:0/1616852689 conn(0x55b4d3443460 msgr2=0x55b4d37ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.168+0000 7fb2a7fff640 0 client.27199 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.169+0000 7fb2d5411740 1 -- 172.21.15.33:0/1616852689 shutdown_connections 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.169+0000 7fb2d5411740 1 -- 172.21.15.33:0/1616852689 wait complete. 2024-08-28T19:42:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.169+0000 7fb2d5411740 20 client.27199 trim_cache size 0 max 16384 2024-08-28T19:42:00.175 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:42:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.169+0000 7fb2cee9c640 1 -- 172.21.15.33:0/2912719275 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2b00b4ca0 msgr2=0x7fb2b00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.169+0000 7fb2cee9c640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2b00b4ca0 0x7fb2b00b71b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009370 tx=0x7fb2c0004ab0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.169+0000 7fb2cee9c640 1 -- 172.21.15.33:0/2912719275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2c8103900 msgr2=0x7fb2c80754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.169+0000 7fb2cee9c640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2c8103900 0x7fb2c80754b0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8005940 tx=0x7fb2b80042f0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.169+0000 7fb2cee9c640 1 -- 172.21.15.33:0/2912719275 shutdown_connections 2024-08-28T19:42:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.169+0000 7fb2cee9c640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2c8109b90 0x7fb2c8075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.170+0000 7fb2cee9c640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2b00b4ca0 0x7fb2b00b71b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.170+0000 7fb2cee9c640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb2c8109240 0x7fb2c80759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.170+0000 7fb2cee9c640 1 --2- 172.21.15.33:0/2912719275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2c8103900 0x7fb2c80754b0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.170+0000 7fb2cee9c640 1 -- 172.21.15.33:0/2912719275 >> 172.21.15.33:0/2912719275 conn(0x7fb2c807b5f0 msgr2=0x7fb2c8107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.170+0000 7fb2cee9c640 1 -- 172.21.15.33:0/2912719275 shutdown_connections 2024-08-28T19:42:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:00.170+0000 7fb2cee9c640 1 -- 172.21.15.33:0/2912719275 wait complete. 2024-08-28T19:42:00.950 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:42:01.222 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:01.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:01 smithi033 ceph-mon[18549]: pgmap v635: 129 pgs: 129 active+clean; 13 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-08-28T19:42:01.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:01 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:42:01.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:01 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:42:01.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.732+0000 7fc9f0048640 1 -- 172.21.15.33:0/1391998199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e8108a90 msgr2=0x7fc9e810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:01.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.732+0000 7fc9f0048640 1 --2- 172.21.15.33:0/1391998199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e8108a90 0x7fc9e810f2c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009ca0 tx=0x7fc9e002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.732+0000 7fc9f0048640 1 -- 172.21.15.33:0/1391998199 shutdown_connections 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.732+0000 7fc9f0048640 1 --2- 172.21.15.33:0/1391998199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e8108a90 0x7fc9e810f2c0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.732+0000 7fc9f0048640 1 --2- 172.21.15.33:0/1391998199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e8108140 0x7fc9e8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.732+0000 7fc9f0048640 1 --2- 172.21.15.33:0/1391998199 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9e8102800 0x7fc9e8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.732+0000 7fc9f0048640 1 -- 172.21.15.33:0/1391998199 >> 172.21.15.33:0/1391998199 conn(0x7fc9e80794d0 msgr2=0x7fc9e80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.732+0000 7fc9f0048640 1 -- 172.21.15.33:0/1391998199 shutdown_connections 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.732+0000 7fc9f0048640 1 -- 172.21.15.33:0/1391998199 wait complete. 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.733+0000 7fc9f0048640 1 Processor -- start 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.733+0000 7fc9f0048640 1 -- start start 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.733+0000 7fc9f0048640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e8102800 0x7fc9e819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.733+0000 7fc9f0048640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9e8108140 0x7fc9e819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.733+0000 7fc9f0048640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e8108a90 0x7fc9e81a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.733+0000 7fc9f0048640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e8115a70 con 0x7fc9e8108a90 2024-08-28T19:42:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9f0048640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e81158f0 con 0x7fc9e8102800 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9f0048640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e8115bf0 con 0x7fc9e8108140 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9ee5e5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e8108a90 0x7fc9e81a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9ee5e5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e8108a90 0x7fc9e81a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46122/0 (socket says 172.21.15.33:46122) 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9ee5e5640 1 -- 172.21.15.33:0/2301729819 learned_addr learned my addr 172.21.15.33:0/2301729819 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9edde4640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e8102800 0x7fc9e819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9e8108140 0x7fc9e819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9ee5e5640 1 -- 172.21.15.33:0/2301729819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9e8108140 msgr2=0x7fc9e819ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9ee5e5640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9e8108140 0x7fc9e819ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9ee5e5640 1 -- 172.21.15.33:0/2301729819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e8102800 msgr2=0x7fc9e819c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9ee5e5640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e8102800 0x7fc9e819c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9ee5e5640 1 -- 172.21.15.33:0/2301729819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e81a23f0 con 0x7fc9e8108a90 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9ee5e5640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e8108a90 0x7fc9e81a1cc0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0005cc0 tx=0x7fc9e002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:01.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9deffd640 1 -- 172.21.15.33:0/2301729819 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0003bf0 con 0x7fc9e8108a90 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9deffd640 1 -- 172.21.15.33:0/2301729819 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e0003d90 con 0x7fc9e8108a90 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9f0048640 1 -- 172.21.15.33:0/2301729819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e81a2680 con 0x7fc9e8108a90 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.734+0000 7fc9deffd640 1 -- 172.21.15.33:0/2301729819 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e002fb20 con 0x7fc9e8108a90 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.735+0000 7fc9f0048640 1 -- 172.21.15.33:0/2301729819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e81a8e40 con 0x7fc9e8108a90 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.737+0000 7fc9f65bd740 1 Processor -- start 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.737+0000 7fc9deffd640 1 -- 172.21.15.33:0/2301729819 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc9e0004580 con 0x7fc9e8108a90 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.737+0000 7fc9f65bd740 1 -- start start 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd51707070 0x55cd51aac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 0x55cd51aacd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cd51a23680 con 0x55cd516de1b0 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cd51a12c10 con 0x55cd51707070 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cd51a16bc0 con 0x55cd516e6390 2024-08-28T19:42:01.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9edde4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9edde4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aac850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46128/0 (socket says 172.21.15.33:46128) 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9edde4640 1 -- 172.21.15.33:0/3106969962 learned_addr learned my addr 172.21.15.33:0/3106969962 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/3106969962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd51707070 0x55cd51aac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/3106969962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 0x55cd51aacd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9deffd640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9d40b4c90 0x7fc9d40b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9edde4640 1 -- 172.21.15.33:0/3106969962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 msgr2=0x55cd51aacd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9edde4640 1 --2- 172.21.15.33:0/3106969962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 0x55cd51aacd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9edde4640 1 -- 172.21.15.33:0/3106969962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd51707070 msgr2=0x55cd51aac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9edde4640 1 --2- 172.21.15.33:0/3106969962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd51707070 0x55cd51aac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9edde4640 1 -- 172.21.15.33:0/3106969962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd51772650 con 0x55cd516de1b0 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9deffd640 1 -- 172.21.15.33:0/2301729819 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fc9e0106cb0 con 0x7fc9e8108a90 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9edde4640 1 --2- 172.21.15.33:0/3106969962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aac850 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009a70 tx=0x7fc9e4009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c6d5e8e8f2789b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.738+0000 7fc9ee5e5640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9d40b4c90 0x7fc9d40b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.739+0000 7fc9d3fff640 1 -- 172.21.15.33:0/3106969962 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4017070 con 0x55cd516de1b0 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.739+0000 7fc9d3fff640 1 -- 172.21.15.33:0/3106969962 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e4013470 con 0x55cd516de1b0 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.739+0000 7fc9d3fff640 1 -- 172.21.15.33:0/3106969962 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e40125d0 con 0x55cd516de1b0 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3106969962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 msgr2=0x55cd51aac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9ee5e5640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9d40b4c90 0x7fc9d40b71a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0006010 tx=0x7fc9e0004870 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3106969962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aac850 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009a70 tx=0x7fc9e4009f30 comp rx=0 tx=0).stop 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3106969962 shutdown_connections 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3106969962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 0x55cd51aacd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3106969962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aac850 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3106969962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd51707070 0x55cd51aac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3106969962 >> 172.21.15.33:0/3106969962 conn(0x55cd516fb460 msgr2=0x55cd51aaa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3106969962 shutdown_connections 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3106969962 wait complete. 2024-08-28T19:42:01.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 -- start start 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.740+0000 7fc9f65bd740 1 Processor -- start 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516de1b0 0x55cd51ab7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516e6390 0x55cd51ab7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd51707070 0x55cd51ac3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cd51875700 con 0x55cd516e6390 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cd51999750 con 0x55cd516de1b0 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cd51abaaf0 con 0x55cd51707070 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9f65bd740 10 client.0 _ll_register_callbacks cb 0x55cd519c8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9edde4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516e6390 0x55cd51ab7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9edde4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516e6390 0x55cd51ab7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46140/0 (socket says 172.21.15.33:46140) 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9edde4640 1 -- 172.21.15.33:0/3979760324 learned_addr learned my addr 172.21.15.33:0/3979760324 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516de1b0 0x55cd51ab7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd51707070 0x55cd51ac3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9edde4640 1 -- 172.21.15.33:0/3979760324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd51707070 msgr2=0x55cd51ac3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9edde4640 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd51707070 0x55cd51ac3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9edde4640 1 -- 172.21.15.33:0/3979760324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516de1b0 msgr2=0x55cd51ab7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9edde4640 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516de1b0 0x55cd51ab7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9edde4640 1 -- 172.21.15.33:0/3979760324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd519d2900 con 0x55cd516e6390 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9edde4640 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516e6390 0x55cd51ab7fc0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4010010 tx=0x7fc9e400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70813300227379a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.741+0000 7fc9d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9d17fa640 1 -- 172.21.15.33:0/3979760324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4017040 con 0x55cd516e6390 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9d17fa640 1 -- 172.21.15.33:0/3979760324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fc9e401c450 con 0x55cd516e6390 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3979760324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e4013470 con 0x55cd516e6390 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9d17fa640 1 -- 172.21.15.33:0/3979760324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc9e401c650 con 0x55cd516e6390 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9f65bd740 10 client.18216 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3979760324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd51ac68c0 con 0x55cd516e6390 2024-08-28T19:42:01.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9d17fa640 1 -- 172.21.15.33:0/3979760324 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e4013470 con 0x55cd516e6390 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9d17fa640 1 -- 172.21.15.33:0/3979760324 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc9e4026910 con 0x55cd516e6390 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9f65bd740 10 client.18216 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9f65bd740 10 client.18216 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9f65bd740 20 client.18216 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55cd516c59f0 0x55cd51ac9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9f65bd740 4 client.18216 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.742+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3979760324 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd51a255d0 con 0x55cd516c59f0 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.743+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55cd516c59f0 0x55cd51ac9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.743+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55cd516c59f0 0x55cd51ac9c20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e356b3d59519f78b server_cookie=a2ee3e0a029fc135 in_seq=0 out_seq=0 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.743+0000 7fc9d17fa640 10 client.18216 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9d17fa640 1 -- 172.21.15.33:0/3979760324 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd51a255d0 con 0x55cd516c59f0 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9d17fa640 10 client.18216 handle_command_reply: tid=0 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9f65bd740 1 client.18216 shutdown 2024-08-28T19:42:01.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3979760324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516e6390 msgr2=0x55cd51ab7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516e6390 0x55cd51ab7fc0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4010010 tx=0x7fc9e400ed70 comp rx=0 tx=0).stop 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3979760324 shutdown_connections 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd51707070 0x55cd51ac3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55cd516c59f0 0x55cd51ac9c20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516e6390 0x55cd51ab7fc0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3979760324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516de1b0 0x55cd51ab7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3979760324 >> 172.21.15.33:0/3979760324 conn(0x55cd516fb460 msgr2=0x55cd51aaf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.744+0000 7fc9d17fa640 0 client.18216 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.745+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3979760324 shutdown_connections 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.745+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3979760324 wait complete. 2024-08-28T19:42:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.745+0000 7fc9f65bd740 20 client.18216 trim_cache size 0 max 16384 2024-08-28T19:42:01.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.758+0000 7fc9f65bd740 1 Processor -- start 2024-08-28T19:42:01.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.758+0000 7fc9f65bd740 1 -- start start 2024-08-28T19:42:01.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aaf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516e6390 0x55cd51aaf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd51707070 0x55cd51ab4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e81b2e70 con 0x55cd516de1b0 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e81b49b0 con 0x55cd516e6390 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e81b3540 con 0x55cd51707070 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9ed5e3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aaf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9ed5e3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aaf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46154/0 (socket says 172.21.15.33:46154) 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9ed5e3640 1 -- 172.21.15.33:0/3309164930 learned_addr learned my addr 172.21.15.33:0/3309164930 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9edde4640 1 --2- 172.21.15.33:0/3309164930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516e6390 0x55cd51aaf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/3309164930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd51707070 0x55cd51ab4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9ed5e3640 1 -- 172.21.15.33:0/3309164930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd51707070 msgr2=0x55cd51ab4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:01.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/3309164930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd51707070 0x55cd51ab4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9ed5e3640 1 -- 172.21.15.33:0/3309164930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516e6390 msgr2=0x55cd51aaf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:01.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/3309164930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516e6390 0x55cd51aaf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9ed5e3640 1 -- 172.21.15.33:0/3309164930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd51aa55a0 con 0x55cd516de1b0 2024-08-28T19:42:01.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.759+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/3309164930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aaf410 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8107880 tx=0x7fc9d800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9531fbf1b61d71 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:01.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.760+0000 7fc9d37fe640 1 -- 172.21.15.33:0/3309164930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8014be0 con 0x55cd516de1b0 2024-08-28T19:42:01.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.760+0000 7fc9d37fe640 1 -- 172.21.15.33:0/3309164930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9d8014d80 con 0x55cd516de1b0 2024-08-28T19:42:01.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.760+0000 7fc9d37fe640 1 -- 172.21.15.33:0/3309164930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8017170 con 0x55cd516de1b0 2024-08-28T19:42:01.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3309164930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 msgr2=0x55cd51aaf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:01.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3309164930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aaf410 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8107880 tx=0x7fc9d800cbf0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3309164930 shutdown_connections 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3309164930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd51707070 0x55cd51ab4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3309164930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516e6390 0x55cd51aaf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/3309164930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd516de1b0 0x55cd51aaf410 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3309164930 >> 172.21.15.33:0/3309164930 conn(0x55cd516fb460 msgr2=0x55cd51ab6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3309164930 shutdown_connections 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 -- 172.21.15.33:0/3309164930 wait complete. 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 -- start start 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.761+0000 7fc9f65bd740 1 Processor -- start 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516de1b0 0x55cd51abc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 0x55cd51abc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9f65bd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd51707070 0x55cd51b33480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e81b42e0 con 0x55cd51707070 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e81b3c10 con 0x55cd516de1b0 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9f65bd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e81b0e70 con 0x55cd516e6390 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9f65bd740 10 client.0 _ll_register_callbacks cb 0x7fc9d800ca90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9ed5e3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd51707070 0x55cd51b33480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9ed5e3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd51707070 0x55cd51b33480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46168/0 (socket says 172.21.15.33:46168) 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9edde4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 0x55cd51abc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9ed5e3640 1 -- 172.21.15.33:0/2232243588 learned_addr learned my addr 172.21.15.33:0/2232243588 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516de1b0 0x55cd51abc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9edde4640 1 -- 172.21.15.33:0/2232243588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516de1b0 msgr2=0x55cd51abc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9edde4640 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516de1b0 0x55cd51abc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9edde4640 1 -- 172.21.15.33:0/2232243588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd51707070 msgr2=0x55cd51b33480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9edde4640 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd51707070 0x55cd51b33480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9edde4640 1 -- 172.21.15.33:0/2232243588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd51b339c0 con 0x55cd516e6390 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd51707070 0x55cd51b33480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9edde4640 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 0x55cd51abc9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009a70 tx=0x7fc9e401ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f9dc3753ede011 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.762+0000 7fc9d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9d17fa640 1 -- 172.21.15.33:0/2232243588 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4013470 con 0x55cd516e6390 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9f65bd740 1 -- 172.21.15.33:0/2232243588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9d8014d80 con 0x55cd516e6390 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9d17fa640 1 -- 172.21.15.33:0/2232243588 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7fc9e401c450 con 0x55cd516e6390 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9d17fa640 1 -- 172.21.15.33:0/2232243588 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc9e40059c0 con 0x55cd516e6390 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9f65bd740 10 client.27214 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9f65bd740 1 -- 172.21.15.33:0/2232243588 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd51b34c10 con 0x55cd516e6390 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9d17fa640 1 -- 172.21.15.33:0/2232243588 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9d8014d80 con 0x55cd516e6390 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9d17fa640 1 -- 172.21.15.33:0/2232243588 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc9e40268a0 con 0x55cd516e6390 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9f65bd740 10 client.27214 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9f65bd740 10 client.27214 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:42:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9f65bd740 20 client.27214 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55cd5169ada0 0x55cd51b37230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9f65bd740 4 client.27214 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.763+0000 7fc9f65bd740 1 -- 172.21.15.33:0/2232243588 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd51a21070 con 0x55cd5169ada0 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.764+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55cd5169ada0 0x55cd51b37230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.764+0000 7fc9d17fa640 10 client.27214 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.764+0000 7fc9ed5e3640 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55cd5169ada0 0x55cd51b37230 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1e5e61e71399885 server_cookie=c4c27d0466348978 in_seq=0 out_seq=0 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.764+0000 7fc9d17fa640 1 -- 172.21.15.33:0/2232243588 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd51a21070 con 0x55cd5169ada0 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.764+0000 7fc9d17fa640 10 client.27214 handle_command_reply: tid=0 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.764+0000 7fc9f65bd740 1 client.27214 shutdown 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.764+0000 7fc9f65bd740 1 -- 172.21.15.33:0/2232243588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 msgr2=0x55cd51abc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.764+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 0x55cd51abc9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009a70 tx=0x7fc9e401ca20 comp rx=0 tx=0).stop 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f65bd740 1 -- 172.21.15.33:0/2232243588 shutdown_connections 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55cd5169ada0 0x55cd51b37230 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd51707070 0x55cd51b33480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd516e6390 0x55cd51abc9c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9d17fa640 0 client.27214 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:42:01.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f65bd740 1 --2- 172.21.15.33:0/2232243588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd516de1b0 0x55cd51abc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f65bd740 1 -- 172.21.15.33:0/2232243588 >> 172.21.15.33:0/2232243588 conn(0x55cd516fb460 msgr2=0x55cd51aaf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:01.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f65bd740 1 -- 172.21.15.33:0/2232243588 shutdown_connections 2024-08-28T19:42:01.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f65bd740 1 -- 172.21.15.33:0/2232243588 wait complete. 2024-08-28T19:42:01.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f65bd740 20 client.27214 trim_cache size 0 max 16384 2024-08-28T19:42:01.770 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 -- 172.21.15.33:0/2301729819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9d40b4c90 msgr2=0x7fc9d40b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9d40b4c90 0x7fc9d40b71a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0006010 tx=0x7fc9e0004870 comp rx=0 tx=0).stop 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 -- 172.21.15.33:0/2301729819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e8108a90 msgr2=0x7fc9e81a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e8108a90 0x7fc9e81a1cc0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0005cc0 tx=0x7fc9e002f380 comp rx=0 tx=0).stop 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 -- 172.21.15.33:0/2301729819 shutdown_connections 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9e8108a90 0x7fc9e81a1cc0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc9d40b4c90 0x7fc9d40b71a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc9e8108140 0x7fc9e819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 --2- 172.21.15.33:0/2301729819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e8102800 0x7fc9e819c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 -- 172.21.15.33:0/2301729819 >> 172.21.15.33:0/2301729819 conn(0x7fc9e80794d0 msgr2=0x7fc9e8105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.765+0000 7fc9f0048640 1 -- 172.21.15.33:0/2301729819 shutdown_connections 2024-08-28T19:42:01.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:01.766+0000 7fc9f0048640 1 -- 172.21.15.33:0/2301729819 wait complete. 2024-08-28T19:42:01.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:01 smithi059 ceph-mon[22052]: pgmap v635: 129 pgs: 129 active+clean; 13 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-08-28T19:42:01.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:01 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:42:01.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:01 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:42:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:01 smithi122 ceph-mon[22174]: pgmap v635: 129 pgs: 129 active+clean; 13 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-08-28T19:42:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:01 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:42:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:01 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:42:02.645 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:42:02.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:42:02.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:42:02.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:42:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:42:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:42:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:42:02.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:42:02.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:42:02.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:42:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:03.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:03 smithi033 ceph-mon[18549]: pgmap v636: 129 pgs: 129 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-08-28T19:42:03.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.565+0000 7efd75e50640 1 -- 172.21.15.33:0/3906862975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd70102800 msgr2=0x7efd70102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:03.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.565+0000 7efd75e50640 1 --2- 172.21.15.33:0/3906862975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd70102800 0x7efd70102c10 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7efd60009900 tx=0x7efd6002a410 comp rx=0 tx=0).stop 2024-08-28T19:42:03.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.565+0000 7efd75e50640 1 -- 172.21.15.33:0/3906862975 shutdown_connections 2024-08-28T19:42:03.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.565+0000 7efd75e50640 1 --2- 172.21.15.33:0/3906862975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd70108a90 0x7efd7010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.566+0000 7efd75e50640 1 --2- 172.21.15.33:0/3906862975 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd70108140 0x7efd70108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.566+0000 7efd75e50640 1 --2- 172.21.15.33:0/3906862975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd70102800 0x7efd70102c10 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.566+0000 7efd75e50640 1 -- 172.21.15.33:0/3906862975 >> 172.21.15.33:0/3906862975 conn(0x7efd700794d0 msgr2=0x7efd700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.566+0000 7efd75e50640 1 -- 172.21.15.33:0/3906862975 shutdown_connections 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.566+0000 7efd75e50640 1 -- 172.21.15.33:0/3906862975 wait complete. 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.566+0000 7efd75e50640 1 Processor -- start 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.566+0000 7efd75e50640 1 -- start start 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd75e50640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd70102800 0x7efd7019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd75e50640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd70108140 0x7efd7019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd75e50640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd70108a90 0x7efd7019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd75e50640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd70113820 con 0x7efd70108a90 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd75e50640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd701136a0 con 0x7efd70108140 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd75e50640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efd701139a0 con 0x7efd70102800 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd70108a90 0x7efd7019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd70108a90 0x7efd7019fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46186/0 (socket says 172.21.15.33:46186) 2024-08-28T19:42:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6ffff640 1 -- 172.21.15.33:0/3714942877 learned_addr learned my addr 172.21.15.33:0/3714942877 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6effd640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd70108140 0x7efd7019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd70102800 0x7efd7019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6ffff640 1 -- 172.21.15.33:0/3714942877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd70102800 msgr2=0x7efd7019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6ffff640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd70102800 0x7efd7019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6ffff640 1 -- 172.21.15.33:0/3714942877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd70108140 msgr2=0x7efd7019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6ffff640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd70108140 0x7efd7019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6ffff640 1 -- 172.21.15.33:0/3714942877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd701a01a0 con 0x7efd70108a90 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6effd640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd70108140 0x7efd7019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6ffff640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd70108a90 0x7efd7019fa70 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7efd68009fd0 tx=0x7efd6800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6cff9640 1 -- 172.21.15.33:0/3714942877 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68017070 con 0x7efd70108a90 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd75e50640 1 -- 172.21.15.33:0/3714942877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd701a0490 con 0x7efd70108a90 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.567+0000 7efd6cff9640 1 -- 172.21.15.33:0/3714942877 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd68003e20 con 0x7efd70108a90 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.568+0000 7efd6cff9640 1 -- 172.21.15.33:0/3714942877 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68010460 con 0x7efd70108a90 2024-08-28T19:42:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.568+0000 7efd75e50640 1 -- 172.21.15.33:0/3714942877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd701a6bf0 con 0x7efd70108a90 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.570+0000 7efd6cff9640 1 -- 172.21.15.33:0/3714942877 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7efd68003970 con 0x7efd70108a90 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.570+0000 7efd7c3c5740 1 Processor -- start 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.570+0000 7efd7c3c5740 1 -- start start 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a717070 0x55924aabc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6ee1b0 0x55924aabc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6f6390 0x55924aabcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55924aa33680 con 0x55924a6ee1b0 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55924aa22c10 con 0x55924a717070 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55924aa26bc0 con 0x55924a6f6390 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6ee1b0 0x55924aabc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6ee1b0 0x55924aabc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46194/0 (socket says 172.21.15.33:46194) 2024-08-28T19:42:03.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6f7fe640 1 -- 172.21.15.33:0/1266013159 learned_addr learned my addr 172.21.15.33:0/1266013159 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6effd640 1 --2- 172.21.15.33:0/1266013159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a717070 0x55924aabc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6cff9640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd580b4ca0 0x7efd580b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6effd640 1 --2- 172.21.15.33:0/1266013159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6f6390 0x55924aabcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6f7fe640 1 -- 172.21.15.33:0/1266013159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6f6390 msgr2=0x55924aabcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/1266013159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6f6390 0x55924aabcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6f7fe640 1 -- 172.21.15.33:0/1266013159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a717070 msgr2=0x55924aabc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/1266013159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a717070 0x55924aabc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6f7fe640 1 -- 172.21.15.33:0/1266013159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924a782650 con 0x55924a6ee1b0 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6effd640 1 --2- 172.21.15.33:0/1266013159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6f6390 0x55924aabcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6cff9640 1 -- 172.21.15.33:0/3714942877 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7efd680e5740 con 0x7efd70108a90 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6ffff640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd580b4ca0 0x7efd580b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.571+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/1266013159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6ee1b0 0x55924aabc890 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7efd6002a930 tx=0x7efd60032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6431a54cddf19ca1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.572+0000 7efd55ffb640 1 -- 172.21.15.33:0/1266013159 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6003f070 con 0x55924a6ee1b0 2024-08-28T19:42:03.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.572+0000 7efd55ffb640 1 -- 172.21.15.33:0/1266013159 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd60032e40 con 0x55924a6ee1b0 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.572+0000 7efd55ffb640 1 -- 172.21.15.33:0/1266013159 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60035070 con 0x55924a6ee1b0 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 -- 172.21.15.33:0/1266013159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6ee1b0 msgr2=0x55924aabc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/1266013159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6ee1b0 0x55924aabc890 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7efd6002a930 tx=0x7efd60032c50 comp rx=0 tx=0).stop 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd6ffff640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd580b4ca0 0x7efd580b71b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efd680a8d00 tx=0x7efd6800b910 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 -- 172.21.15.33:0/1266013159 shutdown_connections 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/1266013159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6f6390 0x55924aabcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/1266013159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6ee1b0 0x55924aabc890 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/1266013159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a717070 0x55924aabc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 -- 172.21.15.33:0/1266013159 >> 172.21.15.33:0/1266013159 conn(0x55924a70b460 msgr2=0x55924aaba240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 -- 172.21.15.33:0/1266013159 shutdown_connections 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 -- 172.21.15.33:0/1266013159 wait complete. 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 -- start start 2024-08-28T19:42:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.573+0000 7efd7c3c5740 1 Processor -- start 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6ee1b0 0x55924aac7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 0x55924aac8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a717070 0x55924aad3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55924a885700 con 0x55924a717070 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55924a9a9750 con 0x55924a6f6390 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55924aacaad0 con 0x55924a6ee1b0 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd7c3c5740 10 client.0 _ll_register_callbacks cb 0x55924a9d8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a717070 0x55924aad3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a717070 0x55924aad3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46200/0 (socket says 172.21.15.33:46200) 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6effd640 1 -- 172.21.15.33:0/2381342322 learned_addr learned my addr 172.21.15.33:0/2381342322 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6effd640 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6ee1b0 0x55924aac7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 0x55924aac8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6effd640 1 -- 172.21.15.33:0/2381342322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6ee1b0 msgr2=0x55924aac7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6effd640 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6ee1b0 0x55924aac7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6effd640 1 -- 172.21.15.33:0/2381342322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 msgr2=0x55924aac8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6effd640 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 0x55924aac8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6effd640 1 -- 172.21.15.33:0/2381342322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55924a9e2900 con 0x55924a717070 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 0x55924aac8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd6effd640 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a717070 0x55924aad3df0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7efd64014fd0 tx=0x7efd64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285f826a8b58deff server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.574+0000 7efd4effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd4effd640 1 -- 172.21.15.33:0/2381342322 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64011e40 con 0x55924a717070 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd4effd640 1 -- 172.21.15.33:0/2381342322 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7efd640140d0 con 0x55924a717070 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2381342322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55924aa355d0 con 0x55924a717070 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd4effd640 1 -- 172.21.15.33:0/2381342322 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd64029050 con 0x55924a717070 2024-08-28T19:42:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd7c3c5740 10 client.18234 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2381342322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55924aad6890 con 0x55924a717070 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd4effd640 1 -- 172.21.15.33:0/2381342322 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55924aa355d0 con 0x55924a717070 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd4effd640 1 -- 172.21.15.33:0/2381342322 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7efd64004aa0 con 0x55924a717070 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd7c3c5740 10 client.18234 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd7c3c5740 10 client.18234 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd7c3c5740 20 client.18234 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55924a6d59f0 0x55924aad9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd7c3c5740 4 client.18234 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.575+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2381342322 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55924aa31070 con 0x55924a6d59f0 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.576+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55924a6d59f0 0x55924aad9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.576+0000 7efd4effd640 10 client.18234 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.576+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55924a6d59f0 0x55924aad9cf0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ecd6fa20f826f59d server_cookie=8822ba329f540148 in_seq=0 out_seq=0 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd4effd640 1 -- 172.21.15.33:0/2381342322 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55924aa31070 con 0x55924a6d59f0 2024-08-28T19:42:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd4effd640 10 client.18234 handle_command_reply: tid=0 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 client.18234 shutdown 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2381342322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a717070 msgr2=0x55924aad3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a717070 0x55924aad3df0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7efd64014fd0 tx=0x7efd64004730 comp rx=0 tx=0).stop 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2381342322 shutdown_connections 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55924a6d59f0 0x55924aad9cf0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a717070 0x55924aad3df0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 0x55924aac8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/2381342322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6ee1b0 0x55924aac7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd4effd640 0 client.18234 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2381342322 >> 172.21.15.33:0/2381342322 conn(0x55924a70b460 msgr2=0x55924aabf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2381342322 shutdown_connections 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.577+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2381342322 wait complete. 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.578+0000 7efd7c3c5740 20 client.18234 trim_cache size 0 max 16384 2024-08-28T19:42:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd7c3c5740 1 Processor -- start 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd7c3c5740 1 -- start start 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aabf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6ee1b0 0x55924aabf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 0x55924aac4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd701b0c80 con 0x55924a6d59f0 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd701b27c0 con 0x55924a6f6390 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efd701b1350 con 0x55924a6ee1b0 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd6effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aabf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd6effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aabf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46206/0 (socket says 172.21.15.33:46206) 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd6effd640 1 -- 172.21.15.33:0/2586993239 learned_addr learned my addr 172.21.15.33:0/2586993239 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/2586993239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6ee1b0 0x55924aabf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.591+0000 7efd6effd640 1 --2- 172.21.15.33:0/2586993239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 0x55924aac4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.592+0000 7efd6effd640 1 -- 172.21.15.33:0/2586993239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6ee1b0 msgr2=0x55924aabf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.592+0000 7efd6effd640 1 --2- 172.21.15.33:0/2586993239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6ee1b0 0x55924aabf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.592+0000 7efd6effd640 1 -- 172.21.15.33:0/2586993239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 msgr2=0x55924aac4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.592+0000 7efd6effd640 1 --2- 172.21.15.33:0/2586993239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 0x55924aac4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.592+0000 7efd6effd640 1 -- 172.21.15.33:0/2586993239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55924aabab30 con 0x55924a6d59f0 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.592+0000 7efd6effd640 1 --2- 172.21.15.33:0/2586993239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aabf450 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7efd6400ca50 tx=0x7efd64005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9097cf9d7b4d942 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.592+0000 7efd557fa640 1 -- 172.21.15.33:0/2586993239 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64034070 con 0x55924a6d59f0 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.592+0000 7efd557fa640 1 -- 172.21.15.33:0/2586993239 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd6400cc80 con 0x55924a6d59f0 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.592+0000 7efd557fa640 1 -- 172.21.15.33:0/2586993239 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64004b20 con 0x55924a6d59f0 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2586993239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 msgr2=0x55924aabf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/2586993239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aabf450 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7efd6400ca50 tx=0x7efd64005fd0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2586993239 shutdown_connections 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/2586993239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6f6390 0x55924aac4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/2586993239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6ee1b0 0x55924aabf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/2586993239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aabf450 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2586993239 >> 172.21.15.33:0/2586993239 conn(0x55924a70b460 msgr2=0x55924aac6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2586993239 shutdown_connections 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 -- 172.21.15.33:0/2586993239 wait complete. 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 -- start start 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.593+0000 7efd7c3c5740 1 Processor -- start 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aacc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6ee1b0 0x55924aacc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd7c3c5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6f6390 0x55924ab43740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd701b20f0 con 0x55924a6d59f0 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd701b1a20 con 0x55924a6ee1b0 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd7c3c5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efd701aec80 con 0x55924a6f6390 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd7c3c5740 10 client.0 _ll_register_callbacks cb 0x7efd6400ce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd6effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aacc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd6effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aacc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46208/0 (socket says 172.21.15.33:46208) 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd6effd640 1 -- 172.21.15.33:0/3300441354 learned_addr learned my addr 172.21.15.33:0/3300441354 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6ee1b0 0x55924aacc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd6effd640 1 -- 172.21.15.33:0/3300441354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6f6390 msgr2=0x55924ab43740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd6effd640 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6f6390 0x55924ab43740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd6effd640 1 -- 172.21.15.33:0/3300441354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6ee1b0 msgr2=0x55924aacc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd6effd640 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6ee1b0 0x55924aacc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd6effd640 1 -- 172.21.15.33:0/3300441354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55924ab43c80 con 0x55924a6d59f0 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd6effd640 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aacc3d0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7efd6400f720 tx=0x7efd64005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251ee7e98b9f019 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.594+0000 7efd4effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd4effd640 1 -- 172.21.15.33:0/3300441354 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64034070 con 0x55924a6d59f0 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd7c3c5740 1 -- 172.21.15.33:0/3300441354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd6400cc80 con 0x55924a6d59f0 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd4effd640 1 -- 172.21.15.33:0/3300441354 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9453+0+0 (secure 0 0 0) 0x7efd640140d0 con 0x55924a6d59f0 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd4effd640 1 -- 172.21.15.33:0/3300441354 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd64025040 con 0x55924a6d59f0 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd7c3c5740 10 client.18240 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd7c3c5740 1 -- 172.21.15.33:0/3300441354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55924ab44e60 con 0x55924a6d59f0 2024-08-28T19:42:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd4effd640 1 -- 172.21.15.33:0/3300441354 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd6400cc80 con 0x55924a6d59f0 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd4effd640 1 -- 172.21.15.33:0/3300441354 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7efd64004fc0 con 0x55924a6d59f0 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd7c3c5740 10 client.18240 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd7c3c5740 10 client.18240 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd7c3c5740 20 client.18240 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55924a717070 0x55924ab47630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd7c3c5740 4 client.18240 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.595+0000 7efd7c3c5740 1 -- 172.21.15.33:0/3300441354 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55924aa2e7b0 con 0x55924a717070 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.596+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55924a717070 0x55924ab47630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.596+0000 7efd4effd640 10 client.18240 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.596+0000 7efd6f7fe640 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55924a717070 0x55924ab47630 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1fbaecafd326dd13 server_cookie=be0384e53a08aaf0 in_seq=0 out_seq=0 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.596+0000 7efd4effd640 1 -- 172.21.15.33:0/3300441354 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55924aa2e7b0 con 0x55924a717070 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.596+0000 7efd4effd640 10 client.18240 handle_command_reply: tid=0 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.596+0000 7efd7c3c5740 1 client.18240 shutdown 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.596+0000 7efd7c3c5740 1 -- 172.21.15.33:0/3300441354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 msgr2=0x55924aacc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.596+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aacc3d0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7efd6400f720 tx=0x7efd64005b00 comp rx=0 tx=0).stop 2024-08-28T19:42:03.620 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:42:03.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd7c3c5740 1 -- 172.21.15.33:0/3300441354 shutdown_connections 2024-08-28T19:42:03.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55924a717070 0x55924ab47630 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55924a6f6390 0x55924ab43740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd4effd640 0 client.18240 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:42:03.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55924a6ee1b0 0x55924aacc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd7c3c5740 1 --2- 172.21.15.33:0/3300441354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55924a6d59f0 0x55924aacc3d0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd7c3c5740 1 -- 172.21.15.33:0/3300441354 >> 172.21.15.33:0/3300441354 conn(0x55924a70b460 msgr2=0x55924aabd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd7c3c5740 1 -- 172.21.15.33:0/3300441354 shutdown_connections 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd7c3c5740 1 -- 172.21.15.33:0/3300441354 wait complete. 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd7c3c5740 20 client.18240 trim_cache size 0 max 16384 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd75e50640 1 -- 172.21.15.33:0/3714942877 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd580b4ca0 msgr2=0x7efd580b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd75e50640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd580b4ca0 0x7efd580b71b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efd680a8d00 tx=0x7efd6800b910 comp rx=0 tx=0).stop 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd75e50640 1 -- 172.21.15.33:0/3714942877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd70108a90 msgr2=0x7efd7019fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd75e50640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd70108a90 0x7efd7019fa70 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7efd68009fd0 tx=0x7efd6800b260 comp rx=0 tx=0).stop 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd75e50640 1 -- 172.21.15.33:0/3714942877 shutdown_connections 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd75e50640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd70108a90 0x7efd7019fa70 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd75e50640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd70108140 0x7efd7019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd75e50640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efd580b4ca0 0x7efd580b71b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd75e50640 1 --2- 172.21.15.33:0/3714942877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efd70102800 0x7efd7019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.597+0000 7efd75e50640 1 -- 172.21.15.33:0/3714942877 >> 172.21.15.33:0/3714942877 conn(0x7efd700794d0 msgr2=0x7efd70101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.598+0000 7efd75e50640 1 -- 172.21.15.33:0/3714942877 shutdown_connections 2024-08-28T19:42:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:03.598+0000 7efd75e50640 1 -- 172.21.15.33:0/3714942877 wait complete. 2024-08-28T19:42:03.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:03 smithi059 ceph-mon[22052]: pgmap v636: 129 pgs: 129 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-08-28T19:42:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:03 smithi122 ceph-mon[22174]: pgmap v636: 129 pgs: 129 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-08-28T19:42:04.315 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:42:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:05.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.084+0000 7fcd51c97640 1 -- 172.21.15.33:0/1796475974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c104f10 msgr2=0x7fcd4c105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.084+0000 7fcd51c97640 1 --2- 172.21.15.33:0/1796475974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c104f10 0x7fcd4c105320 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009900 tx=0x7fcd3402a410 comp rx=0 tx=0).stop 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.084+0000 7fcd51c97640 1 -- 172.21.15.33:0/1796475974 shutdown_connections 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.084+0000 7fcd51c97640 1 --2- 172.21.15.33:0/1796475974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd4c105860 0x7fcd4c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.084+0000 7fcd51c97640 1 --2- 172.21.15.33:0/1796475974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c104f10 0x7fcd4c105320 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.084+0000 7fcd51c97640 1 --2- 172.21.15.33:0/1796475974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c102e20 0x7fcd4c103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.084+0000 7fcd51c97640 1 -- 172.21.15.33:0/1796475974 >> 172.21.15.33:0/1796475974 conn(0x7fcd4c077a00 msgr2=0x7fcd4c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.084+0000 7fcd51c97640 1 -- 172.21.15.33:0/1796475974 shutdown_connections 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.084+0000 7fcd51c97640 1 -- 172.21.15.33:0/1796475974 wait complete. 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.084+0000 7fcd51c97640 1 Processor -- start 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd51c97640 1 -- start start 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd51c97640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c102e20 0x7fcd4c0feb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd51c97640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c104f10 0x7fcd4c0ff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd51c97640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd4c105860 0x7fcd4c0ff600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd51c97640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c112710 con 0x7fcd4c104f10 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd51c97640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c112590 con 0x7fcd4c102e20 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd51c97640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c112890 con 0x7fcd4c105860 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c104f10 0x7fcd4c0ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c104f10 0x7fcd4c0ff0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46230/0 (socket says 172.21.15.33:46230) 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4affd640 1 -- 172.21.15.33:0/3374623730 learned_addr learned my addr 172.21.15.33:0/3374623730 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c102e20 0x7fcd4c0feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd4c105860 0x7fcd4c0ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4affd640 1 -- 172.21.15.33:0/3374623730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd4c105860 msgr2=0x7fcd4c0ff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4affd640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd4c105860 0x7fcd4c0ff600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4affd640 1 -- 172.21.15.33:0/3374623730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c102e20 msgr2=0x7fcd4c0feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4affd640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c102e20 0x7fcd4c0feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4affd640 1 -- 172.21.15.33:0/3374623730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c1a8460 con 0x7fcd4c104f10 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.085+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd4c105860 0x7fcd4c0ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.086+0000 7fcd4affd640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c104f10 0x7fcd4c0ff0c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fcd3402a930 tx=0x7fcd34004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.086+0000 7fcd48ff9640 1 -- 172.21.15.33:0/3374623730 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3403f030 con 0x7fcd4c104f10 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.086+0000 7fcd48ff9640 1 -- 172.21.15.33:0/3374623730 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd34003aa0 con 0x7fcd4c104f10 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.086+0000 7fcd51c97640 1 -- 172.21.15.33:0/3374623730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c1a86f0 con 0x7fcd4c104f10 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.086+0000 7fcd48ff9640 1 -- 172.21.15.33:0/3374623730 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34035070 con 0x7fcd4c104f10 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.086+0000 7fcd51c97640 1 -- 172.21.15.33:0/3374623730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c1a8bd0 con 0x7fcd4c104f10 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd5820c740 1 Processor -- start 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd5820c740 1 -- start start 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd48ff9640 1 -- 172.21.15.33:0/3374623730 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcd34042030 con 0x7fcd4c104f10 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de559c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 0x558de559c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de559cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd5820c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558de5513680 con 0x558de51d6390 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd5820c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558de5502c10 con 0x558de51f7070 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd5820c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558de5506bc0 con 0x558de51ce1b0 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd4affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de559cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd4affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de559cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46244/0 (socket says 172.21.15.33:46244) 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd4affd640 1 -- 172.21.15.33:0/610395995 learned_addr learned my addr 172.21.15.33:0/610395995 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de559c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.089+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 0x558de559c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd4affd640 1 -- 172.21.15.33:0/610395995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 msgr2=0x558de559c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd4affd640 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 0x558de559c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd4affd640 1 -- 172.21.15.33:0/610395995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 msgr2=0x558de559c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd4affd640 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de559c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd4affd640 1 -- 172.21.15.33:0/610395995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558de5262650 con 0x558de51d6390 2024-08-28T19:42:05.096 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 0x558de559c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de559c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd4affd640 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de559cdd0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fcd34103330 tx=0x7fcd3410e3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c486cbe0c94e2a78 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd41ffb640 1 -- 172.21.15.33:0/610395995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3410e7e0 con 0x558de51d6390 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd48ff9640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd380b4ca0 0x7fcd380b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd41ffb640 1 -- 172.21.15.33:0/610395995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd34113030 con 0x558de51d6390 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd41ffb640 1 -- 172.21.15.33:0/610395995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd340d5430 con 0x558de51d6390 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd380b4ca0 0x7fcd380b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.090+0000 7fcd48ff9640 1 -- 172.21.15.33:0/3374623730 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7fcd34106070 con 0x7fcd4c104f10 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.091+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd380b4ca0 0x7fcd380b71b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400cef0 tx=0x7fcd4400c4b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.091+0000 7fcd5820c740 1 -- 172.21.15.33:0/610395995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 msgr2=0x558de559cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.091+0000 7fcd5820c740 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de559cdd0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fcd34103330 tx=0x7fcd3410e3b0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.091+0000 7fcd5820c740 1 -- 172.21.15.33:0/610395995 shutdown_connections 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.091+0000 7fcd5820c740 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de559cdd0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.091+0000 7fcd5820c740 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 0x558de559c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.091+0000 7fcd5820c740 1 --2- 172.21.15.33:0/610395995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de559c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.091+0000 7fcd5820c740 1 -- 172.21.15.33:0/610395995 >> 172.21.15.33:0/610395995 conn(0x558de51eb460 msgr2=0x558de559a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:05.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.091+0000 7fcd5820c740 1 -- 172.21.15.33:0/610395995 shutdown_connections 2024-08-28T19:42:05.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.091+0000 7fcd5820c740 1 -- 172.21.15.33:0/610395995 wait complete. 2024-08-28T19:42:05.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd5820c740 1 -- start start 2024-08-28T19:42:05.098 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd5820c740 1 Processor -- start 2024-08-28T19:42:05.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51ce1b0 0x558de55a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 0x558de55a7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de55b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd5820c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558de5365700 con 0x558de51ce1b0 2024-08-28T19:42:05.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd5820c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558de5489750 con 0x558de51f7070 2024-08-28T19:42:05.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd5820c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558de55aa8f0 con 0x558de51d6390 2024-08-28T19:42:05.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd5820c740 10 client.0 _ll_register_callbacks cb 0x558de54b8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:05.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd4b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51ce1b0 0x558de55a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd4b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51ce1b0 0x558de55a79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46252/0 (socket says 172.21.15.33:46252) 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.092+0000 7fcd4b7fe640 1 -- 172.21.15.33:0/2007684521 learned_addr learned my addr 172.21.15.33:0/2007684521 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd4affd640 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 0x558de55a7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de55b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd4b7fe640 1 -- 172.21.15.33:0/2007684521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 msgr2=0x558de55a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 0x558de55a7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd4b7fe640 1 -- 172.21.15.33:0/2007684521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 msgr2=0x558de55b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de55b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd4b7fe640 1 -- 172.21.15.33:0/2007684521 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558de54c2900 con 0x558de51ce1b0 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de55b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51ce1b0 0x558de55a79b0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c003ca0 tx=0x7fcd3c004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f69ee57099776bc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd2affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd2affd640 1 -- 172.21.15.33:0/2007684521 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c012850 con 0x558de51ce1b0 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd2affd640 1 -- 172.21.15.33:0/2007684521 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7fcd3c0129f0 con 0x558de51ce1b0 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd5820c740 1 -- 172.21.15.33:0/2007684521 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd34113030 con 0x558de51ce1b0 2024-08-28T19:42:05.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd2affd640 1 -- 172.21.15.33:0/2007684521 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcd3c023050 con 0x558de51ce1b0 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd5820c740 10 client.18252 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.093+0000 7fcd5820c740 1 -- 172.21.15.33:0/2007684521 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558de55b65c0 con 0x558de51ce1b0 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.094+0000 7fcd2affd640 1 -- 172.21.15.33:0/2007684521 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd34113030 con 0x558de51ce1b0 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.094+0000 7fcd2affd640 1 -- 172.21.15.33:0/2007684521 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcd3c00f040 con 0x558de51ce1b0 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.094+0000 7fcd5820c740 10 client.18252 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.094+0000 7fcd5820c740 10 client.18252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.094+0000 7fcd5820c740 20 client.18252 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.094+0000 7fcd5820c740 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558de51b59f0 0x558de55b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.094+0000 7fcd5820c740 4 client.18252 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.094+0000 7fcd5820c740 1 -- 172.21.15.33:0/2007684521 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558de55155d0 con 0x558de51b59f0 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.094+0000 7fcd4affd640 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558de51b59f0 0x558de55b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.095+0000 7fcd2affd640 10 client.18252 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.095+0000 7fcd4affd640 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558de51b59f0 0x558de55b9b70 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cccea289f0eafc76 server_cookie=620cb105d642a8e8 in_seq=0 out_seq=0 2024-08-28T19:42:05.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.095+0000 7fcd2affd640 1 -- 172.21.15.33:0/2007684521 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558de55155d0 con 0x558de51b59f0 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.095+0000 7fcd2affd640 10 client.18252 handle_command_reply: tid=0 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.095+0000 7fcd5820c740 1 client.18252 shutdown 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 1 -- 172.21.15.33:0/2007684521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51ce1b0 msgr2=0x558de55a79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51ce1b0 0x558de55a79b0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c003ca0 tx=0x7fcd3c004410 comp rx=0 tx=0).stop 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 1 -- 172.21.15.33:0/2007684521 shutdown_connections 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de55b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 0x558de55a7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558de51b59f0 0x558de55b9b70 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 1 --2- 172.21.15.33:0/2007684521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51ce1b0 0x558de55a79b0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 1 -- 172.21.15.33:0/2007684521 >> 172.21.15.33:0/2007684521 conn(0x558de51eb460 msgr2=0x558de559f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd2affd640 0 client.18252 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 1 -- 172.21.15.33:0/2007684521 shutdown_connections 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 1 -- 172.21.15.33:0/2007684521 wait complete. 2024-08-28T19:42:05.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.096+0000 7fcd5820c740 20 client.18252 trim_cache size 0 max 16384 2024-08-28T19:42:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.109+0000 7fcd5820c740 1 Processor -- start 2024-08-28T19:42:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.109+0000 7fcd5820c740 1 -- start start 2024-08-28T19:42:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.109+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 0x558de55b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.109+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de55a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.109+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de55a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd5820c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c1b2ee0 con 0x558de51d6390 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd5820c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c1b4a20 con 0x558de51f7070 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd5820c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c1b35b0 con 0x558de51ce1b0 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de55a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de55a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46264/0 (socket says 172.21.15.33:46264) 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4affd640 1 -- 172.21.15.33:0/191920587 learned_addr learned my addr 172.21.15.33:0/191920587 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de55a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 0x558de55b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4affd640 1 -- 172.21.15.33:0/191920587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 msgr2=0x558de55b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4affd640 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 0x558de55b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4affd640 1 -- 172.21.15.33:0/191920587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 msgr2=0x558de55a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4affd640 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de55a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4affd640 1 -- 172.21.15.33:0/191920587 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558de559ab30 con 0x558de51d6390 2024-08-28T19:42:05.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de55a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:05.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 0x558de55b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:05.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd4affd640 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de55a4ba0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fcd340d4fb0 tx=0x7fcd34031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bbabc01f26ae91 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:05.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd417fa640 1 -- 172.21.15.33:0/191920587 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd340d45c0 con 0x558de51d6390 2024-08-28T19:42:05.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd417fa640 1 -- 172.21.15.33:0/191920587 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd34113070 con 0x558de51d6390 2024-08-28T19:42:05.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.110+0000 7fcd417fa640 1 -- 172.21.15.33:0/191920587 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd340d4800 con 0x558de51d6390 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.111+0000 7fcd5820c740 1 -- 172.21.15.33:0/191920587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 msgr2=0x558de55a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.111+0000 7fcd5820c740 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de55a4ba0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fcd340d4fb0 tx=0x7fcd34031a10 comp rx=0 tx=0).stop 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.111+0000 7fcd5820c740 1 -- 172.21.15.33:0/191920587 shutdown_connections 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.111+0000 7fcd5820c740 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51f7070 0x558de55a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.111+0000 7fcd5820c740 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51d6390 0x558de55a4ba0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.111+0000 7fcd5820c740 1 --2- 172.21.15.33:0/191920587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51ce1b0 0x558de55b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.111+0000 7fcd5820c740 1 -- 172.21.15.33:0/191920587 >> 172.21.15.33:0/191920587 conn(0x558de51eb460 msgr2=0x558de55a6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.111+0000 7fcd5820c740 1 -- 172.21.15.33:0/191920587 shutdown_connections 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.111+0000 7fcd5820c740 1 -- 172.21.15.33:0/191920587 wait complete. 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd5820c740 1 -- start start 2024-08-28T19:42:05.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd5820c740 1 Processor -- start 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51ce1b0 0x558de55ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 0x558de55ac720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd5820c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51f7070 0x558de5623570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd5820c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c1b4350 con 0x558de51f7070 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd5820c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c1b3c80 con 0x558de51ce1b0 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd5820c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c1b0ee0 con 0x558de51d6390 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd5820c740 10 client.0 _ll_register_callbacks cb 0x7fcd3c009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd4bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51f7070 0x558de5623570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd4bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51f7070 0x558de5623570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46270/0 (socket says 172.21.15.33:46270) 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.112+0000 7fcd4bfff640 1 -- 172.21.15.33:0/998116609 learned_addr learned my addr 172.21.15.33:0/998116609 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51ce1b0 0x558de55ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd4affd640 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 0x558de55ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd4bfff640 1 -- 172.21.15.33:0/998116609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 msgr2=0x558de55ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 0x558de55ac720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd4bfff640 1 -- 172.21.15.33:0/998116609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51ce1b0 msgr2=0x558de55ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51ce1b0 0x558de55ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd4bfff640 1 -- 172.21.15.33:0/998116609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558de5623ab0 con 0x558de51f7070 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd4affd640 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 0x558de55ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51ce1b0 0x558de55ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd4bfff640 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51f7070 0x558de5623570 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fcd4401dde0 tx=0x7fcd440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d973964b0170f44 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd2affd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd2affd640 1 -- 172.21.15.33:0/998116609 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4401be00 con 0x558de51f7070 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd2affd640 1 -- 172.21.15.33:0/998116609 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7fcd4400e5c0 con 0x558de51f7070 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd5820c740 1 -- 172.21.15.33:0/998116609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd34113070 con 0x558de51f7070 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd2affd640 1 -- 172.21.15.33:0/998116609 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcd44031050 con 0x558de51f7070 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd5820c740 10 client.18258 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.113+0000 7fcd5820c740 1 -- 172.21.15.33:0/998116609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558de5624cc0 con 0x558de51f7070 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.114+0000 7fcd2affd640 1 -- 172.21.15.33:0/998116609 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd34113070 con 0x558de51f7070 2024-08-28T19:42:05.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.114+0000 7fcd2affd640 1 -- 172.21.15.33:0/998116609 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fcd44025070 con 0x558de51f7070 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.114+0000 7fcd5820c740 10 client.18258 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.114+0000 7fcd5820c740 10 client.18258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.114+0000 7fcd5820c740 20 client.18258 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.114+0000 7fcd5820c740 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558de518ada0 0x558de56274e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.114+0000 7fcd5820c740 4 client.18258 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.114+0000 7fcd5820c740 1 -- 172.21.15.33:0/998116609 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558de5511070 con 0x558de518ada0 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.114+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558de518ada0 0x558de56274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd4b7fe640 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558de518ada0 0x558de56274e0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af8bca89c70feb26 server_cookie=53c3718739988430 in_seq=0 out_seq=0 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd2affd640 10 client.18258 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd2affd640 1 -- 172.21.15.33:0/998116609 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558de5511070 con 0x558de518ada0 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd2affd640 10 client.18258 handle_command_reply: tid=0 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 client.18258 shutdown 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 -- 172.21.15.33:0/998116609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51f7070 msgr2=0x558de5623570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:05.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51f7070 0x558de5623570 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fcd4401dde0 tx=0x7fcd440046c0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 -- 172.21.15.33:0/998116609 shutdown_connections 2024-08-28T19:42:05.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558de518ada0 0x558de56274e0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558de51f7070 0x558de5623570 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558de51d6390 0x558de55ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 --2- 172.21.15.33:0/998116609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558de51ce1b0 0x558de55ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd2affd640 0 client.18258 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:05.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 -- 172.21.15.33:0/998116609 >> 172.21.15.33:0/998116609 conn(0x558de51eb460 msgr2=0x558de55a8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:05.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 -- 172.21.15.33:0/998116609 shutdown_connections 2024-08-28T19:42:05.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 1 -- 172.21.15.33:0/998116609 wait complete. 2024-08-28T19:42:05.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.115+0000 7fcd5820c740 20 client.18258 trim_cache size 0 max 16384 2024-08-28T19:42:05.122 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:42:05.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 -- 172.21.15.33:0/3374623730 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd380b4ca0 msgr2=0x7fcd380b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:05.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd380b4ca0 0x7fcd380b71b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400cef0 tx=0x7fcd4400c4b0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 -- 172.21.15.33:0/3374623730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c104f10 msgr2=0x7fcd4c0ff0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:05.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c104f10 0x7fcd4c0ff0c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fcd3402a930 tx=0x7fcd34004270 comp rx=0 tx=0).stop 2024-08-28T19:42:05.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 -- 172.21.15.33:0/3374623730 shutdown_connections 2024-08-28T19:42:05.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd380b4ca0 0x7fcd380b71b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd4c105860 0x7fcd4c0ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd4c104f10 0x7fcd4c0ff0c0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 --2- 172.21.15.33:0/3374623730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c102e20 0x7fcd4c0feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:05.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 -- 172.21.15.33:0/3374623730 >> 172.21.15.33:0/3374623730 conn(0x7fcd4c077a00 msgr2=0x7fcd4c1084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:05.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 -- 172.21.15.33:0/3374623730 shutdown_connections 2024-08-28T19:42:05.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:05.116+0000 7fcd51c97640 1 -- 172.21.15.33:0/3374623730 wait complete. 2024-08-28T19:42:05.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:05 smithi059 ceph-mon[22052]: pgmap v637: 129 pgs: 129 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 83 KiB/s wr, 33 op/s 2024-08-28T19:42:05.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:05 smithi059 ceph-mon[22052]: osdmap e91: 12 total, 12 up, 12 in 2024-08-28T19:42:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:05 smithi122 ceph-mon[22174]: pgmap v637: 129 pgs: 129 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 83 KiB/s wr, 33 op/s 2024-08-28T19:42:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:05 smithi122 ceph-mon[22174]: osdmap e91: 12 total, 12 up, 12 in 2024-08-28T19:42:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:05 smithi033 ceph-mon[18549]: pgmap v637: 129 pgs: 129 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 83 KiB/s wr, 33 op/s 2024-08-28T19:42:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:05 smithi033 ceph-mon[18549]: osdmap e91: 12 total, 12 up, 12 in 2024-08-28T19:42:06.931 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:42:06.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:42:07.196 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:07.628 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:07 smithi033 ceph-mon[18549]: pgmap v639: 129 pgs: 129 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 100 KiB/s wr, 35 op/s 2024-08-28T19:42:07.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.723+0000 7f6ad4b29640 1 -- 172.21.15.33:0/203546485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad0103900 msgr2=0x7f6ad0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:07.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.723+0000 7f6ad4b29640 1 --2- 172.21.15.33:0/203546485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad0103900 0x7f6ad0103d10 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009900 tx=0x7f6ac002a410 comp rx=0 tx=0).stop 2024-08-28T19:42:07.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.723+0000 7f6ad4b29640 1 -- 172.21.15.33:0/203546485 shutdown_connections 2024-08-28T19:42:07.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.723+0000 7f6ad4b29640 1 --2- 172.21.15.33:0/203546485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad0109b90 0x7f6ad01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.723+0000 7f6ad4b29640 1 --2- 172.21.15.33:0/203546485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ad0109240 0x7f6ad0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.723+0000 7f6ad4b29640 1 --2- 172.21.15.33:0/203546485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad0103900 0x7f6ad0103d10 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.723+0000 7f6ad4b29640 1 -- 172.21.15.33:0/203546485 >> 172.21.15.33:0/203546485 conn(0x7f6ad007b5f0 msgr2=0x7f6ad007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:07.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.723+0000 7f6ad4b29640 1 -- 172.21.15.33:0/203546485 shutdown_connections 2024-08-28T19:42:07.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.723+0000 7f6ad4b29640 1 -- 172.21.15.33:0/203546485 wait complete. 2024-08-28T19:42:07.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.723+0000 7f6ad4b29640 1 Processor -- start 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6ad4b29640 1 -- start start 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6ad4b29640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad0103900 0x7f6ad00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6ad4b29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ad0109240 0x7f6ad00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6ad4b29640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad0109b90 0x7f6ad0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6ad4b29640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad0113890 con 0x7f6ad0109b90 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6ad4b29640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad0113710 con 0x7f6ad0103900 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6ad4b29640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad0113a10 con 0x7f6ad0109240 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6aced9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad0109b90 0x7f6ad0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6aced9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad0109b90 0x7f6ad0075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46280/0 (socket says 172.21.15.33:46280) 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6aced9d640 1 -- 172.21.15.33:0/146958654 learned_addr learned my addr 172.21.15.33:0/146958654 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6ace59c640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad0103900 0x7f6ad00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ad0109240 0x7f6ad00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6aced9d640 1 -- 172.21.15.33:0/146958654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ad0109240 msgr2=0x7f6ad00759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6aced9d640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ad0109240 0x7f6ad00759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6aced9d640 1 -- 172.21.15.33:0/146958654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad0103900 msgr2=0x7f6ad00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6aced9d640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad0103900 0x7f6ad00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.724+0000 7f6aced9d640 1 -- 172.21.15.33:0/146958654 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad01a8540 con 0x7f6ad0109b90 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.725+0000 7f6aced9d640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad0109b90 0x7f6ad0075f30 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800eaa0 tx=0x7f6ac800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.725+0000 7f6abf7fe640 1 -- 172.21.15.33:0/146958654 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac800cdb0 con 0x7f6ad0109b90 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.725+0000 7f6abf7fe640 1 -- 172.21.15.33:0/146958654 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ac8005020 con 0x7f6ad0109b90 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.725+0000 7f6ad4b29640 1 -- 172.21.15.33:0/146958654 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad01a8830 con 0x7f6ad0109b90 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.725+0000 7f6abf7fe640 1 -- 172.21.15.33:0/146958654 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80116d0 con 0x7f6ad0109b90 2024-08-28T19:42:07.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.725+0000 7f6ad4b29640 1 -- 172.21.15.33:0/146958654 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad01a8df0 con 0x7f6ad0109b90 2024-08-28T19:42:07.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.728+0000 7f6adb09e740 1 Processor -- start 2024-08-28T19:42:07.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.728+0000 7f6abf7fe640 1 -- 172.21.15.33:0/146958654 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6ac8011870 con 0x7f6ad0109b90 2024-08-28T19:42:07.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6adb09e740 1 -- start start 2024-08-28T19:42:07.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 0x55d77b912780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b912cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b54b670 0x55d77b913200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6adb09e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d77b8885f0 con 0x55d77b543490 2024-08-28T19:42:07.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6adb09e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d77b877b80 con 0x55d77b54b670 2024-08-28T19:42:07.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6adb09e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d77b87bb30 con 0x55d77b56c350 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6ace59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b912cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6ace59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b912cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46288/0 (socket says 172.21.15.33:46288) 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6ace59c640 1 -- 172.21.15.33:0/2472530606 learned_addr learned my addr 172.21.15.33:0/2472530606 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/2472530606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 0x55d77b912780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6abf7fe640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6ab80b4d20 0x7f6ab80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.729+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/2472530606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b54b670 0x55d77b913200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6ace59c640 1 -- 172.21.15.33:0/2472530606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 msgr2=0x55d77b912780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6ace59c640 1 --2- 172.21.15.33:0/2472530606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 0x55d77b912780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6ace59c640 1 -- 172.21.15.33:0/2472530606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b54b670 msgr2=0x55d77b913200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6ace59c640 1 --2- 172.21.15.33:0/2472530606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b54b670 0x55d77b913200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6ace59c640 1 -- 172.21.15.33:0/2472530606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d77b5d7930 con 0x55d77b543490 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/2472530606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 0x55d77b912780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6aced9d640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6ab80b4d20 0x7f6ab80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6abf7fe640 1 -- 172.21.15.33:0/146958654 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7f6ac80e5ad0 con 0x7f6ad0109b90 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6ace59c640 1 --2- 172.21.15.33:0/2472530606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b912cc0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009900 tx=0x7f6ac0032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f5847cb1c49a49 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6abcff9640 1 -- 172.21.15.33:0/2472530606 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0040070 con 0x55d77b543490 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6abcff9640 1 -- 172.21.15.33:0/2472530606 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ac0005db0 con 0x55d77b543490 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6aced9d640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6ab80b4d20 0x7f6ab80b7230 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80abd50 tx=0x7f6ac80051d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.730+0000 7f6abcff9640 1 -- 172.21.15.33:0/2472530606 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0035040 con 0x55d77b543490 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.731+0000 7f6adb09e740 1 -- 172.21.15.33:0/2472530606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 msgr2=0x55d77b912cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.731+0000 7f6adb09e740 1 --2- 172.21.15.33:0/2472530606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b912cc0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009900 tx=0x7f6ac0032df0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.731+0000 7f6adb09e740 1 -- 172.21.15.33:0/2472530606 shutdown_connections 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.731+0000 7f6adb09e740 1 --2- 172.21.15.33:0/2472530606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b54b670 0x55d77b913200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.731+0000 7f6adb09e740 1 --2- 172.21.15.33:0/2472530606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b912cc0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.731+0000 7f6adb09e740 1 --2- 172.21.15.33:0/2472530606 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 0x55d77b912780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.731+0000 7f6adb09e740 1 -- 172.21.15.33:0/2472530606 >> 172.21.15.33:0/2472530606 conn(0x55d77b560740 msgr2=0x55d77b910670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.731+0000 7f6adb09e740 1 -- 172.21.15.33:0/2472530606 shutdown_connections 2024-08-28T19:42:07.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.731+0000 7f6adb09e740 1 -- 172.21.15.33:0/2472530606 wait complete. 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6adb09e740 1 -- start start 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6adb09e740 1 Processor -- start 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b91df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 0x55d77b91e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b56c350 0x55d77b92a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6adb09e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d77b6da890 con 0x55d77b543490 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6adb09e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d77b7fe790 con 0x55d77b56c350 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6adb09e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d77b920f00 con 0x55d77b54b670 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6adb09e740 10 client.0 _ll_register_callbacks cb 0x55d77b583ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6acdd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b91df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6acdd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b91df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46290/0 (socket says 172.21.15.33:46290) 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.732+0000 7f6acdd9b640 1 -- 172.21.15.33:0/3972052167 learned_addr learned my addr 172.21.15.33:0/3972052167 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6ace59c640 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 0x55d77b91e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6acdd9b640 1 -- 172.21.15.33:0/3972052167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 msgr2=0x55d77b91e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 0x55d77b91e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6acdd9b640 1 -- 172.21.15.33:0/3972052167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b56c350 msgr2=0x55d77b92a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b56c350 0x55d77b92a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6acdd9b640 1 -- 172.21.15.33:0/3972052167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d77b835f30 con 0x55d77b543490 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b91df20 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f6ad006c790 tx=0x7f6ac4012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286dc691dc588753 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6ab5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/3972052167 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4019020 con 0x55d77b543490 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/3972052167 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7f6ac400f590 con 0x55d77b543490 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6adb09e740 1 -- 172.21.15.33:0/3972052167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ac0005db0 con 0x55d77b543490 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/3972052167 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6ac4024050 con 0x55d77b543490 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6adb09e740 10 client.18270 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6adb09e740 1 -- 172.21.15.33:0/3972052167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d77b92cd60 con 0x55d77b543490 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.733+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/3972052167 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ac0005db0 con 0x55d77b543490 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.734+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/3972052167 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6ac4015910 con 0x55d77b543490 2024-08-28T19:42:07.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.734+0000 7f6adb09e740 10 client.18270 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:07.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.734+0000 7f6adb09e740 10 client.18270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:07.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.734+0000 7f6adb09e740 20 client.18270 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:07.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.734+0000 7f6adb09e740 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d77b52acd0 0x55d77b930270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.734+0000 7f6adb09e740 4 client.18270 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:07.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.734+0000 7f6adb09e740 1 -- 172.21.15.33:0/3972052167 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d77b88a540 con 0x55d77b52acd0 2024-08-28T19:42:07.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.734+0000 7f6ace59c640 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d77b52acd0 0x55d77b930270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.734+0000 7f6ab5ffb640 10 client.18270 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:07.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.734+0000 7f6ace59c640 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d77b52acd0 0x55d77b930270 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=639310a38a082825 server_cookie=c988e737cfe79bc1 in_seq=0 out_seq=0 2024-08-28T19:42:07.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/3972052167 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d77b88a540 con 0x55d77b52acd0 2024-08-28T19:42:07.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6ab5ffb640 10 client.18270 handle_command_reply: tid=0 2024-08-28T19:42:07.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 client.18270 shutdown 2024-08-28T19:42:07.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 -- 172.21.15.33:0/3972052167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 msgr2=0x55d77b91df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:07.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b91df20 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f6ad006c790 tx=0x7f6ac4012980 comp rx=0 tx=0).stop 2024-08-28T19:42:07.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 -- 172.21.15.33:0/3972052167 shutdown_connections 2024-08-28T19:42:07.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b56c350 0x55d77b92a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 0x55d77b91e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d77b52acd0 0x55d77b930270 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 --2- 172.21.15.33:0/3972052167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b543490 0x55d77b91df20 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 -- 172.21.15.33:0/3972052167 >> 172.21.15.33:0/3972052167 conn(0x55d77b560740 msgr2=0x55d77b915910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:07.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6ab5ffb640 0 client.18270 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:07.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 -- 172.21.15.33:0/3972052167 shutdown_connections 2024-08-28T19:42:07.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.735+0000 7f6adb09e740 1 -- 172.21.15.33:0/3972052167 wait complete. 2024-08-28T19:42:07.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.736+0000 7f6adb09e740 20 client.18270 trim_cache size 0 max 16384 2024-08-28T19:42:07.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.753+0000 7f6adb09e740 1 Processor -- start 2024-08-28T19:42:07.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.753+0000 7f6adb09e740 1 -- start start 2024-08-28T19:42:07.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.753+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b54b670 0x55d77b915f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.753+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 0x55d77b91b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b500080 0x55d77b91b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6adb09e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad01b3040 con 0x55d77b54b670 2024-08-28T19:42:07.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6adb09e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad01b4b80 con 0x55d77b500080 2024-08-28T19:42:07.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6adb09e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad01b3710 con 0x55d77b56c350 2024-08-28T19:42:07.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6acdd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b54b670 0x55d77b915f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6acdd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b54b670 0x55d77b915f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46298/0 (socket says 172.21.15.33:46298) 2024-08-28T19:42:07.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6acdd9b640 1 -- 172.21.15.33:0/3452020543 learned_addr learned my addr 172.21.15.33:0/3452020543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:07.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6ace59c640 1 --2- 172.21.15.33:0/3452020543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 0x55d77b91b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6acdd9b640 1 -- 172.21.15.33:0/3452020543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 msgr2=0x55d77b91b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:07.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/3452020543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 0x55d77b91b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6acdd9b640 1 -- 172.21.15.33:0/3452020543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b500080 msgr2=0x55d77b91b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/3452020543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b500080 0x55d77b91b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6acdd9b640 1 -- 172.21.15.33:0/3452020543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d77b91ce80 con 0x55d77b54b670 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/3452020543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b54b670 0x55d77b915f90 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4006ee0 tx=0x7f6ac400a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7251123087c2619 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6ab7fff640 1 -- 172.21.15.33:0/3452020543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4019070 con 0x55d77b54b670 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6ab7fff640 1 -- 172.21.15.33:0/3452020543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ac4015420 con 0x55d77b54b670 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.754+0000 7f6ab7fff640 1 -- 172.21.15.33:0/3452020543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4006290 con 0x55d77b54b670 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.755+0000 7f6adb09e740 1 -- 172.21.15.33:0/3452020543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b54b670 msgr2=0x55d77b915f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.755+0000 7f6adb09e740 1 --2- 172.21.15.33:0/3452020543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b54b670 0x55d77b915f90 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4006ee0 tx=0x7f6ac400a6e0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.755+0000 7f6adb09e740 1 -- 172.21.15.33:0/3452020543 shutdown_connections 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.755+0000 7f6adb09e740 1 --2- 172.21.15.33:0/3452020543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b500080 0x55d77b91b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.755+0000 7f6adb09e740 1 --2- 172.21.15.33:0/3452020543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b56c350 0x55d77b91b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.755+0000 7f6adb09e740 1 --2- 172.21.15.33:0/3452020543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b54b670 0x55d77b915f90 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.755+0000 7f6adb09e740 1 -- 172.21.15.33:0/3452020543 >> 172.21.15.33:0/3452020543 conn(0x55d77b560740 msgr2=0x55d77b915880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:07.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.755+0000 7f6adb09e740 1 -- 172.21.15.33:0/3452020543 shutdown_connections 2024-08-28T19:42:07.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.755+0000 7f6adb09e740 1 -- 172.21.15.33:0/3452020543 wait complete. 2024-08-28T19:42:07.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6adb09e740 1 -- start start 2024-08-28T19:42:07.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6adb09e740 1 Processor -- start 2024-08-28T19:42:07.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b500080 0x55d77b9268f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 0x55d77b922db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6adb09e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b56c350 0x55d77b9232f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6adb09e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad01b44b0 con 0x55d77b56c350 2024-08-28T19:42:07.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6adb09e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad01b3de0 con 0x55d77b500080 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6adb09e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad01b1040 con 0x55d77b54b670 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6adb09e740 10 client.0 _ll_register_callbacks cb 0x7f6ac400aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6acdd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b56c350 0x55d77b9232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6acdd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b56c350 0x55d77b9232f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46314/0 (socket says 172.21.15.33:46314) 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6acdd9b640 1 -- 172.21.15.33:0/2804033851 learned_addr learned my addr 172.21.15.33:0/2804033851 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6ace59c640 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 0x55d77b922db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.756+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b500080 0x55d77b9268f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6acdd9b640 1 -- 172.21.15.33:0/2804033851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 msgr2=0x55d77b922db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 0x55d77b922db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6acdd9b640 1 -- 172.21.15.33:0/2804033851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b500080 msgr2=0x55d77b9268f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b500080 0x55d77b9268f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6acdd9b640 1 -- 172.21.15.33:0/2804033851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d77b923a30 con 0x55d77b56c350 2024-08-28T19:42:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6ace59c640 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 0x55d77b922db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6acdd9b640 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b56c350 0x55d77b9232f0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400a7b0 tx=0x7f6ac4006ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff31c6943d2f4ab server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6ab5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/2804033851 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4019070 con 0x55d77b56c350 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/2804033851 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7f6ac40158e0 con 0x55d77b56c350 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6adb09e740 1 -- 172.21.15.33:0/2804033851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ac4015420 con 0x55d77b56c350 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/2804033851 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6ac4015ae0 con 0x55d77b56c350 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6adb09e740 10 client.18276 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6adb09e740 1 -- 172.21.15.33:0/2804033851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d77b99bb70 con 0x55d77b56c350 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.757+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/2804033851 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ac4015420 con 0x55d77b56c350 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.758+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/2804033851 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6ac400f7c0 con 0x55d77b56c350 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.758+0000 7f6adb09e740 10 client.18276 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.758+0000 7f6adb09e740 10 client.18276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.758+0000 7f6adb09e740 20 client.18276 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:07.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.758+0000 7f6adb09e740 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d77b99c180 0x55d77b99e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:07.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.758+0000 7f6adb09e740 4 client.18276 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:42:07.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.758+0000 7f6adb09e740 1 -- 172.21.15.33:0/2804033851 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d77b885fe0 con 0x55d77b99c180 2024-08-28T19:42:07.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.758+0000 7f6ace59c640 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d77b99c180 0x55d77b99e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:07.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.758+0000 7f6ace59c640 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d77b99c180 0x55d77b99e5a0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8bfd3e3f0e4acc9 server_cookie=e4f0079001449c98 in_seq=0 out_seq=0 2024-08-28T19:42:07.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.758+0000 7f6ab5ffb640 10 client.18276 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.760+0000 7f6ab5ffb640 1 -- 172.21.15.33:0/2804033851 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d77b885fe0 con 0x55d77b99c180 2024-08-28T19:42:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.760+0000 7f6ab5ffb640 10 client.18276 handle_command_reply: tid=0 2024-08-28T19:42:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.760+0000 7f6adb09e740 1 client.18276 shutdown 2024-08-28T19:42:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.760+0000 7f6adb09e740 1 -- 172.21.15.33:0/2804033851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b56c350 msgr2=0x55d77b9232f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.760+0000 7f6adb09e740 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b56c350 0x55d77b9232f0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400a7b0 tx=0x7f6ac4006ae0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6adb09e740 1 -- 172.21.15.33:0/2804033851 shutdown_connections 2024-08-28T19:42:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6adb09e740 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d77b99c180 0x55d77b99e5a0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6adb09e740 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d77b56c350 0x55d77b9232f0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6adb09e740 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d77b54b670 0x55d77b922db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6adb09e740 1 --2- 172.21.15.33:0/2804033851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77b500080 0x55d77b9268f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ab5ffb640 0 client.18276 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6adb09e740 1 -- 172.21.15.33:0/2804033851 >> 172.21.15.33:0/2804033851 conn(0x55d77b560740 msgr2=0x55d77b91f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6adb09e740 1 -- 172.21.15.33:0/2804033851 shutdown_connections 2024-08-28T19:42:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6adb09e740 1 -- 172.21.15.33:0/2804033851 wait complete. 2024-08-28T19:42:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6adb09e740 20 client.18276 trim_cache size 0 max 16384 2024-08-28T19:42:07.765 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:42:07.765 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:42:07.765 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "9f7d985d-a935-4616-b3c6-f9caddb846a5", 2024-08-28T19:42:07.765 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:42:07.766 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:42:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 -- 172.21.15.33:0/146958654 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6ab80b4d20 msgr2=0x7f6ab80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6ab80b4d20 0x7f6ab80b7230 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80abd50 tx=0x7f6ac80051d0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 -- 172.21.15.33:0/146958654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad0109b90 msgr2=0x7f6ad0075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad0109b90 0x7f6ad0075f30 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800eaa0 tx=0x7f6ac800ef60 comp rx=0 tx=0).stop 2024-08-28T19:42:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 -- 172.21.15.33:0/146958654 shutdown_connections 2024-08-28T19:42:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ad0109b90 0x7f6ad0075f30 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6ab80b4d20 0x7f6ab80b7230 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6ad0109240 0x7f6ad00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 --2- 172.21.15.33:0/146958654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad0103900 0x7f6ad00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 -- 172.21.15.33:0/146958654 >> 172.21.15.33:0/146958654 conn(0x7f6ad007b5f0 msgr2=0x7f6ad01072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 -- 172.21.15.33:0/146958654 shutdown_connections 2024-08-28T19:42:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:07.761+0000 7f6ad4b29640 1 -- 172.21.15.33:0/146958654 wait complete. 2024-08-28T19:42:07.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:07 smithi122 ceph-mon[22174]: pgmap v639: 129 pgs: 129 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 100 KiB/s wr, 35 op/s 2024-08-28T19:42:08.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:07 smithi059 ceph-mon[22052]: pgmap v639: 129 pgs: 129 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 100 KiB/s wr, 35 op/s 2024-08-28T19:42:08.601 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:42:08.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:08 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:42:08.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:08 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:08.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:08 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:42:08.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:08 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:08.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:08 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:42:08.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:08 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:08.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:08 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:42:08.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:08 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:08.861 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:09.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:08 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:42:09.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:08 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:09.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:08 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:42:09.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:08 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:09.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.338+0000 7f31e8ac4640 1 -- 172.21.15.33:0/622102347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e41050a0 msgr2=0x7f31e410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:09.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.338+0000 7f31e8ac4640 1 --2- 172.21.15.33:0/622102347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e41050a0 0x7f31e410d5f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009900 tx=0x7f31cc02a3f0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.338+0000 7f31e8ac4640 1 -- 172.21.15.33:0/622102347 shutdown_connections 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.338+0000 7f31e8ac4640 1 --2- 172.21.15.33:0/622102347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e410dbb0 0x7f31e41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.338+0000 7f31e8ac4640 1 --2- 172.21.15.33:0/622102347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e41050a0 0x7f31e410d5f0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.338+0000 7f31e8ac4640 1 --2- 172.21.15.33:0/622102347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e4104750 0x7f31e4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.338+0000 7f31e8ac4640 1 -- 172.21.15.33:0/622102347 >> 172.21.15.33:0/622102347 conn(0x7f31e40794c0 msgr2=0x7f31e40798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.338+0000 7f31e8ac4640 1 -- 172.21.15.33:0/622102347 shutdown_connections 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.338+0000 7f31e8ac4640 1 -- 172.21.15.33:0/622102347 wait complete. 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.339+0000 7f31e8ac4640 1 Processor -- start 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.339+0000 7f31e8ac4640 1 -- start start 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.339+0000 7f31e8ac4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e4104750 0x7f31e419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.339+0000 7f31e8ac4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e41050a0 0x7f31e419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.339+0000 7f31e8ac4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e410dbb0 0x7f31e419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e8ac4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41137d0 con 0x7f31e4104750 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e8ac4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f31e4113650 con 0x7f31e41050a0 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e8ac4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f31e4113950 con 0x7f31e410dbb0 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e4104750 0x7f31e419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e4104750 0x7f31e419a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47562/0 (socket says 172.21.15.33:47562) 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e259c640 1 -- 172.21.15.33:0/3159258343 learned_addr learned my addr 172.21.15.33:0/3159258343 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31dbfff640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e41050a0 0x7f31e419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e410dbb0 0x7f31e419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e259c640 1 -- 172.21.15.33:0/3159258343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e410dbb0 msgr2=0x7f31e419fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e259c640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e410dbb0 0x7f31e419fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e259c640 1 -- 172.21.15.33:0/3159258343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e41050a0 msgr2=0x7f31e419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e259c640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e41050a0 0x7f31e419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e259c640 1 -- 172.21.15.33:0/3159258343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e41a01b0 con 0x7f31e4104750 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e259c640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e4104750 0x7f31e419a300 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f31d400d770 tx=0x7f31d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31db7fe640 1 -- 172.21.15.33:0/3159258343 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4017070 con 0x7f31e4104750 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e8ac4640 1 -- 172.21.15.33:0/3159258343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e41a04a0 con 0x7f31e4104750 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31db7fe640 1 -- 172.21.15.33:0/3159258343 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31d4009c30 con 0x7f31e4104750 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31db7fe640 1 -- 172.21.15.33:0/3159258343 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4003cc0 con 0x7f31e4104750 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.340+0000 7f31e8ac4640 1 -- 172.21.15.33:0/3159258343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e41a6cc0 con 0x7f31e4104750 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.343+0000 7f31ef039740 1 Processor -- start 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.343+0000 7f31ef039740 1 -- start start 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.343+0000 7f31db7fe640 1 -- 172.21.15.33:0/3159258343 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f31d4003e60 con 0x7f31e4104750 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31ef039740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31ef039740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 0x564dd65b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31ef039740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61ef390 0x564dd65b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31ef039740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564dd652c630 con 0x564dd6210070 2024-08-28T19:42:09.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31ef039740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564dd651bbc0 con 0x564dd61e71b0 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31ef039740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564dd651fb70 con 0x564dd61ef390 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31e2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31e2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47578/0 (socket says 172.21.15.33:47578) 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31e2d9d640 1 -- 172.21.15.33:0/2591328825 learned_addr learned my addr 172.21.15.33:0/2591328825 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31e259c640 1 --2- 172.21.15.33:0/2591328825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 0x564dd65b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31dbfff640 1 --2- 172.21.15.33:0/2591328825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61ef390 0x564dd65b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31e2d9d640 1 -- 172.21.15.33:0/2591328825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61ef390 msgr2=0x564dd65b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/2591328825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61ef390 0x564dd65b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31e2d9d640 1 -- 172.21.15.33:0/2591328825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 msgr2=0x564dd65b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/2591328825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 0x564dd65b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31e2d9d640 1 -- 172.21.15.33:0/2591328825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd627b650 con 0x564dd6210070 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31dbfff640 1 --2- 172.21.15.33:0/2591328825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61ef390 0x564dd65b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:09.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.344+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/2591328825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65b52c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f31dc005fd0 tx=0x7f31dc00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cfb80c833c0fd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.345+0000 7f31db7fe640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31d00b4cd0 0x7f31d00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.345+0000 7f31d8ff9640 1 -- 172.21.15.33:0/2591328825 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc018680 con 0x564dd6210070 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.345+0000 7f31d8ff9640 1 -- 172.21.15.33:0/2591328825 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31dc018cd0 con 0x564dd6210070 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.345+0000 7f31d8ff9640 1 -- 172.21.15.33:0/2591328825 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc00fd60 con 0x564dd6210070 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.345+0000 7f31e259c640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31d00b4cd0 0x7f31d00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.345+0000 7f31db7fe640 1 -- 172.21.15.33:0/3159258343 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7f31d40e52c0 con 0x7f31e4104750 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 -- 172.21.15.33:0/2591328825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 msgr2=0x564dd65b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31e259c640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31d00b4cd0 0x7f31d00b71e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f31d40e26c0 tx=0x7f31d40e8e10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 --2- 172.21.15.33:0/2591328825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65b52c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f31dc005fd0 tx=0x7f31dc00d710 comp rx=0 tx=0).stop 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 -- 172.21.15.33:0/2591328825 shutdown_connections 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 --2- 172.21.15.33:0/2591328825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61ef390 0x564dd65b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 --2- 172.21.15.33:0/2591328825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 0x564dd65b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 --2- 172.21.15.33:0/2591328825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65b52c0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 -- 172.21.15.33:0/2591328825 >> 172.21.15.33:0/2591328825 conn(0x564dd6204460 msgr2=0x564dd65b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 -- 172.21.15.33:0/2591328825 shutdown_connections 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 -- 172.21.15.33:0/2591328825 wait complete. 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 -- start start 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.346+0000 7f31ef039740 1 Processor -- start 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31ef039740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 0x564dd65c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31ef039740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65c5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31ef039740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd6210070 0x564dd65d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31ef039740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564dd637e700 con 0x564dd61ef390 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31ef039740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564dd64a2700 con 0x564dd61e71b0 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31ef039740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564dd65c7e00 con 0x564dd6210070 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31ef039740 10 client.0 _ll_register_callbacks cb 0x564dd64d1dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65c5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47584/0 (socket says 172.21.15.33:47584) 2024-08-28T19:42:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31dbfff640 1 -- 172.21.15.33:0/2992136299 learned_addr learned my addr 172.21.15.33:0/2992136299 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 0x564dd65c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd6210070 0x564dd65d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31dbfff640 1 -- 172.21.15.33:0/2992136299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd6210070 msgr2=0x564dd65d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31dbfff640 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd6210070 0x564dd65d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31dbfff640 1 -- 172.21.15.33:0/2992136299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 msgr2=0x564dd65c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31dbfff640 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 0x564dd65c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31dbfff640 1 -- 172.21.15.33:0/2992136299 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd64db8b0 con 0x564dd61ef390 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 0x564dd65c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31dbfff640 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65c5340 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009900 tx=0x7f31cc005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877c450c41436ffc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.347+0000 7f31c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31c9ffb640 1 -- 172.21.15.33:0/2992136299 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc035040 con 0x564dd61ef390 2024-08-28T19:42:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31c9ffb640 1 -- 172.21.15.33:0/2992136299 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7f31cc031820 con 0x564dd61ef390 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31ef039740 1 -- 172.21.15.33:0/2992136299 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31dc018cd0 con 0x564dd61ef390 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31c9ffb640 1 -- 172.21.15.33:0/2992136299 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f31cc004040 con 0x564dd61ef390 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31ef039740 10 client.18288 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31ef039740 1 -- 172.21.15.33:0/2992136299 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564dd65d3be0 con 0x564dd61ef390 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31c9ffb640 1 -- 172.21.15.33:0/2992136299 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31dc018cd0 con 0x564dd61ef390 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31c9ffb640 1 -- 172.21.15.33:0/2992136299 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f31cc0047e0 con 0x564dd61ef390 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31ef039740 10 client.18288 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31ef039740 10 client.18288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31ef039740 20 client.18288 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31ef039740 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564dd61ce9f0 0x564dd65d7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31ef039740 4 client.18288 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.348+0000 7f31ef039740 1 -- 172.21.15.33:0/2992136299 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dd652e580 con 0x564dd61ce9f0 2024-08-28T19:42:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.349+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564dd61ce9f0 0x564dd65d7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.349+0000 7f31c9ffb640 10 client.18288 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.349+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564dd61ce9f0 0x564dd65d7110 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=153a897c17468945 server_cookie=f2a91d9aaf0c694 in_seq=0 out_seq=0 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31c9ffb640 1 -- 172.21.15.33:0/2992136299 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564dd652e580 con 0x564dd61ce9f0 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31c9ffb640 10 client.18288 handle_command_reply: tid=0 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 client.18288 shutdown 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 -- 172.21.15.33:0/2992136299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 msgr2=0x564dd65c5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65c5340 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009900 tx=0x7f31cc005f20 comp rx=0 tx=0).stop 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 -- 172.21.15.33:0/2992136299 shutdown_connections 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd6210070 0x564dd65d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564dd61ce9f0 0x564dd65d7110 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65c5340 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 --2- 172.21.15.33:0/2992136299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61e71b0 0x564dd65c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 -- 172.21.15.33:0/2992136299 >> 172.21.15.33:0/2992136299 conn(0x564dd6204460 msgr2=0x564dd65b6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:09.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31c9ffb640 0 client.18288 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:09.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 -- 172.21.15.33:0/2992136299 shutdown_connections 2024-08-28T19:42:09.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 1 -- 172.21.15.33:0/2992136299 wait complete. 2024-08-28T19:42:09.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.350+0000 7f31ef039740 20 client.18288 trim_cache size 0 max 16384 2024-08-28T19:42:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31ef039740 1 Processor -- start 2024-08-28T19:42:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31ef039740 1 -- start start 2024-08-28T19:42:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31ef039740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61e71b0 0x564dd65ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31ef039740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31ef039740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd6210070 0x564dd65d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31ef039740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41aecb0 con 0x564dd61ef390 2024-08-28T19:42:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31ef039740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41b07f0 con 0x564dd6210070 2024-08-28T19:42:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31ef039740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41af380 con 0x564dd61e71b0 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47594/0 (socket says 172.21.15.33:47594) 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31dbfff640 1 -- 172.21.15.33:0/1961442577 learned_addr learned my addr 172.21.15.33:0/1961442577 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.368+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/1961442577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61e71b0 0x564dd65ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/1961442577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd6210070 0x564dd65d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31dbfff640 1 -- 172.21.15.33:0/1961442577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61e71b0 msgr2=0x564dd65ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31dbfff640 1 --2- 172.21.15.33:0/1961442577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61e71b0 0x564dd65ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31dbfff640 1 -- 172.21.15.33:0/1961442577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd6210070 msgr2=0x564dd65d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31dbfff640 1 --2- 172.21.15.33:0/1961442577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd6210070 0x564dd65d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31dbfff640 1 -- 172.21.15.33:0/1961442577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd65c7540 con 0x564dd61ef390 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/1961442577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd6210070 0x564dd65d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31dbfff640 1 --2- 172.21.15.33:0/1961442577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65b31e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f31cc02a910 tx=0x7f31cc02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a286279fa110c681 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:09.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31cbfff640 1 -- 172.21.15.33:0/1961442577 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc057070 con 0x564dd61ef390 2024-08-28T19:42:09.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31cbfff640 1 -- 172.21.15.33:0/1961442577 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31cc004950 con 0x564dd61ef390 2024-08-28T19:42:09.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.369+0000 7f31cbfff640 1 -- 172.21.15.33:0/1961442577 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc035030 con 0x564dd61ef390 2024-08-28T19:42:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 -- 172.21.15.33:0/1961442577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 msgr2=0x564dd65b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 --2- 172.21.15.33:0/1961442577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65b31e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f31cc02a910 tx=0x7f31cc02a3f0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 -- 172.21.15.33:0/1961442577 shutdown_connections 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 --2- 172.21.15.33:0/1961442577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd6210070 0x564dd65d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 --2- 172.21.15.33:0/1961442577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd61ef390 0x564dd65b31e0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 --2- 172.21.15.33:0/1961442577 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61e71b0 0x564dd65ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 -- 172.21.15.33:0/1961442577 >> 172.21.15.33:0/1961442577 conn(0x564dd6204460 msgr2=0x564dd65b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 -- 172.21.15.33:0/1961442577 shutdown_connections 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 -- 172.21.15.33:0/1961442577 wait complete. 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 -- start start 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.370+0000 7f31ef039740 1 Processor -- start 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31ef039740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61e71b0 0x564dd65c9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31ef039740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61ef390 0x564dd65c9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31ef039740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31ef039740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41b0120 con 0x564dd6210070 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31ef039740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41afa50 con 0x564dd61ef390 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31ef039740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f31e41accb0 con 0x564dd61e71b0 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31ef039740 10 client.0 _ll_register_callbacks cb 0x7f31cc009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31e2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31e2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47606/0 (socket says 172.21.15.33:47606) 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31e2d9d640 1 -- 172.21.15.33:0/202562059 learned_addr learned my addr 172.21.15.33:0/202562059 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61e71b0 0x564dd65c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31dbfff640 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61ef390 0x564dd65c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31e2d9d640 1 -- 172.21.15.33:0/202562059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61e71b0 msgr2=0x564dd65c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61e71b0 0x564dd65c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31e2d9d640 1 -- 172.21.15.33:0/202562059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61ef390 msgr2=0x564dd65c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61ef390 0x564dd65c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31e2d9d640 1 -- 172.21.15.33:0/202562059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd6640ad0 con 0x564dd6210070 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31dbfff640 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61ef390 0x564dd65c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31e2d9d640 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65c9a80 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f31dc008550 tx=0x7f31cc032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c5a8bdee81cf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.371+0000 7f31c9ffb640 1 -- 172.21.15.33:0/202562059 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc036060 con 0x564dd6210070 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31c9ffb640 1 -- 172.21.15.33:0/202562059 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7f31dc00fdf0 con 0x564dd6210070 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31ef039740 1 -- 172.21.15.33:0/202562059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31cc004950 con 0x564dd6210070 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31c9ffb640 1 -- 172.21.15.33:0/202562059 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f31dc03d050 con 0x564dd6210070 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31ef039740 10 client.18294 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31ef039740 1 -- 172.21.15.33:0/202562059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564dd6641c30 con 0x564dd6210070 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31c9ffb640 1 -- 172.21.15.33:0/202562059 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31cc004950 con 0x564dd6210070 2024-08-28T19:42:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31c9ffb640 1 -- 172.21.15.33:0/202562059 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f31dc026040 con 0x564dd6210070 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31ef039740 10 client.18294 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31ef039740 10 client.18294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31ef039740 20 client.18294 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31ef039740 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564dd61a3da0 0x564dd66441d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31ef039740 4 client.18294 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31ef039740 1 -- 172.21.15.33:0/202562059 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564dd652a020 con 0x564dd61a3da0 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.372+0000 7f31dbfff640 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564dd61a3da0 0x564dd66441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31c9ffb640 10 client.18294 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31dbfff640 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564dd61a3da0 0x564dd66441d0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4707c89503e58987 server_cookie=3caf68384d09cb61 in_seq=0 out_seq=0 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31c9ffb640 1 -- 172.21.15.33:0/202562059 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x564dd652a020 con 0x564dd61a3da0 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31c9ffb640 10 client.18294 handle_command_reply: tid=0 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31ef039740 1 client.18294 shutdown 2024-08-28T19:42:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31ef039740 1 -- 172.21.15.33:0/202562059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 msgr2=0x564dd65c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31ef039740 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65c9a80 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f31dc008550 tx=0x7f31cc032bd0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31ef039740 1 -- 172.21.15.33:0/202562059 shutdown_connections 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31ef039740 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564dd61a3da0 0x564dd66441d0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31c9ffb640 0 client.18294 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31ef039740 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564dd6210070 0x564dd65c9a80 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31ef039740 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564dd61ef390 0x564dd65c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31ef039740 1 --2- 172.21.15.33:0/202562059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564dd61e71b0 0x564dd65c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.373+0000 7f31ef039740 1 -- 172.21.15.33:0/202562059 >> 172.21.15.33:0/202562059 conn(0x564dd6204460 msgr2=0x564dd65b62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31ef039740 1 -- 172.21.15.33:0/202562059 shutdown_connections 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31ef039740 1 -- 172.21.15.33:0/202562059 wait complete. 2024-08-28T19:42:09.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31ef039740 20 client.18294 trim_cache size 0 max 16384 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.381 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.382 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:42:09.383 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.385 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.386 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:42:09.387 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:09.390 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:42:09.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 -- 172.21.15.33:0/3159258343 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31d00b4cd0 msgr2=0x7f31d00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:09.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31d00b4cd0 0x7f31d00b71e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f31d40e26c0 tx=0x7f31d40e8e10 comp rx=0 tx=0).stop 2024-08-28T19:42:09.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 -- 172.21.15.33:0/3159258343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e4104750 msgr2=0x7f31e419a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:09.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e4104750 0x7f31e419a300 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f31d400d770 tx=0x7f31d400dc30 comp rx=0 tx=0).stop 2024-08-28T19:42:09.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 -- 172.21.15.33:0/3159258343 shutdown_connections 2024-08-28T19:42:09.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f31d00b4cd0 0x7f31d00b71e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31e410dbb0 0x7f31e419fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31e41050a0 0x7f31e419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 --2- 172.21.15.33:0/3159258343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31e4104750 0x7f31e419a300 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:09.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 -- 172.21.15.33:0/3159258343 >> 172.21.15.33:0/3159258343 conn(0x7f31e40794c0 msgr2=0x7f31e40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:09.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 -- 172.21.15.33:0/3159258343 shutdown_connections 2024-08-28T19:42:09.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:09.374+0000 7f31e8ac4640 1 -- 172.21.15.33:0/3159258343 wait complete. 2024-08-28T19:42:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:09 smithi122 ceph-mon[22174]: pgmap v640: 129 pgs: 129 active+clean; 14 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 37 op/s 2024-08-28T19:42:09.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:09 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:42:09.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:09 smithi033 ceph-mon[18549]: pgmap v640: 129 pgs: 129 active+clean; 14 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 37 op/s 2024-08-28T19:42:09.794 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:09 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:42:10.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:09 smithi059 ceph-mon[22052]: pgmap v640: 129 pgs: 129 active+clean; 14 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 37 op/s 2024-08-28T19:42:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:09 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:42:10.166 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:42:10.166 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:42:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:10.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.946+0000 7f0a923b2640 1 -- 172.21.15.33:0/1165881513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a8c102880 msgr2=0x7f0a8c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.946+0000 7f0a923b2640 1 --2- 172.21.15.33:0/1165881513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a8c102880 0x7f0a8c102c90 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009900 tx=0x7f0a7c02a410 comp rx=0 tx=0).stop 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.947+0000 7f0a923b2640 1 -- 172.21.15.33:0/1165881513 shutdown_connections 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.947+0000 7f0a923b2640 1 --2- 172.21.15.33:0/1165881513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8c108b10 0x7f0a8c10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.947+0000 7f0a923b2640 1 --2- 172.21.15.33:0/1165881513 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a8c1081c0 0x7f0a8c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.947+0000 7f0a923b2640 1 --2- 172.21.15.33:0/1165881513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a8c102880 0x7f0a8c102c90 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.947+0000 7f0a923b2640 1 -- 172.21.15.33:0/1165881513 >> 172.21.15.33:0/1165881513 conn(0x7f0a8c079510 msgr2=0x7f0a8c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.947+0000 7f0a923b2640 1 -- 172.21.15.33:0/1165881513 shutdown_connections 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.947+0000 7f0a923b2640 1 -- 172.21.15.33:0/1165881513 wait complete. 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.947+0000 7f0a923b2640 1 Processor -- start 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.947+0000 7f0a923b2640 1 -- start start 2024-08-28T19:42:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a923b2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8c102880 0x7f0a8c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a923b2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a8c1081c0 0x7f0a8c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a923b2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a8c108b10 0x7f0a8c19fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a923b2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c112810 con 0x7f0a8c1081c0 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a923b2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c112690 con 0x7f0a8c102880 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a923b2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c112990 con 0x7f0a8c108b10 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a8c1081c0 0x7f0a8c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a8c1081c0 0x7f0a8c19a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47628/0 (socket says 172.21.15.33:47628) 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a83fff640 1 -- 172.21.15.33:0/1362206081 learned_addr learned my addr 172.21.15.33:0/1362206081 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a8bfff640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8c102880 0x7f0a8c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a9094f640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a8c108b10 0x7f0a8c19fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a83fff640 1 -- 172.21.15.33:0/1362206081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a8c108b10 msgr2=0x7f0a8c19fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a83fff640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a8c108b10 0x7f0a8c19fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a83fff640 1 -- 172.21.15.33:0/1362206081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8c102880 msgr2=0x7f0a8c19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a83fff640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8c102880 0x7f0a8c19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a83fff640 1 -- 172.21.15.33:0/1362206081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c1a0280 con 0x7f0a8c1081c0 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a8bfff640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8c102880 0x7f0a8c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a83fff640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a8c1081c0 0x7f0a8c19a8b0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0a74006fd0 tx=0x7f0a7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a89ffb640 1 -- 172.21.15.33:0/1362206081 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74011830 con 0x7f0a8c1081c0 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a89ffb640 1 -- 172.21.15.33:0/1362206081 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a74016070 con 0x7f0a8c1081c0 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a89ffb640 1 -- 172.21.15.33:0/1362206081 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74010e00 con 0x7f0a8c1081c0 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.948+0000 7f0a923b2640 1 -- 172.21.15.33:0/1362206081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8c1a0570 con 0x7f0a8c1081c0 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.949+0000 7f0a923b2640 1 -- 172.21.15.33:0/1362206081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8c1a6cd0 con 0x7f0a8c1081c0 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.949+0000 7f0a923b2640 1 -- 172.21.15.33:0/1362206081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a8c103b00 con 0x7f0a8c1081c0 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.951+0000 7f0a89ffb640 1 -- 172.21.15.33:0/1362206081 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0a740119d0 con 0x7f0a8c1081c0 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.952+0000 7f0a89ffb640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0a780b4d20 0x7f0a780b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.952+0000 7f0a8bfff640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0a780b4d20 0x7f0a780b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:10.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.952+0000 7f0a89ffb640 1 -- 172.21.15.33:0/1362206081 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7f0a740e5640 con 0x7f0a8c1081c0 2024-08-28T19:42:10.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.952+0000 7f0a8bfff640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0a780b4d20 0x7f0a780b7230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c031440 tx=0x7f0a7c005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:10.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:10.955+0000 7f0a89ffb640 1 -- 172.21.15.33:0/1362206081 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0a740abfd0 con 0x7f0a8c1081c0 2024-08-28T19:42:11.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.180+0000 7f0a923b2640 1 -- 172.21.15.33:0/1362206081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a8c102c90 con 0x7f0a8c1081c0 2024-08-28T19:42:11.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.181+0000 7f0a89ffb640 1 -- 172.21.15.33:0/1362206081 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f0a8c102c90 con 0x7f0a8c1081c0 2024-08-28T19:42:11.182 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:42:11.182 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:42:11.183 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 -- 172.21.15.33:0/1362206081 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0a780b4d20 msgr2=0x7f0a780b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0a780b4d20 0x7f0a780b7230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c031440 tx=0x7f0a7c005d50 comp rx=0 tx=0).stop 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 -- 172.21.15.33:0/1362206081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a8c1081c0 msgr2=0x7f0a8c19a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a8c1081c0 0x7f0a8c19a8b0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0a74006fd0 tx=0x7f0a7400b8e0 comp rx=0 tx=0).stop 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 -- 172.21.15.33:0/1362206081 shutdown_connections 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0a780b4d20 0x7f0a780b7230 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0a8c108b10 0x7f0a8c19fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a8c1081c0 0x7f0a8c19a8b0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 --2- 172.21.15.33:0/1362206081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a8c102880 0x7f0a8c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 -- 172.21.15.33:0/1362206081 >> 172.21.15.33:0/1362206081 conn(0x7f0a8c079510 msgr2=0x7f0a8c1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:11.185 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 -- 172.21.15.33:0/1362206081 shutdown_connections 2024-08-28T19:42:11.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:11.184+0000 7f0a923b2640 1 -- 172.21.15.33:0/1362206081 wait complete. 2024-08-28T19:42:11.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:11 smithi033 ceph-mon[18549]: pgmap v641: 129 pgs: 129 active+clean; 14 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 37 op/s 2024-08-28T19:42:11.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:11 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1362206081' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:11.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:42:12.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:11 smithi059 ceph-mon[22052]: pgmap v641: 129 pgs: 129 active+clean; 14 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 37 op/s 2024-08-28T19:42:12.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:11 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1362206081' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:12.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:11 smithi122 ceph-mon[22174]: pgmap v641: 129 pgs: 129 active+clean; 14 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 37 op/s 2024-08-28T19:42:12.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:11 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1362206081' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:12.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.701+0000 7fac9f68a640 1 -- 172.21.15.33:0/2793445285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac981081c0 msgr2=0x7fac981085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:12.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.701+0000 7fac9f68a640 1 --2- 172.21.15.33:0/2793445285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac981081c0 0x7fac981085d0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fac88009900 tx=0x7fac8802a410 comp rx=0 tx=0).stop 2024-08-28T19:42:12.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.701+0000 7fac9f68a640 1 -- 172.21.15.33:0/2793445285 shutdown_connections 2024-08-28T19:42:12.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.701+0000 7fac9f68a640 1 --2- 172.21.15.33:0/2793445285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac98108b10 0x7fac9810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.701+0000 7fac9f68a640 1 --2- 172.21.15.33:0/2793445285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac981081c0 0x7fac981085d0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.701+0000 7fac9f68a640 1 --2- 172.21.15.33:0/2793445285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac98102880 0x7fac98102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.701+0000 7fac9f68a640 1 -- 172.21.15.33:0/2793445285 >> 172.21.15.33:0/2793445285 conn(0x7fac98079510 msgr2=0x7fac98079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:12.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.701+0000 7fac9f68a640 1 -- 172.21.15.33:0/2793445285 shutdown_connections 2024-08-28T19:42:12.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.701+0000 7fac9f68a640 1 -- 172.21.15.33:0/2793445285 wait complete. 2024-08-28T19:42:12.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9f68a640 1 Processor -- start 2024-08-28T19:42:12.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9f68a640 1 -- start start 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9f68a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac98102880 0x7fac98199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9f68a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac981081c0 0x7fac981997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9f68a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac98108b10 0x7fac9819ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9f68a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fac98112780 con 0x7fac98108b10 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9f68a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fac98112600 con 0x7fac981081c0 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9f68a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fac98112900 con 0x7fac98102880 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9dc27640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac98108b10 0x7fac9819ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9dc27640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac98108b10 0x7fac9819ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47646/0 (socket says 172.21.15.33:47646) 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9dc27640 1 -- 172.21.15.33:0/729726662 learned_addr learned my addr 172.21.15.33:0/729726662 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9d426640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac98102880 0x7fac98199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.702+0000 7fac9cc25640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac981081c0 0x7fac981997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac9dc27640 1 -- 172.21.15.33:0/729726662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac98102880 msgr2=0x7fac98199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac9dc27640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac98102880 0x7fac98199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac9dc27640 1 -- 172.21.15.33:0/729726662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac981081c0 msgr2=0x7fac981997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac9dc27640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac981081c0 0x7fac981997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac9dc27640 1 -- 172.21.15.33:0/729726662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9819f100 con 0x7fac98108b10 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac9dc27640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac98108b10 0x7fac9819ea90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fac9000eaa0 tx=0x7fac9000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac8e7fc640 1 -- 172.21.15.33:0/729726662 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90004d20 con 0x7fac98108b10 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac9f68a640 1 -- 172.21.15.33:0/729726662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9819f3f0 con 0x7fac98108b10 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac8e7fc640 1 -- 172.21.15.33:0/729726662 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac90005020 con 0x7fac98108b10 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac8e7fc640 1 -- 172.21.15.33:0/729726662 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac900116b0 con 0x7fac98108b10 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.703+0000 7fac9f68a640 1 -- 172.21.15.33:0/729726662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac981a5c10 con 0x7fac98108b10 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.706+0000 7faca5bff740 1 Processor -- start 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.706+0000 7fac8e7fc640 1 -- 172.21.15.33:0/729726662 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fac900051d0 con 0x7fac98108b10 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.706+0000 7faca5bff740 1 -- start start 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7faca5bff740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d011d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7faca5bff740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d011da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7faca5bff740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd55390 0x5654d011dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7faca5bff740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5654d0092680 con 0x5654cfd76070 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7faca5bff740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5654d0081c10 con 0x5654cfd4d1b0 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7faca5bff740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5654d0085bc0 con 0x5654cfd55390 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9cc25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d011d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9cc25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d011d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47660/0 (socket says 172.21.15.33:47660) 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9cc25640 1 -- 172.21.15.33:0/2572175438 learned_addr learned my addr 172.21.15.33:0/2572175438 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9d426640 1 --2- 172.21.15.33:0/2572175438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d011da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9cc25640 1 --2- 172.21.15.33:0/2572175438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd55390 0x5654d011dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac8e7fc640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fac840b4cd0 0x7fac840b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9cc25640 1 -- 172.21.15.33:0/2572175438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd55390 msgr2=0x5654d011dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9cc25640 1 --2- 172.21.15.33:0/2572175438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd55390 0x5654d011dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9cc25640 1 -- 172.21.15.33:0/2572175438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 msgr2=0x5654d011da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9cc25640 1 --2- 172.21.15.33:0/2572175438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d011da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9cc25640 1 -- 172.21.15.33:0/2572175438 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654cfde1650 con 0x5654cfd76070 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.707+0000 7fac9d426640 1 --2- 172.21.15.33:0/2572175438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d011da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.708+0000 7fac8e7fc640 1 -- 172.21.15.33:0/729726662 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7fac900e5a90 con 0x7fac98108b10 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.708+0000 7fac9cc25640 1 --2- 172.21.15.33:0/2572175438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d011d520 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fac9806b760 tx=0x7fac88000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71252f32bc21266 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.708+0000 7fac9dc27640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fac840b4cd0 0x7fac840b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.708+0000 7fac837fe640 1 -- 172.21.15.33:0/2572175438 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88035040 con 0x5654cfd76070 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.708+0000 7fac837fe640 1 -- 172.21.15.33:0/2572175438 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac88005850 con 0x5654cfd76070 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.708+0000 7fac837fe640 1 -- 172.21.15.33:0/2572175438 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88003a30 con 0x5654cfd76070 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.709+0000 7faca5bff740 1 -- 172.21.15.33:0/2572175438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 msgr2=0x5654d011d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.709+0000 7faca5bff740 1 --2- 172.21.15.33:0/2572175438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d011d520 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fac9806b760 tx=0x7fac88000bc0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.709+0000 7fac9dc27640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fac840b4cd0 0x7fac840b71e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fac900aba80 tx=0x7fac90004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.709+0000 7faca5bff740 1 -- 172.21.15.33:0/2572175438 shutdown_connections 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.709+0000 7faca5bff740 1 --2- 172.21.15.33:0/2572175438 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd55390 0x5654d011dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.709+0000 7faca5bff740 1 --2- 172.21.15.33:0/2572175438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d011da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.709+0000 7faca5bff740 1 --2- 172.21.15.33:0/2572175438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d011d520 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.709+0000 7faca5bff740 1 -- 172.21.15.33:0/2572175438 >> 172.21.15.33:0/2572175438 conn(0x5654cfd6a460 msgr2=0x5654d011b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.709+0000 7faca5bff740 1 -- 172.21.15.33:0/2572175438 shutdown_connections 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.709+0000 7faca5bff740 1 -- 172.21.15.33:0/2572175438 wait complete. 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.710+0000 7faca5bff740 1 -- start start 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.710+0000 7faca5bff740 1 Processor -- start 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.710+0000 7faca5bff740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d01271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.710+0000 7faca5bff740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd55390 0x5654d0127790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.710+0000 7faca5bff740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd76070 0x5654d012cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.710+0000 7faca5bff740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5654cfee4700 con 0x5654cfd55390 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.710+0000 7faca5bff740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5654d0008750 con 0x5654cfd4d1b0 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.710+0000 7faca5bff740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5654d0118bf0 con 0x5654cfd76070 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.710+0000 7faca5bff740 10 client.0 _ll_register_callbacks cb 0x5654d0037e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.710+0000 7fac9d426640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd55390 0x5654d0127790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac9d426640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd55390 0x5654d0127790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47668/0 (socket says 172.21.15.33:47668) 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac9d426640 1 -- 172.21.15.33:0/1102358535 learned_addr learned my addr 172.21.15.33:0/1102358535 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac9cc25640 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d01271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac9cc25640 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd76070 0x5654d012cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac9d426640 1 -- 172.21.15.33:0/1102358535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd76070 msgr2=0x5654d012cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac9d426640 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd76070 0x5654d012cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac9d426640 1 -- 172.21.15.33:0/1102358535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 msgr2=0x5654d01271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac9d426640 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d01271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac9d426640 1 -- 172.21.15.33:0/1102358535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654d0041900 con 0x5654cfd55390 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac9d426640 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd55390 0x5654d0127790 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fac94010a50 tx=0x7fac94010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f4577f9f69e161 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac80ff9640 1 -- 172.21.15.33:0/1102358535 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9401e060 con 0x5654cfd55390 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7fac80ff9640 1 -- 172.21.15.33:0/1102358535 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7fac9400fbd0 con 0x5654cfd55390 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.711+0000 7faca5bff740 1 -- 172.21.15.33:0/1102358535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac88005850 con 0x5654cfd55390 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7fac80ff9640 1 -- 172.21.15.33:0/1102358535 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fac94025050 con 0x5654cfd55390 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7faca5bff740 10 client.18312 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7faca5bff740 1 -- 172.21.15.33:0/1102358535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5654d0135970 con 0x5654cfd55390 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7fac80ff9640 1 -- 172.21.15.33:0/1102358535 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac88005850 con 0x5654cfd55390 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7fac80ff9640 1 -- 172.21.15.33:0/1102358535 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fac94018370 con 0x5654cfd55390 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7faca5bff740 10 client.18312 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7faca5bff740 10 client.18312 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:42:12.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7faca5bff740 20 client.18312 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:12.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7faca5bff740 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5654cfd349f0 0x5654d0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7faca5bff740 4 client.18312 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:12.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7faca5bff740 1 -- 172.21.15.33:0/1102358535 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654d00945d0 con 0x5654cfd349f0 2024-08-28T19:42:12.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.712+0000 7fac9cc25640 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5654cfd349f0 0x5654d0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.713+0000 7fac80ff9640 10 client.18312 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:42:12.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.713+0000 7fac9cc25640 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5654cfd349f0 0x5654d0138e60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1e9d9ded81609035 server_cookie=afd6683b0b53139c in_seq=0 out_seq=0 2024-08-28T19:42:12.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7fac80ff9640 1 -- 172.21.15.33:0/1102358535 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654d00945d0 con 0x5654cfd349f0 2024-08-28T19:42:12.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7fac80ff9640 10 client.18312 handle_command_reply: tid=0 2024-08-28T19:42:12.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 client.18312 shutdown 2024-08-28T19:42:12.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 -- 172.21.15.33:0/1102358535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd55390 msgr2=0x5654d0127790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd55390 0x5654d0127790 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fac94010a50 tx=0x7fac94010f10 comp rx=0 tx=0).stop 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 -- 172.21.15.33:0/1102358535 shutdown_connections 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5654cfd349f0 0x5654d0138e60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd76070 0x5654d012cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd55390 0x5654d0127790 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 --2- 172.21.15.33:0/1102358535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d01271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 -- 172.21.15.33:0/1102358535 >> 172.21.15.33:0/1102358535 conn(0x5654cfd6a460 msgr2=0x5654d0120700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7fac80ff9640 0 client.18312 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 -- 172.21.15.33:0/1102358535 shutdown_connections 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 1 -- 172.21.15.33:0/1102358535 wait complete. 2024-08-28T19:42:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.714+0000 7faca5bff740 20 client.18312 trim_cache size 0 max 16384 2024-08-28T19:42:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7faca5bff740 1 Processor -- start 2024-08-28T19:42:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7faca5bff740 1 -- start start 2024-08-28T19:42:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7faca5bff740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd4d1b0 0x5654d011b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7faca5bff740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd55390 0x5654d0133890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7faca5bff740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d012ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7faca5bff740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fac981b2e50 con 0x5654cfd76070 2024-08-28T19:42:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7faca5bff740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fac981b4990 con 0x5654cfd55390 2024-08-28T19:42:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7faca5bff740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fac981b3520 con 0x5654cfd4d1b0 2024-08-28T19:42:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7fac9cc25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d012ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7fac9cc25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d012ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47680/0 (socket says 172.21.15.33:47680) 2024-08-28T19:42:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7fac9cc25640 1 -- 172.21.15.33:0/3653860262 learned_addr learned my addr 172.21.15.33:0/3653860262 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7fac9d426640 1 --2- 172.21.15.33:0/3653860262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd55390 0x5654d0133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7fac9cc25640 1 --2- 172.21.15.33:0/3653860262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd4d1b0 0x5654d011b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7fac9cc25640 1 -- 172.21.15.33:0/3653860262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd4d1b0 msgr2=0x5654d011b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7fac9cc25640 1 --2- 172.21.15.33:0/3653860262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd4d1b0 0x5654d011b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7fac9cc25640 1 -- 172.21.15.33:0/3653860262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd55390 msgr2=0x5654d0133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7fac9cc25640 1 --2- 172.21.15.33:0/3653860262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd55390 0x5654d0133890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.728+0000 7fac9cc25640 1 -- 172.21.15.33:0/3653860262 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654d0125520 con 0x5654cfd76070 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.729+0000 7fac9cc25640 1 --2- 172.21.15.33:0/3653860262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d012ca70 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fac88032e00 tx=0x7fac88005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8cd3584edd1bc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.729+0000 7fac82ffd640 1 -- 172.21.15.33:0/3653860262 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8805c070 con 0x5654cfd76070 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.729+0000 7fac82ffd640 1 -- 172.21.15.33:0/3653860262 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac880054f0 con 0x5654cfd76070 2024-08-28T19:42:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.729+0000 7fac82ffd640 1 -- 172.21.15.33:0/3653860262 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88035040 con 0x5654cfd76070 2024-08-28T19:42:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 -- 172.21.15.33:0/3653860262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 msgr2=0x5654d012ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 --2- 172.21.15.33:0/3653860262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d012ca70 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fac88032e00 tx=0x7fac88005e60 comp rx=0 tx=0).stop 2024-08-28T19:42:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 -- 172.21.15.33:0/3653860262 shutdown_connections 2024-08-28T19:42:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 --2- 172.21.15.33:0/3653860262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d012ca70 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 --2- 172.21.15.33:0/3653860262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd55390 0x5654d0133890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 --2- 172.21.15.33:0/3653860262 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd4d1b0 0x5654d011b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 -- 172.21.15.33:0/3653860262 >> 172.21.15.33:0/3653860262 conn(0x5654cfd6a460 msgr2=0x5654d011ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 -- 172.21.15.33:0/3653860262 shutdown_connections 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 -- 172.21.15.33:0/3653860262 wait complete. 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 -- start start 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.730+0000 7faca5bff740 1 Processor -- start 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7faca5bff740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d012d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7faca5bff740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd55390 0x5654d012d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7faca5bff740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d0132830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7faca5bff740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fac981b42c0 con 0x5654cfd76070 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7faca5bff740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fac981b3bf0 con 0x5654cfd4d1b0 2024-08-28T19:42:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7faca5bff740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fac981b0e50 con 0x5654cfd55390 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7faca5bff740 10 client.0 _ll_register_callbacks cb 0x7fac9400a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9cc25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d0132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9cc25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d0132830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47692/0 (socket says 172.21.15.33:47692) 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9cc25640 1 -- 172.21.15.33:0/981130863 learned_addr learned my addr 172.21.15.33:0/981130863 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9cc25640 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d012d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9d426640 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd55390 0x5654d012d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9cc25640 1 -- 172.21.15.33:0/981130863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd55390 msgr2=0x5654d012d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9cc25640 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd55390 0x5654d012d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9cc25640 1 -- 172.21.15.33:0/981130863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 msgr2=0x5654d012d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9cc25640 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d012d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9cc25640 1 -- 172.21.15.33:0/981130863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654d012de00 con 0x5654cfd76070 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac9cc25640 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d0132830 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fac88031720 tx=0x7fac88004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d09259912f6caf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.731+0000 7fac80ff9640 1 -- 172.21.15.33:0/981130863 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8805c070 con 0x5654cfd76070 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7fac80ff9640 1 -- 172.21.15.33:0/981130863 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7fac88031c90 con 0x5654cfd76070 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7faca5bff740 1 -- 172.21.15.33:0/981130863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac880054f0 con 0x5654cfd76070 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7fac80ff9640 1 -- 172.21.15.33:0/981130863 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fac88035040 con 0x5654cfd76070 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7faca5bff740 10 client.18318 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7faca5bff740 1 -- 172.21.15.33:0/981130863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5654d01a3d20 con 0x5654cfd76070 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7fac80ff9640 1 -- 172.21.15.33:0/981130863 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac880054f0 con 0x5654cfd76070 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7fac80ff9640 1 -- 172.21.15.33:0/981130863 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fac88032030 con 0x5654cfd76070 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7faca5bff740 10 client.18318 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7faca5bff740 10 client.18318 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7faca5bff740 20 client.18318 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7faca5bff740 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5654cfd09da0 0x5654d01a6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:12.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7faca5bff740 4 client.18318 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.732+0000 7faca5bff740 1 -- 172.21.15.33:0/981130863 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654d0090070 con 0x5654cfd09da0 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.733+0000 7fac9d426640 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5654cfd09da0 0x5654d01a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.733+0000 7fac9d426640 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5654cfd09da0 0x5654d01a6010 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b7cb05688476d36c server_cookie=4aed1924fc690a8 in_seq=0 out_seq=0 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.733+0000 7fac80ff9640 10 client.18318 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.733+0000 7fac80ff9640 1 -- 172.21.15.33:0/981130863 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654d0090070 con 0x5654cfd09da0 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.733+0000 7fac80ff9640 10 client.18318 handle_command_reply: tid=0 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.733+0000 7faca5bff740 1 client.18318 shutdown 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 1 -- 172.21.15.33:0/981130863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 msgr2=0x5654d0132830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d0132830 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fac88031720 tx=0x7fac88004a20 comp rx=0 tx=0).stop 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 1 -- 172.21.15.33:0/981130863 shutdown_connections 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5654cfd09da0 0x5654d01a6010 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5654cfd76070 0x5654d0132830 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5654cfd55390 0x5654d012d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac80ff9640 0 client.18318 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:42:12.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 1 --2- 172.21.15.33:0/981130863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5654cfd4d1b0 0x5654d012d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 1 -- 172.21.15.33:0/981130863 >> 172.21.15.33:0/981130863 conn(0x5654cfd6a460 msgr2=0x5654d011e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:12.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 1 -- 172.21.15.33:0/981130863 shutdown_connections 2024-08-28T19:42:12.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 1 -- 172.21.15.33:0/981130863 wait complete. 2024-08-28T19:42:12.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7faca5bff740 20 client.18318 trim_cache size 0 max 16384 2024-08-28T19:42:12.740 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:42:12.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac9f68a640 1 -- 172.21.15.33:0/729726662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fac840b4cd0 msgr2=0x7fac840b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:12.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac9f68a640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fac840b4cd0 0x7fac840b71e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fac900aba80 tx=0x7fac90004a40 comp rx=0 tx=0).stop 2024-08-28T19:42:12.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac9f68a640 1 -- 172.21.15.33:0/729726662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac98108b10 msgr2=0x7fac9819ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:12.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac9f68a640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac98108b10 0x7fac9819ea90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fac9000eaa0 tx=0x7fac9000eea0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac9f68a640 1 -- 172.21.15.33:0/729726662 shutdown_connections 2024-08-28T19:42:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac9f68a640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac98108b10 0x7fac9819ea90 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac9f68a640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac981081c0 0x7fac981997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac9f68a640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fac840b4cd0 0x7fac840b71e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac9f68a640 1 --2- 172.21.15.33:0/729726662 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac98102880 0x7fac98199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.734+0000 7fac9f68a640 1 -- 172.21.15.33:0/729726662 >> 172.21.15.33:0/729726662 conn(0x7fac98079510 msgr2=0x7fac981062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.735+0000 7fac9f68a640 1 -- 172.21.15.33:0/729726662 shutdown_connections 2024-08-28T19:42:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:12.735+0000 7fac9f68a640 1 -- 172.21.15.33:0/729726662 wait complete. 2024-08-28T19:42:13.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:42:13.761 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:13.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:13 smithi033 ceph-mon[18549]: pgmap v642: 129 pgs: 129 active+clean; 14 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 87 KiB/s wr, 34 op/s 2024-08-28T19:42:14.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:13 smithi059 ceph-mon[22052]: pgmap v642: 129 pgs: 129 active+clean; 14 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 87 KiB/s wr, 34 op/s 2024-08-28T19:42:14.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:13 smithi122 ceph-mon[22174]: pgmap v642: 129 pgs: 129 active+clean; 14 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 87 KiB/s wr, 34 op/s 2024-08-28T19:42:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 -- 172.21.15.33:0/3137756361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102820 msgr2=0x7f521c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 --2- 172.21.15.33:0/3137756361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102820 0x7f521c102c30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f520c009900 tx=0x7f520c02a410 comp rx=0 tx=0).stop 2024-08-28T19:42:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 -- 172.21.15.33:0/3137756361 shutdown_connections 2024-08-28T19:42:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 --2- 172.21.15.33:0/3137756361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c108ab0 0x7f521c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 --2- 172.21.15.33:0/3137756361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521c108160 0x7f521c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 --2- 172.21.15.33:0/3137756361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102820 0x7f521c102c30 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 -- 172.21.15.33:0/3137756361 >> 172.21.15.33:0/3137756361 conn(0x7f521c0794e0 msgr2=0x7f521c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 -- 172.21.15.33:0/3137756361 shutdown_connections 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 -- 172.21.15.33:0/3137756361 wait complete. 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 Processor -- start 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.268+0000 7f5223023640 1 -- start start 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5223023640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102820 0x7f521c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5223023640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521c108160 0x7f521c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5223023640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c108ab0 0x7f521c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5223023640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1127b0 con 0x7f521c102820 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5223023640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f521c112630 con 0x7f521c108ab0 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5223023640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f521c112930 con 0x7f521c108160 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5220dbf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102820 0x7f521c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5220dbf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102820 0x7f521c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47704/0 (socket says 172.21.15.33:47704) 2024-08-28T19:42:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5220dbf640 1 -- 172.21.15.33:0/2267004276 learned_addr learned my addr 172.21.15.33:0/2267004276 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f52215c0640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c108ab0 0x7f521c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f521bfff640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521c108160 0x7f521c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5220dbf640 1 -- 172.21.15.33:0/2267004276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521c108160 msgr2=0x7f521c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5220dbf640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521c108160 0x7f521c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5220dbf640 1 -- 172.21.15.33:0/2267004276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c108ab0 msgr2=0x7f521c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5220dbf640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c108ab0 0x7f521c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5220dbf640 1 -- 172.21.15.33:0/2267004276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c1a02a0 con 0x7f521c102820 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f52215c0640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c108ab0 0x7f521c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.269+0000 7f5220dbf640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102820 0x7f521c19a330 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f520c005940 tx=0x7f520c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.270+0000 7f5219ffb640 1 -- 172.21.15.33:0/2267004276 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c03f030 con 0x7f521c102820 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.270+0000 7f5223023640 1 -- 172.21.15.33:0/2267004276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c1a0530 con 0x7f521c102820 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.270+0000 7f5219ffb640 1 -- 172.21.15.33:0/2267004276 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f520c003cb0 con 0x7f521c102820 2024-08-28T19:42:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.270+0000 7f5219ffb640 1 -- 172.21.15.33:0/2267004276 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c035070 con 0x7f521c102820 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.270+0000 7f5223023640 1 -- 172.21.15.33:0/2267004276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c1a6cf0 con 0x7f521c102820 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f5229598740 1 Processor -- start 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f5229598740 1 -- start start 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f5229598740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b042070 0x55a03b3e7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f5229598740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b0191b0 0x55a03b3e7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f5229598740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f5229598740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a03b35e680 con 0x55a03b042070 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f5229598740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a03b34dc10 con 0x55a03b0191b0 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f5229598740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a03b351bc0 con 0x55a03b021390 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f5219ffb640 1 -- 172.21.15.33:0/2267004276 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f520c042030 con 0x7f521c102820 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f52215c0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b042070 0x55a03b3e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.273+0000 7f52215c0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b042070 0x55a03b3e7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47710/0 (socket says 172.21.15.33:47710) 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f52215c0640 1 -- 172.21.15.33:0/2153181624 learned_addr learned my addr 172.21.15.33:0/2153181624 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f521bfff640 1 --2- 172.21.15.33:0/2153181624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f52215c0640 1 -- 172.21.15.33:0/2153181624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 msgr2=0x55a03b3e7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f52215c0640 1 --2- 172.21.15.33:0/2153181624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3e7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f52215c0640 1 -- 172.21.15.33:0/2153181624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b0191b0 msgr2=0x55a03b3e7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f52215c0640 1 --2- 172.21.15.33:0/2153181624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b0191b0 0x55a03b3e7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f52215c0640 1 -- 172.21.15.33:0/2153181624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a03b0ad650 con 0x55a03b042070 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f52215c0640 1 --2- 172.21.15.33:0/2153181624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b042070 0x55a03b3e7310 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f521400c450 tx=0x7f521400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498c5bc01587178a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f5202ffd640 1 -- 172.21.15.33:0/2153181624 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214007430 con 0x55a03b042070 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f5202ffd640 1 -- 172.21.15.33:0/2153181624 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5214007a80 con 0x55a03b042070 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f5202ffd640 1 -- 172.21.15.33:0/2153181624 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521400aa00 con 0x55a03b042070 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f5219ffb640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f52040b4ca0 0x7f52040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.274+0000 7f5220dbf640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f52040b4ca0 0x7f52040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5219ffb640 1 -- 172.21.15.33:0/2267004276 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7f520c1062b0 con 0x7f521c102820 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5229598740 1 -- 172.21.15.33:0/2153181624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b042070 msgr2=0x55a03b3e7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5220dbf640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f52040b4ca0 0x7f52040b71b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x55a03b3e5f90 tx=0x7f520c032f60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5229598740 1 --2- 172.21.15.33:0/2153181624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b042070 0x55a03b3e7310 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f521400c450 tx=0x7f521400c910 comp rx=0 tx=0).stop 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5229598740 1 -- 172.21.15.33:0/2153181624 shutdown_connections 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5229598740 1 --2- 172.21.15.33:0/2153181624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5229598740 1 --2- 172.21.15.33:0/2153181624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b0191b0 0x55a03b3e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5229598740 1 --2- 172.21.15.33:0/2153181624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b042070 0x55a03b3e7310 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5229598740 1 -- 172.21.15.33:0/2153181624 >> 172.21.15.33:0/2153181624 conn(0x55a03b036460 msgr2=0x55a03b3e5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5229598740 1 -- 172.21.15.33:0/2153181624 shutdown_connections 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.275+0000 7f5229598740 1 -- 172.21.15.33:0/2153181624 wait complete. 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.276+0000 7f5229598740 1 -- start start 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.276+0000 7f5229598740 1 Processor -- start 2024-08-28T19:42:14.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.276+0000 7f5229598740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.276+0000 7f5229598740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.276+0000 7f5229598740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b042070 0x55a03b3fee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.276+0000 7f5229598740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a03b1b0700 con 0x55a03b0191b0 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.276+0000 7f5229598740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a03b2d4750 con 0x55a03b042070 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.276+0000 7f5229598740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a03b3f5af0 con 0x55a03b021390 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.276+0000 7f5229598740 10 client.0 _ll_register_callbacks cb 0x55a03b303e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.276+0000 7f52215c0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f52215c0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3f2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47724/0 (socket says 172.21.15.33:47724) 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f52215c0640 1 -- 172.21.15.33:0/409936734 learned_addr learned my addr 172.21.15.33:0/409936734 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f521bfff640 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f52215c0640 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b042070 0x55a03b3fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f52215c0640 1 -- 172.21.15.33:0/409936734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 msgr2=0x55a03b3f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:14.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f52215c0640 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f52215c0640 1 -- 172.21.15.33:0/409936734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b042070 msgr2=0x55a03b3fee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f52215c0640 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b042070 0x55a03b3fee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f52215c0640 1 -- 172.21.15.33:0/409936734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a03b30d900 con 0x55a03b0191b0 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f52215c0640 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3f2a80 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f521400a5e0 tx=0x7f5214009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7187e55d5f7b75 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f51fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f51fbfff640 1 -- 172.21.15.33:0/409936734 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214027060 con 0x55a03b0191b0 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f5229598740 1 -- 172.21.15.33:0/409936734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5214007a80 con 0x55a03b0191b0 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f51fbfff640 1 -- 172.21.15.33:0/409936734 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7f521400a7e0 con 0x55a03b0191b0 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f51fbfff640 1 -- 172.21.15.33:0/409936734 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f521401b040 con 0x55a03b0191b0 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f5229598740 10 client.18330 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.277+0000 7f5229598740 1 -- 172.21.15.33:0/409936734 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a03b401890 con 0x55a03b0191b0 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.278+0000 7f51fbfff640 1 -- 172.21.15.33:0/409936734 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5214007a80 con 0x55a03b0191b0 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.278+0000 7f51fbfff640 1 -- 172.21.15.33:0/409936734 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5214021030 con 0x55a03b0191b0 2024-08-28T19:42:14.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.278+0000 7f5229598740 10 client.18330 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:14.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.278+0000 7f5229598740 10 client.18330 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:42:14.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.278+0000 7f5229598740 20 client.18330 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:14.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.278+0000 7f5229598740 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a03b0009f0 0x55a03b404d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.278+0000 7f5229598740 4 client.18330 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:14.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.278+0000 7f5229598740 1 -- 172.21.15.33:0/409936734 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a03b3605d0 con 0x55a03b0009f0 2024-08-28T19:42:14.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.278+0000 7f521bfff640 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a03b0009f0 0x55a03b404d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.279+0000 7f51fbfff640 10 client.18330 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:42:14.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.279+0000 7f521bfff640 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a03b0009f0 0x55a03b404d60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ab64b1ec1229ef37 server_cookie=2379896d727569d7 in_seq=0 out_seq=0 2024-08-28T19:42:14.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.279+0000 7f51fbfff640 1 -- 172.21.15.33:0/409936734 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a03b3605d0 con 0x55a03b0009f0 2024-08-28T19:42:14.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.279+0000 7f51fbfff640 10 client.18330 handle_command_reply: tid=0 2024-08-28T19:42:14.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.279+0000 7f5229598740 1 client.18330 shutdown 2024-08-28T19:42:14.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 1 -- 172.21.15.33:0/409936734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 msgr2=0x55a03b3f2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:14.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3f2a80 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f521400a5e0 tx=0x7f5214009b60 comp rx=0 tx=0).stop 2024-08-28T19:42:14.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 1 -- 172.21.15.33:0/409936734 shutdown_connections 2024-08-28T19:42:14.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a03b0009f0 0x55a03b404d60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f51fbfff640 0 client.18330 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:42:14.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b042070 0x55a03b3fee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 1 --2- 172.21.15.33:0/409936734 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3f2a80 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 1 -- 172.21.15.33:0/409936734 >> 172.21.15.33:0/409936734 conn(0x55a03b036460 msgr2=0x55a03b3ea4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:14.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 1 -- 172.21.15.33:0/409936734 shutdown_connections 2024-08-28T19:42:14.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 1 -- 172.21.15.33:0/409936734 wait complete. 2024-08-28T19:42:14.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.280+0000 7f5229598740 20 client.18330 trim_cache size 0 max 16384 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f5229598740 1 Processor -- start 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f5229598740 1 -- start start 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f5229598740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b0009f0 0x55a03b3eab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f5229598740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3fed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f5229598740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f5229598740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1b0ea0 con 0x55a03b0191b0 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f5229598740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1b29e0 con 0x55a03b0009f0 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f5229598740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1b1570 con 0x55a03b021390 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f521bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f521bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3fed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47730/0 (socket says 172.21.15.33:47730) 2024-08-28T19:42:14.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f521bfff640 1 -- 172.21.15.33:0/2615730252 learned_addr learned my addr 172.21.15.33:0/2615730252 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.293+0000 7f52215c0640 1 --2- 172.21.15.33:0/2615730252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b0009f0 0x55a03b3eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.294+0000 7f52215c0640 1 --2- 172.21.15.33:0/2615730252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.294+0000 7f521bfff640 1 -- 172.21.15.33:0/2615730252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 msgr2=0x55a03b3e4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.294+0000 7f521bfff640 1 --2- 172.21.15.33:0/2615730252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3e4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.294+0000 7f521bfff640 1 -- 172.21.15.33:0/2615730252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b0009f0 msgr2=0x55a03b3eab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.294+0000 7f521bfff640 1 --2- 172.21.15.33:0/2615730252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b0009f0 0x55a03b3eab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.294+0000 7f521bfff640 1 -- 172.21.15.33:0/2615730252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a03b3f3d40 con 0x55a03b0191b0 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.294+0000 7f521bfff640 1 --2- 172.21.15.33:0/2615730252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3fed80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f521000ba50 tx=0x7f5210014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58345332c5b486d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.294+0000 7f52027fc640 1 -- 172.21.15.33:0/2615730252 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5210014190 con 0x55a03b0191b0 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.294+0000 7f52027fc640 1 -- 172.21.15.33:0/2615730252 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5210012900 con 0x55a03b0191b0 2024-08-28T19:42:14.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.294+0000 7f52027fc640 1 -- 172.21.15.33:0/2615730252 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5210024800 con 0x55a03b0191b0 2024-08-28T19:42:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 -- 172.21.15.33:0/2615730252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 msgr2=0x55a03b3fed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 --2- 172.21.15.33:0/2615730252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3fed80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f521000ba50 tx=0x7f5210014840 comp rx=0 tx=0).stop 2024-08-28T19:42:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 -- 172.21.15.33:0/2615730252 shutdown_connections 2024-08-28T19:42:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 --2- 172.21.15.33:0/2615730252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b021390 0x55a03b3e4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 --2- 172.21.15.33:0/2615730252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0191b0 0x55a03b3fed80 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 --2- 172.21.15.33:0/2615730252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b0009f0 0x55a03b3eab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 -- 172.21.15.33:0/2615730252 >> 172.21.15.33:0/2615730252 conn(0x55a03b036460 msgr2=0x55a03b3ea410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 -- 172.21.15.33:0/2615730252 shutdown_connections 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 -- 172.21.15.33:0/2615730252 wait complete. 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 -- start start 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.295+0000 7f5229598740 1 Processor -- start 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f5229598740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0009f0 0x55a03b405e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f5229598740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b0191b0 0x55a03b4063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f5229598740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b021390 0x55a03b406900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f5229598740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1b2310 con 0x55a03b0009f0 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f5229598740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1b1c40 con 0x55a03b021390 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f5229598740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1aeea0 con 0x55a03b0191b0 2024-08-28T19:42:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f5229598740 10 client.0 _ll_register_callbacks cb 0x7f5214009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f52215c0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0009f0 0x55a03b405e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f52215c0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0009f0 0x55a03b405e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47740/0 (socket says 172.21.15.33:47740) 2024-08-28T19:42:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f52215c0640 1 -- 172.21.15.33:0/3229118819 learned_addr learned my addr 172.21.15.33:0/3229118819 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f521bfff640 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b0191b0 0x55a03b4063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f52215c0640 1 -- 172.21.15.33:0/3229118819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b0191b0 msgr2=0x55a03b4063c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f52215c0640 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b0191b0 0x55a03b4063c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f52215c0640 1 -- 172.21.15.33:0/3229118819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b021390 msgr2=0x55a03b406900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f52215c0640 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b021390 0x55a03b406900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f52215c0640 1 -- 172.21.15.33:0/3229118819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a03b46e5e0 con 0x55a03b0009f0 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.296+0000 7f521bfff640 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b0191b0 0x55a03b4063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f52215c0640 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0009f0 0x55a03b405e80 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f5214007470 tx=0x7f5214016da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd68ec45f16317 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f51fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f51fbfff640 1 -- 172.21.15.33:0/3229118819 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214027040 con 0x55a03b0009f0 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f51fbfff640 1 -- 172.21.15.33:0/3229118819 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9541+0+0 (secure 0 0 0) 0x7f5214007930 con 0x55a03b0009f0 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f5229598740 1 -- 172.21.15.33:0/3229118819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5210012900 con 0x55a03b0009f0 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f51fbfff640 1 -- 172.21.15.33:0/3229118819 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f521400a610 con 0x55a03b0009f0 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f5229598740 10 client.18336 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f5229598740 1 -- 172.21.15.33:0/3229118819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a03b46f860 con 0x55a03b0009f0 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f51fbfff640 1 -- 172.21.15.33:0/3229118819 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5210012900 con 0x55a03b0009f0 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f51fbfff640 1 -- 172.21.15.33:0/3229118819 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5214021040 con 0x55a03b0009f0 2024-08-28T19:42:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f5229598740 10 client.18336 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f5229598740 10 client.18336 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f5229598740 20 client.18336 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f5229598740 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a03b042070 0x55a03b471e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f5229598740 4 client.18336 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.297+0000 7f5229598740 1 -- 172.21.15.33:0/3229118819 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a03b35c070 con 0x55a03b042070 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f521bfff640 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a03b042070 0x55a03b471e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f51fbfff640 10 client.18336 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f521bfff640 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a03b042070 0x55a03b471e70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=49caf43dafa76491 server_cookie=2002a00118a3676c in_seq=0 out_seq=0 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f51fbfff640 1 -- 172.21.15.33:0/3229118819 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a03b35c070 con 0x55a03b042070 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f51fbfff640 10 client.18336 handle_command_reply: tid=0 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f5229598740 1 client.18336 shutdown 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f5229598740 1 -- 172.21.15.33:0/3229118819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0009f0 msgr2=0x55a03b405e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f5229598740 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0009f0 0x55a03b405e80 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f5214007470 tx=0x7f5214016da0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f5229598740 1 -- 172.21.15.33:0/3229118819 shutdown_connections 2024-08-28T19:42:14.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f5229598740 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a03b042070 0x55a03b471e70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.298+0000 7f5229598740 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a03b021390 0x55a03b406900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5229598740 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a03b0191b0 0x55a03b4063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5229598740 1 --2- 172.21.15.33:0/3229118819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a03b0009f0 0x55a03b405e80 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5229598740 1 -- 172.21.15.33:0/3229118819 >> 172.21.15.33:0/3229118819 conn(0x55a03b036460 msgr2=0x55a03b3e4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:14.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f51fbfff640 0 client.18336 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:42:14.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5229598740 1 -- 172.21.15.33:0/3229118819 shutdown_connections 2024-08-28T19:42:14.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5229598740 1 -- 172.21.15.33:0/3229118819 wait complete. 2024-08-28T19:42:14.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5229598740 20 client.18336 trim_cache size 0 max 16384 2024-08-28T19:42:14.307 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:42:14.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5223023640 1 -- 172.21.15.33:0/2267004276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f52040b4ca0 msgr2=0x7f52040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:14.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5223023640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f52040b4ca0 0x7f52040b71b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x55a03b3e5f90 tx=0x7f520c032f60 comp rx=0 tx=0).stop 2024-08-28T19:42:14.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5223023640 1 -- 172.21.15.33:0/2267004276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102820 msgr2=0x7f521c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:14.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5223023640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102820 0x7f521c19a330 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f520c005940 tx=0x7f520c0042f0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5223023640 1 -- 172.21.15.33:0/2267004276 shutdown_connections 2024-08-28T19:42:14.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5223023640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c108ab0 0x7f521c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5223023640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f52040b4ca0 0x7f52040b71b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5223023640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f521c108160 0x7f521c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5223023640 1 --2- 172.21.15.33:0/2267004276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f521c102820 0x7f521c19a330 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:14.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.299+0000 7f5223023640 1 -- 172.21.15.33:0/2267004276 >> 172.21.15.33:0/2267004276 conn(0x7f521c0794e0 msgr2=0x7f521c101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:14.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.300+0000 7f5223023640 1 -- 172.21.15.33:0/2267004276 shutdown_connections 2024-08-28T19:42:14.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:14.300+0000 7f5223023640 1 -- 172.21.15.33:0/2267004276 wait complete. 2024-08-28T19:42:15.204 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:42:15.459 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:15.508 INFO:tasks.quiescer.fs.[cephfs]:Total duration (54.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-28T19:42:15.508 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.05 2024-08-28T19:42:15.508 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:42:15.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:15 smithi033 ceph-mon[18549]: pgmap v643: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 16 op/s 2024-08-28T19:42:15.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:15 smithi033 ceph-mon[18549]: osdmap e92: 12 total, 12 up, 12 in 2024-08-28T19:42:15.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:15 smithi059 ceph-mon[22052]: pgmap v643: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 16 op/s 2024-08-28T19:42:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:15 smithi059 ceph-mon[22052]: osdmap e92: 12 total, 12 up, 12 in 2024-08-28T19:42:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:15 smithi122 ceph-mon[22174]: pgmap v643: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 16 op/s 2024-08-28T19:42:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:15 smithi122 ceph-mon[22174]: osdmap e92: 12 total, 12 up, 12 in 2024-08-28T19:42:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.990+0000 7f862e80b640 1 -- 172.21.15.33:0/509823034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8628108140 msgr2=0x7f8628108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.990+0000 7f862e80b640 1 --2- 172.21.15.33:0/509823034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8628108140 0x7f8628108550 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f8610009900 tx=0x7f861002a410 comp rx=0 tx=0).stop 2024-08-28T19:42:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.990+0000 7f862e80b640 1 -- 172.21.15.33:0/509823034 shutdown_connections 2024-08-28T19:42:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.990+0000 7f862e80b640 1 --2- 172.21.15.33:0/509823034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8628108a90 0x7f862810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.990+0000 7f862e80b640 1 --2- 172.21.15.33:0/509823034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8628108140 0x7f8628108550 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.990+0000 7f862e80b640 1 --2- 172.21.15.33:0/509823034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8628102800 0x7f8628102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.990+0000 7f862e80b640 1 -- 172.21.15.33:0/509823034 >> 172.21.15.33:0/509823034 conn(0x7f86280794d0 msgr2=0x7f86280798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.990+0000 7f862e80b640 1 -- 172.21.15.33:0/509823034 shutdown_connections 2024-08-28T19:42:15.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.990+0000 7f862e80b640 1 -- 172.21.15.33:0/509823034 wait complete. 2024-08-28T19:42:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.991+0000 7f862e80b640 1 Processor -- start 2024-08-28T19:42:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.991+0000 7f862e80b640 1 -- start start 2024-08-28T19:42:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.991+0000 7f862e80b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8628102800 0x7f86280ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.991+0000 7f862e80b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8628108140 0x7f86280ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.991+0000 7f862e80b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8628108a90 0x7f86280ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.991+0000 7f862e80b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f86281126c0 con 0x7f8628108140 2024-08-28T19:42:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.991+0000 7f862e80b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8628112540 con 0x7f8628108a90 2024-08-28T19:42:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.991+0000 7f862e80b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8628112840 con 0x7f8628102800 2024-08-28T19:42:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.991+0000 7f861ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8628108140 0x7f86280ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f861ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8628108140 0x7f86280ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47754/0 (socket says 172.21.15.33:47754) 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f861ffff640 1 -- 172.21.15.33:0/2865575230 learned_addr learned my addr 172.21.15.33:0/2865575230 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f8627fff640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8628102800 0x7f86280ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f862cda8640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8628108a90 0x7f86280ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f8627fff640 1 -- 172.21.15.33:0/2865575230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8628108a90 msgr2=0x7f86280ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f8627fff640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8628108a90 0x7f86280ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f8627fff640 1 -- 172.21.15.33:0/2865575230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8628108140 msgr2=0x7f86280ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f8627fff640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8628108140 0x7f86280ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f8627fff640 1 -- 172.21.15.33:0/2865575230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86281a8560 con 0x7f8628102800 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f861ffff640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8628108140 0x7f86280ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f8627fff640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8628102800 0x7f86280ff410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f861800d6d0 tx=0x7f861800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.992+0000 7f8625ffb640 1 -- 172.21.15.33:0/2865575230 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618017070 con 0x7f8628102800 2024-08-28T19:42:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.993+0000 7f862e80b640 1 -- 172.21.15.33:0/2865575230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86281a8850 con 0x7f8628102800 2024-08-28T19:42:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.993+0000 7f8625ffb640 1 -- 172.21.15.33:0/2865575230 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8618009820 con 0x7f8628102800 2024-08-28T19:42:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.993+0000 7f8625ffb640 1 -- 172.21.15.33:0/2865575230 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618004c40 con 0x7f8628102800 2024-08-28T19:42:15.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.993+0000 7f862e80b640 1 -- 172.21.15.33:0/2865575230 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86281a8d90 con 0x7f8628102800 2024-08-28T19:42:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8634d80740 1 Processor -- start 2024-08-28T19:42:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8634d80740 1 -- start start 2024-08-28T19:42:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8625ffb640 1 -- 172.21.15.33:0/2865575230 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8618005220 con 0x7f8628102800 2024-08-28T19:42:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8634d80740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc5e070 0x55c45d003350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8634d80740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d003890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8634d80740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc3d390 0x55c45d003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8634d80740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c45cf7a680 con 0x55c45cc351b0 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8634d80740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c45cf69c10 con 0x55c45cc3d390 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8634d80740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c45cf6dbc0 con 0x55c45cc5e070 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8627fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d003890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8627fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d003890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47768/0 (socket says 172.21.15.33:47768) 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f8627fff640 1 -- 172.21.15.33:0/151789858 learned_addr learned my addr 172.21.15.33:0/151789858 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f862cda8640 1 --2- 172.21.15.33:0/151789858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc5e070 0x55c45d003350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.996+0000 7f861ffff640 1 --2- 172.21.15.33:0/151789858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc3d390 0x55c45d003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f8627fff640 1 -- 172.21.15.33:0/151789858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc5e070 msgr2=0x55c45d003350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f8627fff640 1 --2- 172.21.15.33:0/151789858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc5e070 0x55c45d003350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f8627fff640 1 -- 172.21.15.33:0/151789858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc3d390 msgr2=0x55c45d003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f8627fff640 1 --2- 172.21.15.33:0/151789858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc3d390 0x55c45d003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f8627fff640 1 -- 172.21.15.33:0/151789858 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c45ccc9650 con 0x55c45cc351b0 2024-08-28T19:42:16.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f8625ffb640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86140b4ca0 0x7f86140b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f8627fff640 1 --2- 172.21.15.33:0/151789858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d003890 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f86180e2450 tx=0x7f86180ed9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0dae76b23b66f1f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:16.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f862cda8640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86140b4ca0 0x7f86140b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f8625ffb640 1 -- 172.21.15.33:0/2865575230 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f86180e5130 con 0x7f8628102800 2024-08-28T19:42:16.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f861e7fc640 1 -- 172.21.15.33:0/151789858 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86180f8070 con 0x55c45cc351b0 2024-08-28T19:42:16.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f861e7fc640 1 -- 172.21.15.33:0/151789858 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86180ab040 con 0x55c45cc351b0 2024-08-28T19:42:16.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.997+0000 7f861e7fc640 1 -- 172.21.15.33:0/151789858 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86180aaca0 con 0x55c45cc351b0 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.998+0000 7f8634d80740 1 -- 172.21.15.33:0/151789858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 msgr2=0x55c45d003890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.998+0000 7f862cda8640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86140b4ca0 0x7f86140b71b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8620005fd0 tx=0x7f8620009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.998+0000 7f8634d80740 1 --2- 172.21.15.33:0/151789858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d003890 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f86180e2450 tx=0x7f86180ed9d0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.999+0000 7f8634d80740 1 -- 172.21.15.33:0/151789858 shutdown_connections 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.999+0000 7f8634d80740 1 --2- 172.21.15.33:0/151789858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc3d390 0x55c45d003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.999+0000 7f8634d80740 1 --2- 172.21.15.33:0/151789858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d003890 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.999+0000 7f8634d80740 1 --2- 172.21.15.33:0/151789858 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc5e070 0x55c45d003350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.999+0000 7f8634d80740 1 -- 172.21.15.33:0/151789858 >> 172.21.15.33:0/151789858 conn(0x55c45cc52460 msgr2=0x55c45d001240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.999+0000 7f8634d80740 1 -- 172.21.15.33:0/151789858 shutdown_connections 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.999+0000 7f8634d80740 1 -- 172.21.15.33:0/151789858 wait complete. 2024-08-28T19:42:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:15.999+0000 7f8634d80740 1 -- start start 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f8634d80740 1 Processor -- start 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f8634d80740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc351b0 0x55c45d00eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f8634d80740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc3d390 0x55c45d00f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f8634d80740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc5e070 0x55c45d01ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f8634d80740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c45cdcc700 con 0x55c45cc5e070 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f8634d80740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c45cef0750 con 0x55c45cc351b0 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f8634d80740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c45d011b30 con 0x55c45cc3d390 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f862cda8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc5e070 0x55c45d01ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f8634d80740 10 client.0 _ll_register_callbacks cb 0x55c45cf1fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f862cda8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc5e070 0x55c45d01ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47778/0 (socket says 172.21.15.33:47778) 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f862cda8640 1 -- 172.21.15.33:0/104835217 learned_addr learned my addr 172.21.15.33:0/104835217 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f8627fff640 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc351b0 0x55c45d00eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f861ffff640 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc3d390 0x55c45d00f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f862cda8640 1 -- 172.21.15.33:0/104835217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc3d390 msgr2=0x55c45d00f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f862cda8640 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc3d390 0x55c45d00f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.000+0000 7f862cda8640 1 -- 172.21.15.33:0/104835217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc351b0 msgr2=0x55c45d00eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f862cda8640 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc351b0 0x55c45d00eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f862cda8640 1 -- 172.21.15.33:0/104835217 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c45cf29900 con 0x55c45cc5e070 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f861ffff640 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc3d390 0x55c45d00f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f862cda8640 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc5e070 0x55c45d01ae20 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f8620011d40 tx=0x7f8620004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ab2127e9727b46 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f86077fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f86077fe640 1 -- 172.21.15.33:0/104835217 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8620004d20 con 0x55c45cc5e070 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f86077fe640 1 -- 172.21.15.33:0/104835217 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f8620005020 con 0x55c45cc5e070 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f8634d80740 1 -- 172.21.15.33:0/104835217 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86180ab040 con 0x55c45cc5e070 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f86077fe640 1 -- 172.21.15.33:0/104835217 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8620005260 con 0x55c45cc5e070 2024-08-28T19:42:16.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f8634d80740 10 client.18348 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:16.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.001+0000 7f8634d80740 1 -- 172.21.15.33:0/104835217 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c45d01da20 con 0x55c45cc5e070 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.002+0000 7f86077fe640 1 -- 172.21.15.33:0/104835217 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86180ab040 con 0x55c45cc5e070 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.002+0000 7f86077fe640 1 -- 172.21.15.33:0/104835217 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f862000f040 con 0x55c45cc5e070 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.002+0000 7f8634d80740 10 client.18348 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.002+0000 7f8634d80740 10 client.18348 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.002+0000 7f8634d80740 20 client.18348 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.002+0000 7f8634d80740 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45cc1c9f0 0x55c45d020f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.002+0000 7f8634d80740 4 client.18348 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.002+0000 7f8634d80740 1 -- 172.21.15.33:0/104835217 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c45cf7c5d0 con 0x55c45cc1c9f0 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.002+0000 7f8627fff640 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45cc1c9f0 0x55c45d020f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.003+0000 7f86077fe640 10 client.18348 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.003+0000 7f8627fff640 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45cc1c9f0 0x55c45d020f70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6179240c2a783bb2 server_cookie=edb1ac8220a62987 in_seq=0 out_seq=0 2024-08-28T19:42:16.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f86077fe640 1 -- 172.21.15.33:0/104835217 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c45cf7c5d0 con 0x55c45cc1c9f0 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f86077fe640 10 client.18348 handle_command_reply: tid=0 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 client.18348 shutdown 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 -- 172.21.15.33:0/104835217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc5e070 msgr2=0x55c45d01ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc5e070 0x55c45d01ae20 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f8620011d40 tx=0x7f8620004a40 comp rx=0 tx=0).stop 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 -- 172.21.15.33:0/104835217 shutdown_connections 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45cc1c9f0 0x55c45d020f70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f86077fe640 0 client.18348 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc5e070 0x55c45d01ae20 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc3d390 0x55c45d00f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 --2- 172.21.15.33:0/104835217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc351b0 0x55c45d00eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 -- 172.21.15.33:0/104835217 >> 172.21.15.33:0/104835217 conn(0x55c45cc52460 msgr2=0x55c45d0064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 -- 172.21.15.33:0/104835217 shutdown_connections 2024-08-28T19:42:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 1 -- 172.21.15.33:0/104835217 wait complete. 2024-08-28T19:42:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.004+0000 7f8634d80740 20 client.18348 trim_cache size 0 max 16384 2024-08-28T19:42:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:16.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f8634d80740 1 Processor -- start 2024-08-28T19:42:16.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f8634d80740 1 -- start start 2024-08-28T19:42:16.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f8634d80740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 0x55c45d006b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f8634d80740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d01ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f8634d80740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc3d390 0x55c45d01b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f8634d80740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f86281b2f40 con 0x55c45cc351b0 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f8634d80740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f86281b4a80 con 0x55c45cc3d390 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f8634d80740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f86281b3610 con 0x55c45cc1c9f0 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f861ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d01ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f861ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d01ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47786/0 (socket says 172.21.15.33:47786) 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.027+0000 7f861ffff640 1 -- 172.21.15.33:0/2926199886 learned_addr learned my addr 172.21.15.33:0/2926199886 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f8627fff640 1 --2- 172.21.15.33:0/2926199886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 0x55c45d006b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f862cda8640 1 --2- 172.21.15.33:0/2926199886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc3d390 0x55c45d01b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f861ffff640 1 -- 172.21.15.33:0/2926199886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 msgr2=0x55c45d006b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f861ffff640 1 --2- 172.21.15.33:0/2926199886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 0x55c45d006b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f861ffff640 1 -- 172.21.15.33:0/2926199886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc3d390 msgr2=0x55c45d01b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f861ffff640 1 --2- 172.21.15.33:0/2926199886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc3d390 0x55c45d01b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f861ffff640 1 -- 172.21.15.33:0/2926199886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c45d00d080 con 0x55c45cc351b0 2024-08-28T19:42:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f8627fff640 1 --2- 172.21.15.33:0/2926199886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 0x55c45d006b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f861ffff640 1 --2- 172.21.15.33:0/2926199886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d01ad20 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f8610006010 tx=0x7f8610031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8ff5d1c267f30a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f861dffb640 1 -- 172.21.15.33:0/2926199886 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610035040 con 0x55c45cc351b0 2024-08-28T19:42:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f861dffb640 1 -- 172.21.15.33:0/2926199886 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8610005020 con 0x55c45cc351b0 2024-08-28T19:42:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.028+0000 7f861dffb640 1 -- 172.21.15.33:0/2926199886 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610004a00 con 0x55c45cc351b0 2024-08-28T19:42:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.029+0000 7f8634d80740 1 -- 172.21.15.33:0/2926199886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 msgr2=0x55c45d01ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.029+0000 7f8634d80740 1 --2- 172.21.15.33:0/2926199886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d01ad20 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f8610006010 tx=0x7f8610031770 comp rx=0 tx=0).stop 2024-08-28T19:42:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.029+0000 7f8634d80740 1 -- 172.21.15.33:0/2926199886 shutdown_connections 2024-08-28T19:42:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.029+0000 7f8634d80740 1 --2- 172.21.15.33:0/2926199886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc3d390 0x55c45d01b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.029+0000 7f8634d80740 1 --2- 172.21.15.33:0/2926199886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc351b0 0x55c45d01ad20 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.029+0000 7f8634d80740 1 --2- 172.21.15.33:0/2926199886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 0x55c45d006b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.029+0000 7f8634d80740 1 -- 172.21.15.33:0/2926199886 >> 172.21.15.33:0/2926199886 conn(0x55c45cc52460 msgr2=0x55c45d006450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.030+0000 7f8634d80740 1 -- 172.21.15.33:0/2926199886 shutdown_connections 2024-08-28T19:42:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.030+0000 7f8634d80740 1 -- 172.21.15.33:0/2926199886 wait complete. 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.030+0000 7f8634d80740 1 -- start start 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.030+0000 7f8634d80740 1 Processor -- start 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8634d80740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 0x55c45d0172d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8634d80740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc351b0 0x55c45d013790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8634d80740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc3d390 0x55c45d013cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8634d80740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f86281b43b0 con 0x55c45cc3d390 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8634d80740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f86281b3ce0 con 0x55c45cc351b0 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8634d80740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f86281b0f40 con 0x55c45cc1c9f0 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8634d80740 10 client.0 _ll_register_callbacks cb 0x7f8620009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f862cda8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc3d390 0x55c45d013cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f862cda8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc3d390 0x55c45d013cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47798/0 (socket says 172.21.15.33:47798) 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f862cda8640 1 -- 172.21.15.33:0/1338434060 learned_addr learned my addr 172.21.15.33:0/1338434060 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8627fff640 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 0x55c45d0172d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f861ffff640 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc351b0 0x55c45d013790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8627fff640 1 -- 172.21.15.33:0/1338434060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc351b0 msgr2=0x55c45d013790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8627fff640 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc351b0 0x55c45d013790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8627fff640 1 -- 172.21.15.33:0/1338434060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc3d390 msgr2=0x55c45d013cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8627fff640 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc3d390 0x55c45d013cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f8627fff640 1 -- 172.21.15.33:0/1338434060 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c45d014210 con 0x55c45cc1c9f0 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.031+0000 7f862cda8640 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc3d390 0x55c45d013cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.032+0000 7f8627fff640 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 0x55c45d0172d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8618000c00 tx=0x7f8618005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b4d2d78e2967ad2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.032+0000 7f86077fe640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.032+0000 7f86077fe640 1 -- 172.21.15.33:0/1338434060 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618096070 con 0x55c45cc1c9f0 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.032+0000 7f8634d80740 1 -- 172.21.15.33:0/1338434060 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8610005020 con 0x55c45cc1c9f0 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.032+0000 7f86077fe640 1 -- 172.21.15.33:0/1338434060 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f8618004de0 con 0x55c45cc1c9f0 2024-08-28T19:42:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.032+0000 7f86077fe640 1 -- 172.21.15.33:0/1338434060 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8618020040 con 0x55c45cc1c9f0 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.032+0000 7f8634d80740 10 client.27316 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.032+0000 7f8634d80740 1 -- 172.21.15.33:0/1338434060 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c45d08c5c0 con 0x55c45cc1c9f0 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.032+0000 7f86077fe640 1 -- 172.21.15.33:0/1338434060 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8610005020 con 0x55c45cc1c9f0 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.032+0000 7f86077fe640 1 -- 172.21.15.33:0/1338434060 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f86180e8ce0 con 0x55c45cc1c9f0 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.033+0000 7f8634d80740 10 client.27316 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.033+0000 7f8634d80740 10 client.27316 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.033+0000 7f8634d80740 20 client.27316 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.033+0000 7f8634d80740 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45cc5e070 0x55c45d08e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.033+0000 7f8634d80740 4 client.27316 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.033+0000 7f8634d80740 1 -- 172.21.15.33:0/1338434060 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c45cf78070 con 0x55c45cc5e070 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.033+0000 7f861ffff640 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45cc5e070 0x55c45d08e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.033+0000 7f861ffff640 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45cc5e070 0x55c45d08e8b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7246206b6ade1f09 server_cookie=73fd1f3d8e293f7f in_seq=0 out_seq=0 2024-08-28T19:42:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.033+0000 7f86077fe640 10 client.27316 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f86077fe640 1 -- 172.21.15.33:0/1338434060 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c45cf78070 con 0x55c45cc5e070 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f86077fe640 10 client.27316 handle_command_reply: tid=0 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 client.27316 shutdown 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 -- 172.21.15.33:0/1338434060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 msgr2=0x55c45d0172d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 0x55c45d0172d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8618000c00 tx=0x7f8618005760 comp rx=0 tx=0).stop 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 -- 172.21.15.33:0/1338434060 shutdown_connections 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55c45cc5e070 0x55c45d08e8b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c45cc3d390 0x55c45d013cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f86077fe640 0 client.27316 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c45cc351b0 0x55c45d013790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 --2- 172.21.15.33:0/1338434060 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c45cc1c9f0 0x55c45d0172d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 -- 172.21.15.33:0/1338434060 >> 172.21.15.33:0/1338434060 conn(0x55c45cc52460 msgr2=0x55c45d0011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:16.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 -- 172.21.15.33:0/1338434060 shutdown_connections 2024-08-28T19:42:16.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 1 -- 172.21.15.33:0/1338434060 wait complete. 2024-08-28T19:42:16.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.034+0000 7f8634d80740 20 client.27316 trim_cache size 0 max 16384 2024-08-28T19:42:16.040 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:42:16.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 -- 172.21.15.33:0/2865575230 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86140b4ca0 msgr2=0x7f86140b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86140b4ca0 0x7f86140b71b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8620005fd0 tx=0x7f8620009600 comp rx=0 tx=0).stop 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 -- 172.21.15.33:0/2865575230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8628102800 msgr2=0x7f86280ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8628102800 0x7f86280ff410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f861800d6d0 tx=0x7f861800db90 comp rx=0 tx=0).stop 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 -- 172.21.15.33:0/2865575230 shutdown_connections 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8628108a90 0x7f86280ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8628108140 0x7f86280ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86140b4ca0 0x7f86140b71b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 --2- 172.21.15.33:0/2865575230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8628102800 0x7f86280ff410 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 -- 172.21.15.33:0/2865575230 >> 172.21.15.33:0/2865575230 conn(0x7f86280794d0 msgr2=0x7f862806b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 -- 172.21.15.33:0/2865575230 shutdown_connections 2024-08-28T19:42:16.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:16.035+0000 7f862e80b640 1 -- 172.21.15.33:0/2865575230 wait complete. 2024-08-28T19:42:16.732 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:42:17.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.262+0000 7ff6b836f640 1 -- 172.21.15.33:0/134612610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6b0106090 msgr2=0x7ff6b01064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.262+0000 7ff6b836f640 1 --2- 172.21.15.33:0/134612610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6b0106090 0x7ff6b01064a0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009900 tx=0x7ff6a002a410 comp rx=0 tx=0).stop 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.262+0000 7ff6b836f640 1 -- 172.21.15.33:0/134612610 shutdown_connections 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.262+0000 7ff6b836f640 1 --2- 172.21.15.33:0/134612610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b01069e0 0x7ff6b0110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.262+0000 7ff6b836f640 1 --2- 172.21.15.33:0/134612610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6b0106090 0x7ff6b01064a0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.262+0000 7ff6b836f640 1 --2- 172.21.15.33:0/134612610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6b0101e40 0x7ff6b0102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.262+0000 7ff6b836f640 1 -- 172.21.15.33:0/134612610 >> 172.21.15.33:0/134612610 conn(0x7ff6b0079d30 msgr2=0x7ff6b007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.262+0000 7ff6b836f640 1 -- 172.21.15.33:0/134612610 shutdown_connections 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.262+0000 7ff6b836f640 1 -- 172.21.15.33:0/134612610 wait complete. 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.263+0000 7ff6b836f640 1 Processor -- start 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.263+0000 7ff6b836f640 1 -- start start 2024-08-28T19:42:17.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.263+0000 7ff6b836f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b0101e40 0x7ff6b019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.263+0000 7ff6b836f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6b0106090 0x7ff6b019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.263+0000 7ff6b836f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6b01069e0 0x7ff6b019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.263+0000 7ff6b836f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b0113890 con 0x7ff6b01069e0 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.263+0000 7ff6b836f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b0113710 con 0x7ff6b0106090 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.263+0000 7ff6b836f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b0113a10 con 0x7ff6b0101e40 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.263+0000 7ff6b690c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6b01069e0 0x7ff6b019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b690c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6b01069e0 0x7ff6b019fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47806/0 (socket says 172.21.15.33:47806) 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b690c640 1 -- 172.21.15.33:0/1659012175 learned_addr learned my addr 172.21.15.33:0/1659012175 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b610b640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b0101e40 0x7ff6b019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b590a640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6b0106090 0x7ff6b019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b690c640 1 -- 172.21.15.33:0/1659012175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b0101e40 msgr2=0x7ff6b019a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b690c640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b0101e40 0x7ff6b019a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:17.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b690c640 1 -- 172.21.15.33:0/1659012175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6b0106090 msgr2=0x7ff6b019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b690c640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6b0106090 0x7ff6b019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b690c640 1 -- 172.21.15.33:0/1659012175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b01a0150 con 0x7ff6b01069e0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b690c640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6b01069e0 0x7ff6b019fae0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800cce0 tx=0x7ff6a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6a77fe640 1 -- 172.21.15.33:0/1659012175 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a800f450 con 0x7ff6b01069e0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6a77fe640 1 -- 172.21.15.33:0/1659012175 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6a800faa0 con 0x7ff6b01069e0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b836f640 1 -- 172.21.15.33:0/1659012175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b01a0440 con 0x7ff6b01069e0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6a77fe640 1 -- 172.21.15.33:0/1659012175 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8018b70 con 0x7ff6b01069e0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.264+0000 7ff6b836f640 1 -- 172.21.15.33:0/1659012175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b01a6c60 con 0x7ff6b01069e0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.265+0000 7ff6b836f640 1 -- 172.21.15.33:0/1659012175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6b0102250 con 0x7ff6b01069e0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.267+0000 7ff6a77fe640 1 -- 172.21.15.33:0/1659012175 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff6a8018d10 con 0x7ff6b01069e0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.267+0000 7ff6a77fe640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff69c0b4d50 0x7ff69c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.268+0000 7ff6b610b640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff69c0b4d50 0x7ff69c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.268+0000 7ff6a77fe640 1 -- 172.21.15.33:0/1659012175 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7ff6a80e5cd0 con 0x7ff6b01069e0 2024-08-28T19:42:17.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.268+0000 7ff6b610b640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff69c0b4d50 0x7ff69c0b7260 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff6b006b8b0 tx=0x7ff6ac00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:17.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.271+0000 7ff6a77fe640 1 -- 172.21.15.33:0/1659012175 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff6a8014030 con 0x7ff6b01069e0 2024-08-28T19:42:17.316 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.498+0000 7ff6b836f640 1 -- 172.21.15.33:0/1659012175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6b010bb00 con 0x7ff6b01069e0 2024-08-28T19:42:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.498+0000 7ff6a77fe640 1 -- 172.21.15.33:0/1659012175 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7ff6a80ac830 con 0x7ff6b01069e0 2024-08-28T19:42:17.499 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:42:17.500 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:42:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:42:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.500+0000 7ff6b836f640 1 -- 172.21.15.33:0/1659012175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff69c0b4d50 msgr2=0x7ff69c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.500+0000 7ff6b836f640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff69c0b4d50 0x7ff69c0b7260 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff6b006b8b0 tx=0x7ff6ac00b390 comp rx=0 tx=0).stop 2024-08-28T19:42:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.500+0000 7ff6b836f640 1 -- 172.21.15.33:0/1659012175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6b01069e0 msgr2=0x7ff6b019fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.500+0000 7ff6b836f640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6b01069e0 0x7ff6b019fae0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800cce0 tx=0x7ff6a800a620 comp rx=0 tx=0).stop 2024-08-28T19:42:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.501+0000 7ff6b836f640 1 -- 172.21.15.33:0/1659012175 shutdown_connections 2024-08-28T19:42:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.501+0000 7ff6b836f640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6b01069e0 0x7ff6b019fae0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.501+0000 7ff6b836f640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6b0106090 0x7ff6b019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.501+0000 7ff6b836f640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff69c0b4d50 0x7ff69c0b7260 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.501+0000 7ff6b836f640 1 --2- 172.21.15.33:0/1659012175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff6b0101e40 0x7ff6b019a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.501+0000 7ff6b836f640 1 -- 172.21.15.33:0/1659012175 >> 172.21.15.33:0/1659012175 conn(0x7ff6b0079d30 msgr2=0x7ff6b0107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.501+0000 7ff6b836f640 1 -- 172.21.15.33:0/1659012175 shutdown_connections 2024-08-28T19:42:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:17.501+0000 7ff6b836f640 1 -- 172.21.15.33:0/1659012175 wait complete. 2024-08-28T19:42:17.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:17 smithi059 ceph-mon[22052]: pgmap v645: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 16 op/s 2024-08-28T19:42:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:17 smithi122 ceph-mon[22174]: pgmap v645: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 16 op/s 2024-08-28T19:42:17.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:17 smithi033 ceph-mon[18549]: pgmap v645: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 16 op/s 2024-08-28T19:42:18.212 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 147.05 --await-for 45.0' 2024-08-28T19:42:18.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 147.05 --await-for 45.0 2024-08-28T19:42:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.461+0000 7f16a021c640 1 -- 172.21.15.33:0/588889210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698108170 msgr2=0x7f1698108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.461+0000 7f16a021c640 1 --2- 172.21.15.33:0/588889210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698108170 0x7f1698108580 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f168c009900 tx=0x7f168c02a410 comp rx=0 tx=0).stop 2024-08-28T19:42:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.461+0000 7f16a021c640 1 -- 172.21.15.33:0/588889210 shutdown_connections 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.461+0000 7f16a021c640 1 --2- 172.21.15.33:0/588889210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1698108ac0 0x7f169810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.461+0000 7f16a021c640 1 --2- 172.21.15.33:0/588889210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698108170 0x7f1698108580 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.461+0000 7f16a021c640 1 --2- 172.21.15.33:0/588889210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1698102880 0x7f1698102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.461+0000 7f16a021c640 1 -- 172.21.15.33:0/588889210 >> 172.21.15.33:0/588889210 conn(0x7f1698079530 msgr2=0x7f1698079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.461+0000 7f16a021c640 1 -- 172.21.15.33:0/588889210 shutdown_connections 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.461+0000 7f16a021c640 1 -- 172.21.15.33:0/588889210 wait complete. 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f16a021c640 1 Processor -- start 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f16a021c640 1 -- start start 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f16a021c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1698102880 0x7f169819b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f16a021c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698108170 0x7f169819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f16a021c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1698108ac0 0x7f169819bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f16a021c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f16981127a0 con 0x7f1698108170 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f16a021c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1698112620 con 0x7f1698108ac0 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f16a021c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1698112920 con 0x7f1698102880 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f169d7b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698108170 0x7f169819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f169d7b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698108170 0x7f169819b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49446/0 (socket says 172.21.15.33:49446) 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f169d7b7640 1 -- 172.21.15.33:0/3657541243 learned_addr learned my addr 172.21.15.33:0/3657541243 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f169e7b9640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1698108ac0 0x7f169819bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f169dfb8640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1698102880 0x7f169819b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f169d7b7640 1 -- 172.21.15.33:0/3657541243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1698102880 msgr2=0x7f169819b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f169d7b7640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1698102880 0x7f169819b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f169d7b7640 1 -- 172.21.15.33:0/3657541243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1698108ac0 msgr2=0x7f169819bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f169d7b7640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1698108ac0 0x7f169819bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.462+0000 7f169d7b7640 1 -- 172.21.15.33:0/3657541243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16981a62f0 con 0x7f1698108170 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.463+0000 7f169d7b7640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698108170 0x7f169819b630 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f168c02a930 tx=0x7f168c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.463+0000 7f1696ffd640 1 -- 172.21.15.33:0/3657541243 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c03f030 con 0x7f1698108170 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.463+0000 7f1696ffd640 1 -- 172.21.15.33:0/3657541243 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f168c003cb0 con 0x7f1698108170 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.463+0000 7f16a021c640 1 -- 172.21.15.33:0/3657541243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16981a6580 con 0x7f1698108170 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.463+0000 7f1696ffd640 1 -- 172.21.15.33:0/3657541243 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c035070 con 0x7f1698108170 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.463+0000 7f16a021c640 1 -- 172.21.15.33:0/3657541243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16981a6ae0 con 0x7f1698108170 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.465+0000 7f1696ffd640 1 -- 172.21.15.33:0/3657541243 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f168c042030 con 0x7f1698108170 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f16a6791740 1 Processor -- start 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f16a6791740 1 -- start start 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f16a6791740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03031070 0x556e033d6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f16a6791740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e030081b0 0x556e033d6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f16a6791740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033d6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f16a6791740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556e0334d680 con 0x556e03010390 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f16a6791740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556e0333cc10 con 0x556e030081b0 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f16a6791740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556e03340bc0 con 0x556e03031070 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f169e7b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03031070 0x556e033d6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f169e7b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03031070 0x556e033d6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:44916/0 (socket says 172.21.15.33:44916) 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f169e7b9640 1 -- 172.21.15.33:0/387637243 learned_addr learned my addr 172.21.15.33:0/387637243 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.466+0000 7f169dfb8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e030081b0 0x556e033d6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f169d7b7640 1 --2- 172.21.15.33:0/387637243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033d6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f169e7b9640 1 -- 172.21.15.33:0/387637243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e030081b0 msgr2=0x556e033d6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f169e7b9640 1 --2- 172.21.15.33:0/387637243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e030081b0 0x556e033d6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f1696ffd640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16800b4cd0 0x7f16800b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f169e7b9640 1 -- 172.21.15.33:0/387637243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 msgr2=0x556e033d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f169e7b9640 1 --2- 172.21.15.33:0/387637243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033d6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f169e7b9640 1 -- 172.21.15.33:0/387637243 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e0309c650 con 0x556e03031070 2024-08-28T19:42:18.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f169d7b7640 1 --2- 172.21.15.33:0/387637243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033d6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:18.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f1696ffd640 1 -- 172.21.15.33:0/3657541243 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f168c105f10 con 0x7f1698108170 2024-08-28T19:42:18.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f169e7b9640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16800b4cd0 0x7f16800b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f169e7b9640 1 --2- 172.21.15.33:0/387637243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03031070 0x556e033d6350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f169000a430 tx=0x7f1690009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556357160448cc8b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:18.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f167ffff640 1 -- 172.21.15.33:0/387637243 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690010bb0 con 0x556e03031070 2024-08-28T19:42:18.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f167ffff640 1 -- 172.21.15.33:0/387637243 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1690020da0 con 0x556e03031070 2024-08-28T19:42:18.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.467+0000 7f167ffff640 1 -- 172.21.15.33:0/387637243 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690014be0 con 0x556e03031070 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.468+0000 7f16a6791740 1 -- 172.21.15.33:0/387637243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03031070 msgr2=0x556e033d6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.468+0000 7f16a6791740 1 --2- 172.21.15.33:0/387637243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03031070 0x556e033d6350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f169000a430 tx=0x7f1690009650 comp rx=0 tx=0).stop 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.468+0000 7f169e7b9640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16800b4cd0 0x7f16800b71e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f169001b000 tx=0x7f169001c000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.468+0000 7f16a6791740 1 -- 172.21.15.33:0/387637243 shutdown_connections 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.468+0000 7f16a6791740 1 --2- 172.21.15.33:0/387637243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033d6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.468+0000 7f16a6791740 1 --2- 172.21.15.33:0/387637243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e030081b0 0x556e033d6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.468+0000 7f16a6791740 1 --2- 172.21.15.33:0/387637243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03031070 0x556e033d6350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.468+0000 7f16a6791740 1 -- 172.21.15.33:0/387637243 >> 172.21.15.33:0/387637243 conn(0x556e03025460 msgr2=0x556e033d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.468+0000 7f16a6791740 1 -- 172.21.15.33:0/387637243 shutdown_connections 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.469+0000 7f16a6791740 1 -- 172.21.15.33:0/387637243 wait complete. 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.469+0000 7f16a6791740 1 -- start start 2024-08-28T19:42:18.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.469+0000 7f16a6791740 1 Processor -- start 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.469+0000 7f16a6791740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e030081b0 0x556e033e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.469+0000 7f16a6791740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033e1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.469+0000 7f16a6791740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03031070 0x556e033f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f16a6791740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556e0319f700 con 0x556e03010390 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f16a6791740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556e032c3750 con 0x556e03031070 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f16a6791740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556e033e8ee0 con 0x556e030081b0 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f16a6791740 10 client.0 _ll_register_callbacks cb 0x556e032f2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169d7b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033e1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169d7b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033e1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49458/0 (socket says 172.21.15.33:49458) 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169d7b7640 1 -- 172.21.15.33:0/3441497453 learned_addr learned my addr 172.21.15.33:0/3441497453 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169dfb8640 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e030081b0 0x556e033e1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169e7b9640 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03031070 0x556e033f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169d7b7640 1 -- 172.21.15.33:0/3441497453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e030081b0 msgr2=0x556e033e1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169d7b7640 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e030081b0 0x556e033e1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169d7b7640 1 -- 172.21.15.33:0/3441497453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03031070 msgr2=0x556e033f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169d7b7640 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03031070 0x556e033f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169d7b7640 1 -- 172.21.15.33:0/3441497453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e032fc900 con 0x556e03010390 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f169d7b7640 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033e1f90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f168c1038c0 tx=0x7f168c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43231896ddbb6a77 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f167d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f167d7fa640 1 -- 172.21.15.33:0/3441497453 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c049050 con 0x556e03010390 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f167d7fa640 1 -- 172.21.15.33:0/3441497453 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f168c0c84f0 con 0x556e03010390 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.470+0000 7f16a6791740 1 -- 172.21.15.33:0/3441497453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1690020da0 con 0x556e03010390 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f167d7fa640 1 -- 172.21.15.33:0/3441497453 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f168c0cb9d0 con 0x556e03010390 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f16a6791740 10 client.18369 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f16a6791740 1 -- 172.21.15.33:0/3441497453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556e033f4bc0 con 0x556e03010390 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f167d7fa640 1 -- 172.21.15.33:0/3441497453 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1690020da0 con 0x556e03010390 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f167d7fa640 1 -- 172.21.15.33:0/3441497453 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f168c03bbe0 con 0x556e03010390 2024-08-28T19:42:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f16a6791740 10 client.18369 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f16a6791740 10 client.18369 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f16a6791740 20 client.18369 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f16a6791740 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556e02fef9f0 0x556e033f8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f16a6791740 4 client.18369 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f16a6791740 1 -- 172.21.15.33:0/3441497453 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e0334f5d0 con 0x556e02fef9f0 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.471+0000 7f169dfb8640 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556e02fef9f0 0x556e033f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.472+0000 7f169dfb8640 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556e02fef9f0 0x556e033f8000 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c23771dc8362dc8 server_cookie=5db9956f8f1ee91d in_seq=0 out_seq=0 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.472+0000 7f167d7fa640 10 client.18369 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.472+0000 7f167d7fa640 1 -- 172.21.15.33:0/3441497453 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556e0334f5d0 con 0x556e02fef9f0 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.472+0000 7f167d7fa640 10 client.18369 handle_command_reply: tid=0 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 client.18369 shutdown 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 -- 172.21.15.33:0/3441497453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 msgr2=0x556e033e1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033e1f90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f168c1038c0 tx=0x7f168c02a410 comp rx=0 tx=0).stop 2024-08-28T19:42:18.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 -- 172.21.15.33:0/3441497453 shutdown_connections 2024-08-28T19:42:18.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556e02fef9f0 0x556e033f8000 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03031070 0x556e033f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03010390 0x556e033e1f90 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 --2- 172.21.15.33:0/3441497453 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e030081b0 0x556e033e1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 -- 172.21.15.33:0/3441497453 >> 172.21.15.33:0/3441497453 conn(0x556e03025460 msgr2=0x556e033d94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:18.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f167d7fa640 0 client.18369 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:42:18.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 -- 172.21.15.33:0/3441497453 shutdown_connections 2024-08-28T19:42:18.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 1 -- 172.21.15.33:0/3441497453 wait complete. 2024-08-28T19:42:18.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.473+0000 7f16a6791740 20 client.18369 trim_cache size 0 max 16384 2024-08-28T19:42:18.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f16a6791740 1 Processor -- start 2024-08-28T19:42:18.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f16a6791740 1 -- start start 2024-08-28T19:42:18.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f16a6791740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e030081b0 0x556e033d9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f16a6791740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03010390 0x556e033dec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f16a6791740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03031070 0x556e033df180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f16a6791740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f16981aea30 con 0x556e03031070 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f16a6791740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16981b0570 con 0x556e03010390 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f16a6791740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f16981af100 con 0x556e030081b0 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f169e7b9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03031070 0x556e033df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f169dfb8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e030081b0 0x556e033d9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f169d7b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03010390 0x556e033dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f169e7b9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03031070 0x556e033df180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49466/0 (socket says 172.21.15.33:49466) 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.487+0000 7f169e7b9640 1 -- 172.21.15.33:0/1685838944 learned_addr learned my addr 172.21.15.33:0/1685838944 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.488+0000 7f169d7b7640 1 -- 172.21.15.33:0/1685838944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e030081b0 msgr2=0x556e033d9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:18.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.488+0000 7f169d7b7640 1 --2- 172.21.15.33:0/1685838944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e030081b0 0x556e033d9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.488+0000 7f169d7b7640 1 -- 172.21.15.33:0/1685838944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03031070 msgr2=0x556e033df180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.488+0000 7f169d7b7640 1 --2- 172.21.15.33:0/1685838944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03031070 0x556e033df180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.488+0000 7f169d7b7640 1 -- 172.21.15.33:0/1685838944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e033d8870 con 0x556e03010390 2024-08-28T19:42:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.488+0000 7f169e7b9640 1 --2- 172.21.15.33:0/1685838944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03031070 0x556e033df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.488+0000 7f169d7b7640 1 --2- 172.21.15.33:0/1685838944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03010390 0x556e033dec40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f168c0c82e0 tx=0x7f168c005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26a359ea423b6692 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.488+0000 7f167f7fe640 1 -- 172.21.15.33:0/1685838944 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c049070 con 0x556e03010390 2024-08-28T19:42:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.488+0000 7f167f7fe640 1 -- 172.21.15.33:0/1685838944 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f168c0cbd70 con 0x556e03010390 2024-08-28T19:42:18.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.488+0000 7f167f7fe640 1 -- 172.21.15.33:0/1685838944 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c03bbe0 con 0x556e03010390 2024-08-28T19:42:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.489+0000 7f16a6791740 1 -- 172.21.15.33:0/1685838944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03010390 msgr2=0x556e033dec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.489+0000 7f16a6791740 1 --2- 172.21.15.33:0/1685838944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03010390 0x556e033dec40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f168c0c82e0 tx=0x7f168c005de0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.489+0000 7f16a6791740 1 -- 172.21.15.33:0/1685838944 shutdown_connections 2024-08-28T19:42:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.489+0000 7f16a6791740 1 --2- 172.21.15.33:0/1685838944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e03031070 0x556e033df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.489+0000 7f16a6791740 1 --2- 172.21.15.33:0/1685838944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03010390 0x556e033dec40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.489+0000 7f16a6791740 1 --2- 172.21.15.33:0/1685838944 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e030081b0 0x556e033d9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.489+0000 7f16a6791740 1 -- 172.21.15.33:0/1685838944 >> 172.21.15.33:0/1685838944 conn(0x556e03025460 msgr2=0x556e033d9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.489+0000 7f16a6791740 1 -- 172.21.15.33:0/1685838944 shutdown_connections 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.489+0000 7f16a6791740 1 -- 172.21.15.33:0/1685838944 wait complete. 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f16a6791740 1 -- start start 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f16a6791740 1 Processor -- start 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f16a6791740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e030081b0 0x556e033eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f16a6791740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03010390 0x556e033eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f16a6791740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03031070 0x556e0345b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f16a6791740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f16981afea0 con 0x556e030081b0 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f16a6791740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16981af7d0 con 0x556e03031070 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f16a6791740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f16981aca30 con 0x556e03010390 2024-08-28T19:42:18.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f169dfb8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e030081b0 0x556e033eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f16a6791740 10 client.0 _ll_register_callbacks cb 0x7f168c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f169dfb8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e030081b0 0x556e033eaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49470/0 (socket says 172.21.15.33:49470) 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.490+0000 7f169dfb8640 1 -- 172.21.15.33:0/393501926 learned_addr learned my addr 172.21.15.33:0/393501926 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f169d7b7640 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03010390 0x556e033eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f169e7b9640 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03031070 0x556e0345b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f169dfb8640 1 -- 172.21.15.33:0/393501926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03010390 msgr2=0x556e033eafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f169dfb8640 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03010390 0x556e033eafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f169dfb8640 1 -- 172.21.15.33:0/393501926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03031070 msgr2=0x556e0345b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f169dfb8640 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03031070 0x556e0345b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f169dfb8640 1 -- 172.21.15.33:0/393501926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e0345bfd0 con 0x556e030081b0 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f169d7b7640 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03010390 0x556e033eafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f169dfb8640 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e030081b0 0x556e033eaa00 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x556e033d4fd0 tx=0x7f16880039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df928a069d3f84 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f167d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:18.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f167d7fa640 1 -- 172.21.15.33:0/393501926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168801c620 con 0x556e030081b0 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f167d7fa640 1 -- 172.21.15.33:0/393501926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f168801c7c0 con 0x556e030081b0 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.491+0000 7f16a6791740 1 -- 172.21.15.33:0/393501926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f168c0cbd70 con 0x556e030081b0 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f167d7fa640 1 -- 172.21.15.33:0/393501926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f168802c050 con 0x556e030081b0 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f16a6791740 10 client.18375 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f16a6791740 1 -- 172.21.15.33:0/393501926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556e03463350 con 0x556e030081b0 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f167d7fa640 1 -- 172.21.15.33:0/393501926 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f168c0cbd70 con 0x556e030081b0 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f167d7fa640 1 -- 172.21.15.33:0/393501926 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1688023bd0 con 0x556e030081b0 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f16a6791740 10 client.18375 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f16a6791740 10 client.18375 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f16a6791740 20 client.18375 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f16a6791740 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556e02fc4da0 0x556e03465af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f16a6791740 4 client.18375 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:42:18.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f16a6791740 1 -- 172.21.15.33:0/393501926 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e0334b070 con 0x556e02fc4da0 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.492+0000 7f169d7b7640 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556e02fc4da0 0x556e03465af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.493+0000 7f167d7fa640 10 client.18375 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.493+0000 7f169d7b7640 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556e02fc4da0 0x556e03465af0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2282af16d98702f server_cookie=be07f3967ff53d1e in_seq=0 out_seq=0 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.493+0000 7f167d7fa640 1 -- 172.21.15.33:0/393501926 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e0334b070 con 0x556e02fc4da0 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.493+0000 7f167d7fa640 10 client.18375 handle_command_reply: tid=0 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.493+0000 7f16a6791740 1 client.18375 shutdown 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.493+0000 7f16a6791740 1 -- 172.21.15.33:0/393501926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e030081b0 msgr2=0x556e033eaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.493+0000 7f16a6791740 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e030081b0 0x556e033eaa00 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x556e033d4fd0 tx=0x7f16880039c0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a6791740 1 -- 172.21.15.33:0/393501926 shutdown_connections 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a6791740 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556e02fc4da0 0x556e03465af0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a6791740 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e03031070 0x556e0345b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a6791740 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556e03010390 0x556e033eafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f167d7fa640 0 client.18375 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:42:18.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a6791740 1 --2- 172.21.15.33:0/393501926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e030081b0 0x556e033eaa00 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a6791740 1 -- 172.21.15.33:0/393501926 >> 172.21.15.33:0/393501926 conn(0x556e03025460 msgr2=0x556e033d7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a6791740 1 -- 172.21.15.33:0/393501926 shutdown_connections 2024-08-28T19:42:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a6791740 1 -- 172.21.15.33:0/393501926 wait complete. 2024-08-28T19:42:18.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a6791740 20 client.18375 trim_cache size 0 max 16384 2024-08-28T19:42:18.500 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a021c640 1 -- 172.21.15.33:0/3657541243 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16800b4cd0 msgr2=0x7f16800b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a021c640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16800b4cd0 0x7f16800b71e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f169001b000 tx=0x7f169001c000 comp rx=0 tx=0).stop 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a021c640 1 -- 172.21.15.33:0/3657541243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698108170 msgr2=0x7f169819b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.494+0000 7f16a021c640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698108170 0x7f169819b630 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f168c02a930 tx=0x7f168c004270 comp rx=0 tx=0).stop 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.495+0000 7f16a021c640 1 -- 172.21.15.33:0/3657541243 shutdown_connections 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.495+0000 7f16a021c640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1698108ac0 0x7f169819bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.495+0000 7f16a021c640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1698108170 0x7f169819b630 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.495+0000 7f16a021c640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f16800b4cd0 0x7f16800b71e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.495+0000 7f16a021c640 1 --2- 172.21.15.33:0/3657541243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1698102880 0x7f169819b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.495+0000 7f16a021c640 1 -- 172.21.15.33:0/3657541243 >> 172.21.15.33:0/3657541243 conn(0x7f1698079530 msgr2=0x7f1698106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:18.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.495+0000 7f16a021c640 1 -- 172.21.15.33:0/3657541243 shutdown_connections 2024-08-28T19:42:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:18.495+0000 7f16a021c640 1 -- 172.21.15.33:0/3657541243 wait complete. 2024-08-28T19:42:18.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:18 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1659012175' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:18.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:18 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1659012175' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:18.812 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:18 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1659012175' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:19.283 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:42:19.540 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:19 smithi033 ceph-mon[18549]: pgmap v646: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-08-28T19:42:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.777+0000 7f8ff2086640 1 -- 172.21.15.33:0/2234933212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fec108ae0 msgr2=0x7f8fec10f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.777+0000 7f8ff2086640 1 --2- 172.21.15.33:0/2234933212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fec108ae0 0x7f8fec10f310 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009ca0 tx=0x7f8fe402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.777+0000 7f8ff2086640 1 -- 172.21.15.33:0/2234933212 shutdown_connections 2024-08-28T19:42:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.777+0000 7f8ff2086640 1 --2- 172.21.15.33:0/2234933212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fec108ae0 0x7f8fec10f310 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.777+0000 7f8ff2086640 1 --2- 172.21.15.33:0/2234933212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fec108190 0x7f8fec1085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.777+0000 7f8ff2086640 1 --2- 172.21.15.33:0/2234933212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fec102850 0x7f8fec102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.777+0000 7f8ff2086640 1 -- 172.21.15.33:0/2234933212 >> 172.21.15.33:0/2234933212 conn(0x7f8fec079610 msgr2=0x7f8fec079a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:19.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.777+0000 7f8ff2086640 1 -- 172.21.15.33:0/2234933212 shutdown_connections 2024-08-28T19:42:19.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.777+0000 7f8ff2086640 1 -- 172.21.15.33:0/2234933212 wait complete. 2024-08-28T19:42:19.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.778+0000 7f8ff2086640 1 Processor -- start 2024-08-28T19:42:19.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.778+0000 7f8ff2086640 1 -- start start 2024-08-28T19:42:19.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8ff2086640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fec102850 0x7f8fec19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8ff2086640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fec108190 0x7f8fec19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8ff2086640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fec108ae0 0x7f8fec19f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8ff2086640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1138c0 con 0x7f8fec102850 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8ff2086640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec113740 con 0x7f8fec108ae0 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8ff2086640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec113a40 con 0x7f8fec108190 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fec102850 0x7f8fec19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fec102850 0x7f8fec19a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49500/0 (socket says 172.21.15.33:49500) 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8feb7fe640 1 -- 172.21.15.33:0/2585588724 learned_addr learned my addr 172.21.15.33:0/2585588724 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8febfff640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fec108ae0 0x7f8fec19f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8feaffd640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fec108190 0x7f8fec19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8feb7fe640 1 -- 172.21.15.33:0/2585588724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fec108190 msgr2=0x7f8fec19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:19.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fec108190 0x7f8fec19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8feb7fe640 1 -- 172.21.15.33:0/2585588724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fec108ae0 msgr2=0x7f8fec19f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fec108ae0 0x7f8fec19f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.779+0000 7f8feb7fe640 1 -- 172.21.15.33:0/2585588724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fec1a0060 con 0x7f8fec102850 2024-08-28T19:42:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.780+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fec102850 0x7f8fec19a1b0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00c920 tx=0x7f8fdc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.780+0000 7f8fe8ff9640 1 -- 172.21.15.33:0/2585588724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc007c70 con 0x7f8fec102850 2024-08-28T19:42:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.780+0000 7f8fe8ff9640 1 -- 172.21.15.33:0/2585588724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc007e10 con 0x7f8fec102850 2024-08-28T19:42:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.780+0000 7f8ff2086640 1 -- 172.21.15.33:0/2585588724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fec1a0350 con 0x7f8fec102850 2024-08-28T19:42:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.780+0000 7f8fe8ff9640 1 -- 172.21.15.33:0/2585588724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc018820 con 0x7f8fec102850 2024-08-28T19:42:19.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.780+0000 7f8ff2086640 1 -- 172.21.15.33:0/2585588724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fec1a6b70 con 0x7f8fec102850 2024-08-28T19:42:19.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:19 smithi059 ceph-mon[22052]: pgmap v646: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-08-28T19:42:19.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.782+0000 7f8ff85fb740 1 Processor -- start 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8ff85fb740 1 -- start start 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8fe8ff9640 1 -- 172.21.15.33:0/2585588724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8fdc00f450 con 0x7f8fec102850 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808cb850 0x555b80c71f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80c72a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555b80be7380 con 0x555b808a2990 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555b80bd6910 con 0x555b808aab70 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b80bda8c0 con 0x555b808cb850 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49504/0 (socket says 172.21.15.33:49504) 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8feb7fe640 1 -- 172.21.15.33:0/3867193357 learned_addr learned my addr 172.21.15.33:0/3867193357 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:19.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8febfff640 1 --2- 172.21.15.33:0/3867193357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808cb850 0x555b80c71f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.783+0000 7f8feaffd640 1 --2- 172.21.15.33:0/3867193357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80c72a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8feb7fe640 1 -- 172.21.15.33:0/3867193357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808cb850 msgr2=0x555b80c71f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/3867193357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808cb850 0x555b80c71f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8feb7fe640 1 -- 172.21.15.33:0/3867193357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 msgr2=0x555b80c72a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/3867193357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80c72a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8feb7fe640 1 -- 172.21.15.33:0/3867193357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b80b734c0 con 0x555b808a2990 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8fe8ff9640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fd40b4cd0 0x7f8fd40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8febfff640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fd40b4cd0 0x7f8fd40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/3867193357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c724d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0e2d10 tx=0x7f8fdc0e9c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7005c2635424d66a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8fe8ff9640 1 -- 172.21.15.33:0/2585588724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f8fdc0e5a80 con 0x7f8fec102850 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8fd1ffb640 1 -- 172.21.15.33:0/3867193357 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0ef040 con 0x555b808a2990 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8fd1ffb640 1 -- 172.21.15.33:0/3867193357 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc0ab880 con 0x555b808a2990 2024-08-28T19:42:19.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.784+0000 7f8fd1ffb640 1 -- 172.21.15.33:0/3867193357 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0ab6c0 con 0x555b808a2990 2024-08-28T19:42:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.785+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3867193357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 msgr2=0x555b80c724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.785+0000 7f8febfff640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fd40b4cd0 0x7f8fd40b71e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4006010 tx=0x7f8fe402f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.785+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/3867193357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c724d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0e2d10 tx=0x7f8fdc0e9c20 comp rx=0 tx=0).stop 2024-08-28T19:42:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.785+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3867193357 shutdown_connections 2024-08-28T19:42:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.785+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/3867193357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80c72a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.785+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/3867193357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c724d0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.785+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/3867193357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808cb850 0x555b80c71f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.785+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3867193357 >> 172.21.15.33:0/3867193357 conn(0x555b808bfc40 msgr2=0x555b80c6fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:19.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.785+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3867193357 shutdown_connections 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.786+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3867193357 wait complete. 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.786+0000 7f8ff85fb740 1 -- start start 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.786+0000 7f8ff85fb740 1 Processor -- start 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c7d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808aab70 0x555b80c7db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808cb850 0x555b80c7e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555b80a397b0 con 0x555b808a2990 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555b80b5d460 con 0x555b808cb850 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555b80c80770 con 0x555b808aab70 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8ff85fb740 10 client.0 _ll_register_callbacks cb 0x555b80b82fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c7d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c7d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49508/0 (socket says 172.21.15.33:49508) 2024-08-28T19:42:19.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8feb7fe640 1 -- 172.21.15.33:0/764663364 learned_addr learned my addr 172.21.15.33:0/764663364 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8feaffd640 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808aab70 0x555b80c7db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8febfff640 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808cb850 0x555b80c7e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8feb7fe640 1 -- 172.21.15.33:0/764663364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808aab70 msgr2=0x555b80c7db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808aab70 0x555b80c7db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8feb7fe640 1 -- 172.21.15.33:0/764663364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808cb850 msgr2=0x555b80c7e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808cb850 0x555b80c7e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.787+0000 7f8feb7fe640 1 -- 172.21.15.33:0/764663364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b80945ba0 con 0x555b808a2990 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.788+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c7d620 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00fea0 tx=0x7f8fdc00fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced6c8d732df77cd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.788+0000 7f8fcaffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.788+0000 7f8fcaffd640 1 -- 172.21.15.33:0/764663364 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0ab4e0 con 0x555b808a2990 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.788+0000 7f8fcaffd640 1 -- 172.21.15.33:0/764663364 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f8fdc0930d0 con 0x555b808a2990 2024-08-28T19:42:19.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.788+0000 7f8ff85fb740 1 -- 172.21.15.33:0/764663364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fdc0ab880 con 0x555b808a2990 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.788+0000 7f8fcaffd640 1 -- 172.21.15.33:0/764663364 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8fdc0ab6c0 con 0x555b808a2990 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.788+0000 7f8ff85fb740 10 client.18387 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.788+0000 7f8ff85fb740 1 -- 172.21.15.33:0/764663364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555b80c8c800 con 0x555b808a2990 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.788+0000 7f8fcaffd640 1 -- 172.21.15.33:0/764663364 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc0ab880 con 0x555b808a2990 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.789+0000 7f8fcaffd640 1 -- 172.21.15.33:0/764663364 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8fdc0a8000 con 0x555b808a2990 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.789+0000 7f8ff85fb740 10 client.18387 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.789+0000 7f8ff85fb740 10 client.18387 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.789+0000 7f8ff85fb740 20 client.18387 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.789+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555b8088a1d0 0x555b80c8fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.789+0000 7f8ff85fb740 4 client.18387 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.789+0000 7f8ff85fb740 1 -- 172.21.15.33:0/764663364 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b80be92d0 con 0x555b8088a1d0 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.789+0000 7f8feaffd640 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555b8088a1d0 0x555b80c8fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.789+0000 7f8fcaffd640 10 client.18387 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.789+0000 7f8feaffd640 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555b8088a1d0 0x555b80c8fb60 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=248cfa44b4d20e17 server_cookie=89ab1d9ddba0c26e in_seq=0 out_seq=0 2024-08-28T19:42:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.790+0000 7f8fcaffd640 1 -- 172.21.15.33:0/764663364 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b80be92d0 con 0x555b8088a1d0 2024-08-28T19:42:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.790+0000 7f8fcaffd640 10 client.18387 handle_command_reply: tid=0 2024-08-28T19:42:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.790+0000 7f8ff85fb740 1 client.18387 shutdown 2024-08-28T19:42:19.795 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:19 smithi122 ceph-mon[22174]: pgmap v646: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-08-28T19:42:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 1 -- 172.21.15.33:0/764663364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 msgr2=0x555b80c7d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c7d620 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00fea0 tx=0x7f8fdc00fcc0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 1 -- 172.21.15.33:0/764663364 shutdown_connections 2024-08-28T19:42:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808cb850 0x555b80c7e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808aab70 0x555b80c7db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555b8088a1d0 0x555b80c8fb60 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8fcaffd640 0 client.18387 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/764663364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c7d620 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 1 -- 172.21.15.33:0/764663364 >> 172.21.15.33:0/764663364 conn(0x555b808bfc40 msgr2=0x555b80c75120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 1 -- 172.21.15.33:0/764663364 shutdown_connections 2024-08-28T19:42:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 1 -- 172.21.15.33:0/764663364 wait complete. 2024-08-28T19:42:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.791+0000 7f8ff85fb740 20 client.18387 trim_cache size 0 max 16384 2024-08-28T19:42:19.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8ff85fb740 1 Processor -- start 2024-08-28T19:42:19.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8ff85fb740 1 -- start start 2024-08-28T19:42:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8088a1d0 0x555b80c6eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808a2990 0x555b80c6fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80c7f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1b2e60 con 0x555b8088a1d0 2024-08-28T19:42:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1b49a0 con 0x555b808aab70 2024-08-28T19:42:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1b3530 con 0x555b808a2990 2024-08-28T19:42:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8088a1d0 0x555b80c6eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8feb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8088a1d0 0x555b80c6eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49514/0 (socket says 172.21.15.33:49514) 2024-08-28T19:42:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8feb7fe640 1 -- 172.21.15.33:0/412055170 learned_addr learned my addr 172.21.15.33:0/412055170 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8febfff640 1 --2- 172.21.15.33:0/412055170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80c7f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.810+0000 7f8feaffd640 1 --2- 172.21.15.33:0/412055170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808a2990 0x555b80c6fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.811+0000 7f8feb7fe640 1 -- 172.21.15.33:0/412055170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808a2990 msgr2=0x555b80c6fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.811+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/412055170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808a2990 0x555b80c6fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.811+0000 7f8feb7fe640 1 -- 172.21.15.33:0/412055170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 msgr2=0x555b80c7f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.811+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/412055170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80c7f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.811+0000 7f8feb7fe640 1 -- 172.21.15.33:0/412055170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b80c7bb20 con 0x555b8088a1d0 2024-08-28T19:42:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.811+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/412055170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8088a1d0 0x555b80c6eee0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00c8f0 tx=0x7f8fdc0e9c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14a5365482bcee3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.811+0000 7f8fd17fa640 1 -- 172.21.15.33:0/412055170 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0a7c30 con 0x555b8088a1d0 2024-08-28T19:42:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.811+0000 7f8fd17fa640 1 -- 172.21.15.33:0/412055170 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc0cee50 con 0x555b8088a1d0 2024-08-28T19:42:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.811+0000 7f8fd17fa640 1 -- 172.21.15.33:0/412055170 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0ab880 con 0x555b8088a1d0 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.812+0000 7f8ff85fb740 1 -- 172.21.15.33:0/412055170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8088a1d0 msgr2=0x555b80c6eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.812+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/412055170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8088a1d0 0x555b80c6eee0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00c8f0 tx=0x7f8fdc0e9c20 comp rx=0 tx=0).stop 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.812+0000 7f8ff85fb740 1 -- 172.21.15.33:0/412055170 shutdown_connections 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.812+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/412055170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80c7f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.812+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/412055170 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b808a2990 0x555b80c6fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.812+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/412055170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b8088a1d0 0x555b80c6eee0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.812+0000 7f8ff85fb740 1 -- 172.21.15.33:0/412055170 >> 172.21.15.33:0/412055170 conn(0x555b808bfc40 msgr2=0x555b80c7eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.812+0000 7f8ff85fb740 1 -- 172.21.15.33:0/412055170 shutdown_connections 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.812+0000 7f8ff85fb740 1 -- 172.21.15.33:0/412055170 wait complete. 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8ff85fb740 1 -- start start 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8ff85fb740 1 Processor -- start 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8088a1d0 0x555b80c92620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c92bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8ff85fb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80cf32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1b42d0 con 0x555b808a2990 2024-08-28T19:42:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1b3c00 con 0x555b808aab70 2024-08-28T19:42:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8ff85fb740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1b0e60 con 0x555b8088a1d0 2024-08-28T19:42:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8ff85fb740 10 client.0 _ll_register_callbacks cb 0x7f8fdc0e9300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8feaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c92bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8feaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c92bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49528/0 (socket says 172.21.15.33:49528) 2024-08-28T19:42:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.813+0000 7f8feaffd640 1 -- 172.21.15.33:0/3676390182 learned_addr learned my addr 172.21.15.33:0/3676390182 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:19.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8febfff640 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80cf32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8088a1d0 0x555b80c92620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8feaffd640 1 -- 172.21.15.33:0/3676390182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8088a1d0 msgr2=0x555b80c92620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:19.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8feaffd640 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8088a1d0 0x555b80c92620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8feaffd640 1 -- 172.21.15.33:0/3676390182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 msgr2=0x555b80cf32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:19.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8feaffd640 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80cf32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8feaffd640 1 -- 172.21.15.33:0/3676390182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b80cf3920 con 0x555b808a2990 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8feaffd640 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c92bc0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8fec06a630 tx=0x7f8fe001e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a4ebf81c6cd6fc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8fcaffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8fcaffd640 1 -- 172.21.15.33:0/3676390182 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0027030 con 0x555b808a2990 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3676390182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fdc0cee50 con 0x555b808a2990 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.814+0000 7f8fcaffd640 1 -- 172.21.15.33:0/3676390182 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f8fe0020040 con 0x555b808a2990 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8fcaffd640 1 -- 172.21.15.33:0/3676390182 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8fe0031050 con 0x555b808a2990 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8ff85fb740 10 client.18393 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3676390182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555b80cfbea0 con 0x555b808a2990 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8fcaffd640 1 -- 172.21.15.33:0/3676390182 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc0cee50 con 0x555b808a2990 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8fcaffd640 1 -- 172.21.15.33:0/3676390182 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8fe0005570 con 0x555b808a2990 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8ff85fb740 10 client.18393 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8ff85fb740 10 client.18393 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8ff85fb740 20 client.18393 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555b808cb850 0x555b80cfe730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:19.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8ff85fb740 4 client.18393 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.05, "await_for": 45.0}] 2024-08-28T19:42:19.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3676390182 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.05, "await_for": 45.0}) -- 0x555b80be4d70 con 0x555b808cb850 2024-08-28T19:42:19.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.815+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555b808cb850 0x555b80cfe730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:19.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.816+0000 7f8fcaffd640 10 client.18393 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:19.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.816+0000 7f8feb7fe640 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555b808cb850 0x555b80cfe730 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee6c3ca1ce543387 server_cookie=506d02a887e0574d in_seq=0 out_seq=0 2024-08-28T19:42:19.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8fcaffd640 1 -- 172.21.15.33:0/3676390182 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555b80be4d70 con 0x555b808cb850 2024-08-28T19:42:19.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8fcaffd640 10 client.18393 handle_command_reply: tid=0 2024-08-28T19:42:19.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 client.18393 shutdown 2024-08-28T19:42:19.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3676390182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 msgr2=0x555b80c92bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:19.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c92bc0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8fec06a630 tx=0x7f8fe001e880 comp rx=0 tx=0).stop 2024-08-28T19:42:19.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3676390182 shutdown_connections 2024-08-28T19:42:19.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b808aab70 0x555b80cf32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555b808cb850 0x555b80cfe730 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8fcaffd640 0 client.18393 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:19.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555b808a2990 0x555b80c92bc0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 --2- 172.21.15.33:0/3676390182 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555b8088a1d0 0x555b80c92620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3676390182 >> 172.21.15.33:0/3676390182 conn(0x555b808bfc40 msgr2=0x555b80c72fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:19.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3676390182 shutdown_connections 2024-08-28T19:42:19.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 1 -- 172.21.15.33:0/3676390182 wait complete. 2024-08-28T19:42:19.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.829+0000 7f8ff85fb740 20 client.18393 trim_cache size 0 max 16384 2024-08-28T19:42:19.831 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:42:19.831 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:42:19.831 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 30, 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "fe27a785": { 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 30, 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 147.1, 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:42:19.832 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:42:19.833 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:42:19.833 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:42:19.833 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:42:19.833 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:19.833 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:19.833 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:19.833 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:19.833 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:19.833 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:42:19.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 -- 172.21.15.33:0/2585588724 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fd40b4cd0 msgr2=0x7f8fd40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fd40b4cd0 0x7f8fd40b71e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4006010 tx=0x7f8fe402f310 comp rx=0 tx=0).stop 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 -- 172.21.15.33:0/2585588724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fec102850 msgr2=0x7f8fec19a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fec102850 0x7f8fec19a1b0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00c920 tx=0x7f8fdc00cde0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 -- 172.21.15.33:0/2585588724 shutdown_connections 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fec108ae0 0x7f8fec19f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8fd40b4cd0 0x7f8fd40b71e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fec108190 0x7f8fec19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 --2- 172.21.15.33:0/2585588724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fec102850 0x7f8fec19a1b0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 -- 172.21.15.33:0/2585588724 >> 172.21.15.33:0/2585588724 conn(0x7f8fec079610 msgr2=0x7f8fec106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 -- 172.21.15.33:0/2585588724 shutdown_connections 2024-08-28T19:42:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:19.830+0000 7f8ff2086640 1 -- 172.21.15.33:0/2585588724 wait complete. 2024-08-28T19:42:20.855 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fe27a785', quiesce took 5.3 seconds. Will release after: 21.75 2024-08-28T19:42:21.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.104+0000 7f25c50fd640 1 -- 172.21.15.33:0/3892981486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25c0103900 msgr2=0x7f25c0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:21.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.104+0000 7f25c50fd640 1 --2- 172.21.15.33:0/3892981486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25c0103900 0x7f25c0103d10 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009900 tx=0x7f25b002a3f0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.104+0000 7f25c50fd640 1 -- 172.21.15.33:0/3892981486 shutdown_connections 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.104+0000 7f25c50fd640 1 --2- 172.21.15.33:0/3892981486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0109b90 0x7f25c01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.104+0000 7f25c50fd640 1 --2- 172.21.15.33:0/3892981486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c0109240 0x7f25c0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.104+0000 7f25c50fd640 1 --2- 172.21.15.33:0/3892981486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25c0103900 0x7f25c0103d10 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.104+0000 7f25c50fd640 1 -- 172.21.15.33:0/3892981486 >> 172.21.15.33:0/3892981486 conn(0x7f25c007b5f0 msgr2=0x7f25c007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.104+0000 7f25c50fd640 1 -- 172.21.15.33:0/3892981486 shutdown_connections 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.104+0000 7f25c50fd640 1 -- 172.21.15.33:0/3892981486 wait complete. 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25c50fd640 1 Processor -- start 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25c50fd640 1 -- start start 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25c50fd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c0103900 0x7f25c00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25c50fd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25c0109240 0x7f25c00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25c50fd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0109b90 0x7f25c0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25c50fd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f25c0113850 con 0x7f25c0109240 2024-08-28T19:42:21.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25c50fd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01136d0 con 0x7f25c0103900 2024-08-28T19:42:21.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25c50fd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01139d0 con 0x7f25c0109b90 2024-08-28T19:42:21.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25be59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25c0109240 0x7f25c00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25be59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25c0109240 0x7f25c00759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49546/0 (socket says 172.21.15.33:49546) 2024-08-28T19:42:21.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.105+0000 7f25be59c640 1 -- 172.21.15.33:0/3686522247 learned_addr learned my addr 172.21.15.33:0/3686522247 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:21.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25bf59e640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0109b90 0x7f25c0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25bed9d640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c0103900 0x7f25c00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25be59c640 1 -- 172.21.15.33:0/3686522247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0109b90 msgr2=0x7f25c0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25be59c640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0109b90 0x7f25c0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25be59c640 1 -- 172.21.15.33:0/3686522247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c0103900 msgr2=0x7f25c00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25be59c640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c0103900 0x7f25c00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25be59c640 1 -- 172.21.15.33:0/3686522247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c01a8450 con 0x7f25c0109240 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25bed9d640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c0103900 0x7f25c00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25be59c640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25c0109240 0x7f25c00759f0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c8c0 tx=0x7f25b400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25a7fff640 1 -- 172.21.15.33:0/3686522247 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4007bb0 con 0x7f25c0109240 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25a7fff640 1 -- 172.21.15.33:0/3686522247 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25b4007d50 con 0x7f25c0109240 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25c50fd640 1 -- 172.21.15.33:0/3686522247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c01a8740 con 0x7f25c0109240 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25a7fff640 1 -- 172.21.15.33:0/3686522247 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b40187c0 con 0x7f25c0109240 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.106+0000 7f25c50fd640 1 -- 172.21.15.33:0/3686522247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c01a8c80 con 0x7f25c0109240 2024-08-28T19:42:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25cb672740 1 Processor -- start 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25cb672740 1 -- start start 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25cb672740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4eb070 0x55fd9e890310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25a7fff640 1 -- 172.21.15.33:0/3686522247 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f25b400f450 con 0x7f25c0109240 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25cb672740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4c21b0 0x55fd9e890850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25cb672740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4ca390 0x55fd9e890d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25cb672740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fd9e807680 con 0x55fd9e4c21b0 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25cb672740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fd9e7f6c10 con 0x55fd9e4eb070 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25cb672740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fd9e7fabc0 con 0x55fd9e4ca390 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25bed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4c21b0 0x55fd9e890850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25bed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4c21b0 0x55fd9e890850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49550/0 (socket says 172.21.15.33:49550) 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.109+0000 7f25bed9d640 1 -- 172.21.15.33:0/3196845191 learned_addr learned my addr 172.21.15.33:0/3196845191 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.110+0000 7f25bf59e640 1 --2- 172.21.15.33:0/3196845191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4eb070 0x55fd9e890310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.110+0000 7f25be59c640 1 --2- 172.21.15.33:0/3196845191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4ca390 0x55fd9e890d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.110+0000 7f25bed9d640 1 -- 172.21.15.33:0/3196845191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4ca390 msgr2=0x55fd9e890d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.110+0000 7f25bed9d640 1 --2- 172.21.15.33:0/3196845191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4ca390 0x55fd9e890d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.110+0000 7f25bed9d640 1 -- 172.21.15.33:0/3196845191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4eb070 msgr2=0x55fd9e890310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.110+0000 7f25bed9d640 1 --2- 172.21.15.33:0/3196845191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4eb070 0x55fd9e890310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.110+0000 7f25bed9d640 1 -- 172.21.15.33:0/3196845191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9e556650 con 0x55fd9e4c21b0 2024-08-28T19:42:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.111+0000 7f25bed9d640 1 --2- 172.21.15.33:0/3196845191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4c21b0 0x55fd9e890850 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f25b0000c00 tx=0x7f25b0032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878a960d98da9efa server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:21.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.111+0000 7f25a7fff640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25a80b4ca0 0x7f25a80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.111+0000 7f25a57fa640 1 -- 172.21.15.33:0/3196845191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b003f070 con 0x55fd9e4c21b0 2024-08-28T19:42:21.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.111+0000 7f25a57fa640 1 -- 172.21.15.33:0/3196845191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25b0031720 con 0x55fd9e4c21b0 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.111+0000 7f25a57fa640 1 -- 172.21.15.33:0/3196845191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0035070 con 0x55fd9e4c21b0 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.111+0000 7f25bf59e640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25a80b4ca0 0x7f25a80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.111+0000 7f25a7fff640 1 -- 172.21.15.33:0/3686522247 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f25b40e5a90 con 0x7f25c0109240 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25cb672740 1 -- 172.21.15.33:0/3196845191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4c21b0 msgr2=0x55fd9e890850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25bf59e640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25a80b4ca0 0x7f25a80b71b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f25b8008e40 tx=0x7f25b80085f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25cb672740 1 --2- 172.21.15.33:0/3196845191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4c21b0 0x55fd9e890850 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f25b0000c00 tx=0x7f25b0032e70 comp rx=0 tx=0).stop 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25cb672740 1 -- 172.21.15.33:0/3196845191 shutdown_connections 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25cb672740 1 --2- 172.21.15.33:0/3196845191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4ca390 0x55fd9e890d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25cb672740 1 --2- 172.21.15.33:0/3196845191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4c21b0 0x55fd9e890850 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25cb672740 1 --2- 172.21.15.33:0/3196845191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4eb070 0x55fd9e890310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25cb672740 1 -- 172.21.15.33:0/3196845191 >> 172.21.15.33:0/3196845191 conn(0x55fd9e4df460 msgr2=0x55fd9e88e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25cb672740 1 -- 172.21.15.33:0/3196845191 shutdown_connections 2024-08-28T19:42:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25cb672740 1 -- 172.21.15.33:0/3196845191 wait complete. 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.112+0000 7f25cb672740 1 -- start start 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25cb672740 1 Processor -- start 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25cb672740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4c21b0 0x55fd9e89ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25cb672740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4ca390 0x55fd9e89bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25cb672740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4eb070 0x55fd9e8a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25cb672740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fd9e659700 con 0x55fd9e4eb070 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25cb672740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fd9e77d750 con 0x55fd9e4c21b0 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25cb672740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fd9e89ea90 con 0x55fd9e4ca390 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25cb672740 10 client.0 _ll_register_callbacks cb 0x55fd9e7ace10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25bf59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4eb070 0x55fd9e8a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25bf59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4eb070 0x55fd9e8a7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49560/0 (socket says 172.21.15.33:49560) 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25bf59e640 1 -- 172.21.15.33:0/470551699 learned_addr learned my addr 172.21.15.33:0/470551699 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25bed9d640 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4c21b0 0x55fd9e89ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25be59c640 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4ca390 0x55fd9e89bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25bf59e640 1 -- 172.21.15.33:0/470551699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4ca390 msgr2=0x55fd9e89bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25bf59e640 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4ca390 0x55fd9e89bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25bf59e640 1 -- 172.21.15.33:0/470551699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4c21b0 msgr2=0x55fd9e89ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25bf59e640 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4c21b0 0x55fd9e89ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25bf59e640 1 -- 172.21.15.33:0/470551699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9e7b6900 con 0x55fd9e4eb070 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.113+0000 7f25bed9d640 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4c21b0 0x55fd9e89ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.114+0000 7f25bf59e640 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4eb070 0x55fd9e8a7db0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f25b80085c0 tx=0x7f25b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ad7a4131b5376d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.114+0000 7f25a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.114+0000 7f25a2ff5640 1 -- 172.21.15.33:0/470551699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b801cd30 con 0x55fd9e4eb070 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.114+0000 7f25a2ff5640 1 -- 172.21.15.33:0/470551699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f25b8028480 con 0x55fd9e4eb070 2024-08-28T19:42:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.114+0000 7f25cb672740 1 -- 172.21.15.33:0/470551699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25b0031720 con 0x55fd9e4eb070 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.114+0000 7f25a2ff5640 1 -- 172.21.15.33:0/470551699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f25b8028680 con 0x55fd9e4eb070 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.114+0000 7f25cb672740 10 client.18405 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.114+0000 7f25cb672740 1 -- 172.21.15.33:0/470551699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd9e8aa890 con 0x55fd9e4eb070 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.114+0000 7f25a2ff5640 1 -- 172.21.15.33:0/470551699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25b0031720 con 0x55fd9e4eb070 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.114+0000 7f25a2ff5640 1 -- 172.21.15.33:0/470551699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f25b801d850 con 0x55fd9e4eb070 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.115+0000 7f25cb672740 10 client.18405 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.115+0000 7f25cb672740 10 client.18405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.115+0000 7f25cb672740 20 client.18405 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.115+0000 7f25cb672740 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fd9e4a99f0 0x55fd9e8ade90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.115+0000 7f25cb672740 4 client.18405 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.115+0000 7f25cb672740 1 -- 172.21.15.33:0/470551699 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd9e8095d0 con 0x55fd9e4a99f0 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.115+0000 7f25bed9d640 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fd9e4a99f0 0x55fd9e8ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.115+0000 7f25bed9d640 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fd9e4a99f0 0x55fd9e8ade90 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6234a3f9535b30e server_cookie=7ed87af7f1823e0b in_seq=0 out_seq=0 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.115+0000 7f25a2ff5640 10 client.18405 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.116+0000 7f25a2ff5640 1 -- 172.21.15.33:0/470551699 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd9e8095d0 con 0x55fd9e4a99f0 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.116+0000 7f25a2ff5640 10 client.18405 handle_command_reply: tid=0 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.116+0000 7f25cb672740 1 client.18405 shutdown 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.116+0000 7f25cb672740 1 -- 172.21.15.33:0/470551699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4eb070 msgr2=0x55fd9e8a7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.116+0000 7f25cb672740 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4eb070 0x55fd9e8a7db0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f25b80085c0 tx=0x7f25b8004a40 comp rx=0 tx=0).stop 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.117+0000 7f25cb672740 1 -- 172.21.15.33:0/470551699 shutdown_connections 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.117+0000 7f25cb672740 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fd9e4a99f0 0x55fd9e8ade90 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.117+0000 7f25a2ff5640 0 client.18405 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.117+0000 7f25cb672740 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4eb070 0x55fd9e8a7db0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.117+0000 7f25cb672740 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4ca390 0x55fd9e89bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.117+0000 7f25cb672740 1 --2- 172.21.15.33:0/470551699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4c21b0 0x55fd9e89ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.117+0000 7f25cb672740 1 -- 172.21.15.33:0/470551699 >> 172.21.15.33:0/470551699 conn(0x55fd9e4df460 msgr2=0x55fd9e8934a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.117+0000 7f25cb672740 1 -- 172.21.15.33:0/470551699 shutdown_connections 2024-08-28T19:42:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.117+0000 7f25cb672740 1 -- 172.21.15.33:0/470551699 wait complete. 2024-08-28T19:42:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.117+0000 7f25cb672740 20 client.18405 trim_cache size 0 max 16384 2024-08-28T19:42:21.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.130+0000 7f25cb672740 1 Processor -- start 2024-08-28T19:42:21.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.130+0000 7f25cb672740 1 -- start start 2024-08-28T19:42:21.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.130+0000 7f25cb672740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4a99f0 0x55fd9e899580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.130+0000 7f25cb672740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 0x55fd9e893410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.130+0000 7f25cb672740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4ca390 0x55fd9e893950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.130+0000 7f25cb672740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01b2db0 con 0x55fd9e4ca390 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.130+0000 7f25cb672740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01b48f0 con 0x55fd9e4a99f0 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.130+0000 7f25cb672740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01b3480 con 0x55fd9e4c21b0 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25bf59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4ca390 0x55fd9e893950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25bf59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4ca390 0x55fd9e893950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49564/0 (socket says 172.21.15.33:49564) 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25bf59e640 1 -- 172.21.15.33:0/3336847687 learned_addr learned my addr 172.21.15.33:0/3336847687 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25be59c640 1 --2- 172.21.15.33:0/3336847687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 0x55fd9e893410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25bed9d640 1 --2- 172.21.15.33:0/3336847687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4a99f0 0x55fd9e899580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25bf59e640 1 -- 172.21.15.33:0/3336847687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 msgr2=0x55fd9e893410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25bf59e640 1 --2- 172.21.15.33:0/3336847687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 0x55fd9e893410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25bf59e640 1 -- 172.21.15.33:0/3336847687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4a99f0 msgr2=0x55fd9e899580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:21.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25bf59e640 1 --2- 172.21.15.33:0/3336847687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4a99f0 0x55fd9e899580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25bf59e640 1 -- 172.21.15.33:0/3336847687 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9e88eb70 con 0x55fd9e4ca390 2024-08-28T19:42:21.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25bf59e640 1 --2- 172.21.15.33:0/3336847687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4ca390 0x55fd9e893950 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f25b8008590 tx=0x7f25b8008310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cf0a529621dc67 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:21.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25a4ff9640 1 -- 172.21.15.33:0/3336847687 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b801c770 con 0x55fd9e4ca390 2024-08-28T19:42:21.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25a4ff9640 1 -- 172.21.15.33:0/3336847687 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25b8004ab0 con 0x55fd9e4ca390 2024-08-28T19:42:21.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.131+0000 7f25a4ff9640 1 -- 172.21.15.33:0/3336847687 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8028820 con 0x55fd9e4ca390 2024-08-28T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.132+0000 7f25cb672740 1 -- 172.21.15.33:0/3336847687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4ca390 msgr2=0x55fd9e893950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.132+0000 7f25cb672740 1 --2- 172.21.15.33:0/3336847687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4ca390 0x55fd9e893950 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f25b8008590 tx=0x7f25b8008310 comp rx=0 tx=0).stop 2024-08-28T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.132+0000 7f25cb672740 1 -- 172.21.15.33:0/3336847687 shutdown_connections 2024-08-28T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.132+0000 7f25cb672740 1 --2- 172.21.15.33:0/3336847687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4ca390 0x55fd9e893950 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.132+0000 7f25cb672740 1 --2- 172.21.15.33:0/3336847687 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 0x55fd9e893410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.132+0000 7f25cb672740 1 --2- 172.21.15.33:0/3336847687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4a99f0 0x55fd9e899580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.132+0000 7f25cb672740 1 -- 172.21.15.33:0/3336847687 >> 172.21.15.33:0/3336847687 conn(0x55fd9e4df460 msgr2=0x55fd9e898e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.132+0000 7f25cb672740 1 -- 172.21.15.33:0/3336847687 shutdown_connections 2024-08-28T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.132+0000 7f25cb672740 1 -- 172.21.15.33:0/3336847687 wait complete. 2024-08-28T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25cb672740 1 -- start start 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25cb672740 1 Processor -- start 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25cb672740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4a99f0 0x55fd9e8a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25cb672740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 0x55fd9e8a2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25cb672740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4ca390 0x55fd9e8a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25cb672740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01b4220 con 0x55fd9e4a99f0 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25cb672740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01b3b50 con 0x55fd9e4ca390 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25cb672740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01b0db0 con 0x55fd9e4c21b0 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25bed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4a99f0 0x55fd9e8a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25cb672740 10 client.0 _ll_register_callbacks cb 0x7f25b8008870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25bed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4a99f0 0x55fd9e8a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49568/0 (socket says 172.21.15.33:49568) 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25bed9d640 1 -- 172.21.15.33:0/156577076 learned_addr learned my addr 172.21.15.33:0/156577076 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25be59c640 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 0x55fd9e8a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.133+0000 7f25bf59e640 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4ca390 0x55fd9e8a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25bed9d640 1 -- 172.21.15.33:0/156577076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 msgr2=0x55fd9e8a2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25bed9d640 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 0x55fd9e8a2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25bed9d640 1 -- 172.21.15.33:0/156577076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4ca390 msgr2=0x55fd9e8a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25bed9d640 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4ca390 0x55fd9e8a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25bed9d640 1 -- 172.21.15.33:0/156577076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9e9179d0 con 0x55fd9e4a99f0 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25be59c640 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 0x55fd9e8a2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25bed9d640 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4a99f0 0x55fd9e8a1e20 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x55fd9e88ef90 tx=0x7f25b0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb30ceb096009cf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25a2ff5640 1 -- 172.21.15.33:0/156577076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0050070 con 0x55fd9e4a99f0 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25a2ff5640 1 -- 172.21.15.33:0/156577076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f25b00055f0 con 0x55fd9e4a99f0 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25cb672740 1 -- 172.21.15.33:0/156577076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25b8004ab0 con 0x55fd9e4a99f0 2024-08-28T19:42:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25a2ff5640 1 -- 172.21.15.33:0/156577076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f25b005d050 con 0x55fd9e4a99f0 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25cb672740 10 client.18411 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.134+0000 7f25cb672740 1 -- 172.21.15.33:0/156577076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd9e918cc0 con 0x55fd9e4a99f0 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25a2ff5640 1 -- 172.21.15.33:0/156577076 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25b8004ab0 con 0x55fd9e4a99f0 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25a2ff5640 1 -- 172.21.15.33:0/156577076 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f25b003bad0 con 0x55fd9e4a99f0 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25cb672740 10 client.18411 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25cb672740 10 client.18411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25cb672740 20 client.18411 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25cb672740 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fd9e4eb070 0x55fd9e91b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25cb672740 4 client.18411 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25cb672740 1 -- 172.21.15.33:0/156577076 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd9e805070 con 0x55fd9e4eb070 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25be59c640 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fd9e4eb070 0x55fd9e91b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25be59c640 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fd9e4eb070 0x55fd9e91b090 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2ecf475799d265 server_cookie=815e4abfa583ea19 in_seq=0 out_seq=0 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.135+0000 7f25a2ff5640 10 client.18411 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25a2ff5640 1 -- 172.21.15.33:0/156577076 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd9e805070 con 0x55fd9e4eb070 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25a2ff5640 10 client.18411 handle_command_reply: tid=0 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 client.18411 shutdown 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 -- 172.21.15.33:0/156577076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4a99f0 msgr2=0x55fd9e8a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4a99f0 0x55fd9e8a1e20 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x55fd9e88ef90 tx=0x7f25b0031400 comp rx=0 tx=0).stop 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 -- 172.21.15.33:0/156577076 shutdown_connections 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fd9e4ca390 0x55fd9e8a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fd9e4c21b0 0x55fd9e8a2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fd9e4eb070 0x55fd9e91b090 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 --2- 172.21.15.33:0/156577076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fd9e4a99f0 0x55fd9e8a1e20 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 -- 172.21.15.33:0/156577076 >> 172.21.15.33:0/156577076 conn(0x55fd9e4df460 msgr2=0x55fd9e899eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25a2ff5640 0 client.18411 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:21.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 -- 172.21.15.33:0/156577076 shutdown_connections 2024-08-28T19:42:21.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 1 -- 172.21.15.33:0/156577076 wait complete. 2024-08-28T19:42:21.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25cb672740 20 client.18411 trim_cache size 0 max 16384 2024-08-28T19:42:21.143 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:42:21.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25c50fd640 1 -- 172.21.15.33:0/3686522247 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25a80b4ca0 msgr2=0x7f25a80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:21.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25c50fd640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25a80b4ca0 0x7f25a80b71b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f25b8008e40 tx=0x7f25b80085f0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25c50fd640 1 -- 172.21.15.33:0/3686522247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25c0109240 msgr2=0x7f25c00759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:21.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.136+0000 7f25c50fd640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25c0109240 0x7f25c00759f0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c8c0 tx=0x7f25b400cd80 comp rx=0 tx=0).stop 2024-08-28T19:42:21.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.137+0000 7f25c50fd640 1 -- 172.21.15.33:0/3686522247 shutdown_connections 2024-08-28T19:42:21.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.137+0000 7f25c50fd640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25a80b4ca0 0x7f25a80b71b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.137+0000 7f25c50fd640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f25c0109b90 0x7f25c0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.137+0000 7f25c50fd640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25c0109240 0x7f25c00759f0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.137+0000 7f25c50fd640 1 --2- 172.21.15.33:0/3686522247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c0103900 0x7f25c00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:21.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.137+0000 7f25c50fd640 1 -- 172.21.15.33:0/3686522247 >> 172.21.15.33:0/3686522247 conn(0x7f25c007b5f0 msgr2=0x7f25c0107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:21.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.137+0000 7f25c50fd640 1 -- 172.21.15.33:0/3686522247 shutdown_connections 2024-08-28T19:42:21.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:21.137+0000 7f25c50fd640 1 -- 172.21.15.33:0/3686522247 wait complete. 2024-08-28T19:42:21.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:21 smithi059 ceph-mon[22052]: pgmap v647: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-08-28T19:42:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:21 smithi122 ceph-mon[22174]: pgmap v647: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-08-28T19:42:21.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:21 smithi033 ceph-mon[18549]: pgmap v647: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-08-28T19:42:22.866 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:42:22.867 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:42:23.134 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:23.554 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:23 smithi033 ceph-mon[18549]: pgmap v648: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-08-28T19:42:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.649+0000 7f004920b640 1 -- 172.21.15.33:0/1315813890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0044108140 msgr2=0x7f0044108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.649+0000 7f004920b640 1 --2- 172.21.15.33:0/1315813890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0044108140 0x7f0044108550 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f0038009900 tx=0x7f003802a410 comp rx=0 tx=0).stop 2024-08-28T19:42:23.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.649+0000 7f004920b640 1 -- 172.21.15.33:0/1315813890 shutdown_connections 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.649+0000 7f004920b640 1 --2- 172.21.15.33:0/1315813890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0044108a90 0x7f004410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.649+0000 7f004920b640 1 --2- 172.21.15.33:0/1315813890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0044108140 0x7f0044108550 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.649+0000 7f004920b640 1 --2- 172.21.15.33:0/1315813890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0044102800 0x7f0044102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.649+0000 7f004920b640 1 -- 172.21.15.33:0/1315813890 >> 172.21.15.33:0/1315813890 conn(0x7f00440794d0 msgr2=0x7f00440798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.649+0000 7f004920b640 1 -- 172.21.15.33:0/1315813890 shutdown_connections 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.649+0000 7f004920b640 1 -- 172.21.15.33:0/1315813890 wait complete. 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004920b640 1 Processor -- start 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004920b640 1 -- start start 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004920b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0044102800 0x7f004419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004920b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0044108140 0x7f004419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004920b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0044108a90 0x7f004419fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004920b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0044113820 con 0x7f0044108140 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004920b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f00441136a0 con 0x7f0044102800 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004920b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f00441139a0 con 0x7f0044108a90 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0044108140 0x7f004419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0044108140 0x7f004419a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49594/0 (socket says 172.21.15.33:49594) 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.650+0000 7f004259c640 1 -- 172.21.15.33:0/3846013010 learned_addr learned my addr 172.21.15.33:0/3846013010 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f004359e640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0044108a90 0x7f004419fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f0042d9d640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0044102800 0x7f004419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f004259c640 1 -- 172.21.15.33:0/3846013010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0044108a90 msgr2=0x7f004419fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f004259c640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0044108a90 0x7f004419fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f004259c640 1 -- 172.21.15.33:0/3846013010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0044102800 msgr2=0x7f004419a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f004259c640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0044102800 0x7f004419a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f004259c640 1 -- 172.21.15.33:0/3846013010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00441a0240 con 0x7f0044108140 2024-08-28T19:42:23.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f004259c640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0044108140 0x7f004419a870 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0038032fd0 tx=0x7f0038004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f002bfff640 1 -- 172.21.15.33:0/3846013010 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003803f030 con 0x7f0044108140 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f004920b640 1 -- 172.21.15.33:0/3846013010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00441a04d0 con 0x7f0044108140 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f002bfff640 1 -- 172.21.15.33:0/3846013010 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0038004490 con 0x7f0044108140 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f002bfff640 1 -- 172.21.15.33:0/3846013010 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038035070 con 0x7f0044108140 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.651+0000 7f004920b640 1 -- 172.21.15.33:0/3846013010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00441a6c90 con 0x7f0044108140 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f002bfff640 1 -- 172.21.15.33:0/3846013010 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0038042030 con 0x7f0044108140 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f004f780740 1 Processor -- start 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f004f780740 1 -- start start 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f004f780740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abdd350 0x56419af83780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f004f780740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abb4490 0x56419af83cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f004f780740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af84200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f004f780740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56419aef95f0 con 0x56419abbc670 2024-08-28T19:42:23.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f004f780740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56419aee8b80 con 0x56419abdd350 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f004f780740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56419aeecb30 con 0x56419abb4490 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f004259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af84200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.654+0000 7f004259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af84200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49596/0 (socket says 172.21.15.33:49596) 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f004259c640 1 -- 172.21.15.33:0/1772065640 learned_addr learned my addr 172.21.15.33:0/1772065640 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f0042d9d640 1 --2- 172.21.15.33:0/1772065640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abb4490 0x56419af83cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f002bfff640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f002c0b4ca0 0x7f002c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f004359e640 1 --2- 172.21.15.33:0/1772065640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abdd350 0x56419af83780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f004359e640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f002c0b4ca0 0x7f002c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f004259c640 1 -- 172.21.15.33:0/1772065640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abb4490 msgr2=0x56419af83cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f004259c640 1 --2- 172.21.15.33:0/1772065640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abb4490 0x56419af83cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f004259c640 1 -- 172.21.15.33:0/1772065640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abdd350 msgr2=0x56419af83780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:23.668 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f004259c640 1 --2- 172.21.15.33:0/1772065640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abdd350 0x56419af83780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f002bfff640 1 -- 172.21.15.33:0/3846013010 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f0038105e00 con 0x7f0044108140 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f004259c640 1 -- 172.21.15.33:0/1772065640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419ac48930 con 0x56419abbc670 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f004259c640 1 --2- 172.21.15.33:0/1772065640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af84200 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f0038103120 tx=0x7f0038000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df687bf90bc46f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f00297fa640 1 -- 172.21.15.33:0/1772065640 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038049070 con 0x56419abbc670 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f004359e640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f002c0b4ca0 0x7f002c0b71b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f003c009990 tx=0x7f003c0096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f00297fa640 1 -- 172.21.15.33:0/1772065640 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00380cbc60 con 0x56419abbc670 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.655+0000 7f00297fa640 1 -- 172.21.15.33:0/1772065640 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00380cc150 con 0x56419abbc670 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.656+0000 7f004f780740 1 -- 172.21.15.33:0/1772065640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 msgr2=0x56419af84200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.656+0000 7f004f780740 1 --2- 172.21.15.33:0/1772065640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af84200 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f0038103120 tx=0x7f0038000bc0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.656+0000 7f004f780740 1 -- 172.21.15.33:0/1772065640 shutdown_connections 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.656+0000 7f004f780740 1 --2- 172.21.15.33:0/1772065640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af84200 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.656+0000 7f004f780740 1 --2- 172.21.15.33:0/1772065640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abb4490 0x56419af83cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.656+0000 7f004f780740 1 --2- 172.21.15.33:0/1772065640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abdd350 0x56419af83780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.656+0000 7f004f780740 1 -- 172.21.15.33:0/1772065640 >> 172.21.15.33:0/1772065640 conn(0x56419abd1740 msgr2=0x56419af81670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.656+0000 7f004f780740 1 -- 172.21.15.33:0/1772065640 shutdown_connections 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.656+0000 7f004f780740 1 -- 172.21.15.33:0/1772065640 wait complete. 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004f780740 1 -- start start 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004f780740 1 Processor -- start 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004f780740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abb4490 0x56419af8eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004f780740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af8f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004f780740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abdd350 0x56419af9aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004f780740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56419ad4b890 con 0x56419abbc670 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004f780740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56419ae6f790 con 0x56419abb4490 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004f780740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56419aef95f0 con 0x56419abdd350 2024-08-28T19:42:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004f780740 10 client.0 _ll_register_callbacks cb 0x56419abf4ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af8f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af8f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49612/0 (socket says 172.21.15.33:49612) 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f004259c640 1 -- 172.21.15.33:0/3427666929 learned_addr learned my addr 172.21.15.33:0/3427666929 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.657+0000 7f0042d9d640 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abb4490 0x56419af8eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f004359e640 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abdd350 0x56419af9aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f004259c640 1 -- 172.21.15.33:0/3427666929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abdd350 msgr2=0x56419af9aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f004259c640 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abdd350 0x56419af9aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f004259c640 1 -- 172.21.15.33:0/3427666929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abb4490 msgr2=0x56419af8eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f004259c640 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abb4490 0x56419af8eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f004259c640 1 -- 172.21.15.33:0/3427666929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419aea6f30 con 0x56419abbc670 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f0042d9d640 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abb4490 0x56419af8eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f004259c640 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af8f3e0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f00380ef040 tx=0x7f003802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8595d7c64ae755d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f0026ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f0026ff5640 1 -- 172.21.15.33:0/3427666929 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038049040 con 0x56419abbc670 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f0026ff5640 1 -- 172.21.15.33:0/3427666929 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f003807f110 con 0x56419abbc670 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f004f780740 1 -- 172.21.15.33:0/3427666929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00380cbc60 con 0x56419abbc670 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f0026ff5640 1 -- 172.21.15.33:0/3427666929 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f00380cbaa0 con 0x56419abbc670 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f004f780740 10 client.18423 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f004f780740 1 -- 172.21.15.33:0/3427666929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56419af9d940 con 0x56419abbc670 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.658+0000 7f0026ff5640 1 -- 172.21.15.33:0/3427666929 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00380cbc60 con 0x56419abbc670 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.659+0000 7f0026ff5640 1 -- 172.21.15.33:0/3427666929 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f003803bc20 con 0x56419abbc670 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.659+0000 7f004f780740 10 client.18423 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.659+0000 7f004f780740 10 client.18423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.659+0000 7f004f780740 20 client.18423 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.659+0000 7f004f780740 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56419ab9bcd0 0x56419afa0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.659+0000 7f004f780740 4 client.18423 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.659+0000 7f004f780740 1 -- 172.21.15.33:0/3427666929 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56419aefb540 con 0x56419ab9bcd0 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.659+0000 7f0042d9d640 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56419ab9bcd0 0x56419afa0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.659+0000 7f0042d9d640 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56419ab9bcd0 0x56419afa0ca0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e6a526752e77b54 server_cookie=f64dbed77b253f93 in_seq=0 out_seq=0 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.659+0000 7f0026ff5640 10 client.18423 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f0026ff5640 1 -- 172.21.15.33:0/3427666929 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56419aefb540 con 0x56419ab9bcd0 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f0026ff5640 10 client.18423 handle_command_reply: tid=0 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 client.18423 shutdown 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 -- 172.21.15.33:0/3427666929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 msgr2=0x56419af8f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af8f3e0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f00380ef040 tx=0x7f003802a410 comp rx=0 tx=0).stop 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 -- 172.21.15.33:0/3427666929 shutdown_connections 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abdd350 0x56419af9aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56419ab9bcd0 0x56419afa0ca0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abbc670 0x56419af8f3e0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f0026ff5640 0 client.18423 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 --2- 172.21.15.33:0/3427666929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abb4490 0x56419af8eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 -- 172.21.15.33:0/3427666929 >> 172.21.15.33:0/3427666929 conn(0x56419abd1740 msgr2=0x56419af86910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 -- 172.21.15.33:0/3427666929 shutdown_connections 2024-08-28T19:42:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.660+0000 7f004f780740 1 -- 172.21.15.33:0/3427666929 wait complete. 2024-08-28T19:42:23.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.661+0000 7f004f780740 20 client.18423 trim_cache size 0 max 16384 2024-08-28T19:42:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.678+0000 7f004f780740 1 Processor -- start 2024-08-28T19:42:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.678+0000 7f004f780740 1 -- start start 2024-08-28T19:42:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f004f780740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abb4490 0x56419af9adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f004f780740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abbc670 0x56419af8c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f004f780740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abdd350 0x56419af8c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f004f780740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00441b0cd0 con 0x56419abb4490 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f004f780740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f00441b2810 con 0x56419abdd350 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f004f780740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f00441b13a0 con 0x56419abbc670 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f0042d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abb4490 0x56419af9adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f0042d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abb4490 0x56419af9adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49620/0 (socket says 172.21.15.33:49620) 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f0042d9d640 1 -- 172.21.15.33:0/4153410056 learned_addr learned my addr 172.21.15.33:0/4153410056 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f004259c640 1 --2- 172.21.15.33:0/4153410056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abbc670 0x56419af8c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f004359e640 1 --2- 172.21.15.33:0/4153410056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abdd350 0x56419af8c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f0042d9d640 1 -- 172.21.15.33:0/4153410056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abbc670 msgr2=0x56419af8c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f0042d9d640 1 --2- 172.21.15.33:0/4153410056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abbc670 0x56419af8c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f0042d9d640 1 -- 172.21.15.33:0/4153410056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abdd350 msgr2=0x56419af8c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f0042d9d640 1 --2- 172.21.15.33:0/4153410056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abdd350 0x56419af8c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f0042d9d640 1 -- 172.21.15.33:0/4153410056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419af7ce50 con 0x56419abb4490 2024-08-28T19:42:23.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f0042d9d640 1 --2- 172.21.15.33:0/4153410056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abb4490 0x56419af9adc0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x56419afa1350 tx=0x7f0034013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a918bdcf8a4ac71f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:23.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.679+0000 7f0028ff9640 1 -- 172.21.15.33:0/4153410056 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034013110 con 0x56419abb4490 2024-08-28T19:42:23.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f0028ff9640 1 -- 172.21.15.33:0/4153410056 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00340132b0 con 0x56419abb4490 2024-08-28T19:42:23.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f0028ff9640 1 -- 172.21.15.33:0/4153410056 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003401d430 con 0x56419abb4490 2024-08-28T19:42:23.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f004f780740 1 -- 172.21.15.33:0/4153410056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abb4490 msgr2=0x56419af9adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f004f780740 1 --2- 172.21.15.33:0/4153410056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abb4490 0x56419af9adc0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x56419afa1350 tx=0x7f0034013830 comp rx=0 tx=0).stop 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f004f780740 1 -- 172.21.15.33:0/4153410056 shutdown_connections 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f004f780740 1 --2- 172.21.15.33:0/4153410056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abdd350 0x56419af8c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f004f780740 1 --2- 172.21.15.33:0/4153410056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abbc670 0x56419af8c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f004f780740 1 --2- 172.21.15.33:0/4153410056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abb4490 0x56419af9adc0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f004f780740 1 -- 172.21.15.33:0/4153410056 >> 172.21.15.33:0/4153410056 conn(0x56419abd1740 msgr2=0x56419af86ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f004f780740 1 -- 172.21.15.33:0/4153410056 shutdown_connections 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.680+0000 7f004f780740 1 -- 172.21.15.33:0/4153410056 wait complete. 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004f780740 1 -- start start 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004f780740 1 Processor -- start 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004f780740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abb4490 0x56419af935b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004f780740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abbc670 0x56419af93af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004f780740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abdd350 0x56419b00a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004f780740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f00441b2140 con 0x56419abdd350 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004f780740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f00441b1a70 con 0x56419abbc670 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004f780740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f00441aecd0 con 0x56419abb4490 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004f780740 10 client.0 _ll_register_callbacks cb 0x7f003400b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004359e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abdd350 0x56419b00a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004359e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abdd350 0x56419b00a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49622/0 (socket says 172.21.15.33:49622) 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.681+0000 7f004359e640 1 -- 172.21.15.33:0/2658351039 learned_addr learned my addr 172.21.15.33:0/2658351039 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f0042d9d640 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abb4490 0x56419af935b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004259c640 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abbc670 0x56419af93af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004359e640 1 -- 172.21.15.33:0/2658351039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abb4490 msgr2=0x56419af935b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004359e640 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abb4490 0x56419af935b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004359e640 1 -- 172.21.15.33:0/2658351039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abbc670 msgr2=0x56419af93af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004359e640 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abbc670 0x56419af93af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004359e640 1 -- 172.21.15.33:0/2658351039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419b00aba0 con 0x56419abdd350 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004259c640 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abbc670 0x56419af93af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004359e640 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abdd350 0x56419b00a5e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f003c003f20 tx=0x7f003c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9a0aab02005c49 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f0026ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f0026ff5640 1 -- 172.21.15.33:0/2658351039 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c010a50 con 0x56419abdd350 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f0026ff5640 1 -- 172.21.15.33:0/2658351039 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f003c010bf0 con 0x56419abdd350 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004f780740 1 -- 172.21.15.33:0/2658351039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00340132b0 con 0x56419abdd350 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f0026ff5640 1 -- 172.21.15.33:0/2658351039 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f003c010df0 con 0x56419abdd350 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004f780740 10 client.18429 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f004f780740 1 -- 172.21.15.33:0/2658351039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56419b00bef0 con 0x56419abdd350 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.682+0000 7f0026ff5640 1 -- 172.21.15.33:0/2658351039 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00340132b0 con 0x56419abdd350 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.683+0000 7f0026ff5640 1 -- 172.21.15.33:0/2658351039 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f003c022540 con 0x56419abdd350 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.683+0000 7f004f780740 10 client.18429 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.683+0000 7f004f780740 10 client.18429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:23.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.683+0000 7f004f780740 20 client.18429 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:23.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.683+0000 7f004f780740 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56419ab71080 0x56419b00e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:23.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.683+0000 7f004f780740 4 client.18429 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:42:23.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.683+0000 7f004f780740 1 -- 172.21.15.33:0/2658351039 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56419aef6fe0 con 0x56419ab71080 2024-08-28T19:42:23.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.683+0000 7f0042d9d640 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56419ab71080 0x56419b00e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:23.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.683+0000 7f0026ff5640 10 client.18429 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:23.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.683+0000 7f0042d9d640 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56419ab71080 0x56419b00e710 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3778b65cce370a15 server_cookie=2670df7fdeff8415 in_seq=0 out_seq=0 2024-08-28T19:42:23.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f0026ff5640 1 -- 172.21.15.33:0/2658351039 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56419aef6fe0 con 0x56419ab71080 2024-08-28T19:42:23.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f0026ff5640 10 client.18429 handle_command_reply: tid=0 2024-08-28T19:42:23.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 client.18429 shutdown 2024-08-28T19:42:23.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 -- 172.21.15.33:0/2658351039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abdd350 msgr2=0x56419b00a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:23.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abdd350 0x56419b00a5e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f003c003f20 tx=0x7f003c004a40 comp rx=0 tx=0).stop 2024-08-28T19:42:23.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 -- 172.21.15.33:0/2658351039 shutdown_connections 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x56419ab71080 0x56419b00e710 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56419abdd350 0x56419b00a5e0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56419abbc670 0x56419af93af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 --2- 172.21.15.33:0/2658351039 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56419abb4490 0x56419af935b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 -- 172.21.15.33:0/2658351039 >> 172.21.15.33:0/2658351039 conn(0x56419abd1740 msgr2=0x56419af81640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f0026ff5640 0 client.18429 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 -- 172.21.15.33:0/2658351039 shutdown_connections 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.685+0000 7f004f780740 1 -- 172.21.15.33:0/2658351039 wait complete. 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004f780740 20 client.18429 trim_cache size 0 max 16384 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:42:23.690 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:42:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "95af3405-6989-47bb-8757-0c4413bc1f6d", 2024-08-28T19:42:23.691 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:42:23.691 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 -- 172.21.15.33:0/3846013010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f002c0b4ca0 msgr2=0x7f002c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f002c0b4ca0 0x7f002c0b71b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f003c009990 tx=0x7f003c0096a0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 -- 172.21.15.33:0/3846013010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0044108140 msgr2=0x7f004419a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0044108140 0x7f004419a870 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0038032fd0 tx=0x7f0038004270 comp rx=0 tx=0).stop 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 -- 172.21.15.33:0/3846013010 shutdown_connections 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f002c0b4ca0 0x7f002c0b71b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0044108a90 0x7f004419fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0044108140 0x7f004419a870 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 --2- 172.21.15.33:0/3846013010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0044102800 0x7f004419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 -- 172.21.15.33:0/3846013010 >> 172.21.15.33:0/3846013010 conn(0x7f00440794d0 msgr2=0x7f00441042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 -- 172.21.15.33:0/3846013010 shutdown_connections 2024-08-28T19:42:23.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:23.686+0000 7f004920b640 1 -- 172.21.15.33:0/3846013010 wait complete. 2024-08-28T19:42:23.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:23 smithi059 ceph-mon[22052]: pgmap v648: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-08-28T19:42:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:23 smithi122 ceph-mon[22174]: pgmap v648: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-08-28T19:42:24.390 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:42:24.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:24 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:42:24.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:24 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:24.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:24 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:42:24.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:24 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:24.647 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:24.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:24 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:42:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:24 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:24 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:42:24.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:24 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:24 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:42:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:24 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:24 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:42:24.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:24 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:42:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.147+0000 7f2af713f640 1 -- 172.21.15.33:0/2048337565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2af0102810 msgr2=0x7f2af0102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.147+0000 7f2af713f640 1 --2- 172.21.15.33:0/2048337565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2af0102810 0x7f2af0102c20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009900 tx=0x7f2ae002a410 comp rx=0 tx=0).stop 2024-08-28T19:42:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.147+0000 7f2af713f640 1 -- 172.21.15.33:0/2048337565 shutdown_connections 2024-08-28T19:42:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.147+0000 7f2af713f640 1 --2- 172.21.15.33:0/2048337565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2af0108aa0 0x7f2af010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.147+0000 7f2af713f640 1 --2- 172.21.15.33:0/2048337565 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2af0108150 0x7f2af0108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.147+0000 7f2af713f640 1 --2- 172.21.15.33:0/2048337565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2af0102810 0x7f2af0102c20 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.147+0000 7f2af713f640 1 -- 172.21.15.33:0/2048337565 >> 172.21.15.33:0/2048337565 conn(0x7f2af00794d0 msgr2=0x7f2af00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.147+0000 7f2af713f640 1 -- 172.21.15.33:0/2048337565 shutdown_connections 2024-08-28T19:42:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.147+0000 7f2af713f640 1 -- 172.21.15.33:0/2048337565 wait complete. 2024-08-28T19:42:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.147+0000 7f2af713f640 1 Processor -- start 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2af713f640 1 -- start start 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2af713f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2af0102810 0x7f2af019b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2af713f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2af0108150 0x7f2af019b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2af713f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2af0108aa0 0x7f2af019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2af713f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2af0112720 con 0x7f2af0108150 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2af713f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2af01125a0 con 0x7f2af0102810 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2af713f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2af01128a0 con 0x7f2af0108aa0 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2aeffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2af0108150 0x7f2af019b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2aeffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2af0108150 0x7f2af019b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49634/0 (socket says 172.21.15.33:49634) 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2aeffff640 1 -- 172.21.15.33:0/3219505027 learned_addr learned my addr 172.21.15.33:0/3219505027 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2af4edb640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2af0102810 0x7f2af019b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2af56dc640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2af0108aa0 0x7f2af019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2aeffff640 1 -- 172.21.15.33:0/3219505027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2af0108aa0 msgr2=0x7f2af019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2aeffff640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2af0108aa0 0x7f2af019bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2aeffff640 1 -- 172.21.15.33:0/3219505027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2af0102810 msgr2=0x7f2af019b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2aeffff640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2af0102810 0x7f2af019b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2aeffff640 1 -- 172.21.15.33:0/3219505027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af01a6310 con 0x7f2af0108150 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.148+0000 7f2aeffff640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2af0108150 0x7f2af019b590 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400d740 tx=0x7f2ae400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.149+0000 7f2aedffb640 1 -- 172.21.15.33:0/3219505027 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4017070 con 0x7f2af0108150 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.149+0000 7f2aedffb640 1 -- 172.21.15.33:0/3219505027 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ae400de50 con 0x7f2af0108150 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.149+0000 7f2af713f640 1 -- 172.21.15.33:0/3219505027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af01a6600 con 0x7f2af0108150 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.149+0000 7f2aedffb640 1 -- 172.21.15.33:0/3219505027 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4004ce0 con 0x7f2af0108150 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.149+0000 7f2af713f640 1 -- 172.21.15.33:0/3219505027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af01a6af0 con 0x7f2af0108150 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.152+0000 7f2afd6b4740 1 Processor -- start 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.152+0000 7f2afd6b4740 1 -- start start 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.152+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab350070 0x55f7ab6f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.152+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab6f5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.152+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 0x55f7ab6f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.152+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f7ab66c630 con 0x55f7ab3271b0 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.152+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f7ab65bbc0 con 0x55f7ab350070 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.152+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f7ab65fb70 con 0x55f7ab32f390 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.152+0000 7f2aedffb640 1 -- 172.21.15.33:0/3219505027 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2ae4004e80 con 0x7f2af0108150 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.152+0000 7f2af4edb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab6f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2af4edb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab6f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49646/0 (socket says 172.21.15.33:49646) 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2af4edb640 1 -- 172.21.15.33:0/2057918798 learned_addr learned my addr 172.21.15.33:0/2057918798 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2af56dc640 1 --2- 172.21.15.33:0/2057918798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab350070 0x55f7ab6f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2aeffff640 1 --2- 172.21.15.33:0/2057918798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 0x55f7ab6f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2af4edb640 1 -- 172.21.15.33:0/2057918798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 msgr2=0x55f7ab6f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2af4edb640 1 --2- 172.21.15.33:0/2057918798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 0x55f7ab6f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2af4edb640 1 -- 172.21.15.33:0/2057918798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab350070 msgr2=0x55f7ab6f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2af4edb640 1 --2- 172.21.15.33:0/2057918798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab350070 0x55f7ab6f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2af4edb640 1 -- 172.21.15.33:0/2057918798 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ab3bb650 con 0x55f7ab3271b0 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2aeffff640 1 --2- 172.21.15.33:0/2057918798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 0x55f7ab6f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2af4edb640 1 --2- 172.21.15.33:0/2057918798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab6f5800 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009900 tx=0x7f2ae0032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564e74df187d4496 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2aedffb640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ad80b4ca0 0x7f2ad80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2ad6ffd640 1 -- 172.21.15.33:0/2057918798 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0040070 con 0x55f7ab3271b0 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2ad6ffd640 1 -- 172.21.15.33:0/2057918798 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ae0032e50 con 0x55f7ab3271b0 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.153+0000 7f2af56dc640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ad80b4ca0 0x7f2ad80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2aedffb640 1 -- 172.21.15.33:0/3219505027 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f2ae40e52c0 con 0x7f2af0108150 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2ad6ffd640 1 -- 172.21.15.33:0/2057918798 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0035040 con 0x55f7ab3271b0 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2afd6b4740 1 -- 172.21.15.33:0/2057918798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 msgr2=0x55f7ab6f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2af56dc640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ad80b4ca0 0x7f2ad80b71b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8005fd0 tx=0x7f2ae8009740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:25.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/2057918798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab6f5800 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009900 tx=0x7f2ae0032c60 comp rx=0 tx=0).stop 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2afd6b4740 1 -- 172.21.15.33:0/2057918798 shutdown_connections 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/2057918798 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 0x55f7ab6f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/2057918798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab6f5800 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/2057918798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab350070 0x55f7ab6f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2afd6b4740 1 -- 172.21.15.33:0/2057918798 >> 172.21.15.33:0/2057918798 conn(0x55f7ab344460 msgr2=0x55f7ab6f31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2afd6b4740 1 -- 172.21.15.33:0/2057918798 shutdown_connections 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.154+0000 7f2afd6b4740 1 -- 172.21.15.33:0/2057918798 wait complete. 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.155+0000 7f2afd6b4740 1 -- start start 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.155+0000 7f2afd6b4740 1 Processor -- start 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab7009c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 0x55f7ab700f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab350070 0x55f7ab701460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f7ab4be700 con 0x55f7ab3271b0 2024-08-28T19:42:25.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f7ab5e2700 con 0x55f7ab350070 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f7ab703a90 con 0x55f7ab32f390 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2afd6b4740 10 client.0 _ll_register_callbacks cb 0x55f7ab611dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2af4edb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab7009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2af4edb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab7009c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49658/0 (socket says 172.21.15.33:49658) 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2af4edb640 1 -- 172.21.15.33:0/3941772787 learned_addr learned my addr 172.21.15.33:0/3941772787 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2af56dc640 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab350070 0x55f7ab701460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2aeffff640 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 0x55f7ab700f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2af4edb640 1 -- 172.21.15.33:0/3941772787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 msgr2=0x55f7ab700f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2af4edb640 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 0x55f7ab700f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2af4edb640 1 -- 172.21.15.33:0/3941772787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab350070 msgr2=0x55f7ab701460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2af4edb640 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab350070 0x55f7ab701460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2af4edb640 1 -- 172.21.15.33:0/3941772787 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ab61b8b0 con 0x55f7ab3271b0 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2af4edb640 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab7009c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00055b0 tx=0x7f2ae00050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d005d8f9231305 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2acffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2acffff640 1 -- 172.21.15.33:0/3941772787 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0035040 con 0x55f7ab3271b0 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2acffff640 1 -- 172.21.15.33:0/3941772787 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f2ae0004040 con 0x55f7ab3271b0 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.156+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3941772787 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae0032e50 con 0x55f7ab3271b0 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2acffff640 1 -- 172.21.15.33:0/3941772787 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ae0057050 con 0x55f7ab3271b0 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2afd6b4740 10 client.18441 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3941772787 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7ab70f700 con 0x55f7ab3271b0 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2acffff640 1 -- 172.21.15.33:0/3941772787 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ae0032e50 con 0x55f7ab3271b0 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2acffff640 1 -- 172.21.15.33:0/3941772787 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2ae0004c00 con 0x55f7ab3271b0 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2afd6b4740 10 client.18441 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:25.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2afd6b4740 10 client.18441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2afd6b4740 20 client.18441 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f7ab30e9f0 0x55f7ab712a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2afd6b4740 4 client.18441 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3941772787 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7ab66e580 con 0x55f7ab30e9f0 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.157+0000 7f2aeffff640 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f7ab30e9f0 0x55f7ab712a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.158+0000 7f2aeffff640 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f7ab30e9f0 0x55f7ab712a60 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e532db1d46dac36 server_cookie=bdbf1acfa3f8fff3 in_seq=0 out_seq=0 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.158+0000 7f2acffff640 10 client.18441 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.158+0000 7f2acffff640 1 -- 172.21.15.33:0/3941772787 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7ab66e580 con 0x55f7ab30e9f0 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2acffff640 10 client.18441 handle_command_reply: tid=0 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 client.18441 shutdown 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3941772787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 msgr2=0x55f7ab7009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab7009c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00055b0 tx=0x7f2ae00050e0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3941772787 shutdown_connections 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab350070 0x55f7ab701460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab32f390 0x55f7ab700f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f7ab30e9f0 0x55f7ab712a60 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3941772787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab3271b0 0x55f7ab7009c0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2acffff640 0 client.18441 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3941772787 >> 172.21.15.33:0/3941772787 conn(0x55f7ab344460 msgr2=0x55f7ab6f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3941772787 shutdown_connections 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3941772787 wait complete. 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.159+0000 7f2afd6b4740 20 client.18441 trim_cache size 0 max 16384 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2afd6b4740 1 Processor -- start 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2afd6b4740 1 -- start start 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 0x55f7ab6ff240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab3271b0 0x55f7ab6ff780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab6fdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2af01b0be0 con 0x55f7ab32f390 2024-08-28T19:42:25.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2af01b2720 con 0x55f7ab30e9f0 2024-08-28T19:42:25.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2af01b12b0 con 0x55f7ab3271b0 2024-08-28T19:42:25.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2af56dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab6fdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2af56dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab6fdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49662/0 (socket says 172.21.15.33:49662) 2024-08-28T19:42:25.208 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:42:25.208 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:42:25.208 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:42:25.208 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "95af3405-6989-47bb-8757-0c4413bc1f6d", 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.210 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.211 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:42:25.212 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:42:25.213 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.214 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.215 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.216 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:25.218 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:42:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2af56dc640 1 -- 172.21.15.33:0/1017763628 learned_addr learned my addr 172.21.15.33:0/1017763628 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2af4edb640 1 --2- 172.21.15.33:0/1017763628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 0x55f7ab6ff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2af56dc640 1 -- 172.21.15.33:0/1017763628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab3271b0 msgr2=0x55f7ab6ff780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2af56dc640 1 --2- 172.21.15.33:0/1017763628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab3271b0 0x55f7ab6ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2af56dc640 1 -- 172.21.15.33:0/1017763628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 msgr2=0x55f7ab6ff240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2af56dc640 1 --2- 172.21.15.33:0/1017763628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 0x55f7ab6ff240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.177+0000 7f2af56dc640 1 -- 172.21.15.33:0/1017763628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ab703980 con 0x55f7ab32f390 2024-08-28T19:42:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2af56dc640 1 --2- 172.21.15.33:0/1017763628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab6fdbb0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f2ae801e7c0 tx=0x7f2ae8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271c87a7e7aad9fb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2ad67fc640 1 -- 172.21.15.33:0/1017763628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8029460 con 0x55f7ab32f390 2024-08-28T19:42:25.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2ad67fc640 1 -- 172.21.15.33:0/1017763628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ae801c8e0 con 0x55f7ab32f390 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2ad67fc640 1 -- 172.21.15.33:0/1017763628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae801f930 con 0x55f7ab32f390 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2afd6b4740 1 -- 172.21.15.33:0/1017763628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 msgr2=0x55f7ab6fdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/1017763628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab6fdbb0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f2ae801e7c0 tx=0x7f2ae8015000 comp rx=0 tx=0).stop 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2afd6b4740 1 -- 172.21.15.33:0/1017763628 shutdown_connections 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/1017763628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab6fdbb0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/1017763628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab3271b0 0x55f7ab6ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/1017763628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 0x55f7ab6ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.178+0000 7f2afd6b4740 1 -- 172.21.15.33:0/1017763628 >> 172.21.15.33:0/1017763628 conn(0x55f7ab344460 msgr2=0x55f7ab6fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.179+0000 7f2afd6b4740 1 -- 172.21.15.33:0/1017763628 shutdown_connections 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.179+0000 7f2afd6b4740 1 -- 172.21.15.33:0/1017763628 wait complete. 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.179+0000 7f2afd6b4740 1 -- start start 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.179+0000 7f2afd6b4740 1 Processor -- start 2024-08-28T19:42:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.179+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 0x55f7ab713d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.179+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab3271b0 0x55f7ab714240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.179+0000 7f2afd6b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab77c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.179+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2af01b2050 con 0x55f7ab32f390 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.179+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2af01b1980 con 0x55f7ab30e9f0 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.179+0000 7f2afd6b4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2af01aebe0 con 0x55f7ab3271b0 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2afd6b4740 10 client.0 _ll_register_callbacks cb 0x7f2ae80095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af56dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab77c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af56dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab77c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49676/0 (socket says 172.21.15.33:49676) 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af56dc640 1 -- 172.21.15.33:0/3167219335 learned_addr learned my addr 172.21.15.33:0/3167219335 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af4edb640 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 0x55f7ab713d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2aeffff640 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab3271b0 0x55f7ab714240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af56dc640 1 -- 172.21.15.33:0/3167219335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab3271b0 msgr2=0x55f7ab714240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af56dc640 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab3271b0 0x55f7ab714240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af56dc640 1 -- 172.21.15.33:0/3167219335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 msgr2=0x55f7ab713d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af56dc640 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 0x55f7ab713d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af56dc640 1 -- 172.21.15.33:0/3167219335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ab714a50 con 0x55f7ab32f390 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af4edb640 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 0x55f7ab713d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2af56dc640 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab77c1e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800a010 tx=0x7f2ae8005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc563bdeb1938be7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2acffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2acffff640 1 -- 172.21.15.33:0/3167219335 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae801ce50 con 0x55f7ab32f390 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2acffff640 1 -- 172.21.15.33:0/3167219335 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f2ae8025040 con 0x55f7ab32f390 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3167219335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae801c8e0 con 0x55f7ab32f390 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2acffff640 1 -- 172.21.15.33:0/3167219335 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ae801f630 con 0x55f7ab32f390 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2afd6b4740 10 client.18447 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.180+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3167219335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7ab77d6f0 con 0x55f7ab32f390 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.181+0000 7f2acffff640 1 -- 172.21.15.33:0/3167219335 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ae801c8e0 con 0x55f7ab32f390 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.181+0000 7f2acffff640 1 -- 172.21.15.33:0/3167219335 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2ae800f040 con 0x55f7ab32f390 2024-08-28T19:42:25.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.181+0000 7f2afd6b4740 10 client.18447 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.181+0000 7f2afd6b4740 10 client.18447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.181+0000 7f2afd6b4740 20 client.18447 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.181+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f7ab350070 0x55f7ab77fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.181+0000 7f2afd6b4740 4 client.18447 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.181+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3167219335 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f7ab66a020 con 0x55f7ab350070 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.181+0000 7f2af4edb640 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f7ab350070 0x55f7ab77fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2af4edb640 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f7ab350070 0x55f7ab77fe90 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e9477564ffd2a1e server_cookie=f9efc93f734f7d5d in_seq=0 out_seq=0 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2acffff640 10 client.18447 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2acffff640 1 -- 172.21.15.33:0/3167219335 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x55f7ab66a020 con 0x55f7ab350070 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2acffff640 10 client.18447 handle_command_reply: tid=0 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 client.18447 shutdown 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3167219335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 msgr2=0x55f7ab77c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab77c1e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800a010 tx=0x7f2ae8005ac0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3167219335 shutdown_connections 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f7ab350070 0x55f7ab77fe90 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f7ab32f390 0x55f7ab77c1e0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f7ab3271b0 0x55f7ab714240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2acffff640 0 client.18447 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 --2- 172.21.15.33:0/3167219335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f7ab30e9f0 0x55f7ab713d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3167219335 >> 172.21.15.33:0/3167219335 conn(0x55f7ab344460 msgr2=0x55f7ab6ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3167219335 shutdown_connections 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 1 -- 172.21.15.33:0/3167219335 wait complete. 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.182+0000 7f2afd6b4740 20 client.18447 trim_cache size 0 max 16384 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 -- 172.21.15.33:0/3219505027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ad80b4ca0 msgr2=0x7f2ad80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ad80b4ca0 0x7f2ad80b71b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8005fd0 tx=0x7f2ae8009740 comp rx=0 tx=0).stop 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 -- 172.21.15.33:0/3219505027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2af0108150 msgr2=0x7f2af019b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2af0108150 0x7f2af019b590 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400d740 tx=0x7f2ae400dc00 comp rx=0 tx=0).stop 2024-08-28T19:42:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 -- 172.21.15.33:0/3219505027 shutdown_connections 2024-08-28T19:42:25.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ad80b4ca0 0x7f2ad80b71b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2af0108aa0 0x7f2af019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2af0108150 0x7f2af019b590 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 --2- 172.21.15.33:0/3219505027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2af0102810 0x7f2af019b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:25.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 -- 172.21.15.33:0/3219505027 >> 172.21.15.33:0/3219505027 conn(0x7f2af00794d0 msgr2=0x7f2af0101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:25.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 -- 172.21.15.33:0/3219505027 shutdown_connections 2024-08-28T19:42:25.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:25.183+0000 7f2af713f640 1 -- 172.21.15.33:0/3219505027 wait complete. 2024-08-28T19:42:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:25 smithi059 ceph-mon[22052]: pgmap v649: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 45 KiB/s wr, 14 op/s 2024-08-28T19:42:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:25 smithi122 ceph-mon[22174]: pgmap v649: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 45 KiB/s wr, 14 op/s 2024-08-28T19:42:25.869 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:25 smithi033 ceph-mon[18549]: pgmap v649: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 45 KiB/s wr, 14 op/s 2024-08-28T19:42:25.896 INFO:tasks.cephfs.filesystem:scrub status for tag:95af3405-6989-47bb-8757-0c4413bc1f6d - {'path': '/', 'tag': '95af3405-6989-47bb-8757-0c4413bc1f6d', 'options': 'recursive,force'} 2024-08-28T19:42:27.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:27 smithi059 ceph-mon[22052]: pgmap v650: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-08-28T19:42:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:27 smithi122 ceph-mon[22174]: pgmap v650: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-08-28T19:42:27.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:27 smithi033 ceph-mon[18549]: pgmap v650: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-08-28T19:42:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:29 smithi059 ceph-mon[22052]: pgmap v651: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-08-28T19:42:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:29 smithi122 ceph-mon[22174]: pgmap v651: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-08-28T19:42:29.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:29 smithi033 ceph-mon[18549]: pgmap v651: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-08-28T19:42:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:31 smithi059 ceph-mon[22052]: pgmap v652: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-28T19:42:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:31 smithi122 ceph-mon[22174]: pgmap v652: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-28T19:42:31.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:31 smithi033 ceph-mon[18549]: pgmap v652: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-28T19:42:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:33 smithi059 ceph-mon[22052]: pgmap v653: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-08-28T19:42:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:33 smithi122 ceph-mon[22174]: pgmap v653: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-08-28T19:42:33.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:33 smithi033 ceph-mon[18549]: pgmap v653: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-08-28T19:42:35.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:35 smithi059 ceph-mon[22052]: pgmap v654: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-08-28T19:42:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:35 smithi122 ceph-mon[22174]: pgmap v654: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-08-28T19:42:35.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:35 smithi033 ceph-mon[18549]: pgmap v654: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-08-28T19:42:37.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:37 smithi059 ceph-mon[22052]: pgmap v655: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-08-28T19:42:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:37 smithi122 ceph-mon[22174]: pgmap v655: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-08-28T19:42:37.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:37 smithi033 ceph-mon[18549]: pgmap v655: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-08-28T19:42:39.767 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:39 smithi122 ceph-mon[22174]: pgmap v656: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-08-28T19:42:39.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:39 smithi059 ceph-mon[22052]: pgmap v656: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-08-28T19:42:39.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:39 smithi033 ceph-mon[18549]: pgmap v656: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-08-28T19:42:41.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:41 smithi059 ceph-mon[22052]: pgmap v657: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-08-28T19:42:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:41 smithi122 ceph-mon[22174]: pgmap v657: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-08-28T19:42:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:41 smithi033 ceph-mon[18549]: pgmap v657: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-08-28T19:42:42.606 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:42:42.875 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:43.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 -- 172.21.15.33:0/1558378331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0102820 msgr2=0x7fd5f0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:43.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 --2- 172.21.15.33:0/1558378331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0102820 0x7fd5f0102c30 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009900 tx=0x7fd5ec02a410 comp rx=0 tx=0).stop 2024-08-28T19:42:43.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 -- 172.21.15.33:0/1558378331 shutdown_connections 2024-08-28T19:42:43.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 --2- 172.21.15.33:0/1558378331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108ab0 0x7fd5f010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:43.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 --2- 172.21.15.33:0/1558378331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f0108160 0x7fd5f0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:43.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 --2- 172.21.15.33:0/1558378331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0102820 0x7fd5f0102c30 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 -- 172.21.15.33:0/1558378331 >> 172.21.15.33:0/1558378331 conn(0x7fd5f00794e0 msgr2=0x7fd5f00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 -- 172.21.15.33:0/1558378331 shutdown_connections 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 -- 172.21.15.33:0/1558378331 wait complete. 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 Processor -- start 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.394+0000 7fd5f8352640 1 -- start start 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f8352640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f0102820 0x7fd5f019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f8352640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108160 0x7fd5f019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f8352640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0108ab0 0x7fd5f019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f8352640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0112800 con 0x7fd5f0108ab0 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f8352640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0112680 con 0x7fd5f0108160 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f8352640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0112980 con 0x7fd5f0102820 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f68ef640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0108ab0 0x7fd5f019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f68ef640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0108ab0 0x7fd5f019fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60826/0 (socket says 172.21.15.33:60826) 2024-08-28T19:42:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f68ef640 1 -- 172.21.15.33:0/3356373716 learned_addr learned my addr 172.21.15.33:0/3356373716 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f58ed640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108160 0x7fd5f019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f60ee640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f0102820 0x7fd5f019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f68ef640 1 -- 172.21.15.33:0/3356373716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f0102820 msgr2=0x7fd5f019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f68ef640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f0102820 0x7fd5f019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f68ef640 1 -- 172.21.15.33:0/3356373716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108160 msgr2=0x7fd5f019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f68ef640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108160 0x7fd5f019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.395+0000 7fd5f68ef640 1 -- 172.21.15.33:0/3356373716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f01a0310 con 0x7fd5f0108ab0 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.396+0000 7fd5f68ef640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0108ab0 0x7fd5f019fbe0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800b970 tx=0x7fd5e800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.396+0000 7fd5e77fe640 1 -- 172.21.15.33:0/3356373716 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8019070 con 0x7fd5f0108ab0 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.396+0000 7fd5f8352640 1 -- 172.21.15.33:0/3356373716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f01a0600 con 0x7fd5f0108ab0 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.396+0000 7fd5e77fe640 1 -- 172.21.15.33:0/3356373716 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5e8014440 con 0x7fd5f0108ab0 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.396+0000 7fd5e77fe640 1 -- 172.21.15.33:0/3356373716 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80075d0 con 0x7fd5f0108ab0 2024-08-28T19:42:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.396+0000 7fd5f8352640 1 -- 172.21.15.33:0/3356373716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f01a6d60 con 0x7fd5f0108ab0 2024-08-28T19:42:43.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.397+0000 7fd5f8352640 1 -- 172.21.15.33:0/3356373716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f0103aa0 con 0x7fd5f0108ab0 2024-08-28T19:42:43.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.400+0000 7fd5e77fe640 1 -- 172.21.15.33:0/3356373716 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd5e801c070 con 0x7fd5f0108ab0 2024-08-28T19:42:43.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.400+0000 7fd5e77fe640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5dc0b4ca0 0x7fd5dc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:43.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.400+0000 7fd5e77fe640 1 -- 172.21.15.33:0/3356373716 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7fd5e80e51a0 con 0x7fd5f0108ab0 2024-08-28T19:42:43.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.400+0000 7fd5f60ee640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5dc0b4ca0 0x7fd5dc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:43.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.401+0000 7fd5f60ee640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5dc0b4ca0 0x7fd5dc0b71b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec031440 tx=0x7fd5ec005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:43.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.403+0000 7fd5e77fe640 1 -- 172.21.15.33:0/3356373716 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd5e80ab5a0 con 0x7fd5f0108ab0 2024-08-28T19:42:43.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.627+0000 7fd5f8352640 1 -- 172.21.15.33:0/3356373716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5f0102cb0 con 0x7fd5f0108ab0 2024-08-28T19:42:43.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:43 smithi033 ceph-mon[18549]: pgmap v658: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-08-28T19:42:43.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.627+0000 7fd5e77fe640 1 -- 172.21.15.33:0/3356373716 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fd5f0102cb0 con 0x7fd5f0108ab0 2024-08-28T19:42:43.630 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:42:43.630 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:42:43.631 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:42:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 -- 172.21.15.33:0/3356373716 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5dc0b4ca0 msgr2=0x7fd5dc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5dc0b4ca0 0x7fd5dc0b71b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec031440 tx=0x7fd5ec005e80 comp rx=0 tx=0).stop 2024-08-28T19:42:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 -- 172.21.15.33:0/3356373716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0108ab0 msgr2=0x7fd5f019fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0108ab0 0x7fd5f019fbe0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800b970 tx=0x7fd5e800bd70 comp rx=0 tx=0).stop 2024-08-28T19:42:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 -- 172.21.15.33:0/3356373716 shutdown_connections 2024-08-28T19:42:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0108ab0 0x7fd5f019fbe0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108160 0x7fd5f019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5dc0b4ca0 0x7fd5dc0b71b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 --2- 172.21.15.33:0/3356373716 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f0102820 0x7fd5f019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:43.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 -- 172.21.15.33:0/3356373716 >> 172.21.15.33:0/3356373716 conn(0x7fd5f00794e0 msgr2=0x7fd5f0101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:43.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 -- 172.21.15.33:0/3356373716 shutdown_connections 2024-08-28T19:42:43.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:43.630+0000 7fd5f8352640 1 -- 172.21.15.33:0/3356373716 wait complete. 2024-08-28T19:42:43.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:43 smithi059 ceph-mon[22052]: pgmap v658: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-08-28T19:42:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:43 smithi122 ceph-mon[22174]: pgmap v658: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.9 KiB/s wr, 9 op/s 2024-08-28T19:42:44.451 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id fe27a785 --release --await' 2024-08-28T19:42:44.452 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id fe27a785 --release --await 2024-08-28T19:42:44.711 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:44.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:44 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3356373716' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:44.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:44 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3356373716' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:44.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:44 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3356373716' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.202+0000 7f78f4fe3640 1 -- 172.21.15.33:0/1081752567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f0102880 msgr2=0x7f78f0102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.202+0000 7f78f4fe3640 1 --2- 172.21.15.33:0/1081752567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f0102880 0x7f78f0102c90 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009900 tx=0x7f78e002a410 comp rx=0 tx=0).stop 2024-08-28T19:42:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.203+0000 7f78f4fe3640 1 -- 172.21.15.33:0/1081752567 shutdown_connections 2024-08-28T19:42:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.203+0000 7f78f4fe3640 1 --2- 172.21.15.33:0/1081752567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f0108b10 0x7f78f010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.203+0000 7f78f4fe3640 1 --2- 172.21.15.33:0/1081752567 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78f01081c0 0x7f78f01085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.203+0000 7f78f4fe3640 1 --2- 172.21.15.33:0/1081752567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f0102880 0x7f78f0102c90 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.203+0000 7f78f4fe3640 1 -- 172.21.15.33:0/1081752567 >> 172.21.15.33:0/1081752567 conn(0x7f78f0079510 msgr2=0x7f78f0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.203+0000 7f78f4fe3640 1 -- 172.21.15.33:0/1081752567 shutdown_connections 2024-08-28T19:42:45.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.203+0000 7f78f4fe3640 1 -- 172.21.15.33:0/1081752567 wait complete. 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.203+0000 7f78f4fe3640 1 Processor -- start 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78f4fe3640 1 -- start start 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78f4fe3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78f0102880 0x7f78f019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78f4fe3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f01081c0 0x7f78f019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78f4fe3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f0108b10 0x7f78f019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78f4fe3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f78f0113960 con 0x7f78f0108b10 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78f4fe3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01137e0 con 0x7f78f01081c0 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78f4fe3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78f0113ae0 con 0x7f78f0102880 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78eed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f0108b10 0x7f78f019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78eed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f0108b10 0x7f78f019fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60838/0 (socket says 172.21.15.33:60838) 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78eed9d640 1 -- 172.21.15.33:0/885039491 learned_addr learned my addr 172.21.15.33:0/885039491 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f01081c0 0x7f78f019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78ee59c640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78f0102880 0x7f78f019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78eed9d640 1 -- 172.21.15.33:0/885039491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78f0102880 msgr2=0x7f78f019a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78eed9d640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78f0102880 0x7f78f019a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78eed9d640 1 -- 172.21.15.33:0/885039491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f01081c0 msgr2=0x7f78f019a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78eed9d640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f01081c0 0x7f78f019a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.204+0000 7f78eed9d640 1 -- 172.21.15.33:0/885039491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f01a0280 con 0x7f78f0108b10 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.205+0000 7f78eed9d640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f0108b10 0x7f78f019fb50 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f78e800eaa0 tx=0x7f78e800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.205+0000 7f78e7fff640 1 -- 172.21.15.33:0/885039491 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8004d20 con 0x7f78f0108b10 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.205+0000 7f78e7fff640 1 -- 172.21.15.33:0/885039491 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e8005020 con 0x7f78f0108b10 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.205+0000 7f78f4fe3640 1 -- 172.21.15.33:0/885039491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f01a0570 con 0x7f78f0108b10 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.205+0000 7f78e7fff640 1 -- 172.21.15.33:0/885039491 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e80116b0 con 0x7f78f0108b10 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.205+0000 7f78f4fe3640 1 -- 172.21.15.33:0/885039491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f01a6cd0 con 0x7f78f0108b10 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.207+0000 7f78e7fff640 1 -- 172.21.15.33:0/885039491 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f78e80051d0 con 0x7f78f0108b10 2024-08-28T19:42:45.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.207+0000 7f78fb558740 1 Processor -- start 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78fb558740 1 -- start start 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78fb558740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0efd520 0x561aa12a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78fb558740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa12a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78fb558740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0edc840 0x561aa12a3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78fb558740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561aa1219a70 con 0x561aa0efd520 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78fb558740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561aa1209000 con 0x561aa0ed4660 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78fb558740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561aa120cfb0 con 0x561aa0edc840 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78e5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0efd520 0x561aa12a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78e5d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0efd520 0x561aa12a2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60840/0 (socket says 172.21.15.33:60840) 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78e5d9b640 1 -- 172.21.15.33:0/4035960458 learned_addr learned my addr 172.21.15.33:0/4035960458 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78ee59c640 1 --2- 172.21.15.33:0/4035960458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa12a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78e7fff640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78dc0b4ca0 0x7f78dc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78e5d9b640 1 -- 172.21.15.33:0/4035960458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0edc840 msgr2=0x561aa12a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/4035960458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0edc840 0x561aa12a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78e5d9b640 1 -- 172.21.15.33:0/4035960458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 msgr2=0x561aa12a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.208+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/4035960458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa12a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.209+0000 7f78e5d9b640 1 -- 172.21.15.33:0/4035960458 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561aa0f68b00 con 0x561aa0efd520 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.209+0000 7f78eed9d640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78dc0b4ca0 0x7f78dc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.209+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/4035960458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0efd520 0x561aa12a2c80 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009a80 tx=0x7f78d8009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd97fc383425508 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.209+0000 7f78e7fff640 1 -- 172.21.15.33:0/885039491 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f78e80e5ab0 con 0x7f78f0108b10 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.209+0000 7f78e4d99640 1 -- 172.21.15.33:0/4035960458 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8018020 con 0x561aa0efd520 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.209+0000 7f78e4d99640 1 -- 172.21.15.33:0/4035960458 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78d8010dc0 con 0x561aa0efd520 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.209+0000 7f78e4d99640 1 -- 172.21.15.33:0/4035960458 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8013710 con 0x561aa0efd520 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78fb558740 1 -- 172.21.15.33:0/4035960458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0efd520 msgr2=0x561aa12a2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:45.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78fb558740 1 --2- 172.21.15.33:0/4035960458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0efd520 0x561aa12a2c80 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009a80 tx=0x7f78d8009f40 comp rx=0 tx=0).stop 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78eed9d640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78dc0b4ca0 0x7f78dc0b71b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f78e80e2f10 tx=0x7f78e8093040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78fb558740 1 -- 172.21.15.33:0/4035960458 shutdown_connections 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78fb558740 1 --2- 172.21.15.33:0/4035960458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0edc840 0x561aa12a3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78fb558740 1 --2- 172.21.15.33:0/4035960458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa12a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78fb558740 1 --2- 172.21.15.33:0/4035960458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0efd520 0x561aa12a2c80 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78fb558740 1 -- 172.21.15.33:0/4035960458 >> 172.21.15.33:0/4035960458 conn(0x561aa0ef1910 msgr2=0x561aa12a0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78fb558740 1 -- 172.21.15.33:0/4035960458 shutdown_connections 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78fb558740 1 -- 172.21.15.33:0/4035960458 wait complete. 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.210+0000 7f78fb558740 1 -- start start 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78fb558740 1 Processor -- start 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78fb558740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa12ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78fb558740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78fb558740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0efd520 0x561aa12ba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78fb558740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x561aa12b1460 con 0x561aa0edc840 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78fb558740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561aa11ca520 con 0x561aa0ed4660 2024-08-28T19:42:45.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78fb558740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561aa12b15e0 con 0x561aa0efd520 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78fb558740 10 client.0 _ll_register_callbacks cb 0x561aa1202c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60854/0 (socket says 172.21.15.33:60854) 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78ee59c640 1 -- 172.21.15.33:0/2456331986 learned_addr learned my addr 172.21.15.33:0/2456331986 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa12ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0efd520 0x561aa12ba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78ee59c640 1 -- 172.21.15.33:0/2456331986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0efd520 msgr2=0x561aa12ba8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78ee59c640 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0efd520 0x561aa12ba8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78ee59c640 1 -- 172.21.15.33:0/2456331986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 msgr2=0x561aa12ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78ee59c640 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa12ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.211+0000 7f78ee59c640 1 -- 172.21.15.33:0/2456331986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561aa0fdf960 con 0x561aa0edc840 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78ee59c640 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12aecf0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f78e0005f70 tx=0x7f78e0004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45db06b7c5c125cb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:45.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2456331986 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0035040 con 0x561aa0edc840 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2456331986 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f78e0005550 con 0x561aa0edc840 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78fb558740 1 -- 172.21.15.33:0/2456331986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561aa11a89a0 con 0x561aa0edc840 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2456331986 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78e004e050 con 0x561aa0edc840 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78fb558740 10 client.18465 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78fb558740 1 -- 172.21.15.33:0/2456331986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561aa12bd500 con 0x561aa0edc840 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2456331986 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561aa11a89a0 con 0x561aa0edc840 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2456331986 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f78e0003a70 con 0x561aa0edc840 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78fb558740 10 client.18465 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78fb558740 10 client.18465 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78fb558740 20 client.18465 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78fb558740 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561aa0ebbea0 0x561aa12c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78fb558740 4 client.18465 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.212+0000 7f78fb558740 1 -- 172.21.15.33:0/2456331986 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561aa121b9c0 con 0x561aa0ebbea0 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.213+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561aa0ebbea0 0x561aa12c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.213+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561aa0ebbea0 0x561aa12c0a30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a23c68574edd61c0 server_cookie=74a974c26fbd07a2 in_seq=0 out_seq=0 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.213+0000 7f78d5ffb640 10 client.18465 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2456331986 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561aa121b9c0 con 0x561aa0ebbea0 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78d5ffb640 10 client.18465 handle_command_reply: tid=0 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 client.18465 shutdown 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 -- 172.21.15.33:0/2456331986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 msgr2=0x561aa12aecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12aecf0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f78e0005f70 tx=0x7f78e0004580 comp rx=0 tx=0).stop 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 -- 172.21.15.33:0/2456331986 shutdown_connections 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0efd520 0x561aa12ba8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561aa0ebbea0 0x561aa12c0a30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12aecf0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 --2- 172.21.15.33:0/2456331986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa12ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 -- 172.21.15.33:0/2456331986 >> 172.21.15.33:0/2456331986 conn(0x561aa0ef1910 msgr2=0x561aa12a5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78d5ffb640 0 client.18465 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 -- 172.21.15.33:0/2456331986 shutdown_connections 2024-08-28T19:42:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 1 -- 172.21.15.33:0/2456331986 wait complete. 2024-08-28T19:42:45.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.214+0000 7f78fb558740 20 client.18465 trim_cache size 0 max 16384 2024-08-28T19:42:45.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.231+0000 7f78fb558740 1 Processor -- start 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78fb558740 1 -- start start 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78fb558740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa129fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78fb558740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78fb558740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0efd520 0x561aa12ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78fb558740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01b0d20 con 0x561aa0edc840 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78fb558740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01b2860 con 0x561aa0ed4660 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78fb558740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01b13f0 con 0x561aa0efd520 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60858/0 (socket says 172.21.15.33:60858) 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78ee59c640 1 -- 172.21.15.33:0/3758236864 learned_addr learned my addr 172.21.15.33:0/3758236864 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/3758236864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa129fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/3758236864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0efd520 0x561aa12ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78ee59c640 1 -- 172.21.15.33:0/3758236864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0efd520 msgr2=0x561aa12ba7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:45.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78ee59c640 1 --2- 172.21.15.33:0/3758236864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0efd520 0x561aa12ba7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78ee59c640 1 -- 172.21.15.33:0/3758236864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 msgr2=0x561aa129fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:45.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78ee59c640 1 --2- 172.21.15.33:0/3758236864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa129fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78ee59c640 1 -- 172.21.15.33:0/3758236864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561aa12a3a90 con 0x561aa0edc840 2024-08-28T19:42:45.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.232+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/3758236864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa129fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:45.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.233+0000 7f78ee59c640 1 --2- 172.21.15.33:0/3758236864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b01e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f78e0031440 tx=0x7f78e0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e8d959a68afce4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:45.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.233+0000 7f78d7fff640 1 -- 172.21.15.33:0/3758236864 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0057070 con 0x561aa0edc840 2024-08-28T19:42:45.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.233+0000 7f78d7fff640 1 -- 172.21.15.33:0/3758236864 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e0040070 con 0x561aa0edc840 2024-08-28T19:42:45.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.233+0000 7f78d7fff640 1 -- 172.21.15.33:0/3758236864 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0035030 con 0x561aa0edc840 2024-08-28T19:42:45.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.233+0000 7f78fb558740 1 -- 172.21.15.33:0/3758236864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 msgr2=0x561aa12b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:45.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.233+0000 7f78fb558740 1 --2- 172.21.15.33:0/3758236864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b01e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f78e0031440 tx=0x7f78e0000bc0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 -- 172.21.15.33:0/3758236864 shutdown_connections 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 --2- 172.21.15.33:0/3758236864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0efd520 0x561aa12ba7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 --2- 172.21.15.33:0/3758236864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b01e0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 --2- 172.21.15.33:0/3758236864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0ed4660 0x561aa129fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 -- 172.21.15.33:0/3758236864 >> 172.21.15.33:0/3758236864 conn(0x561aa0ef1910 msgr2=0x561aa12afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 -- 172.21.15.33:0/3758236864 shutdown_connections 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 -- 172.21.15.33:0/3758236864 wait complete. 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 -- start start 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 Processor -- start 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0ed4660 0x561aa12b3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0efd520 0x561aa1324550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01b2190 con 0x561aa0edc840 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01b1ac0 con 0x561aa0efd520 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78f01aed20 con 0x561aa0ed4660 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78fb558740 10 client.0 _ll_register_callbacks cb 0x7f78e0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.234+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60860/0 (socket says 172.21.15.33:60860) 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78ee59c640 1 -- 172.21.15.33:0/2520912672 learned_addr learned my addr 172.21.15.33:0/2520912672 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0efd520 0x561aa1324550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78ee59c640 1 -- 172.21.15.33:0/2520912672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0ed4660 msgr2=0x561aa12b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0ed4660 0x561aa12b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78ee59c640 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0ed4660 0x561aa12b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78ee59c640 1 -- 172.21.15.33:0/2520912672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0efd520 msgr2=0x561aa1324550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78ee59c640 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0efd520 0x561aa1324550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78ee59c640 1 -- 172.21.15.33:0/2520912672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561aa1324bc0 con 0x561aa0edc840 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0efd520 0x561aa1324550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:45.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78ee59c640 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b3900 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f78e002a930 tx=0x7f78e0004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6436825adffedb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2520912672 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0057040 con 0x561aa0edc840 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2520912672 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f78e0031920 con 0x561aa0edc840 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78fb558740 1 -- 172.21.15.33:0/2520912672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78e0040070 con 0x561aa0edc840 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2520912672 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78e0035040 con 0x561aa0edc840 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78fb558740 10 client.18471 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.235+0000 7f78fb558740 1 -- 172.21.15.33:0/2520912672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561aa132bff0 con 0x561aa0edc840 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.236+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2520912672 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e0040070 con 0x561aa0edc840 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.236+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2520912672 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f78e005a070 con 0x561aa0edc840 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.236+0000 7f78fb558740 10 client.18471 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.236+0000 7f78fb558740 10 client.18471 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.236+0000 7f78fb558740 20 client.18471 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.236+0000 7f78fb558740 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561aa0e91250 0x561aa132e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:45.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.236+0000 7f78fb558740 4 client.18471 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fe27a785", "release": true, "await": true}] 2024-08-28T19:42:45.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.236+0000 7f78fb558740 1 -- 172.21.15.33:0/2520912672 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fe27a785", "release": true, "await": true}) -- 0x561aa1217460 con 0x561aa0e91250 2024-08-28T19:42:45.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.236+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561aa0e91250 0x561aa132e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:45.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.237+0000 7f78e5d9b640 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561aa0e91250 0x561aa132e3e0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79b6ec09c9ab1dfc server_cookie=5915ce7de8f98c66 in_seq=0 out_seq=0 2024-08-28T19:42:45.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.237+0000 7f78d5ffb640 10 client.18471 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:45.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78d5ffb640 1 -- 172.21.15.33:0/2520912672 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561aa1217460 con 0x561aa0e91250 2024-08-28T19:42:45.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78d5ffb640 10 client.18471 handle_command_reply: tid=0 2024-08-28T19:42:45.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 client.18471 shutdown 2024-08-28T19:42:45.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 -- 172.21.15.33:0/2520912672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 msgr2=0x561aa12b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:45.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b3900 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f78e002a930 tx=0x7f78e0004260 comp rx=0 tx=0).stop 2024-08-28T19:42:45.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 -- 172.21.15.33:0/2520912672 shutdown_connections 2024-08-28T19:42:45.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aa0efd520 0x561aa1324550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x561aa0e91250 0x561aa132e3e0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x561aa0edc840 0x561aa12b3900 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 --2- 172.21.15.33:0/2520912672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x561aa0ed4660 0x561aa12b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 -- 172.21.15.33:0/2520912672 >> 172.21.15.33:0/2520912672 conn(0x561aa0ef1910 msgr2=0x561aa129f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78d5ffb640 0 client.18471 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 -- 172.21.15.33:0/2520912672 shutdown_connections 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 1 -- 172.21.15.33:0/2520912672 wait complete. 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.241+0000 7f78fb558740 20 client.18471 trim_cache size 0 max 16384 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 32, 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:42:45.245 INFO:teuthology.orchestra.run.smithi033.stdout: "fe27a785": { 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 32, 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 147.1, 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:42:45.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:45.247 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:45.247 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:45.247 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:45.247 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:45.247 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:42:45.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 -- 172.21.15.33:0/885039491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78dc0b4ca0 msgr2=0x7f78dc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:45.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78dc0b4ca0 0x7f78dc0b71b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f78e80e2f10 tx=0x7f78e8093040 comp rx=0 tx=0).stop 2024-08-28T19:42:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 -- 172.21.15.33:0/885039491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f0108b10 msgr2=0x7f78f019fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f0108b10 0x7f78f019fb50 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f78e800eaa0 tx=0x7f78e800eea0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 -- 172.21.15.33:0/885039491 shutdown_connections 2024-08-28T19:42:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78f0108b10 0x7f78f019fb50 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f01081c0 0x7f78f019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78dc0b4ca0 0x7f78dc0b71b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 --2- 172.21.15.33:0/885039491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f78f0102880 0x7f78f019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 -- 172.21.15.33:0/885039491 >> 172.21.15.33:0/885039491 conn(0x7f78f0079510 msgr2=0x7f78f0106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 -- 172.21.15.33:0/885039491 shutdown_connections 2024-08-28T19:42:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:45.242+0000 7f78f4fe3640 1 -- 172.21.15.33:0/885039491 wait complete. 2024-08-28T19:42:45.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:45 smithi059 ceph-mon[22052]: pgmap v659: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-08-28T19:42:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:45 smithi122 ceph-mon[22174]: pgmap v659: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-08-28T19:42:45.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:45 smithi033 ceph-mon[18549]: pgmap v659: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-08-28T19:42:46.029 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fe27a785', total seconds elapsed: 30.5 2024-08-28T19:42:46.029 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.05 2024-08-28T19:42:46.029 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:42:46.287 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.824+0000 7f761f3fd640 1 -- 172.21.15.33:0/3142797940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76181081c0 msgr2=0x7f76181085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.824+0000 7f761f3fd640 1 --2- 172.21.15.33:0/3142797940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76181081c0 0x7f76181085d0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7608009900 tx=0x7f760802a410 comp rx=0 tx=0).stop 2024-08-28T19:42:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.824+0000 7f761f3fd640 1 -- 172.21.15.33:0/3142797940 shutdown_connections 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.824+0000 7f761f3fd640 1 --2- 172.21.15.33:0/3142797940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7618108b10 0x7f761810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.824+0000 7f761f3fd640 1 --2- 172.21.15.33:0/3142797940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76181081c0 0x7f76181085d0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.824+0000 7f761f3fd640 1 --2- 172.21.15.33:0/3142797940 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7618102880 0x7f7618102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.824+0000 7f761f3fd640 1 -- 172.21.15.33:0/3142797940 >> 172.21.15.33:0/3142797940 conn(0x7f7618079510 msgr2=0x7f7618079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.824+0000 7f761f3fd640 1 -- 172.21.15.33:0/3142797940 shutdown_connections 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.824+0000 7f761f3fd640 1 -- 172.21.15.33:0/3142797940 wait complete. 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761f3fd640 1 Processor -- start 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761f3fd640 1 -- start start 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761f3fd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7618102880 0x7f761819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761f3fd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76181081c0 0x7f761819a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761f3fd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7618108b10 0x7f761819fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:46.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761f3fd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7618113900 con 0x7f7618108b10 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761f3fd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7618113780 con 0x7f7618102880 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761f3fd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7618113a80 con 0x7f76181081c0 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761d99a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7618108b10 0x7f761819fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761d99a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7618108b10 0x7f761819fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60892/0 (socket says 172.21.15.33:60892) 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761d99a640 1 -- 172.21.15.33:0/3727877347 learned_addr learned my addr 172.21.15.33:0/3727877347 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761d199640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7618102880 0x7f761819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761c998640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76181081c0 0x7f761819a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761d99a640 1 -- 172.21.15.33:0/3727877347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76181081c0 msgr2=0x7f761819a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761d99a640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76181081c0 0x7f761819a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761d99a640 1 -- 172.21.15.33:0/3727877347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7618102880 msgr2=0x7f761819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761d99a640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7618102880 0x7f761819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.825+0000 7f761d99a640 1 -- 172.21.15.33:0/3727877347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76181a0200 con 0x7f7618108b10 2024-08-28T19:42:46.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.826+0000 7f761d99a640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7618108b10 0x7f761819fb90 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f761000b970 tx=0x7f761000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.826+0000 7f760e7fc640 1 -- 172.21.15.33:0/3727877347 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610019070 con 0x7f7618108b10 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.826+0000 7f760e7fc640 1 -- 172.21.15.33:0/3727877347 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7610014440 con 0x7f7618108b10 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.826+0000 7f761f3fd640 1 -- 172.21.15.33:0/3727877347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76181a04f0 con 0x7f7618108b10 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.826+0000 7f760e7fc640 1 -- 172.21.15.33:0/3727877347 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76100075d0 con 0x7f7618108b10 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.826+0000 7f761f3fd640 1 -- 172.21.15.33:0/3727877347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76181a09b0 con 0x7f7618108b10 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.827+0000 7f761f3fd640 1 -- 172.21.15.33:0/3727877347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7618103b00 con 0x7f7618108b10 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.828+0000 7f760e7fc640 1 -- 172.21.15.33:0/3727877347 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f761001c070 con 0x7f7618108b10 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.829+0000 7f760e7fc640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76040b4cd0 0x7f76040b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.829+0000 7f761d199640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76040b4cd0 0x7f76040b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.829+0000 7f760e7fc640 1 -- 172.21.15.33:0/3727877347 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f76100e4ce0 con 0x7f7618108b10 2024-08-28T19:42:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.830+0000 7f761d199640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76040b4cd0 0x7f76040b71e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f761400abe0 tx=0x7f761400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:46.834+0000 7f760e7fc640 1 -- 172.21.15.33:0/3727877347 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f76100ab080 con 0x7f7618108b10 2024-08-28T19:42:47.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.055+0000 7f761f3fd640 1 -- 172.21.15.33:0/3727877347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f761810a960 con 0x7f7618108b10 2024-08-28T19:42:47.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.056+0000 7f760e7fc640 1 -- 172.21.15.33:0/3727877347 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f76100af840 con 0x7f7618108b10 2024-08-28T19:42:47.058 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:42:47.059 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:42:47.059 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:42:47.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.059+0000 7f761f3fd640 1 -- 172.21.15.33:0/3727877347 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76040b4cd0 msgr2=0x7f76040b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:47.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.059+0000 7f761f3fd640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76040b4cd0 0x7f76040b71e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f761400abe0 tx=0x7f761400a2d0 comp rx=0 tx=0).stop 2024-08-28T19:42:47.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.059+0000 7f761f3fd640 1 -- 172.21.15.33:0/3727877347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7618108b10 msgr2=0x7f761819fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.059+0000 7f761f3fd640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7618108b10 0x7f761819fb90 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f761000b970 tx=0x7f761000bd70 comp rx=0 tx=0).stop 2024-08-28T19:42:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.060+0000 7f761f3fd640 1 -- 172.21.15.33:0/3727877347 shutdown_connections 2024-08-28T19:42:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.060+0000 7f761f3fd640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7618108b10 0x7f761819fb90 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.060+0000 7f761f3fd640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f76040b4cd0 0x7f76040b71e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.060+0000 7f761f3fd640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f76181081c0 0x7f761819a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.060+0000 7f761f3fd640 1 --2- 172.21.15.33:0/3727877347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7618102880 0x7f761819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.060+0000 7f761f3fd640 1 -- 172.21.15.33:0/3727877347 >> 172.21.15.33:0/3727877347 conn(0x7f7618079510 msgr2=0x7f76181062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.060+0000 7f761f3fd640 1 -- 172.21.15.33:0/3727877347 shutdown_connections 2024-08-28T19:42:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:47.060+0000 7f761f3fd640 1 -- 172.21.15.33:0/3727877347 wait complete. 2024-08-28T19:42:47.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:47 smithi059 ceph-mon[22052]: pgmap v660: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-28T19:42:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:47 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3727877347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:47 smithi122 ceph-mon[22174]: pgmap v660: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-28T19:42:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:47 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3727877347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:47.806 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:47 smithi033 ceph-mon[18549]: pgmap v660: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-28T19:42:47.807 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:47 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3727877347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:47.840 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 147.05 --await-for 45.0' 2024-08-28T19:42:47.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 147.05 --await-for 45.0 2024-08-28T19:42:48.100 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:48.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.626+0000 7f3106749640 1 -- 172.21.15.33:0/3561642957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f310010dcb0 msgr2=0x7f31001101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.626+0000 7f3106749640 1 --2- 172.21.15.33:0/3561642957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f310010dcb0 0x7f31001101c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009ca0 tx=0x7f30f802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.626+0000 7f3106749640 1 -- 172.21.15.33:0/3561642957 shutdown_connections 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.626+0000 7f3106749640 1 --2- 172.21.15.33:0/3561642957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f310010dcb0 0x7f31001101c0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.626+0000 7f3106749640 1 --2- 172.21.15.33:0/3561642957 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31001051a0 0x7f310010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.626+0000 7f3106749640 1 --2- 172.21.15.33:0/3561642957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3100104770 0x7f3100104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.626+0000 7f3106749640 1 -- 172.21.15.33:0/3561642957 >> 172.21.15.33:0/3561642957 conn(0x7f31000794c0 msgr2=0x7f31000798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.626+0000 7f3106749640 1 -- 172.21.15.33:0/3561642957 shutdown_connections 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.627+0000 7f3106749640 1 -- 172.21.15.33:0/3561642957 wait complete. 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.627+0000 7f3106749640 1 Processor -- start 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.627+0000 7f3106749640 1 -- start start 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f3106749640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3100104770 0x7f310019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f3106749640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31001051a0 0x7f310019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f3106749640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310010dcb0 0x7f310019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f3106749640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3100113930 con 0x7f31001051a0 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f3106749640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f31001137b0 con 0x7f310010dcb0 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f3106749640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3100113ab0 con 0x7f3100104770 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31001051a0 0x7f310019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31001051a0 0x7f310019a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42586/0 (socket says 172.21.15.33:42586) 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f30ff7fe640 1 -- 172.21.15.33:0/3294291337 learned_addr learned my addr 172.21.15.33:0/3294291337 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f3104ce6640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310010dcb0 0x7f310019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f30fffff640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3100104770 0x7f310019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f30ff7fe640 1 -- 172.21.15.33:0/3294291337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3100104770 msgr2=0x7f310019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f30ff7fe640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3100104770 0x7f310019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f30ff7fe640 1 -- 172.21.15.33:0/3294291337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310010dcb0 msgr2=0x7f310019faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f30ff7fe640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310010dcb0 0x7f310019faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.628+0000 7f30ff7fe640 1 -- 172.21.15.33:0/3294291337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31001a01d0 con 0x7f31001051a0 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.629+0000 7f30ff7fe640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31001051a0 0x7f310019a800 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f30f400d770 tx=0x7f30f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.629+0000 7f30fd7fa640 1 -- 172.21.15.33:0/3294291337 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4017070 con 0x7f31001051a0 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.629+0000 7f3106749640 1 -- 172.21.15.33:0/3294291337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31001a04c0 con 0x7f31001051a0 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.629+0000 7f30fd7fa640 1 -- 172.21.15.33:0/3294291337 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f4009c30 con 0x7f31001051a0 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.629+0000 7f30fd7fa640 1 -- 172.21.15.33:0/3294291337 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f400f620 con 0x7f31001051a0 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.629+0000 7f3106749640 1 -- 172.21.15.33:0/3294291337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31001a6c20 con 0x7f31001051a0 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f310ccbe740 1 Processor -- start 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f310ccbe740 1 -- start start 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f30fd7fa640 1 -- 172.21.15.33:0/3294291337 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f30f401a070 con 0x7f31001051a0 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13aedf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 0x55ce13aee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13aeea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f310ccbe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ce13a63380 con 0x55ce13747850 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f310ccbe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ce13a52910 con 0x55ce1371e990 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f310ccbe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ce13a568c0 con 0x55ce13726b70 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f3104ce6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13aedf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f3104ce6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13aedf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42590/0 (socket says 172.21.15.33:42590) 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f3104ce6640 1 -- 172.21.15.33:0/554456459 learned_addr learned my addr 172.21.15.33:0/554456459 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f30ff7fe640 1 --2- 172.21.15.33:0/554456459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13aeea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f30fffff640 1 --2- 172.21.15.33:0/554456459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 0x55ce13aee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f3104ce6640 1 -- 172.21.15.33:0/554456459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 msgr2=0x55ce13aeea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f3104ce6640 1 --2- 172.21.15.33:0/554456459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13aeea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f3104ce6640 1 -- 172.21.15.33:0/554456459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 msgr2=0x55ce13aee4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f3104ce6640 1 --2- 172.21.15.33:0/554456459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 0x55ce13aee4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f3104ce6640 1 -- 172.21.15.33:0/554456459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce139ef4c0 con 0x55ce13747850 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.632+0000 7f30fffff640 1 --2- 172.21.15.33:0/554456459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 0x55ce13aee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.633+0000 7f3104ce6640 1 --2- 172.21.15.33:0/554456459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13aedf90 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f30f80098b0 tx=0x7f30f80098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07620d9d4f77d27 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.633+0000 7f30fd7fa640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30e80b4ca0 0x7f30e80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.633+0000 7f30e67fc640 1 -- 172.21.15.33:0/554456459 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f8031cf0 con 0x55ce13747850 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.633+0000 7f30fffff640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30e80b4ca0 0x7f30e80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.633+0000 7f30e67fc640 1 -- 172.21.15.33:0/554456459 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f8036030 con 0x55ce13747850 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.633+0000 7f30e67fc640 1 -- 172.21.15.33:0/554456459 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f80042a0 con 0x55ce13747850 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.633+0000 7f30fd7fa640 1 -- 172.21.15.33:0/3294291337 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f30f40e5470 con 0x7f31001051a0 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f310ccbe740 1 -- 172.21.15.33:0/554456459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 msgr2=0x55ce13aedf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f310ccbe740 1 --2- 172.21.15.33:0/554456459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13aedf90 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f30f80098b0 tx=0x7f30f80098e0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f30fffff640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30e80b4ca0 0x7f30e80b71b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55ce13aecc10 tx=0x7f30f0005f30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f310ccbe740 1 -- 172.21.15.33:0/554456459 shutdown_connections 2024-08-28T19:42:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f310ccbe740 1 --2- 172.21.15.33:0/554456459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13aeea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f310ccbe740 1 --2- 172.21.15.33:0/554456459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 0x55ce13aee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f310ccbe740 1 --2- 172.21.15.33:0/554456459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13aedf90 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f310ccbe740 1 -- 172.21.15.33:0/554456459 >> 172.21.15.33:0/554456459 conn(0x55ce1373bc40 msgr2=0x55ce13aebe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f310ccbe740 1 -- 172.21.15.33:0/554456459 shutdown_connections 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f310ccbe740 1 -- 172.21.15.33:0/554456459 wait complete. 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.634+0000 7f310ccbe740 1 -- start start 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f310ccbe740 1 Processor -- start 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 0x55ce13af96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13af9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13b05880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f310ccbe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ce138b57b0 con 0x55ce13747850 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f310ccbe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ce139d9460 con 0x55ce1371e990 2024-08-28T19:42:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f310ccbe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ce13afc590 con 0x55ce13726b70 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f310ccbe740 10 client.0 _ll_register_callbacks cb 0x55ce139fefd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f3104ce6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13b05880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f3104ce6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13b05880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42604/0 (socket says 172.21.15.33:42604) 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f3104ce6640 1 -- 172.21.15.33:0/4155928701 learned_addr learned my addr 172.21.15.33:0/4155928701 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f30ff7fe640 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13af9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.635+0000 7f30fffff640 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 0x55ce13af96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f3104ce6640 1 -- 172.21.15.33:0/4155928701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 msgr2=0x55ce13af9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f3104ce6640 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13af9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f3104ce6640 1 -- 172.21.15.33:0/4155928701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 msgr2=0x55ce13af96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f3104ce6640 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 0x55ce13af96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f3104ce6640 1 -- 172.21.15.33:0/4155928701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce137c1ba0 con 0x55ce13747850 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f3104ce6640 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13b05880 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f30f8005e30 tx=0x7f30f8031df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186e63378cae6f41 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f30df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f30df7fe640 1 -- 172.21.15.33:0/4155928701 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f804a040 con 0x55ce13747850 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f30df7fe640 1 -- 172.21.15.33:0/4155928701 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f30f8031710 con 0x55ce13747850 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f310ccbe740 1 -- 172.21.15.33:0/4155928701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30f8036030 con 0x55ce13747850 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f30df7fe640 1 -- 172.21.15.33:0/4155928701 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f30f805e050 con 0x55ce13747850 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f310ccbe740 10 client.18489 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f310ccbe740 1 -- 172.21.15.33:0/4155928701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ce13b085a0 con 0x55ce13747850 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.636+0000 7f30df7fe640 1 -- 172.21.15.33:0/4155928701 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f8036030 con 0x55ce13747850 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.637+0000 7f30df7fe640 1 -- 172.21.15.33:0/4155928701 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f30f804d030 con 0x55ce13747850 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.637+0000 7f310ccbe740 10 client.18489 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.637+0000 7f310ccbe740 10 client.18489 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.637+0000 7f310ccbe740 20 client.18489 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.637+0000 7f310ccbe740 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ce137061d0 0x55ce13b0b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.637+0000 7f310ccbe740 4 client.18489 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.637+0000 7f310ccbe740 1 -- 172.21.15.33:0/4155928701 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce13a652d0 con 0x55ce137061d0 2024-08-28T19:42:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.637+0000 7f30fffff640 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ce137061d0 0x55ce13b0b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.637+0000 7f30df7fe640 10 client.18489 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.637+0000 7f30fffff640 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ce137061d0 0x55ce13b0b900 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b29d28458d0bf8fe server_cookie=9a68cc4842d89da in_seq=0 out_seq=0 2024-08-28T19:42:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.638+0000 7f30df7fe640 1 -- 172.21.15.33:0/4155928701 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce13a652d0 con 0x55ce137061d0 2024-08-28T19:42:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.638+0000 7f30df7fe640 10 client.18489 handle_command_reply: tid=0 2024-08-28T19:42:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.638+0000 7f310ccbe740 1 client.18489 shutdown 2024-08-28T19:42:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.638+0000 7f310ccbe740 1 -- 172.21.15.33:0/4155928701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 msgr2=0x55ce13b05880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.638+0000 7f310ccbe740 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13b05880 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f30f8005e30 tx=0x7f30f8031df0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.638+0000 7f310ccbe740 1 -- 172.21.15.33:0/4155928701 shutdown_connections 2024-08-28T19:42:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.638+0000 7f310ccbe740 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ce137061d0 0x55ce13b0b900 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.638+0000 7f310ccbe740 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce13747850 0x55ce13b05880 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.639+0000 7f310ccbe740 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13af9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.639+0000 7f310ccbe740 1 --2- 172.21.15.33:0/4155928701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce1371e990 0x55ce13af96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.639+0000 7f30df7fe640 0 client.18489 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:48.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.639+0000 7f310ccbe740 1 -- 172.21.15.33:0/4155928701 >> 172.21.15.33:0/4155928701 conn(0x55ce1373bc40 msgr2=0x55ce13af1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:48.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.639+0000 7f310ccbe740 1 -- 172.21.15.33:0/4155928701 shutdown_connections 2024-08-28T19:42:48.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.639+0000 7f310ccbe740 1 -- 172.21.15.33:0/4155928701 wait complete. 2024-08-28T19:42:48.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.639+0000 7f310ccbe740 20 client.18489 trim_cache size 0 max 16384 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f310ccbe740 1 Processor -- start 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f310ccbe740 1 -- start start 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13af4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13726b70 0x55ce13afb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13747850 0x55ce13af68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f310ccbe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f31001ae880 con 0x55ce1371e990 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f310ccbe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f31001b03c0 con 0x55ce13726b70 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f310ccbe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f31001aef50 con 0x55ce13747850 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f30fffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13af4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f30fffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13af4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42620/0 (socket says 172.21.15.33:42620) 2024-08-28T19:42:48.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.656+0000 7f30fffff640 1 -- 172.21.15.33:0/1872337191 learned_addr learned my addr 172.21.15.33:0/1872337191 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f3104ce6640 1 --2- 172.21.15.33:0/1872337191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13747850 0x55ce13af68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30ff7fe640 1 --2- 172.21.15.33:0/1872337191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13726b70 0x55ce13afb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30fffff640 1 -- 172.21.15.33:0/1872337191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13747850 msgr2=0x55ce13af68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30fffff640 1 --2- 172.21.15.33:0/1872337191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13747850 0x55ce13af68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30fffff640 1 -- 172.21.15.33:0/1872337191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13726b70 msgr2=0x55ce13afb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30fffff640 1 --2- 172.21.15.33:0/1872337191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13726b70 0x55ce13afb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30fffff640 1 -- 172.21.15.33:0/1872337191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce13afa970 con 0x55ce1371e990 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30ff7fe640 1 --2- 172.21.15.33:0/1872337191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13726b70 0x55ce13afb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30fffff640 1 --2- 172.21.15.33:0/1872337191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13af4dd0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f30f000b430 tx=0x7f30f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1eb01decfe6bd37 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30e5ffb640 1 -- 172.21.15.33:0/1872337191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00206f0 con 0x55ce1371e990 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30e5ffb640 1 -- 172.21.15.33:0/1872337191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f002c070 con 0x55ce1371e990 2024-08-28T19:42:48.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.657+0000 7f30e5ffb640 1 -- 172.21.15.33:0/1872337191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0029b20 con 0x55ce1371e990 2024-08-28T19:42:48.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.658+0000 7f310ccbe740 1 -- 172.21.15.33:0/1872337191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 msgr2=0x55ce13af4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:48.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.658+0000 7f310ccbe740 1 --2- 172.21.15.33:0/1872337191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13af4dd0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f30f000b430 tx=0x7f30f0016000 comp rx=0 tx=0).stop 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.658+0000 7f310ccbe740 1 -- 172.21.15.33:0/1872337191 shutdown_connections 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.658+0000 7f310ccbe740 1 --2- 172.21.15.33:0/1872337191 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13747850 0x55ce13af68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.658+0000 7f310ccbe740 1 --2- 172.21.15.33:0/1872337191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13726b70 0x55ce13afb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.658+0000 7f310ccbe740 1 --2- 172.21.15.33:0/1872337191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13af4dd0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.658+0000 7f310ccbe740 1 -- 172.21.15.33:0/1872337191 >> 172.21.15.33:0/1872337191 conn(0x55ce1373bc40 msgr2=0x55ce13aea520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.658+0000 7f310ccbe740 1 -- 172.21.15.33:0/1872337191 shutdown_connections 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.658+0000 7f310ccbe740 1 -- 172.21.15.33:0/1872337191 wait complete. 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.658+0000 7f310ccbe740 1 -- start start 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f310ccbe740 1 Processor -- start 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13b02160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13afe620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f310ccbe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13747850 0x55ce13afecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f310ccbe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f31001afcf0 con 0x55ce1371e990 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f310ccbe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f31001af620 con 0x55ce13747850 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f310ccbe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f31001ac880 con 0x55ce13726b70 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f310ccbe740 10 client.0 _ll_register_callbacks cb 0x7f30f8031af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f30fffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13b02160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f30fffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13b02160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42626/0 (socket says 172.21.15.33:42626) 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f30fffff640 1 -- 172.21.15.33:0/325644268 learned_addr learned my addr 172.21.15.33:0/325644268 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f3104ce6640 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13747850 0x55ce13afecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f30ff7fe640 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13afe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f30fffff640 1 -- 172.21.15.33:0/325644268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 msgr2=0x55ce13afe620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f30fffff640 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13afe620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f30fffff640 1 -- 172.21.15.33:0/325644268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13747850 msgr2=0x55ce13afecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f30fffff640 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13747850 0x55ce13afecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.659+0000 7f30fffff640 1 -- 172.21.15.33:0/325644268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce13b761f0 con 0x55ce1371e990 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f30fffff640 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13b02160 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f30f0029500 tx=0x7f30f0029530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ffff95e5cd72db server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f30df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f30df7fe640 1 -- 172.21.15.33:0/325644268 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0005320 con 0x55ce1371e990 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f30df7fe640 1 -- 172.21.15.33:0/325644268 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f30f00054c0 con 0x55ce1371e990 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f310ccbe740 1 -- 172.21.15.33:0/325644268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30f002c070 con 0x55ce1371e990 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f30df7fe640 1 -- 172.21.15.33:0/325644268 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f30f00297a0 con 0x55ce1371e990 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f310ccbe740 10 client.18495 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f310ccbe740 1 -- 172.21.15.33:0/325644268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ce13b77210 con 0x55ce1371e990 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f30df7fe640 1 -- 172.21.15.33:0/325644268 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f002c070 con 0x55ce1371e990 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f30df7fe640 1 -- 172.21.15.33:0/325644268 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f30f000f040 con 0x55ce1371e990 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f310ccbe740 10 client.18495 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f310ccbe740 10 client.18495 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:42:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f310ccbe740 20 client.18495 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f310ccbe740 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ce136db580 0x55ce13b79a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f310ccbe740 4 client.18495 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.05, "await_for": 45.0}] 2024-08-28T19:42:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.660+0000 7f310ccbe740 1 -- 172.21.15.33:0/325644268 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.05, "await_for": 45.0}) -- 0x55ce13a60d70 con 0x55ce136db580 2024-08-28T19:42:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.661+0000 7f30ff7fe640 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ce136db580 0x55ce13b79a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.661+0000 7f30df7fe640 10 client.18495 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.661+0000 7f30ff7fe640 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ce136db580 0x55ce13b79a00 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dab2a4cca2159ff server_cookie=5cdf71b32fc71e40 in_seq=0 out_seq=0 2024-08-28T19:42:48.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f30df7fe640 1 -- 172.21.15.33:0/325644268 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55ce13a60d70 con 0x55ce136db580 2024-08-28T19:42:48.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f30df7fe640 10 client.18495 handle_command_reply: tid=0 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 client.18495 shutdown 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 -- 172.21.15.33:0/325644268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 msgr2=0x55ce13b02160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13b02160 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f30f0029500 tx=0x7f30f0029530 comp rx=0 tx=0).stop 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 -- 172.21.15.33:0/325644268 shutdown_connections 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce13747850 0x55ce13afecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ce13726b70 0x55ce13afe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55ce136db580 0x55ce13b79a00 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 --2- 172.21.15.33:0/325644268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ce1371e990 0x55ce13b02160 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f30df7fe640 0 client.18495 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 -- 172.21.15.33:0/325644268 >> 172.21.15.33:0/325644268 conn(0x55ce1373bc40 msgr2=0x55ce13aea520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 -- 172.21.15.33:0/325644268 shutdown_connections 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.675+0000 7f310ccbe740 1 -- 172.21.15.33:0/325644268 wait complete. 2024-08-28T19:42:48.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f310ccbe740 20 client.18495 trim_cache size 0 max 16384 2024-08-28T19:42:48.679 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:42:48.679 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:42:48.679 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:42:48.679 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 34, 2024-08-28T19:42:48.679 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:42:48.679 INFO:teuthology.orchestra.run.smithi033.stdout: "f91a6de": { 2024-08-28T19:42:48.679 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 34, 2024-08-28T19:42:48.679 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:42:48.679 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 147.1, 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:48.680 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:48.681 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:48.681 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:48.681 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:42:48.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 -- 172.21.15.33:0/3294291337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30e80b4ca0 msgr2=0x7f30e80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:48.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30e80b4ca0 0x7f30e80b71b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55ce13aecc10 tx=0x7f30f0005f30 comp rx=0 tx=0).stop 2024-08-28T19:42:48.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 -- 172.21.15.33:0/3294291337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31001051a0 msgr2=0x7f310019a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:48.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31001051a0 0x7f310019a800 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f30f400d770 tx=0x7f30f400dc30 comp rx=0 tx=0).stop 2024-08-28T19:42:48.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 -- 172.21.15.33:0/3294291337 shutdown_connections 2024-08-28T19:42:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310010dcb0 0x7f310019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31001051a0 0x7f310019a800 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f30e80b4ca0 0x7f30e80b71b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 --2- 172.21.15.33:0/3294291337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3100104770 0x7f310019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 -- 172.21.15.33:0/3294291337 >> 172.21.15.33:0/3294291337 conn(0x7f31000794c0 msgr2=0x7f3100100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 -- 172.21.15.33:0/3294291337 shutdown_connections 2024-08-28T19:42:48.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:48.676+0000 7f3106749640 1 -- 172.21.15.33:0/3294291337 wait complete. 2024-08-28T19:42:49.448 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f91a6de', quiesce took 3.4 seconds. Will release after: 23.650000000000002 2024-08-28T19:42:49.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:49 smithi122 ceph-mon[22174]: pgmap v661: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-08-28T19:42:49.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:49 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:42:49.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:49 smithi059 ceph-mon[22052]: pgmap v661: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-08-28T19:42:49.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:49 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:42:49.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:49 smithi033 ceph-mon[18549]: pgmap v661: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-08-28T19:42:49.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:49 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:42:51.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:51 smithi059 ceph-mon[22052]: pgmap v662: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-08-28T19:42:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:51 smithi122 ceph-mon[22174]: pgmap v662: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-08-28T19:42:51.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:51 smithi033 ceph-mon[18549]: pgmap v662: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-08-28T19:42:53.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:53 smithi059 ceph-mon[22052]: pgmap v663: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 10 op/s 2024-08-28T19:42:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:53 smithi122 ceph-mon[22174]: pgmap v663: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 10 op/s 2024-08-28T19:42:53.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:53 smithi033 ceph-mon[18549]: pgmap v663: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 10 op/s 2024-08-28T19:42:55.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:55 smithi059 ceph-mon[22052]: pgmap v664: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-08-28T19:42:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:55 smithi122 ceph-mon[22174]: pgmap v664: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-08-28T19:42:55.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:55 smithi033 ceph-mon[18549]: pgmap v664: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-08-28T19:42:55.897 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:42:56.165 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.644+0000 7f6308eef640 1 -- 172.21.15.33:0/2352408287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6304105120 msgr2=0x7f630410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:56.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.644+0000 7f6308eef640 1 --2- 172.21.15.33:0/2352408287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6304105120 0x7f630410d670 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009900 tx=0x7f62ec02a410 comp rx=0 tx=0).stop 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.644+0000 7f6308eef640 1 -- 172.21.15.33:0/2352408287 shutdown_connections 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.644+0000 7f6308eef640 1 --2- 172.21.15.33:0/2352408287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f630410dc00 0x7f63041100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.644+0000 7f6308eef640 1 --2- 172.21.15.33:0/2352408287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6304105120 0x7f630410d670 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.644+0000 7f6308eef640 1 --2- 172.21.15.33:0/2352408287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f63041047d0 0x7f6304104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.644+0000 7f6308eef640 1 -- 172.21.15.33:0/2352408287 >> 172.21.15.33:0/2352408287 conn(0x7f6304079500 msgr2=0x7f6304079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.644+0000 7f6308eef640 1 -- 172.21.15.33:0/2352408287 shutdown_connections 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.644+0000 7f6308eef640 1 -- 172.21.15.33:0/2352408287 wait complete. 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6308eef640 1 Processor -- start 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6308eef640 1 -- start start 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6308eef640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63041047d0 0x7f630419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6308eef640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6304105120 0x7f630419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6308eef640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f630410dc00 0x7f630419fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6308eef640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6304113840 con 0x7f6304105120 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6308eef640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f63041136c0 con 0x7f63041047d0 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6308eef640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f63041139c0 con 0x7f630410dc00 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6301d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6304105120 0x7f630419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6301d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6304105120 0x7f630419a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42642/0 (socket says 172.21.15.33:42642) 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6301d9b640 1 -- 172.21.15.33:0/738012694 learned_addr learned my addr 172.21.15.33:0/738012694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f630259c640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63041047d0 0x7f630419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.645+0000 7f6302d9d640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f630410dc00 0x7f630419fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f6301d9b640 1 -- 172.21.15.33:0/738012694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f630410dc00 msgr2=0x7f630419fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f6301d9b640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f630410dc00 0x7f630419fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f6301d9b640 1 -- 172.21.15.33:0/738012694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63041047d0 msgr2=0x7f630419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f6301d9b640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63041047d0 0x7f630419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f6301d9b640 1 -- 172.21.15.33:0/738012694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63041a0200 con 0x7f6304105120 2024-08-28T19:42:56.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f630259c640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63041047d0 0x7f630419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f6301d9b640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6304105120 0x7f630419a830 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f62ec02a930 tx=0x7f62ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f62fb7fe640 1 -- 172.21.15.33:0/738012694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec03f030 con 0x7f6304105120 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f6308eef640 1 -- 172.21.15.33:0/738012694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63041a0490 con 0x7f6304105120 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f62fb7fe640 1 -- 172.21.15.33:0/738012694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62ec003aa0 con 0x7f6304105120 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f62fb7fe640 1 -- 172.21.15.33:0/738012694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec035070 con 0x7f6304105120 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.646+0000 7f6308eef640 1 -- 172.21.15.33:0/738012694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63041a6c50 con 0x7f6304105120 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.649+0000 7f62fb7fe640 1 -- 172.21.15.33:0/738012694 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f62ec042030 con 0x7f6304105120 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.649+0000 7f630f464740 1 Processor -- start 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.649+0000 7f630f464740 1 -- start start 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.649+0000 7f630f464740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b548452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.649+0000 7f630f464740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544771b0 0x562b54845800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.649+0000 7f630f464740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b5447f390 0x562b54845d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.649+0000 7f630f464740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562b547bc630 con 0x562b544a0070 2024-08-28T19:42:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.649+0000 7f630f464740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562b547abbc0 con 0x562b544771b0 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.649+0000 7f630f464740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b547afb70 con 0x562b5447f390 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6302d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b548452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6302d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b548452c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42652/0 (socket says 172.21.15.33:42652) 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6302d9d640 1 -- 172.21.15.33:0/4035616272 learned_addr learned my addr 172.21.15.33:0/4035616272 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f62fb7fe640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62f00b4ca0 0x7f62f00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6301d9b640 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b5447f390 0x562b54845d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f630259c640 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544771b0 0x562b54845800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6302d9d640 1 -- 172.21.15.33:0/4035616272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b5447f390 msgr2=0x562b54845d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6302d9d640 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b5447f390 0x562b54845d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6302d9d640 1 -- 172.21.15.33:0/4035616272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544771b0 msgr2=0x562b54845800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6302d9d640 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544771b0 0x562b54845800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6302d9d640 1 -- 172.21.15.33:0/4035616272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b5450b650 con 0x562b544a0070 2024-08-28T19:42:56.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6301d9b640 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b5447f390 0x562b54845d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f630259c640 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544771b0 0x562b54845800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f62fb7fe640 1 -- 172.21.15.33:0/738012694 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f62ec105f50 con 0x7f6304105120 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6302d9d640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62f00b4ca0 0x7f62f00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.650+0000 7f6302d9d640 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b548452c0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f62f4010440 tx=0x7f62f4010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db557d3625e045b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f62f8ff9640 1 -- 172.21.15.33:0/4035616272 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f401d400 con 0x562b544a0070 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f62f8ff9640 1 -- 172.21.15.33:0/4035616272 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62f401da50 con 0x562b544a0070 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f62f8ff9640 1 -- 172.21.15.33:0/4035616272 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f401c740 con 0x562b544a0070 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f630f464740 1 -- 172.21.15.33:0/4035616272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 msgr2=0x562b548452c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f630f464740 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b548452c0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f62f4010440 tx=0x7f62f4010900 comp rx=0 tx=0).stop 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f6302d9d640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62f00b4ca0 0x7f62f00b71b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f62f4021000 tx=0x7f62f401e000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f630f464740 1 -- 172.21.15.33:0/4035616272 shutdown_connections 2024-08-28T19:42:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f630f464740 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b5447f390 0x562b54845d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f630f464740 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544771b0 0x562b54845800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f630f464740 1 --2- 172.21.15.33:0/4035616272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b548452c0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.651+0000 7f630f464740 1 -- 172.21.15.33:0/4035616272 >> 172.21.15.33:0/4035616272 conn(0x562b54494460 msgr2=0x562b548431b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 1 -- 172.21.15.33:0/4035616272 shutdown_connections 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 1 -- 172.21.15.33:0/4035616272 wait complete. 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 1 -- start start 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 1 Processor -- start 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 0x562b54850a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b5447f390 0x562b54850f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b5485cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562b5460e700 con 0x562b544a0070 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562b54732700 con 0x562b5447f390 2024-08-28T19:42:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562b54853aa0 con 0x562b544771b0 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.652+0000 7f630f464740 10 client.0 _ll_register_callbacks cb 0x562b54761dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f6302d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b5485cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f6302d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b5485cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42668/0 (socket says 172.21.15.33:42668) 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f6302d9d640 1 -- 172.21.15.33:0/2991047410 learned_addr learned my addr 172.21.15.33:0/2991047410 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f6301d9b640 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b5447f390 0x562b54850f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f630259c640 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 0x562b54850a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f6302d9d640 1 -- 172.21.15.33:0/2991047410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 msgr2=0x562b54850a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f6302d9d640 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 0x562b54850a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f6302d9d640 1 -- 172.21.15.33:0/2991047410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b5447f390 msgr2=0x562b54850f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f6302d9d640 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b5447f390 0x562b54850f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f6302d9d640 1 -- 172.21.15.33:0/2991047410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b5476b8b0 con 0x562b544a0070 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f6302d9d640 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b5485cdc0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009640 tx=0x7f62f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffe1da748a4bf2b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f62e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f62e9ffb640 1 -- 172.21.15.33:0/2991047410 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f401cc70 con 0x562b544a0070 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f62e9ffb640 1 -- 172.21.15.33:0/2991047410 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f62f401ce10 con 0x562b544a0070 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f630f464740 1 -- 172.21.15.33:0/2991047410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62f401da50 con 0x562b544a0070 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f62e9ffb640 1 -- 172.21.15.33:0/2991047410 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f62f403d050 con 0x562b544a0070 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.653+0000 7f630f464740 10 client.18507 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.654+0000 7f630f464740 1 -- 172.21.15.33:0/2991047410 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b5485f880 con 0x562b544a0070 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.654+0000 7f62e9ffb640 1 -- 172.21.15.33:0/2991047410 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62f401da50 con 0x562b544a0070 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.654+0000 7f62e9ffb640 1 -- 172.21.15.33:0/2991047410 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f62f4038030 con 0x562b544a0070 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.654+0000 7f630f464740 10 client.18507 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.654+0000 7f630f464740 10 client.18507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.654+0000 7f630f464740 20 client.18507 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.654+0000 7f630f464740 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562b5445e9f0 0x562b54862c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.654+0000 7f630f464740 4 client.18507 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.654+0000 7f630f464740 1 -- 172.21.15.33:0/2991047410 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b547be580 con 0x562b5445e9f0 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.654+0000 7f630259c640 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562b5445e9f0 0x562b54862c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.655+0000 7f630259c640 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562b5445e9f0 0x562b54862c90 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49c287f35dce3925 server_cookie=38b8aefee6efd031 in_seq=0 out_seq=0 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.655+0000 7f62e9ffb640 10 client.18507 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.655+0000 7f62e9ffb640 1 -- 172.21.15.33:0/2991047410 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b547be580 con 0x562b5445e9f0 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.655+0000 7f62e9ffb640 10 client.18507 handle_command_reply: tid=0 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.655+0000 7f630f464740 1 client.18507 shutdown 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 1 -- 172.21.15.33:0/2991047410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 msgr2=0x562b5485cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b5485cdc0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009640 tx=0x7f62f4009b60 comp rx=0 tx=0).stop 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 1 -- 172.21.15.33:0/2991047410 shutdown_connections 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562b5445e9f0 0x562b54862c90 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544a0070 0x562b5485cdc0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b5447f390 0x562b54850f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 1 --2- 172.21.15.33:0/2991047410 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 0x562b54850a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f62e9ffb640 0 client.18507 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:56.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 1 -- 172.21.15.33:0/2991047410 >> 172.21.15.33:0/2991047410 conn(0x562b54494460 msgr2=0x562b548484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:56.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 1 -- 172.21.15.33:0/2991047410 shutdown_connections 2024-08-28T19:42:56.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 1 -- 172.21.15.33:0/2991047410 wait complete. 2024-08-28T19:42:56.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.656+0000 7f630f464740 20 client.18507 trim_cache size 0 max 16384 2024-08-28T19:42:56.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.673+0000 7f630f464740 1 Processor -- start 2024-08-28T19:42:56.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.673+0000 7f630f464740 1 -- start start 2024-08-28T19:42:56.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.673+0000 7f630f464740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544771b0 0x562b54848ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630f464740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b5447f390 0x562b5485ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630f464740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544a0070 0x562b5484dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630f464740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f63041b0ca0 con 0x562b544771b0 2024-08-28T19:42:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630f464740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f63041b27e0 con 0x562b544a0070 2024-08-28T19:42:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630f464740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f63041b1370 con 0x562b5447f390 2024-08-28T19:42:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544771b0 0x562b54848ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544771b0 0x562b54848ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42670/0 (socket says 172.21.15.33:42670) 2024-08-28T19:42:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630259c640 1 -- 172.21.15.33:0/1335758678 learned_addr learned my addr 172.21.15.33:0/1335758678 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630259c640 1 -- 172.21.15.33:0/1335758678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b5447f390 msgr2=0x562b5485ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630259c640 1 --2- 172.21.15.33:0/1335758678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b5447f390 0x562b5485ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630259c640 1 -- 172.21.15.33:0/1335758678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544a0070 msgr2=0x562b5484dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630259c640 1 --2- 172.21.15.33:0/1335758678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544a0070 0x562b5484dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630259c640 1 -- 172.21.15.33:0/1335758678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b54848120 con 0x562b544771b0 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f630259c640 1 --2- 172.21.15.33:0/1335758678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544771b0 0x562b54848ad0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x562b54843f40 tx=0x7f62fc00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a8c7b398fe4dfe server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f62ebfff640 1 -- 172.21.15.33:0/1335758678 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc021040 con 0x562b544771b0 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f62ebfff640 1 -- 172.21.15.33:0/1335758678 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62fc012e30 con 0x562b544771b0 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.674+0000 7f62ebfff640 1 -- 172.21.15.33:0/1335758678 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc004a70 con 0x562b544771b0 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 -- 172.21.15.33:0/1335758678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544771b0 msgr2=0x562b54848ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 --2- 172.21.15.33:0/1335758678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544771b0 0x562b54848ad0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x562b54843f40 tx=0x7f62fc00b390 comp rx=0 tx=0).stop 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 -- 172.21.15.33:0/1335758678 shutdown_connections 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 --2- 172.21.15.33:0/1335758678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544a0070 0x562b5484dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 --2- 172.21.15.33:0/1335758678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b5447f390 0x562b5485ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 --2- 172.21.15.33:0/1335758678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b544771b0 0x562b54848ad0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 -- 172.21.15.33:0/1335758678 >> 172.21.15.33:0/1335758678 conn(0x562b54494460 msgr2=0x562b548483c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 -- 172.21.15.33:0/1335758678 shutdown_connections 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 -- 172.21.15.33:0/1335758678 wait complete. 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 -- start start 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.675+0000 7f630f464740 1 Processor -- start 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f630f464740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 0x562b54854c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f630f464740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b5447f390 0x562b548551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f630f464740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544a0070 0x562b54855700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f630f464740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f63041b2110 con 0x562b5447f390 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f630f464740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f63041b1a40 con 0x562b544a0070 2024-08-28T19:42:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f630f464740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f63041aeca0 con 0x562b544771b0 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f630f464740 10 client.0 _ll_register_callbacks cb 0x7f62f4020020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f6301d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b5447f390 0x562b548551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f6301d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b5447f390 0x562b548551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42680/0 (socket says 172.21.15.33:42680) 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f6301d9b640 1 -- 172.21.15.33:0/3766237502 learned_addr learned my addr 172.21.15.33:0/3766237502 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f6302d9d640 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544a0070 0x562b54855700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f630259c640 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 0x562b54854c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f6301d9b640 1 -- 172.21.15.33:0/3766237502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 msgr2=0x562b54854c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f6301d9b640 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 0x562b54854c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f6301d9b640 1 -- 172.21.15.33:0/3766237502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544a0070 msgr2=0x562b54855700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f6301d9b640 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544a0070 0x562b54855700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f6301d9b640 1 -- 172.21.15.33:0/3766237502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b548cc5b0 con 0x562b5447f390 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f630259c640 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 0x562b54854c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f6301d9b640 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b5447f390 0x562b548551c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f62ec031440 tx=0x7f62ec0cbd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e1254bf12d77d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f62e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.676+0000 7f62e9ffb640 1 -- 172.21.15.33:0/3766237502 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec049070 con 0x562b5447f390 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f62e9ffb640 1 -- 172.21.15.33:0/3766237502 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f62ec103580 con 0x562b5447f390 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f630f464740 1 -- 172.21.15.33:0/3766237502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62fc012e30 con 0x562b5447f390 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f62e9ffb640 1 -- 172.21.15.33:0/3766237502 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f62ec0cbe60 con 0x562b5447f390 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f630f464740 10 client.18513 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f630f464740 1 -- 172.21.15.33:0/3766237502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b548cd770 con 0x562b5447f390 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f62e9ffb640 1 -- 172.21.15.33:0/3766237502 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62fc012e30 con 0x562b5447f390 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f62e9ffb640 1 -- 172.21.15.33:0/3766237502 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f62ec0c85e0 con 0x562b5447f390 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f630f464740 10 client.18513 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f630f464740 10 client.18513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f630f464740 20 client.18513 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f630f464740 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562b54433da0 0x562b548cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f630f464740 4 client.18513 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f630f464740 1 -- 172.21.15.33:0/3766237502 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b547ba020 con 0x562b54433da0 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.677+0000 7f630259c640 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562b54433da0 0x562b548cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630259c640 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562b54433da0 0x562b548cfee0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e02fda074a83b65 server_cookie=6dfc3edf5f18442b in_seq=0 out_seq=0 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f62e9ffb640 10 client.18513 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f62e9ffb640 1 -- 172.21.15.33:0/3766237502 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x562b547ba020 con 0x562b54433da0 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f62e9ffb640 10 client.18513 handle_command_reply: tid=0 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 client.18513 shutdown 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 -- 172.21.15.33:0/3766237502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b5447f390 msgr2=0x562b548551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b5447f390 0x562b548551c0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f62ec031440 tx=0x7f62ec0cbd60 comp rx=0 tx=0).stop 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 -- 172.21.15.33:0/3766237502 shutdown_connections 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b544a0070 0x562b54855700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562b54433da0 0x562b548cfee0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562b5447f390 0x562b548551c0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 --2- 172.21.15.33:0/3766237502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562b544771b0 0x562b54854c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f62e9ffb640 0 client.18513 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:42:56.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 -- 172.21.15.33:0/3766237502 >> 172.21.15.33:0/3766237502 conn(0x562b54494460 msgr2=0x562b548462f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:56.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 -- 172.21.15.33:0/3766237502 shutdown_connections 2024-08-28T19:42:56.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 1 -- 172.21.15.33:0/3766237502 wait complete. 2024-08-28T19:42:56.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.678+0000 7f630f464740 20 client.18513 trim_cache size 0 max 16384 2024-08-28T19:42:56.704 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:42:56.704 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:42:56.704 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:42:56.704 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.708 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:42:56.709 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.711 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.712 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.713 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:42:56.714 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:56.715 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:42:56.715 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:42:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 -- 172.21.15.33:0/738012694 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62f00b4ca0 msgr2=0x7f62f00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62f00b4ca0 0x7f62f00b71b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f62f4021000 tx=0x7f62f401e000 comp rx=0 tx=0).stop 2024-08-28T19:42:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 -- 172.21.15.33:0/738012694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6304105120 msgr2=0x7f630419a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6304105120 0x7f630419a830 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f62ec02a930 tx=0x7f62ec004270 comp rx=0 tx=0).stop 2024-08-28T19:42:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 -- 172.21.15.33:0/738012694 shutdown_connections 2024-08-28T19:42:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f62f00b4ca0 0x7f62f00b71b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f630410dc00 0x7f630419fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6304105120 0x7f630419a830 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 --2- 172.21.15.33:0/738012694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63041047d0 0x7f630419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:56.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 -- 172.21.15.33:0/738012694 >> 172.21.15.33:0/738012694 conn(0x7f6304079500 msgr2=0x7f63040ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:56.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 -- 172.21.15.33:0/738012694 shutdown_connections 2024-08-28T19:42:56.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:56.679+0000 7f6308eef640 1 -- 172.21.15.33:0/738012694 wait complete. 2024-08-28T19:42:57.492 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:42:57.492 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:42:57.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:57 smithi033 ceph-mon[18549]: pgmap v665: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-08-28T19:42:57.749 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:57.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:57 smithi059 ceph-mon[22052]: pgmap v665: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-08-28T19:42:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:57 smithi122 ceph-mon[22174]: pgmap v665: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-08-28T19:42:58.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.203+0000 7f647fe08640 1 -- 172.21.15.33:0/162010799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6478102880 msgr2=0x7f6478102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:58.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.203+0000 7f647fe08640 1 --2- 172.21.15.33:0/162010799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6478102880 0x7f6478102c90 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f6474009900 tx=0x7f647402a410 comp rx=0 tx=0).stop 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.203+0000 7f647fe08640 1 -- 172.21.15.33:0/162010799 shutdown_connections 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.203+0000 7f647fe08640 1 --2- 172.21.15.33:0/162010799 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6478108b10 0x7f647810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.203+0000 7f647fe08640 1 --2- 172.21.15.33:0/162010799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64781081c0 0x7f64781085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.203+0000 7f647fe08640 1 --2- 172.21.15.33:0/162010799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6478102880 0x7f6478102c90 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.203+0000 7f647fe08640 1 -- 172.21.15.33:0/162010799 >> 172.21.15.33:0/162010799 conn(0x7f6478079450 msgr2=0x7f6478079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.204+0000 7f647fe08640 1 -- 172.21.15.33:0/162010799 shutdown_connections 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.204+0000 7f647fe08640 1 -- 172.21.15.33:0/162010799 wait complete. 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.204+0000 7f647fe08640 1 Processor -- start 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.204+0000 7f647fe08640 1 -- start start 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647fe08640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6478102880 0x7f64781991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647fe08640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64781081c0 0x7f6478199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647fe08640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6478108b10 0x7f647819e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647fe08640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f64781127e0 con 0x7f64781081c0 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647fe08640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6478112660 con 0x7f6478102880 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647fe08640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6478112960 con 0x7f6478108b10 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647d3a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64781081c0 0x7f6478199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647d3a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64781081c0 0x7f6478199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42696/0 (socket says 172.21.15.33:42696) 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647d3a3640 1 -- 172.21.15.33:0/476450276 learned_addr learned my addr 172.21.15.33:0/476450276 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647e3a5640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6478108b10 0x7f647819e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647dba4640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6478102880 0x7f64781991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647d3a3640 1 -- 172.21.15.33:0/476450276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6478108b10 msgr2=0x7f647819e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647d3a3640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6478108b10 0x7f647819e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647d3a3640 1 -- 172.21.15.33:0/476450276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6478102880 msgr2=0x7f64781991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647d3a3640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6478102880 0x7f64781991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647d3a3640 1 -- 172.21.15.33:0/476450276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647819f120 con 0x7f64781081c0 2024-08-28T19:42:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f647d3a3640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64781081c0 0x7f6478199750 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f646800e9f0 tx=0x7f646800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.205+0000 7f646effd640 1 -- 172.21.15.33:0/476450276 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646800ccc0 con 0x7f64781081c0 2024-08-28T19:42:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.206+0000 7f647fe08640 1 -- 172.21.15.33:0/476450276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647819f410 con 0x7f64781081c0 2024-08-28T19:42:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.206+0000 7f646effd640 1 -- 172.21.15.33:0/476450276 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64680108e0 con 0x7f64781081c0 2024-08-28T19:42:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.206+0000 7f646effd640 1 -- 172.21.15.33:0/476450276 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6468018860 con 0x7f64781081c0 2024-08-28T19:42:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.206+0000 7f647fe08640 1 -- 172.21.15.33:0/476450276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647806b8e0 con 0x7f64781081c0 2024-08-28T19:42:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.207+0000 7f647fe08640 1 -- 172.21.15.33:0/476450276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6478103b00 con 0x7f64781081c0 2024-08-28T19:42:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.208+0000 7f646effd640 1 -- 172.21.15.33:0/476450276 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6468010430 con 0x7f64781081c0 2024-08-28T19:42:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.209+0000 7f646effd640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64640b4ca0 0x7f64640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.209+0000 7f647dba4640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64640b4ca0 0x7f64640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.209+0000 7f646effd640 1 -- 172.21.15.33:0/476450276 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f64680e6070 con 0x7f64781081c0 2024-08-28T19:42:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.210+0000 7f647dba4640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64640b4ca0 0x7f64640b71b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6474031440 tx=0x7f6474009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:58.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.212+0000 7f646effd640 1 -- 172.21.15.33:0/476450276 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f64680ac410 con 0x7f64781081c0 2024-08-28T19:42:58.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.438+0000 7f647fe08640 1 -- 172.21.15.33:0/476450276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6478102c90 con 0x7f64781081c0 2024-08-28T19:42:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.439+0000 7f646effd640 1 -- 172.21.15.33:0/476450276 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f64680b0bd0 con 0x7f64781081c0 2024-08-28T19:42:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:42:58.440 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:42:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:42:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 -- 172.21.15.33:0/476450276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64640b4ca0 msgr2=0x7f64640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64640b4ca0 0x7f64640b71b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6474031440 tx=0x7f6474009560 comp rx=0 tx=0).stop 2024-08-28T19:42:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 -- 172.21.15.33:0/476450276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64781081c0 msgr2=0x7f6478199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64781081c0 0x7f6478199750 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f646800e9f0 tx=0x7f646800eeb0 comp rx=0 tx=0).stop 2024-08-28T19:42:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 -- 172.21.15.33:0/476450276 shutdown_connections 2024-08-28T19:42:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f64640b4ca0 0x7f64640b71b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6478108b10 0x7f647819e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64781081c0 0x7f6478199750 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 --2- 172.21.15.33:0/476450276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6478102880 0x7f64781991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 -- 172.21.15.33:0/476450276 >> 172.21.15.33:0/476450276 conn(0x7f6478079450 msgr2=0x7f64781062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 -- 172.21.15.33:0/476450276 shutdown_connections 2024-08-28T19:42:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:58.441+0000 7f647fe08640 1 -- 172.21.15.33:0/476450276 wait complete. 2024-08-28T19:42:58.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:58 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/476450276' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:58.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:58 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/476450276' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:58.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:58 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/476450276' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:42:59.090 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:42:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:42:59.781 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:42:59 smithi033 ceph-mon[18549]: pgmap v666: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-28T19:42:59.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:42:59 smithi059 ceph-mon[22052]: pgmap v666: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-28T19:42:59.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:42:59 smithi122 ceph-mon[22174]: pgmap v666: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-28T19:42:59.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.873+0000 7ff50bccc640 1 -- 172.21.15.33:0/3508601563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff504108ac0 msgr2=0x7ff50410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:59.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.873+0000 7ff50bccc640 1 --2- 172.21.15.33:0/3508601563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff504108ac0 0x7ff50410f2f0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009ca0 tx=0x7ff4fc02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.873+0000 7ff50bccc640 1 -- 172.21.15.33:0/3508601563 shutdown_connections 2024-08-28T19:42:59.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.873+0000 7ff50bccc640 1 --2- 172.21.15.33:0/3508601563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff504108ac0 0x7ff50410f2f0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.873+0000 7ff50bccc640 1 --2- 172.21.15.33:0/3508601563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff504108170 0x7ff504108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.873+0000 7ff50bccc640 1 --2- 172.21.15.33:0/3508601563 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff504102880 0x7ff504102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.873+0000 7ff50bccc640 1 -- 172.21.15.33:0/3508601563 >> 172.21.15.33:0/3508601563 conn(0x7ff504079500 msgr2=0x7ff504079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.874+0000 7ff50bccc640 1 -- 172.21.15.33:0/3508601563 shutdown_connections 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.874+0000 7ff50bccc640 1 -- 172.21.15.33:0/3508601563 wait complete. 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.874+0000 7ff50bccc640 1 Processor -- start 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.874+0000 7ff50bccc640 1 -- start start 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff50bccc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff504102880 0x7ff50419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff50bccc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff504108170 0x7ff50419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff50bccc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff504108ac0 0x7ff50419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff50bccc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff504112740 con 0x7ff504108170 2024-08-28T19:42:59.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff50bccc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff5041125c0 con 0x7ff504108ac0 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff50bccc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff5041128c0 con 0x7ff504102880 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff509267640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff504108170 0x7ff50419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff509267640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff504108170 0x7ff50419a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36232/0 (socket says 172.21.15.33:36232) 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff509267640 1 -- 172.21.15.33:0/424764117 learned_addr learned my addr 172.21.15.33:0/424764117 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff509a68640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff504102880 0x7ff50419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff50a269640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff504108ac0 0x7ff50419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff509267640 1 -- 172.21.15.33:0/424764117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff504102880 msgr2=0x7ff50419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff509267640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff504102880 0x7ff50419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff509267640 1 -- 172.21.15.33:0/424764117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff504108ac0 msgr2=0x7ff50419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff509267640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff504108ac0 0x7ff50419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff509267640 1 -- 172.21.15.33:0/424764117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5041a0150 con 0x7ff504108170 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff50a269640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff504108ac0 0x7ff50419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff509267640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff504108170 0x7ff50419a780 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400d770 tx=0x7ff4f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:59.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff4faffd640 1 -- 172.21.15.33:0/424764117 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4017070 con 0x7ff504108170 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff50bccc640 1 -- 172.21.15.33:0/424764117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5041a0440 con 0x7ff504108170 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff4faffd640 1 -- 172.21.15.33:0/424764117 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f4009c30 con 0x7ff504108170 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff4faffd640 1 -- 172.21.15.33:0/424764117 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f400f620 con 0x7ff504108170 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.875+0000 7ff50bccc640 1 -- 172.21.15.33:0/424764117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5041a6ba0 con 0x7ff504108170 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.878+0000 7ff512241740 1 Processor -- start 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.878+0000 7ff512241740 1 -- start start 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.878+0000 7ff512241740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f36070 0x5624792db310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.878+0000 7ff512241740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792db850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.878+0000 7ff512241740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f15390 0x5624792dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.878+0000 7ff512241740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562479252680 con 0x562478f0d1b0 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.878+0000 7ff512241740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562479241c10 con 0x562478f15390 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.878+0000 7ff512241740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562479245bc0 con 0x562478f36070 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.878+0000 7ff4faffd640 1 -- 172.21.15.33:0/424764117 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff4f401a070 con 0x7ff504108170 2024-08-28T19:42:59.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff509a68640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792db850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff509a68640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792db850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36240/0 (socket says 172.21.15.33:36240) 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff509a68640 1 -- 172.21.15.33:0/2210254730 learned_addr learned my addr 172.21.15.33:0/2210254730 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff50a269640 1 --2- 172.21.15.33:0/2210254730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f36070 0x5624792db310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff509a68640 1 -- 172.21.15.33:0/2210254730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f36070 msgr2=0x5624792db310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff509267640 1 --2- 172.21.15.33:0/2210254730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f15390 0x5624792dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff509a68640 1 --2- 172.21.15.33:0/2210254730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f36070 0x5624792db310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff509a68640 1 -- 172.21.15.33:0/2210254730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f15390 msgr2=0x5624792dbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff509a68640 1 --2- 172.21.15.33:0/2210254730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f15390 0x5624792dbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff509a68640 1 -- 172.21.15.33:0/2210254730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562478fa1650 con 0x562478f0d1b0 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff509a68640 1 --2- 172.21.15.33:0/2210254730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792db850 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7ff50000ac10 tx=0x7ff50000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b8772d62509c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff4faffd640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff4f00b4ca0 0x7ff4f00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff4effff640 1 -- 172.21.15.33:0/2210254730 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50001d070 con 0x562478f0d1b0 2024-08-28T19:42:59.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff4effff640 1 -- 172.21.15.33:0/2210254730 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff500018af0 con 0x562478f0d1b0 2024-08-28T19:42:59.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff4effff640 1 -- 172.21.15.33:0/2210254730 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500010a90 con 0x562478f0d1b0 2024-08-28T19:42:59.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.879+0000 7ff50a269640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff4f00b4ca0 0x7ff4f00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.880+0000 7ff4faffd640 1 -- 172.21.15.33:0/424764117 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7ff4f40e5480 con 0x7ff504108170 2024-08-28T19:42:59.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.880+0000 7ff512241740 1 -- 172.21.15.33:0/2210254730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 msgr2=0x5624792db850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:59.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.880+0000 7ff50a269640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff4f00b4ca0 0x7ff4f00b71b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc006010 tx=0x7ff4fc02f3a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:59.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.880+0000 7ff512241740 1 --2- 172.21.15.33:0/2210254730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792db850 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7ff50000ac10 tx=0x7ff50000f790 comp rx=0 tx=0).stop 2024-08-28T19:42:59.912 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:42:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.880+0000 7ff512241740 1 -- 172.21.15.33:0/2210254730 shutdown_connections 2024-08-28T19:42:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.880+0000 7ff512241740 1 --2- 172.21.15.33:0/2210254730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f15390 0x5624792dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.880+0000 7ff512241740 1 --2- 172.21.15.33:0/2210254730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792db850 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.880+0000 7ff512241740 1 --2- 172.21.15.33:0/2210254730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f36070 0x5624792db310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.880+0000 7ff512241740 1 -- 172.21.15.33:0/2210254730 >> 172.21.15.33:0/2210254730 conn(0x562478f2a460 msgr2=0x5624792d9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.880+0000 7ff512241740 1 -- 172.21.15.33:0/2210254730 shutdown_connections 2024-08-28T19:42:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.881+0000 7ff512241740 1 -- 172.21.15.33:0/2210254730 wait complete. 2024-08-28T19:42:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.881+0000 7ff512241740 1 -- start start 2024-08-28T19:42:59.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.881+0000 7ff512241740 1 Processor -- start 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.881+0000 7ff512241740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f0d1b0 0x5624792e6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.881+0000 7ff512241740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f15390 0x5624792e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.881+0000 7ff512241740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f36070 0x5624792f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.881+0000 7ff512241740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5624790a4700 con 0x562478f36070 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.881+0000 7ff512241740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5624791c8750 con 0x562478f15390 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.881+0000 7ff512241740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5624792e9af0 con 0x562478f0d1b0 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.881+0000 7ff512241740 10 client.0 _ll_register_callbacks cb 0x5624791f7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff50a269640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f36070 0x5624792f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff50a269640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f36070 0x5624792f2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36252/0 (socket says 172.21.15.33:36252) 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff50a269640 1 -- 172.21.15.33:0/2473058507 learned_addr learned my addr 172.21.15.33:0/2473058507 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff509a68640 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f0d1b0 0x5624792e6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff509267640 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f15390 0x5624792e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff50a269640 1 -- 172.21.15.33:0/2473058507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f0d1b0 msgr2=0x5624792e6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:59.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff50a269640 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f0d1b0 0x5624792e6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff50a269640 1 -- 172.21.15.33:0/2473058507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f15390 msgr2=0x5624792e6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff50a269640 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f15390 0x5624792e6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff50a269640 1 -- 172.21.15.33:0/2473058507 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562479201900 con 0x562478f36070 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff50a269640 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f36070 0x5624792f2e10 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0316b0 tx=0x7ff4fc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec0a92c1a452b29 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff4ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/2473058507 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc04f070 con 0x562478f36070 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/2473058507 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7ff4fc004040 con 0x562478f36070 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.882+0000 7ff512241740 1 -- 172.21.15.33:0/2473058507 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff500018af0 con 0x562478f36070 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/2473058507 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4fc004240 con 0x562478f36070 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff512241740 10 client.18531 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff512241740 1 -- 172.21.15.33:0/2473058507 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5624792f5860 con 0x562478f36070 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/2473058507 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff500018af0 con 0x562478f36070 2024-08-28T19:42:59.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/2473058507 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff4fc044040 con 0x562478f36070 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff512241740 10 client.18531 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff512241740 10 client.18531 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff512241740 20 client.18531 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff512241740 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562478ef49f0 0x5624792f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff512241740 4 client.18531 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.883+0000 7ff512241740 1 -- 172.21.15.33:0/2473058507 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624792545d0 con 0x562478ef49f0 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.884+0000 7ff509a68640 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562478ef49f0 0x5624792f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.884+0000 7ff4ed7fa640 10 client.18531 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.884+0000 7ff509a68640 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562478ef49f0 0x5624792f8da0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=72e1cff1c2b0b00a server_cookie=b04168996b718adb in_seq=0 out_seq=0 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/2473058507 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624792545d0 con 0x562478ef49f0 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff4ed7fa640 10 client.18531 handle_command_reply: tid=0 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 client.18531 shutdown 2024-08-28T19:42:59.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 -- 172.21.15.33:0/2473058507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f36070 msgr2=0x5624792f2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f36070 0x5624792f2e10 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0316b0 tx=0x7ff4fc0095c0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 -- 172.21.15.33:0/2473058507 shutdown_connections 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562478ef49f0 0x5624792f8da0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f36070 0x5624792f2e10 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f15390 0x5624792e6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 --2- 172.21.15.33:0/2473058507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f0d1b0 0x5624792e6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 -- 172.21.15.33:0/2473058507 >> 172.21.15.33:0/2473058507 conn(0x562478f2a460 msgr2=0x5624792de4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff4ed7fa640 0 client.18531 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 -- 172.21.15.33:0/2473058507 shutdown_connections 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 1 -- 172.21.15.33:0/2473058507 wait complete. 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.885+0000 7ff512241740 20 client.18531 trim_cache size 0 max 16384 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.898+0000 7ff512241740 1 Processor -- start 2024-08-28T19:42:59.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.898+0000 7ff512241740 1 -- start start 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff512241740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792deb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff512241740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f15390 0x5624792f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff512241740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f36070 0x5624792d8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff512241740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff5041b0c40 con 0x562478f0d1b0 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff512241740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff5041b2780 con 0x562478f36070 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff512241740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff5041b1310 con 0x562478f15390 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff509a68640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff509a68640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792deb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36256/0 (socket says 172.21.15.33:36256) 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff509a68640 1 -- 172.21.15.33:0/3650004042 learned_addr learned my addr 172.21.15.33:0/3650004042 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff50a269640 1 --2- 172.21.15.33:0/3650004042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f36070 0x5624792d8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff509a68640 1 -- 172.21.15.33:0/3650004042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f15390 msgr2=0x5624792f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff509267640 1 --2- 172.21.15.33:0/3650004042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f15390 0x5624792f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff509a68640 1 --2- 172.21.15.33:0/3650004042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f15390 0x5624792f2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff509a68640 1 -- 172.21.15.33:0/3650004042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f36070 msgr2=0x5624792d8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff509a68640 1 --2- 172.21.15.33:0/3650004042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f36070 0x5624792d8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff509a68640 1 -- 172.21.15.33:0/3650004042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624792dd600 con 0x562478f0d1b0 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff50a269640 1 --2- 172.21.15.33:0/3650004042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f36070 0x5624792d8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff509a68640 1 --2- 172.21.15.33:0/3650004042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792deb20 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ff50000a7c0 tx=0x7ff50000a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230fb5c4ac8ebf90 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.899+0000 7ff4ef7fe640 1 -- 172.21.15.33:0/3650004042 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500032070 con 0x562478f0d1b0 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.900+0000 7ff4ef7fe640 1 -- 172.21.15.33:0/3650004042 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff50001e040 con 0x562478f0d1b0 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.900+0000 7ff4ef7fe640 1 -- 172.21.15.33:0/3650004042 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50001d040 con 0x562478f0d1b0 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.900+0000 7ff512241740 1 -- 172.21.15.33:0/3650004042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 msgr2=0x5624792deb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.900+0000 7ff512241740 1 --2- 172.21.15.33:0/3650004042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792deb20 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ff50000a7c0 tx=0x7ff50000a670 comp rx=0 tx=0).stop 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.900+0000 7ff512241740 1 -- 172.21.15.33:0/3650004042 shutdown_connections 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.900+0000 7ff512241740 1 --2- 172.21.15.33:0/3650004042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f36070 0x5624792d8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.900+0000 7ff512241740 1 --2- 172.21.15.33:0/3650004042 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f15390 0x5624792f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.900+0000 7ff512241740 1 --2- 172.21.15.33:0/3650004042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f0d1b0 0x5624792deb20 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.900+0000 7ff512241740 1 -- 172.21.15.33:0/3650004042 >> 172.21.15.33:0/3650004042 conn(0x562478f2a460 msgr2=0x5624792de410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.900+0000 7ff512241740 1 -- 172.21.15.33:0/3650004042 shutdown_connections 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.901+0000 7ff512241740 1 -- 172.21.15.33:0/3650004042 wait complete. 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.901+0000 7ff512241740 1 -- start start 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.901+0000 7ff512241740 1 Processor -- start 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.901+0000 7ff512241740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f0d1b0 0x5624792ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.901+0000 7ff512241740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f15390 0x5624792eb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.901+0000 7ff512241740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f36070 0x5624792ebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.901+0000 7ff512241740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff5041b20b0 con 0x562478f15390 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.901+0000 7ff512241740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff5041b19e0 con 0x562478f0d1b0 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.901+0000 7ff512241740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff5041aec40 con 0x562478f36070 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.901+0000 7ff512241740 10 client.0 _ll_register_callbacks cb 0x7ff4fc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:42:59.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff509267640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f15390 0x5624792eb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff509267640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f15390 0x5624792eb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36266/0 (socket says 172.21.15.33:36266) 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff509267640 1 -- 172.21.15.33:0/4084014882 learned_addr learned my addr 172.21.15.33:0/4084014882 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff509a68640 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f0d1b0 0x5624792ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff50a269640 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f36070 0x5624792ebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff509267640 1 -- 172.21.15.33:0/4084014882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f36070 msgr2=0x5624792ebdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff509267640 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f36070 0x5624792ebdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff509267640 1 -- 172.21.15.33:0/4084014882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f0d1b0 msgr2=0x5624792ef3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff509267640 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f0d1b0 0x5624792ef3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff509267640 1 -- 172.21.15.33:0/4084014882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624792ec3a0 con 0x562478f15390 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff509267640 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f15390 0x5624792eb870 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40ab760 tx=0x7ff4f40ab5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d095e286fe5b9b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff4ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/4084014882 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4021040 con 0x562478f15390 2024-08-28T19:42:59.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/4084014882 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7ff4f40aac40 con 0x562478f15390 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff512241740 1 -- 172.21.15.33:0/4084014882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff50001e040 con 0x562478f15390 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/4084014882 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4f40b4430 con 0x562478f15390 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff512241740 10 client.18537 fetch_fsmap learned FSMap version 28 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.902+0000 7ff512241740 1 -- 172.21.15.33:0/4084014882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562479368980 con 0x562478f15390 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/4084014882 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff50001e040 con 0x562478f15390 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/4084014882 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff4f40acb00 con 0x562478f15390 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff512241740 10 client.18537 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff512241740 10 client.18537 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff512241740 20 client.18537 populate_metadata read hostname 'smithi033' 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff512241740 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562478ec9da0 0x56247936b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff512241740 4 client.18537 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff512241740 1 -- 172.21.15.33:0/4084014882 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562479250070 con 0x562478ec9da0 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff509a68640 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562478ec9da0 0x56247936b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:42:59.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff4ed7fa640 10 client.18537 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.903+0000 7ff509a68640 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562478ec9da0 0x56247936b0f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a11e5e871d291a7b server_cookie=b77ff97987aa1309 in_seq=0 out_seq=0 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff4ed7fa640 1 -- 172.21.15.33:0/4084014882 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562479250070 con 0x562478ec9da0 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff4ed7fa640 10 client.18537 handle_command_reply: tid=0 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 client.18537 shutdown 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 -- 172.21.15.33:0/4084014882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f15390 msgr2=0x5624792eb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f15390 0x5624792eb870 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40ab760 tx=0x7ff4f40ab5a0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 -- 172.21.15.33:0/4084014882 shutdown_connections 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x562478ec9da0 0x56247936b0f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562478f36070 0x5624792ebdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562478f15390 0x5624792eb870 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 --2- 172.21.15.33:0/4084014882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562478f0d1b0 0x5624792ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff4ed7fa640 0 client.18537 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:42:59.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 -- 172.21.15.33:0/4084014882 >> 172.21.15.33:0/4084014882 conn(0x562478f2a460 msgr2=0x5624792d8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 -- 172.21.15.33:0/4084014882 shutdown_connections 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 1 -- 172.21.15.33:0/4084014882 wait complete. 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.904+0000 7ff512241740 20 client.18537 trim_cache size 0 max 16384 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 -- 172.21.15.33:0/424764117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff4f00b4ca0 msgr2=0x7ff4f00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff4f00b4ca0 0x7ff4f00b71b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc006010 tx=0x7ff4fc02f3a0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 -- 172.21.15.33:0/424764117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff504108170 msgr2=0x7ff50419a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff504108170 0x7ff50419a780 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400d770 tx=0x7ff4f400dc30 comp rx=0 tx=0).stop 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 -- 172.21.15.33:0/424764117 shutdown_connections 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff504108ac0 0x7ff50419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff504108170 0x7ff50419a780 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff4f00b4ca0 0x7ff4f00b71b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 --2- 172.21.15.33:0/424764117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff504102880 0x7ff50419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 -- 172.21.15.33:0/424764117 >> 172.21.15.33:0/424764117 conn(0x7ff504079500 msgr2=0x7ff50406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:42:59.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 -- 172.21.15.33:0/424764117 shutdown_connections 2024-08-28T19:42:59.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:42:59.905+0000 7ff50bccc640 1 -- 172.21.15.33:0/424764117 wait complete. 2024-08-28T19:43:00.675 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:43:00.941 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:01.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.426+0000 7fb25430f640 1 -- 172.21.15.33:0/3806908889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb24c109240 msgr2=0x7fb24c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:01.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.426+0000 7fb25430f640 1 --2- 172.21.15.33:0/3806908889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb24c109240 0x7fb24c109650 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009900 tx=0x7fb23c02a410 comp rx=0 tx=0).stop 2024-08-28T19:43:01.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.426+0000 7fb25430f640 1 -- 172.21.15.33:0/3806908889 shutdown_connections 2024-08-28T19:43:01.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.426+0000 7fb25430f640 1 --2- 172.21.15.33:0/3806908889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb24c109b90 0x7fb24c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.426+0000 7fb25430f640 1 --2- 172.21.15.33:0/3806908889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb24c109240 0x7fb24c109650 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.426+0000 7fb25430f640 1 --2- 172.21.15.33:0/3806908889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c103900 0x7fb24c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.426+0000 7fb25430f640 1 -- 172.21.15.33:0/3806908889 >> 172.21.15.33:0/3806908889 conn(0x7fb24c07b5f0 msgr2=0x7fb24c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.426+0000 7fb25430f640 1 -- 172.21.15.33:0/3806908889 shutdown_connections 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.426+0000 7fb25430f640 1 -- 172.21.15.33:0/3806908889 wait complete. 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.427+0000 7fb25430f640 1 Processor -- start 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.427+0000 7fb25430f640 1 -- start start 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.427+0000 7fb25430f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb24c103900 0x7fb24c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.427+0000 7fb25430f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c109240 0x7fb24c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.427+0000 7fb25430f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb24c109b90 0x7fb24c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.427+0000 7fb25430f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c113850 con 0x7fb24c103900 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.427+0000 7fb25430f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1136d0 con 0x7fb24c109240 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.427+0000 7fb25430f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1139d0 con 0x7fb24c109b90 2024-08-28T19:43:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.427+0000 7fb2520ab640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb24c103900 0x7fb24c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2520ab640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb24c103900 0x7fb24c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36288/0 (socket says 172.21.15.33:36288) 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2520ab640 1 -- 172.21.15.33:0/2375866502 learned_addr learned my addr 172.21.15.33:0/2375866502 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2528ac640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb24c109b90 0x7fb24c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2518aa640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c109240 0x7fb24c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2520ab640 1 -- 172.21.15.33:0/2375866502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb24c109b90 msgr2=0x7fb24c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2520ab640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb24c109b90 0x7fb24c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2520ab640 1 -- 172.21.15.33:0/2375866502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c109240 msgr2=0x7fb24c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2520ab640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c109240 0x7fb24c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2520ab640 1 -- 172.21.15.33:0/2375866502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24c1a8470 con 0x7fb24c103900 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2520ab640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb24c103900 0x7fb24c0754b0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c920 tx=0x7fb24800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2437fe640 1 -- 172.21.15.33:0/2375866502 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248007c70 con 0x7fb24c103900 2024-08-28T19:43:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb25430f640 1 -- 172.21.15.33:0/2375866502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24c1a8760 con 0x7fb24c103900 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2437fe640 1 -- 172.21.15.33:0/2375866502 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb248007e10 con 0x7fb24c103900 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb2437fe640 1 -- 172.21.15.33:0/2375866502 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248018820 con 0x7fb24c103900 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.428+0000 7fb25430f640 1 -- 172.21.15.33:0/2375866502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24c1a8cc0 con 0x7fb24c103900 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.431+0000 7fb25a884740 1 Processor -- start 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb25a884740 1 -- start start 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb25a884740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2ac070 0x55e90d651310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb25a884740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d651850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb25a884740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d28b390 0x55e90d651d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb25a884740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e90d5c8680 con 0x55e90d2831b0 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb25a884740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e90d5b7c10 con 0x55e90d28b390 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb25a884740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e90d5bbbc0 con 0x55e90d2ac070 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb2528ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2ac070 0x55e90d651310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb2437fe640 1 -- 172.21.15.33:0/2375866502 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb24800f450 con 0x7fb24c103900 2024-08-28T19:43:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb2528ac640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2ac070 0x55e90d651310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:51750/0 (socket says 172.21.15.33:51750) 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb2528ac640 1 -- 172.21.15.33:0/1530653304 learned_addr learned my addr 172.21.15.33:0/1530653304 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb2518aa640 1 --2- 172.21.15.33:0/1530653304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d28b390 0x55e90d651d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.432+0000 7fb2520ab640 1 --2- 172.21.15.33:0/1530653304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d651850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb2528ac640 1 -- 172.21.15.33:0/1530653304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d28b390 msgr2=0x55e90d651d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1530653304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d28b390 0x55e90d651d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb2528ac640 1 -- 172.21.15.33:0/1530653304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 msgr2=0x55e90d651850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1530653304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d651850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb2528ac640 1 -- 172.21.15.33:0/1530653304 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e90d317650 con 0x55e90d2ac070 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb2520ab640 1 --2- 172.21.15.33:0/1530653304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d651850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1530653304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2ac070 0x55e90d651310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb244009ee0 tx=0x7fb244010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2577970586da21d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb2437fe640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2380b4ca0 0x7fb2380b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb240d9a640 1 -- 172.21.15.33:0/1530653304 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244016070 con 0x55e90d2ac070 2024-08-28T19:43:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb2520ab640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2380b4ca0 0x7fb2380b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb240d9a640 1 -- 172.21.15.33:0/1530653304 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb244004d20 con 0x55e90d2ac070 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb240d9a640 1 -- 172.21.15.33:0/1530653304 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2440126b0 con 0x55e90d2ac070 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.433+0000 7fb2437fe640 1 -- 172.21.15.33:0/2375866502 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7fb2480e5b20 con 0x7fb24c103900 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.434+0000 7fb25a884740 1 -- 172.21.15.33:0/1530653304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2ac070 msgr2=0x55e90d651310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.434+0000 7fb25a884740 1 --2- 172.21.15.33:0/1530653304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2ac070 0x55e90d651310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb244009ee0 tx=0x7fb244010740 comp rx=0 tx=0).stop 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.434+0000 7fb2520ab640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2380b4ca0 0x7fb2380b71b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb2480e2f80 tx=0x7fb248000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.434+0000 7fb25a884740 1 -- 172.21.15.33:0/1530653304 shutdown_connections 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.434+0000 7fb25a884740 1 --2- 172.21.15.33:0/1530653304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d28b390 0x55e90d651d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.434+0000 7fb25a884740 1 --2- 172.21.15.33:0/1530653304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d651850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.434+0000 7fb25a884740 1 --2- 172.21.15.33:0/1530653304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2ac070 0x55e90d651310 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.434+0000 7fb25a884740 1 -- 172.21.15.33:0/1530653304 >> 172.21.15.33:0/1530653304 conn(0x55e90d2a0460 msgr2=0x55e90d64f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.434+0000 7fb25a884740 1 -- 172.21.15.33:0/1530653304 shutdown_connections 2024-08-28T19:43:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.434+0000 7fb25a884740 1 -- 172.21.15.33:0/1530653304 wait complete. 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb25a884740 1 -- start start 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb25a884740 1 Processor -- start 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb25a884740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2831b0 0x55e90d65cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb25a884740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d28b390 0x55e90d65d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb25a884740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d668de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb25a884740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e90d41a700 con 0x55e90d2ac070 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb25a884740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e90d53e750 con 0x55e90d28b390 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb25a884740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e90d65faf0 con 0x55e90d2831b0 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb25a884740 10 client.0 _ll_register_callbacks cb 0x55e90d56de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb2528ac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d668de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb2528ac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d668de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36318/0 (socket says 172.21.15.33:36318) 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb2528ac640 1 -- 172.21.15.33:0/1296505261 learned_addr learned my addr 172.21.15.33:0/1296505261 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2831b0 0x55e90d65cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.435+0000 7fb2518aa640 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d28b390 0x55e90d65d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb2528ac640 1 -- 172.21.15.33:0/1296505261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d28b390 msgr2=0x55e90d65d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d28b390 0x55e90d65d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb2528ac640 1 -- 172.21.15.33:0/1296505261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 msgr2=0x55e90d668de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d668de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb2528ac640 1 -- 172.21.15.33:0/1296505261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e90d577900 con 0x55e90d2831b0 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2831b0 0x55e90d65cac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb244005bd0 tx=0x7fb244000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81aece49f01b184 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb235ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb235ffb640 1 -- 172.21.15.33:0/1296505261 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24401e020 con 0x55e90d2831b0 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb25a884740 1 -- 172.21.15.33:0/1296505261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb244004d20 con 0x55e90d2831b0 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb235ffb640 1 -- 172.21.15.33:0/1296505261 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7fb244012910 con 0x55e90d2831b0 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb235ffb640 1 -- 172.21.15.33:0/1296505261 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb244031050 con 0x55e90d2831b0 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb25a884740 10 client.27469 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.436+0000 7fb25a884740 1 -- 172.21.15.33:0/1296505261 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e90d66b8f0 con 0x55e90d2831b0 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.437+0000 7fb235ffb640 1 -- 172.21.15.33:0/1296505261 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb244004d20 con 0x55e90d2831b0 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.437+0000 7fb235ffb640 1 -- 172.21.15.33:0/1296505261 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb24400f040 con 0x55e90d2831b0 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.437+0000 7fb25a884740 10 client.27469 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.437+0000 7fb25a884740 10 client.27469 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.437+0000 7fb25a884740 20 client.27469 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.437+0000 7fb25a884740 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55e90d26a9f0 0x55e90d66ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.437+0000 7fb25a884740 4 client.27469 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.437+0000 7fb25a884740 1 -- 172.21.15.33:0/1296505261 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e90d5ca5d0 con 0x55e90d26a9f0 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.437+0000 7fb2518aa640 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55e90d26a9f0 0x55e90d66ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb235ffb640 10 client.27469 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb2518aa640 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55e90d26a9f0 0x55e90d66ecb0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1360764bf66b6b7f server_cookie=9f58e0a90aaa1c7e in_seq=0 out_seq=0 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb235ffb640 1 -- 172.21.15.33:0/1296505261 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e90d5ca5d0 con 0x55e90d26a9f0 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb235ffb640 10 client.27469 handle_command_reply: tid=0 2024-08-28T19:43:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb25a884740 1 client.27469 shutdown 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb25a884740 1 -- 172.21.15.33:0/1296505261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2831b0 msgr2=0x55e90d65cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb25a884740 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2831b0 0x55e90d65cac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb244005bd0 tx=0x7fb244000f40 comp rx=0 tx=0).stop 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb25a884740 1 -- 172.21.15.33:0/1296505261 shutdown_connections 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb25a884740 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55e90d26a9f0 0x55e90d66ecb0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb25a884740 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d668de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb25a884740 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d28b390 0x55e90d65d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb25a884740 1 --2- 172.21.15.33:0/1296505261 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d2831b0 0x55e90d65cac0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb235ffb640 0 client.27469 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.438+0000 7fb25a884740 1 -- 172.21.15.33:0/1296505261 >> 172.21.15.33:0/1296505261 conn(0x55e90d2a0460 msgr2=0x55e90d6544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.439+0000 7fb25a884740 1 -- 172.21.15.33:0/1296505261 shutdown_connections 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.439+0000 7fb25a884740 1 -- 172.21.15.33:0/1296505261 wait complete. 2024-08-28T19:43:01.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.439+0000 7fb25a884740 20 client.27469 trim_cache size 0 max 16384 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb25a884740 1 Processor -- start 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb25a884740 1 -- start start 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb25a884740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d654b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb25a884740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 0x55e90d668ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb25a884740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d2ac070 0x55e90d669220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb25a884740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1b2e20 con 0x55e90d2831b0 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb25a884740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1b4960 con 0x55e90d2ac070 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb25a884740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1b34f0 con 0x55e90d28b390 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb2528ac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d654b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb2528ac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d654b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36332/0 (socket says 172.21.15.33:36332) 2024-08-28T19:43:01.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb2528ac640 1 -- 172.21.15.33:0/3671886364 learned_addr learned my addr 172.21.15.33:0/3671886364 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:01.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb2528ac640 1 -- 172.21.15.33:0/3671886364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 msgr2=0x55e90d668ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:01.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.452+0000 7fb2518aa640 1 --2- 172.21.15.33:0/3671886364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 0x55e90d668ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.453+0000 7fb2528ac640 1 --2- 172.21.15.33:0/3671886364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 0x55e90d668ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.453+0000 7fb2528ac640 1 -- 172.21.15.33:0/3671886364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d2ac070 msgr2=0x55e90d669220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.453+0000 7fb2528ac640 1 --2- 172.21.15.33:0/3671886364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d2ac070 0x55e90d669220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.453+0000 7fb2528ac640 1 -- 172.21.15.33:0/3671886364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e90d65dd80 con 0x55e90d2831b0 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.453+0000 7fb2518aa640 1 --2- 172.21.15.33:0/3671886364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 0x55e90d668ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.453+0000 7fb2528ac640 1 --2- 172.21.15.33:0/3671886364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d654b20 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fb244009700 tx=0x7fb24401a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de867d49251697f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.453+0000 7fb237fff640 1 -- 172.21.15.33:0/3671886364 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24401e040 con 0x55e90d2831b0 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.453+0000 7fb237fff640 1 -- 172.21.15.33:0/3671886364 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2440049e0 con 0x55e90d2831b0 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.453+0000 7fb237fff640 1 -- 172.21.15.33:0/3671886364 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244016040 con 0x55e90d2831b0 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 -- 172.21.15.33:0/3671886364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 msgr2=0x55e90d654b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 --2- 172.21.15.33:0/3671886364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d654b20 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fb244009700 tx=0x7fb24401a4a0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 -- 172.21.15.33:0/3671886364 shutdown_connections 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 --2- 172.21.15.33:0/3671886364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d2ac070 0x55e90d669220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 --2- 172.21.15.33:0/3671886364 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 0x55e90d668ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 --2- 172.21.15.33:0/3671886364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2831b0 0x55e90d654b20 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 -- 172.21.15.33:0/3671886364 >> 172.21.15.33:0/3671886364 conn(0x55e90d2a0460 msgr2=0x55e90d654410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 -- 172.21.15.33:0/3671886364 shutdown_connections 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 -- 172.21.15.33:0/3671886364 wait complete. 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 -- start start 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 Processor -- start 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.454+0000 7fb25a884740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d2831b0 0x55e90d660eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb25a884740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 0x55e90d6613f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb25a884740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d661930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb25a884740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1b4290 con 0x55e90d2ac070 2024-08-28T19:43:01.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb25a884740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1b3bc0 con 0x55e90d2831b0 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb25a884740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb24c1b0e20 con 0x55e90d28b390 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb25a884740 10 client.0 _ll_register_callbacks cb 0x7fb244009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2528ac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d661930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2528ac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d661930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36342/0 (socket says 172.21.15.33:36342) 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2528ac640 1 -- 172.21.15.33:0/1717319531 learned_addr learned my addr 172.21.15.33:0/1717319531 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2518aa640 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 0x55e90d6613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d2831b0 0x55e90d660eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2528ac640 1 -- 172.21.15.33:0/1717319531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 msgr2=0x55e90d6613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 0x55e90d6613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2528ac640 1 -- 172.21.15.33:0/1717319531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d2831b0 msgr2=0x55e90d660eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d2831b0 0x55e90d660eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2528ac640 1 -- 172.21.15.33:0/1717319531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e90d6d8630 con 0x55e90d2ac070 2024-08-28T19:43:01.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2518aa640 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 0x55e90d6613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:01.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb2528ac640 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d661930 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fb244002230 tx=0x7fb244000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d981416403d5ff4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb235ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb235ffb640 1 -- 172.21.15.33:0/1717319531 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244016030 con 0x55e90d2ac070 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb235ffb640 1 -- 172.21.15.33:0/1717319531 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7fb244002030 con 0x55e90d2ac070 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.455+0000 7fb25a884740 1 -- 172.21.15.33:0/1717319531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2440049e0 con 0x55e90d2ac070 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb235ffb640 1 -- 172.21.15.33:0/1717319531 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb244009ae0 con 0x55e90d2ac070 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb25a884740 10 client.18555 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb25a884740 1 -- 172.21.15.33:0/1717319531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e90d6d9800 con 0x55e90d2ac070 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb235ffb640 1 -- 172.21.15.33:0/1717319531 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2440049e0 con 0x55e90d2ac070 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb235ffb640 1 -- 172.21.15.33:0/1717319531 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb244004c60 con 0x55e90d2ac070 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb25a884740 10 client.18555 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:01.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb25a884740 10 client.18555 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb25a884740 20 client.18555 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb25a884740 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55e90d23fda0 0x55e90d6dbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb25a884740 4 client.18555 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb25a884740 1 -- 172.21.15.33:0/1717319531 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e90d5c6070 con 0x55e90d23fda0 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.456+0000 7fb2518aa640 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55e90d23fda0 0x55e90d6dbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb2518aa640 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55e90d23fda0 0x55e90d6dbe50 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b9353a53c63ea38 server_cookie=bd5cff60d3934478 in_seq=0 out_seq=0 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb235ffb640 10 client.18555 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb235ffb640 1 -- 172.21.15.33:0/1717319531 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e90d5c6070 con 0x55e90d23fda0 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb235ffb640 10 client.18555 handle_command_reply: tid=0 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 client.18555 shutdown 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 -- 172.21.15.33:0/1717319531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 msgr2=0x55e90d661930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d661930 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fb244002230 tx=0x7fb244000f40 comp rx=0 tx=0).stop 2024-08-28T19:43:01.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 -- 172.21.15.33:0/1717319531 shutdown_connections 2024-08-28T19:43:01.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55e90d23fda0 0x55e90d6dbe50 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e90d2ac070 0x55e90d661930 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e90d28b390 0x55e90d6613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 --2- 172.21.15.33:0/1717319531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e90d2831b0 0x55e90d660eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 -- 172.21.15.33:0/1717319531 >> 172.21.15.33:0/1717319531 conn(0x55e90d2a0460 msgr2=0x55e90d652200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:01.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb235ffb640 0 client.18555 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:43:01.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 -- 172.21.15.33:0/1717319531 shutdown_connections 2024-08-28T19:43:01.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 1 -- 172.21.15.33:0/1717319531 wait complete. 2024-08-28T19:43:01.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.457+0000 7fb25a884740 20 client.18555 trim_cache size 0 max 16384 2024-08-28T19:43:01.463 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:43:01.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 -- 172.21.15.33:0/2375866502 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2380b4ca0 msgr2=0x7fb2380b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:01.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2380b4ca0 0x7fb2380b71b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb2480e2f80 tx=0x7fb248000bc0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 -- 172.21.15.33:0/2375866502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb24c103900 msgr2=0x7fb24c0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:01.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb24c103900 0x7fb24c0754b0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c920 tx=0x7fb24800cde0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 -- 172.21.15.33:0/2375866502 shutdown_connections 2024-08-28T19:43:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb2380b4ca0 0x7fb2380b71b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb24c109b90 0x7fb24c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c109240 0x7fb24c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 --2- 172.21.15.33:0/2375866502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb24c103900 0x7fb24c0754b0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 -- 172.21.15.33:0/2375866502 >> 172.21.15.33:0/2375866502 conn(0x7fb24c07b5f0 msgr2=0x7fb24c107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 -- 172.21.15.33:0/2375866502 shutdown_connections 2024-08-28T19:43:01.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:01.458+0000 7fb25430f640 1 -- 172.21.15.33:0/2375866502 wait complete. 2024-08-28T19:43:01.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:01 smithi033 ceph-mon[18549]: pgmap v667: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 KiB/s wr, 10 op/s 2024-08-28T19:43:01.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:01 smithi059 ceph-mon[22052]: pgmap v667: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 KiB/s wr, 10 op/s 2024-08-28T19:43:01.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:01 smithi122 ceph-mon[22174]: pgmap v667: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 KiB/s wr, 10 op/s 2024-08-28T19:43:02.137 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:43:02.400 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:43:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:02 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:43:02.855 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.856 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:02 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:02.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.854+0000 7f8f0773d640 1 -- 172.21.15.33:0/3341895886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00102800 msgr2=0x7f8f00102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:02.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.854+0000 7f8f0773d640 1 --2- 172.21.15.33:0/3341895886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00102800 0x7f8f00102c10 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009900 tx=0x7f8efc02a410 comp rx=0 tx=0).stop 2024-08-28T19:43:02.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.854+0000 7f8f0773d640 1 -- 172.21.15.33:0/3341895886 shutdown_connections 2024-08-28T19:43:02.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.854+0000 7f8f0773d640 1 --2- 172.21.15.33:0/3341895886 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f00108a90 0x7f8f0010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.854+0000 7f8f0773d640 1 --2- 172.21.15.33:0/3341895886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f00108140 0x7f8f00108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.854+0000 7f8f0773d640 1 --2- 172.21.15.33:0/3341895886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00102800 0x7f8f00102c10 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.854+0000 7f8f0773d640 1 -- 172.21.15.33:0/3341895886 >> 172.21.15.33:0/3341895886 conn(0x7f8f000794d0 msgr2=0x7f8f000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.854+0000 7f8f0773d640 1 -- 172.21.15.33:0/3341895886 shutdown_connections 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.854+0000 7f8f0773d640 1 -- 172.21.15.33:0/3341895886 wait complete. 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f0773d640 1 Processor -- start 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f0773d640 1 -- start start 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f0773d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00102800 0x7f8f0010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f0773d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f00108140 0x7f8f00110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f0773d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f00108a90 0x7f8f001107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f0773d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8f00113820 con 0x7f8f00102800 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f0773d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001136a0 con 0x7f8f00108140 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f0773d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001139a0 con 0x7f8f00108a90 2024-08-28T19:43:02.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f054d9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00102800 0x7f8f0010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f054d9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00102800 0x7f8f0010fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36350/0 (socket says 172.21.15.33:36350) 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.855+0000 7f8f054d9640 1 -- 172.21.15.33:0/1236180131 learned_addr learned my addr 172.21.15.33:0/1236180131 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f05cda640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f00108a90 0x7f8f001107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f00108140 0x7f8f00110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f054d9640 1 -- 172.21.15.33:0/1236180131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f00108a90 msgr2=0x7f8f001107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f054d9640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f00108a90 0x7f8f001107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f054d9640 1 -- 172.21.15.33:0/1236180131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f00108140 msgr2=0x7f8f00110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f054d9640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f00108140 0x7f8f00110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f054d9640 1 -- 172.21.15.33:0/1236180131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f001a8470 con 0x7f8f00102800 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f00108140 0x7f8f00110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f054d9640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00102800 0x7f8f0010fd50 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f8efc005940 tx=0x7f8efc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8ef67fc640 1 -- 172.21.15.33:0/1236180131 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc03f030 con 0x7f8f00102800 2024-08-28T19:43:02.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8ef67fc640 1 -- 172.21.15.33:0/1236180131 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8efc0044c0 con 0x7f8f00102800 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8ef67fc640 1 -- 172.21.15.33:0/1236180131 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc035070 con 0x7f8f00102800 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f0773d640 1 -- 172.21.15.33:0/1236180131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f001a8700 con 0x7f8f00102800 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.856+0000 7f8f0773d640 1 -- 172.21.15.33:0/1236180131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f001a8be0 con 0x7f8f00102800 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.859+0000 7f8f0dcb2740 1 Processor -- start 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.859+0000 7f8f0dcb2740 1 -- start start 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.859+0000 7f8ef67fc640 1 -- 172.21.15.33:0/1236180131 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8efc042030 con 0x7f8f00102800 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.859+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 0x558977f24350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.859+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b561b0 0x558977f24890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.859+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b5e390 0x558977f24dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.859+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558977e9b680 con 0x558977b7f070 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558977e8ac10 con 0x558977b5e390 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558977e8ebc0 con 0x558977b561b0 2024-08-28T19:43:02.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f05cda640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 0x558977f24350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f05cda640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 0x558977f24350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36360/0 (socket says 172.21.15.33:36360) 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f05cda640 1 -- 172.21.15.33:0/3462340620 learned_addr learned my addr 172.21.15.33:0/3462340620 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f054d9640 1 --2- 172.21.15.33:0/3462340620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b561b0 0x558977f24890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/3462340620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b5e390 0x558977f24dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f05cda640 1 -- 172.21.15.33:0/3462340620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b561b0 msgr2=0x558977f24890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f05cda640 1 --2- 172.21.15.33:0/3462340620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b561b0 0x558977f24890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f05cda640 1 -- 172.21.15.33:0/3462340620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b5e390 msgr2=0x558977f24dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f05cda640 1 --2- 172.21.15.33:0/3462340620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b5e390 0x558977f24dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f05cda640 1 -- 172.21.15.33:0/3462340620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558977bea650 con 0x558977b7f070 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8f05cda640 1 --2- 172.21.15.33:0/3462340620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 0x558977f24350 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009fd0 tx=0x7f8ef80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780cbb29b7765b87 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8eeb7fe640 1 -- 172.21.15.33:0/3462340620 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8004d20 con 0x558977b7f070 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8ef67fc640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8eec0b4ca0 0x7f8eec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8eeb7fe640 1 -- 172.21.15.33:0/3462340620 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef8004050 con 0x558977b7f070 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.860+0000 7f8eeb7fe640 1 -- 172.21.15.33:0/3462340620 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8005280 con 0x558977b7f070 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.861+0000 7f8f054d9640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8eec0b4ca0 0x7f8eec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.861+0000 7f8ef67fc640 1 -- 172.21.15.33:0/1236180131 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f8efc105d30 con 0x7f8f00102800 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.861+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/3462340620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 msgr2=0x558977f24350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.861+0000 7f8f054d9640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8eec0b4ca0 0x7f8eec0b71b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8efc103190 tx=0x7f8efc109880 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.861+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/3462340620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 0x558977f24350 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009fd0 tx=0x7f8ef80118d0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.861+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/3462340620 shutdown_connections 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.861+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/3462340620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b5e390 0x558977f24dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.861+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/3462340620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b561b0 0x558977f24890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.861+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/3462340620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 0x558977f24350 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.861+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/3462340620 >> 172.21.15.33:0/3462340620 conn(0x558977b73460 msgr2=0x558977f22240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:02.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.862+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/3462340620 shutdown_connections 2024-08-28T19:43:02.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.862+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/3462340620 wait complete. 2024-08-28T19:43:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.862+0000 7f8f0dcb2740 1 -- start start 2024-08-28T19:43:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.862+0000 7f8f0dcb2740 1 Processor -- start 2024-08-28T19:43:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f2fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f30000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b7f070 0x558977f3be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558977ced700 con 0x558977b561b0 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558977e11750 con 0x558977b7f070 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558977f32b30 con 0x558977b5e390 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f0dcb2740 10 client.0 _ll_register_callbacks cb 0x558977e40e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f05cda640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f2fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f05cda640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f2fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36362/0 (socket says 172.21.15.33:36362) 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f05cda640 1 -- 172.21.15.33:0/1410439868 learned_addr learned my addr 172.21.15.33:0/1410439868 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f05cda640 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b7f070 0x558977f3be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f30000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f05cda640 1 -- 172.21.15.33:0/1410439868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 msgr2=0x558977f30000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:02.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f05cda640 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f30000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f05cda640 1 -- 172.21.15.33:0/1410439868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b7f070 msgr2=0x558977f3be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.863+0000 7f8f05cda640 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b7f070 0x558977f3be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8f05cda640 1 -- 172.21.15.33:0/1410439868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558977e4a900 con 0x558977b561b0 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f30000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8f05cda640 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f2fac0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005c10 tx=0x7f8ef8003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0e9f5e75c8d4eb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8ee8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1410439868 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef800f8f0 con 0x558977b561b0 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1410439868 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f8ef800fa90 con 0x558977b561b0 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1410439868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ef8004050 con 0x558977b561b0 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1410439868 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ef8036050 con 0x558977b561b0 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8f0dcb2740 10 client.18567 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1410439868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558977f3e900 con 0x558977b561b0 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.864+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1410439868 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef8004050 con 0x558977b561b0 2024-08-28T19:43:02.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.865+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1410439868 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8ef8025070 con 0x558977b561b0 2024-08-28T19:43:02.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.865+0000 7f8f0dcb2740 10 client.18567 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:02.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.865+0000 7f8f0dcb2740 10 client.18567 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:43:02.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.865+0000 7f8f0dcb2740 20 client.18567 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:02.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.865+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x558977b3d9f0 0x558977f41d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.865+0000 7f8f0dcb2740 4 client.18567 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:02.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.865+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1410439868 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558977e9d5d0 con 0x558977b3d9f0 2024-08-28T19:43:02.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.865+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x558977b3d9f0 0x558977f41d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.865+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x558977b3d9f0 0x558977f41d10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70385892c59e8ed9 server_cookie=d0ec2443bad46ccd in_seq=0 out_seq=0 2024-08-28T19:43:02.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.865+0000 7f8ee8ff9640 10 client.18567 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:43:02.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1410439868 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558977e9d5d0 con 0x558977b3d9f0 2024-08-28T19:43:02.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8ee8ff9640 10 client.18567 handle_command_reply: tid=0 2024-08-28T19:43:02.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8f0dcb2740 1 client.18567 shutdown 2024-08-28T19:43:02.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1410439868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 msgr2=0x558977f2fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:02.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f2fac0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005c10 tx=0x7f8ef8003f50 comp rx=0 tx=0).stop 2024-08-28T19:43:02.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1410439868 shutdown_connections 2024-08-28T19:43:02.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b7f070 0x558977f3be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f30000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x558977b3d9f0 0x558977f41d10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1410439868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f2fac0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1410439868 >> 172.21.15.33:0/1410439868 conn(0x558977b73460 msgr2=0x558977f27530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:02.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8ee8ff9640 0 client.18567 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:43:02.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.866+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1410439868 shutdown_connections 2024-08-28T19:43:02.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.867+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1410439868 wait complete. 2024-08-28T19:43:02.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.867+0000 7f8f0dcb2740 20 client.18567 trim_cache size 0 max 16384 2024-08-28T19:43:02.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f0dcb2740 1 Processor -- start 2024-08-28T19:43:02.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f0dcb2740 1 -- start start 2024-08-28T19:43:02.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f222b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f3bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b7f070 0x558977f27450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001b2dc0 con 0x558977b561b0 2024-08-28T19:43:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001b4900 con 0x558977b7f070 2024-08-28T19:43:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001b3490 con 0x558977b5e390 2024-08-28T19:43:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f05cda640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f222b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f05cda640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f222b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36372/0 (socket says 172.21.15.33:36372) 2024-08-28T19:43:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f05cda640 1 -- 172.21.15.33:0/683727927 learned_addr learned my addr 172.21.15.33:0/683727927 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.880+0000 7f8f05cda640 1 --2- 172.21.15.33:0/683727927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b7f070 0x558977f27450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.881+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/683727927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f3bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.881+0000 7f8f05cda640 1 -- 172.21.15.33:0/683727927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 msgr2=0x558977f3bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.881+0000 7f8f05cda640 1 --2- 172.21.15.33:0/683727927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f3bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.881+0000 7f8f05cda640 1 -- 172.21.15.33:0/683727927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b7f070 msgr2=0x558977f27450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.881+0000 7f8f05cda640 1 --2- 172.21.15.33:0/683727927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b7f070 0x558977f27450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.881+0000 7f8f05cda640 1 -- 172.21.15.33:0/683727927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558977f30d80 con 0x558977b561b0 2024-08-28T19:43:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.881+0000 7f8f05cda640 1 --2- 172.21.15.33:0/683727927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f222b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005d70 tx=0x7f8ef8004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5637fa679152b774 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.881+0000 7f8eeaffd640 1 -- 172.21.15.33:0/683727927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8043070 con 0x558977b561b0 2024-08-28T19:43:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.881+0000 7f8eeaffd640 1 -- 172.21.15.33:0/683727927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef802d070 con 0x558977b561b0 2024-08-28T19:43:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.881+0000 7f8eeaffd640 1 -- 172.21.15.33:0/683727927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef800f930 con 0x558977b561b0 2024-08-28T19:43:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/683727927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 msgr2=0x558977f222b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:02.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/683727927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f222b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8005d70 tx=0x7f8ef8004510 comp rx=0 tx=0).stop 2024-08-28T19:43:02.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/683727927 shutdown_connections 2024-08-28T19:43:02.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/683727927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b7f070 0x558977f27450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/683727927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f3bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/683727927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b561b0 0x558977f222b0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/683727927 >> 172.21.15.33:0/683727927 conn(0x558977b73460 msgr2=0x558977f21ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:02.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/683727927 shutdown_connections 2024-08-28T19:43:02.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/683727927 wait complete. 2024-08-28T19:43:02.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 -- start start 2024-08-28T19:43:02.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.882+0000 7f8f0dcb2740 1 Processor -- start 2024-08-28T19:43:02.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b561b0 0x558977f33de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f34320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f0dcb2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 0x558977f34860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001b4230 con 0x558977b7f070 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001b3b60 con 0x558977b561b0 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f0dcb2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8f001b0dc0 con 0x558977b5e390 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f0dcb2740 10 client.0 _ll_register_callbacks cb 0x7f8efc109750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f04cd8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f34320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f05cda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b561b0 0x558977f33de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f04cd8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f34320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:51832/0 (socket says 172.21.15.33:51832) 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f04cd8640 1 -- 172.21.15.33:0/1710579289 learned_addr learned my addr 172.21.15.33:0/1710579289 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f05cda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b561b0 0x558977f33de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:33054/0 (socket says 172.21.15.33:33054) 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f05cda640 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 0x558977f34860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f04cd8640 1 -- 172.21.15.33:0/1710579289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b561b0 msgr2=0x558977f33de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:02.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b561b0 0x558977f33de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f04cd8640 1 -- 172.21.15.33:0/1710579289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 msgr2=0x558977f34860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 0x558977f34860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f04cd8640 1 -- 172.21.15.33:0/1710579289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558977fab5c0 con 0x558977b5e390 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8f04cd8640 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f34320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x558977f422b0 tx=0x7f8ef00139e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed87d9992da1f702 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.883+0000 7f8ee8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1710579289 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0022040 con 0x558977b5e390 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1710579289 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f8ef00035f0 con 0x558977b5e390 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1710579289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ef802d070 con 0x558977b5e390 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1710579289 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8ef00037f0 con 0x558977b5e390 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8f0dcb2740 10 client.27490 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1710579289 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558977fac8a0 con 0x558977b5e390 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1710579289 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef802d070 con 0x558977b5e390 2024-08-28T19:43:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1710579289 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8ef0020a90 con 0x558977b5e390 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8f0dcb2740 10 client.27490 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8f0dcb2740 10 client.27490 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8f0dcb2740 20 client.27490 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x558977b12da0 0x558977faf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8f0dcb2740 4 client.27490 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.884+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1710579289 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558977e99070 con 0x558977b12da0 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f05cda640 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x558977b12da0 0x558977faf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8ee8ff9640 10 client.27490 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f05cda640 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x558977b12da0 0x558977faf0e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f555d26f5581b085 server_cookie=fe3bde5fa01d3eab in_seq=0 out_seq=0 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8ee8ff9640 1 -- 172.21.15.33:0/1710579289 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558977e99070 con 0x558977b12da0 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8ee8ff9640 10 client.27490 handle_command_reply: tid=0 2024-08-28T19:43:02.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 client.27490 shutdown 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1710579289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 msgr2=0x558977f34320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f34320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x558977f422b0 tx=0x7f8ef00139e0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1710579289 shutdown_connections 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x558977b12da0 0x558977faf0e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558977b7f070 0x558977f34860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558977b5e390 0x558977f34320 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8ee8ff9640 0 client.27490 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 --2- 172.21.15.33:0/1710579289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558977b561b0 0x558977f33de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1710579289 >> 172.21.15.33:0/1710579289 conn(0x558977b73460 msgr2=0x558977f30f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1710579289 shutdown_connections 2024-08-28T19:43:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.885+0000 7f8f0dcb2740 1 -- 172.21.15.33:0/1710579289 wait complete. 2024-08-28T19:43:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0dcb2740 20 client.27490 trim_cache size 0 max 16384 2024-08-28T19:43:02.894 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:43:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 -- 172.21.15.33:0/1236180131 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8eec0b4ca0 msgr2=0x7f8eec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8eec0b4ca0 0x7f8eec0b71b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8efc103190 tx=0x7f8efc109880 comp rx=0 tx=0).stop 2024-08-28T19:43:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 -- 172.21.15.33:0/1236180131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00102800 msgr2=0x7f8f0010fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00102800 0x7f8f0010fd50 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f8efc005940 tx=0x7f8efc0040c0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 -- 172.21.15.33:0/1236180131 shutdown_connections 2024-08-28T19:43:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8eec0b4ca0 0x7f8eec0b71b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f00108a90 0x7f8f001107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f00108140 0x7f8f00110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 --2- 172.21.15.33:0/1236180131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00102800 0x7f8f0010fd50 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:02.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 -- 172.21.15.33:0/1236180131 >> 172.21.15.33:0/1236180131 conn(0x7f8f000794d0 msgr2=0x7f8f00101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:02.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 -- 172.21.15.33:0/1236180131 shutdown_connections 2024-08-28T19:43:02.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:02.886+0000 7f8f0773d640 1 -- 172.21.15.33:0/1236180131 wait complete. 2024-08-28T19:43:03.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:43:03.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:03.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:03.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:03.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:03.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:03.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:02 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:03.626 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:43:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:03 smithi122 ceph-mon[22174]: pgmap v668: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.7 KiB/s wr, 9 op/s 2024-08-28T19:43:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:43:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:43:03.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:03 smithi033 ceph-mon[18549]: pgmap v668: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.7 KiB/s wr, 9 op/s 2024-08-28T19:43:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:43:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:43:03.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:03.883 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:04.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:03 smithi059 ceph-mon[22052]: pgmap v668: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.7 KiB/s wr, 9 op/s 2024-08-28T19:43:04.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:43:04.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:43:04.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:43:04.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.390+0000 7fee977ed640 1 -- 172.21.15.33:0/4009044684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90101fe0 msgr2=0x7fee901023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:04.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.390+0000 7fee977ed640 1 --2- 172.21.15.33:0/4009044684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90101fe0 0x7fee901023f0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009900 tx=0x7fee8c02a410 comp rx=0 tx=0).stop 2024-08-28T19:43:04.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.390+0000 7fee977ed640 1 -- 172.21.15.33:0/4009044684 shutdown_connections 2024-08-28T19:43:04.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.390+0000 7fee977ed640 1 --2- 172.21.15.33:0/4009044684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90108270 0x7fee9010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.390+0000 7fee977ed640 1 --2- 172.21.15.33:0/4009044684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee90107920 0x7fee90107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.390+0000 7fee977ed640 1 --2- 172.21.15.33:0/4009044684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90101fe0 0x7fee901023f0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.390+0000 7fee977ed640 1 -- 172.21.15.33:0/4009044684 >> 172.21.15.33:0/4009044684 conn(0x7fee90079d30 msgr2=0x7fee9007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.390+0000 7fee977ed640 1 -- 172.21.15.33:0/4009044684 shutdown_connections 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.390+0000 7fee977ed640 1 -- 172.21.15.33:0/4009044684 wait complete. 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee977ed640 1 Processor -- start 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee977ed640 1 -- start start 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee977ed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90101fe0 0x7fee9019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee977ed640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90107920 0x7fee9019b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee977ed640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee90108270 0x7fee9019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee977ed640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fee901127b0 con 0x7fee90107920 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee977ed640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fee90112630 con 0x7fee90101fe0 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee977ed640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fee90112930 con 0x7fee90108270 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee94d88640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90107920 0x7fee9019b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee94d88640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90107920 0x7fee9019b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36406/0 (socket says 172.21.15.33:36406) 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee94d88640 1 -- 172.21.15.33:0/3943739114 learned_addr learned my addr 172.21.15.33:0/3943739114 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee95589640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90101fe0 0x7fee9019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.391+0000 7fee95d8a640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee90108270 0x7fee9019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee94d88640 1 -- 172.21.15.33:0/3943739114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee90108270 msgr2=0x7fee9019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee94d88640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee90108270 0x7fee9019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee94d88640 1 -- 172.21.15.33:0/3943739114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90101fe0 msgr2=0x7fee9019b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee94d88640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90101fe0 0x7fee9019b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee94d88640 1 -- 172.21.15.33:0/3943739114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee901a6330 con 0x7fee90107920 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee95589640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90101fe0 0x7fee9019b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee94d88640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90107920 0x7fee9019b5e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fee8400d750 tx=0x7fee8400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee827fc640 1 -- 172.21.15.33:0/3943739114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84017070 con 0x7fee90107920 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee827fc640 1 -- 172.21.15.33:0/3943739114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee840054d0 con 0x7fee90107920 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee977ed640 1 -- 172.21.15.33:0/3943739114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee901a6620 con 0x7fee90107920 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee827fc640 1 -- 172.21.15.33:0/3943739114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84004c30 con 0x7fee90107920 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.392+0000 7fee977ed640 1 -- 172.21.15.33:0/3943739114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee901a6b60 con 0x7fee90107920 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee9dd62740 1 Processor -- start 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee9dd62740 1 -- start start 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee827fc640 1 -- 172.21.15.33:0/3943739114 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fee84004dd0 con 0x7fee90107920 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5215e070 0x559e52503310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e521351b0 0x559e52503850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5213d390 0x559e52503d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee9dd62740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559e5247a680 con 0x559e5215e070 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee9dd62740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559e52469c10 con 0x559e5213d390 2024-08-28T19:43:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee9dd62740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559e5246dbc0 con 0x559e521351b0 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee95d8a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5215e070 0x559e52503310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.395+0000 7fee95d8a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5215e070 0x559e52503310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36418/0 (socket says 172.21.15.33:36418) 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee95d8a640 1 -- 172.21.15.33:0/2421497402 learned_addr learned my addr 172.21.15.33:0/2421497402 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee94d88640 1 --2- 172.21.15.33:0/2421497402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5213d390 0x559e52503d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee95589640 1 --2- 172.21.15.33:0/2421497402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e521351b0 0x559e52503850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee95d8a640 1 -- 172.21.15.33:0/2421497402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e521351b0 msgr2=0x559e52503850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee95d8a640 1 --2- 172.21.15.33:0/2421497402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e521351b0 0x559e52503850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee95d8a640 1 -- 172.21.15.33:0/2421497402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5213d390 msgr2=0x559e52503d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee95d8a640 1 --2- 172.21.15.33:0/2421497402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5213d390 0x559e52503d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee95d8a640 1 -- 172.21.15.33:0/2421497402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e521c9650 con 0x559e5215e070 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee827fc640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fee7c0b4d50 0x7fee7c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee95d8a640 1 --2- 172.21.15.33:0/2421497402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5215e070 0x559e52503310 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fee88008dc0 tx=0x7fee8800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4c95385c81ccd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee95589640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fee7c0b4d50 0x7fee7c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee827fc640 1 -- 172.21.15.33:0/3943739114 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7fee840e5330 con 0x7fee90107920 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee7b7fe640 1 -- 172.21.15.33:0/2421497402 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88014070 con 0x559e5215e070 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee7b7fe640 1 -- 172.21.15.33:0/2421497402 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee88003b70 con 0x559e5215e070 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.396+0000 7fee7b7fe640 1 -- 172.21.15.33:0/2421497402 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88010700 con 0x559e5215e070 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.397+0000 7fee9dd62740 1 -- 172.21.15.33:0/2421497402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5215e070 msgr2=0x559e52503310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.397+0000 7fee9dd62740 1 --2- 172.21.15.33:0/2421497402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5215e070 0x559e52503310 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fee88008dc0 tx=0x7fee8800e720 comp rx=0 tx=0).stop 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.397+0000 7fee95589640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fee7c0b4d50 0x7fee7c0b7260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fee8c000c00 tx=0x7fee8c009640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.397+0000 7fee9dd62740 1 -- 172.21.15.33:0/2421497402 shutdown_connections 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.397+0000 7fee9dd62740 1 --2- 172.21.15.33:0/2421497402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5213d390 0x559e52503d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.397+0000 7fee9dd62740 1 --2- 172.21.15.33:0/2421497402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e521351b0 0x559e52503850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.397+0000 7fee9dd62740 1 --2- 172.21.15.33:0/2421497402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5215e070 0x559e52503310 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.397+0000 7fee9dd62740 1 -- 172.21.15.33:0/2421497402 >> 172.21.15.33:0/2421497402 conn(0x559e52152460 msgr2=0x559e52501200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.397+0000 7fee9dd62740 1 -- 172.21.15.33:0/2421497402 shutdown_connections 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.397+0000 7fee9dd62740 1 -- 172.21.15.33:0/2421497402 wait complete. 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.398+0000 7fee9dd62740 1 -- start start 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.398+0000 7fee9dd62740 1 Processor -- start 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.398+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e521351b0 0x559e5250eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.398+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5250eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.398+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5215e070 0x559e5251ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.398+0000 7fee9dd62740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559e522cc700 con 0x559e5213d390 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.398+0000 7fee9dd62740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559e523f0750 con 0x559e521351b0 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.398+0000 7fee9dd62740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559e52511af0 con 0x559e5215e070 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.398+0000 7fee9dd62740 10 client.0 _ll_register_callbacks cb 0x559e5241fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.398+0000 7fee94d88640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5250eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee94d88640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5250eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36428/0 (socket says 172.21.15.33:36428) 2024-08-28T19:43:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee94d88640 1 -- 172.21.15.33:0/212630875 learned_addr learned my addr 172.21.15.33:0/212630875 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee95589640 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e521351b0 0x559e5250eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee95d8a640 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5215e070 0x559e5251ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee94d88640 1 -- 172.21.15.33:0/212630875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5215e070 msgr2=0x559e5251ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee94d88640 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5215e070 0x559e5251ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee94d88640 1 -- 172.21.15.33:0/212630875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e521351b0 msgr2=0x559e5250eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee94d88640 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e521351b0 0x559e5250eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee94d88640 1 -- 172.21.15.33:0/212630875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e52429900 con 0x559e5213d390 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee95589640 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e521351b0 0x559e5250eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee95d8a640 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5215e070 0x559e5251ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee94d88640 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5250eff0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fee840e2740 tx=0x7fee840aafd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1079c86b94c34420 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee78ff9640 1 -- 172.21.15.33:0/212630875 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84020050 con 0x559e5213d390 2024-08-28T19:43:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee78ff9640 1 -- 172.21.15.33:0/212630875 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7fee840e5120 con 0x559e5213d390 2024-08-28T19:43:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee9dd62740 1 -- 172.21.15.33:0/212630875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee88003b70 con 0x559e5213d390 2024-08-28T19:43:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee78ff9640 1 -- 172.21.15.33:0/212630875 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee840ab190 con 0x559e5213d390 2024-08-28T19:43:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee9dd62740 10 client.18585 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.399+0000 7fee9dd62740 1 -- 172.21.15.33:0/212630875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559e5251d9a0 con 0x559e5213d390 2024-08-28T19:43:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee78ff9640 1 -- 172.21.15.33:0/212630875 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee88003b70 con 0x559e5213d390 2024-08-28T19:43:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee78ff9640 1 -- 172.21.15.33:0/212630875 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fee840a7910 con 0x559e5213d390 2024-08-28T19:43:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee9dd62740 10 client.18585 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee9dd62740 10 client.18585 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee9dd62740 20 client.18585 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee9dd62740 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559e5211c9f0 0x559e52520e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee9dd62740 4 client.18585 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee9dd62740 1 -- 172.21.15.33:0/212630875 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e5247c5d0 con 0x559e5211c9f0 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee95589640 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559e5211c9f0 0x559e52520e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee78ff9640 10 client.18585 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.400+0000 7fee95589640 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559e5211c9f0 0x559e52520e70 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9869914393dbefe4 server_cookie=4f7172a40476677e in_seq=0 out_seq=0 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee78ff9640 1 -- 172.21.15.33:0/212630875 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e5247c5d0 con 0x559e5211c9f0 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee78ff9640 10 client.18585 handle_command_reply: tid=0 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee9dd62740 1 client.18585 shutdown 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee9dd62740 1 -- 172.21.15.33:0/212630875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 msgr2=0x559e5250eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee9dd62740 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5250eff0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fee840e2740 tx=0x7fee840aafd0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee9dd62740 1 -- 172.21.15.33:0/212630875 shutdown_connections 2024-08-28T19:43:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee9dd62740 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559e5211c9f0 0x559e52520e70 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee9dd62740 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5215e070 0x559e5251ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee78ff9640 0 client.18585 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:43:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee9dd62740 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5250eff0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee9dd62740 1 --2- 172.21.15.33:0/212630875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e521351b0 0x559e5250eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.401+0000 7fee9dd62740 1 -- 172.21.15.33:0/212630875 >> 172.21.15.33:0/212630875 conn(0x559e52152460 msgr2=0x559e525064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.402+0000 7fee9dd62740 1 -- 172.21.15.33:0/212630875 shutdown_connections 2024-08-28T19:43:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.402+0000 7fee9dd62740 1 -- 172.21.15.33:0/212630875 wait complete. 2024-08-28T19:43:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.402+0000 7fee9dd62740 20 client.18585 trim_cache size 0 max 16384 2024-08-28T19:43:04.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.415+0000 7fee9dd62740 1 Processor -- start 2024-08-28T19:43:04.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.415+0000 7fee9dd62740 1 -- start start 2024-08-28T19:43:04.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.415+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e521351b0 0x559e52506b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.415+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5251ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.415+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 0x559e5251b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.415+0000 7fee9dd62740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fee901b0d20 con 0x559e5213d390 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.415+0000 7fee9dd62740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fee901b2860 con 0x559e5215e070 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee9dd62740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fee901b13f0 con 0x559e521351b0 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee94d88640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5251ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee94d88640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5251ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36432/0 (socket says 172.21.15.33:36432) 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee94d88640 1 -- 172.21.15.33:0/1124743665 learned_addr learned my addr 172.21.15.33:0/1124743665 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee95d8a640 1 --2- 172.21.15.33:0/1124743665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 0x559e5251b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee95589640 1 --2- 172.21.15.33:0/1124743665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e521351b0 0x559e52506b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee94d88640 1 -- 172.21.15.33:0/1124743665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e521351b0 msgr2=0x559e52506b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee94d88640 1 --2- 172.21.15.33:0/1124743665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e521351b0 0x559e52506b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee94d88640 1 -- 172.21.15.33:0/1124743665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 msgr2=0x559e5251b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee94d88640 1 --2- 172.21.15.33:0/1124743665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 0x559e5251b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee94d88640 1 -- 172.21.15.33:0/1124743665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e52507060 con 0x559e5213d390 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee95d8a640 1 --2- 172.21.15.33:0/1124743665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 0x559e5251b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee94d88640 1 --2- 172.21.15.33:0/1124743665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5251ace0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fee840ab610 tx=0x7fee840ab100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f4121565ce96fd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee7affd640 1 -- 172.21.15.33:0/1124743665 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84020070 con 0x559e5213d390 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee7affd640 1 -- 172.21.15.33:0/1124743665 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee840ab680 con 0x559e5213d390 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.416+0000 7fee7affd640 1 -- 172.21.15.33:0/1124743665 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee840b45e0 con 0x559e5213d390 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.417+0000 7fee9dd62740 1 -- 172.21.15.33:0/1124743665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 msgr2=0x559e5251ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.417+0000 7fee9dd62740 1 --2- 172.21.15.33:0/1124743665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5251ace0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fee840ab610 tx=0x7fee840ab100 comp rx=0 tx=0).stop 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.417+0000 7fee9dd62740 1 -- 172.21.15.33:0/1124743665 shutdown_connections 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.417+0000 7fee9dd62740 1 --2- 172.21.15.33:0/1124743665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 0x559e5251b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.417+0000 7fee9dd62740 1 --2- 172.21.15.33:0/1124743665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e5213d390 0x559e5251ace0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.417+0000 7fee9dd62740 1 --2- 172.21.15.33:0/1124743665 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e521351b0 0x559e52506b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.417+0000 7fee9dd62740 1 -- 172.21.15.33:0/1124743665 >> 172.21.15.33:0/1124743665 conn(0x559e52152460 msgr2=0x559e52506410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.417+0000 7fee9dd62740 1 -- 172.21.15.33:0/1124743665 shutdown_connections 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.417+0000 7fee9dd62740 1 -- 172.21.15.33:0/1124743665 wait complete. 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee9dd62740 1 -- start start 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee9dd62740 1 Processor -- start 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e521351b0 0x559e52513630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5213d390 0x559e52513c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee9dd62740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 0x559e52588a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee9dd62740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fee901b2190 con 0x559e521351b0 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee9dd62740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fee901b1ac0 con 0x559e5215e070 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee9dd62740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fee901aed20 con 0x559e5213d390 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee9dd62740 10 client.0 _ll_register_callbacks cb 0x7fee84009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee95589640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e521351b0 0x559e52513630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee95589640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e521351b0 0x559e52513630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36444/0 (socket says 172.21.15.33:36444) 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.418+0000 7fee95589640 1 -- 172.21.15.33:0/1815730891 learned_addr learned my addr 172.21.15.33:0/1815730891 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee95d8a640 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 0x559e52588a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee94d88640 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5213d390 0x559e52513c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee95589640 1 -- 172.21.15.33:0/1815730891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5213d390 msgr2=0x559e52513c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee95589640 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5213d390 0x559e52513c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee95589640 1 -- 172.21.15.33:0/1815730891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 msgr2=0x559e52588a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee95589640 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 0x559e52588a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee95589640 1 -- 172.21.15.33:0/1815730891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e52589090 con 0x559e521351b0 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee95d8a640 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 0x559e52588a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee95589640 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e521351b0 0x559e52513630 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fee8c031950 tx=0x7fee8c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453936b24988330e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:04.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee78ff9640 1 -- 172.21.15.33:0/1815730891 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c035050 con 0x559e521351b0 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee78ff9640 1 -- 172.21.15.33:0/1815730891 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7fee8c0043d0 con 0x559e521351b0 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee9dd62740 1 -- 172.21.15.33:0/1815730891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee840ab680 con 0x559e521351b0 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee78ff9640 1 -- 172.21.15.33:0/1815730891 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee8c005040 con 0x559e521351b0 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee9dd62740 10 client.18591 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee9dd62740 1 -- 172.21.15.33:0/1815730891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559e525903a0 con 0x559e521351b0 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.419+0000 7fee78ff9640 1 -- 172.21.15.33:0/1815730891 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee840ab680 con 0x559e521351b0 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.420+0000 7fee78ff9640 1 -- 172.21.15.33:0/1815730891 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fee8c0035f0 con 0x559e521351b0 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.420+0000 7fee9dd62740 10 client.18591 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.420+0000 7fee9dd62740 10 client.18591 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.420+0000 7fee9dd62740 20 client.18591 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.420+0000 7fee9dd62740 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559e520f1da0 0x559e52592ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.420+0000 7fee9dd62740 4 client.18591 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:43:04.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.420+0000 7fee9dd62740 1 -- 172.21.15.33:0/1815730891 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e52478070 con 0x559e520f1da0 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.420+0000 7fee94d88640 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559e520f1da0 0x559e52592ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.420+0000 7fee94d88640 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559e520f1da0 0x559e52592ae0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e8a76be4ecac35 server_cookie=e4aa0280186ff5b0 in_seq=0 out_seq=0 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.420+0000 7fee78ff9640 10 client.18591 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee78ff9640 1 -- 172.21.15.33:0/1815730891 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e52478070 con 0x559e520f1da0 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee78ff9640 10 client.18591 handle_command_reply: tid=0 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 client.18591 shutdown 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 -- 172.21.15.33:0/1815730891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e521351b0 msgr2=0x559e52513630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e521351b0 0x559e52513630 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fee8c031950 tx=0x7fee8c009260 comp rx=0 tx=0).stop 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 -- 172.21.15.33:0/1815730891 shutdown_connections 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559e520f1da0 0x559e52592ae0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e5215e070 0x559e52588a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559e5213d390 0x559e52513c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 --2- 172.21.15.33:0/1815730891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559e521351b0 0x559e52513630 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 -- 172.21.15.33:0/1815730891 >> 172.21.15.33:0/1815730891 conn(0x559e52152460 msgr2=0x559e5250cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:04.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee78ff9640 0 client.18591 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:43:04.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 -- 172.21.15.33:0/1815730891 shutdown_connections 2024-08-28T19:43:04.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 1 -- 172.21.15.33:0/1815730891 wait complete. 2024-08-28T19:43:04.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.421+0000 7fee9dd62740 20 client.18591 trim_cache size 0 max 16384 2024-08-28T19:43:04.429 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:43:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 -- 172.21.15.33:0/3943739114 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fee7c0b4d50 msgr2=0x7fee7c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fee7c0b4d50 0x7fee7c0b7260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fee8c000c00 tx=0x7fee8c009640 comp rx=0 tx=0).stop 2024-08-28T19:43:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 -- 172.21.15.33:0/3943739114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90107920 msgr2=0x7fee9019b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90107920 0x7fee9019b5e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fee8400d750 tx=0x7fee8400dc10 comp rx=0 tx=0).stop 2024-08-28T19:43:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 -- 172.21.15.33:0/3943739114 shutdown_connections 2024-08-28T19:43:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fee7c0b4d50 0x7fee7c0b7260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fee90108270 0x7fee9019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90107920 0x7fee9019b5e0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 --2- 172.21.15.33:0/3943739114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90101fe0 0x7fee9019b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:04.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 -- 172.21.15.33:0/3943739114 >> 172.21.15.33:0/3943739114 conn(0x7fee90079d30 msgr2=0x7fee901059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 -- 172.21.15.33:0/3943739114 shutdown_connections 2024-08-28T19:43:04.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:04.422+0000 7fee977ed640 1 -- 172.21.15.33:0/3943739114 wait complete. 2024-08-28T19:43:05.145 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:43:05.404 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:05.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:05 smithi122 ceph-mon[22174]: pgmap v669: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-08-28T19:43:05.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:05 smithi033 ceph-mon[18549]: pgmap v669: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-08-28T19:43:05.835 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:05 smithi059 ceph-mon[22052]: pgmap v669: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-08-28T19:43:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 -- 172.21.15.33:0/2920680335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9878109240 msgr2=0x7f9878109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 --2- 172.21.15.33:0/2920680335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9878109240 0x7f9878109650 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f986c009900 tx=0x7f986c02a3f0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 -- 172.21.15.33:0/2920680335 shutdown_connections 2024-08-28T19:43:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 --2- 172.21.15.33:0/2920680335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9878109b90 0x7f98781103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 --2- 172.21.15.33:0/2920680335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9878109240 0x7f9878109650 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 --2- 172.21.15.33:0/2920680335 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9878103900 0x7f9878103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 -- 172.21.15.33:0/2920680335 >> 172.21.15.33:0/2920680335 conn(0x7f987807b5f0 msgr2=0x7f987807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 -- 172.21.15.33:0/2920680335 shutdown_connections 2024-08-28T19:43:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 -- 172.21.15.33:0/2920680335 wait complete. 2024-08-28T19:43:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 Processor -- start 2024-08-28T19:43:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.916+0000 7f987ef79640 1 -- start start 2024-08-28T19:43:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f987ef79640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9878103900 0x7f987819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f987ef79640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9878109240 0x7f987819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f987ef79640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9878109b90 0x7f987819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f987ef79640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9878113850 con 0x7f9878109240 2024-08-28T19:43:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f987ef79640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f98781136d0 con 0x7f9878109b90 2024-08-28T19:43:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f987ef79640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98781139d0 con 0x7f9878103900 2024-08-28T19:43:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f9877fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9878109240 0x7f987819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f9877fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9878109240 0x7f987819a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36470/0 (socket says 172.21.15.33:36470) 2024-08-28T19:43:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f9877fff640 1 -- 172.21.15.33:0/4247503773 learned_addr learned my addr 172.21.15.33:0/4247503773 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f987cd15640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9878103900 0x7f987819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f987d516640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9878109b90 0x7f987819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f9877fff640 1 -- 172.21.15.33:0/4247503773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9878103900 msgr2=0x7f987819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f9877fff640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9878103900 0x7f987819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f9877fff640 1 -- 172.21.15.33:0/4247503773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9878109b90 msgr2=0x7f987819f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f9877fff640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9878109b90 0x7f987819f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f9877fff640 1 -- 172.21.15.33:0/4247503773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98781a0050 con 0x7f9878109240 2024-08-28T19:43:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f9877fff640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9878109240 0x7f987819a740 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f986c02a910 tx=0x7f986c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.917+0000 7f9875ffb640 1 -- 172.21.15.33:0/4247503773 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c03f030 con 0x7f9878109240 2024-08-28T19:43:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.918+0000 7f9875ffb640 1 -- 172.21.15.33:0/4247503773 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f986c003aa0 con 0x7f9878109240 2024-08-28T19:43:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.918+0000 7f987ef79640 1 -- 172.21.15.33:0/4247503773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98781a02e0 con 0x7f9878109240 2024-08-28T19:43:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.918+0000 7f9875ffb640 1 -- 172.21.15.33:0/4247503773 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c035070 con 0x7f9878109240 2024-08-28T19:43:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.918+0000 7f987ef79640 1 -- 172.21.15.33:0/4247503773 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98781a07c0 con 0x7f9878109240 2024-08-28T19:43:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.920+0000 7f9875ffb640 1 -- 172.21.15.33:0/4247503773 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f986c042030 con 0x7f9878109240 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.920+0000 7f98854ee740 1 Processor -- start 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.920+0000 7f98854ee740 1 -- start start 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f98854ee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b6a7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f98854ee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f98854ee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6a81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f98854ee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b69b61a680 con 0x55b69b2d51b0 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f98854ee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b69b609c10 con 0x55b69b2dd390 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f98854ee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b69b60dbc0 con 0x55b69b2fe070 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987cd15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987cd15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6a7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36480/0 (socket says 172.21.15.33:36480) 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987cd15640 1 -- 172.21.15.33:0/271056806 learned_addr learned my addr 172.21.15.33:0/271056806 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:05.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f9877fff640 1 --2- 172.21.15.33:0/271056806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6a81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987d516640 1 --2- 172.21.15.33:0/271056806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b6a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f9875ffb640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98600b4cd0 0x7f98600b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987cd15640 1 -- 172.21.15.33:0/271056806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 msgr2=0x55b69b6a7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987cd15640 1 --2- 172.21.15.33:0/271056806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b6a7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987cd15640 1 -- 172.21.15.33:0/271056806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 msgr2=0x55b69b6a81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987cd15640 1 --2- 172.21.15.33:0/271056806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6a81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987cd15640 1 -- 172.21.15.33:0/271056806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69b369650 con 0x55b69b2d51b0 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987d516640 1 --2- 172.21.15.33:0/271056806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b6a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987d516640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98600b4cd0 0x7f98600b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f9875ffb640 1 -- 172.21.15.33:0/4247503773 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f986c1060b0 con 0x7f9878109240 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.921+0000 7f987cd15640 1 --2- 172.21.15.33:0/271056806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6a7c60 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f986800ad00 tx=0x7f986800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811c6a48dc9c226f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.922+0000 7f985effd640 1 -- 172.21.15.33:0/271056806 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986801d070 con 0x55b69b2d51b0 2024-08-28T19:43:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.922+0000 7f985effd640 1 -- 172.21.15.33:0/271056806 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9868018af0 con 0x55b69b2d51b0 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.922+0000 7f985effd640 1 -- 172.21.15.33:0/271056806 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868010b30 con 0x55b69b2d51b0 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 -- 172.21.15.33:0/271056806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 msgr2=0x55b69b6a7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 --2- 172.21.15.33:0/271056806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6a7c60 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f986800ad00 tx=0x7f986800f790 comp rx=0 tx=0).stop 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f987d516640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98600b4cd0 0x7f98600b71e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9870007f10 tx=0x7f9870004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 -- 172.21.15.33:0/271056806 shutdown_connections 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 --2- 172.21.15.33:0/271056806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6a81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 --2- 172.21.15.33:0/271056806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6a7c60 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 --2- 172.21.15.33:0/271056806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b6a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 -- 172.21.15.33:0/271056806 >> 172.21.15.33:0/271056806 conn(0x55b69b2f2460 msgr2=0x55b69b6a5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 -- 172.21.15.33:0/271056806 shutdown_connections 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 -- 172.21.15.33:0/271056806 wait complete. 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 -- start start 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.923+0000 7f98854ee740 1 Processor -- start 2024-08-28T19:43:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f98854ee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f98854ee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2dd390 0x55b69b6b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f98854ee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2fe070 0x55b69b6bf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f98854ee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b69b46c700 con 0x55b69b2d51b0 2024-08-28T19:43:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f98854ee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b69b590750 con 0x55b69b2fe070 2024-08-28T19:43:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f98854ee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b69b6b5f00 con 0x55b69b2dd390 2024-08-28T19:43:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f98854ee740 10 client.0 _ll_register_callbacks cb 0x55b69b5bfe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987cd15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987cd15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36488/0 (socket says 172.21.15.33:36488) 2024-08-28T19:43:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987cd15640 1 -- 172.21.15.33:0/3692761285 learned_addr learned my addr 172.21.15.33:0/3692761285 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:05.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f9877fff640 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2dd390 0x55b69b6b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987d516640 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2fe070 0x55b69b6bf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987cd15640 1 -- 172.21.15.33:0/3692761285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2dd390 msgr2=0x55b69b6b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987cd15640 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2dd390 0x55b69b6b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987cd15640 1 -- 172.21.15.33:0/3692761285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2fe070 msgr2=0x55b69b6bf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987cd15640 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2fe070 0x55b69b6bf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987cd15640 1 -- 172.21.15.33:0/3692761285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69b5c9900 con 0x55b69b2d51b0 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987d516640 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2fe070 0x55b69b6bf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f987cd15640 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6b2f50 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f9868010730 tx=0x7f98680186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac4e49c3de9fe1a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f9857fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.924+0000 7f9857fff640 1 -- 172.21.15.33:0/3692761285 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986801d040 con 0x55b69b2d51b0 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f9857fff640 1 -- 172.21.15.33:0/3692761285 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f9868010870 con 0x55b69b2d51b0 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f98854ee740 1 -- 172.21.15.33:0/3692761285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9868018af0 con 0x55b69b2d51b0 2024-08-28T19:43:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f9857fff640 1 -- 172.21.15.33:0/3692761285 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9868031050 con 0x55b69b2d51b0 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f98854ee740 10 client.18603 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f98854ee740 1 -- 172.21.15.33:0/3692761285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b69b6c1d60 con 0x55b69b2d51b0 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f9857fff640 1 -- 172.21.15.33:0/3692761285 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9868018af0 con 0x55b69b2d51b0 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f9857fff640 1 -- 172.21.15.33:0/3692761285 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9868020030 con 0x55b69b2d51b0 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f98854ee740 10 client.18603 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f98854ee740 10 client.18603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f98854ee740 20 client.18603 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f98854ee740 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b69b2bc9f0 0x55b69b6c5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f98854ee740 4 client.18603 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f98854ee740 1 -- 172.21.15.33:0/3692761285 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b69b61c5d0 con 0x55b69b2bc9f0 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.925+0000 7f9877fff640 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b69b2bc9f0 0x55b69b6c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.926+0000 7f9877fff640 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b69b2bc9f0 0x55b69b6c5170 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=280894e3f6ac6245 server_cookie=fbba27dc0638edf0 in_seq=0 out_seq=0 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.926+0000 7f9857fff640 10 client.18603 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f9857fff640 1 -- 172.21.15.33:0/3692761285 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b69b61c5d0 con 0x55b69b2bc9f0 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f9857fff640 10 client.18603 handle_command_reply: tid=0 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 client.18603 shutdown 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 -- 172.21.15.33:0/3692761285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 msgr2=0x55b69b6b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6b2f50 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f9868010730 tx=0x7f98680186f0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 -- 172.21.15.33:0/3692761285 shutdown_connections 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2fe070 0x55b69b6bf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2dd390 0x55b69b6b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b69b2bc9f0 0x55b69b6c5170 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 --2- 172.21.15.33:0/3692761285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6b2f50 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f9857fff640 0 client.18603 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 -- 172.21.15.33:0/3692761285 >> 172.21.15.33:0/3692761285 conn(0x55b69b2f2460 msgr2=0x55b69b6aa8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 -- 172.21.15.33:0/3692761285 shutdown_connections 2024-08-28T19:43:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 1 -- 172.21.15.33:0/3692761285 wait complete. 2024-08-28T19:43:05.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.927+0000 7f98854ee740 20 client.18603 trim_cache size 0 max 16384 2024-08-28T19:43:05.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f98854ee740 1 Processor -- start 2024-08-28T19:43:05.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f98854ee740 1 -- start start 2024-08-28T19:43:05.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f98854ee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f98854ee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6bf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f98854ee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b6a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f98854ee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f98781ae920 con 0x55b69b2d51b0 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f98854ee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f98781b0460 con 0x55b69b2dd390 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f98854ee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98781aeff0 con 0x55b69b2fe070 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f987cd15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f987cd15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36498/0 (socket says 172.21.15.33:36498) 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f987cd15640 1 -- 172.21.15.33:0/1079521622 learned_addr learned my addr 172.21.15.33:0/1079521622 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f987d516640 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b6a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f9877fff640 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f987cd15640 1 -- 172.21.15.33:0/1079521622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 msgr2=0x55b69b6a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f987cd15640 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b6a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f987cd15640 1 -- 172.21.15.33:0/1079521622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 msgr2=0x55b69b6bf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f987cd15640 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6bf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f987cd15640 1 -- 172.21.15.33:0/1079521622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69b6b3ff0 con 0x55b69b2d51b0 2024-08-28T19:43:05.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f987d516640 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b6a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.941+0000 7f9877fff640 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6bf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.942+0000 7f987cd15640 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6aaf30 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f986800a5c0 tx=0x7f9868005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df391266baed7c3c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.942+0000 7f985e7fc640 1 -- 172.21.15.33:0/1079521622 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986801d040 con 0x55b69b2d51b0 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.942+0000 7f985e7fc640 1 -- 172.21.15.33:0/1079521622 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9868028070 con 0x55b69b2d51b0 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.942+0000 7f985e7fc640 1 -- 172.21.15.33:0/1079521622 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868018760 con 0x55b69b2d51b0 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 -- 172.21.15.33:0/1079521622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 msgr2=0x55b69b6aaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6aaf30 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f986800a5c0 tx=0x7f9868005870 comp rx=0 tx=0).stop 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 -- 172.21.15.33:0/1079521622 shutdown_connections 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b6a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6bf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 --2- 172.21.15.33:0/1079521622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6aaf30 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 -- 172.21.15.33:0/1079521622 >> 172.21.15.33:0/1079521622 conn(0x55b69b2f2460 msgr2=0x55b69b6aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 -- 172.21.15.33:0/1079521622 shutdown_connections 2024-08-28T19:43:05.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 -- 172.21.15.33:0/1079521622 wait complete. 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 -- start start 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.943+0000 7f98854ee740 1 Processor -- start 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f98854ee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6c6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f98854ee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6c6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f98854ee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b72e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f98854ee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f98781afd90 con 0x55b69b2d51b0 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f98854ee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f98781af6c0 con 0x55b69b2dd390 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f98854ee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f98781ac920 con 0x55b69b2fe070 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f98854ee740 10 client.0 _ll_register_callbacks cb 0x7f986801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f987cd15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f987cd15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6c6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36504/0 (socket says 172.21.15.33:36504) 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f987cd15640 1 -- 172.21.15.33:0/4148473264 learned_addr learned my addr 172.21.15.33:0/4148473264 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:05.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f9877fff640 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f987d516640 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b72e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f987cd15640 1 -- 172.21.15.33:0/4148473264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 msgr2=0x55b69b72e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f987cd15640 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b72e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f987cd15640 1 -- 172.21.15.33:0/4148473264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 msgr2=0x55b69b6c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f987cd15640 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.944+0000 7f987cd15640 1 -- 172.21.15.33:0/4148473264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69b6c7160 con 0x55b69b2d51b0 2024-08-28T19:43:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f987cd15640 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6c6410 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f986800a830 tx=0x7f986800fe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daecc9ba73c7033 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f9857fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f9857fff640 1 -- 172.21.15.33:0/4148473264 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986801d040 con 0x55b69b2d51b0 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f9857fff640 1 -- 172.21.15.33:0/4148473264 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f9868010930 con 0x55b69b2d51b0 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f98854ee740 1 -- 172.21.15.33:0/4148473264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9868028070 con 0x55b69b2d51b0 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f9857fff640 1 -- 172.21.15.33:0/4148473264 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9868045050 con 0x55b69b2d51b0 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f98854ee740 10 client.18609 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f98854ee740 1 -- 172.21.15.33:0/4148473264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b69b72fd60 con 0x55b69b2d51b0 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f9857fff640 1 -- 172.21.15.33:0/4148473264 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9868028070 con 0x55b69b2d51b0 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f9857fff640 1 -- 172.21.15.33:0/4148473264 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9868020040 con 0x55b69b2d51b0 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f98854ee740 10 client.18609 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f98854ee740 10 client.18609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f98854ee740 20 client.18609 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:05.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f98854ee740 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b69b291da0 0x55b69b7323c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f98854ee740 4 client.18609 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.945+0000 7f98854ee740 1 -- 172.21.15.33:0/4148473264 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b69b618070 con 0x55b69b291da0 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.946+0000 7f9877fff640 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b69b291da0 0x55b69b7323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.946+0000 7f9877fff640 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b69b291da0 0x55b69b7323c0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7a15a4905da2d3d server_cookie=35509e59aa564c5b in_seq=0 out_seq=0 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.946+0000 7f9857fff640 10 client.18609 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.946+0000 7f9857fff640 1 -- 172.21.15.33:0/4148473264 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b69b618070 con 0x55b69b291da0 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.946+0000 7f9857fff640 10 client.18609 handle_command_reply: tid=0 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.946+0000 7f98854ee740 1 client.18609 shutdown 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 1 -- 172.21.15.33:0/4148473264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 msgr2=0x55b69b6c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6c6410 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f986800a830 tx=0x7f986800fe30 comp rx=0 tx=0).stop 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 1 -- 172.21.15.33:0/4148473264 shutdown_connections 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b69b2fe070 0x55b69b72e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b69b2dd390 0x55b69b6c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55b69b291da0 0x55b69b7323c0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 1 --2- 172.21.15.33:0/4148473264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b69b2d51b0 0x55b69b6c6410 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f9857fff640 0 client.18609 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:05.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 1 -- 172.21.15.33:0/4148473264 >> 172.21.15.33:0/4148473264 conn(0x55b69b2f2460 msgr2=0x55b69b6a55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:05.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 1 -- 172.21.15.33:0/4148473264 shutdown_connections 2024-08-28T19:43:05.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 1 -- 172.21.15.33:0/4148473264 wait complete. 2024-08-28T19:43:05.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f98854ee740 20 client.18609 trim_cache size 0 max 16384 2024-08-28T19:43:05.956 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:43:05.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f987ef79640 1 -- 172.21.15.33:0/4247503773 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98600b4cd0 msgr2=0x7f98600b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:05.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f987ef79640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98600b4cd0 0x7f98600b71e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9870007f10 tx=0x7f9870004a40 comp rx=0 tx=0).stop 2024-08-28T19:43:05.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f987ef79640 1 -- 172.21.15.33:0/4247503773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9878109240 msgr2=0x7f987819a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:05.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.947+0000 7f987ef79640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9878109240 0x7f987819a740 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f986c02a910 tx=0x7f986c004270 comp rx=0 tx=0).stop 2024-08-28T19:43:05.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.948+0000 7f987ef79640 1 -- 172.21.15.33:0/4247503773 shutdown_connections 2024-08-28T19:43:05.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.948+0000 7f987ef79640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9878109b90 0x7f987819f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.948+0000 7f987ef79640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9878109240 0x7f987819a740 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.948+0000 7f987ef79640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f98600b4cd0 0x7f98600b71e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.948+0000 7f987ef79640 1 --2- 172.21.15.33:0/4247503773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9878103900 0x7f987819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:05.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.948+0000 7f987ef79640 1 -- 172.21.15.33:0/4247503773 >> 172.21.15.33:0/4247503773 conn(0x7f987807b5f0 msgr2=0x7f9878105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:05.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.948+0000 7f987ef79640 1 -- 172.21.15.33:0/4247503773 shutdown_connections 2024-08-28T19:43:05.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:05.948+0000 7f987ef79640 1 -- 172.21.15.33:0/4247503773 wait complete. 2024-08-28T19:43:07.710 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:43:07.710 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:43:07.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:07 smithi033 ceph-mon[18549]: pgmap v670: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-08-28T19:43:07.976 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:08.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:07 smithi059 ceph-mon[22052]: pgmap v670: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-08-28T19:43:08.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:07 smithi122 ceph-mon[22174]: pgmap v670: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 47 KiB/s wr, 26 op/s 2024-08-28T19:43:08.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 -- 172.21.15.33:0/3819532198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09c0105120 msgr2=0x7f09c010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:08.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 --2- 172.21.15.33:0/3819532198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09c0105120 0x7f09c010d670 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009900 tx=0x7f09b402a410 comp rx=0 tx=0).stop 2024-08-28T19:43:08.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 -- 172.21.15.33:0/3819532198 shutdown_connections 2024-08-28T19:43:08.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 --2- 172.21.15.33:0/3819532198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09c010dc30 0x7f09c0110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 --2- 172.21.15.33:0/3819532198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09c0105120 0x7f09c010d670 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 --2- 172.21.15.33:0/3819532198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c01047d0 0x7f09c0104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 -- 172.21.15.33:0/3819532198 >> 172.21.15.33:0/3819532198 conn(0x7f09c0079510 msgr2=0x7f09c0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 -- 172.21.15.33:0/3819532198 shutdown_connections 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 -- 172.21.15.33:0/3819532198 wait complete. 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 Processor -- start 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.577+0000 7f09c655d640 1 -- start start 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c655d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c01047d0 0x7f09c019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c655d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09c0105120 0x7f09c019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c655d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09c010dc30 0x7f09c019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c655d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f09c0113890 con 0x7f09c010dc30 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c655d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09c0113710 con 0x7f09c0105120 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c655d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f09c0113a10 con 0x7f09c01047d0 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c4afa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09c010dc30 0x7f09c019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c4afa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09c010dc30 0x7f09c019fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58812/0 (socket says 172.21.15.33:58812) 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c4afa640 1 -- 172.21.15.33:0/1749890357 learned_addr learned my addr 172.21.15.33:0/1749890357 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09c0105120 0x7f09c019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09bffff640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c01047d0 0x7f09c019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c4afa640 1 -- 172.21.15.33:0/1749890357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c01047d0 msgr2=0x7f09c019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c4afa640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c01047d0 0x7f09c019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c4afa640 1 -- 172.21.15.33:0/1749890357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09c0105120 msgr2=0x7f09c019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c4afa640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09c0105120 0x7f09c019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09c4afa640 1 -- 172.21.15.33:0/1749890357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c01a01f0 con 0x7f09c010dc30 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.578+0000 7f09bffff640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c01047d0 0x7f09c019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.579+0000 7f09c4afa640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09c010dc30 0x7f09c019fac0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f09b800eaa0 tx=0x7f09b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.579+0000 7f09bd7fa640 1 -- 172.21.15.33:0/1749890357 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b800cdb0 con 0x7f09c010dc30 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.579+0000 7f09c655d640 1 -- 172.21.15.33:0/1749890357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c01a04e0 con 0x7f09c010dc30 2024-08-28T19:43:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.579+0000 7f09bd7fa640 1 -- 172.21.15.33:0/1749890357 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09b8005020 con 0x7f09c010dc30 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.579+0000 7f09bd7fa640 1 -- 172.21.15.33:0/1749890357 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b80116d0 con 0x7f09c010dc30 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.579+0000 7f09c655d640 1 -- 172.21.15.33:0/1749890357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c01a6c40 con 0x7f09c010dc30 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.581+0000 7f09ccad2740 1 Processor -- start 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.581+0000 7f09bd7fa640 1 -- 172.21.15.33:0/1749890357 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f09b80051d0 con 0x7f09c010dc30 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09ccad2740 1 -- start start 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf62780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb93490 0x557fedf62cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb9b670 0x557fedf63200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09ccad2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557feded85f0 con 0x557fedb9b670 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09ccad2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557fedec7b80 con 0x557fedbbc350 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09ccad2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557fedecbb30 con 0x557fedb93490 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb9b670 0x557fedf63200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb9b670 0x557fedf63200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58820/0 (socket says 172.21.15.33:58820) 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09bf7fe640 1 -- 172.21.15.33:0/2430887385 learned_addr learned my addr 172.21.15.33:0/2430887385 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09bffff640 1 --2- 172.21.15.33:0/2430887385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb93490 0x557fedf62cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/2430887385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf62780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.582+0000 7f09bd7fa640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09a80b4ca0 0x7f09a80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.583+0000 7f09bffff640 1 -- 172.21.15.33:0/2430887385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 msgr2=0x557fedf62780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.583+0000 7f09bffff640 1 --2- 172.21.15.33:0/2430887385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf62780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.583+0000 7f09bffff640 1 -- 172.21.15.33:0/2430887385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb9b670 msgr2=0x557fedf63200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.583+0000 7f09bffff640 1 --2- 172.21.15.33:0/2430887385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb9b670 0x557fedf63200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.583+0000 7f09bffff640 1 -- 172.21.15.33:0/2430887385 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fedc27930 con 0x557fedb93490 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.583+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/2430887385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf62780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.583+0000 7f09c4afa640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09a80b4ca0 0x7f09a80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.583+0000 7f09bd7fa640 1 -- 172.21.15.33:0/1749890357 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f09b80e5ae0 con 0x7f09c010dc30 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.584+0000 7f09bffff640 1 --2- 172.21.15.33:0/2430887385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb93490 0x557fedf62cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009b90 tx=0x7f09b000e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aee722c1d59c12ad server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.584+0000 7f09c4afa640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09a80b4ca0 0x7f09a80b71b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f09b80abb30 tx=0x7f09b800cf50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.584+0000 7f09a67fc640 1 -- 172.21.15.33:0/2430887385 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0016070 con 0x557fedb93490 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.584+0000 7f09a67fc640 1 -- 172.21.15.33:0/2430887385 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09b00054d0 con 0x557fedb93490 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.584+0000 7f09a67fc640 1 -- 172.21.15.33:0/2430887385 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0011470 con 0x557fedb93490 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.585+0000 7f09ccad2740 1 -- 172.21.15.33:0/2430887385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb93490 msgr2=0x557fedf62cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.585+0000 7f09ccad2740 1 --2- 172.21.15.33:0/2430887385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb93490 0x557fedf62cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009b90 tx=0x7f09b000e6c0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.585+0000 7f09ccad2740 1 -- 172.21.15.33:0/2430887385 shutdown_connections 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.585+0000 7f09ccad2740 1 --2- 172.21.15.33:0/2430887385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb9b670 0x557fedf63200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.585+0000 7f09ccad2740 1 --2- 172.21.15.33:0/2430887385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb93490 0x557fedf62cc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.585+0000 7f09ccad2740 1 --2- 172.21.15.33:0/2430887385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf62780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.585+0000 7f09ccad2740 1 -- 172.21.15.33:0/2430887385 >> 172.21.15.33:0/2430887385 conn(0x557fedbb0740 msgr2=0x557fedf60670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.585+0000 7f09ccad2740 1 -- 172.21.15.33:0/2430887385 shutdown_connections 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.585+0000 7f09ccad2740 1 -- 172.21.15.33:0/2430887385 wait complete. 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.585+0000 7f09ccad2740 1 -- start start 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09ccad2740 1 Processor -- start 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf6ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf6e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf7a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09ccad2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557fedd2a890 con 0x557fedb93490 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09ccad2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557fede4e790 con 0x557fedbbc350 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09ccad2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557fedf70f60 con 0x557fedb9b670 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09ccad2740 10 client.0 _ll_register_callbacks cb 0x557fedbd3ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:08.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf6ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf6ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58836/0 (socket says 172.21.15.33:58836) 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09bf7fe640 1 -- 172.21.15.33:0/395764649 learned_addr learned my addr 172.21.15.33:0/395764649 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09bffff640 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf6e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.586+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf7a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f09bffff640 1 -- 172.21.15.33:0/395764649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 msgr2=0x557fedf7a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f09bffff640 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf7a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f09bffff640 1 -- 172.21.15.33:0/395764649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 msgr2=0x557fedf6ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f09bffff640 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf6ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f09bffff640 1 -- 172.21.15.33:0/395764649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fede85f30 con 0x557fedb9b670 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf6ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:43:08.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f09bffff640 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf6e410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f09b0004b40 tx=0x7f09b00048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d71fb40d6850618e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f099f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f099f7fe640 1 -- 172.21.15.33:0/395764649 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0028060 con 0x557fedb9b670 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f099f7fe640 1 -- 172.21.15.33:0/395764649 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f09b0004eb0 con 0x557fedb9b670 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f09ccad2740 1 -- 172.21.15.33:0/395764649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09b00054d0 con 0x557fedb9b670 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f099f7fe640 1 -- 172.21.15.33:0/395764649 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f09b0016040 con 0x557fedb9b670 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f09ccad2740 10 client.27526 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.587+0000 7f09ccad2740 1 -- 172.21.15.33:0/395764649 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557fedf7cd40 con 0x557fedb9b670 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f099f7fe640 1 -- 172.21.15.33:0/395764649 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09b00054d0 con 0x557fedb9b670 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f099f7fe640 1 -- 172.21.15.33:0/395764649 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f09b000f040 con 0x557fedb9b670 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f09ccad2740 10 client.27526 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f09ccad2740 10 client.27526 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:08.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f09ccad2740 20 client.27526 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f09ccad2740 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557fedb7acd0 0x557fedf801b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f09ccad2740 4 client.27526 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f09ccad2740 1 -- 172.21.15.33:0/395764649 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fededa540 con 0x557fedb7acd0 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557fedb7acd0 0x557fedf801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f099f7fe640 10 client.27526 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.588+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557fedb7acd0 0x557fedf801b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93f04255b5679227 server_cookie=26b580ba9157506a in_seq=0 out_seq=0 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f099f7fe640 1 -- 172.21.15.33:0/395764649 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fededa540 con 0x557fedb7acd0 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f099f7fe640 10 client.27526 handle_command_reply: tid=0 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f09ccad2740 1 client.27526 shutdown 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f09ccad2740 1 -- 172.21.15.33:0/395764649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 msgr2=0x557fedf6e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f09ccad2740 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf6e410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f09b0004b40 tx=0x7f09b00048f0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f09ccad2740 1 -- 172.21.15.33:0/395764649 shutdown_connections 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f09ccad2740 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf7a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f09ccad2740 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf6e410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f09ccad2740 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557fedb7acd0 0x557fedf801b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f09ccad2740 1 --2- 172.21.15.33:0/395764649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf6ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f099f7fe640 0 client.27526 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.589+0000 7f09ccad2740 1 -- 172.21.15.33:0/395764649 >> 172.21.15.33:0/395764649 conn(0x557fedbb0740 msgr2=0x557fedf65910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.590+0000 7f09ccad2740 1 -- 172.21.15.33:0/395764649 shutdown_connections 2024-08-28T19:43:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.590+0000 7f09ccad2740 1 -- 172.21.15.33:0/395764649 wait complete. 2024-08-28T19:43:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.590+0000 7f09ccad2740 20 client.27526 trim_cache size 0 max 16384 2024-08-28T19:43:08.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.607+0000 7f09ccad2740 1 Processor -- start 2024-08-28T19:43:08.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.607+0000 7f09ccad2740 1 -- start start 2024-08-28T19:43:08.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf63ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf5fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09ccad2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f09c01b0bd0 con 0x557fedb93490 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09ccad2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09c01b2710 con 0x557fedbbc350 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09ccad2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f09c01b12a0 con 0x557fedb9b670 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf63ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf63ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58846/0 (socket says 172.21.15.33:58846) 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bf7fe640 1 -- 172.21.15.33:0/3885636929 learned_addr learned my addr 172.21.15.33:0/3885636929 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/3885636929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bffff640 1 --2- 172.21.15.33:0/3885636929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf5fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bf7fe640 1 -- 172.21.15.33:0/3885636929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 msgr2=0x557fedf5fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/3885636929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf5fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bf7fe640 1 -- 172.21.15.33:0/3885636929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 msgr2=0x557fedf601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/3885636929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bf7fe640 1 -- 172.21.15.33:0/3885636929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fedf6ce30 con 0x557fedb93490 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bffff640 1 --2- 172.21.15.33:0/3885636929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf5fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.608+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/3885636929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf63ec0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f09b40096c0 tx=0x7f09b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b18787f3af8208 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09a5ffb640 1 -- 172.21.15.33:0/3885636929 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4035040 con 0x557fedb93490 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09a5ffb640 1 -- 172.21.15.33:0/3885636929 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09b40054f0 con 0x557fedb93490 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09a5ffb640 1 -- 172.21.15.33:0/3885636929 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4004af0 con 0x557fedb93490 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09ccad2740 1 -- 172.21.15.33:0/3885636929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 msgr2=0x557fedf63ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09ccad2740 1 --2- 172.21.15.33:0/3885636929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf63ec0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f09b40096c0 tx=0x7f09b4000bc0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09ccad2740 1 -- 172.21.15.33:0/3885636929 shutdown_connections 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09ccad2740 1 --2- 172.21.15.33:0/3885636929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedbbc350 0x557fedf601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09ccad2740 1 --2- 172.21.15.33:0/3885636929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf5fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09ccad2740 1 --2- 172.21.15.33:0/3885636929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedb93490 0x557fedf63ec0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09ccad2740 1 -- 172.21.15.33:0/3885636929 >> 172.21.15.33:0/3885636929 conn(0x557fedbb0740 msgr2=0x557fedf637b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:08.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09ccad2740 1 -- 172.21.15.33:0/3885636929 shutdown_connections 2024-08-28T19:43:08.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.609+0000 7f09ccad2740 1 -- 172.21.15.33:0/3885636929 wait complete. 2024-08-28T19:43:08.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.610+0000 7f09ccad2740 1 -- start start 2024-08-28T19:43:08.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.610+0000 7f09ccad2740 1 Processor -- start 2024-08-28T19:43:08.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.610+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedb93490 0x557fedf81410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.610+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf81950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.610+0000 7f09ccad2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedbbc350 0x557fedf81ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.610+0000 7f09ccad2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f09c01b2040 con 0x557fedbbc350 2024-08-28T19:43:08.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.610+0000 7f09ccad2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09c01b1970 con 0x557fedb93490 2024-08-28T19:43:08.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.610+0000 7f09ccad2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f09c01aebd0 con 0x557fedb9b670 2024-08-28T19:43:08.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.610+0000 7f09ccad2740 10 client.0 _ll_register_callbacks cb 0x7f09b4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.610+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedbbc350 0x557fedf81ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09bf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedbbc350 0x557fedf81ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58854/0 (socket says 172.21.15.33:58854) 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09bf7fe640 1 -- 172.21.15.33:0/2392106146 learned_addr learned my addr 172.21.15.33:0/2392106146 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09bffff640 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf81950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedb93490 0x557fedf81410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09bf7fe640 1 -- 172.21.15.33:0/2392106146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 msgr2=0x557fedf81950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf81950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09bf7fe640 1 -- 172.21.15.33:0/2392106146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedb93490 msgr2=0x557fedf81410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedb93490 0x557fedf81410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09bf7fe640 1 -- 172.21.15.33:0/2392106146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fedfe9b80 con 0x557fedbbc350 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09bf7fe640 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedbbc350 0x557fedf81ed0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f09b4005820 tx=0x7f09b40048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31847a681aef5027 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f099f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f099f7fe640 1 -- 172.21.15.33:0/2392106146 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4035070 con 0x557fedbbc350 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f099f7fe640 1 -- 172.21.15.33:0/2392106146 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9453+0+0 (secure 0 0 0) 0x7f09b4005250 con 0x557fedbbc350 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09ccad2740 1 -- 172.21.15.33:0/2392106146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09b40054f0 con 0x557fedbbc350 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f099f7fe640 1 -- 172.21.15.33:0/2392106146 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f09b40044d0 con 0x557fedbbc350 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09ccad2740 10 client.18627 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.611+0000 7f09ccad2740 1 -- 172.21.15.33:0/2392106146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557fedfeadb0 con 0x557fedbbc350 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.612+0000 7f099f7fe640 1 -- 172.21.15.33:0/2392106146 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09b40054f0 con 0x557fedbbc350 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.612+0000 7f099f7fe640 1 -- 172.21.15.33:0/2392106146 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f09b403d9c0 con 0x557fedbbc350 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.612+0000 7f09ccad2740 10 client.18627 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.612+0000 7f09ccad2740 10 client.18627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.612+0000 7f09ccad2740 20 client.18627 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.612+0000 7f09ccad2740 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557fedb50080 0x557fedfed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.612+0000 7f09ccad2740 4 client.18627 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:43:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.612+0000 7f09ccad2740 1 -- 172.21.15.33:0/2392106146 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557feded5fe0 con 0x557fedb50080 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.612+0000 7f09bffff640 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557fedb50080 0x557fedfed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.613+0000 7f099f7fe640 10 client.18627 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.613+0000 7f09bffff640 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557fedb50080 0x557fedfed4f0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c600d587a99dc7e server_cookie=f5a0453883c3b9eb in_seq=0 out_seq=0 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.614+0000 7f099f7fe640 1 -- 172.21.15.33:0/2392106146 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557feded5fe0 con 0x557fedb50080 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.614+0000 7f099f7fe640 10 client.18627 handle_command_reply: tid=0 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.614+0000 7f09ccad2740 1 client.18627 shutdown 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 1 -- 172.21.15.33:0/2392106146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedbbc350 msgr2=0x557fedf81ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedbbc350 0x557fedf81ed0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f09b4005820 tx=0x7f09b40048d0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 1 -- 172.21.15.33:0/2392106146 shutdown_connections 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557fedb50080 0x557fedfed4f0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557fedbbc350 0x557fedf81ed0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557fedb9b670 0x557fedf81950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 1 --2- 172.21.15.33:0/2392106146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557fedb93490 0x557fedf81410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 1 -- 172.21.15.33:0/2392106146 >> 172.21.15.33:0/2392106146 conn(0x557fedbb0740 msgr2=0x557fedf6f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:08.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f099f7fe640 0 client.18627 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:08.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 1 -- 172.21.15.33:0/2392106146 shutdown_connections 2024-08-28T19:43:08.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 1 -- 172.21.15.33:0/2392106146 wait complete. 2024-08-28T19:43:08.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.615+0000 7f09ccad2740 20 client.18627 trim_cache size 0 max 16384 2024-08-28T19:43:08.620 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:43:08.620 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:43:08.620 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb", 2024-08-28T19:43:08.620 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:43:08.621 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:43:08.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 -- 172.21.15.33:0/1749890357 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09a80b4ca0 msgr2=0x7f09a80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:08.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09a80b4ca0 0x7f09a80b71b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f09b80abb30 tx=0x7f09b800cf50 comp rx=0 tx=0).stop 2024-08-28T19:43:08.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 -- 172.21.15.33:0/1749890357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09c010dc30 msgr2=0x7f09c019fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:08.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09c010dc30 0x7f09c019fac0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f09b800eaa0 tx=0x7f09b800ef60 comp rx=0 tx=0).stop 2024-08-28T19:43:08.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 -- 172.21.15.33:0/1749890357 shutdown_connections 2024-08-28T19:43:08.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09c010dc30 0x7f09c019fac0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09c0105120 0x7f09c019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09a80b4ca0 0x7f09a80b71b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 --2- 172.21.15.33:0/1749890357 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c01047d0 0x7f09c019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:08.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 -- 172.21.15.33:0/1749890357 >> 172.21.15.33:0/1749890357 conn(0x7f09c0079510 msgr2=0x7f09c0100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:08.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 -- 172.21.15.33:0/1749890357 shutdown_connections 2024-08-28T19:43:08.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:08.616+0000 7f09c655d640 1 -- 172.21.15.33:0/1749890357 wait complete. 2024-08-28T19:43:09.475 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:43:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:09.868 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:09 smithi033 ceph-mon[18549]: pgmap v671: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 48 KiB/s wr, 28 op/s 2024-08-28T19:43:09.868 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:09 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:43:09.868 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:09 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:09.869 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:09 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:43:09.869 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:09 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:09 smithi059 ceph-mon[22052]: pgmap v671: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 48 KiB/s wr, 28 op/s 2024-08-28T19:43:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:09 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:43:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:09 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:09 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:43:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:09 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:10.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:09 smithi122 ceph-mon[22174]: pgmap v671: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 48 KiB/s wr, 28 op/s 2024-08-28T19:43:10.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:09 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:43:10.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:09 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:10.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:09 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:43:10.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:09 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.354+0000 7fa3288eb640 1 -- 172.21.15.33:0/4067823133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa324101e20 msgr2=0x7fa324102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.354+0000 7fa3288eb640 1 --2- 172.21.15.33:0/4067823133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa324101e20 0x7fa324102230 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fa314009900 tx=0x7fa31402a410 comp rx=0 tx=0).stop 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.354+0000 7fa3288eb640 1 -- 172.21.15.33:0/4067823133 shutdown_connections 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.354+0000 7fa3288eb640 1 --2- 172.21.15.33:0/4067823133 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3241069c0 0x7fa324110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.354+0000 7fa3288eb640 1 --2- 172.21.15.33:0/4067823133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa324106070 0x7fa324106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.354+0000 7fa3288eb640 1 --2- 172.21.15.33:0/4067823133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa324101e20 0x7fa324102230 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.354+0000 7fa3288eb640 1 -- 172.21.15.33:0/4067823133 >> 172.21.15.33:0/4067823133 conn(0x7fa324079d30 msgr2=0x7fa32407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.354+0000 7fa3288eb640 1 -- 172.21.15.33:0/4067823133 shutdown_connections 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.354+0000 7fa3288eb640 1 -- 172.21.15.33:0/4067823133 wait complete. 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa3288eb640 1 Processor -- start 2024-08-28T19:43:10.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa3288eb640 1 -- start start 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa3288eb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa324101e20 0x7fa32419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa3288eb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa324106070 0x7fa32419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa3288eb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3241069c0 0x7fa32419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa3288eb640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa324113910 con 0x7fa3241069c0 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa3288eb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa324113790 con 0x7fa324106070 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa3288eb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa324113a90 con 0x7fa324101e20 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa322d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3241069c0 0x7fa32419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa322d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3241069c0 0x7fa32419fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58874/0 (socket says 172.21.15.33:58874) 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa322d9d640 1 -- 172.21.15.33:0/258459007 learned_addr learned my addr 172.21.15.33:0/258459007 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa32259c640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa324101e20 0x7fa32419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.355+0000 7fa321d9b640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa324106070 0x7fa32419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa322d9d640 1 -- 172.21.15.33:0/258459007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa324101e20 msgr2=0x7fa32419a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa322d9d640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa324101e20 0x7fa32419a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa322d9d640 1 -- 172.21.15.33:0/258459007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa324106070 msgr2=0x7fa32419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa322d9d640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa324106070 0x7fa32419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa322d9d640 1 -- 172.21.15.33:0/258459007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3241a0270 con 0x7fa3241069c0 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa322d9d640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3241069c0 0x7fa32419fb40 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00b970 tx=0x7fa31c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa3137fe640 1 -- 172.21.15.33:0/258459007 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c019070 con 0x7fa3241069c0 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa3288eb640 1 -- 172.21.15.33:0/258459007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3241a0560 con 0x7fa3241069c0 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa3137fe640 1 -- 172.21.15.33:0/258459007 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa31c014440 con 0x7fa3241069c0 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa3137fe640 1 -- 172.21.15.33:0/258459007 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c0075d0 con 0x7fa3241069c0 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.356+0000 7fa3288eb640 1 -- 172.21.15.33:0/258459007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3241a6cc0 con 0x7fa3241069c0 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.359+0000 7fa32ee60740 1 Processor -- start 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.359+0000 7fa3137fe640 1 -- 172.21.15.33:0/258459007 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa31c01c070 con 0x7fa3241069c0 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.359+0000 7fa32ee60740 1 -- start start 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.359+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093724070 0x55a093ac92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.359+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 0x55a093ac9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.359+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a093703390 0x55a093ac9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.359+0000 7fa32ee60740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a093a40630 con 0x55a093724070 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.359+0000 7fa32ee60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a093a2fbc0 con 0x55a093703390 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.359+0000 7fa32ee60740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a093a33b70 con 0x55a0936fb1b0 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.359+0000 7fa321d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093724070 0x55a093ac92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa321d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093724070 0x55a093ac92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58876/0 (socket says 172.21.15.33:58876) 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa321d9b640 1 -- 172.21.15.33:0/344111113 learned_addr learned my addr 172.21.15.33:0/344111113 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa3137fe640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa30c0b4ca0 0x7fa30c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa32259c640 1 --2- 172.21.15.33:0/344111113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 0x55a093ac9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa321d9b640 1 -- 172.21.15.33:0/344111113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 msgr2=0x55a093ac9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa321d9b640 1 --2- 172.21.15.33:0/344111113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 0x55a093ac9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa321d9b640 1 -- 172.21.15.33:0/344111113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a093703390 msgr2=0x55a093ac9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa321d9b640 1 --2- 172.21.15.33:0/344111113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a093703390 0x55a093ac9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa321d9b640 1 -- 172.21.15.33:0/344111113 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09378f650 con 0x55a093724070 2024-08-28T19:43:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa32259c640 1 --2- 172.21.15.33:0/344111113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 0x55a093ac9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa322d9d640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa30c0b4ca0 0x7fa30c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa3137fe640 1 -- 172.21.15.33:0/258459007 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9541+0+0 (secure 0 0 0) 0x7fa31c0e4e90 con 0x7fa3241069c0 2024-08-28T19:43:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.360+0000 7fa321d9b640 1 --2- 172.21.15.33:0/344111113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093724070 0x55a093ac92c0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fa31800ac50 tx=0x7fa3180117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da06d41c848cb88 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.361+0000 7fa322d9d640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa30c0b4ca0 0x7fa30c0b71b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0e2290 tx=0x7fa31c00e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.361+0000 7fa310ff9640 1 -- 172.21.15.33:0/344111113 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318005020 con 0x55a093724070 2024-08-28T19:43:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.361+0000 7fa310ff9640 1 -- 172.21.15.33:0/344111113 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3180047a0 con 0x55a093724070 2024-08-28T19:43:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.361+0000 7fa310ff9640 1 -- 172.21.15.33:0/344111113 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3180126b0 con 0x55a093724070 2024-08-28T19:43:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.361+0000 7fa32ee60740 1 -- 172.21.15.33:0/344111113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093724070 msgr2=0x55a093ac92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.361+0000 7fa32ee60740 1 --2- 172.21.15.33:0/344111113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093724070 0x55a093ac92c0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fa31800ac50 tx=0x7fa3180117b0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 -- 172.21.15.33:0/344111113 shutdown_connections 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 --2- 172.21.15.33:0/344111113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a093703390 0x55a093ac9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 --2- 172.21.15.33:0/344111113 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 0x55a093ac9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 --2- 172.21.15.33:0/344111113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093724070 0x55a093ac92c0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 -- 172.21.15.33:0/344111113 >> 172.21.15.33:0/344111113 conn(0x55a093718460 msgr2=0x55a093ac71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 -- 172.21.15.33:0/344111113 shutdown_connections 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 -- 172.21.15.33:0/344111113 wait complete. 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 -- start start 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 Processor -- start 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 0x55a093ad8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ad92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a093724070 0x55a093ae5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a093892700 con 0x55a093703390 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a0939b6700 con 0x55a093724070 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.362+0000 7fa32ee60740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a093adbdd0 con 0x55a0936fb1b0 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32ee60740 10 client.0 _ll_register_callbacks cb 0x55a0939e5dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ad92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ad92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58884/0 (socket says 172.21.15.33:58884) 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32259c640 1 -- 172.21.15.33:0/4231192009 learned_addr learned my addr 172.21.15.33:0/4231192009 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa321d9b640 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a093724070 0x55a093ae5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa321d9b640 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 0x55a093ad8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32259c640 1 -- 172.21.15.33:0/4231192009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 msgr2=0x55a093ad8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32259c640 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 0x55a093ad8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32259c640 1 -- 172.21.15.33:0/4231192009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a093724070 msgr2=0x55a093ae5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32259c640 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a093724070 0x55a093ae5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32259c640 1 -- 172.21.15.33:0/4231192009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0939ef8b0 con 0x55a093703390 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa321d9b640 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 0x55a093ad8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32259c640 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ad92e0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fa314009230 tx=0x7fa314031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb5830c788abb05 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa309ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa309ffb640 1 -- 172.21.15.33:0/4231192009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314035070 con 0x55a093703390 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa32ee60740 1 -- 172.21.15.33:0/4231192009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3180047a0 con 0x55a093703390 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa309ffb640 1 -- 172.21.15.33:0/4231192009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9541+0+0 (secure 0 0 0) 0x7fa314004040 con 0x55a093703390 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.363+0000 7fa309ffb640 1 -- 172.21.15.33:0/4231192009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa314004240 con 0x55a093703390 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa32ee60740 10 client.18639 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa32ee60740 1 -- 172.21.15.33:0/4231192009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a093ae7b00 con 0x55a093703390 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa309ffb640 1 -- 172.21.15.33:0/4231192009 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3180047a0 con 0x55a093703390 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa309ffb640 1 -- 172.21.15.33:0/4231192009 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa31403c440 con 0x55a093703390 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa32ee60740 10 client.18639 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa32ee60740 10 client.18639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa32ee60740 20 client.18639 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0936e29f0 0x55a093aeb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa32ee60740 4 client.18639 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa32ee60740 1 -- 172.21.15.33:0/4231192009 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a093a42580 con 0x55a0936e29f0 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.364+0000 7fa321d9b640 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0936e29f0 0x55a093aeb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.365+0000 7fa309ffb640 10 client.18639 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.365+0000 7fa321d9b640 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0936e29f0 0x55a093aeb070 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63689646c1233217 server_cookie=dc4b044990e48dd9 in_seq=0 out_seq=0 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.365+0000 7fa309ffb640 1 -- 172.21.15.33:0/4231192009 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a093a42580 con 0x55a0936e29f0 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.365+0000 7fa309ffb640 10 client.18639 handle_command_reply: tid=0 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 client.18639 shutdown 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 -- 172.21.15.33:0/4231192009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 msgr2=0x55a093ad92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ad92e0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fa314009230 tx=0x7fa314031660 comp rx=0 tx=0).stop 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 -- 172.21.15.33:0/4231192009 shutdown_connections 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a093724070 0x55a093ae5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0936e29f0 0x55a093aeb070 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ad92e0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4231192009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0936fb1b0 0x55a093ad8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 -- 172.21.15.33:0/4231192009 >> 172.21.15.33:0/4231192009 conn(0x55a093718460 msgr2=0x55a093acc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa309ffb640 0 client.18639 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 -- 172.21.15.33:0/4231192009 shutdown_connections 2024-08-28T19:43:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 1 -- 172.21.15.33:0/4231192009 wait complete. 2024-08-28T19:43:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.366+0000 7fa32ee60740 20 client.18639 trim_cache size 0 max 16384 2024-08-28T19:43:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.383+0000 7fa32ee60740 1 Processor -- start 2024-08-28T19:43:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.383+0000 7fa32ee60740 1 -- start start 2024-08-28T19:43:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0936fb1b0 0x55a093ada9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ae5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 0x55a093ad5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32ee60740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa3241aebf0 con 0x55a093703390 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32ee60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa3241b0730 con 0x55a0936fb1b0 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32ee60740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa3241af2c0 con 0x55a093724070 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ae5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ae5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58894/0 (socket says 172.21.15.33:58894) 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32259c640 1 -- 172.21.15.33:0/2019187991 learned_addr learned my addr 172.21.15.33:0/2019187991 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa321d9b640 1 --2- 172.21.15.33:0/2019187991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0936fb1b0 0x55a093ada9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa321d9b640 1 --2- 172.21.15.33:0/2019187991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 0x55a093ad5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32259c640 1 -- 172.21.15.33:0/2019187991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 msgr2=0x55a093ad5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32259c640 1 --2- 172.21.15.33:0/2019187991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 0x55a093ad5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32259c640 1 -- 172.21.15.33:0/2019187991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0936fb1b0 msgr2=0x55a093ada9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32259c640 1 --2- 172.21.15.33:0/2019187991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0936fb1b0 0x55a093ada9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32259c640 1 -- 172.21.15.33:0/2019187991 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a093ad72a0 con 0x55a093703390 2024-08-28T19:43:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa321d9b640 1 --2- 172.21.15.33:0/2019187991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 0x55a093ad5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:10.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa32259c640 1 --2- 172.21.15.33:0/2019187991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ae5060 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fa314006010 tx=0x7fa31402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345fe0cc33c059a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:10.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.384+0000 7fa30bfff640 1 -- 172.21.15.33:0/2019187991 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314035040 con 0x55a093703390 2024-08-28T19:43:10.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa30bfff640 1 -- 172.21.15.33:0/2019187991 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa314058070 con 0x55a093703390 2024-08-28T19:43:10.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa30bfff640 1 -- 172.21.15.33:0/2019187991 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314032040 con 0x55a093703390 2024-08-28T19:43:10.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa32ee60740 1 -- 172.21.15.33:0/2019187991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 msgr2=0x55a093ae5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:10.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa32ee60740 1 --2- 172.21.15.33:0/2019187991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ae5060 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fa314006010 tx=0x7fa31402a410 comp rx=0 tx=0).stop 2024-08-28T19:43:10.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa32ee60740 1 -- 172.21.15.33:0/2019187991 shutdown_connections 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa32ee60740 1 --2- 172.21.15.33:0/2019187991 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 0x55a093ad5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa32ee60740 1 --2- 172.21.15.33:0/2019187991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093ae5060 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa32ee60740 1 --2- 172.21.15.33:0/2019187991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0936fb1b0 0x55a093ada9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa32ee60740 1 -- 172.21.15.33:0/2019187991 >> 172.21.15.33:0/2019187991 conn(0x55a093718460 msgr2=0x55a093ada2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa32ee60740 1 -- 172.21.15.33:0/2019187991 shutdown_connections 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.385+0000 7fa32ee60740 1 -- 172.21.15.33:0/2019187991 wait complete. 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32ee60740 1 -- start start 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32ee60740 1 Processor -- start 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0936fb1b0 0x55a093ae18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093adcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32ee60740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 0x55a093add310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32ee60740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa3241b0060 con 0x55a093703390 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32ee60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa3241af990 con 0x55a0936fb1b0 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32ee60740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa3241acbf0 con 0x55a093724070 2024-08-28T19:43:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32ee60740 10 client.0 _ll_register_callbacks cb 0x7fa314005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093adcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093adcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58904/0 (socket says 172.21.15.33:58904) 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa32259c640 1 -- 172.21.15.33:0/4200142224 learned_addr learned my addr 172.21.15.33:0/4200142224 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa321d9b640 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0936fb1b0 0x55a093ae18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.386+0000 7fa321d9b640 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 0x55a093add310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa32259c640 1 -- 172.21.15.33:0/4200142224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 msgr2=0x55a093add310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa32259c640 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 0x55a093add310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa32259c640 1 -- 172.21.15.33:0/4200142224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0936fb1b0 msgr2=0x55a093ae18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa32259c640 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0936fb1b0 0x55a093ae18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa32259c640 1 -- 172.21.15.33:0/4200142224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a093addaa0 con 0x55a093703390 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa32259c640 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093adcd90 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fa31403cd60 tx=0x7fa31403cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9f66b7c3a64356 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa309ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa309ffb640 1 -- 172.21.15.33:0/4200142224 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314035030 con 0x55a093703390 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa309ffb640 1 -- 172.21.15.33:0/4200142224 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9541+0+0 (secure 0 0 0) 0x7fa314031640 con 0x55a093703390 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa32ee60740 1 -- 172.21.15.33:0/4200142224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa314058070 con 0x55a093703390 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa309ffb640 1 -- 172.21.15.33:0/4200142224 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa314031840 con 0x55a093703390 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa32ee60740 10 client.18645 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa32ee60740 1 -- 172.21.15.33:0/4200142224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a093b55920 con 0x55a093703390 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.387+0000 7fa309ffb640 1 -- 172.21.15.33:0/4200142224 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa314058070 con 0x55a093703390 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa309ffb640 1 -- 172.21.15.33:0/4200142224 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa314032670 con 0x55a093703390 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa32ee60740 10 client.18645 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa32ee60740 10 client.18645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa32ee60740 20 client.18645 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0936b7da0 0x55a093b57e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa32ee60740 4 client.18645 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:43:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa32ee60740 1 -- 172.21.15.33:0/4200142224 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a093aeb610 con 0x55a0936b7da0 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa321d9b640 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0936b7da0 0x55a093b57e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa321d9b640 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0936b7da0 0x55a093b57e20 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28c8de5513d670b4 server_cookie=3d691aec89299027 in_seq=0 out_seq=0 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa309ffb640 10 client.18645 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa309ffb640 1 -- 172.21.15.33:0/4200142224 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5398 (crc 0 0 0) 0x55a093aeb610 con 0x55a0936b7da0 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.388+0000 7fa309ffb640 10 client.18645 handle_command_reply: tid=0 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 client.18645 shutdown 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 -- 172.21.15.33:0/4200142224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 msgr2=0x55a093adcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093adcd90 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fa31403cd60 tx=0x7fa31403cd90 comp rx=0 tx=0).stop 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 -- 172.21.15.33:0/4200142224 shutdown_connections 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a093724070 0x55a093add310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0936b7da0 0x55a093b57e20 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a093703390 0x55a093adcd90 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 --2- 172.21.15.33:0/4200142224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0936fb1b0 0x55a093ae18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa309ffb640 0 client.18645 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 -- 172.21.15.33:0/4200142224 >> 172.21.15.33:0/4200142224 conn(0x55a093718460 msgr2=0x55a093acacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 -- 172.21.15.33:0/4200142224 shutdown_connections 2024-08-28T19:43:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 1 -- 172.21.15.33:0/4200142224 wait complete. 2024-08-28T19:43:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa32ee60740 20 client.18645 trim_cache size 0 max 16384 2024-08-28T19:43:10.395 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:43:10.395 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:43:10.395 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:43:10.395 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:43:10.395 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb", 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.397 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:43:10.398 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:43:10.399 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.401 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:43:10.402 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.403 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.404 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.405 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:10.406 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:43:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa3288eb640 1 -- 172.21.15.33:0/258459007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa30c0b4ca0 msgr2=0x7fa30c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa3288eb640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa30c0b4ca0 0x7fa30c0b71b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0e2290 tx=0x7fa31c00e040 comp rx=0 tx=0).stop 2024-08-28T19:43:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa3288eb640 1 -- 172.21.15.33:0/258459007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3241069c0 msgr2=0x7fa32419fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa3288eb640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3241069c0 0x7fa32419fb40 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00b970 tx=0x7fa31c00be30 comp rx=0 tx=0).stop 2024-08-28T19:43:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa3288eb640 1 -- 172.21.15.33:0/258459007 shutdown_connections 2024-08-28T19:43:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa3288eb640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3241069c0 0x7fa32419fb40 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa3288eb640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa324106070 0x7fa32419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa3288eb640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa30c0b4ca0 0x7fa30c0b71b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa3288eb640 1 --2- 172.21.15.33:0/258459007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa324101e20 0x7fa32419a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.389+0000 7fa3288eb640 1 -- 172.21.15.33:0/258459007 >> 172.21.15.33:0/258459007 conn(0x7fa324079d30 msgr2=0x7fa324107300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.390+0000 7fa3288eb640 1 -- 172.21.15.33:0/258459007 shutdown_connections 2024-08-28T19:43:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:10.390+0000 7fa3288eb640 1 -- 172.21.15.33:0/258459007 wait complete. 2024-08-28T19:43:10.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:10 smithi033 ceph-mon[18549]: osdmap e93: 12 total, 12 up, 12 in 2024-08-28T19:43:11.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:10 smithi059 ceph-mon[22052]: osdmap e93: 12 total, 12 up, 12 in 2024-08-28T19:43:11.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:10 smithi122 ceph-mon[22174]: osdmap e93: 12 total, 12 up, 12 in 2024-08-28T19:43:11.107 INFO:tasks.cephfs.filesystem:scrub status for tag:2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb - {'path': '/', 'tag': '2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb', 'options': 'recursive,force'} 2024-08-28T19:43:11.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:11 smithi033 ceph-mon[18549]: pgmap v673: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-08-28T19:43:12.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:11 smithi059 ceph-mon[22052]: pgmap v673: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-08-28T19:43:12.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:11 smithi122 ceph-mon[22174]: pgmap v673: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-08-28T19:43:13.099 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:43:13.365 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:13.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:13 smithi033 ceph-mon[18549]: pgmap v674: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-08-28T19:43:14.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:13 smithi059 ceph-mon[22052]: pgmap v674: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.029+0000 7f27252fe640 1 -- 172.21.15.33:0/1342849195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2720109bb0 msgr2=0x7f27201103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.029+0000 7f27252fe640 1 --2- 172.21.15.33:0/1342849195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2720109bb0 0x7f27201103e0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f2718009ca0 tx=0x7f271802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.029+0000 7f27252fe640 1 -- 172.21.15.33:0/1342849195 shutdown_connections 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.029+0000 7f27252fe640 1 --2- 172.21.15.33:0/1342849195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2720109bb0 0x7f27201103e0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.029+0000 7f27252fe640 1 --2- 172.21.15.33:0/1342849195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2720109260 0x7f2720109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.029+0000 7f27252fe640 1 --2- 172.21.15.33:0/1342849195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2720103920 0x7f2720103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.029+0000 7f27252fe640 1 -- 172.21.15.33:0/1342849195 >> 172.21.15.33:0/1342849195 conn(0x7f27200ff3b0 msgr2=0x7f2720101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.029+0000 7f27252fe640 1 -- 172.21.15.33:0/1342849195 shutdown_connections 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.029+0000 7f27252fe640 1 -- 172.21.15.33:0/1342849195 wait complete. 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.030+0000 7f27252fe640 1 Processor -- start 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.030+0000 7f27252fe640 1 -- start start 2024-08-28T19:43:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.030+0000 7f27252fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2720103920 0x7f272019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.030+0000 7f27252fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2720109260 0x7f272019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f27252fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2720109bb0 0x7f272019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f27252fe640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2720113870 con 0x7f2720109bb0 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f27252fe640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27201136f0 con 0x7f2720103920 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f27252fe640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f27201139f0 con 0x7f2720109260 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2720109bb0 0x7f272019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2720109bb0 0x7f272019fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58912/0 (socket says 172.21.15.33:58912) 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271f7fe640 1 -- 172.21.15.33:0/672669552 learned_addr learned my addr 172.21.15.33:0/672669552 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271effd640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2720103920 0x7f272019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271e7fc640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2720109260 0x7f272019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271f7fe640 1 -- 172.21.15.33:0/672669552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2720109260 msgr2=0x7f272019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271f7fe640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2720109260 0x7f272019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271f7fe640 1 -- 172.21.15.33:0/672669552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2720103920 msgr2=0x7f272019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:14.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271f7fe640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2720103920 0x7f272019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271f7fe640 1 -- 172.21.15.33:0/672669552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27201a0130 con 0x7f2720109bb0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.031+0000 7f271f7fe640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2720109bb0 0x7f272019fac0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f2718005cc0 tx=0x7f271802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.032+0000 7f2717fff640 1 -- 172.21.15.33:0/672669552 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2718003bf0 con 0x7f2720109bb0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.032+0000 7f27252fe640 1 -- 172.21.15.33:0/672669552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27201a03c0 con 0x7f2720109bb0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.032+0000 7f2717fff640 1 -- 172.21.15.33:0/672669552 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2718003d90 con 0x7f2720109bb0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.032+0000 7f2717fff640 1 -- 172.21.15.33:0/672669552 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271802fbc0 con 0x7f2720109bb0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.032+0000 7f27252fe640 1 -- 172.21.15.33:0/672669552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27201a6c40 con 0x7f2720109bb0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.033+0000 7f27252fe640 1 -- 172.21.15.33:0/672669552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2720104ba0 con 0x7f2720109bb0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.034+0000 7f2717fff640 1 -- 172.21.15.33:0/672669552 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f271802fd60 con 0x7f2720109bb0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.035+0000 7f2717fff640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f270c0b4cd0 0x7f270c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.035+0000 7f271effd640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f270c0b4cd0 0x7f270c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.035+0000 7f2717fff640 1 -- 172.21.15.33:0/672669552 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9541+0+0 (secure 0 0 0) 0x7f2718106ea0 con 0x7f2720109bb0 2024-08-28T19:43:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.036+0000 7f271effd640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f270c0b4cd0 0x7f270c0b71e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f270800bbe0 tx=0x7f270800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.038+0000 7f2717fff640 1 -- 172.21.15.33:0/672669552 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f27180cd830 con 0x7f2720109bb0 2024-08-28T19:43:14.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:13 smithi122 ceph-mon[22174]: pgmap v674: 129 pgs: 129 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-08-28T19:43:14.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.264+0000 7f27252fe640 1 -- 172.21.15.33:0/672669552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2720103d30 con 0x7f2720109bb0 2024-08-28T19:43:14.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.264+0000 7f2717fff640 1 -- 172.21.15.33:0/672669552 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f27180cd130 con 0x7f2720109bb0 2024-08-28T19:43:14.265 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:43:14.266 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:43:14.266 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:43:14.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 -- 172.21.15.33:0/672669552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f270c0b4cd0 msgr2=0x7f270c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f270c0b4cd0 0x7f270c0b71e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f270800bbe0 tx=0x7f270800b390 comp rx=0 tx=0).stop 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 -- 172.21.15.33:0/672669552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2720109bb0 msgr2=0x7f272019fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2720109bb0 0x7f272019fac0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f2718005cc0 tx=0x7f271802f380 comp rx=0 tx=0).stop 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 -- 172.21.15.33:0/672669552 shutdown_connections 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2720109bb0 0x7f272019fac0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f270c0b4cd0 0x7f270c0b71e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2720109260 0x7f272019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 --2- 172.21.15.33:0/672669552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2720103920 0x7f272019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 -- 172.21.15.33:0/672669552 >> 172.21.15.33:0/672669552 conn(0x7f27200ff3b0 msgr2=0x7f2720106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 -- 172.21.15.33:0/672669552 shutdown_connections 2024-08-28T19:43:14.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:14.267+0000 7f27252fe640 1 -- 172.21.15.33:0/672669552 wait complete. 2024-08-28T19:43:14.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:14 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/672669552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:43:15.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:14 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/672669552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:43:15.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:14 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/672669552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:43:15.075 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id f91a6de --release --await' 2024-08-28T19:43:15.075 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id f91a6de --release --await 2024-08-28T19:43:15.331 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:15.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:15 smithi033 ceph-mon[18549]: pgmap v675: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:43:15.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.945+0000 7f6bfdab5640 1 -- 172.21.15.33:0/1386803053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf8108a90 msgr2=0x7f6bf810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:15.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.945+0000 7f6bfdab5640 1 --2- 172.21.15.33:0/1386803053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf8108a90 0x7f6bf810f2c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009ca0 tx=0x7f6bf002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.945+0000 7f6bfdab5640 1 -- 172.21.15.33:0/1386803053 shutdown_connections 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.945+0000 7f6bfdab5640 1 --2- 172.21.15.33:0/1386803053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf8108a90 0x7f6bf810f2c0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.945+0000 7f6bfdab5640 1 --2- 172.21.15.33:0/1386803053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf8108140 0x7f6bf8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.945+0000 7f6bfdab5640 1 --2- 172.21.15.33:0/1386803053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf8102800 0x7f6bf8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.945+0000 7f6bfdab5640 1 -- 172.21.15.33:0/1386803053 >> 172.21.15.33:0/1386803053 conn(0x7f6bf80794d0 msgr2=0x7f6bf80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.945+0000 7f6bfdab5640 1 -- 172.21.15.33:0/1386803053 shutdown_connections 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.945+0000 7f6bfdab5640 1 -- 172.21.15.33:0/1386803053 wait complete. 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.946+0000 7f6bfdab5640 1 Processor -- start 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.946+0000 7f6bfdab5640 1 -- start start 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.946+0000 7f6bfdab5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf8102800 0x7f6bf819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bfdab5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf8108140 0x7f6bf819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bfdab5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf8108a90 0x7f6bf819fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bfdab5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf8112770 con 0x7f6bf8108140 2024-08-28T19:43:15.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bfdab5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf81125f0 con 0x7f6bf8102800 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bfdab5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf81128f0 con 0x7f6bf8108a90 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf8108140 0x7f6bf819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf8108140 0x7f6bf819a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58928/0 (socket says 172.21.15.33:58928) 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf6ffd640 1 -- 172.21.15.33:0/2372209722 learned_addr learned my addr 172.21.15.33:0/2372209722 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf7fff640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf8108a90 0x7f6bf819fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf8102800 0x7f6bf819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf6ffd640 1 -- 172.21.15.33:0/2372209722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf8108a90 msgr2=0x7f6bf819fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf8108a90 0x7f6bf819fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf6ffd640 1 -- 172.21.15.33:0/2372209722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf8102800 msgr2=0x7f6bf819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf8102800 0x7f6bf819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf6ffd640 1 -- 172.21.15.33:0/2372209722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf81a0260 con 0x7f6bf8108140 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf8108140 0x7f6bf819a890 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f6be000d770 tx=0x7f6be000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:15.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf4ff9640 1 -- 172.21.15.33:0/2372209722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0017070 con 0x7f6bf8108140 2024-08-28T19:43:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bfdab5640 1 -- 172.21.15.33:0/2372209722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf81a0550 con 0x7f6bf8108140 2024-08-28T19:43:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.947+0000 7f6bf4ff9640 1 -- 172.21.15.33:0/2372209722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be0009c30 con 0x7f6bf8108140 2024-08-28T19:43:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.948+0000 7f6bf4ff9640 1 -- 172.21.15.33:0/2372209722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be000f620 con 0x7f6bf8108140 2024-08-28T19:43:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.948+0000 7f6bfdab5640 1 -- 172.21.15.33:0/2372209722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf81a6cb0 con 0x7f6bf8108140 2024-08-28T19:43:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6c0402a740 1 Processor -- start 2024-08-28T19:43:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6c0402a740 1 -- start start 2024-08-28T19:43:15.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6bf4ff9640 1 -- 172.21.15.33:0/2372209722 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6be001a070 con 0x7f6bf8108140 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cee520 0x55d2e7093c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cc5660 0x55d2e70941c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 0x55d2e7094700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6c0402a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d2e700aa70 con 0x55d2e6cee520 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6c0402a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d2e6ffa000 con 0x55d2e6ccd840 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6c0402a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d2e6ffdfb0 con 0x55d2e6cc5660 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6bf7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cee520 0x55d2e7093c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6bf7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cee520 0x55d2e7093c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58934/0 (socket says 172.21.15.33:58934) 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6bf7fff640 1 -- 172.21.15.33:0/3984627984 learned_addr learned my addr 172.21.15.33:0/3984627984 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/3984627984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cc5660 0x55d2e70941c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.951+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/3984627984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 0x55d2e7094700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bf7fff640 1 -- 172.21.15.33:0/3984627984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cc5660 msgr2=0x55d2e70941c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:15.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bf7fff640 1 --2- 172.21.15.33:0/3984627984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cc5660 0x55d2e70941c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bf7fff640 1 -- 172.21.15.33:0/3984627984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 msgr2=0x55d2e7094700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bf7fff640 1 --2- 172.21.15.33:0/3984627984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 0x55d2e7094700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bf7fff640 1 -- 172.21.15.33:0/3984627984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2e6d59b00 con 0x55d2e6cee520 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bf7fff640 1 --2- 172.21.15.33:0/3984627984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cee520 0x55d2e7093c80 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009920 tx=0x7f6bf0009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6139582672b098f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bedffb640 1 -- 172.21.15.33:0/3984627984 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0031e30 con 0x55d2e6cee520 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bedffb640 1 -- 172.21.15.33:0/3984627984 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bf0036030 con 0x55d2e6cee520 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bedffb640 1 -- 172.21.15.33:0/3984627984 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0004240 con 0x55d2e6cee520 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bf4ff9640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6be40b4ca0 0x7f6be40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6be40b4ca0 0x7f6be40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.952+0000 7f6bf4ff9640 1 -- 172.21.15.33:0/2372209722 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9541+0+0 (secure 0 0 0) 0x7f6be00e54d0 con 0x7f6bf8108140 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.953+0000 7f6c0402a740 1 -- 172.21.15.33:0/3984627984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cee520 msgr2=0x55d2e7093c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.953+0000 7f6c0402a740 1 --2- 172.21.15.33:0/3984627984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cee520 0x55d2e7093c80 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009920 tx=0x7f6bf0009950 comp rx=0 tx=0).stop 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.953+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6be40b4ca0 0x7f6be40b71b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55d2e7092900 tx=0x7f6be8008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:15.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.953+0000 7f6c0402a740 1 -- 172.21.15.33:0/3984627984 shutdown_connections 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.953+0000 7f6c0402a740 1 --2- 172.21.15.33:0/3984627984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 0x55d2e7094700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.953+0000 7f6c0402a740 1 --2- 172.21.15.33:0/3984627984 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cc5660 0x55d2e70941c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.953+0000 7f6c0402a740 1 --2- 172.21.15.33:0/3984627984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cee520 0x55d2e7093c80 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.953+0000 7f6c0402a740 1 -- 172.21.15.33:0/3984627984 >> 172.21.15.33:0/3984627984 conn(0x55d2e6ce2910 msgr2=0x55d2e7091b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.953+0000 7f6c0402a740 1 -- 172.21.15.33:0/3984627984 shutdown_connections 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.953+0000 7f6c0402a740 1 -- 172.21.15.33:0/3984627984 wait complete. 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.954+0000 7f6c0402a740 1 -- start start 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.954+0000 7f6c0402a740 1 Processor -- start 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.954+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e709f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.954+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 0x55d2e709fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.954+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6cee520 0x55d2e70ab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.954+0000 7f6c0402a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d2e70a2280 con 0x55d2e6cc5660 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.954+0000 7f6c0402a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d2e6fbb520 con 0x55d2e6cee520 2024-08-28T19:43:15.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.954+0000 7f6c0402a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d2e70a2400 con 0x55d2e6ccd840 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6c0402a740 10 client.0 _ll_register_callbacks cb 0x55d2e6ff3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e709f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e709f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58948/0 (socket says 172.21.15.33:58948) 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf77fe640 1 -- 172.21.15.33:0/3458311624 learned_addr learned my addr 172.21.15.33:0/3458311624 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 0x55d2e709fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf7fff640 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6cee520 0x55d2e70ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf6ffd640 1 -- 172.21.15.33:0/3458311624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6cee520 msgr2=0x55d2e70ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6cee520 0x55d2e70ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf6ffd640 1 -- 172.21.15.33:0/3458311624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 msgr2=0x55d2e709f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e709f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf6ffd640 1 -- 172.21.15.33:0/3458311624 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2e6dd0960 con 0x55d2e6ccd840 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 0x55d2e709fd20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6be00e2820 tx=0x7f6be000df10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f95cbeb68a82f47 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:15.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.955+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/3458311624 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0021030 con 0x55d2e6ccd840 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/3458311624 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9541+0+0 (secure 0 0 0) 0x7f6be00aac30 con 0x55d2e6ccd840 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6c0402a740 1 -- 172.21.15.33:0/3458311624 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d2e6f999a0 con 0x55d2e6ccd840 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/3458311624 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6be00a7680 con 0x55d2e6ccd840 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6c0402a740 10 client.27550 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6c0402a740 1 -- 172.21.15.33:0/3458311624 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2e70ae3f0 con 0x55d2e6ccd840 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/3458311624 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be00b4420 con 0x55d2e6ccd840 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/3458311624 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6be00e50c0 con 0x55d2e6ccd840 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6c0402a740 10 client.27550 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6c0402a740 10 client.27550 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6c0402a740 20 client.27550 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6c0402a740 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d2e6cacea0 0x55d2e70b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6c0402a740 4 client.27550 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.956+0000 7f6c0402a740 1 -- 172.21.15.33:0/3458311624 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2e6f999a0 con 0x55d2e6cacea0 2024-08-28T19:43:15.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.957+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d2e6cacea0 0x55d2e70b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.957+0000 7f6bd6ffd640 10 client.27550 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.957+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d2e6cacea0 0x55d2e70b18c0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55f3d60c9f0668e server_cookie=2a5cd8b4c1bbb06d in_seq=0 out_seq=0 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/3458311624 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2e6f999a0 con 0x55d2e6cacea0 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6bd6ffd640 10 client.27550 handle_command_reply: tid=0 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 client.27550 shutdown 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 -- 172.21.15.33:0/3458311624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 msgr2=0x55d2e709fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 0x55d2e709fd20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6be00e2820 tx=0x7f6be000df10 comp rx=0 tx=0).stop 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 -- 172.21.15.33:0/3458311624 shutdown_connections 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6cee520 0x55d2e70ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 0x55d2e709fd20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d2e6cacea0 0x55d2e70b18c0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 --2- 172.21.15.33:0/3458311624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e709f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6bd6ffd640 0 client.27550 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:15.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 -- 172.21.15.33:0/3458311624 >> 172.21.15.33:0/3458311624 conn(0x55d2e6ce2910 msgr2=0x55d2e7096e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 -- 172.21.15.33:0/3458311624 shutdown_connections 2024-08-28T19:43:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.958+0000 7f6c0402a740 1 -- 172.21.15.33:0/3458311624 wait complete. 2024-08-28T19:43:15.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.959+0000 7f6c0402a740 20 client.27550 trim_cache size 0 max 16384 2024-08-28T19:43:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6c0402a740 1 Processor -- start 2024-08-28T19:43:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6c0402a740 1 -- start start 2024-08-28T19:43:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e70a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 0x55d2e70a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cee520 0x55d2e709c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6c0402a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf81b0e20 con 0x55d2e6cc5660 2024-08-28T19:43:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6c0402a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf81b2960 con 0x55d2e6ccd840 2024-08-28T19:43:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6c0402a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf81b14f0 con 0x55d2e6cee520 2024-08-28T19:43:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6bf77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e70a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6bf77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e70a7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58958/0 (socket says 172.21.15.33:58958) 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6bf77fe640 1 -- 172.21.15.33:0/1222495389 learned_addr learned my addr 172.21.15.33:0/1222495389 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 0x55d2e70a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6bf7fff640 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cee520 0x55d2e709c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6bf77fe640 1 -- 172.21.15.33:0/1222495389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cee520 msgr2=0x55d2e709c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cee520 0x55d2e709c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6bf77fe640 1 -- 172.21.15.33:0/1222495389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 msgr2=0x55d2e70a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 0x55d2e70a7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.976+0000 7f6bf77fe640 1 -- 172.21.15.33:0/1222495389 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2e709ae70 con 0x55d2e6cc5660 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.977+0000 7f6bf7fff640 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cee520 0x55d2e709c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.977+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 0x55d2e70a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.977+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e70a7a60 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f6be8010620 tx=0x7f6be8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1facd7c29be17b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.977+0000 7f6bed7fa640 1 -- 172.21.15.33:0/1222495389 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be802f070 con 0x55d2e6cc5660 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.977+0000 7f6bed7fa640 1 -- 172.21.15.33:0/1222495389 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be801d040 con 0x55d2e6cc5660 2024-08-28T19:43:15.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.977+0000 7f6bed7fa640 1 -- 172.21.15.33:0/1222495389 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be801c040 con 0x55d2e6cc5660 2024-08-28T19:43:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 -- 172.21.15.33:0/1222495389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 msgr2=0x55d2e70a7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e70a7a60 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f6be8010620 tx=0x7f6be8016000 comp rx=0 tx=0).stop 2024-08-28T19:43:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 -- 172.21.15.33:0/1222495389 shutdown_connections 2024-08-28T19:43:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6cee520 0x55d2e709c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6ccd840 0x55d2e70a7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 --2- 172.21.15.33:0/1222495389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e70a7a60 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 -- 172.21.15.33:0/1222495389 >> 172.21.15.33:0/1222495389 conn(0x55d2e6ce2910 msgr2=0x55d2e70913a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 -- 172.21.15.33:0/1222495389 shutdown_connections 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 -- 172.21.15.33:0/1222495389 wait complete. 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 -- start start 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.978+0000 7f6c0402a740 1 Processor -- start 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e7092d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 0x55d2e70932a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6c0402a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6cee520 0x55d2e70937e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6c0402a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf81b2290 con 0x55d2e6cc5660 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6c0402a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf81b1bc0 con 0x55d2e6cee520 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6c0402a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf81aee20 con 0x55d2e6ccd840 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6c0402a740 10 client.0 _ll_register_callbacks cb 0x7f6be00e8d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e7092d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e7092d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58964/0 (socket says 172.21.15.33:58964) 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf77fe640 1 -- 172.21.15.33:0/2762105407 learned_addr learned my addr 172.21.15.33:0/2762105407 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf7fff640 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6cee520 0x55d2e70937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 0x55d2e70932a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf77fe640 1 -- 172.21.15.33:0/2762105407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 msgr2=0x55d2e70932a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 0x55d2e70932a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf77fe640 1 -- 172.21.15.33:0/2762105407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6cee520 msgr2=0x55d2e70937e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6cee520 0x55d2e70937e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf77fe640 1 -- 172.21.15.33:0/2762105407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2e71202c0 con 0x55d2e6cc5660 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bf77fe640 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e7092d60 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f6be8008010 tx=0x7f6be80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac86fa3cf129520 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.979+0000 7f6bd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/2762105407 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8038060 con 0x55d2e6cc5660 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/2762105407 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9541+0+0 (secure 0 0 0) 0x7f6be8023630 con 0x55d2e6cc5660 2024-08-28T19:43:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6c0402a740 1 -- 172.21.15.33:0/2762105407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6be801d040 con 0x55d2e6cc5660 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/2762105407 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6be802f070 con 0x55d2e6cc5660 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6c0402a740 10 client.18669 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6c0402a740 1 -- 172.21.15.33:0/2762105407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2e71214c0 con 0x55d2e6cc5660 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/2762105407 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be801d040 con 0x55d2e6cc5660 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/2762105407 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6be80133d0 con 0x55d2e6cc5660 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6c0402a740 10 client.18669 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6c0402a740 10 client.18669 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6c0402a740 20 client.18669 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6c0402a740 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d2e6c82250 0x55d2e7123c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6c0402a740 4 client.18669 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f91a6de", "release": true, "await": true}] 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.980+0000 7f6c0402a740 1 -- 172.21.15.33:0/2762105407 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f91a6de", "release": true, "await": true}) -- 0x55d2e700c9c0 con 0x55d2e6c82250 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.981+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d2e6c82250 0x55d2e7123c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.981+0000 7f6bf6ffd640 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d2e6c82250 0x55d2e7123c20 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96703c846b6bb1a8 server_cookie=e40e904d6010d952 in_seq=0 out_seq=0 2024-08-28T19:43:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.981+0000 7f6bd6ffd640 10 client.18669 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6bd6ffd640 1 -- 172.21.15.33:0/2762105407 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55d2e700c9c0 con 0x55d2e6c82250 2024-08-28T19:43:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6bd6ffd640 10 client.18669 handle_command_reply: tid=0 2024-08-28T19:43:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 client.18669 shutdown 2024-08-28T19:43:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 -- 172.21.15.33:0/2762105407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 msgr2=0x55d2e7092d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e7092d60 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f6be8008010 tx=0x7f6be80046c0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 -- 172.21.15.33:0/2762105407 shutdown_connections 2024-08-28T19:43:15.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2e6cee520 0x55d2e70937e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d2e6ccd840 0x55d2e70932a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d2e6c82250 0x55d2e7123c20 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 --2- 172.21.15.33:0/2762105407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d2e6cc5660 0x55d2e7092d60 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 -- 172.21.15.33:0/2762105407 >> 172.21.15.33:0/2762105407 conn(0x55d2e6ce2910 msgr2=0x55d2e7096d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6bd6ffd640 0 client.18669 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 -- 172.21.15.33:0/2762105407 shutdown_connections 2024-08-28T19:43:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 1 -- 172.21.15.33:0/2762105407 wait complete. 2024-08-28T19:43:15.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.986+0000 7f6c0402a740 20 client.18669 trim_cache size 0 max 16384 2024-08-28T19:43:15.988 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:43:15.988 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 36, 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "f91a6de": { 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 36, 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 147.1, 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:43:15.989 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:43:15.990 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:43:15.990 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:43:15.990 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:43:15.990 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:43:15.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:15.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:15.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:15.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:15.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:15.990 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:43:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 -- 172.21.15.33:0/2372209722 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6be40b4ca0 msgr2=0x7f6be40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6be40b4ca0 0x7f6be40b71b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x55d2e7092900 tx=0x7f6be8008040 comp rx=0 tx=0).stop 2024-08-28T19:43:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 -- 172.21.15.33:0/2372209722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf8108140 msgr2=0x7f6bf819a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf8108140 0x7f6bf819a890 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f6be000d770 tx=0x7f6be000dc30 comp rx=0 tx=0).stop 2024-08-28T19:43:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 -- 172.21.15.33:0/2372209722 shutdown_connections 2024-08-28T19:43:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6be40b4ca0 0x7f6be40b71b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6bf8108a90 0x7f6bf819fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf8108140 0x7f6bf819a890 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 --2- 172.21.15.33:0/2372209722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf8102800 0x7f6bf819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:15.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 -- 172.21.15.33:0/2372209722 >> 172.21.15.33:0/2372209722 conn(0x7f6bf80794d0 msgr2=0x7f6bf80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:15.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 -- 172.21.15.33:0/2372209722 shutdown_connections 2024-08-28T19:43:15.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:15.987+0000 7f6bfdab5640 1 -- 172.21.15.33:0/2372209722 wait complete. 2024-08-28T19:43:16.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:15 smithi059 ceph-mon[22052]: pgmap v675: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:43:16.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:15 smithi122 ceph-mon[22174]: pgmap v675: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:43:16.683 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f91a6de', total seconds elapsed: 30.7 2024-08-28T19:43:17.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:17 smithi033 ceph-mon[18549]: pgmap v676: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:43:18.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:17 smithi059 ceph-mon[22052]: pgmap v676: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:43:18.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:17 smithi122 ceph-mon[22174]: pgmap v676: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:43:19.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:19 smithi033 ceph-mon[18549]: pgmap v677: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-28T19:43:19.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:19 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:43:19.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:19 smithi033 ceph-mon[18549]: osdmap e94: 12 total, 12 up, 12 in 2024-08-28T19:43:20.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:19 smithi059 ceph-mon[22052]: pgmap v677: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-28T19:43:20.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:19 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:43:20.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:19 smithi059 ceph-mon[22052]: osdmap e94: 12 total, 12 up, 12 in 2024-08-28T19:43:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:19 smithi122 ceph-mon[22174]: pgmap v677: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-28T19:43:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:19 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:43:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:19 smithi122 ceph-mon[22174]: osdmap e94: 12 total, 12 up, 12 in 2024-08-28T19:43:21.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:21 smithi033 ceph-mon[18549]: pgmap v679: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-08-28T19:43:22.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:21 smithi059 ceph-mon[22052]: pgmap v679: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-08-28T19:43:22.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:21 smithi122 ceph-mon[22174]: pgmap v679: 129 pgs: 129 active+clean; 15 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-08-28T19:43:23.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:23 smithi033 ceph-mon[18549]: pgmap v680: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-08-28T19:43:24.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:23 smithi059 ceph-mon[22052]: pgmap v680: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-08-28T19:43:24.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:23 smithi122 ceph-mon[22174]: pgmap v680: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:313/600: open fd = 3 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:314/600: open fd = 3 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:315/600: open fd = 3 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:316/600: open fd = 3 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:317/600: open fd = 3 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:318/600: open fd = 3 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:319/600: open fd = 3 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:320/600: open fd = 3 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:321/600: open fd = 3 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.071 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:322/600: open fd = 3 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:323/600: open fd = 3 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:324/600: open fd = 3 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.072 INFO:tasks.workunit.client.0.smithi033.stdout:325/600: open fd = 3 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:326/600: open fd = 3 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:327/600: open fd = 3 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.073 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:328/600: open fd = 3 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:329/600: open fd = 3 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:330/600: open fd = 3 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.074 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:331/600: open fd = 3 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:332/600: open fd = 3 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:333/600: open fd = 3 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.075 INFO:tasks.workunit.client.0.smithi033.stdout:334/600: open fd = 3 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:335/600: open fd = 3 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:336/600: open fd = 3 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.076 INFO:tasks.workunit.client.0.smithi033.stdout:337/600: open fd = 3 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:338/600: open fd = 3 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:339/600: open fd = 3 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.077 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:340/600: open fd = 3 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:341/600: open fd = 3 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:342/600: open fd = 3 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.078 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:343/600: open fd = 3 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:344/600: open fd = 3 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:345/600: open fd = 3 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.079 INFO:tasks.workunit.client.0.smithi033.stdout:346/600: open fd = 3 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:347/600: open fd = 3 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:348/600: open fd = 3 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:349/600: open fd = 3 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.080 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:350/600: open fd = 3 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:351/600: open fd = 3 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:352/600: open fd = 3 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.081 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:353/600: open fd = 3 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:354/600: open fd = 3 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:355/600: open fd = 3 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.082 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:356/600: open fd = 3 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:357/600: open fd = 3 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:358/600: open fd = 3 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.083 INFO:tasks.workunit.client.0.smithi033.stdout:359/600: open fd = 3 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:360/600: open fd = 3 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:361/600: open fd = 3 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:362/600: open fd = 3 2024-08-28T19:43:24.084 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:363/600: open fd = 3 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:364/600: open fd = 3 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:365/600: open fd = 3 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.085 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:366/600: open fd = 3 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:367/600: open fd = 3 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:368/600: open fd = 3 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.086 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:369/600: open fd = 3 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:370/600: open fd = 3 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:371/600: open fd = 3 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:372/600: open fd = 3 2024-08-28T19:43:24.087 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.088 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.088 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.088 INFO:tasks.workunit.client.0.smithi033.stdout:373/600: open fd = 3 2024-08-28T19:43:24.088 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.088 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.088 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:24.088 INFO:tasks.workunit.client.0.smithi033.stdout:374/600: open fd = 3 2024-08-28T19:43:24.088 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.088 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:43:24.088 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:43:25.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:25 smithi033 ceph-mon[18549]: pgmap v681: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-08-28T19:43:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:25 smithi059 ceph-mon[22052]: pgmap v681: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-08-28T19:43:26.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:25 smithi122 ceph-mon[22174]: pgmap v681: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-08-28T19:43:27.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:27 smithi033 ceph-mon[18549]: pgmap v682: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-08-28T19:43:28.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:27 smithi059 ceph-mon[22052]: pgmap v682: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-08-28T19:43:28.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:27 smithi122 ceph-mon[22174]: pgmap v682: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-08-28T19:43:29.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:29 smithi033 ceph-mon[18549]: pgmap v683: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-08-28T19:43:30.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:29 smithi059 ceph-mon[22052]: pgmap v683: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-08-28T19:43:30.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:29 smithi122 ceph-mon[22174]: pgmap v683: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-08-28T19:43:31.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:31 smithi033 ceph-mon[18549]: pgmap v684: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-08-28T19:43:32.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:31 smithi059 ceph-mon[22052]: pgmap v684: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-08-28T19:43:32.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:31 smithi122 ceph-mon[22174]: pgmap v684: 129 pgs: 129 active+clean; 15 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-08-28T19:43:33.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:33 smithi033 ceph-mon[18549]: pgmap v685: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-08-28T19:43:34.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:33 smithi059 ceph-mon[22052]: pgmap v685: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-08-28T19:43:34.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:33 smithi122 ceph-mon[22174]: pgmap v685: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-08-28T19:43:35.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:35 smithi033 ceph-mon[18549]: pgmap v686: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 71 KiB/s wr, 18 op/s 2024-08-28T19:43:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:35 smithi059 ceph-mon[22052]: pgmap v686: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 71 KiB/s wr, 18 op/s 2024-08-28T19:43:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:35 smithi122 ceph-mon[22174]: pgmap v686: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 71 KiB/s wr, 18 op/s 2024-08-28T19:43:37.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:37 smithi033 ceph-mon[18549]: pgmap v687: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-08-28T19:43:38.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:37 smithi059 ceph-mon[22052]: pgmap v687: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-08-28T19:43:38.334 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:37 smithi122 ceph-mon[22174]: pgmap v687: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-08-28T19:43:39.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:39 smithi033 ceph-mon[18549]: pgmap v688: 129 pgs: 129 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 17 op/s 2024-08-28T19:43:40.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:39 smithi059 ceph-mon[22052]: pgmap v688: 129 pgs: 129 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 17 op/s 2024-08-28T19:43:40.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:39 smithi122 ceph-mon[22174]: pgmap v688: 129 pgs: 129 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 17 op/s 2024-08-28T19:43:41.107 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:43:41.377 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:41.790 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:41 smithi033 ceph-mon[18549]: pgmap v689: 129 pgs: 129 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-08-28T19:43:42.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.958+0000 7f1a9c41b640 1 -- 172.21.15.33:0/3721559651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a94109b90 msgr2=0x7f1a941103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.958+0000 7f1a9c41b640 1 --2- 172.21.15.33:0/3721559651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a94109b90 0x7f1a941103c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009ca0 tx=0x7f1a8c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.958+0000 7f1a9c41b640 1 -- 172.21.15.33:0/3721559651 shutdown_connections 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.958+0000 7f1a9c41b640 1 --2- 172.21.15.33:0/3721559651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a94109b90 0x7f1a941103c0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.958+0000 7f1a9c41b640 1 --2- 172.21.15.33:0/3721559651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94109240 0x7f1a94109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.958+0000 7f1a9c41b640 1 --2- 172.21.15.33:0/3721559651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a94103900 0x7f1a94103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.958+0000 7f1a9c41b640 1 -- 172.21.15.33:0/3721559651 >> 172.21.15.33:0/3721559651 conn(0x7f1a9407b5f0 msgr2=0x7f1a9407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.958+0000 7f1a9c41b640 1 -- 172.21.15.33:0/3721559651 shutdown_connections 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.958+0000 7f1a9c41b640 1 -- 172.21.15.33:0/3721559651 wait complete. 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a9c41b640 1 Processor -- start 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a9c41b640 1 -- start start 2024-08-28T19:43:42.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a9c41b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94103900 0x7f1a9419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a9c41b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a94109240 0x7f1a9419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a9c41b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a94109b90 0x7f1a9419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a9c41b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1a94113850 con 0x7f1a94109240 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a9c41b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941136d0 con 0x7f1a94109b90 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a9c41b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941139d0 con 0x7f1a94103900 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a999b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a94109240 0x7f1a9419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a999b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a94109240 0x7f1a9419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32966/0 (socket says 172.21.15.33:32966) 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a999b6640 1 -- 172.21.15.33:0/1777709693 learned_addr learned my addr 172.21.15.33:0/1777709693 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.959+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94103900 0x7f1a9419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a9a9b8640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a94109b90 0x7f1a9419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a999b6640 1 -- 172.21.15.33:0/1777709693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94103900 msgr2=0x7f1a9419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94103900 0x7f1a9419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a999b6640 1 -- 172.21.15.33:0/1777709693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a94109b90 msgr2=0x7f1a9419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a94109b90 0x7f1a9419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a999b6640 1 -- 172.21.15.33:0/1777709693 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a941a0170 con 0x7f1a94109240 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a9a9b8640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a94109b90 0x7f1a9419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a94109240 0x7f1a9419a7a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400d750 tx=0x7f1a8400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a8b7fe640 1 -- 172.21.15.33:0/1777709693 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84017070 con 0x7f1a94109240 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a8b7fe640 1 -- 172.21.15.33:0/1777709693 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a840054d0 con 0x7f1a94109240 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a9c41b640 1 -- 172.21.15.33:0/1777709693 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a941a0460 con 0x7f1a94109240 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a8b7fe640 1 -- 172.21.15.33:0/1777709693 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84004c30 con 0x7f1a94109240 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.960+0000 7f1a9c41b640 1 -- 172.21.15.33:0/1777709693 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a941a6bc0 con 0x7f1a94109240 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1aa2990740 1 Processor -- start 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1a8b7fe640 1 -- 172.21.15.33:0/1777709693 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1a84004dd0 con 0x7f1a94109240 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1aa2990740 1 -- start start 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f8262c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 0x564c2f826800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f826d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1aa2990740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564c2f79d630 con 0x564c2f460390 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1aa2990740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564c2f78cbc0 con 0x564c2f4581b0 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1aa2990740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564c2f790b70 con 0x564c2f481070 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1a999b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f826d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.963+0000 7f1a999b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f826d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32972/0 (socket says 172.21.15.33:32972) 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a999b6640 1 -- 172.21.15.33:0/3468413694 learned_addr learned my addr 172.21.15.33:0/3468413694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/3468413694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 0x564c2f826800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a9a9b8640 1 --2- 172.21.15.33:0/3468413694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f8262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a8b7fe640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1a800b4ca0 0x7f1a800b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a999b6640 1 -- 172.21.15.33:0/3468413694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 msgr2=0x564c2f8262c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a999b6640 1 --2- 172.21.15.33:0/3468413694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f8262c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a999b6640 1 -- 172.21.15.33:0/3468413694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 msgr2=0x564c2f826800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a999b6640 1 --2- 172.21.15.33:0/3468413694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 0x564c2f826800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a999b6640 1 -- 172.21.15.33:0/3468413694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2f4ec650 con 0x564c2f460390 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/3468413694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 0x564c2f826800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a9a9b8640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1a800b4ca0 0x7f1a800b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a8b7fe640 1 -- 172.21.15.33:0/1777709693 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f1a840e5310 con 0x7f1a94109240 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a999b6640 1 --2- 172.21.15.33:0/3468413694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f826d40 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f1a840e2630 tx=0x7f1a840db860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213a1493d3521284 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a88d9a640 1 -- 172.21.15.33:0/3468413694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84020070 con 0x564c2f460390 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a9a9b8640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1a800b4ca0 0x7f1a800b71b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c02f500 tx=0x7f1a8c0095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.964+0000 7f1a88d9a640 1 -- 172.21.15.33:0/3468413694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a840ab170 con 0x564c2f460390 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.965+0000 7f1a88d9a640 1 -- 172.21.15.33:0/3468413694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840aadd0 con 0x564c2f460390 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.965+0000 7f1aa2990740 1 -- 172.21.15.33:0/3468413694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 msgr2=0x564c2f826d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:42.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.965+0000 7f1aa2990740 1 --2- 172.21.15.33:0/3468413694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f826d40 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f1a840e2630 tx=0x7f1a840db860 comp rx=0 tx=0).stop 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.965+0000 7f1aa2990740 1 -- 172.21.15.33:0/3468413694 shutdown_connections 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.965+0000 7f1aa2990740 1 --2- 172.21.15.33:0/3468413694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f826d40 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.965+0000 7f1aa2990740 1 --2- 172.21.15.33:0/3468413694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 0x564c2f826800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.965+0000 7f1aa2990740 1 --2- 172.21.15.33:0/3468413694 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f8262c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.965+0000 7f1aa2990740 1 -- 172.21.15.33:0/3468413694 >> 172.21.15.33:0/3468413694 conn(0x564c2f475460 msgr2=0x564c2f8241b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 1 -- 172.21.15.33:0/3468413694 shutdown_connections 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 1 -- 172.21.15.33:0/3468413694 wait complete. 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 1 -- start start 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 1 Processor -- start 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 0x564c2f831a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f831f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f83dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564c2f5ef700 con 0x564c2f460390 2024-08-28T19:43:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564c2f713700 con 0x564c2f4581b0 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564c2f8349e0 con 0x564c2f481070 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1aa2990740 10 client.0 _ll_register_callbacks cb 0x564c2f742dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1a999b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f831f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1a999b6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f831f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32988/0 (socket says 172.21.15.33:32988) 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.966+0000 7f1a999b6640 1 -- 172.21.15.33:0/1536938613 learned_addr learned my addr 172.21.15.33:0/1536938613 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 0x564c2f831a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a9a9b8640 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f83dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a999b6640 1 -- 172.21.15.33:0/1536938613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 msgr2=0x564c2f83dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f83dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a999b6640 1 -- 172.21.15.33:0/1536938613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 msgr2=0x564c2f831a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 0x564c2f831a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a999b6640 1 -- 172.21.15.33:0/1536938613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2f74c8b0 con 0x564c2f460390 2024-08-28T19:43:42.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f831f40 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f1a840e2770 tx=0x7f1a840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba805051924b91e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1536938613 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84020040 con 0x564c2f460390 2024-08-28T19:43:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1536938613 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f1a840e1800 con 0x564c2f460390 2024-08-28T19:43:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1aa2990740 1 -- 172.21.15.33:0/1536938613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a840ab170 con 0x564c2f460390 2024-08-28T19:43:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1536938613 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a840b3490 con 0x564c2f460390 2024-08-28T19:43:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1aa2990740 10 client.18681 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1aa2990740 1 -- 172.21.15.33:0/1536938613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564c2f8407a0 con 0x564c2f460390 2024-08-28T19:43:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.967+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1536938613 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a840ab170 con 0x564c2f460390 2024-08-28T19:43:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.968+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1536938613 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1a840bf020 con 0x564c2f460390 2024-08-28T19:43:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.968+0000 7f1aa2990740 10 client.18681 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.968+0000 7f1aa2990740 10 client.18681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.968+0000 7f1aa2990740 20 client.18681 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.968+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c2f43f9f0 0x564c2f843b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.968+0000 7f1aa2990740 4 client.18681 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.968+0000 7f1aa2990740 1 -- 172.21.15.33:0/1536938613 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c2f79f580 con 0x564c2f43f9f0 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.968+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c2f43f9f0 0x564c2f843b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.968+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c2f43f9f0 0x564c2f843b00 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd88c79567ae9508 server_cookie=e09b70ef77bcaa9c in_seq=0 out_seq=0 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.968+0000 7f1a7dffb640 10 client.18681 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1536938613 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c2f79f580 con 0x564c2f43f9f0 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1a7dffb640 10 client.18681 handle_command_reply: tid=0 2024-08-28T19:43:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 client.18681 shutdown 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 -- 172.21.15.33:0/1536938613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 msgr2=0x564c2f831f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f831f40 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f1a840e2770 tx=0x7f1a840046c0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 -- 172.21.15.33:0/1536938613 shutdown_connections 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f83dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c2f43f9f0 0x564c2f843b00 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f460390 0x564c2f831f40 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1536938613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f4581b0 0x564c2f831a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1a7dffb640 0 client.18681 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 -- 172.21.15.33:0/1536938613 >> 172.21.15.33:0/1536938613 conn(0x564c2f475460 msgr2=0x564c2f827cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 -- 172.21.15.33:0/1536938613 shutdown_connections 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.969+0000 7f1aa2990740 1 -- 172.21.15.33:0/1536938613 wait complete. 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.970+0000 7f1aa2990740 20 client.18681 trim_cache size 0 max 16384 2024-08-28T19:43:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1aa2990740 1 Processor -- start 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1aa2990740 1 -- start start 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f82b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 0x564c2f8335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f83dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1aa2990740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941b0c40 con 0x564c2f4581b0 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1aa2990740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941b2780 con 0x564c2f460390 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1aa2990740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941b1310 con 0x564c2f481070 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1a9a1b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f82b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1a9a1b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f82b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32990/0 (socket says 172.21.15.33:32990) 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.987+0000 7f1a9a1b7640 1 -- 172.21.15.33:0/1150563016 learned_addr learned my addr 172.21.15.33:0/1150563016 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 0x564c2f8335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a9a9b8640 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f83dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a9a1b7640 1 -- 172.21.15.33:0/1150563016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 msgr2=0x564c2f83dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f83dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a9a1b7640 1 -- 172.21.15.33:0/1150563016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 msgr2=0x564c2f8335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 0x564c2f8335c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a9a1b7640 1 -- 172.21.15.33:0/1150563016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2f8285b0 con 0x564c2f4581b0 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 0x564c2f8335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a9a9b8640 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f83dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f82b540 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005940 tx=0x7f1a900043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d756f12fbca2a8b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a7ffff640 1 -- 172.21.15.33:0/1150563016 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90003e20 con 0x564c2f4581b0 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a7ffff640 1 -- 172.21.15.33:0/1150563016 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a9001d8d0 con 0x564c2f4581b0 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.988+0000 7f1a7ffff640 1 -- 172.21.15.33:0/1150563016 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90024950 con 0x564c2f4581b0 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 -- 172.21.15.33:0/1150563016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 msgr2=0x564c2f82b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f82b540 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005940 tx=0x7f1a900043f0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 -- 172.21.15.33:0/1150563016 shutdown_connections 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f83dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 0x564c2f8335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1150563016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f82b540 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 -- 172.21.15.33:0/1150563016 >> 172.21.15.33:0/1150563016 conn(0x564c2f475460 msgr2=0x564c2f832eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 -- 172.21.15.33:0/1150563016 shutdown_connections 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 -- 172.21.15.33:0/1150563016 wait complete. 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 -- start start 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.989+0000 7f1aa2990740 1 Processor -- start 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f8431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 0x564c2f843730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1aa2990740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f8ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1aa2990740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941b20b0 con 0x564c2f4581b0 2024-08-28T19:43:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1aa2990740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941b19e0 con 0x564c2f460390 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1aa2990740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1a941aec40 con 0x564c2f481070 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a9a1b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f8431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1aa2990740 10 client.0 _ll_register_callbacks cb 0x7f1a840a7cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a9a1b7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f8431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32992/0 (socket says 172.21.15.33:32992) 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a9a1b7640 1 -- 172.21.15.33:0/1834629542 learned_addr learned my addr 172.21.15.33:0/1834629542 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a9a9b8640 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f8ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a9a1b7640 1 -- 172.21.15.33:0/1834629542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 msgr2=0x564c2f8ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f8ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a9a1b7640 1 -- 172.21.15.33:0/1834629542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 msgr2=0x564c2f843730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 0x564c2f843730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 0x564c2f843730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a9a1b7640 1 -- 172.21.15.33:0/1834629542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2f8ad7b0 con 0x564c2f4581b0 2024-08-28T19:43:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 0x564c2f843730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a9a1b7640 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f8431f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f1a90000c00 tx=0x7f1a9001dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbca7496223228f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1834629542 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9001d630 con 0x564c2f4581b0 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1834629542 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f1a90003c20 con 0x564c2f4581b0 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.990+0000 7f1aa2990740 1 -- 172.21.15.33:0/1834629542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a9001d8d0 con 0x564c2f4581b0 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1834629542 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a90003e20 con 0x564c2f4581b0 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1aa2990740 10 client.18687 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1aa2990740 1 -- 172.21.15.33:0/1834629542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564c2f8ae8d0 con 0x564c2f4581b0 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1834629542 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a9001d8d0 con 0x564c2f4581b0 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1834629542 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1a90024b10 con 0x564c2f4581b0 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1aa2990740 10 client.18687 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1aa2990740 10 client.18687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1aa2990740 20 client.18687 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c2f414da0 0x564c2f8b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1aa2990740 4 client.18687 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:43:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1aa2990740 1 -- 172.21.15.33:0/1834629542 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c2f79b020 con 0x564c2f414da0 2024-08-28T19:43:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.991+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c2f414da0 0x564c2f8b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1a999b6640 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c2f414da0 0x564c2f8b1050 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e824cb47eecf7cf server_cookie=3524752e0481231b in_seq=0 out_seq=0 2024-08-28T19:43:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1a7dffb640 10 client.18687 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:42.049 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:43:42.049 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:43:42.051 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:43:42.055 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.056 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.059 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:42.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:42.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:42.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:42.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:42.061 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:42.061 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:42.061 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:43:42.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1a7dffb640 1 -- 172.21.15.33:0/1834629542 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x564c2f79b020 con 0x564c2f414da0 2024-08-28T19:43:42.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1a7dffb640 10 client.18687 handle_command_reply: tid=0 2024-08-28T19:43:42.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 client.18687 shutdown 2024-08-28T19:43:42.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 -- 172.21.15.33:0/1834629542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 msgr2=0x564c2f8431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f8431f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f1a90000c00 tx=0x7f1a9001dbe0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 -- 172.21.15.33:0/1834629542 shutdown_connections 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564c2f481070 0x564c2f8ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564c2f460390 0x564c2f843730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564c2f414da0 0x564c2f8b1050 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 --2- 172.21.15.33:0/1834629542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564c2f4581b0 0x564c2f8431f0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 -- 172.21.15.33:0/1834629542 >> 172.21.15.33:0/1834629542 conn(0x564c2f475460 msgr2=0x564c2f8271a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1a7dffb640 0 client.18687 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 -- 172.21.15.33:0/1834629542 shutdown_connections 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 1 -- 172.21.15.33:0/1834629542 wait complete. 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.992+0000 7f1aa2990740 20 client.18687 trim_cache size 0 max 16384 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 -- 172.21.15.33:0/1777709693 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1a800b4ca0 msgr2=0x7f1a800b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:42.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1a800b4ca0 0x7f1a800b71b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c02f500 tx=0x7f1a8c0095c0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 -- 172.21.15.33:0/1777709693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a94109240 msgr2=0x7f1a9419a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a94109240 0x7f1a9419a7a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400d750 tx=0x7f1a8400dc10 comp rx=0 tx=0).stop 2024-08-28T19:43:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 -- 172.21.15.33:0/1777709693 shutdown_connections 2024-08-28T19:43:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a94109b90 0x7f1a9419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a94109240 0x7f1a9419a7a0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1a800b4ca0 0x7f1a800b71b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 --2- 172.21.15.33:0/1777709693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1a94103900 0x7f1a9419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 -- 172.21.15.33:0/1777709693 >> 172.21.15.33:0/1777709693 conn(0x7f1a9407b5f0 msgr2=0x7f1a94107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 -- 172.21.15.33:0/1777709693 shutdown_connections 2024-08-28T19:43:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:41.993+0000 7f1a9c41b640 1 -- 172.21.15.33:0/1777709693 wait complete. 2024-08-28T19:43:42.064 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:41 smithi122 ceph-mon[22174]: pgmap v689: 129 pgs: 129 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-08-28T19:43:42.064 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:41 smithi059 ceph-mon[22052]: pgmap v689: 129 pgs: 129 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-08-28T19:43:42.977 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:43:42.978 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:43:43.233 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 -- 172.21.15.33:0/1630959362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee8109b90 msgr2=0x7f2ee81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 --2- 172.21.15.33:0/1630959362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee8109b90 0x7f2ee81103c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009ca0 tx=0x7f2ee002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 -- 172.21.15.33:0/1630959362 shutdown_connections 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 --2- 172.21.15.33:0/1630959362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee8109b90 0x7f2ee81103c0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 --2- 172.21.15.33:0/1630959362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee8109240 0x7f2ee8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 --2- 172.21.15.33:0/1630959362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ee8103900 0x7f2ee8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 -- 172.21.15.33:0/1630959362 >> 172.21.15.33:0/1630959362 conn(0x7f2ee807b5f0 msgr2=0x7f2ee807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 -- 172.21.15.33:0/1630959362 shutdown_connections 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 -- 172.21.15.33:0/1630959362 wait complete. 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 Processor -- start 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.766+0000 7f2eeee07640 1 -- start start 2024-08-28T19:43:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eeee07640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee8103900 0x7f2ee819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eeee07640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ee8109240 0x7f2ee819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eeee07640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee8109b90 0x7f2ee819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eeee07640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee8113850 con 0x7f2ee8103900 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eeee07640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee81136d0 con 0x7f2ee8109b90 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eeee07640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee81139d0 con 0x7f2ee8109240 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eecba3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee8103900 0x7f2ee819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eecba3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee8103900 0x7f2ee819a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33006/0 (socket says 172.21.15.33:33006) 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eecba3640 1 -- 172.21.15.33:0/4126988082 learned_addr learned my addr 172.21.15.33:0/4126988082 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2ee7fff640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ee8109240 0x7f2ee819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eed3a4640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee8109b90 0x7f2ee819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eecba3640 1 -- 172.21.15.33:0/4126988082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ee8109240 msgr2=0x7f2ee819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eecba3640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ee8109240 0x7f2ee819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eecba3640 1 -- 172.21.15.33:0/4126988082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee8109b90 msgr2=0x7f2ee819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eecba3640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee8109b90 0x7f2ee819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eecba3640 1 -- 172.21.15.33:0/4126988082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee81a00d0 con 0x7f2ee8103900 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eed3a4640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee8109b90 0x7f2ee819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.767+0000 7f2eecba3640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee8103900 0x7f2ee819a220 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00d770 tx=0x7f2edc00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.768+0000 7f2ee5ffb640 1 -- 172.21.15.33:0/4126988082 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc017070 con 0x7f2ee8103900 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.768+0000 7f2ee5ffb640 1 -- 172.21.15.33:0/4126988082 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2edc009820 con 0x7f2ee8103900 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.768+0000 7f2eeee07640 1 -- 172.21.15.33:0/4126988082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee81a03c0 con 0x7f2ee8103900 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.768+0000 7f2ee5ffb640 1 -- 172.21.15.33:0/4126988082 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc004bc0 con 0x7f2ee8103900 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.768+0000 7f2eeee07640 1 -- 172.21.15.33:0/4126988082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee81a6be0 con 0x7f2ee8103900 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.769+0000 7f2eeee07640 1 -- 172.21.15.33:0/4126988082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee8104b80 con 0x7f2ee8103900 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.770+0000 7f2ee5ffb640 1 -- 172.21.15.33:0/4126988082 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2edc0099d0 con 0x7f2ee8103900 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.771+0000 7f2ee5ffb640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ed80b4cd0 0x7f2ed80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.771+0000 7f2ee7fff640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ed80b4cd0 0x7f2ed80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.771+0000 7f2ee5ffb640 1 -- 172.21.15.33:0/4126988082 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f2edc0e5860 con 0x7f2ee8103900 2024-08-28T19:43:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.772+0000 7f2ee7fff640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ed80b4cd0 0x7f2ed80b71e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8106ce0 tx=0x7f2ed400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:43.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.774+0000 7f2ee5ffb640 1 -- 172.21.15.33:0/4126988082 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2edc0ac250 con 0x7f2ee8103900 2024-08-28T19:43:43.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:43 smithi033 ceph-mon[18549]: pgmap v690: 129 pgs: 129 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 13 op/s 2024-08-28T19:43:44.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.998+0000 7f2eeee07640 1 -- 172.21.15.33:0/4126988082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ee8103d10 con 0x7f2ee8103900 2024-08-28T19:43:44.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:43.999+0000 7f2ee5ffb640 1 -- 172.21.15.33:0/4126988082 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f2edc0abb50 con 0x7f2ee8103900 2024-08-28T19:43:44.001 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:43:44.001 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:43:44.002 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:43:44.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.001+0000 7f2eeee07640 1 -- 172.21.15.33:0/4126988082 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ed80b4cd0 msgr2=0x7f2ed80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:44.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.001+0000 7f2eeee07640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ed80b4cd0 0x7f2ed80b71e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8106ce0 tx=0x7f2ed400a2d0 comp rx=0 tx=0).stop 2024-08-28T19:43:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.001+0000 7f2eeee07640 1 -- 172.21.15.33:0/4126988082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee8103900 msgr2=0x7f2ee819a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.001+0000 7f2eeee07640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee8103900 0x7f2ee819a220 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00d770 tx=0x7f2edc00db70 comp rx=0 tx=0).stop 2024-08-28T19:43:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.001+0000 7f2eeee07640 1 -- 172.21.15.33:0/4126988082 shutdown_connections 2024-08-28T19:43:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.001+0000 7f2eeee07640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee8109b90 0x7f2ee819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.001+0000 7f2eeee07640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2ed80b4cd0 0x7f2ed80b71e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.001+0000 7f2eeee07640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ee8109240 0x7f2ee819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.002+0000 7f2eeee07640 1 --2- 172.21.15.33:0/4126988082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee8103900 0x7f2ee819a220 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.002+0000 7f2eeee07640 1 -- 172.21.15.33:0/4126988082 >> 172.21.15.33:0/4126988082 conn(0x7f2ee807b5f0 msgr2=0x7f2ee8105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.002+0000 7f2eeee07640 1 -- 172.21.15.33:0/4126988082 shutdown_connections 2024-08-28T19:43:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:44.002+0000 7f2eeee07640 1 -- 172.21.15.33:0/4126988082 wait complete. 2024-08-28T19:43:44.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:43 smithi059 ceph-mon[22052]: pgmap v690: 129 pgs: 129 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 13 op/s 2024-08-28T19:43:44.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:43 smithi122 ceph-mon[22174]: pgmap v690: 129 pgs: 129 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 13 op/s 2024-08-28T19:43:44.766 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:43:45.022 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:45.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:44 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4126988082' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:43:45.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:44 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4126988082' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:43:45.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:44 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4126988082' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:43:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.528+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/2409855888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c4109280 msgr2=0x7fd1c4109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.528+0000 7fd1c9bb4640 1 --2- 172.21.15.33:0/2409855888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c4109280 0x7fd1c4109690 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac009900 tx=0x7fd1ac02a410 comp rx=0 tx=0).stop 2024-08-28T19:43:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.528+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/2409855888 shutdown_connections 2024-08-28T19:43:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.528+0000 7fd1c9bb4640 1 --2- 172.21.15.33:0/2409855888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c4109bd0 0x7fd1c4110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.528+0000 7fd1c9bb4640 1 --2- 172.21.15.33:0/2409855888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c4109280 0x7fd1c4109690 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.528+0000 7fd1c9bb4640 1 --2- 172.21.15.33:0/2409855888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1c4103940 0x7fd1c4103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.528+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/2409855888 >> 172.21.15.33:0/2409855888 conn(0x7fd1c40ff3d0 msgr2=0x7fd1c4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.528+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/2409855888 shutdown_connections 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.528+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/2409855888 wait complete. 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c9bb4640 1 Processor -- start 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c9bb4640 1 -- start start 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c9bb4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c4103940 0x7fd1c419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c9bb4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c4109280 0x7fd1c419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c9bb4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1c4109bd0 0x7fd1c419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c9bb4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c4113890 con 0x7fd1c4103940 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c9bb4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c4113710 con 0x7fd1c4109280 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c9bb4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c4113a10 con 0x7fd1c4109bd0 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c4103940 0x7fd1c419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c4103940 0x7fd1c419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33028/0 (socket says 172.21.15.33:33028) 2024-08-28T19:43:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c37fe640 1 -- 172.21.15.33:0/396484028 learned_addr learned my addr 172.21.15.33:0/396484028 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1baffd640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c4109280 0x7fd1c419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c3fff640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1c4109bd0 0x7fd1c419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c37fe640 1 -- 172.21.15.33:0/396484028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1c4109bd0 msgr2=0x7fd1c419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1c4109bd0 0x7fd1c419fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c37fe640 1 -- 172.21.15.33:0/396484028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c4109280 msgr2=0x7fd1c419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.529+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c4109280 0x7fd1c419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.530+0000 7fd1c37fe640 1 -- 172.21.15.33:0/396484028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c41a01f0 con 0x7fd1c4103940 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.530+0000 7fd1baffd640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c4109280 0x7fd1c419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.530+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c4103940 0x7fd1c419a280 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400d950 tx=0x7fd1b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.530+0000 7fd1c17fa640 1 -- 172.21.15.33:0/396484028 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4017030 con 0x7fd1c4103940 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.530+0000 7fd1c17fa640 1 -- 172.21.15.33:0/396484028 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1b4004020 con 0x7fd1c4103940 2024-08-28T19:43:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.530+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/396484028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c41a04e0 con 0x7fd1c4103940 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.530+0000 7fd1c17fa640 1 -- 172.21.15.33:0/396484028 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40047a0 con 0x7fd1c4103940 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.530+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/396484028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c41a6c40 con 0x7fd1c4103940 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.532+0000 7fd1d0129740 1 Processor -- start 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.532+0000 7fd1d0129740 1 -- start start 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1c17fa640 1 -- 172.21.15.33:0/396484028 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd1b4004940 con 0x7fd1c4103940 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2efd9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efd9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efd9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1d0129740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fb2ef50680 con 0x55fb2ec13390 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1d0129740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fb2ef3fc10 con 0x55fb2ec34070 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1d0129740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fb2ef43bc0 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1baffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efd9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1c37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efd9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1baffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efd9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33030/0 (socket says 172.21.15.33:33030) 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1baffd640 1 -- 172.21.15.33:0/1121300218 learned_addr learned my addr 172.21.15.33:0/1121300218 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1c3fff640 1 --2- 172.21.15.33:0/1121300218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2efd9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1baffd640 1 -- 172.21.15.33:0/1121300218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 msgr2=0x55fb2efd9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1baffd640 1 --2- 172.21.15.33:0/1121300218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efd9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1baffd640 1 -- 172.21.15.33:0/1121300218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 msgr2=0x55fb2efd9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1baffd640 1 --2- 172.21.15.33:0/1121300218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2efd9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.533+0000 7fd1baffd640 1 -- 172.21.15.33:0/1121300218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2ec9f650 con 0x55fb2ec13390 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.534+0000 7fd1baffd640 1 --2- 172.21.15.33:0/1121300218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efd9d90 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac031440 tx=0x7fd1ac032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106d87604befd5e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.534+0000 7fd1c17fa640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd1b00b4ca0 0x7fd1b00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.534+0000 7fd1b9ffb640 1 -- 172.21.15.33:0/1121300218 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac03f070 con 0x55fb2ec13390 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.534+0000 7fd1c3fff640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd1b00b4ca0 0x7fd1b00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.534+0000 7fd1b9ffb640 1 -- 172.21.15.33:0/1121300218 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1ac0316a0 con 0x55fb2ec13390 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.534+0000 7fd1b9ffb640 1 -- 172.21.15.33:0/1121300218 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac035070 con 0x55fb2ec13390 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.534+0000 7fd1c17fa640 1 -- 172.21.15.33:0/396484028 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fd1b40e54b0 con 0x7fd1c4103940 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.535+0000 7fd1d0129740 1 -- 172.21.15.33:0/1121300218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 msgr2=0x55fb2efd9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.535+0000 7fd1c3fff640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd1b00b4ca0 0x7fd1b00b71b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc005fd0 tx=0x7fd1bc009740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.535+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1121300218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efd9d90 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac031440 tx=0x7fd1ac032d00 comp rx=0 tx=0).stop 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.535+0000 7fd1d0129740 1 -- 172.21.15.33:0/1121300218 shutdown_connections 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.535+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1121300218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efd9d90 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.535+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1121300218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efd9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.535+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1121300218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2efd9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.535+0000 7fd1d0129740 1 -- 172.21.15.33:0/1121300218 >> 172.21.15.33:0/1121300218 conn(0x55fb2ec28460 msgr2=0x55fb2efd7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.536+0000 7fd1d0129740 1 -- 172.21.15.33:0/1121300218 shutdown_connections 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.536+0000 7fd1d0129740 1 -- 172.21.15.33:0/1121300218 wait complete. 2024-08-28T19:43:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.536+0000 7fd1d0129740 1 -- start start 2024-08-28T19:43:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.536+0000 7fd1d0129740 1 Processor -- start 2024-08-28T19:43:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efe4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efe4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec34070 0x55fb2eff0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1d0129740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fb2eda2700 con 0x55fb2ec13390 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1d0129740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fb2eec6750 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1d0129740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fb2efe7a90 con 0x55fb2ec34070 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1d0129740 10 client.0 _ll_register_callbacks cb 0x55fb2eef5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1baffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efe4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1baffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efe4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33044/0 (socket says 172.21.15.33:33044) 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1baffd640 1 -- 172.21.15.33:0/4283761254 learned_addr learned my addr 172.21.15.33:0/4283761254 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1c3fff640 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec34070 0x55fb2eff0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efe4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1baffd640 1 -- 172.21.15.33:0/4283761254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec34070 msgr2=0x55fb2eff0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1baffd640 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec34070 0x55fb2eff0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1baffd640 1 -- 172.21.15.33:0/4283761254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec0b1b0 msgr2=0x55fb2efe4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1baffd640 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efe4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1baffd640 1 -- 172.21.15.33:0/4283761254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2eeff900 con 0x55fb2ec13390 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1baffd640 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efe4fb0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac004620 tx=0x7fd1ac0314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b934967774ef36 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.537+0000 7fd1a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/4283761254 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac04a020 con 0x55fb2ec13390 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/4283761254 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fd1ac0035f0 con 0x55fb2ec13390 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1d0129740 1 -- 172.21.15.33:0/4283761254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1ac0316a0 con 0x55fb2ec13390 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/4283761254 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd1ac055050 con 0x55fb2ec13390 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1d0129740 10 client.18705 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1d0129740 1 -- 172.21.15.33:0/4283761254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fb2eff3840 con 0x55fb2ec13390 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/4283761254 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1ac0316a0 con 0x55fb2ec13390 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/4283761254 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd1ac03b700 con 0x55fb2ec13390 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1d0129740 10 client.18705 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1d0129740 10 client.18705 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1d0129740 20 client.18705 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1d0129740 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55fb2ebf29f0 0x55fb2eff6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1d0129740 4 client.18705 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.538+0000 7fd1d0129740 1 -- 172.21.15.33:0/4283761254 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb2ef525d0 con 0x55fb2ebf29f0 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.539+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55fb2ebf29f0 0x55fb2eff6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.539+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55fb2ebf29f0 0x55fb2eff6ba0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2d4240907c314cfe server_cookie=231e2ad616a48b2e in_seq=0 out_seq=0 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.539+0000 7fd1a2ffd640 10 client.18705 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/4283761254 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb2ef525d0 con 0x55fb2ebf29f0 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1a2ffd640 10 client.18705 handle_command_reply: tid=0 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1d0129740 1 client.18705 shutdown 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1d0129740 1 -- 172.21.15.33:0/4283761254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 msgr2=0x55fb2efe4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1d0129740 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efe4fb0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac004620 tx=0x7fd1ac0314a0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1d0129740 1 -- 172.21.15.33:0/4283761254 shutdown_connections 2024-08-28T19:43:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1d0129740 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55fb2ebf29f0 0x55fb2eff6ba0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1d0129740 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec34070 0x55fb2eff0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1d0129740 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2efe4fb0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1d0129740 1 --2- 172.21.15.33:0/4283761254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efe4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1d0129740 1 -- 172.21.15.33:0/4283761254 >> 172.21.15.33:0/4283761254 conn(0x55fb2ec28460 msgr2=0x55fb2efdc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1a2ffd640 0 client.18705 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:43:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.540+0000 7fd1d0129740 1 -- 172.21.15.33:0/4283761254 shutdown_connections 2024-08-28T19:43:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.541+0000 7fd1d0129740 1 -- 172.21.15.33:0/4283761254 wait complete. 2024-08-28T19:43:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.541+0000 7fd1d0129740 20 client.18705 trim_cache size 0 max 16384 2024-08-28T19:43:45.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1d0129740 1 Processor -- start 2024-08-28T19:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1d0129740 1 -- start start 2024-08-28T19:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efdcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2eff0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2efd6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1d0129740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c41b0c40 con 0x55fb2ec13390 2024-08-28T19:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1d0129740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c41b2780 con 0x55fb2ec34070 2024-08-28T19:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1d0129740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c41b1310 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1baffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2eff0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1baffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2eff0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33054/0 (socket says 172.21.15.33:33054) 2024-08-28T19:43:45.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1baffd640 1 -- 172.21.15.33:0/1101333303 learned_addr learned my addr 172.21.15.33:0/1101333303 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efdcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1c3fff640 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2efd6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1baffd640 1 -- 172.21.15.33:0/1101333303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 msgr2=0x55fb2efdcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1baffd640 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efdcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1baffd640 1 -- 172.21.15.33:0/1101333303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 msgr2=0x55fb2efd6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1baffd640 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2efd6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1baffd640 1 -- 172.21.15.33:0/1101333303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2ebf2c20 con 0x55fb2ec13390 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efdcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.554+0000 7fd1c3fff640 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2efd6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.555+0000 7fd1baffd640 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2eff0cf0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac02a930 tx=0x7fd1ac032ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9d1adab42896ce server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.555+0000 7fd1b97fa640 1 -- 172.21.15.33:0/1101333303 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac04a070 con 0x55fb2ec13390 2024-08-28T19:43:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.555+0000 7fd1b97fa640 1 -- 172.21.15.33:0/1101333303 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1ac005490 con 0x55fb2ec13390 2024-08-28T19:43:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.555+0000 7fd1b97fa640 1 -- 172.21.15.33:0/1101333303 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac03f070 con 0x55fb2ec13390 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.555+0000 7fd1d0129740 1 -- 172.21.15.33:0/1101333303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 msgr2=0x55fb2eff0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.556+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2eff0cf0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac02a930 tx=0x7fd1ac032ab0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.556+0000 7fd1d0129740 1 -- 172.21.15.33:0/1101333303 shutdown_connections 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.556+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2efd6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.556+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec13390 0x55fb2eff0cf0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.556+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1101333303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec0b1b0 0x55fb2efdcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.556+0000 7fd1d0129740 1 -- 172.21.15.33:0/1101333303 >> 172.21.15.33:0/1101333303 conn(0x55fb2ec28460 msgr2=0x55fb2efdc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.556+0000 7fd1d0129740 1 -- 172.21.15.33:0/1101333303 shutdown_connections 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.556+0000 7fd1d0129740 1 -- 172.21.15.33:0/1101333303 wait complete. 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.556+0000 7fd1d0129740 1 -- start start 2024-08-28T19:43:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.556+0000 7fd1d0129740 1 Processor -- start 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec0b1b0 0x55fb2eff7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec13390 0x55fb2eff8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1d0129740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2eff8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1d0129740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c41b20b0 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1d0129740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c41b19e0 con 0x55fb2ec34070 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1d0129740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c41aec40 con 0x55fb2ec13390 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1d0129740 10 client.0 _ll_register_callbacks cb 0x7fd1bc0095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec0b1b0 0x55fb2eff7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec0b1b0 0x55fb2eff7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33066/0 (socket says 172.21.15.33:33066) 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1c37fe640 1 -- 172.21.15.33:0/1554355595 learned_addr learned my addr 172.21.15.33:0/1554355595 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1baffd640 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec13390 0x55fb2eff8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1c3fff640 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2eff8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1c37fe640 1 -- 172.21.15.33:0/1554355595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec13390 msgr2=0x55fb2eff8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec13390 0x55fb2eff8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1c37fe640 1 -- 172.21.15.33:0/1554355595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 msgr2=0x55fb2eff8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2eff8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1c37fe640 1 -- 172.21.15.33:0/1554355595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2f060350 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1c37fe640 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec0b1b0 0x55fb2eff7be0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40e2e60 tx=0x7fd1b40eb060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ac089c3622fc0f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.557+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/1554355595 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40ab5d0 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/1554355595 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fd1b40a7a90 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1d0129740 1 -- 172.21.15.33:0/1554355595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1ac005490 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/1554355595 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd1b40aaf70 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1d0129740 10 client.18711 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1d0129740 1 -- 172.21.15.33:0/1554355595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fb2f0658a0 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/1554355595 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1ac005490 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/1554355595 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd1b40e5170 con 0x55fb2ec0b1b0 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1d0129740 10 client.18711 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1d0129740 10 client.18711 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1d0129740 20 client.18711 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55fb2ebc7da0 0x55fb2f067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1d0129740 4 client.18711 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1d0129740 1 -- 172.21.15.33:0/1554355595 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb2ef4e070 con 0x55fb2ebc7da0 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.558+0000 7fd1baffd640 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55fb2ebc7da0 0x55fb2f067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1baffd640 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55fb2ebc7da0 0x55fb2f067fc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6a41fe69fc457de1 server_cookie=e394c8e6ebd3c1b4 in_seq=0 out_seq=0 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1a2ffd640 10 client.18711 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1a2ffd640 1 -- 172.21.15.33:0/1554355595 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb2ef4e070 con 0x55fb2ebc7da0 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1a2ffd640 10 client.18711 handle_command_reply: tid=0 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1d0129740 1 client.18711 shutdown 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1d0129740 1 -- 172.21.15.33:0/1554355595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec0b1b0 msgr2=0x55fb2eff7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec0b1b0 0x55fb2eff7be0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40e2e60 tx=0x7fd1b40eb060 comp rx=0 tx=0).stop 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1d0129740 1 -- 172.21.15.33:0/1554355595 shutdown_connections 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55fb2ebc7da0 0x55fb2f067fc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ec34070 0x55fb2eff8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1a2ffd640 0 client.18711 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fb2ec13390 0x55fb2eff8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1d0129740 1 --2- 172.21.15.33:0/1554355595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fb2ec0b1b0 0x55fb2eff7be0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1d0129740 1 -- 172.21.15.33:0/1554355595 >> 172.21.15.33:0/1554355595 conn(0x55fb2ec28460 msgr2=0x55fb2efd69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.559+0000 7fd1d0129740 1 -- 172.21.15.33:0/1554355595 shutdown_connections 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1d0129740 1 -- 172.21.15.33:0/1554355595 wait complete. 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1d0129740 20 client.18711 trim_cache size 0 max 16384 2024-08-28T19:43:45.567 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:43:45.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/396484028 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd1b00b4ca0 msgr2=0x7fd1b00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:45.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd1b00b4ca0 0x7fd1b00b71b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc005fd0 tx=0x7fd1bc009740 comp rx=0 tx=0).stop 2024-08-28T19:43:45.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/396484028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c4103940 msgr2=0x7fd1c419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:45.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c4103940 0x7fd1c419a280 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400d950 tx=0x7fd1b400de10 comp rx=0 tx=0).stop 2024-08-28T19:43:45.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/396484028 shutdown_connections 2024-08-28T19:43:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd1b00b4ca0 0x7fd1b00b71b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd1c4109bd0 0x7fd1c419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c4109280 0x7fd1c419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 --2- 172.21.15.33:0/396484028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1c4103940 0x7fd1c419a280 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/396484028 >> 172.21.15.33:0/396484028 conn(0x7fd1c40ff3d0 msgr2=0x7fd1c41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/396484028 shutdown_connections 2024-08-28T19:43:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:45.560+0000 7fd1c9bb4640 1 -- 172.21.15.33:0/396484028 wait complete. 2024-08-28T19:43:45.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:45 smithi033 ceph-mon[18549]: pgmap v691: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 75 KiB/s wr, 18 op/s 2024-08-28T19:43:46.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:45 smithi059 ceph-mon[22052]: pgmap v691: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 75 KiB/s wr, 18 op/s 2024-08-28T19:43:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:45 smithi122 ceph-mon[22174]: pgmap v691: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 75 KiB/s wr, 18 op/s 2024-08-28T19:43:46.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:43:46.673 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.221+0000 7f44d0122640 1 -- 172.21.15.33:0/1578919225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44c8108ab0 msgr2=0x7f44c810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.221+0000 7f44d0122640 1 --2- 172.21.15.33:0/1578919225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44c8108ab0 0x7f44c810f2e0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009ca0 tx=0x7f44c002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.221+0000 7f44d0122640 1 -- 172.21.15.33:0/1578919225 shutdown_connections 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.221+0000 7f44d0122640 1 --2- 172.21.15.33:0/1578919225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44c8108ab0 0x7f44c810f2e0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.221+0000 7f44d0122640 1 --2- 172.21.15.33:0/1578919225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44c8108160 0x7f44c8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.221+0000 7f44d0122640 1 --2- 172.21.15.33:0/1578919225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c8102820 0x7f44c8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.221+0000 7f44d0122640 1 -- 172.21.15.33:0/1578919225 >> 172.21.15.33:0/1578919225 conn(0x7f44c80794e0 msgr2=0x7f44c80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.221+0000 7f44d0122640 1 -- 172.21.15.33:0/1578919225 shutdown_connections 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.221+0000 7f44d0122640 1 -- 172.21.15.33:0/1578919225 wait complete. 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.222+0000 7f44d0122640 1 Processor -- start 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.222+0000 7f44d0122640 1 -- start start 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44d0122640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44c8102820 0x7f44c81990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44d0122640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44c8108160 0x7f44c8199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44d0122640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c8108ab0 0x7f44c819e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44d0122640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f44c8112730 con 0x7f44c8108160 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44d0122640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44c81125b0 con 0x7f44c8108ab0 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44d0122640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f44c81128b0 con 0x7f44c8102820 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44cd6bd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44c8108160 0x7f44c8199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44cd6bd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44c8108160 0x7f44c8199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33084/0 (socket says 172.21.15.33:33084) 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44cd6bd640 1 -- 172.21.15.33:0/841764906 learned_addr learned my addr 172.21.15.33:0/841764906 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44cdebe640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44c8102820 0x7f44c81990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c8108ab0 0x7f44c819e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44cd6bd640 1 -- 172.21.15.33:0/841764906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44c8102820 msgr2=0x7f44c81990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44c8102820 0x7f44c81990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44cd6bd640 1 -- 172.21.15.33:0/841764906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c8108ab0 msgr2=0x7f44c819e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c8108ab0 0x7f44c819e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44cd6bd640 1 -- 172.21.15.33:0/841764906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c819f050 con 0x7f44c8108160 2024-08-28T19:43:47.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c8108ab0 0x7f44c819e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44c8108160 0x7f44c8199680 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f44b800d740 tx=0x7f44b800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44beffd640 1 -- 172.21.15.33:0/841764906 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8017070 con 0x7f44c8108160 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44beffd640 1 -- 172.21.15.33:0/841764906 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44b800de50 con 0x7f44c8108160 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.223+0000 7f44d0122640 1 -- 172.21.15.33:0/841764906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c819f340 con 0x7f44c8108160 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.224+0000 7f44beffd640 1 -- 172.21.15.33:0/841764906 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8004ce0 con 0x7f44c8108160 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.224+0000 7f44d0122640 1 -- 172.21.15.33:0/841764906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c81a5aa0 con 0x7f44c8108160 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.226+0000 7f44d6697740 1 Processor -- start 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.226+0000 7f44beffd640 1 -- 172.21.15.33:0/841764906 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f44b8004e80 con 0x7f44c8108160 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.226+0000 7f44d6697740 1 -- start start 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44d6697740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783cff8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44d6697740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc2a1b0 0x55783cff8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44d6697740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc32390 0x55783cff8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44d6697740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55783cf6f680 con 0x55783cc53070 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44d6697740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55783cf5ec10 con 0x55783cc2a1b0 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44d6697740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55783cf62bc0 con 0x55783cc32390 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44ce6bf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783cff8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44ce6bf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783cff8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33094/0 (socket says 172.21.15.33:33094) 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44ce6bf640 1 -- 172.21.15.33:0/3759996221 learned_addr learned my addr 172.21.15.33:0/3759996221 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/3759996221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc32390 0x55783cff8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44cdebe640 1 --2- 172.21.15.33:0/3759996221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc2a1b0 0x55783cff8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44beffd640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f44b40b4ca0 0x7f44b40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44ce6bf640 1 -- 172.21.15.33:0/3759996221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc32390 msgr2=0x55783cff8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/3759996221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc32390 0x55783cff8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44ce6bf640 1 -- 172.21.15.33:0/3759996221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc2a1b0 msgr2=0x55783cff8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/3759996221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc2a1b0 0x55783cff8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44ce6bf640 1 -- 172.21.15.33:0/3759996221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783ccbe650 con 0x55783cc53070 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44beffd640 1 -- 172.21.15.33:0/841764906 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f44b80e5350 con 0x7f44c8108160 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.227+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f44b40b4ca0 0x7f44b40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.228+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/3759996221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783cff8350 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f44c0006010 tx=0x7f44c0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4675162dc8330085 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.228+0000 7f44b3fff640 1 -- 172.21.15.33:0/3759996221 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c004c070 con 0x55783cc53070 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.228+0000 7f44b3fff640 1 -- 172.21.15.33:0/3759996221 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44c0036070 con 0x55783cc53070 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.228+0000 7f44b3fff640 1 -- 172.21.15.33:0/3759996221 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c002f660 con 0x55783cc53070 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 -- 172.21.15.33:0/3759996221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 msgr2=0x55783cff8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f44b40b4ca0 0x7f44b40b71b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f44c0049000 tx=0x7f44c004a000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 --2- 172.21.15.33:0/3759996221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783cff8350 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f44c0006010 tx=0x7f44c0009880 comp rx=0 tx=0).stop 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 -- 172.21.15.33:0/3759996221 shutdown_connections 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 --2- 172.21.15.33:0/3759996221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc32390 0x55783cff8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 --2- 172.21.15.33:0/3759996221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc2a1b0 0x55783cff8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 --2- 172.21.15.33:0/3759996221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783cff8350 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 -- 172.21.15.33:0/3759996221 >> 172.21.15.33:0/3759996221 conn(0x55783cc47460 msgr2=0x55783cff6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 -- 172.21.15.33:0/3759996221 shutdown_connections 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 -- 172.21.15.33:0/3759996221 wait complete. 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 -- start start 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.229+0000 7f44d6697740 1 Processor -- start 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44d6697740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc2a1b0 0x55783d005cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44d6697740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 0x55783d006200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44d6697740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc53070 0x55783d011ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44d6697740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55783cdc1700 con 0x55783cc2a1b0 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44d6697740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55783cee5750 con 0x55783cc32390 2024-08-28T19:43:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44d6697740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55783d008c90 con 0x55783cc53070 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44d6697740 10 client.0 _ll_register_callbacks cb 0x55783cf14e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44cdebe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc2a1b0 0x55783d005cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44cdebe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc2a1b0 0x55783d005cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33096/0 (socket says 172.21.15.33:33096) 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44cdebe640 1 -- 172.21.15.33:0/2047729801 learned_addr learned my addr 172.21.15.33:0/2047729801 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 0x55783d006200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.230+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc53070 0x55783d011ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44cdebe640 1 -- 172.21.15.33:0/2047729801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc53070 msgr2=0x55783d011ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44cdebe640 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc53070 0x55783d011ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44cdebe640 1 -- 172.21.15.33:0/2047729801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 msgr2=0x55783d006200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44cdebe640 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 0x55783d006200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44cdebe640 1 -- 172.21.15.33:0/2047729801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55783cf1e900 con 0x55783cc2a1b0 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 0x55783d006200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:43:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44cdebe640 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc2a1b0 0x55783d005cc0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f44c400bfc0 tx=0x7f44c40128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d80670efc016f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44b17fa640 1 -- 172.21.15.33:0/2047729801 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c401f060 con 0x55783cc2a1b0 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44b17fa640 1 -- 172.21.15.33:0/2047729801 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f44c4010900 con 0x55783cc2a1b0 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44d6697740 1 -- 172.21.15.33:0/2047729801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44c0036070 con 0x55783cc2a1b0 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44b17fa640 1 -- 172.21.15.33:0/2047729801 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f44c4026050 con 0x55783cc2a1b0 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44d6697740 10 client.18723 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44d6697740 1 -- 172.21.15.33:0/2047729801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55783d014af0 con 0x55783cc2a1b0 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.231+0000 7f44b17fa640 1 -- 172.21.15.33:0/2047729801 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44c0036070 con 0x55783cc2a1b0 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.232+0000 7f44b17fa640 1 -- 172.21.15.33:0/2047729801 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f44c4019030 con 0x55783cc2a1b0 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.232+0000 7f44d6697740 10 client.18723 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.232+0000 7f44d6697740 10 client.18723 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.232+0000 7f44d6697740 20 client.18723 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.232+0000 7f44d6697740 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55783cc119f0 0x55783d018020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.232+0000 7f44d6697740 4 client.18723 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:47.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.232+0000 7f44d6697740 1 -- 172.21.15.33:0/2047729801 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55783cf715d0 con 0x55783cc119f0 2024-08-28T19:43:47.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.232+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55783cc119f0 0x55783d018020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.232+0000 7f44b17fa640 10 client.18723 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:43:47.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.232+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55783cc119f0 0x55783d018020 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e4ed79ffb218494 server_cookie=4003182316402b60 in_seq=0 out_seq=0 2024-08-28T19:43:47.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44b17fa640 1 -- 172.21.15.33:0/2047729801 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55783cf715d0 con 0x55783cc119f0 2024-08-28T19:43:47.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44b17fa640 10 client.18723 handle_command_reply: tid=0 2024-08-28T19:43:47.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44d6697740 1 client.18723 shutdown 2024-08-28T19:43:47.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44d6697740 1 -- 172.21.15.33:0/2047729801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc2a1b0 msgr2=0x55783d005cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:47.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44d6697740 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc2a1b0 0x55783d005cc0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f44c400bfc0 tx=0x7f44c40128e0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44d6697740 1 -- 172.21.15.33:0/2047729801 shutdown_connections 2024-08-28T19:43:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44d6697740 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55783cc119f0 0x55783d018020 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44d6697740 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc53070 0x55783d011ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44d6697740 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 0x55783d006200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44b17fa640 0 client.18723 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:43:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44d6697740 1 --2- 172.21.15.33:0/2047729801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc2a1b0 0x55783d005cc0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.233+0000 7f44d6697740 1 -- 172.21.15.33:0/2047729801 >> 172.21.15.33:0/2047729801 conn(0x55783cc47460 msgr2=0x55783cff4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.234+0000 7f44d6697740 1 -- 172.21.15.33:0/2047729801 shutdown_connections 2024-08-28T19:43:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.234+0000 7f44d6697740 1 -- 172.21.15.33:0/2047729801 wait complete. 2024-08-28T19:43:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.234+0000 7f44d6697740 20 client.18723 trim_cache size 0 max 16384 2024-08-28T19:43:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44d6697740 1 Processor -- start 2024-08-28T19:43:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44d6697740 1 -- start start 2024-08-28T19:43:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44d6697740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc2a1b0 0x55783cffdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44d6697740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 0x55783d002eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44d6697740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783d0033f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44d6697740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f44c81aea20 con 0x55783cc53070 2024-08-28T19:43:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44d6697740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44c81b0560 con 0x55783cc32390 2024-08-28T19:43:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44d6697740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f44c81af0f0 con 0x55783cc2a1b0 2024-08-28T19:43:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44ce6bf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783d0033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44ce6bf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783d0033f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33108/0 (socket says 172.21.15.33:33108) 2024-08-28T19:43:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44ce6bf640 1 -- 172.21.15.33:0/3262767132 learned_addr learned my addr 172.21.15.33:0/3262767132 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44cdebe640 1 --2- 172.21.15.33:0/3262767132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc2a1b0 0x55783cffdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44ce6bf640 1 -- 172.21.15.33:0/3262767132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc2a1b0 msgr2=0x55783cffdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/3262767132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc2a1b0 0x55783cffdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/3262767132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 0x55783d002eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.247+0000 7f44ce6bf640 1 -- 172.21.15.33:0/3262767132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 msgr2=0x55783d002eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.248+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/3262767132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 0x55783d002eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.248+0000 7f44ce6bf640 1 -- 172.21.15.33:0/3262767132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783d0041c0 con 0x55783cc53070 2024-08-28T19:43:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.248+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/3262767132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 0x55783d002eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.248+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/3262767132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783d0033f0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f44c00098f0 tx=0x7f44c0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364b2624263e2d65 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.248+0000 7f44b37fe640 1 -- 172.21.15.33:0/3262767132 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c004c040 con 0x55783cc53070 2024-08-28T19:43:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.248+0000 7f44b37fe640 1 -- 172.21.15.33:0/3262767132 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44c0036050 con 0x55783cc53070 2024-08-28T19:43:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.248+0000 7f44b37fe640 1 -- 172.21.15.33:0/3262767132 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c002fe90 con 0x55783cc53070 2024-08-28T19:43:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 -- 172.21.15.33:0/3262767132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 msgr2=0x55783d0033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 --2- 172.21.15.33:0/3262767132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783d0033f0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f44c00098f0 tx=0x7f44c0050000 comp rx=0 tx=0).stop 2024-08-28T19:43:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 -- 172.21.15.33:0/3262767132 shutdown_connections 2024-08-28T19:43:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 --2- 172.21.15.33:0/3262767132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc53070 0x55783d0033f0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 --2- 172.21.15.33:0/3262767132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc32390 0x55783d002eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 --2- 172.21.15.33:0/3262767132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc2a1b0 0x55783cffdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 -- 172.21.15.33:0/3262767132 >> 172.21.15.33:0/3262767132 conn(0x55783cc47460 msgr2=0x55783cffd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 -- 172.21.15.33:0/3262767132 shutdown_connections 2024-08-28T19:43:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 -- 172.21.15.33:0/3262767132 wait complete. 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 -- start start 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.249+0000 7f44d6697740 1 Processor -- start 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44d6697740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc2a1b0 0x55783cffe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44d6697740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc32390 0x55783cffed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44d6697740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc53070 0x55783d07d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44d6697740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f44c81afe90 con 0x55783cc32390 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44d6697740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44c81af7c0 con 0x55783cc53070 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44d6697740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f44c81aca20 con 0x55783cc2a1b0 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44d6697740 10 client.0 _ll_register_callbacks cb 0x7f44c400b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44cd6bd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc32390 0x55783cffed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44cd6bd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc32390 0x55783cffed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33118/0 (socket says 172.21.15.33:33118) 2024-08-28T19:43:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44cd6bd640 1 -- 172.21.15.33:0/1574078139 learned_addr learned my addr 172.21.15.33:0/1574078139 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:47.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44cdebe640 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc2a1b0 0x55783cffe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44ce6bf640 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc53070 0x55783d07d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44cd6bd640 1 -- 172.21.15.33:0/1574078139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc2a1b0 msgr2=0x55783cffe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:47.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc2a1b0 0x55783cffe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44cd6bd640 1 -- 172.21.15.33:0/1574078139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc53070 msgr2=0x55783d07d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:47.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc53070 0x55783d07d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44cd6bd640 1 -- 172.21.15.33:0/1574078139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55783d07e040 con 0x55783cc32390 2024-08-28T19:43:47.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44cd6bd640 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc32390 0x55783cffed40 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f44b80a7720 tx=0x7f44b80e5740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701c25b24f6ef857 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:47.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.250+0000 7f44b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44b17fa640 1 -- 172.21.15.33:0/1574078139 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8020040 con 0x55783cc32390 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44b17fa640 1 -- 172.21.15.33:0/1574078139 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f44b80a7c90 con 0x55783cc32390 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44d6697740 1 -- 172.21.15.33:0/1574078139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44c0036050 con 0x55783cc32390 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44b17fa640 1 -- 172.21.15.33:0/1574078139 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f44b80e51b0 con 0x55783cc32390 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44d6697740 10 client.18729 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44d6697740 1 -- 172.21.15.33:0/1574078139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55783d0853a0 con 0x55783cc32390 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44b17fa640 1 -- 172.21.15.33:0/1574078139 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44c0036050 con 0x55783cc32390 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44b17fa640 1 -- 172.21.15.33:0/1574078139 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f44b805b1a0 con 0x55783cc32390 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44d6697740 10 client.18729 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44d6697740 10 client.18729 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44d6697740 20 client.18729 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44d6697740 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55783cbe6da0 0x55783d087b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:47.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44d6697740 4 client.18729 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44d6697740 1 -- 172.21.15.33:0/1574078139 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55783cf6d070 con 0x55783cbe6da0 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.251+0000 7f44cdebe640 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55783cbe6da0 0x55783d087b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44b17fa640 10 client.18729 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44cdebe640 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55783cbe6da0 0x55783d087b40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1c3ea316379006a1 server_cookie=53bcd1e553fe7955 in_seq=0 out_seq=0 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44b17fa640 1 -- 172.21.15.33:0/1574078139 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55783cf6d070 con 0x55783cbe6da0 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44b17fa640 10 client.18729 handle_command_reply: tid=0 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 client.18729 shutdown 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 -- 172.21.15.33:0/1574078139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc32390 msgr2=0x55783cffed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc32390 0x55783cffed40 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f44b80a7720 tx=0x7f44b80e5740 comp rx=0 tx=0).stop 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 -- 172.21.15.33:0/1574078139 shutdown_connections 2024-08-28T19:43:47.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55783cbe6da0 0x55783d087b40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55783cc53070 0x55783d07d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55783cc32390 0x55783cffed40 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44b17fa640 0 client.18729 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:43:47.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 --2- 172.21.15.33:0/1574078139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55783cc2a1b0 0x55783cffe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 -- 172.21.15.33:0/1574078139 >> 172.21.15.33:0/1574078139 conn(0x55783cc47460 msgr2=0x55783cff9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:47.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 -- 172.21.15.33:0/1574078139 shutdown_connections 2024-08-28T19:43:47.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 1 -- 172.21.15.33:0/1574078139 wait complete. 2024-08-28T19:43:47.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.252+0000 7f44d6697740 20 client.18729 trim_cache size 0 max 16384 2024-08-28T19:43:47.262 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:43:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 -- 172.21.15.33:0/841764906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f44b40b4ca0 msgr2=0x7f44b40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f44b40b4ca0 0x7f44b40b71b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f44c0049000 tx=0x7f44c004a000 comp rx=0 tx=0).stop 2024-08-28T19:43:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 -- 172.21.15.33:0/841764906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44c8108160 msgr2=0x7f44c8199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44c8108160 0x7f44c8199680 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f44b800d740 tx=0x7f44b800dc00 comp rx=0 tx=0).stop 2024-08-28T19:43:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 -- 172.21.15.33:0/841764906 shutdown_connections 2024-08-28T19:43:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c8108ab0 0x7f44c819e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44c8108160 0x7f44c8199680 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f44b40b4ca0 0x7f44b40b71b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 --2- 172.21.15.33:0/841764906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f44c8102820 0x7f44c81990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:47.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 -- 172.21.15.33:0/841764906 >> 172.21.15.33:0/841764906 conn(0x7f44c80794e0 msgr2=0x7f44c8105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:47.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 -- 172.21.15.33:0/841764906 shutdown_connections 2024-08-28T19:43:47.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:47.253+0000 7f44d0122640 1 -- 172.21.15.33:0/841764906 wait complete. 2024-08-28T19:43:47.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:47 smithi033 ceph-mon[18549]: pgmap v692: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 13 op/s 2024-08-28T19:43:48.006 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:43:48.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:47 smithi059 ceph-mon[22052]: pgmap v692: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 13 op/s 2024-08-28T19:43:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:47 smithi122 ceph-mon[22174]: pgmap v692: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 13 op/s 2024-08-28T19:43:48.260 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:48.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.756+0000 7fc696938640 1 -- 172.21.15.33:0/1958123423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc690105100 msgr2=0x7fc69010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:48.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.756+0000 7fc696938640 1 --2- 172.21.15.33:0/1958123423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc690105100 0x7fc69010d650 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fc684009900 tx=0x7fc68402a410 comp rx=0 tx=0).stop 2024-08-28T19:43:48.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.757+0000 7fc696938640 1 -- 172.21.15.33:0/1958123423 shutdown_connections 2024-08-28T19:43:48.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.757+0000 7fc696938640 1 --2- 172.21.15.33:0/1958123423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc69010dbe0 0x7fc6901100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.757+0000 7fc696938640 1 --2- 172.21.15.33:0/1958123423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc690105100 0x7fc69010d650 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.757+0000 7fc696938640 1 --2- 172.21.15.33:0/1958123423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6901047b0 0x7fc690104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.757+0000 7fc696938640 1 -- 172.21.15.33:0/1958123423 >> 172.21.15.33:0/1958123423 conn(0x7fc6900794e0 msgr2=0x7fc6900798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.757+0000 7fc696938640 1 -- 172.21.15.33:0/1958123423 shutdown_connections 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.757+0000 7fc696938640 1 -- 172.21.15.33:0/1958123423 wait complete. 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.757+0000 7fc696938640 1 Processor -- start 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.757+0000 7fc696938640 1 -- start start 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc696938640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6901047b0 0x7fc69019c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc696938640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc690105100 0x7fc69019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc696938640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc69010dbe0 0x7fc6901a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc696938640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc690113880 con 0x7fc690105100 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc696938640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc690113700 con 0x7fc6901047b0 2024-08-28T19:43:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc696938640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc690113a00 con 0x7fc69010dbe0 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc68f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc690105100 0x7fc69019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc68f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc690105100 0x7fc69019ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35868/0 (socket says 172.21.15.33:35868) 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc68f7fe640 1 -- 172.21.15.33:0/858831125 learned_addr learned my addr 172.21.15.33:0/858831125 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc68ffff640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6901047b0 0x7fc69019c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc694ed5640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc69010dbe0 0x7fc6901a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc68f7fe640 1 -- 172.21.15.33:0/858831125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc69010dbe0 msgr2=0x7fc6901a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc69010dbe0 0x7fc6901a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc68f7fe640 1 -- 172.21.15.33:0/858831125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6901047b0 msgr2=0x7fc69019c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6901047b0 0x7fc69019c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc68f7fe640 1 -- 172.21.15.33:0/858831125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6901a2420 con 0x7fc690105100 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.758+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc690105100 0x7fc69019ca50 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fc68402a930 tx=0x7fc684004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.759+0000 7fc68d7fa640 1 -- 172.21.15.33:0/858831125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68403f030 con 0x7fc690105100 2024-08-28T19:43:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.759+0000 7fc696938640 1 -- 172.21.15.33:0/858831125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6901a26b0 con 0x7fc690105100 2024-08-28T19:43:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.759+0000 7fc68d7fa640 1 -- 172.21.15.33:0/858831125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc684003aa0 con 0x7fc690105100 2024-08-28T19:43:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.759+0000 7fc68d7fa640 1 -- 172.21.15.33:0/858831125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684035070 con 0x7fc690105100 2024-08-28T19:43:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.759+0000 7fc696938640 1 -- 172.21.15.33:0/858831125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6901a8e70 con 0x7fc690105100 2024-08-28T19:43:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.761+0000 7fc68d7fa640 1 -- 172.21.15.33:0/858831125 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc684042030 con 0x7fc690105100 2024-08-28T19:43:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.761+0000 7fc69cead740 1 Processor -- start 2024-08-28T19:43:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.761+0000 7fc69cead740 1 -- start start 2024-08-28T19:43:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.761+0000 7fc69cead740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c62070 0x55ae76007310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc69cead740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c391b0 0x55ae76007850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc69cead740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c41390 0x55ae76007d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc69cead740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ae75f7e680 con 0x55ae75c62070 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc69cead740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ae75f6dc10 con 0x55ae75c41390 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc69cead740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ae75f71bc0 con 0x55ae75c391b0 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc694ed5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c62070 0x55ae76007310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc694ed5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c62070 0x55ae76007310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35870/0 (socket says 172.21.15.33:35870) 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc694ed5640 1 -- 172.21.15.33:0/2916122673 learned_addr learned my addr 172.21.15.33:0/2916122673 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc68d7fa640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6780b4ca0 0x7fc6780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc68ffff640 1 --2- 172.21.15.33:0/2916122673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c391b0 0x55ae76007850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/2916122673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c41390 0x55ae76007d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc694ed5640 1 -- 172.21.15.33:0/2916122673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c391b0 msgr2=0x55ae76007850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc694ed5640 1 --2- 172.21.15.33:0/2916122673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c391b0 0x55ae76007850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc694ed5640 1 -- 172.21.15.33:0/2916122673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c41390 msgr2=0x55ae76007d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc694ed5640 1 --2- 172.21.15.33:0/2916122673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c41390 0x55ae76007d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc694ed5640 1 -- 172.21.15.33:0/2916122673 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae75ccd650 con 0x55ae75c62070 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/2916122673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c41390 0x55ae76007d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc68d7fa640 1 -- 172.21.15.33:0/858831125 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fc684106000 con 0x7fc690105100 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc694ed5640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6780b4ca0 0x7fc6780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.762+0000 7fc694ed5640 1 --2- 172.21.15.33:0/2916122673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c62070 0x55ae76007310 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c4a0 tx=0x7fc68800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3baf826010ae8b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.763+0000 7fc6767fc640 1 -- 172.21.15.33:0/2916122673 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688018640 con 0x55ae75c62070 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.763+0000 7fc6767fc640 1 -- 172.21.15.33:0/2916122673 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc68801e070 con 0x55ae75c62070 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.763+0000 7fc6767fc640 1 -- 172.21.15.33:0/2916122673 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68800a900 con 0x55ae75c62070 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.763+0000 7fc694ed5640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6780b4ca0 0x7fc6780b71b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc68801d000 tx=0x7fc688017000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.763+0000 7fc69cead740 1 -- 172.21.15.33:0/2916122673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c62070 msgr2=0x55ae76007310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.763+0000 7fc69cead740 1 --2- 172.21.15.33:0/2916122673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c62070 0x55ae76007310 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c4a0 tx=0x7fc68800c960 comp rx=0 tx=0).stop 2024-08-28T19:43:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.764+0000 7fc69cead740 1 -- 172.21.15.33:0/2916122673 shutdown_connections 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.764+0000 7fc69cead740 1 --2- 172.21.15.33:0/2916122673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c41390 0x55ae76007d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.764+0000 7fc69cead740 1 --2- 172.21.15.33:0/2916122673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c391b0 0x55ae76007850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.764+0000 7fc69cead740 1 --2- 172.21.15.33:0/2916122673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c62070 0x55ae76007310 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.764+0000 7fc69cead740 1 -- 172.21.15.33:0/2916122673 >> 172.21.15.33:0/2916122673 conn(0x55ae75c56460 msgr2=0x55ae76005200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.764+0000 7fc69cead740 1 -- 172.21.15.33:0/2916122673 shutdown_connections 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.764+0000 7fc69cead740 1 -- 172.21.15.33:0/2916122673 wait complete. 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.764+0000 7fc69cead740 1 -- start start 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.764+0000 7fc69cead740 1 Processor -- start 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.764+0000 7fc69cead740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae76012a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc69cead740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae76012fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc69cead740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c62070 0x55ae7601ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc69cead740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ae75dd0700 con 0x55ae75c41390 2024-08-28T19:43:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc69cead740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ae75ef4750 con 0x55ae75c391b0 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc69cead740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ae76015af0 con 0x55ae75c62070 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc69cead740 10 client.0 _ll_register_callbacks cb 0x55ae75f23e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc68f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae76012fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc68f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae76012fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35874/0 (socket says 172.21.15.33:35874) 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc68f7fe640 1 -- 172.21.15.33:0/722313220 learned_addr learned my addr 172.21.15.33:0/722313220 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc694ed5640 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c62070 0x55ae7601ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc68ffff640 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae76012a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc68f7fe640 1 -- 172.21.15.33:0/722313220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c62070 msgr2=0x55ae7601ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c62070 0x55ae7601ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc68f7fe640 1 -- 172.21.15.33:0/722313220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 msgr2=0x55ae76012a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae76012a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc68f7fe640 1 -- 172.21.15.33:0/722313220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae75f2d900 con 0x55ae75c41390 2024-08-28T19:43:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae76012fc0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fc684031440 tx=0x7fc6840963f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee94cbd91b73359 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc66f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc66f7fe640 1 -- 172.21.15.33:0/722313220 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684049040 con 0x55ae75c41390 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc66f7fe640 1 -- 172.21.15.33:0/722313220 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fc6840ef0d0 con 0x55ae75c41390 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.765+0000 7fc69cead740 1 -- 172.21.15.33:0/722313220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc68801e070 con 0x55ae75c41390 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc66f7fe640 1 -- 172.21.15.33:0/722313220 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc6840cbac0 con 0x55ae75c41390 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc69cead740 10 client.18741 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc69cead740 1 -- 172.21.15.33:0/722313220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae76021800 con 0x55ae75c41390 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc66f7fe640 1 -- 172.21.15.33:0/722313220 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc68801e070 con 0x55ae75c41390 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc66f7fe640 1 -- 172.21.15.33:0/722313220 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc684103630 con 0x55ae75c41390 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc69cead740 10 client.18741 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc69cead740 10 client.18741 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc69cead740 20 client.18741 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc69cead740 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55ae75c209f0 0x55ae76024c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc69cead740 4 client.18741 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc69cead740 1 -- 172.21.15.33:0/722313220 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae75f805d0 con 0x55ae75c209f0 2024-08-28T19:43:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.766+0000 7fc68ffff640 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55ae75c209f0 0x55ae76024c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.767+0000 7fc68ffff640 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55ae75c209f0 0x55ae76024c40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9b1ee6efa71dfc09 server_cookie=4d3edbe57eb3986 in_seq=0 out_seq=0 2024-08-28T19:43:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.767+0000 7fc66f7fe640 10 client.18741 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:43:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc66f7fe640 1 -- 172.21.15.33:0/722313220 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae75f805d0 con 0x55ae75c209f0 2024-08-28T19:43:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc66f7fe640 10 client.18741 handle_command_reply: tid=0 2024-08-28T19:43:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 client.18741 shutdown 2024-08-28T19:43:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 -- 172.21.15.33:0/722313220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 msgr2=0x55ae76012fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae76012fc0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fc684031440 tx=0x7fc6840963f0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 -- 172.21.15.33:0/722313220 shutdown_connections 2024-08-28T19:43:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c62070 0x55ae7601ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55ae75c209f0 0x55ae76024c40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae76012fc0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 --2- 172.21.15.33:0/722313220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae76012a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc66f7fe640 0 client.18741 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:43:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 -- 172.21.15.33:0/722313220 >> 172.21.15.33:0/722313220 conn(0x55ae75c56460 msgr2=0x55ae7600a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 -- 172.21.15.33:0/722313220 shutdown_connections 2024-08-28T19:43:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 1 -- 172.21.15.33:0/722313220 wait complete. 2024-08-28T19:43:48.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.768+0000 7fc69cead740 20 client.18741 trim_cache size 0 max 16384 2024-08-28T19:43:48.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.781+0000 7fc69cead740 1 Processor -- start 2024-08-28T19:43:48.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.781+0000 7fc69cead740 1 -- start start 2024-08-28T19:43:48.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc69cead740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c209f0 0x55ae76005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc69cead740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae7601ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc69cead740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae7600a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc69cead740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901b2f30 con 0x55ae75c41390 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc69cead740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901b4a70 con 0x55ae75c391b0 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc69cead740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901b3600 con 0x55ae75c209f0 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc694ed5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae7600a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc694ed5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae7600a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35880/0 (socket says 172.21.15.33:35880) 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc694ed5640 1 -- 172.21.15.33:0/1123958635 learned_addr learned my addr 172.21.15.33:0/1123958635 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/1123958635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae7601ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc68ffff640 1 --2- 172.21.15.33:0/1123958635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c209f0 0x55ae76005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc694ed5640 1 -- 172.21.15.33:0/1123958635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c209f0 msgr2=0x55ae76005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc694ed5640 1 --2- 172.21.15.33:0/1123958635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c209f0 0x55ae76005230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc694ed5640 1 -- 172.21.15.33:0/1123958635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 msgr2=0x55ae7601ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:48.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc694ed5640 1 --2- 172.21.15.33:0/1123958635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae7601ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc694ed5640 1 -- 172.21.15.33:0/1123958635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae76009830 con 0x55ae75c41390 2024-08-28T19:43:48.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc694ed5640 1 --2- 172.21.15.33:0/1123958635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae7600a410 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fc688009660 tx=0x7fc688010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57bcb3246c38d6a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:48.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc675ffb640 1 -- 172.21.15.33:0/1123958635 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68800a670 con 0x55ae75c41390 2024-08-28T19:43:48.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.782+0000 7fc675ffb640 1 -- 172.21.15.33:0/1123958635 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc68801e040 con 0x55ae75c41390 2024-08-28T19:43:48.786 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.783+0000 7fc675ffb640 1 -- 172.21.15.33:0/1123958635 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688018b50 con 0x55ae75c41390 2024-08-28T19:43:48.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.783+0000 7fc69cead740 1 -- 172.21.15.33:0/1123958635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 msgr2=0x55ae7600a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:48.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.783+0000 7fc69cead740 1 --2- 172.21.15.33:0/1123958635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae7600a410 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fc688009660 tx=0x7fc688010000 comp rx=0 tx=0).stop 2024-08-28T19:43:48.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.783+0000 7fc69cead740 1 -- 172.21.15.33:0/1123958635 shutdown_connections 2024-08-28T19:43:48.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.783+0000 7fc69cead740 1 --2- 172.21.15.33:0/1123958635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c41390 0x55ae7600a410 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.783+0000 7fc69cead740 1 --2- 172.21.15.33:0/1123958635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae7601ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.783+0000 7fc69cead740 1 --2- 172.21.15.33:0/1123958635 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c209f0 0x55ae76005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.783+0000 7fc69cead740 1 -- 172.21.15.33:0/1123958635 >> 172.21.15.33:0/1123958635 conn(0x55ae75c56460 msgr2=0x55ae76004b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.783+0000 7fc69cead740 1 -- 172.21.15.33:0/1123958635 shutdown_connections 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.783+0000 7fc69cead740 1 -- 172.21.15.33:0/1123958635 wait complete. 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc69cead740 1 -- start start 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc69cead740 1 Processor -- start 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc69cead740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c209f0 0x55ae76016e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc69cead740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae760173c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc69cead740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c41390 0x55ae76017900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc69cead740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901b43a0 con 0x55ae75c209f0 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc69cead740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901b3cd0 con 0x55ae75c391b0 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc69cead740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901b0f30 con 0x55ae75c41390 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc68ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c209f0 0x55ae76016e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc68ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c209f0 0x55ae76016e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35890/0 (socket says 172.21.15.33:35890) 2024-08-28T19:43:48.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc69cead740 10 client.0 _ll_register_callbacks cb 0x7fc684032a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.784+0000 7fc68ffff640 1 -- 172.21.15.33:0/4197450590 learned_addr learned my addr 172.21.15.33:0/4197450590 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc694ed5640 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c41390 0x55ae76017900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae760173c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc68ffff640 1 -- 172.21.15.33:0/4197450590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c41390 msgr2=0x55ae76017900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc68ffff640 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c41390 0x55ae76017900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc68ffff640 1 -- 172.21.15.33:0/4197450590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 msgr2=0x55ae760173c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc68ffff640 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae760173c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc68ffff640 1 -- 172.21.15.33:0/4197450590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae7608e730 con 0x55ae75c209f0 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc68ffff640 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c209f0 0x55ae76016e80 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fc680000c00 tx=0x7fc680011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7bda53d087d1db server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc66f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc66f7fe640 1 -- 172.21.15.33:0/4197450590 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680005050 con 0x55ae75c209f0 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc66f7fe640 1 -- 172.21.15.33:0/4197450590 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fc6800051f0 con 0x55ae75c209f0 2024-08-28T19:43:48.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc69cead740 1 -- 172.21.15.33:0/4197450590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc68801e040 con 0x55ae75c209f0 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc66f7fe640 1 -- 172.21.15.33:0/4197450590 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc68002c050 con 0x55ae75c209f0 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc69cead740 10 client.18747 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.785+0000 7fc69cead740 1 -- 172.21.15.33:0/4197450590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae7608fa40 con 0x55ae75c209f0 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.786+0000 7fc66f7fe640 1 -- 172.21.15.33:0/4197450590 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc68801e040 con 0x55ae75c209f0 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.786+0000 7fc66f7fe640 1 -- 172.21.15.33:0/4197450590 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc68001d740 con 0x55ae75c209f0 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.786+0000 7fc69cead740 10 client.18747 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.786+0000 7fc69cead740 10 client.18747 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.786+0000 7fc69cead740 20 client.18747 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.786+0000 7fc69cead740 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55ae75c62070 0x55ae76092280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.786+0000 7fc69cead740 4 client.18747 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.786+0000 7fc69cead740 1 -- 172.21.15.33:0/4197450590 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae75f7c070 con 0x55ae75c62070 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.786+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55ae75c62070 0x55ae76092280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:48.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc68f7fe640 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55ae75c62070 0x55ae76092280 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47ecb806ec9a1766 server_cookie=fca2e883e416976f in_seq=0 out_seq=0 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc66f7fe640 10 client.18747 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc66f7fe640 1 -- 172.21.15.33:0/4197450590 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae75f7c070 con 0x55ae75c62070 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc66f7fe640 10 client.18747 handle_command_reply: tid=0 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 client.18747 shutdown 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 -- 172.21.15.33:0/4197450590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c209f0 msgr2=0x55ae76016e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c209f0 0x55ae76016e80 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fc680000c00 tx=0x7fc680011810 comp rx=0 tx=0).stop 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 -- 172.21.15.33:0/4197450590 shutdown_connections 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ae75c41390 0x55ae76017900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae75c391b0 0x55ae760173c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55ae75c62070 0x55ae76092280 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 --2- 172.21.15.33:0/4197450590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ae75c209f0 0x55ae76016e80 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 -- 172.21.15.33:0/4197450590 >> 172.21.15.33:0/4197450590 conn(0x55ae75c56460 msgr2=0x55ae7600a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:48.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc66f7fe640 0 client.18747 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:43:48.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 -- 172.21.15.33:0/4197450590 shutdown_connections 2024-08-28T19:43:48.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 1 -- 172.21.15.33:0/4197450590 wait complete. 2024-08-28T19:43:48.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.787+0000 7fc69cead740 20 client.18747 trim_cache size 0 max 16384 2024-08-28T19:43:48.795 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 -- 172.21.15.33:0/858831125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6780b4ca0 msgr2=0x7fc6780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6780b4ca0 0x7fc6780b71b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc68801d000 tx=0x7fc688017000 comp rx=0 tx=0).stop 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 -- 172.21.15.33:0/858831125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc690105100 msgr2=0x7fc69019ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc690105100 0x7fc69019ca50 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fc68402a930 tx=0x7fc684004270 comp rx=0 tx=0).stop 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 -- 172.21.15.33:0/858831125 shutdown_connections 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc6780b4ca0 0x7fc6780b71b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc69010dbe0 0x7fc6901a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc690105100 0x7fc69019ca50 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 --2- 172.21.15.33:0/858831125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6901047b0 0x7fc69019c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 -- 172.21.15.33:0/858831125 >> 172.21.15.33:0/858831125 conn(0x7fc6900794e0 msgr2=0x7fc69010cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 -- 172.21.15.33:0/858831125 shutdown_connections 2024-08-28T19:43:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:48.788+0000 7fc696938640 1 -- 172.21.15.33:0/858831125 wait complete. 2024-08-28T19:43:49.580 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:43:49.840 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:49.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:49 smithi033 ceph-mon[18549]: pgmap v693: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 76 KiB/s wr, 17 op/s 2024-08-28T19:43:50.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:49 smithi059 ceph-mon[22052]: pgmap v693: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 76 KiB/s wr, 17 op/s 2024-08-28T19:43:50.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:49 smithi122 ceph-mon[22174]: pgmap v693: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 76 KiB/s wr, 17 op/s 2024-08-28T19:43:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.395+0000 7f2ce89c9640 1 -- 172.21.15.33:0/4182247179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce4109b90 msgr2=0x7f2ce41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.395+0000 7f2ce89c9640 1 --2- 172.21.15.33:0/4182247179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce4109b90 0x7f2ce41103c0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009900 tx=0x7f2cdc02a410 comp rx=0 tx=0).stop 2024-08-28T19:43:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.395+0000 7f2ce89c9640 1 -- 172.21.15.33:0/4182247179 shutdown_connections 2024-08-28T19:43:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.395+0000 7f2ce89c9640 1 --2- 172.21.15.33:0/4182247179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce4109b90 0x7f2ce41103c0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.395+0000 7f2ce89c9640 1 --2- 172.21.15.33:0/4182247179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce4109240 0x7f2ce4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.395+0000 7f2ce89c9640 1 --2- 172.21.15.33:0/4182247179 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4103900 0x7f2ce4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.395+0000 7f2ce89c9640 1 -- 172.21.15.33:0/4182247179 >> 172.21.15.33:0/4182247179 conn(0x7f2ce407b5f0 msgr2=0x7f2ce407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.395+0000 7f2ce89c9640 1 -- 172.21.15.33:0/4182247179 shutdown_connections 2024-08-28T19:43:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.395+0000 7f2ce89c9640 1 -- 172.21.15.33:0/4182247179 wait complete. 2024-08-28T19:43:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce89c9640 1 Processor -- start 2024-08-28T19:43:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce89c9640 1 -- start start 2024-08-28T19:43:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce89c9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce4103900 0x7f2ce40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce89c9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce4109240 0x7f2ce40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce89c9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4109b90 0x7f2ce4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce89c9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce4113850 con 0x7f2ce4103900 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce89c9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41136d0 con 0x7f2ce4109240 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce89c9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41139d0 con 0x7f2ce4109b90 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce4103900 0x7f2ce40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce4103900 0x7f2ce40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35916/0 (socket says 172.21.15.33:35916) 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce259c640 1 -- 172.21.15.33:0/1880992220 learned_addr learned my addr 172.21.15.33:0/1880992220 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.396+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce4109240 0x7f2ce40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2ce2d9d640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4109b90 0x7f2ce4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2ce259c640 1 -- 172.21.15.33:0/1880992220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4109b90 msgr2=0x7f2ce4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2ce259c640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4109b90 0x7f2ce4075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2ce259c640 1 -- 172.21.15.33:0/1880992220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce4109240 msgr2=0x7f2ce40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2ce259c640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce4109240 0x7f2ce40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2ce259c640 1 -- 172.21.15.33:0/1880992220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce41a84a0 con 0x7f2ce4103900 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce4109240 0x7f2ce40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2ce259c640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce4103900 0x7f2ce40754b0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400cce0 tx=0x7f2cd400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2cdb7fe640 1 -- 172.21.15.33:0/1880992220 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4004b20 con 0x7f2ce4103900 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2cdb7fe640 1 -- 172.21.15.33:0/1880992220 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cd4004cc0 con 0x7f2ce4103900 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2ce89c9640 1 -- 172.21.15.33:0/1880992220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce41a8790 con 0x7f2ce4103900 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2cdb7fe640 1 -- 172.21.15.33:0/1880992220 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd400f7c0 con 0x7f2ce4103900 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.397+0000 7f2ce89c9640 1 -- 172.21.15.33:0/1880992220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce41a8cd0 con 0x7f2ce4103900 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.400+0000 7f2ceef3e740 1 Processor -- start 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.400+0000 7f2cdb7fe640 1 -- 172.21.15.33:0/1880992220 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2cd4005560 con 0x7f2ce4103900 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.400+0000 7f2ceef3e740 1 -- start start 2024-08-28T19:43:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.400+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 0x556bcfb80310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.400+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb80850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.400+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 0x556bcfb80d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.400+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556bcfaf7680 con 0x556bcf7b21b0 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.400+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556bcfae6c10 con 0x556bcf7db070 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.400+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556bcfaeabc0 con 0x556bcf7ba390 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.400+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb80850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb80850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35918/0 (socket says 172.21.15.33:35918) 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce259c640 1 -- 172.21.15.33:0/917862304 learned_addr learned my addr 172.21.15.33:0/917862304 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce2d9d640 1 --2- 172.21.15.33:0/917862304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 0x556bcfb80310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/917862304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 0x556bcfb80d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce259c640 1 -- 172.21.15.33:0/917862304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 msgr2=0x556bcfb80d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2cdb7fe640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2cd00b4d20 0x7f2cd00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce259c640 1 --2- 172.21.15.33:0/917862304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 0x556bcfb80d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce259c640 1 -- 172.21.15.33:0/917862304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 msgr2=0x556bcfb80310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce259c640 1 --2- 172.21.15.33:0/917862304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 0x556bcfb80310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce259c640 1 -- 172.21.15.33:0/917862304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bcf846650 con 0x556bcf7b21b0 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce2d9d640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2cd00b4d20 0x7f2cd00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2cdb7fe640 1 -- 172.21.15.33:0/1880992220 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f2cd40e59f0 con 0x7f2ce4103900 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2ce259c640 1 --2- 172.21.15.33:0/917862304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb80850 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40e2d10 tx=0x7f2cd40bd8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3bcdf637afc1f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.401+0000 7f2cd8ff9640 1 -- 172.21.15.33:0/917862304 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd401d070 con 0x556bcf7b21b0 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.402+0000 7f2cd8ff9640 1 -- 172.21.15.33:0/917862304 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cd40ab850 con 0x556bcf7b21b0 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.402+0000 7f2cd8ff9640 1 -- 172.21.15.33:0/917862304 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40abb10 con 0x556bcf7b21b0 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.402+0000 7f2ceef3e740 1 -- 172.21.15.33:0/917862304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 msgr2=0x556bcfb80850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.402+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/917862304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb80850 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40e2d10 tx=0x7f2cd40bd8b0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.402+0000 7f2ce2d9d640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2cd00b4d20 0x7f2cd00b7230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc006010 tx=0x7f2cdc009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.402+0000 7f2ceef3e740 1 -- 172.21.15.33:0/917862304 shutdown_connections 2024-08-28T19:43:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.402+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/917862304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 0x556bcfb80d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.402+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/917862304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb80850 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.402+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/917862304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 0x556bcfb80310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.402+0000 7f2ceef3e740 1 -- 172.21.15.33:0/917862304 >> 172.21.15.33:0/917862304 conn(0x556bcf7cf460 msgr2=0x556bcfb7e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 1 -- 172.21.15.33:0/917862304 shutdown_connections 2024-08-28T19:43:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 1 -- 172.21.15.33:0/917862304 wait complete. 2024-08-28T19:43:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 1 -- start start 2024-08-28T19:43:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 1 Processor -- start 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb8ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 0x556bcfb8bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 0x556bcfb97e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556bcf949700 con 0x556bcf7b21b0 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556bcfa6d750 con 0x556bcf7db070 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556bcfb8eaf0 con 0x556bcf7ba390 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ceef3e740 10 client.0 _ll_register_callbacks cb 0x556bcfa9ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb8ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.403+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb8ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35922/0 (socket says 172.21.15.33:35922) 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce259c640 1 -- 172.21.15.33:0/786238927 learned_addr learned my addr 172.21.15.33:0/786238927 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce2d9d640 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 0x556bcfb97e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 0x556bcfb8bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce259c640 1 -- 172.21.15.33:0/786238927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 msgr2=0x556bcfb8bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce259c640 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 0x556bcfb8bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce259c640 1 -- 172.21.15.33:0/786238927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 msgr2=0x556bcfb97e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce259c640 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 0x556bcfb97e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce259c640 1 -- 172.21.15.33:0/786238927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bcfaa6900 con 0x556bcf7b21b0 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce2d9d640 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 0x556bcfb97e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 0x556bcfb8bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ce259c640 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb8ba90 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4005c40 tx=0x7f2cd400af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10f5f4d4c399bd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2cc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/786238927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd401d040 con 0x556bcf7b21b0 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/786238927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f2cd40ac1a0 con 0x556bcf7b21b0 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ceef3e740 1 -- 172.21.15.33:0/786238927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cd40ab850 con 0x556bcf7b21b0 2024-08-28T19:43:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/786238927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2cd40ab4b0 con 0x556bcf7b21b0 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ceef3e740 10 client.18759 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.404+0000 7f2ceef3e740 1 -- 172.21.15.33:0/786238927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556bcfb9a890 con 0x556bcf7b21b0 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/786238927 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cd40ab850 con 0x556bcf7b21b0 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/786238927 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2cd40b01f0 con 0x556bcf7b21b0 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2ceef3e740 10 client.18759 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2ceef3e740 10 client.18759 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2ceef3e740 20 client.18759 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556bcf7999f0 0x556bcfb9da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2ceef3e740 4 client.18759 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2ceef3e740 1 -- 172.21.15.33:0/786238927 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bcfaf95d0 con 0x556bcf7999f0 2024-08-28T19:43:50.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556bcf7999f0 0x556bcfb9da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2cc9ffb640 10 client.18759 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.405+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556bcf7999f0 0x556bcfb9da20 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=58bbb46e3398150f server_cookie=9803f6e1f87d6acd in_seq=0 out_seq=0 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/786238927 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556bcfaf95d0 con 0x556bcf7999f0 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2cc9ffb640 10 client.18759 handle_command_reply: tid=0 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2ceef3e740 1 client.18759 shutdown 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2ceef3e740 1 -- 172.21.15.33:0/786238927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 msgr2=0x556bcfb8ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb8ba90 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4005c40 tx=0x7f2cd400af30 comp rx=0 tx=0).stop 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2ceef3e740 1 -- 172.21.15.33:0/786238927 shutdown_connections 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556bcf7999f0 0x556bcfb9da20 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7db070 0x556bcfb97e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2cc9ffb640 0 client.18759 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:43:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7ba390 0x556bcfb8bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/786238927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb8ba90 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.406+0000 7f2ceef3e740 1 -- 172.21.15.33:0/786238927 >> 172.21.15.33:0/786238927 conn(0x556bcf7cf460 msgr2=0x556bcfb834a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.407+0000 7f2ceef3e740 1 -- 172.21.15.33:0/786238927 shutdown_connections 2024-08-28T19:43:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.407+0000 7f2ceef3e740 1 -- 172.21.15.33:0/786238927 wait complete. 2024-08-28T19:43:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.407+0000 7f2ceef3e740 20 client.18759 trim_cache size 0 max 16384 2024-08-28T19:43:50.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ceef3e740 1 Processor -- start 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ceef3e740 1 -- start start 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb81d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 0x556bcfb8d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7db070 0x556bcfb97d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41b2e70 con 0x556bcf7b21b0 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41b49b0 con 0x556bcf7ba390 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41b3540 con 0x556bcf7db070 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb81d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb81d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35932/0 (socket says 172.21.15.33:35932) 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ce259c640 1 -- 172.21.15.33:0/2533252681 learned_addr learned my addr 172.21.15.33:0/2533252681 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 0x556bcfb8d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.421+0000 7f2ce2d9d640 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7db070 0x556bcfb97d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ce259c640 1 -- 172.21.15.33:0/2533252681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7db070 msgr2=0x556bcfb97d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ce259c640 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7db070 0x556bcfb97d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ce259c640 1 -- 172.21.15.33:0/2533252681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 msgr2=0x556bcfb8d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ce259c640 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 0x556bcfb8d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ce259c640 1 -- 172.21.15.33:0/2533252681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bcfb82ba0 con 0x556bcf7b21b0 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ce2d9d640 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7db070 0x556bcfb97d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 0x556bcfb8d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ce259c640 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb81d00 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ccb0 tx=0x7f2cd40e5cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf2328677e3210 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ccbfff640 1 -- 172.21.15.33:0/2533252681 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd401d070 con 0x556bcf7b21b0 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ccbfff640 1 -- 172.21.15.33:0/2533252681 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cd40ab850 con 0x556bcf7b21b0 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.422+0000 7f2ccbfff640 1 -- 172.21.15.33:0/2533252681 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40ab690 con 0x556bcf7b21b0 2024-08-28T19:43:50.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2533252681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 msgr2=0x556bcfb81d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb81d00 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400ccb0 tx=0x7f2cd40e5cf0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2533252681 shutdown_connections 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7db070 0x556bcfb97d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 0x556bcfb8d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/2533252681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7b21b0 0x556bcfb81d00 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2533252681 >> 172.21.15.33:0/2533252681 conn(0x556bcf7cf460 msgr2=0x556bcfb8cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2533252681 shutdown_connections 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2533252681 wait complete. 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 -- start start 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.423+0000 7f2ceef3e740 1 Processor -- start 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7b21b0 0x556bcfbfc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 0x556bcfbfc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ceef3e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7db070 0x556bcfc071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41b42e0 con 0x556bcf7db070 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41b3c10 con 0x556bcf7ba390 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ceef3e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41b0e70 con 0x556bcf7b21b0 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ceef3e740 10 client.0 _ll_register_callbacks cb 0x7f2cdc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7db070 0x556bcfc071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7b21b0 0x556bcfbfc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce2d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7db070 0x556bcfc071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35948/0 (socket says 172.21.15.33:35948) 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce2d9d640 1 -- 172.21.15.33:0/2286210788 learned_addr learned my addr 172.21.15.33:0/2286210788 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 0x556bcfbfc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce259c640 1 -- 172.21.15.33:0/2286210788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 msgr2=0x556bcfbfc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce259c640 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 0x556bcfbfc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce259c640 1 -- 172.21.15.33:0/2286210788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7db070 msgr2=0x556bcfc071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce259c640 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7db070 0x556bcfc071b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce259c640 1 -- 172.21.15.33:0/2286210788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bcfc076f0 con 0x556bcf7b21b0 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.424+0000 7f2ce2d9d640 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7db070 0x556bcfc071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2ce259c640 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7b21b0 0x556bcfbfc130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40a7dc0 tx=0x7f2cd40e5d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e40be227802d51f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2cc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/2286210788 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd401d070 con 0x556bcf7b21b0 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2286210788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cd40ab850 con 0x556bcf7b21b0 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/2286210788 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f2cd40a7040 con 0x556bcf7b21b0 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/2286210788 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2cd40ab690 con 0x556bcf7b21b0 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2ceef3e740 10 client.27628 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2286210788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556bcfc076f0 con 0x556bcf7b21b0 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/2286210788 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cd40ab850 con 0x556bcf7b21b0 2024-08-28T19:43:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/2286210788 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2cd4091b30 con 0x556bcf7b21b0 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2ceef3e740 10 client.27628 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2ceef3e740 10 client.27628 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2ceef3e740 20 client.27628 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556bcf76eda0 0x556bcfc0ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2ceef3e740 4 client.27628 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.425+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2286210788 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556bcfaf5070 con 0x556bcf76eda0 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556bcf76eda0 0x556bcfc0ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2cc9ffb640 10 client.27628 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ce1d9b640 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556bcf76eda0 0x556bcfc0ab90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=581cbb8bac483b73 server_cookie=462a16a651c2cc8d in_seq=0 out_seq=0 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2cc9ffb640 1 -- 172.21.15.33:0/2286210788 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556bcfaf5070 con 0x556bcf76eda0 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2cc9ffb640 10 client.27628 handle_command_reply: tid=0 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ceef3e740 1 client.27628 shutdown 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2286210788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7b21b0 msgr2=0x556bcfbfc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7b21b0 0x556bcfbfc130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40a7dc0 tx=0x7f2cd40e5d60 comp rx=0 tx=0).stop 2024-08-28T19:43:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2286210788 shutdown_connections 2024-08-28T19:43:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556bcf76eda0 0x556bcfc0ab90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556bcf7db070 0x556bcfc071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556bcf7ba390 0x556bcfbfc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ceef3e740 1 --2- 172.21.15.33:0/2286210788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556bcf7b21b0 0x556bcfbfc130 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2cc9ffb640 0 client.27628 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:43:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.426+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2286210788 >> 172.21.15.33:0/2286210788 conn(0x556bcf7cf460 msgr2=0x556bcfb81ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2286210788 shutdown_connections 2024-08-28T19:43:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ceef3e740 1 -- 172.21.15.33:0/2286210788 wait complete. 2024-08-28T19:43:50.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ceef3e740 20 client.27628 trim_cache size 0 max 16384 2024-08-28T19:43:50.435 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:43:50.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 -- 172.21.15.33:0/1880992220 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2cd00b4d20 msgr2=0x7f2cd00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:50.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2cd00b4d20 0x7f2cd00b7230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc006010 tx=0x7f2cdc009260 comp rx=0 tx=0).stop 2024-08-28T19:43:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 -- 172.21.15.33:0/1880992220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce4103900 msgr2=0x7f2ce40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce4103900 0x7f2ce40754b0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400cce0 tx=0x7f2cd400a620 comp rx=0 tx=0).stop 2024-08-28T19:43:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 -- 172.21.15.33:0/1880992220 shutdown_connections 2024-08-28T19:43:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2cd00b4d20 0x7f2cd00b7230 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2ce4109b90 0x7f2ce4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce4109240 0x7f2ce40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 --2- 172.21.15.33:0/1880992220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce4103900 0x7f2ce40754b0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 -- 172.21.15.33:0/1880992220 >> 172.21.15.33:0/1880992220 conn(0x7f2ce407b5f0 msgr2=0x7f2ce4105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 -- 172.21.15.33:0/1880992220 shutdown_connections 2024-08-28T19:43:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:50.427+0000 7f2ce89c9640 1 -- 172.21.15.33:0/1880992220 wait complete. 2024-08-28T19:43:51.124 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:43:51.382 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:51.780 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:51 smithi033 ceph-mon[18549]: pgmap v694: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-08-28T19:43:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.872+0000 7fe8edfb2640 1 -- 172.21.15.33:0/3344206079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8e81045f0 msgr2=0x7fe8e8104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.872+0000 7fe8edfb2640 1 --2- 172.21.15.33:0/3344206079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8e81045f0 0x7fe8e8104a00 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009900 tx=0x7fe8d802a410 comp rx=0 tx=0).stop 2024-08-28T19:43:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.872+0000 7fe8edfb2640 1 -- 172.21.15.33:0/3344206079 shutdown_connections 2024-08-28T19:43:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.872+0000 7fe8edfb2640 1 --2- 172.21.15.33:0/3344206079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8e810dba0 0x7fe8e81100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.872+0000 7fe8edfb2640 1 --2- 172.21.15.33:0/3344206079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e8105020 0x7fe8e810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.872+0000 7fe8edfb2640 1 --2- 172.21.15.33:0/3344206079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8e81045f0 0x7fe8e8104a00 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.872+0000 7fe8edfb2640 1 -- 172.21.15.33:0/3344206079 >> 172.21.15.33:0/3344206079 conn(0x7fe8e80794b0 msgr2=0x7fe8e80798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.872+0000 7fe8edfb2640 1 -- 172.21.15.33:0/3344206079 shutdown_connections 2024-08-28T19:43:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.872+0000 7fe8edfb2640 1 -- 172.21.15.33:0/3344206079 wait complete. 2024-08-28T19:43:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.872+0000 7fe8edfb2640 1 Processor -- start 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8edfb2640 1 -- start start 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8edfb2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8e81045f0 0x7fe8e819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8edfb2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8e8105020 0x7fe8e819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8edfb2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e810dba0 0x7fe8e81a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8edfb2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8113820 con 0x7fe8e81045f0 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8edfb2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81136a0 con 0x7fe8e810dba0 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8edfb2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81139a0 con 0x7fe8e8105020 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8e77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8e81045f0 0x7fe8e819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8e77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8e81045f0 0x7fe8e819c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35964/0 (socket says 172.21.15.33:35964) 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8e77fe640 1 -- 172.21.15.33:0/1165155427 learned_addr learned my addr 172.21.15.33:0/1165155427 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e810dba0 0x7fe8e81a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8e6ffd640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8e8105020 0x7fe8e819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8e77fe640 1 -- 172.21.15.33:0/1165155427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8e8105020 msgr2=0x7fe8e819ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8e8105020 0x7fe8e819ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8e77fe640 1 -- 172.21.15.33:0/1165155427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e810dba0 msgr2=0x7fe8e81a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e810dba0 0x7fe8e81a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.873+0000 7fe8e77fe640 1 -- 172.21.15.33:0/1165155427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e81a23e0 con 0x7fe8e81045f0 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.874+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8e81045f0 0x7fe8e819c470 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8006010 tx=0x7fe8d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.874+0000 7fe8e4ff9640 1 -- 172.21.15.33:0/1165155427 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d803f030 con 0x7fe8e81045f0 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.874+0000 7fe8e4ff9640 1 -- 172.21.15.33:0/1165155427 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8d8003800 con 0x7fe8e81045f0 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.874+0000 7fe8edfb2640 1 -- 172.21.15.33:0/1165155427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e81a2670 con 0x7fe8e81045f0 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.874+0000 7fe8e4ff9640 1 -- 172.21.15.33:0/1165155427 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8035070 con 0x7fe8e81045f0 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.874+0000 7fe8edfb2640 1 -- 172.21.15.33:0/1165155427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e81a8e30 con 0x7fe8e81045f0 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8f4527740 1 Processor -- start 2024-08-28T19:43:51.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8f4527740 1 -- start start 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8e4ff9640 1 -- 172.21.15.33:0/1165155427 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe8d8003cb0 con 0x7fe8e81045f0 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 0x55610e4e1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4e1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4e1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8f4527740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55610e458680 con 0x55610e1131b0 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8f4527740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55610e447c10 con 0x55610e11b390 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8f4527740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55610e44bbc0 con 0x55610e13c070 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8e77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4e1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8e77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4e1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35968/0 (socket says 172.21.15.33:35968) 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8e77fe640 1 -- 172.21.15.33:0/4096870926 learned_addr learned my addr 172.21.15.33:0/4096870926 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8e6ffd640 1 --2- 172.21.15.33:0/4096870926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4e1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/4096870926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 0x55610e4e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8e77fe640 1 -- 172.21.15.33:0/4096870926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 msgr2=0x55610e4e1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/4096870926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 0x55610e4e1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8e77fe640 1 -- 172.21.15.33:0/4096870926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 msgr2=0x55610e4e1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.877+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/4096870926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4e1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.878+0000 7fe8e77fe640 1 -- 172.21.15.33:0/4096870926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610e1a7650 con 0x55610e1131b0 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.878+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/4096870926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4e1850 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8103690 tx=0x7fe8d810e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c2eeb3be7f8678 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.878+0000 7fe8cdffb640 1 -- 172.21.15.33:0/4096870926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d81080d0 con 0x55610e1131b0 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.878+0000 7fe8e4ff9640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8d00b4ca0 0x7fe8d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.878+0000 7fe8cdffb640 1 -- 172.21.15.33:0/4096870926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8d8113030 con 0x55610e1131b0 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.878+0000 7fe8cdffb640 1 -- 172.21.15.33:0/4096870926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8118640 con 0x55610e1131b0 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.878+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8d00b4ca0 0x7fe8d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.878+0000 7fe8e4ff9640 1 -- 172.21.15.33:0/1165155427 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fe8d8106370 con 0x7fe8e81045f0 2024-08-28T19:43:51.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8f4527740 1 -- 172.21.15.33:0/4096870926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 msgr2=0x55610e4e1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8f4527740 1 --2- 172.21.15.33:0/4096870926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4e1850 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8103690 tx=0x7fe8d810e630 comp rx=0 tx=0).stop 2024-08-28T19:43:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8d00b4ca0 0x7fe8d00b71b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0008e40 tx=0x7fe8e00085f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8f4527740 1 -- 172.21.15.33:0/4096870926 shutdown_connections 2024-08-28T19:43:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8f4527740 1 --2- 172.21.15.33:0/4096870926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4e1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8f4527740 1 --2- 172.21.15.33:0/4096870926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4e1850 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8f4527740 1 --2- 172.21.15.33:0/4096870926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 0x55610e4e1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8f4527740 1 -- 172.21.15.33:0/4096870926 >> 172.21.15.33:0/4096870926 conn(0x55610e130460 msgr2=0x55610e4df200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8f4527740 1 -- 172.21.15.33:0/4096870926 shutdown_connections 2024-08-28T19:43:51.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8f4527740 1 -- 172.21.15.33:0/4096870926 wait complete. 2024-08-28T19:43:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.879+0000 7fe8f4527740 1 -- start start 2024-08-28T19:43:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8f4527740 1 Processor -- start 2024-08-28T19:43:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e1131b0 0x55610e4ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4ed040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8f4527740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55610e2aa700 con 0x55610e13c070 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8f4527740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55610e3ce750 con 0x55610e11b390 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8f4527740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55610e4ef8b0 con 0x55610e1131b0 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8f4527740 10 client.0 _ll_register_callbacks cb 0x55610e3fde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8e7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8e7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35978/0 (socket says 172.21.15.33:35978) 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8e7fff640 1 -- 172.21.15.33:0/1546264659 learned_addr learned my addr 172.21.15.33:0/1546264659 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e1131b0 0x55610e4ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.880+0000 7fe8e6ffd640 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8e7fff640 1 -- 172.21.15.33:0/1546264659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e1131b0 msgr2=0x55610e4ecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e1131b0 0x55610e4ecb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8e7fff640 1 -- 172.21.15.33:0/1546264659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 msgr2=0x55610e4ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4ed040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8e7fff640 1 -- 172.21.15.33:0/1546264659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610e407900 con 0x55610e13c070 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8b10 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000edb0 tx=0x7fe8e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a0a6ec83deac5a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/1546264659 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e001cd70 con 0x55610e13c070 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8f4527740 1 -- 172.21.15.33:0/1546264659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8d8113030 con 0x55610e13c070 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/1546264659 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fe8e0027430 con 0x55610e13c070 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/1546264659 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe8e0030050 con 0x55610e13c070 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8f4527740 10 client.18777 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8f4527740 1 -- 172.21.15.33:0/1546264659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55610e4fb6b0 con 0x55610e13c070 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.881+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/1546264659 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8d8113030 con 0x55610e13c070 2024-08-28T19:43:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.882+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/1546264659 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe8e001d710 con 0x55610e13c070 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.882+0000 7fe8f4527740 10 client.18777 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.882+0000 7fe8f4527740 10 client.18777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.882+0000 7fe8f4527740 20 client.18777 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.882+0000 7fe8f4527740 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55610e0fa9f0 0x55610e4febe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.882+0000 7fe8f4527740 4 client.18777 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.882+0000 7fe8f4527740 1 -- 172.21.15.33:0/1546264659 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55610e45a5d0 con 0x55610e0fa9f0 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.882+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55610e0fa9f0 0x55610e4febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.882+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55610e0fa9f0 0x55610e4febe0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e7ff7536c8deba2 server_cookie=12971d43b3a854bb in_seq=0 out_seq=0 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.882+0000 7fe8c6ffd640 10 client.18777 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/1546264659 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55610e45a5d0 con 0x55610e0fa9f0 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8c6ffd640 10 client.18777 handle_command_reply: tid=0 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8f4527740 1 client.18777 shutdown 2024-08-28T19:43:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8f4527740 1 -- 172.21.15.33:0/1546264659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 msgr2=0x55610e4f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8f4527740 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8b10 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000edb0 tx=0x7fe8e0004a40 comp rx=0 tx=0).stop 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8f4527740 1 -- 172.21.15.33:0/1546264659 shutdown_connections 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8f4527740 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55610e0fa9f0 0x55610e4febe0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8f4527740 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8b10 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8f4527740 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8f4527740 1 --2- 172.21.15.33:0/1546264659 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e1131b0 0x55610e4ecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.883+0000 7fe8f4527740 1 -- 172.21.15.33:0/1546264659 >> 172.21.15.33:0/1546264659 conn(0x55610e130460 msgr2=0x55610e4e44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.884+0000 7fe8c6ffd640 0 client.18777 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.884+0000 7fe8f4527740 1 -- 172.21.15.33:0/1546264659 shutdown_connections 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.884+0000 7fe8f4527740 1 -- 172.21.15.33:0/1546264659 wait complete. 2024-08-28T19:43:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.884+0000 7fe8f4527740 20 client.18777 trim_cache size 0 max 16384 2024-08-28T19:43:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8f4527740 1 Processor -- start 2024-08-28T19:43:51.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8f4527740 1 -- start start 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e1131b0 0x55610e4df250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e11b390 0x55610e4f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8f4527740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81b2e90 con 0x55610e13c070 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8f4527740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81b49d0 con 0x55610e1131b0 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8f4527740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81b3560 con 0x55610e11b390 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8e7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8e7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35986/0 (socket says 172.21.15.33:35986) 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8e7fff640 1 -- 172.21.15.33:0/2232564800 learned_addr learned my addr 172.21.15.33:0/2232564800 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8e6ffd640 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e11b390 0x55610e4f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e1131b0 0x55610e4df250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8e7fff640 1 -- 172.21.15.33:0/2232564800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e11b390 msgr2=0x55610e4f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:51.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e11b390 0x55610e4f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8e7fff640 1 -- 172.21.15.33:0/2232564800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e1131b0 msgr2=0x55610e4df250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e1131b0 0x55610e4df250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.897+0000 7fe8e7fff640 1 -- 172.21.15.33:0/2232564800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610e4e4170 con 0x55610e13c070 2024-08-28T19:43:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.898+0000 7fe8e6ffd640 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e11b390 0x55610e4f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.898+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e1131b0 0x55610e4df250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.898+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8f10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0008330 tx=0x7fe8e0008bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d03644dff503e24 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.898+0000 7fe8cd7fa640 1 -- 172.21.15.33:0/2232564800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e003a030 con 0x55610e13c070 2024-08-28T19:43:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.898+0000 7fe8cd7fa640 1 -- 172.21.15.33:0/2232564800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8e001dd00 con 0x55610e13c070 2024-08-28T19:43:51.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.898+0000 7fe8cd7fa640 1 -- 172.21.15.33:0/2232564800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e001d700 con 0x55610e13c070 2024-08-28T19:43:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 -- 172.21.15.33:0/2232564800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 msgr2=0x55610e4f8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8f10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0008330 tx=0x7fe8e0008bd0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 -- 172.21.15.33:0/2232564800 shutdown_connections 2024-08-28T19:43:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e13c070 0x55610e4f8f10 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e11b390 0x55610e4f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 --2- 172.21.15.33:0/2232564800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e1131b0 0x55610e4df250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 -- 172.21.15.33:0/2232564800 >> 172.21.15.33:0/2232564800 conn(0x55610e130460 msgr2=0x55610e4deb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 -- 172.21.15.33:0/2232564800 shutdown_connections 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 -- 172.21.15.33:0/2232564800 wait complete. 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 -- start start 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.899+0000 7fe8f4527740 1 Processor -- start 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4f5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8f4527740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 0x55610e4f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8f4527740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81b4300 con 0x55610e1131b0 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8f4527740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81b3c30 con 0x55610e11b390 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8f4527740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81b0e90 con 0x55610e13c070 2024-08-28T19:43:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8f4527740 10 client.0 _ll_register_callbacks cb 0x7fe8e000ea30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4f5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35996/0 (socket says 172.21.15.33:35996) 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e77fe640 1 -- 172.21.15.33:0/3728144715 learned_addr learned my addr 172.21.15.33:0/3728144715 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e6ffd640 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 0x55610e4f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e77fe640 1 -- 172.21.15.33:0/3728144715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 msgr2=0x55610e4f0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 0x55610e4f0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e77fe640 1 -- 172.21.15.33:0/3728144715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 msgr2=0x55610e4f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4f05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e77fe640 1 -- 172.21.15.33:0/3728144715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610e4f11b0 con 0x55610e1131b0 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e7fff640 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 0x55610e4f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8e77fe640 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4f5120 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8106c30 tx=0x7fe8d80044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d10d14d41fed76 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.900+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/3728144715 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8049040 con 0x55610e1131b0 2024-08-28T19:43:51.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/3728144715 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fe8d810e150 con 0x55610e1131b0 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8f4527740 1 -- 172.21.15.33:0/3728144715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e001dd00 con 0x55610e1131b0 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/3728144715 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe8d80c8580 con 0x55610e1131b0 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8f4527740 10 client.18783 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8f4527740 1 -- 172.21.15.33:0/3728144715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55610e5692d0 con 0x55610e1131b0 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/3728144715 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8e001dd00 con 0x55610e1131b0 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/3728144715 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe8d81039a0 con 0x55610e1131b0 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8f4527740 10 client.18783 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8f4527740 10 client.18783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8f4527740 20 client.18783 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8f4527740 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55610e0cfda0 0x55610e56b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8f4527740 4 client.18783 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8f4527740 1 -- 172.21.15.33:0/3728144715 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55610e456070 con 0x55610e0cfda0 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.901+0000 7fe8e6ffd640 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55610e0cfda0 0x55610e56b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:51.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.902+0000 7fe8c6ffd640 10 client.18783 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.902+0000 7fe8e6ffd640 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55610e0cfda0 0x55610e56b680 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afb4db1256648c45 server_cookie=2a93f89306f9c277 in_seq=0 out_seq=0 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.902+0000 7fe8c6ffd640 1 -- 172.21.15.33:0/3728144715 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55610e456070 con 0x55610e0cfda0 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.902+0000 7fe8c6ffd640 10 client.18783 handle_command_reply: tid=0 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.902+0000 7fe8f4527740 1 client.18783 shutdown 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.902+0000 7fe8f4527740 1 -- 172.21.15.33:0/3728144715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 msgr2=0x55610e4f5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.902+0000 7fe8f4527740 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4f5120 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8106c30 tx=0x7fe8d80044e0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.902+0000 7fe8f4527740 1 -- 172.21.15.33:0/3728144715 shutdown_connections 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.902+0000 7fe8f4527740 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55610e13c070 0x55610e4f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8f4527740 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55610e11b390 0x55610e4f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8f4527740 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55610e0cfda0 0x55610e56b680 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8f4527740 1 --2- 172.21.15.33:0/3728144715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55610e1131b0 0x55610e4f5120 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8f4527740 1 -- 172.21.15.33:0/3728144715 >> 172.21.15.33:0/3728144715 conn(0x55610e130460 msgr2=0x55610e4ec8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8c6ffd640 0 client.18783 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:51.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8f4527740 1 -- 172.21.15.33:0/3728144715 shutdown_connections 2024-08-28T19:43:51.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8f4527740 1 -- 172.21.15.33:0/3728144715 wait complete. 2024-08-28T19:43:51.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8f4527740 20 client.18783 trim_cache size 0 max 16384 2024-08-28T19:43:51.909 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8edfb2640 1 -- 172.21.15.33:0/1165155427 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8d00b4ca0 msgr2=0x7fe8d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8edfb2640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8d00b4ca0 0x7fe8d00b71b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0008e40 tx=0x7fe8e00085f0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8edfb2640 1 -- 172.21.15.33:0/1165155427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8e81045f0 msgr2=0x7fe8e819c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8edfb2640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8e81045f0 0x7fe8e819c470 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8006010 tx=0x7fe8d80042f0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8edfb2640 1 -- 172.21.15.33:0/1165155427 shutdown_connections 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8edfb2640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e810dba0 0x7fe8e81a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8edfb2640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8d00b4ca0 0x7fe8d00b71b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8edfb2640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe8e8105020 0x7fe8e819ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8edfb2640 1 --2- 172.21.15.33:0/1165155427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8e81045f0 0x7fe8e819c470 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.903+0000 7fe8edfb2640 1 -- 172.21.15.33:0/1165155427 >> 172.21.15.33:0/1165155427 conn(0x7fe8e80794b0 msgr2=0x7fe8e80ff290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.904+0000 7fe8edfb2640 1 -- 172.21.15.33:0/1165155427 shutdown_connections 2024-08-28T19:43:51.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:51.904+0000 7fe8edfb2640 1 -- 172.21.15.33:0/1165155427 wait complete. 2024-08-28T19:43:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:51 smithi059 ceph-mon[22052]: pgmap v694: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-08-28T19:43:52.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:51 smithi122 ceph-mon[22174]: pgmap v694: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 14 op/s 2024-08-28T19:43:53.644 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:43:53.645 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:43:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:54.032 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:53 smithi033 ceph-mon[18549]: pgmap v695: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-08-28T19:43:54.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:53 smithi059 ceph-mon[22052]: pgmap v695: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-08-28T19:43:54.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:53 smithi122 ceph-mon[22174]: pgmap v695: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-08-28T19:43:54.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.449+0000 7fd3110b2640 1 -- 172.21.15.33:0/4024223024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c109b90 msgr2=0x7fd30c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:54.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.449+0000 7fd3110b2640 1 --2- 172.21.15.33:0/4024223024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c109b90 0x7fd30c1103c0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fd304009ca0 tx=0x7fd30402a8e0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.449+0000 7fd3110b2640 1 -- 172.21.15.33:0/4024223024 shutdown_connections 2024-08-28T19:43:54.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.449+0000 7fd3110b2640 1 --2- 172.21.15.33:0/4024223024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c109b90 0x7fd30c1103c0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.449+0000 7fd3110b2640 1 --2- 172.21.15.33:0/4024223024 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd30c109240 0x7fd30c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.449+0000 7fd3110b2640 1 --2- 172.21.15.33:0/4024223024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd30c103900 0x7fd30c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.449+0000 7fd3110b2640 1 -- 172.21.15.33:0/4024223024 >> 172.21.15.33:0/4024223024 conn(0x7fd30c07b5f0 msgr2=0x7fd30c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.449+0000 7fd3110b2640 1 -- 172.21.15.33:0/4024223024 shutdown_connections 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.450+0000 7fd3110b2640 1 -- 172.21.15.33:0/4024223024 wait complete. 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.450+0000 7fd3110b2640 1 Processor -- start 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.450+0000 7fd3110b2640 1 -- start start 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd3110b2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c103900 0x7fd30c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd3110b2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd30c109240 0x7fd30c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd3110b2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd30c109b90 0x7fd30c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd3110b2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c113890 con 0x7fd30c103900 2024-08-28T19:43:54.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd3110b2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c113710 con 0x7fd30c109b90 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd3110b2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c113a10 con 0x7fd30c109240 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c103900 0x7fd30c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c103900 0x7fd30c19a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36014/0 (socket says 172.21.15.33:36014) 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30ad9d640 1 -- 172.21.15.33:0/2791967337 learned_addr learned my addr 172.21.15.33:0/2791967337 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd303fff640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd30c109240 0x7fd30c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30b59e640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd30c109b90 0x7fd30c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30ad9d640 1 -- 172.21.15.33:0/2791967337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd30c109240 msgr2=0x7fd30c19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd30c109240 0x7fd30c19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30ad9d640 1 -- 172.21.15.33:0/2791967337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd30c109b90 msgr2=0x7fd30c19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd30c109b90 0x7fd30c19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30ad9d640 1 -- 172.21.15.33:0/2791967337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c1a01b0 con 0x7fd30c103900 2024-08-28T19:43:54.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30b59e640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd30c109b90 0x7fd30c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c103900 0x7fd30c19a240 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00d950 tx=0x7fd2fc00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.451+0000 7fd308d99640 1 -- 172.21.15.33:0/2791967337 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc017030 con 0x7fd30c103900 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.452+0000 7fd3110b2640 1 -- 172.21.15.33:0/2791967337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30c1a04a0 con 0x7fd30c103900 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.452+0000 7fd308d99640 1 -- 172.21.15.33:0/2791967337 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2fc004020 con 0x7fd30c103900 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.452+0000 7fd308d99640 1 -- 172.21.15.33:0/2791967337 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc005560 con 0x7fd30c103900 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.452+0000 7fd3110b2640 1 -- 172.21.15.33:0/2791967337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30c1a6c00 con 0x7fd30c103900 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.454+0000 7fd317627740 1 Processor -- start 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.454+0000 7fd308d99640 1 -- 172.21.15.33:0/2791967337 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd2fc009a30 con 0x7fd30c103900 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.454+0000 7fd317627740 1 -- start start 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd317627740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176d6350 0x556917a7c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd317627740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a7ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd317627740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176b5670 0x556917a7d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd317627740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5569179f25f0 con 0x5569176ad490 2024-08-28T19:43:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd317627740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5569179e1b80 con 0x5569176b5670 2024-08-28T19:43:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd317627740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5569179e5b30 con 0x5569176d6350 2024-08-28T19:43:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd30ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a7ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd30ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a7ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36026/0 (socket says 172.21.15.33:36026) 2024-08-28T19:43:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd30ad9d640 1 -- 172.21.15.33:0/2719064423 learned_addr learned my addr 172.21.15.33:0/2719064423 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd30b59e640 1 --2- 172.21.15.33:0/2719064423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176d6350 0x556917a7c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.455+0000 7fd303fff640 1 --2- 172.21.15.33:0/2719064423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176b5670 0x556917a7d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd30ad9d640 1 -- 172.21.15.33:0/2719064423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176d6350 msgr2=0x556917a7c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/2719064423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176d6350 0x556917a7c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd308d99640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2f80b4ca0 0x7fd2f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd30ad9d640 1 -- 172.21.15.33:0/2719064423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176b5670 msgr2=0x556917a7d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/2719064423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176b5670 0x556917a7d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd30ad9d640 1 -- 172.21.15.33:0/2719064423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556917741930 con 0x5569176ad490 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd30b59e640 1 --2- 172.21.15.33:0/2719064423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176d6350 0x556917a7c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd30b59e640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2f80b4ca0 0x7fd2f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd308d99640 1 -- 172.21.15.33:0/2791967337 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fd2fc0e5310 con 0x7fd30c103900 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/2719064423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a7ccc0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0e2630 tx=0x7fd2fc0bd1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d42279fcf68c11a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd3017fa640 1 -- 172.21.15.33:0/2719064423 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0ab430 con 0x5569176ad490 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd3017fa640 1 -- 172.21.15.33:0/2719064423 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2fc0b42c0 con 0x5569176ad490 2024-08-28T19:43:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.456+0000 7fd3017fa640 1 -- 172.21.15.33:0/2719064423 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0aadd0 con 0x5569176ad490 2024-08-28T19:43:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.457+0000 7fd317627740 1 -- 172.21.15.33:0/2719064423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 msgr2=0x556917a7ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.457+0000 7fd317627740 1 --2- 172.21.15.33:0/2719064423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a7ccc0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0e2630 tx=0x7fd2fc0bd1d0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.457+0000 7fd30b59e640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2f80b4ca0 0x7fd2f80b71b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd304005cc0 tx=0x7fd304005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.457+0000 7fd317627740 1 -- 172.21.15.33:0/2719064423 shutdown_connections 2024-08-28T19:43:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.457+0000 7fd317627740 1 --2- 172.21.15.33:0/2719064423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176b5670 0x556917a7d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.457+0000 7fd317627740 1 --2- 172.21.15.33:0/2719064423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a7ccc0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.457+0000 7fd317627740 1 --2- 172.21.15.33:0/2719064423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176d6350 0x556917a7c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.457+0000 7fd317627740 1 -- 172.21.15.33:0/2719064423 >> 172.21.15.33:0/2719064423 conn(0x5569176ca740 msgr2=0x556917a7a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.457+0000 7fd317627740 1 -- 172.21.15.33:0/2719064423 shutdown_connections 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.457+0000 7fd317627740 1 -- 172.21.15.33:0/2719064423 wait complete. 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd317627740 1 -- start start 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd317627740 1 Processor -- start 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd317627740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176ad490 0x556917a87fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd317627740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 0x556917a88560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd317627740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176d6350 0x556917a94280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd317627740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556917844890 con 0x5569176d6350 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd317627740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556917968790 con 0x5569176ad490 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd317627740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556917a8af60 con 0x5569176b5670 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd317627740 10 client.0 _ll_register_callbacks cb 0x5569176edba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd30b59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176d6350 0x556917a94280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd30b59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176d6350 0x556917a94280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36030/0 (socket says 172.21.15.33:36030) 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd30b59e640 1 -- 172.21.15.33:0/211116054 learned_addr learned my addr 172.21.15.33:0/211116054 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd303fff640 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 0x556917a88560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.458+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176ad490 0x556917a87fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd30b59e640 1 -- 172.21.15.33:0/211116054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 msgr2=0x556917a88560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd30b59e640 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 0x556917a88560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd30b59e640 1 -- 172.21.15.33:0/211116054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176ad490 msgr2=0x556917a87fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd30b59e640 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176ad490 0x556917a87fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd30b59e640 1 -- 172.21.15.33:0/211116054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55691799ff30 con 0x5569176d6350 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd303fff640 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 0x556917a88560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd30b59e640 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176d6350 0x556917a94280 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fd304031700 tx=0x7fd30402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5044a9025a28cc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:54.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd2f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd2f27fc640 1 -- 172.21.15.33:0/211116054 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3040045c0 con 0x5569176d6350 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd2f27fc640 1 -- 172.21.15.33:0/211116054 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fd304004760 con 0x5569176d6350 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd317627740 1 -- 172.21.15.33:0/211116054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5569179f4540 con 0x5569176d6350 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd2f27fc640 1 -- 172.21.15.33:0/211116054 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd3040305e0 con 0x5569176d6350 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd317627740 10 client.18795 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.459+0000 7fd317627740 1 -- 172.21.15.33:0/211116054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556917a96df0 con 0x5569176d6350 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.460+0000 7fd2f27fc640 1 -- 172.21.15.33:0/211116054 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5569179f4540 con 0x5569176d6350 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.460+0000 7fd2f27fc640 1 -- 172.21.15.33:0/211116054 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd304050070 con 0x5569176d6350 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.460+0000 7fd317627740 10 client.18795 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.460+0000 7fd317627740 10 client.18795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.460+0000 7fd317627740 20 client.18795 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.460+0000 7fd317627740 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556917694cd0 0x556917a9a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.460+0000 7fd317627740 4 client.18795 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.460+0000 7fd317627740 1 -- 172.21.15.33:0/211116054 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569179effe0 con 0x556917694cd0 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.460+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556917694cd0 0x556917a9a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.461+0000 7fd2f27fc640 10 client.18795 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.461+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556917694cd0 0x556917a9a300 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=280b6afbeb0c8d38 server_cookie=d46938e8be8d18b9 in_seq=0 out_seq=0 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.461+0000 7fd2f27fc640 1 -- 172.21.15.33:0/211116054 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569179effe0 con 0x556917694cd0 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.461+0000 7fd2f27fc640 10 client.18795 handle_command_reply: tid=0 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.461+0000 7fd317627740 1 client.18795 shutdown 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.461+0000 7fd317627740 1 -- 172.21.15.33:0/211116054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176d6350 msgr2=0x556917a94280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.461+0000 7fd317627740 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176d6350 0x556917a94280 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fd304031700 tx=0x7fd30402a8e0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.461+0000 7fd317627740 1 -- 172.21.15.33:0/211116054 shutdown_connections 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.461+0000 7fd317627740 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x556917694cd0 0x556917a9a300 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.462+0000 7fd317627740 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176d6350 0x556917a94280 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.462+0000 7fd317627740 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 0x556917a88560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.462+0000 7fd317627740 1 --2- 172.21.15.33:0/211116054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176ad490 0x556917a87fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.462+0000 7fd2f27fc640 0 client.18795 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.462+0000 7fd317627740 1 -- 172.21.15.33:0/211116054 >> 172.21.15.33:0/211116054 conn(0x5569176ca740 msgr2=0x556917a7f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.462+0000 7fd317627740 1 -- 172.21.15.33:0/211116054 shutdown_connections 2024-08-28T19:43:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.462+0000 7fd317627740 1 -- 172.21.15.33:0/211116054 wait complete. 2024-08-28T19:43:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.462+0000 7fd317627740 20 client.18795 trim_cache size 0 max 16384 2024-08-28T19:43:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.479+0000 7fd317627740 1 Processor -- start 2024-08-28T19:43:54.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.479+0000 7fd317627740 1 -- start start 2024-08-28T19:43:54.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd317627740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a94180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd317627740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 0x556917a946c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd317627740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176d6350 0x556917a851d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd317627740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1b0cb0 con 0x5569176ad490 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd317627740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1b27f0 con 0x5569176d6350 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd317627740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1b1380 con 0x5569176b5670 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd30ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a94180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd30ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a94180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36042/0 (socket says 172.21.15.33:36042) 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd30ad9d640 1 -- 172.21.15.33:0/483586321 learned_addr learned my addr 172.21.15.33:0/483586321 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd303fff640 1 --2- 172.21.15.33:0/483586321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 0x556917a946c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd30b59e640 1 --2- 172.21.15.33:0/483586321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176d6350 0x556917a851d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.482 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd30ad9d640 1 -- 172.21.15.33:0/483586321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 msgr2=0x556917a946c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/483586321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 0x556917a946c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd30ad9d640 1 -- 172.21.15.33:0/483586321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176d6350 msgr2=0x556917a851d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/483586321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176d6350 0x556917a851d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd30ad9d640 1 -- 172.21.15.33:0/483586321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556917a7ea70 con 0x5569176ad490 2024-08-28T19:43:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd303fff640 1 --2- 172.21.15.33:0/483586321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 0x556917a946c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.480+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/483586321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a94180 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc005c60 tx=0x7fd2fc0ed150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b9ac08e8b51316 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.481+0000 7fd300ff9640 1 -- 172.21.15.33:0/483586321 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0aafb0 con 0x5569176ad490 2024-08-28T19:43:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.481+0000 7fd300ff9640 1 -- 172.21.15.33:0/483586321 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2fc0ab170 con 0x5569176ad490 2024-08-28T19:43:54.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.481+0000 7fd300ff9640 1 -- 172.21.15.33:0/483586321 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0ab660 con 0x5569176ad490 2024-08-28T19:43:54.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.481+0000 7fd317627740 1 -- 172.21.15.33:0/483586321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 msgr2=0x556917a94180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:54.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.481+0000 7fd317627740 1 --2- 172.21.15.33:0/483586321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a94180 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc005c60 tx=0x7fd2fc0ed150 comp rx=0 tx=0).stop 2024-08-28T19:43:54.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.481+0000 7fd317627740 1 -- 172.21.15.33:0/483586321 shutdown_connections 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.481+0000 7fd317627740 1 --2- 172.21.15.33:0/483586321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176d6350 0x556917a851d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.481+0000 7fd317627740 1 --2- 172.21.15.33:0/483586321 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176b5670 0x556917a946c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 --2- 172.21.15.33:0/483586321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176ad490 0x556917a94180 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 -- 172.21.15.33:0/483586321 >> 172.21.15.33:0/483586321 conn(0x5569176ca740 msgr2=0x556917a7a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 -- 172.21.15.33:0/483586321 shutdown_connections 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 -- 172.21.15.33:0/483586321 wait complete. 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 -- start start 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 Processor -- start 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176ad490 0x556917a8c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176b5670 0x556917a8c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176d6350 0x556917a8cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1b2120 con 0x5569176b5670 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1b1a50 con 0x5569176d6350 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c1aecb0 con 0x5569176ad490 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd317627740 10 client.0 _ll_register_callbacks cb 0x7fd3040315d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd303fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176b5670 0x556917a8c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd303fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176b5670 0x556917a8c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36050/0 (socket says 172.21.15.33:36050) 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.482+0000 7fd303fff640 1 -- 172.21.15.33:0/2812862677 learned_addr learned my addr 172.21.15.33:0/2812862677 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176ad490 0x556917a8c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd303fff640 1 -- 172.21.15.33:0/2812862677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176ad490 msgr2=0x556917a8c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd303fff640 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176ad490 0x556917a8c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd30b59e640 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176d6350 0x556917a8cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd303fff640 1 -- 172.21.15.33:0/2812862677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176d6350 msgr2=0x556917a8cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd303fff640 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176d6350 0x556917a8cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd303fff640 1 -- 172.21.15.33:0/2812862677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556917b03f10 con 0x5569176b5670 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176ad490 0x556917a8c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd303fff640 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176b5670 0x556917a8c990 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd30c06c790 tx=0x7fd2f4009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5d233aa7f577e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd2f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd2f27fc640 1 -- 172.21.15.33:0/2812862677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4024060 con 0x5569176b5670 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd2f27fc640 1 -- 172.21.15.33:0/2812862677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7fd2f400f040 con 0x5569176b5670 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd317627740 1 -- 172.21.15.33:0/2812862677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2fc0ab170 con 0x5569176b5670 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd2f27fc640 1 -- 172.21.15.33:0/2812862677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2f4015d70 con 0x5569176b5670 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd317627740 10 client.18801 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.483+0000 7fd317627740 1 -- 172.21.15.33:0/2812862677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556917b05260 con 0x5569176b5670 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd2f27fc640 1 -- 172.21.15.33:0/2812862677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2fc0ab170 con 0x5569176b5670 2024-08-28T19:43:54.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd2f27fc640 1 -- 172.21.15.33:0/2812862677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd2f401e4d0 con 0x5569176b5670 2024-08-28T19:43:54.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd317627740 10 client.18801 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:54.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd317627740 10 client.18801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:54.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd317627740 20 client.18801 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:54.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd317627740 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55691766a080 0x556917b07a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:54.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd317627740 4 client.18801 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:43:54.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd317627740 1 -- 172.21.15.33:0/2812862677 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5569179ed720 con 0x55691766a080 2024-08-28T19:43:54.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55691766a080 0x556917b07a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:54.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd30ad9d640 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55691766a080 0x556917b07a80 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fafc33879b4950e6 server_cookie=9212e1b1e2f5b4d5 in_seq=0 out_seq=0 2024-08-28T19:43:54.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.484+0000 7fd2f27fc640 10 client.18801 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:54.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.486+0000 7fd2f27fc640 1 -- 172.21.15.33:0/2812862677 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5569179ed720 con 0x55691766a080 2024-08-28T19:43:54.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.486+0000 7fd2f27fc640 10 client.18801 handle_command_reply: tid=0 2024-08-28T19:43:54.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.486+0000 7fd317627740 1 client.18801 shutdown 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.486+0000 7fd317627740 1 -- 172.21.15.33:0/2812862677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176b5670 msgr2=0x556917a8c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.486+0000 7fd317627740 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176b5670 0x556917a8c990 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd30c06c790 tx=0x7fd2f4009f80 comp rx=0 tx=0).stop 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd317627740 1 -- 172.21.15.33:0/2812862677 shutdown_connections 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd317627740 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5569176d6350 0x556917a8cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd317627740 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55691766a080 0x556917b07a80 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd317627740 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5569176b5670 0x556917a8c990 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd317627740 1 --2- 172.21.15.33:0/2812862677 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5569176ad490 0x556917a8c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd2f27fc640 0 client.18801 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd317627740 1 -- 172.21.15.33:0/2812862677 >> 172.21.15.33:0/2812862677 conn(0x5569176ca740 msgr2=0x556917a89e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd317627740 1 -- 172.21.15.33:0/2812862677 shutdown_connections 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd317627740 1 -- 172.21.15.33:0/2812862677 wait complete. 2024-08-28T19:43:54.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd317627740 20 client.18801 trim_cache size 0 max 16384 2024-08-28T19:43:54.493 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:43:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:43:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "f5ea7231-3e1a-4401-bac3-5b2c26666b1f", 2024-08-28T19:43:54.493 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:43:54.493 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:43:54.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd3110b2640 1 -- 172.21.15.33:0/2791967337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2f80b4ca0 msgr2=0x7fd2f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:54.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd3110b2640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2f80b4ca0 0x7fd2f80b71b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd304005cc0 tx=0x7fd304005c50 comp rx=0 tx=0).stop 2024-08-28T19:43:54.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd3110b2640 1 -- 172.21.15.33:0/2791967337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c103900 msgr2=0x7fd30c19a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:54.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd3110b2640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c103900 0x7fd30c19a240 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00d950 tx=0x7fd2fc00dd50 comp rx=0 tx=0).stop 2024-08-28T19:43:54.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.487+0000 7fd3110b2640 1 -- 172.21.15.33:0/2791967337 shutdown_connections 2024-08-28T19:43:54.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.488+0000 7fd3110b2640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd30c109b90 0x7fd30c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.488+0000 7fd3110b2640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2f80b4ca0 0x7fd2f80b71b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.488+0000 7fd3110b2640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd30c109240 0x7fd30c19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.488+0000 7fd3110b2640 1 --2- 172.21.15.33:0/2791967337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd30c103900 0x7fd30c19a240 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:54.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.488+0000 7fd3110b2640 1 -- 172.21.15.33:0/2791967337 >> 172.21.15.33:0/2791967337 conn(0x7fd30c07b5f0 msgr2=0x7fd30c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:54.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.488+0000 7fd3110b2640 1 -- 172.21.15.33:0/2791967337 shutdown_connections 2024-08-28T19:43:54.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:54.488+0000 7fd3110b2640 1 -- 172.21.15.33:0/2791967337 wait complete. 2024-08-28T19:43:55.216 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:43:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:43:55.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:55 smithi033 ceph-mon[18549]: pgmap v696: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 75 KiB/s wr, 18 op/s 2024-08-28T19:43:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:55 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:43:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:55 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:55 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:43:55.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:55 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.000+0000 7f948d23d640 1 -- 172.21.15.33:0/1848147299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9488108a90 msgr2=0x7f948810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:56.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.000+0000 7f948d23d640 1 --2- 172.21.15.33:0/1848147299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9488108a90 0x7f948810f2c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f9480009ca0 tx=0x7f948002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.000+0000 7f948d23d640 1 -- 172.21.15.33:0/1848147299 shutdown_connections 2024-08-28T19:43:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.000+0000 7f948d23d640 1 --2- 172.21.15.33:0/1848147299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9488108a90 0x7f948810f2c0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.000+0000 7f948d23d640 1 --2- 172.21.15.33:0/1848147299 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9488108140 0x7f9488108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.000+0000 7f948d23d640 1 --2- 172.21.15.33:0/1848147299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9488102800 0x7f9488102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.000+0000 7f948d23d640 1 -- 172.21.15.33:0/1848147299 >> 172.21.15.33:0/1848147299 conn(0x7f94880794d0 msgr2=0x7f94880798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.000+0000 7f948d23d640 1 -- 172.21.15.33:0/1848147299 shutdown_connections 2024-08-28T19:43:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.000+0000 7f948d23d640 1 -- 172.21.15.33:0/1848147299 wait complete. 2024-08-28T19:43:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.001+0000 7f948d23d640 1 Processor -- start 2024-08-28T19:43:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.001+0000 7f948d23d640 1 -- start start 2024-08-28T19:43:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.001+0000 7f948d23d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9488102800 0x7f948819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948d23d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9488108140 0x7f948819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948d23d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9488108a90 0x7f948819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948d23d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9488113820 con 0x7f9488108140 2024-08-28T19:43:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948d23d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94881136a0 con 0x7f9488102800 2024-08-28T19:43:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948d23d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94881139a0 con 0x7f9488108a90 2024-08-28T19:43:56.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9488108140 0x7f948819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9488108140 0x7f948819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36072/0 (socket says 172.21.15.33:36072) 2024-08-28T19:43:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948659c640 1 -- 172.21.15.33:0/3894600688 learned_addr learned my addr 172.21.15.33:0/3894600688 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948759e640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9488108a90 0x7f948819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f9486d9d640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9488102800 0x7f948819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948659c640 1 -- 172.21.15.33:0/3894600688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9488108a90 msgr2=0x7f948819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948659c640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9488108a90 0x7f948819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948659c640 1 -- 172.21.15.33:0/3894600688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9488102800 msgr2=0x7f948819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948659c640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9488102800 0x7f948819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948659c640 1 -- 172.21.15.33:0/3894600688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94881a0120 con 0x7f9488108140 2024-08-28T19:43:56.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f9486d9d640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9488102800 0x7f948819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.002+0000 7f948659c640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9488108140 0x7f948819a750 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f947c00d740 tx=0x7f947c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.003+0000 7f946ffff640 1 -- 172.21.15.33:0/3894600688 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c017070 con 0x7f9488108140 2024-08-28T19:43:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.003+0000 7f948d23d640 1 -- 172.21.15.33:0/3894600688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94881a0410 con 0x7f9488108140 2024-08-28T19:43:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.003+0000 7f946ffff640 1 -- 172.21.15.33:0/3894600688 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f947c00de50 con 0x7f9488108140 2024-08-28T19:43:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.003+0000 7f946ffff640 1 -- 172.21.15.33:0/3894600688 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c004ce0 con 0x7f9488108140 2024-08-28T19:43:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.003+0000 7f948d23d640 1 -- 172.21.15.33:0/3894600688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94881a6b70 con 0x7f9488108140 2024-08-28T19:43:56.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.005+0000 7f94937b2740 1 Processor -- start 2024-08-28T19:43:56.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.005+0000 7f94937b2740 1 -- start start 2024-08-28T19:43:56.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.005+0000 7f946ffff640 1 -- 172.21.15.33:0/3894600688 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f947c010460 con 0x7f9488108140 2024-08-28T19:43:56.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f94937b2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa903b070 0x55faa93e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f94937b2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93e0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f94937b2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa901a390 0x55faa93e0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f94937b2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55faa9357630 con 0x55faa90121b0 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f94937b2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55faa9346bc0 con 0x55faa901a390 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f94937b2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55faa934ab70 con 0x55faa903b070 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f9486d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93e0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f9486d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93e0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36088/0 (socket says 172.21.15.33:36088) 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f9486d9d640 1 -- 172.21.15.33:0/2359739913 learned_addr learned my addr 172.21.15.33:0/2359739913 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f948759e640 1 --2- 172.21.15.33:0/2359739913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa903b070 0x55faa93e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f948659c640 1 --2- 172.21.15.33:0/2359739913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa901a390 0x55faa93e0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f9486d9d640 1 -- 172.21.15.33:0/2359739913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa903b070 msgr2=0x55faa93e02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:56.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f9486d9d640 1 --2- 172.21.15.33:0/2359739913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa903b070 0x55faa93e02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f9486d9d640 1 -- 172.21.15.33:0/2359739913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa901a390 msgr2=0x55faa93e0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f9486d9d640 1 --2- 172.21.15.33:0/2359739913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa901a390 0x55faa93e0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f9486d9d640 1 -- 172.21.15.33:0/2359739913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faa90a6650 con 0x55faa90121b0 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f948659c640 1 --2- 172.21.15.33:0/2359739913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa901a390 0x55faa93e0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.006+0000 7f9486d9d640 1 --2- 172.21.15.33:0/2359739913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93e0800 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f947800bd70 tx=0x7f947800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d595c4b362954f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.007+0000 7f946ffff640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94700b4ca0 0x7f94700b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.007+0000 7f946d7fa640 1 -- 172.21.15.33:0/2359739913 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478004020 con 0x55faa90121b0 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.007+0000 7f946d7fa640 1 -- 172.21.15.33:0/2359739913 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94780041c0 con 0x55faa90121b0 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.007+0000 7f946d7fa640 1 -- 172.21.15.33:0/2359739913 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94780116f0 con 0x55faa90121b0 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.007+0000 7f948759e640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94700b4ca0 0x7f94700b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.007+0000 7f946ffff640 1 -- 172.21.15.33:0/3894600688 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f947c0e5240 con 0x7f9488108140 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 -- 172.21.15.33:0/2359739913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 msgr2=0x55faa93e0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f948759e640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94700b4ca0 0x7f94700b71b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f948002f500 tx=0x7f948002f370 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:56.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 --2- 172.21.15.33:0/2359739913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93e0800 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f947800bd70 tx=0x7f947800f730 comp rx=0 tx=0).stop 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 -- 172.21.15.33:0/2359739913 shutdown_connections 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 --2- 172.21.15.33:0/2359739913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa901a390 0x55faa93e0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 --2- 172.21.15.33:0/2359739913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93e0800 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 --2- 172.21.15.33:0/2359739913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa903b070 0x55faa93e02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 -- 172.21.15.33:0/2359739913 >> 172.21.15.33:0/2359739913 conn(0x55faa902f460 msgr2=0x55faa93de1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 -- 172.21.15.33:0/2359739913 shutdown_connections 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 -- 172.21.15.33:0/2359739913 wait complete. 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 -- start start 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 Processor -- start 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa90121b0 0x55faa93efe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93f0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.008+0000 7f94937b2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa903b070 0x55faa93fc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f94937b2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55faa91a9700 con 0x55faa901a390 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f94937b2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55faa92cd700 con 0x55faa90121b0 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f94937b2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55faa93f2dd0 con 0x55faa903b070 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f94937b2740 10 client.0 _ll_register_callbacks cb 0x55faa92fcdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f948659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f948659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93f0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36096/0 (socket says 172.21.15.33:36096) 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f948659c640 1 -- 172.21.15.33:0/284692273 learned_addr learned my addr 172.21.15.33:0/284692273 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f948759e640 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa903b070 0x55faa93fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f9486d9d640 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa90121b0 0x55faa93efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f948659c640 1 -- 172.21.15.33:0/284692273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa903b070 msgr2=0x55faa93fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:56.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f948659c640 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa903b070 0x55faa93fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f948659c640 1 -- 172.21.15.33:0/284692273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa90121b0 msgr2=0x55faa93efe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f948659c640 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa90121b0 0x55faa93efe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f948659c640 1 -- 172.21.15.33:0/284692273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faa93068b0 con 0x55faa901a390 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f948659c640 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93f0340 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f947c009610 tx=0x7f947c0aad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d482c4145846a40 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f946aff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f946aff5640 1 -- 172.21.15.33:0/284692273 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c020070 con 0x55faa901a390 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f946aff5640 1 -- 172.21.15.33:0/284692273 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f947c0ce0b0 con 0x55faa901a390 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f94937b2740 1 -- 172.21.15.33:0/284692273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94780041c0 con 0x55faa901a390 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.009+0000 7f946aff5640 1 -- 172.21.15.33:0/284692273 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f947c0abc90 con 0x55faa901a390 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f94937b2740 10 client.18813 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f94937b2740 1 -- 172.21.15.33:0/284692273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55faa93feb90 con 0x55faa901a390 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f946aff5640 1 -- 172.21.15.33:0/284692273 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94780041c0 con 0x55faa901a390 2024-08-28T19:43:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f946aff5640 1 -- 172.21.15.33:0/284692273 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f947c0a6f00 con 0x55faa901a390 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f94937b2740 10 client.18813 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f94937b2740 10 client.18813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f94937b2740 20 client.18813 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f94937b2740 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55faa8ff99f0 0x55faa9402060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f94937b2740 4 client.18813 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f94937b2740 1 -- 172.21.15.33:0/284692273 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55faa9359580 con 0x55faa8ff99f0 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.010+0000 7f9486d9d640 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55faa8ff99f0 0x55faa9402060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.011+0000 7f9486d9d640 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55faa8ff99f0 0x55faa9402060 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f23318a8289655 server_cookie=98c58a5d3eea3fc7 in_seq=0 out_seq=0 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.011+0000 7f946aff5640 10 client.18813 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.011+0000 7f946aff5640 1 -- 172.21.15.33:0/284692273 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55faa9359580 con 0x55faa8ff99f0 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.011+0000 7f946aff5640 10 client.18813 handle_command_reply: tid=0 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.011+0000 7f94937b2740 1 client.18813 shutdown 2024-08-28T19:43:56.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 1 -- 172.21.15.33:0/284692273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 msgr2=0x55faa93f0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93f0340 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f947c009610 tx=0x7f947c0aad00 comp rx=0 tx=0).stop 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 1 -- 172.21.15.33:0/284692273 shutdown_connections 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa903b070 0x55faa93fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55faa8ff99f0 0x55faa9402060 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f946aff5640 0 client.18813 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93f0340 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 1 --2- 172.21.15.33:0/284692273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa90121b0 0x55faa93efe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 1 -- 172.21.15.33:0/284692273 >> 172.21.15.33:0/284692273 conn(0x55faa902f460 msgr2=0x55faa93e3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 1 -- 172.21.15.33:0/284692273 shutdown_connections 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 1 -- 172.21.15.33:0/284692273 wait complete. 2024-08-28T19:43:56.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.012+0000 7f94937b2740 20 client.18813 trim_cache size 0 max 16384 2024-08-28T19:43:56.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f94937b2740 1 Processor -- start 2024-08-28T19:43:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f94937b2740 1 -- start start 2024-08-28T19:43:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f94937b2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 0x55faa93e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f94937b2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa90121b0 0x55faa93dd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f94937b2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93ddcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f94937b2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f94881ae9c0 con 0x55faa901a390 2024-08-28T19:43:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f94937b2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94881b0500 con 0x55faa8ff99f0 2024-08-28T19:43:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f94937b2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94881af090 con 0x55faa90121b0 2024-08-28T19:43:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f948759e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93ddcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f948759e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93ddcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36112/0 (socket says 172.21.15.33:36112) 2024-08-28T19:43:56.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f948759e640 1 -- 172.21.15.33:0/285549676 learned_addr learned my addr 172.21.15.33:0/285549676 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:56.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f9486d9d640 1 --2- 172.21.15.33:0/285549676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 0x55faa93e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f948659c640 1 --2- 172.21.15.33:0/285549676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa90121b0 0x55faa93dd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f948759e640 1 -- 172.21.15.33:0/285549676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa90121b0 msgr2=0x55faa93dd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:56.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f948759e640 1 --2- 172.21.15.33:0/285549676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa90121b0 0x55faa93dd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f948759e640 1 -- 172.21.15.33:0/285549676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 msgr2=0x55faa93e1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:56.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f948759e640 1 --2- 172.21.15.33:0/285549676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 0x55faa93e1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.030+0000 7f948759e640 1 -- 172.21.15.33:0/285549676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faa93eaa00 con 0x55faa901a390 2024-08-28T19:43:56.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.031+0000 7f948759e640 1 --2- 172.21.15.33:0/285549676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93ddcc0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f9480035000 tx=0x7f9480041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dca27ab6ec541f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:56.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.031+0000 7f946cff9640 1 -- 172.21.15.33:0/285549676 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948002f660 con 0x55faa901a390 2024-08-28T19:43:56.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.031+0000 7f946cff9640 1 -- 172.21.15.33:0/285549676 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9480036050 con 0x55faa901a390 2024-08-28T19:43:56.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.031+0000 7f946cff9640 1 -- 172.21.15.33:0/285549676 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480030b30 con 0x55faa901a390 2024-08-28T19:43:56.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:55 smithi059 ceph-mon[22052]: pgmap v696: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 75 KiB/s wr, 18 op/s 2024-08-28T19:43:56.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:55 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:43:56.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:55 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:56.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:55 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:43:56.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:55 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 -- 172.21.15.33:0/285549676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 msgr2=0x55faa93ddcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:56.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 --2- 172.21.15.33:0/285549676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93ddcc0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f9480035000 tx=0x7f9480041000 comp rx=0 tx=0).stop 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 -- 172.21.15.33:0/285549676 shutdown_connections 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 --2- 172.21.15.33:0/285549676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa901a390 0x55faa93ddcc0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 --2- 172.21.15.33:0/285549676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa90121b0 0x55faa93dd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 --2- 172.21.15.33:0/285549676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 0x55faa93e1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 -- 172.21.15.33:0/285549676 >> 172.21.15.33:0/285549676 conn(0x55faa902f460 msgr2=0x55faa93e12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 -- 172.21.15.33:0/285549676 shutdown_connections 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 -- 172.21.15.33:0/285549676 wait complete. 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 -- start start 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.032+0000 7f94937b2740 1 Processor -- start 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f94937b2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 0x55faa93f8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f94937b2740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f94937b2740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa901a390 0x55faa93f5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f94937b2740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f94881afe30 con 0x55faa90121b0 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f94937b2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94881af760 con 0x55faa8ff99f0 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f94937b2740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94881ac9c0 con 0x55faa901a390 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f94937b2740 10 client.0 _ll_register_callbacks cb 0x7f947c009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f948659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f948659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93f4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36122/0 (socket says 172.21.15.33:36122) 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f948659c640 1 -- 172.21.15.33:0/292529040 learned_addr learned my addr 172.21.15.33:0/292529040 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f948759e640 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa901a390 0x55faa93f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f9486d9d640 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 0x55faa93f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f948659c640 1 -- 172.21.15.33:0/292529040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa901a390 msgr2=0x55faa93f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f948659c640 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa901a390 0x55faa93f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f948659c640 1 -- 172.21.15.33:0/292529040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 msgr2=0x55faa93f8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f948659c640 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 0x55faa93f8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f948659c640 1 -- 172.21.15.33:0/292529040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faa93f55d0 con 0x55faa90121b0 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f9486d9d640 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 0x55faa93f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f948659c640 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93f4b20 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f947c0a7270 tx=0x7f947c0ab160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebd79db98239e70 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f946aff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f946aff5640 1 -- 172.21.15.33:0/292529040 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c05b020 con 0x55faa90121b0 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f946aff5640 1 -- 172.21.15.33:0/292529040 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9453+0+0 (secure 0 0 0) 0x7f947c05b1c0 con 0x55faa90121b0 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.033+0000 7f94937b2740 1 -- 172.21.15.33:0/292529040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9480036050 con 0x55faa90121b0 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f946aff5640 1 -- 172.21.15.33:0/292529040 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f947c020040 con 0x55faa90121b0 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f94937b2740 10 client.18819 fetch_fsmap learned FSMap version 28 2024-08-28T19:43:56.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f94937b2740 1 -- 172.21.15.33:0/292529040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55faa946d6e0 con 0x55faa90121b0 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f946aff5640 1 -- 172.21.15.33:0/292529040 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9480036050 con 0x55faa90121b0 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f946aff5640 1 -- 172.21.15.33:0/292529040 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f947c0d2110 con 0x55faa90121b0 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f94937b2740 10 client.18819 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f94937b2740 10 client.18819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f94937b2740 20 client.18819 populate_metadata read hostname 'smithi033' 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f94937b2740 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55faa903b070 0x55faa946fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f94937b2740 4 client.18819 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f94937b2740 1 -- 172.21.15.33:0/292529040 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55faa9355020 con 0x55faa903b070 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.034+0000 7f9486d9d640 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55faa903b070 0x55faa946fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f946aff5640 10 client.18819 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f9486d9d640 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55faa903b070 0x55faa946fe10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=549e82371275264b server_cookie=b731d8b576504e11 in_seq=0 out_seq=0 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f946aff5640 1 -- 172.21.15.33:0/292529040 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x55faa9355020 con 0x55faa903b070 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f946aff5640 10 client.18819 handle_command_reply: tid=0 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 client.18819 shutdown 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 -- 172.21.15.33:0/292529040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 msgr2=0x55faa93f4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93f4b20 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f947c0a7270 tx=0x7f947c0ab160 comp rx=0 tx=0).stop 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 -- 172.21.15.33:0/292529040 shutdown_connections 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55faa901a390 0x55faa93f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55faa903b070 0x55faa946fe10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55faa90121b0 0x55faa93f4b20 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 --2- 172.21.15.33:0/292529040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55faa8ff99f0 0x55faa93f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f946aff5640 0 client.18819 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:43:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 -- 172.21.15.33:0/292529040 >> 172.21.15.33:0/292529040 conn(0x55faa902f460 msgr2=0x55faa93f1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 -- 172.21.15.33:0/292529040 shutdown_connections 2024-08-28T19:43:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 1 -- 172.21.15.33:0/292529040 wait complete. 2024-08-28T19:43:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.035+0000 7f94937b2740 20 client.18819 trim_cache size 0 max 16384 2024-08-28T19:43:56.044 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:43:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:43:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:43:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:43:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.044 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "f5ea7231-3e1a-4401-bac3-5b2c26666b1f", 2024-08-28T19:43:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:43:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:43:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:43:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:43:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.045 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.046 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.047 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.048 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.049 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:43:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:43:56.051 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.052 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.053 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:43:56.054 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:43:56.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:43:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:56.057 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:43:56.057 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:43:56.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 -- 172.21.15.33:0/3894600688 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94700b4ca0 msgr2=0x7f94700b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:56.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94700b4ca0 0x7f94700b71b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f948002f500 tx=0x7f948002f370 comp rx=0 tx=0).stop 2024-08-28T19:43:56.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 -- 172.21.15.33:0/3894600688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9488108140 msgr2=0x7f948819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:43:56.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9488108140 0x7f948819a750 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f947c00d740 tx=0x7f947c00dc00 comp rx=0 tx=0).stop 2024-08-28T19:43:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 -- 172.21.15.33:0/3894600688 shutdown_connections 2024-08-28T19:43:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94700b4ca0 0x7f94700b71b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9488108a90 0x7f948819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9488108140 0x7f948819a750 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 --2- 172.21.15.33:0/3894600688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9488102800 0x7f948819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:43:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 -- 172.21.15.33:0/3894600688 >> 172.21.15.33:0/3894600688 conn(0x7f94880794d0 msgr2=0x7f9488104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:43:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 -- 172.21.15.33:0/3894600688 shutdown_connections 2024-08-28T19:43:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:43:56.036+0000 7f948d23d640 1 -- 172.21.15.33:0/3894600688 wait complete. 2024-08-28T19:43:56.061 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:55 smithi122 ceph-mon[22174]: pgmap v696: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 75 KiB/s wr, 18 op/s 2024-08-28T19:43:56.061 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:55 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:43:56.061 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:55 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:56.061 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:55 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:43:56.061 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:55 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:43:56.818 INFO:tasks.cephfs.filesystem:scrub status for tag:f5ea7231-3e1a-4401-bac3-5b2c26666b1f - {'path': '/', 'tag': 'f5ea7231-3e1a-4401-bac3-5b2c26666b1f', 'options': 'recursive,force'} 2024-08-28T19:43:58.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:57 smithi059 ceph-mon[22052]: pgmap v697: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 13 op/s 2024-08-28T19:43:58.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:57 smithi122 ceph-mon[22174]: pgmap v697: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 13 op/s 2024-08-28T19:43:58.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:57 smithi033 ceph-mon[18549]: pgmap v697: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 13 op/s 2024-08-28T19:44:00.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:59 smithi059 ceph-mon[22052]: pgmap v698: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 76 KiB/s wr, 17 op/s 2024-08-28T19:44:00.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:43:59 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:44:00.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:59 smithi122 ceph-mon[22174]: pgmap v698: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 76 KiB/s wr, 17 op/s 2024-08-28T19:44:00.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:43:59 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:44:00.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:59 smithi033 ceph-mon[18549]: pgmap v698: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 76 KiB/s wr, 17 op/s 2024-08-28T19:44:00.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:43:59 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:44:02.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:01 smithi059 ceph-mon[22052]: pgmap v699: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-08-28T19:44:02.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:01 smithi122 ceph-mon[22174]: pgmap v699: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-08-28T19:44:02.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:01 smithi033 ceph-mon[18549]: pgmap v699: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-08-28T19:44:03.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:02 smithi059 ceph-mon[22052]: pgmap v700: 129 pgs: 129 active+clean; 17 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-08-28T19:44:03.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:02 smithi122 ceph-mon[22174]: pgmap v700: 129 pgs: 129 active+clean; 17 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-08-28T19:44:03.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:02 smithi033 ceph-mon[18549]: pgmap v700: 129 pgs: 129 active+clean; 17 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-08-28T19:44:04.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:44:04.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:44:04.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:44:04.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:44:04.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:44:04.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:44:04.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:44:04.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:44:04.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:44:04.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:44:04.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:44:04.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:44:05.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:04 smithi059 ceph-mon[22052]: pgmap v701: 129 pgs: 129 active+clean; 17 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 121 KiB/s wr, 35 op/s 2024-08-28T19:44:05.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:04 smithi122 ceph-mon[22174]: pgmap v701: 129 pgs: 129 active+clean; 17 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 121 KiB/s wr, 35 op/s 2024-08-28T19:44:05.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:04 smithi033 ceph-mon[18549]: pgmap v701: 129 pgs: 129 active+clean; 17 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 121 KiB/s wr, 35 op/s 2024-08-28T19:44:05.933 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:05 smithi059 ceph-mon[22052]: osdmap e95: 12 total, 12 up, 12 in 2024-08-28T19:44:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:05 smithi122 ceph-mon[22174]: osdmap e95: 12 total, 12 up, 12 in 2024-08-28T19:44:06.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:05 smithi033 ceph-mon[18549]: osdmap e95: 12 total, 12 up, 12 in 2024-08-28T19:44:07.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:06 smithi059 ceph-mon[22052]: pgmap v703: 129 pgs: 129 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 116 KiB/s wr, 36 op/s 2024-08-28T19:44:07.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:06 smithi122 ceph-mon[22174]: pgmap v703: 129 pgs: 129 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 116 KiB/s wr, 36 op/s 2024-08-28T19:44:07.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:06 smithi033 ceph-mon[18549]: pgmap v703: 129 pgs: 129 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 116 KiB/s wr, 36 op/s 2024-08-28T19:44:09.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:09 smithi033 ceph-mon[18549]: pgmap v704: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 117 KiB/s wr, 37 op/s 2024-08-28T19:44:09.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:09 smithi059 ceph-mon[22052]: pgmap v704: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 117 KiB/s wr, 37 op/s 2024-08-28T19:44:09.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:09 smithi122 ceph-mon[22174]: pgmap v704: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 117 KiB/s wr, 37 op/s 2024-08-28T19:44:11.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:11 smithi033 ceph-mon[18549]: pgmap v705: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 117 KiB/s wr, 36 op/s 2024-08-28T19:44:11.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:11 smithi059 ceph-mon[22052]: pgmap v705: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 117 KiB/s wr, 36 op/s 2024-08-28T19:44:11.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:11 smithi122 ceph-mon[22174]: pgmap v705: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 117 KiB/s wr, 36 op/s 2024-08-28T19:44:13.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:13 smithi033 ceph-mon[18549]: pgmap v706: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 117 KiB/s wr, 36 op/s 2024-08-28T19:44:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:13 smithi059 ceph-mon[22052]: pgmap v706: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 117 KiB/s wr, 36 op/s 2024-08-28T19:44:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:13 smithi122 ceph-mon[22174]: pgmap v706: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 117 KiB/s wr, 36 op/s 2024-08-28T19:44:15.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:15 smithi059 ceph-mon[22052]: pgmap v707: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 16 op/s 2024-08-28T19:44:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:15 smithi059 ceph-mon[22052]: osdmap e96: 12 total, 12 up, 12 in 2024-08-28T19:44:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:15 smithi122 ceph-mon[22174]: pgmap v707: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 16 op/s 2024-08-28T19:44:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:15 smithi122 ceph-mon[22174]: osdmap e96: 12 total, 12 up, 12 in 2024-08-28T19:44:15.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:15 smithi033 ceph-mon[18549]: pgmap v707: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 16 op/s 2024-08-28T19:44:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:15 smithi033 ceph-mon[18549]: osdmap e96: 12 total, 12 up, 12 in 2024-08-28T19:44:17.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:17 smithi059 ceph-mon[22052]: pgmap v709: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 16 op/s 2024-08-28T19:44:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:17 smithi122 ceph-mon[22174]: pgmap v709: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 16 op/s 2024-08-28T19:44:17.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:17 smithi033 ceph-mon[18549]: pgmap v709: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 16 op/s 2024-08-28T19:44:19.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:19 smithi059 ceph-mon[22052]: pgmap v710: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-08-28T19:44:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:19 smithi122 ceph-mon[22174]: pgmap v710: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-08-28T19:44:19.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:19 smithi033 ceph-mon[18549]: pgmap v710: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-08-28T19:44:21.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:21 smithi059 ceph-mon[22052]: pgmap v711: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-08-28T19:44:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:21 smithi122 ceph-mon[22174]: pgmap v711: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-08-28T19:44:21.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:21 smithi033 ceph-mon[18549]: pgmap v711: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-08-28T19:44:23.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:23 smithi059 ceph-mon[22052]: pgmap v712: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-08-28T19:44:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:23 smithi122 ceph-mon[22174]: pgmap v712: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-08-28T19:44:23.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:23 smithi033 ceph-mon[18549]: pgmap v712: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 16 op/s 2024-08-28T19:44:25.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:25 smithi059 ceph-mon[22052]: pgmap v713: 129 pgs: 129 active+clean; 18 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-08-28T19:44:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:25 smithi122 ceph-mon[22174]: pgmap v713: 129 pgs: 129 active+clean; 18 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-08-28T19:44:25.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:25 smithi033 ceph-mon[18549]: pgmap v713: 129 pgs: 129 active+clean; 18 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-08-28T19:44:26.622 INFO:tasks.workunit.client.0.smithi033.stdout:375/600: open fd = 3 2024-08-28T19:44:26.622 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.622 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.622 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:376/600: open fd = 3 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:377/600: open fd = 3 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:378/600: open fd = 3 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.623 INFO:tasks.workunit.client.0.smithi033.stdout:379/600: open fd = 3 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:380/600: open fd = 3 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:381/600: open fd = 3 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.624 INFO:tasks.workunit.client.0.smithi033.stdout:382/600: open fd = 3 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:383/600: open fd = 3 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:384/600: open fd = 3 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.625 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:385/600: open fd = 3 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:386/600: open fd = 3 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:387/600: open fd = 3 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:388/600: open fd = 3 2024-08-28T19:44:26.626 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:389/600: open fd = 3 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:390/600: open fd = 3 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:391/600: open fd = 3 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.627 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:392/600: open fd = 3 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:393/600: open fd = 3 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:394/600: open fd = 3 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.628 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:395/600: open fd = 3 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:396/600: open fd = 3 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:397/600: open fd = 3 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.629 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.630 INFO:tasks.workunit.client.0.smithi033.stdout:398/600: open fd = 3 2024-08-28T19:44:26.630 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.630 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.630 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.630 INFO:tasks.workunit.client.0.smithi033.stdout:399/600: open fd = 3 2024-08-28T19:44:26.630 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.630 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.630 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.630 INFO:tasks.workunit.client.0.smithi033.stdout:400/600: open fd = 3 2024-08-28T19:44:26.630 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:401/600: open fd = 3 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:402/600: open fd = 3 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:403/600: open fd = 3 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.631 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:404/600: open fd = 3 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:405/600: open fd = 3 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:406/600: open fd = 3 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.632 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:407/600: open fd = 3 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:408/600: open fd = 3 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:409/600: open fd = 3 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.633 INFO:tasks.workunit.client.0.smithi033.stdout:410/600: open fd = 3 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:411/600: open fd = 3 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:412/600: open fd = 3 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:413/600: open fd = 3 2024-08-28T19:44:26.634 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:414/600: open fd = 3 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:415/600: open fd = 3 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:416/600: open fd = 3 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.635 INFO:tasks.workunit.client.0.smithi033.stdout:417/600: open fd = 3 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:418/600: open fd = 3 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:419/600: open fd = 3 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:420/600: open fd = 3 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.636 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:421/600: open fd = 3 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:422/600: open fd = 3 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:423/600: open fd = 3 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.637 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:424/600: open fd = 3 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:425/600: open fd = 3 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:426/600: open fd = 3 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.638 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:427/600: open fd = 3 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:428/600: open fd = 3 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:429/600: open fd = 3 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.639 INFO:tasks.workunit.client.0.smithi033.stdout:430/600: open fd = 3 2024-08-28T19:44:26.640 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.640 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.640 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.640 INFO:tasks.workunit.client.0.smithi033.stdout:431/600: open fd = 3 2024-08-28T19:44:26.640 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.640 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.640 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.640 INFO:tasks.workunit.client.0.smithi033.stdout:432/600: open fd = 3 2024-08-28T19:44:26.640 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.640 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:433/600: open fd = 3 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:434/600: open fd = 3 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:435/600: open fd = 3 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.641 INFO:tasks.workunit.client.0.smithi033.stdout:436/600: open fd = 3 2024-08-28T19:44:26.642 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.642 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:44:26.642 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:44:26.819 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:44:27.086 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:27.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.601+0000 7f74bb05f640 1 -- 172.21.15.33:0/587563375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b4103930 msgr2=0x7f74b4103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:27.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.601+0000 7f74bb05f640 1 --2- 172.21.15.33:0/587563375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b4103930 0x7f74b4103d40 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009900 tx=0x7f74a402a410 comp rx=0 tx=0).stop 2024-08-28T19:44:27.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.601+0000 7f74bb05f640 1 -- 172.21.15.33:0/587563375 shutdown_connections 2024-08-28T19:44:27.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.601+0000 7f74bb05f640 1 --2- 172.21.15.33:0/587563375 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74b4109bc0 0x7f74b41103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.601+0000 7f74bb05f640 1 --2- 172.21.15.33:0/587563375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b4109270 0x7f74b4109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.601+0000 7f74bb05f640 1 --2- 172.21.15.33:0/587563375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b4103930 0x7f74b4103d40 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.601+0000 7f74bb05f640 1 -- 172.21.15.33:0/587563375 >> 172.21.15.33:0/587563375 conn(0x7f74b40ff3a0 msgr2=0x7f74b41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.601+0000 7f74bb05f640 1 -- 172.21.15.33:0/587563375 shutdown_connections 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.601+0000 7f74bb05f640 1 -- 172.21.15.33:0/587563375 wait complete. 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74bb05f640 1 Processor -- start 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74bb05f640 1 -- start start 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74bb05f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b4103930 0x7f74b419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74bb05f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b4109270 0x7f74b419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74bb05f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74b4109bc0 0x7f74b419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74bb05f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4113880 con 0x7f74b4109270 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74bb05f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4113700 con 0x7f74b4103930 2024-08-28T19:44:27.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74bb05f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4113a00 con 0x7f74b4109bc0 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b4109270 0x7f74b419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b4109270 0x7f74b419a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51330/0 (socket says 172.21.15.33:51330) 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.602+0000 7f74b3fff640 1 -- 172.21.15.33:0/1499806061 learned_addr learned my addr 172.21.15.33:0/1499806061 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b4103930 0x7f74b419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b3fff640 1 -- 172.21.15.33:0/1499806061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74b4109bc0 msgr2=0x7f74b419fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b3fff640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74b4109bc0 0x7f74b419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b3fff640 1 -- 172.21.15.33:0/1499806061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b4103930 msgr2=0x7f74b419a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b3fff640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b4103930 0x7f74b419a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b3fff640 1 -- 172.21.15.33:0/1499806061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b41a01e0 con 0x7f74b4109270 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b4103930 0x7f74b419a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b3fff640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b4109270 0x7f74b419a810 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c970 tx=0x7f74a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b1ffb640 1 -- 172.21.15.33:0/1499806061 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8007bb0 con 0x7f74b4109270 2024-08-28T19:44:27.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74bb05f640 1 -- 172.21.15.33:0/1499806061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b41a04d0 con 0x7f74b4109270 2024-08-28T19:44:27.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b1ffb640 1 -- 172.21.15.33:0/1499806061 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74a8007d50 con 0x7f74b4109270 2024-08-28T19:44:27.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74b1ffb640 1 -- 172.21.15.33:0/1499806061 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8004e10 con 0x7f74b4109270 2024-08-28T19:44:27.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.603+0000 7f74bb05f640 1 -- 172.21.15.33:0/1499806061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b41a6c30 con 0x7f74b4109270 2024-08-28T19:44:27.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.606+0000 7f74c15d4740 1 Processor -- start 2024-08-28T19:44:27.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.606+0000 7f74b1ffb640 1 -- 172.21.15.33:0/1499806061 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f74a8005000 con 0x7f74b4109270 2024-08-28T19:44:27.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.606+0000 7f74c15d4740 1 -- start start 2024-08-28T19:44:27.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c63800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c63d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74c15d4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e112bda630 con 0x55e1128951b0 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74c15d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e112bc9bc0 con 0x55e1128be070 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74c15d4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e112bcdb70 con 0x55e11289d390 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b8dfb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c63800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b8dfb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c63800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51338/0 (socket says 172.21.15.33:51338) 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b8dfb640 1 -- 172.21.15.33:0/2545471072 learned_addr learned my addr 172.21.15.33:0/2545471072 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b95fc640 1 --2- 172.21.15.33:0/2545471072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b3fff640 1 --2- 172.21.15.33:0/2545471072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c63d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b8dfb640 1 -- 172.21.15.33:0/2545471072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 msgr2=0x55e112c63d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/2545471072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c63d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b8dfb640 1 -- 172.21.15.33:0/2545471072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 msgr2=0x55e112c632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:27.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/2545471072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b8dfb640 1 -- 172.21.15.33:0/2545471072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e112929650 con 0x55e1128951b0 2024-08-28T19:44:27.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b95fc640 1 --2- 172.21.15.33:0/2545471072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:44:27.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.607+0000 7f74b1ffb640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f749c0b4ca0 0x7f749c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.608+0000 7f74b95fc640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f749c0b4ca0 0x7f749c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.608+0000 7f74b1ffb640 1 -- 172.21.15.33:0/1499806061 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f74a80e5720 con 0x7f74b4109270 2024-08-28T19:44:27.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.608+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/2545471072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c63800 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f74a4000c00 tx=0x7f74a4032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2fae7396119f60 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:27.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.608+0000 7f749affd640 1 -- 172.21.15.33:0/2545471072 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a403f070 con 0x55e1128951b0 2024-08-28T19:44:27.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.608+0000 7f749affd640 1 -- 172.21.15.33:0/2545471072 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74a40316a0 con 0x55e1128951b0 2024-08-28T19:44:27.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.608+0000 7f749affd640 1 -- 172.21.15.33:0/2545471072 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4035070 con 0x55e1128951b0 2024-08-28T19:44:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74c15d4740 1 -- 172.21.15.33:0/2545471072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 msgr2=0x55e112c63800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74c15d4740 1 --2- 172.21.15.33:0/2545471072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c63800 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f74a4000c00 tx=0x7f74a4032d00 comp rx=0 tx=0).stop 2024-08-28T19:44:27.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74b95fc640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f749c0b4ca0 0x7f749c0b71b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009270 tx=0x7f74ac0095e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74c15d4740 1 -- 172.21.15.33:0/2545471072 shutdown_connections 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74c15d4740 1 --2- 172.21.15.33:0/2545471072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c63d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74c15d4740 1 --2- 172.21.15.33:0/2545471072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c63800 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74c15d4740 1 --2- 172.21.15.33:0/2545471072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74c15d4740 1 -- 172.21.15.33:0/2545471072 >> 172.21.15.33:0/2545471072 conn(0x55e1128b2460 msgr2=0x55e112c611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74c15d4740 1 -- 172.21.15.33:0/2545471072 shutdown_connections 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74c15d4740 1 -- 172.21.15.33:0/2545471072 wait complete. 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.609+0000 7f74c15d4740 1 -- start start 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74c15d4740 1 Processor -- start 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c6ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c7ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74c15d4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e112a2c700 con 0x55e1128951b0 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74c15d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e112b50700 con 0x55e1128be070 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74c15d4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e112c71a40 con 0x55e11289d390 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74b8dfb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74c15d4740 10 client.0 _ll_register_callbacks cb 0x55e112b7fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74b8dfb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51346/0 (socket says 172.21.15.33:51346) 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74b8dfb640 1 -- 172.21.15.33:0/4263798676 learned_addr learned my addr 172.21.15.33:0/4263798676 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.610+0000 7f74b3fff640 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c6ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74b95fc640 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c7ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74b8dfb640 1 -- 172.21.15.33:0/4263798676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 msgr2=0x55e112c6ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c6ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74b8dfb640 1 -- 172.21.15.33:0/4263798676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 msgr2=0x55e112c7ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c7ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74b8dfb640 1 -- 172.21.15.33:0/4263798676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e112b898b0 con 0x55e1128951b0 2024-08-28T19:44:27.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74b3fff640 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c6ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6ea00 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f74a4033000 tx=0x7f74a40052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b201f65475a135b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f7493fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f7493fff640 1 -- 172.21.15.33:0/4263798676 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a403f070 con 0x55e1128951b0 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74c15d4740 1 -- 172.21.15.33:0/4263798676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74a40316a0 con 0x55e1128951b0 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f7493fff640 1 -- 172.21.15.33:0/4263798676 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f74a4004040 con 0x55e1128951b0 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f7493fff640 1 -- 172.21.15.33:0/4263798676 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f74a4055050 con 0x55e1128951b0 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74c15d4740 10 client.18831 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.611+0000 7f74c15d4740 1 -- 172.21.15.33:0/4263798676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e112c7d780 con 0x55e1128951b0 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f7493fff640 1 -- 172.21.15.33:0/4263798676 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74a40316a0 con 0x55e1128951b0 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f7493fff640 1 -- 172.21.15.33:0/4263798676 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f74a404f4f0 con 0x55e1128951b0 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f74c15d4740 10 client.18831 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f74c15d4740 10 client.18831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f74c15d4740 20 client.18831 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f74c15d4740 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e11287c9f0 0x55e112c80ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f74c15d4740 4 client.18831 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f74c15d4740 1 -- 172.21.15.33:0/4263798676 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e112bdc580 con 0x55e11287c9f0 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f74b3fff640 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e11287c9f0 0x55e112c80ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f74b3fff640 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e11287c9f0 0x55e112c80ae0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47d712e852d97f59 server_cookie=8de41a6abd767f5f in_seq=0 out_seq=0 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.612+0000 7f7493fff640 10 client.18831 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f7493fff640 1 -- 172.21.15.33:0/4263798676 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e112bdc580 con 0x55e11287c9f0 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f7493fff640 10 client.18831 handle_command_reply: tid=0 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f74c15d4740 1 client.18831 shutdown 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f74c15d4740 1 -- 172.21.15.33:0/4263798676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 msgr2=0x55e112c6ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f74c15d4740 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6ea00 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f74a4033000 tx=0x7f74a40052a0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f74c15d4740 1 -- 172.21.15.33:0/4263798676 shutdown_connections 2024-08-28T19:44:27.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f74c15d4740 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c7ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f74c15d4740 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c6ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f74c15d4740 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e11287c9f0 0x55e112c80ae0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f74c15d4740 1 --2- 172.21.15.33:0/4263798676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6ea00 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f74c15d4740 1 -- 172.21.15.33:0/4263798676 >> 172.21.15.33:0/4263798676 conn(0x55e1128b2460 msgr2=0x55e112c664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:27.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.613+0000 7f7493fff640 0 client.18831 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:27.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.614+0000 7f74c15d4740 1 -- 172.21.15.33:0/4263798676 shutdown_connections 2024-08-28T19:44:27.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.614+0000 7f74c15d4740 1 -- 172.21.15.33:0/4263798676 wait complete. 2024-08-28T19:44:27.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.614+0000 7f74c15d4740 20 client.18831 trim_cache size 0 max 16384 2024-08-28T19:44:27.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.632+0000 7f74c15d4740 1 Processor -- start 2024-08-28T19:44:27.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.632+0000 7f74c15d4740 1 -- start start 2024-08-28T19:44:27.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.632+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.632+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c6d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.632+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c663c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74c15d4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41aeb50 con 0x55e1128951b0 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74c15d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41b0690 con 0x55e1128be070 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74c15d4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41af220 con 0x55e11289d390 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b8dfb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b8dfb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51360/0 (socket says 172.21.15.33:51360) 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b8dfb640 1 -- 172.21.15.33:0/663343775 learned_addr learned my addr 172.21.15.33:0/663343775 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b95fc640 1 --2- 172.21.15.33:0/663343775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b3fff640 1 --2- 172.21.15.33:0/663343775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c6d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b8dfb640 1 -- 172.21.15.33:0/663343775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 msgr2=0x55e112c6d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/663343775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c6d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b8dfb640 1 -- 172.21.15.33:0/663343775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 msgr2=0x55e112c663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/663343775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c663c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b8dfb640 1 -- 172.21.15.33:0/663343775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e112c86dd0 con 0x55e1128951b0 2024-08-28T19:44:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b3fff640 1 --2- 172.21.15.33:0/663343775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c6d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/663343775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6d280 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f74a4053040 tx=0x7f74a4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585cc85e055b6668 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f749a7fc640 1 -- 172.21.15.33:0/663343775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a403f070 con 0x55e1128951b0 2024-08-28T19:44:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f749a7fc640 1 -- 172.21.15.33:0/663343775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74a4048030 con 0x55e1128951b0 2024-08-28T19:44:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.633+0000 7f749a7fc640 1 -- 172.21.15.33:0/663343775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4035040 con 0x55e1128951b0 2024-08-28T19:44:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.634+0000 7f74c15d4740 1 -- 172.21.15.33:0/663343775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 msgr2=0x55e112c6d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:27.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.634+0000 7f74c15d4740 1 --2- 172.21.15.33:0/663343775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6d280 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f74a4053040 tx=0x7f74a4001e70 comp rx=0 tx=0).stop 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.634+0000 7f74c15d4740 1 -- 172.21.15.33:0/663343775 shutdown_connections 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.634+0000 7f74c15d4740 1 --2- 172.21.15.33:0/663343775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c663c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.634+0000 7f74c15d4740 1 --2- 172.21.15.33:0/663343775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e11289d390 0x55e112c6d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.634+0000 7f74c15d4740 1 --2- 172.21.15.33:0/663343775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e1128951b0 0x55e112c6d280 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.634+0000 7f74c15d4740 1 -- 172.21.15.33:0/663343775 >> 172.21.15.33:0/663343775 conn(0x55e1128b2460 msgr2=0x55e112c69b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.634+0000 7f74c15d4740 1 -- 172.21.15.33:0/663343775 shutdown_connections 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.634+0000 7f74c15d4740 1 -- 172.21.15.33:0/663343775 wait complete. 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74c15d4740 1 -- start start 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74c15d4740 1 Processor -- start 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1128951b0 0x55e112c842d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e11289d390 0x55e112c817a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74c15d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c81ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74c15d4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41affc0 con 0x55e11289d390 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74c15d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41af8f0 con 0x55e1128be070 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74c15d4740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41acb50 con 0x55e1128951b0 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74c15d4740 10 client.0 _ll_register_callbacks cb 0x7f74ac009500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e11289d390 0x55e112c817a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.635+0000 7f74b8dfb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1128951b0 0x55e112c842d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74b95fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c81ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74b8dfb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1128951b0 0x55e112c842d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:60532/0 (socket says 172.21.15.33:60532) 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74b8dfb640 1 -- 172.21.15.33:0/2173415464 learned_addr learned my addr 172.21.15.33:0/2173415464 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74b3fff640 1 -- 172.21.15.33:0/2173415464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1128951b0 msgr2=0x55e112c842d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74b3fff640 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1128951b0 0x55e112c842d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74b3fff640 1 -- 172.21.15.33:0/2173415464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 msgr2=0x55e112c81ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74b3fff640 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c81ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74b3fff640 1 -- 172.21.15.33:0/2173415464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e112c82450 con 0x55e11289d390 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74b3fff640 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e11289d390 0x55e112c817a0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f74a80e2ad0 tx=0x7f74a80e9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df58efcb926e2a8f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f7493fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f7493fff640 1 -- 172.21.15.33:0/2173415464 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a801d040 con 0x55e11289d390 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f7493fff640 1 -- 172.21.15.33:0/2173415464 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f74a80a7d00 con 0x55e11289d390 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74c15d4740 1 -- 172.21.15.33:0/2173415464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74a4048030 con 0x55e11289d390 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f7493fff640 1 -- 172.21.15.33:0/2173415464 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f74a80a7200 con 0x55e11289d390 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74c15d4740 10 client.18837 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.636+0000 7f74c15d4740 1 -- 172.21.15.33:0/2173415464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e112ceb190 con 0x55e11289d390 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.637+0000 7f7493fff640 1 -- 172.21.15.33:0/2173415464 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74a4048030 con 0x55e11289d390 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.637+0000 7f7493fff640 1 -- 172.21.15.33:0/2173415464 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f74a80efc20 con 0x55e11289d390 2024-08-28T19:44:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.637+0000 7f74c15d4740 10 client.18837 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.637+0000 7f74c15d4740 10 client.18837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.637+0000 7f74c15d4740 20 client.18837 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.637+0000 7f74c15d4740 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e112851da0 0x55e112ced900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.637+0000 7f74c15d4740 4 client.18837 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.637+0000 7f74c15d4740 1 -- 172.21.15.33:0/2173415464 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e112bd8020 con 0x55e112851da0 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.637+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e112851da0 0x55e112ced900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f7493fff640 10 client.18837 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74b8dfb640 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e112851da0 0x55e112ced900 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=572140ffb3e129f9 server_cookie=17f4fec94b331cf9 in_seq=0 out_seq=0 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f7493fff640 1 -- 172.21.15.33:0/2173415464 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x55e112bd8020 con 0x55e112851da0 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f7493fff640 10 client.18837 handle_command_reply: tid=0 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 client.18837 shutdown 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 -- 172.21.15.33:0/2173415464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e11289d390 msgr2=0x55e112c817a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e11289d390 0x55e112c817a0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f74a80e2ad0 tx=0x7f74a80e9040 comp rx=0 tx=0).stop 2024-08-28T19:44:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 -- 172.21.15.33:0/2173415464 shutdown_connections 2024-08-28T19:44:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1128be070 0x55e112c81ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e112851da0 0x55e112ced900 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e11289d390 0x55e112c817a0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 --2- 172.21.15.33:0/2173415464 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e1128951b0 0x55e112c842d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 -- 172.21.15.33:0/2173415464 >> 172.21.15.33:0/2173415464 conn(0x55e1128b2460 msgr2=0x55e112c6cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f7493fff640 0 client.18837 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 -- 172.21.15.33:0/2173415464 shutdown_connections 2024-08-28T19:44:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.638+0000 7f74c15d4740 1 -- 172.21.15.33:0/2173415464 wait complete. 2024-08-28T19:44:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74c15d4740 20 client.18837 trim_cache size 0 max 16384 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.647 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.648 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:44:27.649 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.650 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.651 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.653 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:44:27.654 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.655 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:44:27.656 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:27.658 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:27.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:27.659 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:27.659 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:44:27.659 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:44:27.659 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:44:27.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 -- 172.21.15.33:0/1499806061 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f749c0b4ca0 msgr2=0x7f749c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f749c0b4ca0 0x7f749c0b71b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009270 tx=0x7f74ac0095e0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 -- 172.21.15.33:0/1499806061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b4109270 msgr2=0x7f74b419a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b4109270 0x7f74b419a810 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c970 tx=0x7f74a800ce30 comp rx=0 tx=0).stop 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 -- 172.21.15.33:0/1499806061 shutdown_connections 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f749c0b4ca0 0x7f749c0b71b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f74b4109bc0 0x7f74b419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74b4109270 0x7f74b419a810 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 --2- 172.21.15.33:0/1499806061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b4103930 0x7f74b419a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 -- 172.21.15.33:0/1499806061 >> 172.21.15.33:0/1499806061 conn(0x7f74b40ff3a0 msgr2=0x7f74b41017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 -- 172.21.15.33:0/1499806061 shutdown_connections 2024-08-28T19:44:27.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:27.639+0000 7f74bb05f640 1 -- 172.21.15.33:0/1499806061 wait complete. 2024-08-28T19:44:27.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:27 smithi059 ceph-mon[22052]: pgmap v714: 129 pgs: 129 active+clean; 18 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-08-28T19:44:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:27 smithi122 ceph-mon[22174]: pgmap v714: 129 pgs: 129 active+clean; 18 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-08-28T19:44:27.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:27 smithi033 ceph-mon[18549]: pgmap v714: 129 pgs: 129 active+clean; 18 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-08-28T19:44:28.429 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:44:28.429 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:44:28.688 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.223+0000 7f743677d640 1 -- 172.21.15.33:0/1203349083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7430102880 msgr2=0x7f7430102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.223+0000 7f743677d640 1 --2- 172.21.15.33:0/1203349083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7430102880 0x7f7430102c90 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f7420009900 tx=0x7f742002a410 comp rx=0 tx=0).stop 2024-08-28T19:44:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.223+0000 7f743677d640 1 -- 172.21.15.33:0/1203349083 shutdown_connections 2024-08-28T19:44:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.223+0000 7f743677d640 1 --2- 172.21.15.33:0/1203349083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7430108ac0 0x7f743010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.223+0000 7f743677d640 1 --2- 172.21.15.33:0/1203349083 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430108170 0x7f7430108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.223+0000 7f743677d640 1 --2- 172.21.15.33:0/1203349083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7430102880 0x7f7430102c90 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.223+0000 7f743677d640 1 -- 172.21.15.33:0/1203349083 >> 172.21.15.33:0/1203349083 conn(0x7f7430079530 msgr2=0x7f7430079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.223+0000 7f743677d640 1 -- 172.21.15.33:0/1203349083 shutdown_connections 2024-08-28T19:44:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.223+0000 7f743677d640 1 -- 172.21.15.33:0/1203349083 wait complete. 2024-08-28T19:44:29.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f743677d640 1 Processor -- start 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f743677d640 1 -- start start 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f743677d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7430102880 0x7f743019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f743677d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430108170 0x7f743019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f743677d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7430108ac0 0x7f743019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f743677d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f74301127c0 con 0x7f7430108ac0 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f743677d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7430112640 con 0x7f7430102880 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f743677d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7430112940 con 0x7f7430108170 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f7434d1a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7430108ac0 0x7f743019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f7434d1a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7430108ac0 0x7f743019fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38348/0 (socket says 172.21.15.33:38348) 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f7434d1a640 1 -- 172.21.15.33:0/3725334802 learned_addr learned my addr 172.21.15.33:0/3725334802 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:29.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f742ffff640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7430102880 0x7f743019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.224+0000 7f742f7fe640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430108170 0x7f743019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f7434d1a640 1 -- 172.21.15.33:0/3725334802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430108170 msgr2=0x7f743019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f7434d1a640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430108170 0x7f743019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f7434d1a640 1 -- 172.21.15.33:0/3725334802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7430102880 msgr2=0x7f743019a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f7434d1a640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7430102880 0x7f743019a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f7434d1a640 1 -- 172.21.15.33:0/3725334802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74301a0150 con 0x7f7430108ac0 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f7434d1a640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7430108ac0 0x7f743019fae0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f742800cce0 tx=0x7f742800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f742d7fa640 1 -- 172.21.15.33:0/3725334802 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742800f450 con 0x7f7430108ac0 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f742d7fa640 1 -- 172.21.15.33:0/3725334802 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f742800faa0 con 0x7f7430108ac0 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f742d7fa640 1 -- 172.21.15.33:0/3725334802 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428018b70 con 0x7f7430108ac0 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f743677d640 1 -- 172.21.15.33:0/3725334802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74301a0440 con 0x7f7430108ac0 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.225+0000 7f743677d640 1 -- 172.21.15.33:0/3725334802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74301a6c60 con 0x7f7430108ac0 2024-08-28T19:44:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.226+0000 7f743677d640 1 -- 172.21.15.33:0/3725334802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7430102c90 con 0x7f7430108ac0 2024-08-28T19:44:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.228+0000 7f742d7fa640 1 -- 172.21.15.33:0/3725334802 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7428018d10 con 0x7f7430108ac0 2024-08-28T19:44:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.228+0000 7f742d7fa640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74180b4cd0 0x7f74180b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.228+0000 7f742ffff640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74180b4cd0 0x7f74180b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.229+0000 7f742d7fa640 1 -- 172.21.15.33:0/3725334802 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f74280e5ec0 con 0x7f7430108ac0 2024-08-28T19:44:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.229+0000 7f742ffff640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74180b4cd0 0x7f74180b71e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7420031440 tx=0x7f7420031c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.232+0000 7f742d7fa640 1 -- 172.21.15.33:0/3725334802 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7428014030 con 0x7f7430108ac0 2024-08-28T19:44:29.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.458+0000 7f743677d640 1 -- 172.21.15.33:0/3725334802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f743019b3d0 con 0x7f7430108ac0 2024-08-28T19:44:29.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.459+0000 7f742d7fa640 1 -- 172.21.15.33:0/3725334802 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f743019b3d0 con 0x7f7430108ac0 2024-08-28T19:44:29.461 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:44:29.461 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:44:29.461 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:44:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.461+0000 7f743677d640 1 -- 172.21.15.33:0/3725334802 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74180b4cd0 msgr2=0x7f74180b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.461+0000 7f743677d640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74180b4cd0 0x7f74180b71e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7420031440 tx=0x7f7420031c90 comp rx=0 tx=0).stop 2024-08-28T19:44:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.461+0000 7f743677d640 1 -- 172.21.15.33:0/3725334802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7430108ac0 msgr2=0x7f743019fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.461+0000 7f743677d640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7430108ac0 0x7f743019fae0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f742800cce0 tx=0x7f742800a620 comp rx=0 tx=0).stop 2024-08-28T19:44:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.461+0000 7f743677d640 1 -- 172.21.15.33:0/3725334802 shutdown_connections 2024-08-28T19:44:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.461+0000 7f743677d640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7430108ac0 0x7f743019fae0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.461+0000 7f743677d640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74180b4cd0 0x7f74180b71e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.461+0000 7f743677d640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7430108170 0x7f743019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.461+0000 7f743677d640 1 --2- 172.21.15.33:0/3725334802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7430102880 0x7f743019a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.461+0000 7f743677d640 1 -- 172.21.15.33:0/3725334802 >> 172.21.15.33:0/3725334802 conn(0x7f7430079530 msgr2=0x7f7430101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.462+0000 7f743677d640 1 -- 172.21.15.33:0/3725334802 shutdown_connections 2024-08-28T19:44:29.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:29.462+0000 7f743677d640 1 -- 172.21.15.33:0/3725334802 wait complete. 2024-08-28T19:44:29.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:29 smithi059 ceph-mon[22052]: pgmap v715: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 76 KiB/s wr, 17 op/s 2024-08-28T19:44:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:29 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3725334802' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:44:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:29 smithi122 ceph-mon[22174]: pgmap v715: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 76 KiB/s wr, 17 op/s 2024-08-28T19:44:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:29 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3725334802' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:44:29.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:29 smithi033 ceph-mon[18549]: pgmap v715: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 76 KiB/s wr, 17 op/s 2024-08-28T19:44:29.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:29 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3725334802' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:44:30.225 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:44:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:31.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.010+0000 7f55a23e7640 1 -- 172.21.15.33:0/3900759903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f559c109240 msgr2=0x7f559c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:31.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.010+0000 7f55a23e7640 1 --2- 172.21.15.33:0/3900759903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f559c109240 0x7f559c109650 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f5590009900 tx=0x7f559002a410 comp rx=0 tx=0).stop 2024-08-28T19:44:31.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.010+0000 7f55a23e7640 1 -- 172.21.15.33:0/3900759903 shutdown_connections 2024-08-28T19:44:31.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.010+0000 7f55a23e7640 1 --2- 172.21.15.33:0/3900759903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f559c109b90 0x7f559c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.010+0000 7f55a23e7640 1 --2- 172.21.15.33:0/3900759903 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f559c109240 0x7f559c109650 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.010+0000 7f55a23e7640 1 --2- 172.21.15.33:0/3900759903 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f559c103900 0x7f559c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.010+0000 7f55a23e7640 1 -- 172.21.15.33:0/3900759903 >> 172.21.15.33:0/3900759903 conn(0x7f559c07b5f0 msgr2=0x7f559c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:31.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.011+0000 7f55a23e7640 1 -- 172.21.15.33:0/3900759903 shutdown_connections 2024-08-28T19:44:31.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.011+0000 7f55a23e7640 1 -- 172.21.15.33:0/3900759903 wait complete. 2024-08-28T19:44:31.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.011+0000 7f55a23e7640 1 Processor -- start 2024-08-28T19:44:31.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.011+0000 7f55a23e7640 1 -- start start 2024-08-28T19:44:31.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f55a23e7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f559c103900 0x7f559c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f55a23e7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f559c109240 0x7f559c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f55a23e7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f559c109b90 0x7f559c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f55a23e7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f559c113890 con 0x7f559c103900 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f55a23e7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f559c113710 con 0x7f559c109240 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f55a23e7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f559c113a10 con 0x7f559c109b90 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f559bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f559c103900 0x7f559c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f559bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f559c103900 0x7f559c19a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38366/0 (socket says 172.21.15.33:38366) 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f559bfff640 1 -- 172.21.15.33:0/2147747820 learned_addr learned my addr 172.21.15.33:0/2147747820 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f55a0984640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f559c109b90 0x7f559c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f559b7fe640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f559c109240 0x7f559c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f559bfff640 1 -- 172.21.15.33:0/2147747820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f559c109b90 msgr2=0x7f559c19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f559bfff640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f559c109b90 0x7f559c19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f559bfff640 1 -- 172.21.15.33:0/2147747820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f559c109240 msgr2=0x7f559c19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f559bfff640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f559c109240 0x7f559c19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.012+0000 7f559bfff640 1 -- 172.21.15.33:0/2147747820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c1a01f0 con 0x7f559c103900 2024-08-28T19:44:31.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.013+0000 7f559bfff640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f559c103900 0x7f559c19a280 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f558c00d770 tx=0x7f558c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:31.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.013+0000 7f55997fa640 1 -- 172.21.15.33:0/2147747820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c017070 con 0x7f559c103900 2024-08-28T19:44:31.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.013+0000 7f55a23e7640 1 -- 172.21.15.33:0/2147747820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c1a04e0 con 0x7f559c103900 2024-08-28T19:44:31.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.013+0000 7f55997fa640 1 -- 172.21.15.33:0/2147747820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f558c0054d0 con 0x7f559c103900 2024-08-28T19:44:31.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.013+0000 7f55997fa640 1 -- 172.21.15.33:0/2147747820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c004c30 con 0x7f559c103900 2024-08-28T19:44:31.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.013+0000 7f55a23e7640 1 -- 172.21.15.33:0/2147747820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c1a6c40 con 0x7f559c103900 2024-08-28T19:44:31.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.015+0000 7f55a895c740 1 Processor -- start 2024-08-28T19:44:31.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.015+0000 7f55997fa640 1 -- 172.21.15.33:0/2147747820 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f558c004e10 con 0x7f559c103900 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.015+0000 7f55a895c740 1 -- start start 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f55a895c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3d2070 0x55e96f777310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f55a895c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f777850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f55a895c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f777d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f55a895c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e96f6ee680 con 0x55e96f3b1390 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f55a895c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e96f6ddc10 con 0x55e96f3d2070 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f55a895c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e96f6e1bc0 con 0x55e96f3a91b0 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f559b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f777d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f559b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f777d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38378/0 (socket says 172.21.15.33:38378) 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f559b7fe640 1 -- 172.21.15.33:0/3051467215 learned_addr learned my addr 172.21.15.33:0/3051467215 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:31.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f559bfff640 1 --2- 172.21.15.33:0/3051467215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f777850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f55a0984640 1 --2- 172.21.15.33:0/3051467215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3d2070 0x55e96f777310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f55997fa640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f55840b4ca0 0x7f55840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f559b7fe640 1 -- 172.21.15.33:0/3051467215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 msgr2=0x55e96f777850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f559b7fe640 1 --2- 172.21.15.33:0/3051467215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f777850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f559b7fe640 1 -- 172.21.15.33:0/3051467215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3d2070 msgr2=0x55e96f777310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f559b7fe640 1 --2- 172.21.15.33:0/3051467215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3d2070 0x55e96f777310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f559b7fe640 1 -- 172.21.15.33:0/3051467215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e96f43d650 con 0x55e96f3b1390 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f559bfff640 1 --2- 172.21.15.33:0/3051467215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f777850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.016+0000 7f55a0984640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f55840b4ca0 0x7f55840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.017+0000 7f55997fa640 1 -- 172.21.15.33:0/2147747820 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f558c0e5350 con 0x7f559c103900 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.017+0000 7f559b7fe640 1 --2- 172.21.15.33:0/3051467215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f777d90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f5590009900 tx=0x7f5590000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a7c0f55a3f3595 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.017+0000 7f55827fc640 1 -- 172.21.15.33:0/3051467215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590040070 con 0x55e96f3b1390 2024-08-28T19:44:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.017+0000 7f55827fc640 1 -- 172.21.15.33:0/3051467215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5590005db0 con 0x55e96f3b1390 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.017+0000 7f55827fc640 1 -- 172.21.15.33:0/3051467215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590035040 con 0x55e96f3b1390 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a895c740 1 -- 172.21.15.33:0/3051467215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 msgr2=0x55e96f777d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a0984640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f55840b4ca0 0x7f55840b71b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f559400a4c0 tx=0x7f5594004b50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a895c740 1 --2- 172.21.15.33:0/3051467215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f777d90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f5590009900 tx=0x7f5590000bc0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a895c740 1 -- 172.21.15.33:0/3051467215 shutdown_connections 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a895c740 1 --2- 172.21.15.33:0/3051467215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f777d90 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a895c740 1 --2- 172.21.15.33:0/3051467215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f777850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a895c740 1 --2- 172.21.15.33:0/3051467215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3d2070 0x55e96f777310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a895c740 1 -- 172.21.15.33:0/3051467215 >> 172.21.15.33:0/3051467215 conn(0x55e96f3c6460 msgr2=0x55e96f775200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a895c740 1 -- 172.21.15.33:0/3051467215 shutdown_connections 2024-08-28T19:44:31.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a895c740 1 -- 172.21.15.33:0/3051467215 wait complete. 2024-08-28T19:44:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.018+0000 7f55a895c740 1 -- start start 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f55a895c740 1 Processor -- start 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f55a895c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f77e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f55a895c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f77ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f55a895c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3d2070 0x55e96f797530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f55a895c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e96f540700 con 0x55e96f3b1390 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f55a895c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e96f664750 con 0x55e96f3d2070 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f55a895c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e96f78e280 con 0x55e96f3a91b0 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f55a895c740 10 client.0 _ll_register_callbacks cb 0x55e96f693e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f559b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f77ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f559b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f77ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38394/0 (socket says 172.21.15.33:38394) 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f559b7fe640 1 -- 172.21.15.33:0/1913063834 learned_addr learned my addr 172.21.15.33:0/1913063834 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f55a0984640 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3d2070 0x55e96f797530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f559bfff640 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f77e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f559b7fe640 1 -- 172.21.15.33:0/1913063834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 msgr2=0x55e96f77e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f559b7fe640 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f77e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f559b7fe640 1 -- 172.21.15.33:0/1913063834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3d2070 msgr2=0x55e96f797530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f559b7fe640 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3d2070 0x55e96f797530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f559b7fe640 1 -- 172.21.15.33:0/1913063834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e96f69d900 con 0x55e96f3b1390 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.019+0000 7f559bfff640 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f77e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f559b7fe640 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f77ef20 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f5590005310 tx=0x7f5590005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35105c0c35d5bad8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f557b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f557b7fe640 1 -- 172.21.15.33:0/1913063834 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559004b020 con 0x55e96f3b1390 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f55a895c740 1 -- 172.21.15.33:0/1913063834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5590005db0 con 0x55e96f3b1390 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f557b7fe640 1 -- 172.21.15.33:0/1913063834 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f5590004750 con 0x55e96f3b1390 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f557b7fe640 1 -- 172.21.15.33:0/1913063834 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5590056050 con 0x55e96f3b1390 2024-08-28T19:44:31.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f55a895c740 10 client.18855 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f55a895c740 1 -- 172.21.15.33:0/1913063834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e96f799f80 con 0x55e96f3b1390 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f557b7fe640 1 -- 172.21.15.33:0/1913063834 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5590005db0 con 0x55e96f3b1390 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f557b7fe640 1 -- 172.21.15.33:0/1913063834 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f559003c9e0 con 0x55e96f3b1390 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f55a895c740 10 client.18855 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f55a895c740 10 client.18855 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f55a895c740 20 client.18855 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f55a895c740 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55e96f3909f0 0x55e96f79d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f55a895c740 4 client.18855 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.020+0000 7f55a895c740 1 -- 172.21.15.33:0/1913063834 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e96f6f05d0 con 0x55e96f3909f0 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.021+0000 7f559bfff640 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55e96f3909f0 0x55e96f79d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.021+0000 7f559bfff640 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55e96f3909f0 0x55e96f79d2e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=85736a05a29fca85 server_cookie=2cc708c64b068c76 in_seq=0 out_seq=0 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.021+0000 7f557b7fe640 10 client.18855 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:44:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f557b7fe640 1 -- 172.21.15.33:0/1913063834 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e96f6f05d0 con 0x55e96f3909f0 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f557b7fe640 10 client.18855 handle_command_reply: tid=0 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f55a895c740 1 client.18855 shutdown 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f55a895c740 1 -- 172.21.15.33:0/1913063834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 msgr2=0x55e96f77ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f55a895c740 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f77ef20 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f5590005310 tx=0x7f5590005660 comp rx=0 tx=0).stop 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f55a895c740 1 -- 172.21.15.33:0/1913063834 shutdown_connections 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f55a895c740 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55e96f3909f0 0x55e96f79d2e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f55a895c740 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3d2070 0x55e96f797530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f55a895c740 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f77ef20 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f55a895c740 1 --2- 172.21.15.33:0/1913063834 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f77e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f55a895c740 1 -- 172.21.15.33:0/1913063834 >> 172.21.15.33:0/1913063834 conn(0x55e96f3c6460 msgr2=0x55e96f7737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f557b7fe640 0 client.18855 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.022+0000 7f55a895c740 1 -- 172.21.15.33:0/1913063834 shutdown_connections 2024-08-28T19:44:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.023+0000 7f55a895c740 1 -- 172.21.15.33:0/1913063834 wait complete. 2024-08-28T19:44:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.023+0000 7f55a895c740 20 client.18855 trim_cache size 0 max 16384 2024-08-28T19:44:31.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a895c740 1 Processor -- start 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a895c740 1 -- start start 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a895c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f77e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a895c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3b1390 0x55e96f77ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a895c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3d2070 0x55e96f77bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a895c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1ae9b0 con 0x55e96f3d2070 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a895c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1b04f0 con 0x55e96f3b1390 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a895c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1af080 con 0x55e96f3a91b0 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a0984640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3d2070 0x55e96f77bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a0984640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3d2070 0x55e96f77bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38400/0 (socket says 172.21.15.33:38400) 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a0984640 1 -- 172.21.15.33:0/3965041596 learned_addr learned my addr 172.21.15.33:0/3965041596 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:31.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f559bfff640 1 --2- 172.21.15.33:0/3965041596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f77e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f559b7fe640 1 --2- 172.21.15.33:0/3965041596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3b1390 0x55e96f77ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a0984640 1 -- 172.21.15.33:0/3965041596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 msgr2=0x55e96f77e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a0984640 1 --2- 172.21.15.33:0/3965041596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f77e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.036+0000 7f55a0984640 1 -- 172.21.15.33:0/3965041596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3b1390 msgr2=0x55e96f77ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.037+0000 7f55a0984640 1 --2- 172.21.15.33:0/3965041596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3b1390 0x55e96f77ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.037+0000 7f55a0984640 1 -- 172.21.15.33:0/3965041596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e96f77fa80 con 0x55e96f3d2070 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.037+0000 7f559b7fe640 1 --2- 172.21.15.33:0/3965041596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3b1390 0x55e96f77ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.037+0000 7f55a0984640 1 --2- 172.21.15.33:0/3965041596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3d2070 0x55e96f77bbd0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5594009eb0 tx=0x7f5594014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32a6e7140cb6a67 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.037+0000 7f5581ffb640 1 -- 172.21.15.33:0/3965041596 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594007b50 con 0x55e96f3d2070 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.037+0000 7f5581ffb640 1 -- 172.21.15.33:0/3965041596 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5594028070 con 0x55e96f3d2070 2024-08-28T19:44:31.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.037+0000 7f5581ffb640 1 -- 172.21.15.33:0/3965041596 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55940225c0 con 0x55e96f3d2070 2024-08-28T19:44:31.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 -- 172.21.15.33:0/3965041596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3d2070 msgr2=0x55e96f77bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:31.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 --2- 172.21.15.33:0/3965041596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3d2070 0x55e96f77bbd0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5594009eb0 tx=0x7f5594014000 comp rx=0 tx=0).stop 2024-08-28T19:44:31.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 -- 172.21.15.33:0/3965041596 shutdown_connections 2024-08-28T19:44:31.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 --2- 172.21.15.33:0/3965041596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3d2070 0x55e96f77bbd0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 --2- 172.21.15.33:0/3965041596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3b1390 0x55e96f77ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 --2- 172.21.15.33:0/3965041596 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3a91b0 0x55e96f77e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 -- 172.21.15.33:0/3965041596 >> 172.21.15.33:0/3965041596 conn(0x55e96f3c6460 msgr2=0x55e96f77d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 -- 172.21.15.33:0/3965041596 shutdown_connections 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 -- 172.21.15.33:0/3965041596 wait complete. 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 -- start start 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.038+0000 7f55a895c740 1 Processor -- start 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f55a895c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3a91b0 0x55e96f7a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f55a895c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f79ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f55a895c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3d2070 0x55e96f79f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f55a895c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1afe20 con 0x55e96f3b1390 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f55a895c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1af750 con 0x55e96f3a91b0 2024-08-28T19:44:31.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f55a895c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1ac9b0 con 0x55e96f3d2070 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f55a895c740 10 client.0 _ll_register_callbacks cb 0x7f5590032d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f559b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f79ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f559b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f79ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38402/0 (socket says 172.21.15.33:38402) 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f559b7fe640 1 -- 172.21.15.33:0/3521588603 learned_addr learned my addr 172.21.15.33:0/3521588603 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f559bfff640 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3a91b0 0x55e96f7a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f55a0984640 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3d2070 0x55e96f79f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f559b7fe640 1 -- 172.21.15.33:0/3521588603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3d2070 msgr2=0x55e96f79f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f559b7fe640 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3d2070 0x55e96f79f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f559b7fe640 1 -- 172.21.15.33:0/3521588603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3a91b0 msgr2=0x55e96f7a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f559b7fe640 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3a91b0 0x55e96f7a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f559b7fe640 1 -- 172.21.15.33:0/3521588603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e96f79fbb0 con 0x55e96f3b1390 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f55a0984640 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3d2070 0x55e96f79f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:44:31.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f559b7fe640 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f79ef60 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f559003cdb0 tx=0x7f5590005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81b1a5b7656312b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f557b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f557b7fe640 1 -- 172.21.15.33:0/3521588603 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559005f060 con 0x55e96f3b1390 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.039+0000 7f557b7fe640 1 -- 172.21.15.33:0/3521588603 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f5590031d10 con 0x55e96f3b1390 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f55a895c740 1 -- 172.21.15.33:0/3521588603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5594028070 con 0x55e96f3b1390 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f557b7fe640 1 -- 172.21.15.33:0/3521588603 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f559004b070 con 0x55e96f3b1390 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f55a895c740 10 client.18861 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f55a895c740 1 -- 172.21.15.33:0/3521588603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e96f8088a0 con 0x55e96f3b1390 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f557b7fe640 1 -- 172.21.15.33:0/3521588603 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5594028070 con 0x55e96f3b1390 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f557b7fe640 1 -- 172.21.15.33:0/3521588603 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5590044610 con 0x55e96f3b1390 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f55a895c740 10 client.18861 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f55a895c740 10 client.18861 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f55a895c740 20 client.18861 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:31.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f55a895c740 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55e96f365da0 0x55e96f80b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f55a895c740 4 client.18861 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f55a895c740 1 -- 172.21.15.33:0/3521588603 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e96f6ec070 con 0x55e96f365da0 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.040+0000 7f559bfff640 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55e96f365da0 0x55e96f80b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f557b7fe640 10 client.18861 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f559bfff640 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55e96f365da0 0x55e96f80b090 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3b57fc5dad93cd58 server_cookie=36b2ac48bdcfe382 in_seq=0 out_seq=0 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f557b7fe640 1 -- 172.21.15.33:0/3521588603 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e96f6ec070 con 0x55e96f365da0 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f557b7fe640 10 client.18861 handle_command_reply: tid=0 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 client.18861 shutdown 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 -- 172.21.15.33:0/3521588603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 msgr2=0x55e96f79ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f79ef60 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f559003cdb0 tx=0x7f5590005a40 comp rx=0 tx=0).stop 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 -- 172.21.15.33:0/3521588603 shutdown_connections 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55e96f365da0 0x55e96f80b090 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e96f3d2070 0x55e96f79f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e96f3b1390 0x55e96f79ef60 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 --2- 172.21.15.33:0/3521588603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e96f3a91b0 0x55e96f7a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 -- 172.21.15.33:0/3521588603 >> 172.21.15.33:0/3521588603 conn(0x55e96f3c6460 msgr2=0x55e96f77d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f557b7fe640 0 client.18861 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:44:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 -- 172.21.15.33:0/3521588603 shutdown_connections 2024-08-28T19:44:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.041+0000 7f55a895c740 1 -- 172.21.15.33:0/3521588603 wait complete. 2024-08-28T19:44:31.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a895c740 20 client.18861 trim_cache size 0 max 16384 2024-08-28T19:44:31.049 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:44:31.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 -- 172.21.15.33:0/2147747820 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f55840b4ca0 msgr2=0x7f55840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:31.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f55840b4ca0 0x7f55840b71b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f559400a4c0 tx=0x7f5594004b50 comp rx=0 tx=0).stop 2024-08-28T19:44:31.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 -- 172.21.15.33:0/2147747820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f559c103900 msgr2=0x7f559c19a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:31.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f559c103900 0x7f559c19a280 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f558c00d770 tx=0x7f558c00dc30 comp rx=0 tx=0).stop 2024-08-28T19:44:31.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 -- 172.21.15.33:0/2147747820 shutdown_connections 2024-08-28T19:44:31.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f55840b4ca0 0x7f55840b71b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f559c109b90 0x7f559c19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f559c109240 0x7f559c19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 --2- 172.21.15.33:0/2147747820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f559c103900 0x7f559c19a280 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:31.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 -- 172.21.15.33:0/2147747820 >> 172.21.15.33:0/2147747820 conn(0x7f559c07b5f0 msgr2=0x7f559c105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:31.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 -- 172.21.15.33:0/2147747820 shutdown_connections 2024-08-28T19:44:31.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:31.042+0000 7f55a23e7640 1 -- 172.21.15.33:0/2147747820 wait complete. 2024-08-28T19:44:31.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:31 smithi033 ceph-mon[18549]: pgmap v716: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 KiB/s wr, 13 op/s 2024-08-28T19:44:31.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:31 smithi059 ceph-mon[22052]: pgmap v716: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 KiB/s wr, 13 op/s 2024-08-28T19:44:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:31 smithi122 ceph-mon[22174]: pgmap v716: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 KiB/s wr, 13 op/s 2024-08-28T19:44:31.866 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:44:32.121 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.631+0000 7f29e2f29640 1 -- 172.21.15.33:0/2875891753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102820 msgr2=0x7f29dc102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.631+0000 7f29e2f29640 1 --2- 172.21.15.33:0/2875891753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102820 0x7f29dc102c30 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009900 tx=0x7f29d002a410 comp rx=0 tx=0).stop 2024-08-28T19:44:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.632+0000 7f29e2f29640 1 -- 172.21.15.33:0/2875891753 shutdown_connections 2024-08-28T19:44:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.632+0000 7f29e2f29640 1 --2- 172.21.15.33:0/2875891753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29dc108ab0 0x7f29dc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.632+0000 7f29e2f29640 1 --2- 172.21.15.33:0/2875891753 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29dc108160 0x7f29dc108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.632+0000 7f29e2f29640 1 --2- 172.21.15.33:0/2875891753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102820 0x7f29dc102c30 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.632+0000 7f29e2f29640 1 -- 172.21.15.33:0/2875891753 >> 172.21.15.33:0/2875891753 conn(0x7f29dc0794e0 msgr2=0x7f29dc0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.632+0000 7f29e2f29640 1 -- 172.21.15.33:0/2875891753 shutdown_connections 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.632+0000 7f29e2f29640 1 -- 172.21.15.33:0/2875891753 wait complete. 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.632+0000 7f29e2f29640 1 Processor -- start 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.632+0000 7f29e2f29640 1 -- start start 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e2f29640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102820 0x7f29dc19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e2f29640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29dc108160 0x7f29dc19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e2f29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29dc108ab0 0x7f29dc19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e2f29640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc112780 con 0x7f29dc102820 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e2f29640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc112600 con 0x7f29dc108160 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e2f29640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc112900 con 0x7f29dc108ab0 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e0cc5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102820 0x7f29dc19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e0cc5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102820 0x7f29dc19a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38406/0 (socket says 172.21.15.33:38406) 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e0cc5640 1 -- 172.21.15.33:0/96914673 learned_addr learned my addr 172.21.15.33:0/96914673 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29dbfff640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29dc108160 0x7f29dc19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e14c6640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29dc108ab0 0x7f29dc19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e0cc5640 1 -- 172.21.15.33:0/96914673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29dc108ab0 msgr2=0x7f29dc19fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29dc108ab0 0x7f29dc19fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e0cc5640 1 -- 172.21.15.33:0/96914673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29dc108160 msgr2=0x7f29dc19a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29dc108160 0x7f29dc19a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e0cc5640 1 -- 172.21.15.33:0/96914673 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc1a0210 con 0x7f29dc102820 2024-08-28T19:44:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e14c6640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29dc108ab0 0x7f29dc19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:44:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102820 0x7f29dc19a2a0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f29d0006010 tx=0x7f29d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.633+0000 7f29d9ffb640 1 -- 172.21.15.33:0/96914673 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d003f030 con 0x7f29dc102820 2024-08-28T19:44:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.634+0000 7f29d9ffb640 1 -- 172.21.15.33:0/96914673 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29d0003800 con 0x7f29dc102820 2024-08-28T19:44:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.634+0000 7f29e2f29640 1 -- 172.21.15.33:0/96914673 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc1a04a0 con 0x7f29dc102820 2024-08-28T19:44:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.634+0000 7f29d9ffb640 1 -- 172.21.15.33:0/96914673 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0035070 con 0x7f29dc102820 2024-08-28T19:44:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.634+0000 7f29e2f29640 1 -- 172.21.15.33:0/96914673 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc1a6c60 con 0x7f29dc102820 2024-08-28T19:44:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.636+0000 7f29e949e740 1 Processor -- start 2024-08-28T19:44:32.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.636+0000 7f29e949e740 1 -- start start 2024-08-28T19:44:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.636+0000 7f29d9ffb640 1 -- 172.21.15.33:0/96914673 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f29d0003cb0 con 0x7f29dc102820 2024-08-28T19:44:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.636+0000 7f29e949e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558899920070 0x558899cc5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.636+0000 7f29e949e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998f71b0 0x558899cc5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29e949e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cc5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29e949e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558899c3c680 con 0x5588998ff390 2024-08-28T19:44:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29e949e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558899c2bc10 con 0x5588998f71b0 2024-08-28T19:44:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29e949e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558899c2fbc0 con 0x558899920070 2024-08-28T19:44:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cc5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cc5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38412/0 (socket says 172.21.15.33:38412) 2024-08-28T19:44:32.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29dbfff640 1 -- 172.21.15.33:0/3863922376 learned_addr learned my addr 172.21.15.33:0/3863922376 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/3863922376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998f71b0 0x558899cc5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29e14c6640 1 --2- 172.21.15.33:0/3863922376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558899920070 0x558899cc5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29dbfff640 1 -- 172.21.15.33:0/3863922376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558899920070 msgr2=0x558899cc5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29dbfff640 1 --2- 172.21.15.33:0/3863922376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558899920070 0x558899cc5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29dbfff640 1 -- 172.21.15.33:0/3863922376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998f71b0 msgr2=0x558899cc5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29dbfff640 1 --2- 172.21.15.33:0/3863922376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998f71b0 0x558899cc5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29dbfff640 1 -- 172.21.15.33:0/3863922376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55889998b650 con 0x5588998ff390 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29d9ffb640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29cc0b4ca0 0x7f29cc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.637+0000 7f29dbfff640 1 --2- 172.21.15.33:0/3863922376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cc5d90 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009a00 tx=0x7f29c8009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f49509a8f895c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29e14c6640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29cc0b4ca0 0x7f29cc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29c6ffd640 1 -- 172.21.15.33:0/3863922376 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8017070 con 0x5588998ff390 2024-08-28T19:44:32.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29d9ffb640 1 -- 172.21.15.33:0/96914673 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f29d01062b0 con 0x7f29dc102820 2024-08-28T19:44:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29c6ffd640 1 -- 172.21.15.33:0/3863922376 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29c8013470 con 0x5588998ff390 2024-08-28T19:44:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29c6ffd640 1 -- 172.21.15.33:0/3863922376 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8012610 con 0x5588998ff390 2024-08-28T19:44:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29e949e740 1 -- 172.21.15.33:0/3863922376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 msgr2=0x558899cc5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29e949e740 1 --2- 172.21.15.33:0/3863922376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cc5d90 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009a00 tx=0x7f29c8009ec0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29e14c6640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29cc0b4ca0 0x7f29cc0b71b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f29d4005fd0 tx=0x7f29d40083f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29e949e740 1 -- 172.21.15.33:0/3863922376 shutdown_connections 2024-08-28T19:44:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29e949e740 1 --2- 172.21.15.33:0/3863922376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cc5d90 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.638+0000 7f29e949e740 1 --2- 172.21.15.33:0/3863922376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998f71b0 0x558899cc5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.639+0000 7f29e949e740 1 --2- 172.21.15.33:0/3863922376 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558899920070 0x558899cc5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.639+0000 7f29e949e740 1 -- 172.21.15.33:0/3863922376 >> 172.21.15.33:0/3863922376 conn(0x558899914460 msgr2=0x558899cc3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.639+0000 7f29e949e740 1 -- 172.21.15.33:0/3863922376 shutdown_connections 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.639+0000 7f29e949e740 1 -- 172.21.15.33:0/3863922376 wait complete. 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.639+0000 7f29e949e740 1 -- start start 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.639+0000 7f29e949e740 1 Processor -- start 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.639+0000 7f29e949e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899cd0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.639+0000 7f29e949e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998ff390 0x558899cd0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e949e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558899920070 0x558899cdce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e949e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558899a8e700 con 0x5588998f71b0 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e949e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558899bb2750 con 0x558899920070 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e949e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558899cd3af0 con 0x5588998ff390 2024-08-28T19:44:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e949e740 10 client.0 _ll_register_callbacks cb 0x558899be1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e0cc5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899cd0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e0cc5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899cd0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38414/0 (socket says 172.21.15.33:38414) 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e0cc5640 1 -- 172.21.15.33:0/1785969895 learned_addr learned my addr 172.21.15.33:0/1785969895 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29dbfff640 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998ff390 0x558899cd0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e0cc5640 1 -- 172.21.15.33:0/1785969895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998ff390 msgr2=0x558899cd0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998ff390 0x558899cd0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e0cc5640 1 -- 172.21.15.33:0/1785969895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558899920070 msgr2=0x558899cdce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558899920070 0x558899cdce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e0cc5640 1 -- 172.21.15.33:0/1785969895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558899beb900 con 0x5588998f71b0 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899cd0990 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000c00 tx=0x7f29d00c8580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272ce0c449fdf023 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:32.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29bbfff640 1 -- 172.21.15.33:0/1785969895 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0049040 con 0x5588998f71b0 2024-08-28T19:44:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29bbfff640 1 -- 172.21.15.33:0/1785969895 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f29d00c8890 con 0x5588998f71b0 2024-08-28T19:44:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e949e740 1 -- 172.21.15.33:0/1785969895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29c8013470 con 0x5588998f71b0 2024-08-28T19:44:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29bbfff640 1 -- 172.21.15.33:0/1785969895 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29d00cbd70 con 0x5588998f71b0 2024-08-28T19:44:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e949e740 10 client.18873 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.640+0000 7f29e949e740 1 -- 172.21.15.33:0/1785969895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558899cdf7f0 con 0x5588998f71b0 2024-08-28T19:44:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.641+0000 7f29bbfff640 1 -- 172.21.15.33:0/1785969895 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29c8013470 con 0x5588998f71b0 2024-08-28T19:44:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.641+0000 7f29bbfff640 1 -- 172.21.15.33:0/1785969895 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f29d00cc860 con 0x5588998f71b0 2024-08-28T19:44:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.641+0000 7f29e949e740 10 client.18873 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.641+0000 7f29e949e740 10 client.18873 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:44:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.641+0000 7f29e949e740 20 client.18873 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.641+0000 7f29e949e740 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5588998de9f0 0x558899ce2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.641+0000 7f29e949e740 4 client.18873 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:44:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.641+0000 7f29e949e740 1 -- 172.21.15.33:0/1785969895 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558899c3e5d0 con 0x5588998de9f0 2024-08-28T19:44:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.641+0000 7f29dbfff640 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5588998de9f0 0x558899ce2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.642+0000 7f29bbfff640 10 client.18873 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:44:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.642+0000 7f29dbfff640 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5588998de9f0 0x558899ce2d30 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c681c9074b660d21 server_cookie=73d7bdade26e9d5e in_seq=0 out_seq=0 2024-08-28T19:44:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.642+0000 7f29bbfff640 1 -- 172.21.15.33:0/1785969895 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558899c3e5d0 con 0x5588998de9f0 2024-08-28T19:44:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29bbfff640 10 client.18873 handle_command_reply: tid=0 2024-08-28T19:44:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 client.18873 shutdown 2024-08-28T19:44:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 -- 172.21.15.33:0/1785969895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 msgr2=0x558899cd0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899cd0990 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000c00 tx=0x7f29d00c8580 comp rx=0 tx=0).stop 2024-08-28T19:44:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 -- 172.21.15.33:0/1785969895 shutdown_connections 2024-08-28T19:44:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5588998de9f0 0x558899ce2d30 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558899920070 0x558899cdce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29bbfff640 0 client.18873 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:44:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998ff390 0x558899cd0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 --2- 172.21.15.33:0/1785969895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899cd0990 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 -- 172.21.15.33:0/1785969895 >> 172.21.15.33:0/1785969895 conn(0x558899914460 msgr2=0x558899cc84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 -- 172.21.15.33:0/1785969895 shutdown_connections 2024-08-28T19:44:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 1 -- 172.21.15.33:0/1785969895 wait complete. 2024-08-28T19:44:32.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.643+0000 7f29e949e740 20 client.18873 trim_cache size 0 max 16384 2024-08-28T19:44:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e949e740 1 Processor -- start 2024-08-28T19:44:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e949e740 1 -- start start 2024-08-28T19:44:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e949e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 0x558899cdcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e949e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899ccf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e949e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998ff390 0x558899ccf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e949e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1b0ca0 con 0x5588998f71b0 2024-08-28T19:44:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e949e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1b27e0 con 0x5588998ff390 2024-08-28T19:44:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e949e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1b1370 con 0x5588998de9f0 2024-08-28T19:44:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899ccf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29dbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899ccf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38424/0 (socket says 172.21.15.33:38424) 2024-08-28T19:44:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29dbfff640 1 -- 172.21.15.33:0/2295538424 learned_addr learned my addr 172.21.15.33:0/2295538424 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e14c6640 1 --2- 172.21.15.33:0/2295538424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998ff390 0x558899ccf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/2295538424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 0x558899cdcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29dbfff640 1 -- 172.21.15.33:0/2295538424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 msgr2=0x558899cdcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29dbfff640 1 --2- 172.21.15.33:0/2295538424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 0x558899cdcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29dbfff640 1 -- 172.21.15.33:0/2295538424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998ff390 msgr2=0x558899ccf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29dbfff640 1 --2- 172.21.15.33:0/2295538424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998ff390 0x558899ccf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29dbfff640 1 -- 172.21.15.33:0/2295538424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558899cbe960 con 0x5588998f71b0 2024-08-28T19:44:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.657+0000 7f29e14c6640 1 --2- 172.21.15.33:0/2295538424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998ff390 0x558899ccf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:44:32.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.658+0000 7f29dbfff640 1 --2- 172.21.15.33:0/2295538424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899ccf210 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f29c8013ec0 tx=0x7f29c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc584eb541d0c16a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.658+0000 7f29c67fc640 1 -- 172.21.15.33:0/2295538424 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8017040 con 0x5588998f71b0 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.658+0000 7f29c67fc640 1 -- 172.21.15.33:0/2295538424 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29c8013b00 con 0x5588998f71b0 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.658+0000 7f29c67fc640 1 -- 172.21.15.33:0/2295538424 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c801cbb0 con 0x5588998f71b0 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 -- 172.21.15.33:0/2295538424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 msgr2=0x558899ccf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 --2- 172.21.15.33:0/2295538424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899ccf210 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f29c8013ec0 tx=0x7f29c8008040 comp rx=0 tx=0).stop 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 -- 172.21.15.33:0/2295538424 shutdown_connections 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 --2- 172.21.15.33:0/2295538424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998ff390 0x558899ccf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 --2- 172.21.15.33:0/2295538424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998f71b0 0x558899ccf210 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 --2- 172.21.15.33:0/2295538424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 0x558899cdcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 -- 172.21.15.33:0/2295538424 >> 172.21.15.33:0/2295538424 conn(0x558899914460 msgr2=0x558899ccbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:32.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 -- 172.21.15.33:0/2295538424 shutdown_connections 2024-08-28T19:44:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 -- 172.21.15.33:0/2295538424 wait complete. 2024-08-28T19:44:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 -- start start 2024-08-28T19:44:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.659+0000 7f29e949e740 1 Processor -- start 2024-08-28T19:44:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e949e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 0x558899cd9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e949e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998f71b0 0x558899cd4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e949e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cd4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e949e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1b2110 con 0x5588998ff390 2024-08-28T19:44:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e949e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1b1a40 con 0x5588998f71b0 2024-08-28T19:44:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e949e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1aeca0 con 0x5588998de9f0 2024-08-28T19:44:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e949e740 10 client.0 _ll_register_callbacks cb 0x7f29d0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e14c6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cd4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e14c6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cd4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38428/0 (socket says 172.21.15.33:38428) 2024-08-28T19:44:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e14c6640 1 -- 172.21.15.33:0/1979004058 learned_addr learned my addr 172.21.15.33:0/1979004058 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29dbfff640 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998f71b0 0x558899cd4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 0x558899cd9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e14c6640 1 -- 172.21.15.33:0/1979004058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 msgr2=0x558899cd9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e14c6640 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 0x558899cd9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e14c6640 1 -- 172.21.15.33:0/1979004058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998f71b0 msgr2=0x558899cd4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e14c6640 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998f71b0 0x558899cd4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e14c6640 1 -- 172.21.15.33:0/1979004058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558899cd5330 con 0x5588998ff390 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 0x558899cd9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29e14c6640 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cd4d70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f29d4010f00 tx=0x7f29d4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0443cb47ee204f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.660+0000 7f29bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29bbfff640 1 -- 172.21.15.33:0/1979004058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d401d620 con 0x5588998ff390 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29bbfff640 1 -- 172.21.15.33:0/1979004058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f29d401d7c0 con 0x5588998ff390 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29e949e740 1 -- 172.21.15.33:0/1979004058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29c8013b00 con 0x5588998ff390 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29bbfff640 1 -- 172.21.15.33:0/1979004058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29d4004b40 con 0x5588998ff390 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29e949e740 10 client.18879 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29e949e740 1 -- 172.21.15.33:0/1979004058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558899d4d430 con 0x5588998ff390 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29bbfff640 1 -- 172.21.15.33:0/1979004058 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29c8013b00 con 0x5588998ff390 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29bbfff640 1 -- 172.21.15.33:0/1979004058 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f29d4005590 con 0x5588998ff390 2024-08-28T19:44:32.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29e949e740 10 client.18879 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29e949e740 10 client.18879 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29e949e740 20 client.18879 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29e949e740 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x558899920070 0x558899d4fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29e949e740 4 client.18879 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.661+0000 7f29e949e740 1 -- 172.21.15.33:0/1979004058 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558899c3a070 con 0x558899920070 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.662+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x558899920070 0x558899d4fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.662+0000 7f29e0cc5640 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x558899920070 0x558899d4fc70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=67bc2a0b45eac32 server_cookie=4605e9bec4535afd in_seq=0 out_seq=0 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.662+0000 7f29bbfff640 10 client.18879 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29bbfff640 1 -- 172.21.15.33:0/1979004058 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558899c3a070 con 0x558899920070 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29bbfff640 10 client.18879 handle_command_reply: tid=0 2024-08-28T19:44:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 client.18879 shutdown 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 -- 172.21.15.33:0/1979004058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 msgr2=0x558899cd4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cd4d70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f29d4010f00 tx=0x7f29d4004ab0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 -- 172.21.15.33:0/1979004058 shutdown_connections 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x558899920070 0x558899d4fc70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5588998ff390 0x558899cd4d70 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5588998f71b0 0x558899cd4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29bbfff640 0 client.18879 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 --2- 172.21.15.33:0/1979004058 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5588998de9f0 0x558899cd9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 -- 172.21.15.33:0/1979004058 >> 172.21.15.33:0/1979004058 conn(0x558899914460 msgr2=0x558899ccee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 -- 172.21.15.33:0/1979004058 shutdown_connections 2024-08-28T19:44:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 1 -- 172.21.15.33:0/1979004058 wait complete. 2024-08-28T19:44:32.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.663+0000 7f29e949e740 20 client.18879 trim_cache size 0 max 16384 2024-08-28T19:44:32.677 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:44:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 -- 172.21.15.33:0/96914673 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29cc0b4ca0 msgr2=0x7f29cc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29cc0b4ca0 0x7f29cc0b71b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f29d4005fd0 tx=0x7f29d40083f0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 -- 172.21.15.33:0/96914673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102820 msgr2=0x7f29dc19a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102820 0x7f29dc19a2a0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f29d0006010 tx=0x7f29d00042f0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 -- 172.21.15.33:0/96914673 shutdown_connections 2024-08-28T19:44:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f29cc0b4ca0 0x7f29cc0b71b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29dc108ab0 0x7f29dc19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29dc108160 0x7f29dc19a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 --2- 172.21.15.33:0/96914673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29dc102820 0x7f29dc19a2a0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:32.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 -- 172.21.15.33:0/96914673 >> 172.21.15.33:0/96914673 conn(0x7f29dc0794e0 msgr2=0x7f29dc101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:32.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 -- 172.21.15.33:0/96914673 shutdown_connections 2024-08-28T19:44:32.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:32.664+0000 7f29e2f29640 1 -- 172.21.15.33:0/96914673 wait complete. 2024-08-28T19:44:33.438 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:44:33.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:33 smithi033 ceph-mon[18549]: pgmap v717: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 KiB/s wr, 13 op/s 2024-08-28T19:44:33.698 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:33 smithi059 ceph-mon[22052]: pgmap v717: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 KiB/s wr, 13 op/s 2024-08-28T19:44:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:33 smithi122 ceph-mon[22174]: pgmap v717: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 KiB/s wr, 13 op/s 2024-08-28T19:44:34.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.225+0000 7f2fc0bea640 1 -- 172.21.15.33:0/2392239913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fbc102810 msgr2=0x7f2fbc102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:34.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.225+0000 7f2fc0bea640 1 --2- 172.21.15.33:0/2392239913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fbc102810 0x7f2fbc102c20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009900 tx=0x7f2fac02a410 comp rx=0 tx=0).stop 2024-08-28T19:44:34.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.225+0000 7f2fc0bea640 1 -- 172.21.15.33:0/2392239913 shutdown_connections 2024-08-28T19:44:34.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.225+0000 7f2fc0bea640 1 --2- 172.21.15.33:0/2392239913 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fbc108aa0 0x7f2fbc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.225+0000 7f2fc0bea640 1 --2- 172.21.15.33:0/2392239913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc108150 0x7f2fbc108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.225+0000 7f2fc0bea640 1 --2- 172.21.15.33:0/2392239913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fbc102810 0x7f2fbc102c20 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.225+0000 7f2fc0bea640 1 -- 172.21.15.33:0/2392239913 >> 172.21.15.33:0/2392239913 conn(0x7f2fbc0794d0 msgr2=0x7f2fbc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.225+0000 7f2fc0bea640 1 -- 172.21.15.33:0/2392239913 shutdown_connections 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.225+0000 7f2fc0bea640 1 -- 172.21.15.33:0/2392239913 wait complete. 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fc0bea640 1 Processor -- start 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fc0bea640 1 -- start start 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fc0bea640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fbc102810 0x7f2fbc19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fc0bea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc108150 0x7f2fbc19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fc0bea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fbc108aa0 0x7f2fbc19fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fc0bea640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc112720 con 0x7f2fbc102810 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fc0bea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc1125a0 con 0x7f2fbc108150 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fc0bea640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc1128a0 con 0x7f2fbc108aa0 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fba59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fbc102810 0x7f2fbc19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fba59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fbc102810 0x7f2fbc19a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38434/0 (socket says 172.21.15.33:38434) 2024-08-28T19:44:34.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.226+0000 7f2fba59c640 1 -- 172.21.15.33:0/3643316226 learned_addr learned my addr 172.21.15.33:0/3643316226 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc108150 0x7f2fbc19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fbc108aa0 0x7f2fbc19fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fba59c640 1 -- 172.21.15.33:0/3643316226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fbc108aa0 msgr2=0x7f2fbc19fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fba59c640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fbc108aa0 0x7f2fbc19fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fba59c640 1 -- 172.21.15.33:0/3643316226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc108150 msgr2=0x7f2fbc19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fba59c640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc108150 0x7f2fbc19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fba59c640 1 -- 172.21.15.33:0/3643316226 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc1a0190 con 0x7f2fbc102810 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc108150 0x7f2fbc19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fba59c640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fbc102810 0x7f2fbc19a220 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f2fac005940 tx=0x7f2fac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fab7fe640 1 -- 172.21.15.33:0/3643316226 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac03f030 con 0x7f2fbc102810 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fab7fe640 1 -- 172.21.15.33:0/3643316226 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fac003aa0 con 0x7f2fbc102810 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fc0bea640 1 -- 172.21.15.33:0/3643316226 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc1a0420 con 0x7f2fbc102810 2024-08-28T19:44:34.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fab7fe640 1 -- 172.21.15.33:0/3643316226 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac035070 con 0x7f2fbc102810 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.227+0000 7f2fc0bea640 1 -- 172.21.15.33:0/3643316226 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc1a6be0 con 0x7f2fbc102810 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.230+0000 7f2fc715f740 1 Processor -- start 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.230+0000 7f2fc715f740 1 -- start start 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279861070 0x565279c06310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5652798381b0 0x565279c06850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 0x565279c06d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fc715f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x565279b7d680 con 0x5652798381b0 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fc715f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x565279b6cc10 con 0x565279861070 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fc715f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x565279b70bc0 con 0x565279840390 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fab7fe640 1 -- 172.21.15.33:0/3643316226 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2fac042030 con 0x7f2fbc102810 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fbad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279861070 0x565279c06310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fb9d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 0x565279c06d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fbad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279861070 0x565279c06310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:37722/0 (socket says 172.21.15.33:37722) 2024-08-28T19:44:34.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fb9d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 0x565279c06d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:33866/0 (socket says 172.21.15.33:33866) 2024-08-28T19:44:34.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fbad9d640 1 -- 172.21.15.33:0/1217883696 learned_addr learned my addr 172.21.15.33:0/1217883696 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:34.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fba59c640 1 --2- 172.21.15.33:0/1217883696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5652798381b0 0x565279c06850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fb9d9b640 1 -- 172.21.15.33:0/1217883696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279861070 msgr2=0x565279c06310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:34.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/1217883696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279861070 0x565279c06310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fb9d9b640 1 -- 172.21.15.33:0/1217883696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5652798381b0 msgr2=0x565279c06850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:34.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/1217883696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5652798381b0 0x565279c06850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.231+0000 7f2fb9d9b640 1 -- 172.21.15.33:0/1217883696 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652798cc650 con 0x565279840390 2024-08-28T19:44:34.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.232+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/1217883696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279861070 0x565279c06310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:44:34.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.232+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/1217883696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 0x565279c06d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc100970 tx=0x7f2fb000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd360073f3dae084 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:34.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.232+0000 7f2fab7fe640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2fa40b4ca0 0x7f2fa40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.232+0000 7f2fa8ff9640 1 -- 172.21.15.33:0/1217883696 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0015070 con 0x565279840390 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.232+0000 7f2fa8ff9640 1 -- 172.21.15.33:0/1217883696 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fb001a910 con 0x565279840390 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.232+0000 7f2fa8ff9640 1 -- 172.21.15.33:0/1217883696 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00118c0 con 0x565279840390 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.232+0000 7f2fab7fe640 1 -- 172.21.15.33:0/3643316226 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f2fac105f30 con 0x7f2fbc102810 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.233+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2fa40b4ca0 0x7f2fa40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fc715f740 1 -- 172.21.15.33:0/1217883696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 msgr2=0x565279c06d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2fa40b4ca0 0x7f2fa40b71b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4005c40 tx=0x7f2fb4009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fc715f740 1 --2- 172.21.15.33:0/1217883696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 0x565279c06d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc100970 tx=0x7f2fb000f730 comp rx=0 tx=0).stop 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fc715f740 1 -- 172.21.15.33:0/1217883696 shutdown_connections 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fc715f740 1 --2- 172.21.15.33:0/1217883696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 0x565279c06d90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fc715f740 1 --2- 172.21.15.33:0/1217883696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5652798381b0 0x565279c06850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fc715f740 1 --2- 172.21.15.33:0/1217883696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279861070 0x565279c06310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fc715f740 1 -- 172.21.15.33:0/1217883696 >> 172.21.15.33:0/1217883696 conn(0x565279855460 msgr2=0x565279c04200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fc715f740 1 -- 172.21.15.33:0/1217883696 shutdown_connections 2024-08-28T19:44:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fc715f740 1 -- 172.21.15.33:0/1217883696 wait complete. 2024-08-28T19:44:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.234+0000 7f2fc715f740 1 -- start start 2024-08-28T19:44:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fc715f740 1 Processor -- start 2024-08-28T19:44:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652798381b0 0x565279c11a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279840390 0x565279c11fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c1de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fc715f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5652799cf700 con 0x565279861070 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fc715f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x565279af3750 con 0x565279840390 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fc715f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x565279c14af0 con 0x5652798381b0 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fc715f740 10 client.0 _ll_register_callbacks cb 0x565279b22e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fbad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c1de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fbad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c1de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38464/0 (socket says 172.21.15.33:38464) 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fbad9d640 1 -- 172.21.15.33:0/787118584 learned_addr learned my addr 172.21.15.33:0/787118584 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279840390 0x565279c11fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fba59c640 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652798381b0 0x565279c11a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fbad9d640 1 -- 172.21.15.33:0/787118584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652798381b0 msgr2=0x565279c11a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.235+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652798381b0 0x565279c11a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fbad9d640 1 -- 172.21.15.33:0/787118584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279840390 msgr2=0x565279c11fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279840390 0x565279c11fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fbad9d640 1 -- 172.21.15.33:0/787118584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565279b2c900 con 0x565279861070 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279840390 0x565279c11fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c1de60 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4005c10 tx=0x7f2fb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208329f384625f89 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fa1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/787118584 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4004250 con 0x565279861070 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fc715f740 1 -- 172.21.15.33:0/787118584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fb001a910 con 0x565279861070 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/787118584 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f2fb40043f0 con 0x565279861070 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/787118584 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2fb40045f0 con 0x565279861070 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fc715f740 10 client.18891 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fc715f740 1 -- 172.21.15.33:0/787118584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565279c20990 con 0x565279861070 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.236+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/787118584 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fb001a910 con 0x565279861070 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.237+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/787118584 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2fb4027400 con 0x565279861070 2024-08-28T19:44:34.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.237+0000 7f2fc715f740 10 client.18891 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.237+0000 7f2fc715f740 10 client.18891 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.237+0000 7f2fc715f740 20 client.18891 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.237+0000 7f2fc715f740 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56527981f9f0 0x565279c23e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.237+0000 7f2fc715f740 4 client.18891 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.237+0000 7f2fc715f740 1 -- 172.21.15.33:0/787118584 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565279b7f5d0 con 0x56527981f9f0 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.237+0000 7f2fba59c640 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56527981f9f0 0x565279c23e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.237+0000 7f2fba59c640 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56527981f9f0 0x565279c23e50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a65a8fddedcee800 server_cookie=a382b300a563b48e in_seq=0 out_seq=0 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.237+0000 7f2fa1ffb640 10 client.18891 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/787118584 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565279b7f5d0 con 0x56527981f9f0 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fa1ffb640 10 client.18891 handle_command_reply: tid=0 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fc715f740 1 client.18891 shutdown 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fc715f740 1 -- 172.21.15.33:0/787118584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 msgr2=0x565279c1de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:34.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fc715f740 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c1de60 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4005c10 tx=0x7f2fb4004a40 comp rx=0 tx=0).stop 2024-08-28T19:44:34.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fc715f740 1 -- 172.21.15.33:0/787118584 shutdown_connections 2024-08-28T19:44:34.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fc715f740 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x56527981f9f0 0x565279c23e50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fc715f740 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c1de60 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fc715f740 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x565279840390 0x565279c11fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fc715f740 1 --2- 172.21.15.33:0/787118584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5652798381b0 0x565279c11a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fa1ffb640 0 client.18891 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:44:34.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.238+0000 7f2fc715f740 1 -- 172.21.15.33:0/787118584 >> 172.21.15.33:0/787118584 conn(0x565279855460 msgr2=0x565279c094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:34.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.239+0000 7f2fc715f740 1 -- 172.21.15.33:0/787118584 shutdown_connections 2024-08-28T19:44:34.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.239+0000 7f2fc715f740 1 -- 172.21.15.33:0/787118584 wait complete. 2024-08-28T19:44:34.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.239+0000 7f2fc715f740 20 client.18891 trim_cache size 0 max 16384 2024-08-28T19:44:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fc715f740 1 Processor -- start 2024-08-28T19:44:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fc715f740 1 -- start start 2024-08-28T19:44:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652798381b0 0x565279c09b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279840390 0x565279c1dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279861070 0x565279c1e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fc715f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc1b2eb0 con 0x565279840390 2024-08-28T19:44:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fc715f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc1b49f0 con 0x5652798381b0 2024-08-28T19:44:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fc715f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc1b3580 con 0x565279861070 2024-08-28T19:44:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fb9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279840390 0x565279c1dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fb9d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279840390 0x565279c1dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38478/0 (socket says 172.21.15.33:38478) 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fb9d9b640 1 -- 172.21.15.33:0/3678564556 learned_addr learned my addr 172.21.15.33:0/3678564556 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fba59c640 1 --2- 172.21.15.33:0/3678564556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652798381b0 0x565279c09b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/3678564556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279861070 0x565279c1e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fb9d9b640 1 -- 172.21.15.33:0/3678564556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279861070 msgr2=0x565279c1e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/3678564556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279861070 0x565279c1e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.252+0000 7f2fb9d9b640 1 -- 172.21.15.33:0/3678564556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652798381b0 msgr2=0x565279c09b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.253+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/3678564556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652798381b0 0x565279c09b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.253+0000 7f2fb9d9b640 1 -- 172.21.15.33:0/3678564556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565279c0ff70 con 0x565279840390 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.253+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/3678564556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279840390 0x565279c1dd60 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000b680 tx=0x7f2fb000b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60bb3849c4179b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.253+0000 7f2fa3fff640 1 -- 172.21.15.33:0/3678564556 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0028020 con 0x565279840390 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.253+0000 7f2fa3fff640 1 -- 172.21.15.33:0/3678564556 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fb0005030 con 0x565279840390 2024-08-28T19:44:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.253+0000 7f2fa3fff640 1 -- 172.21.15.33:0/3678564556 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0015070 con 0x565279840390 2024-08-28T19:44:34.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 -- 172.21.15.33:0/3678564556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279840390 msgr2=0x565279c1dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:34.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 --2- 172.21.15.33:0/3678564556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279840390 0x565279c1dd60 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000b680 tx=0x7f2fb000b950 comp rx=0 tx=0).stop 2024-08-28T19:44:34.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 -- 172.21.15.33:0/3678564556 shutdown_connections 2024-08-28T19:44:34.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 --2- 172.21.15.33:0/3678564556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279861070 0x565279c1e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 --2- 172.21.15.33:0/3678564556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279840390 0x565279c1dd60 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 --2- 172.21.15.33:0/3678564556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652798381b0 0x565279c09b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 -- 172.21.15.33:0/3678564556 >> 172.21.15.33:0/3678564556 conn(0x565279855460 msgr2=0x565279c09410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 -- 172.21.15.33:0/3678564556 shutdown_connections 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 -- 172.21.15.33:0/3678564556 wait complete. 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 -- start start 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.254+0000 7f2fc715f740 1 Processor -- start 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652798381b0 0x565279c160e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 0x565279c16620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fc715f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c8d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fc715f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc1b4320 con 0x565279861070 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fc715f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc1b3c50 con 0x5652798381b0 2024-08-28T19:44:34.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fc715f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc1b0eb0 con 0x565279840390 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fc715f740 10 client.0 _ll_register_callbacks cb 0x7f2fb4009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fbad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c8d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fbad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c8d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38484/0 (socket says 172.21.15.33:38484) 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fbad9d640 1 -- 172.21.15.33:0/1088273356 learned_addr learned my addr 172.21.15.33:0/1088273356 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fba59c640 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652798381b0 0x565279c160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fb9d9b640 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 0x565279c16620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fbad9d640 1 -- 172.21.15.33:0/1088273356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 msgr2=0x565279c16620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 0x565279c16620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fbad9d640 1 -- 172.21.15.33:0/1088273356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652798381b0 msgr2=0x565279c160e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652798381b0 0x565279c160e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fbad9d640 1 -- 172.21.15.33:0/1088273356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565279c16ea0 con 0x565279861070 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fbad9d640 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c8d850 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40106f0 tx=0x7f2fb40104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33343abe87506aa server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.255+0000 7f2fa1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/1088273356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4004cb0 con 0x565279861070 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/1088273356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f2fb4027a60 con 0x565279861070 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fc715f740 1 -- 172.21.15.33:0/1088273356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fb0005030 con 0x565279861070 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/1088273356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2fb4004e50 con 0x565279861070 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fc715f740 10 client.18897 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fc715f740 1 -- 172.21.15.33:0/1088273356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565279c8ee30 con 0x565279861070 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/1088273356 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fb0005030 con 0x565279861070 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/1088273356 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2fb4005760 con 0x565279861070 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fc715f740 10 client.18897 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fc715f740 10 client.18897 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fc715f740 20 client.18897 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fc715f740 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5652797f4da0 0x565279c91620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fc715f740 4 client.18897 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fc715f740 1 -- 172.21.15.33:0/1088273356 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565279b7b070 con 0x5652797f4da0 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.256+0000 7f2fba59c640 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5652797f4da0 0x565279c91620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fa1ffb640 10 client.18897 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fba59c640 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5652797f4da0 0x565279c91620 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5aa50c2928f02413 server_cookie=4dd4ecbaf4b1757d in_seq=0 out_seq=0 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fa1ffb640 1 -- 172.21.15.33:0/1088273356 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565279b7b070 con 0x5652797f4da0 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fa1ffb640 10 client.18897 handle_command_reply: tid=0 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 client.18897 shutdown 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 -- 172.21.15.33:0/1088273356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 msgr2=0x565279c8d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c8d850 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40106f0 tx=0x7f2fb40104a0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 -- 172.21.15.33:0/1088273356 shutdown_connections 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5652797f4da0 0x565279c91620 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x565279861070 0x565279c8d850 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x565279840390 0x565279c16620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 --2- 172.21.15.33:0/1088273356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652798381b0 0x565279c160e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 -- 172.21.15.33:0/1088273356 >> 172.21.15.33:0/1088273356 conn(0x565279855460 msgr2=0x565279c039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fa1ffb640 0 client.18897 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:44:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 -- 172.21.15.33:0/1088273356 shutdown_connections 2024-08-28T19:44:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 1 -- 172.21.15.33:0/1088273356 wait complete. 2024-08-28T19:44:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.257+0000 7f2fc715f740 20 client.18897 trim_cache size 0 max 16384 2024-08-28T19:44:34.265 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 -- 172.21.15.33:0/3643316226 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2fa40b4ca0 msgr2=0x7f2fa40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2fa40b4ca0 0x7f2fa40b71b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4005c40 tx=0x7f2fb4009500 comp rx=0 tx=0).stop 2024-08-28T19:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 -- 172.21.15.33:0/3643316226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fbc102810 msgr2=0x7f2fbc19a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fbc102810 0x7f2fbc19a220 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f2fac005940 tx=0x7f2fac004270 comp rx=0 tx=0).stop 2024-08-28T19:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 -- 172.21.15.33:0/3643316226 shutdown_connections 2024-08-28T19:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2fa40b4ca0 0x7f2fa40b71b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2fbc108aa0 0x7f2fbc19fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc108150 0x7f2fbc19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 --2- 172.21.15.33:0/3643316226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2fbc102810 0x7f2fbc19a220 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:34.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 -- 172.21.15.33:0/3643316226 >> 172.21.15.33:0/3643316226 conn(0x7f2fbc0794d0 msgr2=0x7f2fbc06bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:34.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 -- 172.21.15.33:0/3643316226 shutdown_connections 2024-08-28T19:44:34.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:34.258+0000 7f2fc0bea640 1 -- 172.21.15.33:0/3643316226 wait complete. 2024-08-28T19:44:35.058 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:44:35.318 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:35.736 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:35 smithi033 ceph-mon[18549]: pgmap v718: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 73 KiB/s wr, 18 op/s 2024-08-28T19:44:35.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:35 smithi059 ceph-mon[22052]: pgmap v718: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 73 KiB/s wr, 18 op/s 2024-08-28T19:44:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:35 smithi122 ceph-mon[22174]: pgmap v718: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 73 KiB/s wr, 18 op/s 2024-08-28T19:44:35.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.827+0000 7f3c17089640 1 -- 172.21.15.33:0/2715926764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c10108150 msgr2=0x7f3c10108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:35.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.827+0000 7f3c17089640 1 --2- 172.21.15.33:0/2715926764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c10108150 0x7f3c10108560 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009900 tx=0x7f3bfc02a410 comp rx=0 tx=0).stop 2024-08-28T19:44:35.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.827+0000 7f3c17089640 1 -- 172.21.15.33:0/2715926764 shutdown_connections 2024-08-28T19:44:35.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.827+0000 7f3c17089640 1 --2- 172.21.15.33:0/2715926764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10108aa0 0x7f3c1010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.827+0000 7f3c17089640 1 --2- 172.21.15.33:0/2715926764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c10108150 0x7f3c10108560 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.827+0000 7f3c17089640 1 --2- 172.21.15.33:0/2715926764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c10102860 0x7f3c10102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.827+0000 7f3c17089640 1 -- 172.21.15.33:0/2715926764 >> 172.21.15.33:0/2715926764 conn(0x7f3c100794c0 msgr2=0x7f3c100798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.827+0000 7f3c17089640 1 -- 172.21.15.33:0/2715926764 shutdown_connections 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.827+0000 7f3c17089640 1 -- 172.21.15.33:0/2715926764 wait complete. 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c17089640 1 Processor -- start 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c17089640 1 -- start start 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c17089640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c10102860 0x7f3c10199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c17089640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c10108150 0x7f3c10199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c17089640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10108aa0 0x7f3c1019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c17089640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3c10112710 con 0x7f3c10108150 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c17089640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c10112590 con 0x7f3c10108aa0 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c17089640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c10112890 con 0x7f3c10102860 2024-08-28T19:44:35.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c0ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c10108150 0x7f3c10199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c0ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c10108150 0x7f3c10199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38498/0 (socket says 172.21.15.33:38498) 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.828+0000 7f3c0ffff640 1 -- 172.21.15.33:0/2654835557 learned_addr learned my addr 172.21.15.33:0/2654835557 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c14e25640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c10102860 0x7f3c10199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c15626640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10108aa0 0x7f3c1019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c0ffff640 1 -- 172.21.15.33:0/2654835557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c10102860 msgr2=0x7f3c10199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c0ffff640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c10102860 0x7f3c10199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c0ffff640 1 -- 172.21.15.33:0/2654835557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10108aa0 msgr2=0x7f3c1019e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c0ffff640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10108aa0 0x7f3c1019e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c0ffff640 1 -- 172.21.15.33:0/2654835557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1019f0d0 con 0x7f3c10108150 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c15626640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10108aa0 0x7f3c1019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c0ffff640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c10108150 0x7f3c10199700 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc02a930 tx=0x7f3bfc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c0dffb640 1 -- 172.21.15.33:0/2654835557 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc03f030 con 0x7f3c10108150 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c0dffb640 1 -- 172.21.15.33:0/2654835557 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bfc003cb0 con 0x7f3c10108150 2024-08-28T19:44:35.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c17089640 1 -- 172.21.15.33:0/2654835557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1019f360 con 0x7f3c10108150 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c0dffb640 1 -- 172.21.15.33:0/2654835557 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc035070 con 0x7f3c10108150 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.829+0000 7f3c17089640 1 -- 172.21.15.33:0/2654835557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c101a5b20 con 0x7f3c10108150 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.832+0000 7f3c1d5fe740 1 Processor -- start 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.832+0000 7f3c1d5fe740 1 -- start start 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.832+0000 7f3c0dffb640 1 -- 172.21.15.33:0/2654835557 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3bfc042030 con 0x7f3c10108150 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.832+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764ff5070 0x56276539f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.832+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x56276539c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.832+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fd4390 0x56276539cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.832+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562765311680 con 0x562764fcc1b0 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.832+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562765300c10 con 0x562764fd4390 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.832+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562765304bc0 con 0x562764ff5070 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c14e25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x56276539c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c14e25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x56276539c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38500/0 (socket says 172.21.15.33:38500) 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c14e25640 1 -- 172.21.15.33:0/3094359454 learned_addr learned my addr 172.21.15.33:0/3094359454 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c0ffff640 1 --2- 172.21.15.33:0/3094359454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fd4390 0x56276539cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c15626640 1 --2- 172.21.15.33:0/3094359454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764ff5070 0x56276539f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c14e25640 1 -- 172.21.15.33:0/3094359454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764ff5070 msgr2=0x56276539f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c14e25640 1 --2- 172.21.15.33:0/3094359454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764ff5070 0x56276539f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c14e25640 1 -- 172.21.15.33:0/3094359454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fd4390 msgr2=0x56276539cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c14e25640 1 --2- 172.21.15.33:0/3094359454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fd4390 0x56276539cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c14e25640 1 -- 172.21.15.33:0/3094359454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562765060650 con 0x562764fcc1b0 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c0ffff640 1 --2- 172.21.15.33:0/3094359454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fd4390 0x56276539cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c0dffb640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c000b4d20 0x7f3c000b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c14e25640 1 --2- 172.21.15.33:0/3094359454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x56276539c560 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400ac20 tx=0x7f3c0400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf50da91ad41e3d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c15626640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c000b4d20 0x7f3c000b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3bfaffd640 1 -- 172.21.15.33:0/3094359454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0401d070 con 0x562764fcc1b0 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3c0dffb640 1 -- 172.21.15.33:0/2654835557 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f3bfc105e90 con 0x7f3c10108150 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3bfaffd640 1 -- 172.21.15.33:0/3094359454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c04018af0 con 0x562764fcc1b0 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.833+0000 7f3bfaffd640 1 -- 172.21.15.33:0/3094359454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04010ad0 con 0x562764fcc1b0 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.834+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3094359454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 msgr2=0x56276539c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.834+0000 7f3c15626640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c000b4d20 0x7f3c000b7230 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800aee0 tx=0x7f3c0800a4b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.834+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/3094359454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x56276539c560 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400ac20 tx=0x7f3c0400f790 comp rx=0 tx=0).stop 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.834+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3094359454 shutdown_connections 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.834+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/3094359454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fd4390 0x56276539cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.834+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/3094359454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x56276539c560 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.834+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/3094359454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764ff5070 0x56276539f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.834+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3094359454 >> 172.21.15.33:0/3094359454 conn(0x562764fe9460 msgr2=0x56276539a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.834+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3094359454 shutdown_connections 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.834+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3094359454 wait complete. 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.835+0000 7f3c1d5fe740 1 -- start start 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.835+0000 7f3c1d5fe740 1 Processor -- start 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.835+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x5627653aa010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.835+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x5627653aa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.835+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764ff5070 0x5627653b6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.835+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562765163700 con 0x562764fcc1b0 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.835+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562765287750 con 0x562764ff5070 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.835+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5627653ace80 con 0x562764fd4390 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.835+0000 7f3c1d5fe740 10 client.0 _ll_register_callbacks cb 0x5627652b6e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c14e25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x5627653aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c14e25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x5627653aa010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38510/0 (socket says 172.21.15.33:38510) 2024-08-28T19:44:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c14e25640 1 -- 172.21.15.33:0/439151420 learned_addr learned my addr 172.21.15.33:0/439151420 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c0ffff640 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x5627653aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c15626640 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764ff5070 0x5627653b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c14e25640 1 -- 172.21.15.33:0/439151420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 msgr2=0x5627653aa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c14e25640 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x5627653aa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c14e25640 1 -- 172.21.15.33:0/439151420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764ff5070 msgr2=0x5627653b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c14e25640 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764ff5070 0x5627653b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c14e25640 1 -- 172.21.15.33:0/439151420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627652c0900 con 0x562764fcc1b0 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c15626640 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764ff5070 0x5627653b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c14e25640 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x5627653aa010 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f3c04005e90 tx=0x7f3c040186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90be6696458b0b05 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3beffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3beffff640 1 -- 172.21.15.33:0/439151420 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0401d050 con 0x562764fcc1b0 2024-08-28T19:44:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/439151420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c04018af0 con 0x562764fcc1b0 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3beffff640 1 -- 172.21.15.33:0/439151420 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f3c04005250 con 0x562764fcc1b0 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3beffff640 1 -- 172.21.15.33:0/439151420 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c04031050 con 0x562764fcc1b0 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c1d5fe740 10 client.18909 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.836+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/439151420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5627653b8bd0 con 0x562764fcc1b0 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.837+0000 7f3beffff640 1 -- 172.21.15.33:0/439151420 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c04018af0 con 0x562764fcc1b0 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.837+0000 7f3beffff640 1 -- 172.21.15.33:0/439151420 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3c040054c0 con 0x562764fcc1b0 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.837+0000 7f3c1d5fe740 10 client.18909 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.837+0000 7f3c1d5fe740 10 client.18909 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.837+0000 7f3c1d5fe740 20 client.18909 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.837+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x562764fb39f0 0x5627653bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.837+0000 7f3c1d5fe740 4 client.18909 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.837+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/439151420 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627653135d0 con 0x562764fb39f0 2024-08-28T19:44:35.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.837+0000 7f3c0ffff640 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x562764fb39f0 0x5627653bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.838+0000 7f3c0ffff640 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x562764fb39f0 0x5627653bbf90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=340565e44cb41a36 server_cookie=6802544f41d27ec4 in_seq=0 out_seq=0 2024-08-28T19:44:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.838+0000 7f3beffff640 10 client.18909 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:44:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.838+0000 7f3beffff640 1 -- 172.21.15.33:0/439151420 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5627653135d0 con 0x562764fb39f0 2024-08-28T19:44:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.838+0000 7f3beffff640 10 client.18909 handle_command_reply: tid=0 2024-08-28T19:44:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 client.18909 shutdown 2024-08-28T19:44:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/439151420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 msgr2=0x5627653aa010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x5627653aa010 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f3c04005e90 tx=0x7f3c040186f0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/439151420 shutdown_connections 2024-08-28T19:44:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x562764fb39f0 0x5627653bbf90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764ff5070 0x5627653b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x5627653aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3beffff640 0 client.18909 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:44:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/439151420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764fcc1b0 0x5627653aa010 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/439151420 >> 172.21.15.33:0/439151420 conn(0x562764fe9460 msgr2=0x56276539f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/439151420 shutdown_connections 2024-08-28T19:44:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/439151420 wait complete. 2024-08-28T19:44:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.839+0000 7f3c1d5fe740 20 client.18909 trim_cache size 0 max 16384 2024-08-28T19:44:35.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.852+0000 7f3c1d5fe740 1 Processor -- start 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.852+0000 7f3c1d5fe740 1 -- start start 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.852+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 0x562765397810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.852+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x56276539dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.852+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.852+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101aea20 con 0x562764ff5070 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.852+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101b0560 con 0x562764fcc1b0 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.852+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101af0f0 con 0x562764fd4390 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c15626640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c15626640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38520/0 (socket says 172.21.15.33:38520) 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c15626640 1 -- 172.21.15.33:0/813117144 learned_addr learned my addr 172.21.15.33:0/813117144 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c0ffff640 1 --2- 172.21.15.33:0/813117144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x56276539dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c14e25640 1 --2- 172.21.15.33:0/813117144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 0x562765397810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c15626640 1 -- 172.21.15.33:0/813117144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 msgr2=0x56276539dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c15626640 1 --2- 172.21.15.33:0/813117144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x56276539dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c15626640 1 -- 172.21.15.33:0/813117144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 msgr2=0x562765397810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c15626640 1 --2- 172.21.15.33:0/813117144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 0x562765397810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c15626640 1 -- 172.21.15.33:0/813117144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627653aaea0 con 0x562764ff5070 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c14e25640 1 --2- 172.21.15.33:0/813117144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 0x562765397810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3c15626640 1 --2- 172.21.15.33:0/813117144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653b6140 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f3c08011830 tx=0x7f3c08013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb3237baaf22dfe server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3bfa7fc640 1 -- 172.21.15.33:0/813117144 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0801dd40 con 0x562764ff5070 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3bfa7fc640 1 -- 172.21.15.33:0/813117144 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c0801e8d0 con 0x562764ff5070 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.853+0000 7f3bfa7fc640 1 -- 172.21.15.33:0/813117144 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0801b790 con 0x562764ff5070 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.854+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/813117144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 msgr2=0x5627653b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.854+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/813117144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653b6140 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f3c08011830 tx=0x7f3c08013000 comp rx=0 tx=0).stop 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.854+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/813117144 shutdown_connections 2024-08-28T19:44:35.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.854+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/813117144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653b6140 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.854+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/813117144 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x56276539dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.854+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/813117144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 0x562765397810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.854+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/813117144 >> 172.21.15.33:0/813117144 conn(0x562764fe9460 msgr2=0x56276539d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.854+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/813117144 shutdown_connections 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.854+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/813117144 wait complete. 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c1d5fe740 1 -- start start 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c1d5fe740 1 Processor -- start 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 0x5627653b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x5627653b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c1d5fe740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653c0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101afe90 con 0x562764ff5070 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101af7c0 con 0x562764fcc1b0 2024-08-28T19:44:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c1d5fe740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3c101aca20 con 0x562764fd4390 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c1d5fe740 10 client.0 _ll_register_callbacks cb 0x7f3c0401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c15626640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c15626640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653c0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38530/0 (socket says 172.21.15.33:38530) 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c15626640 1 -- 172.21.15.33:0/3761437968 learned_addr learned my addr 172.21.15.33:0/3761437968 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.855+0000 7f3c14e25640 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 0x5627653b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3c0ffff640 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x5627653b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3c15626640 1 -- 172.21.15.33:0/3761437968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 msgr2=0x5627653b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3c15626640 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x5627653b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3c15626640 1 -- 172.21.15.33:0/3761437968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 msgr2=0x5627653b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3c15626640 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 0x5627653b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3c15626640 1 -- 172.21.15.33:0/3761437968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627653c0b10 con 0x562764ff5070 2024-08-28T19:44:35.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3c15626640 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653c0520 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f3c08028040 tx=0x7f3c0801dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5e23cde98985cb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3beffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3beffff640 1 -- 172.21.15.33:0/3761437968 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08034030 con 0x562764ff5070 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3beffff640 1 -- 172.21.15.33:0/3761437968 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f3c0802c040 con 0x562764ff5070 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3761437968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c0801e8d0 con 0x562764ff5070 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3beffff640 1 -- 172.21.15.33:0/3761437968 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c0803e050 con 0x562764ff5070 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3c1d5fe740 10 client.18915 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3761437968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5627653c1ce0 con 0x562764ff5070 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.856+0000 7f3beffff640 1 -- 172.21.15.33:0/3761437968 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c0801e8d0 con 0x562764ff5070 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3beffff640 1 -- 172.21.15.33:0/3761437968 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3c080052e0 con 0x562764ff5070 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3c1d5fe740 10 client.18915 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3c1d5fe740 10 client.18915 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3c1d5fe740 20 client.18915 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:35.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x562764f88da0 0x562765429750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3c1d5fe740 4 client.18915 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3761437968 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56276530f070 con 0x562764f88da0 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3c14e25640 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x562764f88da0 0x562765429750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3c14e25640 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x562764f88da0 0x562765429750 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a3c8f1252b7e58e3 server_cookie=5f79ba18636bbd1d in_seq=0 out_seq=0 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3beffff640 10 client.18915 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3beffff640 1 -- 172.21.15.33:0/3761437968 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56276530f070 con 0x562764f88da0 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.857+0000 7f3beffff640 10 client.18915 handle_command_reply: tid=0 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 client.18915 shutdown 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3761437968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 msgr2=0x5627653c0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653c0520 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f3c08028040 tx=0x7f3c0801dd70 comp rx=0 tx=0).stop 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3761437968 shutdown_connections 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x562764f88da0 0x562765429750 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562764ff5070 0x5627653c0520 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562764fd4390 0x5627653b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3beffff640 0 client.18915 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:44:35.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 --2- 172.21.15.33:0/3761437968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562764fcc1b0 0x5627653b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3761437968 >> 172.21.15.33:0/3761437968 conn(0x562764fe9460 msgr2=0x5627653a8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:35.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3761437968 shutdown_connections 2024-08-28T19:44:35.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 1 -- 172.21.15.33:0/3761437968 wait complete. 2024-08-28T19:44:35.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c1d5fe740 20 client.18915 trim_cache size 0 max 16384 2024-08-28T19:44:35.867 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:44:35.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c17089640 1 -- 172.21.15.33:0/2654835557 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c000b4d20 msgr2=0x7f3c000b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:35.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.858+0000 7f3c17089640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c000b4d20 0x7f3c000b7230 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800aee0 tx=0x7f3c0800a4b0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.859+0000 7f3c17089640 1 -- 172.21.15.33:0/2654835557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c10108150 msgr2=0x7f3c10199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:35.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.859+0000 7f3c17089640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c10108150 0x7f3c10199700 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc02a930 tx=0x7f3bfc004270 comp rx=0 tx=0).stop 2024-08-28T19:44:35.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.859+0000 7f3c17089640 1 -- 172.21.15.33:0/2654835557 shutdown_connections 2024-08-28T19:44:35.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.859+0000 7f3c17089640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c10108aa0 0x7f3c1019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.859+0000 7f3c17089640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c10108150 0x7f3c10199700 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.859+0000 7f3c17089640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3c000b4d20 0x7f3c000b7230 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.859+0000 7f3c17089640 1 --2- 172.21.15.33:0/2654835557 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3c10102860 0x7f3c10199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:35.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.859+0000 7f3c17089640 1 -- 172.21.15.33:0/2654835557 >> 172.21.15.33:0/2654835557 conn(0x7f3c100794c0 msgr2=0x7f3c10106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:35.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.859+0000 7f3c17089640 1 -- 172.21.15.33:0/2654835557 shutdown_connections 2024-08-28T19:44:35.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:35.859+0000 7f3c17089640 1 -- 172.21.15.33:0/2654835557 wait complete. 2024-08-28T19:44:36.667 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:44:36.925 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 -- 172.21.15.33:0/3703947334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ed0108160 msgr2=0x7f5ed0108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:37.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 --2- 172.21.15.33:0/3703947334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ed0108160 0x7f5ed0108570 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009900 tx=0x7f5eb802a410 comp rx=0 tx=0).stop 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 -- 172.21.15.33:0/3703947334 shutdown_connections 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 --2- 172.21.15.33:0/3703947334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed0108ab0 0x7f5ed010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 --2- 172.21.15.33:0/3703947334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ed0108160 0x7f5ed0108570 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 --2- 172.21.15.33:0/3703947334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ed0102820 0x7f5ed0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 -- 172.21.15.33:0/3703947334 >> 172.21.15.33:0/3703947334 conn(0x7f5ed00794e0 msgr2=0x7f5ed00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 -- 172.21.15.33:0/3703947334 shutdown_connections 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 -- 172.21.15.33:0/3703947334 wait complete. 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 Processor -- start 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.436+0000 7f5ed61cd640 1 -- start start 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ed61cd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ed0102820 0x7f5ed019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ed61cd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed0108160 0x7f5ed019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ed61cd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ed0108ab0 0x7f5ed019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ed61cd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed0112760 con 0x7f5ed0108ab0 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ed61cd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01125e0 con 0x7f5ed0102820 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ed61cd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01128e0 con 0x7f5ed0108160 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ecffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ed0108ab0 0x7f5ed019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ecffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ed0108ab0 0x7f5ed019fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38548/0 (socket says 172.21.15.33:38548) 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ecffff640 1 -- 172.21.15.33:0/2934374319 learned_addr learned my addr 172.21.15.33:0/2934374319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed0108160 0x7f5ed019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ed0102820 0x7f5ed019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ecffff640 1 -- 172.21.15.33:0/2934374319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed0108160 msgr2=0x7f5ed019a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ecffff640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed0108160 0x7f5ed019a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ecffff640 1 -- 172.21.15.33:0/2934374319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ed0102820 msgr2=0x7f5ed019a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:37.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ecffff640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ed0102820 0x7f5ed019a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ecffff640 1 -- 172.21.15.33:0/2934374319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed01a0290 con 0x7f5ed0108ab0 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.437+0000 7f5ecffff640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ed0108ab0 0x7f5ed019fb60 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800b970 tx=0x7f5ec800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.438+0000 7f5ecd7fa640 1 -- 172.21.15.33:0/2934374319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8019070 con 0x7f5ed0108ab0 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.438+0000 7f5ed61cd640 1 -- 172.21.15.33:0/2934374319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed01a0580 con 0x7f5ed0108ab0 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.438+0000 7f5ecd7fa640 1 -- 172.21.15.33:0/2934374319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ec8014440 con 0x7f5ed0108ab0 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.438+0000 7f5ecd7fa640 1 -- 172.21.15.33:0/2934374319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80075d0 con 0x7f5ed0108ab0 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.438+0000 7f5ed61cd640 1 -- 172.21.15.33:0/2934374319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed01a6ce0 con 0x7f5ed0108ab0 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.440+0000 7f5edc742740 1 Processor -- start 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.440+0000 7f5ecd7fa640 1 -- 172.21.15.33:0/2934374319 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5ec801c070 con 0x7f5ed0108ab0 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5edc742740 1 -- start start 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5edc742740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727fc0070 0x557728365310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5edc742740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727f971b0 0x557728365850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5edc742740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728365d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5edc742740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5577282dc680 con 0x557727f9f390 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5edc742740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5577282cbc10 con 0x557727fc0070 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5edc742740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5577282cfbc0 con 0x557727f971b0 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5ec6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728365d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5ec6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728365d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38560/0 (socket says 172.21.15.33:38560) 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5ec6ffd640 1 -- 172.21.15.33:0/3650184354 learned_addr learned my addr 172.21.15.33:0/3650184354 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/3650184354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727f971b0 0x557728365850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/3650184354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727fc0070 0x557728365310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5ecd7fa640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ebc0b4ca0 0x7f5ebc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5ec6ffd640 1 -- 172.21.15.33:0/3650184354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727f971b0 msgr2=0x557728365850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:37.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.441+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/3650184354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727f971b0 0x557728365850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.442+0000 7f5ec6ffd640 1 -- 172.21.15.33:0/3650184354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727fc0070 msgr2=0x557728365310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.442+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/3650184354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727fc0070 0x557728365310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.442+0000 7f5ec6ffd640 1 -- 172.21.15.33:0/3650184354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55772802b650 con 0x557727f9f390 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.442+0000 7f5ecffff640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ebc0b4ca0 0x7f5ebc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.442+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/3650184354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728365d90 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f5ed006b460 tx=0x7f5eb8005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd879374c9a8a07c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.442+0000 7f5ecd7fa640 1 -- 172.21.15.33:0/2934374319 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f5ec80e4e30 con 0x7f5ed0108ab0 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.442+0000 7f5ec5ffb640 1 -- 172.21.15.33:0/3650184354 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8035070 con 0x557727f9f390 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.442+0000 7f5ec5ffb640 1 -- 172.21.15.33:0/3650184354 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5eb80035f0 con 0x557727f9f390 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.442+0000 7f5ec5ffb640 1 -- 172.21.15.33:0/3650184354 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80044e0 con 0x557727f9f390 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5edc742740 1 -- 172.21.15.33:0/3650184354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 msgr2=0x557728365d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5ecffff640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ebc0b4ca0 0x7f5ebc0b71b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80e2290 tx=0x7f5ec80786d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5edc742740 1 --2- 172.21.15.33:0/3650184354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728365d90 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f5ed006b460 tx=0x7f5eb8005780 comp rx=0 tx=0).stop 2024-08-28T19:44:37.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5edc742740 1 -- 172.21.15.33:0/3650184354 shutdown_connections 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5edc742740 1 --2- 172.21.15.33:0/3650184354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728365d90 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5edc742740 1 --2- 172.21.15.33:0/3650184354 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727f971b0 0x557728365850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5edc742740 1 --2- 172.21.15.33:0/3650184354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727fc0070 0x557728365310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5edc742740 1 -- 172.21.15.33:0/3650184354 >> 172.21.15.33:0/3650184354 conn(0x557727fb4460 msgr2=0x557728363200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5edc742740 1 -- 172.21.15.33:0/3650184354 shutdown_connections 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5edc742740 1 -- 172.21.15.33:0/3650184354 wait complete. 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.443+0000 7f5edc742740 1 -- start start 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5edc742740 1 Processor -- start 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5edc742740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727f971b0 0x557728370a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5edc742740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f9f390 0x557728370f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5edc742740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727fc0070 0x55772837cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5edc742740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55772812e700 con 0x557727fc0070 2024-08-28T19:44:37.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5edc742740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557728252750 con 0x557727f9f390 2024-08-28T19:44:37.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5edc742740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557728373a90 con 0x557727f971b0 2024-08-28T19:44:37.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5edc742740 10 client.0 _ll_register_callbacks cb 0x557728281e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:37.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5ec6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727fc0070 0x55772837cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5ec6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727fc0070 0x55772837cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38574/0 (socket says 172.21.15.33:38574) 2024-08-28T19:44:37.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5ec6ffd640 1 -- 172.21.15.33:0/685876214 learned_addr learned my addr 172.21.15.33:0/685876214 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:37.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f9f390 0x557728370f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.444+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727f971b0 0x557728370a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.445+0000 7f5ec6ffd640 1 -- 172.21.15.33:0/685876214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727f971b0 msgr2=0x557728370a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:37.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.445+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727f971b0 0x557728370a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.445+0000 7f5ec6ffd640 1 -- 172.21.15.33:0/685876214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f9f390 msgr2=0x557728370f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:37.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.445+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f9f390 0x557728370f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.445+0000 7f5ec6ffd640 1 -- 172.21.15.33:0/685876214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55772828b900 con 0x557727fc0070 2024-08-28T19:44:37.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.445+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727fc0070 0x55772837cdb0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x557728373280 tx=0x7f5eb8041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e9f3b72b5a2469 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:37.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.445+0000 7f5eaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:37.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.445+0000 7f5eaeffd640 1 -- 172.21.15.33:0/685876214 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8035070 con 0x557727fc0070 2024-08-28T19:44:37.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.445+0000 7f5eaeffd640 1 -- 172.21.15.33:0/685876214 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f5eb8004410 con 0x557727fc0070 2024-08-28T19:44:37.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.445+0000 7f5edc742740 1 -- 172.21.15.33:0/685876214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5eb80035f0 con 0x557727fc0070 2024-08-28T19:44:37.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5eaeffd640 1 -- 172.21.15.33:0/685876214 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5eb805c050 con 0x557727fc0070 2024-08-28T19:44:37.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5edc742740 10 client.18927 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:37.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5edc742740 1 -- 172.21.15.33:0/685876214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55772837f810 con 0x557727fc0070 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5eaeffd640 1 -- 172.21.15.33:0/685876214 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5eb80035f0 con 0x557727fc0070 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5eaeffd640 1 -- 172.21.15.33:0/685876214 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5eb803c810 con 0x557727fc0070 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5edc742740 10 client.18927 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5edc742740 10 client.18927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5edc742740 20 client.18927 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5edc742740 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557727f7e9f0 0x557728382b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5edc742740 4 client.18927 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.446+0000 7f5edc742740 1 -- 172.21.15.33:0/685876214 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577282de5d0 con 0x557727f7e9f0 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.447+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557727f7e9f0 0x557728382b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.447+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557727f7e9f0 0x557728382b70 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a787a6985778a8f8 server_cookie=de5bd0e8c27512ed in_seq=0 out_seq=0 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.447+0000 7f5eaeffd640 10 client.18927 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5eaeffd640 1 -- 172.21.15.33:0/685876214 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5577282de5d0 con 0x557727f7e9f0 2024-08-28T19:44:37.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5eaeffd640 10 client.18927 handle_command_reply: tid=0 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 client.18927 shutdown 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 -- 172.21.15.33:0/685876214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727fc0070 msgr2=0x55772837cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727fc0070 0x55772837cdb0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x557728373280 tx=0x7f5eb8041040 comp rx=0 tx=0).stop 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 -- 172.21.15.33:0/685876214 shutdown_connections 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557727f7e9f0 0x557728382b70 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727fc0070 0x55772837cdb0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f9f390 0x557728370f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 --2- 172.21.15.33:0/685876214 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727f971b0 0x557728370a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 -- 172.21.15.33:0/685876214 >> 172.21.15.33:0/685876214 conn(0x557727fb4460 msgr2=0x5577283684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5eaeffd640 0 client.18927 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 -- 172.21.15.33:0/685876214 shutdown_connections 2024-08-28T19:44:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 1 -- 172.21.15.33:0/685876214 wait complete. 2024-08-28T19:44:37.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.448+0000 7f5edc742740 20 client.18927 trim_cache size 0 max 16384 2024-08-28T19:44:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.461+0000 7f5edc742740 1 Processor -- start 2024-08-28T19:44:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5edc742740 1 -- start start 2024-08-28T19:44:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5edc742740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 0x557728368b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5edc742740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x55772837cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5edc742740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727fc0070 0x557728362b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5edc742740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01b0e00 con 0x557727f9f390 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5edc742740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01b2940 con 0x557727f971b0 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5edc742740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01b14d0 con 0x557727fc0070 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5ecf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x55772837cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5ecf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x55772837cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38586/0 (socket says 172.21.15.33:38586) 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5ecf7fe640 1 -- 172.21.15.33:0/4101208947 learned_addr learned my addr 172.21.15.33:0/4101208947 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/4101208947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 0x557728368b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/4101208947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727fc0070 0x557728362b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5ecf7fe640 1 -- 172.21.15.33:0/4101208947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727fc0070 msgr2=0x557728362b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/4101208947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727fc0070 0x557728362b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5ecf7fe640 1 -- 172.21.15.33:0/4101208947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 msgr2=0x557728368b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:37.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/4101208947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 0x557728368b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.462+0000 7f5ecf7fe640 1 -- 172.21.15.33:0/4101208947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557728367600 con 0x557727f9f390 2024-08-28T19:44:37.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/4101208947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x55772837cd20 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000b900 tx=0x7f5ec000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b9b47cfd0a865a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:37.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5ec57fa640 1 -- 172.21.15.33:0/4101208947 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0028070 con 0x557727f9f390 2024-08-28T19:44:37.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5ec57fa640 1 -- 172.21.15.33:0/4101208947 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ec0003d50 con 0x557727f9f390 2024-08-28T19:44:37.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5ec57fa640 1 -- 172.21.15.33:0/4101208947 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0023660 con 0x557727f9f390 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5edc742740 1 -- 172.21.15.33:0/4101208947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 msgr2=0x55772837cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5edc742740 1 --2- 172.21.15.33:0/4101208947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x55772837cd20 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000b900 tx=0x7f5ec000b390 comp rx=0 tx=0).stop 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5edc742740 1 -- 172.21.15.33:0/4101208947 shutdown_connections 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5edc742740 1 --2- 172.21.15.33:0/4101208947 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727fc0070 0x557728362b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5edc742740 1 --2- 172.21.15.33:0/4101208947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x55772837cd20 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5edc742740 1 --2- 172.21.15.33:0/4101208947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 0x557728368b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.463+0000 7f5edc742740 1 -- 172.21.15.33:0/4101208947 >> 172.21.15.33:0/4101208947 conn(0x557727fb4460 msgr2=0x557728368410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.464+0000 7f5edc742740 1 -- 172.21.15.33:0/4101208947 shutdown_connections 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.464+0000 7f5edc742740 1 -- 172.21.15.33:0/4101208947 wait complete. 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.464+0000 7f5edc742740 1 -- start start 2024-08-28T19:44:37.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.464+0000 7f5edc742740 1 Processor -- start 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.464+0000 7f5edc742740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 0x5577283864c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.464+0000 7f5edc742740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728383990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.464+0000 7f5edc742740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727fc0070 0x557728384030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.464+0000 7f5edc742740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01b2270 con 0x557727f9f390 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.464+0000 7f5edc742740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01b1ba0 con 0x557727f971b0 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.464+0000 7f5edc742740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01aee00 con 0x557727fc0070 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5edc742740 10 client.0 _ll_register_callbacks cb 0x7f5eb8032e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ecf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728383990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ecf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728383990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38594/0 (socket says 172.21.15.33:38594) 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ecf7fe640 1 -- 172.21.15.33:0/3264759227 learned_addr learned my addr 172.21.15.33:0/3264759227 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727fc0070 0x557728384030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 0x5577283864c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ecf7fe640 1 -- 172.21.15.33:0/3264759227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727fc0070 msgr2=0x557728384030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727fc0070 0x557728384030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ecf7fe640 1 -- 172.21.15.33:0/3264759227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 msgr2=0x5577283864c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 0x5577283864c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ecf7fe640 1 -- 172.21.15.33:0/3264759227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577283847a0 con 0x557727f9f390 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 0x5577283864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5ecf7fe640 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728383990 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0005890 tx=0x7f5ec0004020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e34127ec0a099a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5eaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5eaeffd640 1 -- 172.21.15.33:0/3264759227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0028040 con 0x557727f9f390 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5eaeffd640 1 -- 172.21.15.33:0/3264759227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f5ec0005240 con 0x557727f9f390 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.465+0000 7f5edc742740 1 -- 172.21.15.33:0/3264759227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ec0003d50 con 0x557727f9f390 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5eaeffd640 1 -- 172.21.15.33:0/3264759227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5ec003a050 con 0x557727f9f390 2024-08-28T19:44:37.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5edc742740 10 client.18933 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5edc742740 1 -- 172.21.15.33:0/3264759227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5577283ed370 con 0x557727f9f390 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5eaeffd640 1 -- 172.21.15.33:0/3264759227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ec0003d50 con 0x557727f9f390 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5eaeffd640 1 -- 172.21.15.33:0/3264759227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5ec002b070 con 0x557727f9f390 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5edc742740 10 client.18933 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5edc742740 10 client.18933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5edc742740 20 client.18933 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5edc742740 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557727f53da0 0x5577283ef990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5edc742740 4 client.18933 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5edc742740 1 -- 172.21.15.33:0/3264759227 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577282da070 con 0x557727f53da0 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.466+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557727f53da0 0x5577283ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5ec6ffd640 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557727f53da0 0x5577283ef990 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ada2c27e7a998c2 server_cookie=2e59f1f96cd35177 in_seq=0 out_seq=0 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5eaeffd640 10 client.18933 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:37.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5eaeffd640 1 -- 172.21.15.33:0/3264759227 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577282da070 con 0x557727f53da0 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5eaeffd640 10 client.18933 handle_command_reply: tid=0 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 client.18933 shutdown 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 -- 172.21.15.33:0/3264759227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 msgr2=0x557728383990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728383990 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0005890 tx=0x7f5ec0004020 comp rx=0 tx=0).stop 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 -- 172.21.15.33:0/3264759227 shutdown_connections 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557727fc0070 0x557728384030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557727f53da0 0x5577283ef990 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557727f9f390 0x557728383990 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5eaeffd640 0 client.18933 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 --2- 172.21.15.33:0/3264759227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557727f971b0 0x5577283864c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 -- 172.21.15.33:0/3264759227 >> 172.21.15.33:0/3264759227 conn(0x557727fb4460 msgr2=0x557728362a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 -- 172.21.15.33:0/3264759227 shutdown_connections 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.467+0000 7f5edc742740 1 -- 172.21.15.33:0/3264759227 wait complete. 2024-08-28T19:44:37.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5edc742740 20 client.18933 trim_cache size 0 max 16384 2024-08-28T19:44:37.475 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 -- 172.21.15.33:0/2934374319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ebc0b4ca0 msgr2=0x7f5ebc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ebc0b4ca0 0x7f5ebc0b71b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80e2290 tx=0x7f5ec80786d0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 -- 172.21.15.33:0/2934374319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ed0108ab0 msgr2=0x7f5ed019fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ed0108ab0 0x7f5ed019fb60 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800b970 tx=0x7f5ec800be30 comp rx=0 tx=0).stop 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 -- 172.21.15.33:0/2934374319 shutdown_connections 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ed0108ab0 0x7f5ed019fb60 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5ebc0b4ca0 0x7f5ebc0b71b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ed0108160 0x7f5ed019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 --2- 172.21.15.33:0/2934374319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ed0102820 0x7f5ed019a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 -- 172.21.15.33:0/2934374319 >> 172.21.15.33:0/2934374319 conn(0x7f5ed00794e0 msgr2=0x7f5ed01017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 -- 172.21.15.33:0/2934374319 shutdown_connections 2024-08-28T19:44:37.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:37.468+0000 7f5ed61cd640 1 -- 172.21.15.33:0/2934374319 wait complete. 2024-08-28T19:44:37.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:37 smithi033 ceph-mon[18549]: pgmap v719: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 13 op/s 2024-08-28T19:44:37.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:37 smithi059 ceph-mon[22052]: pgmap v719: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 13 op/s 2024-08-28T19:44:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:37 smithi122 ceph-mon[22174]: pgmap v719: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 13 op/s 2024-08-28T19:44:39.148 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:44:39.149 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:44:39.416 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:39.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:39 smithi059 ceph-mon[22052]: pgmap v720: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 80 KiB/s wr, 17 op/s 2024-08-28T19:44:39.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:39 smithi122 ceph-mon[22174]: pgmap v720: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 80 KiB/s wr, 17 op/s 2024-08-28T19:44:39.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:39 smithi033 ceph-mon[18549]: pgmap v720: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 80 KiB/s wr, 17 op/s 2024-08-28T19:44:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.923+0000 7f9468671640 1 -- 172.21.15.33:0/1612584102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9460107980 msgr2=0x7f9460107d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.923+0000 7f9468671640 1 --2- 172.21.15.33:0/1612584102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9460107980 0x7f9460107d90 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f9450009900 tx=0x7f945002a3f0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.923+0000 7f9468671640 1 -- 172.21.15.33:0/1612584102 shutdown_connections 2024-08-28T19:44:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.923+0000 7f9468671640 1 --2- 172.21.15.33:0/1612584102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94601082d0 0x7f946010eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.923+0000 7f9468671640 1 --2- 172.21.15.33:0/1612584102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9460107980 0x7f9460107d90 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.923+0000 7f9468671640 1 --2- 172.21.15.33:0/1612584102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9460102040 0x7f9460102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.924+0000 7f9468671640 1 -- 172.21.15.33:0/1612584102 >> 172.21.15.33:0/1612584102 conn(0x7f9460079c60 msgr2=0x7f946007a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.924+0000 7f9468671640 1 -- 172.21.15.33:0/1612584102 shutdown_connections 2024-08-28T19:44:39.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.924+0000 7f9468671640 1 -- 172.21.15.33:0/1612584102 wait complete. 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.924+0000 7f9468671640 1 Processor -- start 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.924+0000 7f9468671640 1 -- start start 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9468671640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9460102040 0x7f946019b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9468671640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9460107980 0x7f946019b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9468671640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94601082d0 0x7f946019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9468671640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9460111f30 con 0x7f9460107980 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9468671640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9460111db0 con 0x7f9460102040 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9468671640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94601120b0 con 0x7f94601082d0 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9465c0c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9460107980 0x7f946019b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9465c0c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9460107980 0x7f946019b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46976/0 (socket says 172.21.15.33:46976) 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9465c0c640 1 -- 172.21.15.33:0/1340499019 learned_addr learned my addr 172.21.15.33:0/1340499019 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:39.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9466c0e640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94601082d0 0x7f946019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f946640d640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9460102040 0x7f946019b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9465c0c640 1 -- 172.21.15.33:0/1340499019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94601082d0 msgr2=0x7f946019baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9465c0c640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94601082d0 0x7f946019baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9465c0c640 1 -- 172.21.15.33:0/1340499019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9460102040 msgr2=0x7f946019b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9465c0c640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9460102040 0x7f946019b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9465c0c640 1 -- 172.21.15.33:0/1340499019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94601a62f0 con 0x7f9460107980 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9465c0c640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9460107980 0x7f946019b5b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f945002a910 tx=0x7f9450004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f94577fe640 1 -- 172.21.15.33:0/1340499019 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945003f030 con 0x7f9460107980 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f94577fe640 1 -- 172.21.15.33:0/1340499019 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9450003aa0 con 0x7f9460107980 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f9468671640 1 -- 172.21.15.33:0/1340499019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94601a6580 con 0x7f9460107980 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.925+0000 7f94577fe640 1 -- 172.21.15.33:0/1340499019 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450035070 con 0x7f9460107980 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.926+0000 7f9468671640 1 -- 172.21.15.33:0/1340499019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94601a6ab0 con 0x7f9460107980 2024-08-28T19:44:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.928+0000 7f946ebe6740 1 Processor -- start 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.928+0000 7f946ebe6740 1 -- start start 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.928+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d2bd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.928+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.928+0000 7f94577fe640 1 -- 172.21.15.33:0/1340499019 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9450042030 con 0x7f9460107980 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.928+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 0x564f6d2be200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.928+0000 7f946ebe6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564f6d2335f0 con 0x564f6ceee490 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.928+0000 7f946ebe6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564f6d222b80 con 0x564f6cef6670 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.928+0000 7f946ebe6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564f6d226b30 con 0x564f6cf17350 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f946640d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f946640d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2bdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46978/0 (socket says 172.21.15.33:46978) 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f946640d640 1 -- 172.21.15.33:0/2155729270 learned_addr learned my addr 172.21.15.33:0/2155729270 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f9465c0c640 1 --2- 172.21.15.33:0/2155729270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 0x564f6d2be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f9466c0e640 1 --2- 172.21.15.33:0/2155729270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d2bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f946640d640 1 -- 172.21.15.33:0/2155729270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 msgr2=0x564f6d2bd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f946640d640 1 --2- 172.21.15.33:0/2155729270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d2bd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f946640d640 1 -- 172.21.15.33:0/2155729270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 msgr2=0x564f6d2be200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f946640d640 1 --2- 172.21.15.33:0/2155729270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 0x564f6d2be200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f946640d640 1 -- 172.21.15.33:0/2155729270 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f6cf82930 con 0x564f6ceee490 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f946640d640 1 --2- 172.21.15.33:0/2155729270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2bdcc0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f945c00cc20 tx=0x7f945c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9f1e9830a96145 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f94577fe640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f944c0b4d20 0x7f944c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f9454ff9640 1 -- 172.21.15.33:0/2155729270 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c014070 con 0x564f6ceee490 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f9466c0e640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f944c0b4d20 0x7f944c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f9454ff9640 1 -- 172.21.15.33:0/2155729270 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f945c0047a0 con 0x564f6ceee490 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.929+0000 7f9454ff9640 1 -- 172.21.15.33:0/2155729270 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c010690 con 0x564f6ceee490 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.930+0000 7f94577fe640 1 -- 172.21.15.33:0/1340499019 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f9450105f70 con 0x7f9460107980 2024-08-28T19:44:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.930+0000 7f946ebe6740 1 -- 172.21.15.33:0/2155729270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 msgr2=0x564f6d2bdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.930+0000 7f9466c0e640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f944c0b4d20 0x7f944c0b7230 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9460106870 tx=0x7f9458009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.930+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2155729270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2bdcc0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f945c00cc20 tx=0x7f945c00e720 comp rx=0 tx=0).stop 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.930+0000 7f946ebe6740 1 -- 172.21.15.33:0/2155729270 shutdown_connections 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.930+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2155729270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 0x564f6d2be200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.930+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2155729270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2bdcc0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.930+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2155729270 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d2bd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.930+0000 7f946ebe6740 1 -- 172.21.15.33:0/2155729270 >> 172.21.15.33:0/2155729270 conn(0x564f6cf0b740 msgr2=0x564f6d2bb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 1 -- 172.21.15.33:0/2155729270 shutdown_connections 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 1 -- 172.21.15.33:0/2155729270 wait complete. 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 1 -- start start 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 1 Processor -- start 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cef6670 0x564f6d2c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cf17350 0x564f6d2d5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564f6d085890 con 0x564f6ceee490 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564f6d1a9790 con 0x564f6cf17350 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564f6d2cbf60 con 0x564f6cef6670 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946ebe6740 10 client.0 _ll_register_callbacks cb 0x564f6cf2eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946640d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.931+0000 7f946640d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46986/0 (socket says 172.21.15.33:46986) 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f946640d640 1 -- 172.21.15.33:0/2865551770 learned_addr learned my addr 172.21.15.33:0/2865551770 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f9465c0c640 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cef6670 0x564f6d2c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f9466c0e640 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cf17350 0x564f6d2d5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f946640d640 1 -- 172.21.15.33:0/2865551770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cef6670 msgr2=0x564f6d2c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f946640d640 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cef6670 0x564f6d2c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f946640d640 1 -- 172.21.15.33:0/2865551770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cf17350 msgr2=0x564f6d2d5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f946640d640 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cf17350 0x564f6d2d5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f946640d640 1 -- 172.21.15.33:0/2865551770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f6d1e0f30 con 0x564f6ceee490 2024-08-28T19:44:39.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f946640d640 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2c8f00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f945c000c00 tx=0x7f945c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627cf8326b2301b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f9449ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f9449ffb640 1 -- 172.21.15.33:0/2865551770 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c027060 con 0x564f6ceee490 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f9449ffb640 1 -- 172.21.15.33:0/2865551770 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f945c005430 con 0x564f6ceee490 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.932+0000 7f946ebe6740 1 -- 172.21.15.33:0/2865551770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f945c0047a0 con 0x564f6ceee490 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f9449ffb640 1 -- 172.21.15.33:0/2865551770 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f945c02e050 con 0x564f6ceee490 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f946ebe6740 10 client.18945 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f946ebe6740 1 -- 172.21.15.33:0/2865551770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f6d2d7d00 con 0x564f6ceee490 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f9449ffb640 1 -- 172.21.15.33:0/2865551770 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f945c0047a0 con 0x564f6ceee490 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f9449ffb640 1 -- 172.21.15.33:0/2865551770 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f945c0104a0 con 0x564f6ceee490 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f946ebe6740 10 client.18945 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f946ebe6740 10 client.18945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:44:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f946ebe6740 20 client.18945 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564f6ced5cd0 0x564f6d2db110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f946ebe6740 4 client.18945 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f946ebe6740 1 -- 172.21.15.33:0/2865551770 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f6d235540 con 0x564f6ced5cd0 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.933+0000 7f9465c0c640 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564f6ced5cd0 0x564f6d2db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.934+0000 7f9449ffb640 10 client.18945 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.934+0000 7f9465c0c640 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564f6ced5cd0 0x564f6d2db110 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c91f967f4d4bc35 server_cookie=db2fd8ea57d8249b in_seq=0 out_seq=0 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.934+0000 7f9449ffb640 1 -- 172.21.15.33:0/2865551770 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f6d235540 con 0x564f6ced5cd0 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.934+0000 7f9449ffb640 10 client.18945 handle_command_reply: tid=0 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 client.18945 shutdown 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 -- 172.21.15.33:0/2865551770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 msgr2=0x564f6d2c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2c8f00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f945c000c00 tx=0x7f945c00cf20 comp rx=0 tx=0).stop 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 -- 172.21.15.33:0/2865551770 shutdown_connections 2024-08-28T19:44:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cf17350 0x564f6d2d5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cef6670 0x564f6d2c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564f6ced5cd0 0x564f6d2db110 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2865551770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d2c8f00 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f9449ffb640 0 client.18945 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 -- 172.21.15.33:0/2865551770 >> 172.21.15.33:0/2865551770 conn(0x564f6cf0b740 msgr2=0x564f6d2c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 -- 172.21.15.33:0/2865551770 shutdown_connections 2024-08-28T19:44:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 1 -- 172.21.15.33:0/2865551770 wait complete. 2024-08-28T19:44:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.935+0000 7f946ebe6740 20 client.18945 trim_cache size 0 max 16384 2024-08-28T19:44:39.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.953+0000 7f946ebe6740 1 Processor -- start 2024-08-28T19:44:39.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f946ebe6740 1 -- start start 2024-08-28T19:44:39.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6ceee490 0x564f6d2c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6cef6670 0x564f6d2beec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d2d51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f946ebe6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f94601b0be0 con 0x564f6cef6670 2024-08-28T19:44:39.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f946ebe6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94601b2720 con 0x564f6ceee490 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f946ebe6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94601b12b0 con 0x564f6cf17350 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f9465c0c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6cef6670 0x564f6d2beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f9465c0c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6cef6670 0x564f6d2beec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46996/0 (socket says 172.21.15.33:46996) 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f9465c0c640 1 -- 172.21.15.33:0/2942340116 learned_addr learned my addr 172.21.15.33:0/2942340116 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f946640d640 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6ceee490 0x564f6d2c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f9466c0e640 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d2d51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f9465c0c640 1 -- 172.21.15.33:0/2942340116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 msgr2=0x564f6d2d51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f9465c0c640 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d2d51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f9465c0c640 1 -- 172.21.15.33:0/2942340116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6ceee490 msgr2=0x564f6d2c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f9465c0c640 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6ceee490 0x564f6d2c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f9465c0c640 1 -- 172.21.15.33:0/2942340116 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f6d2c7e60 con 0x564f6cef6670 2024-08-28T19:44:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f9466c0e640 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d2d51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.954+0000 7f946640d640 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6ceee490 0x564f6d2c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.955+0000 7f9465c0c640 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6cef6670 0x564f6d2beec0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f94500d50b0 tx=0x7f94500ef040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7384097f7508bc17 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.955+0000 7f944bfff640 1 -- 172.21.15.33:0/2942340116 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450049040 con 0x564f6cef6670 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.955+0000 7f944bfff640 1 -- 172.21.15.33:0/2942340116 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94500cbdd0 con 0x564f6cef6670 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.955+0000 7f944bfff640 1 -- 172.21.15.33:0/2942340116 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500d0b30 con 0x564f6cef6670 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 -- 172.21.15.33:0/2942340116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6cef6670 msgr2=0x564f6d2beec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6cef6670 0x564f6d2beec0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f94500d50b0 tx=0x7f94500ef040 comp rx=0 tx=0).stop 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 -- 172.21.15.33:0/2942340116 shutdown_connections 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d2d51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6cef6670 0x564f6d2beec0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 --2- 172.21.15.33:0/2942340116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6ceee490 0x564f6d2c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 -- 172.21.15.33:0/2942340116 >> 172.21.15.33:0/2942340116 conn(0x564f6cf0b740 msgr2=0x564f6d2be7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 -- 172.21.15.33:0/2942340116 shutdown_connections 2024-08-28T19:44:39.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 -- 172.21.15.33:0/2942340116 wait complete. 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 -- start start 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.956+0000 7f946ebe6740 1 Processor -- start 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d339a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 0x564f6d33a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946ebe6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d33e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946ebe6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f94601b2050 con 0x564f6ceee490 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946ebe6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94601b1980 con 0x564f6cef6670 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946ebe6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f94601aebe0 con 0x564f6cf17350 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946ebe6740 10 client.0 _ll_register_callbacks cb 0x7f9450109990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946640d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d339a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946640d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d339a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47012/0 (socket says 172.21.15.33:47012) 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946640d640 1 -- 172.21.15.33:0/4007598831 learned_addr learned my addr 172.21.15.33:0/4007598831 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f9466c0e640 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d33e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f9465c0c640 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 0x564f6d33a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946640d640 1 -- 172.21.15.33:0/4007598831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 msgr2=0x564f6d33e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946640d640 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d33e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946640d640 1 -- 172.21.15.33:0/4007598831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 msgr2=0x564f6d33a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946640d640 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 0x564f6d33a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946640d640 1 -- 172.21.15.33:0/4007598831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f6d33eee0 con 0x564f6ceee490 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f9465c0c640 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 0x564f6d33a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f946640d640 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d339a20 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f945c00e760 tx=0x7f945c004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca3a818065716c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f9449ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f9449ffb640 1 -- 172.21.15.33:0/4007598831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c027070 con 0x564f6ceee490 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.957+0000 7f9449ffb640 1 -- 172.21.15.33:0/4007598831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f945c005230 con 0x564f6ceee490 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f946ebe6740 1 -- 172.21.15.33:0/4007598831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94500cbdd0 con 0x564f6ceee490 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f9449ffb640 1 -- 172.21.15.33:0/4007598831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f945c040050 con 0x564f6ceee490 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f946ebe6740 10 client.18951 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:39.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f946ebe6740 1 -- 172.21.15.33:0/4007598831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f6d3461f0 con 0x564f6ceee490 2024-08-28T19:44:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f9449ffb640 1 -- 172.21.15.33:0/4007598831 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94500cbdd0 con 0x564f6ceee490 2024-08-28T19:44:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f9449ffb640 1 -- 172.21.15.33:0/4007598831 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f945c005430 con 0x564f6ceee490 2024-08-28T19:44:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f946ebe6740 10 client.18951 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f946ebe6740 10 client.18951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:44:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f946ebe6740 20 client.18951 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f946ebe6740 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564f6ceab080 0x564f6d3489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f946ebe6740 4 client.18951 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:44:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f946ebe6740 1 -- 172.21.15.33:0/4007598831 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564f6d230fe0 con 0x564f6ceab080 2024-08-28T19:44:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.958+0000 7f9465c0c640 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564f6ceab080 0x564f6d3489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:39.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.959+0000 7f9449ffb640 10 client.18951 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.959+0000 7f9465c0c640 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564f6ceab080 0x564f6d3489d0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=486311679e8fa4c server_cookie=ba22b617113933c4 in_seq=0 out_seq=0 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.960+0000 7f9449ffb640 1 -- 172.21.15.33:0/4007598831 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564f6d230fe0 con 0x564f6ceab080 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.960+0000 7f9449ffb640 10 client.18951 handle_command_reply: tid=0 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.960+0000 7f946ebe6740 1 client.18951 shutdown 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 1 -- 172.21.15.33:0/4007598831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 msgr2=0x564f6d339a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d339a20 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f945c00e760 tx=0x7f945c004c60 comp rx=0 tx=0).stop 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 1 -- 172.21.15.33:0/4007598831 shutdown_connections 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564f6cf17350 0x564f6d33e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f6cef6670 0x564f6d33a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x564f6ceab080 0x564f6d3489d0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 1 --2- 172.21.15.33:0/4007598831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564f6ceee490 0x564f6d339a20 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f9449ffb640 0 client.18951 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 1 -- 172.21.15.33:0/4007598831 >> 172.21.15.33:0/4007598831 conn(0x564f6cf0b740 msgr2=0x564f6d2d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 1 -- 172.21.15.33:0/4007598831 shutdown_connections 2024-08-28T19:44:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 1 -- 172.21.15.33:0/4007598831 wait complete. 2024-08-28T19:44:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.961+0000 7f946ebe6740 20 client.18951 trim_cache size 0 max 16384 2024-08-28T19:44:39.970 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:44:39.970 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:44:39.970 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "36820268-5bed-48c3-bfaa-51c3537532e6", 2024-08-28T19:44:39.970 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:44:39.970 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:44:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 -- 172.21.15.33:0/1340499019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f944c0b4d20 msgr2=0x7f944c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f944c0b4d20 0x7f944c0b7230 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9460106870 tx=0x7f9458009600 comp rx=0 tx=0).stop 2024-08-28T19:44:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 -- 172.21.15.33:0/1340499019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9460107980 msgr2=0x7f946019b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9460107980 0x7f946019b5b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f945002a910 tx=0x7f9450004270 comp rx=0 tx=0).stop 2024-08-28T19:44:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 -- 172.21.15.33:0/1340499019 shutdown_connections 2024-08-28T19:44:39.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f944c0b4d20 0x7f944c0b7230 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94601082d0 0x7f946019baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9460107980 0x7f946019b5b0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 --2- 172.21.15.33:0/1340499019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9460102040 0x7f946019b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:39.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 -- 172.21.15.33:0/1340499019 >> 172.21.15.33:0/1340499019 conn(0x7f9460079c60 msgr2=0x7f9460100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:39.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 -- 172.21.15.33:0/1340499019 shutdown_connections 2024-08-28T19:44:39.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:39.962+0000 7f9468671640 1 -- 172.21.15.33:0/1340499019 wait complete. 2024-08-28T19:44:40.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:40 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:44:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:40 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:44:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:40 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:44:40.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:40 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:44:40.702 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:44:40.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:40 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:44:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:40 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:44:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:40 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:44:40.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:40 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:44:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:40 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:44:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:40 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:44:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:40 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:44:40.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:40 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:44:40.958 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:41.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.473+0000 7f26b13f9640 1 -- 172.21.15.33:0/3189205385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ac108b10 msgr2=0x7f26ac10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.473+0000 7f26b13f9640 1 --2- 172.21.15.33:0/3189205385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ac108b10 0x7f26ac10f340 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009ca0 tx=0x7f26a402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.473+0000 7f26b13f9640 1 -- 172.21.15.33:0/3189205385 shutdown_connections 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.473+0000 7f26b13f9640 1 --2- 172.21.15.33:0/3189205385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ac108b10 0x7f26ac10f340 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.473+0000 7f26b13f9640 1 --2- 172.21.15.33:0/3189205385 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26ac1081c0 0x7f26ac1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.473+0000 7f26b13f9640 1 --2- 172.21.15.33:0/3189205385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26ac102880 0x7f26ac102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.473+0000 7f26b13f9640 1 -- 172.21.15.33:0/3189205385 >> 172.21.15.33:0/3189205385 conn(0x7f26ac079510 msgr2=0x7f26ac079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.473+0000 7f26b13f9640 1 -- 172.21.15.33:0/3189205385 shutdown_connections 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.473+0000 7f26b13f9640 1 -- 172.21.15.33:0/3189205385 wait complete. 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.474+0000 7f26b13f9640 1 Processor -- start 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.474+0000 7f26b13f9640 1 -- start start 2024-08-28T19:44:41.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.474+0000 7f26b13f9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ac102880 0x7f26ac0ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.474+0000 7f26b13f9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26ac1081c0 0x7f26ac0ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.474+0000 7f26b13f9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26ac108b10 0x7f26ac0ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.474+0000 7f26b13f9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1127c0 con 0x7f26ac102880 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.474+0000 7f26b13f9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac112640 con 0x7f26ac1081c0 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.474+0000 7f26b13f9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac112940 con 0x7f26ac108b10 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ac102880 0x7f26ac0ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ac102880 0x7f26ac0ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47020/0 (socket says 172.21.15.33:47020) 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aaffd640 1 -- 172.21.15.33:0/2983659737 learned_addr learned my addr 172.21.15.33:0/2983659737 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26ac1081c0 0x7f26ac0ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26ab7fe640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26ac108b10 0x7f26ac0ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aaffd640 1 -- 172.21.15.33:0/2983659737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26ac108b10 msgr2=0x7f26ac0ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aaffd640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26ac108b10 0x7f26ac0ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aaffd640 1 -- 172.21.15.33:0/2983659737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26ac1081c0 msgr2=0x7f26ac0ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:41.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aaffd640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26ac1081c0 0x7f26ac0ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aaffd640 1 -- 172.21.15.33:0/2983659737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac1a8470 con 0x7f26ac102880 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26ac1081c0 0x7f26ac0ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26ab7fe640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26ac108b10 0x7f26ac0ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26aaffd640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ac102880 0x7f26ac0ff410 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f269c00d950 tx=0x7f269c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f2693fff640 1 -- 172.21.15.33:0/2983659737 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c017070 con 0x7f26ac102880 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f2693fff640 1 -- 172.21.15.33:0/2983659737 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f269c009c30 con 0x7f26ac102880 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26b13f9640 1 -- 172.21.15.33:0/2983659737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ac1a8760 con 0x7f26ac102880 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f2693fff640 1 -- 172.21.15.33:0/2983659737 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c00f620 con 0x7f26ac102880 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.475+0000 7f26b13f9640 1 -- 172.21.15.33:0/2983659737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ac1a8ca0 con 0x7f26ac102880 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.478+0000 7f26b796e740 1 Processor -- start 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.478+0000 7f26b796e740 1 -- start start 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f2693fff640 1 -- 172.21.15.33:0/2983659737 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f269c010460 con 0x7f26ac102880 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26b796e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2659070 0x5621f29fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26b796e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f29fe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26b796e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2638390 0x5621f29fed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26b796e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5621f2975630 con 0x5621f26301b0 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26b796e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5621f2964bc0 con 0x5621f2659070 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26b796e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5621f2968b70 con 0x5621f2638390 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26aaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f29fe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26aaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f29fe800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47034/0 (socket says 172.21.15.33:47034) 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26aaffd640 1 -- 172.21.15.33:0/3655617929 learned_addr learned my addr 172.21.15.33:0/3655617929 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26ab7fe640 1 --2- 172.21.15.33:0/3655617929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2659070 0x5621f29fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/3655617929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2638390 0x5621f29fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26aaffd640 1 -- 172.21.15.33:0/3655617929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2638390 msgr2=0x5621f29fed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26aaffd640 1 --2- 172.21.15.33:0/3655617929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2638390 0x5621f29fed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26aaffd640 1 -- 172.21.15.33:0/3655617929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2659070 msgr2=0x5621f29fe2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26aaffd640 1 --2- 172.21.15.33:0/3655617929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2659070 0x5621f29fe2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.479+0000 7f26aaffd640 1 -- 172.21.15.33:0/3655617929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621f26c4650 con 0x5621f26301b0 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.480+0000 7f2693fff640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26940b4ca0 0x7f26940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.480+0000 7f26aaffd640 1 --2- 172.21.15.33:0/3655617929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f29fe800 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f269c0e2910 tx=0x7f269c0ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06442f70b4326a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.480+0000 7f26ab7fe640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26940b4ca0 0x7f26940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.480+0000 7f26917fa640 1 -- 172.21.15.33:0/3655617929 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0a7800 con 0x5621f26301b0 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.480+0000 7f2693fff640 1 -- 172.21.15.33:0/2983659737 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f269c0e55f0 con 0x7f26ac102880 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.480+0000 7f26917fa640 1 -- 172.21.15.33:0/3655617929 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f269c0ab450 con 0x5621f26301b0 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.480+0000 7f26917fa640 1 -- 172.21.15.33:0/3655617929 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0ab0b0 con 0x5621f26301b0 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.481+0000 7f26b796e740 1 -- 172.21.15.33:0/3655617929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 msgr2=0x5621f29fe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.481+0000 7f26b796e740 1 --2- 172.21.15.33:0/3655617929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f29fe800 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f269c0e2910 tx=0x7f269c0ed690 comp rx=0 tx=0).stop 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.481+0000 7f26ab7fe640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26940b4ca0 0x7f26940b71b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f26a4004af0 tx=0x7f26a4005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.481+0000 7f26b796e740 1 -- 172.21.15.33:0/3655617929 shutdown_connections 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.481+0000 7f26b796e740 1 --2- 172.21.15.33:0/3655617929 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2638390 0x5621f29fed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.481+0000 7f26b796e740 1 --2- 172.21.15.33:0/3655617929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f29fe800 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.481+0000 7f26b796e740 1 --2- 172.21.15.33:0/3655617929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2659070 0x5621f29fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.481+0000 7f26b796e740 1 -- 172.21.15.33:0/3655617929 >> 172.21.15.33:0/3655617929 conn(0x5621f264d460 msgr2=0x5621f29fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.481+0000 7f26b796e740 1 -- 172.21.15.33:0/3655617929 shutdown_connections 2024-08-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26b796e740 1 -- 172.21.15.33:0/3655617929 wait complete. 2024-08-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26b796e740 1 -- start start 2024-08-28T19:44:41.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26b796e740 1 Processor -- start 2024-08-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26b796e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a09ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26b796e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2638390 0x5621f2a0a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26b796e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2659070 0x5621f2a15d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26b796e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5621f27c7700 con 0x5621f26301b0 2024-08-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26b796e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5621f28eb700 con 0x5621f2638390 2024-08-28T19:44:41.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26b796e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5621f2a0caa0 con 0x5621f2659070 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26b796e740 10 client.0 _ll_register_callbacks cb 0x5621f291adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.482+0000 7f26aaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a09ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26aaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a09ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47046/0 (socket says 172.21.15.33:47046) 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26aaffd640 1 -- 172.21.15.33:0/1615608983 learned_addr learned my addr 172.21.15.33:0/1615608983 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2638390 0x5621f2a0a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26ab7fe640 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2659070 0x5621f2a15d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26aaffd640 1 -- 172.21.15.33:0/1615608983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2659070 msgr2=0x5621f2a15d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26aaffd640 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2659070 0x5621f2a15d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26aaffd640 1 -- 172.21.15.33:0/1615608983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2638390 msgr2=0x5621f2a0a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26aaffd640 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2638390 0x5621f2a0a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26aaffd640 1 -- 172.21.15.33:0/1615608983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621f29248b0 con 0x5621f26301b0 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26aaffd640 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a09ac0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f269c0e2a50 tx=0x7f269c005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474b438e9f54c26b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:41.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f268eff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f268eff5640 1 -- 172.21.15.33:0/1615608983 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c020030 con 0x5621f26301b0 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f268eff5640 1 -- 172.21.15.33:0/1615608983 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f269c0a7bd0 con 0x5621f26301b0 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26b796e740 1 -- 172.21.15.33:0/1615608983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f269c0ab450 con 0x5621f26301b0 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f268eff5640 1 -- 172.21.15.33:0/1615608983 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f269c0ab290 con 0x5621f26301b0 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26b796e740 10 client.18963 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.483+0000 7f26b796e740 1 -- 172.21.15.33:0/1615608983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5621f2a188a0 con 0x5621f26301b0 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.484+0000 7f268eff5640 1 -- 172.21.15.33:0/1615608983 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f269c0ab450 con 0x5621f26301b0 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.484+0000 7f268eff5640 1 -- 172.21.15.33:0/1615608983 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f269c0abba0 con 0x5621f26301b0 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.484+0000 7f26b796e740 10 client.18963 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.484+0000 7f26b796e740 10 client.18963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.484+0000 7f26b796e740 20 client.18963 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.484+0000 7f26b796e740 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5621f26179f0 0x5621f2a1bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.484+0000 7f26b796e740 4 client.18963 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.484+0000 7f26b796e740 1 -- 172.21.15.33:0/1615608983 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621f2977580 con 0x5621f26179f0 2024-08-28T19:44:41.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.484+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5621f26179f0 0x5621f2a1bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.485+0000 7f268eff5640 10 client.18963 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.485+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5621f26179f0 0x5621f2a1bc00 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5818ef4e39dcb41 server_cookie=b3b8a26d6e7fc1b1 in_seq=0 out_seq=0 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.485+0000 7f268eff5640 1 -- 172.21.15.33:0/1615608983 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5621f2977580 con 0x5621f26179f0 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.485+0000 7f268eff5640 10 client.18963 handle_command_reply: tid=0 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.485+0000 7f26b796e740 1 client.18963 shutdown 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 1 -- 172.21.15.33:0/1615608983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 msgr2=0x5621f2a09ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a09ac0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f269c0e2a50 tx=0x7f269c005f70 comp rx=0 tx=0).stop 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 1 -- 172.21.15.33:0/1615608983 shutdown_connections 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2659070 0x5621f2a15d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2638390 0x5621f2a0a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5621f26179f0 0x5621f2a1bc00 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 1 --2- 172.21.15.33:0/1615608983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a09ac0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 1 -- 172.21.15.33:0/1615608983 >> 172.21.15.33:0/1615608983 conn(0x5621f264d460 msgr2=0x5621f29ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:41.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f268eff5640 0 client.18963 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 1 -- 172.21.15.33:0/1615608983 shutdown_connections 2024-08-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 1 -- 172.21.15.33:0/1615608983 wait complete. 2024-08-28T19:44:41.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.486+0000 7f26b796e740 20 client.18963 trim_cache size 0 max 16384 2024-08-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26b796e740 1 Processor -- start 2024-08-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26b796e740 1 -- start start 2024-08-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26b796e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f26301b0 0x5621f29ffa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26b796e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f2638390 0x5621f2a06cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26b796e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2659070 0x5621f2a071f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26b796e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1b2e50 con 0x5621f2638390 2024-08-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26b796e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1b4990 con 0x5621f26301b0 2024-08-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26b796e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1b3520 con 0x5621f2659070 2024-08-28T19:44:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26aa7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f2638390 0x5621f2a06cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26aa7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f2638390 0x5621f2a06cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47054/0 (socket says 172.21.15.33:47054) 2024-08-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26aa7fc640 1 -- 172.21.15.33:0/1828942482 learned_addr learned my addr 172.21.15.33:0/1828942482 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26aaffd640 1 --2- 172.21.15.33:0/1828942482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f26301b0 0x5621f29ffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.504+0000 7f26ab7fe640 1 --2- 172.21.15.33:0/1828942482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2659070 0x5621f2a071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.505+0000 7f26aa7fc640 1 -- 172.21.15.33:0/1828942482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2659070 msgr2=0x5621f2a071f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.505+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/1828942482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2659070 0x5621f2a071f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.505+0000 7f26aa7fc640 1 -- 172.21.15.33:0/1828942482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f26301b0 msgr2=0x5621f29ffa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.505+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/1828942482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f26301b0 0x5621f29ffa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.505+0000 7f26aa7fc640 1 -- 172.21.15.33:0/1828942482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621f2a005b0 con 0x5621f2638390 2024-08-28T19:44:41.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.505+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/1828942482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f2638390 0x5621f2a06cb0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f26ac06b3f0 tx=0x7f26a0004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d6964c0cf3ac43 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:41.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.508+0000 7f2690ff9640 1 -- 172.21.15.33:0/1828942482 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0003d20 con 0x5621f2638390 2024-08-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.508+0000 7f2690ff9640 1 -- 172.21.15.33:0/1828942482 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26a001c8e0 con 0x5621f2638390 2024-08-28T19:44:41.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.508+0000 7f2690ff9640 1 -- 172.21.15.33:0/1828942482 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0010850 con 0x5621f2638390 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 -- 172.21.15.33:0/1828942482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f2638390 msgr2=0x5621f2a06cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 --2- 172.21.15.33:0/1828942482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f2638390 0x5621f2a06cb0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f26ac06b3f0 tx=0x7f26a0004410 comp rx=0 tx=0).stop 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 -- 172.21.15.33:0/1828942482 shutdown_connections 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 --2- 172.21.15.33:0/1828942482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2659070 0x5621f2a071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 --2- 172.21.15.33:0/1828942482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f2638390 0x5621f2a06cb0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 --2- 172.21.15.33:0/1828942482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f26301b0 0x5621f29ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 -- 172.21.15.33:0/1828942482 >> 172.21.15.33:0/1828942482 conn(0x5621f264d460 msgr2=0x5621f29ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 -- 172.21.15.33:0/1828942482 shutdown_connections 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 -- 172.21.15.33:0/1828942482 wait complete. 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 -- start start 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.509+0000 7f26b796e740 1 Processor -- start 2024-08-28T19:44:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26b796e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a1cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26b796e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2638390 0x5621f2a1d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26b796e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2659070 0x5621f2a1d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26b796e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1b42c0 con 0x5621f26301b0 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26b796e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1b3bf0 con 0x5621f2659070 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26b796e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1b0e50 con 0x5621f2638390 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26b796e740 10 client.0 _ll_register_callbacks cb 0x7f26a4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26aaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a1cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26aaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a1cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47064/0 (socket says 172.21.15.33:47064) 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26aaffd640 1 -- 172.21.15.33:0/1737999861 learned_addr learned my addr 172.21.15.33:0/1737999861 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2638390 0x5621f2a1d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26ab7fe640 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2659070 0x5621f2a1d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26aaffd640 1 -- 172.21.15.33:0/1737999861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2638390 msgr2=0x5621f2a1d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:41.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26aaffd640 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2638390 0x5621f2a1d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26aaffd640 1 -- 172.21.15.33:0/1737999861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2659070 msgr2=0x5621f2a1d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26aaffd640 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2659070 0x5621f2a1d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26aaffd640 1 -- 172.21.15.33:0/1737999861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621f2a854b0 con 0x5621f26301b0 2024-08-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f26aaffd640 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a1cd60 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f269c0a79c0 tx=0x7f269c0a71e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57104f9483715e54 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.510+0000 7f268eff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f268eff5640 1 -- 172.21.15.33:0/1737999861 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c020070 con 0x5621f26301b0 2024-08-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f268eff5640 1 -- 172.21.15.33:0/1737999861 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f269c0abba0 con 0x5621f26301b0 2024-08-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f26b796e740 1 -- 172.21.15.33:0/1737999861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26a001c8e0 con 0x5621f26301b0 2024-08-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f268eff5640 1 -- 172.21.15.33:0/1737999861 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f269c0ab710 con 0x5621f26301b0 2024-08-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f26b796e740 10 client.18969 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f26b796e740 1 -- 172.21.15.33:0/1737999861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5621f2a854b0 con 0x5621f26301b0 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f268eff5640 1 -- 172.21.15.33:0/1737999861 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26a001c8e0 con 0x5621f26301b0 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f268eff5640 1 -- 172.21.15.33:0/1737999861 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f269c0c3020 con 0x5621f26301b0 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f26b796e740 10 client.18969 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f26b796e740 10 client.18969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f26b796e740 20 client.18969 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f26b796e740 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5621f25ecda0 0x5621f2a88a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f26b796e740 4 client.18969 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.511+0000 7f26b796e740 1 -- 172.21.15.33:0/1737999861 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5621f2973020 con 0x5621f25ecda0 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.512+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5621f25ecda0 0x5621f2a88a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.512+0000 7f26aa7fc640 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5621f25ecda0 0x5621f2a88a80 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f90394f4d069e49 server_cookie=1b94d2b3a0d761fa in_seq=0 out_seq=0 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.512+0000 7f268eff5640 10 client.18969 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f268eff5640 1 -- 172.21.15.33:0/1737999861 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x5621f2973020 con 0x5621f25ecda0 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f268eff5640 10 client.18969 handle_command_reply: tid=0 2024-08-28T19:44:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 client.18969 shutdown 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 -- 172.21.15.33:0/1737999861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 msgr2=0x5621f2a1cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a1cd60 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f269c0a79c0 tx=0x7f269c0a71e0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 -- 172.21.15.33:0/1737999861 shutdown_connections 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5621f2659070 0x5621f2a1d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5621f2638390 0x5621f2a1d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5621f25ecda0 0x5621f2a88a80 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 --2- 172.21.15.33:0/1737999861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5621f26301b0 0x5621f2a1cd60 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f268eff5640 0 client.18969 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 -- 172.21.15.33:0/1737999861 >> 172.21.15.33:0/1737999861 conn(0x5621f264d460 msgr2=0x5621f2a0ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 -- 172.21.15.33:0/1737999861 shutdown_connections 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 1 -- 172.21.15.33:0/1737999861 wait complete. 2024-08-28T19:44:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b796e740 20 client.18969 trim_cache size 0 max 16384 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "36820268-5bed-48c3-bfaa-51c3537532e6", 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.519 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.520 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.521 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.522 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.523 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.524 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:44:41.525 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:44:41.526 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.528 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.529 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:44:41.530 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b13f9640 1 -- 172.21.15.33:0/2983659737 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26940b4ca0 msgr2=0x7f26940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b13f9640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26940b4ca0 0x7f26940b71b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f26a4004af0 tx=0x7f26a4005d80 comp rx=0 tx=0).stop 2024-08-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b13f9640 1 -- 172.21.15.33:0/2983659737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ac102880 msgr2=0x7f26ac0ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.513+0000 7f26b13f9640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ac102880 0x7f26ac0ff410 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f269c00d950 tx=0x7f269c00de10 comp rx=0 tx=0).stop 2024-08-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.514+0000 7f26b13f9640 1 -- 172.21.15.33:0/2983659737 shutdown_connections 2024-08-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.514+0000 7f26b13f9640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f26940b4ca0 0x7f26940b71b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.514+0000 7f26b13f9640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f26ac108b10 0x7f26ac0ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.514+0000 7f26b13f9640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26ac1081c0 0x7f26ac0ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.514+0000 7f26b13f9640 1 --2- 172.21.15.33:0/2983659737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26ac102880 0x7f26ac0ff410 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.514+0000 7f26b13f9640 1 -- 172.21.15.33:0/2983659737 >> 172.21.15.33:0/2983659737 conn(0x7f26ac079510 msgr2=0x7f26ac1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.514+0000 7f26b13f9640 1 -- 172.21.15.33:0/2983659737 shutdown_connections 2024-08-28T19:44:41.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:41.514+0000 7f26b13f9640 1 -- 172.21.15.33:0/2983659737 wait complete. 2024-08-28T19:44:41.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:41 smithi059 ceph-mon[22052]: pgmap v721: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-08-28T19:44:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:41 smithi122 ceph-mon[22174]: pgmap v721: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-08-28T19:44:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:41 smithi033 ceph-mon[18549]: pgmap v721: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-08-28T19:44:42.257 INFO:tasks.cephfs.filesystem:scrub status for tag:36820268-5bed-48c3-bfaa-51c3537532e6 - {'path': '/', 'tag': '36820268-5bed-48c3-bfaa-51c3537532e6', 'options': 'recursive,force'} 2024-08-28T19:44:43.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:43 smithi059 ceph-mon[22052]: pgmap v722: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-08-28T19:44:43.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:43 smithi122 ceph-mon[22174]: pgmap v722: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-08-28T19:44:43.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:43 smithi033 ceph-mon[18549]: pgmap v722: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-08-28T19:44:44.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:44 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:44:44.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:44 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:44:44.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:44 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:44:45.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:45 smithi059 ceph-mon[22052]: pgmap v723: 129 pgs: 129 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 79 KiB/s wr, 18 op/s 2024-08-28T19:44:45.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:45 smithi122 ceph-mon[22174]: pgmap v723: 129 pgs: 129 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 79 KiB/s wr, 18 op/s 2024-08-28T19:44:45.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:45 smithi033 ceph-mon[18549]: pgmap v723: 129 pgs: 129 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 79 KiB/s wr, 18 op/s 2024-08-28T19:44:47.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:47 smithi059 ceph-mon[22052]: pgmap v724: 129 pgs: 129 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:44:47.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:47 smithi122 ceph-mon[22174]: pgmap v724: 129 pgs: 129 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:44:47.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:47 smithi033 ceph-mon[18549]: pgmap v724: 129 pgs: 129 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:44:49.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:49 smithi059 ceph-mon[22052]: pgmap v725: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 81 KiB/s wr, 18 op/s 2024-08-28T19:44:49.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:49 smithi122 ceph-mon[22174]: pgmap v725: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 81 KiB/s wr, 18 op/s 2024-08-28T19:44:49.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:49 smithi033 ceph-mon[18549]: pgmap v725: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 81 KiB/s wr, 18 op/s 2024-08-28T19:44:51.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:51 smithi059 ceph-mon[22052]: pgmap v726: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-08-28T19:44:51.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:51 smithi122 ceph-mon[22174]: pgmap v726: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-08-28T19:44:51.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:51 smithi033 ceph-mon[18549]: pgmap v726: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-08-28T19:44:53.784 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:53 smithi059 ceph-mon[22052]: pgmap v727: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-08-28T19:44:53.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:53 smithi122 ceph-mon[22174]: pgmap v727: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-08-28T19:44:53.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:53 smithi033 ceph-mon[18549]: pgmap v727: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-08-28T19:44:55.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:55 smithi122 ceph-mon[22174]: pgmap v728: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 79 KiB/s wr, 18 op/s 2024-08-28T19:44:55.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:55 smithi033 ceph-mon[18549]: pgmap v728: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 79 KiB/s wr, 18 op/s 2024-08-28T19:44:56.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:55 smithi059 ceph-mon[22052]: pgmap v728: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 79 KiB/s wr, 18 op/s 2024-08-28T19:44:57.156 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-08-28T19:44:57.156 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:44:57.422 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:57.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:57 smithi122 ceph-mon[22174]: pgmap v729: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-08-28T19:44:57.796 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:57 smithi033 ceph-mon[18549]: pgmap v729: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-08-28T19:44:58.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:57 smithi059 ceph-mon[22052]: pgmap v729: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 13 op/s 2024-08-28T19:44:58.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.026+0000 7f217a60d640 1 -- 172.21.15.33:0/3646244867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2174108ad0 msgr2=0x7f217410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:58.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.026+0000 7f217a60d640 1 --2- 172.21.15.33:0/3646244867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2174108ad0 0x7f217410f300 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f216c009ca0 tx=0x7f216c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:44:58.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.026+0000 7f217a60d640 1 -- 172.21.15.33:0/3646244867 shutdown_connections 2024-08-28T19:44:58.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.026+0000 7f217a60d640 1 --2- 172.21.15.33:0/3646244867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2174108ad0 0x7f217410f300 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:58.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.026+0000 7f217a60d640 1 --2- 172.21.15.33:0/3646244867 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2174108180 0x7f2174108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:58.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.026+0000 7f217a60d640 1 --2- 172.21.15.33:0/3646244867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2174102840 0x7f2174102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:58.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.026+0000 7f217a60d640 1 -- 172.21.15.33:0/3646244867 >> 172.21.15.33:0/3646244867 conn(0x7f21740794f0 msgr2=0x7f2174079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:58.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.026+0000 7f217a60d640 1 -- 172.21.15.33:0/3646244867 shutdown_connections 2024-08-28T19:44:58.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.026+0000 7f217a60d640 1 -- 172.21.15.33:0/3646244867 wait complete. 2024-08-28T19:44:58.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.027+0000 7f217a60d640 1 Processor -- start 2024-08-28T19:44:58.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.027+0000 7f217a60d640 1 -- start start 2024-08-28T19:44:58.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f217a60d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2174102840 0x7f217419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:58.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f217a60d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2174108180 0x7f217419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:58.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f217a60d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2174108ad0 0x7f217419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:58.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f217a60d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2174112780 con 0x7f2174108ad0 2024-08-28T19:44:58.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f217a60d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2174112600 con 0x7f2174108180 2024-08-28T19:44:58.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f217a60d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2174112900 con 0x7f2174102840 2024-08-28T19:44:58.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f2178baa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2174108ad0 0x7f217419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:58.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f2178baa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2174108ad0 0x7f217419fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56078/0 (socket says 172.21.15.33:56078) 2024-08-28T19:44:58.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f2178baa640 1 -- 172.21.15.33:0/3240767125 learned_addr learned my addr 172.21.15.33:0/3240767125 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:58.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f2173fff640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2174102840 0x7f217419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:58.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f21737fe640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2174108180 0x7f217419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:58.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f2178baa640 1 -- 172.21.15.33:0/3240767125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2174102840 msgr2=0x7f217419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:58.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f2178baa640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2174102840 0x7f217419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:58.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f2178baa640 1 -- 172.21.15.33:0/3240767125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2174108180 msgr2=0x7f217419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f2178baa640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2174108180 0x7f217419a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f2178baa640 1 -- 172.21.15.33:0/3240767125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21741a00b0 con 0x7f2174108ad0 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f2178baa640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2174108ad0 0x7f217419fa40 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f216c005cc0 tx=0x7f216c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f21717fa640 1 -- 172.21.15.33:0/3240767125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c003bf0 con 0x7f2174108ad0 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f21717fa640 1 -- 172.21.15.33:0/3240767125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c003d90 con 0x7f2174108ad0 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.028+0000 7f217a60d640 1 -- 172.21.15.33:0/3240767125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21741a0340 con 0x7f2174108ad0 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.029+0000 7f21717fa640 1 -- 172.21.15.33:0/3240767125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c02fb20 con 0x7f2174108ad0 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.029+0000 7f217a60d640 1 -- 172.21.15.33:0/3240767125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21741a0880 con 0x7f2174108ad0 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.029+0000 7f217a60d640 1 -- 172.21.15.33:0/3240767125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2174102c50 con 0x7f2174108ad0 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.031+0000 7f21717fa640 1 -- 172.21.15.33:0/3240767125 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f216c004580 con 0x7f2174108ad0 2024-08-28T19:44:58.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.032+0000 7f21717fa640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f215c0b4cd0 0x7f215c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:58.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.032+0000 7f21717fa640 1 -- 172.21.15.33:0/3240767125 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7f216c106d60 con 0x7f2174108ad0 2024-08-28T19:44:58.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.032+0000 7f2173fff640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f215c0b4cd0 0x7f215c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:58.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.032+0000 7f2173fff640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f215c0b4cd0 0x7f215c0b71e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f216400bbe0 tx=0x7f216400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:58.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.035+0000 7f21717fa640 1 -- 172.21.15.33:0/3240767125 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f216c0cd7b0 con 0x7f2174108ad0 2024-08-28T19:44:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.260+0000 7f217a60d640 1 -- 172.21.15.33:0/3240767125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21741a6df0 con 0x7f2174108ad0 2024-08-28T19:44:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.261+0000 7f21717fa640 1 -- 172.21.15.33:0/3240767125 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f216c0098b0 con 0x7f2174108ad0 2024-08-28T19:44:58.262 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:44:58.262 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:44:58.263 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:44:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 -- 172.21.15.33:0/3240767125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f215c0b4cd0 msgr2=0x7f215c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f215c0b4cd0 0x7f215c0b71e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f216400bbe0 tx=0x7f216400b390 comp rx=0 tx=0).stop 2024-08-28T19:44:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 -- 172.21.15.33:0/3240767125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2174108ad0 msgr2=0x7f217419fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2174108ad0 0x7f217419fa40 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f216c005cc0 tx=0x7f216c02f380 comp rx=0 tx=0).stop 2024-08-28T19:44:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 -- 172.21.15.33:0/3240767125 shutdown_connections 2024-08-28T19:44:58.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2174108ad0 0x7f217419fa40 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:58.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2174108180 0x7f217419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:58.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f215c0b4cd0 0x7f215c0b71e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:58.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 --2- 172.21.15.33:0/3240767125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2174102840 0x7f217419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:58.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 -- 172.21.15.33:0/3240767125 >> 172.21.15.33:0/3240767125 conn(0x7f21740794f0 msgr2=0x7f2174101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:58.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 -- 172.21.15.33:0/3240767125 shutdown_connections 2024-08-28T19:44:58.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:58.263+0000 7f217a60d640 1 -- 172.21.15.33:0/3240767125 wait complete. 2024-08-28T19:44:58.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:58 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3240767125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:44:58.932 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-08-28T19:44:58.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-08-28T19:44:59.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:58 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3240767125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:44:59.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:58 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3240767125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:44:59.185 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:44:59.613 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:44:59 smithi033 ceph-mon[18549]: pgmap v730: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 80 KiB/s wr, 17 op/s 2024-08-28T19:44:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.712+0000 7fca74237640 1 -- 172.21.15.33:0/3348308654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca6c108ab0 msgr2=0x7fca6c10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.712+0000 7fca74237640 1 --2- 172.21.15.33:0/3348308654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca6c108ab0 0x7fca6c10f2e0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fca64009ca0 tx=0x7fca6402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.713+0000 7fca74237640 1 -- 172.21.15.33:0/3348308654 shutdown_connections 2024-08-28T19:44:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.713+0000 7fca74237640 1 --2- 172.21.15.33:0/3348308654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca6c108ab0 0x7fca6c10f2e0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.713+0000 7fca74237640 1 --2- 172.21.15.33:0/3348308654 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca6c108160 0x7fca6c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.713+0000 7fca74237640 1 --2- 172.21.15.33:0/3348308654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c102820 0x7fca6c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.713+0000 7fca74237640 1 -- 172.21.15.33:0/3348308654 >> 172.21.15.33:0/3348308654 conn(0x7fca6c079660 msgr2=0x7fca6c079a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:59.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.713+0000 7fca74237640 1 -- 172.21.15.33:0/3348308654 shutdown_connections 2024-08-28T19:44:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.713+0000 7fca74237640 1 -- 172.21.15.33:0/3348308654 wait complete. 2024-08-28T19:44:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.713+0000 7fca74237640 1 Processor -- start 2024-08-28T19:44:59.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.713+0000 7fca74237640 1 -- start start 2024-08-28T19:44:59.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca74237640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca6c102820 0x7fca6c19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca74237640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c108160 0x7fca6c19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca74237640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca6c108ab0 0x7fca6c19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca74237640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c112760 con 0x7fca6c102820 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca74237640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1125e0 con 0x7fca6c108160 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca74237640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1128e0 con 0x7fca6c108ab0 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca71fd3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca6c102820 0x7fca6c19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca71fd3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca6c102820 0x7fca6c19a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49292/0 (socket says 172.21.15.33:49292) 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca71fd3640 1 -- 172.21.15.33:0/573735472 learned_addr learned my addr 172.21.15.33:0/573735472 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca717d2640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c108160 0x7fca6c19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca727d4640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca6c108ab0 0x7fca6c19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca71fd3640 1 -- 172.21.15.33:0/573735472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca6c108ab0 msgr2=0x7fca6c19fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca71fd3640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca6c108ab0 0x7fca6c19fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca71fd3640 1 -- 172.21.15.33:0/573735472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c108160 msgr2=0x7fca6c19a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca71fd3640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c108160 0x7fca6c19a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca71fd3640 1 -- 172.21.15.33:0/573735472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6c1a01b0 con 0x7fca6c102820 2024-08-28T19:44:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.714+0000 7fca71fd3640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca6c102820 0x7fca6c19a300 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fca6800e9f0 tx=0x7fca6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.715+0000 7fca62ffd640 1 -- 172.21.15.33:0/573735472 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6800ccc0 con 0x7fca6c102820 2024-08-28T19:44:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.715+0000 7fca62ffd640 1 -- 172.21.15.33:0/573735472 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca680108e0 con 0x7fca6c102820 2024-08-28T19:44:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.715+0000 7fca74237640 1 -- 172.21.15.33:0/573735472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6c1a04a0 con 0x7fca6c102820 2024-08-28T19:44:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.715+0000 7fca62ffd640 1 -- 172.21.15.33:0/573735472 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68018880 con 0x7fca6c102820 2024-08-28T19:44:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.715+0000 7fca74237640 1 -- 172.21.15.33:0/573735472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca6c1a6cc0 con 0x7fca6c102820 2024-08-28T19:44:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.718+0000 7fca7a7ac740 1 Processor -- start 2024-08-28T19:44:59.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.718+0000 7fca7a7ac740 1 -- start start 2024-08-28T19:44:59.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.718+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 0x55a4da9d6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.718+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 0x55a4da9d71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.718+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da60eb60 0x55a4da9d7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.718+0000 7fca62ffd640 1 -- 172.21.15.33:0/573735472 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fca68010430 con 0x7fca6c102820 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.718+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a4da94b330 con 0x55a4da606980 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.718+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a4da93a8c0 con 0x55a4da60eb60 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.718+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a4da93e870 con 0x55a4da62f840 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca71fd3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 0x55a4da9d71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca727d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 0x55a4da9d6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca727d4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 0x55a4da9d6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:44474/0 (socket says 172.21.15.33:44474) 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca727d4640 1 -- 172.21.15.33:0/1923448924 learned_addr learned my addr 172.21.15.33:0/1923448924 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca717d2640 1 --2- 172.21.15.33:0/1923448924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da60eb60 0x55a4da9d7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca727d4640 1 -- 172.21.15.33:0/1923448924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da60eb60 msgr2=0x55a4da9d7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca727d4640 1 --2- 172.21.15.33:0/1923448924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da60eb60 0x55a4da9d7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca727d4640 1 -- 172.21.15.33:0/1923448924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 msgr2=0x55a4da9d71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca727d4640 1 --2- 172.21.15.33:0/1923448924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 0x55a4da9d71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca727d4640 1 -- 172.21.15.33:0/1923448924 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4da8f2df0 con 0x55a4da62f840 2024-08-28T19:44:59.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca62ffd640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca580b4cd0 0x7fca580b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca727d4640 1 --2- 172.21.15.33:0/1923448924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 0x55a4da9d6c90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca64009880 tx=0x7fca640098b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91850a67a4ca593a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:59.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.719+0000 7fca71fd3640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca580b4cd0 0x7fca580b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.720+0000 7fca57fff640 1 -- 172.21.15.33:0/1923448924 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64031d70 con 0x55a4da62f840 2024-08-28T19:44:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.720+0000 7fca57fff640 1 -- 172.21.15.33:0/1923448924 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca64036040 con 0x55a4da62f840 2024-08-28T19:44:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.720+0000 7fca62ffd640 1 -- 172.21.15.33:0/573735472 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7fca680e5d40 con 0x7fca6c102820 2024-08-28T19:44:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.720+0000 7fca57fff640 1 -- 172.21.15.33:0/1923448924 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca640042a0 con 0x55a4da62f840 2024-08-28T19:44:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1923448924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 msgr2=0x55a4da9d6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1923448924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 0x55a4da9d6c90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca64009880 tx=0x7fca640098b0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca71fd3640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca580b4cd0 0x7fca580b71e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fca680e31a0 tx=0x7fca680e9890 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1923448924 shutdown_connections 2024-08-28T19:44:59.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1923448924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da60eb60 0x55a4da9d7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1923448924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 0x55a4da9d71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1923448924 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 0x55a4da9d6c90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1923448924 >> 172.21.15.33:0/1923448924 conn(0x55a4da623990 msgr2=0x55a4da9d4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:59.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1923448924 shutdown_connections 2024-08-28T19:44:59.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1923448924 wait complete. 2024-08-28T19:44:59.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 -- start start 2024-08-28T19:44:59.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.721+0000 7fca7a7ac740 1 Processor -- start 2024-08-28T19:44:59.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da606980 0x55a4da9e23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da60eb60 0x55a4da9e2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da62f840 0x55a4da9ee700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a4da79d7a0 con 0x55a4da62f840 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a4da8c1240 con 0x55a4da606980 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a4da9e5410 con 0x55a4da60eb60 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca7a7ac740 10 client.0 _ll_register_callbacks cb 0x55a4da647090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca727d4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da62f840 0x55a4da9ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca727d4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da62f840 0x55a4da9ee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49306/0 (socket says 172.21.15.33:49306) 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca727d4640 1 -- 172.21.15.33:0/1407616962 learned_addr learned my addr 172.21.15.33:0/1407616962 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca727d4640 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da606980 0x55a4da9e23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca717d2640 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da60eb60 0x55a4da9e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca727d4640 1 -- 172.21.15.33:0/1407616962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da60eb60 msgr2=0x55a4da9e2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca727d4640 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da60eb60 0x55a4da9e2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca727d4640 1 -- 172.21.15.33:0/1407616962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da606980 msgr2=0x55a4da9e23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:59.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca727d4640 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da606980 0x55a4da9e23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.722+0000 7fca727d4640 1 -- 172.21.15.33:0/1407616962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4da8f72b0 con 0x55a4da62f840 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca727d4640 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da62f840 0x55a4da9ee700 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fca64003d10 tx=0x7fca6403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2e55dc6555694b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca557fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca557fa640 1 -- 172.21.15.33:0/1407616962 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64059060 con 0x55a4da62f840 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca557fa640 1 -- 172.21.15.33:0/1407616962 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7fca64031450 con 0x55a4da62f840 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1407616962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca64036040 con 0x55a4da62f840 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca557fa640 1 -- 172.21.15.33:0/1407616962 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca64031650 con 0x55a4da62f840 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca7a7ac740 10 client.18987 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1407616962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a4da6a9b90 con 0x55a4da62f840 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca557fa640 1 -- 172.21.15.33:0/1407616962 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca64036040 con 0x55a4da62f840 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca557fa640 1 -- 172.21.15.33:0/1407616962 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fca640045f0 con 0x55a4da62f840 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca7a7ac740 10 client.18987 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:59.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.723+0000 7fca7a7ac740 10 client.18987 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:44:59.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.724+0000 7fca7a7ac740 20 client.18987 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:59.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.724+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a4da5ee1c0 0x55a4da9f4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.724+0000 7fca7a7ac740 4 client.18987 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:44:59.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.724+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1407616962 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4da94d280 con 0x55a4da5ee1c0 2024-08-28T19:44:59.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.724+0000 7fca717d2640 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a4da5ee1c0 0x55a4da9f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.724+0000 7fca717d2640 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a4da5ee1c0 0x55a4da9f4330 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d466a9286e400991 server_cookie=82969307ccc5a829 in_seq=0 out_seq=0 2024-08-28T19:44:59.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.724+0000 7fca557fa640 10 client.18987 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:59.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca557fa640 1 -- 172.21.15.33:0/1407616962 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a4da94d280 con 0x55a4da5ee1c0 2024-08-28T19:44:59.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca557fa640 10 client.18987 handle_command_reply: tid=0 2024-08-28T19:44:59.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 client.18987 shutdown 2024-08-28T19:44:59.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1407616962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da62f840 msgr2=0x55a4da9ee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:59.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da62f840 0x55a4da9ee700 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fca64003d10 tx=0x7fca6403e040 comp rx=0 tx=0).stop 2024-08-28T19:44:59.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1407616962 shutdown_connections 2024-08-28T19:44:59.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a4da5ee1c0 0x55a4da9f4330 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da62f840 0x55a4da9ee700 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da60eb60 0x55a4da9e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca557fa640 0 client.18987 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:59.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1407616962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da606980 0x55a4da9e23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1407616962 >> 172.21.15.33:0/1407616962 conn(0x55a4da623990 msgr2=0x55a4da9d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:59.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1407616962 shutdown_connections 2024-08-28T19:44:59.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.725+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1407616962 wait complete. 2024-08-28T19:44:59.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.726+0000 7fca7a7ac740 20 client.18987 trim_cache size 0 max 16384 2024-08-28T19:44:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca7a7ac740 1 Processor -- start 2024-08-28T19:44:59.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca7a7ac740 1 -- start start 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da606980 0x55a4da9e2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da60eb60 0x55a4da9e4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da62f840 0x55a4da9ee670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1b2f00 con 0x55a4da60eb60 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1b4a40 con 0x55a4da62f840 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1b35d0 con 0x55a4da606980 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca717d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da60eb60 0x55a4da9e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca717d2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da60eb60 0x55a4da9e4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49314/0 (socket says 172.21.15.33:49314) 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca717d2640 1 -- 172.21.15.33:0/1739390007 learned_addr learned my addr 172.21.15.33:0/1739390007 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca727d4640 1 --2- 172.21.15.33:0/1739390007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da606980 0x55a4da9e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca727d4640 1 --2- 172.21.15.33:0/1739390007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da62f840 0x55a4da9ee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca717d2640 1 -- 172.21.15.33:0/1739390007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da606980 msgr2=0x55a4da9e2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca717d2640 1 --2- 172.21.15.33:0/1739390007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da606980 0x55a4da9e2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca717d2640 1 -- 172.21.15.33:0/1739390007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da62f840 msgr2=0x55a4da9ee670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca717d2640 1 --2- 172.21.15.33:0/1739390007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da62f840 0x55a4da9ee670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca717d2640 1 -- 172.21.15.33:0/1739390007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4da90ad90 con 0x55a4da60eb60 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.743+0000 7fca727d4640 1 --2- 172.21.15.33:0/1739390007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da62f840 0x55a4da9ee670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.744+0000 7fca717d2640 1 --2- 172.21.15.33:0/1739390007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da60eb60 0x55a4da9e4000 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fca5c005920 tx=0x7fca5c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd7bf6133500b26 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.744+0000 7fca577fe640 1 -- 172.21.15.33:0/1739390007 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c024610 con 0x55a4da60eb60 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.744+0000 7fca577fe640 1 -- 172.21.15.33:0/1739390007 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca5c024c60 con 0x55a4da60eb60 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.744+0000 7fca577fe640 1 -- 172.21.15.33:0/1739390007 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c01ed30 con 0x55a4da60eb60 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1739390007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da60eb60 msgr2=0x55a4da9e4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1739390007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da60eb60 0x55a4da9e4000 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fca5c005920 tx=0x7fca5c00a2d0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1739390007 shutdown_connections 2024-08-28T19:44:59.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1739390007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da62f840 0x55a4da9ee670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1739390007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da60eb60 0x55a4da9e4000 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/1739390007 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da606980 0x55a4da9e2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1739390007 >> 172.21.15.33:0/1739390007 conn(0x55a4da623990 msgr2=0x55a4da9e38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1739390007 shutdown_connections 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 -- 172.21.15.33:0/1739390007 wait complete. 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 -- start start 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.745+0000 7fca7a7ac740 1 Processor -- start 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 0x55a4da9f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da60eb60 0x55a4da9f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca7a7ac740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 0x55a4daa57ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1b4370 con 0x55a4da606980 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1b3ca0 con 0x55a4da60eb60 2024-08-28T19:44:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca7a7ac740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1b0f00 con 0x55a4da62f840 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca7a7ac740 10 client.0 _ll_register_callbacks cb 0x7fca680e9760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca727d4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 0x55a4da9f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca727d4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 0x55a4da9f4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49330/0 (socket says 172.21.15.33:49330) 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca727d4640 1 -- 172.21.15.33:0/2423272457 learned_addr learned my addr 172.21.15.33:0/2423272457 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca717d2640 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da60eb60 0x55a4da9f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca727d4640 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 0x55a4daa57ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca727d4640 1 -- 172.21.15.33:0/2423272457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 msgr2=0x55a4daa57ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca727d4640 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 0x55a4daa57ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca727d4640 1 -- 172.21.15.33:0/2423272457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da60eb60 msgr2=0x55a4da9f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca727d4640 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da60eb60 0x55a4da9f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca727d4640 1 -- 172.21.15.33:0/2423272457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4daa58150 con 0x55a4da606980 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca727d4640 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 0x55a4da9f4e40 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fca64009ca0 tx=0x7fca6403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cd4d61aff34776 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:44:59.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.746+0000 7fca557fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca557fa640 1 -- 172.21.15.33:0/2423272457 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64059070 con 0x55a4da606980 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca7a7ac740 1 -- 172.21.15.33:0/2423272457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca5c024c60 con 0x55a4da606980 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca557fa640 1 -- 172.21.15.33:0/2423272457 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9453+0+0 (secure 0 0 0) 0x7fca64031450 con 0x55a4da606980 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca557fa640 1 -- 172.21.15.33:0/2423272457 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca64009540 con 0x55a4da606980 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca7a7ac740 10 client.18993 fetch_fsmap learned FSMap version 28 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca7a7ac740 1 -- 172.21.15.33:0/2423272457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a4daa5f490 con 0x55a4da606980 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca557fa640 1 -- 172.21.15.33:0/2423272457 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca5c024c60 con 0x55a4da606980 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca557fa640 1 -- 172.21.15.33:0/2423272457 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fca64064040 con 0x55a4da606980 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca7a7ac740 10 client.18993 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca7a7ac740 10 client.18993 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca7a7ac740 20 client.18993 populate_metadata read hostname 'smithi033' 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a4da5c3570 0x55a4daa61bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca7a7ac740 4 client.18993 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-08-28T19:44:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.747+0000 7fca7a7ac740 1 -- 172.21.15.33:0/2423272457 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x55a4da948d20 con 0x55a4da5c3570 2024-08-28T19:44:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.748+0000 7fca717d2640 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a4da5c3570 0x55a4daa61bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:44:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.748+0000 7fca717d2640 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a4da5c3570 0x55a4daa61bd0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b119ece375b9a71d server_cookie=ca413f89da635bd8 in_seq=0 out_seq=0 2024-08-28T19:44:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.748+0000 7fca557fa640 10 client.18993 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.762+0000 7fca557fa640 1 -- 172.21.15.33:0/2423272457 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a4da948d20 con 0x55a4da5c3570 2024-08-28T19:44:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.762+0000 7fca557fa640 10 client.18993 handle_command_reply: tid=0 2024-08-28T19:44:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.762+0000 7fca7a7ac740 1 client.18993 shutdown 2024-08-28T19:44:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.762+0000 7fca7a7ac740 1 -- 172.21.15.33:0/2423272457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 msgr2=0x55a4da9f4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.762+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 0x55a4da9f4e40 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fca64009ca0 tx=0x7fca6403e040 comp rx=0 tx=0).stop 2024-08-28T19:44:59.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca7a7ac740 1 -- 172.21.15.33:0/2423272457 shutdown_connections 2024-08-28T19:44:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a4da62f840 0x55a4daa57ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4da60eb60 0x55a4da9f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a4da5c3570 0x55a4daa61bd0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca7a7ac740 1 --2- 172.21.15.33:0/2423272457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a4da606980 0x55a4da9f4e40 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca557fa640 0 client.18993 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:44:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca7a7ac740 1 -- 172.21.15.33:0/2423272457 >> 172.21.15.33:0/2423272457 conn(0x55a4da623990 msgr2=0x55a4da9e3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca7a7ac740 1 -- 172.21.15.33:0/2423272457 shutdown_connections 2024-08-28T19:44:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca7a7ac740 1 -- 172.21.15.33:0/2423272457 wait complete. 2024-08-28T19:44:59.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca7a7ac740 20 client.18993 trim_cache size 0 max 16384 2024-08-28T19:44:59.765 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 38, 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "624e1828": { 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 38, 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:44:59.766 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 140.5, 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:44:59.767 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:44:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca74237640 1 -- 172.21.15.33:0/573735472 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca580b4cd0 msgr2=0x7fca580b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca74237640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca580b4cd0 0x7fca580b71e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fca680e31a0 tx=0x7fca680e9890 comp rx=0 tx=0).stop 2024-08-28T19:44:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca74237640 1 -- 172.21.15.33:0/573735472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca6c102820 msgr2=0x7fca6c19a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:44:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca74237640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca6c102820 0x7fca6c19a300 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fca6800e9f0 tx=0x7fca6800edf0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca74237640 1 -- 172.21.15.33:0/573735472 shutdown_connections 2024-08-28T19:44:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca74237640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fca580b4cd0 0x7fca580b71e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca74237640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca6c108ab0 0x7fca6c19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.763+0000 7fca74237640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c108160 0x7fca6c19a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.764+0000 7fca74237640 1 --2- 172.21.15.33:0/573735472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca6c102820 0x7fca6c19a300 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:44:59.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.764+0000 7fca74237640 1 -- 172.21.15.33:0/573735472 >> 172.21.15.33:0/573735472 conn(0x7fca6c079660 msgr2=0x7fca6c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:44:59.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.764+0000 7fca74237640 1 -- 172.21.15.33:0/573735472 shutdown_connections 2024-08-28T19:44:59.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:44:59.764+0000 7fca74237640 1 -- 172.21.15.33:0/573735472 wait complete. 2024-08-28T19:45:00.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:44:59 smithi059 ceph-mon[22052]: pgmap v730: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 80 KiB/s wr, 17 op/s 2024-08-28T19:45:00.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:44:59 smithi122 ceph-mon[22174]: pgmap v730: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 80 KiB/s wr, 17 op/s 2024-08-28T19:45:00.484 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '624e1828', quiesce took 3.3 seconds. Will release after: 17.2 2024-08-28T19:45:01.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:01 smithi033 ceph-mon[18549]: pgmap v731: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:45:02.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:01 smithi059 ceph-mon[22052]: pgmap v731: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:45:02.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:01 smithi122 ceph-mon[22174]: pgmap v731: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:45:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:03 smithi033 ceph-mon[18549]: pgmap v732: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:45:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:03 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:45:04.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:03 smithi059 ceph-mon[22052]: pgmap v732: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:45:04.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:03 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:45:04.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:03 smithi122 ceph-mon[22174]: pgmap v732: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:45:04.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:03 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:45:04.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:45:04.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:45:04.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:45:05.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:45:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:45:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:45:05.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:45:05.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:45:05.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:45:05.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:05 smithi033 ceph-mon[18549]: pgmap v733: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 109 KiB/s wr, 34 op/s 2024-08-28T19:45:05.933 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:05 smithi059 ceph-mon[22052]: pgmap v733: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 109 KiB/s wr, 34 op/s 2024-08-28T19:45:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:05 smithi122 ceph-mon[22174]: pgmap v733: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 109 KiB/s wr, 34 op/s 2024-08-28T19:45:07.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:07 smithi033 ceph-mon[18549]: pgmap v734: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 83 KiB/s wr, 29 op/s 2024-08-28T19:45:08.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:07 smithi059 ceph-mon[22052]: pgmap v734: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 83 KiB/s wr, 29 op/s 2024-08-28T19:45:08.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:07 smithi122 ceph-mon[22174]: pgmap v734: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 83 KiB/s wr, 29 op/s 2024-08-28T19:45:09.845 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:09 smithi122 ceph-mon[22174]: pgmap v735: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 87 KiB/s wr, 32 op/s 2024-08-28T19:45:09.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:09 smithi033 ceph-mon[18549]: pgmap v735: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 87 KiB/s wr, 32 op/s 2024-08-28T19:45:10.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:09 smithi059 ceph-mon[22052]: pgmap v735: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 87 KiB/s wr, 32 op/s 2024-08-28T19:45:10.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:10 smithi033 ceph-mon[18549]: osdmap e97: 12 total, 12 up, 12 in 2024-08-28T19:45:11.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:10 smithi059 ceph-mon[22052]: osdmap e97: 12 total, 12 up, 12 in 2024-08-28T19:45:11.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:10 smithi122 ceph-mon[22174]: osdmap e97: 12 total, 12 up, 12 in 2024-08-28T19:45:11.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:11 smithi033 ceph-mon[18549]: pgmap v737: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 KiB/s wr, 32 op/s 2024-08-28T19:45:12.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:11 smithi059 ceph-mon[22052]: pgmap v737: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 KiB/s wr, 32 op/s 2024-08-28T19:45:12.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:11 smithi122 ceph-mon[22174]: pgmap v737: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 KiB/s wr, 32 op/s 2024-08-28T19:45:12.258 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:45:12.526 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.008+0000 7f9c2d431640 1 -- 172.21.15.33:0/3610769118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c28102990 msgr2=0x7f9c28107ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.008+0000 7f9c2d431640 1 --2- 172.21.15.33:0/3610769118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c28102990 0x7f9c28107ec0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009ca0 tx=0x7f9c2002a8e0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.008+0000 7f9c2d431640 1 -- 172.21.15.33:0/3610769118 shutdown_connections 2024-08-28T19:45:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.008+0000 7f9c2d431640 1 --2- 172.21.15.33:0/3610769118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c28102990 0x7f9c28107ec0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.008+0000 7f9c2d431640 1 --2- 172.21.15.33:0/3610769118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28102580 0x7f9c28107980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.008+0000 7f9c2d431640 1 --2- 172.21.15.33:0/3610769118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c2806b070 0x7f9c28102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.008+0000 7f9c2d431640 1 -- 172.21.15.33:0/3610769118 >> 172.21.15.33:0/3610769118 conn(0x7f9c28079c60 msgr2=0x7f9c2807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.008+0000 7f9c2d431640 1 -- 172.21.15.33:0/3610769118 shutdown_connections 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.008+0000 7f9c2d431640 1 -- 172.21.15.33:0/3610769118 wait complete. 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.008+0000 7f9c2d431640 1 Processor -- start 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c2d431640 1 -- start start 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c2d431640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c2806b070 0x7f9c2819b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c2d431640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c28102580 0x7f9c2819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c2d431640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28102990 0x7f9c2819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c2d431640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9c28112840 con 0x7f9c28102580 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c2d431640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281126c0 con 0x7f9c28102990 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c2d431640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281129c0 con 0x7f9c2806b070 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c267fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c28102580 0x7f9c2819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c267fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c28102580 0x7f9c2819b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57796/0 (socket says 172.21.15.33:57796) 2024-08-28T19:45:13.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c267fc640 1 -- 172.21.15.33:0/3245814137 learned_addr learned my addr 172.21.15.33:0/3245814137 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c2806b070 0x7f9c2819b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c277fe640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28102990 0x7f9c2819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c267fc640 1 -- 172.21.15.33:0/3245814137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c2806b070 msgr2=0x7f9c2819b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c267fc640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c2806b070 0x7f9c2819b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c267fc640 1 -- 172.21.15.33:0/3245814137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28102990 msgr2=0x7f9c2819bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c267fc640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28102990 0x7f9c2819bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c267fc640 1 -- 172.21.15.33:0/3245814137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c281a6280 con 0x7f9c28102580 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.009+0000 7f9c277fe640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28102990 0x7f9c2819bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.010+0000 7f9c267fc640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c28102580 0x7f9c2819b590 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c006fd0 tx=0x7f9c1c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.010+0000 7f9c0ffff640 1 -- 172.21.15.33:0/3245814137 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c011830 con 0x7f9c28102580 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.010+0000 7f9c0ffff640 1 -- 172.21.15.33:0/3245814137 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c1c016070 con 0x7f9c28102580 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.010+0000 7f9c2d431640 1 -- 172.21.15.33:0/3245814137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c281a6570 con 0x7f9c28102580 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.010+0000 7f9c0ffff640 1 -- 172.21.15.33:0/3245814137 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c010e00 con 0x7f9c28102580 2024-08-28T19:45:13.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.010+0000 7f9c2d431640 1 -- 172.21.15.33:0/3245814137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c281a6b00 con 0x7f9c28102580 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.012+0000 7f9c339a6740 1 Processor -- start 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.012+0000 7f9c0ffff640 1 -- 172.21.15.33:0/3245814137 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9c1c01b460 con 0x7f9c28102580 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.012+0000 7f9c339a6740 1 -- start start 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb39a070 0x5643eb73f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb73f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb379390 0x5643eb73fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c339a6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5643eb6b6630 con 0x5643eb3711b0 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c339a6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5643eb6a5bc0 con 0x5643eb39a070 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c339a6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5643eb6a9b70 con 0x5643eb379390 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb73f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb73f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57806/0 (socket says 172.21.15.33:57806) 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c26ffd640 1 -- 172.21.15.33:0/1838179401 learned_addr learned my addr 172.21.15.33:0/1838179401 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c277fe640 1 --2- 172.21.15.33:0/1838179401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb39a070 0x5643eb73f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c267fc640 1 --2- 172.21.15.33:0/1838179401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb379390 0x5643eb73fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c0ffff640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9c100b4d20 0x7f9c100b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c26ffd640 1 -- 172.21.15.33:0/1838179401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb379390 msgr2=0x5643eb73fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/1838179401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb379390 0x5643eb73fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c26ffd640 1 -- 172.21.15.33:0/1838179401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb39a070 msgr2=0x5643eb73f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/1838179401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb39a070 0x5643eb73f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c26ffd640 1 -- 172.21.15.33:0/1838179401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643eb405650 con 0x5643eb3711b0 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.013+0000 7f9c277fe640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9c100b4d20 0x7f9c100b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.014+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/1838179401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb73f840 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800cc20 tx=0x7f9c1800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b06d40a2e9e9cb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.014+0000 7f9c0ffff640 1 -- 172.21.15.33:0/3245814137 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9541+0+0 (secure 0 0 0) 0x7f9c1c0e4ef0 con 0x7f9c28102580 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.014+0000 7f9c0d7fa640 1 -- 172.21.15.33:0/1838179401 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18014070 con 0x5643eb3711b0 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.014+0000 7f9c0d7fa640 1 -- 172.21.15.33:0/1838179401 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c180047a0 con 0x5643eb3711b0 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.014+0000 7f9c0d7fa640 1 -- 172.21.15.33:0/1838179401 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18010690 con 0x5643eb3711b0 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 -- 172.21.15.33:0/1838179401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 msgr2=0x5643eb73f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:13.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 --2- 172.21.15.33:0/1838179401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb73f840 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800cc20 tx=0x7f9c1800e720 comp rx=0 tx=0).stop 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c277fe640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9c100b4d20 0x7f9c100b7230 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009a60 tx=0x7f9c2002a8e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 -- 172.21.15.33:0/1838179401 shutdown_connections 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 --2- 172.21.15.33:0/1838179401 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb379390 0x5643eb73fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 --2- 172.21.15.33:0/1838179401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb73f840 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 --2- 172.21.15.33:0/1838179401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb39a070 0x5643eb73f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 -- 172.21.15.33:0/1838179401 >> 172.21.15.33:0/1838179401 conn(0x5643eb38e460 msgr2=0x5643eb73d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 -- 172.21.15.33:0/1838179401 shutdown_connections 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 -- 172.21.15.33:0/1838179401 wait complete. 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 -- start start 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.015+0000 7f9c339a6740 1 Processor -- start 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3711b0 0x5643eb74aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb74afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb39a070 0x5643eb756dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c339a6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5643eb508700 con 0x5643eb39a070 2024-08-28T19:45:13.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c339a6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5643eb62c700 con 0x5643eb379390 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c339a6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5643eb74dae0 con 0x5643eb3711b0 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c339a6740 10 client.0 _ll_register_callbacks cb 0x5643eb65bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c277fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb39a070 0x5643eb756dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c277fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb39a070 0x5643eb756dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57822/0 (socket says 172.21.15.33:57822) 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c277fe640 1 -- 172.21.15.33:0/72300502 learned_addr learned my addr 172.21.15.33:0/72300502 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c267fc640 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb74afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3711b0 0x5643eb74aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c277fe640 1 -- 172.21.15.33:0/72300502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3711b0 msgr2=0x5643eb74aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c277fe640 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3711b0 0x5643eb74aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c277fe640 1 -- 172.21.15.33:0/72300502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 msgr2=0x5643eb74afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c277fe640 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb74afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c277fe640 1 -- 172.21.15.33:0/72300502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643eb6658b0 con 0x5643eb39a070 2024-08-28T19:45:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c277fe640 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb39a070 0x5643eb756dd0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f9c20035000 tx=0x7f9c200095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e273ff0cd112f3f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.016+0000 7f9c0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c0aff5640 1 -- 172.21.15.33:0/72300502 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20044070 con 0x5643eb39a070 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c0aff5640 1 -- 172.21.15.33:0/72300502 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9541+0+0 (secure 0 0 0) 0x7f9c200309f0 con 0x5643eb39a070 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c339a6740 1 -- 172.21.15.33:0/72300502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c180047a0 con 0x5643eb39a070 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c0aff5640 1 -- 172.21.15.33:0/72300502 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9c20030bf0 con 0x5643eb39a070 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c339a6740 10 client.19005 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c339a6740 1 -- 172.21.15.33:0/72300502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643eb759870 con 0x5643eb39a070 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c0aff5640 1 -- 172.21.15.33:0/72300502 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c180047a0 con 0x5643eb39a070 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c0aff5640 1 -- 172.21.15.33:0/72300502 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9c2004bbc0 con 0x5643eb39a070 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c339a6740 10 client.19005 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c339a6740 10 client.19005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c339a6740 20 client.19005 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:13.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c339a6740 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643eb3589f0 0x5643eb75cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c339a6740 4 client.19005 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.017+0000 7f9c339a6740 1 -- 172.21.15.33:0/72300502 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643eb6b8580 con 0x5643eb3589f0 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.018+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643eb3589f0 0x5643eb75cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.018+0000 7f9c0aff5640 10 client.19005 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.018+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643eb3589f0 0x5643eb75cd40 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=386f81795f80290 server_cookie=b00f1e45a0df125f in_seq=0 out_seq=0 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c0aff5640 1 -- 172.21.15.33:0/72300502 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643eb6b8580 con 0x5643eb3589f0 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c0aff5640 10 client.19005 handle_command_reply: tid=0 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 client.19005 shutdown 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 -- 172.21.15.33:0/72300502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb39a070 msgr2=0x5643eb756dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb39a070 0x5643eb756dd0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f9c20035000 tx=0x7f9c200095c0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 -- 172.21.15.33:0/72300502 shutdown_connections 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643eb3589f0 0x5643eb75cd40 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb39a070 0x5643eb756dd0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c0aff5640 0 client.19005 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb74afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 --2- 172.21.15.33:0/72300502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3711b0 0x5643eb74aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 -- 172.21.15.33:0/72300502 >> 172.21.15.33:0/72300502 conn(0x5643eb38e460 msgr2=0x5643eb7424e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 -- 172.21.15.33:0/72300502 shutdown_connections 2024-08-28T19:45:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 1 -- 172.21.15.33:0/72300502 wait complete. 2024-08-28T19:45:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.019+0000 7f9c339a6740 20 client.19005 trim_cache size 0 max 16384 2024-08-28T19:45:13.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c339a6740 1 Processor -- start 2024-08-28T19:45:13.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c339a6740 1 -- start start 2024-08-28T19:45:13.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3589f0 0x5643eb742b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3711b0 0x5643eb756cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb73cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c339a6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b0dc0 con 0x5643eb3589f0 2024-08-28T19:45:13.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c339a6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b2900 con 0x5643eb379390 2024-08-28T19:45:13.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c339a6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b1490 con 0x5643eb3711b0 2024-08-28T19:45:13.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3589f0 0x5643eb742b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c26ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3589f0 0x5643eb742b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57832/0 (socket says 172.21.15.33:57832) 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.038+0000 7f9c26ffd640 1 -- 172.21.15.33:0/1138377078 learned_addr learned my addr 172.21.15.33:0/1138377078 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c277fe640 1 --2- 172.21.15.33:0/1138377078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb73cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c267fc640 1 --2- 172.21.15.33:0/1138377078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3711b0 0x5643eb756cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c26ffd640 1 -- 172.21.15.33:0/1138377078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3711b0 msgr2=0x5643eb756cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/1138377078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3711b0 0x5643eb756cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c26ffd640 1 -- 172.21.15.33:0/1138377078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 msgr2=0x5643eb73cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/1138377078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb73cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c26ffd640 1 -- 172.21.15.33:0/1138377078 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643eb7499f0 con 0x5643eb3589f0 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/1138377078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3589f0 0x5643eb742b10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800ec20 tx=0x7f9c1800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20bf95af81258b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c0cff9640 1 -- 172.21.15.33:0/1138377078 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18014030 con 0x5643eb3589f0 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c0cff9640 1 -- 172.21.15.33:0/1138377078 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c18004240 con 0x5643eb3589f0 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.039+0000 7f9c0cff9640 1 -- 172.21.15.33:0/1138377078 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18026690 con 0x5643eb3589f0 2024-08-28T19:45:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.040+0000 7f9c339a6740 1 -- 172.21.15.33:0/1138377078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3589f0 msgr2=0x5643eb742b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.040+0000 7f9c339a6740 1 --2- 172.21.15.33:0/1138377078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3589f0 0x5643eb742b10 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800ec20 tx=0x7f9c1800c730 comp rx=0 tx=0).stop 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.040+0000 7f9c339a6740 1 -- 172.21.15.33:0/1138377078 shutdown_connections 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.040+0000 7f9c339a6740 1 --2- 172.21.15.33:0/1138377078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb73cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.040+0000 7f9c339a6740 1 --2- 172.21.15.33:0/1138377078 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3711b0 0x5643eb756cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.040+0000 7f9c339a6740 1 --2- 172.21.15.33:0/1138377078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3589f0 0x5643eb742b10 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.040+0000 7f9c339a6740 1 -- 172.21.15.33:0/1138377078 >> 172.21.15.33:0/1138377078 conn(0x5643eb38e460 msgr2=0x5643eb742400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.040+0000 7f9c339a6740 1 -- 172.21.15.33:0/1138377078 shutdown_connections 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.040+0000 7f9c339a6740 1 -- 172.21.15.33:0/1138377078 wait complete. 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c339a6740 1 -- start start 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c339a6740 1 Processor -- start 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3589f0 0x5643eb74f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb74fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c339a6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb7c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c339a6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b2230 con 0x5643eb3711b0 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c339a6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281b1b60 con 0x5643eb379390 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c339a6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9c281aedc0 con 0x5643eb3589f0 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c339a6740 10 client.0 _ll_register_callbacks cb 0x7f9c20031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c267fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb74fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c267fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb74fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57846/0 (socket says 172.21.15.33:57846) 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c267fc640 1 -- 172.21.15.33:0/2198172561 learned_addr learned my addr 172.21.15.33:0/2198172561 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3589f0 0x5643eb74f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c277fe640 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb7c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c267fc640 1 -- 172.21.15.33:0/2198172561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3589f0 msgr2=0x5643eb74f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c267fc640 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3589f0 0x5643eb74f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c267fc640 1 -- 172.21.15.33:0/2198172561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 msgr2=0x5643eb7c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:13.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.041+0000 7f9c267fc640 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb7c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c267fc640 1 -- 172.21.15.33:0/2198172561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643eb7c0e60 con 0x5643eb3711b0 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c277fe640 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb7c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c267fc640 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb74fcb0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0e2840 tx=0x7f9c1c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac870c76fa865f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c0aff5640 1 -- 172.21.15.33:0/2198172561 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0aacf0 con 0x5643eb3711b0 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c0aff5640 1 -- 172.21.15.33:0/2198172561 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9541+0+0 (secure 0 0 0) 0x7f9c1c0a7470 con 0x5643eb3711b0 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c339a6740 1 -- 172.21.15.33:0/2198172561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c18004240 con 0x5643eb3711b0 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c0aff5640 1 -- 172.21.15.33:0/2198172561 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9c1c021250 con 0x5643eb3711b0 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c339a6740 10 client.19011 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c339a6740 1 -- 172.21.15.33:0/2198172561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643eb7c8190 con 0x5643eb3711b0 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c0aff5640 1 -- 172.21.15.33:0/2198172561 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c18004240 con 0x5643eb3711b0 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.042+0000 7f9c0aff5640 1 -- 172.21.15.33:0/2198172561 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9c1c0b4070 con 0x5643eb3711b0 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.043+0000 7f9c339a6740 10 client.19011 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.043+0000 7f9c339a6740 10 client.19011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:45:13.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.043+0000 7f9c339a6740 20 client.19011 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.043+0000 7f9c339a6740 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643eb39a070 0x5643eb7ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.043+0000 7f9c339a6740 4 client.19011 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.043+0000 7f9c339a6740 1 -- 172.21.15.33:0/2198172561 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5643eb6b4020 con 0x5643eb39a070 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.043+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643eb39a070 0x5643eb7ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.043+0000 7f9c26ffd640 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643eb39a070 0x5643eb7ca950 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eed2442ca1ae4178 server_cookie=e0bc885af0497251 in_seq=0 out_seq=0 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.043+0000 7f9c0aff5640 10 client.19011 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c0aff5640 1 -- 172.21.15.33:0/2198172561 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x5643eb6b4020 con 0x5643eb39a070 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c0aff5640 10 client.19011 handle_command_reply: tid=0 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 client.19011 shutdown 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 -- 172.21.15.33:0/2198172561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 msgr2=0x5643eb74fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb74fcb0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0e2840 tx=0x7f9c1c00bf90 comp rx=0 tx=0).stop 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 -- 172.21.15.33:0/2198172561 shutdown_connections 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643eb379390 0x5643eb7c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643eb39a070 0x5643eb7ca950 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643eb3711b0 0x5643eb74fcb0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 --2- 172.21.15.33:0/2198172561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643eb3589f0 0x5643eb74f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 -- 172.21.15.33:0/2198172561 >> 172.21.15.33:0/2198172561 conn(0x5643eb38e460 msgr2=0x5643eb73c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:13.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c0aff5640 0 client.19011 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:13.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 -- 172.21.15.33:0/2198172561 shutdown_connections 2024-08-28T19:45:13.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 1 -- 172.21.15.33:0/2198172561 wait complete. 2024-08-28T19:45:13.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.044+0000 7f9c339a6740 20 client.19011 trim_cache size 0 max 16384 2024-08-28T19:45:13.053 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:45:13.053 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:45:13.054 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.056 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:45:13.057 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.059 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:45:13.060 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.062 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.063 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:45:13.064 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:45:13.065 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:45:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 -- 172.21.15.33:0/3245814137 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9c100b4d20 msgr2=0x7f9c100b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9c100b4d20 0x7f9c100b7230 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009a60 tx=0x7f9c2002a8e0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 -- 172.21.15.33:0/3245814137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c28102580 msgr2=0x7f9c2819b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c28102580 0x7f9c2819b590 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c006fd0 tx=0x7f9c1c00b8e0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 -- 172.21.15.33:0/3245814137 shutdown_connections 2024-08-28T19:45:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c28102990 0x7f9c2819bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c28102580 0x7f9c2819b590 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9c100b4d20 0x7f9c100b7230 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 --2- 172.21.15.33:0/3245814137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c2806b070 0x7f9c2819b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 -- 172.21.15.33:0/3245814137 >> 172.21.15.33:0/3245814137 conn(0x7f9c28079c60 msgr2=0x7f9c28100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 -- 172.21.15.33:0/3245814137 shutdown_connections 2024-08-28T19:45:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:13.045+0000 7f9c2d431640 1 -- 172.21.15.33:0/3245814137 wait complete. 2024-08-28T19:45:13.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:13 smithi033 ceph-mon[18549]: pgmap v738: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 KiB/s wr, 32 op/s 2024-08-28T19:45:13.964 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:45:13.964 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:45:14.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:13 smithi059 ceph-mon[22052]: pgmap v738: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 KiB/s wr, 32 op/s 2024-08-28T19:45:14.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:13 smithi122 ceph-mon[22174]: pgmap v738: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 KiB/s wr, 32 op/s 2024-08-28T19:45:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:14.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.754+0000 7f6068d29640 1 -- 172.21.15.33:0/3675590045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064108ac0 msgr2=0x7f606410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:14.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.754+0000 7f6068d29640 1 --2- 172.21.15.33:0/3675590045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064108ac0 0x7f606410f2f0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f605c009ca0 tx=0x7f605c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:45:14.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.754+0000 7f6068d29640 1 -- 172.21.15.33:0/3675590045 shutdown_connections 2024-08-28T19:45:14.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.754+0000 7f6068d29640 1 --2- 172.21.15.33:0/3675590045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064108ac0 0x7f606410f2f0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:14.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.754+0000 7f6068d29640 1 --2- 172.21.15.33:0/3675590045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6064108170 0x7f6064108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:14.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.754+0000 7f6068d29640 1 --2- 172.21.15.33:0/3675590045 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064102880 0x7f6064102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:14.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.754+0000 7f6068d29640 1 -- 172.21.15.33:0/3675590045 >> 172.21.15.33:0/3675590045 conn(0x7f6064079500 msgr2=0x7f6064079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:14.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.754+0000 7f6068d29640 1 -- 172.21.15.33:0/3675590045 shutdown_connections 2024-08-28T19:45:14.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.754+0000 7f6068d29640 1 -- 172.21.15.33:0/3675590045 wait complete. 2024-08-28T19:45:14.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6068d29640 1 Processor -- start 2024-08-28T19:45:14.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6068d29640 1 -- start start 2024-08-28T19:45:14.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6068d29640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064102880 0x7f606419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:14.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6068d29640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6064108170 0x7f606419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:14.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6068d29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064108ac0 0x7f606419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6068d29640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6064112740 con 0x7f6064102880 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6068d29640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f60641125c0 con 0x7f6064108170 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6068d29640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f60641128c0 con 0x7f6064108ac0 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f606259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064102880 0x7f606419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f606259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064102880 0x7f606419a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57858/0 (socket says 172.21.15.33:57858) 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f606259c640 1 -- 172.21.15.33:0/306686847 learned_addr learned my addr 172.21.15.33:0/306686847 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6061d9b640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6064108170 0x7f606419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6062d9d640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064108ac0 0x7f606419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f606259c640 1 -- 172.21.15.33:0/306686847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064108ac0 msgr2=0x7f606419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f606259c640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064108ac0 0x7f606419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f606259c640 1 -- 172.21.15.33:0/306686847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6064108170 msgr2=0x7f606419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f606259c640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6064108170 0x7f606419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:14.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f606259c640 1 -- 172.21.15.33:0/306686847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60641a0150 con 0x7f6064102880 2024-08-28T19:45:14.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.755+0000 7f6062d9d640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064108ac0 0x7f606419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:14.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.756+0000 7f606259c640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064102880 0x7f606419a1e0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f605400c970 tx=0x7f605400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:14.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.756+0000 7f60537fe640 1 -- 172.21.15.33:0/306686847 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054007bb0 con 0x7f6064102880 2024-08-28T19:45:14.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.756+0000 7f6068d29640 1 -- 172.21.15.33:0/306686847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60641a0440 con 0x7f6064102880 2024-08-28T19:45:14.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.756+0000 7f60537fe640 1 -- 172.21.15.33:0/306686847 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6054007d50 con 0x7f6064102880 2024-08-28T19:45:14.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.756+0000 7f60537fe640 1 -- 172.21.15.33:0/306686847 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605400f450 con 0x7f6064102880 2024-08-28T19:45:14.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.756+0000 7f6068d29640 1 -- 172.21.15.33:0/306686847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60641a6ba0 con 0x7f6064102880 2024-08-28T19:45:14.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.757+0000 7f6068d29640 1 -- 172.21.15.33:0/306686847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6064103ab0 con 0x7f6064102880 2024-08-28T19:45:14.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.759+0000 7f60537fe640 1 -- 172.21.15.33:0/306686847 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6054004f20 con 0x7f6064102880 2024-08-28T19:45:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.760+0000 7f60537fe640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f604c0b4ca0 0x7f604c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.760+0000 7f6061d9b640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f604c0b4ca0 0x7f604c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.760+0000 7f60537fe640 1 -- 172.21.15.33:0/306686847 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9541+0+0 (secure 0 0 0) 0x7f60540e5aa0 con 0x7f6064102880 2024-08-28T19:45:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.761+0000 7f6061d9b640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f604c0b4ca0 0x7f604c0b71b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f60641077d0 tx=0x7f605800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.763+0000 7f60537fe640 1 -- 172.21.15.33:0/306686847 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6054014030 con 0x7f6064102880 2024-08-28T19:45:14.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.985+0000 7f6068d29640 1 -- 172.21.15.33:0/306686847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f606410b920 con 0x7f6064102880 2024-08-28T19:45:14.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.986+0000 7f60537fe640 1 -- 172.21.15.33:0/306686847 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f60540ac430 con 0x7f6064102880 2024-08-28T19:45:14.986 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:45:14.987 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:45:14.987 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:45:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 -- 172.21.15.33:0/306686847 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f604c0b4ca0 msgr2=0x7f604c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f604c0b4ca0 0x7f604c0b71b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f60641077d0 tx=0x7f605800b390 comp rx=0 tx=0).stop 2024-08-28T19:45:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 -- 172.21.15.33:0/306686847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064102880 msgr2=0x7f606419a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064102880 0x7f606419a1e0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f605400c970 tx=0x7f605400ce30 comp rx=0 tx=0).stop 2024-08-28T19:45:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 -- 172.21.15.33:0/306686847 shutdown_connections 2024-08-28T19:45:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f604c0b4ca0 0x7f604c0b71b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6064108ac0 0x7f606419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6064108170 0x7f606419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 --2- 172.21.15.33:0/306686847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6064102880 0x7f606419a1e0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 -- 172.21.15.33:0/306686847 >> 172.21.15.33:0/306686847 conn(0x7f6064079500 msgr2=0x7f606406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 -- 172.21.15.33:0/306686847 shutdown_connections 2024-08-28T19:45:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:14.988+0000 7f6068d29640 1 -- 172.21.15.33:0/306686847 wait complete. 2024-08-28T19:45:15.718 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:15 smithi033 ceph-mon[18549]: pgmap v739: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-08-28T19:45:15.718 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:15 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/306686847' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:45:15.748 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:45:16.003 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:16.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:15 smithi059 ceph-mon[22052]: pgmap v739: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-08-28T19:45:16.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:15 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/306686847' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:45:16.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:15 smithi122 ceph-mon[22174]: pgmap v739: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-08-28T19:45:16.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:15 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/306686847' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:45:16.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.491+0000 7f460cf39640 1 -- 172.21.15.33:0/2093979825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4608105070 msgr2=0x7f460810d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:16.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.491+0000 7f460cf39640 1 --2- 172.21.15.33:0/2093979825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4608105070 0x7f460810d6b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009900 tx=0x7f45fc02a410 comp rx=0 tx=0).stop 2024-08-28T19:45:16.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.491+0000 7f460cf39640 1 -- 172.21.15.33:0/2093979825 shutdown_connections 2024-08-28T19:45:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.491+0000 7f460cf39640 1 --2- 172.21.15.33:0/2093979825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f460810dbf0 0x7f46081100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.491+0000 7f460cf39640 1 --2- 172.21.15.33:0/2093979825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4608105070 0x7f460810d6b0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.491+0000 7f460cf39640 1 --2- 172.21.15.33:0/2093979825 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4608104640 0x7f4608104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.491+0000 7f460cf39640 1 -- 172.21.15.33:0/2093979825 >> 172.21.15.33:0/2093979825 conn(0x7f46080794e0 msgr2=0x7f46080798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.491+0000 7f460cf39640 1 -- 172.21.15.33:0/2093979825 shutdown_connections 2024-08-28T19:45:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.491+0000 7f460cf39640 1 -- 172.21.15.33:0/2093979825 wait complete. 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f460cf39640 1 Processor -- start 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f460cf39640 1 -- start start 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f460cf39640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4608104640 0x7f460819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f460cf39640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4608105070 0x7f460819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f460cf39640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f460810dbf0 0x7f460819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f460cf39640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4608113890 con 0x7f460810dbf0 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f460cf39640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4608113710 con 0x7f4608104640 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f460cf39640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4608113a10 con 0x7f4608105070 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f4606d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f460810dbf0 0x7f460819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f4606d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f460810dbf0 0x7f460819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57880/0 (socket says 172.21.15.33:57880) 2024-08-28T19:45:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.492+0000 7f4606d9d640 1 -- 172.21.15.33:0/1681417573 learned_addr learned my addr 172.21.15.33:0/1681417573 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f460659c640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4608104640 0x7f460819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f4605d9b640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4608105070 0x7f460819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f4606d9d640 1 -- 172.21.15.33:0/1681417573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4608105070 msgr2=0x7f460819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f4606d9d640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4608105070 0x7f460819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f4606d9d640 1 -- 172.21.15.33:0/1681417573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4608104640 msgr2=0x7f460819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f4606d9d640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4608104640 0x7f460819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f4606d9d640 1 -- 172.21.15.33:0/1681417573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46081a02f0 con 0x7f460810dbf0 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f4606d9d640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f460810dbf0 0x7f460819fbc0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f460000cad0 tx=0x7f460000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f45f77fe640 1 -- 172.21.15.33:0/1681417573 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460000ad60 con 0x7f460810dbf0 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f45f77fe640 1 -- 172.21.15.33:0/1681417573 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4600005020 con 0x7f460810dbf0 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f460cf39640 1 -- 172.21.15.33:0/1681417573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46081a05e0 con 0x7f460810dbf0 2024-08-28T19:45:16.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f45f77fe640 1 -- 172.21.15.33:0/1681417573 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460000f6b0 con 0x7f460810dbf0 2024-08-28T19:45:16.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.493+0000 7f460cf39640 1 -- 172.21.15.33:0/1681417573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46081a6d40 con 0x7f460810dbf0 2024-08-28T19:45:16.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.496+0000 7f46134ae740 1 Processor -- start 2024-08-28T19:45:16.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.496+0000 7f45f77fe640 1 -- 172.21.15.33:0/1681417573 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f46000051d0 con 0x7f460810dbf0 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.496+0000 7f46134ae740 1 -- start start 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f46134ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x564986231310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f46134ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e631b0 0x564986231850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f46134ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e6b390 0x564986231d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f46134ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5649861a8680 con 0x564985e631b0 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f46134ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564986197c10 con 0x564985e6b390 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f46134ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x56498619bbc0 con 0x564985e8c070 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f460659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e631b0 0x564986231850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f460659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e631b0 0x564986231850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57888/0 (socket says 172.21.15.33:57888) 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f460659c640 1 -- 172.21.15.33:0/990767420 learned_addr learned my addr 172.21.15.33:0/990767420 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f4605d9b640 1 --2- 172.21.15.33:0/990767420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e6b390 0x564986231d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f4605d9b640 1 --2- 172.21.15.33:0/990767420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x564986231310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f460659c640 1 -- 172.21.15.33:0/990767420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 msgr2=0x564986231310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f460659c640 1 --2- 172.21.15.33:0/990767420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x564986231310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f460659c640 1 -- 172.21.15.33:0/990767420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e6b390 msgr2=0x564986231d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f460659c640 1 --2- 172.21.15.33:0/990767420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e6b390 0x564986231d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f45f77fe640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f45f00b4d20 0x7f45f00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f460659c640 1 -- 172.21.15.33:0/990767420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564985ef7650 con 0x564985e631b0 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.497+0000 7f4605d9b640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f45f00b4d20 0x7f45f00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.498+0000 7f460659c640 1 --2- 172.21.15.33:0/990767420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e631b0 0x564986231850 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009a70 tx=0x7f45f8009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97eb407ecc040916 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.498+0000 7f45f77fe640 1 -- 172.21.15.33:0/1681417573 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9541+0+0 (secure 0 0 0) 0x7f46000e5900 con 0x7f460810dbf0 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.498+0000 7f45f4ff9640 1 -- 172.21.15.33:0/990767420 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8017070 con 0x564985e631b0 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.498+0000 7f45f4ff9640 1 -- 172.21.15.33:0/990767420 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45f8013470 con 0x564985e631b0 2024-08-28T19:45:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.498+0000 7f45f4ff9640 1 -- 172.21.15.33:0/990767420 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8012630 con 0x564985e631b0 2024-08-28T19:45:16.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 -- 172.21.15.33:0/990767420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e631b0 msgr2=0x564986231850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:16.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 --2- 172.21.15.33:0/990767420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e631b0 0x564986231850 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009a70 tx=0x7f45f8009f30 comp rx=0 tx=0).stop 2024-08-28T19:45:16.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f4605d9b640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f45f00b4d20 0x7f45f00b7230 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f45fc000c00 tx=0x7f45fc040040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 -- 172.21.15.33:0/990767420 shutdown_connections 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 --2- 172.21.15.33:0/990767420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e6b390 0x564986231d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 --2- 172.21.15.33:0/990767420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e631b0 0x564986231850 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 --2- 172.21.15.33:0/990767420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x564986231310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 -- 172.21.15.33:0/990767420 >> 172.21.15.33:0/990767420 conn(0x564985e80460 msgr2=0x56498622f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 -- 172.21.15.33:0/990767420 shutdown_connections 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 -- 172.21.15.33:0/990767420 wait complete. 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 -- start start 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.499+0000 7f46134ae740 1 Processor -- start 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f46134ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e631b0 0x564986240df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f46134ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e6b390 0x564986241330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f46134ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e8c070 0x56498624d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f46134ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564985ffa700 con 0x564985e8c070 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f46134ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56498611e750 con 0x564985e6b390 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f46134ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564986243e20 con 0x564985e631b0 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f46134ae740 10 client.0 _ll_register_callbacks cb 0x56498614de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f4606d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e8c070 0x56498624d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f4606d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e8c070 0x56498624d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57892/0 (socket says 172.21.15.33:57892) 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f4606d9d640 1 -- 172.21.15.33:0/2835117696 learned_addr learned my addr 172.21.15.33:0/2835117696 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f4605d9b640 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e6b390 0x564986241330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f460659c640 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e631b0 0x564986240df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f4606d9d640 1 -- 172.21.15.33:0/2835117696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e631b0 msgr2=0x564986240df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f4606d9d640 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e631b0 0x564986240df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f4606d9d640 1 -- 172.21.15.33:0/2835117696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e6b390 msgr2=0x564986241330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:16.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f4606d9d640 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e6b390 0x564986241330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f4606d9d640 1 -- 172.21.15.33:0/2835117696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564986157900 con 0x564985e8c070 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f4606d9d640 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e8c070 0x56498624d150 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f46000a7c70 tx=0x7f46000ab700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f00dfe568fb083 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.500+0000 7f45edffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f45edffb640 1 -- 172.21.15.33:0/2835117696 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460001d040 con 0x564985e8c070 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f45edffb640 1 -- 172.21.15.33:0/2835117696 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9541+0+0 (secure 0 0 0) 0x7f46000b01b0 con 0x564985e8c070 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f46134ae740 1 -- 172.21.15.33:0/2835117696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45f8013470 con 0x564985e8c070 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f45edffb640 1 -- 172.21.15.33:0/2835117696 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f46000abbf0 con 0x564985e8c070 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f46134ae740 10 client.19029 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f46134ae740 1 -- 172.21.15.33:0/2835117696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56498624fb80 con 0x564985e8c070 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f45edffb640 1 -- 172.21.15.33:0/2835117696 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45f8013470 con 0x564985e8c070 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f45edffb640 1 -- 172.21.15.33:0/2835117696 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f46000aa8c0 con 0x564985e8c070 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f46134ae740 10 client.19029 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:16.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f46134ae740 10 client.19029 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:45:16.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f46134ae740 20 client.19029 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:16.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f46134ae740 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x564985e4a9f0 0x564986253140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f46134ae740 4 client.19029 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:45:16.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.501+0000 7f46134ae740 1 -- 172.21.15.33:0/2835117696 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649861aa5d0 con 0x564985e4a9f0 2024-08-28T19:45:16.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.502+0000 7f460659c640 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x564985e4a9f0 0x564986253140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.502+0000 7f460659c640 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x564985e4a9f0 0x564986253140 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=338cfe0f8cc41728 server_cookie=bb70413b1fd71b28 in_seq=0 out_seq=0 2024-08-28T19:45:16.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.502+0000 7f45edffb640 10 client.19029 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:45:16.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.503+0000 7f45edffb640 1 -- 172.21.15.33:0/2835117696 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5649861aa5d0 con 0x564985e4a9f0 2024-08-28T19:45:16.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.503+0000 7f45edffb640 10 client.19029 handle_command_reply: tid=0 2024-08-28T19:45:16.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.503+0000 7f46134ae740 1 client.19029 shutdown 2024-08-28T19:45:16.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.503+0000 7f46134ae740 1 -- 172.21.15.33:0/2835117696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e8c070 msgr2=0x56498624d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:16.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.503+0000 7f46134ae740 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e8c070 0x56498624d150 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f46000a7c70 tx=0x7f46000ab700 comp rx=0 tx=0).stop 2024-08-28T19:45:16.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.503+0000 7f46134ae740 1 -- 172.21.15.33:0/2835117696 shutdown_connections 2024-08-28T19:45:16.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.503+0000 7f46134ae740 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x564985e4a9f0 0x564986253140 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.503+0000 7f46134ae740 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e8c070 0x56498624d150 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.503+0000 7f46134ae740 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e6b390 0x564986241330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.503+0000 7f46134ae740 1 --2- 172.21.15.33:0/2835117696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e631b0 0x564986240df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.504+0000 7f46134ae740 1 -- 172.21.15.33:0/2835117696 >> 172.21.15.33:0/2835117696 conn(0x564985e80460 msgr2=0x564986234460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:16.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.504+0000 7f45edffb640 0 client.19029 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:45:16.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.504+0000 7f46134ae740 1 -- 172.21.15.33:0/2835117696 shutdown_connections 2024-08-28T19:45:16.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.504+0000 7f46134ae740 1 -- 172.21.15.33:0/2835117696 wait complete. 2024-08-28T19:45:16.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.504+0000 7f46134ae740 20 client.19029 trim_cache size 0 max 16384 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f46134ae740 1 Processor -- start 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f46134ae740 1 -- start start 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f46134ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 0x56498624d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f46134ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x56498624d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f46134ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x56498623f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f46134ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f46081aec20 con 0x564985e6b390 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f46134ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f46081b0760 con 0x564985e631b0 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f46134ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f46081af2f0 con 0x564985e8c070 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f4605d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x56498624d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f4605d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x56498624d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57896/0 (socket says 172.21.15.33:57896) 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f4605d9b640 1 -- 172.21.15.33:0/3416360967 learned_addr learned my addr 172.21.15.33:0/3416360967 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.517+0000 7f460659c640 1 --2- 172.21.15.33:0/3416360967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 0x56498624d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f4605d9b640 1 -- 172.21.15.33:0/3416360967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 msgr2=0x56498623f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f4606d9d640 1 --2- 172.21.15.33:0/3416360967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x56498623f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f4605d9b640 1 --2- 172.21.15.33:0/3416360967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x56498623f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f4605d9b640 1 -- 172.21.15.33:0/3416360967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 msgr2=0x56498624d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f4605d9b640 1 --2- 172.21.15.33:0/3416360967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 0x56498624d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f4605d9b640 1 -- 172.21.15.33:0/3416360967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564986234110 con 0x564985e6b390 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f460659c640 1 --2- 172.21.15.33:0/3416360967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 0x56498624d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f4605d9b640 1 --2- 172.21.15.33:0/3416360967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x56498624d590 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f45fc005940 tx=0x7f45fc031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78359d0f2ee01888 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f45effff640 1 -- 172.21.15.33:0/3416360967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc045070 con 0x564985e6b390 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f45effff640 1 -- 172.21.15.33:0/3416360967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45fc0054d0 con 0x564985e6b390 2024-08-28T19:45:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.518+0000 7f45effff640 1 -- 172.21.15.33:0/3416360967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc035040 con 0x564985e6b390 2024-08-28T19:45:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 -- 172.21.15.33:0/3416360967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 msgr2=0x56498624d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 --2- 172.21.15.33:0/3416360967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x56498624d590 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f45fc005940 tx=0x7f45fc031400 comp rx=0 tx=0).stop 2024-08-28T19:45:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 -- 172.21.15.33:0/3416360967 shutdown_connections 2024-08-28T19:45:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 --2- 172.21.15.33:0/3416360967 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x56498623f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 --2- 172.21.15.33:0/3416360967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x56498624d590 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 --2- 172.21.15.33:0/3416360967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 0x56498624d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 -- 172.21.15.33:0/3416360967 >> 172.21.15.33:0/3416360967 conn(0x564985e80460 msgr2=0x56498623bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:16.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 -- 172.21.15.33:0/3416360967 shutdown_connections 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 -- 172.21.15.33:0/3416360967 wait complete. 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 -- start start 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.519+0000 7f46134ae740 1 Processor -- start 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f46134ae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 0x5649862498b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f46134ae740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x564986244db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f46134ae740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x564986245310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f46134ae740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f46081b0090 con 0x564985e6b390 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f46134ae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f46081af9c0 con 0x564985e631b0 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f46134ae740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f46081acc20 con 0x564985e8c070 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f46134ae740 10 client.0 _ll_register_callbacks cb 0x7f46000a7ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4605d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x564986244db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4605d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x564986244db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57902/0 (socket says 172.21.15.33:57902) 2024-08-28T19:45:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4605d9b640 1 -- 172.21.15.33:0/3588312775 learned_addr learned my addr 172.21.15.33:0/3588312775 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f460659c640 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 0x5649862498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4606d9d640 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x564986245310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4605d9b640 1 -- 172.21.15.33:0/3588312775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 msgr2=0x564986245310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4605d9b640 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x564986245310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4605d9b640 1 -- 172.21.15.33:0/3588312775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 msgr2=0x5649862498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4605d9b640 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 0x5649862498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4605d9b640 1 -- 172.21.15.33:0/3588312775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564986245aa0 con 0x564985e6b390 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4606d9d640 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x564986245310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f4605d9b640 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x564986244db0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f45fc006010 tx=0x7f45fc0318f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66c98ab6d874019 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f45edffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f45edffb640 1 -- 172.21.15.33:0/3588312775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc045030 con 0x564985e6b390 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f46134ae740 1 -- 172.21.15.33:0/3588312775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45fc0054d0 con 0x564985e6b390 2024-08-28T19:45:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.520+0000 7f45edffb640 1 -- 172.21.15.33:0/3588312775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9541+0+0 (secure 0 0 0) 0x7f45fc005200 con 0x564985e6b390 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f45edffb640 1 -- 172.21.15.33:0/3588312775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f45fc063050 con 0x564985e6b390 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f46134ae740 10 client.19035 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f46134ae740 1 -- 172.21.15.33:0/3588312775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5649862bdaa0 con 0x564985e6b390 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f45edffb640 1 -- 172.21.15.33:0/3588312775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45fc0054d0 con 0x564985e6b390 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f45edffb640 1 -- 172.21.15.33:0/3588312775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f45fc03a040 con 0x564985e6b390 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f46134ae740 10 client.19035 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f46134ae740 10 client.19035 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f46134ae740 20 client.19035 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f46134ae740 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x564985e1fda0 0x5649862c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f46134ae740 4 client.19035 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f46134ae740 1 -- 172.21.15.33:0/3588312775 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649861a6070 con 0x564985e1fda0 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.521+0000 7f460659c640 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x564985e1fda0 0x5649862c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f460659c640 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x564985e1fda0 0x5649862c01a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=642d242d0e912b02 server_cookie=aca9771620ef6ca8 in_seq=0 out_seq=0 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f45edffb640 10 client.19035 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f45edffb640 1 -- 172.21.15.33:0/3588312775 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649861a6070 con 0x564985e1fda0 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f45edffb640 10 client.19035 handle_command_reply: tid=0 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 client.19035 shutdown 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 -- 172.21.15.33:0/3588312775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 msgr2=0x564986244db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x564986244db0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f45fc006010 tx=0x7f45fc0318f0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 -- 172.21.15.33:0/3588312775 shutdown_connections 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x564985e1fda0 0x5649862c01a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564985e8c070 0x564986245310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564985e6b390 0x564986244db0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f45edffb640 0 client.19035 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 --2- 172.21.15.33:0/3588312775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564985e631b0 0x5649862498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 -- 172.21.15.33:0/3588312775 >> 172.21.15.33:0/3588312775 conn(0x564985e80460 msgr2=0x56498623f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:16.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 -- 172.21.15.33:0/3588312775 shutdown_connections 2024-08-28T19:45:16.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 1 -- 172.21.15.33:0/3588312775 wait complete. 2024-08-28T19:45:16.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.522+0000 7f46134ae740 20 client.19035 trim_cache size 0 max 16384 2024-08-28T19:45:16.529 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:45:16.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 -- 172.21.15.33:0/1681417573 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f45f00b4d20 msgr2=0x7f45f00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:16.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f45f00b4d20 0x7f45f00b7230 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f45fc000c00 tx=0x7f45fc040040 comp rx=0 tx=0).stop 2024-08-28T19:45:16.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 -- 172.21.15.33:0/1681417573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f460810dbf0 msgr2=0x7f460819fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:16.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f460810dbf0 0x7f460819fbc0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f460000cad0 tx=0x7f460000ced0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 -- 172.21.15.33:0/1681417573 shutdown_connections 2024-08-28T19:45:16.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f460810dbf0 0x7f460819fbc0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f45f00b4d20 0x7f45f00b7230 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4608105070 0x7f460819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 --2- 172.21.15.33:0/1681417573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4608104640 0x7f460819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:16.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 -- 172.21.15.33:0/1681417573 >> 172.21.15.33:0/1681417573 conn(0x7f46080794e0 msgr2=0x7f46080ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:16.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 -- 172.21.15.33:0/1681417573 shutdown_connections 2024-08-28T19:45:16.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:16.523+0000 7f460cf39640 1 -- 172.21.15.33:0/1681417573 wait complete. 2024-08-28T19:45:17.438 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:45:17.685 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:45:17.698 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:17.707 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:17 smithi033 ceph-mon[18549]: pgmap v740: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-08-28T19:45:18.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:17 smithi059 ceph-mon[22052]: pgmap v740: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-08-28T19:45:18.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:17 smithi122 ceph-mon[22174]: pgmap v740: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-08-28T19:45:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.225+0000 7f0974cb2640 1 -- 172.21.15.33:0/1896705761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970109260 msgr2=0x7f0970109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.225+0000 7f0974cb2640 1 --2- 172.21.15.33:0/1896705761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970109260 0x7f0970109670 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f0964009900 tx=0x7f096402a410 comp rx=0 tx=0).stop 2024-08-28T19:45:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.226+0000 7f0974cb2640 1 -- 172.21.15.33:0/1896705761 shutdown_connections 2024-08-28T19:45:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.226+0000 7f0974cb2640 1 --2- 172.21.15.33:0/1896705761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0970109bb0 0x7f09701103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.226+0000 7f0974cb2640 1 --2- 172.21.15.33:0/1896705761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970109260 0x7f0970109670 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.226+0000 7f0974cb2640 1 --2- 172.21.15.33:0/1896705761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970103920 0x7f0970103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.226+0000 7f0974cb2640 1 -- 172.21.15.33:0/1896705761 >> 172.21.15.33:0/1896705761 conn(0x7f09700ff3b0 msgr2=0x7f0970101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.226+0000 7f0974cb2640 1 -- 172.21.15.33:0/1896705761 shutdown_connections 2024-08-28T19:45:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.226+0000 7f0974cb2640 1 -- 172.21.15.33:0/1896705761 wait complete. 2024-08-28T19:45:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f0974cb2640 1 Processor -- start 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f0974cb2640 1 -- start start 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f0974cb2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970103920 0x7f097019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f0974cb2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970109260 0x7f097019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f0974cb2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0970109bb0 0x7f097019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f0974cb2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0970113870 con 0x7f0970109260 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f0974cb2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09701136f0 con 0x7f0970103920 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f0974cb2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f09701139f0 con 0x7f0970109bb0 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f096dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970109260 0x7f097019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f096dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970109260 0x7f097019a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57912/0 (socket says 172.21.15.33:57912) 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f096dd9b640 1 -- 172.21.15.33:0/2825016584 learned_addr learned my addr 172.21.15.33:0/2825016584 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.227+0000 7f096e59c640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970103920 0x7f097019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f096dd9b640 1 -- 172.21.15.33:0/2825016584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0970109bb0 msgr2=0x7f097019fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f096dd9b640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0970109bb0 0x7f097019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f096dd9b640 1 -- 172.21.15.33:0/2825016584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970103920 msgr2=0x7f097019a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f096dd9b640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970103920 0x7f097019a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f096dd9b640 1 -- 172.21.15.33:0/2825016584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09701a01b0 con 0x7f0970109260 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f096dd9b640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970109260 0x7f097019a7e0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f096402a930 tx=0x7f0964004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f095f7fe640 1 -- 172.21.15.33:0/2825016584 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096403f030 con 0x7f0970109260 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f095f7fe640 1 -- 172.21.15.33:0/2825016584 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0964003aa0 con 0x7f0970109260 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f0974cb2640 1 -- 172.21.15.33:0/2825016584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09701a0440 con 0x7f0970109260 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f095f7fe640 1 -- 172.21.15.33:0/2825016584 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964035070 con 0x7f0970109260 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.228+0000 7f0974cb2640 1 -- 172.21.15.33:0/2825016584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09701a6c00 con 0x7f0970109260 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.231+0000 7f095f7fe640 1 -- 172.21.15.33:0/2825016584 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0964042030 con 0x7f0970109260 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.231+0000 7f097b227740 1 Processor -- start 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.231+0000 7f097b227740 1 -- start start 2024-08-28T19:45:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.231+0000 7f097b227740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fecd070 0x561680272310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.231+0000 7f097b227740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680272850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.231+0000 7f097b227740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x561680272d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.231+0000 7f097b227740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5616801e9680 con 0x56167feac390 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.231+0000 7f097b227740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5616801d8c10 con 0x56167fecd070 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.231+0000 7f097b227740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5616801dcbc0 con 0x56167fea41b0 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x561680272d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096ed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fecd070 0x561680272310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x561680272d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57924/0 (socket says 172.21.15.33:57924) 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096dd9b640 1 -- 172.21.15.33:0/375071072 learned_addr learned my addr 172.21.15.33:0/375071072 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096e59c640 1 --2- 172.21.15.33:0/375071072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680272850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f095f7fe640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09580b4ca0 0x7f09580b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096ed9d640 1 -- 172.21.15.33:0/375071072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 msgr2=0x561680272850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:18.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096ed9d640 1 --2- 172.21.15.33:0/375071072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680272850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096ed9d640 1 -- 172.21.15.33:0/375071072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 msgr2=0x561680272d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096ed9d640 1 --2- 172.21.15.33:0/375071072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x561680272d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096ed9d640 1 -- 172.21.15.33:0/375071072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56167ff38650 con 0x56167fecd070 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096dd9b640 1 --2- 172.21.15.33:0/375071072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x561680272d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f095f7fe640 1 -- 172.21.15.33:0/2825016584 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9541+0+0 (secure 0 0 0) 0x7f0964106170 con 0x7f0970109260 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096ed9d640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09580b4ca0 0x7f09580b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.232+0000 7f096ed9d640 1 --2- 172.21.15.33:0/375071072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fecd070 0x561680272310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0968009e40 tx=0x7f096800e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e70c77482aaa60d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.233+0000 7f095cff9640 1 -- 172.21.15.33:0/375071072 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0968003dd0 con 0x56167fecd070 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.233+0000 7f095cff9640 1 -- 172.21.15.33:0/375071072 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f096800ed70 con 0x56167fecd070 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.233+0000 7f095cff9640 1 -- 172.21.15.33:0/375071072 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096801a610 con 0x56167fecd070 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 -- 172.21.15.33:0/375071072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fecd070 msgr2=0x561680272310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:18.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 --2- 172.21.15.33:0/375071072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fecd070 0x561680272310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0968009e40 tx=0x7f096800e6c0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f096ed9d640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09580b4ca0 0x7f09580b71b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f096801f000 tx=0x7f0968020000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 -- 172.21.15.33:0/375071072 shutdown_connections 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 --2- 172.21.15.33:0/375071072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x561680272d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 --2- 172.21.15.33:0/375071072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680272850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 --2- 172.21.15.33:0/375071072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fecd070 0x561680272310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 -- 172.21.15.33:0/375071072 >> 172.21.15.33:0/375071072 conn(0x56167fec1460 msgr2=0x561680270200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 -- 172.21.15.33:0/375071072 shutdown_connections 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 -- 172.21.15.33:0/375071072 wait complete. 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 -- start start 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.234+0000 7f097b227740 1 Processor -- start 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f097b227740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fea41b0 0x56168027da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f097b227740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x56168027df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f097b227740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fecd070 0x561680289e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f097b227740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x56168003b700 con 0x56167feac390 2024-08-28T19:45:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f097b227740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56168015f750 con 0x56167fea41b0 2024-08-28T19:45:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f097b227740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x561680280af0 con 0x56167fecd070 2024-08-28T19:45:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f097b227740 10 client.0 _ll_register_callbacks cb 0x56168018ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fea41b0 0x56168027da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x56168027df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fea41b0 0x56168027da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:37490/0 (socket says 172.21.15.33:37490) 2024-08-28T19:45:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096e59c640 1 -- 172.21.15.33:0/3015386172 learned_addr learned my addr 172.21.15.33:0/3015386172 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096ed9d640 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fecd070 0x561680289e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096e59c640 1 -- 172.21.15.33:0/3015386172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fecd070 msgr2=0x561680289e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:18.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096e59c640 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fecd070 0x561680289e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096e59c640 1 -- 172.21.15.33:0/3015386172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 msgr2=0x56168027df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096e59c640 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x56168027df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096e59c640 1 -- 172.21.15.33:0/3015386172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561680198900 con 0x56167fea41b0 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.235+0000 7f096dd9b640 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x56168027df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.236+0000 7f096e59c640 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fea41b0 0x56168027da50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f096000bee0 tx=0x7f0960012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=442a7eacf31c7187 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.236+0000 7f0955ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.236+0000 7f0955ffb640 1 -- 172.21.15.33:0/3015386172 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960004230 con 0x56167fea41b0 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.236+0000 7f0955ffb640 1 -- 172.21.15.33:0/3015386172 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9541+0+0 (secure 0 0 0) 0x7f09600043d0 con 0x56167fea41b0 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.236+0000 7f097b227740 1 -- 172.21.15.33:0/3015386172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f096800ed70 con 0x56167fea41b0 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.236+0000 7f0955ffb640 1 -- 172.21.15.33:0/3015386172 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0960024050 con 0x56167fea41b0 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.236+0000 7f097b227740 10 client.27923 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:18.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.236+0000 7f097b227740 1 -- 172.21.15.33:0/3015386172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56168028c910 con 0x56167fea41b0 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.237+0000 7f0955ffb640 1 -- 172.21.15.33:0/3015386172 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f096800ed70 con 0x56167fea41b0 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.237+0000 7f0955ffb640 1 -- 172.21.15.33:0/3015386172 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f09600039d0 con 0x56167fea41b0 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.237+0000 7f097b227740 10 client.27923 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.237+0000 7f097b227740 10 client.27923 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.237+0000 7f097b227740 20 client.27923 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.237+0000 7f097b227740 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56167fe8b9f0 0x56168028fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.237+0000 7f097b227740 4 client.27923 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.237+0000 7f097b227740 1 -- 172.21.15.33:0/3015386172 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616801eb5d0 con 0x56167fe8b9f0 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.237+0000 7f096dd9b640 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56167fe8b9f0 0x56168028fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.238+0000 7f096dd9b640 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56167fe8b9f0 0x56168028fe20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=859b74052b506d09 server_cookie=e402615f20894a1 in_seq=0 out_seq=0 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.238+0000 7f0955ffb640 10 client.27923 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f0955ffb640 1 -- 172.21.15.33:0/3015386172 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5616801eb5d0 con 0x56167fe8b9f0 2024-08-28T19:45:18.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f0955ffb640 10 client.27923 handle_command_reply: tid=0 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 client.27923 shutdown 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 -- 172.21.15.33:0/3015386172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fea41b0 msgr2=0x56168027da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fea41b0 0x56168027da50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f096000bee0 tx=0x7f0960012820 comp rx=0 tx=0).stop 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 -- 172.21.15.33:0/3015386172 shutdown_connections 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56167fe8b9f0 0x56168028fe20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fecd070 0x561680289e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167feac390 0x56168027df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f0955ffb640 0 client.27923 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 --2- 172.21.15.33:0/3015386172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167fea41b0 0x56168027da50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 -- 172.21.15.33:0/3015386172 >> 172.21.15.33:0/3015386172 conn(0x56167fec1460 msgr2=0x5616802754a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 -- 172.21.15.33:0/3015386172 shutdown_connections 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 1 -- 172.21.15.33:0/3015386172 wait complete. 2024-08-28T19:45:18.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.239+0000 7f097b227740 20 client.27923 trim_cache size 0 max 16384 2024-08-28T19:45:18.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f097b227740 1 Processor -- start 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f097b227740 1 -- start start 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f097b227740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680275b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f097b227740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 0x561680289d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f097b227740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 0x56168026fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f097b227740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f09701b0d70 con 0x56167fecd070 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f097b227740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09701b28b0 con 0x56167feac390 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f097b227740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f09701b1440 con 0x56167fea41b0 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f096ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 0x56168026fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f096ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 0x56168026fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57940/0 (socket says 172.21.15.33:57940) 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f096ed9d640 1 -- 172.21.15.33:0/3800384460 learned_addr learned my addr 172.21.15.33:0/3800384460 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.253+0000 7f096dd9b640 1 --2- 172.21.15.33:0/3800384460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 0x561680289d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f096e59c640 1 --2- 172.21.15.33:0/3800384460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680275b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f096ed9d640 1 -- 172.21.15.33:0/3800384460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 msgr2=0x561680275b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:18.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f096ed9d640 1 --2- 172.21.15.33:0/3800384460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680275b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f096ed9d640 1 -- 172.21.15.33:0/3800384460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 msgr2=0x561680289d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:18.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f096ed9d640 1 --2- 172.21.15.33:0/3800384460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 0x561680289d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f096ed9d640 1 -- 172.21.15.33:0/3800384460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168026a3d0 con 0x56167fecd070 2024-08-28T19:45:18.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f096e59c640 1 --2- 172.21.15.33:0/3800384460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680275b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:18.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f096ed9d640 1 --2- 172.21.15.33:0/3800384460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 0x56168026fb60 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f0968009270 tx=0x7f0968009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1e717848e0eaa9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f0957fff640 1 -- 172.21.15.33:0/3800384460 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0968003970 con 0x56167fecd070 2024-08-28T19:45:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f0957fff640 1 -- 172.21.15.33:0/3800384460 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0968003dd0 con 0x56167fecd070 2024-08-28T19:45:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.254+0000 7f0957fff640 1 -- 172.21.15.33:0/3800384460 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096801ad20 con 0x56167fecd070 2024-08-28T19:45:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.255+0000 7f097b227740 1 -- 172.21.15.33:0/3800384460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 msgr2=0x56168026fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.255+0000 7f097b227740 1 --2- 172.21.15.33:0/3800384460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 0x56168026fb60 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f0968009270 tx=0x7f0968009690 comp rx=0 tx=0).stop 2024-08-28T19:45:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.255+0000 7f097b227740 1 -- 172.21.15.33:0/3800384460 shutdown_connections 2024-08-28T19:45:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.255+0000 7f097b227740 1 --2- 172.21.15.33:0/3800384460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 0x56168026fb60 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.255+0000 7f097b227740 1 --2- 172.21.15.33:0/3800384460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 0x561680289d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.255+0000 7f097b227740 1 --2- 172.21.15.33:0/3800384460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680275b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.255+0000 7f097b227740 1 -- 172.21.15.33:0/3800384460 >> 172.21.15.33:0/3800384460 conn(0x56167fec1460 msgr2=0x561680275410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.255+0000 7f097b227740 1 -- 172.21.15.33:0/3800384460 shutdown_connections 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.255+0000 7f097b227740 1 -- 172.21.15.33:0/3800384460 wait complete. 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.256+0000 7f097b227740 1 -- start start 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.256+0000 7f097b227740 1 Processor -- start 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.256+0000 7f097b227740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680282180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.256+0000 7f097b227740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 0x561680282720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.256+0000 7f097b227740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 0x5616802f9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.256+0000 7f097b227740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f09701b21e0 con 0x56167fecd070 2024-08-28T19:45:18.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.256+0000 7f097b227740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09701b1b10 con 0x56167feac390 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.256+0000 7f097b227740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f09701aed70 con 0x56167fea41b0 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.256+0000 7f097b227740 10 client.0 _ll_register_callbacks cb 0x7f096000b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680282180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 0x561680282720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096e59c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680282180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:50616/0 (socket says 172.21.15.33:50616) 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 0x561680282720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:37522/0 (socket says 172.21.15.33:37522) 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096e59c640 1 -- 172.21.15.33:0/1861503173 learned_addr learned my addr 172.21.15.33:0/1861503173 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096ed9d640 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 0x5616802f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096e59c640 1 -- 172.21.15.33:0/1861503173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 msgr2=0x561680282720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096e59c640 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 0x561680282720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096e59c640 1 -- 172.21.15.33:0/1861503173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 msgr2=0x5616802f9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:18.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096e59c640 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 0x5616802f9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096e59c640 1 -- 172.21.15.33:0/1861503173 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616802f9d60 con 0x56167fea41b0 2024-08-28T19:45:18.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f096e59c640 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680282180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0960001eb0 tx=0x7f096001b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c1af0ea69140ef4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:18.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.257+0000 7f0955ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:45:18.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.258+0000 7f0955ffb640 1 -- 172.21.15.33:0/1861503173 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600041f0 con 0x56167fea41b0 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.258+0000 7f0955ffb640 1 -- 172.21.15.33:0/1861503173 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9541+0+0 (secure 0 0 0) 0x7f0960004390 con 0x56167fea41b0 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.258+0000 7f097b227740 1 -- 172.21.15.33:0/1861503173 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0968003dd0 con 0x56167fea41b0 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.258+0000 7f0955ffb640 1 -- 172.21.15.33:0/1861503173 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f09600035f0 con 0x56167fea41b0 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.258+0000 7f097b227740 10 client.27838 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.258+0000 7f097b227740 1 -- 172.21.15.33:0/1861503173 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5616802faee0 con 0x56167fea41b0 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.258+0000 7f0955ffb640 1 -- 172.21.15.33:0/1861503173 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0968003dd0 con 0x56167fea41b0 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.259+0000 7f0955ffb640 1 -- 172.21.15.33:0/1861503173 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f096001b830 con 0x56167fea41b0 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.259+0000 7f097b227740 10 client.27838 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.259+0000 7f097b227740 10 client.27838 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.259+0000 7f097b227740 20 client.27838 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.259+0000 7f097b227740 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56167fe60da0 0x5616802fd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.259+0000 7f097b227740 4 client.27838 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.259+0000 7f097b227740 1 -- 172.21.15.33:0/1861503173 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5616801e7070 con 0x56167fe60da0 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.259+0000 7f096dd9b640 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56167fe60da0 0x5616802fd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.259+0000 7f0955ffb640 10 client.27838 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.259+0000 7f096dd9b640 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56167fe60da0 0x5616802fd6d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=adaa0971b5fe8ea2 server_cookie=a3b38a20b1974400 in_seq=0 out_seq=0 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f0955ffb640 1 -- 172.21.15.33:0/1861503173 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5616801e7070 con 0x56167fe60da0 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f0955ffb640 10 client.27838 handle_command_reply: tid=0 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 client.27838 shutdown 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 -- 172.21.15.33:0/1861503173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 msgr2=0x561680282180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680282180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0960001eb0 tx=0x7f096001b730 comp rx=0 tx=0).stop 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 -- 172.21.15.33:0/1861503173 shutdown_connections 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x56167fe60da0 0x5616802fd6d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56167fecd070 0x5616802f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56167feac390 0x561680282720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 --2- 172.21.15.33:0/1861503173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56167fea41b0 0x561680282180 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 -- 172.21.15.33:0/1861503173 >> 172.21.15.33:0/1861503173 conn(0x56167fec1460 msgr2=0x561680275170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f0955ffb640 0 client.27838 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:45:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 -- 172.21.15.33:0/1861503173 shutdown_connections 2024-08-28T19:45:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 1 -- 172.21.15.33:0/1861503173 wait complete. 2024-08-28T19:45:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.260+0000 7f097b227740 20 client.27838 trim_cache size 0 max 16384 2024-08-28T19:45:18.265 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:45:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 -- 172.21.15.33:0/2825016584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09580b4ca0 msgr2=0x7f09580b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09580b4ca0 0x7f09580b71b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f096801f000 tx=0x7f0968020000 comp rx=0 tx=0).stop 2024-08-28T19:45:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 -- 172.21.15.33:0/2825016584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970109260 msgr2=0x7f097019a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970109260 0x7f097019a7e0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f096402a930 tx=0x7f0964004270 comp rx=0 tx=0).stop 2024-08-28T19:45:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 -- 172.21.15.33:0/2825016584 shutdown_connections 2024-08-28T19:45:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09580b4ca0 0x7f09580b71b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0970109bb0 0x7f097019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0970109260 0x7f097019a7e0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 --2- 172.21.15.33:0/2825016584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970103920 0x7f097019a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 -- 172.21.15.33:0/2825016584 >> 172.21.15.33:0/2825016584 conn(0x7f09700ff3b0 msgr2=0x7f09701017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 -- 172.21.15.33:0/2825016584 shutdown_connections 2024-08-28T19:45:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:18.261+0000 7f0974cb2640 1 -- 172.21.15.33:0/2825016584 wait complete. 2024-08-28T19:45:18.273 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:19.080 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:45:19.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.628+0000 7f8bacd29640 1 -- 172.21.15.33:0/2609976232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba8108a90 msgr2=0x7f8ba810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:19.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.628+0000 7f8bacd29640 1 --2- 172.21.15.33:0/2609976232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba8108a90 0x7f8ba810f2c0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009ca0 tx=0x7f8ba002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:45:19.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.628+0000 7f8bacd29640 1 -- 172.21.15.33:0/2609976232 shutdown_connections 2024-08-28T19:45:19.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.628+0000 7f8bacd29640 1 --2- 172.21.15.33:0/2609976232 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba8108a90 0x7f8ba810f2c0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.628+0000 7f8bacd29640 1 --2- 172.21.15.33:0/2609976232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba8108140 0x7f8ba8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.628+0000 7f8bacd29640 1 --2- 172.21.15.33:0/2609976232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ba8102800 0x7f8ba8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.628+0000 7f8bacd29640 1 -- 172.21.15.33:0/2609976232 >> 172.21.15.33:0/2609976232 conn(0x7f8ba80794d0 msgr2=0x7f8ba80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.628+0000 7f8bacd29640 1 -- 172.21.15.33:0/2609976232 shutdown_connections 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.628+0000 7f8bacd29640 1 -- 172.21.15.33:0/2609976232 wait complete. 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.629+0000 7f8bacd29640 1 Processor -- start 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.629+0000 7f8bacd29640 1 -- start start 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.629+0000 7f8bacd29640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba8102800 0x7f8ba819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.629+0000 7f8bacd29640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ba8108140 0x7f8ba819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.629+0000 7f8bacd29640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba8108a90 0x7f8ba819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.629+0000 7f8bacd29640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba81138e0 con 0x7f8ba8102800 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.629+0000 7f8bacd29640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8113760 con 0x7f8ba8108140 2024-08-28T19:45:19.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.629+0000 7f8bacd29640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8113a60 con 0x7f8ba8108a90 2024-08-28T19:45:19.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.629+0000 7f8ba659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba8102800 0x7f8ba819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:19.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba8102800 0x7f8ba819a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53398/0 (socket says 172.21.15.33:53398) 2024-08-28T19:45:19.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba659c640 1 -- 172.21.15.33:0/2937025251 learned_addr learned my addr 172.21.15.33:0/2937025251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:19.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba6d9d640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba8108a90 0x7f8ba819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:19.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba5d9b640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ba8108140 0x7f8ba819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:19.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba659c640 1 -- 172.21.15.33:0/2937025251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba8108a90 msgr2=0x7f8ba819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:19.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba659c640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba8108a90 0x7f8ba819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:19.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba659c640 1 -- 172.21.15.33:0/2937025251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ba8108140 msgr2=0x7f8ba819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:19.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba659c640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ba8108140 0x7f8ba819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:19.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba659c640 1 -- 172.21.15.33:0/2937025251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba81a03c0 con 0x7f8ba8102800 2024-08-28T19:45:19.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba6d9d640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba8108a90 0x7f8ba819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:19.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba5d9b640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ba8108140 0x7f8ba819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:45:19.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8ba659c640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba8102800 0x7f8ba819a450 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f8b9800b4a0 tx=0x7f8b9800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:19.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8b977fe640 1 -- 172.21.15.33:0/2937025251 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98014070 con 0x7f8ba8102800 2024-08-28T19:45:19.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8bacd29640 1 -- 172.21.15.33:0/2937025251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba81a06b0 con 0x7f8ba8102800 2024-08-28T19:45:19.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8b977fe640 1 -- 172.21.15.33:0/2937025251 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b98010ac0 con 0x7f8ba8102800 2024-08-28T19:45:19.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8b977fe640 1 -- 172.21.15.33:0/2937025251 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98017c30 con 0x7f8ba8102800 2024-08-28T19:45:19.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.630+0000 7f8bacd29640 1 -- 172.21.15.33:0/2937025251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba81a6e10 con 0x7f8ba8102800 2024-08-28T19:45:19.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.631+0000 7f8bacd29640 1 -- 172.21.15.33:0/2937025251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba8102c90 con 0x7f8ba8102800 2024-08-28T19:45:19.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.633+0000 7f8b977fe640 1 -- 172.21.15.33:0/2937025251 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8b98017070 con 0x7f8ba8102800 2024-08-28T19:45:19.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.634+0000 7f8b977fe640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b900b4ca0 0x7f8b900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:19.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.634+0000 7f8ba5d9b640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b900b4ca0 0x7f8b900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:19.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.634+0000 7f8b977fe640 1 -- 172.21.15.33:0/2937025251 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f8b980e4f60 con 0x7f8ba8102800 2024-08-28T19:45:19.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.634+0000 7f8ba5d9b640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b900b4ca0 0x7f8b900b71b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c006fd0 tx=0x7f8b9c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:19.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.637+0000 7f8b977fe640 1 -- 172.21.15.33:0/2937025251 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8b980ab950 con 0x7f8ba8102800 2024-08-28T19:45:19.683 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:19.804 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:19 smithi033 ceph-mon[18549]: pgmap v741: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-28T19:45:19.804 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:19 smithi033 ceph-mon[18549]: osdmap e98: 12 total, 12 up, 12 in 2024-08-28T19:45:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.879+0000 7f8bacd29640 1 -- 172.21.15.33:0/2937025251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ba819b580 con 0x7f8ba8102800 2024-08-28T19:45:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.880+0000 7f8b977fe640 1 -- 172.21.15.33:0/2937025251 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f8b980ab250 con 0x7f8ba8102800 2024-08-28T19:45:19.882 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:45:19.882 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:45:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:45:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 -- 172.21.15.33:0/2937025251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b900b4ca0 msgr2=0x7f8b900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b900b4ca0 0x7f8b900b71b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c006fd0 tx=0x7f8b9c008040 comp rx=0 tx=0).stop 2024-08-28T19:45:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 -- 172.21.15.33:0/2937025251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba8102800 msgr2=0x7f8ba819a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba8102800 0x7f8ba819a450 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f8b9800b4a0 tx=0x7f8b9800b960 comp rx=0 tx=0).stop 2024-08-28T19:45:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 -- 172.21.15.33:0/2937025251 shutdown_connections 2024-08-28T19:45:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b900b4ca0 0x7f8b900b71b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8ba8108a90 0x7f8ba819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ba8108140 0x7f8ba819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 --2- 172.21.15.33:0/2937025251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba8102800 0x7f8ba819a450 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 -- 172.21.15.33:0/2937025251 >> 172.21.15.33:0/2937025251 conn(0x7f8ba80794d0 msgr2=0x7f8ba8105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 -- 172.21.15.33:0/2937025251 shutdown_connections 2024-08-28T19:45:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:19.882+0000 7f8bacd29640 1 -- 172.21.15.33:0/2937025251 wait complete. 2024-08-28T19:45:20.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:19 smithi059 ceph-mon[22052]: pgmap v741: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-28T19:45:20.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:19 smithi059 ceph-mon[22052]: osdmap e98: 12 total, 12 up, 12 in 2024-08-28T19:45:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:19 smithi122 ceph-mon[22174]: pgmap v741: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-28T19:45:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:19 smithi122 ceph-mon[22174]: osdmap e98: 12 total, 12 up, 12 in 2024-08-28T19:45:20.611 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id 624e1828 --release --await' 2024-08-28T19:45:20.611 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id 624e1828 --release --await 2024-08-28T19:45:20.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:20 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2937025251' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.832+0000 7fa13dcd8640 1 -- 172.21.15.33:0/598233878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa138109240 msgr2=0x7fa138109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.832+0000 7fa13dcd8640 1 --2- 172.21.15.33:0/598233878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa138109240 0x7fa138109650 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009900 tx=0x7fa12c02a3f0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.832+0000 7fa13dcd8640 1 -- 172.21.15.33:0/598233878 shutdown_connections 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.832+0000 7fa13dcd8640 1 --2- 172.21.15.33:0/598233878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa138109b90 0x7fa1381103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.832+0000 7fa13dcd8640 1 --2- 172.21.15.33:0/598233878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa138109240 0x7fa138109650 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.832+0000 7fa13dcd8640 1 --2- 172.21.15.33:0/598233878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa138103900 0x7fa138103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.832+0000 7fa13dcd8640 1 -- 172.21.15.33:0/598233878 >> 172.21.15.33:0/598233878 conn(0x7fa13807b5f0 msgr2=0x7fa13807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.832+0000 7fa13dcd8640 1 -- 172.21.15.33:0/598233878 shutdown_connections 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.832+0000 7fa13dcd8640 1 -- 172.21.15.33:0/598233878 wait complete. 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.833+0000 7fa13dcd8640 1 Processor -- start 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.833+0000 7fa13dcd8640 1 -- start start 2024-08-28T19:45:20.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.833+0000 7fa13dcd8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa138103900 0x7fa13819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.833+0000 7fa13dcd8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa138109240 0x7fa13819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.833+0000 7fa13dcd8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa138109b90 0x7fa13819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.833+0000 7fa13dcd8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa138113870 con 0x7fa138109b90 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.833+0000 7fa13dcd8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1381136f0 con 0x7fa138103900 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.833+0000 7fa13dcd8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa1381139f0 con 0x7fa138109240 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa137fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa138109b90 0x7fa13819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa137fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa138109b90 0x7fa13819fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53416/0 (socket says 172.21.15.33:53416) 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa137fff640 1 -- 172.21.15.33:0/668522423 learned_addr learned my addr 172.21.15.33:0/668522423 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa136ffd640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa138109240 0x7fa13819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa1377fe640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa138103900 0x7fa13819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa137fff640 1 -- 172.21.15.33:0/668522423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa138109240 msgr2=0x7fa13819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa137fff640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa138109240 0x7fa13819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa137fff640 1 -- 172.21.15.33:0/668522423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa138103900 msgr2=0x7fa13819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa137fff640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa138103900 0x7fa13819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa137fff640 1 -- 172.21.15.33:0/668522423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1381a01f0 con 0x7fa138109b90 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa137fff640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa138109b90 0x7fa13819fb80 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fa13000b970 tx=0x7fa13000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa134ff9640 1 -- 172.21.15.33:0/668522423 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa130019070 con 0x7fa138109b90 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa13dcd8640 1 -- 172.21.15.33:0/668522423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1381a04e0 con 0x7fa138109b90 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa134ff9640 1 -- 172.21.15.33:0/668522423 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa130014440 con 0x7fa138109b90 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa134ff9640 1 -- 172.21.15.33:0/668522423 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1300075d0 con 0x7fa138109b90 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.834+0000 7fa13dcd8640 1 -- 172.21.15.33:0/668522423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1381a6d00 con 0x7fa138109b90 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.837+0000 7fa14424d740 1 Processor -- start 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa134ff9640 1 -- 172.21.15.33:0/668522423 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa13001c070 con 0x7fa138109b90 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa14424d740 1 -- start start 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa14424d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 0x55704b8ec310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa14424d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b8ec850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa14424d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa14424d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55704b863680 con 0x55704b526390 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa14424d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55704b852c10 con 0x55704b51e1b0 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa14424d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55704b856bc0 con 0x55704b547070 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8ecd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53418/0 (socket says 172.21.15.33:53418) 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa136ffd640 1 -- 172.21.15.33:0/3406487233 learned_addr learned my addr 172.21.15.33:0/3406487233 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.838+0000 7fa136ffd640 1 --2- 172.21.15.33:0/3406487233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 0x55704b8ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa1377fe640 1 --2- 172.21.15.33:0/3406487233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b8ec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa136ffd640 1 -- 172.21.15.33:0/3406487233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 msgr2=0x55704b8ec310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa136ffd640 1 --2- 172.21.15.33:0/3406487233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 0x55704b8ec310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa136ffd640 1 -- 172.21.15.33:0/3406487233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 msgr2=0x55704b8ec850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:20.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa136ffd640 1 --2- 172.21.15.33:0/3406487233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b8ec850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa136ffd640 1 -- 172.21.15.33:0/3406487233 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55704b5b2650 con 0x55704b526390 2024-08-28T19:45:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa1377fe640 1 --2- 172.21.15.33:0/3406487233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b8ec850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa134ff9640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa1200b4cd0 0x7fa1200b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa134ff9640 1 -- 172.21.15.33:0/668522423 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7fa1300e4e50 con 0x7fa138109b90 2024-08-28T19:45:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa1377fe640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa1200b4cd0 0x7fa1200b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.839+0000 7fa136ffd640 1 --2- 172.21.15.33:0/3406487233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8ecd90 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fa12c000c00 tx=0x7fa12c009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4766cd4e3ec7927 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.840+0000 7fa11dffb640 1 -- 172.21.15.33:0/3406487233 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c035040 con 0x55704b526390 2024-08-28T19:45:20.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.840+0000 7fa11dffb640 1 -- 172.21.15.33:0/3406487233 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa12c005020 con 0x55704b526390 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.841+0000 7fa11dffb640 1 -- 172.21.15.33:0/3406487233 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0044e0 con 0x55704b526390 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.841+0000 7fa1377fe640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa1200b4cd0 0x7fa1200b71e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa1280058c0 tx=0x7fa128005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.841+0000 7fa14424d740 1 -- 172.21.15.33:0/3406487233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 msgr2=0x55704b8ecd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.841+0000 7fa14424d740 1 --2- 172.21.15.33:0/3406487233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8ecd90 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fa12c000c00 tx=0x7fa12c009680 comp rx=0 tx=0).stop 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.841+0000 7fa14424d740 1 -- 172.21.15.33:0/3406487233 shutdown_connections 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.841+0000 7fa14424d740 1 --2- 172.21.15.33:0/3406487233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8ecd90 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.841+0000 7fa14424d740 1 --2- 172.21.15.33:0/3406487233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b8ec850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.841+0000 7fa14424d740 1 --2- 172.21.15.33:0/3406487233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 0x55704b8ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.841+0000 7fa14424d740 1 -- 172.21.15.33:0/3406487233 >> 172.21.15.33:0/3406487233 conn(0x55704b53b460 msgr2=0x55704b8ea200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.842+0000 7fa14424d740 1 -- 172.21.15.33:0/3406487233 shutdown_connections 2024-08-28T19:45:20.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.842+0000 7fa14424d740 1 -- 172.21.15.33:0/3406487233 wait complete. 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.842+0000 7fa14424d740 1 -- start start 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.842+0000 7fa14424d740 1 Processor -- start 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa14424d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b8f7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa14424d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa14424d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 0x55704b903e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa14424d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55704b6b5700 con 0x55704b526390 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa14424d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55704b7d9750 con 0x55704b51e1b0 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa14424d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55704b8faae0 con 0x55704b547070 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa14424d740 10 client.0 _ll_register_callbacks cb 0x55704b808e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8f7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53432/0 (socket says 172.21.15.33:53432) 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa136ffd640 1 -- 172.21.15.33:0/4102021036 learned_addr learned my addr 172.21.15.33:0/4102021036 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa1377fe640 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b8f7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa137fff640 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 0x55704b903e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa136ffd640 1 -- 172.21.15.33:0/4102021036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 msgr2=0x55704b903e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa136ffd640 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 0x55704b903e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa136ffd640 1 -- 172.21.15.33:0/4102021036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 msgr2=0x55704b8f7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa136ffd640 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b8f7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa136ffd640 1 -- 172.21.15.33:0/4102021036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55704b812900 con 0x55704b526390 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa137fff640 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 0x55704b903e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa136ffd640 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8f7f70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fa12c02a910 tx=0x7fa12c02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2a8d60e8a73b50 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.843+0000 7fa116ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa116ffd640 1 -- 172.21.15.33:0/4102021036 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c04d070 con 0x55704b526390 2024-08-28T19:45:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa116ffd640 1 -- 172.21.15.33:0/4102021036 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7fa12c0053d0 con 0x55704b526390 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa14424d740 1 -- 172.21.15.33:0/4102021036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa12c005020 con 0x55704b526390 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa116ffd640 1 -- 172.21.15.33:0/4102021036 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa12c059050 con 0x55704b526390 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa14424d740 10 client.19071 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa14424d740 1 -- 172.21.15.33:0/4102021036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55704b90acb0 con 0x55704b526390 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa116ffd640 1 -- 172.21.15.33:0/4102021036 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa12c005020 con 0x55704b526390 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa116ffd640 1 -- 172.21.15.33:0/4102021036 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa12c03a040 con 0x55704b526390 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa14424d740 10 client.19071 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa14424d740 10 client.19071 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa14424d740 20 client.19071 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa14424d740 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55704b5059f0 0x55704b90e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa14424d740 4 client.19071 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.844+0000 7fa14424d740 1 -- 172.21.15.33:0/4102021036 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55704b8655d0 con 0x55704b5059f0 2024-08-28T19:45:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.845+0000 7fa1377fe640 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55704b5059f0 0x55704b90e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.845+0000 7fa1377fe640 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55704b5059f0 0x55704b90e010 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa423fdf3dd9a7f2 server_cookie=1e760946b4de646c in_seq=0 out_seq=0 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.845+0000 7fa116ffd640 10 client.19071 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa116ffd640 1 -- 172.21.15.33:0/4102021036 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55704b8655d0 con 0x55704b5059f0 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa116ffd640 10 client.19071 handle_command_reply: tid=0 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa14424d740 1 client.19071 shutdown 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa14424d740 1 -- 172.21.15.33:0/4102021036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 msgr2=0x55704b8f7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa14424d740 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8f7f70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fa12c02a910 tx=0x7fa12c02a3f0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa14424d740 1 -- 172.21.15.33:0/4102021036 shutdown_connections 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa14424d740 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b547070 0x55704b903e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa14424d740 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55704b5059f0 0x55704b90e010 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa14424d740 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b526390 0x55704b8f7f70 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa116ffd640 0 client.19071 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:45:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa14424d740 1 --2- 172.21.15.33:0/4102021036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b8f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa14424d740 1 -- 172.21.15.33:0/4102021036 >> 172.21.15.33:0/4102021036 conn(0x55704b53b460 msgr2=0x55704b8ef4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.846+0000 7fa14424d740 1 -- 172.21.15.33:0/4102021036 shutdown_connections 2024-08-28T19:45:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.847+0000 7fa14424d740 1 -- 172.21.15.33:0/4102021036 wait complete. 2024-08-28T19:45:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.847+0000 7fa14424d740 20 client.19071 trim_cache size 0 max 16384 2024-08-28T19:45:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa14424d740 1 Processor -- start 2024-08-28T19:45:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa14424d740 1 -- start start 2024-08-28T19:45:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa14424d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b5059f0 0x55704b8f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa14424d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b903d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa14424d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b526390 0x55704b8e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa14424d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa1381ae9e0 con 0x55704b5059f0 2024-08-28T19:45:20.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa14424d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1381b0520 con 0x55704b51e1b0 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa14424d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa1381af0b0 con 0x55704b526390 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa1377fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b5059f0 0x55704b8f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa1377fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b5059f0 0x55704b8f7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53444/0 (socket says 172.21.15.33:53444) 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.860+0000 7fa1377fe640 1 -- 172.21.15.33:0/1052954455 learned_addr learned my addr 172.21.15.33:0/1052954455 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa137fff640 1 --2- 172.21.15.33:0/1052954455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b526390 0x55704b8e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa136ffd640 1 --2- 172.21.15.33:0/1052954455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b903d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa1377fe640 1 -- 172.21.15.33:0/1052954455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b526390 msgr2=0x55704b8e9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa1377fe640 1 --2- 172.21.15.33:0/1052954455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b526390 0x55704b8e9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa1377fe640 1 -- 172.21.15.33:0/1052954455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 msgr2=0x55704b903d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa1377fe640 1 --2- 172.21.15.33:0/1052954455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b903d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa1377fe640 1 -- 172.21.15.33:0/1052954455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55704b8eab70 con 0x55704b5059f0 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa137fff640 1 --2- 172.21.15.33:0/1052954455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b526390 0x55704b8e9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:20.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa1377fe640 1 --2- 172.21.15.33:0/1052954455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b5059f0 0x55704b8f7ef0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fa128011740 tx=0x7fa128013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b7c331c8026d49 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa11d7fa640 1 -- 172.21.15.33:0/1052954455 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12802c070 con 0x55704b5059f0 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa11d7fa640 1 -- 172.21.15.33:0/1052954455 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1280042f0 con 0x55704b5059f0 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.861+0000 7fa11d7fa640 1 -- 172.21.15.33:0/1052954455 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12801e870 con 0x55704b5059f0 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.862+0000 7fa14424d740 1 -- 172.21.15.33:0/1052954455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b5059f0 msgr2=0x55704b8f7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.862+0000 7fa14424d740 1 --2- 172.21.15.33:0/1052954455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b5059f0 0x55704b8f7ef0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fa128011740 tx=0x7fa128013000 comp rx=0 tx=0).stop 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.862+0000 7fa14424d740 1 -- 172.21.15.33:0/1052954455 shutdown_connections 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.862+0000 7fa14424d740 1 --2- 172.21.15.33:0/1052954455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b526390 0x55704b8e9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.862+0000 7fa14424d740 1 --2- 172.21.15.33:0/1052954455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b51e1b0 0x55704b903d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.862+0000 7fa14424d740 1 --2- 172.21.15.33:0/1052954455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b5059f0 0x55704b8f7ef0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.862+0000 7fa14424d740 1 -- 172.21.15.33:0/1052954455 >> 172.21.15.33:0/1052954455 conn(0x55704b53b460 msgr2=0x55704b8f77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.862+0000 7fa14424d740 1 -- 172.21.15.33:0/1052954455 shutdown_connections 2024-08-28T19:45:20.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.862+0000 7fa14424d740 1 -- 172.21.15.33:0/1052954455 wait complete. 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.863+0000 7fa14424d740 1 -- start start 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.863+0000 7fa14424d740 1 Processor -- start 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.863+0000 7fa14424d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b5059f0 0x55704b90f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.863+0000 7fa14424d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b51e1b0 0x55704b90f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.863+0000 7fa14424d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b526390 0x55704b90fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa14424d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa1381afe50 con 0x55704b51e1b0 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b51e1b0 0x55704b90f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa14424d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1381af780 con 0x55704b526390 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa14424d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa1381ac9e0 con 0x55704b5059f0 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b51e1b0 0x55704b90f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53446/0 (socket says 172.21.15.33:53446) 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa136ffd640 1 -- 172.21.15.33:0/2245520106 learned_addr learned my addr 172.21.15.33:0/2245520106 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa14424d740 10 client.0 _ll_register_callbacks cb 0x7fa12c032e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:20.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa1377fe640 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b5059f0 0x55704b90f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa137fff640 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b526390 0x55704b90fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa136ffd640 1 -- 172.21.15.33:0/2245520106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b5059f0 msgr2=0x55704b90f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa136ffd640 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b5059f0 0x55704b90f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa136ffd640 1 -- 172.21.15.33:0/2245520106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b526390 msgr2=0x55704b90fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa136ffd640 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b526390 0x55704b90fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa136ffd640 1 -- 172.21.15.33:0/2245520106 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55704b9779c0 con 0x55704b51e1b0 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa137fff640 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b526390 0x55704b90fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa136ffd640 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b51e1b0 0x55704b90f7e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fa12c02a910 tx=0x7fa12c005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605173a785bbcff6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.864+0000 7fa116ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa116ffd640 1 -- 172.21.15.33:0/2245520106 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c04d040 con 0x55704b51e1b0 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa116ffd640 1 -- 172.21.15.33:0/2245520106 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7fa12c031a90 con 0x55704b51e1b0 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa14424d740 1 -- 172.21.15.33:0/2245520106 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1280042f0 con 0x55704b51e1b0 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa116ffd640 1 -- 172.21.15.33:0/2245520106 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa12c035070 con 0x55704b51e1b0 2024-08-28T19:45:20.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa14424d740 10 client.19077 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa14424d740 1 -- 172.21.15.33:0/2245520106 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55704b978c20 con 0x55704b51e1b0 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa116ffd640 1 -- 172.21.15.33:0/2245520106 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1280042f0 con 0x55704b51e1b0 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa116ffd640 1 -- 172.21.15.33:0/2245520106 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa12c0047a0 con 0x55704b51e1b0 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa14424d740 10 client.19077 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa14424d740 10 client.19077 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa14424d740 20 client.19077 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa14424d740 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55704b547070 0x55704b97b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa14424d740 4 client.19077 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.865+0000 7fa14424d740 1 -- 172.21.15.33:0/2245520106 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55704b861070 con 0x55704b547070 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.866+0000 7fa1377fe640 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55704b547070 0x55704b97b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:20.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.866+0000 7fa1377fe640 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55704b547070 0x55704b97b210 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac6836f12a3ff2b3 server_cookie=e96aa46d8afb51b7 in_seq=0 out_seq=0 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.866+0000 7fa116ffd640 10 client.19077 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.866+0000 7fa116ffd640 1 -- 172.21.15.33:0/2245520106 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55704b861070 con 0x55704b547070 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.866+0000 7fa116ffd640 10 client.19077 handle_command_reply: tid=0 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.866+0000 7fa14424d740 1 client.19077 shutdown 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 1 -- 172.21.15.33:0/2245520106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b51e1b0 msgr2=0x55704b90f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b51e1b0 0x55704b90f7e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fa12c02a910 tx=0x7fa12c005980 comp rx=0 tx=0).stop 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 1 -- 172.21.15.33:0/2245520106 shutdown_connections 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55704b526390 0x55704b90fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55704b547070 0x55704b97b210 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55704b51e1b0 0x55704b90f7e0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 1 --2- 172.21.15.33:0/2245520106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55704b5059f0 0x55704b90f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa116ffd640 0 client.19077 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:45:20.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 1 -- 172.21.15.33:0/2245520106 >> 172.21.15.33:0/2245520106 conn(0x55704b53b460 msgr2=0x55704b8ef3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:20.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 1 -- 172.21.15.33:0/2245520106 shutdown_connections 2024-08-28T19:45:20.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 1 -- 172.21.15.33:0/2245520106 wait complete. 2024-08-28T19:45:20.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.867+0000 7fa14424d740 20 client.19077 trim_cache size 0 max 16384 2024-08-28T19:45:20.876 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 -- 172.21.15.33:0/668522423 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa1200b4cd0 msgr2=0x7fa1200b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa1200b4cd0 0x7fa1200b71e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa1280058c0 tx=0x7fa128005850 comp rx=0 tx=0).stop 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 -- 172.21.15.33:0/668522423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa138109b90 msgr2=0x7fa13819fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa138109b90 0x7fa13819fb80 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fa13000b970 tx=0x7fa13000be30 comp rx=0 tx=0).stop 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 -- 172.21.15.33:0/668522423 shutdown_connections 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa138109b90 0x7fa13819fb80 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa1200b4cd0 0x7fa1200b71e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa138109240 0x7fa13819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 --2- 172.21.15.33:0/668522423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa138103900 0x7fa13819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 -- 172.21.15.33:0/668522423 >> 172.21.15.33:0/668522423 conn(0x7fa13807b5f0 msgr2=0x7fa138107390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 -- 172.21.15.33:0/668522423 shutdown_connections 2024-08-28T19:45:20.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:20.868+0000 7fa13dcd8640 1 -- 172.21.15.33:0/668522423 wait complete. 2024-08-28T19:45:21.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:20 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2937025251' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:45:21.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:20 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2937025251' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:45:21.583 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:45:21.594 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:21.872 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:21 smithi033 ceph-mon[18549]: pgmap v743: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-28T19:45:22.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:21 smithi059 ceph-mon[22052]: pgmap v743: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-28T19:45:22.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:21 smithi122 ceph-mon[22174]: pgmap v743: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-28T19:45:22.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.255+0000 7f6c886dd640 1 -- 172.21.15.33:0/157024819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c80108160 msgr2=0x7f6c80108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:22.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.255+0000 7f6c886dd640 1 --2- 172.21.15.33:0/157024819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c80108160 0x7f6c80108570 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009900 tx=0x7f6c7002a410 comp rx=0 tx=0).stop 2024-08-28T19:45:22.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.255+0000 7f6c886dd640 1 -- 172.21.15.33:0/157024819 shutdown_connections 2024-08-28T19:45:22.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.255+0000 7f6c886dd640 1 --2- 172.21.15.33:0/157024819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80108ab0 0x7f6c8010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.255+0000 7f6c886dd640 1 --2- 172.21.15.33:0/157024819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c80108160 0x7f6c80108570 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.255+0000 7f6c886dd640 1 --2- 172.21.15.33:0/157024819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c80102820 0x7f6c80102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.255+0000 7f6c886dd640 1 -- 172.21.15.33:0/157024819 >> 172.21.15.33:0/157024819 conn(0x7f6c800794e0 msgr2=0x7f6c800798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.255+0000 7f6c886dd640 1 -- 172.21.15.33:0/157024819 shutdown_connections 2024-08-28T19:45:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.256+0000 7f6c886dd640 1 -- 172.21.15.33:0/157024819 wait complete. 2024-08-28T19:45:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.256+0000 7f6c886dd640 1 Processor -- start 2024-08-28T19:45:22.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.256+0000 7f6c886dd640 1 -- start start 2024-08-28T19:45:22.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.256+0000 7f6c886dd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80102820 0x7f6c80198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.256+0000 7f6c886dd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c80108160 0x7f6c80199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.256+0000 7f6c886dd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c80108ab0 0x7f6c801998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.256+0000 7f6c886dd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80112700 con 0x7f6c80108160 2024-08-28T19:45:22.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.256+0000 7f6c886dd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80112580 con 0x7f6c80102820 2024-08-28T19:45:22.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.256+0000 7f6c886dd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80112880 con 0x7f6c80108ab0 2024-08-28T19:45:22.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c85c78640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c80108160 0x7f6c80199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c85c78640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c80108160 0x7f6c80199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53466/0 (socket says 172.21.15.33:53466) 2024-08-28T19:45:22.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c85c78640 1 -- 172.21.15.33:0/69293584 learned_addr learned my addr 172.21.15.33:0/69293584 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:22.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c86c7a640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c80108ab0 0x7f6c801998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c86479640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80102820 0x7f6c80198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c85c78640 1 -- 172.21.15.33:0/69293584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c80108ab0 msgr2=0x7f6c801998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c85c78640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c80108ab0 0x7f6c801998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c85c78640 1 -- 172.21.15.33:0/69293584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80102820 msgr2=0x7f6c80198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c85c78640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80102820 0x7f6c80198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c85c78640 1 -- 172.21.15.33:0/69293584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c801a84f0 con 0x7f6c80108160 2024-08-28T19:45:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c86c7a640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c80108ab0 0x7f6c801998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:22.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c85c78640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c80108160 0x7f6c80199380 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f6c70032fd0 tx=0x7f6c70004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c777fe640 1 -- 172.21.15.33:0/69293584 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7003f030 con 0x7f6c80108160 2024-08-28T19:45:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c777fe640 1 -- 172.21.15.33:0/69293584 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c70004490 con 0x7f6c80108160 2024-08-28T19:45:22.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c886dd640 1 -- 172.21.15.33:0/69293584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c801a8780 con 0x7f6c80108160 2024-08-28T19:45:22.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c777fe640 1 -- 172.21.15.33:0/69293584 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70035070 con 0x7f6c80108160 2024-08-28T19:45:22.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.257+0000 7f6c886dd640 1 -- 172.21.15.33:0/69293584 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c801a8c60 con 0x7f6c80108160 2024-08-28T19:45:22.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.260+0000 7f6c8ec52740 1 Processor -- start 2024-08-28T19:45:22.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.260+0000 7f6c8ec52740 1 -- start start 2024-08-28T19:45:22.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.260+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9492520 0x563fd9837c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.260+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 0x563fd98381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.260+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9471840 0x563fd9838700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.260+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563fd97aea70 con 0x563fd9492520 2024-08-28T19:45:22.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.260+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563fd979e000 con 0x563fd9471840 2024-08-28T19:45:22.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.260+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563fd97a1fb0 con 0x563fd9469660 2024-08-28T19:45:22.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c777fe640 1 -- 172.21.15.33:0/69293584 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f6c70042030 con 0x7f6c80108160 2024-08-28T19:45:22.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c86c7a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9492520 0x563fd9837c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c86c7a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9492520 0x563fd9837c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53482/0 (socket says 172.21.15.33:53482) 2024-08-28T19:45:22.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c86c7a640 1 -- 172.21.15.33:0/3427728980 learned_addr learned my addr 172.21.15.33:0/3427728980 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:22.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c86479640 1 --2- 172.21.15.33:0/3427728980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 0x563fd98381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c85c78640 1 --2- 172.21.15.33:0/3427728980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9471840 0x563fd9838700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c86c7a640 1 -- 172.21.15.33:0/3427728980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 msgr2=0x563fd98381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:22.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c86c7a640 1 --2- 172.21.15.33:0/3427728980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 0x563fd98381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c86c7a640 1 -- 172.21.15.33:0/3427728980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9471840 msgr2=0x563fd9838700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:22.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c86c7a640 1 --2- 172.21.15.33:0/3427728980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9471840 0x563fd9838700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c86c7a640 1 -- 172.21.15.33:0/3427728980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd94fdb00 con 0x563fd9492520 2024-08-28T19:45:22.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c86c7a640 1 --2- 172.21.15.33:0/3427728980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9492520 0x563fd9837c80 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800af40 tx=0x7f6c7800e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469009f31abb8838 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:22.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c74ff9640 1 -- 172.21.15.33:0/3427728980 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78003b70 con 0x563fd9492520 2024-08-28T19:45:22.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.261+0000 7f6c777fe640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6c6c0b4ca0 0x7f6c6c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.262+0000 7f6c74ff9640 1 -- 172.21.15.33:0/3427728980 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c78010af0 con 0x563fd9492520 2024-08-28T19:45:22.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.262+0000 7f6c74ff9640 1 -- 172.21.15.33:0/3427728980 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800fae0 con 0x563fd9492520 2024-08-28T19:45:22.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.262+0000 7f6c86479640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6c6c0b4ca0 0x7f6c6c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.262+0000 7f6c777fe640 1 -- 172.21.15.33:0/69293584 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f6c70105ef0 con 0x7f6c80108160 2024-08-28T19:45:22.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3427728980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9492520 msgr2=0x563fd9837c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:22.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c86479640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6c6c0b4ca0 0x7f6c6c0b71b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x563fd9836900 tx=0x7f6c7c00b500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:22.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/3427728980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9492520 0x563fd9837c80 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800af40 tx=0x7f6c7800e7e0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3427728980 shutdown_connections 2024-08-28T19:45:22.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/3427728980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9471840 0x563fd9838700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/3427728980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 0x563fd98381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/3427728980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9492520 0x563fd9837c80 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3427728980 >> 172.21.15.33:0/3427728980 conn(0x563fd9486910 msgr2=0x563fd9835b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:22.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3427728980 shutdown_connections 2024-08-28T19:45:22.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3427728980 wait complete. 2024-08-28T19:45:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 -- start start 2024-08-28T19:45:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 Processor -- start 2024-08-28T19:45:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9843830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9471840 0x563fd9843d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.263+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9492520 0x563fd984f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563fd9846460 con 0x563fd9469660 2024-08-28T19:45:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563fd975f520 con 0x563fd9471840 2024-08-28T19:45:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563fd98465e0 con 0x563fd9492520 2024-08-28T19:45:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c8ec52740 10 client.0 _ll_register_callbacks cb 0x563fd9797c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86479640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9843830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86479640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9843830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53492/0 (socket says 172.21.15.33:53492) 2024-08-28T19:45:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86479640 1 -- 172.21.15.33:0/612698632 learned_addr learned my addr 172.21.15.33:0/612698632 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c85c78640 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9471840 0x563fd9843d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86c7a640 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9492520 0x563fd984f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86479640 1 -- 172.21.15.33:0/612698632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9492520 msgr2=0x563fd984f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86479640 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9492520 0x563fd984f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86479640 1 -- 172.21.15.33:0/612698632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9471840 msgr2=0x563fd9843d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86479640 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9471840 0x563fd9843d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86479640 1 -- 172.21.15.33:0/612698632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fd9574960 con 0x563fd9469660 2024-08-28T19:45:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86c7a640 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9492520 0x563fd984f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:45:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c86479640 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9843830 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c010720 tx=0x7f6c7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a775f60a4502f5da server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c69ffb640 1 -- 172.21.15.33:0/612698632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00fa50 con 0x563fd9469660 2024-08-28T19:45:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c69ffb640 1 -- 172.21.15.33:0/612698632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f6c7c00fbf0 con 0x563fd9469660 2024-08-28T19:45:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c8ec52740 1 -- 172.21.15.33:0/612698632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563fd973d9a0 con 0x563fd9469660 2024-08-28T19:45:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.264+0000 7f6c69ffb640 1 -- 172.21.15.33:0/612698632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6c7c00fdf0 con 0x563fd9469660 2024-08-28T19:45:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.265+0000 7f6c8ec52740 10 client.19089 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.265+0000 7f6c8ec52740 1 -- 172.21.15.33:0/612698632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563fd9852660 con 0x563fd9469660 2024-08-28T19:45:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.265+0000 7f6c69ffb640 1 -- 172.21.15.33:0/612698632 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563fd973d9a0 con 0x563fd9469660 2024-08-28T19:45:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.266+0000 7f6c69ffb640 1 -- 172.21.15.33:0/612698632 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6c7c01f3f0 con 0x563fd9469660 2024-08-28T19:45:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.266+0000 7f6c8ec52740 10 client.19089 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.266+0000 7f6c8ec52740 10 client.19089 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:45:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.266+0000 7f6c8ec52740 20 client.19089 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.266+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563fd9450ea0 0x563fd9855be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.266+0000 7f6c8ec52740 4 client.19089 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:45:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.266+0000 7f6c8ec52740 1 -- 172.21.15.33:0/612698632 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fd97b09c0 con 0x563fd9450ea0 2024-08-28T19:45:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.266+0000 7f6c85c78640 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563fd9450ea0 0x563fd9855be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.266+0000 7f6c85c78640 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563fd9450ea0 0x563fd9855be0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f12f8ecb0df68a server_cookie=91dffca9c90c6851 in_seq=0 out_seq=0 2024-08-28T19:45:22.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.266+0000 7f6c69ffb640 10 client.19089 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:22.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c69ffb640 1 -- 172.21.15.33:0/612698632 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563fd97b09c0 con 0x563fd9450ea0 2024-08-28T19:45:22.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c69ffb640 10 client.19089 handle_command_reply: tid=0 2024-08-28T19:45:22.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c8ec52740 1 client.19089 shutdown 2024-08-28T19:45:22.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c8ec52740 1 -- 172.21.15.33:0/612698632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 msgr2=0x563fd9843830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:22.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9843830 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c010720 tx=0x7f6c7c0046c0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c8ec52740 1 -- 172.21.15.33:0/612698632 shutdown_connections 2024-08-28T19:45:22.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9492520 0x563fd984f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9471840 0x563fd9843d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563fd9450ea0 0x563fd9855be0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/612698632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9843830 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c8ec52740 1 -- 172.21.15.33:0/612698632 >> 172.21.15.33:0/612698632 conn(0x563fd9486910 msgr2=0x563fd983ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c69ffb640 0 client.19089 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.267+0000 7f6c8ec52740 1 -- 172.21.15.33:0/612698632 shutdown_connections 2024-08-28T19:45:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.268+0000 7f6c8ec52740 1 -- 172.21.15.33:0/612698632 wait complete. 2024-08-28T19:45:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.268+0000 7f6c8ec52740 20 client.19089 trim_cache size 0 max 16384 2024-08-28T19:45:22.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.288+0000 7f6c8ec52740 1 Processor -- start 2024-08-28T19:45:22.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.288+0000 7f6c8ec52740 1 -- start start 2024-08-28T19:45:22.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 0x563fd9841eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9471840 0x563fd984f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 0x563fd984fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801b2e70 con 0x563fd9471840 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801b49b0 con 0x563fd9492520 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801b3540 con 0x563fd9469660 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c85c78640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9471840 0x563fd984f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c86479640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 0x563fd9841eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c85c78640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9471840 0x563fd984f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53496/0 (socket says 172.21.15.33:53496) 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c85c78640 1 -- 172.21.15.33:0/1422367723 learned_addr learned my addr 172.21.15.33:0/1422367723 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c86c7a640 1 --2- 172.21.15.33:0/1422367723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 0x563fd984fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c86479640 1 -- 172.21.15.33:0/1422367723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 msgr2=0x563fd984fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c86479640 1 --2- 172.21.15.33:0/1422367723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 0x563fd984fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c86479640 1 -- 172.21.15.33:0/1422367723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9471840 msgr2=0x563fd984f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c86479640 1 --2- 172.21.15.33:0/1422367723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9471840 0x563fd984f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c86479640 1 -- 172.21.15.33:0/1422367723 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fd983eec0 con 0x563fd9469660 2024-08-28T19:45:22.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.289+0000 7f6c85c78640 1 --2- 172.21.15.33:0/1422367723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9471840 0x563fd984f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.290+0000 7f6c86479640 1 --2- 172.21.15.33:0/1422367723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 0x563fd9841eb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c01fa50 tx=0x7f6c7c00ba00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38aeec83e598a799 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.290+0000 7f6c6bfff640 1 -- 172.21.15.33:0/1422367723 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c039020 con 0x563fd9469660 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.290+0000 7f6c6bfff640 1 -- 172.21.15.33:0/1422367723 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c7c01fcd0 con 0x563fd9469660 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.290+0000 7f6c6bfff640 1 -- 172.21.15.33:0/1422367723 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c035860 con 0x563fd9469660 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 -- 172.21.15.33:0/1422367723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 msgr2=0x563fd9841eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/1422367723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 0x563fd9841eb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c01fa50 tx=0x7f6c7c00ba00 comp rx=0 tx=0).stop 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 -- 172.21.15.33:0/1422367723 shutdown_connections 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/1422367723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 0x563fd984fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/1422367723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9471840 0x563fd984f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/1422367723 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9469660 0x563fd9841eb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 -- 172.21.15.33:0/1422367723 >> 172.21.15.33:0/1422367723 conn(0x563fd9486910 msgr2=0x563fd9843810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 -- 172.21.15.33:0/1422367723 shutdown_connections 2024-08-28T19:45:22.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 -- 172.21.15.33:0/1422367723 wait complete. 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 -- start start 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.291+0000 7f6c8ec52740 1 Processor -- start 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9848120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9471840 0x563fd98486e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c8ec52740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 0x563fd98b9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801b42e0 con 0x563fd9469660 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801b3c10 con 0x563fd9492520 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c8ec52740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801b0e70 con 0x563fd9471840 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c86479640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9848120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c86479640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9848120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53510/0 (socket says 172.21.15.33:53510) 2024-08-28T19:45:22.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c86479640 1 -- 172.21.15.33:0/3997810228 learned_addr learned my addr 172.21.15.33:0/3997810228 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c8ec52740 10 client.0 _ll_register_callbacks cb 0x7f6c7c00b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c85c78640 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9471840 0x563fd98486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c86c7a640 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 0x563fd98b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c86479640 1 -- 172.21.15.33:0/3997810228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9471840 msgr2=0x563fd98486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c86479640 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9471840 0x563fd98486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c86479640 1 -- 172.21.15.33:0/3997810228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 msgr2=0x563fd98b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c86479640 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 0x563fd98b9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c86479640 1 -- 172.21.15.33:0/3997810228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fd98b9be0 con 0x563fd9469660 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.292+0000 7f6c86c7a640 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 0x563fd98b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c86479640 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9848120 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00bfe0 tx=0x7f6c7c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219956b9adb4a3e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c69ffb640 1 -- 172.21.15.33:0/3997810228 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c039030 con 0x563fd9469660 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c69ffb640 1 -- 172.21.15.33:0/3997810228 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f6c7c0355a0 con 0x563fd9469660 2024-08-28T19:45:22.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3997810228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c7c01fcd0 con 0x563fd9469660 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c69ffb640 1 -- 172.21.15.33:0/3997810228 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6c7c0357a0 con 0x563fd9469660 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c8ec52740 10 client.19095 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3997810228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563fd98c0f00 con 0x563fd9469660 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c69ffb640 1 -- 172.21.15.33:0/3997810228 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c7c035df0 con 0x563fd9469660 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c69ffb640 1 -- 172.21.15.33:0/3997810228 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6c7c03ec30 con 0x563fd9469660 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c8ec52740 10 client.19095 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c8ec52740 10 client.19095 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c8ec52740 20 client.19095 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563fd9426250 0x563fd98c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c8ec52740 4 client.19095 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "624e1828", "release": true, "await": true}] 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.293+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3997810228 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "624e1828", "release": true, "await": true}) -- 0x7f6c7c01fcd0 con 0x563fd9426250 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.294+0000 7f6c85c78640 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563fd9426250 0x563fd98c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:22.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.294+0000 7f6c69ffb640 10 client.19095 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.294+0000 7f6c85c78640 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563fd9426250 0x563fd98c35b0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a740642a4be8591 server_cookie=f24b7db1ab27f47a in_seq=0 out_seq=0 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c69ffb640 1 -- 172.21.15.33:0/3997810228 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f6c7c01fcd0 con 0x563fd9426250 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c69ffb640 10 client.19095 handle_command_reply: tid=0 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 client.19095 shutdown 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3997810228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 msgr2=0x563fd9848120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9848120 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00bfe0 tx=0x7f6c7c015000 comp rx=0 tx=0).stop 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3997810228 shutdown_connections 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fd9492520 0x563fd98b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563fd9471840 0x563fd98486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x563fd9426250 0x563fd98c35b0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 --2- 172.21.15.33:0/3997810228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fd9469660 0x563fd9848120 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c69ffb640 0 client.19095 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3997810228 >> 172.21.15.33:0/3997810228 conn(0x563fd9486910 msgr2=0x563fd9841e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3997810228 shutdown_connections 2024-08-28T19:45:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 1 -- 172.21.15.33:0/3997810228 wait complete. 2024-08-28T19:45:22.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.298+0000 7f6c8ec52740 20 client.19095 trim_cache size 0 max 16384 2024-08-28T19:45:22.309 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:45:22.309 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:45:22.309 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:45:22.309 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 40, 2024-08-28T19:45:22.309 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:45:22.309 INFO:teuthology.orchestra.run.smithi033.stdout: "624e1828": { 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 40, 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 140.5, 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:45:22.310 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:45:22.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:45:22.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:45:22.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:45:22.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:45:22.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:45:22.311 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:45:22.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 -- 172.21.15.33:0/69293584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6c6c0b4ca0 msgr2=0x7f6c6c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6c6c0b4ca0 0x7f6c6c0b71b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x563fd9836900 tx=0x7f6c7c00b500 comp rx=0 tx=0).stop 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 -- 172.21.15.33:0/69293584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c80108160 msgr2=0x7f6c80199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c80108160 0x7f6c80199380 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f6c70032fd0 tx=0x7f6c70004270 comp rx=0 tx=0).stop 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 -- 172.21.15.33:0/69293584 shutdown_connections 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f6c6c0b4ca0 0x7f6c6c0b71b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6c80108ab0 0x7f6c801998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c80108160 0x7f6c80199380 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 --2- 172.21.15.33:0/69293584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80102820 0x7f6c80198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 -- 172.21.15.33:0/69293584 >> 172.21.15.33:0/69293584 conn(0x7f6c800794e0 msgr2=0x7f6c80105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 -- 172.21.15.33:0/69293584 shutdown_connections 2024-08-28T19:45:22.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:22.299+0000 7f6c886dd640 1 -- 172.21.15.33:0/69293584 wait complete. 2024-08-28T19:45:22.313 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:23.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.023+0000 7f7138cbf640 1 -- 172.21.15.33:0/2468235827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7134109240 msgr2=0x7f7134109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:23.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.023+0000 7f7138cbf640 1 --2- 172.21.15.33:0/2468235827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7134109240 0x7f7134109650 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f7128009900 tx=0x7f712802a410 comp rx=0 tx=0).stop 2024-08-28T19:45:23.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.023+0000 7f7138cbf640 1 -- 172.21.15.33:0/2468235827 shutdown_connections 2024-08-28T19:45:23.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.023+0000 7f7138cbf640 1 --2- 172.21.15.33:0/2468235827 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7134109b90 0x7f71341103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.023+0000 7f7138cbf640 1 --2- 172.21.15.33:0/2468235827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7134109240 0x7f7134109650 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.023+0000 7f7138cbf640 1 --2- 172.21.15.33:0/2468235827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7134103900 0x7f7134103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.023+0000 7f7138cbf640 1 -- 172.21.15.33:0/2468235827 >> 172.21.15.33:0/2468235827 conn(0x7f713407b5f0 msgr2=0x7f713407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.023+0000 7f7138cbf640 1 -- 172.21.15.33:0/2468235827 shutdown_connections 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.023+0000 7f7138cbf640 1 -- 172.21.15.33:0/2468235827 wait complete. 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7138cbf640 1 Processor -- start 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7138cbf640 1 -- start start 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7138cbf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7134103900 0x7f713419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7138cbf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7134109240 0x7f713419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7138cbf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7134109b90 0x7f713419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7138cbf640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7134113850 con 0x7f7134109b90 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7138cbf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71341136d0 con 0x7f7134103900 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7138cbf640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f71341139d0 con 0x7f7134109240 2024-08-28T19:45:23.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7134109b90 0x7f713419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7134109b90 0x7f713419fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53532/0 (socket says 172.21.15.33:53532) 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7132d9d640 1 -- 172.21.15.33:0/1675096006 learned_addr learned my addr 172.21.15.33:0/1675096006 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f713259c640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7134103900 0x7f713419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7131d9b640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7134109240 0x7f713419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7132d9d640 1 -- 172.21.15.33:0/1675096006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7134109240 msgr2=0x7f713419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7132d9d640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7134109240 0x7f713419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7132d9d640 1 -- 172.21.15.33:0/1675096006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7134103900 msgr2=0x7f713419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7132d9d640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7134103900 0x7f713419a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7132d9d640 1 -- 172.21.15.33:0/1675096006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71341a00d0 con 0x7f7134109b90 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.024+0000 7f7131d9b640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7134109240 0x7f713419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.025+0000 7f7132d9d640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7134109b90 0x7f713419fa60 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f712c00eaa0 tx=0x7f712c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:23.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.025+0000 7f71237fe640 1 -- 172.21.15.33:0/1675096006 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c004d20 con 0x7f7134109b90 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.025+0000 7f71237fe640 1 -- 172.21.15.33:0/1675096006 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f712c005020 con 0x7f7134109b90 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.025+0000 7f71237fe640 1 -- 172.21.15.33:0/1675096006 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c0116b0 con 0x7f7134109b90 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.025+0000 7f7138cbf640 1 -- 172.21.15.33:0/1675096006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71341a03c0 con 0x7f7134109b90 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.025+0000 7f7138cbf640 1 -- 172.21.15.33:0/1675096006 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71341a6be0 con 0x7f7134109b90 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.027+0000 7f713f234740 1 Processor -- start 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.027+0000 7f71237fe640 1 -- 172.21.15.33:0/1675096006 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f712c0051d0 con 0x7f7134109b90 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f713f234740 1 -- start start 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f713f234740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926ee070 0x55af92a93310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f713f234740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92a93850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f713f234740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92a93d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f713f234740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55af92a0a680 con 0x55af926c51b0 2024-08-28T19:45:23.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f713f234740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55af929f9c10 con 0x55af926ee070 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f713f234740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55af929fdbc0 con 0x55af926cd390 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f713259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92a93850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f713259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92a93850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53548/0 (socket says 172.21.15.33:53548) 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f713259c640 1 -- 172.21.15.33:0/798363487 learned_addr learned my addr 172.21.15.33:0/798363487 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f7131d9b640 1 --2- 172.21.15.33:0/798363487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926ee070 0x55af92a93310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f71237fe640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f711c0b4cd0 0x7f711c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.028+0000 7f7131d9b640 1 --2- 172.21.15.33:0/798363487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92a93d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f713259c640 1 -- 172.21.15.33:0/798363487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 msgr2=0x55af92a93d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f713259c640 1 --2- 172.21.15.33:0/798363487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92a93d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f713259c640 1 -- 172.21.15.33:0/798363487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926ee070 msgr2=0x55af92a93310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f713259c640 1 --2- 172.21.15.33:0/798363487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926ee070 0x55af92a93310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f7132d9d640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f711c0b4cd0 0x7f711c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f713259c640 1 -- 172.21.15.33:0/798363487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af92759650 con 0x55af926c51b0 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f7131d9b640 1 --2- 172.21.15.33:0/798363487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926ee070 0x55af92a93310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f71237fe640 1 -- 172.21.15.33:0/1675096006 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f712c0e5ae0 con 0x7f7134109b90 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f713259c640 1 --2- 172.21.15.33:0/798363487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92a93850 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f712400ad00 tx=0x7f712400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec9400fe1f515db server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f7120ff9640 1 -- 172.21.15.33:0/798363487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712401d070 con 0x55af926c51b0 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f7120ff9640 1 -- 172.21.15.33:0/798363487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7124018af0 con 0x55af926c51b0 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f7120ff9640 1 -- 172.21.15.33:0/798363487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124010a70 con 0x55af926c51b0 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.029+0000 7f7132d9d640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f711c0b4cd0 0x7f711c0b71e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f712c009270 tx=0x7f712c078030 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.030+0000 7f713f234740 1 -- 172.21.15.33:0/798363487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 msgr2=0x55af92a93850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.030+0000 7f713f234740 1 --2- 172.21.15.33:0/798363487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92a93850 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f712400ad00 tx=0x7f712400f790 comp rx=0 tx=0).stop 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.030+0000 7f713f234740 1 -- 172.21.15.33:0/798363487 shutdown_connections 2024-08-28T19:45:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.030+0000 7f713f234740 1 --2- 172.21.15.33:0/798363487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92a93d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.030+0000 7f713f234740 1 --2- 172.21.15.33:0/798363487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92a93850 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.030+0000 7f713f234740 1 --2- 172.21.15.33:0/798363487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926ee070 0x55af92a93310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.030+0000 7f713f234740 1 -- 172.21.15.33:0/798363487 >> 172.21.15.33:0/798363487 conn(0x55af926e2460 msgr2=0x55af92a91200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.030+0000 7f713f234740 1 -- 172.21.15.33:0/798363487 shutdown_connections 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.030+0000 7f713f234740 1 -- 172.21.15.33:0/798363487 wait complete. 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f713f234740 1 -- start start 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f713f234740 1 Processor -- start 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f713f234740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926c51b0 0x55af92aa2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f713f234740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f713f234740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aaf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f713f234740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55af9285c700 con 0x55af926ee070 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f713f234740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55af92980750 con 0x55af926c51b0 2024-08-28T19:45:23.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f713f234740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55af92aa5e50 con 0x55af926cd390 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f713f234740 10 client.0 _ll_register_callbacks cb 0x55af929afe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aaf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aaf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53554/0 (socket says 172.21.15.33:53554) 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f7131d9b640 1 -- 172.21.15.33:0/622240455 learned_addr learned my addr 172.21.15.33:0/622240455 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f713259c640 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.031+0000 7f7131d9b640 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926c51b0 0x55af92aa2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7131d9b640 1 -- 172.21.15.33:0/622240455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 msgr2=0x55af92aa33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7131d9b640 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7131d9b640 1 -- 172.21.15.33:0/622240455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926c51b0 msgr2=0x55af92aa2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7131d9b640 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926c51b0 0x55af92aa2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7131d9b640 1 -- 172.21.15.33:0/622240455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af929b9900 con 0x55af926ee070 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7131d9b640 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aaf180 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f7128005e00 tx=0x7f712802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a70aeb8ae3738f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:23.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7119ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7119ffb640 1 -- 172.21.15.33:0/622240455 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128045070 con 0x55af926ee070 2024-08-28T19:45:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7119ffb640 1 -- 172.21.15.33:0/622240455 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f712803fa50 con 0x55af926ee070 2024-08-28T19:45:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f713f234740 1 -- 172.21.15.33:0/622240455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7124018af0 con 0x55af926ee070 2024-08-28T19:45:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7119ffb640 1 -- 172.21.15.33:0/622240455 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7128053050 con 0x55af926ee070 2024-08-28T19:45:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f713f234740 10 client.19107 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f713f234740 1 -- 172.21.15.33:0/622240455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af92ab1c40 con 0x55af926ee070 2024-08-28T19:45:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.032+0000 7f7119ffb640 1 -- 172.21.15.33:0/622240455 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7124018af0 con 0x55af926ee070 2024-08-28T19:45:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.033+0000 7f7119ffb640 1 -- 172.21.15.33:0/622240455 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f712803a070 con 0x55af926ee070 2024-08-28T19:45:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.033+0000 7f713f234740 10 client.19107 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:23.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.033+0000 7f713f234740 10 client.19107 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:45:23.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.033+0000 7f713f234740 20 client.19107 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:23.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.033+0000 7f713f234740 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55af926ac9f0 0x55af92ab5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.033+0000 7f713f234740 4 client.19107 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:45:23.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.033+0000 7f713f234740 1 -- 172.21.15.33:0/622240455 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af92a0c5d0 con 0x55af926ac9f0 2024-08-28T19:45:23.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.033+0000 7f713259c640 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55af926ac9f0 0x55af92ab5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.034+0000 7f7119ffb640 10 client.19107 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:45:23.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.034+0000 7f713259c640 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55af926ac9f0 0x55af92ab5110 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d96f25daba8371e server_cookie=5d01ec215e64cc2f in_seq=0 out_seq=0 2024-08-28T19:45:23.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.034+0000 7f7119ffb640 1 -- 172.21.15.33:0/622240455 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af92a0c5d0 con 0x55af926ac9f0 2024-08-28T19:45:23.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.034+0000 7f7119ffb640 10 client.19107 handle_command_reply: tid=0 2024-08-28T19:45:23.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.034+0000 7f713f234740 1 client.19107 shutdown 2024-08-28T19:45:23.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 1 -- 172.21.15.33:0/622240455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 msgr2=0x55af92aaf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aaf180 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f7128005e00 tx=0x7f712802a410 comp rx=0 tx=0).stop 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 1 -- 172.21.15.33:0/622240455 shutdown_connections 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55af926ac9f0 0x55af92ab5110 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aaf180 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f7119ffb640 0 client.19107 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 1 --2- 172.21.15.33:0/622240455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926c51b0 0x55af92aa2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 1 -- 172.21.15.33:0/622240455 >> 172.21.15.33:0/622240455 conn(0x55af926e2460 msgr2=0x55af92a94d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 1 -- 172.21.15.33:0/622240455 shutdown_connections 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 1 -- 172.21.15.33:0/622240455 wait complete. 2024-08-28T19:45:23.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.035+0000 7f713f234740 20 client.19107 trim_cache size 0 max 16384 2024-08-28T19:45:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f713f234740 1 Processor -- start 2024-08-28T19:45:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f713f234740 1 -- start start 2024-08-28T19:45:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f713f234740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926c51b0 0x55af92aa1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f713f234740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f713f234740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aa00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f713f234740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f71341aeae0 con 0x55af926ee070 2024-08-28T19:45:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f713f234740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71341b0620 con 0x55af926c51b0 2024-08-28T19:45:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f713f234740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f71341af1b0 con 0x55af926cd390 2024-08-28T19:45:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aa00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aa00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53566/0 (socket says 172.21.15.33:53566) 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.048+0000 7f7131d9b640 1 -- 172.21.15.33:0/416229188 learned_addr learned my addr 172.21.15.33:0/416229188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f713259c640 1 --2- 172.21.15.33:0/416229188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f7131d9b640 1 --2- 172.21.15.33:0/416229188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926c51b0 0x55af92aa1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f7131d9b640 1 -- 172.21.15.33:0/416229188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 msgr2=0x55af92aa1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f7131d9b640 1 --2- 172.21.15.33:0/416229188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f7131d9b640 1 -- 172.21.15.33:0/416229188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926c51b0 msgr2=0x55af92aa1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f7131d9b640 1 --2- 172.21.15.33:0/416229188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926c51b0 0x55af92aa1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f7131d9b640 1 -- 172.21.15.33:0/416229188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af92aa37e0 con 0x55af926ee070 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f7131d9b640 1 --2- 172.21.15.33:0/416229188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aa00a0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x55af92a8c210 tx=0x7f7128005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88132d17a5a0666a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f711bfff640 1 -- 172.21.15.33:0/416229188 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128045070 con 0x55af926ee070 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f711bfff640 1 -- 172.21.15.33:0/416229188 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7128031930 con 0x55af926ee070 2024-08-28T19:45:23.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.049+0000 7f711bfff640 1 -- 172.21.15.33:0/416229188 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128035040 con 0x55af926ee070 2024-08-28T19:45:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.050+0000 7f713f234740 1 -- 172.21.15.33:0/416229188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 msgr2=0x55af92aa00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.050+0000 7f713f234740 1 --2- 172.21.15.33:0/416229188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aa00a0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x55af92a8c210 tx=0x7f7128005fd0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.050+0000 7f713f234740 1 -- 172.21.15.33:0/416229188 shutdown_connections 2024-08-28T19:45:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.050+0000 7f713f234740 1 --2- 172.21.15.33:0/416229188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926ee070 0x55af92aa00a0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.050+0000 7f713f234740 1 --2- 172.21.15.33:0/416229188 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.050+0000 7f713f234740 1 --2- 172.21.15.33:0/416229188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af926c51b0 0x55af92aa1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.050+0000 7f713f234740 1 -- 172.21.15.33:0/416229188 >> 172.21.15.33:0/416229188 conn(0x55af926e2460 msgr2=0x55af92a9dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.050+0000 7f713f234740 1 -- 172.21.15.33:0/416229188 shutdown_connections 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.050+0000 7f713f234740 1 -- 172.21.15.33:0/416229188 wait complete. 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f713f234740 1 -- start start 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f713f234740 1 Processor -- start 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f713f234740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92aa7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f713f234740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f713f234740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af92681da0 0x55af92b1eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f713f234740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f71341aff50 con 0x55af926c51b0 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f713f234740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71341af880 con 0x55af92681da0 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f713f234740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f71341acae0 con 0x55af926cd390 2024-08-28T19:45:23.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f713f234740 10 client.0 _ll_register_callbacks cb 0x7f7128009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92aa7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92aa7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53568/0 (socket says 172.21.15.33:53568) 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f7131d9b640 1 -- 172.21.15.33:0/417699347 learned_addr learned my addr 172.21.15.33:0/417699347 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f713259c640 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f7131d9b640 1 -- 172.21.15.33:0/417699347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 msgr2=0x55af92aa7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f7131d9b640 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f7131d9b640 1 -- 172.21.15.33:0/417699347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af92681da0 msgr2=0x55af92b1eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f7131d9b640 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af92681da0 0x55af92b1eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.051+0000 7f7131d9b640 1 -- 172.21.15.33:0/417699347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af92b1eff0 con 0x55af926c51b0 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f7131d9b640 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92aa7780 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f7128001eb0 tx=0x7f7128009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d1b66d6afad543 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f7119ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f7119ffb640 1 -- 172.21.15.33:0/417699347 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128035070 con 0x55af926c51b0 2024-08-28T19:45:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f7119ffb640 1 -- 172.21.15.33:0/417699347 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f7128004040 con 0x55af926c51b0 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f713f234740 1 -- 172.21.15.33:0/417699347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7128031930 con 0x55af926c51b0 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f7119ffb640 1 -- 172.21.15.33:0/417699347 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f712806a050 con 0x55af926c51b0 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f713f234740 10 client.19113 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f713f234740 1 -- 172.21.15.33:0/417699347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af92b20200 con 0x55af926c51b0 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f7119ffb640 1 -- 172.21.15.33:0/417699347 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7128031930 con 0x55af926c51b0 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f7119ffb640 1 -- 172.21.15.33:0/417699347 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f712803a040 con 0x55af926c51b0 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f713f234740 10 client.19113 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f713f234740 10 client.19113 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f713f234740 20 client.19113 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f713f234740 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55af92b208c0 0x55af92b22ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f713f234740 4 client.19113 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:45:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.052+0000 7f713f234740 1 -- 172.21.15.33:0/417699347 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55af92a08070 con 0x55af92b208c0 2024-08-28T19:45:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.053+0000 7f713259c640 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55af92b208c0 0x55af92b22ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.053+0000 7f713259c640 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55af92b208c0 0x55af92b22ce0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f0809c175512781 server_cookie=c4f06b83f486faa8 in_seq=0 out_seq=0 2024-08-28T19:45:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.053+0000 7f7119ffb640 10 client.19113 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:45:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.053+0000 7f7119ffb640 1 -- 172.21.15.33:0/417699347 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55af92a08070 con 0x55af92b208c0 2024-08-28T19:45:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.053+0000 7f7119ffb640 10 client.19113 handle_command_reply: tid=0 2024-08-28T19:45:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.053+0000 7f713f234740 1 client.19113 shutdown 2024-08-28T19:45:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.053+0000 7f713f234740 1 -- 172.21.15.33:0/417699347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 msgr2=0x55af92aa7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.053+0000 7f713f234740 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92aa7780 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f7128001eb0 tx=0x7f7128009680 comp rx=0 tx=0).stop 2024-08-28T19:45:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f713f234740 1 -- 172.21.15.33:0/417699347 shutdown_connections 2024-08-28T19:45:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f713f234740 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55af92b208c0 0x55af92b22ce0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f713f234740 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af92681da0 0x55af92b1eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f713f234740 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55af926cd390 0x55af92aa7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f713f234740 1 --2- 172.21.15.33:0/417699347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55af926c51b0 0x55af92aa7780 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f713f234740 1 -- 172.21.15.33:0/417699347 >> 172.21.15.33:0/417699347 conn(0x55af926e2460 msgr2=0x55af92aa1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7119ffb640 0 client.19113 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:45:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f713f234740 1 -- 172.21.15.33:0/417699347 shutdown_connections 2024-08-28T19:45:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f713f234740 1 -- 172.21.15.33:0/417699347 wait complete. 2024-08-28T19:45:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f713f234740 20 client.19113 trim_cache size 0 max 16384 2024-08-28T19:45:23.062 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:45:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 -- 172.21.15.33:0/1675096006 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f711c0b4cd0 msgr2=0x7f711c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f711c0b4cd0 0x7f711c0b71e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f712c009270 tx=0x7f712c078030 comp rx=0 tx=0).stop 2024-08-28T19:45:23.062 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 -- 172.21.15.33:0/1675096006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7134109b90 msgr2=0x7f713419fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7134109b90 0x7f713419fa60 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f712c00eaa0 tx=0x7f712c00eea0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 -- 172.21.15.33:0/1675096006 shutdown_connections 2024-08-28T19:45:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7134109b90 0x7f713419fa60 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f711c0b4cd0 0x7f711c0b71e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7134109240 0x7f713419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 --2- 172.21.15.33:0/1675096006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7134103900 0x7f713419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 -- 172.21.15.33:0/1675096006 >> 172.21.15.33:0/1675096006 conn(0x7f713407b5f0 msgr2=0x7f7134107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 -- 172.21.15.33:0/1675096006 shutdown_connections 2024-08-28T19:45:23.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:23.054+0000 7f7138cbf640 1 -- 172.21.15.33:0/1675096006 wait complete. 2024-08-28T19:45:23.797 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:23 smithi033 ceph-mon[18549]: pgmap v744: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-28T19:45:23.824 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:45:24.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:23 smithi059 ceph-mon[22052]: pgmap v744: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-28T19:45:24.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:23 smithi122 ceph-mon[22174]: pgmap v744: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-08-28T19:45:24.338 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '624e1828', total seconds elapsed: 27.2 2024-08-28T19:45:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.955+0000 7fb1a50b1640 1 -- 172.21.15.33:0/891884689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a0108aa0 msgr2=0x7fb1a010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.955+0000 7fb1a50b1640 1 --2- 172.21.15.33:0/891884689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a0108aa0 0x7fb1a010f2d0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fb198009ca0 tx=0x7fb19802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.955+0000 7fb1a50b1640 1 -- 172.21.15.33:0/891884689 shutdown_connections 2024-08-28T19:45:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.955+0000 7fb1a50b1640 1 --2- 172.21.15.33:0/891884689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a0108aa0 0x7fb1a010f2d0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.955+0000 7fb1a50b1640 1 --2- 172.21.15.33:0/891884689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a0108150 0x7fb1a0108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.955+0000 7fb1a50b1640 1 --2- 172.21.15.33:0/891884689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a0102810 0x7fb1a0102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.955+0000 7fb1a50b1640 1 -- 172.21.15.33:0/891884689 >> 172.21.15.33:0/891884689 conn(0x7fb1a00794b0 msgr2=0x7fb1a00798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.955+0000 7fb1a50b1640 1 -- 172.21.15.33:0/891884689 shutdown_connections 2024-08-28T19:45:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.955+0000 7fb1a50b1640 1 -- 172.21.15.33:0/891884689 wait complete. 2024-08-28T19:45:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.956+0000 7fb1a50b1640 1 Processor -- start 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.956+0000 7fb1a50b1640 1 -- start start 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb1a50b1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a0102810 0x7fb1a019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb1a50b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a0108150 0x7fb1a019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb1a50b1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a0108aa0 0x7fb1a019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb1a50b1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0113880 con 0x7fb1a0108150 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb1a50b1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0113700 con 0x7fb1a0108aa0 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb1a50b1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0113a00 con 0x7fb1a0102810 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a0108150 0x7fb1a019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a0108150 0x7fb1a019a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53590/0 (socket says 172.21.15.33:53590) 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19e59c640 1 -- 172.21.15.33:0/1129245787 learned_addr learned my addr 172.21.15.33:0/1129245787 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a0102810 0x7fb1a019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19f59e640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a0108aa0 0x7fb1a019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19e59c640 1 -- 172.21.15.33:0/1129245787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a0102810 msgr2=0x7fb1a019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19e59c640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a0102810 0x7fb1a019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19e59c640 1 -- 172.21.15.33:0/1129245787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a0108aa0 msgr2=0x7fb1a019fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19e59c640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a0108aa0 0x7fb1a019fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19e59c640 1 -- 172.21.15.33:0/1129245787 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a01a0260 con 0x7fb1a0108150 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.957+0000 7fb19e59c640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a0108150 0x7fb1a019a890 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fb19400d750 tx=0x7fb19400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.958+0000 7fb187fff640 1 -- 172.21.15.33:0/1129245787 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194017070 con 0x7fb1a0108150 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.958+0000 7fb1a50b1640 1 -- 172.21.15.33:0/1129245787 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a01a0550 con 0x7fb1a0108150 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.958+0000 7fb187fff640 1 -- 172.21.15.33:0/1129245787 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1940054d0 con 0x7fb1a0108150 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.958+0000 7fb187fff640 1 -- 172.21.15.33:0/1129245787 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194004c30 con 0x7fb1a0108150 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.958+0000 7fb1a50b1640 1 -- 172.21.15.33:0/1129245787 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a01a6cb0 con 0x7fb1a0108150 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.960+0000 7fb1ab626740 1 Processor -- start 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb1ab626740 1 -- start start 2024-08-28T19:45:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb187fff640 1 -- 172.21.15.33:0/1129245787 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb194004dd0 con 0x7fb1a0108150 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c4e070 0x560861ff3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c251b0 0x560861ff3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c2d390 0x560861ff3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb1ab626740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560861f6a680 con 0x560861c2d390 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb1ab626740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560861f59c10 con 0x560861c4e070 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb1ab626740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560861f5dbc0 con 0x560861c251b0 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb19e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c2d390 0x560861ff3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb19e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c2d390 0x560861ff3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53600/0 (socket says 172.21.15.33:53600) 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb19e59c640 1 -- 172.21.15.33:0/3432277497 learned_addr learned my addr 172.21.15.33:0/3432277497 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb19f59e640 1 --2- 172.21.15.33:0/3432277497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c4e070 0x560861ff3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/3432277497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c251b0 0x560861ff3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb19e59c640 1 -- 172.21.15.33:0/3432277497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c251b0 msgr2=0x560861ff3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb19e59c640 1 --2- 172.21.15.33:0/3432277497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c251b0 0x560861ff3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb19e59c640 1 -- 172.21.15.33:0/3432277497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c4e070 msgr2=0x560861ff3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb19e59c640 1 --2- 172.21.15.33:0/3432277497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c4e070 0x560861ff3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.961+0000 7fb19e59c640 1 -- 172.21.15.33:0/3432277497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560861cb9650 con 0x560861c2d390 2024-08-28T19:45:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.962+0000 7fb187fff640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb1880b4ca0 0x7fb1880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.962+0000 7fb19e59c640 1 --2- 172.21.15.33:0/3432277497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c2d390 0x560861ff3d90 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fb1940e25b0 tx=0x7fb1940ed990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c63cad0c5a2f8c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.962+0000 7fb19f59e640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb1880b4ca0 0x7fb1880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.962+0000 7fb187fff640 1 -- 172.21.15.33:0/1129245787 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7fb1940e5290 con 0x7fb1a0108150 2024-08-28T19:45:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.962+0000 7fb1857fa640 1 -- 172.21.15.33:0/3432277497 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1940a74a0 con 0x560861c2d390 2024-08-28T19:45:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.962+0000 7fb1857fa640 1 -- 172.21.15.33:0/3432277497 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1940ab0f0 con 0x560861c2d390 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.962+0000 7fb1857fa640 1 -- 172.21.15.33:0/3432277497 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1940aad50 con 0x560861c2d390 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 -- 172.21.15.33:0/3432277497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c2d390 msgr2=0x560861ff3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb19f59e640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb1880b4ca0 0x7fb1880b71b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb198005e30 tx=0x7fb198005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3432277497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c2d390 0x560861ff3d90 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fb1940e25b0 tx=0x7fb1940ed990 comp rx=0 tx=0).stop 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 -- 172.21.15.33:0/3432277497 shutdown_connections 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3432277497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c2d390 0x560861ff3d90 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3432277497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c251b0 0x560861ff3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3432277497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c4e070 0x560861ff3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 -- 172.21.15.33:0/3432277497 >> 172.21.15.33:0/3432277497 conn(0x560861c42460 msgr2=0x560861ff1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 -- 172.21.15.33:0/3432277497 shutdown_connections 2024-08-28T19:45:24.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 -- 172.21.15.33:0/3432277497 wait complete. 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 -- start start 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.963+0000 7fb1ab626740 1 Processor -- start 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c251b0 0x560861ffe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x560861ffeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c4e070 0x56086200ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb1ab626740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560861dbc700 con 0x560861c4e070 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb1ab626740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560861ee0750 con 0x560861c2d390 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb1ab626740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560862001af0 con 0x560861c251b0 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb1ab626740 10 client.0 _ll_register_callbacks cb 0x560861f0fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19f59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c4e070 0x56086200ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19f59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c4e070 0x56086200ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53602/0 (socket says 172.21.15.33:53602) 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19f59e640 1 -- 172.21.15.33:0/3824609447 learned_addr learned my addr 172.21.15.33:0/3824609447 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c251b0 0x560861ffe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19e59c640 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x560861ffeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19f59e640 1 -- 172.21.15.33:0/3824609447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c251b0 msgr2=0x560861ffe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19f59e640 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c251b0 0x560861ffe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19f59e640 1 -- 172.21.15.33:0/3824609447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 msgr2=0x560861ffeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19f59e640 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x560861ffeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19f59e640 1 -- 172.21.15.33:0/3824609447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560861f19900 con 0x560861c4e070 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19e59c640 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x560861ffeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb19f59e640 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c4e070 0x56086200ae10 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fb198035000 tx=0x7fb19802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27ebfdb34d3eeb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.964+0000 7fb182ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb182ff5640 1 -- 172.21.15.33:0/3824609447 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb198003b80 con 0x560861c4e070 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb182ff5640 1 -- 172.21.15.33:0/3824609447 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7fb198003d20 con 0x560861c4e070 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb1ab626740 1 -- 172.21.15.33:0/3824609447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1940ab0f0 con 0x560861c4e070 2024-08-28T19:45:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb182ff5640 1 -- 172.21.15.33:0/3824609447 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb198004040 con 0x560861c4e070 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb1ab626740 10 client.19125 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb1ab626740 1 -- 172.21.15.33:0/3824609447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56086200d7d0 con 0x560861c4e070 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb182ff5640 1 -- 172.21.15.33:0/3824609447 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1940ab0f0 con 0x560861c4e070 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb182ff5640 1 -- 172.21.15.33:0/3824609447 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb198051070 con 0x560861c4e070 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb1ab626740 10 client.19125 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb1ab626740 10 client.19125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb1ab626740 20 client.19125 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560861c0c9f0 0x560862010cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb1ab626740 4 client.19125 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.965+0000 7fb1ab626740 1 -- 172.21.15.33:0/3824609447 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560861f6c5d0 con 0x560861c0c9f0 2024-08-28T19:45:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.966+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560861c0c9f0 0x560862010cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.966+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560861c0c9f0 0x560862010cc0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=832669949123d47f server_cookie=8f59d182e62ef774 in_seq=0 out_seq=0 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.966+0000 7fb182ff5640 10 client.19125 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb182ff5640 1 -- 172.21.15.33:0/3824609447 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560861f6c5d0 con 0x560861c0c9f0 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb182ff5640 10 client.19125 handle_command_reply: tid=0 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 client.19125 shutdown 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 -- 172.21.15.33:0/3824609447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c4e070 msgr2=0x56086200ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c4e070 0x56086200ae10 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fb198035000 tx=0x7fb19802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 -- 172.21.15.33:0/3824609447 shutdown_connections 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560861c0c9f0 0x560862010cc0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c4e070 0x56086200ae10 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb182ff5640 0 client.19125 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:24.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x560861ffeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3824609447 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c251b0 0x560861ffe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 -- 172.21.15.33:0/3824609447 >> 172.21.15.33:0/3824609447 conn(0x560861c42460 msgr2=0x560861ff64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:24.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 -- 172.21.15.33:0/3824609447 shutdown_connections 2024-08-28T19:45:24.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 1 -- 172.21.15.33:0/3824609447 wait complete. 2024-08-28T19:45:24.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.967+0000 7fb1ab626740 20 client.19125 trim_cache size 0 max 16384 2024-08-28T19:45:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.980+0000 7fb1ab626740 1 Processor -- start 2024-08-28T19:45:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb1ab626740 1 -- start start 2024-08-28T19:45:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x560861ff4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x56086200ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 0x560861ffbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb1ab626740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b0cc0 con 0x560861c251b0 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb1ab626740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b2800 con 0x560861c2d390 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb1ab626740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b1390 con 0x560861c4e070 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb19ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x560861ff4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb19ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x560861ff4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53604/0 (socket says 172.21.15.33:53604) 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb19ed9d640 1 -- 172.21.15.33:0/3061796895 learned_addr learned my addr 172.21.15.33:0/3061796895 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb19e59c640 1 --2- 172.21.15.33:0/3061796895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x56086200ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb19ed9d640 1 -- 172.21.15.33:0/3061796895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 msgr2=0x560861ffbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb19f59e640 1 --2- 172.21.15.33:0/3061796895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 0x560861ffbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/3061796895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 0x560861ffbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb19ed9d640 1 -- 172.21.15.33:0/3061796895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 msgr2=0x56086200ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/3061796895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x56086200ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.981+0000 7fb19ed9d640 1 -- 172.21.15.33:0/3061796895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560861fffc30 con 0x560861c251b0 2024-08-28T19:45:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.982+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/3061796895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x560861ff4a50 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fb190005940 tx=0x7fb19000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2355bc9b1685eea server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.982+0000 7fb184ff9640 1 -- 172.21.15.33:0/3061796895 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190005220 con 0x560861c251b0 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.982+0000 7fb184ff9640 1 -- 172.21.15.33:0/3061796895 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb190004c50 con 0x560861c251b0 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.982+0000 7fb184ff9640 1 -- 172.21.15.33:0/3061796895 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19001d9c0 con 0x560861c251b0 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.982+0000 7fb1ab626740 1 -- 172.21.15.33:0/3061796895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 msgr2=0x560861ff4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.982+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3061796895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x560861ff4a50 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fb190005940 tx=0x7fb19000b410 comp rx=0 tx=0).stop 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.982+0000 7fb1ab626740 1 -- 172.21.15.33:0/3061796895 shutdown_connections 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.982+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3061796895 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 0x560861ffbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.982+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3061796895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x56086200ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.982+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3061796895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x560861ff4a50 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 -- 172.21.15.33:0/3061796895 >> 172.21.15.33:0/3061796895 conn(0x560861c42460 msgr2=0x560861ff4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 -- 172.21.15.33:0/3061796895 shutdown_connections 2024-08-28T19:45:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 -- 172.21.15.33:0/3061796895 wait complete. 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 -- start start 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 Processor -- start 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x5608620075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x560862003af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 0x5608620040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b2130 con 0x560861c251b0 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b1a60 con 0x560861c2d390 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.983+0000 7fb1ab626740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01aecc0 con 0x560861c4e070 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb1ab626740 10 client.0 _ll_register_callbacks cb 0x7fb198004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x5608620075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x5608620075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53614/0 (socket says 172.21.15.33:53614) 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19ed9d640 1 -- 172.21.15.33:0/3835779672 learned_addr learned my addr 172.21.15.33:0/3835779672 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19e59c640 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x560862003af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19f59e640 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 0x5608620040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19ed9d640 1 -- 172.21.15.33:0/3835779672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 msgr2=0x5608620040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 0x5608620040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19ed9d640 1 -- 172.21.15.33:0/3835779672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 msgr2=0x560862003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x560862003af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19ed9d640 1 -- 172.21.15.33:0/3835779672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560862004840 con 0x560861c251b0 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19e59c640 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x560862003af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19f59e640 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 0x5608620040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb19ed9d640 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x5608620075e0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fb190004820 tx=0x7fb190004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263fc8f132441332 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb182ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb182ff5640 1 -- 172.21.15.33:0/3835779672 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190028070 con 0x560861c251b0 2024-08-28T19:45:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb182ff5640 1 -- 172.21.15.33:0/3835779672 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7fb19001da70 con 0x560861c251b0 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.984+0000 7fb1ab626740 1 -- 172.21.15.33:0/3835779672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb190004c50 con 0x560861c251b0 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb182ff5640 1 -- 172.21.15.33:0/3835779672 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb19003a050 con 0x560861c251b0 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb1ab626740 10 client.19131 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb1ab626740 1 -- 172.21.15.33:0/3835779672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56086207c650 con 0x560861c251b0 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb182ff5640 1 -- 172.21.15.33:0/3835779672 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb190004c50 con 0x560861c251b0 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb182ff5640 1 -- 172.21.15.33:0/3835779672 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb190035030 con 0x560861c251b0 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb1ab626740 10 client.19131 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb1ab626740 10 client.19131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb1ab626740 20 client.19131 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560861be1da0 0x56086207edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb1ab626740 4 client.19131 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb1ab626740 1 -- 172.21.15.33:0/3835779672 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560861f68070 con 0x560861be1da0 2024-08-28T19:45:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.985+0000 7fb19e59c640 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560861be1da0 0x56086207edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb19e59c640 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560861be1da0 0x56086207edd0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51dae9cbaeec11e2 server_cookie=ff5f8a1db54f1ec2 in_seq=0 out_seq=0 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb182ff5640 10 client.19131 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb182ff5640 1 -- 172.21.15.33:0/3835779672 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560861f68070 con 0x560861be1da0 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb182ff5640 10 client.19131 handle_command_reply: tid=0 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 client.19131 shutdown 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 -- 172.21.15.33:0/3835779672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 msgr2=0x5608620075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x5608620075e0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fb190004820 tx=0x7fb190004850 comp rx=0 tx=0).stop 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 -- 172.21.15.33:0/3835779672 shutdown_connections 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560861c4e070 0x5608620040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560861c2d390 0x560862003af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x560861be1da0 0x56086207edd0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 --2- 172.21.15.33:0/3835779672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560861c251b0 0x5608620075e0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb182ff5640 0 client.19131 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 -- 172.21.15.33:0/3835779672 >> 172.21.15.33:0/3835779672 conn(0x560861c42460 msgr2=0x560861fffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 -- 172.21.15.33:0/3835779672 shutdown_connections 2024-08-28T19:45:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 1 -- 172.21.15.33:0/3835779672 wait complete. 2024-08-28T19:45:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.986+0000 7fb1ab626740 20 client.19131 trim_cache size 0 max 16384 2024-08-28T19:45:24.995 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:45:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 -- 172.21.15.33:0/1129245787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb1880b4ca0 msgr2=0x7fb1880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb1880b4ca0 0x7fb1880b71b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb198005e30 tx=0x7fb198005c30 comp rx=0 tx=0).stop 2024-08-28T19:45:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 -- 172.21.15.33:0/1129245787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a0108150 msgr2=0x7fb1a019a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a0108150 0x7fb1a019a890 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fb19400d750 tx=0x7fb19400dc10 comp rx=0 tx=0).stop 2024-08-28T19:45:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 -- 172.21.15.33:0/1129245787 shutdown_connections 2024-08-28T19:45:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a0108aa0 0x7fb1a019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a0108150 0x7fb1a019a890 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb1880b4ca0 0x7fb1880b71b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 --2- 172.21.15.33:0/1129245787 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb1a0102810 0x7fb1a019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 -- 172.21.15.33:0/1129245787 >> 172.21.15.33:0/1129245787 conn(0x7fb1a00794b0 msgr2=0x7fb1a0106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 -- 172.21.15.33:0/1129245787 shutdown_connections 2024-08-28T19:45:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:24.987+0000 7fb1a50b1640 1 -- 172.21.15.33:0/1129245787 wait complete. 2024-08-28T19:45:25.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:25 smithi033 ceph-mon[18549]: pgmap v745: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-08-28T19:45:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:25 smithi059 ceph-mon[22052]: pgmap v745: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-08-28T19:45:26.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:25 smithi122 ceph-mon[22174]: pgmap v745: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-08-28T19:45:26.700 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:45:26.701 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:45:26.969 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.498+0000 7f0d6db64640 1 -- 172.21.15.33:0/3137309552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d68109240 msgr2=0x7f0d68109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.498+0000 7f0d6db64640 1 --2- 172.21.15.33:0/3137309552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d68109240 0x7f0d68109650 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009900 tx=0x7f0d5c02a410 comp rx=0 tx=0).stop 2024-08-28T19:45:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.498+0000 7f0d6db64640 1 -- 172.21.15.33:0/3137309552 shutdown_connections 2024-08-28T19:45:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.498+0000 7f0d6db64640 1 --2- 172.21.15.33:0/3137309552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68109b90 0x7f0d681103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.498+0000 7f0d6db64640 1 --2- 172.21.15.33:0/3137309552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d68109240 0x7f0d68109650 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.498+0000 7f0d6db64640 1 --2- 172.21.15.33:0/3137309552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d68103900 0x7f0d68103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.498+0000 7f0d6db64640 1 -- 172.21.15.33:0/3137309552 >> 172.21.15.33:0/3137309552 conn(0x7f0d6807b5f0 msgr2=0x7f0d6807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.498+0000 7f0d6db64640 1 -- 172.21.15.33:0/3137309552 shutdown_connections 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.499+0000 7f0d6db64640 1 -- 172.21.15.33:0/3137309552 wait complete. 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.499+0000 7f0d6db64640 1 Processor -- start 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.499+0000 7f0d6db64640 1 -- start start 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d6db64640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d68103900 0x7f0d6819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d6db64640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d68109240 0x7f0d6819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d6db64640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68109b90 0x7f0d6819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d6db64640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0d68113850 con 0x7f0d68103900 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d6db64640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681136d0 con 0x7f0d68109240 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d6db64640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681139d0 con 0x7f0d68109b90 2024-08-28T19:45:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d677fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d68103900 0x7f0d6819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d677fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d68103900 0x7f0d6819a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53638/0 (socket says 172.21.15.33:53638) 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d677fe640 1 -- 172.21.15.33:0/862374597 learned_addr learned my addr 172.21.15.33:0/862374597 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d67fff640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68109b90 0x7f0d6819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d68109240 0x7f0d6819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d677fe640 1 -- 172.21.15.33:0/862374597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68109b90 msgr2=0x7f0d6819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d677fe640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68109b90 0x7f0d6819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d677fe640 1 -- 172.21.15.33:0/862374597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d68109240 msgr2=0x7f0d6819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d677fe640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d68109240 0x7f0d6819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d677fe640 1 -- 172.21.15.33:0/862374597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d681a0190 con 0x7f0d68103900 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d68109240 0x7f0d6819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.500+0000 7f0d677fe640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d68103900 0x7f0d6819a220 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800cce0 tx=0x7f0d5800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:27.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.501+0000 7f0d64ff9640 1 -- 172.21.15.33:0/862374597 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58004b20 con 0x7f0d68103900 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.501+0000 7f0d6db64640 1 -- 172.21.15.33:0/862374597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d681a0480 con 0x7f0d68103900 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.501+0000 7f0d64ff9640 1 -- 172.21.15.33:0/862374597 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d58004cc0 con 0x7f0d68103900 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.501+0000 7f0d64ff9640 1 -- 172.21.15.33:0/862374597 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800f6b0 con 0x7f0d68103900 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.501+0000 7f0d6db64640 1 -- 172.21.15.33:0/862374597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d681a6be0 con 0x7f0d68103900 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.503+0000 7f0d64ff9640 1 -- 172.21.15.33:0/862374597 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0d5800f850 con 0x7f0d68103900 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.503+0000 7f0d740d9740 1 Processor -- start 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.503+0000 7f0d740d9740 1 -- start start 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db7e350 0x55fc5df24780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df24cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df25200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d740d9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fc5de9a5f0 con 0x55fc5db5d670 2024-08-28T19:45:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d740d9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fc5de89b80 con 0x55fc5db55490 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d740d9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fc5de8db30 con 0x55fc5db7e350 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d66ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df25200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d66ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df25200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53650/0 (socket says 172.21.15.33:53650) 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d66ffd640 1 -- 172.21.15.33:0/2889363897 learned_addr learned my addr 172.21.15.33:0/2889363897 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d677fe640 1 --2- 172.21.15.33:0/2889363897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df24cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d67fff640 1 --2- 172.21.15.33:0/2889363897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db7e350 0x55fc5df24780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d64ff9640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d500b4ca0 0x7f0d500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d66ffd640 1 -- 172.21.15.33:0/2889363897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db7e350 msgr2=0x55fc5df24780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/2889363897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db7e350 0x55fc5df24780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d66ffd640 1 -- 172.21.15.33:0/2889363897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 msgr2=0x55fc5df24cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/2889363897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df24cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d66ffd640 1 -- 172.21.15.33:0/2889363897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc5dbe9930 con 0x55fc5db5d670 2024-08-28T19:45:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d67fff640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d500b4ca0 0x7f0d500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.504+0000 7f0d64ff9640 1 -- 172.21.15.33:0/862374597 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f0d580e5950 con 0x7f0d68103900 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.505+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/2889363897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df25200 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c000c00 tx=0x7f0d5c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f078728d2597b85 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.505+0000 7f0d4dffb640 1 -- 172.21.15.33:0/2889363897 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c03f070 con 0x55fc5db5d670 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.505+0000 7f0d4dffb640 1 -- 172.21.15.33:0/2889363897 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d5c0316a0 con 0x55fc5db5d670 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.505+0000 7f0d4dffb640 1 -- 172.21.15.33:0/2889363897 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c035070 con 0x55fc5db5d670 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d740d9740 1 -- 172.21.15.33:0/2889363897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 msgr2=0x55fc5df25200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d740d9740 1 --2- 172.21.15.33:0/2889363897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df25200 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c000c00 tx=0x7f0d5c032ce0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d67fff640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d500b4ca0 0x7f0d500b71b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000b7a0 tx=0x7f0d600046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d740d9740 1 -- 172.21.15.33:0/2889363897 shutdown_connections 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d740d9740 1 --2- 172.21.15.33:0/2889363897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df25200 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d740d9740 1 --2- 172.21.15.33:0/2889363897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df24cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d740d9740 1 --2- 172.21.15.33:0/2889363897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db7e350 0x55fc5df24780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d740d9740 1 -- 172.21.15.33:0/2889363897 >> 172.21.15.33:0/2889363897 conn(0x55fc5db72740 msgr2=0x55fc5df22670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d740d9740 1 -- 172.21.15.33:0/2889363897 shutdown_connections 2024-08-28T19:45:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d740d9740 1 -- 172.21.15.33:0/2889363897 wait complete. 2024-08-28T19:45:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.506+0000 7f0d740d9740 1 -- start start 2024-08-28T19:45:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d740d9740 1 Processor -- start 2024-08-28T19:45:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df2ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db5d670 0x55fc5df30440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db7e350 0x55fc5df40600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d740d9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fc5dcec890 con 0x55fc5db7e350 2024-08-28T19:45:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d740d9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fc5de10790 con 0x55fc5db55490 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d740d9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fc5df37310 con 0x55fc5db5d670 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d740d9740 10 client.0 _ll_register_callbacks cb 0x55fc5db95ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df2ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d67fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db7e350 0x55fc5df40600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df2ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:41756/0 (socket says 172.21.15.33:41756) 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d677fe640 1 -- 172.21.15.33:0/3860638443 learned_addr learned my addr 172.21.15.33:0/3860638443 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db5d670 0x55fc5df30440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d677fe640 1 -- 172.21.15.33:0/3860638443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db5d670 msgr2=0x55fc5df30440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d677fe640 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db5d670 0x55fc5df30440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d677fe640 1 -- 172.21.15.33:0/3860638443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db7e350 msgr2=0x55fc5df40600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d677fe640 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db7e350 0x55fc5df40600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d677fe640 1 -- 172.21.15.33:0/3860638443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc5de47f30 con 0x55fc5db55490 2024-08-28T19:45:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.507+0000 7f0d67fff640 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db7e350 0x55fc5df40600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d677fe640 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df2ff00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0d580e2d60 tx=0x7f0d580077c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83bd0b87518dbcb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d46ffd640 1 -- 172.21.15.33:0/3860638443 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5801d040 con 0x55fc5db55490 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d740d9740 1 -- 172.21.15.33:0/3860638443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d5c0316a0 con 0x55fc5db55490 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d46ffd640 1 -- 172.21.15.33:0/3860638443 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f0d580a8290 con 0x55fc5db55490 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d46ffd640 1 -- 172.21.15.33:0/3860638443 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d580ab5f0 con 0x55fc5db55490 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d740d9740 10 client.27995 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d740d9740 1 -- 172.21.15.33:0/3860638443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fc5df43140 con 0x55fc5db55490 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d46ffd640 1 -- 172.21.15.33:0/3860638443 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d5c0316a0 con 0x55fc5db55490 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d46ffd640 1 -- 172.21.15.33:0/3860638443 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0d580b0160 con 0x55fc5db55490 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d740d9740 10 client.27995 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.508+0000 7f0d740d9740 10 client.27995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:45:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.509+0000 7f0d740d9740 20 client.27995 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:27.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.509+0000 7f0d740d9740 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fc5db3ccd0 0x55fc5df465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.509+0000 7f0d740d9740 4 client.27995 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:45:27.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.509+0000 7f0d740d9740 1 -- 172.21.15.33:0/3860638443 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc5de9c540 con 0x55fc5db3ccd0 2024-08-28T19:45:27.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.509+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fc5db3ccd0 0x55fc5df465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.509+0000 7f0d46ffd640 10 client.27995 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:27.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.509+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fc5db3ccd0 0x55fc5df465f0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2daa97ad7f25754 server_cookie=b9228d1eb236730e in_seq=0 out_seq=0 2024-08-28T19:45:27.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d46ffd640 1 -- 172.21.15.33:0/3860638443 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc5de9c540 con 0x55fc5db3ccd0 2024-08-28T19:45:27.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d46ffd640 10 client.27995 handle_command_reply: tid=0 2024-08-28T19:45:27.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 client.27995 shutdown 2024-08-28T19:45:27.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 -- 172.21.15.33:0/3860638443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 msgr2=0x55fc5df2ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:27.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df2ff00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0d580e2d60 tx=0x7f0d580077c0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 -- 172.21.15.33:0/3860638443 shutdown_connections 2024-08-28T19:45:27.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fc5db3ccd0 0x55fc5df465f0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db7e350 0x55fc5df40600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db5d670 0x55fc5df30440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 --2- 172.21.15.33:0/3860638443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df2ff00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d46ffd640 0 client.27995 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 -- 172.21.15.33:0/3860638443 >> 172.21.15.33:0/3860638443 conn(0x55fc5db72740 msgr2=0x55fc5df27910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 -- 172.21.15.33:0/3860638443 shutdown_connections 2024-08-28T19:45:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 1 -- 172.21.15.33:0/3860638443 wait complete. 2024-08-28T19:45:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.510+0000 7f0d740d9740 20 client.27995 trim_cache size 0 max 16384 2024-08-28T19:45:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.528+0000 7f0d740d9740 1 Processor -- start 2024-08-28T19:45:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.528+0000 7f0d740d9740 1 -- start start 2024-08-28T19:45:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.528+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db3ccd0 0x55fc5df26170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.528+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db55490 0x55fc5df31b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.528+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df40500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.528+0000 7f0d740d9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681ae910 con 0x55fc5db5d670 2024-08-28T19:45:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.528+0000 7f0d740d9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681b0450 con 0x55fc5db3ccd0 2024-08-28T19:45:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.528+0000 7f0d740d9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681aefe0 con 0x55fc5db55490 2024-08-28T19:45:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.528+0000 7f0d67fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df40500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.528+0000 7f0d67fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df40500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53662/0 (socket says 172.21.15.33:53662) 2024-08-28T19:45:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d67fff640 1 -- 172.21.15.33:0/1243661752 learned_addr learned my addr 172.21.15.33:0/1243661752 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/1243661752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db55490 0x55fc5df31b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d677fe640 1 --2- 172.21.15.33:0/1243661752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db3ccd0 0x55fc5df26170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d67fff640 1 -- 172.21.15.33:0/1243661752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db55490 msgr2=0x55fc5df31b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d67fff640 1 --2- 172.21.15.33:0/1243661752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db55490 0x55fc5df31b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d67fff640 1 -- 172.21.15.33:0/1243661752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db3ccd0 msgr2=0x55fc5df26170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d67fff640 1 --2- 172.21.15.33:0/1243661752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db3ccd0 0x55fc5df26170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d67fff640 1 -- 172.21.15.33:0/1243661752 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc5df1db80 con 0x55fc5db5d670 2024-08-28T19:45:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d67fff640 1 --2- 172.21.15.33:0/1243661752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df40500 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f0d60003f80 tx=0x7f0d60016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed494dd01a05b3a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:27.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d4d7fa640 1 -- 172.21.15.33:0/1243661752 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60010430 con 0x55fc5db5d670 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d4d7fa640 1 -- 172.21.15.33:0/1243661752 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d60010a80 con 0x55fc5db5d670 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.529+0000 7f0d4d7fa640 1 -- 172.21.15.33:0/1243661752 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6001f960 con 0x55fc5db5d670 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.530+0000 7f0d740d9740 1 -- 172.21.15.33:0/1243661752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 msgr2=0x55fc5df40500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.530+0000 7f0d740d9740 1 --2- 172.21.15.33:0/1243661752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df40500 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f0d60003f80 tx=0x7f0d60016000 comp rx=0 tx=0).stop 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.530+0000 7f0d740d9740 1 -- 172.21.15.33:0/1243661752 shutdown_connections 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.530+0000 7f0d740d9740 1 --2- 172.21.15.33:0/1243661752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db5d670 0x55fc5df40500 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.530+0000 7f0d740d9740 1 --2- 172.21.15.33:0/1243661752 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db55490 0x55fc5df31b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.530+0000 7f0d740d9740 1 --2- 172.21.15.33:0/1243661752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db3ccd0 0x55fc5df26170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.530+0000 7f0d740d9740 1 -- 172.21.15.33:0/1243661752 >> 172.21.15.33:0/1243661752 conn(0x55fc5db72740 msgr2=0x55fc5df31420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.530+0000 7f0d740d9740 1 -- 172.21.15.33:0/1243661752 shutdown_connections 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.530+0000 7f0d740d9740 1 -- 172.21.15.33:0/1243661752 wait complete. 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.530+0000 7f0d740d9740 1 -- start start 2024-08-28T19:45:27.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d740d9740 1 Processor -- start 2024-08-28T19:45:27.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db3ccd0 0x55fc5df38ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df39440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d740d9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db5d670 0x55fc5dfa9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d740d9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681afd80 con 0x55fc5db3ccd0 2024-08-28T19:45:27.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d740d9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681af6b0 con 0x55fc5db55490 2024-08-28T19:45:27.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d740d9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681ac910 con 0x55fc5db5d670 2024-08-28T19:45:27.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d740d9740 10 client.0 _ll_register_callbacks cb 0x7f0d5800cc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:27.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d677fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db3ccd0 0x55fc5df38ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d677fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db3ccd0 0x55fc5df38ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53666/0 (socket says 172.21.15.33:53666) 2024-08-28T19:45:27.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d677fe640 1 -- 172.21.15.33:0/666555017 learned_addr learned my addr 172.21.15.33:0/666555017 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df39440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d67fff640 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db5d670 0x55fc5dfa9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d677fe640 1 -- 172.21.15.33:0/666555017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db5d670 msgr2=0x55fc5dfa9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d677fe640 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db5d670 0x55fc5dfa9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d677fe640 1 -- 172.21.15.33:0/666555017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 msgr2=0x55fc5df39440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d677fe640 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df39440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.531+0000 7f0d677fe640 1 -- 172.21.15.33:0/666555017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc5dfaa660 con 0x55fc5db3ccd0 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d677fe640 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db3ccd0 0x55fc5df38ea0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f0d580b5100 tx=0x7f0d580eb5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156732077e6ea446 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d46ffd640 1 -- 172.21.15.33:0/666555017 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5801d040 con 0x55fc5db3ccd0 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d46ffd640 1 -- 172.21.15.33:0/666555017 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f0d5800fd50 con 0x55fc5db3ccd0 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d740d9740 1 -- 172.21.15.33:0/666555017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d60010a80 con 0x55fc5db3ccd0 2024-08-28T19:45:27.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d46ffd640 1 -- 172.21.15.33:0/666555017 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0d580c6050 con 0x55fc5db3ccd0 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d740d9740 10 client.19149 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d740d9740 1 -- 172.21.15.33:0/666555017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fc5dfb19c0 con 0x55fc5db3ccd0 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d46ffd640 1 -- 172.21.15.33:0/666555017 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d60010a80 con 0x55fc5db3ccd0 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d46ffd640 1 -- 172.21.15.33:0/666555017 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0d580aa970 con 0x55fc5db3ccd0 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d740d9740 10 client.19149 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d740d9740 10 client.19149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d740d9740 20 client.19149 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d740d9740 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fc5db7e350 0x55fc5dfb40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d740d9740 4 client.19149 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.532+0000 7f0d740d9740 1 -- 172.21.15.33:0/666555017 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fc5de97fe0 con 0x55fc5db7e350 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.533+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fc5db7e350 0x55fc5dfb40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:27.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.533+0000 7f0d46ffd640 10 client.19149 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:27.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.533+0000 7f0d66ffd640 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fc5db7e350 0x55fc5dfb40c0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16568bb93e84a8b0 server_cookie=b505b9e6c1cbb8a6 in_seq=0 out_seq=0 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.535+0000 7f0d46ffd640 1 -- 172.21.15.33:0/666555017 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fc5de97fe0 con 0x55fc5db7e350 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.535+0000 7f0d46ffd640 10 client.19149 handle_command_reply: tid=0 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.535+0000 7f0d740d9740 1 client.19149 shutdown 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 1 -- 172.21.15.33:0/666555017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db3ccd0 msgr2=0x55fc5df38ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db3ccd0 0x55fc5df38ea0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f0d580b5100 tx=0x7f0d580eb5c0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 1 -- 172.21.15.33:0/666555017 shutdown_connections 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fc5db5d670 0x55fc5dfa9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc5db55490 0x55fc5df39440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fc5db7e350 0x55fc5dfb40c0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 1 --2- 172.21.15.33:0/666555017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fc5db3ccd0 0x55fc5df38ea0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d46ffd640 0 client.19149 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:27.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 1 -- 172.21.15.33:0/666555017 >> 172.21.15.33:0/666555017 conn(0x55fc5db72740 msgr2=0x55fc5df25f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:27.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 1 -- 172.21.15.33:0/666555017 shutdown_connections 2024-08-28T19:45:27.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 1 -- 172.21.15.33:0/666555017 wait complete. 2024-08-28T19:45:27.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d740d9740 20 client.19149 trim_cache size 0 max 16384 2024-08-28T19:45:27.541 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:45:27.541 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:45:27.541 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "31a7d457-d6d6-4057-9174-bbe79f84c62c", 2024-08-28T19:45:27.541 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:45:27.541 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:45:27.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d6db64640 1 -- 172.21.15.33:0/862374597 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d500b4ca0 msgr2=0x7f0d500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:27.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d6db64640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d500b4ca0 0x7f0d500b71b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000b7a0 tx=0x7f0d600046c0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d6db64640 1 -- 172.21.15.33:0/862374597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d68103900 msgr2=0x7f0d6819a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:27.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.536+0000 7f0d6db64640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d68103900 0x7f0d6819a220 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800cce0 tx=0x7f0d5800a620 comp rx=0 tx=0).stop 2024-08-28T19:45:27.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.537+0000 7f0d6db64640 1 -- 172.21.15.33:0/862374597 shutdown_connections 2024-08-28T19:45:27.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.537+0000 7f0d6db64640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f0d500b4ca0 0x7f0d500b71b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.537+0000 7f0d6db64640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0d68109b90 0x7f0d6819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.537+0000 7f0d6db64640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d68109240 0x7f0d6819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.537+0000 7f0d6db64640 1 --2- 172.21.15.33:0/862374597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d68103900 0x7f0d6819a220 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:27.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.537+0000 7f0d6db64640 1 -- 172.21.15.33:0/862374597 >> 172.21.15.33:0/862374597 conn(0x7f0d6807b5f0 msgr2=0x7f0d68107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:27.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.537+0000 7f0d6db64640 1 -- 172.21.15.33:0/862374597 shutdown_connections 2024-08-28T19:45:27.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:27.537+0000 7f0d6db64640 1 -- 172.21.15.33:0/862374597 wait complete. 2024-08-28T19:45:27.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:27 smithi033 ceph-mon[18549]: pgmap v746: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-08-28T19:45:28.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:27 smithi059 ceph-mon[22052]: pgmap v746: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-08-28T19:45:28.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:27 smithi122 ceph-mon[22174]: pgmap v746: 129 pgs: 129 active+clean; 21 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-08-28T19:45:28.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:45:28.593 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:45:28.863 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:28 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:45:28.863 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:28 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:45:28.863 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:28 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:45:28.864 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:28 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:45:29.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:28 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:45:29.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:28 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:45:29.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:28 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:45:29.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:28 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:45:29.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:28 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:45:29.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:28 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:45:29.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:28 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:45:29.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:28 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:45:29.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.093+0000 7f47c9bfc640 1 -- 172.21.15.33:0/664343132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c4103900 msgr2=0x7f47c4103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:29.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.093+0000 7f47c9bfc640 1 --2- 172.21.15.33:0/664343132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c4103900 0x7f47c4103d10 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009900 tx=0x7f47b402a410 comp rx=0 tx=0).stop 2024-08-28T19:45:29.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.094+0000 7f47c9bfc640 1 -- 172.21.15.33:0/664343132 shutdown_connections 2024-08-28T19:45:29.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.094+0000 7f47c9bfc640 1 --2- 172.21.15.33:0/664343132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4109b90 0x7f47c41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.094+0000 7f47c9bfc640 1 --2- 172.21.15.33:0/664343132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47c4109240 0x7f47c4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.094+0000 7f47c9bfc640 1 --2- 172.21.15.33:0/664343132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c4103900 0x7f47c4103d10 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.094+0000 7f47c9bfc640 1 -- 172.21.15.33:0/664343132 >> 172.21.15.33:0/664343132 conn(0x7f47c407b5f0 msgr2=0x7f47c407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:29.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.094+0000 7f47c9bfc640 1 -- 172.21.15.33:0/664343132 shutdown_connections 2024-08-28T19:45:29.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.094+0000 7f47c9bfc640 1 -- 172.21.15.33:0/664343132 wait complete. 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.094+0000 7f47c9bfc640 1 Processor -- start 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.094+0000 7f47c9bfc640 1 -- start start 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c9bfc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4103900 0x7f47c40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c9bfc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c4109240 0x7f47c40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c9bfc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47c4109b90 0x7f47c4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c9bfc640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4113850 con 0x7f47c4109240 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c9bfc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41136d0 con 0x7f47c4103900 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c9bfc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41139d0 con 0x7f47c4109b90 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c4109240 0x7f47c40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c2ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c4109240 0x7f47c40759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55506/0 (socket says 172.21.15.33:55506) 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c2ffd640 1 -- 172.21.15.33:0/3274678235 learned_addr learned my addr 172.21.15.33:0/3274678235 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c37fe640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4103900 0x7f47c40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47c4109b90 0x7f47c4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c2ffd640 1 -- 172.21.15.33:0/3274678235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47c4109b90 msgr2=0x7f47c4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c2ffd640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47c4109b90 0x7f47c4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c2ffd640 1 -- 172.21.15.33:0/3274678235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4103900 msgr2=0x7f47c40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c2ffd640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4103900 0x7f47c40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c2ffd640 1 -- 172.21.15.33:0/3274678235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c41a8540 con 0x7f47c4109240 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47c4109b90 0x7f47c4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.095+0000 7f47c2ffd640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c4109240 0x7f47c40759f0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f47b800d750 tx=0x7f47b800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.096+0000 7f47c0ff9640 1 -- 172.21.15.33:0/3274678235 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8017070 con 0x7f47c4109240 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.096+0000 7f47c0ff9640 1 -- 172.21.15.33:0/3274678235 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b80054d0 con 0x7f47c4109240 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.096+0000 7f47c9bfc640 1 -- 172.21.15.33:0/3274678235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c41a8830 con 0x7f47c4109240 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.096+0000 7f47c0ff9640 1 -- 172.21.15.33:0/3274678235 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8004c30 con 0x7f47c4109240 2024-08-28T19:45:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.096+0000 7f47c9bfc640 1 -- 172.21.15.33:0/3274678235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c41a8d70 con 0x7f47c4109240 2024-08-28T19:45:29.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.098+0000 7f47d0171740 1 Processor -- start 2024-08-28T19:45:29.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.098+0000 7f47c0ff9640 1 -- 172.21.15.33:0/3274678235 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f47b8004dd0 con 0x7f47c4109240 2024-08-28T19:45:29.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.098+0000 7f47d0171740 1 -- start start 2024-08-28T19:45:29.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47d0171740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d2c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47d0171740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a13495e1b0 0x55a134d2c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47d0171740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a134966390 0x55a134d2cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47d0171740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a134ca3630 con 0x55a13495e1b0 2024-08-28T19:45:29.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47d0171740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a134c92bc0 con 0x55a134987070 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47d0171740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a134c96b70 con 0x55a134966390 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a13495e1b0 0x55a134d2c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a13495e1b0 0x55a134d2c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55508/0 (socket says 172.21.15.33:55508) 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c37fe640 1 -- 172.21.15.33:0/2113064226 learned_addr learned my addr 172.21.15.33:0/2113064226 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c3fff640 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d2c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c2ffd640 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a134966390 0x55a134d2cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c37fe640 1 -- 172.21.15.33:0/2113064226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a134966390 msgr2=0x55a134d2cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c37fe640 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a134966390 0x55a134d2cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c37fe640 1 -- 172.21.15.33:0/2113064226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 msgr2=0x55a134d2c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c37fe640 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d2c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c0ff9640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47ac0b4d20 0x7f47ac0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c37fe640 1 -- 172.21.15.33:0/2113064226 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1349f2650 con 0x55a13495e1b0 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c2ffd640 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a134966390 0x55a134d2cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c3fff640 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d2c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c2ffd640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47ac0b4d20 0x7f47ac0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c37fe640 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a13495e1b0 0x55a134d2c800 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009900 tx=0x7f47b4032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545bd65b613e2614 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.099+0000 7f47c0ff9640 1 -- 172.21.15.33:0/3274678235 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f47b80e52c0 con 0x7f47c4109240 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.100+0000 7f47a9ffb640 1 -- 172.21.15.33:0/2113064226 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4040070 con 0x55a13495e1b0 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.100+0000 7f47a9ffb640 1 -- 172.21.15.33:0/2113064226 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b4032e50 con 0x55a13495e1b0 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.100+0000 7f47a9ffb640 1 -- 172.21.15.33:0/2113064226 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4035040 con 0x55a13495e1b0 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47d0171740 1 -- 172.21.15.33:0/2113064226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a13495e1b0 msgr2=0x55a134d2c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47c2ffd640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47ac0b4d20 0x7f47ac0b7230 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f47b80e2720 tx=0x7f47b80ce040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:29.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47d0171740 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a13495e1b0 0x55a134d2c800 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009900 tx=0x7f47b4032c60 comp rx=0 tx=0).stop 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47d0171740 1 -- 172.21.15.33:0/2113064226 shutdown_connections 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47d0171740 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a134966390 0x55a134d2cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47d0171740 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a13495e1b0 0x55a134d2c800 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47d0171740 1 --2- 172.21.15.33:0/2113064226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d2c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47d0171740 1 -- 172.21.15.33:0/2113064226 >> 172.21.15.33:0/2113064226 conn(0x55a13497b460 msgr2=0x55a134d2a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47d0171740 1 -- 172.21.15.33:0/2113064226 shutdown_connections 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47d0171740 1 -- 172.21.15.33:0/2113064226 wait complete. 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.101+0000 7f47d0171740 1 -- start start 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47d0171740 1 Processor -- start 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47d0171740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d37a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.112 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47d0171740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d37f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47d0171740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d43d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47d0171740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a134af5700 con 0x55a134966390 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47d0171740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a134c19700 con 0x55a134987070 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47d0171740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a134d3aa40 con 0x55a13495e1b0 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47d0171740 10 client.0 _ll_register_callbacks cb 0x55a134c48dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d37f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d37f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55516/0 (socket says 172.21.15.33:55516) 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c37fe640 1 -- 172.21.15.33:0/3935975082 learned_addr learned my addr 172.21.15.33:0/3935975082 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d43d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d37a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c37fe640 1 -- 172.21.15.33:0/3935975082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 msgr2=0x55a134d37a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c37fe640 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d37a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c37fe640 1 -- 172.21.15.33:0/3935975082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 msgr2=0x55a134d43d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c37fe640 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d43d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c37fe640 1 -- 172.21.15.33:0/3935975082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a134c528b0 con 0x55a134966390 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.102+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d43d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47c37fe640 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d37f90 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005560 tx=0x7f47b40050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef4b36d4a8d999e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47a2ffd640 1 -- 172.21.15.33:0/3935975082 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4051060 con 0x55a134966390 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47a2ffd640 1 -- 172.21.15.33:0/3935975082 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f47b4004040 con 0x55a134966390 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47d0171740 1 -- 172.21.15.33:0/3935975082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47b4032e50 con 0x55a134966390 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47a2ffd640 1 -- 172.21.15.33:0/3935975082 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f47b4058050 con 0x55a134966390 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47d0171740 10 client.19161 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47d0171740 1 -- 172.21.15.33:0/3935975082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a134d46740 con 0x55a134966390 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47a2ffd640 1 -- 172.21.15.33:0/3935975082 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b4032e50 con 0x55a134966390 2024-08-28T19:45:29.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47a2ffd640 1 -- 172.21.15.33:0/3935975082 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f47b4004d90 con 0x55a134966390 2024-08-28T19:45:29.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47d0171740 10 client.19161 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:29.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47d0171740 10 client.19161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:45:29.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47d0171740 20 client.19161 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:29.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47d0171740 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1349459f0 0x55a134d49aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47d0171740 4 client.19161 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:45:29.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.103+0000 7f47d0171740 1 -- 172.21.15.33:0/3935975082 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a134ca5580 con 0x55a1349459f0 2024-08-28T19:45:29.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.104+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1349459f0 0x55a134d49aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.104+0000 7f47a2ffd640 10 client.19161 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:29.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.104+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1349459f0 0x55a134d49aa0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50b999184eff23fc server_cookie=da898a400d842727 in_seq=0 out_seq=0 2024-08-28T19:45:29.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47a2ffd640 1 -- 172.21.15.33:0/3935975082 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a134ca5580 con 0x55a1349459f0 2024-08-28T19:45:29.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47a2ffd640 10 client.19161 handle_command_reply: tid=0 2024-08-28T19:45:29.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 client.19161 shutdown 2024-08-28T19:45:29.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 -- 172.21.15.33:0/3935975082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 msgr2=0x55a134d37f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:29.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d37f90 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005560 tx=0x7f47b40050e0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 -- 172.21.15.33:0/3935975082 shutdown_connections 2024-08-28T19:45:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d43d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a1349459f0 0x55a134d49aa0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d37f90 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 --2- 172.21.15.33:0/3935975082 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d37a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47a2ffd640 0 client.19161 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 -- 172.21.15.33:0/3935975082 >> 172.21.15.33:0/3935975082 conn(0x55a13497b460 msgr2=0x55a134d2f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 -- 172.21.15.33:0/3935975082 shutdown_connections 2024-08-28T19:45:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 1 -- 172.21.15.33:0/3935975082 wait complete. 2024-08-28T19:45:29.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.105+0000 7f47d0171740 20 client.19161 trim_cache size 0 max 16384 2024-08-28T19:45:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.123+0000 7f47d0171740 1 Processor -- start 2024-08-28T19:45:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.123+0000 7f47d0171740 1 -- start start 2024-08-28T19:45:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.123+0000 7f47d0171740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d2fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.123+0000 7f47d0171740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134966390 0x55a134d43ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.123+0000 7f47d0171740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134987070 0x55a134d29ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.123+0000 7f47d0171740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41b2e10 con 0x55a134987070 2024-08-28T19:45:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.123+0000 7f47d0171740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41b4950 con 0x55a134966390 2024-08-28T19:45:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.123+0000 7f47d0171740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41b34e0 con 0x55a13495e1b0 2024-08-28T19:45:29.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134987070 0x55a134d29ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134987070 0x55a134d29ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55520/0 (socket says 172.21.15.33:55520) 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c3fff640 1 -- 172.21.15.33:0/3692418518 learned_addr learned my addr 172.21.15.33:0/3692418518 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3692418518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d2fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c37fe640 1 --2- 172.21.15.33:0/3692418518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134966390 0x55a134d43ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c3fff640 1 -- 172.21.15.33:0/3692418518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 msgr2=0x55a134d2fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3692418518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d2fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c3fff640 1 -- 172.21.15.33:0/3692418518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134966390 msgr2=0x55a134d43ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3692418518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134966390 0x55a134d43ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c3fff640 1 -- 172.21.15.33:0/3692418518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a134d32680 con 0x55a134987070 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c37fe640 1 --2- 172.21.15.33:0/3692418518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134966390 0x55a134d43ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47c3fff640 1 --2- 172.21.15.33:0/3692418518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134987070 0x55a134d29ad0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x55a134d3a2a0 tx=0x7f47bc009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad6f0757f306f4e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:29.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47a97fa640 1 -- 172.21.15.33:0/3692418518 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc021030 con 0x55a134987070 2024-08-28T19:45:29.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47a97fa640 1 -- 172.21.15.33:0/3692418518 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47bc018070 con 0x55a134987070 2024-08-28T19:45:29.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.124+0000 7f47a97fa640 1 -- 172.21.15.33:0/3692418518 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0056d0 con 0x55a134987070 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.125+0000 7f47d0171740 1 -- 172.21.15.33:0/3692418518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134987070 msgr2=0x55a134d29ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.125+0000 7f47d0171740 1 --2- 172.21.15.33:0/3692418518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134987070 0x55a134d29ad0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x55a134d3a2a0 tx=0x7f47bc009800 comp rx=0 tx=0).stop 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.125+0000 7f47d0171740 1 -- 172.21.15.33:0/3692418518 shutdown_connections 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.125+0000 7f47d0171740 1 --2- 172.21.15.33:0/3692418518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134987070 0x55a134d29ad0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.125+0000 7f47d0171740 1 --2- 172.21.15.33:0/3692418518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134966390 0x55a134d43ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.125+0000 7f47d0171740 1 --2- 172.21.15.33:0/3692418518 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d2fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.125+0000 7f47d0171740 1 -- 172.21.15.33:0/3692418518 >> 172.21.15.33:0/3692418518 conn(0x55a13497b460 msgr2=0x55a134d2f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.125+0000 7f47d0171740 1 -- 172.21.15.33:0/3692418518 shutdown_connections 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.125+0000 7f47d0171740 1 -- 172.21.15.33:0/3692418518 wait complete. 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.126+0000 7f47d0171740 1 -- start start 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.126+0000 7f47d0171740 1 Processor -- start 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.126+0000 7f47d0171740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d4abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.126+0000 7f47d0171740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d4b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.126+0000 7f47d0171740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d4b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.126+0000 7f47d0171740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41b4280 con 0x55a134966390 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.126+0000 7f47d0171740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41b3bb0 con 0x55a134987070 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.126+0000 7f47d0171740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41b0e10 con 0x55a13495e1b0 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47d0171740 10 client.0 _ll_register_callbacks cb 0x7f47b4032bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d4b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d4b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55522/0 (socket says 172.21.15.33:55522) 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c37fe640 1 -- 172.21.15.33:0/1515009198 learned_addr learned my addr 172.21.15.33:0/1515009198 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c3fff640 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d4abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c3fff640 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d4b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c37fe640 1 -- 172.21.15.33:0/1515009198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 msgr2=0x55a134d4abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c37fe640 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d4abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c37fe640 1 -- 172.21.15.33:0/1515009198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 msgr2=0x55a134d4b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c37fe640 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d4b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c37fe640 1 -- 172.21.15.33:0/1515009198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a134db3350 con 0x55a134966390 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c3fff640 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d4b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47c37fe640 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d4b120 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f47b40092a0 tx=0x7f47b4005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d7524bd55c1c01 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47a2ffd640 1 -- 172.21.15.33:0/1515009198 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4051070 con 0x55a134966390 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47a2ffd640 1 -- 172.21.15.33:0/1515009198 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f47b40046c0 con 0x55a134966390 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.127+0000 7f47d0171740 1 -- 172.21.15.33:0/1515009198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47bc018070 con 0x55a134966390 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47a2ffd640 1 -- 172.21.15.33:0/1515009198 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f47b406a050 con 0x55a134966390 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47d0171740 10 client.19167 fetch_fsmap learned FSMap version 28 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47d0171740 1 -- 172.21.15.33:0/1515009198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a134db45c0 con 0x55a134966390 2024-08-28T19:45:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47a2ffd640 1 -- 172.21.15.33:0/1515009198 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47bc018070 con 0x55a134966390 2024-08-28T19:45:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47a2ffd640 1 -- 172.21.15.33:0/1515009198 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f47b403c770 con 0x55a134966390 2024-08-28T19:45:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47d0171740 10 client.19167 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:45:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47d0171740 10 client.19167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:45:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47d0171740 20 client.19167 populate_metadata read hostname 'smithi033' 2024-08-28T19:45:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47d0171740 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a13491ada0 0x55a134db6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:45:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47d0171740 4 client.19167 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:45:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.128+0000 7f47d0171740 1 -- 172.21.15.33:0/1515009198 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a134ca1020 con 0x55a13491ada0 2024-08-28T19:45:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.129+0000 7f47c3fff640 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a13491ada0 0x55a134db6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:45:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.129+0000 7f47a2ffd640 10 client.19167 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.129+0000 7f47c3fff640 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a13491ada0 0x55a134db6cb0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dcb48f083177d6a server_cookie=c3f04fea9c5f72c2 in_seq=0 out_seq=0 2024-08-28T19:45:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.129+0000 7f47a2ffd640 1 -- 172.21.15.33:0/1515009198 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6250 (crc 0 0 0) 0x55a134ca1020 con 0x55a13491ada0 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.129+0000 7f47a2ffd640 10 client.19167 handle_command_reply: tid=0 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.129+0000 7f47d0171740 1 client.19167 shutdown 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.129+0000 7f47d0171740 1 -- 172.21.15.33:0/1515009198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 msgr2=0x55a134d4b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.129+0000 7f47d0171740 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d4b120 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f47b40092a0 tx=0x7f47b4005250 comp rx=0 tx=0).stop 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47d0171740 1 -- 172.21.15.33:0/1515009198 shutdown_connections 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47d0171740 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a134987070 0x55a134d4b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47d0171740 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a13491ada0 0x55a134db6cb0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47d0171740 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a134966390 0x55a134d4b120 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47d0171740 1 --2- 172.21.15.33:0/1515009198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a13495e1b0 0x55a134d4abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47a2ffd640 0 client.19167 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47d0171740 1 -- 172.21.15.33:0/1515009198 >> 172.21.15.33:0/1515009198 conn(0x55a13497b460 msgr2=0x55a134d37800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47d0171740 1 -- 172.21.15.33:0/1515009198 shutdown_connections 2024-08-28T19:45:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47d0171740 1 -- 172.21.15.33:0/1515009198 wait complete. 2024-08-28T19:45:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47d0171740 20 client.19167 trim_cache size 0 max 16384 2024-08-28T19:45:29.137 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:45:29.137 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:45:29.137 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:45:29.137 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:45:29.137 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.137 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "31a7d457-d6d6-4057-9174-bbe79f84c62c", 2024-08-28T19:45:29.137 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:45:29.137 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:45:29.138 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.140 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.141 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:45:27.534627+0000", 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.142 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.144 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.145 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.146 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.147 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:45:29.148 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:45:29.150 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:45:29.151 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:45:29.151 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:45:29.151 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:45:29.151 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:45:29.151 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:45:29.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47c9bfc640 1 -- 172.21.15.33:0/3274678235 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47ac0b4d20 msgr2=0x7f47ac0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:29.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47c9bfc640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47ac0b4d20 0x7f47ac0b7230 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f47b80e2720 tx=0x7f47b80ce040 comp rx=0 tx=0).stop 2024-08-28T19:45:29.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47c9bfc640 1 -- 172.21.15.33:0/3274678235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c4109240 msgr2=0x7f47c40759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:45:29.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.130+0000 7f47c9bfc640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c4109240 0x7f47c40759f0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f47b800d750 tx=0x7f47b800dc10 comp rx=0 tx=0).stop 2024-08-28T19:45:29.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.131+0000 7f47c9bfc640 1 -- 172.21.15.33:0/3274678235 shutdown_connections 2024-08-28T19:45:29.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.131+0000 7f47c9bfc640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f47ac0b4d20 0x7f47ac0b7230 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.131+0000 7f47c9bfc640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f47c4109b90 0x7f47c4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.131+0000 7f47c9bfc640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47c4109240 0x7f47c40759f0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.131+0000 7f47c9bfc640 1 --2- 172.21.15.33:0/3274678235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4103900 0x7f47c40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:45:29.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.131+0000 7f47c9bfc640 1 -- 172.21.15.33:0/3274678235 >> 172.21.15.33:0/3274678235 conn(0x7f47c407b5f0 msgr2=0x7f47c4107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:45:29.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.131+0000 7f47c9bfc640 1 -- 172.21.15.33:0/3274678235 shutdown_connections 2024-08-28T19:45:29.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:45:29.131+0000 7f47c9bfc640 1 -- 172.21.15.33:0/3274678235 wait complete. 2024-08-28T19:45:29.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:29 smithi033 ceph-mon[18549]: pgmap v747: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-08-28T19:45:29.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:29 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:45:29.960 INFO:tasks.cephfs.filesystem:scrub status for tag:31a7d457-d6d6-4057-9174-bbe79f84c62c - {'path': '/', 'tag': '31a7d457-d6d6-4057-9174-bbe79f84c62c', 'options': 'recursive,force'} 2024-08-28T19:45:30.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:29 smithi059 ceph-mon[22052]: pgmap v747: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-08-28T19:45:30.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:29 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:45:30.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:29 smithi122 ceph-mon[22174]: pgmap v747: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-08-28T19:45:30.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:29 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:45:31.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:31 smithi033 ceph-mon[18549]: pgmap v748: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-08-28T19:45:32.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:31 smithi059 ceph-mon[22052]: pgmap v748: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-08-28T19:45:32.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:31 smithi122 ceph-mon[22174]: pgmap v748: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-08-28T19:45:33.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:33 smithi033 ceph-mon[18549]: pgmap v749: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-08-28T19:45:34.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:33 smithi059 ceph-mon[22052]: pgmap v749: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-08-28T19:45:34.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:33 smithi122 ceph-mon[22174]: pgmap v749: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-08-28T19:45:35.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:35 smithi033 ceph-mon[18549]: pgmap v750: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 17 op/s 2024-08-28T19:45:36.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:35 smithi059 ceph-mon[22052]: pgmap v750: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 17 op/s 2024-08-28T19:45:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:35 smithi122 ceph-mon[22174]: pgmap v750: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 17 op/s 2024-08-28T19:45:37.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:37 smithi033 ceph-mon[18549]: pgmap v751: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 60 KiB/s wr, 14 op/s 2024-08-28T19:45:38.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:37 smithi059 ceph-mon[22052]: pgmap v751: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 60 KiB/s wr, 14 op/s 2024-08-28T19:45:38.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:37 smithi122 ceph-mon[22174]: pgmap v751: 129 pgs: 129 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 60 KiB/s wr, 14 op/s 2024-08-28T19:45:39.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:39 smithi033 ceph-mon[18549]: pgmap v752: 129 pgs: 129 active+clean; 21 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 60 KiB/s wr, 16 op/s 2024-08-28T19:45:40.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:39 smithi059 ceph-mon[22052]: pgmap v752: 129 pgs: 129 active+clean; 21 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 60 KiB/s wr, 16 op/s 2024-08-28T19:45:40.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:39 smithi122 ceph-mon[22174]: pgmap v752: 129 pgs: 129 active+clean; 21 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 60 KiB/s wr, 16 op/s 2024-08-28T19:45:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:41 smithi033 ceph-mon[18549]: pgmap v753: 129 pgs: 129 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-08-28T19:45:42.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:41 smithi059 ceph-mon[22052]: pgmap v753: 129 pgs: 129 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-08-28T19:45:42.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:41 smithi122 ceph-mon[22174]: pgmap v753: 129 pgs: 129 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-08-28T19:45:44.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:43 smithi059 ceph-mon[22052]: pgmap v754: 129 pgs: 129 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 14 op/s 2024-08-28T19:45:44.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:43 smithi122 ceph-mon[22174]: pgmap v754: 129 pgs: 129 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 14 op/s 2024-08-28T19:45:44.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:43 smithi033 ceph-mon[18549]: pgmap v754: 129 pgs: 129 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 14 op/s 2024-08-28T19:45:46.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:45 smithi059 ceph-mon[22052]: pgmap v755: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 89 KiB/s wr, 19 op/s 2024-08-28T19:45:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:45 smithi122 ceph-mon[22174]: pgmap v755: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 89 KiB/s wr, 19 op/s 2024-08-28T19:45:46.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:45 smithi033 ceph-mon[18549]: pgmap v755: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 89 KiB/s wr, 19 op/s 2024-08-28T19:45:48.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:47 smithi059 ceph-mon[22052]: pgmap v756: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 14 op/s 2024-08-28T19:45:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:47 smithi122 ceph-mon[22174]: pgmap v756: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 14 op/s 2024-08-28T19:45:48.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:47 smithi033 ceph-mon[18549]: pgmap v756: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 14 op/s 2024-08-28T19:45:50.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:49 smithi059 ceph-mon[22052]: pgmap v757: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-08-28T19:45:50.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:49 smithi122 ceph-mon[22174]: pgmap v757: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-08-28T19:45:50.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:49 smithi033 ceph-mon[18549]: pgmap v757: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-08-28T19:45:51.564 INFO:tasks.workunit.client.0.smithi033.stdout:437/600: open fd = 3 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:438/600: open fd = 3 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:439/600: open fd = 3 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.565 INFO:tasks.workunit.client.0.smithi033.stdout:440/600: open fd = 3 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:441/600: open fd = 3 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:442/600: open fd = 3 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:443/600: open fd = 3 2024-08-28T19:45:51.566 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:444/600: open fd = 3 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:445/600: open fd = 3 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:446/600: open fd = 3 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.567 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:447/600: open fd = 3 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:448/600: open fd = 3 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:449/600: open fd = 3 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.568 INFO:tasks.workunit.client.0.smithi033.stdout:450/600: open fd = 3 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:451/600: open fd = 3 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:452/600: open fd = 3 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.569 INFO:tasks.workunit.client.0.smithi033.stdout:453/600: open fd = 3 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:454/600: open fd = 3 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:455/600: open fd = 3 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:456/600: open fd = 3 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.570 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:457/600: open fd = 3 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:458/600: open fd = 3 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:459/600: open fd = 3 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.571 INFO:tasks.workunit.client.0.smithi033.stdout:460/600: open fd = 3 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:461/600: open fd = 3 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:462/600: open fd = 3 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:463/600: open fd = 3 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.572 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:464/600: open fd = 3 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:465/600: open fd = 3 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:466/600: open fd = 3 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:467/600: open fd = 3 2024-08-28T19:45:51.573 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:468/600: open fd = 3 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:469/600: open fd = 3 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:470/600: open fd = 3 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.574 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:471/600: open fd = 3 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:472/600: open fd = 3 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:473/600: open fd = 3 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.575 INFO:tasks.workunit.client.0.smithi033.stdout:474/600: open fd = 3 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:475/600: open fd = 3 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:476/600: open fd = 3 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:477/600: open fd = 3 2024-08-28T19:45:51.576 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:478/600: open fd = 3 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:479/600: open fd = 3 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:480/600: open fd = 3 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.577 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:481/600: open fd = 3 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:482/600: open fd = 3 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:483/600: open fd = 3 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:484/600: open fd = 3 2024-08-28T19:45:51.578 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:485/600: open fd = 3 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:486/600: open fd = 3 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:487/600: open fd = 3 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.579 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:488/600: open fd = 3 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:489/600: open fd = 3 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:490/600: open fd = 3 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:491/600: open fd = 3 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.580 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:492/600: open fd = 3 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:493/600: open fd = 3 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:494/600: open fd = 3 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.581 INFO:tasks.workunit.client.0.smithi033.stdout:495/600: open fd = 3 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:496/600: open fd = 3 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:497/600: open fd = 3 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:498/600: open fd = 3 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:45:51.582 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:45:52.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:51 smithi059 ceph-mon[22052]: pgmap v758: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 15 op/s 2024-08-28T19:45:52.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:51 smithi122 ceph-mon[22174]: pgmap v758: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 15 op/s 2024-08-28T19:45:52.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:51 smithi033 ceph-mon[18549]: pgmap v758: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 15 op/s 2024-08-28T19:45:54.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:53 smithi059 ceph-mon[22052]: pgmap v759: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 13 op/s 2024-08-28T19:45:54.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:53 smithi122 ceph-mon[22174]: pgmap v759: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 13 op/s 2024-08-28T19:45:54.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:53 smithi033 ceph-mon[18549]: pgmap v759: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 13 op/s 2024-08-28T19:45:56.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:55 smithi059 ceph-mon[22052]: pgmap v760: 129 pgs: 129 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 87 KiB/s wr, 18 op/s 2024-08-28T19:45:56.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:55 smithi122 ceph-mon[22174]: pgmap v760: 129 pgs: 129 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 87 KiB/s wr, 18 op/s 2024-08-28T19:45:56.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:55 smithi033 ceph-mon[18549]: pgmap v760: 129 pgs: 129 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 87 KiB/s wr, 18 op/s 2024-08-28T19:45:58.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:57 smithi059 ceph-mon[22052]: pgmap v761: 129 pgs: 129 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 13 op/s 2024-08-28T19:45:58.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:57 smithi122 ceph-mon[22174]: pgmap v761: 129 pgs: 129 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 13 op/s 2024-08-28T19:45:58.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:57 smithi033 ceph-mon[18549]: pgmap v761: 129 pgs: 129 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 13 op/s 2024-08-28T19:45:59.961 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:45:59.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:45:59 smithi033 ceph-mon[18549]: pgmap v762: 129 pgs: 129 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-08-28T19:46:00.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:45:59 smithi059 ceph-mon[22052]: pgmap v762: 129 pgs: 129 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-08-28T19:46:00.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:45:59 smithi122 ceph-mon[22174]: pgmap v762: 129 pgs: 129 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-08-28T19:46:00.245 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:00.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.738+0000 7f0269310640 1 -- 172.21.15.33:0/3532642322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02641047d0 msgr2=0x7f0264104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:00.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.738+0000 7f0269310640 1 --2- 172.21.15.33:0/3532642322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02641047d0 0x7f0264104be0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f0254009900 tx=0x7f025402a410 comp rx=0 tx=0).stop 2024-08-28T19:46:00.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.738+0000 7f0269310640 1 -- 172.21.15.33:0/3532642322 shutdown_connections 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.738+0000 7f0269310640 1 --2- 172.21.15.33:0/3532642322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f026410dc30 0x7f0264110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.738+0000 7f0269310640 1 --2- 172.21.15.33:0/3532642322 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0264105120 0x7f026410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.738+0000 7f0269310640 1 --2- 172.21.15.33:0/3532642322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02641047d0 0x7f0264104be0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.738+0000 7f0269310640 1 -- 172.21.15.33:0/3532642322 >> 172.21.15.33:0/3532642322 conn(0x7f0264079510 msgr2=0x7f0264079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.738+0000 7f0269310640 1 -- 172.21.15.33:0/3532642322 shutdown_connections 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.738+0000 7f0269310640 1 -- 172.21.15.33:0/3532642322 wait complete. 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f0269310640 1 Processor -- start 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f0269310640 1 -- start start 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f0269310640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02641047d0 0x7f026419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f0269310640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0264105120 0x7f026419a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f0269310640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f026410dc30 0x7f026419fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f0269310640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f02641138b0 con 0x7f026410dc30 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f0269310640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0264113730 con 0x7f0264105120 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f0269310640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0264113a30 con 0x7f02641047d0 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f02637fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f026410dc30 0x7f026419fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f02637fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f026410dc30 0x7f026419fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45420/0 (socket says 172.21.15.33:45420) 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f02637fe640 1 -- 172.21.15.33:0/1342999911 learned_addr learned my addr 172.21.15.33:0/1342999911 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f02627fc640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0264105120 0x7f026419a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.739+0000 7f0262ffd640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02641047d0 0x7f026419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f02637fe640 1 -- 172.21.15.33:0/1342999911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02641047d0 msgr2=0x7f026419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f02637fe640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02641047d0 0x7f026419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f02637fe640 1 -- 172.21.15.33:0/1342999911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0264105120 msgr2=0x7f026419a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f02637fe640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0264105120 0x7f026419a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f02637fe640 1 -- 172.21.15.33:0/1342999911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02641a0250 con 0x7f026410dc30 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f0262ffd640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02641047d0 0x7f026419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f02637fe640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f026410dc30 0x7f026419fb20 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f025c00eaa0 tx=0x7f025c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f024bfff640 1 -- 172.21.15.33:0/1342999911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c00cdb0 con 0x7f026410dc30 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f024bfff640 1 -- 172.21.15.33:0/1342999911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f025c005020 con 0x7f026410dc30 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f0269310640 1 -- 172.21.15.33:0/1342999911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02641a0540 con 0x7f026410dc30 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f024bfff640 1 -- 172.21.15.33:0/1342999911 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c0116d0 con 0x7f026410dc30 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.740+0000 7f0269310640 1 -- 172.21.15.33:0/1342999911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02641a6ca0 con 0x7f026410dc30 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.742+0000 7f026f885740 1 Processor -- start 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f024bfff640 1 -- 172.21.15.33:0/1342999911 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f025c0051d0 con 0x7f026410dc30 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f026f885740 1 -- start start 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f026f885740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64f3070 0x559fc68982c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f026f885740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 0x559fc6898800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f026f885740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64d2390 0x559fc6898d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f026f885740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559fc680f630 con 0x559fc64f3070 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f026f885740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559fc67febc0 con 0x559fc64ca1b0 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f026f885740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fc6802b70 con 0x559fc64d2390 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f02627fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64f3070 0x559fc68982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f02627fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64f3070 0x559fc68982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45434/0 (socket says 172.21.15.33:45434) 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f02627fc640 1 -- 172.21.15.33:0/208326937 learned_addr learned my addr 172.21.15.33:0/208326937 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f0262ffd640 1 --2- 172.21.15.33:0/208326937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 0x559fc6898800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f024bfff640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f024c0b4ca0 0x7f024c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f02637fe640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f024c0b4ca0 0x7f024c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.743+0000 7f02627fc640 1 --2- 172.21.15.33:0/208326937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64d2390 0x559fc6898d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f024bfff640 1 -- 172.21.15.33:0/1342999911 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f025c0e5ae0 con 0x7f026410dc30 2024-08-28T19:46:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f02627fc640 1 -- 172.21.15.33:0/208326937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64d2390 msgr2=0x559fc6898d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f02627fc640 1 --2- 172.21.15.33:0/208326937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64d2390 0x559fc6898d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f02627fc640 1 -- 172.21.15.33:0/208326937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 msgr2=0x559fc6898800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f02627fc640 1 --2- 172.21.15.33:0/208326937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 0x559fc6898800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f02627fc640 1 -- 172.21.15.33:0/208326937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fc655e650 con 0x559fc64f3070 2024-08-28T19:46:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f0262ffd640 1 --2- 172.21.15.33:0/208326937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 0x559fc6898800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f02627fc640 1 --2- 172.21.15.33:0/208326937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64f3070 0x559fc68982c0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f0258011410 tx=0x7f025800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2b181b5dcedd32 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f02497fa640 1 -- 172.21.15.33:0/208326937 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258005020 con 0x559fc64f3070 2024-08-28T19:46:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f02637fe640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f024c0b4ca0 0x7f024c0b71b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f025c0a90a0 tx=0x7f025c074fa0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f02497fa640 1 -- 172.21.15.33:0/208326937 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02580047a0 con 0x559fc64f3070 2024-08-28T19:46:00.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.744+0000 7f02497fa640 1 -- 172.21.15.33:0/208326937 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02580126b0 con 0x559fc64f3070 2024-08-28T19:46:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.745+0000 7f026f885740 1 -- 172.21.15.33:0/208326937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64f3070 msgr2=0x559fc68982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:00.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.745+0000 7f026f885740 1 --2- 172.21.15.33:0/208326937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64f3070 0x559fc68982c0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f0258011410 tx=0x7f025800a6e0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.745+0000 7f026f885740 1 -- 172.21.15.33:0/208326937 shutdown_connections 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.745+0000 7f026f885740 1 --2- 172.21.15.33:0/208326937 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64d2390 0x559fc6898d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.745+0000 7f026f885740 1 --2- 172.21.15.33:0/208326937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 0x559fc6898800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.745+0000 7f026f885740 1 --2- 172.21.15.33:0/208326937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64f3070 0x559fc68982c0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.745+0000 7f026f885740 1 -- 172.21.15.33:0/208326937 >> 172.21.15.33:0/208326937 conn(0x559fc64e7460 msgr2=0x559fc68961b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.745+0000 7f026f885740 1 -- 172.21.15.33:0/208326937 shutdown_connections 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.745+0000 7f026f885740 1 -- 172.21.15.33:0/208326937 wait complete. 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f026f885740 1 -- start start 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f026f885740 1 Processor -- start 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f026f885740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 0x559fc68a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f026f885740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f026f885740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64f3070 0x559fc68afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f026f885740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559fc6661700 con 0x559fc64d2390 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f026f885740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559fc6785700 con 0x559fc64ca1b0 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f026f885740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559fc68a6aa0 con 0x559fc64f3070 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f026f885740 10 client.0 _ll_register_callbacks cb 0x559fc67b4dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f0262ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f0262ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45440/0 (socket says 172.21.15.33:45440) 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f0262ffd640 1 -- 172.21.15.33:0/3956907738 learned_addr learned my addr 172.21.15.33:0/3956907738 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f02627fc640 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 0x559fc68a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f02627fc640 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64f3070 0x559fc68afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f0262ffd640 1 -- 172.21.15.33:0/3956907738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64f3070 msgr2=0x559fc68afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f0262ffd640 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64f3070 0x559fc68afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f0262ffd640 1 -- 172.21.15.33:0/3956907738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 msgr2=0x559fc68a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.746+0000 7f0262ffd640 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 0x559fc68a3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f0262ffd640 1 -- 172.21.15.33:0/3956907738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fc67be8b0 con 0x559fc64d2390 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f02627fc640 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64f3070 0x559fc68afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f0262ffd640 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a3f90 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f0254009900 tx=0x7f0254031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baa5a724b8831a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f0246ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f0246ff5640 1 -- 172.21.15.33:0/3956907738 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254035040 con 0x559fc64d2390 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f0246ff5640 1 -- 172.21.15.33:0/3956907738 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f0254004240 con 0x559fc64d2390 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f026f885740 1 -- 172.21.15.33:0/3956907738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02580047a0 con 0x559fc64d2390 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f0246ff5640 1 -- 172.21.15.33:0/3956907738 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f025404e050 con 0x559fc64d2390 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f026f885740 10 client.19179 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f026f885740 1 -- 172.21.15.33:0/3956907738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559fc68b2880 con 0x559fc64d2390 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.747+0000 7f0246ff5640 1 -- 172.21.15.33:0/3956907738 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02580047a0 con 0x559fc64d2390 2024-08-28T19:46:00.757 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.748+0000 7f0246ff5640 1 -- 172.21.15.33:0/3956907738 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f02540049b0 con 0x559fc64d2390 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.748+0000 7f026f885740 10 client.19179 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.748+0000 7f026f885740 10 client.19179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.748+0000 7f026f885740 20 client.19179 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.748+0000 7f026f885740 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fc64b19f0 0x559fc68b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.748+0000 7f026f885740 4 client.19179 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.748+0000 7f026f885740 1 -- 172.21.15.33:0/3956907738 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fc6811580 con 0x559fc64b19f0 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.748+0000 7f02627fc640 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fc64b19f0 0x559fc68b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.748+0000 7f02627fc640 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fc64b19f0 0x559fc68b5da0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff4b295541e71bc server_cookie=14aa9220c2157764 in_seq=0 out_seq=0 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.748+0000 7f0246ff5640 10 client.19179 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f0246ff5640 1 -- 172.21.15.33:0/3956907738 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559fc6811580 con 0x559fc64b19f0 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f0246ff5640 10 client.19179 handle_command_reply: tid=0 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f026f885740 1 client.19179 shutdown 2024-08-28T19:46:00.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f026f885740 1 -- 172.21.15.33:0/3956907738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 msgr2=0x559fc68a3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f026f885740 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a3f90 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f0254009900 tx=0x7f0254031810 comp rx=0 tx=0).stop 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f026f885740 1 -- 172.21.15.33:0/3956907738 shutdown_connections 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f026f885740 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64f3070 0x559fc68afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f026f885740 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fc64b19f0 0x559fc68b5da0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f026f885740 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a3f90 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f026f885740 1 --2- 172.21.15.33:0/3956907738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64ca1b0 0x559fc68a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f0246ff5640 0 client.19179 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.749+0000 7f026f885740 1 -- 172.21.15.33:0/3956907738 >> 172.21.15.33:0/3956907738 conn(0x559fc64e7460 msgr2=0x559fc689b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.750+0000 7f026f885740 1 -- 172.21.15.33:0/3956907738 shutdown_connections 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.750+0000 7f026f885740 1 -- 172.21.15.33:0/3956907738 wait complete. 2024-08-28T19:46:00.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.750+0000 7f026f885740 20 client.19179 trim_cache size 0 max 16384 2024-08-28T19:46:00.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.767+0000 7f026f885740 1 Processor -- start 2024-08-28T19:46:00.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.767+0000 7f026f885740 1 -- start start 2024-08-28T19:46:00.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.767+0000 7f026f885740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64ca1b0 0x559fc689b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.767+0000 7f026f885740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64d2390 0x559fc689b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.767+0000 7f026f885740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64f3070 0x559fc68a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.767+0000 7f026f885740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f02641b0be0 con 0x559fc64ca1b0 2024-08-28T19:46:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.767+0000 7f026f885740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02641b2720 con 0x559fc64d2390 2024-08-28T19:46:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.767+0000 7f026f885740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f02641b12b0 con 0x559fc64f3070 2024-08-28T19:46:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f02627fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64ca1b0 0x559fc689b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f02627fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64ca1b0 0x559fc689b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45442/0 (socket says 172.21.15.33:45442) 2024-08-28T19:46:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f02627fc640 1 -- 172.21.15.33:0/381876218 learned_addr learned my addr 172.21.15.33:0/381876218 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f0262ffd640 1 --2- 172.21.15.33:0/381876218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64d2390 0x559fc689b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f02627fc640 1 -- 172.21.15.33:0/381876218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64f3070 msgr2=0x559fc68a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:00.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f02627fc640 1 --2- 172.21.15.33:0/381876218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64f3070 0x559fc68a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f02627fc640 1 -- 172.21.15.33:0/381876218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64d2390 msgr2=0x559fc689b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f02627fc640 1 --2- 172.21.15.33:0/381876218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64d2390 0x559fc689b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f02627fc640 1 -- 172.21.15.33:0/381876218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fc6896aa0 con 0x559fc64ca1b0 2024-08-28T19:46:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f0262ffd640 1 --2- 172.21.15.33:0/381876218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64d2390 0x559fc689b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f02627fc640 1 --2- 172.21.15.33:0/381876218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64ca1b0 0x559fc689b3c0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f0258011d60 tx=0x7f025800ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7241a2fb9d618ca4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f0248ff9640 1 -- 172.21.15.33:0/381876218 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025802e070 con 0x559fc64ca1b0 2024-08-28T19:46:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f0248ff9640 1 -- 172.21.15.33:0/381876218 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0258004b10 con 0x559fc64ca1b0 2024-08-28T19:46:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.768+0000 7f0248ff9640 1 -- 172.21.15.33:0/381876218 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02580052d0 con 0x559fc64ca1b0 2024-08-28T19:46:00.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.769+0000 7f026f885740 1 -- 172.21.15.33:0/381876218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64ca1b0 msgr2=0x559fc689b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:00.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.769+0000 7f026f885740 1 --2- 172.21.15.33:0/381876218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64ca1b0 0x559fc689b3c0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f0258011d60 tx=0x7f025800ae30 comp rx=0 tx=0).stop 2024-08-28T19:46:00.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.769+0000 7f026f885740 1 -- 172.21.15.33:0/381876218 shutdown_connections 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.769+0000 7f026f885740 1 --2- 172.21.15.33:0/381876218 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64f3070 0x559fc68a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.769+0000 7f026f885740 1 --2- 172.21.15.33:0/381876218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64d2390 0x559fc689b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.769+0000 7f026f885740 1 --2- 172.21.15.33:0/381876218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64ca1b0 0x559fc689b3c0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.769+0000 7f026f885740 1 -- 172.21.15.33:0/381876218 >> 172.21.15.33:0/381876218 conn(0x559fc64e7460 msgr2=0x559fc68a22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.769+0000 7f026f885740 1 -- 172.21.15.33:0/381876218 shutdown_connections 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.769+0000 7f026f885740 1 -- 172.21.15.33:0/381876218 wait complete. 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.769+0000 7f026f885740 1 -- start start 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f026f885740 1 Processor -- start 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f026f885740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64ca1b0 0x559fc68a8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f026f885740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f026f885740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64f3070 0x559fc691f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f026f885740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f02641b2050 con 0x559fc64d2390 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f026f885740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02641b1980 con 0x559fc64f3070 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f026f885740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f02641aebe0 con 0x559fc64ca1b0 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f026f885740 10 client.0 _ll_register_callbacks cb 0x7f02540314a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f0262ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f0262ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45444/0 (socket says 172.21.15.33:45444) 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f0262ffd640 1 -- 172.21.15.33:0/3536483118 learned_addr learned my addr 172.21.15.33:0/3536483118 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f02627fc640 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64ca1b0 0x559fc68a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f02627fc640 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64f3070 0x559fc691f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f0262ffd640 1 -- 172.21.15.33:0/3536483118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64ca1b0 msgr2=0x559fc68a8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f0262ffd640 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64ca1b0 0x559fc68a8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f0262ffd640 1 -- 172.21.15.33:0/3536483118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64f3070 msgr2=0x559fc691f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f0262ffd640 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64f3070 0x559fc691f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.770+0000 7f0262ffd640 1 -- 172.21.15.33:0/3536483118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fc691fd10 con 0x559fc64d2390 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f0262ffd640 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a8990 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f0254001eb0 tx=0x7f0254003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26be7c92ad0957d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f0246ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f0246ff5640 1 -- 172.21.15.33:0/3536483118 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0254056020 con 0x559fc64d2390 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f0246ff5640 1 -- 172.21.15.33:0/3536483118 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f02540048d0 con 0x559fc64d2390 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f026f885740 1 -- 172.21.15.33:0/3536483118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0258004b10 con 0x559fc64d2390 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f0246ff5640 1 -- 172.21.15.33:0/3536483118 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f025405e050 con 0x559fc64d2390 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f026f885740 10 client.19185 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f026f885740 1 -- 172.21.15.33:0/3536483118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559fc6920f40 con 0x559fc64d2390 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f0246ff5640 1 -- 172.21.15.33:0/3536483118 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0258004b10 con 0x559fc64d2390 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f0246ff5640 1 -- 172.21.15.33:0/3536483118 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0254045600 con 0x559fc64d2390 2024-08-28T19:46:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f026f885740 10 client.19185 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f026f885740 10 client.19185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f026f885740 20 client.19185 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f026f885740 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fc6486da0 0x559fc69237d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f026f885740 4 client.19185 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.771+0000 7f026f885740 1 -- 172.21.15.33:0/3536483118 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559fc680d020 con 0x559fc6486da0 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.772+0000 7f02627fc640 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fc6486da0 0x559fc69237d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.772+0000 7f0246ff5640 10 client.19185 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.772+0000 7f02627fc640 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fc6486da0 0x559fc69237d0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0c1c730410763b server_cookie=b45475be58ad4abb in_seq=0 out_seq=0 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.772+0000 7f0246ff5640 1 -- 172.21.15.33:0/3536483118 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6054 (crc 0 0 0) 0x559fc680d020 con 0x559fc6486da0 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.772+0000 7f0246ff5640 10 client.19185 handle_command_reply: tid=0 2024-08-28T19:46:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.772+0000 7f026f885740 1 client.19185 shutdown 2024-08-28T19:46:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.772+0000 7f026f885740 1 -- 172.21.15.33:0/3536483118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 msgr2=0x559fc68a8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.772+0000 7f026f885740 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a8990 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f0254001eb0 tx=0x7f0254003820 comp rx=0 tx=0).stop 2024-08-28T19:46:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f026f885740 1 -- 172.21.15.33:0/3536483118 shutdown_connections 2024-08-28T19:46:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f026f885740 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559fc64f3070 0x559fc691f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f026f885740 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x559fc6486da0 0x559fc69237d0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f026f885740 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559fc64d2390 0x559fc68a8990 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f026f885740 1 --2- 172.21.15.33:0/3536483118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559fc64ca1b0 0x559fc68a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f026f885740 1 -- 172.21.15.33:0/3536483118 >> 172.21.15.33:0/3536483118 conn(0x559fc64e7460 msgr2=0x559fc689b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f0246ff5640 0 client.19185 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f026f885740 1 -- 172.21.15.33:0/3536483118 shutdown_connections 2024-08-28T19:46:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f026f885740 1 -- 172.21.15.33:0/3536483118 wait complete. 2024-08-28T19:46:00.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f026f885740 20 client.19185 trim_cache size 0 max 16384 2024-08-28T19:46:00.781 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:46:00.781 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:46:00.781 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:46:00.781 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.784 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.785 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:45:27.534627+0000", 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.786 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.787 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.788 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:46:00.789 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.791 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:46:00.792 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.793 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:00.794 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:00.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:00.795 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:46:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f0269310640 1 -- 172.21.15.33:0/1342999911 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f024c0b4ca0 msgr2=0x7f024c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f0269310640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f024c0b4ca0 0x7f024c0b71b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f025c0a90a0 tx=0x7f025c074fa0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f0269310640 1 -- 172.21.15.33:0/1342999911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f026410dc30 msgr2=0x7f026419fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.773+0000 7f0269310640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f026410dc30 0x7f026419fb20 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f025c00eaa0 tx=0x7f025c00ef60 comp rx=0 tx=0).stop 2024-08-28T19:46:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.774+0000 7f0269310640 1 -- 172.21.15.33:0/1342999911 shutdown_connections 2024-08-28T19:46:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.774+0000 7f0269310640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f026410dc30 0x7f026419fb20 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.774+0000 7f0269310640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0264105120 0x7f026419a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.774+0000 7f0269310640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f024c0b4ca0 0x7f024c0b71b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.774+0000 7f0269310640 1 --2- 172.21.15.33:0/1342999911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f02641047d0 0x7f026419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.774+0000 7f0269310640 1 -- 172.21.15.33:0/1342999911 >> 172.21.15.33:0/1342999911 conn(0x7f0264079510 msgr2=0x7f02641005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.774+0000 7f0269310640 1 -- 172.21.15.33:0/1342999911 shutdown_connections 2024-08-28T19:46:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:00.774+0000 7f0269310640 1 -- 172.21.15.33:0/1342999911 wait complete. 2024-08-28T19:46:01.704 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:46:01.704 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:46:02.005 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:02.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:01 smithi059 ceph-mon[22052]: pgmap v763: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 16 op/s 2024-08-28T19:46:02.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:01 smithi122 ceph-mon[22174]: pgmap v763: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 16 op/s 2024-08-28T19:46:02.125 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:01 smithi033 ceph-mon[18549]: pgmap v763: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 85 KiB/s wr, 16 op/s 2024-08-28T19:46:02.411 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.7 2024-08-28T19:46:02.411 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.516+0000 7f05fd114640 1 -- 172.21.15.33:0/4096950176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05f8102880 msgr2=0x7f05f8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.516+0000 7f05fd114640 1 --2- 172.21.15.33:0/4096950176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05f8102880 0x7f05f8102c90 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009900 tx=0x7f05e802a410 comp rx=0 tx=0).stop 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.516+0000 7f05fd114640 1 -- 172.21.15.33:0/4096950176 shutdown_connections 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.516+0000 7f05fd114640 1 --2- 172.21.15.33:0/4096950176 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05f8108ac0 0x7f05f810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.516+0000 7f05fd114640 1 --2- 172.21.15.33:0/4096950176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05f8108170 0x7f05f8108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.516+0000 7f05fd114640 1 --2- 172.21.15.33:0/4096950176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05f8102880 0x7f05f8102c90 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.516+0000 7f05fd114640 1 -- 172.21.15.33:0/4096950176 >> 172.21.15.33:0/4096950176 conn(0x7f05f8079530 msgr2=0x7f05f8079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.516+0000 7f05fd114640 1 -- 172.21.15.33:0/4096950176 shutdown_connections 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.516+0000 7f05fd114640 1 -- 172.21.15.33:0/4096950176 wait complete. 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05fd114640 1 Processor -- start 2024-08-28T19:46:02.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05fd114640 1 -- start start 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05fd114640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05f8102880 0x7f05f819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05fd114640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05f8108170 0x7f05f819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05fd114640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05f8108ac0 0x7f05f819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05fd114640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81138a0 con 0x7f05f8102880 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05fd114640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f05f8113720 con 0x7f05f8108ac0 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05fd114640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f05f8113a20 con 0x7f05f8108170 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05f6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05f8102880 0x7f05f819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05f6d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05f8102880 0x7f05f819a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45456/0 (socket says 172.21.15.33:45456) 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05f6d9d640 1 -- 172.21.15.33:0/1425484480 learned_addr learned my addr 172.21.15.33:0/1425484480 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.517+0000 7f05f759e640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05f8108ac0 0x7f05f819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05f659c640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05f8108170 0x7f05f819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05f6d9d640 1 -- 172.21.15.33:0/1425484480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05f8108170 msgr2=0x7f05f819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:02.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05f6d9d640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05f8108170 0x7f05f819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05f6d9d640 1 -- 172.21.15.33:0/1425484480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05f8108ac0 msgr2=0x7f05f819fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05f6d9d640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05f8108ac0 0x7f05f819fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05f6d9d640 1 -- 172.21.15.33:0/1425484480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f81a00e0 con 0x7f05f8102880 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05f659c640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05f8108170 0x7f05f819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05f6d9d640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05f8102880 0x7f05f819a230 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f05e8005940 tx=0x7f05e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05effff640 1 -- 172.21.15.33:0/1425484480 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e803f030 con 0x7f05f8102880 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05fd114640 1 -- 172.21.15.33:0/1425484480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f81a0370 con 0x7f05f8102880 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05fd114640 1 -- 172.21.15.33:0/1425484480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f81a08a0 con 0x7f05f8102880 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05effff640 1 -- 172.21.15.33:0/1425484480 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05e8003cb0 con 0x7f05f8102880 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.518+0000 7f05effff640 1 -- 172.21.15.33:0/1425484480 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8035070 con 0x7f05f8102880 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.519+0000 7f05fd114640 1 -- 172.21.15.33:0/1425484480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f8102c90 con 0x7f05f8102880 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.521+0000 7f05effff640 1 -- 172.21.15.33:0/1425484480 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f05e8042030 con 0x7f05f8102880 2024-08-28T19:46:02.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.522+0000 7f05effff640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05e40b4cd0 0x7f05e40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:02.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.522+0000 7f05f659c640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05e40b4cd0 0x7f05e40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:02.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.522+0000 7f05effff640 1 -- 172.21.15.33:0/1425484480 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7f05e81060c0 con 0x7f05f8102880 2024-08-28T19:46:02.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.524+0000 7f05f659c640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05e40b4cd0 0x7f05e40b71e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f05f8104840 tx=0x7f05e0005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:02.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.526+0000 7f05effff640 1 -- 172.21.15.33:0/1425484480 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f05f81a08a0 con 0x7f05f8102880 2024-08-28T19:46:02.681 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:02.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.770+0000 7f05fd114640 1 -- 172.21.15.33:0/1425484480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05f810a890 con 0x7f05f8102880 2024-08-28T19:46:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.771+0000 7f05effff640 1 -- 172.21.15.33:0/1425484480 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f05e80ccab0 con 0x7f05f8102880 2024-08-28T19:46:02.772 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:46:02.772 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:46:02.773 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:46:02.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.773+0000 7f05fd114640 1 -- 172.21.15.33:0/1425484480 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05e40b4cd0 msgr2=0x7f05e40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:02.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.773+0000 7f05fd114640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05e40b4cd0 0x7f05e40b71e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f05f8104840 tx=0x7f05e0005e50 comp rx=0 tx=0).stop 2024-08-28T19:46:02.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.773+0000 7f05fd114640 1 -- 172.21.15.33:0/1425484480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05f8102880 msgr2=0x7f05f819a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:02.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.773+0000 7f05fd114640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05f8102880 0x7f05f819a230 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f05e8005940 tx=0x7f05e80042f0 comp rx=0 tx=0).stop 2024-08-28T19:46:02.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.773+0000 7f05fd114640 1 -- 172.21.15.33:0/1425484480 shutdown_connections 2024-08-28T19:46:02.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.773+0000 7f05fd114640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05f8108ac0 0x7f05f819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:02.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.773+0000 7f05fd114640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f05e40b4cd0 0x7f05e40b71e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:02.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.773+0000 7f05fd114640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f05f8108170 0x7f05f819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:02.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.773+0000 7f05fd114640 1 --2- 172.21.15.33:0/1425484480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05f8102880 0x7f05f819a230 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:02.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.773+0000 7f05fd114640 1 -- 172.21.15.33:0/1425484480 >> 172.21.15.33:0/1425484480 conn(0x7f05f8079530 msgr2=0x7f05f8106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:02.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.774+0000 7f05fd114640 1 -- 172.21.15.33:0/1425484480 shutdown_connections 2024-08-28T19:46:02.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:02.774+0000 7f05fd114640 1 -- 172.21.15.33:0/1425484480 wait complete. 2024-08-28T19:46:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.364+0000 7fa75f85d640 1 -- 172.21.15.33:0/4234112888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758075ea0 msgr2=0x7fa75810f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.364+0000 7fa75f85d640 1 --2- 172.21.15.33:0/4234112888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758075ea0 0x7fa75810f920 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fa748009900 tx=0x7fa74802a410 comp rx=0 tx=0).stop 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.364+0000 7fa75f85d640 1 -- 172.21.15.33:0/4234112888 shutdown_connections 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.364+0000 7fa75f85d640 1 --2- 172.21.15.33:0/4234112888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75810fe60 0x7fa7581122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.364+0000 7fa75f85d640 1 --2- 172.21.15.33:0/4234112888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758075ea0 0x7fa75810f920 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.364+0000 7fa75f85d640 1 --2- 172.21.15.33:0/4234112888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa758075550 0x7fa758075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.364+0000 7fa75f85d640 1 -- 172.21.15.33:0/4234112888 >> 172.21.15.33:0/4234112888 conn(0x7fa75807b5f0 msgr2=0x7fa75807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.364+0000 7fa75f85d640 1 -- 172.21.15.33:0/4234112888 shutdown_connections 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.364+0000 7fa75f85d640 1 -- 172.21.15.33:0/4234112888 wait complete. 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.365+0000 7fa75f85d640 1 Processor -- start 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.365+0000 7fa75f85d640 1 -- start start 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.365+0000 7fa75f85d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758075550 0x7fa75819c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:03.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.365+0000 7fa75f85d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa758075ea0 0x7fa75819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.365+0000 7fa75f85d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75810fe60 0x7fa7581a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.365+0000 7fa75f85d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa758115a10 con 0x7fa758075550 2024-08-28T19:46:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.365+0000 7fa75f85d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa758115890 con 0x7fa75810fe60 2024-08-28T19:46:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.365+0000 7fa75f85d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa758115b90 con 0x7fa758075ea0 2024-08-28T19:46:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.365+0000 7fa75d5f9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758075550 0x7fa75819c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.365+0000 7fa75d5f9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758075550 0x7fa75819c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45466/0 (socket says 172.21.15.33:45466) 2024-08-28T19:46:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75d5f9640 1 -- 172.21.15.33:0/2362130053 learned_addr learned my addr 172.21.15.33:0/2362130053 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75cdf8640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa758075ea0 0x7fa75819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75ddfa640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75810fe60 0x7fa7581a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:03.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75d5f9640 1 -- 172.21.15.33:0/2362130053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa758075ea0 msgr2=0x7fa75819c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75d5f9640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa758075ea0 0x7fa75819c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75d5f9640 1 -- 172.21.15.33:0/2362130053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75810fe60 msgr2=0x7fa7581a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75d5f9640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75810fe60 0x7fa7581a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75d5f9640 1 -- 172.21.15.33:0/2362130053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7581a2350 con 0x7fa758075550 2024-08-28T19:46:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75d5f9640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758075550 0x7fa75819c3e0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fa75400d770 tx=0x7fa75400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa74e7fc640 1 -- 172.21.15.33:0/2362130053 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754017070 con 0x7fa758075550 2024-08-28T19:46:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75f85d640 1 -- 172.21.15.33:0/2362130053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7581a2640 con 0x7fa758075550 2024-08-28T19:46:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa74e7fc640 1 -- 172.21.15.33:0/2362130053 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7540054d0 con 0x7fa758075550 2024-08-28T19:46:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa74e7fc640 1 -- 172.21.15.33:0/2362130053 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754004c30 con 0x7fa758075550 2024-08-28T19:46:03.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.366+0000 7fa75f85d640 1 -- 172.21.15.33:0/2362130053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7581a8da0 con 0x7fa758075550 2024-08-28T19:46:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.367+0000 7fa75f85d640 1 -- 172.21.15.33:0/2362130053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa758076a60 con 0x7fa758075550 2024-08-28T19:46:03.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.369+0000 7fa74e7fc640 1 -- 172.21.15.33:0/2362130053 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa754004dd0 con 0x7fa758075550 2024-08-28T19:46:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.370+0000 7fa74e7fc640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7440b4ca0 0x7fa7440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.370+0000 7fa75cdf8640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7440b4ca0 0x7fa7440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.370+0000 7fa74e7fc640 1 -- 172.21.15.33:0/2362130053 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9453+0+0 (secure 0 0 0) 0x7fa7540e58a0 con 0x7fa758075550 2024-08-28T19:46:03.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.370+0000 7fa75cdf8640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7440b4ca0 0x7fa7440b71b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa748000c00 tx=0x7fa748031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:03.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.373+0000 7fa74e7fc640 1 -- 172.21.15.33:0/2362130053 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa7540ac290 con 0x7fa758075550 2024-08-28T19:46:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.602+0000 7fa75f85d640 1 -- 172.21.15.33:0/2362130053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa758075960 con 0x7fa758075550 2024-08-28T19:46:03.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.603+0000 7fa74e7fc640 1 -- 172.21.15.33:0/2362130053 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fa7540abb90 con 0x7fa758075550 2024-08-28T19:46:03.604 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:46:03.604 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:46:03.604 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:46:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 -- 172.21.15.33:0/2362130053 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7440b4ca0 msgr2=0x7fa7440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7440b4ca0 0x7fa7440b71b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa748000c00 tx=0x7fa748031400 comp rx=0 tx=0).stop 2024-08-28T19:46:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 -- 172.21.15.33:0/2362130053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758075550 msgr2=0x7fa75819c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758075550 0x7fa75819c3e0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fa75400d770 tx=0x7fa75400dc30 comp rx=0 tx=0).stop 2024-08-28T19:46:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 -- 172.21.15.33:0/2362130053 shutdown_connections 2024-08-28T19:46:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75810fe60 0x7fa7581a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa7440b4ca0 0x7fa7440b71b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa758075ea0 0x7fa75819c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 --2- 172.21.15.33:0/2362130053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa758075550 0x7fa75819c3e0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 -- 172.21.15.33:0/2362130053 >> 172.21.15.33:0/2362130053 conn(0x7fa75807b5f0 msgr2=0x7fa758101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 -- 172.21.15.33:0/2362130053 shutdown_connections 2024-08-28T19:46:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:03.605+0000 7fa75f85d640 1 -- 172.21.15.33:0/2362130053 wait complete. 2024-08-28T19:46:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:03 smithi033 ceph-mon[18549]: pgmap v764: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 13 op/s 2024-08-28T19:46:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:03 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1425484480' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:03 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2362130053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:04.022 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:46:04.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:03 smithi059 ceph-mon[22052]: pgmap v764: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 13 op/s 2024-08-28T19:46:04.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:03 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1425484480' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:04.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:03 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2362130053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:04.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:03 smithi122 ceph-mon[22174]: pgmap v764: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 13 op/s 2024-08-28T19:46:04.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:03 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1425484480' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:04.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:03 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2362130053' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:04.361 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:04.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:46:04.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:46:04.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:46:04.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:46:04.941 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 145.7 --await-for 45.0' 2024-08-28T19:46:04.941 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 145.7 --await-for 45.0 2024-08-28T19:46:05.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:46:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:46:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:46:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:46:05.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:46:05.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:46:05.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:46:05.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:46:05.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.412+0000 7fd276993640 1 -- 172.21.15.33:0/416738220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270109240 msgr2=0x7fd270109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:05.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.412+0000 7fd276993640 1 --2- 172.21.15.33:0/416738220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270109240 0x7fd270109650 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fd264009900 tx=0x7fd26402a410 comp rx=0 tx=0).stop 2024-08-28T19:46:05.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.412+0000 7fd276993640 1 -- 172.21.15.33:0/416738220 shutdown_connections 2024-08-28T19:46:05.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.412+0000 7fd276993640 1 --2- 172.21.15.33:0/416738220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd270109b90 0x7fd2701103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.412+0000 7fd276993640 1 --2- 172.21.15.33:0/416738220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270109240 0x7fd270109650 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.412+0000 7fd276993640 1 --2- 172.21.15.33:0/416738220 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd270103900 0x7fd270103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.412+0000 7fd276993640 1 -- 172.21.15.33:0/416738220 >> 172.21.15.33:0/416738220 conn(0x7fd27007b5f0 msgr2=0x7fd27007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.413+0000 7fd276993640 1 -- 172.21.15.33:0/416738220 shutdown_connections 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.413+0000 7fd276993640 1 -- 172.21.15.33:0/416738220 wait complete. 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.413+0000 7fd276993640 1 Processor -- start 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.413+0000 7fd276993640 1 -- start start 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd276993640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270103900 0x7fd27019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd276993640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd270109240 0x7fd27019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd276993640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd270109b90 0x7fd27019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd276993640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd270113850 con 0x7fd270103900 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd276993640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701136d0 con 0x7fd270109b90 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd276993640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701139d0 con 0x7fd270109240 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270103900 0x7fd27019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270103900 0x7fd27019a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45482/0 (socket says 172.21.15.33:45482) 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26ffff640 1 -- 172.21.15.33:0/2563315383 learned_addr learned my addr 172.21.15.33:0/2563315383 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26f7fe640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd270109240 0x7fd27019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd274f30640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd270109b90 0x7fd27019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26ffff640 1 -- 172.21.15.33:0/2563315383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd270109240 msgr2=0x7fd27019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26ffff640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd270109240 0x7fd27019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26ffff640 1 -- 172.21.15.33:0/2563315383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd270109b90 msgr2=0x7fd27019fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26ffff640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd270109b90 0x7fd27019fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26ffff640 1 -- 172.21.15.33:0/2563315383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2701a01b0 con 0x7fd270103900 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26ffff640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270103900 0x7fd27019a240 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fd26000e9f0 tx=0x7fd26000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.414+0000 7fd26d7fa640 1 -- 172.21.15.33:0/2563315383 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26000cd80 con 0x7fd270103900 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.415+0000 7fd276993640 1 -- 172.21.15.33:0/2563315383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2701a04a0 con 0x7fd270103900 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.415+0000 7fd26d7fa640 1 -- 172.21.15.33:0/2563315383 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2600054d0 con 0x7fd270103900 2024-08-28T19:46:05.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.415+0000 7fd26d7fa640 1 -- 172.21.15.33:0/2563315383 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd260010690 con 0x7fd270103900 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.415+0000 7fd276993640 1 -- 172.21.15.33:0/2563315383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2701a6c00 con 0x7fd270103900 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.417+0000 7fd26d7fa640 1 -- 172.21.15.33:0/2563315383 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd260004e90 con 0x7fd270103900 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.417+0000 7fd27cf08740 1 Processor -- start 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.417+0000 7fd27cf08740 1 -- start start 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f0a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 0x558852f0a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b44390 0x558852f0ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd27cf08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558852e81680 con 0x558852b44390 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd27cf08740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558852e70c10 con 0x558852b3c1b0 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd27cf08740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558852e74bc0 con 0x558852b65070 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd26f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b44390 0x558852f0ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd26f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b44390 0x558852f0ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45484/0 (socket says 172.21.15.33:45484) 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd26f7fe640 1 -- 172.21.15.33:0/1284948773 learned_addr learned my addr 172.21.15.33:0/1284948773 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd26ffff640 1 --2- 172.21.15.33:0/1284948773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 0x558852f0a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd274f30640 1 --2- 172.21.15.33:0/1284948773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f0a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd26d7fa640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2580b4d20 0x7fd2580b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd274f30640 1 -- 172.21.15.33:0/1284948773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 msgr2=0x558852f0a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd274f30640 1 --2- 172.21.15.33:0/1284948773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 0x558852f0a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd274f30640 1 -- 172.21.15.33:0/1284948773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b44390 msgr2=0x558852f0ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd274f30640 1 --2- 172.21.15.33:0/1284948773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b44390 0x558852f0ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd274f30640 1 -- 172.21.15.33:0/1284948773 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558852bd0650 con 0x558852b65070 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.418+0000 7fd26f7fe640 1 --2- 172.21.15.33:0/1284948773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b44390 0x558852f0ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.419+0000 7fd274f30640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2580b4d20 0x7fd2580b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.419+0000 7fd26d7fa640 1 -- 172.21.15.33:0/2563315383 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7fd2600e5d60 con 0x7fd270103900 2024-08-28T19:46:05.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.419+0000 7fd274f30640 1 --2- 172.21.15.33:0/1284948773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f0a310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd268010440 tx=0x7fd268010900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4828c3cbb832b1b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.419+0000 7fd274f30640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2580b4d20 0x7fd2580b7230 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd268021000 tx=0x7fd26801e000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.419+0000 7fd2567fc640 1 -- 172.21.15.33:0/1284948773 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26801d910 con 0x558852b65070 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.419+0000 7fd2567fc640 1 -- 172.21.15.33:0/1284948773 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd26801c440 con 0x558852b65070 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.419+0000 7fd2567fc640 1 -- 172.21.15.33:0/1284948773 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd268011600 con 0x558852b65070 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.420+0000 7fd27cf08740 1 -- 172.21.15.33:0/1284948773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 msgr2=0x558852f0a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.420+0000 7fd27cf08740 1 --2- 172.21.15.33:0/1284948773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f0a310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd268010440 tx=0x7fd268010900 comp rx=0 tx=0).stop 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.420+0000 7fd27cf08740 1 -- 172.21.15.33:0/1284948773 shutdown_connections 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.420+0000 7fd27cf08740 1 --2- 172.21.15.33:0/1284948773 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b44390 0x558852f0ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.420+0000 7fd27cf08740 1 --2- 172.21.15.33:0/1284948773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 0x558852f0a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.420+0000 7fd27cf08740 1 --2- 172.21.15.33:0/1284948773 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f0a310 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.420+0000 7fd27cf08740 1 -- 172.21.15.33:0/1284948773 >> 172.21.15.33:0/1284948773 conn(0x558852b59460 msgr2=0x558852f08200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.420+0000 7fd27cf08740 1 -- 172.21.15.33:0/1284948773 shutdown_connections 2024-08-28T19:46:05.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.420+0000 7fd27cf08740 1 -- 172.21.15.33:0/1284948773 wait complete. 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.420+0000 7fd27cf08740 1 -- start start 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd27cf08740 1 Processor -- start 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f19e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b44390 0x558852f1a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f261a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd27cf08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558852cd3700 con 0x558852b3c1b0 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd27cf08740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558852df7750 con 0x558852b44390 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd27cf08740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558852f1cdf0 con 0x558852b65070 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd27cf08740 10 client.0 _ll_register_callbacks cb 0x558852e26e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f19e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45498/0 (socket says 172.21.15.33:45498) 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd26ffff640 1 -- 172.21.15.33:0/2347512472 learned_addr learned my addr 172.21.15.33:0/2347512472 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd26f7fe640 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b44390 0x558852f1a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd274f30640 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f261a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd26ffff640 1 -- 172.21.15.33:0/2347512472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 msgr2=0x558852f261a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd26ffff640 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f261a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd26ffff640 1 -- 172.21.15.33:0/2347512472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b44390 msgr2=0x558852f1a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.421+0000 7fd26ffff640 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b44390 0x558852f1a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd26ffff640 1 -- 172.21.15.33:0/2347512472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558852e30900 con 0x558852b3c1b0 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd274f30640 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f261a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd26ffff640 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f19e70 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fd2600e30b0 tx=0x7fd2600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3093c465a86f940 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd24f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2347512472 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd260005180 con 0x558852b3c1b0 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2347512472 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7fd2600b5080 con 0x558852b3c1b0 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd27cf08740 1 -- 172.21.15.33:0/2347512472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd26801c440 con 0x558852b3c1b0 2024-08-28T19:46:05.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2347512472 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2600e34e0 con 0x558852b3c1b0 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd27cf08740 10 client.19209 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd27cf08740 1 -- 172.21.15.33:0/2347512472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558852f28c80 con 0x558852b3c1b0 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2347512472 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd26801c440 con 0x558852b3c1b0 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2347512472 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd2600970f0 con 0x558852b3c1b0 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.422+0000 7fd27cf08740 10 client.19209 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.423+0000 7fd27cf08740 10 client.19209 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.423+0000 7fd27cf08740 20 client.19209 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.423+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558852b239f0 0x558852f2c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.423+0000 7fd27cf08740 4 client.19209 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.423+0000 7fd27cf08740 1 -- 172.21.15.33:0/2347512472 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558852e835d0 con 0x558852b239f0 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.423+0000 7fd26f7fe640 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558852b239f0 0x558852f2c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.423+0000 7fd24f7fe640 10 client.19209 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:46:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.423+0000 7fd26f7fe640 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558852b239f0 0x558852f2c170 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8a76a6ff3dc31c48 server_cookie=405d4ec45a485946 in_seq=0 out_seq=0 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2347512472 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558852e835d0 con 0x558852b239f0 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd24f7fe640 10 client.19209 handle_command_reply: tid=0 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd27cf08740 1 client.19209 shutdown 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd27cf08740 1 -- 172.21.15.33:0/2347512472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 msgr2=0x558852f19e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f19e70 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fd2600e30b0 tx=0x7fd2600048f0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd27cf08740 1 -- 172.21.15.33:0/2347512472 shutdown_connections 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558852b239f0 0x558852f2c170 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f261a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b44390 0x558852f1a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd24f7fe640 0 client.19209 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2347512472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f19e70 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd27cf08740 1 -- 172.21.15.33:0/2347512472 >> 172.21.15.33:0/2347512472 conn(0x558852b59460 msgr2=0x558852f0bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.424+0000 7fd27cf08740 1 -- 172.21.15.33:0/2347512472 shutdown_connections 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.425+0000 7fd27cf08740 1 -- 172.21.15.33:0/2347512472 wait complete. 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.425+0000 7fd27cf08740 20 client.19209 trim_cache size 0 max 16384 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd27cf08740 1 Processor -- start 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd27cf08740 1 -- start start 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f260a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b44390 0x558852f07b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd27cf08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701aeba0 con 0x558852b3c1b0 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd27cf08740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701b06e0 con 0x558852b44390 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd27cf08740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701af270 con 0x558852b65070 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45504/0 (socket says 172.21.15.33:45504) 2024-08-28T19:46:05.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd26ffff640 1 -- 172.21.15.33:0/1064299233 learned_addr learned my addr 172.21.15.33:0/1064299233 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd26ffff640 1 -- 172.21.15.33:0/1064299233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 msgr2=0x558852f080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd26ffff640 1 --2- 172.21.15.33:0/1064299233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd26ffff640 1 -- 172.21.15.33:0/1064299233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b44390 msgr2=0x558852f07b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd26ffff640 1 --2- 172.21.15.33:0/1064299233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b44390 0x558852f07b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.438+0000 7fd26ffff640 1 -- 172.21.15.33:0/1064299233 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558852f0d0d0 con 0x558852b3c1b0 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.439+0000 7fd26ffff640 1 --2- 172.21.15.33:0/1064299233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f260a0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fd2600a8070 tx=0x7fd2600b0860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf26f242cf7a3a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.439+0000 7fd255ffb640 1 -- 172.21.15.33:0/1064299233 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2600c6070 con 0x558852b3c1b0 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.439+0000 7fd255ffb640 1 -- 172.21.15.33:0/1064299233 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd260005680 con 0x558852b3c1b0 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.439+0000 7fd255ffb640 1 -- 172.21.15.33:0/1064299233 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2600abff0 con 0x558852b3c1b0 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.440+0000 7fd27cf08740 1 -- 172.21.15.33:0/1064299233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 msgr2=0x558852f260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.440+0000 7fd27cf08740 1 --2- 172.21.15.33:0/1064299233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f260a0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fd2600a8070 tx=0x7fd2600b0860 comp rx=0 tx=0).stop 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.440+0000 7fd27cf08740 1 -- 172.21.15.33:0/1064299233 shutdown_connections 2024-08-28T19:46:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.440+0000 7fd27cf08740 1 --2- 172.21.15.33:0/1064299233 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b65070 0x558852f080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.440+0000 7fd27cf08740 1 --2- 172.21.15.33:0/1064299233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b44390 0x558852f07b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.440+0000 7fd27cf08740 1 --2- 172.21.15.33:0/1064299233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b3c1b0 0x558852f260a0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.440+0000 7fd27cf08740 1 -- 172.21.15.33:0/1064299233 >> 172.21.15.33:0/1064299233 conn(0x558852b59460 msgr2=0x558852f186f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.440+0000 7fd27cf08740 1 -- 172.21.15.33:0/1064299233 shutdown_connections 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.440+0000 7fd27cf08740 1 -- 172.21.15.33:0/1064299233 wait complete. 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.440+0000 7fd27cf08740 1 -- start start 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd27cf08740 1 Processor -- start 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 0x558852f22a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b44390 0x558852f1ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd27cf08740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b65070 0x558852f1f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd27cf08740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701b0010 con 0x558852b65070 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd27cf08740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701af940 con 0x558852b3c1b0 2024-08-28T19:46:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd27cf08740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701acba0 con 0x558852b44390 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd27cf08740 10 client.0 _ll_register_callbacks cb 0x7fd26000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd274f30640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b65070 0x558852f1f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd274f30640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b65070 0x558852f1f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45516/0 (socket says 172.21.15.33:45516) 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd274f30640 1 -- 172.21.15.33:0/2377879479 learned_addr learned my addr 172.21.15.33:0/2377879479 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.441+0000 7fd26ffff640 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 0x558852f22a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd26f7fe640 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b44390 0x558852f1ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd26ffff640 1 -- 172.21.15.33:0/2377879479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b44390 msgr2=0x558852f1ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd26ffff640 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b44390 0x558852f1ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd26ffff640 1 -- 172.21.15.33:0/2377879479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b65070 msgr2=0x558852f1f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd26ffff640 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b65070 0x558852f1f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd26ffff640 1 -- 172.21.15.33:0/2377879479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558852f96b40 con 0x558852b3c1b0 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd274f30640 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b65070 0x558852f1f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd26ffff640 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 0x558852f22a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd2600abcf0 tx=0x7fd260009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6bc45d1aa296d56 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd24f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2377879479 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2600cb060 con 0x558852b3c1b0 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd27cf08740 1 -- 172.21.15.33:0/2377879479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd260005680 con 0x558852b3c1b0 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.442+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2377879479 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7fd2600ab250 con 0x558852b3c1b0 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2377879479 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2600c6040 con 0x558852b3c1b0 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd27cf08740 10 client.28052 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd27cf08740 1 -- 172.21.15.33:0/2377879479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558852f96b40 con 0x558852b3c1b0 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2377879479 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd260005680 con 0x558852b3c1b0 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2377879479 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd2600cd2b0 con 0x558852b3c1b0 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd27cf08740 10 client.28052 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd27cf08740 10 client.28052 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd27cf08740 20 client.28052 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:05.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558852af8da0 0x558852f99ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd27cf08740 4 client.28052 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:46:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd27cf08740 1 -- 172.21.15.33:0/2377879479 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558852f1a7e0 con 0x558852af8da0 2024-08-28T19:46:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.443+0000 7fd26f7fe640 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558852af8da0 0x558852f99ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.444+0000 7fd24f7fe640 10 client.28052 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:46:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.444+0000 7fd26f7fe640 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558852af8da0 0x558852f99ef0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=454af9b4e574d959 server_cookie=b0e21c5ed5e39317 in_seq=0 out_seq=0 2024-08-28T19:46:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.444+0000 7fd24f7fe640 1 -- 172.21.15.33:0/2377879479 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558852f1a7e0 con 0x558852af8da0 2024-08-28T19:46:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.444+0000 7fd24f7fe640 10 client.28052 handle_command_reply: tid=0 2024-08-28T19:46:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.444+0000 7fd27cf08740 1 client.28052 shutdown 2024-08-28T19:46:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 1 -- 172.21.15.33:0/2377879479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 msgr2=0x558852f22a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 0x558852f22a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd2600abcf0 tx=0x7fd260009310 comp rx=0 tx=0).stop 2024-08-28T19:46:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 1 -- 172.21.15.33:0/2377879479 shutdown_connections 2024-08-28T19:46:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x558852af8da0 0x558852f99ef0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558852b65070 0x558852f1f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558852b44390 0x558852f1ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 1 --2- 172.21.15.33:0/2377879479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558852b3c1b0 0x558852f22a60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 1 -- 172.21.15.33:0/2377879479 >> 172.21.15.33:0/2377879479 conn(0x558852b59460 msgr2=0x558852f07b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd24f7fe640 0 client.28052 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:46:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 1 -- 172.21.15.33:0/2377879479 shutdown_connections 2024-08-28T19:46:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 1 -- 172.21.15.33:0/2377879479 wait complete. 2024-08-28T19:46:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.445+0000 7fd27cf08740 20 client.28052 trim_cache size 0 max 16384 2024-08-28T19:46:05.462 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:46:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 -- 172.21.15.33:0/2563315383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2580b4d20 msgr2=0x7fd2580b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2580b4d20 0x7fd2580b7230 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd268021000 tx=0x7fd26801e000 comp rx=0 tx=0).stop 2024-08-28T19:46:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 -- 172.21.15.33:0/2563315383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270103900 msgr2=0x7fd27019a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270103900 0x7fd27019a240 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fd26000e9f0 tx=0x7fd26000edf0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 -- 172.21.15.33:0/2563315383 shutdown_connections 2024-08-28T19:46:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd270109b90 0x7fd27019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd2580b4d20 0x7fd2580b7230 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd270109240 0x7fd27019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 --2- 172.21.15.33:0/2563315383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270103900 0x7fd27019a240 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:05.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 -- 172.21.15.33:0/2563315383 >> 172.21.15.33:0/2563315383 conn(0x7fd27007b5f0 msgr2=0x7fd270107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:05.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 -- 172.21.15.33:0/2563315383 shutdown_connections 2024-08-28T19:46:05.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:05.446+0000 7fd276993640 1 -- 172.21.15.33:0/2563315383 wait complete. 2024-08-28T19:46:05.709 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:05.816 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:05 smithi033 ceph-mon[18549]: pgmap v765: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 134 KiB/s wr, 35 op/s 2024-08-28T19:46:05.816 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:05 smithi033 ceph-mon[18549]: osdmap e99: 12 total, 12 up, 12 in 2024-08-28T19:46:05.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:05 smithi059 ceph-mon[22052]: pgmap v765: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 134 KiB/s wr, 35 op/s 2024-08-28T19:46:05.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:05 smithi059 ceph-mon[22052]: osdmap e99: 12 total, 12 up, 12 in 2024-08-28T19:46:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:05 smithi122 ceph-mon[22174]: pgmap v765: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 134 KiB/s wr, 35 op/s 2024-08-28T19:46:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:05 smithi122 ceph-mon[22174]: osdmap e99: 12 total, 12 up, 12 in 2024-08-28T19:46:06.162 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:46:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.682+0000 7faa64c25640 1 -- 172.21.15.33:0/1725316277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa60109290 msgr2=0x7faa601096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.682+0000 7faa64c25640 1 --2- 172.21.15.33:0/1725316277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa60109290 0x7faa601096a0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7faa54009900 tx=0x7faa5402a410 comp rx=0 tx=0).stop 2024-08-28T19:46:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.682+0000 7faa64c25640 1 -- 172.21.15.33:0/1725316277 shutdown_connections 2024-08-28T19:46:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.682+0000 7faa64c25640 1 --2- 172.21.15.33:0/1725316277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa60109be0 0x7faa60110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.682+0000 7faa64c25640 1 --2- 172.21.15.33:0/1725316277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa60109290 0x7faa601096a0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.682+0000 7faa64c25640 1 --2- 172.21.15.33:0/1725316277 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa60103950 0x7faa60103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.682+0000 7faa64c25640 1 -- 172.21.15.33:0/1725316277 >> 172.21.15.33:0/1725316277 conn(0x7faa600ff3a0 msgr2=0x7faa601017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.682+0000 7faa64c25640 1 -- 172.21.15.33:0/1725316277 shutdown_connections 2024-08-28T19:46:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.682+0000 7faa64c25640 1 -- 172.21.15.33:0/1725316277 wait complete. 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.683+0000 7faa64c25640 1 Processor -- start 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.683+0000 7faa64c25640 1 -- start start 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.683+0000 7faa64c25640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa60103950 0x7faa6019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.683+0000 7faa64c25640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa60109290 0x7faa6019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.683+0000 7faa64c25640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa60109be0 0x7faa6019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa64c25640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faa60113990 con 0x7faa60109be0 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa64c25640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faa60113810 con 0x7faa60103950 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa64c25640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faa60113b10 con 0x7faa60109290 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa60109be0 0x7faa6019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa60103950 0x7faa6019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa60103950 0x7faa6019a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:33100/0 (socket says 172.21.15.33:33100) 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa60109be0 0x7faa6019fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45534/0 (socket says 172.21.15.33:45534) 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5e59c640 1 -- 172.21.15.33:0/127263441 learned_addr learned my addr 172.21.15.33:0/127263441 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa60109290 0x7faa6019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5ed9d640 1 -- 172.21.15.33:0/127263441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa60109290 msgr2=0x7faa6019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5ed9d640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa60109290 0x7faa6019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5ed9d640 1 -- 172.21.15.33:0/127263441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa60103950 msgr2=0x7faa6019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5ed9d640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa60103950 0x7faa6019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5ed9d640 1 -- 172.21.15.33:0/127263441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa601a0330 con 0x7faa60109be0 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.684+0000 7faa5ed9d640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa60109be0 0x7faa6019fc00 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7faa5800be20 tx=0x7faa5800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.685+0000 7faa4f7fe640 1 -- 172.21.15.33:0/127263441 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa58019070 con 0x7faa60109be0 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.685+0000 7faa64c25640 1 -- 172.21.15.33:0/127263441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa601a0620 con 0x7faa60109be0 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.685+0000 7faa4f7fe640 1 -- 172.21.15.33:0/127263441 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa580148f0 con 0x7faa60109be0 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.685+0000 7faa4f7fe640 1 -- 172.21.15.33:0/127263441 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa58012840 con 0x7faa60109be0 2024-08-28T19:46:06.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.685+0000 7faa64c25640 1 -- 172.21.15.33:0/127263441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa601a6d80 con 0x7faa60109be0 2024-08-28T19:46:06.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.687+0000 7faa6b19a740 1 Processor -- start 2024-08-28T19:46:06.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.687+0000 7faa4f7fe640 1 -- 172.21.15.33:0/127263441 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7faa5801c070 con 0x7faa60109be0 2024-08-28T19:46:06.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa6b19a740 1 -- start start 2024-08-28T19:46:06.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 0x55dd27904c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd27534980 0x55dd279051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2753cb60 0x55dd27905710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa6b19a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55dd27879330 con 0x55dd2755d840 2024-08-28T19:46:06.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa6b19a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dd278688c0 con 0x55dd27534980 2024-08-28T19:46:06.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa6b19a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd2786c870 con 0x55dd2753cb60 2024-08-28T19:46:06.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa5e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd27534980 0x55dd279051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa5e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd27534980 0x55dd279051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:33112/0 (socket says 172.21.15.33:33112) 2024-08-28T19:46:06.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa5e59c640 1 -- 172.21.15.33:0/3197053171 learned_addr learned my addr 172.21.15.33:0/3197053171 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:06.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3197053171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 0x55dd27904c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.688+0000 7faa4f7fe640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faa480b4ca0 0x7faa480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3197053171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2753cb60 0x55dd27905710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa5ed9d640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faa480b4ca0 0x7faa480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa5e59c640 1 -- 172.21.15.33:0/3197053171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2753cb60 msgr2=0x55dd27905710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa5e59c640 1 --2- 172.21.15.33:0/3197053171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2753cb60 0x55dd27905710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa5e59c640 1 -- 172.21.15.33:0/3197053171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 msgr2=0x55dd27904c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa5e59c640 1 --2- 172.21.15.33:0/3197053171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 0x55dd27904c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa5e59c640 1 -- 172.21.15.33:0/3197053171 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd27820df0 con 0x55dd27534980 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3197053171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2753cb60 0x55dd27905710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa5e59c640 1 --2- 172.21.15.33:0/3197053171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd27534980 0x55dd279051d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa50009b20 tx=0x7faa5000e1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd17ee81e7fb4d53 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa4f7fe640 1 -- 172.21.15.33:0/127263441 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7faa580e5020 con 0x7faa60109be0 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa4cff9640 1 -- 172.21.15.33:0/3197053171 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50017070 con 0x55dd27534980 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa4cff9640 1 -- 172.21.15.33:0/3197053171 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa5000ec10 con 0x55dd27534980 2024-08-28T19:46:06.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.689+0000 7faa4cff9640 1 -- 172.21.15.33:0/3197053171 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50012630 con 0x55dd27534980 2024-08-28T19:46:06.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.690+0000 7faa6b19a740 1 -- 172.21.15.33:0/3197053171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd27534980 msgr2=0x55dd279051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:06.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.690+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3197053171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd27534980 0x55dd279051d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa50009b20 tx=0x7faa5000e1d0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.690+0000 7faa5ed9d640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faa480b4ca0 0x7faa480b71b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faa580ab0c0 tx=0x7faa580a7af0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.690+0000 7faa6b19a740 1 -- 172.21.15.33:0/3197053171 shutdown_connections 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.690+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3197053171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2753cb60 0x55dd27905710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.690+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3197053171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd27534980 0x55dd279051d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.690+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3197053171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 0x55dd27904c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.690+0000 7faa6b19a740 1 -- 172.21.15.33:0/3197053171 >> 172.21.15.33:0/3197053171 conn(0x55dd27551990 msgr2=0x55dd27902b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 1 -- 172.21.15.33:0/3197053171 shutdown_connections 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 1 -- 172.21.15.33:0/3197053171 wait complete. 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 1 -- start start 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 1 Processor -- start 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd27534980 0x55dd27910400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 0x55dd27910940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 0x55dd2791c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55dd276cb7a0 con 0x55dd2755d840 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dd277ef240 con 0x55dd2753cb60 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dd279134c0 con 0x55dd27534980 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.691+0000 7faa6b19a740 10 client.0 _ll_register_callbacks cb 0x55dd27575090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 0x55dd2791c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 0x55dd2791c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45556/0 (socket says 172.21.15.33:45556) 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5dd9b640 1 -- 172.21.15.33:0/3944706317 learned_addr learned my addr 172.21.15.33:0/3944706317 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd27534980 0x55dd27910400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5e59c640 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 0x55dd27910940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5dd9b640 1 -- 172.21.15.33:0/3944706317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd27534980 msgr2=0x55dd27910400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:06.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd27534980 0x55dd27910400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5dd9b640 1 -- 172.21.15.33:0/3944706317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 msgr2=0x55dd27910940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 0x55dd27910940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5dd9b640 1 -- 172.21.15.33:0/3944706317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd278252b0 con 0x55dd2755d840 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 0x55dd2791c810 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7faa54009340 tx=0x7faa54005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a2977e9687e805 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.692+0000 7faa45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa45ffb640 1 -- 172.21.15.33:0/3944706317 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54035040 con 0x55dd2755d840 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa45ffb640 1 -- 172.21.15.33:0/3944706317 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7faa54003e60 con 0x55dd2755d840 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa6b19a740 1 -- 172.21.15.33:0/3944706317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa5000ec10 con 0x55dd2755d840 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa45ffb640 1 -- 172.21.15.33:0/3944706317 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa54004060 con 0x55dd2755d840 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa6b19a740 10 client.19227 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa6b19a740 1 -- 172.21.15.33:0/3944706317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd275d7b90 con 0x55dd2755d840 2024-08-28T19:46:06.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa45ffb640 1 -- 172.21.15.33:0/3944706317 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa5000ec10 con 0x55dd2755d840 2024-08-28T19:46:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa45ffb640 1 -- 172.21.15.33:0/3944706317 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7faa540314a0 con 0x55dd2755d840 2024-08-28T19:46:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa6b19a740 10 client.19227 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa6b19a740 10 client.19227 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:46:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa6b19a740 20 client.19227 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.693+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd2751c1c0 0x55dd279224b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.694+0000 7faa6b19a740 4 client.19227 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.694+0000 7faa6b19a740 1 -- 172.21.15.33:0/3944706317 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd2787b280 con 0x55dd2751c1c0 2024-08-28T19:46:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.694+0000 7faa5e59c640 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd2751c1c0 0x55dd279224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.694+0000 7faa5e59c640 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd2751c1c0 0x55dd279224b0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c6986bdf675f4c8 server_cookie=41021c72df2c19e0 in_seq=0 out_seq=0 2024-08-28T19:46:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.694+0000 7faa45ffb640 10 client.19227 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.696+0000 7faa45ffb640 1 -- 172.21.15.33:0/3944706317 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dd2787b280 con 0x55dd2751c1c0 2024-08-28T19:46:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.696+0000 7faa45ffb640 10 client.19227 handle_command_reply: tid=0 2024-08-28T19:46:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.696+0000 7faa6b19a740 1 client.19227 shutdown 2024-08-28T19:46:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 1 -- 172.21.15.33:0/3944706317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 msgr2=0x55dd2791c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:06.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 0x55dd2791c810 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7faa54009340 tx=0x7faa54005a20 comp rx=0 tx=0).stop 2024-08-28T19:46:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 1 -- 172.21.15.33:0/3944706317 shutdown_connections 2024-08-28T19:46:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd2751c1c0 0x55dd279224b0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2755d840 0x55dd2791c810 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 0x55dd27910940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa45ffb640 0 client.19227 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3944706317 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd27534980 0x55dd27910400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 1 -- 172.21.15.33:0/3944706317 >> 172.21.15.33:0/3944706317 conn(0x55dd27551990 msgr2=0x55dd27901340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 1 -- 172.21.15.33:0/3944706317 shutdown_connections 2024-08-28T19:46:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 1 -- 172.21.15.33:0/3944706317 wait complete. 2024-08-28T19:46:06.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.697+0000 7faa6b19a740 20 client.19227 trim_cache size 0 max 16384 2024-08-28T19:46:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa6b19a740 1 Processor -- start 2024-08-28T19:46:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa6b19a740 1 -- start start 2024-08-28T19:46:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2751c1c0 0x55dd27906680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd27534980 0x55dd27912030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2753cb60 0x55dd2791c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa6b19a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faa601b0f30 con 0x55dd2753cb60 2024-08-28T19:46:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa6b19a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faa601b2a70 con 0x55dd2751c1c0 2024-08-28T19:46:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa6b19a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faa601b1600 con 0x55dd27534980 2024-08-28T19:46:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa5dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2753cb60 0x55dd2791c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa5dd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2753cb60 0x55dd2791c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45564/0 (socket says 172.21.15.33:45564) 2024-08-28T19:46:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa5dd9b640 1 -- 172.21.15.33:0/3289693102 learned_addr learned my addr 172.21.15.33:0/3289693102 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:06.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3289693102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2751c1c0 0x55dd27906680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.724+0000 7faa5e59c640 1 --2- 172.21.15.33:0/3289693102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd27534980 0x55dd27912030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.725+0000 7faa5dd9b640 1 -- 172.21.15.33:0/3289693102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd27534980 msgr2=0x55dd27912030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:06.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.725+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3289693102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd27534980 0x55dd27912030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.725+0000 7faa5dd9b640 1 -- 172.21.15.33:0/3289693102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2751c1c0 msgr2=0x55dd27906680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:06.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.725+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3289693102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2751c1c0 0x55dd27906680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.725+0000 7faa5dd9b640 1 -- 172.21.15.33:0/3289693102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd27838d90 con 0x55dd2753cb60 2024-08-28T19:46:06.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.725+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/3289693102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2753cb60 0x55dd2791c710 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7faa54005db0 tx=0x7faa5402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e745ea15a4c61d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:06.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.725+0000 7faa47fff640 1 -- 172.21.15.33:0/3289693102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54035030 con 0x55dd2753cb60 2024-08-28T19:46:06.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.725+0000 7faa47fff640 1 -- 172.21.15.33:0/3289693102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa54031d40 con 0x55dd2753cb60 2024-08-28T19:46:06.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.725+0000 7faa47fff640 1 -- 172.21.15.33:0/3289693102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5403bda0 con 0x55dd2753cb60 2024-08-28T19:46:06.728 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:06.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.726+0000 7faa6b19a740 1 -- 172.21.15.33:0/3289693102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2753cb60 msgr2=0x55dd2791c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:06.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.726+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3289693102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2753cb60 0x55dd2791c710 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7faa54005db0 tx=0x7faa5402a410 comp rx=0 tx=0).stop 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.726+0000 7faa6b19a740 1 -- 172.21.15.33:0/3289693102 shutdown_connections 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.726+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3289693102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd2753cb60 0x55dd2791c710 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.726+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3289693102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd27534980 0x55dd27912030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.726+0000 7faa6b19a740 1 --2- 172.21.15.33:0/3289693102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2751c1c0 0x55dd27906680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.726+0000 7faa6b19a740 1 -- 172.21.15.33:0/3289693102 >> 172.21.15.33:0/3289693102 conn(0x55dd27551990 msgr2=0x55dd27911920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.726+0000 7faa6b19a740 1 -- 172.21.15.33:0/3289693102 shutdown_connections 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.726+0000 7faa6b19a740 1 -- 172.21.15.33:0/3289693102 wait complete. 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa6b19a740 1 -- start start 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa6b19a740 1 Processor -- start 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2751c1c0 0x55dd27918f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd27534980 0x55dd27915420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa6b19a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 0x55dd27915960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa6b19a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faa601b23a0 con 0x55dd27534980 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa6b19a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faa601b1cd0 con 0x55dd2753cb60 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa6b19a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7faa601aef30 con 0x55dd2751c1c0 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa6b19a740 10 client.0 _ll_register_callbacks cb 0x7faa54009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa5e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd27534980 0x55dd27915420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa5e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd27534980 0x55dd27915420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45570/0 (socket says 172.21.15.33:45570) 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa5e59c640 1 -- 172.21.15.33:0/4231081916 learned_addr learned my addr 172.21.15.33:0/4231081916 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 0x55dd27915960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.727+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2751c1c0 0x55dd27918f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.728+0000 7faa5e59c640 1 -- 172.21.15.33:0/4231081916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2751c1c0 msgr2=0x55dd27918f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.728+0000 7faa5e59c640 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2751c1c0 0x55dd27918f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.728+0000 7faa5e59c640 1 -- 172.21.15.33:0/4231081916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 msgr2=0x55dd27915960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.728+0000 7faa5e59c640 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 0x55dd27915960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.728+0000 7faa5e59c640 1 -- 172.21.15.33:0/4231081916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd279160f0 con 0x55dd27534980 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.728+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 0x55dd27915960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.728+0000 7faa5e59c640 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd27534980 0x55dd27915420 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7faa50013d90 tx=0x7faa5000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79860aa4b869e6c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.728+0000 7faa45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.728+0000 7faa45ffb640 1 -- 172.21.15.33:0/4231081916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50017040 con 0x55dd27534980 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa45ffb640 1 -- 172.21.15.33:0/4231081916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7faa50005d10 con 0x55dd27534980 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa6b19a740 1 -- 172.21.15.33:0/4231081916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dd27876d20 con 0x55dd27534980 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa45ffb640 1 -- 172.21.15.33:0/4231081916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa50037050 con 0x55dd27534980 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa6b19a740 10 client.19233 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa6b19a740 1 -- 172.21.15.33:0/4231081916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd2798de00 con 0x55dd27534980 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa45ffb640 1 -- 172.21.15.33:0/4231081916 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55dd27876d20 con 0x55dd27534980 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa45ffb640 1 -- 172.21.15.33:0/4231081916 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7faa50006420 con 0x55dd27534980 2024-08-28T19:46:06.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa6b19a740 10 client.19233 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:06.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa6b19a740 10 client.19233 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:46:06.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa6b19a740 20 client.19233 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:06.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa6b19a740 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd2755d840 0x55dd279902a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:06.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa6b19a740 4 client.19233 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.7, "await_for": 45.0}] 2024-08-28T19:46:06.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.729+0000 7faa6b19a740 1 -- 172.21.15.33:0/4231081916 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.7, "await_for": 45.0}) -- 0x55dd27874460 con 0x55dd2755d840 2024-08-28T19:46:06.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.730+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd2755d840 0x55dd279902a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:06.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.730+0000 7faa45ffb640 10 client.19233 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:06.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.730+0000 7faa5dd9b640 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd2755d840 0x55dd279902a0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c09e9315531d9923 server_cookie=3e4ec2e4508006c3 in_seq=0 out_seq=0 2024-08-28T19:46:06.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.743+0000 7faa45ffb640 1 -- 172.21.15.33:0/4231081916 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55dd27874460 con 0x55dd2755d840 2024-08-28T19:46:06.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.743+0000 7faa45ffb640 10 client.19233 handle_command_reply: tid=0 2024-08-28T19:46:06.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.743+0000 7faa6b19a740 1 client.19233 shutdown 2024-08-28T19:46:06.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.743+0000 7faa6b19a740 1 -- 172.21.15.33:0/4231081916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd27534980 msgr2=0x55dd27915420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.743+0000 7faa6b19a740 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd27534980 0x55dd27915420 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7faa50013d90 tx=0x7faa5000ed00 comp rx=0 tx=0).stop 2024-08-28T19:46:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.743+0000 7faa6b19a740 1 -- 172.21.15.33:0/4231081916 shutdown_connections 2024-08-28T19:46:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.744+0000 7faa6b19a740 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd2753cb60 0x55dd27915960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.744+0000 7faa6b19a740 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dd2755d840 0x55dd279902a0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.744+0000 7faa6b19a740 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dd27534980 0x55dd27915420 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.744+0000 7faa45ffb640 0 client.19233 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.744+0000 7faa6b19a740 1 --2- 172.21.15.33:0/4231081916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dd2751c1c0 0x55dd27918f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.744+0000 7faa6b19a740 1 -- 172.21.15.33:0/4231081916 >> 172.21.15.33:0/4231081916 conn(0x55dd27551990 msgr2=0x55dd27912270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:06.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.744+0000 7faa6b19a740 1 -- 172.21.15.33:0/4231081916 shutdown_connections 2024-08-28T19:46:06.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.744+0000 7faa6b19a740 1 -- 172.21.15.33:0/4231081916 wait complete. 2024-08-28T19:46:06.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.744+0000 7faa6b19a740 20 client.19233 trim_cache size 0 max 16384 2024-08-28T19:46:06.746 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:46:06.746 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:46:06.746 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:46:06.746 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 42, 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "86c16439": { 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 42, 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 145.7, 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:46:06.747 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:46:06.748 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:46:06.748 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:46:06.748 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:46:06.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:06.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:06.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:06.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:06.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:06.748 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:46:06.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 -- 172.21.15.33:0/127263441 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faa480b4ca0 msgr2=0x7faa480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:06.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faa480b4ca0 0x7faa480b71b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faa580ab0c0 tx=0x7faa580a7af0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 -- 172.21.15.33:0/127263441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa60109be0 msgr2=0x7faa6019fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:06.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa60109be0 0x7faa6019fc00 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7faa5800be20 tx=0x7faa5800bf10 comp rx=0 tx=0).stop 2024-08-28T19:46:06.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 -- 172.21.15.33:0/127263441 shutdown_connections 2024-08-28T19:46:06.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa60109be0 0x7faa6019fc00 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7faa480b4ca0 0x7faa480b71b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faa60109290 0x7faa6019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 --2- 172.21.15.33:0/127263441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa60103950 0x7faa6019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:06.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 -- 172.21.15.33:0/127263441 >> 172.21.15.33:0/127263441 conn(0x7faa600ff3a0 msgr2=0x7faa601017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:06.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 -- 172.21.15.33:0/127263441 shutdown_connections 2024-08-28T19:46:06.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:06.745+0000 7faa64c25640 1 -- 172.21.15.33:0/127263441 wait complete. 2024-08-28T19:46:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.529+0000 7f177e8e6640 1 -- 172.21.15.33:0/2044634302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1778108b10 msgr2=0x7f177810f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.529+0000 7f177e8e6640 1 --2- 172.21.15.33:0/2044634302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1778108b10 0x7f177810f340 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f1770009ca0 tx=0x7f177002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.529+0000 7f177e8e6640 1 -- 172.21.15.33:0/2044634302 shutdown_connections 2024-08-28T19:46:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.529+0000 7f177e8e6640 1 --2- 172.21.15.33:0/2044634302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1778108b10 0x7f177810f340 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.529+0000 7f177e8e6640 1 --2- 172.21.15.33:0/2044634302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17781081c0 0x7f17781085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.529+0000 7f177e8e6640 1 --2- 172.21.15.33:0/2044634302 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1778102880 0x7f1778102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.529+0000 7f177e8e6640 1 -- 172.21.15.33:0/2044634302 >> 172.21.15.33:0/2044634302 conn(0x7f1778079510 msgr2=0x7f1778079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.529+0000 7f177e8e6640 1 -- 172.21.15.33:0/2044634302 shutdown_connections 2024-08-28T19:46:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.529+0000 7f177e8e6640 1 -- 172.21.15.33:0/2044634302 wait complete. 2024-08-28T19:46:07.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.530+0000 7f177e8e6640 1 Processor -- start 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.530+0000 7f177e8e6640 1 -- start start 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.530+0000 7f177e8e6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1778102880 0x7f17780ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.530+0000 7f177e8e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17781081c0 0x7f17780ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.530+0000 7f177e8e6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1778108b10 0x7f17780ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.530+0000 7f177e8e6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1778112830 con 0x7f1778102880 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.530+0000 7f177e8e6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17781126b0 con 0x7f1778108b10 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.530+0000 7f177e8e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f17781129b0 con 0x7f17781081c0 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.530+0000 7f1777fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1778102880 0x7f17780ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f1777fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1778102880 0x7f17780ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45588/0 (socket says 172.21.15.33:45588) 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f1777fff640 1 -- 172.21.15.33:0/2051388823 learned_addr learned my addr 172.21.15.33:0/2051388823 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f17777fe640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17781081c0 0x7f17780ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f1777fff640 1 -- 172.21.15.33:0/2051388823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17781081c0 msgr2=0x7f17780ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f1777fff640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17781081c0 0x7f17780ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f1777fff640 1 -- 172.21.15.33:0/2051388823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1778108b10 msgr2=0x7f17780ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f177ce83640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1778108b10 0x7f17780ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f1777fff640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1778108b10 0x7f17780ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f1777fff640 1 -- 172.21.15.33:0/2051388823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17781a8570 con 0x7f1778102880 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f177ce83640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1778108b10 0x7f17780ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f1777fff640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1778102880 0x7f17780ff410 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f176800b4a0 tx=0x7f176800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f17757fa640 1 -- 172.21.15.33:0/2051388823 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768014070 con 0x7f1778102880 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f17757fa640 1 -- 172.21.15.33:0/2051388823 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1768010ac0 con 0x7f1778102880 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f177e8e6640 1 -- 172.21.15.33:0/2051388823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17781a8860 con 0x7f1778102880 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f17757fa640 1 -- 172.21.15.33:0/2051388823 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768017c30 con 0x7f1778102880 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.531+0000 7f177e8e6640 1 -- 172.21.15.33:0/2051388823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17781a8df0 con 0x7f1778102880 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f1784e5b740 1 Processor -- start 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f1784e5b740 1 -- start start 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f812b7070 0x563f8165c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f8128e1b0 0x563f8165c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f81296390 0x563f8165cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f1784e5b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563f815d3680 con 0x563f812b7070 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f1784e5b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563f815c2c10 con 0x563f81296390 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f1784e5b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563f815c6bc0 con 0x563f8128e1b0 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f17757fa640 1 -- 172.21.15.33:0/2051388823 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1768017070 con 0x7f1778102880 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f177ce83640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f812b7070 0x563f8165c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f177ce83640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f812b7070 0x563f8165c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45598/0 (socket says 172.21.15.33:45598) 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f177ce83640 1 -- 172.21.15.33:0/1150610110 learned_addr learned my addr 172.21.15.33:0/1150610110 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.534+0000 7f17777fe640 1 --2- 172.21.15.33:0/1150610110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f81296390 0x563f8165cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f1777fff640 1 --2- 172.21.15.33:0/1150610110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f8128e1b0 0x563f8165c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f177ce83640 1 -- 172.21.15.33:0/1150610110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f8128e1b0 msgr2=0x563f8165c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f177ce83640 1 --2- 172.21.15.33:0/1150610110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f8128e1b0 0x563f8165c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f177ce83640 1 -- 172.21.15.33:0/1150610110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f81296390 msgr2=0x563f8165cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f177ce83640 1 --2- 172.21.15.33:0/1150610110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f81296390 0x563f8165cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f177ce83640 1 -- 172.21.15.33:0/1150610110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f81322650 con 0x563f812b7070 2024-08-28T19:46:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f177ce83640 1 --2- 172.21.15.33:0/1150610110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f812b7070 0x563f8165c310 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f177002f500 tx=0x7f1770009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1358718bd9ded41 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f175e7fc640 1 -- 172.21.15.33:0/1150610110 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1770031450 con 0x563f812b7070 2024-08-28T19:46:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f175e7fc640 1 -- 172.21.15.33:0/1150610110 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1770036070 con 0x563f812b7070 2024-08-28T19:46:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f175e7fc640 1 -- 172.21.15.33:0/1150610110 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17700043c0 con 0x563f812b7070 2024-08-28T19:46:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f17757fa640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17600b4d20 0x7f17600b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.535+0000 7f1777fff640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17600b4d20 0x7f17600b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f17757fa640 1 -- 172.21.15.33:0/2051388823 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7f17680e4fe0 con 0x7f1778102880 2024-08-28T19:46:07.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f1784e5b740 1 -- 172.21.15.33:0/1150610110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f812b7070 msgr2=0x563f8165c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f1777fff640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17600b4d20 0x7f17600b7230 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x563f8165af90 tx=0x7f1768010f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f1784e5b740 1 --2- 172.21.15.33:0/1150610110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f812b7070 0x563f8165c310 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f177002f500 tx=0x7f1770009a20 comp rx=0 tx=0).stop 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f1784e5b740 1 -- 172.21.15.33:0/1150610110 shutdown_connections 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f1784e5b740 1 --2- 172.21.15.33:0/1150610110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f81296390 0x563f8165cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f1784e5b740 1 --2- 172.21.15.33:0/1150610110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f8128e1b0 0x563f8165c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f1784e5b740 1 --2- 172.21.15.33:0/1150610110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f812b7070 0x563f8165c310 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f1784e5b740 1 -- 172.21.15.33:0/1150610110 >> 172.21.15.33:0/1150610110 conn(0x563f812ab460 msgr2=0x563f8165a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f1784e5b740 1 -- 172.21.15.33:0/1150610110 shutdown_connections 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.536+0000 7f1784e5b740 1 -- 172.21.15.33:0/1150610110 wait complete. 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.537+0000 7f1784e5b740 1 -- start start 2024-08-28T19:46:07.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.537+0000 7f1784e5b740 1 Processor -- start 2024-08-28T19:46:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f8128e1b0 0x563f81667af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f81296390 0x563f81668030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f812b7070 0x563f81673db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f1784e5b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x563f81425700 con 0x563f8128e1b0 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f1784e5b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563f81549750 con 0x563f81296390 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f1784e5b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x563f8166aa90 con 0x563f812b7070 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f1784e5b740 10 client.0 _ll_register_callbacks cb 0x563f81578e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f177ce83640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f8128e1b0 0x563f81667af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f177ce83640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f8128e1b0 0x563f81667af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45612/0 (socket says 172.21.15.33:45612) 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f177ce83640 1 -- 172.21.15.33:0/2810923198 learned_addr learned my addr 172.21.15.33:0/2810923198 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f177ce83640 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f812b7070 0x563f81673db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f17777fe640 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f81296390 0x563f81668030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f177ce83640 1 -- 172.21.15.33:0/2810923198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f812b7070 msgr2=0x563f81673db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:07.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f177ce83640 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f812b7070 0x563f81673db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f177ce83640 1 -- 172.21.15.33:0/2810923198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f81296390 msgr2=0x563f81668030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f177ce83640 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f81296390 0x563f81668030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.538+0000 7f177ce83640 1 -- 172.21.15.33:0/2810923198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f81582900 con 0x563f8128e1b0 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.539+0000 7f177ce83640 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f8128e1b0 0x563f81667af0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x563f8166a6c0 tx=0x7f1770003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2356bf979e73bd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.539+0000 7f17577fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.539+0000 7f17577fe640 1 -- 172.21.15.33:0/2810923198 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1770031650 con 0x563f8128e1b0 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.539+0000 7f17577fe640 1 -- 172.21.15.33:0/2810923198 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7f17700317f0 con 0x563f8128e1b0 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.539+0000 7f1784e5b740 1 -- 172.21.15.33:0/2810923198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1770036070 con 0x563f8128e1b0 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.539+0000 7f17577fe640 1 -- 172.21.15.33:0/2810923198 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1770004b40 con 0x563f8128e1b0 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.539+0000 7f1784e5b740 10 client.19245 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.539+0000 7f1784e5b740 1 -- 172.21.15.33:0/2810923198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563f816768a0 con 0x563f8128e1b0 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.539+0000 7f17577fe640 1 -- 172.21.15.33:0/2810923198 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1770036070 con 0x563f8128e1b0 2024-08-28T19:46:07.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.539+0000 7f17577fe640 1 -- 172.21.15.33:0/2810923198 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f177002f710 con 0x563f8128e1b0 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.540+0000 7f1784e5b740 10 client.19245 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.540+0000 7f1784e5b740 10 client.19245 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.540+0000 7f1784e5b740 20 client.19245 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.540+0000 7f1784e5b740 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x563f812759f0 0x563f81679c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.540+0000 7f1784e5b740 4 client.19245 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.540+0000 7f1784e5b740 1 -- 172.21.15.33:0/2810923198 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f815d55d0 con 0x563f812759f0 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.540+0000 7f17777fe640 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x563f812759f0 0x563f81679c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.540+0000 7f17777fe640 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x563f812759f0 0x563f81679c00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a2cc4a499913c9ed server_cookie=8fc9ae46447cd2ea in_seq=0 out_seq=0 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.540+0000 7f17577fe640 10 client.19245 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.541+0000 7f17577fe640 1 -- 172.21.15.33:0/2810923198 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f815d55d0 con 0x563f812759f0 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.541+0000 7f17577fe640 10 client.19245 handle_command_reply: tid=0 2024-08-28T19:46:07.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.541+0000 7f1784e5b740 1 client.19245 shutdown 2024-08-28T19:46:07.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.541+0000 7f1784e5b740 1 -- 172.21.15.33:0/2810923198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f8128e1b0 msgr2=0x563f81667af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:07.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.541+0000 7f1784e5b740 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f8128e1b0 0x563f81667af0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x563f8166a6c0 tx=0x7f1770003f30 comp rx=0 tx=0).stop 2024-08-28T19:46:07.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.542+0000 7f1784e5b740 1 -- 172.21.15.33:0/2810923198 shutdown_connections 2024-08-28T19:46:07.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.542+0000 7f1784e5b740 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x563f812759f0 0x563f81679c00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.542+0000 7f1784e5b740 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f812b7070 0x563f81673db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.542+0000 7f1784e5b740 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f81296390 0x563f81668030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.542+0000 7f17577fe640 0 client.19245 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:46:07.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.542+0000 7f1784e5b740 1 --2- 172.21.15.33:0/2810923198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f8128e1b0 0x563f81667af0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.542+0000 7f1784e5b740 1 -- 172.21.15.33:0/2810923198 >> 172.21.15.33:0/2810923198 conn(0x563f812ab460 msgr2=0x563f8165f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:07.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.542+0000 7f1784e5b740 1 -- 172.21.15.33:0/2810923198 shutdown_connections 2024-08-28T19:46:07.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.542+0000 7f1784e5b740 1 -- 172.21.15.33:0/2810923198 wait complete. 2024-08-28T19:46:07.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.542+0000 7f1784e5b740 20 client.19245 trim_cache size 0 max 16384 2024-08-28T19:46:07.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.555+0000 7f1784e5b740 1 Processor -- start 2024-08-28T19:46:07.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.555+0000 7f1784e5b740 1 -- start start 2024-08-28T19:46:07.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f8128e1b0 0x563f816699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f8165da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f812b7070 0x563f81673d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f1784e5b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f17781b3020 con 0x563f81296390 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f1784e5b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17781b4b60 con 0x563f812b7070 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f1784e5b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f17781b36f0 con 0x563f8128e1b0 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f17777fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f8165da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f17777fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f8165da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45620/0 (socket says 172.21.15.33:45620) 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f17777fe640 1 -- 172.21.15.33:0/861239568 learned_addr learned my addr 172.21.15.33:0/861239568 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f177ce83640 1 --2- 172.21.15.33:0/861239568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f812b7070 0x563f81673d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f177ce83640 1 --2- 172.21.15.33:0/861239568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f8128e1b0 0x563f816699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f17777fe640 1 -- 172.21.15.33:0/861239568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f8128e1b0 msgr2=0x563f816699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f17777fe640 1 --2- 172.21.15.33:0/861239568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f8128e1b0 0x563f816699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f17777fe640 1 -- 172.21.15.33:0/861239568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f812b7070 msgr2=0x563f81673d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:07.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f17777fe640 1 --2- 172.21.15.33:0/861239568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f812b7070 0x563f81673d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f17777fe640 1 -- 172.21.15.33:0/861239568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f8165f170 con 0x563f81296390 2024-08-28T19:46:07.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.556+0000 7f17777fe640 1 --2- 172.21.15.33:0/861239568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f8165da50 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f176c005fd0 tx=0x7f176c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8256739eea29d88d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:07.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.557+0000 7f175dffb640 1 -- 172.21.15.33:0/861239568 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c010e20 con 0x563f81296390 2024-08-28T19:46:07.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.557+0000 7f175dffb640 1 -- 172.21.15.33:0/861239568 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c005020 con 0x563f81296390 2024-08-28T19:46:07.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.557+0000 7f175dffb640 1 -- 172.21.15.33:0/861239568 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c004a90 con 0x563f81296390 2024-08-28T19:46:07.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.557+0000 7f1784e5b740 1 -- 172.21.15.33:0/861239568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 msgr2=0x563f8165da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.557+0000 7f1784e5b740 1 --2- 172.21.15.33:0/861239568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f8165da50 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f176c005fd0 tx=0x7f176c010800 comp rx=0 tx=0).stop 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 -- 172.21.15.33:0/861239568 shutdown_connections 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 --2- 172.21.15.33:0/861239568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f812b7070 0x563f81673d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 --2- 172.21.15.33:0/861239568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f8165da50 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 --2- 172.21.15.33:0/861239568 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f8128e1b0 0x563f816699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 -- 172.21.15.33:0/861239568 >> 172.21.15.33:0/861239568 conn(0x563f812ab460 msgr2=0x563f8165d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 -- 172.21.15.33:0/861239568 shutdown_connections 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 -- 172.21.15.33:0/861239568 wait complete. 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 -- start start 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 Processor -- start 2024-08-28T19:46:07.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f8128e1b0 0x563f816d8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f816d8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.558+0000 7f1784e5b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f812b7070 0x563f816e3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f1784e5b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f17781b4490 con 0x563f81296390 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f1784e5b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17781b3dc0 con 0x563f8128e1b0 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f1784e5b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f17781b1020 con 0x563f812b7070 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f1784e5b740 10 client.0 _ll_register_callbacks cb 0x7f176c00c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17777fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f816d8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17777fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f816d8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45622/0 (socket says 172.21.15.33:45622) 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17777fe640 1 -- 172.21.15.33:0/1572214228 learned_addr learned my addr 172.21.15.33:0/1572214228 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f177ce83640 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f812b7070 0x563f816e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f177ce83640 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f8128e1b0 0x563f816d8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17777fe640 1 -- 172.21.15.33:0/1572214228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f812b7070 msgr2=0x563f816e3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17777fe640 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f812b7070 0x563f816e3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17777fe640 1 -- 172.21.15.33:0/1572214228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f8128e1b0 msgr2=0x563f816d8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17777fe640 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f8128e1b0 0x563f816d8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17777fe640 1 -- 172.21.15.33:0/1572214228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f816e3a00 con 0x563f81296390 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17777fe640 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f816d8af0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f176c005560 tx=0x7f176c005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc582ea811618b30 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17577fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17577fe640 1 -- 172.21.15.33:0/1572214228 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c01f040 con 0x563f81296390 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f17577fe640 1 -- 172.21.15.33:0/1572214228 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7f176c004230 con 0x563f81296390 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.559+0000 7f1784e5b740 1 -- 172.21.15.33:0/1572214228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f176c005020 con 0x563f81296390 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f17577fe640 1 -- 172.21.15.33:0/1572214228 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f176c004430 con 0x563f81296390 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f1784e5b740 10 client.19251 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f1784e5b740 1 -- 172.21.15.33:0/1572214228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563f816e4c80 con 0x563f81296390 2024-08-28T19:46:07.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f17577fe640 1 -- 172.21.15.33:0/1572214228 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c005020 con 0x563f81296390 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f17577fe640 1 -- 172.21.15.33:0/1572214228 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f176c003a50 con 0x563f81296390 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f1784e5b740 10 client.19251 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f1784e5b740 10 client.19251 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f1784e5b740 20 client.19251 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f1784e5b740 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x563f8124ada0 0x563f816e73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f1784e5b740 4 client.19251 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f1784e5b740 1 -- 172.21.15.33:0/1572214228 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f815d1070 con 0x563f8124ada0 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.560+0000 7f177ce83640 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x563f8124ada0 0x563f816e73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f177ce83640 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x563f8124ada0 0x563f816e73b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=902cc14e93dd6b9f server_cookie=e69a0becfca5782f in_seq=0 out_seq=0 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f17577fe640 10 client.19251 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f17577fe640 1 -- 172.21.15.33:0/1572214228 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f815d1070 con 0x563f8124ada0 2024-08-28T19:46:07.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f17577fe640 10 client.19251 handle_command_reply: tid=0 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 client.19251 shutdown 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 -- 172.21.15.33:0/1572214228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 msgr2=0x563f816d8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f816d8af0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f176c005560 tx=0x7f176c005590 comp rx=0 tx=0).stop 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 -- 172.21.15.33:0/1572214228 shutdown_connections 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x563f8124ada0 0x563f816e73b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x563f812b7070 0x563f816e3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563f81296390 0x563f816d8af0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 --2- 172.21.15.33:0/1572214228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f8128e1b0 0x563f816d8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f17577fe640 0 client.19251 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 -- 172.21.15.33:0/1572214228 >> 172.21.15.33:0/1572214228 conn(0x563f812ab460 msgr2=0x563f81669770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 -- 172.21.15.33:0/1572214228 shutdown_connections 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 1 -- 172.21.15.33:0/1572214228 wait complete. 2024-08-28T19:46:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.561+0000 7f1784e5b740 20 client.19251 trim_cache size 0 max 16384 2024-08-28T19:46:07.568 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:46:07.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 -- 172.21.15.33:0/2051388823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17600b4d20 msgr2=0x7f17600b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17600b4d20 0x7f17600b7230 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x563f8165af90 tx=0x7f1768010f90 comp rx=0 tx=0).stop 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 -- 172.21.15.33:0/2051388823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1778102880 msgr2=0x7f17780ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1778102880 0x7f17780ff410 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f176800b4a0 tx=0x7f176800b960 comp rx=0 tx=0).stop 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 -- 172.21.15.33:0/2051388823 shutdown_connections 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1778108b10 0x7f17780ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f17600b4d20 0x7f17600b7230 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f17781081c0 0x7f17780ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 --2- 172.21.15.33:0/2051388823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1778102880 0x7f17780ff410 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 -- 172.21.15.33:0/2051388823 >> 172.21.15.33:0/2051388823 conn(0x7f1778079510 msgr2=0x7f17781017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 -- 172.21.15.33:0/2051388823 shutdown_connections 2024-08-28T19:46:07.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:07.562+0000 7f177e8e6640 1 -- 172.21.15.33:0/2051388823 wait complete. 2024-08-28T19:46:07.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:07 smithi033 ceph-mon[18549]: pgmap v767: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 124 KiB/s wr, 35 op/s 2024-08-28T19:46:08.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:07 smithi059 ceph-mon[22052]: pgmap v767: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 124 KiB/s wr, 35 op/s 2024-08-28T19:46:08.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:07 smithi122 ceph-mon[22174]: pgmap v767: 129 pgs: 129 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 124 KiB/s wr, 35 op/s 2024-08-28T19:46:08.381 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '86c16439', quiesce took 6.0 seconds. Will release after: 19.7 2024-08-28T19:46:08.897 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:46:09.157 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:09.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.676+0000 7f440c930640 1 -- 172.21.15.33:0/4006946770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4408105010 msgr2=0x7f440810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:09.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.676+0000 7f440c930640 1 --2- 172.21.15.33:0/4006946770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4408105010 0x7f440810d650 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009900 tx=0x7f43fc02a410 comp rx=0 tx=0).stop 2024-08-28T19:46:09.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.676+0000 7f440c930640 1 -- 172.21.15.33:0/4006946770 shutdown_connections 2024-08-28T19:46:09.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.676+0000 7f440c930640 1 --2- 172.21.15.33:0/4006946770 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f440810db90 0x7f44081100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.676+0000 7f440c930640 1 --2- 172.21.15.33:0/4006946770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4408105010 0x7f440810d650 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.676+0000 7f440c930640 1 --2- 172.21.15.33:0/4006946770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44081045e0 0x7f44081049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.676+0000 7f440c930640 1 -- 172.21.15.33:0/4006946770 >> 172.21.15.33:0/4006946770 conn(0x7f44080794d0 msgr2=0x7f44080798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.676+0000 7f440c930640 1 -- 172.21.15.33:0/4006946770 shutdown_connections 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.676+0000 7f440c930640 1 -- 172.21.15.33:0/4006946770 wait complete. 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.677+0000 7f440c930640 1 Processor -- start 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.677+0000 7f440c930640 1 -- start start 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.677+0000 7f440c930640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44081045e0 0x7f44081024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.677+0000 7f440c930640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4408105010 0x7f4408102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.677+0000 7f440c930640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f440810db90 0x7f4408102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.677+0000 7f440c930640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f44081137d0 con 0x7f44081045e0 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.677+0000 7f440c930640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4408113650 con 0x7f440810db90 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.677+0000 7f440c930640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4408113950 con 0x7f4408105010 2024-08-28T19:46:09.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44081045e0 0x7f44081024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44081045e0 0x7f44081024f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42514/0 (socket says 172.21.15.33:42514) 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f4405d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4408105010 0x7f4408102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440659c640 1 -- 172.21.15.33:0/256313175 learned_addr learned my addr 172.21.15.33:0/256313175 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f4406d9d640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f440810db90 0x7f4408102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440659c640 1 -- 172.21.15.33:0/256313175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4408105010 msgr2=0x7f4408102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440659c640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4408105010 0x7f4408102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440659c640 1 -- 172.21.15.33:0/256313175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f440810db90 msgr2=0x7f4408102f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440659c640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f440810db90 0x7f4408102f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440659c640 1 -- 172.21.15.33:0/256313175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44081a8640 con 0x7f44081045e0 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440659c640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44081045e0 0x7f44081024f0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f43f800d770 tx=0x7f43f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:09.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f43f77fe640 1 -- 172.21.15.33:0/256313175 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8017070 con 0x7f44081045e0 2024-08-28T19:46:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f43f77fe640 1 -- 172.21.15.33:0/256313175 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43f8009c30 con 0x7f44081045e0 2024-08-28T19:46:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440c930640 1 -- 172.21.15.33:0/256313175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44081a8930 con 0x7f44081045e0 2024-08-28T19:46:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f43f77fe640 1 -- 172.21.15.33:0/256313175 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8003cc0 con 0x7f44081045e0 2024-08-28T19:46:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.678+0000 7f440c930640 1 -- 172.21.15.33:0/256313175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44081a8e40 con 0x7f44081045e0 2024-08-28T19:46:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.681+0000 7f4412ea5740 1 Processor -- start 2024-08-28T19:46:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.681+0000 7f43f77fe640 1 -- 172.21.15.33:0/256313175 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f43f8003e60 con 0x7f44081045e0 2024-08-28T19:46:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.681+0000 7f4412ea5740 1 -- start start 2024-08-28T19:46:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.681+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe153070 0x55babe4f8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.681+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe12a1b0 0x55babe4f8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.681+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe132390 0x55babe4f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.681+0000 7f4412ea5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55babe46f680 con 0x55babe12a1b0 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.681+0000 7f4412ea5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55babe45ec10 con 0x55babe153070 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.681+0000 7f4412ea5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55babe462bc0 con 0x55babe132390 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f440659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe12a1b0 0x55babe4f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f440659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe12a1b0 0x55babe4f8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42530/0 (socket says 172.21.15.33:42530) 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f440659c640 1 -- 172.21.15.33:0/2200038396 learned_addr learned my addr 172.21.15.33:0/2200038396 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f4405d9b640 1 --2- 172.21.15.33:0/2200038396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe132390 0x55babe4f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f4406d9d640 1 --2- 172.21.15.33:0/2200038396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe153070 0x55babe4f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f43f77fe640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43f00b4ca0 0x7f43f00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f440659c640 1 -- 172.21.15.33:0/2200038396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe132390 msgr2=0x55babe4f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f440659c640 1 --2- 172.21.15.33:0/2200038396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe132390 0x55babe4f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f440659c640 1 -- 172.21.15.33:0/2200038396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe153070 msgr2=0x55babe4f8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f440659c640 1 --2- 172.21.15.33:0/2200038396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe153070 0x55babe4f8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f440659c640 1 -- 172.21.15.33:0/2200038396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babe1be650 con 0x55babe12a1b0 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f4406d9d640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43f00b4ca0 0x7f43f00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f43f77fe640 1 -- 172.21.15.33:0/256313175 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7f43f80e5230 con 0x7f44081045e0 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f440659c640 1 --2- 172.21.15.33:0/2200038396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe12a1b0 0x55babe4f8850 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f43f80e2520 tx=0x7f43f806ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d327554daa08b9fb server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.682+0000 7f43f4ff9640 1 -- 172.21.15.33:0/2200038396 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f80ab3a0 con 0x55babe12a1b0 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.683+0000 7f4406d9d640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43f00b4ca0 0x7f43f00b71b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4400005fd0 tx=0x7f4400004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.683+0000 7f43f4ff9640 1 -- 172.21.15.33:0/2200038396 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43f80ab0e0 con 0x55babe12a1b0 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.683+0000 7f43f4ff9640 1 -- 172.21.15.33:0/2200038396 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f80aad40 con 0x55babe12a1b0 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.683+0000 7f4412ea5740 1 -- 172.21.15.33:0/2200038396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe12a1b0 msgr2=0x55babe4f8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:09.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.683+0000 7f4412ea5740 1 --2- 172.21.15.33:0/2200038396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe12a1b0 0x55babe4f8850 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f43f80e2520 tx=0x7f43f806ff80 comp rx=0 tx=0).stop 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.683+0000 7f4412ea5740 1 -- 172.21.15.33:0/2200038396 shutdown_connections 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.683+0000 7f4412ea5740 1 --2- 172.21.15.33:0/2200038396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe132390 0x55babe4f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.683+0000 7f4412ea5740 1 --2- 172.21.15.33:0/2200038396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe12a1b0 0x55babe4f8850 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.683+0000 7f4412ea5740 1 --2- 172.21.15.33:0/2200038396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe153070 0x55babe4f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.683+0000 7f4412ea5740 1 -- 172.21.15.33:0/2200038396 >> 172.21.15.33:0/2200038396 conn(0x55babe147460 msgr2=0x55babe4f6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 1 -- 172.21.15.33:0/2200038396 shutdown_connections 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 1 -- 172.21.15.33:0/2200038396 wait complete. 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 1 -- start start 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 1 Processor -- start 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe503a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe503f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe50fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55babe2c1700 con 0x55babe153070 2024-08-28T19:46:09.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55babe3e5750 con 0x55babe132390 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55babe506a90 con 0x55babe12a1b0 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4412ea5740 10 client.0 _ll_register_callbacks cb 0x55babe414e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.684+0000 7f4406d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe50fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4406d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe50fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42536/0 (socket says 172.21.15.33:42536) 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4406d9d640 1 -- 172.21.15.33:0/3162276174 learned_addr learned my addr 172.21.15.33:0/3162276174 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4405d9b640 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe503f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f440659c640 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe503a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4406d9d640 1 -- 172.21.15.33:0/3162276174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 msgr2=0x55babe503a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4406d9d640 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe503a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4406d9d640 1 -- 172.21.15.33:0/3162276174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 msgr2=0x55babe503f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4406d9d640 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe503f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4406d9d640 1 -- 172.21.15.33:0/3162276174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55babe41e900 con 0x55babe153070 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f440659c640 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe503a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:09.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4406d9d640 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe50fdb0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f44000136c0 tx=0x7f4400004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5734cc1c39b6f5ca server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f43edffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f43edffb640 1 -- 172.21.15.33:0/3162276174 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400022070 con 0x55babe153070 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f43edffb640 1 -- 172.21.15.33:0/3162276174 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7f440001e8f0 con 0x55babe153070 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4412ea5740 1 -- 172.21.15.33:0/3162276174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43f80ab0e0 con 0x55babe153070 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f43edffb640 1 -- 172.21.15.33:0/3162276174 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f440002e050 con 0x55babe153070 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4412ea5740 10 client.19263 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.685+0000 7f4412ea5740 1 -- 172.21.15.33:0/3162276174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55babe512840 con 0x55babe153070 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.686+0000 7f43edffb640 1 -- 172.21.15.33:0/3162276174 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43f80ab0e0 con 0x55babe153070 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.686+0000 7f43edffb640 1 -- 172.21.15.33:0/3162276174 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f440001cc10 con 0x55babe153070 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.686+0000 7f4412ea5740 10 client.19263 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:09.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.686+0000 7f4412ea5740 10 client.19263 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:46:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.686+0000 7f4412ea5740 20 client.19263 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.686+0000 7f4412ea5740 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55babe1119f0 0x55babe515cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.686+0000 7f4412ea5740 4 client.19263 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.686+0000 7f4412ea5740 1 -- 172.21.15.33:0/3162276174 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55babe4715d0 con 0x55babe1119f0 2024-08-28T19:46:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.686+0000 7f440659c640 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55babe1119f0 0x55babe515cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.687+0000 7f43edffb640 10 client.19263 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:46:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.687+0000 7f440659c640 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55babe1119f0 0x55babe515cf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3730c04ae67eb297 server_cookie=e0769675914956d8 in_seq=0 out_seq=0 2024-08-28T19:46:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.687+0000 7f43edffb640 1 -- 172.21.15.33:0/3162276174 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55babe4715d0 con 0x55babe1119f0 2024-08-28T19:46:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.687+0000 7f43edffb640 10 client.19263 handle_command_reply: tid=0 2024-08-28T19:46:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 client.19263 shutdown 2024-08-28T19:46:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 -- 172.21.15.33:0/3162276174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 msgr2=0x55babe50fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe50fdb0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f44000136c0 tx=0x7f4400004ab0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 -- 172.21.15.33:0/3162276174 shutdown_connections 2024-08-28T19:46:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55babe1119f0 0x55babe515cf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe50fdb0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe503f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 --2- 172.21.15.33:0/3162276174 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe503a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 -- 172.21.15.33:0/3162276174 >> 172.21.15.33:0/3162276174 conn(0x55babe147460 msgr2=0x55babe4fb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f43edffb640 0 client.19263 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 -- 172.21.15.33:0/3162276174 shutdown_connections 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 1 -- 172.21.15.33:0/3162276174 wait complete. 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.688+0000 7f4412ea5740 20 client.19263 trim_cache size 0 max 16384 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.701+0000 7f4412ea5740 1 Processor -- start 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.701+0000 7f4412ea5740 1 -- start start 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.701+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe4f9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.701+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe50fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.701+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe500c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.701+0000 7f4412ea5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f44081b3030 con 0x55babe153070 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.701+0000 7f4412ea5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44081b4b70 con 0x55babe132390 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.701+0000 7f4412ea5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f44081b3700 con 0x55babe12a1b0 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f4406d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe500c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f4406d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe500c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42552/0 (socket says 172.21.15.33:42552) 2024-08-28T19:46:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f4406d9d640 1 -- 172.21.15.33:0/28536647 learned_addr learned my addr 172.21.15.33:0/28536647 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f440659c640 1 --2- 172.21.15.33:0/28536647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe4f9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f4405d9b640 1 --2- 172.21.15.33:0/28536647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe50fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f4406d9d640 1 -- 172.21.15.33:0/28536647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 msgr2=0x55babe4f9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f4406d9d640 1 --2- 172.21.15.33:0/28536647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe4f9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f4406d9d640 1 -- 172.21.15.33:0/28536647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 msgr2=0x55babe50fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f4406d9d640 1 --2- 172.21.15.33:0/28536647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe50fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f4406d9d640 1 -- 172.21.15.33:0/28536647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55babe111c20 con 0x55babe153070 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f4406d9d640 1 --2- 172.21.15.33:0/28536647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe500c30 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f44000096e0 tx=0x7f4400004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e0a8fe076d2b5e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f43effff640 1 -- 172.21.15.33:0/28536647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400022040 con 0x55babe153070 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f43effff640 1 -- 172.21.15.33:0/28536647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4400036020 con 0x55babe153070 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.702+0000 7f43effff640 1 -- 172.21.15.33:0/28536647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400026da0 con 0x55babe153070 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.703+0000 7f4412ea5740 1 -- 172.21.15.33:0/28536647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 msgr2=0x55babe500c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.703+0000 7f4412ea5740 1 --2- 172.21.15.33:0/28536647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe500c30 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f44000096e0 tx=0x7f4400004980 comp rx=0 tx=0).stop 2024-08-28T19:46:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.703+0000 7f4412ea5740 1 -- 172.21.15.33:0/28536647 shutdown_connections 2024-08-28T19:46:09.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.703+0000 7f4412ea5740 1 --2- 172.21.15.33:0/28536647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe500c30 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.703+0000 7f4412ea5740 1 --2- 172.21.15.33:0/28536647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe50fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.703+0000 7f4412ea5740 1 --2- 172.21.15.33:0/28536647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe4f9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.703+0000 7f4412ea5740 1 -- 172.21.15.33:0/28536647 >> 172.21.15.33:0/28536647 conn(0x55babe147460 msgr2=0x55babe4f9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:09.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.703+0000 7f4412ea5740 1 -- 172.21.15.33:0/28536647 shutdown_connections 2024-08-28T19:46:09.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.703+0000 7f4412ea5740 1 -- 172.21.15.33:0/28536647 wait complete. 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.703+0000 7f4412ea5740 1 -- start start 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4412ea5740 1 Processor -- start 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe508380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe5088c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4412ea5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe57f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4412ea5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f44081b44a0 con 0x55babe153070 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4412ea5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44081b3dd0 con 0x55babe132390 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4412ea5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f44081b1030 con 0x55babe12a1b0 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4412ea5740 10 client.0 _ll_register_callbacks cb 0x7f4400003ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4406d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe57f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4406d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe57f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42564/0 (socket says 172.21.15.33:42564) 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4406d9d640 1 -- 172.21.15.33:0/1278172841 learned_addr learned my addr 172.21.15.33:0/1278172841 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f440659c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe508380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4405d9b640 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe5088c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4406d9d640 1 -- 172.21.15.33:0/1278172841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 msgr2=0x55babe508380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4406d9d640 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe508380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4406d9d640 1 -- 172.21.15.33:0/1278172841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 msgr2=0x55babe5088c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4406d9d640 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe5088c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4406d9d640 1 -- 172.21.15.33:0/1278172841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55babe57fbf0 con 0x55babe153070 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f4406d9d640 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe57f6b0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f44000136c0 tx=0x7f44000094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd70c99b79c7a8f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.704+0000 7f43edffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f43edffb640 1 -- 172.21.15.33:0/1278172841 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400022030 con 0x55babe153070 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f43edffb640 1 -- 172.21.15.33:0/1278172841 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7f440001e6f0 con 0x55babe153070 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f4412ea5740 1 -- 172.21.15.33:0/1278172841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4400036020 con 0x55babe153070 2024-08-28T19:46:09.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f43edffb640 1 -- 172.21.15.33:0/1278172841 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f440004c050 con 0x55babe153070 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f4412ea5740 10 client.19269 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f4412ea5740 1 -- 172.21.15.33:0/1278172841 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55babe580dd0 con 0x55babe153070 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f43edffb640 1 -- 172.21.15.33:0/1278172841 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4400036020 con 0x55babe153070 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f43edffb640 1 -- 172.21.15.33:0/1278172841 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4400027850 con 0x55babe153070 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f4412ea5740 10 client.19269 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f4412ea5740 10 client.19269 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f4412ea5740 20 client.19269 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f4412ea5740 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55babe0e6da0 0x55babe583450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f4412ea5740 4 client.19269 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.705+0000 7f4412ea5740 1 -- 172.21.15.33:0/1278172841 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55babe46d070 con 0x55babe0e6da0 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f440659c640 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55babe0e6da0 0x55babe583450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f43edffb640 10 client.19269 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:46:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f440659c640 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55babe0e6da0 0x55babe583450 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea94fa1b0b0fdf90 server_cookie=d283bc6e4386bac in_seq=0 out_seq=0 2024-08-28T19:46:09.753 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:46:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f43edffb640 1 -- 172.21.15.33:0/1278172841 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55babe46d070 con 0x55babe0e6da0 2024-08-28T19:46:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f43edffb640 10 client.19269 handle_command_reply: tid=0 2024-08-28T19:46:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 client.19269 shutdown 2024-08-28T19:46:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 -- 172.21.15.33:0/1278172841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 msgr2=0x55babe57f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe57f6b0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f44000136c0 tx=0x7f44000094b0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 -- 172.21.15.33:0/1278172841 shutdown_connections 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55babe0e6da0 0x55babe583450 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55babe153070 0x55babe57f6b0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55babe132390 0x55babe5088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 --2- 172.21.15.33:0/1278172841 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55babe12a1b0 0x55babe508380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f43edffb640 0 client.19269 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 -- 172.21.15.33:0/1278172841 >> 172.21.15.33:0/1278172841 conn(0x55babe147460 msgr2=0x55babe4f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 -- 172.21.15.33:0/1278172841 shutdown_connections 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.706+0000 7f4412ea5740 1 -- 172.21.15.33:0/1278172841 wait complete. 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f4412ea5740 20 client.19269 trim_cache size 0 max 16384 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 -- 172.21.15.33:0/256313175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43f00b4ca0 msgr2=0x7f43f00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43f00b4ca0 0x7f43f00b71b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4400005fd0 tx=0x7f4400004a40 comp rx=0 tx=0).stop 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 -- 172.21.15.33:0/256313175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44081045e0 msgr2=0x7f44081024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44081045e0 0x7f44081024f0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f43f800d770 tx=0x7f43f800dc30 comp rx=0 tx=0).stop 2024-08-28T19:46:09.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 -- 172.21.15.33:0/256313175 shutdown_connections 2024-08-28T19:46:09.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f440810db90 0x7f4408102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f43f00b4ca0 0x7f43f00b71b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4408105010 0x7f4408102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 --2- 172.21.15.33:0/256313175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44081045e0 0x7f44081024f0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:09.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 -- 172.21.15.33:0/256313175 >> 172.21.15.33:0/256313175 conn(0x7f44080794d0 msgr2=0x7f44080ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:09.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 -- 172.21.15.33:0/256313175 shutdown_connections 2024-08-28T19:46:09.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:09.707+0000 7f440c930640 1 -- 172.21.15.33:0/256313175 wait complete. 2024-08-28T19:46:09.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:09 smithi033 ceph-mon[18549]: pgmap v768: 129 pgs: 129 active+clean; 23 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 124 KiB/s wr, 35 op/s 2024-08-28T19:46:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:09 smithi059 ceph-mon[22052]: pgmap v768: 129 pgs: 129 active+clean; 23 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 124 KiB/s wr, 35 op/s 2024-08-28T19:46:10.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:09 smithi122 ceph-mon[22174]: pgmap v768: 129 pgs: 129 active+clean; 23 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 124 KiB/s wr, 35 op/s 2024-08-28T19:46:10.429 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:46:10.681 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:11.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:10 smithi059 ceph-mon[22052]: pgmap v769: 129 pgs: 129 active+clean; 24 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 113 KiB/s wr, 34 op/s 2024-08-28T19:46:11.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:10 smithi122 ceph-mon[22174]: pgmap v769: 129 pgs: 129 active+clean; 24 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 113 KiB/s wr, 34 op/s 2024-08-28T19:46:11.094 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:10 smithi033 ceph-mon[18549]: pgmap v769: 129 pgs: 129 active+clean; 24 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 113 KiB/s wr, 34 op/s 2024-08-28T19:46:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.186+0000 7fe90d1fd640 1 -- 172.21.15.33:0/558576427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe908109b90 msgr2=0x7fe9081103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.186+0000 7fe90d1fd640 1 --2- 172.21.15.33:0/558576427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe908109b90 0x7fe9081103c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fe900009900 tx=0x7fe90002a410 comp rx=0 tx=0).stop 2024-08-28T19:46:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.186+0000 7fe90d1fd640 1 -- 172.21.15.33:0/558576427 shutdown_connections 2024-08-28T19:46:11.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.186+0000 7fe90d1fd640 1 --2- 172.21.15.33:0/558576427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe908109b90 0x7fe9081103c0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.186+0000 7fe90d1fd640 1 --2- 172.21.15.33:0/558576427 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe908109240 0x7fe908109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.186+0000 7fe90d1fd640 1 --2- 172.21.15.33:0/558576427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908103900 0x7fe908103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.186+0000 7fe90d1fd640 1 -- 172.21.15.33:0/558576427 >> 172.21.15.33:0/558576427 conn(0x7fe90807b5f0 msgr2=0x7fe90807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.186+0000 7fe90d1fd640 1 -- 172.21.15.33:0/558576427 shutdown_connections 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.186+0000 7fe90d1fd640 1 -- 172.21.15.33:0/558576427 wait complete. 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe90d1fd640 1 Processor -- start 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe90d1fd640 1 -- start start 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe90d1fd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe908103900 0x7fe90819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe90d1fd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe908109240 0x7fe90819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe90d1fd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908109b90 0x7fe90819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe90d1fd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe908113850 con 0x7fe908103900 2024-08-28T19:46:11.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe90d1fd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081136d0 con 0x7fe908109b90 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe90d1fd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081139d0 con 0x7fe908109240 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe906d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe908103900 0x7fe90819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe906d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe908103900 0x7fe90819a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42592/0 (socket says 172.21.15.33:42592) 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe906d9d640 1 -- 172.21.15.33:0/1203135287 learned_addr learned my addr 172.21.15.33:0/1203135287 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe90659c640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe908109240 0x7fe90819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe906d9d640 1 -- 172.21.15.33:0/1203135287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe908109240 msgr2=0x7fe90819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe906d9d640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe908109240 0x7fe90819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe90759e640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908109b90 0x7fe90819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.187+0000 7fe906d9d640 1 -- 172.21.15.33:0/1203135287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908109b90 msgr2=0x7fe90819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.188+0000 7fe906d9d640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908109b90 0x7fe90819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.188+0000 7fe906d9d640 1 -- 172.21.15.33:0/1203135287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9081a0190 con 0x7fe908103900 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.188+0000 7fe90659c640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe908109240 0x7fe90819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:11.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.188+0000 7fe90759e640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908109b90 0x7fe90819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.188+0000 7fe906d9d640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe908103900 0x7fe90819a220 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800eab0 tx=0x7fe8f800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.188+0000 7fe8fffff640 1 -- 172.21.15.33:0/1203135287 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f800ce40 con 0x7fe908103900 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.188+0000 7fe90d1fd640 1 -- 172.21.15.33:0/1203135287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9081a0480 con 0x7fe908103900 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.188+0000 7fe8fffff640 1 -- 172.21.15.33:0/1203135287 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8f8011920 con 0x7fe908103900 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.188+0000 7fe8fffff640 1 -- 172.21.15.33:0/1203135287 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8010a30 con 0x7fe908103900 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.188+0000 7fe90d1fd640 1 -- 172.21.15.33:0/1203135287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9081a6be0 con 0x7fe908103900 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.191+0000 7fe913772740 1 Processor -- start 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.191+0000 7fe913772740 1 -- start start 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe913772740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 0x556fab654310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe913772740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab654850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe8fffff640 1 -- 172.21.15.33:0/1203135287 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe8f8010bd0 con 0x7fe908103900 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe913772740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab654d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe913772740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556fab5cb680 con 0x556fab2861b0 2024-08-28T19:46:11.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe913772740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556fab5bac10 con 0x556fab28e390 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe913772740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556fab5bebc0 con 0x556fab2af070 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe906d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab654850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe906d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab654850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42606/0 (socket says 172.21.15.33:42606) 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe906d9d640 1 -- 172.21.15.33:0/2173487878 learned_addr learned my addr 172.21.15.33:0/2173487878 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe90759e640 1 --2- 172.21.15.33:0/2173487878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 0x556fab654310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe90659c640 1 --2- 172.21.15.33:0/2173487878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab654d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe906d9d640 1 -- 172.21.15.33:0/2173487878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 msgr2=0x556fab654310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe906d9d640 1 --2- 172.21.15.33:0/2173487878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 0x556fab654310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe906d9d640 1 -- 172.21.15.33:0/2173487878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 msgr2=0x556fab654d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe906d9d640 1 --2- 172.21.15.33:0/2173487878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab654d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe906d9d640 1 -- 172.21.15.33:0/2173487878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fab31a650 con 0x556fab2861b0 2024-08-28T19:46:11.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.192+0000 7fe906d9d640 1 --2- 172.21.15.33:0/2173487878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab654850 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80e32c0 tx=0x7fe8f80ee320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fd07ed403549fc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.193+0000 7fe8fd7fa640 1 -- 172.21.15.33:0/2173487878 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80f9070 con 0x556fab2861b0 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.193+0000 7fe8fd7fa640 1 -- 172.21.15.33:0/2173487878 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8f80e82e0 con 0x556fab2861b0 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.193+0000 7fe8fd7fa640 1 -- 172.21.15.33:0/2173487878 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80f4660 con 0x556fab2861b0 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.193+0000 7fe8fffff640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8f40b4ca0 0x7fe8f40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.193+0000 7fe90759e640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8f40b4ca0 0x7fe8f40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.193+0000 7fe8fffff640 1 -- 172.21.15.33:0/1203135287 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7fe8f80e6000 con 0x7fe908103900 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 -- 172.21.15.33:0/2173487878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 msgr2=0x556fab654850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 --2- 172.21.15.33:0/2173487878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab654850 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80e32c0 tx=0x7fe8f80ee320 comp rx=0 tx=0).stop 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 -- 172.21.15.33:0/2173487878 shutdown_connections 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 --2- 172.21.15.33:0/2173487878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab654d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 --2- 172.21.15.33:0/2173487878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab654850 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 --2- 172.21.15.33:0/2173487878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 0x556fab654310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 -- 172.21.15.33:0/2173487878 >> 172.21.15.33:0/2173487878 conn(0x556fab2a3460 msgr2=0x556fab652200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 -- 172.21.15.33:0/2173487878 shutdown_connections 2024-08-28T19:46:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 -- 172.21.15.33:0/2173487878 wait complete. 2024-08-28T19:46:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe90759e640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8f40b4ca0 0x7fe8f40b71b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe900031440 tx=0x7fe900005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 -- start start 2024-08-28T19:46:11.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.194+0000 7fe913772740 1 Processor -- start 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe913772740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2861b0 0x556fab65fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe913772740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab28e390 0x556fab65ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe913772740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab2af070 0x556fab66be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe913772740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x556fab41d700 con 0x556fab28e390 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe913772740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556fab541750 con 0x556fab2af070 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe913772740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x556fab662af0 con 0x556fab2861b0 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe913772740 10 client.0 _ll_register_callbacks cb 0x556fab570e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab28e390 0x556fab65ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab28e390 0x556fab65ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42620/0 (socket says 172.21.15.33:42620) 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90659c640 1 -- 172.21.15.33:0/3934143728 learned_addr learned my addr 172.21.15.33:0/3934143728 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe906d9d640 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2861b0 0x556fab65fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90759e640 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab2af070 0x556fab66be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90659c640 1 -- 172.21.15.33:0/3934143728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2861b0 msgr2=0x556fab65fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90659c640 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2861b0 0x556fab65fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90659c640 1 -- 172.21.15.33:0/3934143728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab2af070 msgr2=0x556fab66be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90659c640 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab2af070 0x556fab66be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90659c640 1 -- 172.21.15.33:0/3934143728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fab57a900 con 0x556fab28e390 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90759e640 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab2af070 0x556fab66be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe90659c640 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab28e390 0x556fab65ffa0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00107c0 tx=0x7fe8f0010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a57137f6c61dd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe8ee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/3934143728 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f000ed40 con 0x556fab28e390 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/3934143728 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7fe8f0004020 con 0x556fab28e390 2024-08-28T19:46:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.195+0000 7fe913772740 1 -- 172.21.15.33:0/3934143728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8f80e82e0 con 0x556fab28e390 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/3934143728 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe8f0023050 con 0x556fab28e390 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe913772740 10 client.19281 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe913772740 1 -- 172.21.15.33:0/3934143728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556fab66e8c0 con 0x556fab28e390 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/3934143728 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8f80e82e0 con 0x556fab28e390 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/3934143728 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe8f00047a0 con 0x556fab28e390 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe913772740 10 client.19281 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe913772740 10 client.19281 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe913772740 20 client.19281 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe913772740 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556fab26d9f0 0x556fab671e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe913772740 4 client.19281 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe913772740 1 -- 172.21.15.33:0/3934143728 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fab5cd5d0 con 0x556fab26d9f0 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.196+0000 7fe906d9d640 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556fab26d9f0 0x556fab671e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.197+0000 7fe906d9d640 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556fab26d9f0 0x556fab671e30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ea7b94a304e16ba server_cookie=cbc91d6cd234aa08 in_seq=0 out_seq=0 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.197+0000 7fe8ee7fc640 10 client.19281 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.197+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/3934143728 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556fab5cd5d0 con 0x556fab26d9f0 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.197+0000 7fe8ee7fc640 10 client.19281 handle_command_reply: tid=0 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 client.19281 shutdown 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 -- 172.21.15.33:0/3934143728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab28e390 msgr2=0x556fab65ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab28e390 0x556fab65ffa0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00107c0 tx=0x7fe8f0010c80 comp rx=0 tx=0).stop 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 -- 172.21.15.33:0/3934143728 shutdown_connections 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556fab26d9f0 0x556fab671e30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab2af070 0x556fab66be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab28e390 0x556fab65ffa0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 --2- 172.21.15.33:0/3934143728 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2861b0 0x556fab65fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 -- 172.21.15.33:0/3934143728 >> 172.21.15.33:0/3934143728 conn(0x556fab2a3460 msgr2=0x556fab6574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe8ee7fc640 0 client.19281 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:46:11.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 -- 172.21.15.33:0/3934143728 shutdown_connections 2024-08-28T19:46:11.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 1 -- 172.21.15.33:0/3934143728 wait complete. 2024-08-28T19:46:11.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.198+0000 7fe913772740 20 client.19281 trim_cache size 0 max 16384 2024-08-28T19:46:11.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.211+0000 7fe913772740 1 Processor -- start 2024-08-28T19:46:11.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.211+0000 7fe913772740 1 -- start start 2024-08-28T19:46:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe913772740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2861b0 0x556fab652230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe913772740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab66bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe913772740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2af070 0x556fab65cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe913772740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b0da0 con 0x556fab2af070 2024-08-28T19:46:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe913772740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b28e0 con 0x556fab28e390 2024-08-28T19:46:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe913772740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b1470 con 0x556fab2861b0 2024-08-28T19:46:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90759e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2af070 0x556fab65cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90759e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2af070 0x556fab65cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42632/0 (socket says 172.21.15.33:42632) 2024-08-28T19:46:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90759e640 1 -- 172.21.15.33:0/1767227287 learned_addr learned my addr 172.21.15.33:0/1767227287 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90659c640 1 --2- 172.21.15.33:0/1767227287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab66bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe906d9d640 1 --2- 172.21.15.33:0/1767227287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2861b0 0x556fab652230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90759e640 1 -- 172.21.15.33:0/1767227287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2861b0 msgr2=0x556fab652230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90759e640 1 --2- 172.21.15.33:0/1767227287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2861b0 0x556fab652230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90759e640 1 -- 172.21.15.33:0/1767227287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 msgr2=0x556fab66bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90759e640 1 --2- 172.21.15.33:0/1767227287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab66bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90759e640 1 -- 172.21.15.33:0/1767227287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fab672390 con 0x556fab2af070 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90659c640 1 --2- 172.21.15.33:0/1767227287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab66bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe90759e640 1 --2- 172.21.15.33:0/1767227287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2af070 0x556fab65cc50 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fe900033000 tx=0x7fe90003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa13c43fe7274d27 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.212+0000 7fe8fcff9640 1 -- 172.21.15.33:0/1767227287 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90004d070 con 0x556fab2af070 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.213+0000 7fe8fcff9640 1 -- 172.21.15.33:0/1767227287 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe900005040 con 0x556fab2af070 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.213+0000 7fe8fcff9640 1 -- 172.21.15.33:0/1767227287 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900035040 con 0x556fab2af070 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.213+0000 7fe913772740 1 -- 172.21.15.33:0/1767227287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2af070 msgr2=0x556fab65cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.213+0000 7fe913772740 1 --2- 172.21.15.33:0/1767227287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2af070 0x556fab65cc50 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fe900033000 tx=0x7fe90003d000 comp rx=0 tx=0).stop 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.213+0000 7fe913772740 1 -- 172.21.15.33:0/1767227287 shutdown_connections 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.213+0000 7fe913772740 1 --2- 172.21.15.33:0/1767227287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2af070 0x556fab65cc50 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.213+0000 7fe913772740 1 --2- 172.21.15.33:0/1767227287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab66bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.213+0000 7fe913772740 1 --2- 172.21.15.33:0/1767227287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2861b0 0x556fab652230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.213+0000 7fe913772740 1 -- 172.21.15.33:0/1767227287 >> 172.21.15.33:0/1767227287 conn(0x556fab2a3460 msgr2=0x556fab651b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.213+0000 7fe913772740 1 -- 172.21.15.33:0/1767227287 shutdown_connections 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe913772740 1 -- 172.21.15.33:0/1767227287 wait complete. 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe913772740 1 -- start start 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe913772740 1 Processor -- start 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe913772740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab668690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe913772740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab663b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe913772740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 0x556fab664230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe913772740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b2210 con 0x556fab2861b0 2024-08-28T19:46:11.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe913772740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081b1b40 con 0x556fab28e390 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe913772740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe9081aeda0 con 0x556fab2af070 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe913772740 10 client.0 _ll_register_callbacks cb 0x7fe8f000c410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe906d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab668690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe906d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab668690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42634/0 (socket says 172.21.15.33:42634) 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.214+0000 7fe906d9d640 1 -- 172.21.15.33:0/636196767 learned_addr learned my addr 172.21.15.33:0/636196767 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe90659c640 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab663b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe90759e640 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 0x556fab664230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe906d9d640 1 -- 172.21.15.33:0/636196767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 msgr2=0x556fab664230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe906d9d640 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 0x556fab664230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe906d9d640 1 -- 172.21.15.33:0/636196767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 msgr2=0x556fab663b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe906d9d640 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab663b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe906d9d640 1 -- 172.21.15.33:0/636196767 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fab6649a0 con 0x556fab2861b0 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe90759e640 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 0x556fab664230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:11.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe906d9d640 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab668690 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80a9560 tx=0x7fe8f80e6c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d158aaec631bd517 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe8ee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/636196767 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80a81b0 con 0x556fab2861b0 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/636196767 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7fe8f80cf0b0 con 0x556fab2861b0 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe913772740 1 -- 172.21.15.33:0/636196767 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe900005040 con 0x556fab2861b0 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/636196767 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe8f80aba60 con 0x556fab2861b0 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe913772740 10 client.19287 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.215+0000 7fe913772740 1 -- 172.21.15.33:0/636196767 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556fab6dc870 con 0x556fab2861b0 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/636196767 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe900005040 con 0x556fab2861b0 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/636196767 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe8f800f040 con 0x556fab2861b0 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe913772740 10 client.19287 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe913772740 10 client.19287 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe913772740 20 client.19287 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:11.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe913772740 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556fab242da0 0x556fab6deab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe913772740 4 client.19287 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe913772740 1 -- 172.21.15.33:0/636196767 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556fab5c9070 con 0x556fab242da0 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe90659c640 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556fab242da0 0x556fab6deab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe8ee7fc640 10 client.19287 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.216+0000 7fe90659c640 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556fab242da0 0x556fab6deab0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ef838a7d8c0b6c2 server_cookie=3bbd0702ff3d5db in_seq=0 out_seq=0 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe8ee7fc640 1 -- 172.21.15.33:0/636196767 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556fab5c9070 con 0x556fab242da0 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe8ee7fc640 10 client.19287 handle_command_reply: tid=0 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 client.19287 shutdown 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 -- 172.21.15.33:0/636196767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 msgr2=0x556fab668690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab668690 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80a9560 tx=0x7fe8f80e6c00 comp rx=0 tx=0).stop 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 -- 172.21.15.33:0/636196767 shutdown_connections 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x556fab242da0 0x556fab6deab0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x556fab2af070 0x556fab664230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556fab28e390 0x556fab663b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 --2- 172.21.15.33:0/636196767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556fab2861b0 0x556fab668690 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe8ee7fc640 0 client.19287 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:46:11.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 -- 172.21.15.33:0/636196767 >> 172.21.15.33:0/636196767 conn(0x556fab2a3460 msgr2=0x556fab655340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:11.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 -- 172.21.15.33:0/636196767 shutdown_connections 2024-08-28T19:46:11.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 1 -- 172.21.15.33:0/636196767 wait complete. 2024-08-28T19:46:11.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.217+0000 7fe913772740 20 client.19287 trim_cache size 0 max 16384 2024-08-28T19:46:11.226 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:46:11.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 -- 172.21.15.33:0/1203135287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8f40b4ca0 msgr2=0x7fe8f40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:11.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8f40b4ca0 0x7fe8f40b71b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe900031440 tx=0x7fe900005a20 comp rx=0 tx=0).stop 2024-08-28T19:46:11.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 -- 172.21.15.33:0/1203135287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe908103900 msgr2=0x7fe90819a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:11.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe908103900 0x7fe90819a220 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800eab0 tx=0x7fe8f800ef70 comp rx=0 tx=0).stop 2024-08-28T19:46:11.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 -- 172.21.15.33:0/1203135287 shutdown_connections 2024-08-28T19:46:11.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe908109b90 0x7fe90819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe8f40b4ca0 0x7fe8f40b71b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe908109240 0x7fe90819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 --2- 172.21.15.33:0/1203135287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe908103900 0x7fe90819a220 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:11.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 -- 172.21.15.33:0/1203135287 >> 172.21.15.33:0/1203135287 conn(0x7fe90807b5f0 msgr2=0x7fe9081072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:11.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 -- 172.21.15.33:0/1203135287 shutdown_connections 2024-08-28T19:46:11.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:11.218+0000 7fe90d1fd640 1 -- 172.21.15.33:0/1203135287 wait complete. 2024-08-28T19:46:11.966 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:46:12.225 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.714+0000 7f7898079640 1 -- 172.21.15.33:0/1534021986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7890109b90 msgr2=0x7f78901103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.714+0000 7f7898079640 1 --2- 172.21.15.33:0/1534021986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7890109b90 0x7f78901103c0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f7888009ca0 tx=0x7f788802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.714+0000 7f7898079640 1 -- 172.21.15.33:0/1534021986 shutdown_connections 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.714+0000 7f7898079640 1 --2- 172.21.15.33:0/1534021986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7890109b90 0x7f78901103c0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.714+0000 7f7898079640 1 --2- 172.21.15.33:0/1534021986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890109240 0x7f7890109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.714+0000 7f7898079640 1 --2- 172.21.15.33:0/1534021986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7890103900 0x7f7890103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.714+0000 7f7898079640 1 -- 172.21.15.33:0/1534021986 >> 172.21.15.33:0/1534021986 conn(0x7f789007b5f0 msgr2=0x7f789007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.714+0000 7f7898079640 1 -- 172.21.15.33:0/1534021986 shutdown_connections 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.714+0000 7f7898079640 1 -- 172.21.15.33:0/1534021986 wait complete. 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.715+0000 7f7898079640 1 Processor -- start 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.715+0000 7f7898079640 1 -- start start 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.715+0000 7f7898079640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7890103900 0x7f789019c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.715+0000 7f7898079640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7890109240 0x7f789019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.715+0000 7f7898079640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890109b90 0x7f78901a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.715+0000 7f7898079640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7890113850 con 0x7f7890103900 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.715+0000 7f7898079640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78901136d0 con 0x7f7890109b90 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.715+0000 7f7898079640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78901139d0 con 0x7f7890109240 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895e15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7890103900 0x7f789019c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895e15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7890103900 0x7f789019c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42650/0 (socket says 172.21.15.33:42650) 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895e15640 1 -- 172.21.15.33:0/889371566 learned_addr learned my addr 172.21.15.33:0/889371566 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7896616640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890109b90 0x7f78901a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895e15640 1 -- 172.21.15.33:0/889371566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7890109240 msgr2=0x7f789019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895614640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7890109240 0x7f789019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895e15640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7890109240 0x7f789019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895e15640 1 -- 172.21.15.33:0/889371566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890109b90 msgr2=0x7f78901a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895e15640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890109b90 0x7f78901a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895e15640 1 -- 172.21.15.33:0/889371566 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78901a2350 con 0x7f7890103900 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895614640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7890109240 0x7f789019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7896616640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890109b90 0x7f78901a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7895e15640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7890103900 0x7f789019c3e0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c890 tx=0x7f788c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7882ffd640 1 -- 172.21.15.33:0/889371566 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c004220 con 0x7f7890103900 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7882ffd640 1 -- 172.21.15.33:0/889371566 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f788c0043c0 con 0x7f7890103900 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7898079640 1 -- 172.21.15.33:0/889371566 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78901a2640 con 0x7f7890103900 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7882ffd640 1 -- 172.21.15.33:0/889371566 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c004a00 con 0x7f7890103900 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.716+0000 7f7898079640 1 -- 172.21.15.33:0/889371566 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78901a8da0 con 0x7f7890103900 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.719+0000 7f7882ffd640 1 -- 172.21.15.33:0/889371566 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f788c0079b0 con 0x7f7890103900 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.719+0000 7f789e5ee740 1 Processor -- start 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.719+0000 7f789e5ee740 1 -- start start 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.719+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ef4070 0x562eda299310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.719+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ecb1b0 0x562eda299850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda299d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f789e5ee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562eda210680 con 0x562ed9ed3390 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f789e5ee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562eda1ffc10 con 0x562ed9ecb1b0 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f789e5ee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562eda203bc0 con 0x562ed9ef4070 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7895614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda299d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7895614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda299d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42652/0 (socket says 172.21.15.33:42652) 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7895614640 1 -- 172.21.15.33:0/1162030863 learned_addr learned my addr 172.21.15.33:0/1162030863 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7882ffd640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f787c0b4ca0 0x7f787c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7895e15640 1 --2- 172.21.15.33:0/1162030863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ecb1b0 0x562eda299850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7896616640 1 --2- 172.21.15.33:0/1162030863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ef4070 0x562eda299310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7896616640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f787c0b4ca0 0x7f787c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7895614640 1 -- 172.21.15.33:0/1162030863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ef4070 msgr2=0x562eda299310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:12.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7895614640 1 --2- 172.21.15.33:0/1162030863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ef4070 0x562eda299310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7895614640 1 -- 172.21.15.33:0/1162030863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ecb1b0 msgr2=0x562eda299850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7895614640 1 --2- 172.21.15.33:0/1162030863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ecb1b0 0x562eda299850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7895614640 1 -- 172.21.15.33:0/1162030863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ed9f5f650 con 0x562ed9ed3390 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7882ffd640 1 -- 172.21.15.33:0/889371566 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7f788c0e5780 con 0x7f7890103900 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.720+0000 7f7895614640 1 --2- 172.21.15.33:0/1162030863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda299d90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f7884009bc0 tx=0x7f788400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ee3428c98d6877 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.721+0000 7f787bfff640 1 -- 172.21.15.33:0/1162030863 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884016070 con 0x562ed9ed3390 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.721+0000 7f787bfff640 1 -- 172.21.15.33:0/1162030863 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7884011920 con 0x562ed9ed3390 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.721+0000 7f787bfff640 1 -- 172.21.15.33:0/1162030863 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78840107f0 con 0x562ed9ed3390 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.721+0000 7f7896616640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f787c0b4ca0 0x7f787c0b71b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f78880094e0 tx=0x7f7888005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 -- 172.21.15.33:0/1162030863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 msgr2=0x562eda299d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 --2- 172.21.15.33:0/1162030863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda299d90 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f7884009bc0 tx=0x7f788400e6c0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 -- 172.21.15.33:0/1162030863 shutdown_connections 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 --2- 172.21.15.33:0/1162030863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda299d90 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 --2- 172.21.15.33:0/1162030863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ecb1b0 0x562eda299850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 --2- 172.21.15.33:0/1162030863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ef4070 0x562eda299310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 -- 172.21.15.33:0/1162030863 >> 172.21.15.33:0/1162030863 conn(0x562ed9ee8460 msgr2=0x562eda297200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 -- 172.21.15.33:0/1162030863 shutdown_connections 2024-08-28T19:46:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 -- 172.21.15.33:0/1162030863 wait complete. 2024-08-28T19:46:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 -- start start 2024-08-28T19:46:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.722+0000 7f789e5ee740 1 Processor -- start 2024-08-28T19:46:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 0x562eda2a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 0x562eda2b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f789e5ee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562eda062700 con 0x562ed9ed3390 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f789e5ee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562eda186750 con 0x562ed9ef4070 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f789e5ee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562eda2a7af0 con 0x562ed9ecb1b0 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f789e5ee740 10 client.0 _ll_register_callbacks cb 0x562eda1b5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f7895614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f7895614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2a4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42654/0 (socket says 172.21.15.33:42654) 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f7895614640 1 -- 172.21.15.33:0/223457674 learned_addr learned my addr 172.21.15.33:0/223457674 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f7895e15640 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 0x562eda2a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f7896616640 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 0x562eda2b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f7895614640 1 -- 172.21.15.33:0/223457674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 msgr2=0x562eda2a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f7895614640 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 0x562eda2a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f7895614640 1 -- 172.21.15.33:0/223457674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 msgr2=0x562eda2b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f7895614640 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 0x562eda2b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.723+0000 7f7895614640 1 -- 172.21.15.33:0/223457674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eda1bf900 con 0x562ed9ed3390 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f7895614640 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2a4f30 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f788400efa0 tx=0x7f788400efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a7855811a9e075 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f78797fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f78797fa640 1 -- 172.21.15.33:0/223457674 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884016030 con 0x562ed9ed3390 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f78797fa640 1 -- 172.21.15.33:0/223457674 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7f7884005050 con 0x562ed9ed3390 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f789e5ee740 1 -- 172.21.15.33:0/223457674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7884011920 con 0x562ed9ed3390 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f78797fa640 1 -- 172.21.15.33:0/223457674 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7884005250 con 0x562ed9ed3390 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f789e5ee740 10 client.19299 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f789e5ee740 1 -- 172.21.15.33:0/223457674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562eda2b3830 con 0x562ed9ed3390 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f78797fa640 1 -- 172.21.15.33:0/223457674 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7884011920 con 0x562ed9ed3390 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f78797fa640 1 -- 172.21.15.33:0/223457674 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f788400f040 con 0x562ed9ed3390 2024-08-28T19:46:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f789e5ee740 10 client.19299 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f789e5ee740 10 client.19299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f789e5ee740 20 client.19299 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f789e5ee740 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562ed9eb29f0 0x562eda2b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f789e5ee740 4 client.19299 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.724+0000 7f789e5ee740 1 -- 172.21.15.33:0/223457674 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562eda2125d0 con 0x562ed9eb29f0 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.725+0000 7f7895e15640 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562ed9eb29f0 0x562eda2b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.725+0000 7f78797fa640 10 client.19299 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.725+0000 7f7895e15640 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562ed9eb29f0 0x562eda2b6bf0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a03354f893546ad9 server_cookie=cd86173706a94b7 in_seq=0 out_seq=0 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f78797fa640 1 -- 172.21.15.33:0/223457674 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562eda2125d0 con 0x562ed9eb29f0 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f78797fa640 10 client.19299 handle_command_reply: tid=0 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 client.19299 shutdown 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 -- 172.21.15.33:0/223457674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 msgr2=0x562eda2a4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2a4f30 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f788400efa0 tx=0x7f788400efd0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 -- 172.21.15.33:0/223457674 shutdown_connections 2024-08-28T19:46:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 0x562eda2b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562ed9eb29f0 0x562eda2b6bf0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2a4f30 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 --2- 172.21.15.33:0/223457674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 0x562eda2a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f78797fa640 0 client.19299 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 -- 172.21.15.33:0/223457674 >> 172.21.15.33:0/223457674 conn(0x562ed9ee8460 msgr2=0x562eda29c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 -- 172.21.15.33:0/223457674 shutdown_connections 2024-08-28T19:46:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 1 -- 172.21.15.33:0/223457674 wait complete. 2024-08-28T19:46:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.726+0000 7f789e5ee740 20 client.19299 trim_cache size 0 max 16384 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f789e5ee740 1 Processor -- start 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f789e5ee740 1 -- start start 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 0x562eda2a6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 0x562eda2a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f789e5ee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f78901b2fc0 con 0x562ed9ed3390 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f789e5ee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78901b4b00 con 0x562ed9ef4070 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f789e5ee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78901b3690 con 0x562ed9ecb1b0 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f7895614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f7895614640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42670/0 (socket says 172.21.15.33:42670) 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f7895614640 1 -- 172.21.15.33:0/2011877600 learned_addr learned my addr 172.21.15.33:0/2011877600 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:12.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f7895e15640 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 0x562eda2a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f7895614640 1 -- 172.21.15.33:0/2011877600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 msgr2=0x562eda2a6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f7896616640 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 0x562eda2a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f7895614640 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 0x562eda2a6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.740+0000 7f7895614640 1 -- 172.21.15.33:0/2011877600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 msgr2=0x562eda2a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.741+0000 7f7895614640 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 0x562eda2a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.741+0000 7f7895614640 1 -- 172.21.15.33:0/2011877600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eda29b600 con 0x562ed9ed3390 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.741+0000 7f7895e15640 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 0x562eda2a6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.741+0000 7f7896616640 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 0x562eda2a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.741+0000 7f7895614640 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2b0ce0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f7884009f20 tx=0x7f78840094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7603dff218b95340 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.741+0000 7f787b7fe640 1 -- 172.21.15.33:0/2011877600 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884036070 con 0x562ed9ed3390 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.741+0000 7f787b7fe640 1 -- 172.21.15.33:0/2011877600 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7884011780 con 0x562ed9ed3390 2024-08-28T19:46:12.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.741+0000 7f787b7fe640 1 -- 172.21.15.33:0/2011877600 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7884016070 con 0x562ed9ed3390 2024-08-28T19:46:12.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 -- 172.21.15.33:0/2011877600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 msgr2=0x562eda2b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:12.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2b0ce0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f7884009f20 tx=0x7f78840094e0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 -- 172.21.15.33:0/2011877600 shutdown_connections 2024-08-28T19:46:12.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ef4070 0x562eda2a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ed3390 0x562eda2b0ce0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 --2- 172.21.15.33:0/2011877600 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ecb1b0 0x562eda2a6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 -- 172.21.15.33:0/2011877600 >> 172.21.15.33:0/2011877600 conn(0x562ed9ee8460 msgr2=0x562eda2a5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 -- 172.21.15.33:0/2011877600 shutdown_connections 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 -- 172.21.15.33:0/2011877600 wait complete. 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 -- start start 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.742+0000 7f789e5ee740 1 Processor -- start 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ecb1b0 0x562eda2a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ed3390 0x562eda2a8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f789e5ee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ef4070 0x562eda2acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f789e5ee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f78901b4430 con 0x562ed9ecb1b0 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f789e5ee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78901b3d60 con 0x562ed9ed3390 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f789e5ee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78901b0fc0 con 0x562ed9ef4070 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f789e5ee740 10 client.0 _ll_register_callbacks cb 0x7f788c0ab840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7895e15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ecb1b0 0x562eda2a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7895e15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ecb1b0 0x562eda2a87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42682/0 (socket says 172.21.15.33:42682) 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7895e15640 1 -- 172.21.15.33:0/1355788574 learned_addr learned my addr 172.21.15.33:0/1355788574 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:12.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7896616640 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ef4070 0x562eda2acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7895614640 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ed3390 0x562eda2a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7895e15640 1 -- 172.21.15.33:0/1355788574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ef4070 msgr2=0x562eda2acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7895e15640 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ef4070 0x562eda2acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7895e15640 1 -- 172.21.15.33:0/1355788574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ed3390 msgr2=0x562eda2a8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7895e15640 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ed3390 0x562eda2a8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7895e15640 1 -- 172.21.15.33:0/1355788574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eda2ad2b0 con 0x562ed9ecb1b0 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f7895e15640 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ecb1b0 0x562eda2a87e0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f788c0ab770 tx=0x7f788c0ab970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c3821c62189813 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.743+0000 7f78797fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f78797fa640 1 -- 172.21.15.33:0/1355788574 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c0b0070 con 0x562ed9ecb1b0 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f78797fa640 1 -- 172.21.15.33:0/1355788574 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9541+0+0 (secure 0 0 0) 0x7f788c0e2d50 con 0x562ed9ecb1b0 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f789e5ee740 1 -- 172.21.15.33:0/1355788574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7884011780 con 0x562ed9ecb1b0 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f78797fa640 1 -- 172.21.15.33:0/1355788574 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f788c01d040 con 0x562ed9ecb1b0 2024-08-28T19:46:12.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f789e5ee740 10 client.19305 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f789e5ee740 1 -- 172.21.15.33:0/1355788574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562eda320fa0 con 0x562ed9ecb1b0 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f78797fa640 1 -- 172.21.15.33:0/1355788574 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7884011780 con 0x562ed9ecb1b0 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f78797fa640 1 -- 172.21.15.33:0/1355788574 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f788c0b4900 con 0x562ed9ecb1b0 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f789e5ee740 10 client.19305 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f789e5ee740 10 client.19305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f789e5ee740 20 client.19305 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f789e5ee740 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562ed9e87da0 0x562eda3236c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f789e5ee740 4 client.19305 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.744+0000 7f789e5ee740 1 -- 172.21.15.33:0/1355788574 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562eda20e070 con 0x562ed9e87da0 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f7895614640 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562ed9e87da0 0x562eda3236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f7895614640 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562ed9e87da0 0x562eda3236c0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b4dd1fe96f5015 server_cookie=7885431b87de3c51 in_seq=0 out_seq=0 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f78797fa640 10 client.19305 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f78797fa640 1 -- 172.21.15.33:0/1355788574 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562eda20e070 con 0x562ed9e87da0 2024-08-28T19:46:12.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f78797fa640 10 client.19305 handle_command_reply: tid=0 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 client.19305 shutdown 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 -- 172.21.15.33:0/1355788574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ecb1b0 msgr2=0x562eda2a87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ecb1b0 0x562eda2a87e0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f788c0ab770 tx=0x7f788c0ab970 comp rx=0 tx=0).stop 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 -- 172.21.15.33:0/1355788574 shutdown_connections 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562ed9ef4070 0x562eda2acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ed9ed3390 0x562eda2a8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562ed9e87da0 0x562eda3236c0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 --2- 172.21.15.33:0/1355788574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562ed9ecb1b0 0x562eda2a87e0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f78797fa640 0 client.19305 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 -- 172.21.15.33:0/1355788574 >> 172.21.15.33:0/1355788574 conn(0x562ed9ee8460 msgr2=0x562eda2a5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 -- 172.21.15.33:0/1355788574 shutdown_connections 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.745+0000 7f789e5ee740 1 -- 172.21.15.33:0/1355788574 wait complete. 2024-08-28T19:46:12.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f789e5ee740 20 client.19305 trim_cache size 0 max 16384 2024-08-28T19:46:12.752 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:46:12.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 -- 172.21.15.33:0/889371566 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f787c0b4ca0 msgr2=0x7f787c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f787c0b4ca0 0x7f787c0b71b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f78880094e0 tx=0x7f7888005fd0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 -- 172.21.15.33:0/889371566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7890103900 msgr2=0x7f789019c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7890103900 0x7f789019c3e0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c890 tx=0x7f788c00cd50 comp rx=0 tx=0).stop 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 -- 172.21.15.33:0/889371566 shutdown_connections 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890109b90 0x7f78901a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f787c0b4ca0 0x7f787c0b71b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7890109240 0x7f789019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 --2- 172.21.15.33:0/889371566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7890103900 0x7f789019c3e0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 -- 172.21.15.33:0/889371566 >> 172.21.15.33:0/889371566 conn(0x7f789007b5f0 msgr2=0x7f7890107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 -- 172.21.15.33:0/889371566 shutdown_connections 2024-08-28T19:46:12.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:12.746+0000 7f7898079640 1 -- 172.21.15.33:0/889371566 wait complete. 2024-08-28T19:46:13.371 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:13 smithi033 ceph-mon[18549]: pgmap v770: 129 pgs: 129 active+clean; 24 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 113 KiB/s wr, 34 op/s 2024-08-28T19:46:13.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:13 smithi059 ceph-mon[22052]: pgmap v770: 129 pgs: 129 active+clean; 24 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 113 KiB/s wr, 34 op/s 2024-08-28T19:46:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:13 smithi122 ceph-mon[22174]: pgmap v770: 129 pgs: 129 active+clean; 24 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 113 KiB/s wr, 34 op/s 2024-08-28T19:46:14.608 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:46:14.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:46:14.879 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:15.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.392+0000 7f7474351640 1 -- 172.21.15.33:0/3443633048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f746c102810 msgr2=0x7f746c102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:15.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.392+0000 7f7474351640 1 --2- 172.21.15.33:0/3443633048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f746c102810 0x7f746c102c20 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f7468009900 tx=0x7f746802a410 comp rx=0 tx=0).stop 2024-08-28T19:46:15.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.392+0000 7f7474351640 1 -- 172.21.15.33:0/3443633048 shutdown_connections 2024-08-28T19:46:15.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.392+0000 7f7474351640 1 --2- 172.21.15.33:0/3443633048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c108aa0 0x7f746c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.392+0000 7f7474351640 1 --2- 172.21.15.33:0/3443633048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f746c108150 0x7f746c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.392+0000 7f7474351640 1 --2- 172.21.15.33:0/3443633048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f746c102810 0x7f746c102c20 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.392+0000 7f7474351640 1 -- 172.21.15.33:0/3443633048 >> 172.21.15.33:0/3443633048 conn(0x7f746c0794d0 msgr2=0x7f746c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.392+0000 7f7474351640 1 -- 172.21.15.33:0/3443633048 shutdown_connections 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.392+0000 7f7474351640 1 -- 172.21.15.33:0/3443633048 wait complete. 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.392+0000 7f7474351640 1 Processor -- start 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f7474351640 1 -- start start 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f7474351640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c102810 0x7f746c104000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f7474351640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f746c108150 0x7f746c104540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f7474351640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f746c108aa0 0x7f746c104a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f7474351640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f746c112770 con 0x7f746c108150 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f7474351640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1125f0 con 0x7f746c102810 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f7474351640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1128f0 con 0x7f746c108aa0 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74718ec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f746c108150 0x7f746c104540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74718ec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f746c108150 0x7f746c104540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42700/0 (socket says 172.21.15.33:42700) 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74718ec640 1 -- 172.21.15.33:0/1049450267 learned_addr learned my addr 172.21.15.33:0/1049450267 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:15.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74720ed640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c102810 0x7f746c104000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74728ee640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f746c108aa0 0x7f746c104a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74718ec640 1 -- 172.21.15.33:0/1049450267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f746c108aa0 msgr2=0x7f746c104a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74718ec640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f746c108aa0 0x7f746c104a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74718ec640 1 -- 172.21.15.33:0/1049450267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c102810 msgr2=0x7f746c104000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74718ec640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c102810 0x7f746c104000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74718ec640 1 -- 172.21.15.33:0/1049450267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c1a8530 con 0x7f746c108150 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.393+0000 7f74718ec640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f746c108150 0x7f746c104540 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f745c00b450 tx=0x7f745c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.394+0000 7f74637fe640 1 -- 172.21.15.33:0/1049450267 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c015020 con 0x7f746c108150 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.394+0000 7f74637fe640 1 -- 172.21.15.33:0/1049450267 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f745c011d40 con 0x7f746c108150 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.394+0000 7f7474351640 1 -- 172.21.15.33:0/1049450267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c1a8820 con 0x7f746c108150 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.394+0000 7f74637fe640 1 -- 172.21.15.33:0/1049450267 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c00f340 con 0x7f746c108150 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.394+0000 7f7474351640 1 -- 172.21.15.33:0/1049450267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c1a8de0 con 0x7f746c108150 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.396+0000 7f747a8c6740 1 Processor -- start 2024-08-28T19:46:15.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.396+0000 7f747a8c6740 1 -- start start 2024-08-28T19:46:15.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.396+0000 7f74637fe640 1 -- 172.21.15.33:0/1049450267 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f745c018020 con 0x7f746c108150 2024-08-28T19:46:15.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.397+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75ea350 0x558af7990780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.397+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 0x558af7990cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.397+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af7991200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.397+0000 7f747a8c6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558af79065f0 con 0x558af75c9670 2024-08-28T19:46:15.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.397+0000 7f747a8c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558af78f5b80 con 0x558af75ea350 2024-08-28T19:46:15.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.397+0000 7f747a8c6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558af78f9b30 con 0x558af75c1490 2024-08-28T19:46:15.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74728ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75ea350 0x558af7990780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74637fe640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74580b4ca0 0x7f74580b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74718ec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af7991200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74718ec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af7991200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42714/0 (socket says 172.21.15.33:42714) 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74718ec640 1 -- 172.21.15.33:0/844448561 learned_addr learned my addr 172.21.15.33:0/844448561 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74728ee640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74580b4ca0 0x7f74580b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74720ed640 1 --2- 172.21.15.33:0/844448561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 0x558af7990cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74637fe640 1 -- 172.21.15.33:0/1049450267 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f745c0e5290 con 0x7f746c108150 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74718ec640 1 -- 172.21.15.33:0/844448561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 msgr2=0x558af7990cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74718ec640 1 --2- 172.21.15.33:0/844448561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 0x558af7990cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74718ec640 1 -- 172.21.15.33:0/844448561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75ea350 msgr2=0x558af7990780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74718ec640 1 --2- 172.21.15.33:0/844448561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75ea350 0x558af7990780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74718ec640 1 -- 172.21.15.33:0/844448561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af7655930 con 0x558af75c9670 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74720ed640 1 --2- 172.21.15.33:0/844448561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 0x558af7990cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74728ee640 1 --2- 172.21.15.33:0/844448561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75ea350 0x558af7990780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.398+0000 7f74718ec640 1 --2- 172.21.15.33:0/844448561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af7991200 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f745c0ab7a0 tx=0x7f745c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95dfe9f56774a6be server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.399+0000 7f74728ee640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74580b4ca0 0x7f74580b71b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7464005c40 tx=0x7f7464004ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.399+0000 7f7460d9a640 1 -- 172.21.15.33:0/844448561 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c0abce0 con 0x558af75c9670 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.399+0000 7f7460d9a640 1 -- 172.21.15.33:0/844448561 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f745c0b4900 con 0x558af75c9670 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.399+0000 7f7460d9a640 1 -- 172.21.15.33:0/844448561 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c0a7a00 con 0x558af75c9670 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 -- 172.21.15.33:0/844448561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 msgr2=0x558af7991200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 --2- 172.21.15.33:0/844448561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af7991200 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f745c0ab7a0 tx=0x7f745c0047d0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 -- 172.21.15.33:0/844448561 shutdown_connections 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 --2- 172.21.15.33:0/844448561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af7991200 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 --2- 172.21.15.33:0/844448561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 0x558af7990cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 --2- 172.21.15.33:0/844448561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75ea350 0x558af7990780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 -- 172.21.15.33:0/844448561 >> 172.21.15.33:0/844448561 conn(0x558af75de740 msgr2=0x558af798e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 -- 172.21.15.33:0/844448561 shutdown_connections 2024-08-28T19:46:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 -- 172.21.15.33:0/844448561 wait complete. 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 -- start start 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.400+0000 7f747a8c6740 1 Processor -- start 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 0x558af799bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af799c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75ea350 0x558af79a8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f747a8c6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x558af7758890 con 0x558af75c9670 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f747a8c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558af787c790 con 0x558af75c1490 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f747a8c6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x558af799ef60 con 0x558af75ea350 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f747a8c6740 10 client.0 _ll_register_callbacks cb 0x558af7601ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74718ec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af799c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74718ec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af799c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42718/0 (socket says 172.21.15.33:42718) 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74718ec640 1 -- 172.21.15.33:0/549609471 learned_addr learned my addr 172.21.15.33:0/549609471 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74728ee640 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75ea350 0x558af79a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74720ed640 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 0x558af799bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74718ec640 1 -- 172.21.15.33:0/549609471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75ea350 msgr2=0x558af79a8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74718ec640 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75ea350 0x558af79a8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74718ec640 1 -- 172.21.15.33:0/549609471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 msgr2=0x558af799bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74718ec640 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 0x558af799bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74718ec640 1 -- 172.21.15.33:0/549609471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af78b3f30 con 0x558af75c9670 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74728ee640 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75ea350 0x558af79a8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f74718ec640 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af799c4c0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f745c0ab0a0 tx=0x7f745c010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd3d65a3befb8aa server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.401+0000 7f7455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f7455ffb640 1 -- 172.21.15.33:0/549609471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c0afe50 con 0x558af75c9670 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f747a8c6740 1 -- 172.21.15.33:0/549609471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f745c0b4900 con 0x558af75c9670 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f7455ffb640 1 -- 172.21.15.33:0/549609471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f745c0a7bd0 con 0x558af75c9670 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f7455ffb640 1 -- 172.21.15.33:0/549609471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f745c0b4240 con 0x558af75c9670 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f747a8c6740 10 client.19317 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:15.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f747a8c6740 1 -- 172.21.15.33:0/549609471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558af79aada0 con 0x558af75c9670 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f7455ffb640 1 -- 172.21.15.33:0/549609471 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f745c0b4900 con 0x558af75c9670 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f7455ffb640 1 -- 172.21.15.33:0/549609471 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f745c0aa9d0 con 0x558af75c9670 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f747a8c6740 10 client.19317 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f747a8c6740 10 client.19317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f747a8c6740 20 client.19317 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f747a8c6740 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558af75a8cd0 0x558af79ae100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f747a8c6740 4 client.19317 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f747a8c6740 1 -- 172.21.15.33:0/549609471 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558af7908540 con 0x558af75a8cd0 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.402+0000 7f74720ed640 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558af75a8cd0 0x558af79ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.403+0000 7f74720ed640 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558af75a8cd0 0x558af79ae100 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf51a30d940c1d7c server_cookie=c790f0045abaca59 in_seq=0 out_seq=0 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.403+0000 7f7455ffb640 10 client.19317 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f7455ffb640 1 -- 172.21.15.33:0/549609471 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558af7908540 con 0x558af75a8cd0 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f7455ffb640 10 client.19317 handle_command_reply: tid=0 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 client.19317 shutdown 2024-08-28T19:46:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 -- 172.21.15.33:0/549609471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 msgr2=0x558af799c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af799c4c0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f745c0ab0a0 tx=0x7f745c010730 comp rx=0 tx=0).stop 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 -- 172.21.15.33:0/549609471 shutdown_connections 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75ea350 0x558af79a8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558af75a8cd0 0x558af79ae100 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75c9670 0x558af799c4c0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 --2- 172.21.15.33:0/549609471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 0x558af799bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f7455ffb640 0 client.19317 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 -- 172.21.15.33:0/549609471 >> 172.21.15.33:0/549609471 conn(0x558af75de740 msgr2=0x558af7993960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 -- 172.21.15.33:0/549609471 shutdown_connections 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 1 -- 172.21.15.33:0/549609471 wait complete. 2024-08-28T19:46:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.404+0000 7f747a8c6740 20 client.19317 trim_cache size 0 max 16384 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f747a8c6740 1 Processor -- start 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f747a8c6740 1 -- start start 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 0x558af7994200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c9670 0x558af79a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af7999150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f747a8c6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1b2f00 con 0x558af75ea350 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f747a8c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1b4a40 con 0x558af75c9670 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f747a8c6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1b35d0 con 0x558af75c1490 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f74728ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af7999150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f74728ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af7999150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42720/0 (socket says 172.21.15.33:42720) 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f74728ee640 1 -- 172.21.15.33:0/1274590782 learned_addr learned my addr 172.21.15.33:0/1274590782 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f74718ec640 1 --2- 172.21.15.33:0/1274590782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c9670 0x558af79a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.422+0000 7f74720ed640 1 --2- 172.21.15.33:0/1274590782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 0x558af7994200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.423+0000 7f74728ee640 1 -- 172.21.15.33:0/1274590782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 msgr2=0x558af7994200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.423+0000 7f74728ee640 1 --2- 172.21.15.33:0/1274590782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 0x558af7994200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.423+0000 7f74728ee640 1 -- 172.21.15.33:0/1274590782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c9670 msgr2=0x558af79a81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.423+0000 7f74728ee640 1 --2- 172.21.15.33:0/1274590782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c9670 0x558af79a81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.423+0000 7f74728ee640 1 -- 172.21.15.33:0/1274590782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af799a460 con 0x558af75ea350 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.423+0000 7f74720ed640 1 --2- 172.21.15.33:0/1274590782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 0x558af7994200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.423+0000 7f74728ee640 1 --2- 172.21.15.33:0/1274590782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af7999150 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f7464012d40 tx=0x7f7464009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922e0100cbd22ec7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.423+0000 7f7457fff640 1 -- 172.21.15.33:0/1274590782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464021420 con 0x558af75ea350 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.423+0000 7f7457fff640 1 -- 172.21.15.33:0/1274590782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7464015e50 con 0x558af75ea350 2024-08-28T19:46:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.423+0000 7f7457fff640 1 -- 172.21.15.33:0/1274590782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746402b890 con 0x558af75ea350 2024-08-28T19:46:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 -- 172.21.15.33:0/1274590782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 msgr2=0x558af7999150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 --2- 172.21.15.33:0/1274590782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af7999150 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f7464012d40 tx=0x7f7464009720 comp rx=0 tx=0).stop 2024-08-28T19:46:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 -- 172.21.15.33:0/1274590782 shutdown_connections 2024-08-28T19:46:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 --2- 172.21.15.33:0/1274590782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af7999150 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 --2- 172.21.15.33:0/1274590782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c9670 0x558af79a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 --2- 172.21.15.33:0/1274590782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c1490 0x558af7994200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 -- 172.21.15.33:0/1274590782 >> 172.21.15.33:0/1274590782 conn(0x558af75de740 msgr2=0x558af798e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 -- 172.21.15.33:0/1274590782 shutdown_connections 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 -- 172.21.15.33:0/1274590782 wait complete. 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 -- start start 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.424+0000 7f747a8c6740 1 Processor -- start 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 0x558af79af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c9670 0x558af79af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f747a8c6740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af79afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f747a8c6740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1b4370 con 0x558af75ea350 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f747a8c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1b3ca0 con 0x558af75c1490 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f747a8c6740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1b0f00 con 0x558af75c9670 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f747a8c6740 10 client.0 _ll_register_callbacks cb 0x7f7464009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74728ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af79afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74728ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af79afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42724/0 (socket says 172.21.15.33:42724) 2024-08-28T19:46:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74728ee640 1 -- 172.21.15.33:0/3697757994 learned_addr learned my addr 172.21.15.33:0/3697757994 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74720ed640 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 0x558af79af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74718ec640 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c9670 0x558af79af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74728ee640 1 -- 172.21.15.33:0/3697757994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c9670 msgr2=0x558af79af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74728ee640 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c9670 0x558af79af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74728ee640 1 -- 172.21.15.33:0/3697757994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 msgr2=0x558af79af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74728ee640 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 0x558af79af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74728ee640 1 -- 172.21.15.33:0/3697757994 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af7a179b0 con 0x558af75ea350 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74718ec640 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c9670 0x558af79af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74720ed640 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 0x558af79af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f74728ee640 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af79afcc0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f7464012d10 tx=0x7f746402b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f1255c47d3dde5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f7455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.425+0000 7f7455ffb640 1 -- 172.21.15.33:0/3697757994 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464039020 con 0x558af75ea350 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f7455ffb640 1 -- 172.21.15.33:0/3697757994 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f7464004b20 con 0x558af75ea350 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f747a8c6740 1 -- 172.21.15.33:0/3697757994 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7464015e50 con 0x558af75ea350 2024-08-28T19:46:15.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f7455ffb640 1 -- 172.21.15.33:0/3697757994 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7464041050 con 0x558af75ea350 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f747a8c6740 10 client.19323 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f747a8c6740 1 -- 172.21.15.33:0/3697757994 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558af7a18c50 con 0x558af75ea350 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f7455ffb640 1 -- 172.21.15.33:0/3697757994 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7464015e50 con 0x558af75ea350 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f7455ffb640 1 -- 172.21.15.33:0/3697757994 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7464034070 con 0x558af75ea350 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f747a8c6740 10 client.19323 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f747a8c6740 10 client.19323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f747a8c6740 20 client.19323 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f747a8c6740 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558af757e080 0x558af7a1b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f747a8c6740 4 client.19323 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f747a8c6740 1 -- 172.21.15.33:0/3697757994 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558af799c850 con 0x558af757e080 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.426+0000 7f74720ed640 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558af757e080 0x558af7a1b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.427+0000 7f7455ffb640 10 client.19323 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.427+0000 7f74720ed640 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558af757e080 0x558af7a1b3b0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a831159cbc420e73 server_cookie=185b965c686b26e0 in_seq=0 out_seq=0 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f7455ffb640 1 -- 172.21.15.33:0/3697757994 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558af799c850 con 0x558af757e080 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f7455ffb640 10 client.19323 handle_command_reply: tid=0 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f747a8c6740 1 client.19323 shutdown 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f747a8c6740 1 -- 172.21.15.33:0/3697757994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 msgr2=0x558af79afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f747a8c6740 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af79afcc0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f7464012d10 tx=0x7f746402b410 comp rx=0 tx=0).stop 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f747a8c6740 1 -- 172.21.15.33:0/3697757994 shutdown_connections 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f747a8c6740 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x558af757e080 0x558af7a1b3b0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f747a8c6740 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558af75ea350 0x558af79afcc0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f747a8c6740 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x558af75c9670 0x558af79af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f747a8c6740 1 --2- 172.21.15.33:0/3697757994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558af75c1490 0x558af79af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f747a8c6740 1 -- 172.21.15.33:0/3697757994 >> 172.21.15.33:0/3697757994 conn(0x558af75de740 msgr2=0x558af799dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.428+0000 7f7455ffb640 0 client.19323 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f747a8c6740 1 -- 172.21.15.33:0/3697757994 shutdown_connections 2024-08-28T19:46:15.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f747a8c6740 1 -- 172.21.15.33:0/3697757994 wait complete. 2024-08-28T19:46:15.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f747a8c6740 20 client.19323 trim_cache size 0 max 16384 2024-08-28T19:46:15.434 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:46:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:46:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "48fef576-2648-4bab-8772-21d3637a9125", 2024-08-28T19:46:15.434 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:46:15.434 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:46:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 -- 172.21.15.33:0/1049450267 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74580b4ca0 msgr2=0x7f74580b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74580b4ca0 0x7f74580b71b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7464005c40 tx=0x7f7464004ab0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 -- 172.21.15.33:0/1049450267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f746c108150 msgr2=0x7f746c104540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f746c108150 0x7f746c104540 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f745c00b450 tx=0x7f745c00b910 comp rx=0 tx=0).stop 2024-08-28T19:46:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 -- 172.21.15.33:0/1049450267 shutdown_connections 2024-08-28T19:46:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f74580b4ca0 0x7f74580b71b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f746c108aa0 0x7f746c104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f746c108150 0x7f746c104540 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 --2- 172.21.15.33:0/1049450267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f746c102810 0x7f746c104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 -- 172.21.15.33:0/1049450267 >> 172.21.15.33:0/1049450267 conn(0x7f746c0794d0 msgr2=0x7f746c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:15.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 -- 172.21.15.33:0/1049450267 shutdown_connections 2024-08-28T19:46:15.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:15.429+0000 7f7474351640 1 -- 172.21.15.33:0/1049450267 wait complete. 2024-08-28T19:46:15.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:15 smithi033 ceph-mon[18549]: pgmap v771: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:46:15.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:15 smithi033 ceph-mon[18549]: osdmap e100: 12 total, 12 up, 12 in 2024-08-28T19:46:15.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:15 smithi059 ceph-mon[22052]: pgmap v771: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:46:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:15 smithi059 ceph-mon[22052]: osdmap e100: 12 total, 12 up, 12 in 2024-08-28T19:46:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:15 smithi122 ceph-mon[22174]: pgmap v771: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:46:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:15 smithi122 ceph-mon[22174]: osdmap e100: 12 total, 12 up, 12 in 2024-08-28T19:46:16.157 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:46:16.411 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:16 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:46:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:16 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:46:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:16 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:46:16.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:16 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:46:16.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:16 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:46:16.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:16 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:46:16.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:16 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:46:16.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:16 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:46:16.815 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:16 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:46:16.816 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:16 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:46:16.816 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:16 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:46:16.816 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:16 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.907+0000 7f9b65e65640 1 -- 172.21.15.33:0/2427510918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b60104f60 msgr2=0x7f9b60105370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.907+0000 7f9b65e65640 1 --2- 172.21.15.33:0/2427510918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b60104f60 0x7f9b60105370 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009900 tx=0x7f9b5402a410 comp rx=0 tx=0).stop 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.907+0000 7f9b65e65640 1 -- 172.21.15.33:0/2427510918 shutdown_connections 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.907+0000 7f9b65e65640 1 --2- 172.21.15.33:0/2427510918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b601058b0 0x7f9b6010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.907+0000 7f9b65e65640 1 --2- 172.21.15.33:0/2427510918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b60104f60 0x7f9b60105370 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.907+0000 7f9b65e65640 1 --2- 172.21.15.33:0/2427510918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b60102f50 0x7f9b60103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.907+0000 7f9b65e65640 1 -- 172.21.15.33:0/2427510918 >> 172.21.15.33:0/2427510918 conn(0x7f9b60079d30 msgr2=0x7f9b6007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.907+0000 7f9b65e65640 1 -- 172.21.15.33:0/2427510918 shutdown_connections 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.907+0000 7f9b65e65640 1 -- 172.21.15.33:0/2427510918 wait complete. 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.907+0000 7f9b65e65640 1 Processor -- start 2024-08-28T19:46:16.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b65e65640 1 -- start start 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b65e65640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b60102f50 0x7f9b6019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b65e65640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b60104f60 0x7f9b6019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b65e65640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b601058b0 0x7f9b6019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b65e65640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9b60112760 con 0x7f9b60104f60 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b65e65640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b601125e0 con 0x7f9b60102f50 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b65e65640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9b601128e0 con 0x7f9b601058b0 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b60104f60 0x7f9b6019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b60102f50 0x7f9b6019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b60104f60 0x7f9b6019a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42746/0 (socket says 172.21.15.33:42746) 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5effd640 1 -- 172.21.15.33:0/81848397 learned_addr learned my addr 172.21.15.33:0/81848397 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b601058b0 0x7f9b6019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5effd640 1 -- 172.21.15.33:0/81848397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b601058b0 msgr2=0x7f9b6019fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5effd640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b601058b0 0x7f9b6019fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5effd640 1 -- 172.21.15.33:0/81848397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b60102f50 msgr2=0x7f9b6019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5effd640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b60102f50 0x7f9b6019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5effd640 1 -- 172.21.15.33:0/81848397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b601a0130 con 0x7f9b60104f60 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.908+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b60102f50 0x7f9b6019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.909+0000 7f9b5effd640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b60104f60 0x7f9b6019a820 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f9b5402a930 tx=0x7f9b54004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.909+0000 7f9b5cff9640 1 -- 172.21.15.33:0/81848397 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5403f030 con 0x7f9b60104f60 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.909+0000 7f9b5cff9640 1 -- 172.21.15.33:0/81848397 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b54003aa0 con 0x7f9b60104f60 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.909+0000 7f9b65e65640 1 -- 172.21.15.33:0/81848397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b601a03c0 con 0x7f9b60104f60 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.909+0000 7f9b5cff9640 1 -- 172.21.15.33:0/81848397 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b54035070 con 0x7f9b60104f60 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.909+0000 7f9b65e65640 1 -- 172.21.15.33:0/81848397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b601a08a0 con 0x7f9b60104f60 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.912+0000 7f9b6c3da740 1 Processor -- start 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.912+0000 7f9b6c3da740 1 -- start start 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.912+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.912+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffed41b0 0x55e0002a2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.912+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffedc390 0x55e0002a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.912+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e000219630 con 0x55dfffed41b0 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.912+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e000208bc0 con 0x55dfffefd070 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.912+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e00020cb70 con 0x55dfffedc390 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.912+0000 7f9b5cff9640 1 -- 172.21.15.33:0/81848397 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9b54042030 con 0x7f9b60104f60 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.912+0000 7f9b5f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffed41b0 0x55e0002a2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffed41b0 0x55e0002a2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42756/0 (socket says 172.21.15.33:42756) 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5f7fe640 1 -- 172.21.15.33:0/1502970995 learned_addr learned my addr 172.21.15.33:0/1502970995 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/1502970995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5f7fe640 1 -- 172.21.15.33:0/1502970995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffedc390 msgr2=0x55e0002a2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/1502970995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffedc390 0x55e0002a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5f7fe640 1 -- 172.21.15.33:0/1502970995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 msgr2=0x55e0002a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/1502970995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002a22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5f7fe640 1 -- 172.21.15.33:0/1502970995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dffff68650 con 0x55dfffed41b0 2024-08-28T19:46:16.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/1502970995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffed41b0 0x55e0002a2800 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000f4f0 tx=0x7f9b5000f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7c44e1b32da954 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5cff9640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9b480b4cd0 0x7f9b480b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b45ffb640 1 -- 172.21.15.33:0/1502970995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50005220 con 0x55dfffed41b0 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b45ffb640 1 -- 172.21.15.33:0/1502970995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b50014070 con 0x55dfffed41b0 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b45ffb640 1 -- 172.21.15.33:0/1502970995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50010a50 con 0x55dfffed41b0 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.913+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9b480b4cd0 0x7f9b480b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b5cff9640 1 -- 172.21.15.33:0/81848397 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f9b54106060 con 0x7f9b60104f60 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b6c3da740 1 -- 172.21.15.33:0/1502970995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffed41b0 msgr2=0x55e0002a2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9b480b4cd0 0x7f9b480b71e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9b58008e40 tx=0x7f9b580085d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/1502970995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffed41b0 0x55e0002a2800 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000f4f0 tx=0x7f9b5000f9b0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b6c3da740 1 -- 172.21.15.33:0/1502970995 shutdown_connections 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/1502970995 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffedc390 0x55e0002a2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/1502970995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffed41b0 0x55e0002a2800 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/1502970995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b6c3da740 1 -- 172.21.15.33:0/1502970995 >> 172.21.15.33:0/1502970995 conn(0x55dfffef1460 msgr2=0x55e0002a01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b6c3da740 1 -- 172.21.15.33:0/1502970995 shutdown_connections 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.914+0000 7f9b6c3da740 1 -- 172.21.15.33:0/1502970995 wait complete. 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b6c3da740 1 -- start start 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b6c3da740 1 Processor -- start 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002be160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e00006b700 con 0x55dfffedc390 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e00018f700 con 0x55dfffefd070 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e0002b4dd0 con 0x55dfffed41b0 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b6c3da740 10 client.0 _ll_register_callbacks cb 0x55e0001bedc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42770/0 (socket says 172.21.15.33:42770) 2024-08-28T19:46:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b5effd640 1 -- 172.21.15.33:0/3039879139 learned_addr learned my addr 172.21.15.33:0/3039879139 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.915+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b5effd640 1 -- 172.21.15.33:0/3039879139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 msgr2=0x55e0002b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b5effd640 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b5effd640 1 -- 172.21.15.33:0/3039879139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 msgr2=0x55e0002be160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b5effd640 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002be160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b5effd640 1 -- 172.21.15.33:0/3039879139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0001c88b0 con 0x55dfffedc390 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b5effd640 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002b22d0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f9b54103470 tx=0x7f9b540cc240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa9f2c3de5c43da server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b3effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b3effd640 1 -- 172.21.15.33:0/3039879139 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b54049070 con 0x55dfffedc390 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b3effd640 1 -- 172.21.15.33:0/3039879139 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f9b54003c50 con 0x55dfffedc390 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3039879139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b50014070 con 0x55dfffedc390 2024-08-28T19:46:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b3effd640 1 -- 172.21.15.33:0/3039879139 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b540ccab0 con 0x55dfffedc390 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b6c3da740 10 client.19335 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.916+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3039879139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0002c0b80 con 0x55dfffedc390 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b3effd640 1 -- 172.21.15.33:0/3039879139 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b50014070 con 0x55dfffedc390 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b3effd640 1 -- 172.21.15.33:0/3039879139 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9b54103690 con 0x55dfffedc390 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b6c3da740 10 client.19335 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b6c3da740 10 client.19335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b6c3da740 20 client.19335 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dfffebb9f0 0x55e0002c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b6c3da740 4 client.19335 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3039879139 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e00021b580 con 0x55dfffebb9f0 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dfffebb9f0 0x55e0002c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dfffebb9f0 0x55e0002c3ff0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d7a0d247a03e720 server_cookie=f9663d33e8e31efd in_seq=0 out_seq=0 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.917+0000 7f9b3effd640 10 client.19335 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:16.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b3effd640 1 -- 172.21.15.33:0/3039879139 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e00021b580 con 0x55dfffebb9f0 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b3effd640 10 client.19335 handle_command_reply: tid=0 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b6c3da740 1 client.19335 shutdown 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3039879139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 msgr2=0x55e0002b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002b22d0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f9b54103470 tx=0x7f9b540cc240 comp rx=0 tx=0).stop 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3039879139 shutdown_connections 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002be160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dfffebb9f0 0x55e0002c3ff0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002b22d0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3039879139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b3effd640 0 client.19335 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.918+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3039879139 >> 172.21.15.33:0/3039879139 conn(0x55dfffef1460 msgr2=0x55e0002a5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.919+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3039879139 shutdown_connections 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.919+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3039879139 wait complete. 2024-08-28T19:46:16.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.919+0000 7f9b6c3da740 20 client.19335 trim_cache size 0 max 16384 2024-08-28T19:46:16.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b6c3da740 1 Processor -- start 2024-08-28T19:46:16.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b6c3da740 1 -- start start 2024-08-28T19:46:16.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002be060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9b601ae940 con 0x55dfffedc390 2024-08-28T19:46:16.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b601b0480 con 0x55dfffefd070 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9b601af010 con 0x55dfffed41b0 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002be060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002be060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42776/0 (socket says 172.21.15.33:42776) 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5effd640 1 -- 172.21.15.33:0/3655021420 learned_addr learned my addr 172.21.15.33:0/3655021420 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/3655021420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/3655021420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5effd640 1 -- 172.21.15.33:0/3655021420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 msgr2=0x55e0002b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5effd640 1 --2- 172.21.15.33:0/3655021420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5effd640 1 -- 172.21.15.33:0/3655021420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 msgr2=0x55e0002a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5effd640 1 --2- 172.21.15.33:0/3655021420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5effd640 1 -- 172.21.15.33:0/3655021420 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0002b0290 con 0x55dfffedc390 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/3655021420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:16.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.937+0000 7f9b5effd640 1 --2- 172.21.15.33:0/3655021420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002be060 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f9b540cc0b0 tx=0x7f9b54009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381db75a6d6b0c85 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.938+0000 7f9b457fa640 1 -- 172.21.15.33:0/3655021420 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b54049020 con 0x55dfffedc390 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.938+0000 7f9b457fa640 1 -- 172.21.15.33:0/3655021420 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b540cc3b0 con 0x55dfffedc390 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.938+0000 7f9b457fa640 1 -- 172.21.15.33:0/3655021420 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b54103690 con 0x55dfffedc390 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3655021420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 msgr2=0x55e0002be060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3655021420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002be060 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f9b540cc0b0 tx=0x7f9b54009260 comp rx=0 tx=0).stop 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3655021420 shutdown_connections 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3655021420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffefd070 0x55e0002a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3655021420 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffedc390 0x55e0002be060 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3655021420 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3655021420 >> 172.21.15.33:0/3655021420 conn(0x55dfffef1460 msgr2=0x55e0002a5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3655021420 shutdown_connections 2024-08-28T19:46:16.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3655021420 wait complete. 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 -- start start 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.939+0000 7f9b6c3da740 1 Processor -- start 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffedc390 0x55e0002b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b6c3da740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffefd070 0x55e0002b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9b601afdb0 con 0x55dfffefd070 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b601af6e0 con 0x55dfffedc390 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b6c3da740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9b601ac940 con 0x55dfffed41b0 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b6c3da740 10 client.0 _ll_register_callbacks cb 0x7f9b54005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffefd070 0x55e0002b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffefd070 0x55e0002b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42792/0 (socket says 172.21.15.33:42792) 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5ffff640 1 -- 172.21.15.33:0/3482325118 learned_addr learned my addr 172.21.15.33:0/3482325118 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:16.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5effd640 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffedc390 0x55e0002b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5ffff640 1 -- 172.21.15.33:0/3482325118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 msgr2=0x55e0002b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5ffff640 1 -- 172.21.15.33:0/3482325118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffedc390 msgr2=0x55e0002b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffedc390 0x55e0002b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5ffff640 1 -- 172.21.15.33:0/3482325118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e00032da70 con 0x55dfffefd070 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b5ffff640 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffefd070 0x55e0002b6c00 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f9b5801d6c0 tx=0x7f9b58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594f4a3b63e949e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.940+0000 7f9b3effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b3effd640 1 -- 172.21.15.33:0/3482325118 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b580273f0 con 0x55dfffefd070 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3482325118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b540cc3b0 con 0x55dfffefd070 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b3effd640 1 -- 172.21.15.33:0/3482325118 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f9b58027590 con 0x55dfffefd070 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b3effd640 1 -- 172.21.15.33:0/3482325118 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b58034050 con 0x55dfffefd070 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b6c3da740 10 client.19341 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3482325118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e00032ed40 con 0x55dfffefd070 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b3effd640 1 -- 172.21.15.33:0/3482325118 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b540cc3b0 con 0x55dfffefd070 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b3effd640 1 -- 172.21.15.33:0/3482325118 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9b5801c840 con 0x55dfffefd070 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b6c3da740 10 client.19341 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b6c3da740 10 client.19341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b6c3da740 20 client.19341 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dfffe90da0 0x55e000331560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b6c3da740 4 client.19341 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3482325118 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e000217020 con 0x55dfffe90da0 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.941+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dfffe90da0 0x55e000331560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.942+0000 7f9b5f7fe640 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dfffe90da0 0x55e000331560 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=615293366334dbae server_cookie=a9599698cbf84c7b in_seq=0 out_seq=0 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.942+0000 7f9b3effd640 10 client.19341 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.942+0000 7f9b3effd640 1 -- 172.21.15.33:0/3482325118 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6534 (crc 0 0 0) 0x55e000217020 con 0x55dfffe90da0 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.942+0000 7f9b3effd640 10 client.19341 handle_command_reply: tid=0 2024-08-28T19:46:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.942+0000 7f9b6c3da740 1 client.19341 shutdown 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.942+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3482325118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffefd070 msgr2=0x55e0002b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.942+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffefd070 0x55e0002b6c00 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f9b5801d6c0 tx=0x7f9b58004a40 comp rx=0 tx=0).stop 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.942+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3482325118 shutdown_connections 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.942+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55dfffe90da0 0x55e000331560 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.942+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dfffefd070 0x55e0002b6c00 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfffedc390 0x55e0002b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b6c3da740 1 --2- 172.21.15.33:0/3482325118 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dfffed41b0 0x55e0002b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3482325118 >> 172.21.15.33:0/3482325118 conn(0x55dfffef1460 msgr2=0x55e0002b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b3effd640 0 client.19341 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3482325118 shutdown_connections 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b6c3da740 1 -- 172.21.15.33:0/3482325118 wait complete. 2024-08-28T19:46:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b6c3da740 20 client.19341 trim_cache size 0 max 16384 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout: "48fef576-2648-4bab-8772-21d3637a9125": { 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "48fef576-2648-4bab-8772-21d3637a9125", 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:46:16.953 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.954 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.955 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:46:16.956 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.957 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:45:27.534627+0000", 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.958 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "48fef576-2648-4bab-8772-21d3637a9125": { 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:46:15.427396+0000", 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:46:16.959 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.961 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.962 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.964 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.965 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:16.966 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:46:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b65e65640 1 -- 172.21.15.33:0/81848397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9b480b4cd0 msgr2=0x7f9b480b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b65e65640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9b480b4cd0 0x7f9b480b71e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9b58008e40 tx=0x7f9b580085d0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b65e65640 1 -- 172.21.15.33:0/81848397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b60104f60 msgr2=0x7f9b6019a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b65e65640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b60104f60 0x7f9b6019a820 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f9b5402a930 tx=0x7f9b54004270 comp rx=0 tx=0).stop 2024-08-28T19:46:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b65e65640 1 -- 172.21.15.33:0/81848397 shutdown_connections 2024-08-28T19:46:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b65e65640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f9b480b4cd0 0x7f9b480b71e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b65e65640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b601058b0 0x7f9b6019fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b65e65640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b60104f60 0x7f9b6019a820 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b65e65640 1 --2- 172.21.15.33:0/81848397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b60102f50 0x7f9b6019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.943+0000 7f9b65e65640 1 -- 172.21.15.33:0/81848397 >> 172.21.15.33:0/81848397 conn(0x7f9b60079d30 msgr2=0x7f9b60100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.944+0000 7f9b65e65640 1 -- 172.21.15.33:0/81848397 shutdown_connections 2024-08-28T19:46:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:16.944+0000 7f9b65e65640 1 -- 172.21.15.33:0/81848397 wait complete. 2024-08-28T19:46:17.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:17 smithi033 ceph-mon[18549]: pgmap v773: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:46:17.704 INFO:tasks.cephfs.filesystem:scrub status for tag:48fef576-2648-4bab-8772-21d3637a9125 - {'path': '/', 'tag': '48fef576-2648-4bab-8772-21d3637a9125', 'options': 'recursive,force'} 2024-08-28T19:46:17.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:17 smithi059 ceph-mon[22052]: pgmap v773: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:46:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:17 smithi122 ceph-mon[22174]: pgmap v773: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:46:19.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:19 smithi059 ceph-mon[22052]: pgmap v774: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:46:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:19 smithi122 ceph-mon[22174]: pgmap v774: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:46:19.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:19 smithi033 ceph-mon[18549]: pgmap v774: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-08-28T19:46:21.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:21 smithi059 ceph-mon[22052]: pgmap v775: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-08-28T19:46:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:21 smithi122 ceph-mon[22174]: pgmap v775: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-08-28T19:46:21.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:21 smithi033 ceph-mon[18549]: pgmap v775: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-08-28T19:46:23.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:23 smithi059 ceph-mon[22052]: pgmap v776: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-08-28T19:46:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:23 smithi122 ceph-mon[22174]: pgmap v776: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-08-28T19:46:23.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:23 smithi033 ceph-mon[18549]: pgmap v776: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-08-28T19:46:25.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:25 smithi059 ceph-mon[22052]: pgmap v777: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-08-28T19:46:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:25 smithi122 ceph-mon[22174]: pgmap v777: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-08-28T19:46:25.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:25 smithi033 ceph-mon[18549]: pgmap v777: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-08-28T19:46:27.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:27 smithi059 ceph-mon[22052]: pgmap v778: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-08-28T19:46:27.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:27 smithi122 ceph-mon[22174]: pgmap v778: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-08-28T19:46:27.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:27 smithi033 ceph-mon[18549]: pgmap v778: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-08-28T19:46:28.081 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:46:28.352 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:28.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 -- 172.21.15.33:0/1601279939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c8103920 msgr2=0x7f95c8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:28.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 --2- 172.21.15.33:0/1601279939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c8103920 0x7f95c8103d30 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009900 tx=0x7f95c402a410 comp rx=0 tx=0).stop 2024-08-28T19:46:28.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 -- 172.21.15.33:0/1601279939 shutdown_connections 2024-08-28T19:46:28.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 --2- 172.21.15.33:0/1601279939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8109bb0 0x7f95c81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:28.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 --2- 172.21.15.33:0/1601279939 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c8109260 0x7f95c8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:28.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 --2- 172.21.15.33:0/1601279939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c8103920 0x7f95c8103d30 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:28.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 -- 172.21.15.33:0/1601279939 >> 172.21.15.33:0/1601279939 conn(0x7f95c80ff350 msgr2=0x7f95c81017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 -- 172.21.15.33:0/1601279939 shutdown_connections 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 -- 172.21.15.33:0/1601279939 wait complete. 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 Processor -- start 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.857+0000 7f95cf687640 1 -- start start 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cf687640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8103920 0x7f95c819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cf687640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c8109260 0x7f95c819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cf687640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c8109bb0 0x7f95c819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cf687640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95c81138f0 con 0x7f95c8109bb0 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cf687640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8113770 con 0x7f95c8103920 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cf687640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8113a70 con 0x7f95c8109260 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cdc24640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c8109bb0 0x7f95c819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:28.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cd423640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8103920 0x7f95c819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95ccc22640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c8109260 0x7f95c819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cdc24640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c8109bb0 0x7f95c819fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54154/0 (socket says 172.21.15.33:54154) 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cd423640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8103920 0x7f95c819a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:39168/0 (socket says 172.21.15.33:39168) 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cdc24640 1 -- 172.21.15.33:0/4173206901 learned_addr learned my addr 172.21.15.33:0/4173206901 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cdc24640 1 -- 172.21.15.33:0/4173206901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c8109260 msgr2=0x7f95c819a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cdc24640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c8109260 0x7f95c819a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cdc24640 1 -- 172.21.15.33:0/4173206901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8103920 msgr2=0x7f95c819a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cdc24640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8103920 0x7f95c819a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.858+0000 7f95cdc24640 1 -- 172.21.15.33:0/4173206901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c81a0310 con 0x7f95c8109bb0 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.859+0000 7f95cdc24640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c8109bb0 0x7f95c819fbe0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f95c000b970 tx=0x7f95c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.859+0000 7f95be7fc640 1 -- 172.21.15.33:0/4173206901 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0019070 con 0x7f95c8109bb0 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.859+0000 7f95be7fc640 1 -- 172.21.15.33:0/4173206901 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95c0014440 con 0x7f95c8109bb0 2024-08-28T19:46:28.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.859+0000 7f95be7fc640 1 -- 172.21.15.33:0/4173206901 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c00075d0 con 0x7f95c8109bb0 2024-08-28T19:46:28.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.859+0000 7f95cf687640 1 -- 172.21.15.33:0/4173206901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c81a0600 con 0x7f95c8109bb0 2024-08-28T19:46:28.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.859+0000 7f95cf687640 1 -- 172.21.15.33:0/4173206901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c81a6d60 con 0x7f95c8109bb0 2024-08-28T19:46:28.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.860+0000 7f95cf687640 1 -- 172.21.15.33:0/4173206901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c8103d30 con 0x7f95c8109bb0 2024-08-28T19:46:28.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.862+0000 7f95be7fc640 1 -- 172.21.15.33:0/4173206901 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f95c001c070 con 0x7f95c8109bb0 2024-08-28T19:46:28.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.862+0000 7f95be7fc640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95b40b4ca0 0x7f95b40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:28.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.862+0000 7f95cd423640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95b40b4ca0 0x7f95b40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:28.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.862+0000 7f95be7fc640 1 -- 172.21.15.33:0/4173206901 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f95c00e5230 con 0x7f95c8109bb0 2024-08-28T19:46:28.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.863+0000 7f95cd423640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95b40b4ca0 0x7f95b40b71b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f95c4031440 tx=0x7f95c4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:28.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:28.866+0000 7f95be7fc640 1 -- 172.21.15.33:0/4173206901 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f95c00ab630 con 0x7f95c8109bb0 2024-08-28T19:46:29.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.087+0000 7f95cf687640 1 -- 172.21.15.33:0/4173206901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95c819b4d0 con 0x7f95c8109bb0 2024-08-28T19:46:29.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.088+0000 7f95be7fc640 1 -- 172.21.15.33:0/4173206901 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f95c819b4d0 con 0x7f95c8109bb0 2024-08-28T19:46:29.090 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:46:29.090 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:46:29.091 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:46:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 -- 172.21.15.33:0/4173206901 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95b40b4ca0 msgr2=0x7f95b40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95b40b4ca0 0x7f95b40b71b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f95c4031440 tx=0x7f95c4009560 comp rx=0 tx=0).stop 2024-08-28T19:46:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 -- 172.21.15.33:0/4173206901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c8109bb0 msgr2=0x7f95c819fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c8109bb0 0x7f95c819fbe0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f95c000b970 tx=0x7f95c000be30 comp rx=0 tx=0).stop 2024-08-28T19:46:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 -- 172.21.15.33:0/4173206901 shutdown_connections 2024-08-28T19:46:29.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c8109bb0 0x7f95c819fbe0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:29.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f95b40b4ca0 0x7f95b40b71b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:29.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95c8109260 0x7f95c819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:29.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 --2- 172.21.15.33:0/4173206901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95c8103920 0x7f95c819a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:29.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 -- 172.21.15.33:0/4173206901 >> 172.21.15.33:0/4173206901 conn(0x7f95c80ff350 msgr2=0x7f95c81088d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:29.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 -- 172.21.15.33:0/4173206901 shutdown_connections 2024-08-28T19:46:29.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:29.091+0000 7f95cf687640 1 -- 172.21.15.33:0/4173206901 wait complete. 2024-08-28T19:46:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:29 smithi059 ceph-mon[22052]: pgmap v779: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-08-28T19:46:29.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:29 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/4173206901' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:29 smithi122 ceph-mon[22174]: pgmap v779: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-08-28T19:46:29.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:29 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/4173206901' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:29.799 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:29 smithi033 ceph-mon[18549]: pgmap v779: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-08-28T19:46:29.799 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:29 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/4173206901' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:29.830 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id 86c16439 --release --await' 2024-08-28T19:46:29.830 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id 86c16439 --release --await 2024-08-28T19:46:30.089 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:30.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.609+0000 7f89f6c17640 1 -- 172.21.15.33:0/233738402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f0108a90 msgr2=0x7f89f010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:30.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.609+0000 7f89f6c17640 1 --2- 172.21.15.33:0/233738402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f0108a90 0x7f89f010f2c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009ca0 tx=0x7f89e802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.609+0000 7f89f6c17640 1 -- 172.21.15.33:0/233738402 shutdown_connections 2024-08-28T19:46:30.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.609+0000 7f89f6c17640 1 --2- 172.21.15.33:0/233738402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f0108a90 0x7f89f010f2c0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.609+0000 7f89f6c17640 1 --2- 172.21.15.33:0/233738402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89f0108140 0x7f89f0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.609+0000 7f89f6c17640 1 --2- 172.21.15.33:0/233738402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f0102800 0x7f89f0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.609+0000 7f89f6c17640 1 -- 172.21.15.33:0/233738402 >> 172.21.15.33:0/233738402 conn(0x7f89f00794c0 msgr2=0x7f89f00798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:30.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.609+0000 7f89f6c17640 1 -- 172.21.15.33:0/233738402 shutdown_connections 2024-08-28T19:46:30.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.609+0000 7f89f6c17640 1 -- 172.21.15.33:0/233738402 wait complete. 2024-08-28T19:46:30.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.609+0000 7f89f6c17640 1 Processor -- start 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89f6c17640 1 -- start start 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89f6c17640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89f0102800 0x7f89f019afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89f6c17640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f0108140 0x7f89f019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89f6c17640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f0108a90 0x7f89f019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89f6c17640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01126f0 con 0x7f89f0108140 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89f6c17640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0112570 con 0x7f89f0108a90 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89f6c17640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0112870 con 0x7f89f0102800 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f0108140 0x7f89f019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f0108140 0x7f89f019b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54162/0 (socket says 172.21.15.33:54162) 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89effff640 1 -- 172.21.15.33:0/2091837395 learned_addr learned my addr 172.21.15.33:0/2091837395 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89f49b3640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89f0102800 0x7f89f019afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89f51b4640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f0108a90 0x7f89f019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89effff640 1 -- 172.21.15.33:0/2091837395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89f0102800 msgr2=0x7f89f019afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89effff640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89f0102800 0x7f89f019afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89effff640 1 -- 172.21.15.33:0/2091837395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f0108a90 msgr2=0x7f89f019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89effff640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f0108a90 0x7f89f019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89effff640 1 -- 172.21.15.33:0/2091837395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f01a6260 con 0x7f89f0108140 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.610+0000 7f89effff640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f0108140 0x7f89f019b4e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f89e400d770 tx=0x7f89e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.611+0000 7f89edffb640 1 -- 172.21.15.33:0/2091837395 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4017070 con 0x7f89f0108140 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.611+0000 7f89edffb640 1 -- 172.21.15.33:0/2091837395 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e4009c30 con 0x7f89f0108140 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.611+0000 7f89f6c17640 1 -- 172.21.15.33:0/2091837395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f01a6550 con 0x7f89f0108140 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.611+0000 7f89edffb640 1 -- 172.21.15.33:0/2091837395 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e400f620 con 0x7f89f0108140 2024-08-28T19:46:30.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.611+0000 7f89f6c17640 1 -- 172.21.15.33:0/2091837395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f01a6a90 con 0x7f89f0108140 2024-08-28T19:46:30.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.613+0000 7f89fd18c740 1 Processor -- start 2024-08-28T19:46:30.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.613+0000 7f89edffb640 1 -- 172.21.15.33:0/2091837395 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f89e401a070 con 0x7f89f0108140 2024-08-28T19:46:30.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.613+0000 7f89fd18c740 1 -- start start 2024-08-28T19:46:30.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 0x55fa58f2cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 0x55fa58f2d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f2d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89fd18c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fa58ea3a70 con 0x55fa58b66840 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89fd18c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fa58e93000 con 0x55fa58b87520 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89fd18c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fa58e96fb0 con 0x55fa58b5e660 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f2d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f2d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54172/0 (socket says 172.21.15.33:54172) 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89effff640 1 -- 172.21.15.33:0/1615049005 learned_addr learned my addr 172.21.15.33:0/1615049005 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89f51b4640 1 --2- 172.21.15.33:0/1615049005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 0x55fa58f2cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89f49b3640 1 --2- 172.21.15.33:0/1615049005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 0x55fa58f2d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89edffb640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89d80b4ca0 0x7f89d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89f51b4640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89d80b4ca0 0x7f89d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89f49b3640 1 -- 172.21.15.33:0/1615049005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 msgr2=0x55fa58f2cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89f49b3640 1 --2- 172.21.15.33:0/1615049005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 0x55fa58f2cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.614+0000 7f89f49b3640 1 -- 172.21.15.33:0/1615049005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 msgr2=0x55fa58f2d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.615+0000 7f89edffb640 1 -- 172.21.15.33:0/2091837395 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f89e40e53b0 con 0x7f89f0108140 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.615+0000 7f89f49b3640 1 --2- 172.21.15.33:0/1615049005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f2d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.615+0000 7f89f49b3640 1 -- 172.21.15.33:0/1615049005 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa58bf2b00 con 0x55fa58b5e660 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.615+0000 7f89effff640 1 --2- 172.21.15.33:0/1615049005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f2d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.615+0000 7f89f51b4640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89d80b4ca0 0x7f89d80b71b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f89e802f500 tx=0x7f89e802a8c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.615+0000 7f89f49b3640 1 --2- 172.21.15.33:0/1615049005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 0x55fa58f2d1c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89e000bbc0 tx=0x7f89e00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c5522e10189769 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.615+0000 7f89d6ffd640 1 -- 172.21.15.33:0/1615049005 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0004030 con 0x55fa58b5e660 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.615+0000 7f89d6ffd640 1 -- 172.21.15.33:0/1615049005 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e00041d0 con 0x55fa58b5e660 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.615+0000 7f89d6ffd640 1 -- 172.21.15.33:0/1615049005 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e00116a0 con 0x55fa58b5e660 2024-08-28T19:46:30.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.616+0000 7f89fd18c740 1 -- 172.21.15.33:0/1615049005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 msgr2=0x55fa58f2d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:30.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.616+0000 7f89fd18c740 1 --2- 172.21.15.33:0/1615049005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 0x55fa58f2d1c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89e000bbc0 tx=0x7f89e00107a0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.616+0000 7f89fd18c740 1 -- 172.21.15.33:0/1615049005 shutdown_connections 2024-08-28T19:46:30.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.616+0000 7f89fd18c740 1 --2- 172.21.15.33:0/1615049005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f2d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.616+0000 7f89fd18c740 1 --2- 172.21.15.33:0/1615049005 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 0x55fa58f2d1c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.616+0000 7f89fd18c740 1 --2- 172.21.15.33:0/1615049005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 0x55fa58f2cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.616+0000 7f89fd18c740 1 -- 172.21.15.33:0/1615049005 >> 172.21.15.33:0/1615049005 conn(0x55fa58b7b910 msgr2=0x55fa58f2ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:30.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.616+0000 7f89fd18c740 1 -- 172.21.15.33:0/1615049005 shutdown_connections 2024-08-28T19:46:30.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.616+0000 7f89fd18c740 1 -- 172.21.15.33:0/1615049005 wait complete. 2024-08-28T19:46:30.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89fd18c740 1 -- start start 2024-08-28T19:46:30.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89fd18c740 1 Processor -- start 2024-08-28T19:46:30.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 0x55fa58f387a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f38ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 0x55fa58f448d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89fd18c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fa58f3b460 con 0x55fa58b66840 2024-08-28T19:46:30.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89fd18c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fa58e54520 con 0x55fa58b87520 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89fd18c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fa58f3b5e0 con 0x55fa58b5e660 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89fd18c740 10 client.0 _ll_register_callbacks cb 0x55fa58e8cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f38ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f38ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54174/0 (socket says 172.21.15.33:54174) 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.617+0000 7f89effff640 1 -- 172.21.15.33:0/2588401389 learned_addr learned my addr 172.21.15.33:0/2588401389 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89f49b3640 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 0x55fa58f387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89f51b4640 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 0x55fa58f448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89effff640 1 -- 172.21.15.33:0/2588401389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 msgr2=0x55fa58f387a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89effff640 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 0x55fa58f387a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89effff640 1 -- 172.21.15.33:0/2588401389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 msgr2=0x55fa58f448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89effff640 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 0x55fa58f448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89effff640 1 -- 172.21.15.33:0/2588401389 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa58c69960 con 0x55fa58b66840 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89f51b4640 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 0x55fa58f448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89effff640 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f38ce0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f89e40ab740 tx=0x7f89e4010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96edad8cc085b81e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89cffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89cffff640 1 -- 172.21.15.33:0/2588401389 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4021030 con 0x55fa58b66840 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89cffff640 1 -- 172.21.15.33:0/2588401389 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f89e40e5150 con 0x55fa58b66840 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89fd18c740 1 -- 172.21.15.33:0/2588401389 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa58e329a0 con 0x55fa58b66840 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89cffff640 1 -- 172.21.15.33:0/2588401389 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89e40ab580 con 0x55fa58b66840 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89fd18c740 10 client.19359 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.618+0000 7f89fd18c740 1 -- 172.21.15.33:0/2588401389 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fa58f475a0 con 0x55fa58b66840 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89cffff640 1 -- 172.21.15.33:0/2588401389 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fa58e329a0 con 0x55fa58b66840 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89cffff640 1 -- 172.21.15.33:0/2588401389 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f89e40b4040 con 0x55fa58b66840 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89fd18c740 10 client.19359 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89fd18c740 10 client.19359 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:46:30.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89fd18c740 20 client.19359 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89fd18c740 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa58b45ea0 0x55fa58f4a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89fd18c740 4 client.19359 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89fd18c740 1 -- 172.21.15.33:0/2588401389 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa58ea59c0 con 0x55fa58b45ea0 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89f49b3640 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa58b45ea0 0x55fa58f4a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89cffff640 10 client.19359 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.619+0000 7f89f49b3640 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa58b45ea0 0x55fa58f4a970 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=123b0f697df5c559 server_cookie=b927f092f5a98e9b in_seq=0 out_seq=0 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89cffff640 1 -- 172.21.15.33:0/2588401389 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa58ea59c0 con 0x55fa58b45ea0 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89cffff640 10 client.19359 handle_command_reply: tid=0 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89fd18c740 1 client.19359 shutdown 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89fd18c740 1 -- 172.21.15.33:0/2588401389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 msgr2=0x55fa58f38ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89fd18c740 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f38ce0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f89e40ab740 tx=0x7f89e4010c00 comp rx=0 tx=0).stop 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89fd18c740 1 -- 172.21.15.33:0/2588401389 shutdown_connections 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89fd18c740 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b87520 0x55fa58f448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89fd18c740 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa58b45ea0 0x55fa58f4a970 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89fd18c740 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b66840 0x55fa58f38ce0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89fd18c740 1 --2- 172.21.15.33:0/2588401389 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b5e660 0x55fa58f387a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89fd18c740 1 -- 172.21.15.33:0/2588401389 >> 172.21.15.33:0/2588401389 conn(0x55fa58b7b910 msgr2=0x55fa58f2fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:30.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.620+0000 7f89cffff640 0 client.19359 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:30.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.621+0000 7f89fd18c740 1 -- 172.21.15.33:0/2588401389 shutdown_connections 2024-08-28T19:46:30.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.621+0000 7f89fd18c740 1 -- 172.21.15.33:0/2588401389 wait complete. 2024-08-28T19:46:30.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.621+0000 7f89fd18c740 20 client.19359 trim_cache size 0 max 16384 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89fd18c740 1 Processor -- start 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89fd18c740 1 -- start start 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b7b910 0x55fa58f29b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f2e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f35790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89fd18c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01b0bc0 con 0x55fa58b5e660 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89fd18c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01b2700 con 0x55fa58b66840 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89fd18c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01b1290 con 0x55fa58b7b910 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f2e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89effff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f2e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54184/0 (socket says 172.21.15.33:54184) 2024-08-28T19:46:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89effff640 1 -- 172.21.15.33:0/2038742198 learned_addr learned my addr 172.21.15.33:0/2038742198 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.638+0000 7f89f49b3640 1 --2- 172.21.15.33:0/2038742198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b7b910 0x55fa58f29b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89f51b4640 1 --2- 172.21.15.33:0/2038742198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f35790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89effff640 1 -- 172.21.15.33:0/2038742198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b7b910 msgr2=0x55fa58f29b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89effff640 1 --2- 172.21.15.33:0/2038742198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b7b910 0x55fa58f29b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89effff640 1 -- 172.21.15.33:0/2038742198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 msgr2=0x55fa58f35790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89effff640 1 --2- 172.21.15.33:0/2038742198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f35790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89effff640 1 -- 172.21.15.33:0/2038742198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa58f24e70 con 0x55fa58b5e660 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89f51b4640 1 --2- 172.21.15.33:0/2038742198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f35790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89effff640 1 --2- 172.21.15.33:0/2038742198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f2e3c0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f89e40ae040 tx=0x7f89e40e5760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4557d369fc93a85e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89d67fc640 1 -- 172.21.15.33:0/2038742198 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4021070 con 0x55fa58b5e660 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89d67fc640 1 -- 172.21.15.33:0/2038742198 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e40b4360 con 0x55fa58b5e660 2024-08-28T19:46:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.639+0000 7f89d67fc640 1 -- 172.21.15.33:0/2038742198 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e40aaf20 con 0x55fa58b5e660 2024-08-28T19:46:30.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 -- 172.21.15.33:0/2038742198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 msgr2=0x55fa58f2e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:30.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 --2- 172.21.15.33:0/2038742198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f2e3c0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f89e40ae040 tx=0x7f89e40e5760 comp rx=0 tx=0).stop 2024-08-28T19:46:30.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 -- 172.21.15.33:0/2038742198 shutdown_connections 2024-08-28T19:46:30.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 --2- 172.21.15.33:0/2038742198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f35790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 --2- 172.21.15.33:0/2038742198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f2e3c0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 --2- 172.21.15.33:0/2038742198 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b7b910 0x55fa58f29b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 -- 172.21.15.33:0/2038742198 >> 172.21.15.33:0/2038742198 conn(0x55fa58f4acc0 msgr2=0x55fa58f2dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 -- 172.21.15.33:0/2038742198 shutdown_connections 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 -- 172.21.15.33:0/2038742198 wait complete. 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 -- start start 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.640+0000 7f89fd18c740 1 Processor -- start 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f3b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f3bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89fd18c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b7b910 0x55fa58f3c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89fd18c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01b2030 con 0x55fa58b5e660 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89fd18c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01b1960 con 0x55fa58b66840 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89fd18c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01aebc0 con 0x55fa58b7b910 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89fd18c740 10 client.0 _ll_register_callbacks cb 0x7f89e40e2c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89f49b3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f3b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89effff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f3bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89f49b3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f3b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54186/0 (socket says 172.21.15.33:54186) 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89effff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f3bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:39222/0 (socket says 172.21.15.33:39222) 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89f49b3640 1 -- 172.21.15.33:0/1796041517 learned_addr learned my addr 172.21.15.33:0/1796041517 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89f51b4640 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b7b910 0x55fa58f3c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89f49b3640 1 -- 172.21.15.33:0/1796041517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b7b910 msgr2=0x55fa58f3c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89f49b3640 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b7b910 0x55fa58f3c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89f49b3640 1 -- 172.21.15.33:0/1796041517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 msgr2=0x55fa58f3bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89f49b3640 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f3bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89f49b3640 1 -- 172.21.15.33:0/1796041517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa58fb5330 con 0x55fa58b5e660 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89effff640 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f3bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89f49b3640 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f3b7f0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f89e000bb90 tx=0x7f89e000bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a749cfeea0bfdf3a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.641+0000 7f89cffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89cffff640 1 -- 172.21.15.33:0/1796041517 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e00035f0 con 0x55fa58b5e660 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89cffff640 1 -- 172.21.15.33:0/1796041517 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f89e0003790 con 0x55fa58b5e660 2024-08-28T19:46:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89fd18c740 1 -- 172.21.15.33:0/1796041517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa58f34150 con 0x55fa58b5e660 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89cffff640 1 -- 172.21.15.33:0/1796041517 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89e0003990 con 0x55fa58b5e660 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89fd18c740 10 client.19365 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89fd18c740 1 -- 172.21.15.33:0/1796041517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fa58fb6430 con 0x55fa58b5e660 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89cffff640 1 -- 172.21.15.33:0/1796041517 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fa58f34150 con 0x55fa58b5e660 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89cffff640 1 -- 172.21.15.33:0/1796041517 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f89e0003ce0 con 0x55fa58b5e660 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89fd18c740 10 client.19365 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89fd18c740 10 client.19365 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89fd18c740 20 client.19365 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89fd18c740 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa58b87520 0x55fa58fb8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89fd18c740 4 client.19365 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "86c16439", "release": true, "await": true}] 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89fd18c740 1 -- 172.21.15.33:0/1796041517 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "86c16439", "release": true, "await": true}) -- 0x55fa58ea1460 con 0x55fa58b87520 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.642+0000 7f89effff640 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa58b87520 0x55fa58fb8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.643+0000 7f89effff640 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa58b87520 0x55fa58fb8890 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5e1143220692a7 server_cookie=3059099189a2ed73 in_seq=0 out_seq=0 2024-08-28T19:46:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.643+0000 7f89cffff640 10 client.19365 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89cffff640 1 -- 172.21.15.33:0/1796041517 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fa58ea1460 con 0x55fa58b87520 2024-08-28T19:46:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89cffff640 10 client.19365 handle_command_reply: tid=0 2024-08-28T19:46:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 client.19365 shutdown 2024-08-28T19:46:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 -- 172.21.15.33:0/1796041517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 msgr2=0x55fa58f3b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f3b7f0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f89e000bb90 tx=0x7f89e000bee0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 -- 172.21.15.33:0/1796041517 shutdown_connections 2024-08-28T19:46:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa58b7b910 0x55fa58f3c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa58b66840 0x55fa58f3bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa58b87520 0x55fa58fb8890 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 --2- 172.21.15.33:0/1796041517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa58b5e660 0x55fa58f3b7f0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89cffff640 0 client.19365 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 -- 172.21.15.33:0/1796041517 >> 172.21.15.33:0/1796041517 conn(0x55fa58f4acc0 msgr2=0x55fa58f298e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 -- 172.21.15.33:0/1796041517 shutdown_connections 2024-08-28T19:46:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 1 -- 172.21.15.33:0/1796041517 wait complete. 2024-08-28T19:46:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.649+0000 7f89fd18c740 20 client.19365 trim_cache size 0 max 16384 2024-08-28T19:46:30.652 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 44, 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "86c16439": { 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 44, 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:30.653 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 145.7, 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:30.654 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:46:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 -- 172.21.15.33:0/2091837395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89d80b4ca0 msgr2=0x7f89d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89d80b4ca0 0x7f89d80b71b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f89e802f500 tx=0x7f89e802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 -- 172.21.15.33:0/2091837395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f0108140 msgr2=0x7f89f019b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f0108140 0x7f89f019b4e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f89e400d770 tx=0x7f89e400dc30 comp rx=0 tx=0).stop 2024-08-28T19:46:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 -- 172.21.15.33:0/2091837395 shutdown_connections 2024-08-28T19:46:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f0108a90 0x7f89f019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f0108140 0x7f89f019b4e0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f89d80b4ca0 0x7f89d80b71b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 --2- 172.21.15.33:0/2091837395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89f0102800 0x7f89f019afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:30.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 -- 172.21.15.33:0/2091837395 >> 172.21.15.33:0/2091837395 conn(0x7f89f00794c0 msgr2=0x7f89f0104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:30.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 -- 172.21.15.33:0/2091837395 shutdown_connections 2024-08-28T19:46:30.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:30.650+0000 7f89f6c17640 1 -- 172.21.15.33:0/2091837395 wait complete. 2024-08-28T19:46:31.356 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '86c16439', total seconds elapsed: 28.9 2024-08-28T19:46:31.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:31 smithi033 ceph-mon[18549]: pgmap v780: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-08-28T19:46:31.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:31 smithi059 ceph-mon[22052]: pgmap v780: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-08-28T19:46:31.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:31 smithi122 ceph-mon[22174]: pgmap v780: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-08-28T19:46:33.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:33 smithi059 ceph-mon[22052]: pgmap v781: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-08-28T19:46:33.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:33 smithi122 ceph-mon[22174]: pgmap v781: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-08-28T19:46:33.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:33 smithi033 ceph-mon[18549]: pgmap v781: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-08-28T19:46:34.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:34 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:46:34.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:34 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:46:35.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:34 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:46:35.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:35 smithi122 ceph-mon[22174]: pgmap v782: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-08-28T19:46:35.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:35 smithi033 ceph-mon[18549]: pgmap v782: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-08-28T19:46:35.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:35 smithi059 ceph-mon[22052]: pgmap v782: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-08-28T19:46:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:37 smithi122 ceph-mon[22174]: pgmap v783: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-08-28T19:46:37.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:37 smithi033 ceph-mon[18549]: pgmap v783: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-08-28T19:46:38.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:37 smithi059 ceph-mon[22052]: pgmap v783: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-08-28T19:46:39.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:39 smithi033 ceph-mon[18549]: pgmap v784: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-08-28T19:46:40.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:39 smithi059 ceph-mon[22052]: pgmap v784: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-08-28T19:46:40.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:39 smithi122 ceph-mon[22174]: pgmap v784: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-08-28T19:46:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:41 smithi033 ceph-mon[18549]: pgmap v785: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 13 op/s 2024-08-28T19:46:42.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:41 smithi059 ceph-mon[22052]: pgmap v785: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 13 op/s 2024-08-28T19:46:42.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:41 smithi122 ceph-mon[22174]: pgmap v785: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 13 op/s 2024-08-28T19:46:43.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:43 smithi033 ceph-mon[18549]: pgmap v786: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-08-28T19:46:44.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:43 smithi059 ceph-mon[22052]: pgmap v786: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-08-28T19:46:44.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:43 smithi122 ceph-mon[22174]: pgmap v786: 129 pgs: 129 active+clean; 24 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-08-28T19:46:45.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:45 smithi033 ceph-mon[18549]: pgmap v787: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 79 KiB/s wr, 17 op/s 2024-08-28T19:46:46.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:45 smithi059 ceph-mon[22052]: pgmap v787: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 79 KiB/s wr, 17 op/s 2024-08-28T19:46:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:45 smithi122 ceph-mon[22174]: pgmap v787: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 79 KiB/s wr, 17 op/s 2024-08-28T19:46:47.705 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:46:47.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:47 smithi033 ceph-mon[18549]: pgmap v788: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 13 op/s 2024-08-28T19:46:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:48.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:47 smithi059 ceph-mon[22052]: pgmap v788: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 13 op/s 2024-08-28T19:46:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:47 smithi122 ceph-mon[22174]: pgmap v788: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 13 op/s 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.504+0000 7f3a4b579640 1 -- 172.21.15.33:0/892976831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a44109bf0 msgr2=0x7f3a44110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.504+0000 7f3a4b579640 1 --2- 172.21.15.33:0/892976831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a44109bf0 0x7f3a44110420 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009ca0 tx=0x7f3a3c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.504+0000 7f3a4b579640 1 -- 172.21.15.33:0/892976831 shutdown_connections 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.504+0000 7f3a4b579640 1 --2- 172.21.15.33:0/892976831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a44109bf0 0x7f3a44110420 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.504+0000 7f3a4b579640 1 --2- 172.21.15.33:0/892976831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a441092a0 0x7f3a441096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.504+0000 7f3a4b579640 1 --2- 172.21.15.33:0/892976831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a44101d60 0x7f3a44102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.504+0000 7f3a4b579640 1 -- 172.21.15.33:0/892976831 >> 172.21.15.33:0/892976831 conn(0x7f3a44079d30 msgr2=0x7f3a4407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.504+0000 7f3a4b579640 1 -- 172.21.15.33:0/892976831 shutdown_connections 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.505+0000 7f3a4b579640 1 -- 172.21.15.33:0/892976831 wait complete. 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.505+0000 7f3a4b579640 1 Processor -- start 2024-08-28T19:46:48.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.505+0000 7f3a4b579640 1 -- start start 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.505+0000 7f3a4b579640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a44101d60 0x7f3a4419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.505+0000 7f3a4b579640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a441092a0 0x7f3a4419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.505+0000 7f3a4b579640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a44109bf0 0x7f3a4419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.505+0000 7f3a4b579640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3a441138b0 con 0x7f3a44101d60 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.505+0000 7f3a4b579640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3a44113730 con 0x7f3a441092a0 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.505+0000 7f3a4b579640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3a44113a30 con 0x7f3a44109bf0 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49315640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a44101d60 0x7f3a4419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49315640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a44101d60 0x7f3a4419a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45362/0 (socket says 172.21.15.33:45362) 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49315640 1 -- 172.21.15.33:0/692409129 learned_addr learned my addr 172.21.15.33:0/692409129 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a48b14640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a441092a0 0x7f3a4419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49b16640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a44109bf0 0x7f3a4419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49315640 1 -- 172.21.15.33:0/692409129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a44109bf0 msgr2=0x7f3a4419fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49315640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a44109bf0 0x7f3a4419fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49315640 1 -- 172.21.15.33:0/692409129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a441092a0 msgr2=0x7f3a4419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49315640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a441092a0 0x7f3a4419a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49315640 1 -- 172.21.15.33:0/692409129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a441a01b0 con 0x7f3a44101d60 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49b16640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a44109bf0 0x7f3a4419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a49315640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a44101d60 0x7f3a4419a240 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000c970 tx=0x7f3a4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a3a7fc640 1 -- 172.21.15.33:0/692409129 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40007bb0 con 0x7f3a44101d60 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a3a7fc640 1 -- 172.21.15.33:0/692409129 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a40007d50 con 0x7f3a44101d60 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a3a7fc640 1 -- 172.21.15.33:0/692409129 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4000f450 con 0x7f3a44101d60 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a4b579640 1 -- 172.21.15.33:0/692409129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a441a04a0 con 0x7f3a44101d60 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.506+0000 7f3a4b579640 1 -- 172.21.15.33:0/692409129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a441a6c00 con 0x7f3a44101d60 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.509+0000 7f3a3a7fc640 1 -- 172.21.15.33:0/692409129 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3a40004f20 con 0x7f3a44101d60 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.509+0000 7f3a51aee740 1 Processor -- start 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.509+0000 7f3a51aee740 1 -- start start 2024-08-28T19:46:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.509+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4de070 0x55686e8832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.509+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4b51b0 0x55686e883800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4bd390 0x55686e883d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a51aee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55686e7fa630 con 0x55686e4de070 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a51aee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55686e7e9bc0 con 0x55686e4bd390 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a51aee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55686e7edb70 con 0x55686e4b51b0 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49b16640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4de070 0x55686e8832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49b16640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4de070 0x55686e8832c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45378/0 (socket says 172.21.15.33:45378) 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49b16640 1 -- 172.21.15.33:0/3009513489 learned_addr learned my addr 172.21.15.33:0/3009513489 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49315640 1 --2- 172.21.15.33:0/3009513489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4b51b0 0x55686e883800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a3a7fc640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a300b4ca0 0x7f3a300b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a48b14640 1 --2- 172.21.15.33:0/3009513489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4bd390 0x55686e883d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49b16640 1 -- 172.21.15.33:0/3009513489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4b51b0 msgr2=0x55686e883800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49b16640 1 --2- 172.21.15.33:0/3009513489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4b51b0 0x55686e883800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49b16640 1 -- 172.21.15.33:0/3009513489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4bd390 msgr2=0x55686e883d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49b16640 1 --2- 172.21.15.33:0/3009513489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4bd390 0x55686e883d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49b16640 1 -- 172.21.15.33:0/3009513489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55686e549650 con 0x55686e4de070 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a3a7fc640 1 -- 172.21.15.33:0/692409129 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f3a400e56d0 con 0x7f3a44101d60 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49b16640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a300b4ca0 0x7f3a300b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.510+0000 7f3a49b16640 1 --2- 172.21.15.33:0/3009513489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4de070 0x55686e8832c0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c006010 tx=0x7f3a3c009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff96dc50147450c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.511+0000 7f3a2f7fe640 1 -- 172.21.15.33:0/3009513489 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c003e40 con 0x55686e4de070 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.511+0000 7f3a2f7fe640 1 -- 172.21.15.33:0/3009513489 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a3c036070 con 0x55686e4de070 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.511+0000 7f3a2f7fe640 1 -- 172.21.15.33:0/3009513489 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c02fae0 con 0x55686e4de070 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.511+0000 7f3a49b16640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a300b4ca0 0x7f3a300b71b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c04b000 tx=0x7f3a3c048000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.511+0000 7f3a51aee740 1 -- 172.21.15.33:0/3009513489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4de070 msgr2=0x55686e8832c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.511+0000 7f3a51aee740 1 --2- 172.21.15.33:0/3009513489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4de070 0x55686e8832c0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c006010 tx=0x7f3a3c009a00 comp rx=0 tx=0).stop 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.512+0000 7f3a51aee740 1 -- 172.21.15.33:0/3009513489 shutdown_connections 2024-08-28T19:46:48.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.512+0000 7f3a51aee740 1 --2- 172.21.15.33:0/3009513489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4bd390 0x55686e883d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.512+0000 7f3a51aee740 1 --2- 172.21.15.33:0/3009513489 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4b51b0 0x55686e883800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.512+0000 7f3a51aee740 1 --2- 172.21.15.33:0/3009513489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4de070 0x55686e8832c0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.512+0000 7f3a51aee740 1 -- 172.21.15.33:0/3009513489 >> 172.21.15.33:0/3009513489 conn(0x55686e4d2460 msgr2=0x55686e8811b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.512+0000 7f3a51aee740 1 -- 172.21.15.33:0/3009513489 shutdown_connections 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.512+0000 7f3a51aee740 1 -- 172.21.15.33:0/3009513489 wait complete. 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.512+0000 7f3a51aee740 1 -- start start 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.512+0000 7f3a51aee740 1 Processor -- start 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e88ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4bd390 0x55686e88ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4de070 0x55686e89ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a51aee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55686e64c700 con 0x55686e4b51b0 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a51aee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55686e770700 con 0x55686e4de070 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a51aee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55686e891920 con 0x55686e4bd390 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a51aee740 10 client.0 _ll_register_callbacks cb 0x55686e79fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:48.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a49315640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e88ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a49315640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e88ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45384/0 (socket says 172.21.15.33:45384) 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a49315640 1 -- 172.21.15.33:0/513952163 learned_addr learned my addr 172.21.15.33:0/513952163 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a49b16640 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4de070 0x55686e89ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a48b14640 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4bd390 0x55686e88ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a49315640 1 -- 172.21.15.33:0/513952163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4bd390 msgr2=0x55686e88ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a49315640 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4bd390 0x55686e88ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a49315640 1 -- 172.21.15.33:0/513952163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4de070 msgr2=0x55686e89ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a49315640 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4de070 0x55686e89ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a49315640 1 -- 172.21.15.33:0/513952163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55686e7a98b0 con 0x55686e4b51b0 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a49315640 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e88ea20 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f3a400e2ae0 tx=0x7f3a400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789089f4d06203bc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:48.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:48.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.513+0000 7f3a2cff9640 1 -- 172.21.15.33:0/513952163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4001d070 con 0x55686e4b51b0 2024-08-28T19:46:48.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a2cff9640 1 -- 172.21.15.33:0/513952163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f3a400a8010 con 0x55686e4b51b0 2024-08-28T19:46:48.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a51aee740 1 -- 172.21.15.33:0/513952163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a3c036070 con 0x55686e4b51b0 2024-08-28T19:46:48.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a2cff9640 1 -- 172.21.15.33:0/513952163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a400ab530 con 0x55686e4b51b0 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a51aee740 10 client.19377 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a51aee740 1 -- 172.21.15.33:0/513952163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55686e89d740 con 0x55686e4b51b0 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a2cff9640 1 -- 172.21.15.33:0/513952163 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a3c036070 con 0x55686e4b51b0 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a2cff9640 1 -- 172.21.15.33:0/513952163 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3a40005210 con 0x55686e4b51b0 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a51aee740 10 client.19377 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a51aee740 10 client.19377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a51aee740 20 client.19377 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a51aee740 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55686e49c9f0 0x55686e8a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a51aee740 4 client.19377 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.514+0000 7f3a51aee740 1 -- 172.21.15.33:0/513952163 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55686e7fc580 con 0x55686e49c9f0 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.515+0000 7f3a48b14640 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55686e49c9f0 0x55686e8a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.515+0000 7f3a2cff9640 10 client.19377 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.515+0000 7f3a48b14640 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55686e49c9f0 0x55686e8a10d0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c253aaa87c86e607 server_cookie=ba2932ec64fa8a02 in_seq=0 out_seq=0 2024-08-28T19:46:48.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a2cff9640 1 -- 172.21.15.33:0/513952163 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55686e7fc580 con 0x55686e49c9f0 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a2cff9640 10 client.19377 handle_command_reply: tid=0 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 client.19377 shutdown 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 -- 172.21.15.33:0/513952163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 msgr2=0x55686e88ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e88ea20 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f3a400e2ae0 tx=0x7f3a400048f0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 -- 172.21.15.33:0/513952163 shutdown_connections 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4de070 0x55686e89ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4bd390 0x55686e88ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55686e49c9f0 0x55686e8a10d0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 --2- 172.21.15.33:0/513952163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e88ea20 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 -- 172.21.15.33:0/513952163 >> 172.21.15.33:0/513952163 conn(0x55686e4d2460 msgr2=0x55686e8864a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a2cff9640 0 client.19377 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 -- 172.21.15.33:0/513952163 shutdown_connections 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 1 -- 172.21.15.33:0/513952163 wait complete. 2024-08-28T19:46:48.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.516+0000 7f3a51aee740 20 client.19377 trim_cache size 0 max 16384 2024-08-28T19:46:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a51aee740 1 Processor -- start 2024-08-28T19:46:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a51aee740 1 -- start start 2024-08-28T19:46:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4b51b0 0x55686e886ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4bd390 0x55686e8a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4de070 0x55686e8a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a51aee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3a441b0bb0 con 0x55686e4bd390 2024-08-28T19:46:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a51aee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3a441b26f0 con 0x55686e4b51b0 2024-08-28T19:46:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a51aee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3a441b1280 con 0x55686e4de070 2024-08-28T19:46:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a48b14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4bd390 0x55686e8a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a48b14640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4bd390 0x55686e8a44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45390/0 (socket says 172.21.15.33:45390) 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a48b14640 1 -- 172.21.15.33:0/296298477 learned_addr learned my addr 172.21.15.33:0/296298477 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a49b16640 1 --2- 172.21.15.33:0/296298477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4de070 0x55686e8a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.534+0000 7f3a49315640 1 --2- 172.21.15.33:0/296298477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4b51b0 0x55686e886ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.535+0000 7f3a48b14640 1 -- 172.21.15.33:0/296298477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4de070 msgr2=0x55686e8a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.535+0000 7f3a48b14640 1 --2- 172.21.15.33:0/296298477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4de070 0x55686e8a4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.535+0000 7f3a48b14640 1 -- 172.21.15.33:0/296298477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4b51b0 msgr2=0x55686e886ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.535+0000 7f3a48b14640 1 --2- 172.21.15.33:0/296298477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4b51b0 0x55686e886ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.535+0000 7f3a48b14640 1 -- 172.21.15.33:0/296298477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55686e8855b0 con 0x55686e4bd390 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.535+0000 7f3a48b14640 1 --2- 172.21.15.33:0/296298477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4bd390 0x55686e8a44e0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x55686e770800 tx=0x7f3a340044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b552cbeec84d0745 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.535+0000 7f3a2effd640 1 -- 172.21.15.33:0/296298477 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34003e40 con 0x55686e4bd390 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.535+0000 7f3a2effd640 1 -- 172.21.15.33:0/296298477 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a34012900 con 0x55686e4bd390 2024-08-28T19:46:48.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.535+0000 7f3a2effd640 1 -- 172.21.15.33:0/296298477 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34011a70 con 0x55686e4bd390 2024-08-28T19:46:48.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 -- 172.21.15.33:0/296298477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4bd390 msgr2=0x55686e8a44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:48.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 --2- 172.21.15.33:0/296298477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4bd390 0x55686e8a44e0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x55686e770800 tx=0x7f3a340044d0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 -- 172.21.15.33:0/296298477 shutdown_connections 2024-08-28T19:46:48.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 --2- 172.21.15.33:0/296298477 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4de070 0x55686e8a4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 --2- 172.21.15.33:0/296298477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4bd390 0x55686e8a44e0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 --2- 172.21.15.33:0/296298477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4b51b0 0x55686e886ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 -- 172.21.15.33:0/296298477 >> 172.21.15.33:0/296298477 conn(0x55686e4d2460 msgr2=0x55686e8863c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 -- 172.21.15.33:0/296298477 shutdown_connections 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 -- 172.21.15.33:0/296298477 wait complete. 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 -- start start 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.536+0000 7f3a51aee740 1 Processor -- start 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e903590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4bd390 0x55686e903b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a51aee740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4de070 0x55686e908b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a51aee740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3a441b2020 con 0x55686e4b51b0 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a51aee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3a441b1950 con 0x55686e4bd390 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a51aee740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3a441aebb0 con 0x55686e4de070 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a51aee740 10 client.0 _ll_register_callbacks cb 0x7f3a4000a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a49315640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e903590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a49315640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e903590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45404/0 (socket says 172.21.15.33:45404) 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a49315640 1 -- 172.21.15.33:0/765821562 learned_addr learned my addr 172.21.15.33:0/765821562 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a49b16640 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4de070 0x55686e908b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a48b14640 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4bd390 0x55686e903b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a49315640 1 -- 172.21.15.33:0/765821562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4de070 msgr2=0x55686e908b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a49315640 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4de070 0x55686e908b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a49315640 1 -- 172.21.15.33:0/765821562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4bd390 msgr2=0x55686e903b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a49315640 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4bd390 0x55686e903b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a49315640 1 -- 172.21.15.33:0/765821562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55686e909200 con 0x55686e4b51b0 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a49315640 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e903590 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f3a400ab6d0 tx=0x7f3a400aaeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9b9f5c1b8beb7b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.537+0000 7f3a2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a2cff9640 1 -- 172.21.15.33:0/765821562 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4001d070 con 0x55686e4b51b0 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a2cff9640 1 -- 172.21.15.33:0/765821562 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f3a400a8010 con 0x55686e4b51b0 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a51aee740 1 -- 172.21.15.33:0/765821562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a34012900 con 0x55686e4b51b0 2024-08-28T19:46:48.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a2cff9640 1 -- 172.21.15.33:0/765821562 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a400a71b0 con 0x55686e4b51b0 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a51aee740 10 client.19383 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a51aee740 1 -- 172.21.15.33:0/765821562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55686e910600 con 0x55686e4b51b0 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a2cff9640 1 -- 172.21.15.33:0/765821562 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a34012900 con 0x55686e4b51b0 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a2cff9640 1 -- 172.21.15.33:0/765821562 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3a400aa6f0 con 0x55686e4b51b0 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a51aee740 10 client.19383 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a51aee740 10 client.19383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a51aee740 20 client.19383 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a51aee740 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55686e471da0 0x55686e912d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a51aee740 4 client.19383 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.538+0000 7f3a51aee740 1 -- 172.21.15.33:0/765821562 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55686e88f390 con 0x55686e471da0 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.539+0000 7f3a48b14640 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55686e471da0 0x55686e912d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.539+0000 7f3a48b14640 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55686e471da0 0x55686e912d00 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b3e75dc56605206 server_cookie=21bb4c5a9837078f in_seq=0 out_seq=0 2024-08-28T19:46:48.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.539+0000 7f3a2cff9640 10 client.19383 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.539+0000 7f3a2cff9640 1 -- 172.21.15.33:0/765821562 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6338 (crc 0 0 0) 0x55686e88f390 con 0x55686e471da0 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.539+0000 7f3a2cff9640 10 client.19383 handle_command_reply: tid=0 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.539+0000 7f3a51aee740 1 client.19383 shutdown 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.539+0000 7f3a51aee740 1 -- 172.21.15.33:0/765821562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 msgr2=0x55686e903590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a51aee740 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e903590 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f3a400ab6d0 tx=0x7f3a400aaeb0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a51aee740 1 -- 172.21.15.33:0/765821562 shutdown_connections 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a51aee740 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55686e4de070 0x55686e908b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a51aee740 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55686e4bd390 0x55686e903b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a51aee740 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55686e471da0 0x55686e912d00 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a51aee740 1 --2- 172.21.15.33:0/765821562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55686e4b51b0 0x55686e903590 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a51aee740 1 -- 172.21.15.33:0/765821562 >> 172.21.15.33:0/765821562 conn(0x55686e4d2460 msgr2=0x55686e8842f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a2cff9640 0 client.19383 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a51aee740 1 -- 172.21.15.33:0/765821562 shutdown_connections 2024-08-28T19:46:48.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a51aee740 1 -- 172.21.15.33:0/765821562 wait complete. 2024-08-28T19:46:48.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a51aee740 20 client.19383 trim_cache size 0 max 16384 2024-08-28T19:46:48.546 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:46:48.546 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:46:48.546 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:46:48.546 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:46:48.546 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:46:48.546 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:46:48.546 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.546 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:46:48.547 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:46:48.549 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.550 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:45:27.534627+0000", 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.551 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "48fef576-2648-4bab-8772-21d3637a9125": { 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:46:15.427396+0000", 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:46:48.552 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.553 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.554 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:46:48.556 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.557 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.558 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:46:48.559 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:46:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.540+0000 7f3a4b579640 1 -- 172.21.15.33:0/692409129 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a300b4ca0 msgr2=0x7f3a300b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a300b4ca0 0x7f3a300b71b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c04b000 tx=0x7f3a3c048000 comp rx=0 tx=0).stop 2024-08-28T19:46:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 -- 172.21.15.33:0/692409129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a44101d60 msgr2=0x7f3a4419a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a44101d60 0x7f3a4419a240 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000c970 tx=0x7f3a4000ce30 comp rx=0 tx=0).stop 2024-08-28T19:46:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 -- 172.21.15.33:0/692409129 shutdown_connections 2024-08-28T19:46:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a300b4ca0 0x7f3a300b71b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3a44109bf0 0x7f3a4419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a441092a0 0x7f3a4419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 --2- 172.21.15.33:0/692409129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a44101d60 0x7f3a4419a240 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 -- 172.21.15.33:0/692409129 >> 172.21.15.33:0/692409129 conn(0x7f3a44079d30 msgr2=0x7f3a44105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 -- 172.21.15.33:0/692409129 shutdown_connections 2024-08-28T19:46:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:48.541+0000 7f3a4b579640 1 -- 172.21.15.33:0/692409129 wait complete. 2024-08-28T19:46:49.445 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:46:49.446 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:46:49.703 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:49.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:49 smithi033 ceph-mon[18549]: pgmap v789: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 56 KiB/s wr, 15 op/s 2024-08-28T19:46:50.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:49 smithi059 ceph-mon[22052]: pgmap v789: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 56 KiB/s wr, 15 op/s 2024-08-28T19:46:50.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:49 smithi122 ceph-mon[22174]: pgmap v789: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 56 KiB/s wr, 15 op/s 2024-08-28T19:46:50.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.198+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/3656015890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb68105910 msgr2=0x7fdb6810f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:50.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.198+0000 7fdb6cf3f640 1 --2- 172.21.15.33:0/3656015890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb68105910 0x7fdb6810f380 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009ca0 tx=0x7fdb6002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:46:50.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.198+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/3656015890 shutdown_connections 2024-08-28T19:46:50.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.198+0000 7fdb6cf3f640 1 --2- 172.21.15.33:0/3656015890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb68105910 0x7fdb6810f380 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:50.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.198+0000 7fdb6cf3f640 1 --2- 172.21.15.33:0/3656015890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68104fc0 0x7fdb681053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:50.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.198+0000 7fdb6cf3f640 1 --2- 172.21.15.33:0/3656015890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb68102fb0 0x7fdb681033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:50.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.198+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/3656015890 >> 172.21.15.33:0/3656015890 conn(0x7fdb68079c60 msgr2=0x7fdb6807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:50.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.198+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/3656015890 shutdown_connections 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.198+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/3656015890 wait complete. 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.199+0000 7fdb6cf3f640 1 Processor -- start 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.199+0000 7fdb6cf3f640 1 -- start start 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb6cf3f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68102fb0 0x7fdb6819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb6cf3f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb68104fc0 0x7fdb6819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb6cf3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb68105910 0x7fdb6819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb6cf3f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdb68113930 con 0x7fdb68104fc0 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb6cf3f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdb681137b0 con 0x7fdb68105910 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb6cf3f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fdb68113ab0 con 0x7fdb68102fb0 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb65d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb68104fc0 0x7fdb6819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb65d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb68104fc0 0x7fdb6819a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45414/0 (socket says 172.21.15.33:45414) 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb65d9b640 1 -- 172.21.15.33:0/481839296 learned_addr learned my addr 172.21.15.33:0/481839296 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb6659c640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68102fb0 0x7fdb6819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb66d9d640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb68105910 0x7fdb6819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb65d9b640 1 -- 172.21.15.33:0/481839296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68102fb0 msgr2=0x7fdb6819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb65d9b640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68102fb0 0x7fdb6819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb65d9b640 1 -- 172.21.15.33:0/481839296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb68105910 msgr2=0x7fdb6819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb65d9b640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb68105910 0x7fdb6819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb65d9b640 1 -- 172.21.15.33:0/481839296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb681a0210 con 0x7fdb68104fc0 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb65d9b640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb68104fc0 0x7fdb6819a840 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00d750 tx=0x7fdb5c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb577fe640 1 -- 172.21.15.33:0/481839296 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c017070 con 0x7fdb68104fc0 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/481839296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb681a0500 con 0x7fdb68104fc0 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb577fe640 1 -- 172.21.15.33:0/481839296 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb5c0054d0 con 0x7fdb68104fc0 2024-08-28T19:46:50.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.200+0000 7fdb577fe640 1 -- 172.21.15.33:0/481839296 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c004c30 con 0x7fdb68104fc0 2024-08-28T19:46:50.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.201+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/481839296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb681a6c60 con 0x7fdb68104fc0 2024-08-28T19:46:50.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.201+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/481839296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb681033c0 con 0x7fdb68104fc0 2024-08-28T19:46:50.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.203+0000 7fdb577fe640 1 -- 172.21.15.33:0/481839296 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdb5c004dd0 con 0x7fdb68104fc0 2024-08-28T19:46:50.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.204+0000 7fdb577fe640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb500b4ca0 0x7fdb500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:50.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.204+0000 7fdb6659c640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb500b4ca0 0x7fdb500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:50.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.204+0000 7fdb577fe640 1 -- 172.21.15.33:0/481839296 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7fdb5c0e56f0 con 0x7fdb68104fc0 2024-08-28T19:46:50.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.204+0000 7fdb6659c640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb500b4ca0 0x7fdb500b71b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdb58005d00 tx=0x7fdb5800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:50.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.207+0000 7fdb577fe640 1 -- 172.21.15.33:0/481839296 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdb5c0ac0e0 con 0x7fdb68104fc0 2024-08-28T19:46:50.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.431+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/481839296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb6819b3d0 con 0x7fdb68104fc0 2024-08-28T19:46:50.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.431+0000 7fdb577fe640 1 -- 172.21.15.33:0/481839296 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fdb5c0ab9e0 con 0x7fdb68104fc0 2024-08-28T19:46:50.432 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:46:50.433 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:46:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/481839296 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb500b4ca0 msgr2=0x7fdb500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb500b4ca0 0x7fdb500b71b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fdb58005d00 tx=0x7fdb5800b410 comp rx=0 tx=0).stop 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/481839296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb68104fc0 msgr2=0x7fdb6819a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb68104fc0 0x7fdb6819a840 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00d750 tx=0x7fdb5c00dc10 comp rx=0 tx=0).stop 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/481839296 shutdown_connections 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb68105910 0x7fdb6819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb68104fc0 0x7fdb6819a840 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdb500b4ca0 0x7fdb500b71b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 --2- 172.21.15.33:0/481839296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdb68102fb0 0x7fdb6819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/481839296 >> 172.21.15.33:0/481839296 conn(0x7fdb68079c60 msgr2=0x7fdb68106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/481839296 shutdown_connections 2024-08-28T19:46:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:50.434+0000 7fdb6cf3f640 1 -- 172.21.15.33:0/481839296 wait complete. 2024-08-28T19:46:50.788 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:50 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/481839296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:51.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:50 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/481839296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:51.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:50 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/481839296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:46:51.185 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:46:51.442 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:51.852 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:51 smithi033 ceph-mon[18549]: pgmap v790: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 15 op/s 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.945+0000 7f4d41643640 1 -- 172.21.15.33:0/3589760001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d3c10b490 msgr2=0x7f4d3c10b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.945+0000 7f4d41643640 1 --2- 172.21.15.33:0/3589760001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d3c10b490 0x7f4d3c10b8a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009900 tx=0x7f4d3002a410 comp rx=0 tx=0).stop 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.946+0000 7f4d41643640 1 -- 172.21.15.33:0/3589760001 shutdown_connections 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.946+0000 7f4d41643640 1 --2- 172.21.15.33:0/3589760001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d3c10bde0 0x7f4d3c112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.946+0000 7f4d41643640 1 --2- 172.21.15.33:0/3589760001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d3c10b490 0x7f4d3c10b8a0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.946+0000 7f4d41643640 1 --2- 172.21.15.33:0/3589760001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d3c105b50 0x7f4d3c105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.946+0000 7f4d41643640 1 -- 172.21.15.33:0/3589760001 >> 172.21.15.33:0/3589760001 conn(0x7f4d3c101560 msgr2=0x7f4d3c1039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.946+0000 7f4d41643640 1 -- 172.21.15.33:0/3589760001 shutdown_connections 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.946+0000 7f4d41643640 1 -- 172.21.15.33:0/3589760001 wait complete. 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.946+0000 7f4d41643640 1 Processor -- start 2024-08-28T19:46:51.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.946+0000 7f4d41643640 1 -- start start 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d41643640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d3c105b50 0x7f4d3c19c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d41643640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d3c10b490 0x7f4d3c19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d41643640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d3c10bde0 0x7f4d3c1a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d41643640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c115aa0 con 0x7f4d3c10b490 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d41643640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c115920 con 0x7f4d3c10bde0 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d41643640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c115c20 con 0x7f4d3c105b50 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d3a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d3c10b490 0x7f4d3c19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d3affd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d3c105b50 0x7f4d3c19c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d3a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d3c10b490 0x7f4d3c19ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45436/0 (socket says 172.21.15.33:45436) 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d3a7fc640 1 -- 172.21.15.33:0/3381013016 learned_addr learned my addr 172.21.15.33:0/3381013016 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d3c10bde0 0x7f4d3c1a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d3a7fc640 1 -- 172.21.15.33:0/3381013016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d3c105b50 msgr2=0x7f4d3c19c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d3a7fc640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d3c105b50 0x7f4d3c19c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d3a7fc640 1 -- 172.21.15.33:0/3381013016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d3c10bde0 msgr2=0x7f4d3c1a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d3a7fc640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d3c10bde0 0x7f4d3c1a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.947+0000 7f4d3a7fc640 1 -- 172.21.15.33:0/3381013016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3c1a2400 con 0x7f4d3c10b490 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.948+0000 7f4d3a7fc640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d3c10b490 0x7f4d3c19ca30 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f4d3002a930 tx=0x7f4d30004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.948+0000 7f4d23fff640 1 -- 172.21.15.33:0/3381013016 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3003f030 con 0x7f4d3c10b490 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.948+0000 7f4d41643640 1 -- 172.21.15.33:0/3381013016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3c1a2690 con 0x7f4d3c10b490 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.948+0000 7f4d23fff640 1 -- 172.21.15.33:0/3381013016 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d30003aa0 con 0x7f4d3c10b490 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.948+0000 7f4d23fff640 1 -- 172.21.15.33:0/3381013016 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30035070 con 0x7f4d3c10b490 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.948+0000 7f4d41643640 1 -- 172.21.15.33:0/3381013016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3c1a8e50 con 0x7f4d3c10b490 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.950+0000 7f4d47bb8740 1 Processor -- start 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d47bb8740 1 -- start start 2024-08-28T19:46:51.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d23fff640 1 -- 172.21.15.33:0/3381013016 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f4d30042030 con 0x7f4d3c10b490 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960aaf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e11b0 0x55b960aaf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 0x55b960aafd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b960a26680 con 0x55b96070a070 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b960a15c10 con 0x55b9606e11b0 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b960a19bc0 con 0x55b9606e9390 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960aaf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960aaf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45438/0 (socket says 172.21.15.33:45438) 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/3951223344 learned_addr learned my addr 172.21.15.33:0/3951223344 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3affd640 1 --2- 172.21.15.33:0/3951223344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e11b0 0x55b960aaf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3a7fc640 1 --2- 172.21.15.33:0/3951223344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 0x55b960aafd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/3951223344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 msgr2=0x55b960aafd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/3951223344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 0x55b960aafd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/3951223344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e11b0 msgr2=0x55b960aaf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/3951223344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e11b0 0x55b960aaf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/3951223344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b960775650 con 0x55b96070a070 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.951+0000 7f4d3a7fc640 1 --2- 172.21.15.33:0/3951223344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 0x55b960aafd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.952+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/3951223344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960aaf310 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f4d34010370 tx=0x7f4d34010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8154e729d617ec server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.952+0000 7f4d23fff640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4d240b4ca0 0x7f4d240b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.952+0000 7f4d217fa640 1 -- 172.21.15.33:0/3951223344 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34016070 con 0x55b96070a070 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.952+0000 7f4d217fa640 1 -- 172.21.15.33:0/3951223344 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d34004d20 con 0x55b96070a070 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.952+0000 7f4d23fff640 1 -- 172.21.15.33:0/3381013016 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f4d30105f90 con 0x7f4d3c10b490 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.952+0000 7f4d3affd640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4d240b4ca0 0x7f4d240b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.952+0000 7f4d217fa640 1 -- 172.21.15.33:0/3951223344 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34005350 con 0x55b96070a070 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d47bb8740 1 -- 172.21.15.33:0/3951223344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 msgr2=0x55b960aaf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/3951223344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960aaf310 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f4d34010370 tx=0x7f4d34010830 comp rx=0 tx=0).stop 2024-08-28T19:46:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d3affd640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4d240b4ca0 0x7f4d240b71b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c004650 tx=0x7f4d2c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d47bb8740 1 -- 172.21.15.33:0/3951223344 shutdown_connections 2024-08-28T19:46:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/3951223344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 0x55b960aafd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/3951223344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e11b0 0x55b960aaf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/3951223344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960aaf310 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d47bb8740 1 -- 172.21.15.33:0/3951223344 >> 172.21.15.33:0/3951223344 conn(0x55b9606fe460 msgr2=0x55b960aad200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d47bb8740 1 -- 172.21.15.33:0/3951223344 shutdown_connections 2024-08-28T19:46:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d47bb8740 1 -- 172.21.15.33:0/3951223344 wait complete. 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.953+0000 7f4d47bb8740 1 -- start start 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d47bb8740 1 Processor -- start 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e11b0 0x55b960abaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 0x55b960abaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960ac6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55b960878700 con 0x55b96070a070 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b96099c750 con 0x55b9606e11b0 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55b960abdb40 con 0x55b9606e9390 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d47bb8740 10 client.0 _ll_register_callbacks cb 0x55b9609cbe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960ac6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960ac6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45448/0 (socket says 172.21.15.33:45448) 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/4000362680 learned_addr learned my addr 172.21.15.33:0/4000362680 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:51.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d3a7fc640 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 0x55b960abaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.954+0000 7f4d3affd640 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e11b0 0x55b960abaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/4000362680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 msgr2=0x55b960abaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 0x55b960abaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/4000362680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e11b0 msgr2=0x55b960abaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e11b0 0x55b960abaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/4000362680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9609d5900 con 0x55b96070a070 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960ac6e30 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f4d34006010 tx=0x7f4d34004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adce4b614e376e28 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d1eff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d1eff5640 1 -- 172.21.15.33:0/4000362680 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34029060 con 0x55b96070a070 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d1eff5640 1 -- 172.21.15.33:0/4000362680 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f4d34012820 con 0x55b96070a070 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d47bb8740 1 -- 172.21.15.33:0/4000362680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d34004d20 con 0x55b96070a070 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d1eff5640 1 -- 172.21.15.33:0/4000362680 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4d34030050 con 0x55b96070a070 2024-08-28T19:46:51.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d47bb8740 10 client.19401 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d47bb8740 1 -- 172.21.15.33:0/4000362680 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b960ac98d0 con 0x55b96070a070 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.955+0000 7f4d1eff5640 1 -- 172.21.15.33:0/4000362680 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d34004d20 con 0x55b96070a070 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.956+0000 7f4d1eff5640 1 -- 172.21.15.33:0/4000362680 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4d3400f040 con 0x55b96070a070 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.956+0000 7f4d47bb8740 10 client.19401 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.956+0000 7f4d47bb8740 10 client.19401 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.956+0000 7f4d47bb8740 20 client.19401 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.956+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b9606c89f0 0x55b960accce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.956+0000 7f4d47bb8740 4 client.19401 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.956+0000 7f4d47bb8740 1 -- 172.21.15.33:0/4000362680 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b960a285d0 con 0x55b9606c89f0 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.956+0000 7f4d3affd640 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b9606c89f0 0x55b960accce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.956+0000 7f4d3affd640 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b9606c89f0 0x55b960accce0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d886eeb0a32900c2 server_cookie=b28fb563275f5f5 in_seq=0 out_seq=0 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.956+0000 7f4d1eff5640 10 client.19401 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:46:51.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d1eff5640 1 -- 172.21.15.33:0/4000362680 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b960a285d0 con 0x55b9606c89f0 2024-08-28T19:46:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d1eff5640 10 client.19401 handle_command_reply: tid=0 2024-08-28T19:46:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d47bb8740 1 client.19401 shutdown 2024-08-28T19:46:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d47bb8740 1 -- 172.21.15.33:0/4000362680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 msgr2=0x55b960ac6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960ac6e30 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f4d34006010 tx=0x7f4d34004c70 comp rx=0 tx=0).stop 2024-08-28T19:46:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d47bb8740 1 -- 172.21.15.33:0/4000362680 shutdown_connections 2024-08-28T19:46:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b9606c89f0 0x55b960accce0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d1eff5640 0 client.19401 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:46:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b96070a070 0x55b960ac6e30 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e9390 0x55b960abaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/4000362680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e11b0 0x55b960abaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.957+0000 7f4d47bb8740 1 -- 172.21.15.33:0/4000362680 >> 172.21.15.33:0/4000362680 conn(0x55b9606fe460 msgr2=0x55b960ab0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:51.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.958+0000 7f4d47bb8740 1 -- 172.21.15.33:0/4000362680 shutdown_connections 2024-08-28T19:46:51.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.958+0000 7f4d47bb8740 1 -- 172.21.15.33:0/4000362680 wait complete. 2024-08-28T19:46:51.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.958+0000 7f4d47bb8740 20 client.19401 trim_cache size 0 max 16384 2024-08-28T19:46:51.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d47bb8740 1 Processor -- start 2024-08-28T19:46:51.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d47bb8740 1 -- start start 2024-08-28T19:46:51.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606c89f0 0x55b960ab0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 0x55b960ac6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e9390 0x55b960aacb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b2ec0 con 0x55b9606c89f0 2024-08-28T19:46:51.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b4a00 con 0x55b9606e9390 2024-08-28T19:46:51.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b3590 con 0x55b9606e11b0 2024-08-28T19:46:51.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d3affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606c89f0 0x55b960ab0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d3affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606c89f0 0x55b960ab0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45460/0 (socket says 172.21.15.33:45460) 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.971+0000 7f4d3affd640 1 -- 172.21.15.33:0/1398275444 learned_addr learned my addr 172.21.15.33:0/1398275444 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d3affd640 1 -- 172.21.15.33:0/1398275444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 msgr2=0x55b960ac6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d3a7fc640 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 0x55b960ac6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d3affd640 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 0x55b960ac6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e9390 0x55b960aacb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d3affd640 1 -- 172.21.15.33:0/1398275444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e9390 msgr2=0x55b960aacb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d3affd640 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e9390 0x55b960aacb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d3affd640 1 -- 172.21.15.33:0/1398275444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b960abd680 con 0x55b9606c89f0 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d3a7fc640 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 0x55b960ac6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e9390 0x55b960aacb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d3affd640 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606c89f0 0x55b960ab0a50 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c004620 tx=0x7f4d2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805e96cf0285d40e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:51.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d20ff9640 1 -- 172.21.15.33:0/1398275444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c01eb50 con 0x55b9606c89f0 2024-08-28T19:46:51.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d20ff9640 1 -- 172.21.15.33:0/1398275444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d2c01ecf0 con 0x55b9606c89f0 2024-08-28T19:46:51.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.972+0000 7f4d20ff9640 1 -- 172.21.15.33:0/1398275444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c004d60 con 0x55b9606c89f0 2024-08-28T19:46:51.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1398275444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606c89f0 msgr2=0x55b960ab0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:51.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606c89f0 0x55b960ab0a50 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c004620 tx=0x7f4d2c019000 comp rx=0 tx=0).stop 2024-08-28T19:46:51.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1398275444 shutdown_connections 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606e9390 0x55b960aacb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 0x55b960ac6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/1398275444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606c89f0 0x55b960ab0a50 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1398275444 >> 172.21.15.33:0/1398275444 conn(0x55b9606fe460 msgr2=0x55b960ab0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1398275444 shutdown_connections 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1398275444 wait complete. 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 -- start start 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.973+0000 7f4d47bb8740 1 Processor -- start 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606c89f0 0x55b960ad0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 0x55b960acdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d47bb8740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606e9390 0x55b960ace330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b4330 con 0x55b9606e9390 2024-08-28T19:46:51.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b3c60 con 0x55b9606c89f0 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d47bb8740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c1b0ec0 con 0x55b9606e11b0 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d47bb8740 10 client.0 _ll_register_callbacks cb 0x7f4d2c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606e9390 0x55b960ace330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606e9390 0x55b960ace330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45478/0 (socket says 172.21.15.33:45478) 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/1723460065 learned_addr learned my addr 172.21.15.33:0/1723460065 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3affd640 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606c89f0 0x55b960ad0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3a7fc640 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 0x55b960acdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/1723460065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 msgr2=0x55b960acdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 0x55b960acdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/1723460065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606c89f0 msgr2=0x55b960ad0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606c89f0 0x55b960ad0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3b7fe640 1 -- 172.21.15.33:0/1723460065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b960b36460 con 0x55b9606e9390 2024-08-28T19:46:51.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3affd640 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606c89f0 0x55b960ad0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d3b7fe640 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606e9390 0x55b960ace330 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f4d34010870 tx=0x7f4d34012510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999be354ac669eae server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d1eff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d1eff5640 1 -- 172.21.15.33:0/1723460065 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34029070 con 0x55b9606e9390 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d1eff5640 1 -- 172.21.15.33:0/1723460065 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f4d34021040 con 0x55b9606e9390 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.974+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1723460065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d2c01ecf0 con 0x55b9606e9390 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d1eff5640 1 -- 172.21.15.33:0/1723460065 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4d3403c050 con 0x55b9606e9390 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d47bb8740 10 client.19407 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1723460065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b960b37490 con 0x55b9606e9390 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d1eff5640 1 -- 172.21.15.33:0/1723460065 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d2c01ecf0 con 0x55b9606e9390 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d1eff5640 1 -- 172.21.15.33:0/1723460065 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4d34024af0 con 0x55b9606e9390 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d47bb8740 10 client.19407 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:51.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d47bb8740 10 client.19407 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:46:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d47bb8740 20 client.19407 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b96070a070 0x55b960b39c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d47bb8740 4 client.19407 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:46:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1723460065 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b960a24070 con 0x55b96070a070 2024-08-28T19:46:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.975+0000 7f4d3affd640 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b96070a070 0x55b960b39c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d1eff5640 10 client.19407 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:46:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d3affd640 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b96070a070 0x55b960b39c80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7efbec1d9ea7652c server_cookie=61df6a799e12a042 in_seq=0 out_seq=0 2024-08-28T19:46:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d1eff5640 1 -- 172.21.15.33:0/1723460065 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b960a24070 con 0x55b96070a070 2024-08-28T19:46:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d1eff5640 10 client.19407 handle_command_reply: tid=0 2024-08-28T19:46:51.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 client.19407 shutdown 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1723460065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606e9390 msgr2=0x55b960ace330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606e9390 0x55b960ace330 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f4d34010870 tx=0x7f4d34012510 comp rx=0 tx=0).stop 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1723460065 shutdown_connections 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55b96070a070 0x55b960b39c80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b9606e9390 0x55b960ace330 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b9606e11b0 0x55b960acdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 --2- 172.21.15.33:0/1723460065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9606c89f0 0x55b960ad0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d1eff5640 0 client.19407 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1723460065 >> 172.21.15.33:0/1723460065 conn(0x55b9606fe460 msgr2=0x55b960aba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1723460065 shutdown_connections 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 1 -- 172.21.15.33:0/1723460065 wait complete. 2024-08-28T19:46:51.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.976+0000 7f4d47bb8740 20 client.19407 trim_cache size 0 max 16384 2024-08-28T19:46:51.984 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:46:51.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 -- 172.21.15.33:0/3381013016 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4d240b4ca0 msgr2=0x7f4d240b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:51.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4d240b4ca0 0x7f4d240b71b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c004650 tx=0x7f4d2c00b390 comp rx=0 tx=0).stop 2024-08-28T19:46:51.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 -- 172.21.15.33:0/3381013016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d3c10b490 msgr2=0x7f4d3c19ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d3c10b490 0x7f4d3c19ca30 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f4d3002a930 tx=0x7f4d30004270 comp rx=0 tx=0).stop 2024-08-28T19:46:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 -- 172.21.15.33:0/3381013016 shutdown_connections 2024-08-28T19:46:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d3c10bde0 0x7f4d3c1a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d3c10b490 0x7f4d3c19ca30 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f4d240b4ca0 0x7f4d240b71b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 --2- 172.21.15.33:0/3381013016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4d3c105b50 0x7f4d3c19c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:51.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 -- 172.21.15.33:0/3381013016 >> 172.21.15.33:0/3381013016 conn(0x7f4d3c101560 msgr2=0x7f4d3c107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:51.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 -- 172.21.15.33:0/3381013016 shutdown_connections 2024-08-28T19:46:51.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:51.977+0000 7f4d41643640 1 -- 172.21.15.33:0/3381013016 wait complete. 2024-08-28T19:46:52.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:51 smithi059 ceph-mon[22052]: pgmap v790: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 15 op/s 2024-08-28T19:46:52.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:51 smithi122 ceph-mon[22174]: pgmap v790: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 85 KiB/s wr, 15 op/s 2024-08-28T19:46:52.749 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:46:53.009 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:53.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.530+0000 7f8db629a640 1 -- 172.21.15.33:0/3651688721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8db0108af0 msgr2=0x7f8db010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.530+0000 7f8db629a640 1 --2- 172.21.15.33:0/3651688721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8db0108af0 0x7f8db010f320 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009ca0 tx=0x7f8da802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.530+0000 7f8db629a640 1 -- 172.21.15.33:0/3651688721 shutdown_connections 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.530+0000 7f8db629a640 1 --2- 172.21.15.33:0/3651688721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8db0108af0 0x7f8db010f320 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.530+0000 7f8db629a640 1 --2- 172.21.15.33:0/3651688721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8db01081a0 0x7f8db01085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.530+0000 7f8db629a640 1 --2- 172.21.15.33:0/3651688721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db0102f30 0x7f8db0103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.530+0000 7f8db629a640 1 -- 172.21.15.33:0/3651688721 >> 172.21.15.33:0/3651688721 conn(0x7f8db0079d30 msgr2=0x7f8db007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.530+0000 7f8db629a640 1 -- 172.21.15.33:0/3651688721 shutdown_connections 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.530+0000 7f8db629a640 1 -- 172.21.15.33:0/3651688721 wait complete. 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.531+0000 7f8db629a640 1 Processor -- start 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.531+0000 7f8db629a640 1 -- start start 2024-08-28T19:46:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.531+0000 7f8db629a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db0102f30 0x7f8db019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.531+0000 7f8db629a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8db01081a0 0x7f8db019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.531+0000 7f8db629a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8db0108af0 0x7f8db019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.531+0000 7f8db629a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01127a0 con 0x7f8db0108af0 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.531+0000 7f8db629a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8db0112620 con 0x7f8db0102f30 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.531+0000 7f8db629a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8db0112920 con 0x7f8db01081a0 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.531+0000 7f8db4837640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8db0108af0 0x7f8db019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8db4837640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8db0108af0 0x7f8db019fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45488/0 (socket says 172.21.15.33:45488) 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8daffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db0102f30 0x7f8db019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8db4837640 1 -- 172.21.15.33:0/2739148161 learned_addr learned my addr 172.21.15.33:0/2739148161 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8db01081a0 0x7f8db019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8db4837640 1 -- 172.21.15.33:0/2739148161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8db01081a0 msgr2=0x7f8db019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8db4837640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8db01081a0 0x7f8db019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8db4837640 1 -- 172.21.15.33:0/2739148161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db0102f30 msgr2=0x7f8db019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8db4837640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db0102f30 0x7f8db019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8db4837640 1 -- 172.21.15.33:0/2739148161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db01a0130 con 0x7f8db0108af0 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8db4837640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8db0108af0 0x7f8db019fac0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f8da8005cc0 tx=0x7f8da802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8dad7fa640 1 -- 172.21.15.33:0/2739148161 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8003cf0 con 0x7f8db0108af0 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8db629a640 1 -- 172.21.15.33:0/2739148161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db01a03c0 con 0x7f8db0108af0 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8dad7fa640 1 -- 172.21.15.33:0/2739148161 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8da80044f0 con 0x7f8db0108af0 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8dad7fa640 1 -- 172.21.15.33:0/2739148161 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da802fc30 con 0x7f8db0108af0 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.532+0000 7f8db629a640 1 -- 172.21.15.33:0/2739148161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db01a6c40 con 0x7f8db0108af0 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.535+0000 7f8dbc80f740 1 Processor -- start 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.535+0000 7f8dad7fa640 1 -- 172.21.15.33:0/2739148161 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8da80046a0 con 0x7f8db0108af0 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.535+0000 7f8dbc80f740 1 -- start start 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.535+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7d11070 0x560da80b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.535+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7ce81b0 0x560da80b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.535+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.535+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560da802d680 con 0x560da7ce81b0 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.535+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560da801cc10 con 0x560da7cf0390 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.535+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560da8020bc0 con 0x560da7d11070 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7ce81b0 0x560da80b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7ce81b0 0x560da80b6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45490/0 (socket says 172.21.15.33:45490) 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daffff640 1 -- 172.21.15.33:0/3087013012 learned_addr learned my addr 172.21.15.33:0/3087013012 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/3087013012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7d11070 0x560da80b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daffff640 1 -- 172.21.15.33:0/3087013012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7d11070 msgr2=0x560da80b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daffff640 1 --2- 172.21.15.33:0/3087013012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7d11070 0x560da80b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daffff640 1 -- 172.21.15.33:0/3087013012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 msgr2=0x560da80b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daffff640 1 --2- 172.21.15.33:0/3087013012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daffff640 1 -- 172.21.15.33:0/3087013012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560da7d7c650 con 0x560da7ce81b0 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/3087013012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7d11070 0x560da80b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8dad7fa640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d980b4cd0 0x7f8d980b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daffff640 1 --2- 172.21.15.33:0/3087013012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7ce81b0 0x560da80b6850 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f8da000ac20 tx=0x7f8da000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1ddf1193c9c542 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d980b4cd0 0x7f8d980b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8dad7fa640 1 -- 172.21.15.33:0/2739148161 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f8da8106d70 con 0x7f8db0108af0 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8d967fc640 1 -- 172.21.15.33:0/3087013012 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da001d070 con 0x560da7ce81b0 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8d967fc640 1 -- 172.21.15.33:0/3087013012 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8da0018af0 con 0x560da7ce81b0 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.536+0000 7f8d967fc640 1 -- 172.21.15.33:0/3087013012 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0010ab0 con 0x560da7ce81b0 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.537+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3087013012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7ce81b0 msgr2=0x560da80b6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.537+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d980b4cd0 0x7f8d980b71e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005e10 tx=0x7f8da4005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.537+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/3087013012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7ce81b0 0x560da80b6850 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f8da000ac20 tx=0x7f8da000f790 comp rx=0 tx=0).stop 2024-08-28T19:46:53.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.537+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3087013012 shutdown_connections 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.537+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/3087013012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.537+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/3087013012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7ce81b0 0x560da80b6850 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.537+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/3087013012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7d11070 0x560da80b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.537+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3087013012 >> 172.21.15.33:0/3087013012 conn(0x560da7d05460 msgr2=0x560da80b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.537+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3087013012 shutdown_connections 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.537+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3087013012 wait complete. 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8dbc80f740 1 -- start start 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8dbc80f740 1 Processor -- start 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7cf0390 0x560da80c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7d11070 0x560da80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560da7e7f700 con 0x560da7cf0390 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560da7fa3750 con 0x560da7d11070 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560da80c4af0 con 0x560da7ce81b0 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8dbc80f740 10 client.0 _ll_register_callbacks cb 0x560da7fd2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8daf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7cf0390 0x560da80c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8daf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7cf0390 0x560da80c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45492/0 (socket says 172.21.15.33:45492) 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.538+0000 7f8daf7fe640 1 -- 172.21.15.33:0/3189563215 learned_addr learned my addr 172.21.15.33:0/3189563215 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8db4837640 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7d11070 0x560da80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8daffff640 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8daf7fe640 1 -- 172.21.15.33:0/3189563215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 msgr2=0x560da80c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80c1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8daf7fe640 1 -- 172.21.15.33:0/3189563215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7d11070 msgr2=0x560da80cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7d11070 0x560da80cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8daf7fe640 1 -- 172.21.15.33:0/3189563215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560da7fdc900 con 0x560da7cf0390 2024-08-28T19:46:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7cf0390 0x560da80c1fc0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005520 tx=0x7f8da40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb02d4ad61aa05da server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8d8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/3189563215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4025630 con 0x560da7cf0390 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/3189563215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f8da401b420 con 0x560da7cf0390 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3189563215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8da0018af0 con 0x560da7cf0390 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/3189563215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8da40257d0 con 0x560da7cf0390 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8dbc80f740 10 client.19419 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.539+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3189563215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560da80d0890 con 0x560da7cf0390 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.540+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/3189563215 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8da0018af0 con 0x560da7cf0390 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.540+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/3189563215 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8da401bc90 con 0x560da7cf0390 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.540+0000 7f8dbc80f740 10 client.19419 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.540+0000 7f8dbc80f740 10 client.19419 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.540+0000 7f8dbc80f740 20 client.19419 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.540+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560da7ccf9f0 0x560da80d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.540+0000 7f8dbc80f740 4 client.19419 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.540+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3189563215 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560da802f5d0 con 0x560da7ccf9f0 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.540+0000 7f8daffff640 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560da7ccf9f0 0x560da80d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.541+0000 7f8d8f7fe640 10 client.19419 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.541+0000 7f8daffff640 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560da7ccf9f0 0x560da80d3e30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5ca48c3b7b546153 server_cookie=2132ff27b14f9d45 in_seq=0 out_seq=0 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.541+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/3189563215 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560da802f5d0 con 0x560da7ccf9f0 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.541+0000 7f8d8f7fe640 10 client.19419 handle_command_reply: tid=0 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.541+0000 7f8dbc80f740 1 client.19419 shutdown 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3189563215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7cf0390 msgr2=0x560da80c1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7cf0390 0x560da80c1fc0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005520 tx=0x7f8da40046c0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3189563215 shutdown_connections 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560da7ccf9f0 0x560da80d3e30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7d11070 0x560da80cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7cf0390 0x560da80c1fc0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/3189563215 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8d8f7fe640 0 client.19419 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:46:53.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3189563215 >> 172.21.15.33:0/3189563215 conn(0x560da7d05460 msgr2=0x560da80b94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:53.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3189563215 shutdown_connections 2024-08-28T19:46:53.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 1 -- 172.21.15.33:0/3189563215 wait complete. 2024-08-28T19:46:53.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.542+0000 7f8dbc80f740 20 client.19419 trim_cache size 0 max 16384 2024-08-28T19:46:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.555+0000 7f8dbc80f740 1 Processor -- start 2024-08-28T19:46:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8dbc80f740 1 -- start start 2024-08-28T19:46:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b0ca0 con 0x560da7d11070 2024-08-28T19:46:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b27e0 con 0x560da7cf0390 2024-08-28T19:46:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b1370 con 0x560da7ce81b0 2024-08-28T19:46:53.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8db4837640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8db4837640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da80ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45508/0 (socket says 172.21.15.33:45508) 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8db4837640 1 -- 172.21.15.33:0/459174721 learned_addr learned my addr 172.21.15.33:0/459174721 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8daffff640 1 --2- 172.21.15.33:0/459174721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/459174721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8db4837640 1 -- 172.21.15.33:0/459174721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 msgr2=0x560da80b9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8db4837640 1 --2- 172.21.15.33:0/459174721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80b9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8db4837640 1 -- 172.21.15.33:0/459174721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 msgr2=0x560da80cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8db4837640 1 --2- 172.21.15.33:0/459174721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8db4837640 1 -- 172.21.15.33:0/459174721 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560da80b8ba0 con 0x560da7d11070 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.556+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/459174721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.557+0000 7f8db4837640 1 --2- 172.21.15.33:0/459174721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da80ce220 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f8da80cd050 tx=0x7f8da80ccad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15538afeea47023d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:53.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.557+0000 7f8d95ffb640 1 -- 172.21.15.33:0/459174721 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da80cd7c0 con 0x560da7d11070 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.557+0000 7f8d95ffb640 1 -- 172.21.15.33:0/459174721 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8da8036040 con 0x560da7d11070 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.557+0000 7f8d95ffb640 1 -- 172.21.15.33:0/459174721 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da80c9350 con 0x560da7d11070 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 -- 172.21.15.33:0/459174721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 msgr2=0x560da80ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/459174721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da80ce220 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f8da80cd050 tx=0x7f8da80ccad0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 -- 172.21.15.33:0/459174721 shutdown_connections 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/459174721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da80ce220 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/459174721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/459174721 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80b9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 -- 172.21.15.33:0/459174721 >> 172.21.15.33:0/459174721 conn(0x560da7d05460 msgr2=0x560da80b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 -- 172.21.15.33:0/459174721 shutdown_connections 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 -- 172.21.15.33:0/459174721 wait complete. 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 -- start start 2024-08-28T19:46:53.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.558+0000 7f8dbc80f740 1 Processor -- start 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80c6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8dbc80f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da813d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b2110 con 0x560da7d11070 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b1a40 con 0x560da7cf0390 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8dbc80f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01aeca0 con 0x560da7ce81b0 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8dbc80f740 10 client.0 _ll_register_callbacks cb 0x7f8da40051a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8db4837640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da813d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8db4837640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da813d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45518/0 (socket says 172.21.15.33:45518) 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8db4837640 1 -- 172.21.15.33:0/4291470875 learned_addr learned my addr 172.21.15.33:0/4291470875 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8daffff640 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8db4837640 1 -- 172.21.15.33:0/4291470875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 msgr2=0x560da80c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8db4837640 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8db4837640 1 -- 172.21.15.33:0/4291470875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 msgr2=0x560da80c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8db4837640 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8db4837640 1 -- 172.21.15.33:0/4291470875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560da813dd70 con 0x560da7d11070 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.559+0000 7f8daf7fe640 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8db4837640 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da813d830 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f8da80ccb80 tx=0x7f8da802f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464a955f7c005ace server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8d8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/4291470875 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da80e6020 con 0x560da7d11070 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/4291470875 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f8da80cd320 con 0x560da7d11070 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8dbc80f740 1 -- 172.21.15.33:0/4291470875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8da8036040 con 0x560da7d11070 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/4291470875 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8da80cd0c0 con 0x560da7d11070 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8dbc80f740 10 client.19425 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8dbc80f740 1 -- 172.21.15.33:0/4291470875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560da813ef80 con 0x560da7d11070 2024-08-28T19:46:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/4291470875 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8da8036040 con 0x560da7d11070 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/4291470875 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8da80d5f50 con 0x560da7d11070 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8dbc80f740 10 client.19425 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8dbc80f740 10 client.19425 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8dbc80f740 20 client.19425 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560da7ca4da0 0x560da8141410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8dbc80f740 4 client.19425 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.560+0000 7f8dbc80f740 1 -- 172.21.15.33:0/4291470875 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560da802b070 con 0x560da7ca4da0 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.561+0000 7f8daffff640 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560da7ca4da0 0x560da8141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.561+0000 7f8d8f7fe640 10 client.19425 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.561+0000 7f8daffff640 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560da7ca4da0 0x560da8141410 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7b1f0f65fbdd6c05 server_cookie=d6b2e26a19951d5b in_seq=0 out_seq=0 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.561+0000 7f8d8f7fe640 1 -- 172.21.15.33:0/4291470875 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560da802b070 con 0x560da7ca4da0 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.561+0000 7f8d8f7fe640 10 client.19425 handle_command_reply: tid=0 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.561+0000 7f8dbc80f740 1 client.19425 shutdown 2024-08-28T19:46:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 1 -- 172.21.15.33:0/4291470875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 msgr2=0x560da813d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da813d830 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f8da80ccb80 tx=0x7f8da802f6d0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 1 -- 172.21.15.33:0/4291470875 shutdown_connections 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x560da7ca4da0 0x560da8141410 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560da7d11070 0x560da813d830 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560da7cf0390 0x560da80c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 1 --2- 172.21.15.33:0/4291470875 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560da7ce81b0 0x560da80c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8d8f7fe640 0 client.19425 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 1 -- 172.21.15.33:0/4291470875 >> 172.21.15.33:0/4291470875 conn(0x560da7d05460 msgr2=0x560da80b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 1 -- 172.21.15.33:0/4291470875 shutdown_connections 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 1 -- 172.21.15.33:0/4291470875 wait complete. 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8dbc80f740 20 client.19425 trim_cache size 0 max 16384 2024-08-28T19:46:53.576 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:46:53.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.562+0000 7f8db629a640 1 -- 172.21.15.33:0/2739148161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d980b4cd0 msgr2=0x7f8d980b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:53.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d980b4cd0 0x7f8d980b71e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8da4005e10 tx=0x7f8da4005d80 comp rx=0 tx=0).stop 2024-08-28T19:46:53.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 -- 172.21.15.33:0/2739148161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8db0108af0 msgr2=0x7f8db019fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:53.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8db0108af0 0x7f8db019fac0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f8da8005cc0 tx=0x7f8da802f470 comp rx=0 tx=0).stop 2024-08-28T19:46:53.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 -- 172.21.15.33:0/2739148161 shutdown_connections 2024-08-28T19:46:53.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8db0108af0 0x7f8db019fac0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8d980b4cd0 0x7f8d980b71e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8db01081a0 0x7f8db019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 --2- 172.21.15.33:0/2739148161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db0102f30 0x7f8db019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:53.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 -- 172.21.15.33:0/2739148161 >> 172.21.15.33:0/2739148161 conn(0x7f8db0079d30 msgr2=0x7f8db0106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:53.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 -- 172.21.15.33:0/2739148161 shutdown_connections 2024-08-28T19:46:53.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:53.563+0000 7f8db629a640 1 -- 172.21.15.33:0/2739148161 wait complete. 2024-08-28T19:46:53.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:53 smithi033 ceph-mon[18549]: pgmap v791: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 13 op/s 2024-08-28T19:46:54.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:53 smithi059 ceph-mon[22052]: pgmap v791: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 13 op/s 2024-08-28T19:46:54.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:53 smithi122 ceph-mon[22174]: pgmap v791: 129 pgs: 129 active+clean; 25 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 13 op/s 2024-08-28T19:46:54.479 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:46:54.737 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:55.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 -- 172.21.15.33:0/3627833432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7854102800 msgr2=0x7f7854102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:55.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 --2- 172.21.15.33:0/3627833432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7854102800 0x7f7854102c10 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f7844009900 tx=0x7f784402a410 comp rx=0 tx=0).stop 2024-08-28T19:46:55.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 -- 172.21.15.33:0/3627833432 shutdown_connections 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 --2- 172.21.15.33:0/3627833432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7854108a90 0x7f785410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 --2- 172.21.15.33:0/3627833432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7854108140 0x7f7854108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 --2- 172.21.15.33:0/3627833432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7854102800 0x7f7854102c10 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 -- 172.21.15.33:0/3627833432 >> 172.21.15.33:0/3627833432 conn(0x7f78540794d0 msgr2=0x7f78540798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 -- 172.21.15.33:0/3627833432 shutdown_connections 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 -- 172.21.15.33:0/3627833432 wait complete. 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 Processor -- start 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.226+0000 7f78599ec640 1 -- start start 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f78599ec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7854102800 0x7f785419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f78599ec640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7854108140 0x7f785419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f78599ec640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7854108a90 0x7f785419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f78599ec640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7854113820 con 0x7f7854102800 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f78599ec640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78541136a0 con 0x7f7854108a90 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f78599ec640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78541139a0 con 0x7f7854108140 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f7852ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7854102800 0x7f785419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f7852ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7854102800 0x7f785419a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45542/0 (socket says 172.21.15.33:45542) 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f7852ffd640 1 -- 172.21.15.33:0/4272326813 learned_addr learned my addr 172.21.15.33:0/4272326813 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f78537fe640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7854108a90 0x7f785419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f784a7fc640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7854108140 0x7f785419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f7852ffd640 1 -- 172.21.15.33:0/4272326813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7854108140 msgr2=0x7f785419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f7852ffd640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7854108140 0x7f785419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f7852ffd640 1 -- 172.21.15.33:0/4272326813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7854108a90 msgr2=0x7f785419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f7852ffd640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7854108a90 0x7f785419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.227+0000 7f7852ffd640 1 -- 172.21.15.33:0/4272326813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78541a0160 con 0x7f7854102800 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.228+0000 7f7852ffd640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7854102800 0x7f785419a1f0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f7844005940 tx=0x7f78440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.228+0000 7f78589ea640 1 -- 172.21.15.33:0/4272326813 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784403f030 con 0x7f7854102800 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.228+0000 7f78599ec640 1 -- 172.21.15.33:0/4272326813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78541a03f0 con 0x7f7854102800 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.228+0000 7f78589ea640 1 -- 172.21.15.33:0/4272326813 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7844003cb0 con 0x7f7854102800 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.228+0000 7f78589ea640 1 -- 172.21.15.33:0/4272326813 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844035070 con 0x7f7854102800 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.228+0000 7f78599ec640 1 -- 172.21.15.33:0/4272326813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78541a6bb0 con 0x7f7854102800 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.230+0000 7f78589ea640 1 -- 172.21.15.33:0/4272326813 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7844042030 con 0x7f7854102800 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f785ff61740 1 Processor -- start 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f785ff61740 1 -- start start 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f785ff61740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 0x55bb9a010310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f785ff61740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a010850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f785ff61740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 0x55bb9a010d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f785ff61740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bb99f87680 con 0x55bb99c421b0 2024-08-28T19:46:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f785ff61740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bb99f76c10 con 0x55bb99c6b070 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f785ff61740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb99f7abc0 con 0x55bb99c4a390 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f7852ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a010850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f7852ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a010850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45550/0 (socket says 172.21.15.33:45550) 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f7852ffd640 1 -- 172.21.15.33:0/505465700 learned_addr learned my addr 172.21.15.33:0/505465700 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f78589ea640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78400b4ca0 0x7f78400b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f784a7fc640 1 --2- 172.21.15.33:0/505465700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 0x55bb9a010d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f78537fe640 1 --2- 172.21.15.33:0/505465700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 0x55bb9a010310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f78537fe640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78400b4ca0 0x7f78400b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.231+0000 7f78589ea640 1 -- 172.21.15.33:0/4272326813 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f7844106110 con 0x7f7854102800 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.232+0000 7f7852ffd640 1 -- 172.21.15.33:0/505465700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 msgr2=0x55bb9a010d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.232+0000 7f7852ffd640 1 --2- 172.21.15.33:0/505465700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 0x55bb9a010d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.232+0000 7f7852ffd640 1 -- 172.21.15.33:0/505465700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 msgr2=0x55bb9a010310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.232+0000 7f7852ffd640 1 --2- 172.21.15.33:0/505465700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 0x55bb9a010310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.232+0000 7f7852ffd640 1 -- 172.21.15.33:0/505465700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb99cd6650 con 0x55bb99c421b0 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.232+0000 7f7852ffd640 1 --2- 172.21.15.33:0/505465700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a010850 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f78440cc210 tx=0x7f78440045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574cefd41af82f6d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.232+0000 7f78537fe640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78400b4ca0 0x7f78400b71b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f784c009fd0 tx=0x7f784c009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.232+0000 7f7849ffb640 1 -- 172.21.15.33:0/505465700 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844049070 con 0x55bb99c421b0 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.232+0000 7f7849ffb640 1 -- 172.21.15.33:0/505465700 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78440cc020 con 0x55bb99c421b0 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.232+0000 7f7849ffb640 1 -- 172.21.15.33:0/505465700 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78440ef110 con 0x55bb99c421b0 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.233+0000 7f785ff61740 1 -- 172.21.15.33:0/505465700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 msgr2=0x55bb9a010850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.233+0000 7f785ff61740 1 --2- 172.21.15.33:0/505465700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a010850 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f78440cc210 tx=0x7f78440045a0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.234+0000 7f785ff61740 1 -- 172.21.15.33:0/505465700 shutdown_connections 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.234+0000 7f785ff61740 1 --2- 172.21.15.33:0/505465700 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 0x55bb9a010d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.234+0000 7f785ff61740 1 --2- 172.21.15.33:0/505465700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a010850 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.234+0000 7f785ff61740 1 --2- 172.21.15.33:0/505465700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 0x55bb9a010310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.234+0000 7f785ff61740 1 -- 172.21.15.33:0/505465700 >> 172.21.15.33:0/505465700 conn(0x55bb99c5f460 msgr2=0x55bb9a00e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.234+0000 7f785ff61740 1 -- 172.21.15.33:0/505465700 shutdown_connections 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.234+0000 7f785ff61740 1 -- 172.21.15.33:0/505465700 wait complete. 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.234+0000 7f785ff61740 1 -- start start 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f785ff61740 1 Processor -- start 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f785ff61740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a01ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f785ff61740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 0x55bb9a020440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f785ff61740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 0x55bb9a02bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f785ff61740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55bb99dd9700 con 0x55bb99c421b0 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f785ff61740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bb99efd750 con 0x55bb99c6b070 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f785ff61740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55bb99f87680 con 0x55bb99c4a390 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f785ff61740 10 client.0 _ll_register_callbacks cb 0x55bb99f2ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f7852ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a01ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f7852ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a01ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45558/0 (socket says 172.21.15.33:45558) 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f784a7fc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 0x55bb9a020440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f7852ffd640 1 -- 172.21.15.33:0/3807398688 learned_addr learned my addr 172.21.15.33:0/3807398688 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f78537fe640 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 0x55bb9a02bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f7852ffd640 1 -- 172.21.15.33:0/3807398688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 msgr2=0x55bb9a020440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f7852ffd640 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 0x55bb9a020440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f7852ffd640 1 -- 172.21.15.33:0/3807398688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 msgr2=0x55bb9a02bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f7852ffd640 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 0x55bb9a02bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.235+0000 7f7852ffd640 1 -- 172.21.15.33:0/3807398688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb99f36900 con 0x55bb99c421b0 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f78537fe640 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 0x55bb9a02bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f784a7fc640 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 0x55bb9a020440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f7852ffd640 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a01ff00 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f78440cc4a0 tx=0x7f78440c84d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12791c78d0947a94 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:55.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f7832ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f7832ffd640 1 -- 172.21.15.33:0/3807398688 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844049040 con 0x55bb99c421b0 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f785ff61740 1 -- 172.21.15.33:0/3807398688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78440cc020 con 0x55bb99c421b0 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f7832ffd640 1 -- 172.21.15.33:0/3807398688 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f7844103740 con 0x55bb99c421b0 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f7832ffd640 1 -- 172.21.15.33:0/3807398688 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78440cc510 con 0x55bb99c421b0 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f785ff61740 10 client.19437 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f785ff61740 1 -- 172.21.15.33:0/3807398688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb9a02e8d0 con 0x55bb99c421b0 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f7832ffd640 1 -- 172.21.15.33:0/3807398688 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78440cc020 con 0x55bb99c421b0 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.236+0000 7f7832ffd640 1 -- 172.21.15.33:0/3807398688 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f784403bca0 con 0x55bb99c421b0 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.237+0000 7f785ff61740 10 client.19437 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.237+0000 7f785ff61740 10 client.19437 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.237+0000 7f785ff61740 20 client.19437 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.237+0000 7f785ff61740 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55bb99c299f0 0x55bb9a031c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.237+0000 7f785ff61740 4 client.19437 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:55.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.237+0000 7f785ff61740 1 -- 172.21.15.33:0/3807398688 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb99f895d0 con 0x55bb99c299f0 2024-08-28T19:46:55.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.237+0000 7f784a7fc640 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55bb99c299f0 0x55bb9a031c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.237+0000 7f784a7fc640 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55bb99c299f0 0x55bb9a031c30 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=862651ece3020902 server_cookie=c4d244347db1ef0e in_seq=0 out_seq=0 2024-08-28T19:46:55.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.237+0000 7f7832ffd640 10 client.19437 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:46:55.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.238+0000 7f7832ffd640 1 -- 172.21.15.33:0/3807398688 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb99f895d0 con 0x55bb99c299f0 2024-08-28T19:46:55.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.238+0000 7f7832ffd640 10 client.19437 handle_command_reply: tid=0 2024-08-28T19:46:55.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.238+0000 7f785ff61740 1 client.19437 shutdown 2024-08-28T19:46:55.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.238+0000 7f785ff61740 1 -- 172.21.15.33:0/3807398688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 msgr2=0x55bb9a01ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.238+0000 7f785ff61740 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a01ff00 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f78440cc4a0 tx=0x7f78440c84d0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.239+0000 7f785ff61740 1 -- 172.21.15.33:0/3807398688 shutdown_connections 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.239+0000 7f785ff61740 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c6b070 0x55bb9a02bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.239+0000 7f785ff61740 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c4a390 0x55bb9a020440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.239+0000 7f785ff61740 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55bb99c299f0 0x55bb9a031c30 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.239+0000 7f785ff61740 1 --2- 172.21.15.33:0/3807398688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c421b0 0x55bb9a01ff00 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.239+0000 7f785ff61740 1 -- 172.21.15.33:0/3807398688 >> 172.21.15.33:0/3807398688 conn(0x55bb99c5f460 msgr2=0x55bb9a00c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.239+0000 7f7832ffd640 0 client.19437 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.239+0000 7f785ff61740 1 -- 172.21.15.33:0/3807398688 shutdown_connections 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.239+0000 7f785ff61740 1 -- 172.21.15.33:0/3807398688 wait complete. 2024-08-28T19:46:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.239+0000 7f785ff61740 20 client.19437 trim_cache size 0 max 16384 2024-08-28T19:46:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.252+0000 7f785ff61740 1 Processor -- start 2024-08-28T19:46:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.252+0000 7f785ff61740 1 -- start start 2024-08-28T19:46:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.252+0000 7f785ff61740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 0x55bb9a01fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.252+0000 7f785ff61740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 0x55bb9a0203b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.252+0000 7f785ff61740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a01d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.252+0000 7f785ff61740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f78541ae950 con 0x55bb99c6b070 2024-08-28T19:46:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.252+0000 7f785ff61740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78541b0490 con 0x55bb99c4a390 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.252+0000 7f785ff61740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78541af020 con 0x55bb99c421b0 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f78537fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a01d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f78537fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a01d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45572/0 (socket says 172.21.15.33:45572) 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f78537fe640 1 -- 172.21.15.33:0/224134640 learned_addr learned my addr 172.21.15.33:0/224134640 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f784a7fc640 1 --2- 172.21.15.33:0/224134640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 0x55bb9a0203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f7852ffd640 1 --2- 172.21.15.33:0/224134640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 0x55bb9a01fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f78537fe640 1 -- 172.21.15.33:0/224134640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 msgr2=0x55bb9a01fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f78537fe640 1 --2- 172.21.15.33:0/224134640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 0x55bb9a01fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f78537fe640 1 -- 172.21.15.33:0/224134640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 msgr2=0x55bb9a0203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f78537fe640 1 --2- 172.21.15.33:0/224134640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 0x55bb9a0203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f78537fe640 1 -- 172.21.15.33:0/224134640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9a032090 con 0x55bb99c6b070 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f7852ffd640 1 --2- 172.21.15.33:0/224134640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 0x55bb9a01fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f78537fe640 1 --2- 172.21.15.33:0/224134640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a01d0f0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f784c012a30 tx=0x7f784c009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dd5bb86beeb69f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.253+0000 7f78497fa640 1 -- 172.21.15.33:0/224134640 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c02e070 con 0x55bb99c6b070 2024-08-28T19:46:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.254+0000 7f78497fa640 1 -- 172.21.15.33:0/224134640 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f784c021e20 con 0x55bb99c6b070 2024-08-28T19:46:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.254+0000 7f78497fa640 1 -- 172.21.15.33:0/224134640 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c029e60 con 0x55bb99c6b070 2024-08-28T19:46:55.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.254+0000 7f785ff61740 1 -- 172.21.15.33:0/224134640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 msgr2=0x55bb9a01d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.254+0000 7f785ff61740 1 --2- 172.21.15.33:0/224134640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a01d0f0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f784c012a30 tx=0x7f784c009a00 comp rx=0 tx=0).stop 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.254+0000 7f785ff61740 1 -- 172.21.15.33:0/224134640 shutdown_connections 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.254+0000 7f785ff61740 1 --2- 172.21.15.33:0/224134640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a01d0f0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.254+0000 7f785ff61740 1 --2- 172.21.15.33:0/224134640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 0x55bb9a0203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.254+0000 7f785ff61740 1 --2- 172.21.15.33:0/224134640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 0x55bb9a01fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.254+0000 7f785ff61740 1 -- 172.21.15.33:0/224134640 >> 172.21.15.33:0/224134640 conn(0x55bb99c5f460 msgr2=0x55bb9a01e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.255+0000 7f785ff61740 1 -- 172.21.15.33:0/224134640 shutdown_connections 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.255+0000 7f785ff61740 1 -- 172.21.15.33:0/224134640 wait complete. 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.255+0000 7f785ff61740 1 -- start start 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.255+0000 7f785ff61740 1 Processor -- start 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.255+0000 7f785ff61740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 0x55bb9a028460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.255+0000 7f785ff61740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 0x55bb9a023910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.255+0000 7f785ff61740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a023e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f785ff61740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f78541afdc0 con 0x55bb99c6b070 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f785ff61740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78541af6f0 con 0x55bb99c4a390 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f785ff61740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f78541ac950 con 0x55bb99c421b0 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f785ff61740 10 client.0 _ll_register_callbacks cb 0x7f784c009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f78537fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a023e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f78537fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a023e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45580/0 (socket says 172.21.15.33:45580) 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f78537fe640 1 -- 172.21.15.33:0/2786005482 learned_addr learned my addr 172.21.15.33:0/2786005482 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f7852ffd640 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 0x55bb9a028460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f784a7fc640 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 0x55bb9a023910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f78537fe640 1 -- 172.21.15.33:0/2786005482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 msgr2=0x55bb9a028460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f78537fe640 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 0x55bb9a028460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f78537fe640 1 -- 172.21.15.33:0/2786005482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 msgr2=0x55bb9a023910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f78537fe640 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 0x55bb9a023910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f78537fe640 1 -- 172.21.15.33:0/2786005482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9a024540 con 0x55bb99c6b070 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f784a7fc640 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 0x55bb9a023910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f7852ffd640 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 0x55bb9a028460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f78537fe640 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a023e50 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f784c02c040 tx=0x7f784c021ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bb74f58d0bd07e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f7832ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f7832ffd640 1 -- 172.21.15.33:0/2786005482 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c039060 con 0x55bb99c6b070 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f7832ffd640 1 -- 172.21.15.33:0/2786005482 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f784c01b070 con 0x55bb99c6b070 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.256+0000 7f785ff61740 1 -- 172.21.15.33:0/2786005482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f784c021e20 con 0x55bb99c6b070 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f7832ffd640 1 -- 172.21.15.33:0/2786005482 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f784c040050 con 0x55bb99c6b070 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f785ff61740 10 client.19443 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:55.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f785ff61740 1 -- 172.21.15.33:0/2786005482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bb9a09c3f0 con 0x55bb99c6b070 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f7832ffd640 1 -- 172.21.15.33:0/2786005482 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f784c021e20 con 0x55bb99c6b070 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f7832ffd640 1 -- 172.21.15.33:0/2786005482 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f784c028030 con 0x55bb99c6b070 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f785ff61740 10 client.19443 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f785ff61740 10 client.19443 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f785ff61740 20 client.19443 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f785ff61740 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55bb99bfeda0 0x55bb9a09eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f785ff61740 4 client.19443 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.257+0000 7f785ff61740 1 -- 172.21.15.33:0/2786005482 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bb99f85070 con 0x55bb99bfeda0 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f7852ffd640 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55bb99bfeda0 0x55bb9a09eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f7832ffd640 10 client.19443 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f7852ffd640 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55bb99bfeda0 0x55bb9a09eb00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7f45424b3b3122c server_cookie=c5e51848efa9bb95 in_seq=0 out_seq=0 2024-08-28T19:46:55.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f7832ffd640 1 -- 172.21.15.33:0/2786005482 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bb99f85070 con 0x55bb99bfeda0 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f7832ffd640 10 client.19443 handle_command_reply: tid=0 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f785ff61740 1 client.19443 shutdown 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f785ff61740 1 -- 172.21.15.33:0/2786005482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 msgr2=0x55bb9a023e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f785ff61740 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a023e50 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f784c02c040 tx=0x7f784c021ba0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f785ff61740 1 -- 172.21.15.33:0/2786005482 shutdown_connections 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f785ff61740 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55bb99bfeda0 0x55bb9a09eb00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f785ff61740 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb99c6b070 0x55bb9a023e50 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f785ff61740 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bb99c4a390 0x55bb9a023910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f785ff61740 1 --2- 172.21.15.33:0/2786005482 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55bb99c421b0 0x55bb9a028460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f785ff61740 1 -- 172.21.15.33:0/2786005482 >> 172.21.15.33:0/2786005482 conn(0x55bb99c5f460 msgr2=0x55bb9a01fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.258+0000 7f7832ffd640 0 client.19443 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f785ff61740 1 -- 172.21.15.33:0/2786005482 shutdown_connections 2024-08-28T19:46:55.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f785ff61740 1 -- 172.21.15.33:0/2786005482 wait complete. 2024-08-28T19:46:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f785ff61740 20 client.19443 trim_cache size 0 max 16384 2024-08-28T19:46:55.265 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:46:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 -- 172.21.15.33:0/4272326813 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78400b4ca0 msgr2=0x7f78400b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78400b4ca0 0x7f78400b71b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f784c009fd0 tx=0x7f784c009600 comp rx=0 tx=0).stop 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 -- 172.21.15.33:0/4272326813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7854102800 msgr2=0x7f785419a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7854102800 0x7f785419a1f0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f7844005940 tx=0x7f78440042f0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 -- 172.21.15.33:0/4272326813 shutdown_connections 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7854108a90 0x7f785419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f78400b4ca0 0x7f78400b71b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7854108140 0x7f785419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 --2- 172.21.15.33:0/4272326813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7854102800 0x7f785419a1f0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 -- 172.21.15.33:0/4272326813 >> 172.21.15.33:0/4272326813 conn(0x7f78540794d0 msgr2=0x7f78541011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.259+0000 7f78599ec640 1 -- 172.21.15.33:0/4272326813 shutdown_connections 2024-08-28T19:46:55.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:55.260+0000 7f78599ec640 1 -- 172.21.15.33:0/4272326813 wait complete. 2024-08-28T19:46:55.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:55 smithi033 ceph-mon[18549]: pgmap v792: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 81 KiB/s wr, 18 op/s 2024-08-28T19:46:55.975 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:46:56.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:55 smithi059 ceph-mon[22052]: pgmap v792: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 81 KiB/s wr, 18 op/s 2024-08-28T19:46:56.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:55 smithi122 ceph-mon[22174]: pgmap v792: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 81 KiB/s wr, 18 op/s 2024-08-28T19:46:56.236 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:56.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.779+0000 7fe008bb6640 1 -- 172.21.15.33:0/1660800158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe004108ad0 msgr2=0x7fe00410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:56.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.779+0000 7fe008bb6640 1 --2- 172.21.15.33:0/1660800158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe004108ad0 0x7fe00410f300 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009ca0 tx=0x7fdffc02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.779+0000 7fe008bb6640 1 -- 172.21.15.33:0/1660800158 shutdown_connections 2024-08-28T19:46:56.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.779+0000 7fe008bb6640 1 --2- 172.21.15.33:0/1660800158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe004108ad0 0x7fe00410f300 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.779+0000 7fe008bb6640 1 --2- 172.21.15.33:0/1660800158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe004108180 0x7fe004108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.779+0000 7fe008bb6640 1 --2- 172.21.15.33:0/1660800158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe004102840 0x7fe004102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.779+0000 7fe008bb6640 1 -- 172.21.15.33:0/1660800158 >> 172.21.15.33:0/1660800158 conn(0x7fe004079580 msgr2=0x7fe004079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:56.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.779+0000 7fe008bb6640 1 -- 172.21.15.33:0/1660800158 shutdown_connections 2024-08-28T19:46:56.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.779+0000 7fe008bb6640 1 -- 172.21.15.33:0/1660800158 wait complete. 2024-08-28T19:46:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.780+0000 7fe008bb6640 1 Processor -- start 2024-08-28T19:46:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.780+0000 7fe008bb6640 1 -- start start 2024-08-28T19:46:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe008bb6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe004102840 0x7fe0041990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe008bb6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe004108180 0x7fe004199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe008bb6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe004108ad0 0x7fe00419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe008bb6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe004112730 con 0x7fe004108ad0 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe008bb6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041125b0 con 0x7fe004108180 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe008bb6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041128b0 con 0x7fe004102840 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe002d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe004108ad0 0x7fe00419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe002d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe004108ad0 0x7fe00419e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45592/0 (socket says 172.21.15.33:45592) 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe002d9d640 1 -- 172.21.15.33:0/2524353175 learned_addr learned my addr 172.21.15.33:0/2524353175 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe001d9b640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe004108180 0x7fe004199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe00259c640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe004102840 0x7fe0041990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe002d9d640 1 -- 172.21.15.33:0/2524353175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe004102840 msgr2=0x7fe0041990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe002d9d640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe004102840 0x7fe0041990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe002d9d640 1 -- 172.21.15.33:0/2524353175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe004108180 msgr2=0x7fe004199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:56.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe002d9d640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe004108180 0x7fe004199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe002d9d640 1 -- 172.21.15.33:0/2524353175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00419f030 con 0x7fe004108ad0 2024-08-28T19:46:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe00259c640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe004102840 0x7fe0041990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.781+0000 7fe002d9d640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe004108ad0 0x7fe00419e900 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fdffc005cc0 tx=0x7fdffc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.782+0000 7fdff37fe640 1 -- 172.21.15.33:0/2524353175 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc003bf0 con 0x7fe004108ad0 2024-08-28T19:46:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.782+0000 7fdff37fe640 1 -- 172.21.15.33:0/2524353175 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdffc003d90 con 0x7fe004108ad0 2024-08-28T19:46:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.782+0000 7fe008bb6640 1 -- 172.21.15.33:0/2524353175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00419f2c0 con 0x7fe004108ad0 2024-08-28T19:46:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.782+0000 7fdff37fe640 1 -- 172.21.15.33:0/2524353175 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc02fbc0 con 0x7fe004108ad0 2024-08-28T19:46:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.782+0000 7fe008bb6640 1 -- 172.21.15.33:0/2524353175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0041a5a80 con 0x7fe004108ad0 2024-08-28T19:46:56.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.784+0000 7fe00f12b740 1 Processor -- start 2024-08-28T19:46:56.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.785+0000 7fdff37fe640 1 -- 172.21.15.33:0/2524353175 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fdffc02fd60 con 0x7fe004108ad0 2024-08-28T19:46:56.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.785+0000 7fe00f12b740 1 -- start start 2024-08-28T19:46:56.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.785+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7878350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.785+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74aa1b0 0x55e6b7878890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.785+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 0x55e6b7878dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.785+0000 7fe00f12b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e6b77ef680 con 0x55e6b74d3070 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.785+0000 7fe00f12b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e6b77dec10 con 0x55e6b74b2390 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.785+0000 7fe00f12b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e6b77e2bc0 con 0x55e6b74aa1b0 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.785+0000 7fe001d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7878350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.785+0000 7fe001d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7878350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45600/0 (socket says 172.21.15.33:45600) 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fe001d9b640 1 -- 172.21.15.33:0/1196975221 learned_addr learned my addr 172.21.15.33:0/1196975221 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fe00259c640 1 --2- 172.21.15.33:0/1196975221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74aa1b0 0x55e6b7878890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fe001d9b640 1 --2- 172.21.15.33:0/1196975221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 0x55e6b7878dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fdff37fe640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdfec0b4ca0 0x7fdfec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fe001d9b640 1 -- 172.21.15.33:0/1196975221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74aa1b0 msgr2=0x55e6b7878890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fe001d9b640 1 --2- 172.21.15.33:0/1196975221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74aa1b0 0x55e6b7878890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fe001d9b640 1 -- 172.21.15.33:0/1196975221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 msgr2=0x55e6b7878dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fe001d9b640 1 --2- 172.21.15.33:0/1196975221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 0x55e6b7878dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fe001d9b640 1 -- 172.21.15.33:0/1196975221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b753e650 con 0x55e6b74d3070 2024-08-28T19:46:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fe002d9d640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdfec0b4ca0 0x7fdfec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fdff37fe640 1 -- 172.21.15.33:0/2524353175 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7fdffc106ec0 con 0x7fe004108ad0 2024-08-28T19:46:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fe001d9b640 1 --2- 172.21.15.33:0/1196975221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7878350 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fdff8012570 tx=0x7fdff800b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1af07586d5e3320 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.786+0000 7fdff0ff9640 1 -- 172.21.15.33:0/1196975221 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff8004020 con 0x55e6b74d3070 2024-08-28T19:46:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.787+0000 7fdff0ff9640 1 -- 172.21.15.33:0/1196975221 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdff8004c50 con 0x55e6b74d3070 2024-08-28T19:46:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.787+0000 7fe002d9d640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdfec0b4ca0 0x7fdfec0b71b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdffc104320 tx=0x7fdffc0ccfe0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.787+0000 7fdff0ff9640 1 -- 172.21.15.33:0/1196975221 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff8005280 con 0x55e6b74d3070 2024-08-28T19:46:56.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.787+0000 7fe00f12b740 1 -- 172.21.15.33:0/1196975221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 msgr2=0x55e6b7878350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:56.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.787+0000 7fe00f12b740 1 --2- 172.21.15.33:0/1196975221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7878350 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fdff8012570 tx=0x7fdff800b650 comp rx=0 tx=0).stop 2024-08-28T19:46:56.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.788+0000 7fe00f12b740 1 -- 172.21.15.33:0/1196975221 shutdown_connections 2024-08-28T19:46:56.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.788+0000 7fe00f12b740 1 --2- 172.21.15.33:0/1196975221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 0x55e6b7878dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.788+0000 7fe00f12b740 1 --2- 172.21.15.33:0/1196975221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74aa1b0 0x55e6b7878890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.788+0000 7fe00f12b740 1 --2- 172.21.15.33:0/1196975221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7878350 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.788+0000 7fe00f12b740 1 -- 172.21.15.33:0/1196975221 >> 172.21.15.33:0/1196975221 conn(0x55e6b74c7460 msgr2=0x55e6b7876240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.788+0000 7fe00f12b740 1 -- 172.21.15.33:0/1196975221 shutdown_connections 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.788+0000 7fe00f12b740 1 -- 172.21.15.33:0/1196975221 wait complete. 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.788+0000 7fe00f12b740 1 -- start start 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.788+0000 7fe00f12b740 1 Processor -- start 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74aa1b0 0x55e6b7885bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74b2390 0x55e6b7886130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74d3070 0x55e6b7892020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe00f12b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e6b7641700 con 0x55e6b74aa1b0 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe00f12b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e6b7765750 con 0x55e6b74d3070 2024-08-28T19:46:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe00f12b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e6b7888c90 con 0x55e6b74b2390 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe001d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74aa1b0 0x55e6b7885bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe00f12b740 10 client.0 _ll_register_callbacks cb 0x55e6b7794e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe001d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74aa1b0 0x55e6b7885bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45608/0 (socket says 172.21.15.33:45608) 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe001d9b640 1 -- 172.21.15.33:0/4176214877 learned_addr learned my addr 172.21.15.33:0/4176214877 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe00259c640 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74b2390 0x55e6b7886130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe001d9b640 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74d3070 0x55e6b7892020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe001d9b640 1 -- 172.21.15.33:0/4176214877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74b2390 msgr2=0x55e6b7886130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe001d9b640 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74b2390 0x55e6b7886130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe001d9b640 1 -- 172.21.15.33:0/4176214877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74d3070 msgr2=0x55e6b7892020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe001d9b640 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74d3070 0x55e6b7892020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe001d9b640 1 -- 172.21.15.33:0/4176214877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b779e900 con 0x55e6b74aa1b0 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.789+0000 7fe00259c640 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74b2390 0x55e6b7886130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:56.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fe001d9b640 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74aa1b0 0x55e6b7885bf0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fdff80044c0 tx=0x7fdff800b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8213ac352ad1374a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fdfe9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/4176214877 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff8026070 con 0x55e6b74aa1b0 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fe00f12b740 1 -- 172.21.15.33:0/4176214877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdff8004c50 con 0x55e6b74aa1b0 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/4176214877 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7fdff8005000 con 0x55e6b74aa1b0 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/4176214877 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdff8033050 con 0x55e6b74aa1b0 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fe00f12b740 10 client.19455 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fe00f12b740 1 -- 172.21.15.33:0/4176214877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6b7894a10 con 0x55e6b74aa1b0 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/4176214877 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdff8004c50 con 0x55e6b74aa1b0 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/4176214877 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fdff80106c0 con 0x55e6b74aa1b0 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fe00f12b740 10 client.19455 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.790+0000 7fe00f12b740 10 client.19455 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.791+0000 7fe00f12b740 20 client.19455 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.791+0000 7fe00f12b740 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e6b74919f0 0x55e6b7897f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.791+0000 7fe00f12b740 4 client.19455 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.791+0000 7fe00f12b740 1 -- 172.21.15.33:0/4176214877 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6b77f15d0 con 0x55e6b74919f0 2024-08-28T19:46:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.791+0000 7fe00259c640 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e6b74919f0 0x55e6b7897f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.791+0000 7fe00259c640 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e6b74919f0 0x55e6b7897f20 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35f74ed926d69061 server_cookie=4d7cfd3cdbb8c0b7 in_seq=0 out_seq=0 2024-08-28T19:46:56.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.791+0000 7fdfe9ffb640 10 client.19455 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:46:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/4176214877 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6b77f15d0 con 0x55e6b74919f0 2024-08-28T19:46:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fdfe9ffb640 10 client.19455 handle_command_reply: tid=0 2024-08-28T19:46:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fe00f12b740 1 client.19455 shutdown 2024-08-28T19:46:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fe00f12b740 1 -- 172.21.15.33:0/4176214877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74aa1b0 msgr2=0x55e6b7885bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fe00f12b740 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74aa1b0 0x55e6b7885bf0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fdff80044c0 tx=0x7fdff800b470 comp rx=0 tx=0).stop 2024-08-28T19:46:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fe00f12b740 1 -- 172.21.15.33:0/4176214877 shutdown_connections 2024-08-28T19:46:56.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fe00f12b740 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e6b74919f0 0x55e6b7897f20 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fe00f12b740 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74d3070 0x55e6b7892020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fe00f12b740 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74b2390 0x55e6b7886130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fe00f12b740 1 --2- 172.21.15.33:0/4176214877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74aa1b0 0x55e6b7885bf0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fe00f12b740 1 -- 172.21.15.33:0/4176214877 >> 172.21.15.33:0/4176214877 conn(0x55e6b74c7460 msgr2=0x55e6b7874800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fdfe9ffb640 0 client.19455 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:46:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.792+0000 7fe00f12b740 1 -- 172.21.15.33:0/4176214877 shutdown_connections 2024-08-28T19:46:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.793+0000 7fe00f12b740 1 -- 172.21.15.33:0/4176214877 wait complete. 2024-08-28T19:46:56.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.793+0000 7fe00f12b740 20 client.19455 trim_cache size 0 max 16384 2024-08-28T19:46:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00f12b740 1 Processor -- start 2024-08-28T19:46:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00f12b740 1 -- start start 2024-08-28T19:46:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 0x55e6b7876340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7891f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b7466da0 0x55e6b787d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00f12b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041ae990 con 0x55e6b74d3070 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00f12b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041b04d0 con 0x55e6b74b2390 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00f12b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041af060 con 0x55e6b7466da0 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7891f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7891f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45624/0 (socket says 172.21.15.33:45624) 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.807+0000 7fe00259c640 1 -- 172.21.15.33:0/193537543 learned_addr learned my addr 172.21.15.33:0/193537543 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fe001d9b640 1 --2- 172.21.15.33:0/193537543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 0x55e6b7876340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fe001d9b640 1 --2- 172.21.15.33:0/193537543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b7466da0 0x55e6b787d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fe00259c640 1 -- 172.21.15.33:0/193537543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b7466da0 msgr2=0x55e6b787d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fe00259c640 1 --2- 172.21.15.33:0/193537543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b7466da0 0x55e6b787d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fe00259c640 1 -- 172.21.15.33:0/193537543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 msgr2=0x55e6b7876340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fe00259c640 1 --2- 172.21.15.33:0/193537543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 0x55e6b7876340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fe00259c640 1 -- 172.21.15.33:0/193537543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b787b170 con 0x55e6b74d3070 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fe001d9b640 1 --2- 172.21.15.33:0/193537543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 0x55e6b7876340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fe00259c640 1 --2- 172.21.15.33:0/193537543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7891f90 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdff400bd60 tx=0x7fdff40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f483b614145d97d server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fdfebfff640 1 -- 172.21.15.33:0/193537543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4013110 con 0x55e6b74d3070 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fdfebfff640 1 -- 172.21.15.33:0/193537543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdff40132b0 con 0x55e6b74d3070 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.808+0000 7fdfebfff640 1 -- 172.21.15.33:0/193537543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4011440 con 0x55e6b74d3070 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 -- 172.21.15.33:0/193537543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 msgr2=0x55e6b7891f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 --2- 172.21.15.33:0/193537543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7891f90 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdff400bd60 tx=0x7fdff40046c0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 -- 172.21.15.33:0/193537543 shutdown_connections 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 --2- 172.21.15.33:0/193537543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b7466da0 0x55e6b787d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 --2- 172.21.15.33:0/193537543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74d3070 0x55e6b7891f90 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 --2- 172.21.15.33:0/193537543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b74b2390 0x55e6b7876340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 -- 172.21.15.33:0/193537543 >> 172.21.15.33:0/193537543 conn(0x55e6b74c7460 msgr2=0x55e6b7875c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 -- 172.21.15.33:0/193537543 shutdown_connections 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 -- 172.21.15.33:0/193537543 wait complete. 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 -- start start 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.809+0000 7fe00f12b740 1 Processor -- start 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b7466da0 0x55e6b789b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74b2390 0x55e6b7898bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00f12b740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74d3070 0x55e6b78990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00f12b740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041afe00 con 0x55e6b74b2390 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00f12b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041af730 con 0x55e6b7466da0 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00f12b740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041ac990 con 0x55e6b74d3070 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00f12b740 10 client.0 _ll_register_callbacks cb 0x7fdff400b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74b2390 0x55e6b7898bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe001d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74d3070 0x55e6b78990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00259c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74b2390 0x55e6b7898bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45632/0 (socket says 172.21.15.33:45632) 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00259c640 1 -- 172.21.15.33:0/2151173388 learned_addr learned my addr 172.21.15.33:0/2151173388 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe001d9b640 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b7466da0 0x55e6b789b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe001d9b640 1 -- 172.21.15.33:0/2151173388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b7466da0 msgr2=0x55e6b789b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe001d9b640 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b7466da0 0x55e6b789b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe001d9b640 1 -- 172.21.15.33:0/2151173388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74b2390 msgr2=0x55e6b7898bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe001d9b640 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74b2390 0x55e6b7898bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe001d9b640 1 -- 172.21.15.33:0/2151173388 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b7899880 con 0x55e6b74d3070 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.810+0000 7fe00259c640 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74b2390 0x55e6b7898bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.811+0000 7fe001d9b640 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74d3070 0x55e6b78990f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdff8028000 tx=0x7fdff800be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=667b87a6d6211afe server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.811+0000 7fdfe9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:46:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.811+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/2151173388 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff8026070 con 0x55e6b74d3070 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.811+0000 7fe00f12b740 1 -- 172.21.15.33:0/2151173388 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdff40132b0 con 0x55e6b74d3070 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.811+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/2151173388 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7fdff8010870 con 0x55e6b74d3070 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.811+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/2151173388 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdff800e490 con 0x55e6b74d3070 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.811+0000 7fe00f12b740 10 client.28147 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.811+0000 7fe00f12b740 1 -- 172.21.15.33:0/2151173388 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6b787ea00 con 0x55e6b74d3070 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.811+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/2151173388 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdff40132b0 con 0x55e6b74d3070 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.811+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/2151173388 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fdff802e410 con 0x55e6b74d3070 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.812+0000 7fe00f12b740 10 client.28147 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.812+0000 7fe00f12b740 10 client.28147 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.812+0000 7fe00f12b740 20 client.28147 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.812+0000 7fe00f12b740 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e6b787f180 0x55e6b787f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.812+0000 7fe00f12b740 4 client.28147 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:46:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.812+0000 7fe00f12b740 1 -- 172.21.15.33:0/2151173388 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6b77ed070 con 0x55e6b787f180 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.812+0000 7fe00259c640 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e6b787f180 0x55e6b787f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.812+0000 7fe00259c640 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e6b787f180 0x55e6b787f590 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a8afad19a85ed017 server_cookie=cbaeeda5642fc3c2 in_seq=0 out_seq=0 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.812+0000 7fdfe9ffb640 10 client.28147 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fdfe9ffb640 1 -- 172.21.15.33:0/2151173388 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6b77ed070 con 0x55e6b787f180 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fdfe9ffb640 10 client.28147 handle_command_reply: tid=0 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 client.28147 shutdown 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 -- 172.21.15.33:0/2151173388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74d3070 msgr2=0x55e6b78990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74d3070 0x55e6b78990f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdff8028000 tx=0x7fdff800be10 comp rx=0 tx=0).stop 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 -- 172.21.15.33:0/2151173388 shutdown_connections 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55e6b787f180 0x55e6b787f590 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6b74d3070 0x55e6b78990f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fdfe9ffb640 0 client.28147 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:46:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e6b74b2390 0x55e6b7898bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 --2- 172.21.15.33:0/2151173388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6b7466da0 0x55e6b789b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 -- 172.21.15.33:0/2151173388 >> 172.21.15.33:0/2151173388 conn(0x55e6b74c7460 msgr2=0x55e6b787d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:56.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 -- 172.21.15.33:0/2151173388 shutdown_connections 2024-08-28T19:46:56.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 1 -- 172.21.15.33:0/2151173388 wait complete. 2024-08-28T19:46:56.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.813+0000 7fe00f12b740 20 client.28147 trim_cache size 0 max 16384 2024-08-28T19:46:56.822 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:46:56.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 -- 172.21.15.33:0/2524353175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdfec0b4ca0 msgr2=0x7fdfec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:56.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdfec0b4ca0 0x7fdfec0b71b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdffc104320 tx=0x7fdffc0ccfe0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 -- 172.21.15.33:0/2524353175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe004108ad0 msgr2=0x7fe00419e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:56.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe004108ad0 0x7fe00419e900 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fdffc005cc0 tx=0x7fdffc02f380 comp rx=0 tx=0).stop 2024-08-28T19:46:56.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 -- 172.21.15.33:0/2524353175 shutdown_connections 2024-08-28T19:46:56.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe004108ad0 0x7fe00419e900 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe004108180 0x7fe004199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fdfec0b4ca0 0x7fdfec0b71b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 --2- 172.21.15.33:0/2524353175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe004102840 0x7fe0041990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 -- 172.21.15.33:0/2524353175 >> 172.21.15.33:0/2524353175 conn(0x7fe004079580 msgr2=0x7fe004104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 -- 172.21.15.33:0/2524353175 shutdown_connections 2024-08-28T19:46:56.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:56.814+0000 7fe008bb6640 1 -- 172.21.15.33:0/2524353175 wait complete. 2024-08-28T19:46:57.648 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:46:57.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:57 smithi033 ceph-mon[18549]: pgmap v793: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:46:57.905 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:46:58.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:57 smithi059 ceph-mon[22052]: pgmap v793: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:46:58.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:57 smithi122 ceph-mon[22174]: pgmap v793: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-08-28T19:46:58.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.422+0000 7f75523e4640 1 -- 172.21.15.33:0/325469925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f754c1082c0 msgr2=0x7f754c10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:58.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.422+0000 7f75523e4640 1 --2- 172.21.15.33:0/325469925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f754c1082c0 0x7f754c10eaf0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f7544009ca0 tx=0x7f754402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.422+0000 7f75523e4640 1 -- 172.21.15.33:0/325469925 shutdown_connections 2024-08-28T19:46:58.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.422+0000 7f75523e4640 1 --2- 172.21.15.33:0/325469925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f754c1082c0 0x7f754c10eaf0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.422+0000 7f75523e4640 1 --2- 172.21.15.33:0/325469925 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c107970 0x7f754c107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.422+0000 7f75523e4640 1 --2- 172.21.15.33:0/325469925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754c102030 0x7f754c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.422+0000 7f75523e4640 1 -- 172.21.15.33:0/325469925 >> 172.21.15.33:0/325469925 conn(0x7f754c079c40 msgr2=0x7f754c07a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:58.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.422+0000 7f75523e4640 1 -- 172.21.15.33:0/325469925 shutdown_connections 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.422+0000 7f75523e4640 1 -- 172.21.15.33:0/325469925 wait complete. 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.423+0000 7f75523e4640 1 Processor -- start 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.423+0000 7f75523e4640 1 -- start start 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.423+0000 7f75523e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754c102030 0x7f754c19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.423+0000 7f75523e4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f754c107970 0x7f754c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.423+0000 7f75523e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c1082c0 0x7f754c19fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.423+0000 7f75523e4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f754c111700 con 0x7f754c107970 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.423+0000 7f75523e4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f754c111580 con 0x7f754c102030 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.423+0000 7f75523e4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f754c111880 con 0x7f754c1082c0 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f754b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f754c107970 0x7f754c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f754b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f754c107970 0x7f754c19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33082/0 (socket says 172.21.15.33:33082) 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f754b7fe640 1 -- 172.21.15.33:0/2074348505 learned_addr learned my addr 172.21.15.33:0/2074348505 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f754bfff640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754c102030 0x7f754c19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f7550981640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c1082c0 0x7f754c19fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f754b7fe640 1 -- 172.21.15.33:0/2074348505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c1082c0 msgr2=0x7f754c19fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f754b7fe640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c1082c0 0x7f754c19fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f754b7fe640 1 -- 172.21.15.33:0/2074348505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754c102030 msgr2=0x7f754c19a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f754b7fe640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754c102030 0x7f754c19a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f754b7fe640 1 -- 172.21.15.33:0/2074348505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c1a0240 con 0x7f754c107970 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f754b7fe640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f754c107970 0x7f754c19a870 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f754000d750 tx=0x7f754000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f75497fa640 1 -- 172.21.15.33:0/2074348505 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540017070 con 0x7f754c107970 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f75497fa640 1 -- 172.21.15.33:0/2074348505 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75400054d0 con 0x7f754c107970 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f75523e4640 1 -- 172.21.15.33:0/2074348505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754c1a0530 con 0x7f754c107970 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f75497fa640 1 -- 172.21.15.33:0/2074348505 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540004c30 con 0x7f754c107970 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.424+0000 7f75523e4640 1 -- 172.21.15.33:0/2074348505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f754c1a6c90 con 0x7f754c107970 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.427+0000 7f7558959740 1 Processor -- start 2024-08-28T19:46:58.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.427+0000 7f7558959740 1 -- start start 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.427+0000 7f75497fa640 1 -- 172.21.15.33:0/2074348505 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7540004dd0 con 0x7f754c107970 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.427+0000 7f7558959740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a82577310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.427+0000 7f7558959740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82577850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.427+0000 7f7558959740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82577d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.427+0000 7f7558959740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555a824ee680 con 0x555a821b1390 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.427+0000 7f7558959740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555a824ddc10 con 0x555a821d2070 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.427+0000 7f7558959740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a824e1bc0 con 0x555a821a91b0 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.427+0000 7f754b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82577d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f754b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82577d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33098/0 (socket says 172.21.15.33:33098) 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f754b7fe640 1 -- 172.21.15.33:0/2321608431 learned_addr learned my addr 172.21.15.33:0/2321608431 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f754bfff640 1 --2- 172.21.15.33:0/2321608431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82577850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f7550981640 1 --2- 172.21.15.33:0/2321608431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a82577310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f754b7fe640 1 -- 172.21.15.33:0/2321608431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 msgr2=0x555a82577850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f754b7fe640 1 --2- 172.21.15.33:0/2321608431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82577850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f754b7fe640 1 -- 172.21.15.33:0/2321608431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 msgr2=0x555a82577310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f754b7fe640 1 --2- 172.21.15.33:0/2321608431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a82577310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f754b7fe640 1 -- 172.21.15.33:0/2321608431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a8223d650 con 0x555a821b1390 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f7550981640 1 --2- 172.21.15.33:0/2321608431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a82577310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f75497fa640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f75340b4d20 0x7f75340b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f754b7fe640 1 --2- 172.21.15.33:0/2321608431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82577d90 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f75400e2480 tx=0x7f75400ed850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9bced969e5d6a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f7550981640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f75340b4d20 0x7f75340b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f75497fa640 1 -- 172.21.15.33:0/2074348505 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f75400e5160 con 0x7f754c107970 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f75327fc640 1 -- 172.21.15.33:0/2321608431 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75400a7420 con 0x555a821b1390 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f75327fc640 1 -- 172.21.15.33:0/2321608431 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75400ab070 con 0x555a821b1390 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.428+0000 7f75327fc640 1 -- 172.21.15.33:0/2321608431 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75400aacd0 con 0x555a821b1390 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.429+0000 7f7558959740 1 -- 172.21.15.33:0/2321608431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 msgr2=0x555a82577d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.429+0000 7f7550981640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f75340b4d20 0x7f75340b7230 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7544006010 tx=0x7f7544009480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.429+0000 7f7558959740 1 --2- 172.21.15.33:0/2321608431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82577d90 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f75400e2480 tx=0x7f75400ed850 comp rx=0 tx=0).stop 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.429+0000 7f7558959740 1 -- 172.21.15.33:0/2321608431 shutdown_connections 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.429+0000 7f7558959740 1 --2- 172.21.15.33:0/2321608431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82577d90 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.429+0000 7f7558959740 1 --2- 172.21.15.33:0/2321608431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82577850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.429+0000 7f7558959740 1 --2- 172.21.15.33:0/2321608431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a82577310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.429+0000 7f7558959740 1 -- 172.21.15.33:0/2321608431 >> 172.21.15.33:0/2321608431 conn(0x555a821c6460 msgr2=0x555a82575200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.429+0000 7f7558959740 1 -- 172.21.15.33:0/2321608431 shutdown_connections 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.429+0000 7f7558959740 1 -- 172.21.15.33:0/2321608431 wait complete. 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.430+0000 7f7558959740 1 -- start start 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.430+0000 7f7558959740 1 Processor -- start 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.430+0000 7f7558959740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82582a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.430+0000 7f7558959740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82582fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.430+0000 7f7558959740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a8258ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.430+0000 7f7558959740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555a82340700 con 0x555a821b1390 2024-08-28T19:46:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.430+0000 7f7558959740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555a82464750 con 0x555a821d2070 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.430+0000 7f7558959740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x555a82585af0 con 0x555a821a91b0 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.430+0000 7f7558959740 10 client.0 _ll_register_callbacks cb 0x555a82493e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82582fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754bfff640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82582a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82582fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33110/0 (socket says 172.21.15.33:33110) 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754b7fe640 1 -- 172.21.15.33:0/152763849 learned_addr learned my addr 172.21.15.33:0/152763849 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f7550981640 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a8258ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754b7fe640 1 -- 172.21.15.33:0/152763849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 msgr2=0x555a82582a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754b7fe640 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82582a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754b7fe640 1 -- 172.21.15.33:0/152763849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 msgr2=0x555a8258ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754b7fe640 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a8258ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754b7fe640 1 -- 172.21.15.33:0/152763849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a8249d900 con 0x555a821b1390 2024-08-28T19:46:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f7550981640 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a8258ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754bfff640 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82582a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f754b7fe640 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82582fd0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f75400e25c0 tx=0x7f75400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49169d54b30d097e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f752b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f752b7fe640 1 -- 172.21.15.33:0/152763849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540020070 con 0x555a821b1390 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f752b7fe640 1 -- 172.21.15.33:0/152763849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f75400e2790 con 0x555a821b1390 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f7558959740 1 -- 172.21.15.33:0/152763849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75400ab070 con 0x555a821b1390 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f752b7fe640 1 -- 172.21.15.33:0/152763849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f75400aaeb0 con 0x555a821b1390 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f7558959740 10 client.19473 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.431+0000 7f7558959740 1 -- 172.21.15.33:0/152763849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555a82591950 con 0x555a821b1390 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.432+0000 7f752b7fe640 1 -- 172.21.15.33:0/152763849 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75400ab070 con 0x555a821b1390 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.432+0000 7f752b7fe640 1 -- 172.21.15.33:0/152763849 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f75400ce0b0 con 0x555a821b1390 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.432+0000 7f7558959740 10 client.19473 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.432+0000 7f7558959740 10 client.19473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.432+0000 7f7558959740 20 client.19473 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.432+0000 7f7558959740 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555a821909f0 0x555a82594cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.432+0000 7f7558959740 4 client.19473 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.432+0000 7f7558959740 1 -- 172.21.15.33:0/152763849 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a824f05d0 con 0x555a821909f0 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.432+0000 7f754bfff640 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555a821909f0 0x555a82594cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.433+0000 7f754bfff640 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555a821909f0 0x555a82594cb0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7399b01d0fc523f server_cookie=2df69426f7177ab8 in_seq=0 out_seq=0 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.433+0000 7f752b7fe640 10 client.19473 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.433+0000 7f752b7fe640 1 -- 172.21.15.33:0/152763849 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a824f05d0 con 0x555a821909f0 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.433+0000 7f752b7fe640 10 client.19473 handle_command_reply: tid=0 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.433+0000 7f7558959740 1 client.19473 shutdown 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 1 -- 172.21.15.33:0/152763849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 msgr2=0x555a82582fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82582fd0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f75400e25c0 tx=0x7f75400046c0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 1 -- 172.21.15.33:0/152763849 shutdown_connections 2024-08-28T19:46:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a8258ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555a821909f0 0x555a82594cb0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821b1390 0x555a82582fd0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 1 --2- 172.21.15.33:0/152763849 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82582a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f752b7fe640 0 client.19473 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 1 -- 172.21.15.33:0/152763849 >> 172.21.15.33:0/152763849 conn(0x555a821c6460 msgr2=0x555a8257a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 1 -- 172.21.15.33:0/152763849 shutdown_connections 2024-08-28T19:46:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 1 -- 172.21.15.33:0/152763849 wait complete. 2024-08-28T19:46:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.434+0000 7f7558959740 20 client.19473 trim_cache size 0 max 16384 2024-08-28T19:46:58.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.447+0000 7f7558959740 1 Processor -- start 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.447+0000 7f7558959740 1 -- start start 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.447+0000 7f7558959740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82582f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.447+0000 7f7558959740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821b1390 0x555a8257a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.447+0000 7f7558959740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821d2070 0x555a8257a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.447+0000 7f7558959740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1b0c90 con 0x555a821d2070 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.447+0000 7f7558959740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1b27d0 con 0x555a821b1390 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.447+0000 7f7558959740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1b1360 con 0x555a821a91b0 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7550981640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821d2070 0x555a8257a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7550981640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821d2070 0x555a8257a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33126/0 (socket says 172.21.15.33:33126) 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7550981640 1 -- 172.21.15.33:0/3934593269 learned_addr learned my addr 172.21.15.33:0/3934593269 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f754bfff640 1 --2- 172.21.15.33:0/3934593269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82582f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f754b7fe640 1 --2- 172.21.15.33:0/3934593269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821b1390 0x555a8257a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7550981640 1 -- 172.21.15.33:0/3934593269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 msgr2=0x555a82582f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7550981640 1 --2- 172.21.15.33:0/3934593269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82582f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7550981640 1 -- 172.21.15.33:0/3934593269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821b1390 msgr2=0x555a8257a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7550981640 1 --2- 172.21.15.33:0/3934593269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821b1390 0x555a8257a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7550981640 1 -- 172.21.15.33:0/3934593269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a82575af0 con 0x555a821d2070 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7550981640 1 --2- 172.21.15.33:0/3934593269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821d2070 0x555a8257a950 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f7544031e60 tx=0x7f7544041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a160b9412537e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7531ffb640 1 -- 172.21.15.33:0/3934593269 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544003970 con 0x555a821d2070 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7531ffb640 1 -- 172.21.15.33:0/3934593269 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7544036050 con 0x555a821d2070 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.448+0000 7f7531ffb640 1 -- 172.21.15.33:0/3934593269 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75440047e0 con 0x555a821d2070 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.449+0000 7f7558959740 1 -- 172.21.15.33:0/3934593269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821d2070 msgr2=0x555a8257a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.449+0000 7f7558959740 1 --2- 172.21.15.33:0/3934593269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821d2070 0x555a8257a950 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f7544031e60 tx=0x7f7544041000 comp rx=0 tx=0).stop 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.449+0000 7f7558959740 1 -- 172.21.15.33:0/3934593269 shutdown_connections 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.449+0000 7f7558959740 1 --2- 172.21.15.33:0/3934593269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821d2070 0x555a8257a950 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.449+0000 7f7558959740 1 --2- 172.21.15.33:0/3934593269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821b1390 0x555a8257a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.449+0000 7f7558959740 1 --2- 172.21.15.33:0/3934593269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821a91b0 0x555a82582f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.449+0000 7f7558959740 1 -- 172.21.15.33:0/3934593269 >> 172.21.15.33:0/3934593269 conn(0x555a821c6460 msgr2=0x555a82582840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.449+0000 7f7558959740 1 -- 172.21.15.33:0/3934593269 shutdown_connections 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.449+0000 7f7558959740 1 -- 172.21.15.33:0/3934593269 wait complete. 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.449+0000 7f7558959740 1 -- start start 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f7558959740 1 Processor -- start 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f7558959740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821a91b0 0x555a825984a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f7558959740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821b1390 0x555a825959c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f7558959740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a82595f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f7558959740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1b2100 con 0x555a821a91b0 2024-08-28T19:46:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f7558959740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1b1a30 con 0x555a821d2070 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f7558959740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1aec90 con 0x555a821b1390 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f7558959740 10 client.0 _ll_register_callbacks cb 0x7f75400ed300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f754bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821a91b0 0x555a825984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f754bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821a91b0 0x555a825984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33132/0 (socket says 172.21.15.33:33132) 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f754bfff640 1 -- 172.21.15.33:0/3739564025 learned_addr learned my addr 172.21.15.33:0/3739564025 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f754b7fe640 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821b1390 0x555a825959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.450+0000 7f7550981640 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a82595f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f754bfff640 1 -- 172.21.15.33:0/3739564025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821b1390 msgr2=0x555a825959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f754bfff640 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821b1390 0x555a825959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f754bfff640 1 -- 172.21.15.33:0/3739564025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 msgr2=0x555a82595f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f754bfff640 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a82595f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f754bfff640 1 -- 172.21.15.33:0/3739564025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a82596670 con 0x555a821a91b0 2024-08-28T19:46:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f754bfff640 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821a91b0 0x555a825984a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f753c000c00 tx=0x7f753c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd00f47e1f89dc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:46:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f752b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:46:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f752b7fe640 1 -- 172.21.15.33:0/3739564025 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c025020 con 0x555a821a91b0 2024-08-28T19:46:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f752b7fe640 1 -- 172.21.15.33:0/3739564025 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f753c00ed10 con 0x555a821a91b0 2024-08-28T19:46:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f7558959740 1 -- 172.21.15.33:0/3739564025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7544036050 con 0x555a821a91b0 2024-08-28T19:46:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f752b7fe640 1 -- 172.21.15.33:0/3739564025 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f753c02d050 con 0x555a821a91b0 2024-08-28T19:46:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f7558959740 10 client.19479 fetch_fsmap learned FSMap version 28 2024-08-28T19:46:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f7558959740 1 -- 172.21.15.33:0/3739564025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555a825ff3e0 con 0x555a821a91b0 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f752b7fe640 1 -- 172.21.15.33:0/3739564025 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7544036050 con 0x555a821a91b0 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.451+0000 7f752b7fe640 1 -- 172.21.15.33:0/3739564025 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f753c00b040 con 0x555a821a91b0 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f7558959740 10 client.19479 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f7558959740 10 client.19479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f7558959740 20 client.19479 populate_metadata read hostname 'smithi033' 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f7558959740 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555a82165da0 0x555a82601c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f7558959740 4 client.19479 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f7558959740 1 -- 172.21.15.33:0/3739564025 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a824ec070 con 0x555a82165da0 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f754b7fe640 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555a82165da0 0x555a82601c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f754b7fe640 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555a82165da0 0x555a82601c20 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=618f9cc230bc4265 server_cookie=2ce1599e4a007301 in_seq=0 out_seq=0 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f752b7fe640 10 client.19479 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f752b7fe640 1 -- 172.21.15.33:0/3739564025 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a824ec070 con 0x555a82165da0 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.452+0000 7f752b7fe640 10 client.19479 handle_command_reply: tid=0 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 client.19479 shutdown 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 -- 172.21.15.33:0/3739564025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821a91b0 msgr2=0x555a825984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821a91b0 0x555a825984a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f753c000c00 tx=0x7f753c00fc30 comp rx=0 tx=0).stop 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 -- 172.21.15.33:0/3739564025 shutdown_connections 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a821d2070 0x555a82595f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555a821b1390 0x555a825959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x555a82165da0 0x555a82601c20 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 --2- 172.21.15.33:0/3739564025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a821a91b0 0x555a825984a0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 -- 172.21.15.33:0/3739564025 >> 172.21.15.33:0/3739564025 conn(0x555a821c6460 msgr2=0x555a82578280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f752b7fe640 0 client.19479 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 -- 172.21.15.33:0/3739564025 shutdown_connections 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 1 -- 172.21.15.33:0/3739564025 wait complete. 2024-08-28T19:46:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f7558959740 20 client.19479 trim_cache size 0 max 16384 2024-08-28T19:46:58.460 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:46:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.453+0000 7f75523e4640 1 -- 172.21.15.33:0/2074348505 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f75340b4d20 msgr2=0x7f75340b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f75340b4d20 0x7f75340b7230 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7544006010 tx=0x7f7544009480 comp rx=0 tx=0).stop 2024-08-28T19:46:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 -- 172.21.15.33:0/2074348505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f754c107970 msgr2=0x7f754c19a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:46:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f754c107970 0x7f754c19a870 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f754000d750 tx=0x7f754000dc10 comp rx=0 tx=0).stop 2024-08-28T19:46:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 -- 172.21.15.33:0/2074348505 shutdown_connections 2024-08-28T19:46:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f75340b4d20 0x7f75340b7230 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c1082c0 0x7f754c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f754c107970 0x7f754c19a870 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 --2- 172.21.15.33:0/2074348505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754c102030 0x7f754c19a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:46:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 -- 172.21.15.33:0/2074348505 >> 172.21.15.33:0/2074348505 conn(0x7f754c079c40 msgr2=0x7f754c105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:46:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 -- 172.21.15.33:0/2074348505 shutdown_connections 2024-08-28T19:46:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:46:58.454+0000 7f75523e4640 1 -- 172.21.15.33:0/2074348505 wait complete. 2024-08-28T19:46:59.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:46:59 smithi033 ceph-mon[18549]: pgmap v794: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 66 KiB/s wr, 16 op/s 2024-08-28T19:47:00.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:46:59 smithi059 ceph-mon[22052]: pgmap v794: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 66 KiB/s wr, 16 op/s 2024-08-28T19:47:00.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:46:59 smithi122 ceph-mon[22174]: pgmap v794: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 66 KiB/s wr, 16 op/s 2024-08-28T19:47:00.174 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:47:00.174 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:47:00.450 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.960+0000 7f30a8308640 1 -- 172.21.15.33:0/737309159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a0103900 msgr2=0x7f30a0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.960+0000 7f30a8308640 1 --2- 172.21.15.33:0/737309159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a0103900 0x7f30a0103d10 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f309c009900 tx=0x7f309c02a410 comp rx=0 tx=0).stop 2024-08-28T19:47:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.960+0000 7f30a8308640 1 -- 172.21.15.33:0/737309159 shutdown_connections 2024-08-28T19:47:00.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.960+0000 7f30a8308640 1 --2- 172.21.15.33:0/737309159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a0109b90 0x7f30a01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.960+0000 7f30a8308640 1 --2- 172.21.15.33:0/737309159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a0109240 0x7f30a0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.960+0000 7f30a8308640 1 --2- 172.21.15.33:0/737309159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a0103900 0x7f30a0103d10 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.960+0000 7f30a8308640 1 -- 172.21.15.33:0/737309159 >> 172.21.15.33:0/737309159 conn(0x7f30a007b5f0 msgr2=0x7f30a007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.960+0000 7f30a8308640 1 -- 172.21.15.33:0/737309159 shutdown_connections 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.960+0000 7f30a8308640 1 -- 172.21.15.33:0/737309159 wait complete. 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.960+0000 7f30a8308640 1 Processor -- start 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a8308640 1 -- start start 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a8308640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a0103900 0x7f30a019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a8308640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a0109240 0x7f30a019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a8308640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a0109b90 0x7f30a019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a8308640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01138b0 con 0x7f30a0103900 2024-08-28T19:47:00.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a8308640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30a0113730 con 0x7f30a0109240 2024-08-28T19:47:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a8308640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f30a0113a30 con 0x7f30a0109b90 2024-08-28T19:47:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a60a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a0103900 0x7f30a019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a60a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a0103900 0x7f30a019a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33152/0 (socket says 172.21.15.33:33152) 2024-08-28T19:47:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a60a4640 1 -- 172.21.15.33:0/236034338 learned_addr learned my addr 172.21.15.33:0/236034338 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a68a5640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a0109b90 0x7f30a019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a58a3640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a0109240 0x7f30a019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a60a4640 1 -- 172.21.15.33:0/236034338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a0109b90 msgr2=0x7f30a019fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a60a4640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a0109b90 0x7f30a019fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a60a4640 1 -- 172.21.15.33:0/236034338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a0109240 msgr2=0x7f30a019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a60a4640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a0109240 0x7f30a019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a60a4640 1 -- 172.21.15.33:0/236034338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a01a0150 con 0x7f30a0103900 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a68a5640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a0109b90 0x7f30a019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.961+0000 7f30a60a4640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a0103900 0x7f30a019a2a0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f309c006010 tx=0x7f309c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.962+0000 7f30977fe640 1 -- 172.21.15.33:0/236034338 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c03f030 con 0x7f30a0103900 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.962+0000 7f30a8308640 1 -- 172.21.15.33:0/236034338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a01a03e0 con 0x7f30a0103900 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.962+0000 7f30977fe640 1 -- 172.21.15.33:0/236034338 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f309c003800 con 0x7f30a0103900 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.962+0000 7f30977fe640 1 -- 172.21.15.33:0/236034338 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c035070 con 0x7f30a0103900 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.962+0000 7f30a8308640 1 -- 172.21.15.33:0/236034338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a01a6c60 con 0x7f30a0103900 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.964+0000 7f30ae87d740 1 Processor -- start 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.964+0000 7f30ae87d740 1 -- start start 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.964+0000 7f30977fe640 1 -- 172.21.15.33:0/236034338 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f309c003cb0 con 0x7f30a0103900 2024-08-28T19:47:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 0x562eac8d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8d3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30ae87d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562eac8485f0 con 0x562eac503490 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30ae87d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562eac837b80 con 0x562eac50b670 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30ae87d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562eac83bb30 con 0x562eac52c350 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a60a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a60a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8d2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33162/0 (socket says 172.21.15.33:33162) 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a60a4640 1 -- 172.21.15.33:0/2534282208 learned_addr learned my addr 172.21.15.33:0/2534282208 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a68a5640 1 --2- 172.21.15.33:0/2534282208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 0x562eac8d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a58a3640 1 --2- 172.21.15.33:0/2534282208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8d3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30977fe640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f308c0b4cd0 0x7f308c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a60a4640 1 -- 172.21.15.33:0/2534282208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 msgr2=0x562eac8d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a60a4640 1 --2- 172.21.15.33:0/2534282208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 0x562eac8d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a60a4640 1 -- 172.21.15.33:0/2534282208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 msgr2=0x562eac8d3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a60a4640 1 --2- 172.21.15.33:0/2534282208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8d3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a60a4640 1 -- 172.21.15.33:0/2534282208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eac597930 con 0x562eac503490 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.965+0000 7f30a68a5640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f308c0b4cd0 0x7f308c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.966+0000 7f30977fe640 1 -- 172.21.15.33:0/236034338 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f309c106370 con 0x7f30a0103900 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.966+0000 7f30a60a4640 1 --2- 172.21.15.33:0/2534282208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8d2cc0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f309c103690 tx=0x7f309c0988c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc6615feb2ea0ab server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.966+0000 7f3094d9a640 1 -- 172.21.15.33:0/2534282208 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c049070 con 0x562eac503490 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.966+0000 7f3094d9a640 1 -- 172.21.15.33:0/2534282208 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f309c0d5330 con 0x562eac503490 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.966+0000 7f3094d9a640 1 -- 172.21.15.33:0/2534282208 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c0e35c0 con 0x562eac503490 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.966+0000 7f30a68a5640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f308c0b4cd0 0x7f308c0b71e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f309800a5a0 tx=0x7f309800e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 -- 172.21.15.33:0/2534282208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 msgr2=0x562eac8d2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 --2- 172.21.15.33:0/2534282208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8d2cc0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f309c103690 tx=0x7f309c0988c0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 -- 172.21.15.33:0/2534282208 shutdown_connections 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 --2- 172.21.15.33:0/2534282208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8d3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 --2- 172.21.15.33:0/2534282208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8d2cc0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 --2- 172.21.15.33:0/2534282208 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 0x562eac8d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 -- 172.21.15.33:0/2534282208 >> 172.21.15.33:0/2534282208 conn(0x562eac520740 msgr2=0x562eac8d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 -- 172.21.15.33:0/2534282208 shutdown_connections 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 -- 172.21.15.33:0/2534282208 wait complete. 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 -- start start 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.967+0000 7f30ae87d740 1 Processor -- start 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac503490 0x562eac8e23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8e28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac52c350 0x562eac8ee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30ae87d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x562eac69a890 con 0x562eac52c350 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30ae87d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562eac7be790 con 0x562eac50b670 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30ae87d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x562eac8e5080 con 0x562eac503490 2024-08-28T19:47:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30ae87d740 10 client.0 _ll_register_callbacks cb 0x562eac543ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a68a5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac52c350 0x562eac8ee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a68a5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac52c350 0x562eac8ee2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33174/0 (socket says 172.21.15.33:33174) 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a68a5640 1 -- 172.21.15.33:0/2535471040 learned_addr learned my addr 172.21.15.33:0/2535471040 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a60a4640 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac503490 0x562eac8e23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a58a3640 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8e28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a68a5640 1 -- 172.21.15.33:0/2535471040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac503490 msgr2=0x562eac8e23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a68a5640 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac503490 0x562eac8e23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a68a5640 1 -- 172.21.15.33:0/2535471040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 msgr2=0x562eac8e28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a68a5640 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8e28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a68a5640 1 -- 172.21.15.33:0/2535471040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eac7f5f30 con 0x562eac52c350 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f30a68a5640 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac52c350 0x562eac8ee2a0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f3098018ac0 tx=0x7f3098009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e0d75f8b367600 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:00.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.968+0000 7f3089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f3089ffb640 1 -- 172.21.15.33:0/2535471040 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098007950 con 0x562eac52c350 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f30ae87d740 1 -- 172.21.15.33:0/2535471040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f309c0d5330 con 0x562eac52c350 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f3089ffb640 1 -- 172.21.15.33:0/2535471040 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f3098007af0 con 0x562eac52c350 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f3089ffb640 1 -- 172.21.15.33:0/2535471040 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f309802e050 con 0x562eac52c350 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f30ae87d740 10 client.19491 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f30ae87d740 1 -- 172.21.15.33:0/2535471040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562eac8f0e10 con 0x562eac52c350 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f3089ffb640 1 -- 172.21.15.33:0/2535471040 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f309c0d5330 con 0x562eac52c350 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f3089ffb640 1 -- 172.21.15.33:0/2535471040 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f30980233f0 con 0x562eac52c350 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f30ae87d740 10 client.19491 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f30ae87d740 10 client.19491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f30ae87d740 20 client.19491 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:00.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f30ae87d740 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562eac4eacd0 0x562eac8f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f30ae87d740 4 client.19491 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.969+0000 7f30ae87d740 1 -- 172.21.15.33:0/2535471040 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562eac84a540 con 0x562eac4eacd0 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.970+0000 7f30a60a4640 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562eac4eacd0 0x562eac8f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.970+0000 7f30a60a4640 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562eac4eacd0 0x562eac8f42d0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c37d9c4b494ce7b1 server_cookie=c5ce35c13320a82d in_seq=0 out_seq=0 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.970+0000 7f3089ffb640 10 client.19491 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f3089ffb640 1 -- 172.21.15.33:0/2535471040 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562eac84a540 con 0x562eac4eacd0 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f3089ffb640 10 client.19491 handle_command_reply: tid=0 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 client.19491 shutdown 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 -- 172.21.15.33:0/2535471040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac52c350 msgr2=0x562eac8ee2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac52c350 0x562eac8ee2a0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f3098018ac0 tx=0x7f3098009850 comp rx=0 tx=0).stop 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 -- 172.21.15.33:0/2535471040 shutdown_connections 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562eac4eacd0 0x562eac8f42d0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac52c350 0x562eac8ee2a0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8e28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 --2- 172.21.15.33:0/2535471040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac503490 0x562eac8e23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 -- 172.21.15.33:0/2535471040 >> 172.21.15.33:0/2535471040 conn(0x562eac520740 msgr2=0x562eac8d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:00.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f3089ffb640 0 client.19491 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:00.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 -- 172.21.15.33:0/2535471040 shutdown_connections 2024-08-28T19:47:00.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 1 -- 172.21.15.33:0/2535471040 wait complete. 2024-08-28T19:47:00.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.971+0000 7f30ae87d740 20 client.19491 trim_cache size 0 max 16384 2024-08-28T19:47:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30ae87d740 1 Processor -- start 2024-08-28T19:47:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30ae87d740 1 -- start start 2024-08-28T19:47:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac503490 0x562eac8ddb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac50b670 0x562eac8e3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac52c350 0x562eac8ee1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30ae87d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01aeaf0 con 0x562eac50b670 2024-08-28T19:47:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30ae87d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01b0630 con 0x562eac52c350 2024-08-28T19:47:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30ae87d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01af1c0 con 0x562eac503490 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30a58a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac50b670 0x562eac8e3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30a58a3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac50b670 0x562eac8e3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33184/0 (socket says 172.21.15.33:33184) 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.989+0000 7f30a58a3640 1 -- 172.21.15.33:0/1206336159 learned_addr learned my addr 172.21.15.33:0/1206336159 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f30a68a5640 1 --2- 172.21.15.33:0/1206336159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac52c350 0x562eac8ee1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f30a60a4640 1 --2- 172.21.15.33:0/1206336159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac503490 0x562eac8ddb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f30a58a3640 1 -- 172.21.15.33:0/1206336159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac503490 msgr2=0x562eac8ddb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f30a58a3640 1 --2- 172.21.15.33:0/1206336159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac503490 0x562eac8ddb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f30a58a3640 1 -- 172.21.15.33:0/1206336159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac52c350 msgr2=0x562eac8ee1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f30a58a3640 1 --2- 172.21.15.33:0/1206336159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac52c350 0x562eac8ee1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f30a58a3640 1 -- 172.21.15.33:0/1206336159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eac8d55b0 con 0x562eac50b670 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f30a68a5640 1 --2- 172.21.15.33:0/1206336159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac52c350 0x562eac8ee1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f30a58a3640 1 --2- 172.21.15.33:0/1206336159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac50b670 0x562eac8e3fd0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f309000c730 tx=0x7f309000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c853ef26dbaa881 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f308bfff640 1 -- 172.21.15.33:0/1206336159 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309000ce40 con 0x562eac50b670 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f308bfff640 1 -- 172.21.15.33:0/1206336159 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3090003ce0 con 0x562eac50b670 2024-08-28T19:47:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.990+0000 7f308bfff640 1 -- 172.21.15.33:0/1206336159 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309001a730 con 0x562eac50b670 2024-08-28T19:47:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 -- 172.21.15.33:0/1206336159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac50b670 msgr2=0x562eac8e3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 --2- 172.21.15.33:0/1206336159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac50b670 0x562eac8e3fd0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f309000c730 tx=0x7f309000cbf0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 -- 172.21.15.33:0/1206336159 shutdown_connections 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 --2- 172.21.15.33:0/1206336159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac52c350 0x562eac8ee1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 --2- 172.21.15.33:0/1206336159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac50b670 0x562eac8e3fd0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 --2- 172.21.15.33:0/1206336159 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac503490 0x562eac8ddb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 -- 172.21.15.33:0/1206336159 >> 172.21.15.33:0/1206336159 conn(0x562eac520740 msgr2=0x562eac8e38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 -- 172.21.15.33:0/1206336159 shutdown_connections 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 -- 172.21.15.33:0/1206336159 wait complete. 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 -- start start 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.991+0000 7f30ae87d740 1 Processor -- start 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8e6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30ae87d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 0x562eac957d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30ae87d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01aff60 con 0x562eac503490 2024-08-28T19:47:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30ae87d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01af890 con 0x562eac50b670 2024-08-28T19:47:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30ae87d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01acaf0 con 0x562eac52c350 2024-08-28T19:47:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30ae87d740 10 client.0 _ll_register_callbacks cb 0x7f3098009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a60a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8e6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a60a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8e6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33196/0 (socket says 172.21.15.33:33196) 2024-08-28T19:47:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a60a4640 1 -- 172.21.15.33:0/3356692828 learned_addr learned my addr 172.21.15.33:0/3356692828 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a58a3640 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a68a5640 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 0x562eac957d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a60a4640 1 -- 172.21.15.33:0/3356692828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 msgr2=0x562eac957d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a60a4640 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 0x562eac957d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a60a4640 1 -- 172.21.15.33:0/3356692828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 msgr2=0x562eac8e71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a60a4640 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8e71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a60a4640 1 -- 172.21.15.33:0/3356692828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eac958390 con 0x562eac503490 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a68a5640 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 0x562eac957d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f30a60a4640 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8e6c50 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f309c103d20 tx=0x7f309c0cc590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ec30b4133484f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.992+0000 7f3089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f3089ffb640 1 -- 172.21.15.33:0/3356692828 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c049040 con 0x562eac503490 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f3089ffb640 1 -- 172.21.15.33:0/3356692828 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7f309c1039a0 con 0x562eac503490 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f30ae87d740 1 -- 172.21.15.33:0/3356692828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3090003ce0 con 0x562eac503490 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f3089ffb640 1 -- 172.21.15.33:0/3356692828 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f309c0cc010 con 0x562eac503490 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f30ae87d740 10 client.19497 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f30ae87d740 1 -- 172.21.15.33:0/3356692828 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562eac95f7c0 con 0x562eac503490 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f3089ffb640 1 -- 172.21.15.33:0/3356692828 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3090003ce0 con 0x562eac503490 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f3089ffb640 1 -- 172.21.15.33:0/3356692828 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f309c0c8950 con 0x562eac503490 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f30ae87d740 10 client.19497 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f30ae87d740 10 client.19497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f30ae87d740 20 client.19497 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f30ae87d740 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562eac4c0080 0x562eac961b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f30ae87d740 4 client.19497 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.993+0000 7f30ae87d740 1 -- 172.21.15.33:0/3356692828 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562eac845fe0 con 0x562eac4c0080 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.994+0000 7f30a58a3640 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562eac4c0080 0x562eac961b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.994+0000 7f3089ffb640 10 client.19497 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.994+0000 7f30a58a3640 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562eac4c0080 0x562eac961b20 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93a4c8970049a3a3 server_cookie=bded1d133c6e3225 in_seq=0 out_seq=0 2024-08-28T19:47:01.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.996+0000 7f3089ffb640 1 -- 172.21.15.33:0/3356692828 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562eac845fe0 con 0x562eac4c0080 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.996+0000 7f3089ffb640 10 client.19497 handle_command_reply: tid=0 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.996+0000 7f30ae87d740 1 client.19497 shutdown 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 1 -- 172.21.15.33:0/3356692828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 msgr2=0x562eac8e6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8e6c50 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f309c103d20 tx=0x7f309c0cc590 comp rx=0 tx=0).stop 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 1 -- 172.21.15.33:0/3356692828 shutdown_connections 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x562eac52c350 0x562eac957d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eac50b670 0x562eac8e71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x562eac4c0080 0x562eac961b20 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 1 --2- 172.21.15.33:0/3356692828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562eac503490 0x562eac8e6c50 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 1 -- 172.21.15.33:0/3356692828 >> 172.21.15.33:0/3356692828 conn(0x562eac520740 msgr2=0x562eac8e3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f3089ffb640 0 client.19497 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 1 -- 172.21.15.33:0/3356692828 shutdown_connections 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 1 -- 172.21.15.33:0/3356692828 wait complete. 2024-08-28T19:47:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.997+0000 7f30ae87d740 20 client.19497 trim_cache size 0 max 16384 2024-08-28T19:47:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:47:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:47:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "7bc9ceff-c40a-4b60-a12f-cc9f203af1aa", 2024-08-28T19:47:01.002 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:47:01.002 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 -- 172.21.15.33:0/236034338 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f308c0b4cd0 msgr2=0x7f308c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f308c0b4cd0 0x7f308c0b71e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f309800a5a0 tx=0x7f309800e040 comp rx=0 tx=0).stop 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 -- 172.21.15.33:0/236034338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a0103900 msgr2=0x7f30a019a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a0103900 0x7f30a019a2a0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f309c006010 tx=0x7f309c0042f0 comp rx=0 tx=0).stop 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 -- 172.21.15.33:0/236034338 shutdown_connections 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f308c0b4cd0 0x7f308c0b71e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f30a0109b90 0x7f30a019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a0109240 0x7f30a019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 --2- 172.21.15.33:0/236034338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a0103900 0x7f30a019a2a0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 -- 172.21.15.33:0/236034338 >> 172.21.15.33:0/236034338 conn(0x7f30a007b5f0 msgr2=0x7f30a01072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 -- 172.21.15.33:0/236034338 shutdown_connections 2024-08-28T19:47:01.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:00.998+0000 7f30a8308640 1 -- 172.21.15.33:0/236034338 wait complete. 2024-08-28T19:47:01.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:01 smithi033 ceph-mon[18549]: pgmap v795: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 71 KiB/s wr, 15 op/s 2024-08-28T19:47:01.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:01 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:47:01.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:01 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:01.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:01 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:47:01.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:01 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:01.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:47:02.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:01 smithi059 ceph-mon[22052]: pgmap v795: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 71 KiB/s wr, 15 op/s 2024-08-28T19:47:02.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:01 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:47:02.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:01 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:02.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:01 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:47:02.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:01 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:02.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:01 smithi122 ceph-mon[22174]: pgmap v795: 129 pgs: 129 active+clean; 25 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 71 KiB/s wr, 15 op/s 2024-08-28T19:47:02.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:01 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:47:02.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:01 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:02.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:01 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:47:02.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:01 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:02.171 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:02.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.694+0000 7effac2a7640 1 -- 172.21.15.33:0/1447562621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa4108180 msgr2=0x7effa4108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:02.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.694+0000 7effac2a7640 1 --2- 172.21.15.33:0/1447562621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa4108180 0x7effa4108590 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7eff94009900 tx=0x7eff9402a410 comp rx=0 tx=0).stop 2024-08-28T19:47:02.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.694+0000 7effac2a7640 1 -- 172.21.15.33:0/1447562621 shutdown_connections 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.694+0000 7effac2a7640 1 --2- 172.21.15.33:0/1447562621 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa4108ad0 0x7effa410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.694+0000 7effac2a7640 1 --2- 172.21.15.33:0/1447562621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa4108180 0x7effa4108590 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.694+0000 7effac2a7640 1 --2- 172.21.15.33:0/1447562621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa4102840 0x7effa4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.694+0000 7effac2a7640 1 -- 172.21.15.33:0/1447562621 >> 172.21.15.33:0/1447562621 conn(0x7effa40794f0 msgr2=0x7effa4079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.694+0000 7effac2a7640 1 -- 172.21.15.33:0/1447562621 shutdown_connections 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.694+0000 7effac2a7640 1 -- 172.21.15.33:0/1447562621 wait complete. 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effac2a7640 1 Processor -- start 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effac2a7640 1 -- start start 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effac2a7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa4102840 0x7effa419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effac2a7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa4108180 0x7effa419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effac2a7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa4108ad0 0x7effa419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effac2a7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7effa4113900 con 0x7effa4108ad0 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effac2a7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7effa4113780 con 0x7effa4102840 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effac2a7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7effa4113a80 con 0x7effa4108180 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effaa844640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa4108ad0 0x7effa419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effaa844640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa4108ad0 0x7effa419fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33200/0 (socket says 172.21.15.33:33200) 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effaa844640 1 -- 172.21.15.33:0/2800559072 learned_addr learned my addr 172.21.15.33:0/2800559072 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.695+0000 7effaa043640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa4102840 0x7effa419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7effa9842640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa4108180 0x7effa419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7effaa844640 1 -- 172.21.15.33:0/2800559072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa4108180 msgr2=0x7effa419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7effaa844640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa4108180 0x7effa419a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7effaa844640 1 -- 172.21.15.33:0/2800559072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa4102840 msgr2=0x7effa419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7effaa844640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa4102840 0x7effa419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7effaa844640 1 -- 172.21.15.33:0/2800559072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa41a02a0 con 0x7effa4108ad0 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7effaa844640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa4108ad0 0x7effa419fb70 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00b970 tx=0x7eff9c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:02.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7eff9b7fe640 1 -- 172.21.15.33:0/2800559072 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c019070 con 0x7effa4108ad0 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7eff9b7fe640 1 -- 172.21.15.33:0/2800559072 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff9c014440 con 0x7effa4108ad0 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7eff9b7fe640 1 -- 172.21.15.33:0/2800559072 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0075d0 con 0x7effa4108ad0 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7effac2a7640 1 -- 172.21.15.33:0/2800559072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa41a0590 con 0x7effa4108ad0 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.696+0000 7effac2a7640 1 -- 172.21.15.33:0/2800559072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa41a6cf0 con 0x7effa4108ad0 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.699+0000 7effb281c740 1 Processor -- start 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.699+0000 7eff9b7fe640 1 -- 172.21.15.33:0/2800559072 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7eff9c01c070 con 0x7effa4108ad0 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.699+0000 7effb281c740 1 -- start start 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.699+0000 7effb281c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3da02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.699+0000 7effb281c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 0x55a0a3da0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.699+0000 7effb281c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3da0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.699+0000 7effb281c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a0a3d17630 con 0x55a0a39da390 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.699+0000 7effb281c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a0a3d06bc0 con 0x55a0a39fb070 2024-08-28T19:47:02.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effb281c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a0a3d0ab70 con 0x55a0a39d21b0 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effa9842640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3da0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effa9842640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3da0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33212/0 (socket says 172.21.15.33:33212) 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effa9842640 1 -- 172.21.15.33:0/3369852122 learned_addr learned my addr 172.21.15.33:0/3369852122 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effa9842640 1 --2- 172.21.15.33:0/3369852122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3da02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effaa043640 1 --2- 172.21.15.33:0/3369852122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 0x55a0a3da0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7eff9b7fe640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff900b4d20 0x7eff900b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effa9842640 1 -- 172.21.15.33:0/3369852122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 msgr2=0x55a0a3da0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effaa844640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff900b4d20 0x7eff900b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effa9842640 1 --2- 172.21.15.33:0/3369852122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 0x55a0a3da0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effa9842640 1 -- 172.21.15.33:0/3369852122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 msgr2=0x55a0a3da02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effa9842640 1 --2- 172.21.15.33:0/3369852122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3da02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effa9842640 1 -- 172.21.15.33:0/3369852122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0a3a66650 con 0x55a0a39da390 2024-08-28T19:47:02.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7eff9b7fe640 1 -- 172.21.15.33:0/2800559072 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7eff9c0e4d90 con 0x7effa4108ad0 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.700+0000 7effa9842640 1 --2- 172.21.15.33:0/3369852122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3da0d40 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7eff94005f70 tx=0x7eff94005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d6db8bd8762ca0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.701+0000 7eff98d9a640 1 -- 172.21.15.33:0/3369852122 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94035030 con 0x55a0a39da390 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.701+0000 7eff98d9a640 1 -- 172.21.15.33:0/3369852122 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff9403d450 con 0x55a0a39da390 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.701+0000 7eff98d9a640 1 -- 172.21.15.33:0/3369852122 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9403c6a0 con 0x55a0a39da390 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.701+0000 7effaa844640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff900b4d20 0x7eff900b7230 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0aae30 tx=0x7eff9c092040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.701+0000 7effb281c740 1 -- 172.21.15.33:0/3369852122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 msgr2=0x55a0a3da0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.701+0000 7effb281c740 1 --2- 172.21.15.33:0/3369852122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3da0d40 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7eff94005f70 tx=0x7eff94005780 comp rx=0 tx=0).stop 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.702+0000 7effb281c740 1 -- 172.21.15.33:0/3369852122 shutdown_connections 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.702+0000 7effb281c740 1 --2- 172.21.15.33:0/3369852122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3da0d40 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.702+0000 7effb281c740 1 --2- 172.21.15.33:0/3369852122 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 0x55a0a3da0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.702+0000 7effb281c740 1 --2- 172.21.15.33:0/3369852122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3da02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.702+0000 7effb281c740 1 -- 172.21.15.33:0/3369852122 >> 172.21.15.33:0/3369852122 conn(0x55a0a39ef460 msgr2=0x55a0a3d9e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.702+0000 7effb281c740 1 -- 172.21.15.33:0/3369852122 shutdown_connections 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.702+0000 7effb281c740 1 -- 172.21.15.33:0/3369852122 wait complete. 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.702+0000 7effb281c740 1 -- start start 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.702+0000 7effb281c740 1 Processor -- start 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effb281c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3dafe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effb281c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39da390 0x55a0a3db0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effb281c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3dbc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effb281c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a0a3b69700 con 0x55a0a39d21b0 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effb281c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a0a3c8d700 con 0x55a0a39fb070 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effb281c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a0a3db2da0 con 0x55a0a39da390 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effa9842640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3dafe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effb281c740 10 client.0 _ll_register_callbacks cb 0x55a0a3cbcdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effa9842640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3dafe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33226/0 (socket says 172.21.15.33:33226) 2024-08-28T19:47:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effa9842640 1 -- 172.21.15.33:0/56581525 learned_addr learned my addr 172.21.15.33:0/56581525 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effaa043640 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39da390 0x55a0a3db0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effa9842640 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3dbc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effa9842640 1 -- 172.21.15.33:0/56581525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39da390 msgr2=0x55a0a3db0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effa9842640 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39da390 0x55a0a3db0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effa9842640 1 -- 172.21.15.33:0/56581525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 msgr2=0x55a0a3dbc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effa9842640 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3dbc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effa9842640 1 -- 172.21.15.33:0/56581525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0a3cc68b0 con 0x55a0a39d21b0 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7effa9842640 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3dafe40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7eff940096c0 tx=0x7eff9403dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65436adc452d27b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.703+0000 7eff8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7eff8dffb640 1 -- 172.21.15.33:0/56581525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94052060 con 0x55a0a39d21b0 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7eff8dffb640 1 -- 172.21.15.33:0/56581525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7eff94005050 con 0x55a0a39d21b0 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7effb281c740 1 -- 172.21.15.33:0/56581525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff9403d450 con 0x55a0a39d21b0 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7eff8dffb640 1 -- 172.21.15.33:0/56581525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff94059050 con 0x55a0a39d21b0 2024-08-28T19:47:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7effb281c740 10 client.19509 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7effb281c740 1 -- 172.21.15.33:0/56581525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a0a3dbeb70 con 0x55a0a39d21b0 2024-08-28T19:47:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7eff8dffb640 1 -- 172.21.15.33:0/56581525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff9403d450 con 0x55a0a39d21b0 2024-08-28T19:47:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7eff8dffb640 1 -- 172.21.15.33:0/56581525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7eff94003ca0 con 0x55a0a39d21b0 2024-08-28T19:47:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7effb281c740 10 client.19509 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7effb281c740 10 client.19509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7effb281c740 20 client.19509 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7effb281c740 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0a39b99f0 0x55a0a3dc1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7effb281c740 4 client.19509 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.704+0000 7effb281c740 1 -- 172.21.15.33:0/56581525 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0a3d19580 con 0x55a0a39b99f0 2024-08-28T19:47:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.705+0000 7effaa043640 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0a39b99f0 0x55a0a3dc1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.705+0000 7effaa043640 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0a39b99f0 0x55a0a3dc1ed0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1fb90cb4dd31325 server_cookie=f8d8522ea0999ffa in_seq=0 out_seq=0 2024-08-28T19:47:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.705+0000 7eff8dffb640 10 client.19509 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7eff8dffb640 1 -- 172.21.15.33:0/56581525 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0a3d19580 con 0x55a0a39b99f0 2024-08-28T19:47:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7eff8dffb640 10 client.19509 handle_command_reply: tid=0 2024-08-28T19:47:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 client.19509 shutdown 2024-08-28T19:47:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 -- 172.21.15.33:0/56581525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 msgr2=0x55a0a3dafe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3dafe40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7eff940096c0 tx=0x7eff9403dce0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 -- 172.21.15.33:0/56581525 shutdown_connections 2024-08-28T19:47:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3dbc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39da390 0x55a0a3db0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0a39b99f0 0x55a0a3dc1ed0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 --2- 172.21.15.33:0/56581525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3dafe40 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7eff8dffb640 0 client.19509 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 -- 172.21.15.33:0/56581525 >> 172.21.15.33:0/56581525 conn(0x55a0a39ef460 msgr2=0x55a0a3d9c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 -- 172.21.15.33:0/56581525 shutdown_connections 2024-08-28T19:47:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 1 -- 172.21.15.33:0/56581525 wait complete. 2024-08-28T19:47:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.706+0000 7effb281c740 20 client.19509 trim_cache size 0 max 16384 2024-08-28T19:47:02.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effb281c740 1 Processor -- start 2024-08-28T19:47:02.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effb281c740 1 -- start start 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effb281c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3db1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effb281c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39da390 0x55a0a3dad030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effb281c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39fb070 0x55a0a3dad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effb281c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7effa41aea20 con 0x55a0a39d21b0 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effb281c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7effa41b0560 con 0x55a0a39da390 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effb281c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7effa41af0f0 con 0x55a0a39fb070 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effa9842640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3db1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effa9842640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3db1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33240/0 (socket says 172.21.15.33:33240) 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effa9842640 1 -- 172.21.15.33:0/3971635332 learned_addr learned my addr 172.21.15.33:0/3971635332 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effaa043640 1 --2- 172.21.15.33:0/3971635332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39da390 0x55a0a3dad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.724+0000 7effa9842640 1 -- 172.21.15.33:0/3971635332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39fb070 msgr2=0x55a0a3dad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.725+0000 7effa9842640 1 --2- 172.21.15.33:0/3971635332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39fb070 0x55a0a3dad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.725+0000 7effa9842640 1 -- 172.21.15.33:0/3971635332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39da390 msgr2=0x55a0a3dad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.725+0000 7effa9842640 1 --2- 172.21.15.33:0/3971635332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39da390 0x55a0a3dad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.725+0000 7effa9842640 1 -- 172.21.15.33:0/3971635332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0a3da3190 con 0x55a0a39d21b0 2024-08-28T19:47:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.725+0000 7effaa043640 1 --2- 172.21.15.33:0/3971635332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39da390 0x55a0a3dad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.725+0000 7effa9842640 1 --2- 172.21.15.33:0/3971635332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3db1a70 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7eff94006010 tx=0x7eff9403d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b310226d844ac104 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.725+0000 7eff8ffff640 1 -- 172.21.15.33:0/3971635332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94052030 con 0x55a0a39d21b0 2024-08-28T19:47:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.725+0000 7eff8ffff640 1 -- 172.21.15.33:0/3971635332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff9403d450 con 0x55a0a39d21b0 2024-08-28T19:47:02.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.725+0000 7eff8ffff640 1 -- 172.21.15.33:0/3971635332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94041030 con 0x55a0a39d21b0 2024-08-28T19:47:02.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 -- 172.21.15.33:0/3971635332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 msgr2=0x55a0a3db1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 --2- 172.21.15.33:0/3971635332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3db1a70 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7eff94006010 tx=0x7eff9403d810 comp rx=0 tx=0).stop 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 -- 172.21.15.33:0/3971635332 shutdown_connections 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 --2- 172.21.15.33:0/3971635332 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39fb070 0x55a0a3dad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 --2- 172.21.15.33:0/3971635332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39da390 0x55a0a3dad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 --2- 172.21.15.33:0/3971635332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39d21b0 0x55a0a3db1a70 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 -- 172.21.15.33:0/3971635332 >> 172.21.15.33:0/3971635332 conn(0x55a0a39ef460 msgr2=0x55a0a3db1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 -- 172.21.15.33:0/3971635332 shutdown_connections 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 -- 172.21.15.33:0/3971635332 wait complete. 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 -- start start 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.726+0000 7effb281c740 1 Processor -- start 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effb281c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 0x55a0a3dc55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effb281c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3dc3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effb281c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3dc4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effb281c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7effa41afe90 con 0x55a0a39da390 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effb281c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7effa41af7c0 con 0x55a0a39fb070 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effb281c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7effa41aca20 con 0x55a0a39d21b0 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effb281c740 10 client.0 _ll_register_callbacks cb 0x7eff94004410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effaa043640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3dc3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effaa043640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3dc3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33252/0 (socket says 172.21.15.33:33252) 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effaa043640 1 -- 172.21.15.33:0/3103106744 learned_addr learned my addr 172.21.15.33:0/3103106744 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effa9842640 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 0x55a0a3dc55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effa9842640 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3dc4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effaa043640 1 -- 172.21.15.33:0/3103106744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 msgr2=0x55a0a3dc55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effaa043640 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 0x55a0a3dc55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effaa043640 1 -- 172.21.15.33:0/3103106744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 msgr2=0x55a0a3dc4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effaa043640 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3dc4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effaa043640 1 -- 172.21.15.33:0/3103106744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0a3da10b0 con 0x55a0a39da390 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effa9842640 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 0x55a0a3dc55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effaa043640 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3dc3ac0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7effa000b890 tx=0x7effa000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717e400569430ec0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7eff8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7eff8dffb640 1 -- 172.21.15.33:0/3103106744 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0011440 con 0x55a0a39da390 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7eff8dffb640 1 -- 172.21.15.33:0/3103106744 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9453+0+0 (secure 0 0 0) 0x7effa00115e0 con 0x55a0a39da390 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.727+0000 7effb281c740 1 -- 172.21.15.33:0/3103106744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff9403d450 con 0x55a0a39da390 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7eff8dffb640 1 -- 172.21.15.33:0/3103106744 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7effa00117e0 con 0x55a0a39da390 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7effb281c740 10 client.19515 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7effb281c740 1 -- 172.21.15.33:0/3103106744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a0a3e2d2d0 con 0x55a0a39da390 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7eff8dffb640 1 -- 172.21.15.33:0/3103106744 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff9403d450 con 0x55a0a39da390 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7eff8dffb640 1 -- 172.21.15.33:0/3103106744 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7effa0024bb0 con 0x55a0a39da390 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7effb281c740 10 client.19515 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7effb281c740 10 client.19515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:02.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7effb281c740 20 client.19515 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7effb281c740 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0a398eda0 0x55a0a3e2fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7effb281c740 4 client.19515 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7effb281c740 1 -- 172.21.15.33:0/3103106744 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0a3d15020 con 0x55a0a398eda0 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.728+0000 7effa9842640 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0a398eda0 0x55a0a3e2fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7effa9842640 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0a398eda0 0x55a0a3e2fb10 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13f03f5333da5ebe server_cookie=f627c7700291c501 in_seq=0 out_seq=0 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7eff8dffb640 10 client.19515 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7eff8dffb640 1 -- 172.21.15.33:0/3103106744 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6818 (crc 0 0 0) 0x55a0a3d15020 con 0x55a0a398eda0 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7eff8dffb640 10 client.19515 handle_command_reply: tid=0 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7effb281c740 1 client.19515 shutdown 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7effb281c740 1 -- 172.21.15.33:0/3103106744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 msgr2=0x55a0a3dc3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7effb281c740 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3dc3ac0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7effa000b890 tx=0x7effa000be30 comp rx=0 tx=0).stop 2024-08-28T19:47:02.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7effb281c740 1 -- 172.21.15.33:0/3103106744 shutdown_connections 2024-08-28T19:47:02.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7effb281c740 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0a39fb070 0x55a0a3dc4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7effb281c740 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a0a398eda0 0x55a0a3e2fb10 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7effb281c740 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a0a39da390 0x55a0a3dc3ac0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7effb281c740 1 --2- 172.21.15.33:0/3103106744 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a0a39d21b0 0x55a0a3dc55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7eff8dffb640 0 client.19515 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:02.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.729+0000 7effb281c740 1 -- 172.21.15.33:0/3103106744 >> 172.21.15.33:0/3103106744 conn(0x55a0a39ef460 msgr2=0x55a0a3da1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:02.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effb281c740 1 -- 172.21.15.33:0/3103106744 shutdown_connections 2024-08-28T19:47:02.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effb281c740 1 -- 172.21.15.33:0/3103106744 wait complete. 2024-08-28T19:47:02.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effb281c740 20 client.19515 trim_cache size 0 max 16384 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: "7bc9ceff-c40a-4b60-a12f-cc9f203af1aa": { 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "7bc9ceff-c40a-4b60-a12f-cc9f203af1aa", 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:47:02.736 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.737 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.738 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "7bc9ceff-c40a-4b60-a12f-cc9f203af1aa": { 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:47:00.994176+0000", 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.739 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:47:02.740 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:45:27.534627+0000", 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.741 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "48fef576-2648-4bab-8772-21d3637a9125": { 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:46:15.427396+0000", 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.742 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.743 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.744 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:47:02.745 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.747 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:47:02.748 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:02.749 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 -- 172.21.15.33:0/2800559072 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff900b4d20 msgr2=0x7eff900b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff900b4d20 0x7eff900b7230 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0aae30 tx=0x7eff9c092040 comp rx=0 tx=0).stop 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 -- 172.21.15.33:0/2800559072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa4108ad0 msgr2=0x7effa419fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa4108ad0 0x7effa419fb70 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00b970 tx=0x7eff9c00be30 comp rx=0 tx=0).stop 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 -- 172.21.15.33:0/2800559072 shutdown_connections 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa4108ad0 0x7effa419fb70 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7eff900b4d20 0x7eff900b7230 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7effa4108180 0x7effa419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 --2- 172.21.15.33:0/2800559072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa4102840 0x7effa419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:02.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 -- 172.21.15.33:0/2800559072 >> 172.21.15.33:0/2800559072 conn(0x7effa40794f0 msgr2=0x7effa4106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:02.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 -- 172.21.15.33:0/2800559072 shutdown_connections 2024-08-28T19:47:02.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:02.730+0000 7effac2a7640 1 -- 172.21.15.33:0/2800559072 wait complete. 2024-08-28T19:47:03.504 INFO:tasks.cephfs.filesystem:scrub status for tag:7bc9ceff-c40a-4b60-a12f-cc9f203af1aa - {'path': '/', 'tag': '7bc9ceff-c40a-4b60-a12f-cc9f203af1aa', 'options': 'recursive,force'} 2024-08-28T19:47:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:03 smithi033 ceph-mon[18549]: pgmap v796: 129 pgs: 129 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 77 KiB/s wr, 15 op/s 2024-08-28T19:47:04.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:03 smithi059 ceph-mon[22052]: pgmap v796: 129 pgs: 129 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 77 KiB/s wr, 15 op/s 2024-08-28T19:47:04.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:03 smithi122 ceph-mon[22174]: pgmap v796: 129 pgs: 129 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 77 KiB/s wr, 15 op/s 2024-08-28T19:47:04.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:04 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:47:04.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:04 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:47:05.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:04 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:47:05.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:04 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:47:05.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:04 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:47:05.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:04 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:47:05.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:05 smithi033 ceph-mon[18549]: pgmap v797: 129 pgs: 129 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 121 KiB/s wr, 35 op/s 2024-08-28T19:47:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:05 smithi033 ceph-mon[18549]: osdmap e101: 12 total, 12 up, 12 in 2024-08-28T19:47:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:47:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:47:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:47:05.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:05 smithi059 ceph-mon[22052]: pgmap v797: 129 pgs: 129 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 121 KiB/s wr, 35 op/s 2024-08-28T19:47:05.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:05 smithi059 ceph-mon[22052]: osdmap e101: 12 total, 12 up, 12 in 2024-08-28T19:47:05.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:47:05.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:47:05.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:47:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:05 smithi122 ceph-mon[22174]: pgmap v797: 129 pgs: 129 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 121 KiB/s wr, 35 op/s 2024-08-28T19:47:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:05 smithi122 ceph-mon[22174]: osdmap e101: 12 total, 12 up, 12 in 2024-08-28T19:47:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:47:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:47:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:47:07.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:07 smithi033 ceph-mon[18549]: pgmap v799: 129 pgs: 129 active+clean; 26 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 115 KiB/s wr, 36 op/s 2024-08-28T19:47:08.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:07 smithi059 ceph-mon[22052]: pgmap v799: 129 pgs: 129 active+clean; 26 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 115 KiB/s wr, 36 op/s 2024-08-28T19:47:08.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:07 smithi122 ceph-mon[22174]: pgmap v799: 129 pgs: 129 active+clean; 26 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 115 KiB/s wr, 36 op/s 2024-08-28T19:47:09.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:09 smithi033 ceph-mon[18549]: pgmap v800: 129 pgs: 129 active+clean; 26 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 137 KiB/s wr, 37 op/s 2024-08-28T19:47:10.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:09 smithi059 ceph-mon[22052]: pgmap v800: 129 pgs: 129 active+clean; 26 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 137 KiB/s wr, 37 op/s 2024-08-28T19:47:10.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:09 smithi122 ceph-mon[22174]: pgmap v800: 129 pgs: 129 active+clean; 26 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 137 KiB/s wr, 37 op/s 2024-08-28T19:47:11.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:11 smithi033 ceph-mon[18549]: pgmap v801: 129 pgs: 129 active+clean; 26 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 131 KiB/s wr, 36 op/s 2024-08-28T19:47:12.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:11 smithi059 ceph-mon[22052]: pgmap v801: 129 pgs: 129 active+clean; 26 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 131 KiB/s wr, 36 op/s 2024-08-28T19:47:12.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:11 smithi122 ceph-mon[22174]: pgmap v801: 129 pgs: 129 active+clean; 26 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 131 KiB/s wr, 36 op/s 2024-08-28T19:47:13.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:13 smithi033 ceph-mon[18549]: pgmap v802: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 129 KiB/s wr, 35 op/s 2024-08-28T19:47:14.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:13 smithi059 ceph-mon[22052]: pgmap v802: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 129 KiB/s wr, 35 op/s 2024-08-28T19:47:14.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:13 smithi122 ceph-mon[22174]: pgmap v802: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 129 KiB/s wr, 35 op/s 2024-08-28T19:47:15.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:15 smithi059 ceph-mon[22052]: pgmap v803: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:15.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:15 smithi059 ceph-mon[22052]: osdmap e102: 12 total, 12 up, 12 in 2024-08-28T19:47:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:15 smithi122 ceph-mon[22174]: pgmap v803: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:15.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:15 smithi122 ceph-mon[22174]: osdmap e102: 12 total, 12 up, 12 in 2024-08-28T19:47:15.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:15 smithi033 ceph-mon[18549]: pgmap v803: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:15.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:15 smithi033 ceph-mon[18549]: osdmap e102: 12 total, 12 up, 12 in 2024-08-28T19:47:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:499/600: open fd = 3 2024-08-28T19:47:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.054 INFO:tasks.workunit.client.0.smithi033.stdout:500/600: open fd = 3 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:501/600: open fd = 3 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:502/600: open fd = 3 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:503/600: open fd = 3 2024-08-28T19:47:17.055 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:504/600: open fd = 3 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:505/600: open fd = 3 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:506/600: open fd = 3 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.056 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:507/600: open fd = 3 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:508/600: open fd = 3 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:509/600: open fd = 3 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.057 INFO:tasks.workunit.client.0.smithi033.stdout:510/600: open fd = 3 2024-08-28T19:47:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:511/600: open fd = 3 2024-08-28T19:47:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:512/600: open fd = 3 2024-08-28T19:47:17.058 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:513/600: open fd = 3 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:514/600: open fd = 3 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:515/600: open fd = 3 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.059 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.060 INFO:tasks.workunit.client.0.smithi033.stdout:516/600: open fd = 3 2024-08-28T19:47:17.060 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.060 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.060 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.061 INFO:tasks.workunit.client.0.smithi033.stdout:517/600: open fd = 3 2024-08-28T19:47:17.061 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.061 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.061 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.061 INFO:tasks.workunit.client.0.smithi033.stdout:518/600: open fd = 3 2024-08-28T19:47:17.061 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.061 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.061 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:519/600: open fd = 3 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:520/600: open fd = 3 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:521/600: open fd = 3 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:522/600: open fd = 3 2024-08-28T19:47:17.062 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:523/600: open fd = 3 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:524/600: open fd = 3 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:525/600: open fd = 3 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.063 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:526/600: open fd = 3 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:527/600: open fd = 3 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:528/600: open fd = 3 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.064 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:529/600: open fd = 3 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:530/600: open fd = 3 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:531/600: open fd = 3 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.065 INFO:tasks.workunit.client.0.smithi033.stdout:532/600: open fd = 3 2024-08-28T19:47:17.066 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.066 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.066 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.066 INFO:tasks.workunit.client.0.smithi033.stdout:533/600: open fd = 3 2024-08-28T19:47:17.066 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.066 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.066 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.066 INFO:tasks.workunit.client.0.smithi033.stdout:534/600: open fd = 3 2024-08-28T19:47:17.066 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.066 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:535/600: open fd = 3 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:536/600: open fd = 3 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:537/600: open fd = 3 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.067 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:538/600: open fd = 3 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:539/600: open fd = 3 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:540/600: open fd = 3 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.068 INFO:tasks.workunit.client.0.smithi033.stdout:541/600: open fd = 3 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:542/600: open fd = 3 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:543/600: open fd = 3 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:544/600: open fd = 3 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.069 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:545/600: open fd = 3 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:546/600: open fd = 3 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:547/600: open fd = 3 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.070 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:548/600: open fd = 3 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:549/600: open fd = 3 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:550/600: open fd = 3 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.071 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:551/600: open fd = 3 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:552/600: open fd = 3 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:553/600: open fd = 3 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.072 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:554/600: open fd = 3 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:555/600: open fd = 3 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:556/600: open fd = 3 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.073 INFO:tasks.workunit.client.0.smithi033.stdout:557/600: open fd = 3 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:558/600: open fd = 3 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:559/600: open fd = 3 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:560/600: open fd = 3 2024-08-28T19:47:17.074 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.075 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:47:17.075 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:47:17.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:17 smithi059 ceph-mon[22052]: pgmap v805: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:17.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:17 smithi122 ceph-mon[22174]: pgmap v805: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:17.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:17 smithi033 ceph-mon[18549]: pgmap v805: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:19.086 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-28T19:47:19.086 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-28T19:47:19.086 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:47:19.356 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:19.779 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:19 smithi033 ceph-mon[18549]: pgmap v806: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:19.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:19 smithi059 ceph-mon[22052]: pgmap v806: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:19.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:19 smithi122 ceph-mon[22174]: pgmap v806: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.869+0000 7f3aa54e1640 1 -- 172.21.15.33:0/3746042487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0102820 msgr2=0x7f3aa0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.869+0000 7f3aa54e1640 1 --2- 172.21.15.33:0/3746042487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0102820 0x7f3aa0102c30 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009900 tx=0x7f3a9002a410 comp rx=0 tx=0).stop 2024-08-28T19:47:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.869+0000 7f3aa54e1640 1 -- 172.21.15.33:0/3746042487 shutdown_connections 2024-08-28T19:47:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.869+0000 7f3aa54e1640 1 --2- 172.21.15.33:0/3746042487 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa0108ab0 0x7f3aa010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.869+0000 7f3aa54e1640 1 --2- 172.21.15.33:0/3746042487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa0108160 0x7f3aa0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.869+0000 7f3aa54e1640 1 --2- 172.21.15.33:0/3746042487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0102820 0x7f3aa0102c30 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.869+0000 7f3aa54e1640 1 -- 172.21.15.33:0/3746042487 >> 172.21.15.33:0/3746042487 conn(0x7f3aa00794e0 msgr2=0x7f3aa00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.869+0000 7f3aa54e1640 1 -- 172.21.15.33:0/3746042487 shutdown_connections 2024-08-28T19:47:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.869+0000 7f3aa54e1640 1 -- 172.21.15.33:0/3746042487 wait complete. 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.869+0000 7f3aa54e1640 1 Processor -- start 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3aa54e1640 1 -- start start 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3aa54e1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa0102820 0x7f3aa019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3aa54e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa0108160 0x7f3aa019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3aa54e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0108ab0 0x7f3aa019fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3aa54e1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa0113830 con 0x7f3aa0108ab0 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3aa54e1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa01136b0 con 0x7f3aa0102820 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3aa54e1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa01139b0 con 0x7f3aa0108160 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0108ab0 0x7f3aa019fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0108ab0 0x7f3aa019fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56324/0 (socket says 172.21.15.33:56324) 2024-08-28T19:47:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9f7fe640 1 -- 172.21.15.33:0/2317355204 learned_addr learned my addr 172.21.15.33:0/2317355204 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a97fff640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa0108160 0x7f3aa019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9effd640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa0102820 0x7f3aa019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9f7fe640 1 -- 172.21.15.33:0/2317355204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa0108160 msgr2=0x7f3aa019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9f7fe640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa0108160 0x7f3aa019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9f7fe640 1 -- 172.21.15.33:0/2317355204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa0102820 msgr2=0x7f3aa019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9f7fe640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa0102820 0x7f3aa019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9f7fe640 1 -- 172.21.15.33:0/2317355204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa01a0150 con 0x7f3aa0108ab0 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9effd640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa0102820 0x7f3aa019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.870+0000 7f3a9f7fe640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0108ab0 0x7f3aa019fa20 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800eb10 tx=0x7f3a9800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.871+0000 7f3a9cff9640 1 -- 172.21.15.33:0/2317355204 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a98004b20 con 0x7f3aa0108ab0 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.871+0000 7f3a9cff9640 1 -- 172.21.15.33:0/2317355204 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a98004cc0 con 0x7f3aa0108ab0 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.871+0000 7f3aa54e1640 1 -- 172.21.15.33:0/2317355204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa01a0440 con 0x7f3aa0108ab0 2024-08-28T19:47:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.871+0000 7f3a9cff9640 1 -- 172.21.15.33:0/2317355204 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a98010670 con 0x7f3aa0108ab0 2024-08-28T19:47:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.871+0000 7f3aa54e1640 1 -- 172.21.15.33:0/2317355204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa01a6ba0 con 0x7f3aa0108ab0 2024-08-28T19:47:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.872+0000 7f3aa54e1640 1 -- 172.21.15.33:0/2317355204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa0103aa0 con 0x7f3aa0108ab0 2024-08-28T19:47:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.873+0000 7f3a9cff9640 1 -- 172.21.15.33:0/2317355204 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3a98005000 con 0x7f3aa0108ab0 2024-08-28T19:47:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.874+0000 7f3a9cff9640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a8c0b4ca0 0x7f3a8c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.874+0000 7f3a9effd640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a8c0b4ca0 0x7f3a8c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.874+0000 7f3a9cff9640 1 -- 172.21.15.33:0/2317355204 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f3a980e6180 con 0x7f3aa0108ab0 2024-08-28T19:47:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.875+0000 7f3a9effd640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a8c0b4ca0 0x7f3a8c0b71b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3a900096c0 tx=0x7f3a90031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:19.877+0000 7f3a9cff9640 1 -- 172.21.15.33:0/2317355204 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3a98056130 con 0x7f3aa0108ab0 2024-08-28T19:47:20.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.101+0000 7f3aa54e1640 1 -- 172.21.15.33:0/2317355204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3aa0102c30 con 0x7f3aa0108ab0 2024-08-28T19:47:20.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.102+0000 7f3a9cff9640 1 -- 172.21.15.33:0/2317355204 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f3aa0102c30 con 0x7f3aa0108ab0 2024-08-28T19:47:20.104 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:47:20.104 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:47:20.105 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:47:20.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 -- 172.21.15.33:0/2317355204 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a8c0b4ca0 msgr2=0x7f3a8c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:20.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a8c0b4ca0 0x7f3a8c0b71b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3a900096c0 tx=0x7f3a90031400 comp rx=0 tx=0).stop 2024-08-28T19:47:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 -- 172.21.15.33:0/2317355204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0108ab0 msgr2=0x7f3aa019fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0108ab0 0x7f3aa019fa20 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800eb10 tx=0x7f3a9800c2d0 comp rx=0 tx=0).stop 2024-08-28T19:47:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 -- 172.21.15.33:0/2317355204 shutdown_connections 2024-08-28T19:47:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3aa0108ab0 0x7f3aa019fa20 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3a8c0b4ca0 0x7f3a8c0b71b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3aa0108160 0x7f3aa019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 --2- 172.21.15.33:0/2317355204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa0102820 0x7f3aa019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 -- 172.21.15.33:0/2317355204 >> 172.21.15.33:0/2317355204 conn(0x7f3aa00794e0 msgr2=0x7f3aa01011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.104+0000 7f3aa54e1640 1 -- 172.21.15.33:0/2317355204 shutdown_connections 2024-08-28T19:47:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:20.105+0000 7f3aa54e1640 1 -- 172.21.15.33:0/2317355204 wait complete. 2024-08-28T19:47:20.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:20 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2317355204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:20.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:20 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2317355204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:20.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:20 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2317355204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:20.923 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-28T19:47:20.923 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-28T19:47:21.176 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:21.598 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:21 smithi033 ceph-mon[18549]: pgmap v807: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.697+0000 7fa189c80640 1 -- 172.21.15.33:0/1252997746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1841081a0 msgr2=0x7fa1841085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.697+0000 7fa189c80640 1 --2- 172.21.15.33:0/1252997746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1841081a0 0x7fa1841085b0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fa178009900 tx=0x7fa17802a410 comp rx=0 tx=0).stop 2024-08-28T19:47:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.697+0000 7fa189c80640 1 -- 172.21.15.33:0/1252997746 shutdown_connections 2024-08-28T19:47:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.697+0000 7fa189c80640 1 --2- 172.21.15.33:0/1252997746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184108af0 0x7fa18410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.697+0000 7fa189c80640 1 --2- 172.21.15.33:0/1252997746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1841081a0 0x7fa1841085b0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.697+0000 7fa189c80640 1 --2- 172.21.15.33:0/1252997746 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa184103040 0x7fa184103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.697+0000 7fa189c80640 1 -- 172.21.15.33:0/1252997746 >> 172.21.15.33:0/1252997746 conn(0x7fa184079d70 msgr2=0x7fa18407a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.697+0000 7fa189c80640 1 -- 172.21.15.33:0/1252997746 shutdown_connections 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.697+0000 7fa189c80640 1 -- 172.21.15.33:0/1252997746 wait complete. 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.698+0000 7fa189c80640 1 Processor -- start 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.698+0000 7fa189c80640 1 -- start start 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.698+0000 7fa189c80640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184103040 0x7fa18419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.698+0000 7fa189c80640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1841081a0 0x7fa18419b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.698+0000 7fa189c80640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa184108af0 0x7fa18419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.698+0000 7fa189c80640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841127a0 con 0x7fa1841081a0 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.698+0000 7fa189c80640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa184112620 con 0x7fa184103040 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.698+0000 7fa189c80640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa184112920 con 0x7fa184108af0 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa182ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1841081a0 0x7fa18419b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa182ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1841081a0 0x7fa18419b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56344/0 (socket says 172.21.15.33:56344) 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa182ffd640 1 -- 172.21.15.33:0/2190276960 learned_addr learned my addr 172.21.15.33:0/2190276960 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa1837fe640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184103040 0x7fa18419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa183fff640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa184108af0 0x7fa18419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa182ffd640 1 -- 172.21.15.33:0/2190276960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa184108af0 msgr2=0x7fa18419bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa182ffd640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa184108af0 0x7fa18419bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa182ffd640 1 -- 172.21.15.33:0/2190276960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184103040 msgr2=0x7fa18419b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa182ffd640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184103040 0x7fa18419b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa182ffd640 1 -- 172.21.15.33:0/2190276960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1841a6390 con 0x7fa1841081a0 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa183fff640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa184108af0 0x7fa18419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa182ffd640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1841081a0 0x7fa18419b610 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fa178005940 tx=0x7fa1780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa180ff9640 1 -- 172.21.15.33:0/2190276960 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17803f030 con 0x7fa1841081a0 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa189c80640 1 -- 172.21.15.33:0/2190276960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1841a6620 con 0x7fa1841081a0 2024-08-28T19:47:21.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa180ff9640 1 -- 172.21.15.33:0/2190276960 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa178003cb0 con 0x7fa1841081a0 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa180ff9640 1 -- 172.21.15.33:0/2190276960 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178035070 con 0x7fa1841081a0 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.699+0000 7fa189c80640 1 -- 172.21.15.33:0/2190276960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1841a6b00 con 0x7fa1841081a0 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.702+0000 7fa1901f5740 1 Processor -- start 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1901f5740 1 -- start start 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa180ff9640 1 -- 172.21.15.33:0/2190276960 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa178042030 con 0x7fa1841081a0 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 0x5573cb9b6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1901f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5573cb92a330 con 0x5573cb5e5980 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1901f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5573cb9198c0 con 0x5573cb60e840 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1901f5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5573cb91d870 con 0x5573cb5edb60 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56354/0 (socket says 172.21.15.33:56354) 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1837fe640 1 -- 172.21.15.33:0/1581014539 learned_addr learned my addr 172.21.15.33:0/1581014539 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa183fff640 1 --2- 172.21.15.33:0/1581014539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa182ffd640 1 --2- 172.21.15.33:0/1581014539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 0x5573cb9b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1837fe640 1 -- 172.21.15.33:0/1581014539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 msgr2=0x5573cb9b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1837fe640 1 --2- 172.21.15.33:0/1581014539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 0x5573cb9b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.703+0000 7fa1837fe640 1 -- 172.21.15.33:0/1581014539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 msgr2=0x5573cb9b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.704+0000 7fa1837fe640 1 --2- 172.21.15.33:0/1581014539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.704+0000 7fa1837fe640 1 -- 172.21.15.33:0/1581014539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573cb8d1df0 con 0x5573cb5e5980 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.704+0000 7fa1837fe640 1 --2- 172.21.15.33:0/1581014539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b61d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fa17400b7f0 tx=0x7fa17400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a29fd302cb36e6c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.704+0000 7fa180ff9640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa16c0b4ca0 0x7fa16c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.704+0000 7fa169ffb640 1 -- 172.21.15.33:0/1581014539 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17400d950 con 0x5573cb5e5980 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.704+0000 7fa169ffb640 1 -- 172.21.15.33:0/1581014539 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa174018070 con 0x5573cb5e5980 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.704+0000 7fa183fff640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa16c0b4ca0 0x7fa16c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.704+0000 7fa169ffb640 1 -- 172.21.15.33:0/1581014539 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1740123e0 con 0x5573cb5e5980 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.704+0000 7fa180ff9640 1 -- 172.21.15.33:0/2190276960 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fa178106420 con 0x7fa1841081a0 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa1901f5740 1 -- 172.21.15.33:0/1581014539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 msgr2=0x5573cb9b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa183fff640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa16c0b4ca0 0x7fa16c0b71b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa17c005fd0 tx=0x7fa17c008630 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa1901f5740 1 --2- 172.21.15.33:0/1581014539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b61d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fa17400b7f0 tx=0x7fa17400bcb0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa1901f5740 1 -- 172.21.15.33:0/1581014539 shutdown_connections 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa1901f5740 1 --2- 172.21.15.33:0/1581014539 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 0x5573cb9b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa1901f5740 1 --2- 172.21.15.33:0/1581014539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b61d0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa1901f5740 1 --2- 172.21.15.33:0/1581014539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa1901f5740 1 -- 172.21.15.33:0/1581014539 >> 172.21.15.33:0/1581014539 conn(0x5573cb602990 msgr2=0x5573cb9b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa1901f5740 1 -- 172.21.15.33:0/1581014539 shutdown_connections 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa1901f5740 1 -- 172.21.15.33:0/1581014539 wait complete. 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.705+0000 7fa1901f5740 1 -- start start 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa1901f5740 1 Processor -- start 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5e5980 0x5573cb9c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5edb60 0x5573cb9c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa1901f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5573cb77c7a0 con 0x5573cb5edb60 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa1901f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5573cb8a0240 con 0x5573cb60e840 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa1901f5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5573cb9c4470 con 0x5573cb5e5980 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa1901f5740 10 client.0 _ll_register_callbacks cb 0x5573cb626090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa182ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5edb60 0x5573cb9c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa182ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5edb60 0x5573cb9c19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56364/0 (socket says 172.21.15.33:56364) 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa182ffd640 1 -- 172.21.15.33:0/3918016022 learned_addr learned my addr 172.21.15.33:0/3918016022 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa183fff640 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa1837fe640 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5e5980 0x5573cb9c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa182ffd640 1 -- 172.21.15.33:0/3918016022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5e5980 msgr2=0x5573cb9c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa182ffd640 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5e5980 0x5573cb9c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa182ffd640 1 -- 172.21.15.33:0/3918016022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 msgr2=0x5573cb9cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa182ffd640 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.706+0000 7fa182ffd640 1 -- 172.21.15.33:0/3918016022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573cb8d62b0 con 0x5573cb5edb60 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa182ffd640 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5edb60 0x5573cb9c19a0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fa1780c8790 tx=0x7fa1780c8690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4b7350b5d2250a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa162ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa162ffd640 1 -- 172.21.15.33:0/3918016022 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178049040 con 0x5573cb5edb60 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa162ffd640 1 -- 172.21.15.33:0/3918016022 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fa178106170 con 0x5573cb5edb60 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa1901f5740 1 -- 172.21.15.33:0/3918016022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa174018070 con 0x5573cb5edb60 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa162ffd640 1 -- 172.21.15.33:0/3918016022 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa178003e60 con 0x5573cb5edb60 2024-08-28T19:47:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa1901f5740 10 client.19533 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa1901f5740 1 -- 172.21.15.33:0/3918016022 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5573cb688b90 con 0x5573cb5edb60 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa162ffd640 1 -- 172.21.15.33:0/3918016022 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa174018070 con 0x5573cb5edb60 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa162ffd640 1 -- 172.21.15.33:0/3918016022 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa17807c1a0 con 0x5573cb5edb60 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa1901f5740 10 client.19533 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa1901f5740 10 client.19533 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa1901f5740 20 client.19533 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa1901f5740 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5573cb5cd1c0 0x5573cb9d3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa1901f5740 4 client.19533 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.707+0000 7fa1901f5740 1 -- 172.21.15.33:0/3918016022 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573cb92c280 con 0x5573cb5cd1c0 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.708+0000 7fa1837fe640 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5573cb5cd1c0 0x5573cb9d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.708+0000 7fa1837fe640 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5573cb5cd1c0 0x5573cb9d3490 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f197895e611cdac4 server_cookie=566a8640fd7f7107 in_seq=0 out_seq=0 2024-08-28T19:47:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.708+0000 7fa162ffd640 10 client.19533 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa162ffd640 1 -- 172.21.15.33:0/3918016022 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5573cb92c280 con 0x5573cb5cd1c0 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa162ffd640 10 client.19533 handle_command_reply: tid=0 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 client.19533 shutdown 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 -- 172.21.15.33:0/3918016022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5edb60 msgr2=0x5573cb9c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5edb60 0x5573cb9c19a0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fa1780c8790 tx=0x7fa1780c8690 comp rx=0 tx=0).stop 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 -- 172.21.15.33:0/3918016022 shutdown_connections 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5573cb5cd1c0 0x5573cb9d3490 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5edb60 0x5573cb9c19a0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 --2- 172.21.15.33:0/3918016022 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5e5980 0x5573cb9c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa162ffd640 0 client.19533 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 -- 172.21.15.33:0/3918016022 >> 172.21.15.33:0/3918016022 conn(0x5573cb602990 msgr2=0x5573cb9b8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 -- 172.21.15.33:0/3918016022 shutdown_connections 2024-08-28T19:47:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.709+0000 7fa1901f5740 1 -- 172.21.15.33:0/3918016022 wait complete. 2024-08-28T19:47:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.710+0000 7fa1901f5740 20 client.19533 trim_cache size 0 max 16384 2024-08-28T19:47:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1901f5740 1 Processor -- start 2024-08-28T19:47:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1901f5740 1 -- start start 2024-08-28T19:47:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb5edb60 0x5573cb9cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb60e840 0x5573cb9d8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1901f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841b0c80 con 0x5573cb5e5980 2024-08-28T19:47:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1901f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841b27c0 con 0x5573cb5edb60 2024-08-28T19:47:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1901f5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841b1350 con 0x5573cb60e840 2024-08-28T19:47:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56380/0 (socket says 172.21.15.33:56380) 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.727+0000 7fa1837fe640 1 -- 172.21.15.33:0/1965847173 learned_addr learned my addr 172.21.15.33:0/1965847173 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa183fff640 1 --2- 172.21.15.33:0/1965847173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb60e840 0x5573cb9d8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa182ffd640 1 --2- 172.21.15.33:0/1965847173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb5edb60 0x5573cb9cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa1837fe640 1 -- 172.21.15.33:0/1965847173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb60e840 msgr2=0x5573cb9d8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa1837fe640 1 --2- 172.21.15.33:0/1965847173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb60e840 0x5573cb9d8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa1837fe640 1 -- 172.21.15.33:0/1965847173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb5edb60 msgr2=0x5573cb9cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa1837fe640 1 --2- 172.21.15.33:0/1965847173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb5edb60 0x5573cb9cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa1837fe640 1 -- 172.21.15.33:0/1965847173 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573cb8e9d90 con 0x5573cb5e5980 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa183fff640 1 --2- 172.21.15.33:0/1965847173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb60e840 0x5573cb9d8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa1837fe640 1 --2- 172.21.15.33:0/1965847173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b7680 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fa1740134a0 tx=0x7fa17400f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9a570fcb2ddbc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa1697fa640 1 -- 172.21.15.33:0/1965847173 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174024070 con 0x5573cb5e5980 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa1697fa640 1 -- 172.21.15.33:0/1965847173 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa174018040 con 0x5573cb5e5980 2024-08-28T19:47:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.728+0000 7fa1697fa640 1 -- 172.21.15.33:0/1965847173 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17401c770 con 0x5573cb5e5980 2024-08-28T19:47:21.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.729+0000 7fa1901f5740 1 -- 172.21.15.33:0/1965847173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 msgr2=0x5573cb9b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:21.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.729+0000 7fa1901f5740 1 --2- 172.21.15.33:0/1965847173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b7680 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fa1740134a0 tx=0x7fa17400f040 comp rx=0 tx=0).stop 2024-08-28T19:47:21.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.729+0000 7fa1901f5740 1 -- 172.21.15.33:0/1965847173 shutdown_connections 2024-08-28T19:47:21.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.729+0000 7fa1901f5740 1 --2- 172.21.15.33:0/1965847173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb60e840 0x5573cb9d8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.729+0000 7fa1901f5740 1 --2- 172.21.15.33:0/1965847173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb5edb60 0x5573cb9cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.729+0000 7fa1901f5740 1 --2- 172.21.15.33:0/1965847173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9b7680 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.729+0000 7fa1901f5740 1 -- 172.21.15.33:0/1965847173 >> 172.21.15.33:0/1965847173 conn(0x5573cb602990 msgr2=0x5573cb9c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.729+0000 7fa1901f5740 1 -- 172.21.15.33:0/1965847173 shutdown_connections 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.729+0000 7fa1901f5740 1 -- 172.21.15.33:0/1965847173 wait complete. 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.729+0000 7fa1901f5740 1 -- start start 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1901f5740 1 Processor -- start 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 0x5573cb9c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1901f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1901f5740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841b20f0 con 0x5573cb5e5980 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1901f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841b1a20 con 0x5573cb60e840 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1901f5740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841aec80 con 0x5573cb5edb60 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1901f5740 10 client.0 _ll_register_callbacks cb 0x7fa178109a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:21.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56390/0 (socket says 172.21.15.33:56390) 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1837fe640 1 -- 172.21.15.33:0/63672001 learned_addr learned my addr 172.21.15.33:0/63672001 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa183fff640 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa182ffd640 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 0x5573cb9c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1837fe640 1 -- 172.21.15.33:0/63672001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 msgr2=0x5573cb9c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1837fe640 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 0x5573cb9c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1837fe640 1 -- 172.21.15.33:0/63672001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 msgr2=0x5573cb9c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1837fe640 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa1837fe640 1 -- 172.21.15.33:0/63672001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573cb9c5440 con 0x5573cb5e5980 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa183fff640 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.730+0000 7fa182ffd640 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 0x5573cb9c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.731+0000 7fa1837fe640 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9c9fa0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fa174006e10 tx=0x7fa17400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0983da81392209b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.731+0000 7fa162ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:21.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.731+0000 7fa162ffd640 1 -- 172.21.15.33:0/63672001 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17400db50 con 0x5573cb5e5980 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.731+0000 7fa162ffd640 1 -- 172.21.15.33:0/63672001 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fa17400dcf0 con 0x5573cb5e5980 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.731+0000 7fa1901f5740 1 -- 172.21.15.33:0/63672001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa174018040 con 0x5573cb5e5980 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.731+0000 7fa162ffd640 1 -- 172.21.15.33:0/63672001 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa174040050 con 0x5573cb5e5980 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.731+0000 7fa1901f5740 10 client.19539 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.731+0000 7fa1901f5740 1 -- 172.21.15.33:0/63672001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5573cba3ede0 con 0x5573cb5e5980 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.731+0000 7fa162ffd640 1 -- 172.21.15.33:0/63672001 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa174018040 con 0x5573cb5e5980 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.731+0000 7fa162ffd640 1 -- 172.21.15.33:0/63672001 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa174013ce0 con 0x5573cb5e5980 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.732+0000 7fa1901f5740 10 client.19539 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.732+0000 7fa1901f5740 10 client.19539 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.732+0000 7fa1901f5740 20 client.19539 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.732+0000 7fa1901f5740 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5573cb5a2570 0x5573cba41360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.732+0000 7fa1901f5740 4 client.19539 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.732+0000 7fa1901f5740 1 -- 172.21.15.33:0/63672001 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5573cb927d20 con 0x5573cb5a2570 2024-08-28T19:47:21.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.732+0000 7fa182ffd640 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5573cb5a2570 0x5573cba41360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:21.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.732+0000 7fa162ffd640 10 client.19539 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:21.738 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.732+0000 7fa182ffd640 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5573cb5a2570 0x5573cba41360 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e9053ef10adeddd server_cookie=f4ef3afdb85ad4cd in_seq=0 out_seq=0 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.747+0000 7fa162ffd640 1 -- 172.21.15.33:0/63672001 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5573cb927d20 con 0x5573cb5a2570 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.747+0000 7fa162ffd640 10 client.19539 handle_command_reply: tid=0 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.747+0000 7fa1901f5740 1 client.19539 shutdown 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.747+0000 7fa1901f5740 1 -- 172.21.15.33:0/63672001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 msgr2=0x5573cb9c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.747+0000 7fa1901f5740 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9c9fa0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fa174006e10 tx=0x7fa17400b390 comp rx=0 tx=0).stop 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.747+0000 7fa1901f5740 1 -- 172.21.15.33:0/63672001 shutdown_connections 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.747+0000 7fa1901f5740 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573cb60e840 0x5573cb9c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.747+0000 7fa1901f5740 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5573cb5edb60 0x5573cb9c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.747+0000 7fa1901f5740 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5573cb5a2570 0x5573cba41360 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.748+0000 7fa1901f5740 1 --2- 172.21.15.33:0/63672001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5573cb5e5980 0x5573cb9c9fa0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.748+0000 7fa162ffd640 0 client.19539 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:21.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.748+0000 7fa1901f5740 1 -- 172.21.15.33:0/63672001 >> 172.21.15.33:0/63672001 conn(0x5573cb602990 msgr2=0x5573cb9c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:21.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.748+0000 7fa1901f5740 1 -- 172.21.15.33:0/63672001 shutdown_connections 2024-08-28T19:47:21.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.748+0000 7fa1901f5740 1 -- 172.21.15.33:0/63672001 wait complete. 2024-08-28T19:47:21.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.748+0000 7fa1901f5740 20 client.19539 trim_cache size 0 max 16384 2024-08-28T19:47:21.751 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:47:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:47:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:47:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 46, 2024-08-28T19:47:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:47:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "24c6780b": { 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 46, 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:47:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:47:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:21.753 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.748+0000 7fa189c80640 1 -- 172.21.15.33:0/2190276960 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa16c0b4ca0 msgr2=0x7fa16c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.748+0000 7fa189c80640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa16c0b4ca0 0x7fa16c0b71b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa17c005fd0 tx=0x7fa17c008630 comp rx=0 tx=0).stop 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.748+0000 7fa189c80640 1 -- 172.21.15.33:0/2190276960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1841081a0 msgr2=0x7fa18419b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.748+0000 7fa189c80640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1841081a0 0x7fa18419b610 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fa178005940 tx=0x7fa1780042f0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.749+0000 7fa189c80640 1 -- 172.21.15.33:0/2190276960 shutdown_connections 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.749+0000 7fa189c80640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa16c0b4ca0 0x7fa16c0b71b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.749+0000 7fa189c80640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa184108af0 0x7fa18419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.749+0000 7fa189c80640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1841081a0 0x7fa18419b610 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.749+0000 7fa189c80640 1 --2- 172.21.15.33:0/2190276960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa184103040 0x7fa18419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.749+0000 7fa189c80640 1 -- 172.21.15.33:0/2190276960 >> 172.21.15.33:0/2190276960 conn(0x7fa184079d70 msgr2=0x7fa184106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.749+0000 7fa189c80640 1 -- 172.21.15.33:0/2190276960 shutdown_connections 2024-08-28T19:47:21.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:21.749+0000 7fa189c80640 1 -- 172.21.15.33:0/2190276960 wait complete. 2024-08-28T19:47:21.782 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:21 smithi059 ceph-mon[22052]: pgmap v807: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:21.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:21 smithi122 ceph-mon[22174]: pgmap v807: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:22.600 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '24c6780b', quiesce took 3.5 seconds. Will release after: 26.5 2024-08-28T19:47:23.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:23 smithi122 ceph-mon[22174]: pgmap v808: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:23.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:23 smithi033 ceph-mon[18549]: pgmap v808: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:24.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:23 smithi059 ceph-mon[22052]: pgmap v808: 129 pgs: 129 active+clean; 27 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:25.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:25 smithi122 ceph-mon[22174]: pgmap v809: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:25.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:25 smithi033 ceph-mon[18549]: pgmap v809: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:26.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:25 smithi059 ceph-mon[22052]: pgmap v809: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 15 op/s 2024-08-28T19:47:27.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:27 smithi033 ceph-mon[18549]: pgmap v810: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 13 op/s 2024-08-28T19:47:28.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:27 smithi059 ceph-mon[22052]: pgmap v810: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 13 op/s 2024-08-28T19:47:28.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:27 smithi122 ceph-mon[22174]: pgmap v810: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 13 op/s 2024-08-28T19:47:29.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:29 smithi033 ceph-mon[18549]: pgmap v811: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 64 KiB/s wr, 15 op/s 2024-08-28T19:47:30.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:29 smithi059 ceph-mon[22052]: pgmap v811: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 64 KiB/s wr, 15 op/s 2024-08-28T19:47:30.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:29 smithi122 ceph-mon[22174]: pgmap v811: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 64 KiB/s wr, 15 op/s 2024-08-28T19:47:31.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:31 smithi033 ceph-mon[18549]: pgmap v812: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-08-28T19:47:32.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:31 smithi059 ceph-mon[22052]: pgmap v812: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-08-28T19:47:32.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:31 smithi122 ceph-mon[22174]: pgmap v812: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-08-28T19:47:33.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:47:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:33.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:33 smithi033 ceph-mon[18549]: pgmap v813: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-08-28T19:47:34.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:33 smithi059 ceph-mon[22052]: pgmap v813: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-08-28T19:47:34.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:33 smithi122 ceph-mon[22174]: pgmap v813: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-08-28T19:47:34.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.309+0000 7fa53e7a4640 1 -- 172.21.15.33:0/1276702451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa538101fe0 msgr2=0x7fa5381023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:34.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.309+0000 7fa53e7a4640 1 --2- 172.21.15.33:0/1276702451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa538101fe0 0x7fa5381023f0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fa528009900 tx=0x7fa52802a410 comp rx=0 tx=0).stop 2024-08-28T19:47:34.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.309+0000 7fa53e7a4640 1 -- 172.21.15.33:0/1276702451 shutdown_connections 2024-08-28T19:47:34.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.309+0000 7fa53e7a4640 1 --2- 172.21.15.33:0/1276702451 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa538108270 0x7fa53810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.309+0000 7fa53e7a4640 1 --2- 172.21.15.33:0/1276702451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa538107920 0x7fa538107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.309+0000 7fa53e7a4640 1 --2- 172.21.15.33:0/1276702451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa538101fe0 0x7fa5381023f0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.309+0000 7fa53e7a4640 1 -- 172.21.15.33:0/1276702451 >> 172.21.15.33:0/1276702451 conn(0x7fa538079d30 msgr2=0x7fa53807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.309+0000 7fa53e7a4640 1 -- 172.21.15.33:0/1276702451 shutdown_connections 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.309+0000 7fa53e7a4640 1 -- 172.21.15.33:0/1276702451 wait complete. 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa53e7a4640 1 Processor -- start 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa53e7a4640 1 -- start start 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa53e7a4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa538101fe0 0x7fa5380feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa53e7a4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa538107920 0x7fa5380ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa53e7a4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa538108270 0x7fa5380ff610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa53e7a4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa538111710 con 0x7fa538101fe0 2024-08-28T19:47:34.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa53e7a4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa538111590 con 0x7fa538108270 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa53e7a4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa538111890 con 0x7fa538107920 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa537fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa538101fe0 0x7fa5380feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa537fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa538101fe0 0x7fa5380feb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42540/0 (socket says 172.21.15.33:42540) 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.310+0000 7fa537fff640 1 -- 172.21.15.33:0/550977979 learned_addr learned my addr 172.21.15.33:0/550977979 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa53cd41640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa538108270 0x7fa5380ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa5377fe640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa538107920 0x7fa5380ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa537fff640 1 -- 172.21.15.33:0/550977979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa538107920 msgr2=0x7fa5380ff0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa537fff640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa538107920 0x7fa5380ff0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa537fff640 1 -- 172.21.15.33:0/550977979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa538108270 msgr2=0x7fa5380ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa537fff640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa538108270 0x7fa5380ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa537fff640 1 -- 172.21.15.33:0/550977979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5381a85a0 con 0x7fa538101fe0 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa53cd41640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa538108270 0x7fa5380ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa5377fe640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa538107920 0x7fa5380ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa537fff640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa538101fe0 0x7fa5380feb90 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fa528005940 tx=0x7fa5280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa5357fa640 1 -- 172.21.15.33:0/550977979 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52803f030 con 0x7fa538101fe0 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa53e7a4640 1 -- 172.21.15.33:0/550977979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5381a8830 con 0x7fa538101fe0 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa5357fa640 1 -- 172.21.15.33:0/550977979 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa528003cb0 con 0x7fa538101fe0 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa5357fa640 1 -- 172.21.15.33:0/550977979 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528035070 con 0x7fa538101fe0 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.311+0000 7fa53e7a4640 1 -- 172.21.15.33:0/550977979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5381a8d60 con 0x7fa538101fe0 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa544d19740 1 Processor -- start 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa544d19740 1 -- start start 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa5357fa640 1 -- 172.21.15.33:0/550977979 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fa528042030 con 0x7fa538101fe0 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa544d19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e5e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa544d19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e5e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa544d19740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e5ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa544d19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fed2dd5630 con 0x55fed2ab9070 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa544d19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fed2dc4bc0 con 0x55fed2a901b0 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa544d19740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fed2dc8b70 con 0x55fed2a98390 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa53cd41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e5e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa53cd41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e5e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42552/0 (socket says 172.21.15.33:42552) 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa53cd41640 1 -- 172.21.15.33:0/3094218619 learned_addr learned my addr 172.21.15.33:0/3094218619 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa5377fe640 1 --2- 172.21.15.33:0/3094218619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e5ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa537fff640 1 --2- 172.21.15.33:0/3094218619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e5e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa53cd41640 1 -- 172.21.15.33:0/3094218619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 msgr2=0x55fed2e5ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa53cd41640 1 --2- 172.21.15.33:0/3094218619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e5ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa53cd41640 1 -- 172.21.15.33:0/3094218619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 msgr2=0x55fed2e5e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa53cd41640 1 --2- 172.21.15.33:0/3094218619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e5e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa53cd41640 1 -- 172.21.15.33:0/3094218619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed2b24650 con 0x55fed2ab9070 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.314+0000 7fa5377fe640 1 --2- 172.21.15.33:0/3094218619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e5ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.315+0000 7fa53cd41640 1 --2- 172.21.15.33:0/3094218619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e5e2c0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fa530007f30 tx=0x7fa53000c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac5d606f9b5d023 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.315+0000 7fa5357fa640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa5200b4ca0 0x7fa5200b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.315+0000 7fa51e7fc640 1 -- 172.21.15.33:0/3094218619 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530014070 con 0x55fed2ab9070 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.315+0000 7fa51e7fc640 1 -- 172.21.15.33:0/3094218619 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa53000fd00 con 0x55fed2ab9070 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.315+0000 7fa537fff640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa5200b4ca0 0x7fa5200b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.315+0000 7fa51e7fc640 1 -- 172.21.15.33:0/3094218619 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53000ecd0 con 0x55fed2ab9070 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.315+0000 7fa5357fa640 1 -- 172.21.15.33:0/550977979 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fa5281062c0 con 0x7fa538101fe0 2024-08-28T19:47:34.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa544d19740 1 -- 172.21.15.33:0/3094218619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 msgr2=0x55fed2e5e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:34.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa544d19740 1 --2- 172.21.15.33:0/3094218619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e5e2c0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fa530007f30 tx=0x7fa53000c750 comp rx=0 tx=0).stop 2024-08-28T19:47:34.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa537fff640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa5200b4ca0 0x7fa5200b71b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa528103720 tx=0x7fa52803b640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:34.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa544d19740 1 -- 172.21.15.33:0/3094218619 shutdown_connections 2024-08-28T19:47:34.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa544d19740 1 --2- 172.21.15.33:0/3094218619 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e5ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa544d19740 1 --2- 172.21.15.33:0/3094218619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e5e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa544d19740 1 --2- 172.21.15.33:0/3094218619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e5e2c0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa544d19740 1 -- 172.21.15.33:0/3094218619 >> 172.21.15.33:0/3094218619 conn(0x55fed2aad460 msgr2=0x55fed2e5c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:34.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa544d19740 1 -- 172.21.15.33:0/3094218619 shutdown_connections 2024-08-28T19:47:34.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa544d19740 1 -- 172.21.15.33:0/3094218619 wait complete. 2024-08-28T19:47:34.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.316+0000 7fa544d19740 1 -- start start 2024-08-28T19:47:34.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa544d19740 1 Processor -- start 2024-08-28T19:47:34.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa544d19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2a901b0 0x55fed2e69ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa544d19740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e6a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa544d19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2ab9070 0x55fed2e75d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa544d19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fed2c27700 con 0x55fed2a901b0 2024-08-28T19:47:34.365 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.366 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.367 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:47:34.368 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "7bc9ceff-c40a-4b60-a12f-cc9f203af1aa": { 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:47:00.994176+0000", 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.370 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:45:27.534627+0000", 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.371 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: "48fef576-2648-4bab-8772-21d3637a9125": { 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:46:15.427396+0000", 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.373 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:47:34.373 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:47:34.373 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.373 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.373 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.373 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.373 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.373 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.374 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.375 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:47:34.376 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.377 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:47:34.378 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.379 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:34.380 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:47:34.381 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:47:34.381 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:34.381 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:34.381 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:34.381 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:34.381 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:34.381 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:34.381 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:34.381 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:47:34.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa544d19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fed2d4b700 con 0x55fed2ab9070 2024-08-28T19:47:34.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa544d19740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fed2e6caa0 con 0x55fed2a98390 2024-08-28T19:47:34.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa544d19740 10 client.0 _ll_register_callbacks cb 0x55fed2d7adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:34.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa53cd41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2a901b0 0x55fed2e69ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa53cd41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2a901b0 0x55fed2e69ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42568/0 (socket says 172.21.15.33:42568) 2024-08-28T19:47:34.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa53cd41640 1 -- 172.21.15.33:0/514767338 learned_addr learned my addr 172.21.15.33:0/514767338 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa5377fe640 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e6a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa53cd41640 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2ab9070 0x55fed2e75d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa53cd41640 1 -- 172.21.15.33:0/514767338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 msgr2=0x55fed2e6a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa53cd41640 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e6a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa53cd41640 1 -- 172.21.15.33:0/514767338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2ab9070 msgr2=0x55fed2e75d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa53cd41640 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2ab9070 0x55fed2e75d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.317+0000 7fa53cd41640 1 -- 172.21.15.33:0/514767338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed2d848b0 con 0x55fed2a901b0 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa53cd41640 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2a901b0 0x55fed2e69ac0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e5d0 tx=0x7fa53000e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edb4eb4e4ac2318 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa5177fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa5177fe640 1 -- 172.21.15.33:0/514767338 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530022040 con 0x55fed2a901b0 2024-08-28T19:47:34.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa5177fe640 1 -- 172.21.15.33:0/514767338 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fa53000f850 con 0x55fed2a901b0 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa544d19740 1 -- 172.21.15.33:0/514767338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa53000fd00 con 0x55fed2a901b0 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa5177fe640 1 -- 172.21.15.33:0/514767338 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa530030050 con 0x55fed2a901b0 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa544d19740 10 client.19551 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa544d19740 1 -- 172.21.15.33:0/514767338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fed2e788a0 con 0x55fed2a901b0 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa5177fe640 1 -- 172.21.15.33:0/514767338 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa53000fd00 con 0x55fed2a901b0 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa5177fe640 1 -- 172.21.15.33:0/514767338 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa530027430 con 0x55fed2a901b0 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa544d19740 10 client.19551 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa544d19740 10 client.19551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa544d19740 20 client.19551 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa544d19740 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fed2a779f0 0x55fed2e7bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa544d19740 4 client.19551 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.318+0000 7fa544d19740 1 -- 172.21.15.33:0/514767338 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fed2dd7580 con 0x55fed2a779f0 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.319+0000 7fa5377fe640 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fed2a779f0 0x55fed2e7bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.319+0000 7fa5177fe640 10 client.19551 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.319+0000 7fa5377fe640 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fed2a779f0 0x55fed2e7bcb0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a1e9f2e784fcf9 server_cookie=a0d532581666479a in_seq=0 out_seq=0 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa5177fe640 1 -- 172.21.15.33:0/514767338 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fed2dd7580 con 0x55fed2a779f0 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa5177fe640 10 client.19551 handle_command_reply: tid=0 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa544d19740 1 client.19551 shutdown 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa544d19740 1 -- 172.21.15.33:0/514767338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2a901b0 msgr2=0x55fed2e69ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa544d19740 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2a901b0 0x55fed2e69ac0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e5d0 tx=0x7fa53000e950 comp rx=0 tx=0).stop 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa544d19740 1 -- 172.21.15.33:0/514767338 shutdown_connections 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa544d19740 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2ab9070 0x55fed2e75d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa544d19740 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e6a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa544d19740 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fed2a779f0 0x55fed2e7bcb0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa544d19740 1 --2- 172.21.15.33:0/514767338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2a901b0 0x55fed2e69ac0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.320+0000 7fa5177fe640 0 client.19551 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.321+0000 7fa544d19740 1 -- 172.21.15.33:0/514767338 >> 172.21.15.33:0/514767338 conn(0x55fed2aad460 msgr2=0x55fed2e614a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.321+0000 7fa544d19740 1 -- 172.21.15.33:0/514767338 shutdown_connections 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.321+0000 7fa544d19740 1 -- 172.21.15.33:0/514767338 wait complete. 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.321+0000 7fa544d19740 20 client.19551 trim_cache size 0 max 16384 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.338+0000 7fa544d19740 1 Processor -- start 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.338+0000 7fa544d19740 1 -- start start 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.338+0000 7fa544d19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e69c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.338+0000 7fa544d19740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e61ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.338+0000 7fa544d19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e66cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.338+0000 7fa544d19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381b2f40 con 0x55fed2ab9070 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.338+0000 7fa544d19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381b4a80 con 0x55fed2a901b0 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.338+0000 7fa544d19740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381b3610 con 0x55fed2a98390 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa53cd41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e66cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa53cd41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e66cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42576/0 (socket says 172.21.15.33:42576) 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa53cd41640 1 -- 172.21.15.33:0/1565335946 learned_addr learned my addr 172.21.15.33:0/1565335946 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa53cd41640 1 --2- 172.21.15.33:0/1565335946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e69c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa5377fe640 1 --2- 172.21.15.33:0/1565335946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e61ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa53cd41640 1 -- 172.21.15.33:0/1565335946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 msgr2=0x55fed2e61ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa53cd41640 1 --2- 172.21.15.33:0/1565335946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e61ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa53cd41640 1 -- 172.21.15.33:0/1565335946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 msgr2=0x55fed2e69c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa53cd41640 1 --2- 172.21.15.33:0/1565335946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e69c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa53cd41640 1 -- 172.21.15.33:0/1565335946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed2e68a20 con 0x55fed2ab9070 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa53cd41640 1 --2- 172.21.15.33:0/1565335946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e66cb0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e870 tx=0x7fa5300021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c58007ef9e8821 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa51dffb640 1 -- 172.21.15.33:0/1565335946 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530014040 con 0x55fed2ab9070 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa51dffb640 1 -- 172.21.15.33:0/1565335946 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa530027e50 con 0x55fed2ab9070 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.339+0000 7fa51dffb640 1 -- 172.21.15.33:0/1565335946 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530027430 con 0x55fed2ab9070 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.340+0000 7fa544d19740 1 -- 172.21.15.33:0/1565335946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 msgr2=0x55fed2e66cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.340+0000 7fa544d19740 1 --2- 172.21.15.33:0/1565335946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e66cb0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e870 tx=0x7fa5300021d0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.340+0000 7fa544d19740 1 -- 172.21.15.33:0/1565335946 shutdown_connections 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.340+0000 7fa544d19740 1 --2- 172.21.15.33:0/1565335946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e66cb0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.340+0000 7fa544d19740 1 --2- 172.21.15.33:0/1565335946 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e61ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.340+0000 7fa544d19740 1 --2- 172.21.15.33:0/1565335946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e69c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.340+0000 7fa544d19740 1 -- 172.21.15.33:0/1565335946 >> 172.21.15.33:0/1565335946 conn(0x55fed2aad460 msgr2=0x55fed2e613c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.340+0000 7fa544d19740 1 -- 172.21.15.33:0/1565335946 shutdown_connections 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.340+0000 7fa544d19740 1 -- 172.21.15.33:0/1565335946 wait complete. 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.340+0000 7fa544d19740 1 -- start start 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa544d19740 1 Processor -- start 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa544d19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e6dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa544d19740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e6e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa544d19740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e6e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa544d19740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381b43b0 con 0x55fed2ab9070 2024-08-28T19:47:34.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa544d19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381b3ce0 con 0x55fed2a901b0 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa544d19740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fa5381b0f40 con 0x55fed2a98390 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa544d19740 10 client.0 _ll_register_callbacks cb 0x7fa530007d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa53cd41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e6e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa53cd41640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e6e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42586/0 (socket says 172.21.15.33:42586) 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa53cd41640 1 -- 172.21.15.33:0/2954467365 learned_addr learned my addr 172.21.15.33:0/2954467365 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa53cd41640 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e6dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa5377fe640 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e6e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa53cd41640 1 -- 172.21.15.33:0/2954467365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 msgr2=0x55fed2e6e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa53cd41640 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e6e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa53cd41640 1 -- 172.21.15.33:0/2954467365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 msgr2=0x55fed2e6dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:34.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa53cd41640 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e6dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa53cd41640 1 -- 172.21.15.33:0/2954467365 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed2ee5450 con 0x55fed2ab9070 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.341+0000 7fa5377fe640 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e6e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa53cd41640 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e6e750 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fa53000edc0 tx=0x7fa530027a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381c890bd2617e53 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa5177fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa5177fe640 1 -- 172.21.15.33:0/2954467365 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530045060 con 0x55fed2ab9070 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa5177fe640 1 -- 172.21.15.33:0/2954467365 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fa530007360 con 0x55fed2ab9070 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa544d19740 1 -- 172.21.15.33:0/2954467365 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa530027e50 con 0x55fed2ab9070 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa5177fe640 1 -- 172.21.15.33:0/2954467365 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa530027640 con 0x55fed2ab9070 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa544d19740 10 client.19557 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa544d19740 1 -- 172.21.15.33:0/2954467365 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fed2ee66e0 con 0x55fed2ab9070 2024-08-28T19:47:34.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa5177fe640 1 -- 172.21.15.33:0/2954467365 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa530027e50 con 0x55fed2ab9070 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa5177fe640 1 -- 172.21.15.33:0/2954467365 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa530040550 con 0x55fed2ab9070 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa544d19740 10 client.19557 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa544d19740 10 client.19557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa544d19740 20 client.19557 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa544d19740 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fed2a4cda0 0x55fed2ee8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa544d19740 4 client.19557 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.342+0000 7fa544d19740 1 -- 172.21.15.33:0/2954467365 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fed2dd3020 con 0x55fed2a4cda0 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.343+0000 7fa5377fe640 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fed2a4cda0 0x55fed2ee8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.343+0000 7fa5177fe640 10 client.19557 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.343+0000 7fa5377fe640 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fed2a4cda0 0x55fed2ee8d40 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bce238cfdc79ab10 server_cookie=8bd82fba8cec9666 in_seq=0 out_seq=0 2024-08-28T19:47:34.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa5177fe640 1 -- 172.21.15.33:0/2954467365 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6622 (crc 0 0 0) 0x55fed2dd3020 con 0x55fed2a4cda0 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa5177fe640 10 client.19557 handle_command_reply: tid=0 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 client.19557 shutdown 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 -- 172.21.15.33:0/2954467365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 msgr2=0x55fed2e6e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e6e750 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fa53000edc0 tx=0x7fa530027a70 comp rx=0 tx=0).stop 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 -- 172.21.15.33:0/2954467365 shutdown_connections 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fed2a4cda0 0x55fed2ee8d40 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fed2ab9070 0x55fed2e6e750 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fed2a98390 0x55fed2e6e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa5177fe640 0 client.19557 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 --2- 172.21.15.33:0/2954467365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fed2a901b0 0x55fed2e6dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 -- 172.21.15.33:0/2954467365 >> 172.21.15.33:0/2954467365 conn(0x55fed2aad460 msgr2=0x55fed2e5f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:34.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 -- 172.21.15.33:0/2954467365 shutdown_connections 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 1 -- 172.21.15.33:0/2954467365 wait complete. 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa544d19740 20 client.19557 trim_cache size 0 max 16384 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa53e7a4640 1 -- 172.21.15.33:0/550977979 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa5200b4ca0 msgr2=0x7fa5200b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.344+0000 7fa53e7a4640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa5200b4ca0 0x7fa5200b71b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa528103720 tx=0x7fa52803b640 comp rx=0 tx=0).stop 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.345+0000 7fa53e7a4640 1 -- 172.21.15.33:0/550977979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa538101fe0 msgr2=0x7fa5380feb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.345+0000 7fa53e7a4640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa538101fe0 0x7fa5380feb90 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fa528005940 tx=0x7fa5280042f0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.345+0000 7fa53e7a4640 1 -- 172.21.15.33:0/550977979 shutdown_connections 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.345+0000 7fa53e7a4640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa538108270 0x7fa5380ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.345+0000 7fa53e7a4640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fa5200b4ca0 0x7fa5200b71b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.345+0000 7fa53e7a4640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa538107920 0x7fa5380ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.345+0000 7fa53e7a4640 1 --2- 172.21.15.33:0/550977979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa538101fe0 0x7fa5380feb90 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:34.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.345+0000 7fa53e7a4640 1 -- 172.21.15.33:0/550977979 >> 172.21.15.33:0/550977979 conn(0x7fa538079d30 msgr2=0x7fa5381010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:34.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.345+0000 7fa53e7a4640 1 -- 172.21.15.33:0/550977979 shutdown_connections 2024-08-28T19:47:34.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:34.345+0000 7fa53e7a4640 1 -- 172.21.15.33:0/550977979 wait complete. 2024-08-28T19:47:35.219 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:47:35.219 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:47:35.475 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:35.835 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:35 smithi059 ceph-mon[22052]: pgmap v814: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-08-28T19:47:35.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:35 smithi033 ceph-mon[18549]: pgmap v814: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-08-28T19:47:36.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.975+0000 7faccec3a640 1 -- 172.21.15.33:0/3296951027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc8109b90 msgr2=0x7facc81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.975+0000 7faccec3a640 1 --2- 172.21.15.33:0/3296951027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc8109b90 0x7facc81103c0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7facc0009ca0 tx=0x7facc002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.975+0000 7faccec3a640 1 -- 172.21.15.33:0/3296951027 shutdown_connections 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.975+0000 7faccec3a640 1 --2- 172.21.15.33:0/3296951027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc8109b90 0x7facc81103c0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.975+0000 7faccec3a640 1 --2- 172.21.15.33:0/3296951027 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facc8109240 0x7facc8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.975+0000 7faccec3a640 1 --2- 172.21.15.33:0/3296951027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8103900 0x7facc8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.975+0000 7faccec3a640 1 -- 172.21.15.33:0/3296951027 >> 172.21.15.33:0/3296951027 conn(0x7facc807b5f0 msgr2=0x7facc807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.975+0000 7faccec3a640 1 -- 172.21.15.33:0/3296951027 shutdown_connections 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.975+0000 7faccec3a640 1 -- 172.21.15.33:0/3296951027 wait complete. 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccec3a640 1 Processor -- start 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccec3a640 1 -- start start 2024-08-28T19:47:36.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccec3a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8103900 0x7facc819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccec3a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facc8109240 0x7facc819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccec3a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc8109b90 0x7facc819fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccec3a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7facc8113850 con 0x7facc8109b90 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccec3a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7facc81136d0 con 0x7facc8103900 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccec3a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7facc81139d0 con 0x7facc8109240 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccd1d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc8109b90 0x7facc819fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccd1d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc8109b90 0x7facc819fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42610/0 (socket says 172.21.15.33:42610) 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccd1d7640 1 -- 172.21.15.33:0/3615290578 learned_addr learned my addr 172.21.15.33:0/3615290578 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccc9d6640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8103900 0x7facc819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7facc7fff640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facc8109240 0x7facc819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccd1d7640 1 -- 172.21.15.33:0/3615290578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facc8109240 msgr2=0x7facc819a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccd1d7640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facc8109240 0x7facc819a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccd1d7640 1 -- 172.21.15.33:0/3615290578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8103900 msgr2=0x7facc819a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:36.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.976+0000 7faccd1d7640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8103900 0x7facc819a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.977+0000 7faccd1d7640 1 -- 172.21.15.33:0/3615290578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc81a0090 con 0x7facc8109b90 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.977+0000 7facc7fff640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facc8109240 0x7facc819a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.977+0000 7faccc9d6640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8103900 0x7facc819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.977+0000 7faccd1d7640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc8109b90 0x7facc819fa20 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7facc0005cc0 tx=0x7facc002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.977+0000 7facc5ffb640 1 -- 172.21.15.33:0/3615290578 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0003bf0 con 0x7facc8109b90 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.977+0000 7faccec3a640 1 -- 172.21.15.33:0/3615290578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc81a0320 con 0x7facc8109b90 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.977+0000 7facc5ffb640 1 -- 172.21.15.33:0/3615290578 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facc0003d90 con 0x7facc8109b90 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.977+0000 7facc5ffb640 1 -- 172.21.15.33:0/3615290578 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc002fbc0 con 0x7facc8109b90 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.977+0000 7faccec3a640 1 -- 172.21.15.33:0/3615290578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc81a6ba0 con 0x7facc8109b90 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.978+0000 7faccec3a640 1 -- 172.21.15.33:0/3615290578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc8103d10 con 0x7facc8109b90 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.980+0000 7facc5ffb640 1 -- 172.21.15.33:0/3615290578 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7facc002fd60 con 0x7facc8109b90 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.980+0000 7facc5ffb640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facb80b4cd0 0x7facb80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.980+0000 7facc5ffb640 1 -- 172.21.15.33:0/3615290578 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7facc0106e80 con 0x7facc8109b90 2024-08-28T19:47:36.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.980+0000 7faccc9d6640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facb80b4cd0 0x7facb80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.981+0000 7faccc9d6640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facb80b4cd0 0x7facb80b71e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7facbc0058c0 tx=0x7facbc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:35.984+0000 7facc5ffb640 1 -- 172.21.15.33:0/3615290578 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7facc00cd8d0 con 0x7facc8109b90 2024-08-28T19:47:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:35 smithi122 ceph-mon[22174]: pgmap v814: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 KiB/s wr, 12 op/s 2024-08-28T19:47:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.206+0000 7faccec3a640 1 -- 172.21.15.33:0/3615290578 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facc810b9e0 con 0x7facc8109b90 2024-08-28T19:47:36.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.207+0000 7facc5ffb640 1 -- 172.21.15.33:0/3615290578 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7facc00098b0 con 0x7facc8109b90 2024-08-28T19:47:36.209 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:47:36.209 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:47:36.209 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 -- 172.21.15.33:0/3615290578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facb80b4cd0 msgr2=0x7facb80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facb80b4cd0 0x7facb80b71e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7facbc0058c0 tx=0x7facbc005850 comp rx=0 tx=0).stop 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 -- 172.21.15.33:0/3615290578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc8109b90 msgr2=0x7facc819fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc8109b90 0x7facc819fa20 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7facc0005cc0 tx=0x7facc002f380 comp rx=0 tx=0).stop 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 -- 172.21.15.33:0/3615290578 shutdown_connections 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facc8109b90 0x7facc819fa20 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7facb80b4cd0 0x7facb80b71e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7facc8109240 0x7facc819a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 --2- 172.21.15.33:0/3615290578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc8103900 0x7facc819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 -- 172.21.15.33:0/3615290578 >> 172.21.15.33:0/3615290578 conn(0x7facc807b5f0 msgr2=0x7facc8105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 -- 172.21.15.33:0/3615290578 shutdown_connections 2024-08-28T19:47:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:36.210+0000 7faccec3a640 1 -- 172.21.15.33:0/3615290578 wait complete. 2024-08-28T19:47:36.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:36 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3615290578' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:36.955 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:47:37.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:36 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3615290578' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:37.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:36 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3615290578' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:37.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:37 smithi033 ceph-mon[18549]: pgmap v815: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-08-28T19:47:37.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.813+0000 7f3607ec9640 1 -- 172.21.15.33:0/954569325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3600108a90 msgr2=0x7f360010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.813+0000 7f3607ec9640 1 --2- 172.21.15.33:0/954569325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3600108a90 0x7f360010f2c0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009ca0 tx=0x7f35f802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.813+0000 7f3607ec9640 1 -- 172.21.15.33:0/954569325 shutdown_connections 2024-08-28T19:47:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.813+0000 7f3607ec9640 1 --2- 172.21.15.33:0/954569325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3600108a90 0x7f360010f2c0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.813+0000 7f3607ec9640 1 --2- 172.21.15.33:0/954569325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3600108140 0x7f3600108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.813+0000 7f3607ec9640 1 --2- 172.21.15.33:0/954569325 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3600102800 0x7f3600102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.813+0000 7f3607ec9640 1 -- 172.21.15.33:0/954569325 >> 172.21.15.33:0/954569325 conn(0x7f36000794d0 msgr2=0x7f36000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.813+0000 7f3607ec9640 1 -- 172.21.15.33:0/954569325 shutdown_connections 2024-08-28T19:47:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.813+0000 7f3607ec9640 1 -- 172.21.15.33:0/954569325 wait complete. 2024-08-28T19:47:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.814+0000 7f3607ec9640 1 Processor -- start 2024-08-28T19:47:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3607ec9640 1 -- start start 2024-08-28T19:47:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3607ec9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3600102800 0x7f360019b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3607ec9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3600108140 0x7f360019b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3607ec9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3600108a90 0x7f360019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3607ec9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3600112770 con 0x7f3600108a90 2024-08-28T19:47:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3607ec9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f36001125f0 con 0x7f3600102800 2024-08-28T19:47:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3607ec9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f36001128f0 con 0x7f3600108140 2024-08-28T19:47:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3606466640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3600108a90 0x7f360019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3606466640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3600108a90 0x7f360019bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42624/0 (socket says 172.21.15.33:42624) 2024-08-28T19:47:37.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3606466640 1 -- 172.21.15.33:0/1328250992 learned_addr learned my addr 172.21.15.33:0/1328250992 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:37.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3605c65640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3600102800 0x7f360019b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3605464640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3600108140 0x7f360019b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3606466640 1 -- 172.21.15.33:0/1328250992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3600108140 msgr2=0x7f360019b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:37.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3606466640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3600108140 0x7f360019b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3606466640 1 -- 172.21.15.33:0/1328250992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3600102800 msgr2=0x7f360019b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:37.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3606466640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3600102800 0x7f360019b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.815+0000 7f3606466640 1 -- 172.21.15.33:0/1328250992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36001a6350 con 0x7f3600108a90 2024-08-28T19:47:37.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.816+0000 7f3606466640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3600108a90 0x7f360019bac0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005cc0 tx=0x7f35f802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:37.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.816+0000 7f35f6ffd640 1 -- 172.21.15.33:0/1328250992 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8003cf0 con 0x7f3600108a90 2024-08-28T19:47:37.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.816+0000 7f35f6ffd640 1 -- 172.21.15.33:0/1328250992 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f80044f0 con 0x7f3600108a90 2024-08-28T19:47:37.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.816+0000 7f3607ec9640 1 -- 172.21.15.33:0/1328250992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36001a65e0 con 0x7f3600108a90 2024-08-28T19:47:37.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.816+0000 7f35f6ffd640 1 -- 172.21.15.33:0/1328250992 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f802fc30 con 0x7f3600108a90 2024-08-28T19:47:37.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.816+0000 7f3607ec9640 1 -- 172.21.15.33:0/1328250992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36001a6bf0 con 0x7f3600108a90 2024-08-28T19:47:37.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.819+0000 7f360e43e740 1 Processor -- start 2024-08-28T19:47:37.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.819+0000 7f35f6ffd640 1 -- 172.21.15.33:0/1328250992 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f35f80046a0 con 0x7f3600108a90 2024-08-28T19:47:37.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.819+0000 7f360e43e740 1 -- start start 2024-08-28T19:47:37.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f360e43e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80d1070 0x5586f8476310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f360e43e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8476850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f360e43e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f8476d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f360e43e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586f83ed680 con 0x5586f80a81b0 2024-08-28T19:47:37.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f360e43e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5586f83dcc10 con 0x5586f80d1070 2024-08-28T19:47:37.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f360e43e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5586f83e0bc0 con 0x5586f80b0390 2024-08-28T19:47:37.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605c65640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8476850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605c65640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8476850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42640/0 (socket says 172.21.15.33:42640) 2024-08-28T19:47:37.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605c65640 1 -- 172.21.15.33:0/3361514684 learned_addr learned my addr 172.21.15.33:0/3361514684 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:37.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605464640 1 --2- 172.21.15.33:0/3361514684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f8476d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605464640 1 --2- 172.21.15.33:0/3361514684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80d1070 0x5586f8476310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f35f6ffd640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35ec0b4d20 0x7f35ec0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605c65640 1 -- 172.21.15.33:0/3361514684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 msgr2=0x5586f8476d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:37.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605c65640 1 --2- 172.21.15.33:0/3361514684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f8476d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605c65640 1 -- 172.21.15.33:0/3361514684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80d1070 msgr2=0x5586f8476310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:37.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605c65640 1 --2- 172.21.15.33:0/3361514684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80d1070 0x5586f8476310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605c65640 1 -- 172.21.15.33:0/3361514684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586f813c650 con 0x5586f80a81b0 2024-08-28T19:47:37.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3606466640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35ec0b4d20 0x7f35ec0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.820+0000 7f3605c65640 1 --2- 172.21.15.33:0/3361514684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8476850 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009a40 tx=0x7f35fc009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a570657456708e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:37.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.821+0000 7f35f6ffd640 1 -- 172.21.15.33:0/1328250992 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f35f8106d50 con 0x7f3600108a90 2024-08-28T19:47:37.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.821+0000 7f35ebfff640 1 -- 172.21.15.33:0/3361514684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc020070 con 0x5586f80a81b0 2024-08-28T19:47:37.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.821+0000 7f35ebfff640 1 -- 172.21.15.33:0/3361514684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35fc013650 con 0x5586f80a81b0 2024-08-28T19:47:37.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.821+0000 7f3606466640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35ec0b4d20 0x7f35ec0b7230 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f35f80ca2b0 tx=0x7f35f80cc990 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:37.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.821+0000 7f35ebfff640 1 -- 172.21.15.33:0/3361514684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc01b730 con 0x5586f80a81b0 2024-08-28T19:47:37.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 -- 172.21.15.33:0/3361514684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 msgr2=0x5586f8476850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:37.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 --2- 172.21.15.33:0/3361514684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8476850 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009a40 tx=0x7f35fc009f00 comp rx=0 tx=0).stop 2024-08-28T19:47:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 -- 172.21.15.33:0/3361514684 shutdown_connections 2024-08-28T19:47:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 --2- 172.21.15.33:0/3361514684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f8476d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 --2- 172.21.15.33:0/3361514684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8476850 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 --2- 172.21.15.33:0/3361514684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80d1070 0x5586f8476310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 -- 172.21.15.33:0/3361514684 >> 172.21.15.33:0/3361514684 conn(0x5586f80c5460 msgr2=0x5586f8474200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 -- 172.21.15.33:0/3361514684 shutdown_connections 2024-08-28T19:47:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 -- 172.21.15.33:0/3361514684 wait complete. 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 -- start start 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.822+0000 7f360e43e740 1 Processor -- start 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f360e43e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80a81b0 0x5586f8481aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f360e43e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80b0390 0x5586f8481fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f360e43e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f848de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f360e43e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586f823f700 con 0x5586f80d1070 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f360e43e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5586f8363750 con 0x5586f80b0390 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f360e43e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5586f8484af0 con 0x5586f80a81b0 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f360e43e740 10 client.0 _ll_register_callbacks cb 0x5586f8392e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f3605464640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f848de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f3605464640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f848de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42646/0 (socket says 172.21.15.33:42646) 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f3605464640 1 -- 172.21.15.33:0/1241069576 learned_addr learned my addr 172.21.15.33:0/1241069576 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f3605464640 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80a81b0 0x5586f8481aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f3605c65640 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80b0390 0x5586f8481fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f3605464640 1 -- 172.21.15.33:0/1241069576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80a81b0 msgr2=0x5586f8481aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f3605464640 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80a81b0 0x5586f8481aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f3605464640 1 -- 172.21.15.33:0/1241069576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80b0390 msgr2=0x5586f8481fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f3605464640 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80b0390 0x5586f8481fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.823+0000 7f3605464640 1 -- 172.21.15.33:0/1241069576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586f839c900 con 0x5586f80d1070 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f3605464640 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f848de10 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f35f000b010 tx=0x7f35f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5963097c847cd5c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f35e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f35e97fa640 1 -- 172.21.15.33:0/1241069576 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f000dde0 con 0x5586f80d1070 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f35e97fa640 1 -- 172.21.15.33:0/1241069576 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f35f0005020 con 0x5586f80d1070 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f360e43e740 1 -- 172.21.15.33:0/1241069576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35fc013650 con 0x5586f80d1070 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f35e97fa640 1 -- 172.21.15.33:0/1241069576 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f35f0005220 con 0x5586f80d1070 2024-08-28T19:47:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f360e43e740 10 client.19575 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f360e43e740 1 -- 172.21.15.33:0/1241069576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586f84908b0 con 0x5586f80d1070 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f35e97fa640 1 -- 172.21.15.33:0/1241069576 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35fc013650 con 0x5586f80d1070 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f35e97fa640 1 -- 172.21.15.33:0/1241069576 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f35f0004940 con 0x5586f80d1070 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f360e43e740 10 client.19575 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f360e43e740 10 client.19575 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f360e43e740 20 client.19575 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f360e43e740 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5586f808f9f0 0x5586f8493d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f360e43e740 4 client.19575 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.824+0000 7f360e43e740 1 -- 172.21.15.33:0/1241069576 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586f83ef5d0 con 0x5586f808f9f0 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.825+0000 7f3605c65640 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5586f808f9f0 0x5586f8493d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.825+0000 7f3605c65640 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5586f808f9f0 0x5586f8493d60 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=beb93290666b6018 server_cookie=7a84948a42579574 in_seq=0 out_seq=0 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.825+0000 7f35e97fa640 10 client.19575 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:47:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f35e97fa640 1 -- 172.21.15.33:0/1241069576 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586f83ef5d0 con 0x5586f808f9f0 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f35e97fa640 10 client.19575 handle_command_reply: tid=0 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f360e43e740 1 client.19575 shutdown 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f360e43e740 1 -- 172.21.15.33:0/1241069576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 msgr2=0x5586f848de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f360e43e740 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f848de10 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f35f000b010 tx=0x7f35f0004730 comp rx=0 tx=0).stop 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f360e43e740 1 -- 172.21.15.33:0/1241069576 shutdown_connections 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f360e43e740 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5586f808f9f0 0x5586f8493d60 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f360e43e740 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f848de10 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f360e43e740 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80b0390 0x5586f8481fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f360e43e740 1 --2- 172.21.15.33:0/1241069576 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80a81b0 0x5586f8481aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.826+0000 7f35e97fa640 0 client.19575 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.827+0000 7f360e43e740 1 -- 172.21.15.33:0/1241069576 >> 172.21.15.33:0/1241069576 conn(0x5586f80c5460 msgr2=0x5586f84794a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.827+0000 7f360e43e740 1 -- 172.21.15.33:0/1241069576 shutdown_connections 2024-08-28T19:47:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.827+0000 7f360e43e740 1 -- 172.21.15.33:0/1241069576 wait complete. 2024-08-28T19:47:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.827+0000 7f360e43e740 20 client.19575 trim_cache size 0 max 16384 2024-08-28T19:47:37.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.840+0000 7f360e43e740 1 Processor -- start 2024-08-28T19:47:37.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.840+0000 7f360e43e740 1 -- start start 2024-08-28T19:47:37.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.840+0000 7f360e43e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80a81b0 0x5586f8479b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.840+0000 7f360e43e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f847ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.840+0000 7f360e43e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f847f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.840+0000 7f360e43e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f36001aeb10 con 0x5586f80d1070 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.840+0000 7f360e43e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f36001b0650 con 0x5586f80a81b0 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.840+0000 7f360e43e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f36001af1e0 con 0x5586f80b0390 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.840+0000 7f3605464640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f847f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605464640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f847f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42662/0 (socket says 172.21.15.33:42662) 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605464640 1 -- 172.21.15.33:0/1086312000 learned_addr learned my addr 172.21.15.33:0/1086312000 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605464640 1 --2- 172.21.15.33:0/1086312000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80a81b0 0x5586f8479b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605c65640 1 --2- 172.21.15.33:0/1086312000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f847ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605464640 1 -- 172.21.15.33:0/1086312000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 msgr2=0x5586f847ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605464640 1 --2- 172.21.15.33:0/1086312000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f847ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605464640 1 -- 172.21.15.33:0/1086312000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80a81b0 msgr2=0x5586f8479b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:37.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605464640 1 --2- 172.21.15.33:0/1086312000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80a81b0 0x5586f8479b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605464640 1 -- 172.21.15.33:0/1086312000 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586f8482d60 con 0x5586f80d1070 2024-08-28T19:47:37.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605c65640 1 --2- 172.21.15.33:0/1086312000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f847ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:47:37.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f3605464640 1 --2- 172.21.15.33:0/1086312000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f847f1d0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f35f0005af0 tx=0x7f35f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a17704f69417eac server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:37.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f35eb7fe640 1 -- 172.21.15.33:0/1086312000 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f000dde0 con 0x5586f80d1070 2024-08-28T19:47:37.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f35eb7fe640 1 -- 172.21.15.33:0/1086312000 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f0005550 con 0x5586f80d1070 2024-08-28T19:47:37.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.841+0000 7f35eb7fe640 1 -- 172.21.15.33:0/1086312000 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f002d750 con 0x5586f80d1070 2024-08-28T19:47:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.842+0000 7f360e43e740 1 -- 172.21.15.33:0/1086312000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 msgr2=0x5586f847f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.842+0000 7f360e43e740 1 --2- 172.21.15.33:0/1086312000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f847f1d0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f35f0005af0 tx=0x7f35f00046c0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.842+0000 7f360e43e740 1 -- 172.21.15.33:0/1086312000 shutdown_connections 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.842+0000 7f360e43e740 1 --2- 172.21.15.33:0/1086312000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80d1070 0x5586f847f1d0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.842+0000 7f360e43e740 1 --2- 172.21.15.33:0/1086312000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f847ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.842+0000 7f360e43e740 1 --2- 172.21.15.33:0/1086312000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80a81b0 0x5586f8479b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.842+0000 7f360e43e740 1 -- 172.21.15.33:0/1086312000 >> 172.21.15.33:0/1086312000 conn(0x5586f80c5460 msgr2=0x5586f8479410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.842+0000 7f360e43e740 1 -- 172.21.15.33:0/1086312000 shutdown_connections 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.842+0000 7f360e43e740 1 -- 172.21.15.33:0/1086312000 wait complete. 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f360e43e740 1 -- start start 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f360e43e740 1 Processor -- start 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f360e43e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8486750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f360e43e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f8486d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f360e43e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80d1070 0x5586f84f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f360e43e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f36001aff80 con 0x5586f80a81b0 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f360e43e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f36001af8b0 con 0x5586f80d1070 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f360e43e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f36001acb10 con 0x5586f80b0390 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f360e43e740 10 client.0 _ll_register_callbacks cb 0x7f35f000acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f3605464640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8486750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f3605464640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8486750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42674/0 (socket says 172.21.15.33:42674) 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f3605464640 1 -- 172.21.15.33:0/2691055338 learned_addr learned my addr 172.21.15.33:0/2691055338 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.843+0000 7f3605c65640 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f8486d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f3605464640 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80d1070 0x5586f84f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f3605464640 1 -- 172.21.15.33:0/2691055338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 msgr2=0x5586f8486d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f3605464640 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f8486d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f3605464640 1 -- 172.21.15.33:0/2691055338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80d1070 msgr2=0x5586f84f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f3605464640 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80d1070 0x5586f84f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f3605464640 1 -- 172.21.15.33:0/2691055338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586f84f7e10 con 0x5586f80a81b0 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f3605464640 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8486750 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f35f00051f0 tx=0x7f35f00050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720cd20d87335da2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f35e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f35e97fa640 1 -- 172.21.15.33:0/2691055338 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0004220 con 0x5586f80a81b0 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f35e97fa640 1 -- 172.21.15.33:0/2691055338 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f35f00043c0 con 0x5586f80a81b0 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f360e43e740 1 -- 172.21.15.33:0/2691055338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f0005550 con 0x5586f80a81b0 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f35e97fa640 1 -- 172.21.15.33:0/2691055338 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f35f002d6e0 con 0x5586f80a81b0 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f360e43e740 10 client.19581 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.844+0000 7f360e43e740 1 -- 172.21.15.33:0/2691055338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586f84ff210 con 0x5586f80a81b0 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.845+0000 7f35e97fa640 1 -- 172.21.15.33:0/2691055338 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f0005550 con 0x5586f80a81b0 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.845+0000 7f35e97fa640 1 -- 172.21.15.33:0/2691055338 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f35f0003710 con 0x5586f80a81b0 2024-08-28T19:47:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.845+0000 7f360e43e740 10 client.19581 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.845+0000 7f360e43e740 10 client.19581 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:47:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.845+0000 7f360e43e740 20 client.19581 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.845+0000 7f360e43e740 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5586f8064da0 0x5586f8501a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.845+0000 7f360e43e740 4 client.19581 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:47:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.845+0000 7f360e43e740 1 -- 172.21.15.33:0/2691055338 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5586f83eb070 con 0x5586f8064da0 2024-08-28T19:47:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.845+0000 7f3605c65640 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5586f8064da0 0x5586f8501a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.845+0000 7f35e97fa640 10 client.19581 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:47:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f3605c65640 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5586f8064da0 0x5586f8501a00 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9245c8577db31160 server_cookie=db8ee5e696f71b7a in_seq=0 out_seq=0 2024-08-28T19:47:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f35e97fa640 1 -- 172.21.15.33:0/2691055338 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5586f83eb070 con 0x5586f8064da0 2024-08-28T19:47:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f35e97fa640 10 client.19581 handle_command_reply: tid=0 2024-08-28T19:47:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 client.19581 shutdown 2024-08-28T19:47:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 -- 172.21.15.33:0/2691055338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 msgr2=0x5586f8486750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8486750 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f35f00051f0 tx=0x7f35f00050d0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 -- 172.21.15.33:0/2691055338 shutdown_connections 2024-08-28T19:47:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5586f8064da0 0x5586f8501a00 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586f80d1070 0x5586f84f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586f80b0390 0x5586f8486d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f35e97fa640 0 client.19581 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:47:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 --2- 172.21.15.33:0/2691055338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586f80a81b0 0x5586f8486750 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 -- 172.21.15.33:0/2691055338 >> 172.21.15.33:0/2691055338 conn(0x5586f80c5460 msgr2=0x5586f8477340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 -- 172.21.15.33:0/2691055338 shutdown_connections 2024-08-28T19:47:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 1 -- 172.21.15.33:0/2691055338 wait complete. 2024-08-28T19:47:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.846+0000 7f360e43e740 20 client.19581 trim_cache size 0 max 16384 2024-08-28T19:47:37.855 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:47:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 -- 172.21.15.33:0/1328250992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35ec0b4d20 msgr2=0x7f35ec0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35ec0b4d20 0x7f35ec0b7230 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f35f80ca2b0 tx=0x7f35f80cc990 comp rx=0 tx=0).stop 2024-08-28T19:47:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 -- 172.21.15.33:0/1328250992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3600108a90 msgr2=0x7f360019bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3600108a90 0x7f360019bac0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005cc0 tx=0x7f35f802f470 comp rx=0 tx=0).stop 2024-08-28T19:47:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 -- 172.21.15.33:0/1328250992 shutdown_connections 2024-08-28T19:47:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3600108a90 0x7f360019bac0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f35ec0b4d20 0x7f35ec0b7230 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3600108140 0x7f360019b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 --2- 172.21.15.33:0/1328250992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3600102800 0x7f360019b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 -- 172.21.15.33:0/1328250992 >> 172.21.15.33:0/1328250992 conn(0x7f36000794d0 msgr2=0x7f3600105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 -- 172.21.15.33:0/1328250992 shutdown_connections 2024-08-28T19:47:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:37.847+0000 7f3607ec9640 1 -- 172.21.15.33:0/1328250992 wait complete. 2024-08-28T19:47:38.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:37 smithi059 ceph-mon[22052]: pgmap v815: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-08-28T19:47:38.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:37 smithi122 ceph-mon[22174]: pgmap v815: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-08-28T19:47:38.785 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:47:39.040 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:39.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.591+0000 7fce452c4640 1 -- 172.21.15.33:0/3775044009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce40109280 msgr2=0x7fce40109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:39.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.591+0000 7fce452c4640 1 --2- 172.21.15.33:0/3775044009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce40109280 0x7fce40109690 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fce38009ca0 tx=0x7fce3802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.591+0000 7fce452c4640 1 -- 172.21.15.33:0/3775044009 shutdown_connections 2024-08-28T19:47:39.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.591+0000 7fce452c4640 1 --2- 172.21.15.33:0/3775044009 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce40109bd0 0x7fce40110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.591+0000 7fce452c4640 1 --2- 172.21.15.33:0/3775044009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce40109280 0x7fce40109690 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.591+0000 7fce452c4640 1 --2- 172.21.15.33:0/3775044009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce40103940 0x7fce40103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.591+0000 7fce452c4640 1 -- 172.21.15.33:0/3775044009 >> 172.21.15.33:0/3775044009 conn(0x7fce400ff3d0 msgr2=0x7fce40101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:39.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.591+0000 7fce452c4640 1 -- 172.21.15.33:0/3775044009 shutdown_connections 2024-08-28T19:47:39.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.591+0000 7fce452c4640 1 -- 172.21.15.33:0/3775044009 wait complete. 2024-08-28T19:47:39.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.592+0000 7fce452c4640 1 Processor -- start 2024-08-28T19:47:39.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.592+0000 7fce452c4640 1 -- start start 2024-08-28T19:47:39.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce452c4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce40103940 0x7fce4019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce452c4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce40109280 0x7fce4019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce452c4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce40109bd0 0x7fce4019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce452c4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fce40113890 con 0x7fce40103940 2024-08-28T19:47:39.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce452c4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce40113710 con 0x7fce40109280 2024-08-28T19:47:39.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce452c4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fce40113a10 con 0x7fce40109bd0 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce40103940 0x7fce4019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce40103940 0x7fce4019a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33382/0 (socket says 172.21.15.33:33382) 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3effd640 1 -- 172.21.15.33:0/975084175 learned_addr learned my addr 172.21.15.33:0/975084175 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce40109280 0x7fce4019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce40109bd0 0x7fce4019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3effd640 1 -- 172.21.15.33:0/975084175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce40109bd0 msgr2=0x7fce4019fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3effd640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce40109bd0 0x7fce4019fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3effd640 1 -- 172.21.15.33:0/975084175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce40109280 msgr2=0x7fce4019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3effd640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce40109280 0x7fce4019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3effd640 1 -- 172.21.15.33:0/975084175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce401a01f0 con 0x7fce40103940 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce3effd640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce40103940 0x7fce4019a280 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fce3000e9f0 tx=0x7fce3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.593+0000 7fce27fff640 1 -- 172.21.15.33:0/975084175 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3000cd80 con 0x7fce40103940 2024-08-28T19:47:39.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.594+0000 7fce452c4640 1 -- 172.21.15.33:0/975084175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce401a04e0 con 0x7fce40103940 2024-08-28T19:47:39.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.594+0000 7fce27fff640 1 -- 172.21.15.33:0/975084175 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce300108e0 con 0x7fce40103940 2024-08-28T19:47:39.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.594+0000 7fce27fff640 1 -- 172.21.15.33:0/975084175 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30018980 con 0x7fce40103940 2024-08-28T19:47:39.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.594+0000 7fce452c4640 1 -- 172.21.15.33:0/975084175 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce401a6c40 con 0x7fce40103940 2024-08-28T19:47:39.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce4b839740 1 Processor -- start 2024-08-28T19:47:39.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce4b839740 1 -- start start 2024-08-28T19:47:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce4b839740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb48070 0x5625ceeed310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce27fff640 1 -- 172.21.15.33:0/975084175 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fce30010430 con 0x7fce40103940 2024-08-28T19:47:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce4b839740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 0x5625ceeed850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce4b839740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb27390 0x5625ceeedd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce4b839740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5625cee64680 con 0x5625ceb48070 2024-08-28T19:47:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce4b839740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5625cee53c10 con 0x5625ceb1f1b0 2024-08-28T19:47:39.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce4b839740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5625cee57bc0 con 0x5625ceb27390 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce3f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb48070 0x5625ceeed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce3f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb48070 0x5625ceeed310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33396/0 (socket says 172.21.15.33:33396) 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce3f7fe640 1 -- 172.21.15.33:0/1923452098 learned_addr learned my addr 172.21.15.33:0/1923452098 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.597+0000 7fce3effd640 1 --2- 172.21.15.33:0/1923452098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 0x5625ceeed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/1923452098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb27390 0x5625ceeedd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce3f7fe640 1 -- 172.21.15.33:0/1923452098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb27390 msgr2=0x5625ceeedd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/1923452098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb27390 0x5625ceeedd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce3f7fe640 1 -- 172.21.15.33:0/1923452098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 msgr2=0x5625ceeed850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/1923452098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 0x5625ceeed850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce3f7fe640 1 -- 172.21.15.33:0/1923452098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625cebb3650 con 0x5625ceb48070 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/1923452098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb48070 0x5625ceeed310 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fce34009ca0 tx=0x7fce34011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e9f26334aa5e17 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce27fff640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fce280b4ca0 0x7fce280b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce257fa640 1 -- 172.21.15.33:0/1923452098 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3401e070 con 0x5625ceb48070 2024-08-28T19:47:39.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce257fa640 1 -- 172.21.15.33:0/1923452098 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce34009e50 con 0x5625ceb48070 2024-08-28T19:47:39.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce257fa640 1 -- 172.21.15.33:0/1923452098 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3400e9f0 con 0x5625ceb48070 2024-08-28T19:47:39.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce3effd640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fce280b4ca0 0x7fce280b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.598+0000 7fce27fff640 1 -- 172.21.15.33:0/975084175 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fce300e5c50 con 0x7fce40103940 2024-08-28T19:47:39.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.599+0000 7fce4b839740 1 -- 172.21.15.33:0/1923452098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb48070 msgr2=0x5625ceeed310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:39.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.599+0000 7fce4b839740 1 --2- 172.21.15.33:0/1923452098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb48070 0x5625ceeed310 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fce34009ca0 tx=0x7fce34011810 comp rx=0 tx=0).stop 2024-08-28T19:47:39.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.599+0000 7fce3effd640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fce280b4ca0 0x7fce280b71b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x5625ceeebf90 tx=0x7fce30000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:39.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.599+0000 7fce4b839740 1 -- 172.21.15.33:0/1923452098 shutdown_connections 2024-08-28T19:47:39.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.599+0000 7fce4b839740 1 --2- 172.21.15.33:0/1923452098 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb27390 0x5625ceeedd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.599+0000 7fce4b839740 1 --2- 172.21.15.33:0/1923452098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 0x5625ceeed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.599+0000 7fce4b839740 1 --2- 172.21.15.33:0/1923452098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb48070 0x5625ceeed310 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.599+0000 7fce4b839740 1 -- 172.21.15.33:0/1923452098 >> 172.21.15.33:0/1923452098 conn(0x5625ceb3c460 msgr2=0x5625ceeeb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.599+0000 7fce4b839740 1 -- 172.21.15.33:0/1923452098 shutdown_connections 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.599+0000 7fce4b839740 1 -- 172.21.15.33:0/1923452098 wait complete. 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce4b839740 1 -- start start 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce4b839740 1 Processor -- start 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce4b839740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb1f1b0 0x5625ceef8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce4b839740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce4b839740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb48070 0x5625cef04de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce4b839740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5625cecb6700 con 0x5625ceb27390 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce4b839740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5625cedda750 con 0x5625ceb48070 2024-08-28T19:47:39.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce4b839740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5625ceefbaf0 con 0x5625ceb1f1b0 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce4b839740 10 client.0 _ll_register_callbacks cb 0x5625cee09e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33398/0 (socket says 172.21.15.33:33398) 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3e7fc640 1 -- 172.21.15.33:0/1936864459 learned_addr learned my addr 172.21.15.33:0/1936864459 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb48070 0x5625cef04de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb1f1b0 0x5625ceef8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3e7fc640 1 -- 172.21.15.33:0/1936864459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb1f1b0 msgr2=0x5625ceef8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb1f1b0 0x5625ceef8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3e7fc640 1 -- 172.21.15.33:0/1936864459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb48070 msgr2=0x5625cef04de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb48070 0x5625cef04de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3e7fc640 1 -- 172.21.15.33:0/1936864459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625cee13900 con 0x5625ceb27390 2024-08-28T19:47:39.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.600+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb48070 0x5625cef04de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.601+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef8fd0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fce38009ca0 tx=0x7fce38009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffaef4956fbf0c1e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.601+0000 7fce22ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.601+0000 7fce22ff5640 1 -- 172.21.15.33:0/1936864459 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38031660 con 0x5625ceb27390 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.601+0000 7fce22ff5640 1 -- 172.21.15.33:0/1936864459 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fce38031800 con 0x5625ceb27390 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.601+0000 7fce4b839740 1 -- 172.21.15.33:0/1936864459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce34009e50 con 0x5625ceb27390 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.601+0000 7fce22ff5640 1 -- 172.21.15.33:0/1936864459 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fce38050050 con 0x5625ceb27390 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.601+0000 7fce4b839740 10 client.19593 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.601+0000 7fce4b839740 1 -- 172.21.15.33:0/1936864459 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5625cef07860 con 0x5625ceb27390 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.601+0000 7fce22ff5640 1 -- 172.21.15.33:0/1936864459 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce34009e50 con 0x5625ceb27390 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.602+0000 7fce22ff5640 1 -- 172.21.15.33:0/1936864459 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fce380046c0 con 0x5625ceb27390 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.602+0000 7fce4b839740 10 client.19593 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:39.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.602+0000 7fce4b839740 10 client.19593 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.602+0000 7fce4b839740 20 client.19593 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.602+0000 7fce4b839740 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5625ceb069f0 0x5625cef0ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.602+0000 7fce4b839740 4 client.19593 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.602+0000 7fce4b839740 1 -- 172.21.15.33:0/1936864459 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625cee665d0 con 0x5625ceb069f0 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.602+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5625ceb069f0 0x5625cef0ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.602+0000 7fce22ff5640 10 client.19593 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.602+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5625ceb069f0 0x5625cef0ae00 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c0a9a5b300d7d4db server_cookie=f0cd54d3adc688c6 in_seq=0 out_seq=0 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.603+0000 7fce22ff5640 1 -- 172.21.15.33:0/1936864459 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5625cee665d0 con 0x5625ceb069f0 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.603+0000 7fce22ff5640 10 client.19593 handle_command_reply: tid=0 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.603+0000 7fce4b839740 1 client.19593 shutdown 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 1 -- 172.21.15.33:0/1936864459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 msgr2=0x5625ceef8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef8fd0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fce38009ca0 tx=0x7fce38009800 comp rx=0 tx=0).stop 2024-08-28T19:47:39.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 1 -- 172.21.15.33:0/1936864459 shutdown_connections 2024-08-28T19:47:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5625ceb069f0 0x5625cef0ae00 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce22ff5640 0 client.19593 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:47:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb48070 0x5625cef04de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef8fd0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 1 --2- 172.21.15.33:0/1936864459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb1f1b0 0x5625ceef8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 1 -- 172.21.15.33:0/1936864459 >> 172.21.15.33:0/1936864459 conn(0x5625ceb3c460 msgr2=0x5625ceef04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 1 -- 172.21.15.33:0/1936864459 shutdown_connections 2024-08-28T19:47:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 1 -- 172.21.15.33:0/1936864459 wait complete. 2024-08-28T19:47:39.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.604+0000 7fce4b839740 20 client.19593 trim_cache size 0 max 16384 2024-08-28T19:47:39.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.617+0000 7fce4b839740 1 Processor -- start 2024-08-28T19:47:39.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.617+0000 7fce4b839740 1 -- start start 2024-08-28T19:47:39.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce4b839740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb069f0 0x5625ceef0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce4b839740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 0x5625cef04ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce4b839740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce4b839740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fce401b0ce0 con 0x5625ceb27390 2024-08-28T19:47:39.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce4b839740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce401b2820 con 0x5625ceb1f1b0 2024-08-28T19:47:39.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce4b839740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fce401b13b0 con 0x5625ceb069f0 2024-08-28T19:47:39.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 0x5625cef04ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33410/0 (socket says 172.21.15.33:33410) 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3f7fe640 1 -- 172.21.15.33:0/74626140 learned_addr learned my addr 172.21.15.33:0/74626140 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/74626140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb069f0 0x5625ceef0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3e7fc640 1 -- 172.21.15.33:0/74626140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb069f0 msgr2=0x5625ceef0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/74626140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb069f0 0x5625ceef0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3e7fc640 1 -- 172.21.15.33:0/74626140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 msgr2=0x5625ceef5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/74626140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3e7fc640 1 -- 172.21.15.33:0/74626140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625ceef1060 con 0x5625ceb1f1b0 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.618+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/74626140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:47:39.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.619+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/74626140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 0x5625cef04ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce380094a0 tx=0x7fce3802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4990dcc66511d96 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.619+0000 7fce24ff9640 1 -- 172.21.15.33:0/74626140 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3802fbe0 con 0x5625ceb1f1b0 2024-08-28T19:47:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.619+0000 7fce24ff9640 1 -- 172.21.15.33:0/74626140 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce38036050 con 0x5625ceb1f1b0 2024-08-28T19:47:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.619+0000 7fce24ff9640 1 -- 172.21.15.33:0/74626140 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38003d70 con 0x5625ceb1f1b0 2024-08-28T19:47:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 -- 172.21.15.33:0/74626140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 msgr2=0x5625cef04ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 --2- 172.21.15.33:0/74626140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 0x5625cef04ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce380094a0 tx=0x7fce3802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 -- 172.21.15.33:0/74626140 shutdown_connections 2024-08-28T19:47:39.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 --2- 172.21.15.33:0/74626140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb27390 0x5625ceef5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 --2- 172.21.15.33:0/74626140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb1f1b0 0x5625cef04ce0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 --2- 172.21.15.33:0/74626140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb069f0 0x5625ceef0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 -- 172.21.15.33:0/74626140 >> 172.21.15.33:0/74626140 conn(0x5625ceb3c460 msgr2=0x5625ceef0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 -- 172.21.15.33:0/74626140 shutdown_connections 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 -- 172.21.15.33:0/74626140 wait complete. 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 -- start start 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 Processor -- start 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.620+0000 7fce4b839740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb069f0 0x5625ceefcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce4b839740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb1f1b0 0x5625ceefd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce4b839740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb27390 0x5625ceefd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce4b839740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fce401b2150 con 0x5625ceb1f1b0 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce4b839740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce401b1a80 con 0x5625ceb069f0 2024-08-28T19:47:39.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce4b839740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fce401aed30 con 0x5625ceb27390 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce4b839740 10 client.0 _ll_register_callbacks cb 0x7fce34005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb1f1b0 0x5625ceefd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb1f1b0 0x5625ceefd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33422/0 (socket says 172.21.15.33:33422) 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3e7fc640 1 -- 172.21.15.33:0/3824335626 learned_addr learned my addr 172.21.15.33:0/3824335626 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb069f0 0x5625ceefcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb27390 0x5625ceefd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3e7fc640 1 -- 172.21.15.33:0/3824335626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb27390 msgr2=0x5625ceefd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb27390 0x5625ceefd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3e7fc640 1 -- 172.21.15.33:0/3824335626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb069f0 msgr2=0x5625ceefcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb069f0 0x5625ceefcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3e7fc640 1 -- 172.21.15.33:0/3824335626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625cef747a0 con 0x5625ceb1f1b0 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce3e7fc640 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb1f1b0 0x5625ceefd240 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fce38043040 tx=0x7fce38009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4deb980e15409f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:39.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce22ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.621+0000 7fce22ff5640 1 -- 172.21.15.33:0/3824335626 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38061060 con 0x5625ceb1f1b0 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce22ff5640 1 -- 172.21.15.33:0/3824335626 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fce38004b40 con 0x5625ceb1f1b0 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce4b839740 1 -- 172.21.15.33:0/3824335626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce38036050 con 0x5625ceb1f1b0 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce22ff5640 1 -- 172.21.15.33:0/3824335626 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fce38068050 con 0x5625ceb1f1b0 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce4b839740 10 client.19599 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce4b839740 1 -- 172.21.15.33:0/3824335626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5625cef75a00 con 0x5625ceb1f1b0 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce22ff5640 1 -- 172.21.15.33:0/3824335626 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce38036050 con 0x5625ceb1f1b0 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce22ff5640 1 -- 172.21.15.33:0/3824335626 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fce38054430 con 0x5625ceb1f1b0 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce4b839740 10 client.19599 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce4b839740 10 client.19599 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce4b839740 20 client.19599 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce4b839740 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5625ceb48070 0x5625cef78070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce4b839740 4 client.19599 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:47:39.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.622+0000 7fce4b839740 1 -- 172.21.15.33:0/3824335626 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5625cee62070 con 0x5625ceb48070 2024-08-28T19:47:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5625ceb48070 0x5625cef78070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:39.628 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:39 smithi033 ceph-mon[18549]: pgmap v816: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-08-28T19:47:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce22ff5640 10 client.19599 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:47:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce3f7fe640 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5625ceb48070 0x5625cef78070 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3bb01085d95a1942 server_cookie=5021424e2e8c6d56 in_seq=0 out_seq=0 2024-08-28T19:47:39.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce22ff5640 1 -- 172.21.15.33:0/3824335626 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5625cee62070 con 0x5625ceb48070 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce22ff5640 10 client.19599 handle_command_reply: tid=0 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce4b839740 1 client.19599 shutdown 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce4b839740 1 -- 172.21.15.33:0/3824335626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb1f1b0 msgr2=0x5625ceefd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce4b839740 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb1f1b0 0x5625ceefd240 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fce38043040 tx=0x7fce38009800 comp rx=0 tx=0).stop 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce4b839740 1 -- 172.21.15.33:0/3824335626 shutdown_connections 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce4b839740 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x5625ceb48070 0x5625cef78070 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce4b839740 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5625ceb27390 0x5625ceefd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.623+0000 7fce4b839740 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5625ceb1f1b0 0x5625ceefd240 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce4b839740 1 --2- 172.21.15.33:0/3824335626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5625ceb069f0 0x5625ceefcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce22ff5640 0 client.19599 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce4b839740 1 -- 172.21.15.33:0/3824335626 >> 172.21.15.33:0/3824335626 conn(0x5625ceb3c460 msgr2=0x5625ceeee340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce4b839740 1 -- 172.21.15.33:0/3824335626 shutdown_connections 2024-08-28T19:47:39.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce4b839740 1 -- 172.21.15.33:0/3824335626 wait complete. 2024-08-28T19:47:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce4b839740 20 client.19599 trim_cache size 0 max 16384 2024-08-28T19:47:39.630 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:47:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce452c4640 1 -- 172.21.15.33:0/975084175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fce280b4ca0 msgr2=0x7fce280b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce452c4640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fce280b4ca0 0x7fce280b71b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x5625ceeebf90 tx=0x7fce30000bc0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce452c4640 1 -- 172.21.15.33:0/975084175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce40103940 msgr2=0x7fce4019a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce452c4640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce40103940 0x7fce4019a280 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fce3000e9f0 tx=0x7fce3000eeb0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce452c4640 1 -- 172.21.15.33:0/975084175 shutdown_connections 2024-08-28T19:47:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce452c4640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fce280b4ca0 0x7fce280b71b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce452c4640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fce40109bd0 0x7fce4019fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce452c4640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce40109280 0x7fce4019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce452c4640 1 --2- 172.21.15.33:0/975084175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce40103940 0x7fce4019a280 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.624+0000 7fce452c4640 1 -- 172.21.15.33:0/975084175 >> 172.21.15.33:0/975084175 conn(0x7fce400ff3d0 msgr2=0x7fce401017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.625+0000 7fce452c4640 1 -- 172.21.15.33:0/975084175 shutdown_connections 2024-08-28T19:47:39.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:39.625+0000 7fce452c4640 1 -- 172.21.15.33:0/975084175 wait complete. 2024-08-28T19:47:39.846 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:39 smithi122 ceph-mon[22174]: pgmap v816: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-08-28T19:47:40.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:39 smithi059 ceph-mon[22052]: pgmap v816: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-08-28T19:47:40.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:47:40.677 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.223+0000 7f342ed3a640 1 -- 172.21.15.33:0/766301269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3428109b90 msgr2=0x7f34281103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.223+0000 7f342ed3a640 1 --2- 172.21.15.33:0/766301269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3428109b90 0x7f34281103c0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f3420009ca0 tx=0x7f342002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.223+0000 7f342ed3a640 1 -- 172.21.15.33:0/766301269 shutdown_connections 2024-08-28T19:47:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.223+0000 7f342ed3a640 1 --2- 172.21.15.33:0/766301269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3428109b90 0x7f34281103c0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.223+0000 7f342ed3a640 1 --2- 172.21.15.33:0/766301269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428109240 0x7f3428109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.223+0000 7f342ed3a640 1 --2- 172.21.15.33:0/766301269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3428103900 0x7f3428103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.223+0000 7f342ed3a640 1 -- 172.21.15.33:0/766301269 >> 172.21.15.33:0/766301269 conn(0x7f342807b5f0 msgr2=0x7f342807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.223+0000 7f342ed3a640 1 -- 172.21.15.33:0/766301269 shutdown_connections 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.223+0000 7f342ed3a640 1 -- 172.21.15.33:0/766301269 wait complete. 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.224+0000 7f342ed3a640 1 Processor -- start 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.224+0000 7f342ed3a640 1 -- start start 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.224+0000 7f342ed3a640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3428103900 0x7f34280754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.224+0000 7f342ed3a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3428109240 0x7f34280759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.224+0000 7f342ed3a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428109b90 0x7f3428075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.224+0000 7f342ed3a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3428113850 con 0x7f3428109240 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.224+0000 7f342ed3a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34281136d0 con 0x7f3428109b90 2024-08-28T19:47:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.224+0000 7f342ed3a640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f34281139d0 con 0x7f3428103900 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3427fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3428109240 0x7f34280759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f342cad6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3428103900 0x7f34280754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3427fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3428109240 0x7f34280759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33440/0 (socket says 172.21.15.33:33440) 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3427fff640 1 -- 172.21.15.33:0/3136958068 learned_addr learned my addr 172.21.15.33:0/3136958068 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f342d2d7640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428109b90 0x7f3428075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3427fff640 1 -- 172.21.15.33:0/3136958068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3428103900 msgr2=0x7f34280754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3427fff640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3428103900 0x7f34280754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3427fff640 1 -- 172.21.15.33:0/3136958068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428109b90 msgr2=0x7f3428075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3427fff640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428109b90 0x7f3428075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3427fff640 1 -- 172.21.15.33:0/3136958068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34281a84a0 con 0x7f3428109240 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f342cad6640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3428103900 0x7f34280754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f342d2d7640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428109b90 0x7f3428075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3427fff640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3428109240 0x7f34280759f0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f341800e9f0 tx=0x7f341800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3425ffb640 1 -- 172.21.15.33:0/3136958068 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341800ccc0 con 0x7f3428109240 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f342ed3a640 1 -- 172.21.15.33:0/3136958068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34281a8790 con 0x7f3428109240 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3425ffb640 1 -- 172.21.15.33:0/3136958068 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34180108e0 con 0x7f3428109240 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.225+0000 7f3425ffb640 1 -- 172.21.15.33:0/3136958068 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418018860 con 0x7f3428109240 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.226+0000 7f342ed3a640 1 -- 172.21.15.33:0/3136958068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34281a8d20 con 0x7f3428109240 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.228+0000 7f3425ffb640 1 -- 172.21.15.33:0/3136958068 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3418010430 con 0x7f3428109240 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.228+0000 7f34352af740 1 Processor -- start 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.228+0000 7f34352af740 1 -- start start 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f34352af740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d76740310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f34352af740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 0x560d76740850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f34352af740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76740d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f34352af740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560d766b7680 con 0x560d7639b070 2024-08-28T19:47:41.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f34352af740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560d766a6c10 con 0x560d763721b0 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f34352af740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560d766aabc0 con 0x560d7637a390 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342d2d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d76740310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342d2d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d76740310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33452/0 (socket says 172.21.15.33:33452) 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342d2d7640 1 -- 172.21.15.33:0/288514558 learned_addr learned my addr 172.21.15.33:0/288514558 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f3425ffb640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34140b4ca0 0x7f34140b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342cad6640 1 --2- 172.21.15.33:0/288514558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 0x560d76740850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f3427fff640 1 --2- 172.21.15.33:0/288514558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76740d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342d2d7640 1 -- 172.21.15.33:0/288514558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 msgr2=0x560d76740d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342d2d7640 1 --2- 172.21.15.33:0/288514558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76740d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342d2d7640 1 -- 172.21.15.33:0/288514558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 msgr2=0x560d76740850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342d2d7640 1 --2- 172.21.15.33:0/288514558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 0x560d76740850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342d2d7640 1 -- 172.21.15.33:0/288514558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d76406650 con 0x560d7639b070 2024-08-28T19:47:41.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342cad6640 1 --2- 172.21.15.33:0/288514558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 0x560d76740850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f3425ffb640 1 -- 172.21.15.33:0/3136958068 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f34180e5bb0 con 0x7f3428109240 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.229+0000 7f342d2d7640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34140b4ca0 0x7f34140b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.230+0000 7f342d2d7640 1 --2- 172.21.15.33:0/288514558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d76740310 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f3420009830 tx=0x7f3420009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3d2cea8dac4f0f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.230+0000 7f341effd640 1 -- 172.21.15.33:0/288514558 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420003ab0 con 0x560d7639b070 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.230+0000 7f341effd640 1 -- 172.21.15.33:0/288514558 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3420036040 con 0x560d7639b070 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.230+0000 7f341effd640 1 -- 172.21.15.33:0/288514558 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420004860 con 0x560d7639b070 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 -- 172.21.15.33:0/288514558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 msgr2=0x560d76740310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 --2- 172.21.15.33:0/288514558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d76740310 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f3420009830 tx=0x7f3420009860 comp rx=0 tx=0).stop 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f342d2d7640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34140b4ca0 0x7f34140b71b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f342004c000 tx=0x7f3420049000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 -- 172.21.15.33:0/288514558 shutdown_connections 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 --2- 172.21.15.33:0/288514558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76740d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 --2- 172.21.15.33:0/288514558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 0x560d76740850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 --2- 172.21.15.33:0/288514558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d76740310 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 -- 172.21.15.33:0/288514558 >> 172.21.15.33:0/288514558 conn(0x560d7638f460 msgr2=0x560d7673e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 -- 172.21.15.33:0/288514558 shutdown_connections 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 -- 172.21.15.33:0/288514558 wait complete. 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 -- start start 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.231+0000 7f34352af740 1 Processor -- start 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f34352af740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d763721b0 0x560d7674ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f34352af740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7637a390 0x560d7674bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f34352af740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7639b070 0x560d76757c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f34352af740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x560d76509700 con 0x560d7637a390 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f34352af740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560d7662d750 con 0x560d7639b070 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f34352af740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x560d7674e970 con 0x560d763721b0 2024-08-28T19:47:41.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f34352af740 10 client.0 _ll_register_callbacks cb 0x560d7665ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f3427fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7637a390 0x560d7674bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f3427fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7637a390 0x560d7674bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33454/0 (socket says 172.21.15.33:33454) 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f3427fff640 1 -- 172.21.15.33:0/1621564275 learned_addr learned my addr 172.21.15.33:0/1621564275 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f342cad6640 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d763721b0 0x560d7674ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f342d2d7640 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7639b070 0x560d76757c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f3427fff640 1 -- 172.21.15.33:0/1621564275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d763721b0 msgr2=0x560d7674ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f3427fff640 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d763721b0 0x560d7674ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f3427fff640 1 -- 172.21.15.33:0/1621564275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7639b070 msgr2=0x560d76757c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f3427fff640 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7639b070 0x560d76757c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.232+0000 7f3427fff640 1 -- 172.21.15.33:0/1621564275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d76666900 con 0x560d7637a390 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f3427fff640 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7637a390 0x560d7674bfc0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f34180a7f80 tx=0x7f34180096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54692e34b90dd781 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f3407fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:41.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f3407fff640 1 -- 172.21.15.33:0/1621564275 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34180932d0 con 0x560d7637a390 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f3407fff640 1 -- 172.21.15.33:0/1621564275 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f34180ab160 con 0x560d7637a390 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f34352af740 1 -- 172.21.15.33:0/1621564275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3420036040 con 0x560d7637a390 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f3407fff640 1 -- 172.21.15.33:0/1621564275 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34180aba10 con 0x560d7637a390 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f34352af740 10 client.19611 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f34352af740 1 -- 172.21.15.33:0/1621564275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d7675a730 con 0x560d7637a390 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f3407fff640 1 -- 172.21.15.33:0/1621564275 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3420036040 con 0x560d7637a390 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f3407fff640 1 -- 172.21.15.33:0/1621564275 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f34180b0370 con 0x560d7637a390 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f34352af740 10 client.19611 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f34352af740 10 client.19611 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f34352af740 20 client.19611 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.233+0000 7f34352af740 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560d763599f0 0x560d7675dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.234+0000 7f34352af740 4 client.19611 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.234+0000 7f34352af740 1 -- 172.21.15.33:0/1621564275 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d766b95d0 con 0x560d763599f0 2024-08-28T19:47:41.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.234+0000 7f342cad6640 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560d763599f0 0x560d7675dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.234+0000 7f342cad6640 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560d763599f0 0x560d7675dc00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1e7877dcf4291dca server_cookie=cb12abe9c1618ec9 in_seq=0 out_seq=0 2024-08-28T19:47:41.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.234+0000 7f3407fff640 10 client.19611 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:47:41.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f3407fff640 1 -- 172.21.15.33:0/1621564275 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d766b95d0 con 0x560d763599f0 2024-08-28T19:47:41.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f3407fff640 10 client.19611 handle_command_reply: tid=0 2024-08-28T19:47:41.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 client.19611 shutdown 2024-08-28T19:47:41.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 -- 172.21.15.33:0/1621564275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7637a390 msgr2=0x560d7674bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:41.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7637a390 0x560d7674bfc0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f34180a7f80 tx=0x7f34180096a0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 -- 172.21.15.33:0/1621564275 shutdown_connections 2024-08-28T19:47:41.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7639b070 0x560d76757c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560d763599f0 0x560d7675dc00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7637a390 0x560d7674bfc0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 --2- 172.21.15.33:0/1621564275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d763721b0 0x560d7674ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f3407fff640 0 client.19611 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:47:41.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 -- 172.21.15.33:0/1621564275 >> 172.21.15.33:0/1621564275 conn(0x560d7638f460 msgr2=0x560d767434f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:41.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 -- 172.21.15.33:0/1621564275 shutdown_connections 2024-08-28T19:47:41.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.235+0000 7f34352af740 1 -- 172.21.15.33:0/1621564275 wait complete. 2024-08-28T19:47:41.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.236+0000 7f34352af740 20 client.19611 trim_cache size 0 max 16384 2024-08-28T19:47:41.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f34352af740 1 Processor -- start 2024-08-28T19:47:41.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f34352af740 1 -- start start 2024-08-28T19:47:41.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f34352af740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d763721b0 0x560d76743b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f34352af740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76748c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f34352af740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7639b070 0x560d767491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f34352af740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f34281b2d60 con 0x560d763721b0 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f34352af740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34281b48a0 con 0x560d7639b070 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f34352af740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f34281b3430 con 0x560d7637a390 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f342cad6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d763721b0 0x560d76743b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f342cad6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d763721b0 0x560d76743b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33462/0 (socket says 172.21.15.33:33462) 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f342cad6640 1 -- 172.21.15.33:0/1917393561 learned_addr learned my addr 172.21.15.33:0/1917393561 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f342d2d7640 1 --2- 172.21.15.33:0/1917393561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7639b070 0x560d767491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f3427fff640 1 --2- 172.21.15.33:0/1917393561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76748c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f342cad6640 1 -- 172.21.15.33:0/1917393561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 msgr2=0x560d76748c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f342cad6640 1 --2- 172.21.15.33:0/1917393561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76748c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f342cad6640 1 -- 172.21.15.33:0/1917393561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7639b070 msgr2=0x560d767491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f342cad6640 1 --2- 172.21.15.33:0/1917393561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7639b070 0x560d767491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.249+0000 7f342cad6640 1 -- 172.21.15.33:0/1917393561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d76742830 con 0x560d763721b0 2024-08-28T19:47:41.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.250+0000 7f342cad6640 1 --2- 172.21.15.33:0/1917393561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d763721b0 0x560d76743b20 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f3428076f00 tx=0x7f3410013b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40d3ff75393f084 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:41.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.250+0000 7f341e7fc640 1 -- 172.21.15.33:0/1917393561 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410013ca0 con 0x560d763721b0 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.250+0000 7f341e7fc640 1 -- 172.21.15.33:0/1917393561 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3410013e40 con 0x560d763721b0 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.250+0000 7f341e7fc640 1 -- 172.21.15.33:0/1917393561 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3410005260 con 0x560d763721b0 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.250+0000 7f34352af740 1 -- 172.21.15.33:0/1917393561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d763721b0 msgr2=0x560d76743b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.250+0000 7f34352af740 1 --2- 172.21.15.33:0/1917393561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d763721b0 0x560d76743b20 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f3428076f00 tx=0x7f3410013b70 comp rx=0 tx=0).stop 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.251+0000 7f34352af740 1 -- 172.21.15.33:0/1917393561 shutdown_connections 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.251+0000 7f34352af740 1 --2- 172.21.15.33:0/1917393561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7639b070 0x560d767491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.251+0000 7f34352af740 1 --2- 172.21.15.33:0/1917393561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76748c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.251+0000 7f34352af740 1 --2- 172.21.15.33:0/1917393561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d763721b0 0x560d76743b20 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.251+0000 7f34352af740 1 -- 172.21.15.33:0/1917393561 >> 172.21.15.33:0/1917393561 conn(0x560d7638f460 msgr2=0x560d76743410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.251+0000 7f34352af740 1 -- 172.21.15.33:0/1917393561 shutdown_connections 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.251+0000 7f34352af740 1 -- 172.21.15.33:0/1917393561 wait complete. 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.251+0000 7f34352af740 1 -- start start 2024-08-28T19:47:41.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.251+0000 7f34352af740 1 Processor -- start 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f34352af740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 0x560d76750500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f34352af740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76750aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f34352af740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d767c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f34352af740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f34281b41d0 con 0x560d7639b070 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f34352af740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34281b3b00 con 0x560d763721b0 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f34352af740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f34281b0d60 con 0x560d7637a390 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f34352af740 10 client.0 _ll_register_callbacks cb 0x7f34180a8640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342d2d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d767c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342d2d7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d767c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33468/0 (socket says 172.21.15.33:33468) 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342d2d7640 1 -- 172.21.15.33:0/2506695668 learned_addr learned my addr 172.21.15.33:0/2506695668 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342cad6640 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 0x560d76750500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f3427fff640 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76750aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342d2d7640 1 -- 172.21.15.33:0/2506695668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 msgr2=0x560d76750aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342d2d7640 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76750aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342d2d7640 1 -- 172.21.15.33:0/2506695668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 msgr2=0x560d76750500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342d2d7640 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 0x560d76750500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342d2d7640 1 -- 172.21.15.33:0/2506695668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d767c1c40 con 0x560d7639b070 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342cad6640 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 0x560d76750500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f342d2d7640 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d767c15d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3420006010 tx=0x7f34200095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6dbb97a4b7015ab server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.252+0000 7f3407fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f3407fff640 1 -- 172.21.15.33:0/2506695668 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420063060 con 0x560d7639b070 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f34352af740 1 -- 172.21.15.33:0/2506695668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d766b5070 con 0x560d7639b070 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f3407fff640 1 -- 172.21.15.33:0/2506695668 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f3420004040 con 0x560d7639b070 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f3407fff640 1 -- 172.21.15.33:0/2506695668 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f342006a050 con 0x560d7639b070 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f34352af740 10 client.19617 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:41.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f34352af740 1 -- 172.21.15.33:0/2506695668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560d767c8fb0 con 0x560d7639b070 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f3407fff640 1 -- 172.21.15.33:0/2506695668 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560d766b5070 con 0x560d7639b070 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f3407fff640 1 -- 172.21.15.33:0/2506695668 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f342002fb90 con 0x560d7639b070 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f34352af740 10 client.19617 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f34352af740 10 client.19617 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f34352af740 20 client.19617 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f34352af740 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560d7632eda0 0x560d767cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f34352af740 4 client.19617 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.253+0000 7f34352af740 1 -- 172.21.15.33:0/2506695668 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d766b27b0 con 0x560d7632eda0 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.254+0000 7f342cad6640 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560d7632eda0 0x560d767cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.254+0000 7f342cad6640 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560d7632eda0 0x560d767cb400 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=943567662b5b790d server_cookie=9f46e304d0ab9d5e in_seq=0 out_seq=0 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.254+0000 7f3407fff640 10 client.19617 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.254+0000 7f3407fff640 1 -- 172.21.15.33:0/2506695668 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d766b27b0 con 0x560d7632eda0 2024-08-28T19:47:41.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.254+0000 7f3407fff640 10 client.19617 handle_command_reply: tid=0 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.254+0000 7f34352af740 1 client.19617 shutdown 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.254+0000 7f34352af740 1 -- 172.21.15.33:0/2506695668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 msgr2=0x560d767c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.254+0000 7f34352af740 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d767c15d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3420006010 tx=0x7f34200095a0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.254+0000 7f34352af740 1 -- 172.21.15.33:0/2506695668 shutdown_connections 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.254+0000 7f34352af740 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x560d7632eda0 0x560d767cb400 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f34352af740 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d7639b070 0x560d767c15d0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f34352af740 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x560d7637a390 0x560d76750aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f34352af740 1 --2- 172.21.15.33:0/2506695668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d763721b0 0x560d76750500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f34352af740 1 -- 172.21.15.33:0/2506695668 >> 172.21.15.33:0/2506695668 conn(0x560d7638f460 msgr2=0x560d76741230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f3407fff640 0 client.19617 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f34352af740 1 -- 172.21.15.33:0/2506695668 shutdown_connections 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f34352af740 1 -- 172.21.15.33:0/2506695668 wait complete. 2024-08-28T19:47:41.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f34352af740 20 client.19617 trim_cache size 0 max 16384 2024-08-28T19:47:41.262 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:47:41.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f342ed3a640 1 -- 172.21.15.33:0/3136958068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34140b4ca0 msgr2=0x7f34140b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:41.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f342ed3a640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34140b4ca0 0x7f34140b71b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f342004c000 tx=0x7f3420049000 comp rx=0 tx=0).stop 2024-08-28T19:47:41.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f342ed3a640 1 -- 172.21.15.33:0/3136958068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3428109240 msgr2=0x7f34280759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:41.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.255+0000 7f342ed3a640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3428109240 0x7f34280759f0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f341800e9f0 tx=0x7f341800eeb0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.256+0000 7f342ed3a640 1 -- 172.21.15.33:0/3136958068 shutdown_connections 2024-08-28T19:47:41.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.256+0000 7f342ed3a640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3428109b90 0x7f3428075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.256+0000 7f342ed3a640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3428109240 0x7f34280759f0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.256+0000 7f342ed3a640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f34140b4ca0 0x7f34140b71b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.256+0000 7f342ed3a640 1 --2- 172.21.15.33:0/3136958068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3428103900 0x7f34280754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:41.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.256+0000 7f342ed3a640 1 -- 172.21.15.33:0/3136958068 >> 172.21.15.33:0/3136958068 conn(0x7f342807b5f0 msgr2=0x7f3428107250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:41.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.256+0000 7f342ed3a640 1 -- 172.21.15.33:0/3136958068 shutdown_connections 2024-08-28T19:47:41.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:41.256+0000 7f342ed3a640 1 -- 172.21.15.33:0/3136958068 wait complete. 2024-08-28T19:47:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:41 smithi033 ceph-mon[18549]: pgmap v817: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-08-28T19:47:41.935 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:47:42.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:41 smithi059 ceph-mon[22052]: pgmap v817: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-08-28T19:47:42.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:41 smithi122 ceph-mon[22174]: pgmap v817: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-08-28T19:47:42.191 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.769+0000 7fb8ebb45640 1 -- 172.21.15.33:0/867299583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e4108140 msgr2=0x7fb8e4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.769+0000 7fb8ebb45640 1 --2- 172.21.15.33:0/867299583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e4108140 0x7fb8e4108550 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009900 tx=0x7fb8d402a410 comp rx=0 tx=0).stop 2024-08-28T19:47:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.769+0000 7fb8ebb45640 1 -- 172.21.15.33:0/867299583 shutdown_connections 2024-08-28T19:47:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.769+0000 7fb8ebb45640 1 --2- 172.21.15.33:0/867299583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e4108a90 0x7fb8e410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.769+0000 7fb8ebb45640 1 --2- 172.21.15.33:0/867299583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e4108140 0x7fb8e4108550 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.769+0000 7fb8ebb45640 1 --2- 172.21.15.33:0/867299583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8e4102800 0x7fb8e4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.769+0000 7fb8ebb45640 1 -- 172.21.15.33:0/867299583 >> 172.21.15.33:0/867299583 conn(0x7fb8e40794d0 msgr2=0x7fb8e40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.769+0000 7fb8ebb45640 1 -- 172.21.15.33:0/867299583 shutdown_connections 2024-08-28T19:47:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.769+0000 7fb8ebb45640 1 -- 172.21.15.33:0/867299583 wait complete. 2024-08-28T19:47:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.770+0000 7fb8ebb45640 1 Processor -- start 2024-08-28T19:47:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.770+0000 7fb8ebb45640 1 -- start start 2024-08-28T19:47:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8ebb45640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e4102800 0x7fb8e410adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8ebb45640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8e4108140 0x7fb8e41093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8ebb45640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e4108a90 0x7fb8e41098f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8ebb45640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e41126e0 con 0x7fb8e4102800 2024-08-28T19:47:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8ebb45640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e4112560 con 0x7fb8e4108a90 2024-08-28T19:47:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8ebb45640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e4112860 con 0x7fb8e4108140 2024-08-28T19:47:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e98e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e4102800 0x7fb8e410adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e98e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e4102800 0x7fb8e410adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33490/0 (socket says 172.21.15.33:33490) 2024-08-28T19:47:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e98e1640 1 -- 172.21.15.33:0/2258905981 learned_addr learned my addr 172.21.15.33:0/2258905981 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8ea0e2640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e4108a90 0x7fb8e41098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e90e0640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8e4108140 0x7fb8e41093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e98e1640 1 -- 172.21.15.33:0/2258905981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8e4108140 msgr2=0x7fb8e41093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8e4108140 0x7fb8e41093b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e98e1640 1 -- 172.21.15.33:0/2258905981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e4108a90 msgr2=0x7fb8e41098f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e4108a90 0x7fb8e41098f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e98e1640 1 -- 172.21.15.33:0/2258905981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e410a110 con 0x7fb8e4102800 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e90e0640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8e4108140 0x7fb8e41093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e4102800 0x7fb8e410adc0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000d770 tx=0x7fb8e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8daffd640 1 -- 172.21.15.33:0/2258905981 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0017070 con 0x7fb8e4102800 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8ebb45640 1 -- 172.21.15.33:0/2258905981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e41accc0 con 0x7fb8e4102800 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8daffd640 1 -- 172.21.15.33:0/2258905981 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e00054d0 con 0x7fb8e4102800 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.771+0000 7fb8daffd640 1 -- 172.21.15.33:0/2258905981 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0004c30 con 0x7fb8e4102800 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.772+0000 7fb8ebb45640 1 -- 172.21.15.33:0/2258905981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e41ad1b0 con 0x7fb8e4102800 2024-08-28T19:47:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.774+0000 7fb8f20ba740 1 Processor -- start 2024-08-28T19:47:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.774+0000 7fb8f20ba740 1 -- start start 2024-08-28T19:47:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.774+0000 7fb8daffd640 1 -- 172.21.15.33:0/2258905981 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb8e0004e10 con 0x7fb8e4102800 2024-08-28T19:47:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d594304070 0x55d5946a9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942e3390 0x55d5946a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d594620680 con 0x55d5942db1b0 2024-08-28T19:47:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d59460fc10 con 0x55d594304070 2024-08-28T19:47:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d594613bc0 con 0x55d5942e3390 2024-08-28T19:47:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8e98e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8e98e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33496/0 (socket says 172.21.15.33:33496) 2024-08-28T19:47:42.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8e98e1640 1 -- 172.21.15.33:0/3983815493 learned_addr learned my addr 172.21.15.33:0/3983815493 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:42.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8e90e0640 1 --2- 172.21.15.33:0/3983815493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942e3390 0x55d5946a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8ea0e2640 1 --2- 172.21.15.33:0/3983815493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d594304070 0x55d5946a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8e98e1640 1 -- 172.21.15.33:0/3983815493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942e3390 msgr2=0x55d5946a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:42.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/3983815493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942e3390 0x55d5946a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8e98e1640 1 -- 172.21.15.33:0/3983815493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d594304070 msgr2=0x55d5946a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/3983815493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d594304070 0x55d5946a9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8e98e1640 1 -- 172.21.15.33:0/3983815493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d59436f650 con 0x55d5942db1b0 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8daffd640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8d00b4ca0 0x7fb8d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/3983815493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a9850 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00e2720 tx=0x7fb8e00eba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3de03f57a367abe server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.775+0000 7fb8ea0e2640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8d00b4ca0 0x7fb8d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.776+0000 7fb8daffd640 1 -- 172.21.15.33:0/2258905981 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fb8e00e5400 con 0x7fb8e4102800 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.776+0000 7fb8cffff640 1 -- 172.21.15.33:0/3983815493 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00a7610 con 0x55d5942db1b0 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.776+0000 7fb8cffff640 1 -- 172.21.15.33:0/3983815493 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e00ab260 con 0x55d5942db1b0 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.776+0000 7fb8cffff640 1 -- 172.21.15.33:0/3983815493 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00aaec0 con 0x55d5942db1b0 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 -- 172.21.15.33:0/3983815493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 msgr2=0x55d5946a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/3983815493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a9850 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00e2720 tx=0x7fb8e00eba70 comp rx=0 tx=0).stop 2024-08-28T19:47:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8ea0e2640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8d00b4ca0 0x7fb8d00b71b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb8e410b470 tx=0x7fb8dc009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:42.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 -- 172.21.15.33:0/3983815493 shutdown_connections 2024-08-28T19:47:42.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/3983815493 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942e3390 0x55d5946a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/3983815493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a9850 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/3983815493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d594304070 0x55d5946a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 -- 172.21.15.33:0/3983815493 >> 172.21.15.33:0/3983815493 conn(0x55d5942f8460 msgr2=0x55d5946a7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:42.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 -- 172.21.15.33:0/3983815493 shutdown_connections 2024-08-28T19:47:42.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 -- 172.21.15.33:0/3983815493 wait complete. 2024-08-28T19:47:42.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 -- start start 2024-08-28T19:47:42.785 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.777+0000 7fb8f20ba740 1 Processor -- start 2024-08-28T19:47:42.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942db1b0 0x55d5946b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5942e3390 0x55d5946b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d594304070 0x55d5946c0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d594472700 con 0x55d594304070 2024-08-28T19:47:42.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d594596750 con 0x55d5942e3390 2024-08-28T19:47:42.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d5946b7a90 con 0x55d5942db1b0 2024-08-28T19:47:42.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8f20ba740 10 client.0 _ll_register_callbacks cb 0x55d5945c5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:42.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8ea0e2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d594304070 0x55d5946c0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8ea0e2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d594304070 0x55d5946c0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33498/0 (socket says 172.21.15.33:33498) 2024-08-28T19:47:42.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8ea0e2640 1 -- 172.21.15.33:0/185899663 learned_addr learned my addr 172.21.15.33:0/185899663 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:42.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942db1b0 0x55d5946b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8e90e0640 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5942e3390 0x55d5946b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8ea0e2640 1 -- 172.21.15.33:0/185899663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942db1b0 msgr2=0x55d5946b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:42.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8ea0e2640 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942db1b0 0x55d5946b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8ea0e2640 1 -- 172.21.15.33:0/185899663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5942e3390 msgr2=0x55d5946b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8ea0e2640 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5942e3390 0x55d5946b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.778+0000 7fb8ea0e2640 1 -- 172.21.15.33:0/185899663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5945cf900 con 0x55d594304070 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.779+0000 7fb8ea0e2640 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d594304070 0x55d5946c0db0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0108d0 tx=0x7fb8dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f0d692356b666b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.779+0000 7fb8cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.779+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/185899663 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc00fc70 con 0x55d594304070 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.779+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/185899663 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fb8dc027400 con 0x55d594304070 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.779+0000 7fb8f20ba740 1 -- 172.21.15.33:0/185899663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8e00ab260 con 0x55d594304070 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.779+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/185899663 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb8dc030050 con 0x55d594304070 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.779+0000 7fb8f20ba740 10 client.19629 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.779+0000 7fb8f20ba740 1 -- 172.21.15.33:0/185899663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d5946c3860 con 0x55d594304070 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.779+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/185899663 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e00ab260 con 0x55d594304070 2024-08-28T19:47:42.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.779+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/185899663 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb8dc00f040 con 0x55d594304070 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.780+0000 7fb8f20ba740 10 client.19629 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.780+0000 7fb8f20ba740 10 client.19629 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.780+0000 7fb8f20ba740 20 client.19629 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.780+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55d5942c29f0 0x55d5946c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.780+0000 7fb8f20ba740 4 client.19629 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.780+0000 7fb8f20ba740 1 -- 172.21.15.33:0/185899663 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5946225d0 con 0x55d5942c29f0 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.780+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55d5942c29f0 0x55d5946c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.780+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55d5942c29f0 0x55d5946c6da0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a8fe94851f9e55b server_cookie=5dbefce8d4a1bd1c in_seq=0 out_seq=0 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.780+0000 7fb8cd7fa640 10 client.19629 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.781+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/185899663 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d5946225d0 con 0x55d5942c29f0 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.781+0000 7fb8cd7fa640 10 client.19629 handle_command_reply: tid=0 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.781+0000 7fb8f20ba740 1 client.19629 shutdown 2024-08-28T19:47:42.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 1 -- 172.21.15.33:0/185899663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d594304070 msgr2=0x55d5946c0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d594304070 0x55d5946c0db0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0108d0 tx=0x7fb8dc004a40 comp rx=0 tx=0).stop 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 1 -- 172.21.15.33:0/185899663 shutdown_connections 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55d5942c29f0 0x55d5946c6da0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d594304070 0x55d5946c0db0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5942e3390 0x55d5946b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/185899663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942db1b0 0x55d5946b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8cd7fa640 0 client.19629 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 1 -- 172.21.15.33:0/185899663 >> 172.21.15.33:0/185899663 conn(0x55d5942f8460 msgr2=0x55d5946ac4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 1 -- 172.21.15.33:0/185899663 shutdown_connections 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 1 -- 172.21.15.33:0/185899663 wait complete. 2024-08-28T19:47:42.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.782+0000 7fb8f20ba740 20 client.19629 trim_cache size 0 max 16384 2024-08-28T19:47:42.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.795+0000 7fb8f20ba740 1 Processor -- start 2024-08-28T19:47:42.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.795+0000 7fb8f20ba740 1 -- start start 2024-08-28T19:47:42.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942e3390 0x55d5946c0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d594304070 0x55d5946b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e41b7360 con 0x55d5942db1b0 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e41b8ea0 con 0x55d594304070 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e41b7a30 con 0x55d5942e3390 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8e98e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8e98e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33504/0 (socket says 172.21.15.33:33504) 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8e98e1640 1 -- 172.21.15.33:0/3360148080 learned_addr learned my addr 172.21.15.33:0/3360148080 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8ea0e2640 1 --2- 172.21.15.33:0/3360148080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d594304070 0x55d5946b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8e90e0640 1 --2- 172.21.15.33:0/3360148080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942e3390 0x55d5946c0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8e98e1640 1 -- 172.21.15.33:0/3360148080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942e3390 msgr2=0x55d5946c0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/3360148080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942e3390 0x55d5946c0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8e98e1640 1 -- 172.21.15.33:0/3360148080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d594304070 msgr2=0x55d5946b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/3360148080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d594304070 0x55d5946b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8e98e1640 1 -- 172.21.15.33:0/3360148080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5946af660 con 0x55d5942db1b0 2024-08-28T19:47:42.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/3360148080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a7230 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009610 tx=0x7fb8e00e8f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30523fb40e603ae5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:42.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8cf7fe640 1 -- 172.21.15.33:0/3360148080 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0096020 con 0x55d5942db1b0 2024-08-28T19:47:42.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8cf7fe640 1 -- 172.21.15.33:0/3360148080 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e0005680 con 0x55d5942db1b0 2024-08-28T19:47:42.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.796+0000 7fb8cf7fe640 1 -- 172.21.15.33:0/3360148080 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0020040 con 0x55d5942db1b0 2024-08-28T19:47:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.797+0000 7fb8f20ba740 1 -- 172.21.15.33:0/3360148080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 msgr2=0x55d5946a7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.797+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/3360148080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a7230 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009610 tx=0x7fb8e00e8f50 comp rx=0 tx=0).stop 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.797+0000 7fb8f20ba740 1 -- 172.21.15.33:0/3360148080 shutdown_connections 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.797+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/3360148080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d594304070 0x55d5946b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.797+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/3360148080 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d5942e3390 0x55d5946c0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.797+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/3360148080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946a7230 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.797+0000 7fb8f20ba740 1 -- 172.21.15.33:0/3360148080 >> 172.21.15.33:0/3360148080 conn(0x55d5942f8460 msgr2=0x55d5946a6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.797+0000 7fb8f20ba740 1 -- 172.21.15.33:0/3360148080 shutdown_connections 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.797+0000 7fb8f20ba740 1 -- 172.21.15.33:0/3360148080 wait complete. 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8f20ba740 1 -- start start 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8f20ba740 1 Processor -- start 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5942e3390 0x55d5946b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8f20ba740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d594304070 0x55d5946b9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e41b87d0 con 0x55d5942db1b0 2024-08-28T19:47:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e41b8100 con 0x55d5942e3390 2024-08-28T19:47:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8f20ba740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e41b5360 con 0x55d594304070 2024-08-28T19:47:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8f20ba740 10 client.0 _ll_register_callbacks cb 0x7fb8dc009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8e98e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8e98e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946bd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33508/0 (socket says 172.21.15.33:33508) 2024-08-28T19:47:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.798+0000 7fb8e98e1640 1 -- 172.21.15.33:0/643737739 learned_addr learned my addr 172.21.15.33:0/643737739 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8e90e0640 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5942e3390 0x55d5946b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8ea0e2640 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d594304070 0x55d5946b9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8e98e1640 1 -- 172.21.15.33:0/643737739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d594304070 msgr2=0x55d5946b9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d594304070 0x55d5946b9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8e98e1640 1 -- 172.21.15.33:0/643737739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5942e3390 msgr2=0x55d5946b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5942e3390 0x55d5946b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8e98e1640 1 -- 172.21.15.33:0/643737739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d594730760 con 0x55d5942db1b0 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8e98e1640 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946bd6d0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00eb5b0 tx=0x7fb8e00eb2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818f4c4b4778bf1e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/643737739 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0020050 con 0x55d5942db1b0 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/643737739 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fb8e00a7d40 con 0x55d5942db1b0 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8f20ba740 1 -- 172.21.15.33:0/643737739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8e0005680 con 0x55d5942db1b0 2024-08-28T19:47:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/643737739 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb8e0096040 con 0x55d5942db1b0 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8f20ba740 10 client.19635 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8f20ba740 1 -- 172.21.15.33:0/643737739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d594731880 con 0x55d5942db1b0 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.799+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/643737739 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e0005680 con 0x55d5942db1b0 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.800+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/643737739 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb8e00e2a30 con 0x55d5942db1b0 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.800+0000 7fb8f20ba740 10 client.19635 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.800+0000 7fb8f20ba740 10 client.19635 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.800+0000 7fb8f20ba740 20 client.19635 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.800+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55d594297da0 0x55d594733b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.800+0000 7fb8f20ba740 4 client.19635 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.800+0000 7fb8f20ba740 1 -- 172.21.15.33:0/643737739 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d59461e070 con 0x55d594297da0 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.800+0000 7fb8e90e0640 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55d594297da0 0x55d594733b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.800+0000 7fb8e90e0640 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55d594297da0 0x55d594733b00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=63c99b2102aa6924 server_cookie=fba50a8132192232 in_seq=0 out_seq=0 2024-08-28T19:47:42.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.800+0000 7fb8cd7fa640 10 client.19635 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8cd7fa640 1 -- 172.21.15.33:0/643737739 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d59461e070 con 0x55d594297da0 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8cd7fa640 10 client.19635 handle_command_reply: tid=0 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 client.19635 shutdown 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 -- 172.21.15.33:0/643737739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 msgr2=0x55d5946bd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946bd6d0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00eb5b0 tx=0x7fb8e00eb2b0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 -- 172.21.15.33:0/643737739 shutdown_connections 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55d594297da0 0x55d594733b00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d594304070 0x55d5946b9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5942e3390 0x55d5946b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 --2- 172.21.15.33:0/643737739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d5942db1b0 0x55d5946bd6d0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8cd7fa640 0 client.19635 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 -- 172.21.15.33:0/643737739 >> 172.21.15.33:0/643737739 conn(0x55d5942f8460 msgr2=0x55d5946b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 -- 172.21.15.33:0/643737739 shutdown_connections 2024-08-28T19:47:42.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 1 -- 172.21.15.33:0/643737739 wait complete. 2024-08-28T19:47:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.801+0000 7fb8f20ba740 20 client.19635 trim_cache size 0 max 16384 2024-08-28T19:47:42.808 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:47:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 -- 172.21.15.33:0/2258905981 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8d00b4ca0 msgr2=0x7fb8d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8d00b4ca0 0x7fb8d00b71b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb8e410b470 tx=0x7fb8dc009600 comp rx=0 tx=0).stop 2024-08-28T19:47:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 -- 172.21.15.33:0/2258905981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e4102800 msgr2=0x7fb8e410adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e4102800 0x7fb8e410adc0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000d770 tx=0x7fb8e000dc30 comp rx=0 tx=0).stop 2024-08-28T19:47:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 -- 172.21.15.33:0/2258905981 shutdown_connections 2024-08-28T19:47:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e4108a90 0x7fb8e41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8d00b4ca0 0x7fb8d00b71b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8e4108140 0x7fb8e41093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 --2- 172.21.15.33:0/2258905981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e4102800 0x7fb8e410adc0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 -- 172.21.15.33:0/2258905981 >> 172.21.15.33:0/2258905981 conn(0x7fb8e40794d0 msgr2=0x7fb8e406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 -- 172.21.15.33:0/2258905981 shutdown_connections 2024-08-28T19:47:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:42.802+0000 7fb8ebb45640 1 -- 172.21.15.33:0/2258905981 wait complete. 2024-08-28T19:47:43.747 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:47:43.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:43 smithi033 ceph-mon[18549]: pgmap v818: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-08-28T19:47:44.004 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:44.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:43 smithi059 ceph-mon[22052]: pgmap v818: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-08-28T19:47:44.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:43 smithi122 ceph-mon[22174]: pgmap v818: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-08-28T19:47:44.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.555+0000 7f241e2a8640 1 -- 172.21.15.33:0/1173207303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2418109240 msgr2=0x7f2418109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:44.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.555+0000 7f241e2a8640 1 --2- 172.21.15.33:0/1173207303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2418109240 0x7f2418109650 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f240c009900 tx=0x7f240c02a410 comp rx=0 tx=0).stop 2024-08-28T19:47:44.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.555+0000 7f241e2a8640 1 -- 172.21.15.33:0/1173207303 shutdown_connections 2024-08-28T19:47:44.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.555+0000 7f241e2a8640 1 --2- 172.21.15.33:0/1173207303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2418109b90 0x7f24181103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.555+0000 7f241e2a8640 1 --2- 172.21.15.33:0/1173207303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2418109240 0x7f2418109650 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.555+0000 7f241e2a8640 1 --2- 172.21.15.33:0/1173207303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2418103900 0x7f2418103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.555+0000 7f241e2a8640 1 -- 172.21.15.33:0/1173207303 >> 172.21.15.33:0/1173207303 conn(0x7f241807b5f0 msgr2=0x7f241807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:44.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.555+0000 7f241e2a8640 1 -- 172.21.15.33:0/1173207303 shutdown_connections 2024-08-28T19:47:44.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.555+0000 7f241e2a8640 1 -- 172.21.15.33:0/1173207303 wait complete. 2024-08-28T19:47:44.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f241e2a8640 1 Processor -- start 2024-08-28T19:47:44.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f241e2a8640 1 -- start start 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f241e2a8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2418103900 0x7f241819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f241e2a8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2418109240 0x7f241819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f241e2a8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2418109b90 0x7f241819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f241e2a8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2418113850 con 0x7f2418103900 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f241e2a8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24181136d0 con 0x7f2418109240 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f241e2a8640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f24181139d0 con 0x7f2418109b90 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f2417fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2418103900 0x7f241819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f2417fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2418103900 0x7f241819a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33528/0 (socket says 172.21.15.33:33528) 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.556+0000 7f2417fff640 1 -- 172.21.15.33:0/1302247961 learned_addr learned my addr 172.21.15.33:0/1302247961 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f24177fe640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2418109240 0x7f241819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f241c845640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2418109b90 0x7f241819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f2417fff640 1 -- 172.21.15.33:0/1302247961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2418109b90 msgr2=0x7f241819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:44.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f2417fff640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2418109b90 0x7f241819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f2417fff640 1 -- 172.21.15.33:0/1302247961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2418109240 msgr2=0x7f241819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f2417fff640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2418109240 0x7f241819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f2417fff640 1 -- 172.21.15.33:0/1302247961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24181a0290 con 0x7f2418103900 2024-08-28T19:47:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f2417fff640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2418103900 0x7f241819a320 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f240800c970 tx=0x7f240800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f24157fa640 1 -- 172.21.15.33:0/1302247961 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408007bb0 con 0x7f2418103900 2024-08-28T19:47:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f24157fa640 1 -- 172.21.15.33:0/1302247961 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2408007d50 con 0x7f2418103900 2024-08-28T19:47:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f24157fa640 1 -- 172.21.15.33:0/1302247961 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240800f450 con 0x7f2418103900 2024-08-28T19:47:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f241e2a8640 1 -- 172.21.15.33:0/1302247961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24181a0580 con 0x7f2418103900 2024-08-28T19:47:44.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.557+0000 7f241e2a8640 1 -- 172.21.15.33:0/1302247961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24181a6ce0 con 0x7f2418103900 2024-08-28T19:47:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.560+0000 7f242481d740 1 Processor -- start 2024-08-28T19:47:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.560+0000 7f24157fa640 1 -- 172.21.15.33:0/1302247961 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2408004f20 con 0x7f2418103900 2024-08-28T19:47:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.560+0000 7f242481d740 1 -- start start 2024-08-28T19:47:44.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.560+0000 7f242481d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a598310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f242481d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1ca1b0 0x55a82a598850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f242481d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 0x55a82a598d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f242481d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a82a50f680 con 0x55a82a1f3070 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f242481d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a82a4fec10 con 0x55a82a1d2390 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f242481d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a82a502bc0 con 0x55a82a1ca1b0 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f241c845640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a598310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f241c845640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a598310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33544/0 (socket says 172.21.15.33:33544) 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f241c845640 1 -- 172.21.15.33:0/4276807297 learned_addr learned my addr 172.21.15.33:0/4276807297 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f24177fe640 1 --2- 172.21.15.33:0/4276807297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 0x55a82a598d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f2417fff640 1 --2- 172.21.15.33:0/4276807297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1ca1b0 0x55a82a598850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f241c845640 1 -- 172.21.15.33:0/4276807297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1ca1b0 msgr2=0x55a82a598850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:44.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f241c845640 1 --2- 172.21.15.33:0/4276807297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1ca1b0 0x55a82a598850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f241c845640 1 -- 172.21.15.33:0/4276807297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 msgr2=0x55a82a598d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f241c845640 1 --2- 172.21.15.33:0/4276807297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 0x55a82a598d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f241c845640 1 -- 172.21.15.33:0/4276807297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a82a25e650 con 0x55a82a1f3070 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f24177fe640 1 --2- 172.21.15.33:0/4276807297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 0x55a82a598d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f24157fa640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24000b4ca0 0x7f24000b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f241c845640 1 --2- 172.21.15.33:0/4276807297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a598310 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f2410009e60 tx=0x7f2410010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62c3ce18bf469dc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.561+0000 7f2417fff640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24000b4ca0 0x7f24000b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.562+0000 7f24157fa640 1 -- 172.21.15.33:0/1302247961 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f24080e5620 con 0x7f2418103900 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.562+0000 7f23fe7fc640 1 -- 172.21.15.33:0/4276807297 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410016070 con 0x55a82a1f3070 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.562+0000 7f23fe7fc640 1 -- 172.21.15.33:0/4276807297 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2410004d20 con 0x55a82a1f3070 2024-08-28T19:47:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.562+0000 7f23fe7fc640 1 -- 172.21.15.33:0/4276807297 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24100126b0 con 0x55a82a1f3070 2024-08-28T19:47:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 -- 172.21.15.33:0/4276807297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 msgr2=0x55a82a598310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f2417fff640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24000b4ca0 0x7f24000b71b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f24080e2a80 tx=0x7f2408004980 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 --2- 172.21.15.33:0/4276807297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a598310 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f2410009e60 tx=0x7f2410010740 comp rx=0 tx=0).stop 2024-08-28T19:47:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 -- 172.21.15.33:0/4276807297 shutdown_connections 2024-08-28T19:47:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 --2- 172.21.15.33:0/4276807297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 0x55a82a598d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 --2- 172.21.15.33:0/4276807297 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1ca1b0 0x55a82a598850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 --2- 172.21.15.33:0/4276807297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a598310 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 -- 172.21.15.33:0/4276807297 >> 172.21.15.33:0/4276807297 conn(0x55a82a1e7460 msgr2=0x55a82a596200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 -- 172.21.15.33:0/4276807297 shutdown_connections 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 -- 172.21.15.33:0/4276807297 wait complete. 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 -- start start 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.563+0000 7f242481d740 1 Processor -- start 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f242481d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 0x55a82a5a7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f242481d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1d2390 0x55a82a5a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f242481d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a5b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f242481d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a82a361700 con 0x55a82a1f3070 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f242481d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a82a485750 con 0x55a82a1ca1b0 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f242481d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a82a5aae50 con 0x55a82a1d2390 2024-08-28T19:47:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f242481d740 10 client.0 _ll_register_callbacks cb 0x55a82a4b4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f241c845640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a5b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f241c845640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a5b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33552/0 (socket says 172.21.15.33:33552) 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f241c845640 1 -- 172.21.15.33:0/2752374667 learned_addr learned my addr 172.21.15.33:0/2752374667 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f241c845640 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 0x55a82a5a7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f24177fe640 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1d2390 0x55a82a5a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f241c845640 1 -- 172.21.15.33:0/2752374667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1d2390 msgr2=0x55a82a5a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f241c845640 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1d2390 0x55a82a5a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f241c845640 1 -- 172.21.15.33:0/2752374667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 msgr2=0x55a82a5a7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f241c845640 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 0x55a82a5a7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.564+0000 7f241c845640 1 -- 172.21.15.33:0/2752374667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a82a4be900 con 0x55a82a1f3070 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f241c845640 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a5b4180 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f2410011010 tx=0x7f24100059c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adec317423acf1a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f23f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:44.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f23f77fe640 1 -- 172.21.15.33:0/2752374667 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410016040 con 0x55a82a1f3070 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f23f77fe640 1 -- 172.21.15.33:0/2752374667 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f2410012910 con 0x55a82a1f3070 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f242481d740 1 -- 172.21.15.33:0/2752374667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2410004d20 con 0x55a82a1f3070 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f23f77fe640 1 -- 172.21.15.33:0/2752374667 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2410012b10 con 0x55a82a1f3070 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f242481d740 10 client.19647 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f242481d740 1 -- 172.21.15.33:0/2752374667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a82a5b6c00 con 0x55a82a1f3070 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f23f77fe640 1 -- 172.21.15.33:0/2752374667 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2410004d20 con 0x55a82a1f3070 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f23f77fe640 1 -- 172.21.15.33:0/2752374667 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f241000f040 con 0x55a82a1f3070 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f242481d740 10 client.19647 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f242481d740 10 client.19647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f242481d740 20 client.19647 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f242481d740 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a82a1b19f0 0x55a82a5b9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f242481d740 4 client.19647 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.565+0000 7f242481d740 1 -- 172.21.15.33:0/2752374667 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a82a5115d0 con 0x55a82a1b19f0 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.566+0000 7f24177fe640 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a82a1b19f0 0x55a82a5b9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.566+0000 7f24177fe640 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a82a1b19f0 0x55a82a5b9fc0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9ab1355165ad0cc server_cookie=b3c83b136e1ed3bd in_seq=0 out_seq=0 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.566+0000 7f23f77fe640 10 client.19647 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f23f77fe640 1 -- 172.21.15.33:0/2752374667 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a82a5115d0 con 0x55a82a1b19f0 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f23f77fe640 10 client.19647 handle_command_reply: tid=0 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 client.19647 shutdown 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 -- 172.21.15.33:0/2752374667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 msgr2=0x55a82a5b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a5b4180 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f2410011010 tx=0x7f24100059c0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 -- 172.21.15.33:0/2752374667 shutdown_connections 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a82a1b19f0 0x55a82a5b9fc0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f23f77fe640 0 client.19647 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1f3070 0x55a82a5b4180 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1d2390 0x55a82a5a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 --2- 172.21.15.33:0/2752374667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 0x55a82a5a7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 -- 172.21.15.33:0/2752374667 >> 172.21.15.33:0/2752374667 conn(0x55a82a1e7460 msgr2=0x55a82a5947c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:44.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 -- 172.21.15.33:0/2752374667 shutdown_connections 2024-08-28T19:47:44.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 1 -- 172.21.15.33:0/2752374667 wait complete. 2024-08-28T19:47:44.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.567+0000 7f242481d740 20 client.19647 trim_cache size 0 max 16384 2024-08-28T19:47:44.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f242481d740 1 Processor -- start 2024-08-28T19:47:44.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f242481d740 1 -- start start 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f242481d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a599d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f242481d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 0x55a82a5a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f242481d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1d2390 0x55a82a5b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f242481d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f24181aeb70 con 0x55a82a1b19f0 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f242481d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24181b06b0 con 0x55a82a1ca1b0 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f242481d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f24181af240 con 0x55a82a1d2390 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f241c845640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a599d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f241c845640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a599d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33554/0 (socket says 172.21.15.33:33554) 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f241c845640 1 -- 172.21.15.33:0/3425869338 learned_addr learned my addr 172.21.15.33:0/3425869338 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f24177fe640 1 --2- 172.21.15.33:0/3425869338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 0x55a82a5a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f241c845640 1 -- 172.21.15.33:0/3425869338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1d2390 msgr2=0x55a82a5b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:44.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f241c845640 1 --2- 172.21.15.33:0/3425869338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1d2390 0x55a82a5b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f241c845640 1 -- 172.21.15.33:0/3425869338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 msgr2=0x55a82a5a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:44.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f241c845640 1 --2- 172.21.15.33:0/3425869338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 0x55a82a5a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.581+0000 7f241c845640 1 -- 172.21.15.33:0/3425869338 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a82a59b140 con 0x55a82a1b19f0 2024-08-28T19:47:44.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.582+0000 7f24177fe640 1 --2- 172.21.15.33:0/3425869338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 0x55a82a5a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:47:44.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.582+0000 7f241c845640 1 --2- 172.21.15.33:0/3425869338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a599d00 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f241001a3e0 tx=0x7f2410005a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd29e7d92001ede server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:44.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.582+0000 7f23fdffb640 1 -- 172.21.15.33:0/3425869338 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410016040 con 0x55a82a1b19f0 2024-08-28T19:47:44.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.582+0000 7f23fdffb640 1 -- 172.21.15.33:0/3425869338 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2410010c40 con 0x55a82a1b19f0 2024-08-28T19:47:44.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.582+0000 7f23fdffb640 1 -- 172.21.15.33:0/3425869338 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241001a830 con 0x55a82a1b19f0 2024-08-28T19:47:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 -- 172.21.15.33:0/3425869338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 msgr2=0x55a82a599d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 --2- 172.21.15.33:0/3425869338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a599d00 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f241001a3e0 tx=0x7f2410005a30 comp rx=0 tx=0).stop 2024-08-28T19:47:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 -- 172.21.15.33:0/3425869338 shutdown_connections 2024-08-28T19:47:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 --2- 172.21.15.33:0/3425869338 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1d2390 0x55a82a5b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 --2- 172.21.15.33:0/3425869338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1ca1b0 0x55a82a5a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 --2- 172.21.15.33:0/3425869338 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a599d00 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 -- 172.21.15.33:0/3425869338 >> 172.21.15.33:0/3425869338 conn(0x55a82a1e7460 msgr2=0x55a82a5a9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 -- 172.21.15.33:0/3425869338 shutdown_connections 2024-08-28T19:47:44.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 -- 172.21.15.33:0/3425869338 wait complete. 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 -- start start 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.583+0000 7f242481d740 1 Processor -- start 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f242481d740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a5ac820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f242481d740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1ca1b0 0x55a82a5acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f242481d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 0x55a82a6237c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f242481d740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f24181affe0 con 0x55a82a1b19f0 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f242481d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24181af910 con 0x55a82a1d2390 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f242481d740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f24181acb70 con 0x55a82a1ca1b0 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f242481d740 10 client.0 _ll_register_callbacks cb 0x7f2410009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f241c845640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a5ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f241c845640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a5ac820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33560/0 (socket says 172.21.15.33:33560) 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f241c845640 1 -- 172.21.15.33:0/3587928120 learned_addr learned my addr 172.21.15.33:0/3587928120 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:44.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f24177fe640 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1ca1b0 0x55a82a5acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f241c845640 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 0x55a82a6237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f241c845640 1 -- 172.21.15.33:0/3587928120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1ca1b0 msgr2=0x55a82a5acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f241c845640 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1ca1b0 0x55a82a5acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f241c845640 1 -- 172.21.15.33:0/3587928120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 msgr2=0x55a82a6237c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f241c845640 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 0x55a82a6237c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f241c845640 1 -- 172.21.15.33:0/3587928120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a82a623d30 con 0x55a82a1b19f0 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f241c845640 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a5ac820 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f2410010780 tx=0x7f24100097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262182f1abb218b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.584+0000 7f23f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f23f77fe640 1 -- 172.21.15.33:0/3587928120 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410016040 con 0x55a82a1b19f0 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f23f77fe640 1 -- 172.21.15.33:0/3587928120 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f24100054d0 con 0x55a82a1b19f0 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f242481d740 1 -- 172.21.15.33:0/3587928120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2410010c40 con 0x55a82a1b19f0 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f23f77fe640 1 -- 172.21.15.33:0/3587928120 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2410005860 con 0x55a82a1b19f0 2024-08-28T19:47:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f242481d740 10 client.19653 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f242481d740 1 -- 172.21.15.33:0/3587928120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a82a624fb0 con 0x55a82a1b19f0 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f23f77fe640 1 -- 172.21.15.33:0/3587928120 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2410010c40 con 0x55a82a1b19f0 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f23f77fe640 1 -- 172.21.15.33:0/3587928120 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2410035650 con 0x55a82a1b19f0 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f242481d740 10 client.19653 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f242481d740 10 client.19653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f242481d740 20 client.19653 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f242481d740 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a82a1f3070 0x55a82a6273a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f242481d740 4 client.19653 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.585+0000 7f242481d740 1 -- 172.21.15.33:0/3587928120 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a82a50d070 con 0x55a82a1f3070 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f24177fe640 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a82a1f3070 0x55a82a6273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f23f77fe640 10 client.19653 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f24177fe640 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a82a1f3070 0x55a82a6273a0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70fb1b7927a8e70 server_cookie=421288461518809b in_seq=0 out_seq=0 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f23f77fe640 1 -- 172.21.15.33:0/3587928120 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a82a50d070 con 0x55a82a1f3070 2024-08-28T19:47:44.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f23f77fe640 10 client.19653 handle_command_reply: tid=0 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f242481d740 1 client.19653 shutdown 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f242481d740 1 -- 172.21.15.33:0/3587928120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 msgr2=0x55a82a5ac820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f242481d740 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a5ac820 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f2410010780 tx=0x7f24100097a0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f242481d740 1 -- 172.21.15.33:0/3587928120 shutdown_connections 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f242481d740 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a82a1d2390 0x55a82a6237c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f242481d740 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a82a1ca1b0 0x55a82a5acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f242481d740 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a82a1f3070 0x55a82a6273a0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f242481d740 1 --2- 172.21.15.33:0/3587928120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a82a1b19f0 0x55a82a5ac820 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.586+0000 7f242481d740 1 -- 172.21.15.33:0/3587928120 >> 172.21.15.33:0/3587928120 conn(0x55a82a1e7460 msgr2=0x55a82a59de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f23f77fe640 0 client.19653 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f242481d740 1 -- 172.21.15.33:0/3587928120 shutdown_connections 2024-08-28T19:47:44.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f242481d740 1 -- 172.21.15.33:0/3587928120 wait complete. 2024-08-28T19:47:44.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f242481d740 20 client.19653 trim_cache size 0 max 16384 2024-08-28T19:47:44.593 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:47:44.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 -- 172.21.15.33:0/1302247961 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24000b4ca0 msgr2=0x7f24000b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:44.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24000b4ca0 0x7f24000b71b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f24080e2a80 tx=0x7f2408004980 comp rx=0 tx=0).stop 2024-08-28T19:47:44.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 -- 172.21.15.33:0/1302247961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2418103900 msgr2=0x7f241819a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:44.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2418103900 0x7f241819a320 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f240800c970 tx=0x7f240800ce30 comp rx=0 tx=0).stop 2024-08-28T19:47:44.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 -- 172.21.15.33:0/1302247961 shutdown_connections 2024-08-28T19:47:44.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f24000b4ca0 0x7f24000b71b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2418109b90 0x7f241819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2418109240 0x7f241819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 --2- 172.21.15.33:0/1302247961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2418103900 0x7f241819a320 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:44.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 -- 172.21.15.33:0/1302247961 >> 172.21.15.33:0/1302247961 conn(0x7f241807b5f0 msgr2=0x7f2418105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:44.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.587+0000 7f241e2a8640 1 -- 172.21.15.33:0/1302247961 shutdown_connections 2024-08-28T19:47:44.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:44.588+0000 7f241e2a8640 1 -- 172.21.15.33:0/1302247961 wait complete. 2024-08-28T19:47:45.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:45 smithi033 ceph-mon[18549]: pgmap v819: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-08-28T19:47:46.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:45 smithi059 ceph-mon[22052]: pgmap v819: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-08-28T19:47:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:45 smithi122 ceph-mon[22174]: pgmap v819: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-08-28T19:47:46.415 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:47:46.416 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:47:46.684 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:47.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.208+0000 7f6683b99640 1 -- 172.21.15.33:0/84379327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f667c102fd0 msgr2=0x7f667c1033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:47.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.208+0000 7f6683b99640 1 --2- 172.21.15.33:0/84379327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f667c102fd0 0x7f667c1033e0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f6678009900 tx=0x7f667802a410 comp rx=0 tx=0).stop 2024-08-28T19:47:47.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.208+0000 7f6683b99640 1 -- 172.21.15.33:0/84379327 shutdown_connections 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.208+0000 7f6683b99640 1 --2- 172.21.15.33:0/84379327 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f667c108b50 0x7f667c10f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.208+0000 7f6683b99640 1 --2- 172.21.15.33:0/84379327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c108200 0x7f667c108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.208+0000 7f6683b99640 1 --2- 172.21.15.33:0/84379327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f667c102fd0 0x7f667c1033e0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.208+0000 7f6683b99640 1 -- 172.21.15.33:0/84379327 >> 172.21.15.33:0/84379327 conn(0x7f667c079c60 msgr2=0x7f667c07a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.208+0000 7f6683b99640 1 -- 172.21.15.33:0/84379327 shutdown_connections 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.208+0000 7f6683b99640 1 -- 172.21.15.33:0/84379327 wait complete. 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6683b99640 1 Processor -- start 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6683b99640 1 -- start start 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6683b99640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f667c102fd0 0x7f667c19b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6683b99640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c108200 0x7f667c19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6683b99640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f667c108b50 0x7f667c19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6683b99640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f667c1128d0 con 0x7f667c108b50 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6683b99640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f667c112750 con 0x7f667c108200 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6683b99640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f667c112a50 con 0x7f667c102fd0 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6682136640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f667c108b50 0x7f667c19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6682136640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f667c108b50 0x7f667c19bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33584/0 (socket says 172.21.15.33:33584) 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6682136640 1 -- 172.21.15.33:0/1592500598 learned_addr learned my addr 172.21.15.33:0/1592500598 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6681935640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f667c102fd0 0x7f667c19b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.209+0000 7f6681134640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c108200 0x7f667c19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6682136640 1 -- 172.21.15.33:0/1592500598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f667c102fd0 msgr2=0x7f667c19b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6682136640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f667c102fd0 0x7f667c19b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6682136640 1 -- 172.21.15.33:0/1592500598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c108200 msgr2=0x7f667c19b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6682136640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c108200 0x7f667c19b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6682136640 1 -- 172.21.15.33:0/1592500598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667c1a6470 con 0x7f667c108b50 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6681134640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c108200 0x7f667c19b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6682136640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f667c108b50 0x7f667c19bbe0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f667400b970 tx=0x7f667400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6672ffd640 1 -- 172.21.15.33:0/1592500598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6674019070 con 0x7f667c108b50 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6683b99640 1 -- 172.21.15.33:0/1592500598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667c1a6760 con 0x7f667c108b50 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6672ffd640 1 -- 172.21.15.33:0/1592500598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6674014440 con 0x7f667c108b50 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6672ffd640 1 -- 172.21.15.33:0/1592500598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66740075d0 con 0x7f667c108b50 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.210+0000 7f6683b99640 1 -- 172.21.15.33:0/1592500598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f667c1a6d20 con 0x7f667c108b50 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.213+0000 7f668a10e740 1 Processor -- start 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.213+0000 7f6672ffd640 1 -- 172.21.15.33:0/1592500598 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f667401c070 con 0x7f667c108b50 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.213+0000 7f668a10e740 1 -- start start 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.213+0000 7f668a10e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359022350 0x5573593c8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.213+0000 7f668a10e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557358ff9490 0x5573593c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.213+0000 7f668a10e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359001670 0x5573593c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.213+0000 7f668a10e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55735933e5f0 con 0x557359022350 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.213+0000 7f668a10e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55735932db80 con 0x557359001670 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.213+0000 7f668a10e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x557359331b30 con 0x557358ff9490 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681134640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359022350 0x5573593c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681134640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359022350 0x5573593c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33598/0 (socket says 172.21.15.33:33598) 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681134640 1 -- 172.21.15.33:0/3243064434 learned_addr learned my addr 172.21.15.33:0/3243064434 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6672ffd640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66680b4ca0 0x7f66680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681134640 1 --2- 172.21.15.33:0/3243064434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359001670 0x5573593c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681935640 1 --2- 172.21.15.33:0/3243064434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557358ff9490 0x5573593c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681134640 1 -- 172.21.15.33:0/3243064434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557358ff9490 msgr2=0x5573593c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681134640 1 --2- 172.21.15.33:0/3243064434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557358ff9490 0x5573593c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681134640 1 -- 172.21.15.33:0/3243064434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359001670 msgr2=0x5573593c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681134640 1 --2- 172.21.15.33:0/3243064434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359001670 0x5573593c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681134640 1 -- 172.21.15.33:0/3243064434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55735908d930 con 0x557359022350 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6682136640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66680b4ca0 0x7f66680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6672ffd640 1 -- 172.21.15.33:0/1592500598 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f66740e4df0 con 0x7f667c108b50 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6681134640 1 --2- 172.21.15.33:0/3243064434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359022350 0x5573593c8780 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f666c007ed0 tx=0x7f666c0073c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4980ab6496e74a8b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.214+0000 7f6667fff640 1 -- 172.21.15.33:0/3243064434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c01c070 con 0x557359022350 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.215+0000 7f6667fff640 1 -- 172.21.15.33:0/3243064434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f666c010040 con 0x557359022350 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.215+0000 7f6667fff640 1 -- 172.21.15.33:0/3243064434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0145b0 con 0x557359022350 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.215+0000 7f668a10e740 1 -- 172.21.15.33:0/3243064434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359022350 msgr2=0x5573593c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.215+0000 7f6682136640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66680b4ca0 0x7f66680b71b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f66740a8460 tx=0x7f6674014d00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.215+0000 7f668a10e740 1 --2- 172.21.15.33:0/3243064434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359022350 0x5573593c8780 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f666c007ed0 tx=0x7f666c0073c0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.215+0000 7f668a10e740 1 -- 172.21.15.33:0/3243064434 shutdown_connections 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.215+0000 7f668a10e740 1 --2- 172.21.15.33:0/3243064434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359001670 0x5573593c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.215+0000 7f668a10e740 1 --2- 172.21.15.33:0/3243064434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557358ff9490 0x5573593c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.215+0000 7f668a10e740 1 --2- 172.21.15.33:0/3243064434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359022350 0x5573593c8780 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.216+0000 7f668a10e740 1 -- 172.21.15.33:0/3243064434 >> 172.21.15.33:0/3243064434 conn(0x557359016740 msgr2=0x5573593c6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.216+0000 7f668a10e740 1 -- 172.21.15.33:0/3243064434 shutdown_connections 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.216+0000 7f668a10e740 1 -- 172.21.15.33:0/3243064434 wait complete. 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.216+0000 7f668a10e740 1 -- start start 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.216+0000 7f668a10e740 1 Processor -- start 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f668a10e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557358ff9490 0x5573593d8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f668a10e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359001670 0x5573593d8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f668a10e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359022350 0x5573593e4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f668a10e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x557359190890 con 0x557359001670 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f668a10e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5573592b4790 con 0x557358ff9490 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f668a10e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5573593db260 con 0x557359022350 2024-08-28T19:47:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f668a10e740 10 client.0 _ll_register_callbacks cb 0x557359039ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681935640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359001670 0x5573593d8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681935640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359001670 0x5573593d8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33600/0 (socket says 172.21.15.33:33600) 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681935640 1 -- 172.21.15.33:0/338598311 learned_addr learned my addr 172.21.15.33:0/338598311 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681134640 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557358ff9490 0x5573593d8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681134640 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359022350 0x5573593e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681935640 1 -- 172.21.15.33:0/338598311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359022350 msgr2=0x5573593e4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681935640 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359022350 0x5573593e4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681935640 1 -- 172.21.15.33:0/338598311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557358ff9490 msgr2=0x5573593d8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681935640 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557358ff9490 0x5573593d8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681935640 1 -- 172.21.15.33:0/338598311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573592ebf30 con 0x557359001670 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681134640 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557358ff9490 0x5573593d8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f6681935640 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359001670 0x5573593d8860 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f6678009900 tx=0x7f66780314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abe2cef2bf8ffd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f66657fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f66657fa640 1 -- 172.21.15.33:0/338598311 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678035040 con 0x557359001670 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f66657fa640 1 -- 172.21.15.33:0/338598311 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f6678004040 con 0x557359001670 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.217+0000 7f668a10e740 1 -- 172.21.15.33:0/338598311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f666c010040 con 0x557359001670 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f66657fa640 1 -- 172.21.15.33:0/338598311 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66780318d0 con 0x557359001670 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f668a10e740 10 client.19665 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f668a10e740 1 -- 172.21.15.33:0/338598311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5573593e7050 con 0x557359001670 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f66657fa640 1 -- 172.21.15.33:0/338598311 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f666c010040 con 0x557359001670 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f66657fa640 1 -- 172.21.15.33:0/338598311 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6678004940 con 0x557359001670 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f668a10e740 10 client.19665 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f668a10e740 10 client.19665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f668a10e740 20 client.19665 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f668a10e740 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557358fe0cd0 0x5573593ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f668a10e740 4 client.19665 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f668a10e740 1 -- 172.21.15.33:0/338598311 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557359340540 con 0x557358fe0cd0 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.218+0000 7f6681134640 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557358fe0cd0 0x5573593ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.219+0000 7f6681134640 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557358fe0cd0 0x5573593ea5a0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f09a1a30680dc42 server_cookie=92aa9af1b29cc04b in_seq=0 out_seq=0 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.219+0000 7f66657fa640 10 client.19665 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f66657fa640 1 -- 172.21.15.33:0/338598311 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557359340540 con 0x557358fe0cd0 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f66657fa640 10 client.19665 handle_command_reply: tid=0 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 client.19665 shutdown 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 -- 172.21.15.33:0/338598311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359001670 msgr2=0x5573593d8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359001670 0x5573593d8860 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f6678009900 tx=0x7f66780314a0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 -- 172.21.15.33:0/338598311 shutdown_connections 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359022350 0x5573593e4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557358fe0cd0 0x5573593ea5a0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557359001670 0x5573593d8860 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 --2- 172.21.15.33:0/338598311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557358ff9490 0x5573593d8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 -- 172.21.15.33:0/338598311 >> 172.21.15.33:0/338598311 conn(0x557359016740 msgr2=0x5573593ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f66657fa640 0 client.19665 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 -- 172.21.15.33:0/338598311 shutdown_connections 2024-08-28T19:47:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 1 -- 172.21.15.33:0/338598311 wait complete. 2024-08-28T19:47:47.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.220+0000 7f668a10e740 20 client.19665 trim_cache size 0 max 16384 2024-08-28T19:47:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f668a10e740 1 Processor -- start 2024-08-28T19:47:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f668a10e740 1 -- start start 2024-08-28T19:47:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f668a10e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f668a10e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359001670 0x5573593e4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f668a10e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359022350 0x5573593d5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f668a10e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f667c1aeb20 con 0x557358ff9490 2024-08-28T19:47:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f668a10e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f667c1b0660 con 0x557359022350 2024-08-28T19:47:47.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f668a10e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f667c1af1f0 con 0x557359001670 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f6681134640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f6681134640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593c66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33604/0 (socket says 172.21.15.33:33604) 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.238+0000 7f6681134640 1 -- 172.21.15.33:0/2265552036 learned_addr learned my addr 172.21.15.33:0/2265552036 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f6681935640 1 --2- 172.21.15.33:0/2265552036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359001670 0x5573593e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f6681134640 1 --2- 172.21.15.33:0/2265552036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359022350 0x5573593d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f6681134640 1 -- 172.21.15.33:0/2265552036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359001670 msgr2=0x5573593e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f6681134640 1 --2- 172.21.15.33:0/2265552036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359001670 0x5573593e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f6681134640 1 -- 172.21.15.33:0/2265552036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359022350 msgr2=0x5573593d5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f6681134640 1 --2- 172.21.15.33:0/2265552036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359022350 0x5573593d5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f6681134640 1 -- 172.21.15.33:0/2265552036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573593daa60 con 0x557358ff9490 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f6681935640 1 --2- 172.21.15.33:0/2265552036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359001670 0x5573593e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f6681134640 1 --2- 172.21.15.33:0/2265552036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593c66a0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f666c017e20 tx=0x7f666c017e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa9dc3352c9cc95 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:47.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f66677fe640 1 -- 172.21.15.33:0/2265552036 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c02b030 con 0x557358ff9490 2024-08-28T19:47:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f66677fe640 1 -- 172.21.15.33:0/2265552036 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f666c027400 con 0x557358ff9490 2024-08-28T19:47:47.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.239+0000 7f66677fe640 1 -- 172.21.15.33:0/2265552036 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c01c040 con 0x557358ff9490 2024-08-28T19:47:47.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.240+0000 7f668a10e740 1 -- 172.21.15.33:0/2265552036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 msgr2=0x5573593c66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.240+0000 7f668a10e740 1 --2- 172.21.15.33:0/2265552036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593c66a0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f666c017e20 tx=0x7f666c017e50 comp rx=0 tx=0).stop 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.240+0000 7f668a10e740 1 -- 172.21.15.33:0/2265552036 shutdown_connections 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.240+0000 7f668a10e740 1 --2- 172.21.15.33:0/2265552036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359022350 0x5573593d5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.240+0000 7f668a10e740 1 --2- 172.21.15.33:0/2265552036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359001670 0x5573593e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.240+0000 7f668a10e740 1 --2- 172.21.15.33:0/2265552036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593c66a0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.240+0000 7f668a10e740 1 -- 172.21.15.33:0/2265552036 >> 172.21.15.33:0/2265552036 conn(0x557359016740 msgr2=0x5573593c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.240+0000 7f668a10e740 1 -- 172.21.15.33:0/2265552036 shutdown_connections 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.240+0000 7f668a10e740 1 -- 172.21.15.33:0/2265552036 wait complete. 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.240+0000 7f668a10e740 1 -- start start 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f668a10e740 1 Processor -- start 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f668a10e740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f668a10e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359001670 0x5573593dd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f668a10e740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359022350 0x55735944dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f668a10e740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f667c1aff90 con 0x557358ff9490 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f668a10e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f667c1af8c0 con 0x557359001670 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f668a10e740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f667c1acb20 con 0x557359022350 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f668a10e740 10 client.0 _ll_register_callbacks cb 0x7f6678009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f6681134640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f6681134640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593dd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33616/0 (socket says 172.21.15.33:33616) 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f6681134640 1 -- 172.21.15.33:0/3659021559 learned_addr learned my addr 172.21.15.33:0/3659021559 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f6681935640 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359001670 0x5573593dd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f6681134640 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359022350 0x55735944dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f6681134640 1 -- 172.21.15.33:0/3659021559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359022350 msgr2=0x55735944dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.241+0000 7f6681134640 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359022350 0x55735944dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f6681134640 1 -- 172.21.15.33:0/3659021559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359001670 msgr2=0x5573593dd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:47.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f6681134640 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359001670 0x5573593dd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f6681134640 1 -- 172.21.15.33:0/3659021559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55735944e630 con 0x557358ff9490 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f6681134640 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593dd000 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f666c007ea0 tx=0x7f666c006da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7204864f4673e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f66657fa640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f66657fa640 1 -- 172.21.15.33:0/3659021559 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c03d020 con 0x557358ff9490 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f66657fa640 1 -- 172.21.15.33:0/3659021559 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f666c027790 con 0x557358ff9490 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f668a10e740 1 -- 172.21.15.33:0/3659021559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f666c027400 con 0x557358ff9490 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f66657fa640 1 -- 172.21.15.33:0/3659021559 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f666c048050 con 0x557358ff9490 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f668a10e740 10 client.19671 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f668a10e740 1 -- 172.21.15.33:0/3659021559 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557359455a60 con 0x557358ff9490 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f66657fa640 1 -- 172.21.15.33:0/3659021559 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f666c027400 con 0x557358ff9490 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.242+0000 7f66657fa640 1 -- 172.21.15.33:0/3659021559 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f666c022040 con 0x557358ff9490 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.243+0000 7f668a10e740 10 client.19671 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.243+0000 7f668a10e740 10 client.19671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.243+0000 7f668a10e740 20 client.19671 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.243+0000 7f668a10e740 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557358fb6080 0x557359458020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.243+0000 7f668a10e740 4 client.19671 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:47:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.243+0000 7f668a10e740 1 -- 172.21.15.33:0/3659021559 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55735933bfe0 con 0x557358fb6080 2024-08-28T19:47:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.243+0000 7f6681935640 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557358fb6080 0x557359458020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.243+0000 7f6681935640 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557358fb6080 0x557359458020 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5e114d8a0bd876c server_cookie=86af5fd8acbfd3c7 in_seq=0 out_seq=0 2024-08-28T19:47:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.243+0000 7f66657fa640 10 client.19671 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f66657fa640 1 -- 172.21.15.33:0/3659021559 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55735933bfe0 con 0x557358fb6080 2024-08-28T19:47:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f66657fa640 10 client.19671 handle_command_reply: tid=0 2024-08-28T19:47:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 client.19671 shutdown 2024-08-28T19:47:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 -- 172.21.15.33:0/3659021559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 msgr2=0x5573593dd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593dd000 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f666c007ea0 tx=0x7f666c006da0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 -- 172.21.15.33:0/3659021559 shutdown_connections 2024-08-28T19:47:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x557359022350 0x55735944dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557359001670 0x5573593dd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x557358fb6080 0x557359458020 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 --2- 172.21.15.33:0/3659021559 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557358ff9490 0x5573593dd000 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f66657fa640 0 client.19671 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 -- 172.21.15.33:0/3659021559 >> 172.21.15.33:0/3659021559 conn(0x557359016740 msgr2=0x5573593c4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 -- 172.21.15.33:0/3659021559 shutdown_connections 2024-08-28T19:47:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 1 -- 172.21.15.33:0/3659021559 wait complete. 2024-08-28T19:47:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.245+0000 7f668a10e740 20 client.19671 trim_cache size 0 max 16384 2024-08-28T19:47:47.250 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:47:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:47:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "153c14e4-9cf6-465d-b1e1-c611091f3f27", 2024-08-28T19:47:47.251 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:47:47.251 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 -- 172.21.15.33:0/1592500598 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66680b4ca0 msgr2=0x7f66680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66680b4ca0 0x7f66680b71b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f66740a8460 tx=0x7f6674014d00 comp rx=0 tx=0).stop 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 -- 172.21.15.33:0/1592500598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f667c108b50 msgr2=0x7f667c19bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f667c108b50 0x7f667c19bbe0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f667400b970 tx=0x7f667400be30 comp rx=0 tx=0).stop 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 -- 172.21.15.33:0/1592500598 shutdown_connections 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f667c108b50 0x7f667c19bbe0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667c108200 0x7f667c19b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66680b4ca0 0x7f66680b71b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 --2- 172.21.15.33:0/1592500598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f667c102fd0 0x7f667c19b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 -- 172.21.15.33:0/1592500598 >> 172.21.15.33:0/1592500598 conn(0x7f667c079c60 msgr2=0x7f667c1062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 -- 172.21.15.33:0/1592500598 shutdown_connections 2024-08-28T19:47:47.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:47.246+0000 7f6683b99640 1 -- 172.21.15.33:0/1592500598 wait complete. 2024-08-28T19:47:47.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:47 smithi033 ceph-mon[18549]: pgmap v820: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-08-28T19:47:47.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:47 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:47:47.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:47 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:47.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:47 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:47:47.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:47 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:48.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:47 smithi059 ceph-mon[22052]: pgmap v820: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-08-28T19:47:48.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:47 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:47:48.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:47 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:48.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:47 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:47:48.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:47 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:47 smithi122 ceph-mon[22174]: pgmap v820: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-08-28T19:47:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:47 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:47:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:47 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:47 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:47:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:47 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:47:48.059 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:47:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.833+0000 7f2550fa7640 1 -- 172.21.15.33:0/3344231782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254c108af0 msgr2=0x7f254c10f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.833+0000 7f2550fa7640 1 --2- 172.21.15.33:0/3344231782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254c108af0 0x7f254c10f320 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f2544009ca0 tx=0x7f254402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.833+0000 7f2550fa7640 1 -- 172.21.15.33:0/3344231782 shutdown_connections 2024-08-28T19:47:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.833+0000 7f2550fa7640 1 --2- 172.21.15.33:0/3344231782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254c108af0 0x7f254c10f320 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.833+0000 7f2550fa7640 1 --2- 172.21.15.33:0/3344231782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f254c1081a0 0x7f254c1085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.833+0000 7f2550fa7640 1 --2- 172.21.15.33:0/3344231782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c102f30 0x7f254c103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.833+0000 7f2550fa7640 1 -- 172.21.15.33:0/3344231782 >> 172.21.15.33:0/3344231782 conn(0x7f254c079d30 msgr2=0x7f254c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:48.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.833+0000 7f2550fa7640 1 -- 172.21.15.33:0/3344231782 shutdown_connections 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.833+0000 7f2550fa7640 1 -- 172.21.15.33:0/3344231782 wait complete. 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.834+0000 7f2550fa7640 1 Processor -- start 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.834+0000 7f2550fa7640 1 -- start start 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.834+0000 7f2550fa7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c102f30 0x7f254c198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.834+0000 7f2550fa7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254c1081a0 0x7f254c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.834+0000 7f2550fa7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f254c108af0 0x7f254c199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.834+0000 7f2550fa7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1127c0 con 0x7f254c1081a0 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.834+0000 7f2550fa7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f254c112640 con 0x7f254c108af0 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.834+0000 7f2550fa7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f254c112940 con 0x7f254c102f30 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.834+0000 7f2549d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254c1081a0 0x7f254c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f2549d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254c1081a0 0x7f254c199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45892/0 (socket says 172.21.15.33:45892) 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f2549d9b640 1 -- 172.21.15.33:0/1860073359 learned_addr learned my addr 172.21.15.33:0/1860073359 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:48.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f254a59c640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c102f30 0x7f254c198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f254ad9d640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f254c108af0 0x7f254c199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f2549d9b640 1 -- 172.21.15.33:0/1860073359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c102f30 msgr2=0x7f254c198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f2549d9b640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c102f30 0x7f254c198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f2549d9b640 1 -- 172.21.15.33:0/1860073359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f254c108af0 msgr2=0x7f254c199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f2549d9b640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f254c108af0 0x7f254c199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f2549d9b640 1 -- 172.21.15.33:0/1860073359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c1a8570 con 0x7f254c1081a0 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f2549d9b640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254c1081a0 0x7f254c199400 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f254000c970 tx=0x7f254000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f253b7fe640 1 -- 172.21.15.33:0/1860073359 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2540007bb0 con 0x7f254c1081a0 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f253b7fe640 1 -- 172.21.15.33:0/1860073359 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2540007d50 con 0x7f254c1081a0 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f2550fa7640 1 -- 172.21.15.33:0/1860073359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254c1a8860 con 0x7f254c1081a0 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f253b7fe640 1 -- 172.21.15.33:0/1860073359 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254000f450 con 0x7f254c1081a0 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.835+0000 7f2550fa7640 1 -- 172.21.15.33:0/1860073359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f254c1a8da0 con 0x7f254c1081a0 2024-08-28T19:47:48.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.838+0000 7f255751c740 1 Processor -- start 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.838+0000 7f255751c740 1 -- start start 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.838+0000 7f255751c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a846572070 0x55a846917300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.838+0000 7f255751c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8465491b0 0x55a846917840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.838+0000 7f255751c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846551390 0x55a846917d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.838+0000 7f255751c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a84688e630 con 0x55a846572070 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.838+0000 7f255751c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a84687dbc0 con 0x55a8465491b0 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.838+0000 7f255751c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a846881b70 con 0x55a846551390 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f253b7fe640 1 -- 172.21.15.33:0/1860073359 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f254000f5f0 con 0x7f254c1081a0 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f254ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a846572070 0x55a846917300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f254ad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a846572070 0x55a846917300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45908/0 (socket says 172.21.15.33:45908) 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f254ad9d640 1 -- 172.21.15.33:0/128135336 learned_addr learned my addr 172.21.15.33:0/128135336 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:48.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f254a59c640 1 --2- 172.21.15.33:0/128135336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8465491b0 0x55a846917840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f254ad9d640 1 -- 172.21.15.33:0/128135336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846551390 msgr2=0x55a846917d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f254ad9d640 1 --2- 172.21.15.33:0/128135336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846551390 0x55a846917d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f254ad9d640 1 -- 172.21.15.33:0/128135336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8465491b0 msgr2=0x55a846917840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f254ad9d640 1 --2- 172.21.15.33:0/128135336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8465491b0 0x55a846917840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f254ad9d640 1 -- 172.21.15.33:0/128135336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8465dd650 con 0x55a846572070 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f254ad9d640 1 --2- 172.21.15.33:0/128135336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a846572070 0x55a846917300 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f2544009920 tx=0x7f2544009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba6d8619ef78001 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f2538ff9640 1 -- 172.21.15.33:0/128135336 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544031e30 con 0x55a846572070 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.839+0000 7f2538ff9640 1 -- 172.21.15.33:0/128135336 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2544036030 con 0x55a846572070 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f2538ff9640 1 -- 172.21.15.33:0/128135336 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440042a0 con 0x55a846572070 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f253b7fe640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25340b4ca0 0x7f25340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f254a59c640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25340b4ca0 0x7f25340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f253b7fe640 1 -- 172.21.15.33:0/1860073359 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f25400e5560 con 0x7f254c1081a0 2024-08-28T19:47:48.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f255751c740 1 -- 172.21.15.33:0/128135336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a846572070 msgr2=0x55a846917300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f254a59c640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25340b4ca0 0x7f25340b71b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55a846915f80 tx=0x7f253c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f255751c740 1 --2- 172.21.15.33:0/128135336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a846572070 0x55a846917300 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f2544009920 tx=0x7f2544009950 comp rx=0 tx=0).stop 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f255751c740 1 -- 172.21.15.33:0/128135336 shutdown_connections 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f255751c740 1 --2- 172.21.15.33:0/128135336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846551390 0x55a846917d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f255751c740 1 --2- 172.21.15.33:0/128135336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a8465491b0 0x55a846917840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f255751c740 1 --2- 172.21.15.33:0/128135336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a846572070 0x55a846917300 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.840+0000 7f255751c740 1 -- 172.21.15.33:0/128135336 >> 172.21.15.33:0/128135336 conn(0x55a846566460 msgr2=0x55a8469151f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 1 -- 172.21.15.33:0/128135336 shutdown_connections 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 1 -- 172.21.15.33:0/128135336 wait complete. 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 1 -- start start 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 1 Processor -- start 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a846922a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846551390 0x55a846922fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846572070 0x55a84692ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a8466e0700 con 0x55a8465491b0 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a846804700 con 0x55a846572070 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a846925900 con 0x55a846551390 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f254a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a846922a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.841+0000 7f255751c740 10 client.0 _ll_register_callbacks cb 0x55a846833dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f254a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a846922a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45922/0 (socket says 172.21.15.33:45922) 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f254a59c640 1 -- 172.21.15.33:0/2715223207 learned_addr learned my addr 172.21.15.33:0/2715223207 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f254ad9d640 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846572070 0x55a84692ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f2549d9b640 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846551390 0x55a846922fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f254a59c640 1 -- 172.21.15.33:0/2715223207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846551390 msgr2=0x55a846922fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f254a59c640 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846551390 0x55a846922fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f254a59c640 1 -- 172.21.15.33:0/2715223207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846572070 msgr2=0x55a84692ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f254a59c640 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846572070 0x55a84692ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f254a59c640 1 -- 172.21.15.33:0/2715223207 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a84683d8b0 con 0x55a8465491b0 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f2549d9b640 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846551390 0x55a846922fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f254a59c640 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a846922a70 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f253c003de0 tx=0x7f253c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22980eb14f7978f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f2531ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f2531ffb640 1 -- 172.21.15.33:0/2715223207 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c01b660 con 0x55a8465491b0 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f2531ffb640 1 -- 172.21.15.33:0/2715223207 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f253c01b800 con 0x55a8465491b0 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.842+0000 7f255751c740 1 -- 172.21.15.33:0/2715223207 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2544036030 con 0x55a8465491b0 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f2531ffb640 1 -- 172.21.15.33:0/2715223207 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f253c01ba00 con 0x55a8465491b0 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f255751c740 10 client.19683 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:48.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f255751c740 1 -- 172.21.15.33:0/2715223207 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a846931700 con 0x55a8465491b0 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f2531ffb640 1 -- 172.21.15.33:0/2715223207 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2544036030 con 0x55a8465491b0 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f2531ffb640 1 -- 172.21.15.33:0/2715223207 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f253c024070 con 0x55a8465491b0 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f255751c740 10 client.19683 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f255751c740 10 client.19683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f255751c740 20 client.19683 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f255751c740 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a8465309f0 0x55a846934c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f255751c740 4 client.19683 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f255751c740 1 -- 172.21.15.33:0/2715223207 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a846890580 con 0x55a8465309f0 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.843+0000 7f2549d9b640 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a8465309f0 0x55a846934c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.844+0000 7f2531ffb640 10 client.19683 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.844+0000 7f2549d9b640 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a8465309f0 0x55a846934c60 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=358c3282b8605d18 server_cookie=d3726cd92cc9eb1b in_seq=0 out_seq=0 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f2531ffb640 1 -- 172.21.15.33:0/2715223207 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a846890580 con 0x55a8465309f0 2024-08-28T19:47:48.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f2531ffb640 10 client.19683 handle_command_reply: tid=0 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 client.19683 shutdown 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 -- 172.21.15.33:0/2715223207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 msgr2=0x55a846922a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a846922a70 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f253c003de0 tx=0x7f253c0046c0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 -- 172.21.15.33:0/2715223207 shutdown_connections 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846572070 0x55a84692ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846551390 0x55a846922fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a8465309f0 0x55a846934c60 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 --2- 172.21.15.33:0/2715223207 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a846922a70 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f2531ffb640 0 client.19683 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 -- 172.21.15.33:0/2715223207 >> 172.21.15.33:0/2715223207 conn(0x55a846566460 msgr2=0x55a84691a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 -- 172.21.15.33:0/2715223207 shutdown_connections 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 1 -- 172.21.15.33:0/2715223207 wait complete. 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.845+0000 7f255751c740 20 client.19683 trim_cache size 0 max 16384 2024-08-28T19:47:48.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f255751c740 1 Processor -- start 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f255751c740 1 -- start start 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f255751c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84691ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f255751c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846551390 0x55a84691fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f255751c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846572070 0x55a8469201a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f255751c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1b2ea0 con 0x55a8465491b0 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f255751c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1b49e0 con 0x55a846551390 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f255751c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1b3570 con 0x55a846572070 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f254a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84691ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f254a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84691ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45936/0 (socket says 172.21.15.33:45936) 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.863+0000 7f254a59c640 1 -- 172.21.15.33:0/3962124212 learned_addr learned my addr 172.21.15.33:0/3962124212 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.864+0000 7f254a59c640 1 -- 172.21.15.33:0/3962124212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846572070 msgr2=0x55a8469201a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.864+0000 7f254a59c640 1 --2- 172.21.15.33:0/3962124212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846572070 0x55a8469201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.864+0000 7f254a59c640 1 -- 172.21.15.33:0/3962124212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846551390 msgr2=0x55a84691fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.864+0000 7f254a59c640 1 --2- 172.21.15.33:0/3962124212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846551390 0x55a84691fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.864+0000 7f254a59c640 1 -- 172.21.15.33:0/3962124212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8469195f0 con 0x55a8465491b0 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.864+0000 7f254a59c640 1 --2- 172.21.15.33:0/3962124212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84691ab10 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f253c006010 tx=0x7f253c00b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0e2c8212e2d4c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.864+0000 7f2533fff640 1 -- 172.21.15.33:0/3962124212 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c039070 con 0x55a8465491b0 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.864+0000 7f2533fff640 1 -- 172.21.15.33:0/3962124212 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f253c01bda0 con 0x55a8465491b0 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.864+0000 7f2533fff640 1 -- 172.21.15.33:0/3962124212 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c004a20 con 0x55a8465491b0 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 -- 172.21.15.33:0/3962124212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 msgr2=0x55a84691ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 --2- 172.21.15.33:0/3962124212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84691ab10 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f253c006010 tx=0x7f253c00b580 comp rx=0 tx=0).stop 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 -- 172.21.15.33:0/3962124212 shutdown_connections 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 --2- 172.21.15.33:0/3962124212 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846572070 0x55a8469201a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 --2- 172.21.15.33:0/3962124212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846551390 0x55a84691fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 --2- 172.21.15.33:0/3962124212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84691ab10 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 -- 172.21.15.33:0/3962124212 >> 172.21.15.33:0/3962124212 conn(0x55a846566460 msgr2=0x55a84691a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 -- 172.21.15.33:0/3962124212 shutdown_connections 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 -- 172.21.15.33:0/3962124212 wait complete. 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 -- start start 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.865+0000 7f255751c740 1 Processor -- start 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f255751c740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84692b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f255751c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846551390 0x55a8469274e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f255751c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846572070 0x55a846927a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f255751c740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1b4310 con 0x55a8465491b0 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f255751c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1b3c40 con 0x55a846551390 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f255751c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1b0ea0 con 0x55a846572070 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f255751c740 10 client.0 _ll_register_callbacks cb 0x7f253c004440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f254a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84692b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f254a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84692b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45942/0 (socket says 172.21.15.33:45942) 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f254a59c640 1 -- 172.21.15.33:0/2548702516 learned_addr learned my addr 172.21.15.33:0/2548702516 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f254ad9d640 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846572070 0x55a846927a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f2549d9b640 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846551390 0x55a8469274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f254a59c640 1 -- 172.21.15.33:0/2548702516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846572070 msgr2=0x55a846927a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f254a59c640 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846572070 0x55a846927a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f254a59c640 1 -- 172.21.15.33:0/2548702516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846551390 msgr2=0x55a8469274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f254a59c640 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846551390 0x55a8469274e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.866+0000 7f254a59c640 1 -- 172.21.15.33:0/2548702516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a846927f60 con 0x55a8465491b0 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.867+0000 7f254a59c640 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84692b020 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f253c013fd0 tx=0x7f253c026670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b196b5257449acc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.867+0000 7f2531ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.867+0000 7f2531ffb640 1 -- 172.21.15.33:0/2548702516 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c039040 con 0x55a8465491b0 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.867+0000 7f2531ffb640 1 -- 172.21.15.33:0/2548702516 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f253c026860 con 0x55a8465491b0 2024-08-28T19:47:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.867+0000 7f255751c740 1 -- 172.21.15.33:0/2548702516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f253c01bda0 con 0x55a8465491b0 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.867+0000 7f2531ffb640 1 -- 172.21.15.33:0/2548702516 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f253c04d050 con 0x55a8465491b0 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.867+0000 7f255751c740 10 client.19689 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.867+0000 7f255751c740 1 -- 172.21.15.33:0/2548702516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a8469a0240 con 0x55a8465491b0 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.867+0000 7f2531ffb640 1 -- 172.21.15.33:0/2548702516 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f253c01bda0 con 0x55a8465491b0 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.868+0000 7f2531ffb640 1 -- 172.21.15.33:0/2548702516 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f253c03c030 con 0x55a8465491b0 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.868+0000 7f255751c740 10 client.19689 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.868+0000 7f255751c740 10 client.19689 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.868+0000 7f255751c740 20 client.19689 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.868+0000 7f255751c740 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a846505da0 0x55a8469a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.868+0000 7f255751c740 4 client.19689 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.868+0000 7f255751c740 1 -- 172.21.15.33:0/2548702516 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a84688c020 con 0x55a846505da0 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.868+0000 7f2549d9b640 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a846505da0 0x55a8469a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:48.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.868+0000 7f2531ffb640 10 client.19689 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:48.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.868+0000 7f2549d9b640 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a846505da0 0x55a8469a29f0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=235d6844855bd8e0 server_cookie=bf378ad4b21bf1e7 in_seq=0 out_seq=0 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f2531ffb640 1 -- 172.21.15.33:0/2548702516 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7102 (crc 0 0 0) 0x55a84688c020 con 0x55a846505da0 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f2531ffb640 10 client.19689 handle_command_reply: tid=0 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 client.19689 shutdown 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 -- 172.21.15.33:0/2548702516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 msgr2=0x55a84692b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84692b020 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f253c013fd0 tx=0x7f253c026670 comp rx=0 tx=0).stop 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 -- 172.21.15.33:0/2548702516 shutdown_connections 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a846572070 0x55a846927a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a846551390 0x55a8469274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55a846505da0 0x55a8469a29f0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 --2- 172.21.15.33:0/2548702516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a8465491b0 0x55a84692b020 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f2531ffb640 0 client.19689 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 -- 172.21.15.33:0/2548702516 >> 172.21.15.33:0/2548702516 conn(0x55a846566460 msgr2=0x55a846918330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 -- 172.21.15.33:0/2548702516 shutdown_connections 2024-08-28T19:47:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 1 -- 172.21.15.33:0/2548702516 wait complete. 2024-08-28T19:47:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.869+0000 7f255751c740 20 client.19689 trim_cache size 0 max 16384 2024-08-28T19:47:48.886 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:47:48.886 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:47:48.886 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:47:48.886 INFO:teuthology.orchestra.run.smithi033.stdout: "153c14e4-9cf6-465d-b1e1-c611091f3f27": { 2024-08-28T19:47:48.886 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "153c14e4-9cf6-465d-b1e1-c611091f3f27", 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.888 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "7bc9ceff-c40a-4b60-a12f-cc9f203af1aa": { 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:47:00.994176+0000", 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.890 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.891 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:45:27.534627+0000", 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.892 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "48fef576-2648-4bab-8772-21d3637a9125": { 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:46:15.427396+0000", 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.893 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:47:48.894 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "153c14e4-9cf6-465d-b1e1-c611091f3f27": { 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:47:47.242949+0000", 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.895 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:47:48.896 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.898 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:47:48.899 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:47:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:47:48.902 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:47:48.902 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:47:48.902 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:48.902 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:48.902 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:47:48.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 -- 172.21.15.33:0/1860073359 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25340b4ca0 msgr2=0x7f25340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:48.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25340b4ca0 0x7f25340b71b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55a846915f80 tx=0x7f253c00b390 comp rx=0 tx=0).stop 2024-08-28T19:47:48.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 -- 172.21.15.33:0/1860073359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254c1081a0 msgr2=0x7f254c199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:48.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254c1081a0 0x7f254c199400 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f254000c970 tx=0x7f254000ce30 comp rx=0 tx=0).stop 2024-08-28T19:47:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 -- 172.21.15.33:0/1860073359 shutdown_connections 2024-08-28T19:47:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f254c108af0 0x7f254c199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254c1081a0 0x7f254c199400 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f25340b4ca0 0x7f25340b71b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 --2- 172.21.15.33:0/1860073359 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f254c102f30 0x7f254c198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 -- 172.21.15.33:0/1860073359 >> 172.21.15.33:0/1860073359 conn(0x7f254c079d30 msgr2=0x7f254c106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 -- 172.21.15.33:0/1860073359 shutdown_connections 2024-08-28T19:47:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:48.870+0000 7f2550fa7640 1 -- 172.21.15.33:0/1860073359 wait complete. 2024-08-28T19:47:49.101 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:47:49.793 INFO:tasks.cephfs.filesystem:scrub status for tag:153c14e4-9cf6-465d-b1e1-c611091f3f27 - {'path': '/', 'tag': '153c14e4-9cf6-465d-b1e1-c611091f3f27', 'options': 'recursive,force'} 2024-08-28T19:47:49.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:49 smithi033 ceph-mon[18549]: pgmap v821: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-08-28T19:47:49.887 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:50.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:49 smithi059 ceph-mon[22052]: pgmap v821: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-08-28T19:47:50.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:49 smithi122 ceph-mon[22174]: pgmap v821: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-08-28T19:47:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.401+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/328044564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe04075ea0 msgr2=0x7fbe0410f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.401+0000 7fbe0b1e1640 1 --2- 172.21.15.33:0/328044564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe04075ea0 0x7fbe0410f920 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009900 tx=0x7fbdf002a410 comp rx=0 tx=0).stop 2024-08-28T19:47:50.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.402+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/328044564 shutdown_connections 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.402+0000 7fbe0b1e1640 1 --2- 172.21.15.33:0/328044564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0410fe60 0x7fbe041122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.402+0000 7fbe0b1e1640 1 --2- 172.21.15.33:0/328044564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe04075ea0 0x7fbe0410f920 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.402+0000 7fbe0b1e1640 1 --2- 172.21.15.33:0/328044564 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe04075550 0x7fbe04075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.402+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/328044564 >> 172.21.15.33:0/328044564 conn(0x7fbe0407b5f0 msgr2=0x7fbe0407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.402+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/328044564 shutdown_connections 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.402+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/328044564 wait complete. 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.402+0000 7fbe0b1e1640 1 Processor -- start 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.402+0000 7fbe0b1e1640 1 -- start start 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe0b1e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe04075550 0x7fbe0419c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe0b1e1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe04075ea0 0x7fbe0419c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe0b1e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe0410fe60 0x7fbe041a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:50.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe0b1e1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041159d0 con 0x7fbe04075550 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe0b1e1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe04115850 con 0x7fbe04075ea0 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe0b1e1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fbe04115b50 con 0x7fbe0410fe60 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe08f7d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe04075550 0x7fbe0419c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe08f7d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe04075550 0x7fbe0419c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45962/0 (socket says 172.21.15.33:45962) 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe08f7d640 1 -- 172.21.15.33:0/3828291552 learned_addr learned my addr 172.21.15.33:0/3828291552 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe03fff640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe04075ea0 0x7fbe0419c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe0977e640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe0410fe60 0x7fbe041a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe08f7d640 1 -- 172.21.15.33:0/3828291552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe0410fe60 msgr2=0x7fbe041a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe08f7d640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe0410fe60 0x7fbe041a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe08f7d640 1 -- 172.21.15.33:0/3828291552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe04075ea0 msgr2=0x7fbe0419c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe08f7d640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe04075ea0 0x7fbe0419c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe08f7d640 1 -- 172.21.15.33:0/3828291552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe041a2390 con 0x7fbe04075550 2024-08-28T19:47:50.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe03fff640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe04075ea0 0x7fbe0419c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe08f7d640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe04075550 0x7fbe0419c420 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800d950 tx=0x7fbdf800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe01ffb640 1 -- 172.21.15.33:0/3828291552 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8017070 con 0x7fbe04075550 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/3828291552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe041a2680 con 0x7fbe04075550 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe01ffb640 1 -- 172.21.15.33:0/3828291552 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdf8009c30 con 0x7fbe04075550 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.403+0000 7fbe01ffb640 1 -- 172.21.15.33:0/3828291552 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800f620 con 0x7fbe04075550 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.404+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/3828291552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe041a8de0 con 0x7fbe04075550 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.405+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/3828291552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe04075960 con 0x7fbe04075550 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.406+0000 7fbe01ffb640 1 -- 172.21.15.33:0/3828291552 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fbdf8010460 con 0x7fbe04075550 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.407+0000 7fbe01ffb640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbdf40b4ca0 0x7fbdf40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.407+0000 7fbe03fff640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbdf40b4ca0 0x7fbdf40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.407+0000 7fbe01ffb640 1 -- 172.21.15.33:0/3828291552 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fbdf80e55f0 con 0x7fbe04075550 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.407+0000 7fbe03fff640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbdf40b4ca0 0x7fbdf40b71b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0000c00 tx=0x7fbdf0032da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:50.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.411+0000 7fbe01ffb640 1 -- 172.21.15.33:0/3828291552 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbdf80ac040 con 0x7fbe04075550 2024-08-28T19:47:50.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.636+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/3828291552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe0419d550 con 0x7fbe04075550 2024-08-28T19:47:50.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.637+0000 7fbe01ffb640 1 -- 172.21.15.33:0/3828291552 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fbdf8009de0 con 0x7fbe04075550 2024-08-28T19:47:50.638 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:47:50.638 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:47:50.638 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:47:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/3828291552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbdf40b4ca0 msgr2=0x7fbdf40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbdf40b4ca0 0x7fbdf40b71b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0000c00 tx=0x7fbdf0032da0 comp rx=0 tx=0).stop 2024-08-28T19:47:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/3828291552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe04075550 msgr2=0x7fbe0419c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe04075550 0x7fbe0419c420 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800d950 tx=0x7fbdf800de10 comp rx=0 tx=0).stop 2024-08-28T19:47:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/3828291552 shutdown_connections 2024-08-28T19:47:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fbdf40b4ca0 0x7fbdf40b71b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:50.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe0410fe60 0x7fbe041a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe04075ea0 0x7fbe0419c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 --2- 172.21.15.33:0/3828291552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe04075550 0x7fbe0419c420 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/3828291552 >> 172.21.15.33:0/3828291552 conn(0x7fbe0407b5f0 msgr2=0x7fbe04101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/3828291552 shutdown_connections 2024-08-28T19:47:50.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:50.639+0000 7fbe0b1e1640 1 -- 172.21.15.33:0/3828291552 wait complete. 2024-08-28T19:47:51.295 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id 24c6780b --release --await' 2024-08-28T19:47:51.295 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id 24c6780b --release --await 2024-08-28T19:47:51.549 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:51.845 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:51 smithi033 ceph-mon[18549]: pgmap v822: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-08-28T19:47:51.845 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:51 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3828291552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:52.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:51 smithi059 ceph-mon[22052]: pgmap v822: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-08-28T19:47:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:51 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3828291552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:52.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:51 smithi122 ceph-mon[22174]: pgmap v822: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-08-28T19:47:52.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:51 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3828291552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.119+0000 7fba871b3640 1 -- 172.21.15.33:0/1958118283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba80102800 msgr2=0x7fba80102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.119+0000 7fba871b3640 1 --2- 172.21.15.33:0/1958118283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba80102800 0x7fba80102c10 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fba70009900 tx=0x7fba7002a410 comp rx=0 tx=0).stop 2024-08-28T19:47:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.119+0000 7fba871b3640 1 -- 172.21.15.33:0/1958118283 shutdown_connections 2024-08-28T19:47:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.119+0000 7fba871b3640 1 --2- 172.21.15.33:0/1958118283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba80108a90 0x7fba8010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.119+0000 7fba871b3640 1 --2- 172.21.15.33:0/1958118283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba80108140 0x7fba80108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.119+0000 7fba871b3640 1 --2- 172.21.15.33:0/1958118283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba80102800 0x7fba80102c10 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.119+0000 7fba871b3640 1 -- 172.21.15.33:0/1958118283 >> 172.21.15.33:0/1958118283 conn(0x7fba800794d0 msgr2=0x7fba800798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.119+0000 7fba871b3640 1 -- 172.21.15.33:0/1958118283 shutdown_connections 2024-08-28T19:47:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.119+0000 7fba871b3640 1 -- 172.21.15.33:0/1958118283 wait complete. 2024-08-28T19:47:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba871b3640 1 Processor -- start 2024-08-28T19:47:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba871b3640 1 -- start start 2024-08-28T19:47:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba871b3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba80102800 0x7fba80199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba871b3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba80108140 0x7fba801996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba871b3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba80108a90 0x7fba8019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba871b3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fba80112710 con 0x7fba80102800 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba871b3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fba80112590 con 0x7fba80108a90 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba871b3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fba80112890 con 0x7fba80108140 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba84f4f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba80102800 0x7fba80199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba84f4f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba80102800 0x7fba80199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45982/0 (socket says 172.21.15.33:45982) 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.120+0000 7fba84f4f640 1 -- 172.21.15.33:0/3050788916 learned_addr learned my addr 172.21.15.33:0/3050788916 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba85750640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba80108a90 0x7fba8019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba7ffff640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba80108140 0x7fba801996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba84f4f640 1 -- 172.21.15.33:0/3050788916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba80108140 msgr2=0x7fba801996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba84f4f640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba80108140 0x7fba801996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba84f4f640 1 -- 172.21.15.33:0/3050788916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba80108a90 msgr2=0x7fba8019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba84f4f640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba80108a90 0x7fba8019e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba84f4f640 1 -- 172.21.15.33:0/3050788916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8019efd0 con 0x7fba80102800 2024-08-28T19:47:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba7ffff640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba80108140 0x7fba801996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba84f4f640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba80102800 0x7fba80199120 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fba70005940 tx=0x7fba700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba7dffb640 1 -- 172.21.15.33:0/3050788916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7003f030 con 0x7fba80102800 2024-08-28T19:47:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba7dffb640 1 -- 172.21.15.33:0/3050788916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba70003cb0 con 0x7fba80102800 2024-08-28T19:47:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba871b3640 1 -- 172.21.15.33:0/3050788916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8019f260 con 0x7fba80102800 2024-08-28T19:47:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba7dffb640 1 -- 172.21.15.33:0/3050788916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba70035070 con 0x7fba80102800 2024-08-28T19:47:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.121+0000 7fba871b3640 1 -- 172.21.15.33:0/3050788916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8019f740 con 0x7fba80102800 2024-08-28T19:47:52.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba8d728740 1 Processor -- start 2024-08-28T19:47:52.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba8d728740 1 -- start start 2024-08-28T19:47:52.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba7dffb640 1 -- 172.21.15.33:0/3050788916 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fba70042030 con 0x7fba80102800 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba8d728740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd7c520 0x55fe1c121c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba8d728740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd53660 0x55fe1c1221c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba8d728740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c122700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba8d728740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c098a70 con 0x55fe1bd53660 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba8d728740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c088000 con 0x55fe1bd5b840 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba8d728740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c08bfb0 con 0x55fe1bd7c520 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba84f4f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd53660 0x55fe1c1221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba84f4f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd53660 0x55fe1c1221c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45998/0 (socket says 172.21.15.33:45998) 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba84f4f640 1 -- 172.21.15.33:0/2481615712 learned_addr learned my addr 172.21.15.33:0/2481615712 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba7ffff640 1 --2- 172.21.15.33:0/2481615712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.124+0000 7fba85750640 1 --2- 172.21.15.33:0/2481615712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd7c520 0x55fe1c121c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba84f4f640 1 -- 172.21.15.33:0/2481615712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd7c520 msgr2=0x55fe1c121c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba84f4f640 1 --2- 172.21.15.33:0/2481615712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd7c520 0x55fe1c121c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba84f4f640 1 -- 172.21.15.33:0/2481615712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 msgr2=0x55fe1c122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba84f4f640 1 --2- 172.21.15.33:0/2481615712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba84f4f640 1 -- 172.21.15.33:0/2481615712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1bde7b00 con 0x55fe1bd53660 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba84f4f640 1 --2- 172.21.15.33:0/2481615712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd53660 0x55fe1c1221c0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fba701031f0 tx=0x7fba7010e2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153bfa8dd48d6e7b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba7dffb640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fba680b4cd0 0x7fba680b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba66ffd640 1 -- 172.21.15.33:0/2481615712 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba700c8870 con 0x55fe1bd53660 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba85750640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fba680b4cd0 0x7fba680b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba66ffd640 1 -- 172.21.15.33:0/2481615712 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba70113070 con 0x55fe1bd53660 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.125+0000 7fba7dffb640 1 -- 172.21.15.33:0/3050788916 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fba70105ed0 con 0x7fba80102800 2024-08-28T19:47:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba66ffd640 1 -- 172.21.15.33:0/2481615712 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba700cb990 con 0x55fe1bd53660 2024-08-28T19:47:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba8d728740 1 -- 172.21.15.33:0/2481615712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd53660 msgr2=0x55fe1c1221c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba85750640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fba680b4cd0 0x7fba680b71e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fba78008e80 tx=0x7fba780085d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba8d728740 1 --2- 172.21.15.33:0/2481615712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd53660 0x55fe1c1221c0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fba701031f0 tx=0x7fba7010e2d0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba8d728740 1 -- 172.21.15.33:0/2481615712 shutdown_connections 2024-08-28T19:47:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba8d728740 1 --2- 172.21.15.33:0/2481615712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba8d728740 1 --2- 172.21.15.33:0/2481615712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd53660 0x55fe1c1221c0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba8d728740 1 --2- 172.21.15.33:0/2481615712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd7c520 0x55fe1c121c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba8d728740 1 -- 172.21.15.33:0/2481615712 >> 172.21.15.33:0/2481615712 conn(0x55fe1bd70910 msgr2=0x55fe1c11fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba8d728740 1 -- 172.21.15.33:0/2481615712 shutdown_connections 2024-08-28T19:47:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.126+0000 7fba8d728740 1 -- 172.21.15.33:0/2481615712 wait complete. 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.127+0000 7fba8d728740 1 -- start start 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.127+0000 7fba8d728740 1 Processor -- start 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.127+0000 7fba8d728740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd53660 0x55fe1c12f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.127+0000 7fba8d728740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c12fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.127+0000 7fba8d728740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c13b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.127+0000 7fba8d728740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c132380 con 0x55fe1bd7c520 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.127+0000 7fba8d728740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c049520 con 0x55fe1bd5b840 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.127+0000 7fba8d728740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fe1c132500 con 0x55fe1bd53660 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.127+0000 7fba8d728740 10 client.0 _ll_register_callbacks cb 0x55fe1c081c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba85750640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c13b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba85750640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c13b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46010/0 (socket says 172.21.15.33:46010) 2024-08-28T19:47:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba85750640 1 -- 172.21.15.33:0/2402617894 learned_addr learned my addr 172.21.15.33:0/2402617894 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba7ffff640 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c12fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba84f4f640 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd53660 0x55fe1c12f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba85750640 1 -- 172.21.15.33:0/2402617894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd53660 msgr2=0x55fe1c12f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba85750640 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd53660 0x55fe1c12f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba85750640 1 -- 172.21.15.33:0/2402617894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 msgr2=0x55fe1c12fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba85750640 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c12fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba85750640 1 -- 172.21.15.33:0/2402617894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe1be5e960 con 0x55fe1bd7c520 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba85750640 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c13b7f0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fba7800ed80 tx=0x7fba78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fea0f9d5fa87b31 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba5ffff640 1 -- 172.21.15.33:0/2402617894 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78025600 con 0x55fe1bd7c520 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba5ffff640 1 -- 172.21.15.33:0/2402617894 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fba780257a0 con 0x55fe1bd7c520 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.128+0000 7fba8d728740 1 -- 172.21.15.33:0/2402617894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe1c0279a0 con 0x55fe1bd7c520 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba5ffff640 1 -- 172.21.15.33:0/2402617894 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fba7800ee70 con 0x55fe1bd7c520 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba8d728740 10 client.19707 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba8d728740 1 -- 172.21.15.33:0/2402617894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fe1c13e480 con 0x55fe1bd7c520 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba5ffff640 1 -- 172.21.15.33:0/2402617894 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fe1c0279a0 con 0x55fe1bd7c520 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba5ffff640 1 -- 172.21.15.33:0/2402617894 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fba7801da00 con 0x55fe1bd7c520 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba8d728740 10 client.19707 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba8d728740 10 client.19707 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba8d728740 20 client.19707 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba8d728740 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fe1bd3aea0 0x55fe1c1419d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba8d728740 4 client.19707 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba8d728740 1 -- 172.21.15.33:0/2402617894 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe1c09a9c0 con 0x55fe1bd3aea0 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.129+0000 7fba84f4f640 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fe1bd3aea0 0x55fe1c1419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.130+0000 7fba84f4f640 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fe1bd3aea0 0x55fe1c1419d0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e818151ae9c6ab03 server_cookie=58f989b1699903ac in_seq=0 out_seq=0 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.130+0000 7fba5ffff640 10 client.19707 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba5ffff640 1 -- 172.21.15.33:0/2402617894 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fe1c09a9c0 con 0x55fe1bd3aea0 2024-08-28T19:47:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba5ffff640 10 client.19707 handle_command_reply: tid=0 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 client.19707 shutdown 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 -- 172.21.15.33:0/2402617894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 msgr2=0x55fe1c13b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c13b7f0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fba7800ed80 tx=0x7fba78004a40 comp rx=0 tx=0).stop 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 -- 172.21.15.33:0/2402617894 shutdown_connections 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fe1bd3aea0 0x55fe1c1419d0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c13b7f0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c12fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba5ffff640 0 client.19707 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 --2- 172.21.15.33:0/2402617894 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd53660 0x55fe1c12f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 -- 172.21.15.33:0/2402617894 >> 172.21.15.33:0/2402617894 conn(0x55fe1bd70910 msgr2=0x55fe1c123670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 -- 172.21.15.33:0/2402617894 shutdown_connections 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 1 -- 172.21.15.33:0/2402617894 wait complete. 2024-08-28T19:47:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.131+0000 7fba8d728740 20 client.19707 trim_cache size 0 max 16384 2024-08-28T19:47:52.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba8d728740 1 Processor -- start 2024-08-28T19:47:52.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba8d728740 1 -- start start 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba8d728740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd53660 0x55fe1c137b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba8d728740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba8d728740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c11f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba8d728740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fba801ae980 con 0x55fe1bd7c520 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba8d728740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fba801b04c0 con 0x55fe1bd5b840 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba8d728740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fba801af050 con 0x55fe1bd53660 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba85750640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c11f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba85750640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c11f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46020/0 (socket says 172.21.15.33:46020) 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba85750640 1 -- 172.21.15.33:0/3523175037 learned_addr learned my addr 172.21.15.33:0/3523175037 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba7ffff640 1 --2- 172.21.15.33:0/3523175037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba84f4f640 1 --2- 172.21.15.33:0/3523175037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd53660 0x55fe1c137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba85750640 1 -- 172.21.15.33:0/3523175037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd53660 msgr2=0x55fe1c137b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:52.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.149+0000 7fba85750640 1 --2- 172.21.15.33:0/3523175037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd53660 0x55fe1c137b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.150+0000 7fba85750640 1 -- 172.21.15.33:0/3523175037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 msgr2=0x55fe1c138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:52.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.150+0000 7fba85750640 1 --2- 172.21.15.33:0/3523175037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.150+0000 7fba85750640 1 -- 172.21.15.33:0/3523175037 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1c12b020 con 0x55fe1bd7c520 2024-08-28T19:47:52.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.150+0000 7fba85750640 1 --2- 172.21.15.33:0/3523175037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c11f490 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fba78008980 tx=0x7fba7800ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77ff135836ce361 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:52.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.150+0000 7fba667fc640 1 -- 172.21.15.33:0/3523175037 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78004cb0 con 0x55fe1bd7c520 2024-08-28T19:47:52.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.150+0000 7fba667fc640 1 -- 172.21.15.33:0/3523175037 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba7800dc00 con 0x55fe1bd7c520 2024-08-28T19:47:52.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.150+0000 7fba667fc640 1 -- 172.21.15.33:0/3523175037 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba780055f0 con 0x55fe1bd7c520 2024-08-28T19:47:52.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 -- 172.21.15.33:0/3523175037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 msgr2=0x55fe1c11f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:52.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 --2- 172.21.15.33:0/3523175037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c11f490 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fba78008980 tx=0x7fba7800ea90 comp rx=0 tx=0).stop 2024-08-28T19:47:52.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 -- 172.21.15.33:0/3523175037 shutdown_connections 2024-08-28T19:47:52.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 --2- 172.21.15.33:0/3523175037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd7c520 0x55fe1c11f490 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 --2- 172.21.15.33:0/3523175037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd5b840 0x55fe1c138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 --2- 172.21.15.33:0/3523175037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd53660 0x55fe1c137b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 -- 172.21.15.33:0/3523175037 >> 172.21.15.33:0/3523175037 conn(0x55fe1bd70910 msgr2=0x55fe1c12e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:52.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 -- 172.21.15.33:0/3523175037 shutdown_connections 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 -- 172.21.15.33:0/3523175037 wait complete. 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 -- start start 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.151+0000 7fba8d728740 1 Processor -- start 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba8d728740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd53660 0x55fe1c12c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba8d728740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd5b840 0x55fe1c12cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba8d728740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd7c520 0x55fe1c1a7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba8d728740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fba801afdf0 con 0x55fe1bd5b840 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba8d728740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fba801af720 con 0x55fe1bd53660 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba8d728740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fba801ac980 con 0x55fe1bd7c520 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba7ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd5b840 0x55fe1c12cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba8d728740 10 client.0 _ll_register_callbacks cb 0x7fba780087f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:52.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba7ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd5b840 0x55fe1c12cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46034/0 (socket says 172.21.15.33:46034) 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba7ffff640 1 -- 172.21.15.33:0/3158245084 learned_addr learned my addr 172.21.15.33:0/3158245084 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba84f4f640 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd53660 0x55fe1c12c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba85750640 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd7c520 0x55fe1c1a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba7ffff640 1 -- 172.21.15.33:0/3158245084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd7c520 msgr2=0x55fe1c1a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba7ffff640 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd7c520 0x55fe1c1a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba7ffff640 1 -- 172.21.15.33:0/3158245084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd53660 msgr2=0x55fe1c12c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba7ffff640 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd53660 0x55fe1c12c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba7ffff640 1 -- 172.21.15.33:0/3158245084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe1c1a79e0 con 0x55fe1bd5b840 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba7ffff640 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd5b840 0x55fe1c12cbb0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fba74012750 tx=0x7fba74012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a3494f45b89f5e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.152+0000 7fba5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba5ffff640 1 -- 172.21.15.33:0/3158245084 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba74021060 con 0x55fe1bd5b840 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba5ffff640 1 -- 172.21.15.33:0/3158245084 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7fba74011d30 con 0x55fe1bd5b840 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba8d728740 1 -- 172.21.15.33:0/3158245084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba7800dc00 con 0x55fe1bd5b840 2024-08-28T19:47:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba5ffff640 1 -- 172.21.15.33:0/3158245084 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fba74028050 con 0x55fe1bd5b840 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba8d728740 10 client.19713 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba8d728740 1 -- 172.21.15.33:0/3158245084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fe1c1affc0 con 0x55fe1bd5b840 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba5ffff640 1 -- 172.21.15.33:0/3158245084 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba7800dc00 con 0x55fe1bd5b840 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba5ffff640 1 -- 172.21.15.33:0/3158245084 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fba7401b070 con 0x55fe1bd5b840 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba8d728740 10 client.19713 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba8d728740 10 client.19713 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba8d728740 20 client.19713 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba8d728740 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fe1bd10250 0x55fe1c1b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba8d728740 4 client.19713 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "24c6780b", "release": true, "await": true}] 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.153+0000 7fba8d728740 1 -- 172.21.15.33:0/3158245084 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "24c6780b", "release": true, "await": true}) -- 0x55fe1c096460 con 0x55fe1bd10250 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.154+0000 7fba84f4f640 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fe1bd10250 0x55fe1c1b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.154+0000 7fba5ffff640 10 client.19713 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:52.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.154+0000 7fba84f4f640 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fe1bd10250 0x55fe1c1b27e0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd25082f1fe88208 server_cookie=d695a7511be43d03 in_seq=0 out_seq=0 2024-08-28T19:47:52.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.158+0000 7fba5ffff640 1 -- 172.21.15.33:0/3158245084 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fe1c096460 con 0x55fe1bd10250 2024-08-28T19:47:52.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.158+0000 7fba5ffff640 10 client.19713 handle_command_reply: tid=0 2024-08-28T19:47:52.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.158+0000 7fba8d728740 1 client.19713 shutdown 2024-08-28T19:47:52.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 1 -- 172.21.15.33:0/3158245084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd5b840 msgr2=0x55fe1c12cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:52.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd5b840 0x55fe1c12cbb0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fba74012750 tx=0x7fba74012c10 comp rx=0 tx=0).stop 2024-08-28T19:47:52.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 1 -- 172.21.15.33:0/3158245084 shutdown_connections 2024-08-28T19:47:52.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fe1bd7c520 0x55fe1c1a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fe1bd10250 0x55fe1c1b27e0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fe1bd5b840 0x55fe1c12cbb0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba5ffff640 0 client.19713 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 1 --2- 172.21.15.33:0/3158245084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe1bd53660 0x55fe1c12c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 1 -- 172.21.15.33:0/3158245084 >> 172.21.15.33:0/3158245084 conn(0x55fe1bd70910 msgr2=0x55fe1c11f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 1 -- 172.21.15.33:0/3158245084 shutdown_connections 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 1 -- 172.21.15.33:0/3158245084 wait complete. 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.159+0000 7fba8d728740 20 client.19713 trim_cache size 0 max 16384 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 48, 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:47:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "24c6780b": { 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 48, 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:47:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:47:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:52.163 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:47:52.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 -- 172.21.15.33:0/3050788916 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fba680b4cd0 msgr2=0x7fba680b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fba680b4cd0 0x7fba680b71e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fba78008e80 tx=0x7fba780085d0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 -- 172.21.15.33:0/3050788916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba80102800 msgr2=0x7fba80199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba80102800 0x7fba80199120 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fba70005940 tx=0x7fba700042f0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 -- 172.21.15.33:0/3050788916 shutdown_connections 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba80108a90 0x7fba8019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fba680b4cd0 0x7fba680b71e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fba80108140 0x7fba801996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 --2- 172.21.15.33:0/3050788916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba80102800 0x7fba80199120 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 -- 172.21.15.33:0/3050788916 >> 172.21.15.33:0/3050788916 conn(0x7fba800794d0 msgr2=0x7fba80101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 -- 172.21.15.33:0/3050788916 shutdown_connections 2024-08-28T19:47:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:52.160+0000 7fba871b3640 1 -- 172.21.15.33:0/3050788916 wait complete. 2024-08-28T19:47:52.925 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '24c6780b', total seconds elapsed: 33.8 2024-08-28T19:47:52.925 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-28T19:47:52.926 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:47:53.185 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:53.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:53 smithi033 ceph-mon[18549]: pgmap v823: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-08-28T19:47:53.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.862+0000 7f3f1badd640 1 -- 172.21.15.33:0/3260305737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14109b90 msgr2=0x7f3f141103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:53.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.862+0000 7f3f1badd640 1 --2- 172.21.15.33:0/3260305737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14109b90 0x7f3f141103c0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009ca0 tx=0x7f3f0c02a8e0 comp rx=0 tx=0).stop 2024-08-28T19:47:53.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.862+0000 7f3f1badd640 1 -- 172.21.15.33:0/3260305737 shutdown_connections 2024-08-28T19:47:53.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.862+0000 7f3f1badd640 1 --2- 172.21.15.33:0/3260305737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14109b90 0x7f3f141103c0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:53.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.862+0000 7f3f1badd640 1 --2- 172.21.15.33:0/3260305737 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f14109240 0x7f3f14109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:53.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.862+0000 7f3f1badd640 1 --2- 172.21.15.33:0/3260305737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f14103900 0x7f3f14103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:53.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.862+0000 7f3f1badd640 1 -- 172.21.15.33:0/3260305737 >> 172.21.15.33:0/3260305737 conn(0x7f3f1407b5f0 msgr2=0x7f3f1407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:53.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.863+0000 7f3f1badd640 1 -- 172.21.15.33:0/3260305737 shutdown_connections 2024-08-28T19:47:53.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.863+0000 7f3f1badd640 1 -- 172.21.15.33:0/3260305737 wait complete. 2024-08-28T19:47:53.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.863+0000 7f3f1badd640 1 Processor -- start 2024-08-28T19:47:53.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.863+0000 7f3f1badd640 1 -- start start 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.863+0000 7f3f1badd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14103900 0x7f3f1419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.863+0000 7f3f1badd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f14109240 0x7f3f1419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.863+0000 7f3f1badd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f14109b90 0x7f3f1419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.863+0000 7f3f1badd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14113910 con 0x7f3f14103900 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.863+0000 7f3f1badd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14113790 con 0x7f3f14109b90 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.863+0000 7f3f1badd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f3f14113a90 con 0x7f3f14109240 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19879640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14103900 0x7f3f1419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19879640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14103900 0x7f3f1419a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46064/0 (socket says 172.21.15.33:46064) 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19879640 1 -- 172.21.15.33:0/701300156 learned_addr learned my addr 172.21.15.33:0/701300156 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19078640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f14109240 0x7f3f1419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f1a07a640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f14109b90 0x7f3f1419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19879640 1 -- 172.21.15.33:0/701300156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f14109240 msgr2=0x7f3f1419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:53.866 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19879640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f14109240 0x7f3f1419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19879640 1 -- 172.21.15.33:0/701300156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f14109b90 msgr2=0x7f3f1419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19879640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f14109b90 0x7f3f1419fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19879640 1 -- 172.21.15.33:0/701300156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f141a03b0 con 0x7f3f14103900 2024-08-28T19:47:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19078640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f14109240 0x7f3f1419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f19879640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14103900 0x7f3f1419a440 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000b4a0 tx=0x7f3f1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f0affd640 1 -- 172.21.15.33:0/701300156 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10014070 con 0x7f3f14103900 2024-08-28T19:47:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f0affd640 1 -- 172.21.15.33:0/701300156 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f10010ac0 con 0x7f3f14103900 2024-08-28T19:47:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f0affd640 1 -- 172.21.15.33:0/701300156 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10017c30 con 0x7f3f14103900 2024-08-28T19:47:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f1badd640 1 -- 172.21.15.33:0/701300156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f141a06a0 con 0x7f3f14103900 2024-08-28T19:47:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.864+0000 7f3f1badd640 1 -- 172.21.15.33:0/701300156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f141a6e00 con 0x7f3f14103900 2024-08-28T19:47:53.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.865+0000 7f3f1badd640 1 -- 172.21.15.33:0/701300156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f14103d90 con 0x7f3f14103900 2024-08-28T19:47:53.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.867+0000 7f3f0affd640 1 -- 172.21.15.33:0/701300156 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3f10017070 con 0x7f3f14103900 2024-08-28T19:47:53.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.868+0000 7f3f0affd640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f000b4ca0 0x7f3f000b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:53.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.868+0000 7f3f19078640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f000b4ca0 0x7f3f000b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:53.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.868+0000 7f3f0affd640 1 -- 172.21.15.33:0/701300156 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f3f100e4f30 con 0x7f3f14103900 2024-08-28T19:47:53.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.869+0000 7f3f19078640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f000b4ca0 0x7f3f000b71b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3f14106260 tx=0x7f3f04008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:53.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:53.871+0000 7f3f0affd640 1 -- 172.21.15.33:0/701300156 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3f100ab980 con 0x7f3f14103900 2024-08-28T19:47:54.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:53 smithi059 ceph-mon[22052]: pgmap v823: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-08-28T19:47:54.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:53 smithi122 ceph-mon[22174]: pgmap v823: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.1 KiB/s wr, 9 op/s 2024-08-28T19:47:54.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.099+0000 7f3f1badd640 1 -- 172.21.15.33:0/701300156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f1419b570 con 0x7f3f14103900 2024-08-28T19:47:54.100 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.100+0000 7f3f0affd640 1 -- 172.21.15.33:0/701300156 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f3f1419b570 con 0x7f3f14103900 2024-08-28T19:47:54.101 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:47:54.101 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:47:54.101 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:47:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 -- 172.21.15.33:0/701300156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f000b4ca0 msgr2=0x7f3f000b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f000b4ca0 0x7f3f000b71b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3f14106260 tx=0x7f3f04008040 comp rx=0 tx=0).stop 2024-08-28T19:47:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 -- 172.21.15.33:0/701300156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14103900 msgr2=0x7f3f1419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14103900 0x7f3f1419a440 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000b4a0 tx=0x7f3f1000b960 comp rx=0 tx=0).stop 2024-08-28T19:47:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 -- 172.21.15.33:0/701300156 shutdown_connections 2024-08-28T19:47:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f14109b90 0x7f3f1419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f3f000b4ca0 0x7f3f000b71b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3f14109240 0x7f3f1419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 --2- 172.21.15.33:0/701300156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f14103900 0x7f3f1419a440 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 -- 172.21.15.33:0/701300156 >> 172.21.15.33:0/701300156 conn(0x7f3f1407b5f0 msgr2=0x7f3f141073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 -- 172.21.15.33:0/701300156 shutdown_connections 2024-08-28T19:47:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:54.102+0000 7f3f1badd640 1 -- 172.21.15.33:0/701300156 wait complete. 2024-08-28T19:47:54.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:54 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/701300156' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:54.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:54 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:47:54.816 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-28T19:47:54.816 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-28T19:47:55.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:54 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/701300156' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:55.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:54 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:47:55.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:54 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/701300156' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:47:55.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:54 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:47:55.074 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:47:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.642+0000 7f2f873ea640 1 -- 172.21.15.33:0/671290173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f80103910 msgr2=0x7f2f80103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.642+0000 7f2f873ea640 1 --2- 172.21.15.33:0/671290173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f80103910 0x7f2f80103d20 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009900 tx=0x7f2f7402a410 comp rx=0 tx=0).stop 2024-08-28T19:47:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.642+0000 7f2f873ea640 1 -- 172.21.15.33:0/671290173 shutdown_connections 2024-08-28T19:47:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.642+0000 7f2f873ea640 1 --2- 172.21.15.33:0/671290173 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f80109ba0 0x7f2f801103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.642+0000 7f2f873ea640 1 --2- 172.21.15.33:0/671290173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f80109250 0x7f2f80109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.642+0000 7f2f873ea640 1 --2- 172.21.15.33:0/671290173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f80103910 0x7f2f80103d20 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.642+0000 7f2f873ea640 1 -- 172.21.15.33:0/671290173 >> 172.21.15.33:0/671290173 conn(0x7f2f800ff340 msgr2=0x7f2f80101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:55.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.642+0000 7f2f873ea640 1 -- 172.21.15.33:0/671290173 shutdown_connections 2024-08-28T19:47:55.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.642+0000 7f2f873ea640 1 -- 172.21.15.33:0/671290173 wait complete. 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f873ea640 1 Processor -- start 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f873ea640 1 -- start start 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f873ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f80103910 0x7f2f8019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f873ea640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f80109250 0x7f2f8019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f873ea640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f80109ba0 0x7f2f8019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f873ea640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2f80113860 con 0x7f2f80109ba0 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f873ea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801136e0 con 0x7f2f80103910 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f873ea640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801139e0 con 0x7f2f80109250 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f85987640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f80109ba0 0x7f2f8019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f85987640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f80109ba0 0x7f2f8019fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46080/0 (socket says 172.21.15.33:46080) 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f85987640 1 -- 172.21.15.33:0/2028972511 learned_addr learned my addr 172.21.15.33:0/2028972511 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f85186640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f80103910 0x7f2f8019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.643+0000 7f2f84985640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f80109250 0x7f2f8019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f85987640 1 -- 172.21.15.33:0/2028972511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f80109250 msgr2=0x7f2f8019a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f85987640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f80109250 0x7f2f8019a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f85987640 1 -- 172.21.15.33:0/2028972511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f80103910 msgr2=0x7f2f8019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f85987640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f80103910 0x7f2f8019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f85987640 1 -- 172.21.15.33:0/2028972511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f801a01a0 con 0x7f2f80109ba0 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f84985640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f80109250 0x7f2f8019a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f85987640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f80109ba0 0x7f2f8019fb30 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800cce0 tx=0x7f2f7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f727fc640 1 -- 172.21.15.33:0/2028972511 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800f450 con 0x7f2f80109ba0 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f727fc640 1 -- 172.21.15.33:0/2028972511 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f7800faa0 con 0x7f2f80109ba0 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f873ea640 1 -- 172.21.15.33:0/2028972511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f801a0490 con 0x7f2f80109ba0 2024-08-28T19:47:55.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f727fc640 1 -- 172.21.15.33:0/2028972511 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78018b70 con 0x7f2f80109ba0 2024-08-28T19:47:55.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.644+0000 7f2f873ea640 1 -- 172.21.15.33:0/2028972511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f801a6cb0 con 0x7f2f80109ba0 2024-08-28T19:47:55.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f727fc640 1 -- 172.21.15.33:0/2028972511 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2f78018d10 con 0x7f2f80109ba0 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f8d95f740 1 Processor -- start 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f8d95f740 1 -- start start 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57f3840 0x55d9e5b9f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57ca980 0x55d9e5b9f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5b9fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d9e5b0f330 con 0x55d9e57d2b60 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d9e5afe8c0 con 0x55d9e57ca980 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d9e5b02870 con 0x55d9e57f3840 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f84985640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5b9fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f84985640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5b9fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46082/0 (socket says 172.21.15.33:46082) 2024-08-28T19:47:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f84985640 1 -- 172.21.15.33:0/919044956 learned_addr learned my addr 172.21.15.33:0/919044956 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.647+0000 7f2f85186640 1 --2- 172.21.15.33:0/919044956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57ca980 0x55d9e5b9f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f727fc640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2f6c0b4cd0 0x7f2f6c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f84985640 1 --2- 172.21.15.33:0/919044956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57f3840 0x55d9e5b9f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f85987640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2f6c0b4cd0 0x7f2f6c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f84985640 1 -- 172.21.15.33:0/919044956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57f3840 msgr2=0x55d9e5b9f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f84985640 1 --2- 172.21.15.33:0/919044956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57f3840 0x55d9e5b9f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f84985640 1 -- 172.21.15.33:0/919044956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57ca980 msgr2=0x55d9e5b9f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f84985640 1 --2- 172.21.15.33:0/919044956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57ca980 0x55d9e5b9f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f84985640 1 -- 172.21.15.33:0/919044956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e5ab6df0 con 0x55d9e57d2b60 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f727fc640 1 -- 172.21.15.33:0/2028972511 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f2f780e5cc0 con 0x7f2f80109ba0 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f84985640 1 --2- 172.21.15.33:0/919044956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5b9fb20 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0149f0 tx=0x7f2f7c00c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bc3975dbd3772c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f6b7fe640 1 -- 172.21.15.33:0/919044956 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0142d0 con 0x55d9e57d2b60 2024-08-28T19:47:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f85987640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2f6c0b4cd0 0x7f2f6c0b71e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2f780a9280 tx=0x7f2f780dc210 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f6b7fe640 1 -- 172.21.15.33:0/919044956 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f7c00f760 con 0x55d9e57d2b60 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.648+0000 7f2f6b7fe640 1 -- 172.21.15.33:0/919044956 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c003810 con 0x55d9e57d2b60 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.649+0000 7f2f8d95f740 1 -- 172.21.15.33:0/919044956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 msgr2=0x55d9e5b9fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.649+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/919044956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5b9fb20 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0149f0 tx=0x7f2f7c00c510 comp rx=0 tx=0).stop 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.649+0000 7f2f8d95f740 1 -- 172.21.15.33:0/919044956 shutdown_connections 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.649+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/919044956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5b9fb20 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.649+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/919044956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57ca980 0x55d9e5b9f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.649+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/919044956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57f3840 0x55d9e5b9f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.649+0000 7f2f8d95f740 1 -- 172.21.15.33:0/919044956 >> 172.21.15.33:0/919044956 conn(0x55d9e57e7990 msgr2=0x55d9e5b9cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.649+0000 7f2f8d95f740 1 -- 172.21.15.33:0/919044956 shutdown_connections 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.649+0000 7f2f8d95f740 1 -- 172.21.15.33:0/919044956 wait complete. 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.650+0000 7f2f8d95f740 1 -- start start 2024-08-28T19:47:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.650+0000 7f2f8d95f740 1 Processor -- start 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.650+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57ca980 0x55d9e5baa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.650+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5baade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.650+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57f3840 0x55d9e5bb6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.650+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55d9e59617a0 con 0x55d9e57d2b60 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.650+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d9e5a85240 con 0x55d9e57f3840 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.650+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55d9e5bad820 con 0x55d9e57ca980 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.650+0000 7f2f8d95f740 10 client.0 _ll_register_callbacks cb 0x55d9e580b090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.650+0000 7f2f85186640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5baade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f85186640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5baade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46094/0 (socket says 172.21.15.33:46094) 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f85186640 1 -- 172.21.15.33:0/3390639374 learned_addr learned my addr 172.21.15.33:0/3390639374 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f84985640 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57f3840 0x55d9e5bb6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f84985640 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57ca980 0x55d9e5baa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f85186640 1 -- 172.21.15.33:0/3390639374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57ca980 msgr2=0x55d9e5baa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f85186640 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57ca980 0x55d9e5baa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f85186640 1 -- 172.21.15.33:0/3390639374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57f3840 msgr2=0x55d9e5bb6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f85186640 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57f3840 0x55d9e5bb6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f85186640 1 -- 172.21.15.33:0/3390639374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e5abb2b0 con 0x55d9e57d2b60 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f85186640 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5baade0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009900 tx=0x7f2f740316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67510279d1b095d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f68ff9640 1 -- 172.21.15.33:0/3390639374 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74035040 con 0x55d9e57d2b60 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f68ff9640 1 -- 172.21.15.33:0/3390639374 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f2f74031d10 con 0x55d9e57d2b60 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f8d95f740 1 -- 172.21.15.33:0/3390639374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f7c00f760 con 0x55d9e57d2b60 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f68ff9640 1 -- 172.21.15.33:0/3390639374 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f7404e050 con 0x55d9e57d2b60 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f8d95f740 10 client.19731 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.651+0000 7f2f8d95f740 1 -- 172.21.15.33:0/3390639374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d9e586db90 con 0x55d9e57d2b60 2024-08-28T19:47:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.652+0000 7f2f68ff9640 1 -- 172.21.15.33:0/3390639374 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f7c00f760 con 0x55d9e57d2b60 2024-08-28T19:47:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.652+0000 7f2f68ff9640 1 -- 172.21.15.33:0/3390639374 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2f74004750 con 0x55d9e57d2b60 2024-08-28T19:47:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.652+0000 7f2f8d95f740 10 client.19731 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.652+0000 7f2f8d95f740 10 client.19731 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:47:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.652+0000 7f2f8d95f740 20 client.19731 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.652+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d9e57b21c0 0x55d9e5bbca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.652+0000 7f2f8d95f740 4 client.19731 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:47:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.652+0000 7f2f8d95f740 1 -- 172.21.15.33:0/3390639374 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9e5b11280 con 0x55d9e57b21c0 2024-08-28T19:47:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.652+0000 7f2f84985640 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d9e57b21c0 0x55d9e5bbca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.653+0000 7f2f84985640 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d9e57b21c0 0x55d9e5bbca00 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca6ae3a1b564d14d server_cookie=31e6c92085a27b61 in_seq=0 out_seq=0 2024-08-28T19:47:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.653+0000 7f2f68ff9640 10 client.19731 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.653+0000 7f2f68ff9640 1 -- 172.21.15.33:0/3390639374 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9e5b11280 con 0x55d9e57b21c0 2024-08-28T19:47:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.653+0000 7f2f68ff9640 10 client.19731 handle_command_reply: tid=0 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.653+0000 7f2f8d95f740 1 client.19731 shutdown 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 1 -- 172.21.15.33:0/3390639374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 msgr2=0x55d9e5baade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5baade0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009900 tx=0x7f2f740316d0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 1 -- 172.21.15.33:0/3390639374 shutdown_connections 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57f3840 0x55d9e5bb6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d9e57b21c0 0x55d9e5bbca00 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57d2b60 0x55d9e5baade0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/3390639374 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57ca980 0x55d9e5baa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 1 -- 172.21.15.33:0/3390639374 >> 172.21.15.33:0/3390639374 conn(0x55d9e57e7990 msgr2=0x55d9e5ba00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f68ff9640 0 client.19731 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 1 -- 172.21.15.33:0/3390639374 shutdown_connections 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 1 -- 172.21.15.33:0/3390639374 wait complete. 2024-08-28T19:47:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.654+0000 7f2f8d95f740 20 client.19731 trim_cache size 0 max 16384 2024-08-28T19:47:55.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.671+0000 7f2f8d95f740 1 Processor -- start 2024-08-28T19:47:55.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.671+0000 7f2f8d95f740 1 -- start start 2024-08-28T19:47:55.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57ca980 0x55d9e5ba0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 0x55d9e5bac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57f3840 0x55d9e5bb6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801ae9d0 con 0x55d9e57ca980 2024-08-28T19:47:55.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801b0510 con 0x55d9e57d2b60 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801af0a0 con 0x55d9e57f3840 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f84985640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57ca980 0x55d9e5ba0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f84985640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57ca980 0x55d9e5ba0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46110/0 (socket says 172.21.15.33:46110) 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f84985640 1 -- 172.21.15.33:0/1044680395 learned_addr learned my addr 172.21.15.33:0/1044680395 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f85186640 1 --2- 172.21.15.33:0/1044680395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 0x55d9e5bac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f84985640 1 -- 172.21.15.33:0/1044680395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57f3840 msgr2=0x55d9e5bb6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f84985640 1 --2- 172.21.15.33:0/1044680395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57f3840 0x55d9e5bb6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f84985640 1 -- 172.21.15.33:0/1044680395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 msgr2=0x55d9e5bac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f84985640 1 --2- 172.21.15.33:0/1044680395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 0x55d9e5bac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f84985640 1 -- 172.21.15.33:0/1044680395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e5aced90 con 0x55d9e57ca980 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f85186640 1 --2- 172.21.15.33:0/1044680395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 0x55d9e5bac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:47:55.674 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f84985640 1 --2- 172.21.15.33:0/1044680395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57ca980 0x55d9e5ba0a90 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c014990 tx=0x7f2f7c014f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e196dbd6e81e0909 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:55.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f6affd640 1 -- 172.21.15.33:0/1044680395 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c004230 con 0x55d9e57ca980 2024-08-28T19:47:55.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f6affd640 1 -- 172.21.15.33:0/1044680395 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f7c0142b0 con 0x55d9e57ca980 2024-08-28T19:47:55.675 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.672+0000 7f2f6affd640 1 -- 172.21.15.33:0/1044680395 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00fa90 con 0x55d9e57ca980 2024-08-28T19:47:55.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.673+0000 7f2f8d95f740 1 -- 172.21.15.33:0/1044680395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57ca980 msgr2=0x55d9e5ba0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:55.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.673+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/1044680395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57ca980 0x55d9e5ba0a90 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c014990 tx=0x7f2f7c014f70 comp rx=0 tx=0).stop 2024-08-28T19:47:55.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.673+0000 7f2f8d95f740 1 -- 172.21.15.33:0/1044680395 shutdown_connections 2024-08-28T19:47:55.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.673+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/1044680395 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57f3840 0x55d9e5bb6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.673+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/1044680395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 0x55d9e5bac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.673+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/1044680395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57ca980 0x55d9e5ba0a90 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.673+0000 7f2f8d95f740 1 -- 172.21.15.33:0/1044680395 >> 172.21.15.33:0/1044680395 conn(0x55d9e57e7990 msgr2=0x55d9e5babda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:55.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.673+0000 7f2f8d95f740 1 -- 172.21.15.33:0/1044680395 shutdown_connections 2024-08-28T19:47:55.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.673+0000 7f2f8d95f740 1 -- 172.21.15.33:0/1044680395 wait complete. 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.673+0000 7f2f8d95f740 1 -- start start 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f8d95f740 1 Processor -- start 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57ca980 0x55d9e5bb2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 0x55d9e5bb3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f8d95f740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57f3840 0x55d9e5bada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801afe40 con 0x55d9e57f3840 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801af770 con 0x55d9e57d2b60 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f8d95f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2f801ac9d0 con 0x55d9e57ca980 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f8d95f740 10 client.0 _ll_register_callbacks cb 0x7f2f74005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f84985640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57f3840 0x55d9e5bada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f84985640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57f3840 0x55d9e5bada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46112/0 (socket says 172.21.15.33:46112) 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f84985640 1 -- 172.21.15.33:0/355563870 learned_addr learned my addr 172.21.15.33:0/355563870 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f85186640 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 0x55d9e5bb3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.674+0000 7f2f84985640 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57ca980 0x55d9e5bb2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f84985640 1 -- 172.21.15.33:0/355563870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57ca980 msgr2=0x55d9e5bb2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f84985640 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57ca980 0x55d9e5bb2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f84985640 1 -- 172.21.15.33:0/355563870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 msgr2=0x55d9e5bb3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f84985640 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 0x55d9e5bb3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f84985640 1 -- 172.21.15.33:0/355563870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e5badf70 con 0x55d9e57f3840 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f85186640 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 0x55d9e5bb3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f84985640 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57f3840 0x55d9e5bada30 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0141f0 tx=0x7f2f7c024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59e582266e2df3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f68ff9640 1 -- 172.21.15.33:0/355563870 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c03c030 con 0x55d9e57f3840 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f68ff9640 1 -- 172.21.15.33:0/355563870 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9453+0+0 (secure 0 0 0) 0x7f2f7c004020 con 0x55d9e57f3840 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f8d95f740 1 -- 172.21.15.33:0/355563870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9e5b0cd20 con 0x55d9e57f3840 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f68ff9640 1 -- 172.21.15.33:0/355563870 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2f7c004220 con 0x55d9e57f3840 2024-08-28T19:47:55.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f8d95f740 10 client.19737 fetch_fsmap learned FSMap version 28 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f8d95f740 1 -- 172.21.15.33:0/355563870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d9e5c27a90 con 0x55d9e57f3840 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.675+0000 7f2f68ff9640 1 -- 172.21.15.33:0/355563870 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d9e5b0cd20 con 0x55d9e57f3840 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.676+0000 7f2f68ff9640 1 -- 172.21.15.33:0/355563870 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2f7c033040 con 0x55d9e57f3840 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.676+0000 7f2f8d95f740 10 client.19737 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.676+0000 7f2f8d95f740 10 client.19737 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.676+0000 7f2f8d95f740 20 client.19737 populate_metadata read hostname 'smithi033' 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.676+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d9e5787570 0x55d9e5c29f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.676+0000 7f2f8d95f740 4 client.19737 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.676+0000 7f2f8d95f740 1 -- 172.21.15.33:0/355563870 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55d9e5b0a460 con 0x55d9e5787570 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.676+0000 7f2f85186640 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d9e5787570 0x55d9e5c29f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.676+0000 7f2f85186640 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d9e5787570 0x55d9e5c29f80 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1116bcf194def server_cookie=186a31946611ad1f in_seq=0 out_seq=0 2024-08-28T19:47:55.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.676+0000 7f2f68ff9640 10 client.19737 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f68ff9640 1 -- 172.21.15.33:0/355563870 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d9e5b0a460 con 0x55d9e5787570 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f68ff9640 10 client.19737 handle_command_reply: tid=0 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f8d95f740 1 client.19737 shutdown 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f8d95f740 1 -- 172.21.15.33:0/355563870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57f3840 msgr2=0x55d9e5bada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57f3840 0x55d9e5bada30 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0141f0 tx=0x7f2f7c024040 comp rx=0 tx=0).stop 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f8d95f740 1 -- 172.21.15.33:0/355563870 shutdown_connections 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55d9e5787570 0x55d9e5c29f80 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55d9e57f3840 0x55d9e5bada30 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e57d2b60 0x55d9e5bb3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f8d95f740 1 --2- 172.21.15.33:0/355563870 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d9e57ca980 0x55d9e5bb2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.690+0000 7f2f8d95f740 1 -- 172.21.15.33:0/355563870 >> 172.21.15.33:0/355563870 conn(0x55d9e57e7990 msgr2=0x55d9e5ba0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:55.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f68ff9640 0 client.19737 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:47:55.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f8d95f740 1 -- 172.21.15.33:0/355563870 shutdown_connections 2024-08-28T19:47:55.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f8d95f740 1 -- 172.21.15.33:0/355563870 wait complete. 2024-08-28T19:47:55.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f8d95f740 20 client.19737 trim_cache size 0 max 16384 2024-08-28T19:47:55.693 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:47:55.693 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:47:55.693 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:47:55.693 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 50, 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f8b6ef": { 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 50, 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:47:55.694 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:47:55.695 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:47:55.695 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "QUIESCED", 2024-08-28T19:47:55.695 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:47:55.695 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:55.695 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:55.695 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:55.695 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:55.695 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:47:55.695 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:47:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 -- 172.21.15.33:0/2028972511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2f6c0b4cd0 msgr2=0x7f2f6c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2f6c0b4cd0 0x7f2f6c0b71e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2f780a9280 tx=0x7f2f780dc210 comp rx=0 tx=0).stop 2024-08-28T19:47:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 -- 172.21.15.33:0/2028972511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f80109ba0 msgr2=0x7f2f8019fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:47:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f80109ba0 0x7f2f8019fb30 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800cce0 tx=0x7f2f7800a620 comp rx=0 tx=0).stop 2024-08-28T19:47:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 -- 172.21.15.33:0/2028972511 shutdown_connections 2024-08-28T19:47:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f80109ba0 0x7f2f8019fb30 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2f6c0b4cd0 0x7f2f6c0b71e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f80109250 0x7f2f8019a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 --2- 172.21.15.33:0/2028972511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f80103910 0x7f2f8019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:47:55.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 -- 172.21.15.33:0/2028972511 >> 172.21.15.33:0/2028972511 conn(0x7f2f800ff340 msgr2=0x7f2f80101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:47:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.691+0000 7f2f873ea640 1 -- 172.21.15.33:0/2028972511 shutdown_connections 2024-08-28T19:47:55.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:47:55.692+0000 7f2f873ea640 1 -- 172.21.15.33:0/2028972511 wait complete. 2024-08-28T19:47:55.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:55 smithi033 ceph-mon[18549]: pgmap v824: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-08-28T19:47:56.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:55 smithi059 ceph-mon[22052]: pgmap v824: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-08-28T19:47:56.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:55 smithi122 ceph-mon[22174]: pgmap v824: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-08-28T19:47:56.604 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd4f8b6ef', quiesce took 3.7 seconds. Will release after: 26.3 2024-08-28T19:47:57.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:57 smithi033 ceph-mon[18549]: pgmap v825: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-28T19:47:58.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:57 smithi059 ceph-mon[22052]: pgmap v825: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-28T19:47:58.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:57 smithi122 ceph-mon[22174]: pgmap v825: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-28T19:47:59.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:47:59 smithi033 ceph-mon[18549]: pgmap v826: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-08-28T19:48:00.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:47:59 smithi059 ceph-mon[22052]: pgmap v826: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-08-28T19:48:00.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:47:59 smithi122 ceph-mon[22174]: pgmap v826: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-08-28T19:48:01.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:01 smithi033 ceph-mon[18549]: pgmap v827: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-08-28T19:48:02.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:01 smithi059 ceph-mon[22052]: pgmap v827: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-08-28T19:48:02.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:01 smithi122 ceph-mon[22174]: pgmap v827: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-08-28T19:48:03.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:03 smithi033 ceph-mon[18549]: pgmap v828: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-08-28T19:48:04.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:03 smithi059 ceph-mon[22052]: pgmap v828: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-08-28T19:48:04.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:03 smithi122 ceph-mon[22174]: pgmap v828: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 11 op/s 2024-08-28T19:48:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:05 smithi033 ceph-mon[18549]: pgmap v829: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 74 KiB/s wr, 30 op/s 2024-08-28T19:48:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:48:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:48:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:48:05.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:05 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:48:06.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:05 smithi059 ceph-mon[22052]: pgmap v829: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 74 KiB/s wr, 30 op/s 2024-08-28T19:48:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:48:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:48:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:48:06.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:05 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:48:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:05 smithi122 ceph-mon[22174]: pgmap v829: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 74 KiB/s wr, 30 op/s 2024-08-28T19:48:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:48:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:48:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:48:06.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:05 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:48:07.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:07 smithi033 ceph-mon[18549]: pgmap v830: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-08-28T19:48:08.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:07 smithi059 ceph-mon[22052]: pgmap v830: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-08-28T19:48:08.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:07 smithi122 ceph-mon[22174]: pgmap v830: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-08-28T19:48:09.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:09 smithi033 ceph-mon[18549]: pgmap v831: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 74 KiB/s wr, 30 op/s 2024-08-28T19:48:10.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:09 smithi059 ceph-mon[22052]: pgmap v831: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 74 KiB/s wr, 30 op/s 2024-08-28T19:48:10.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:09 smithi122 ceph-mon[22174]: pgmap v831: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 74 KiB/s wr, 30 op/s 2024-08-28T19:48:11.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:10 smithi059 ceph-mon[22052]: osdmap e103: 12 total, 12 up, 12 in 2024-08-28T19:48:11.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:10 smithi122 ceph-mon[22174]: osdmap e103: 12 total, 12 up, 12 in 2024-08-28T19:48:11.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:10 smithi033 ceph-mon[18549]: osdmap e103: 12 total, 12 up, 12 in 2024-08-28T19:48:12.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:11 smithi059 ceph-mon[22052]: pgmap v833: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 58 KiB/s wr, 30 op/s 2024-08-28T19:48:12.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:11 smithi122 ceph-mon[22174]: pgmap v833: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 58 KiB/s wr, 30 op/s 2024-08-28T19:48:12.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:11 smithi033 ceph-mon[18549]: pgmap v833: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 58 KiB/s wr, 30 op/s 2024-08-28T19:48:14.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:13 smithi059 ceph-mon[22052]: pgmap v834: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-08-28T19:48:14.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:13 smithi122 ceph-mon[22174]: pgmap v834: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-08-28T19:48:14.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:13 smithi033 ceph-mon[18549]: pgmap v834: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-08-28T19:48:16.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:15 smithi059 ceph-mon[22052]: pgmap v835: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:48:16.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:15 smithi122 ceph-mon[22174]: pgmap v835: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:48:16.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:15 smithi033 ceph-mon[18549]: pgmap v835: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:48:18.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:17 smithi059 ceph-mon[22052]: pgmap v836: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:48:18.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:17 smithi122 ceph-mon[22174]: pgmap v836: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:48:18.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:17 smithi033 ceph-mon[18549]: pgmap v836: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:48:19.794 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:48:20.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:19 smithi059 ceph-mon[22052]: pgmap v837: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:20.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:19 smithi059 ceph-mon[22052]: osdmap e104: 12 total, 12 up, 12 in 2024-08-28T19:48:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:19 smithi122 ceph-mon[22174]: pgmap v837: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:19 smithi122 ceph-mon[22174]: osdmap e104: 12 total, 12 up, 12 in 2024-08-28T19:48:20.065 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:20.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:19 smithi033 ceph-mon[18549]: pgmap v837: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:20.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:19 smithi033 ceph-mon[18549]: osdmap e104: 12 total, 12 up, 12 in 2024-08-28T19:48:20.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.562+0000 7f66324d1640 1 -- 172.21.15.33:0/2443024833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f662c10dbb0 msgr2=0x7f662c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.562+0000 7f66324d1640 1 --2- 172.21.15.33:0/2443024833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f662c10dbb0 0x7f662c1100a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f6624009ca0 tx=0x7f662402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.562+0000 7f66324d1640 1 -- 172.21.15.33:0/2443024833 shutdown_connections 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.562+0000 7f66324d1640 1 --2- 172.21.15.33:0/2443024833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f662c10dbb0 0x7f662c1100a0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.562+0000 7f66324d1640 1 --2- 172.21.15.33:0/2443024833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f662c1050a0 0x7f662c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.562+0000 7f66324d1640 1 --2- 172.21.15.33:0/2443024833 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f662c104750 0x7f662c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.562+0000 7f66324d1640 1 -- 172.21.15.33:0/2443024833 >> 172.21.15.33:0/2443024833 conn(0x7f662c0794d0 msgr2=0x7f662c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.562+0000 7f66324d1640 1 -- 172.21.15.33:0/2443024833 shutdown_connections 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.562+0000 7f66324d1640 1 -- 172.21.15.33:0/2443024833 wait complete. 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.563+0000 7f66324d1640 1 Processor -- start 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.563+0000 7f66324d1640 1 -- start start 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.563+0000 7f66324d1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f662c104750 0x7f662c19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.563+0000 7f66324d1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f662c1050a0 0x7f662c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.563+0000 7f66324d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f662c10dbb0 0x7f662c19fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f66324d1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f662c113900 con 0x7f662c104750 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f66324d1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f662c113780 con 0x7f662c10dbb0 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f66324d1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f662c113a80 con 0x7f662c1050a0 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f662bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f662c104750 0x7f662c19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f662bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f662c104750 0x7f662c19a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55198/0 (socket says 172.21.15.33:55198) 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f662bfff640 1 -- 172.21.15.33:0/1723605344 learned_addr learned my addr 172.21.15.33:0/1723605344 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f6630a6e640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f662c10dbb0 0x7f662c19fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f662b7fe640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f662c1050a0 0x7f662c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f662bfff640 1 -- 172.21.15.33:0/1723605344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f662c1050a0 msgr2=0x7f662c19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f662bfff640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f662c1050a0 0x7f662c19a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f662bfff640 1 -- 172.21.15.33:0/1723605344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f662c10dbb0 msgr2=0x7f662c19fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:20.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f662bfff640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f662c10dbb0 0x7f662c19fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f662bfff640 1 -- 172.21.15.33:0/1723605344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c1a0240 con 0x7f662c104750 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f6630a6e640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f662c10dbb0 0x7f662c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f662bfff640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f662c104750 0x7f662c19a2d0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f661c00b450 tx=0x7f661c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.564+0000 7f66297fa640 1 -- 172.21.15.33:0/1723605344 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c015020 con 0x7f662c104750 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.565+0000 7f66324d1640 1 -- 172.21.15.33:0/1723605344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662c1a0530 con 0x7f662c104750 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.565+0000 7f66297fa640 1 -- 172.21.15.33:0/1723605344 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f661c011d40 con 0x7f662c104750 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.565+0000 7f66297fa640 1 -- 172.21.15.33:0/1723605344 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c00f340 con 0x7f662c104750 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.565+0000 7f66324d1640 1 -- 172.21.15.33:0/1723605344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f662c1a6d10 con 0x7f662c104750 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.567+0000 7f6638a46740 1 Processor -- start 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.567+0000 7f6638a46740 1 -- start start 2024-08-28T19:48:20.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f66297fa640 1 -- 172.21.15.33:0/1723605344 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f661c018020 con 0x7f662c104750 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f6638a46740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9d8070 0x55fa1fd7d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f6638a46740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd7d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f6638a46740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd7dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f6638a46740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fa1fcf4630 con 0x55fa1f9af1b0 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f6638a46740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fa1fce3bc0 con 0x55fa1f9d8070 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f6638a46740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fa1fce7b70 con 0x55fa1f9b7390 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f662bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd7d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f662bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd7d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55202/0 (socket says 172.21.15.33:55202) 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f662bfff640 1 -- 172.21.15.33:0/3394888645 learned_addr learned my addr 172.21.15.33:0/3394888645 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f662b7fe640 1 --2- 172.21.15.33:0/3394888645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd7dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f662bfff640 1 -- 172.21.15.33:0/3394888645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 msgr2=0x55fa1fd7dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:20.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f662bfff640 1 --2- 172.21.15.33:0/3394888645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd7dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f662bfff640 1 -- 172.21.15.33:0/3394888645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9d8070 msgr2=0x55fa1fd7d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f662bfff640 1 --2- 172.21.15.33:0/3394888645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9d8070 0x55fa1fd7d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.568+0000 7f662bfff640 1 -- 172.21.15.33:0/3394888645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa1fa43650 con 0x55fa1f9af1b0 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.569+0000 7f662bfff640 1 --2- 172.21.15.33:0/3394888645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd7d800 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f661c0e2660 tx=0x7f661c0ed9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a7449eee799a10 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.569+0000 7f66297fa640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66140b4ca0 0x7f66140b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.569+0000 7f66127fc640 1 -- 172.21.15.33:0/3394888645 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c0f9070 con 0x55fa1f9af1b0 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.569+0000 7f66127fc640 1 -- 172.21.15.33:0/3394888645 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f661c0ab1a0 con 0x55fa1f9af1b0 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.569+0000 7f66127fc640 1 -- 172.21.15.33:0/3394888645 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c06ce40 con 0x55fa1f9af1b0 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.569+0000 7f6630a6e640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66140b4ca0 0x7f66140b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.569+0000 7f66297fa640 1 -- 172.21.15.33:0/1723605344 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f661c0e5340 con 0x7f662c104750 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6638a46740 1 -- 172.21.15.33:0/3394888645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 msgr2=0x55fa1fd7d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6638a46740 1 --2- 172.21.15.33:0/3394888645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd7d800 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f661c0e2660 tx=0x7f661c0ed9d0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6630a6e640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66140b4ca0 0x7f66140b71b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f66240094e0 tx=0x7f662402f4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6638a46740 1 -- 172.21.15.33:0/3394888645 shutdown_connections 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6638a46740 1 --2- 172.21.15.33:0/3394888645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd7dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6638a46740 1 --2- 172.21.15.33:0/3394888645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd7d800 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6638a46740 1 --2- 172.21.15.33:0/3394888645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9d8070 0x55fa1fd7d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6638a46740 1 -- 172.21.15.33:0/3394888645 >> 172.21.15.33:0/3394888645 conn(0x55fa1f9cc460 msgr2=0x55fa1fd7b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6638a46740 1 -- 172.21.15.33:0/3394888645 shutdown_connections 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6638a46740 1 -- 172.21.15.33:0/3394888645 wait complete. 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.570+0000 7f6638a46740 1 -- start start 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6638a46740 1 Processor -- start 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6638a46740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd889e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6638a46740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd88f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6638a46740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fd94df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6638a46740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55fa1fb46700 con 0x55fa1f9d8070 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6638a46740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fa1fc6a700 con 0x55fa1f9af1b0 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6638a46740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55fa1fd8baa0 con 0x55fa1f9b7390 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6638a46740 10 client.0 _ll_register_callbacks cb 0x55fa1fc99dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6630a6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fd94df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6630a6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fd94df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55208/0 (socket says 172.21.15.33:55208) 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f662b7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd88f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6630a6e640 1 -- 172.21.15.33:0/235850048 learned_addr learned my addr 172.21.15.33:0/235850048 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f662bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6630a6e640 1 -- 172.21.15.33:0/235850048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 msgr2=0x55fa1fd88f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6630a6e640 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd88f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6630a6e640 1 -- 172.21.15.33:0/235850048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9af1b0 msgr2=0x55fa1fd889e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:20.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6630a6e640 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd889e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.571+0000 7f6630a6e640 1 -- 172.21.15.33:0/235850048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa1fca38b0 con 0x55fa1f9d8070 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f6630a6e640 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fd94df0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f6624035000 tx=0x7f662402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f572cadeb165ce server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f660b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f660b7fe640 1 -- 172.21.15.33:0/235850048 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624004200 con 0x55fa1f9d8070 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f660b7fe640 1 -- 172.21.15.33:0/235850048 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f66240043a0 con 0x55fa1f9d8070 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f6638a46740 1 -- 172.21.15.33:0/235850048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f661c0ab1a0 con 0x55fa1f9d8070 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f660b7fe640 1 -- 172.21.15.33:0/235850048 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f662405a050 con 0x55fa1f9d8070 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f6638a46740 10 client.19749 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f6638a46740 1 -- 172.21.15.33:0/235850048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fa1fd97810 con 0x55fa1f9d8070 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f660b7fe640 1 -- 172.21.15.33:0/235850048 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f661c0ab1a0 con 0x55fa1f9d8070 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f660b7fe640 1 -- 172.21.15.33:0/235850048 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f66240305c0 con 0x55fa1f9d8070 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f6638a46740 10 client.19749 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.572+0000 7f6638a46740 10 client.19749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:48:20.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.573+0000 7f6638a46740 20 client.19749 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.573+0000 7f6638a46740 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa1f9969f0 0x55fa1fd9ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.573+0000 7f6638a46740 4 client.19749 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.573+0000 7f6638a46740 1 -- 172.21.15.33:0/235850048 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa1fcf6580 con 0x55fa1f9969f0 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.573+0000 7f662bfff640 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa1f9969f0 0x55fa1fd9ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.573+0000 7f660b7fe640 10 client.19749 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.573+0000 7f662bfff640 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa1f9969f0 0x55fa1fd9ad20 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee23b5fd9c771a2f server_cookie=6f49d144716e45b3 in_seq=0 out_seq=0 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f660b7fe640 1 -- 172.21.15.33:0/235850048 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa1fcf6580 con 0x55fa1f9969f0 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f660b7fe640 10 client.19749 handle_command_reply: tid=0 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 client.19749 shutdown 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 -- 172.21.15.33:0/235850048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 msgr2=0x55fa1fd94df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fd94df0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f6624035000 tx=0x7f662402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 -- 172.21.15.33:0/235850048 shutdown_connections 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa1f9969f0 0x55fa1fd9ad20 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fd94df0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd88f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 --2- 172.21.15.33:0/235850048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd889e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 -- 172.21.15.33:0/235850048 >> 172.21.15.33:0/235850048 conn(0x55fa1f9cc460 msgr2=0x55fa1fd80450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f660b7fe640 0 client.19749 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 -- 172.21.15.33:0/235850048 shutdown_connections 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 1 -- 172.21.15.33:0/235850048 wait complete. 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.574+0000 7f6638a46740 20 client.19749 trim_cache size 0 max 16384 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f6638a46740 1 Processor -- start 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f6638a46740 1 -- start start 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f6638a46740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd80ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f6638a46740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9b7390 0x55fa1fd85bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f6638a46740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9d8070 0x55fa1fd86110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f6638a46740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1b0e50 con 0x55fa1f9af1b0 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f6638a46740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1b2990 con 0x55fa1f9b7390 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f6638a46740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1b1520 con 0x55fa1f9d8070 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f662bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd80ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f662bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd80ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55214/0 (socket says 172.21.15.33:55214) 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.592+0000 7f662bfff640 1 -- 172.21.15.33:0/2094058818 learned_addr learned my addr 172.21.15.33:0/2094058818 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f662b7fe640 1 --2- 172.21.15.33:0/2094058818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9b7390 0x55fa1fd85bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f6630a6e640 1 --2- 172.21.15.33:0/2094058818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9d8070 0x55fa1fd86110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f662bfff640 1 -- 172.21.15.33:0/2094058818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9d8070 msgr2=0x55fa1fd86110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f662bfff640 1 --2- 172.21.15.33:0/2094058818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9d8070 0x55fa1fd86110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f662bfff640 1 -- 172.21.15.33:0/2094058818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9b7390 msgr2=0x55fa1fd85bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:20.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f662bfff640 1 --2- 172.21.15.33:0/2094058818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9b7390 0x55fa1fd85bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f662bfff640 1 -- 172.21.15.33:0/2094058818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa1fd89ca0 con 0x55fa1f9af1b0 2024-08-28T19:48:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f662bfff640 1 --2- 172.21.15.33:0/2094058818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd80ad0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f661c0e27a0 tx=0x7f661c0108a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2dceb8200a00ab server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f6611ffb640 1 -- 172.21.15.33:0/2094058818 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c06f330 con 0x55fa1f9af1b0 2024-08-28T19:48:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f6611ffb640 1 -- 172.21.15.33:0/2094058818 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f661c0e8c60 con 0x55fa1f9af1b0 2024-08-28T19:48:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.593+0000 7f6611ffb640 1 -- 172.21.15.33:0/2094058818 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c06f510 con 0x55fa1f9af1b0 2024-08-28T19:48:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.594+0000 7f6638a46740 1 -- 172.21.15.33:0/2094058818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 msgr2=0x55fa1fd80ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.594+0000 7f6638a46740 1 --2- 172.21.15.33:0/2094058818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd80ad0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f661c0e27a0 tx=0x7f661c0108a0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.594+0000 7f6638a46740 1 -- 172.21.15.33:0/2094058818 shutdown_connections 2024-08-28T19:48:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.594+0000 7f6638a46740 1 --2- 172.21.15.33:0/2094058818 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9d8070 0x55fa1fd86110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.594+0000 7f6638a46740 1 --2- 172.21.15.33:0/2094058818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9b7390 0x55fa1fd85bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.594+0000 7f6638a46740 1 --2- 172.21.15.33:0/2094058818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd80ad0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.594+0000 7f6638a46740 1 -- 172.21.15.33:0/2094058818 >> 172.21.15.33:0/2094058818 conn(0x55fa1f9cc460 msgr2=0x55fa1fd803c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.594+0000 7f6638a46740 1 -- 172.21.15.33:0/2094058818 shutdown_connections 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.594+0000 7f6638a46740 1 -- 172.21.15.33:0/2094058818 wait complete. 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6638a46740 1 -- start start 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6638a46740 1 Processor -- start 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6638a46740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd8d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6638a46740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd8d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6638a46740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fe046e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6638a46740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1b22c0 con 0x55fa1f9d8070 2024-08-28T19:48:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6638a46740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1b1bf0 con 0x55fa1f9af1b0 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6638a46740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1aee50 con 0x55fa1f9b7390 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6638a46740 10 client.0 _ll_register_callbacks cb 0x7f6624009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6630a6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fe046e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6630a6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fe046e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55220/0 (socket says 172.21.15.33:55220) 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.595+0000 7f6630a6e640 1 -- 172.21.15.33:0/626562583 learned_addr learned my addr 172.21.15.33:0/626562583 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f662bfff640 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd8d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f662b7fe640 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd8d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f6630a6e640 1 -- 172.21.15.33:0/626562583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 msgr2=0x55fa1fd8d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f6630a6e640 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd8d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f6630a6e640 1 -- 172.21.15.33:0/626562583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9af1b0 msgr2=0x55fa1fd8d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f6630a6e640 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd8d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f6630a6e640 1 -- 172.21.15.33:0/626562583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa1fe04c20 con 0x55fa1f9d8070 2024-08-28T19:48:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f662b7fe640 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd8d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f6630a6e640 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fe046e0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f662402ade0 tx=0x7f6624009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a6bcb036c44516 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f660b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f660b7fe640 1 -- 172.21.15.33:0/626562583 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624057040 con 0x55fa1f9d8070 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f6638a46740 1 -- 172.21.15.33:0/626562583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f661c0e8c60 con 0x55fa1f9d8070 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f660b7fe640 1 -- 172.21.15.33:0/626562583 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f6624004b40 con 0x55fa1f9d8070 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f660b7fe640 1 -- 172.21.15.33:0/626562583 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f662406d050 con 0x55fa1f9d8070 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f6638a46740 10 client.19755 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.596+0000 7f6638a46740 1 -- 172.21.15.33:0/626562583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fa1fe05de0 con 0x55fa1f9d8070 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.597+0000 7f660b7fe640 1 -- 172.21.15.33:0/626562583 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f661c0e8c60 con 0x55fa1f9d8070 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.597+0000 7f660b7fe640 1 -- 172.21.15.33:0/626562583 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f662402f610 con 0x55fa1f9d8070 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.597+0000 7f6638a46740 10 client.19755 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.597+0000 7f6638a46740 10 client.19755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:48:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.597+0000 7f6638a46740 20 client.19755 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.597+0000 7f6638a46740 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa1f96bda0 0x55fa1fe08590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.597+0000 7f6638a46740 4 client.19755 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:48:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.597+0000 7f6638a46740 1 -- 172.21.15.33:0/626562583 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fa1fcf2020 con 0x55fa1f96bda0 2024-08-28T19:48:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.597+0000 7f662bfff640 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa1f96bda0 0x55fa1fe08590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f660b7fe640 10 client.19755 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f662bfff640 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa1f96bda0 0x55fa1fe08590 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bdb8f7b07e5216f server_cookie=fc0627ee803a6b17 in_seq=0 out_seq=0 2024-08-28T19:48:20.622 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:48:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:48:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "7bc9ceff-c40a-4b60-a12f-cc9f203af1aa": { 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:47:00.994176+0000", 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:48:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:45:27.534627+0000", 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "48fef576-2648-4bab-8772-21d3637a9125": { 2024-08-28T19:48:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:46:15.427396+0000", 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:48:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:48:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "153c14e4-9cf6-465d-b1e1-c611091f3f27": { 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:47:47.242949+0000", 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:48:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:48:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:48:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:48:20.639 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:48:20.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f660b7fe640 1 -- 172.21.15.33:0/626562583 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6906 (crc 0 0 0) 0x55fa1fcf2020 con 0x55fa1f96bda0 2024-08-28T19:48:20.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f660b7fe640 10 client.19755 handle_command_reply: tid=0 2024-08-28T19:48:20.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 client.19755 shutdown 2024-08-28T19:48:20.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 -- 172.21.15.33:0/626562583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 msgr2=0x55fa1fe046e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:20.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fe046e0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f662402ade0 tx=0x7f6624009470 comp rx=0 tx=0).stop 2024-08-28T19:48:20.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 -- 172.21.15.33:0/626562583 shutdown_connections 2024-08-28T19:48:20.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55fa1f96bda0 0x55fa1fe08590 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa1f9d8070 0x55fa1fe046e0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55fa1f9b7390 0x55fa1fd8d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 --2- 172.21.15.33:0/626562583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa1f9af1b0 0x55fa1fd8d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 -- 172.21.15.33:0/626562583 >> 172.21.15.33:0/626562583 conn(0x55fa1f9cc460 msgr2=0x55fa1fd89e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:20.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f660b7fe640 0 client.19755 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:20.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 -- 172.21.15.33:0/626562583 shutdown_connections 2024-08-28T19:48:20.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.598+0000 7f6638a46740 1 -- 172.21.15.33:0/626562583 wait complete. 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f6638a46740 20 client.19755 trim_cache size 0 max 16384 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 -- 172.21.15.33:0/1723605344 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66140b4ca0 msgr2=0x7f66140b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66140b4ca0 0x7f66140b71b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f66240094e0 tx=0x7f662402f4a0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 -- 172.21.15.33:0/1723605344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f662c104750 msgr2=0x7f662c19a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f662c104750 0x7f662c19a2d0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f661c00b450 tx=0x7f661c00b910 comp rx=0 tx=0).stop 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 -- 172.21.15.33:0/1723605344 shutdown_connections 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f662c10dbb0 0x7f662c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66140b4ca0 0x7f66140b71b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f662c1050a0 0x7f662c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 --2- 172.21.15.33:0/1723605344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f662c104750 0x7f662c19a2d0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 -- 172.21.15.33:0/1723605344 >> 172.21.15.33:0/1723605344 conn(0x7f662c0794d0 msgr2=0x7f662c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 -- 172.21.15.33:0/1723605344 shutdown_connections 2024-08-28T19:48:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:20.599+0000 7f66324d1640 1 -- 172.21.15.33:0/1723605344 wait complete. 2024-08-28T19:48:21.419 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:48:21.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:48:21.677 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:21.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:21 smithi033 ceph-mon[18549]: pgmap v839: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:22.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:21 smithi059 ceph-mon[22052]: pgmap v839: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:22.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:21 smithi122 ceph-mon[22174]: pgmap v839: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:22.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.193+0000 7f9496add640 1 -- 172.21.15.33:0/440722664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94901039d0 msgr2=0x7f9490103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:22.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.193+0000 7f9496add640 1 --2- 172.21.15.33:0/440722664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94901039d0 0x7f9490103de0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f9480009900 tx=0x7f948002a410 comp rx=0 tx=0).stop 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.193+0000 7f9496add640 1 -- 172.21.15.33:0/440722664 shutdown_connections 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.193+0000 7f9496add640 1 --2- 172.21.15.33:0/440722664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490109c60 0x7f9490110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.193+0000 7f9496add640 1 --2- 172.21.15.33:0/440722664 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9490109310 0x7f9490109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.193+0000 7f9496add640 1 --2- 172.21.15.33:0/440722664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94901039d0 0x7f9490103de0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.193+0000 7f9496add640 1 -- 172.21.15.33:0/440722664 >> 172.21.15.33:0/440722664 conn(0x7f949007b670 msgr2=0x7f949007ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.193+0000 7f9496add640 1 -- 172.21.15.33:0/440722664 shutdown_connections 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.193+0000 7f9496add640 1 -- 172.21.15.33:0/440722664 wait complete. 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9496add640 1 Processor -- start 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9496add640 1 -- start start 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9496add640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94901039d0 0x7f949019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9496add640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9490109310 0x7f949019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:22.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9496add640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490109c60 0x7f949019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9496add640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9490113880 con 0x7f94901039d0 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9496add640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9490113700 con 0x7f9490109c60 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9496add640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f9490113a00 con 0x7f9490109310 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9494879640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94901039d0 0x7f949019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9494879640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94901039d0 0x7f949019a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55236/0 (socket says 172.21.15.33:55236) 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f9494879640 1 -- 172.21.15.33:0/2140485942 learned_addr learned my addr 172.21.15.33:0/2140485942 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.194+0000 7f949507a640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490109c60 0x7f949019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f948ffff640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9490109310 0x7f949019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f9494879640 1 -- 172.21.15.33:0/2140485942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9490109310 msgr2=0x7f949019a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f9494879640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9490109310 0x7f949019a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f9494879640 1 -- 172.21.15.33:0/2140485942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490109c60 msgr2=0x7f949019fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f9494879640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490109c60 0x7f949019fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f9494879640 1 -- 172.21.15.33:0/2140485942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94901a0280 con 0x7f94901039d0 2024-08-28T19:48:22.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f9494879640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94901039d0 0x7f949019a310 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f9480005940 tx=0x7f9480004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:22.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f948dffb640 1 -- 172.21.15.33:0/2140485942 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948003f030 con 0x7f94901039d0 2024-08-28T19:48:22.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f948dffb640 1 -- 172.21.15.33:0/2140485942 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9480003aa0 con 0x7f94901039d0 2024-08-28T19:48:22.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f9496add640 1 -- 172.21.15.33:0/2140485942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94901a0510 con 0x7f94901039d0 2024-08-28T19:48:22.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f948dffb640 1 -- 172.21.15.33:0/2140485942 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480035070 con 0x7f94901039d0 2024-08-28T19:48:22.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.195+0000 7f9496add640 1 -- 172.21.15.33:0/2140485942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94901a6cd0 con 0x7f94901039d0 2024-08-28T19:48:22.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.196+0000 7f9496add640 1 -- 172.21.15.33:0/2140485942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9490103de0 con 0x7f94901039d0 2024-08-28T19:48:22.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.198+0000 7f948dffb640 1 -- 172.21.15.33:0/2140485942 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f9480042030 con 0x7f94901039d0 2024-08-28T19:48:22.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.199+0000 7f948dffb640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94780b4d20 0x7f94780b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:22.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.199+0000 7f948ffff640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94780b4d20 0x7f94780b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:22.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.199+0000 7f948dffb640 1 -- 172.21.15.33:0/2140485942 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f94801062e0 con 0x7f94901039d0 2024-08-28T19:48:22.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.199+0000 7f948ffff640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94780b4d20 0x7f94780b7230 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f94901063a0 tx=0x7f9484005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:22.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.202+0000 7f948dffb640 1 -- 172.21.15.33:0/2140485942 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f94800cccd0 con 0x7f94901039d0 2024-08-28T19:48:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.423+0000 7f9496add640 1 -- 172.21.15.33:0/2140485942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f949019b440 con 0x7f94901039d0 2024-08-28T19:48:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.424+0000 7f948dffb640 1 -- 172.21.15.33:0/2140485942 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f94800cc5d0 con 0x7f94901039d0 2024-08-28T19:48:22.426 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:48:22.426 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:48:22.426 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:48:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 -- 172.21.15.33:0/2140485942 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94780b4d20 msgr2=0x7f94780b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94780b4d20 0x7f94780b7230 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f94901063a0 tx=0x7f9484005f90 comp rx=0 tx=0).stop 2024-08-28T19:48:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 -- 172.21.15.33:0/2140485942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94901039d0 msgr2=0x7f949019a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94901039d0 0x7f949019a310 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f9480005940 tx=0x7f9480004270 comp rx=0 tx=0).stop 2024-08-28T19:48:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 -- 172.21.15.33:0/2140485942 shutdown_connections 2024-08-28T19:48:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9490109c60 0x7f949019fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f94780b4d20 0x7f94780b7230 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9490109310 0x7f949019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 --2- 172.21.15.33:0/2140485942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94901039d0 0x7f949019a310 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 -- 172.21.15.33:0/2140485942 >> 172.21.15.33:0/2140485942 conn(0x7f949007b670 msgr2=0x7f9490107450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 -- 172.21.15.33:0/2140485942 shutdown_connections 2024-08-28T19:48:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:22.426+0000 7f9496add640 1 -- 172.21.15.33:0/2140485942 wait complete. 2024-08-28T19:48:22.790 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:22 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2140485942' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:48:22.905 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:48:23.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:22 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2140485942' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:48:23.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:22 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2140485942' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:48:23.141 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:48:23.175 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:23.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:23 smithi033 ceph-mon[18549]: pgmap v840: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:48:23.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.711+0000 7f370ddf5640 1 -- 172.21.15.33:0/1462655809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3708108140 msgr2=0x7f3708108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.711+0000 7f370ddf5640 1 --2- 172.21.15.33:0/1462655809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3708108140 0x7f3708108550 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009900 tx=0x7f36fc02a410 comp rx=0 tx=0).stop 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.711+0000 7f370ddf5640 1 -- 172.21.15.33:0/1462655809 shutdown_connections 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.711+0000 7f370ddf5640 1 --2- 172.21.15.33:0/1462655809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3708108a90 0x7f370810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.711+0000 7f370ddf5640 1 --2- 172.21.15.33:0/1462655809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3708108140 0x7f3708108550 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.711+0000 7f370ddf5640 1 --2- 172.21.15.33:0/1462655809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3708102800 0x7f3708102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.711+0000 7f370ddf5640 1 -- 172.21.15.33:0/1462655809 >> 172.21.15.33:0/1462655809 conn(0x7f37080794d0 msgr2=0x7f37080798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.711+0000 7f370ddf5640 1 -- 172.21.15.33:0/1462655809 shutdown_connections 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.711+0000 7f370ddf5640 1 -- 172.21.15.33:0/1462655809 wait complete. 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.712+0000 7f370ddf5640 1 Processor -- start 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.712+0000 7f370ddf5640 1 -- start start 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.712+0000 7f370ddf5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3708102800 0x7f370819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:23.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f370ddf5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3708108140 0x7f370819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f370ddf5640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3708108a90 0x7f370819fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f370ddf5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3708113820 con 0x7f3708102800 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f370ddf5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f37081136a0 con 0x7f3708108140 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f370ddf5640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f37081139a0 con 0x7f3708108a90 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f37077fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3708102800 0x7f370819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f37077fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3708102800 0x7f370819a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55254/0 (socket says 172.21.15.33:55254) 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f37077fe640 1 -- 172.21.15.33:0/2810350298 learned_addr learned my addr 172.21.15.33:0/2810350298 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f3706ffd640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3708108140 0x7f370819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f3707fff640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3708108a90 0x7f370819fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f37077fe640 1 -- 172.21.15.33:0/2810350298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3708108a90 msgr2=0x7f370819fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f37077fe640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3708108a90 0x7f370819fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f37077fe640 1 -- 172.21.15.33:0/2810350298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3708108140 msgr2=0x7f370819a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:23.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f37077fe640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3708108140 0x7f370819a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f37077fe640 1 -- 172.21.15.33:0/2810350298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37081a0280 con 0x7f3708102800 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f3706ffd640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3708108140 0x7f370819a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f37077fe640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3708102800 0x7f370819a310 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c890 tx=0x7f36f800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f3704ff9640 1 -- 172.21.15.33:0/2810350298 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8004220 con 0x7f3708102800 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f3704ff9640 1 -- 172.21.15.33:0/2810350298 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36f80043c0 con 0x7f3708102800 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f370ddf5640 1 -- 172.21.15.33:0/2810350298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37081a0570 con 0x7f3708102800 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.713+0000 7f3704ff9640 1 -- 172.21.15.33:0/2810350298 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8004a00 con 0x7f3708102800 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.714+0000 7f370ddf5640 1 -- 172.21.15.33:0/2810350298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37081a6cd0 con 0x7f3708102800 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.715+0000 7f370ddf5640 1 -- 172.21.15.33:0/2810350298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3708102c10 con 0x7f3708102800 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.716+0000 7f3704ff9640 1 -- 172.21.15.33:0/2810350298 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f36f80079b0 con 0x7f3708102800 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.717+0000 7f3704ff9640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f36f00b4ca0 0x7f36f00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.717+0000 7f3704ff9640 1 -- 172.21.15.33:0/2810350298 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f36f80e5ad0 con 0x7f3708102800 2024-08-28T19:48:23.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.717+0000 7f3706ffd640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f36f00b4ca0 0x7f36f00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:23.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.718+0000 7f3706ffd640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f36f00b4ca0 0x7f36f00b71b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f36fc000c00 tx=0x7f36fc032da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:23.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.720+0000 7f3704ff9640 1 -- 172.21.15.33:0/2810350298 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f36f8014030 con 0x7f3708102800 2024-08-28T19:48:23.757 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:23.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.949+0000 7f370ddf5640 1 -- 172.21.15.33:0/2810350298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f370819b440 con 0x7f3708102800 2024-08-28T19:48:23.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.950+0000 7f3704ff9640 1 -- 172.21.15.33:0/2810350298 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f36f80ac520 con 0x7f3708102800 2024-08-28T19:48:23.952 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:48:23.952 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:48:23.952 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:48:23.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 -- 172.21.15.33:0/2810350298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f36f00b4ca0 msgr2=0x7f36f00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:23.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f36f00b4ca0 0x7f36f00b71b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f36fc000c00 tx=0x7f36fc032da0 comp rx=0 tx=0).stop 2024-08-28T19:48:23.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 -- 172.21.15.33:0/2810350298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3708102800 msgr2=0x7f370819a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:23.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3708102800 0x7f370819a310 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c890 tx=0x7f36f800cd50 comp rx=0 tx=0).stop 2024-08-28T19:48:23.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 -- 172.21.15.33:0/2810350298 shutdown_connections 2024-08-28T19:48:23.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f36f00b4ca0 0x7f36f00b71b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:23.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3708108a90 0x7f370819fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:23.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3708108140 0x7f370819a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:23.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 --2- 172.21.15.33:0/2810350298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3708102800 0x7f370819a310 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:23.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 -- 172.21.15.33:0/2810350298 >> 172.21.15.33:0/2810350298 conn(0x7f37080794d0 msgr2=0x7f3708105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:23.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 -- 172.21.15.33:0/2810350298 shutdown_connections 2024-08-28T19:48:23.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:23.952+0000 7f370ddf5640 1 -- 172.21.15.33:0/2810350298 wait complete. 2024-08-28T19:48:24.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:23 smithi059 ceph-mon[22052]: pgmap v840: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:48:24.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:23 smithi122 ceph-mon[22174]: pgmap v840: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-08-28T19:48:24.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.418+0000 7f049a19e640 1 -- 172.21.15.33:0/170679859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0494109b90 msgr2=0x7f04941103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.418+0000 7f049a19e640 1 --2- 172.21.15.33:0/170679859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0494109b90 0x7f04941103c0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f048c009ca0 tx=0x7f048c02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.418+0000 7f049a19e640 1 -- 172.21.15.33:0/170679859 shutdown_connections 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.418+0000 7f049a19e640 1 --2- 172.21.15.33:0/170679859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0494109b90 0x7f04941103c0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.418+0000 7f049a19e640 1 --2- 172.21.15.33:0/170679859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494109240 0x7f0494109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.418+0000 7f049a19e640 1 --2- 172.21.15.33:0/170679859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0494103900 0x7f0494103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.418+0000 7f049a19e640 1 -- 172.21.15.33:0/170679859 >> 172.21.15.33:0/170679859 conn(0x7f049407b5f0 msgr2=0x7f049407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.418+0000 7f049a19e640 1 -- 172.21.15.33:0/170679859 shutdown_connections 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.418+0000 7f049a19e640 1 -- 172.21.15.33:0/170679859 wait complete. 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f049a19e640 1 Processor -- start 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f049a19e640 1 -- start start 2024-08-28T19:48:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f049a19e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494103900 0x7f049419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f049a19e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0494109240 0x7f049419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f049a19e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0494109b90 0x7f049419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f049a19e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0494113850 con 0x7f0494109240 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f049a19e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f04941136d0 con 0x7f0494103900 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f049a19e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f04941139d0 con 0x7f0494109b90 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f0492ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0494109240 0x7f049419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f0492ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0494109240 0x7f049419a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55274/0 (socket says 172.21.15.33:55274) 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.419+0000 7f0492ffd640 1 -- 172.21.15.33:0/2782805141 learned_addr learned my addr 172.21.15.33:0/2782805141 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0493fff640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0494109b90 0x7f049419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f04937fe640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494103900 0x7f049419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0492ffd640 1 -- 172.21.15.33:0/2782805141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0494109b90 msgr2=0x7f049419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:24.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0492ffd640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0494109b90 0x7f049419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0492ffd640 1 -- 172.21.15.33:0/2782805141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494103900 msgr2=0x7f049419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0492ffd640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494103900 0x7f049419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0492ffd640 1 -- 172.21.15.33:0/2782805141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04941a0150 con 0x7f0494109240 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f04937fe640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494103900 0x7f049419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0493fff640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0494109b90 0x7f049419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0492ffd640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0494109240 0x7f049419a780 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f048800c970 tx=0x7f048800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0490ff9640 1 -- 172.21.15.33:0/2782805141 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488007bb0 con 0x7f0494109240 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f049a19e640 1 -- 172.21.15.33:0/2782805141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04941a0440 con 0x7f0494109240 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0490ff9640 1 -- 172.21.15.33:0/2782805141 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0488007d50 con 0x7f0494109240 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f0490ff9640 1 -- 172.21.15.33:0/2782805141 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488004e10 con 0x7f0494109240 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.420+0000 7f049a19e640 1 -- 172.21.15.33:0/2782805141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04941a6ba0 con 0x7f0494109240 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f04a0713740 1 Processor -- start 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f04a0713740 1 -- start start 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f0490ff9640 1 -- 172.21.15.33:0/2782805141 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f0488004fb0 con 0x7f0494109240 2024-08-28T19:48:24.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f04a0713740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d971310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f04a0713740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d971850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f04a0713740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5ab390 0x55788d971d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f04a0713740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55788d8e8680 con 0x55788d5cc070 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f04a0713740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55788d8d7c10 con 0x55788d5a31b0 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f04a0713740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55788d8dbbc0 con 0x55788d5ab390 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f0493fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d971310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f0493fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d971310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55290/0 (socket says 172.21.15.33:55290) 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f0493fff640 1 -- 172.21.15.33:0/3318340056 learned_addr learned my addr 172.21.15.33:0/3318340056 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.423+0000 7f04937fe640 1 --2- 172.21.15.33:0/3318340056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d971850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0493fff640 1 -- 172.21.15.33:0/3318340056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5ab390 msgr2=0x55788d971d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0493fff640 1 --2- 172.21.15.33:0/3318340056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5ab390 0x55788d971d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0493fff640 1 -- 172.21.15.33:0/3318340056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 msgr2=0x55788d971850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:24.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0493fff640 1 --2- 172.21.15.33:0/3318340056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d971850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0493fff640 1 -- 172.21.15.33:0/3318340056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788d637650 con 0x55788d5cc070 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f04937fe640 1 --2- 172.21.15.33:0/3318340056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d971850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0493fff640 1 --2- 172.21.15.33:0/3318340056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d971310 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f048c009880 tx=0x7f048c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cd19c5497a943e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0490ff9640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f047c0b4ca0 0x7f047c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0479ffb640 1 -- 172.21.15.33:0/3318340056 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c031d70 con 0x55788d5cc070 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0479ffb640 1 -- 172.21.15.33:0/3318340056 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f048c03f070 con 0x55788d5cc070 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0479ffb640 1 -- 172.21.15.33:0/3318340056 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0042a0 con 0x55788d5cc070 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f04937fe640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f047c0b4ca0 0x7f047c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.424+0000 7f0490ff9640 1 -- 172.21.15.33:0/2782805141 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f04880e5710 con 0x7f0494109240 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.425+0000 7f04a0713740 1 -- 172.21.15.33:0/3318340056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 msgr2=0x55788d971310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.425+0000 7f04937fe640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f047c0b4ca0 0x7f047c0b71b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0484005fd0 tx=0x7f04840093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.425+0000 7f04a0713740 1 --2- 172.21.15.33:0/3318340056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d971310 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f048c009880 tx=0x7f048c0098b0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.425+0000 7f04a0713740 1 -- 172.21.15.33:0/3318340056 shutdown_connections 2024-08-28T19:48:24.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.425+0000 7f04a0713740 1 --2- 172.21.15.33:0/3318340056 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5ab390 0x55788d971d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.425+0000 7f04a0713740 1 --2- 172.21.15.33:0/3318340056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d971850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.425+0000 7f04a0713740 1 --2- 172.21.15.33:0/3318340056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d971310 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.425+0000 7f04a0713740 1 -- 172.21.15.33:0/3318340056 >> 172.21.15.33:0/3318340056 conn(0x55788d5c0460 msgr2=0x55788d96f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:24.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.425+0000 7f04a0713740 1 -- 172.21.15.33:0/3318340056 shutdown_connections 2024-08-28T19:48:24.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.425+0000 7f04a0713740 1 -- 172.21.15.33:0/3318340056 wait complete. 2024-08-28T19:48:24.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.426+0000 7f04a0713740 1 -- start start 2024-08-28T19:48:24.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.426+0000 7f04a0713740 1 Processor -- start 2024-08-28T19:48:24.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.426+0000 7f04a0713740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d980f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.426+0000 7f04a0713740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5ab390 0x55788d981520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.426+0000 7f04a0713740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d98d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.426+0000 7f04a0713740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55788d73a700 con 0x55788d5cc070 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.426+0000 7f04a0713740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55788d85e750 con 0x55788d5a31b0 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.426+0000 7f04a0713740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55788d983dc0 con 0x55788d5ab390 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.426+0000 7f04a0713740 10 client.0 _ll_register_callbacks cb 0x55788d88de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0493fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d98d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0493fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d98d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55306/0 (socket says 172.21.15.33:55306) 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0493fff640 1 -- 172.21.15.33:0/1407361908 learned_addr learned my addr 172.21.15.33:0/1407361908 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f04937fe640 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d980f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0492ffd640 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5ab390 0x55788d981520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0493fff640 1 -- 172.21.15.33:0/1407361908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5ab390 msgr2=0x55788d981520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0493fff640 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5ab390 0x55788d981520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0493fff640 1 -- 172.21.15.33:0/1407361908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 msgr2=0x55788d980f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:24.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0493fff640 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d980f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0493fff640 1 -- 172.21.15.33:0/1407361908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788d897900 con 0x55788d5cc070 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0493fff640 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d98d120 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f048c009ca0 tx=0x7f048c031da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd95d781badc69 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0472ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0472ffd640 1 -- 172.21.15.33:0/1407361908 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c052060 con 0x55788d5cc070 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0472ffd640 1 -- 172.21.15.33:0/1407361908 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f048c031720 con 0x55788d5cc070 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f04a0713740 1 -- 172.21.15.33:0/1407361908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f048c03f070 con 0x55788d5cc070 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.427+0000 7f0472ffd640 1 -- 172.21.15.33:0/1407361908 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f048c031920 con 0x55788d5cc070 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f04a0713740 10 client.19779 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f04a0713740 1 -- 172.21.15.33:0/1407361908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55788d98fcd0 con 0x55788d5cc070 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f0472ffd640 1 -- 172.21.15.33:0/1407361908 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f048c03f070 con 0x55788d5cc070 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f0472ffd640 1 -- 172.21.15.33:0/1407361908 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f048c02f900 con 0x55788d5cc070 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f04a0713740 10 client.19779 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f04a0713740 10 client.19779 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f04a0713740 20 client.19779 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f04a0713740 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55788d58a9f0 0x55788d993030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f04a0713740 4 client.19779 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f04a0713740 1 -- 172.21.15.33:0/1407361908 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55788d8ea5d0 con 0x55788d58a9f0 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.428+0000 7f04937fe640 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55788d58a9f0 0x55788d993030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.429+0000 7f0472ffd640 10 client.19779 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.429+0000 7f04937fe640 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55788d58a9f0 0x55788d993030 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=62a2ac9dc15c2b72 server_cookie=a035b04248b96a9a in_seq=0 out_seq=0 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f0472ffd640 1 -- 172.21.15.33:0/1407361908 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55788d8ea5d0 con 0x55788d58a9f0 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f0472ffd640 10 client.19779 handle_command_reply: tid=0 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 client.19779 shutdown 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 -- 172.21.15.33:0/1407361908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 msgr2=0x55788d98d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d98d120 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f048c009ca0 tx=0x7f048c031da0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 -- 172.21.15.33:0/1407361908 shutdown_connections 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55788d58a9f0 0x55788d993030 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5cc070 0x55788d98d120 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5ab390 0x55788d981520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 --2- 172.21.15.33:0/1407361908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d980f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 -- 172.21.15.33:0/1407361908 >> 172.21.15.33:0/1407361908 conn(0x55788d5c0460 msgr2=0x55788d9744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f0472ffd640 0 client.19779 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:48:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 -- 172.21.15.33:0/1407361908 shutdown_connections 2024-08-28T19:48:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 1 -- 172.21.15.33:0/1407361908 wait complete. 2024-08-28T19:48:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.430+0000 7f04a0713740 20 client.19779 trim_cache size 0 max 16384 2024-08-28T19:48:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.443+0000 7f04a0713740 1 Processor -- start 2024-08-28T19:48:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.443+0000 7f04a0713740 1 -- start start 2024-08-28T19:48:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04a0713740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d9744a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04a0713740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5ab390 0x55788d9749e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04a0713740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 0x55788d97e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04a0713740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f04941aea30 con 0x55788d5ab390 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04a0713740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f04941b0570 con 0x55788d5a31b0 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04a0713740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f04941af100 con 0x55788d5cc070 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0492ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5ab390 0x55788d9749e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0492ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5ab390 0x55788d9749e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55316/0 (socket says 172.21.15.33:55316) 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0492ffd640 1 -- 172.21.15.33:0/2542086755 learned_addr learned my addr 172.21.15.33:0/2542086755 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0493fff640 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 0x55788d97e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04937fe640 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d9744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0492ffd640 1 -- 172.21.15.33:0/2542086755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 msgr2=0x55788d97e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0492ffd640 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 0x55788d97e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0492ffd640 1 -- 172.21.15.33:0/2542086755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 msgr2=0x55788d9744a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0492ffd640 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d9744a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0492ffd640 1 -- 172.21.15.33:0/2542086755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788d9836a0 con 0x55788d5ab390 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0493fff640 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 0x55788d97e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04937fe640 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d9744a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:48:24.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f0492ffd640 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5ab390 0x55788d9749e0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f04880ab760 tx=0x7f04880ab4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd2078ea496d820 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:24.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04797fa640 1 -- 172.21.15.33:0/2542086755 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880b0020 con 0x55788d5ab390 2024-08-28T19:48:24.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04797fa640 1 -- 172.21.15.33:0/2542086755 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04880a7040 con 0x55788d5ab390 2024-08-28T19:48:24.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.444+0000 7f04797fa640 1 -- 172.21.15.33:0/2542086755 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048801d040 con 0x55788d5ab390 2024-08-28T19:48:24.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.445+0000 7f04a0713740 1 -- 172.21.15.33:0/2542086755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5ab390 msgr2=0x55788d9749e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.445+0000 7f04a0713740 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5ab390 0x55788d9749e0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f04880ab760 tx=0x7f04880ab4c0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.445+0000 7f04a0713740 1 -- 172.21.15.33:0/2542086755 shutdown_connections 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.445+0000 7f04a0713740 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 0x55788d97e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.445+0000 7f04a0713740 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5ab390 0x55788d9749e0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.445+0000 7f04a0713740 1 --2- 172.21.15.33:0/2542086755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5a31b0 0x55788d9744a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.445+0000 7f04a0713740 1 -- 172.21.15.33:0/2542086755 >> 172.21.15.33:0/2542086755 conn(0x55788d5c0460 msgr2=0x55788d97f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.445+0000 7f04a0713740 1 -- 172.21.15.33:0/2542086755 shutdown_connections 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.445+0000 7f04a0713740 1 -- 172.21.15.33:0/2542086755 wait complete. 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04a0713740 1 -- start start 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04a0713740 1 Processor -- start 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04a0713740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5a31b0 0x55788d9949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04a0713740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5ab390 0x55788d994f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04a0713740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 0x55788d9f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04a0713740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f04941afea0 con 0x55788d5a31b0 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04a0713740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f04941af7d0 con 0x55788d5ab390 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04a0713740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f04941aca30 con 0x55788d5cc070 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04a0713740 10 client.0 _ll_register_callbacks cb 0x7f048c009420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04937fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5a31b0 0x55788d9949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04937fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5a31b0 0x55788d9949e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55324/0 (socket says 172.21.15.33:55324) 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f04937fe640 1 -- 172.21.15.33:0/1053632200 learned_addr learned my addr 172.21.15.33:0/1053632200 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f0492ffd640 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5ab390 0x55788d994f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.446+0000 7f0493fff640 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 0x55788d9f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f04937fe640 1 -- 172.21.15.33:0/1053632200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 msgr2=0x55788d9f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f04937fe640 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 0x55788d9f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f04937fe640 1 -- 172.21.15.33:0/1053632200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5ab390 msgr2=0x55788d994f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f04937fe640 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5ab390 0x55788d994f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f04937fe640 1 -- 172.21.15.33:0/1053632200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788d9f6e60 con 0x55788d5a31b0 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f04937fe640 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5a31b0 0x55788d9949e0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x55788d983a70 tx=0x7f04840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76ffaf4d3ccb32c server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f0472ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f0472ffd640 1 -- 172.21.15.33:0/1053632200 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484020840 con 0x55788d5a31b0 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f0472ffd640 1 -- 172.21.15.33:0/1053632200 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f04840209e0 con 0x55788d5a31b0 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f04a0713740 1 -- 172.21.15.33:0/1053632200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04880a7040 con 0x55788d5a31b0 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f0472ffd640 1 -- 172.21.15.33:0/1053632200 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0484020be0 con 0x55788d5a31b0 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f04a0713740 10 client.19785 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f04a0713740 1 -- 172.21.15.33:0/1053632200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55788d9fe170 con 0x55788d5a31b0 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.447+0000 7f0472ffd640 1 -- 172.21.15.33:0/1053632200 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04880a7040 con 0x55788d5a31b0 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.448+0000 7f0472ffd640 1 -- 172.21.15.33:0/1053632200 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f048400f040 con 0x55788d5a31b0 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.448+0000 7f04a0713740 10 client.19785 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.448+0000 7f04a0713740 10 client.19785 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.448+0000 7f04a0713740 20 client.19785 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:24.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.448+0000 7f04a0713740 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55788d55fda0 0x55788da00910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.448+0000 7f04a0713740 4 client.19785 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.448+0000 7f04a0713740 1 -- 172.21.15.33:0/1053632200 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55788d8e6070 con 0x55788d55fda0 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.448+0000 7f0492ffd640 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55788d55fda0 0x55788da00910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.448+0000 7f0492ffd640 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55788d55fda0 0x55788da00910 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=af96d09d6e5ba754 server_cookie=1b099ca43befd270 in_seq=0 out_seq=0 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.448+0000 7f0472ffd640 10 client.19785 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f0472ffd640 1 -- 172.21.15.33:0/1053632200 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55788d8e6070 con 0x55788d55fda0 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f0472ffd640 10 client.19785 handle_command_reply: tid=0 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 client.19785 shutdown 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 -- 172.21.15.33:0/1053632200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5a31b0 msgr2=0x55788d9949e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5a31b0 0x55788d9949e0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x55788d983a70 tx=0x7f04840046c0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 -- 172.21.15.33:0/1053632200 shutdown_connections 2024-08-28T19:48:24.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x55788d55fda0 0x55788da00910 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f0472ffd640 0 client.19785 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:48:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55788d5cc070 0x55788d9f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55788d5ab390 0x55788d994f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 --2- 172.21.15.33:0/1053632200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55788d5a31b0 0x55788d9949e0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 -- 172.21.15.33:0/1053632200 >> 172.21.15.33:0/1053632200 conn(0x55788d5c0460 msgr2=0x55788d9744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 -- 172.21.15.33:0/1053632200 shutdown_connections 2024-08-28T19:48:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 1 -- 172.21.15.33:0/1053632200 wait complete. 2024-08-28T19:48:24.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.449+0000 7f04a0713740 20 client.19785 trim_cache size 0 max 16384 2024-08-28T19:48:24.456 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:48:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 -- 172.21.15.33:0/2782805141 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f047c0b4ca0 msgr2=0x7f047c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f047c0b4ca0 0x7f047c0b71b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0484005fd0 tx=0x7f04840093f0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 -- 172.21.15.33:0/2782805141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0494109240 msgr2=0x7f049419a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0494109240 0x7f049419a780 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f048800c970 tx=0x7f048800ce30 comp rx=0 tx=0).stop 2024-08-28T19:48:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 -- 172.21.15.33:0/2782805141 shutdown_connections 2024-08-28T19:48:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f047c0b4ca0 0x7f047c0b71b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0494109b90 0x7f049419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0494109240 0x7f049419a780 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 --2- 172.21.15.33:0/2782805141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0494103900 0x7f049419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 -- 172.21.15.33:0/2782805141 >> 172.21.15.33:0/2782805141 conn(0x7f049407b5f0 msgr2=0x7f0494107250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 -- 172.21.15.33:0/2782805141 shutdown_connections 2024-08-28T19:48:24.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:24.450+0000 7f049a19e640 1 -- 172.21.15.33:0/2782805141 wait complete. 2024-08-28T19:48:25.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:24 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2810350298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:48:25.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:24 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2810350298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:48:25.107 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:24 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2810350298' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:48:25.134 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:48:25.730 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --set-id d4f8b6ef --release --await' 2024-08-28T19:48:25.730 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --set-id d4f8b6ef --release --await 2024-08-28T19:48:25.765 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:25.920 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:25 smithi033 ceph-mon[18549]: pgmap v841: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:26.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:25 smithi059 ceph-mon[22052]: pgmap v841: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:26.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:25 smithi122 ceph-mon[22174]: pgmap v841: 129 pgs: 129 active+clean; 28 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:26.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.315+0000 7f7d45148640 1 -- 172.21.15.33:0/565268008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d401028b0 msgr2=0x7f7d40102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:26.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.315+0000 7f7d45148640 1 --2- 172.21.15.33:0/565268008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d401028b0 0x7f7d40102cc0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009900 tx=0x7f7d3002a410 comp rx=0 tx=0).stop 2024-08-28T19:48:26.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.315+0000 7f7d45148640 1 -- 172.21.15.33:0/565268008 shutdown_connections 2024-08-28T19:48:26.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.315+0000 7f7d45148640 1 --2- 172.21.15.33:0/565268008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d40108b40 0x7f7d4010f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.315+0000 7f7d45148640 1 --2- 172.21.15.33:0/565268008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d401081f0 0x7f7d40108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.315+0000 7f7d45148640 1 --2- 172.21.15.33:0/565268008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d401028b0 0x7f7d40102cc0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.315+0000 7f7d45148640 1 -- 172.21.15.33:0/565268008 >> 172.21.15.33:0/565268008 conn(0x7f7d40079470 msgr2=0x7f7d40079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.315+0000 7f7d45148640 1 -- 172.21.15.33:0/565268008 shutdown_connections 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.315+0000 7f7d45148640 1 -- 172.21.15.33:0/565268008 wait complete. 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.316+0000 7f7d45148640 1 Processor -- start 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.316+0000 7f7d45148640 1 -- start start 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d45148640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d401028b0 0x7f7d4019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d45148640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d401081f0 0x7f7d4019a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d45148640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d40108b40 0x7f7d4019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d45148640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7d40113920 con 0x7f7d401081f0 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d45148640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401137a0 con 0x7f7d401028b0 2024-08-28T19:48:26.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d45148640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d40113aa0 con 0x7f7d40108b40 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d401081f0 0x7f7d4019a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d401081f0 0x7f7d4019a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55352/0 (socket says 172.21.15.33:55352) 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3e59c640 1 -- 172.21.15.33:0/482614382 learned_addr learned my addr 172.21.15.33:0/482614382 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d401028b0 0x7f7d4019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d40108b40 0x7f7d4019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3e59c640 1 -- 172.21.15.33:0/482614382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d40108b40 msgr2=0x7f7d4019fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d40108b40 0x7f7d4019fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3e59c640 1 -- 172.21.15.33:0/482614382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d401028b0 msgr2=0x7f7d4019a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d401028b0 0x7f7d4019a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3e59c640 1 -- 172.21.15.33:0/482614382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d401a02e0 con 0x7f7d401081f0 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d40108b40 0x7f7d4019fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.317+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d401081f0 0x7f7d4019a910 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400c970 tx=0x7f7d3400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:26.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.318+0000 7f7d27fff640 1 -- 172.21.15.33:0/482614382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d34007bb0 con 0x7f7d401081f0 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.318+0000 7f7d27fff640 1 -- 172.21.15.33:0/482614382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d34007d50 con 0x7f7d401081f0 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.318+0000 7f7d45148640 1 -- 172.21.15.33:0/482614382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d401a05d0 con 0x7f7d401081f0 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.318+0000 7f7d27fff640 1 -- 172.21.15.33:0/482614382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400f450 con 0x7f7d401081f0 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.318+0000 7f7d45148640 1 -- 172.21.15.33:0/482614382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d401a6d30 con 0x7f7d401081f0 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.320+0000 7f7d4b6bd740 1 Processor -- start 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.320+0000 7f7d4b6bd740 1 -- start start 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d27fff640 1 -- 172.21.15.33:0/482614382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f7d34004eb0 con 0x7f7d401081f0 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a534990070 0x55a534d35310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d35850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d35d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a534cac680 con 0x55a53496f390 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a534c9bc10 con 0x55a5349671b0 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a534c9fbc0 con 0x55a534990070 2024-08-28T19:48:26.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d35d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d35d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55364/0 (socket says 172.21.15.33:55364) 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3e59c640 1 -- 172.21.15.33:0/1067447304 learned_addr learned my addr 172.21.15.33:0/1067447304 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/1067447304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d35850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/1067447304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a534990070 0x55a534d35310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3e59c640 1 -- 172.21.15.33:0/1067447304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a534990070 msgr2=0x55a534d35310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/1067447304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a534990070 0x55a534d35310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3e59c640 1 -- 172.21.15.33:0/1067447304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 msgr2=0x55a534d35850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/1067447304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d35850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3e59c640 1 -- 172.21.15.33:0/1067447304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5349fb650 con 0x55a53496f390 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.321+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/1067447304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d35d90 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f7d340e28d0 tx=0x7f7d340ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dca937f46094191 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.322+0000 7f7d257fa640 1 -- 172.21.15.33:0/1067447304 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d340f4070 con 0x55a53496f390 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.322+0000 7f7d27fff640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d280b4ca0 0x7f7d280b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.322+0000 7f7d257fa640 1 -- 172.21.15.33:0/1067447304 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d340a7bc0 con 0x55a53496f390 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.322+0000 7f7d257fa640 1 -- 172.21.15.33:0/1067447304 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d340a70c0 con 0x55a53496f390 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.322+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d280b4ca0 0x7f7d280b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.322+0000 7f7d27fff640 1 -- 172.21.15.33:0/482614382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f7d340e55e0 con 0x7f7d401081f0 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/1067447304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 msgr2=0x55a534d35d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/1067447304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d35d90 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f7d340e28d0 tx=0x7f7d340ed690 comp rx=0 tx=0).stop 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d280b4ca0 0x7f7d280b71b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7d38005fd0 tx=0x7f7d38009820 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/1067447304 shutdown_connections 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/1067447304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d35d90 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/1067447304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d35850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/1067447304 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a534990070 0x55a534d35310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/1067447304 >> 172.21.15.33:0/1067447304 conn(0x55a534984460 msgr2=0x55a534d33200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/1067447304 shutdown_connections 2024-08-28T19:48:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/1067447304 wait complete. 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 -- start start 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 Processor -- start 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d44e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d45350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a534990070 0x55a534d51180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55a534afe700 con 0x55a53496f390 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a534c22750 con 0x55a5349671b0 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.323+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55a534d47e20 con 0x55a534990070 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d4b6bd740 10 client.0 _ll_register_callbacks cb 0x55a534c51e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d45350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3e59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d45350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55372/0 (socket says 172.21.15.33:55372) 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3e59c640 1 -- 172.21.15.33:0/3240738289 learned_addr learned my addr 172.21.15.33:0/3240738289 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a534990070 0x55a534d51180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d44e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3e59c640 1 -- 172.21.15.33:0/3240738289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a534990070 msgr2=0x55a534d51180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a534990070 0x55a534d51180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3e59c640 1 -- 172.21.15.33:0/3240738289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 msgr2=0x55a534d44e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d44e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3e59c640 1 -- 172.21.15.33:0/3240738289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a534c5b900 con 0x55a53496f390 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d44e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d45350 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f7d340ab8c0 tx=0x7f7d340e5950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e742d3d80e9302 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d22ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d22ff5640 1 -- 172.21.15.33:0/3240738289 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d340aa440 con 0x55a53496f390 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d22ff5640 1 -- 172.21.15.33:0/3240738289 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f7d340a7f20 con 0x55a53496f390 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/3240738289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d340a7bc0 con 0x55a53496f390 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d22ff5640 1 -- 172.21.15.33:0/3240738289 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d340aab90 con 0x55a53496f390 2024-08-28T19:48:26.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d4b6bd740 10 client.19797 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.324+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/3240738289 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a534d53bd0 con 0x55a53496f390 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.325+0000 7f7d22ff5640 1 -- 172.21.15.33:0/3240738289 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d340a7bc0 con 0x55a53496f390 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.325+0000 7f7d22ff5640 1 -- 172.21.15.33:0/3240738289 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7d340051a0 con 0x55a53496f390 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.325+0000 7f7d4b6bd740 10 client.19797 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.325+0000 7f7d4b6bd740 10 client.19797 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.325+0000 7f7d4b6bd740 20 client.19797 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.325+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a53494e9f0 0x55a534d56f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.325+0000 7f7d4b6bd740 4 client.19797 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.325+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/3240738289 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a534cae5d0 con 0x55a53494e9f0 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.325+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a53494e9f0 0x55a534d56f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.326+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a53494e9f0 0x55a534d56f30 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4823120b4c6028c5 server_cookie=e87ae34695d6867b in_seq=0 out_seq=0 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.326+0000 7f7d22ff5640 10 client.19797 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:48:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.326+0000 7f7d22ff5640 1 -- 172.21.15.33:0/3240738289 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a534cae5d0 con 0x55a53494e9f0 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.326+0000 7f7d22ff5640 10 client.19797 handle_command_reply: tid=0 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.326+0000 7f7d4b6bd740 1 client.19797 shutdown 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.326+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/3240738289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 msgr2=0x55a534d45350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d45350 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f7d340ab8c0 tx=0x7f7d340e5950 comp rx=0 tx=0).stop 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/3240738289 shutdown_connections 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a53494e9f0 0x55a534d56f30 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a534990070 0x55a534d51180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a53496f390 0x55a534d45350 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/3240738289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d44e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/3240738289 >> 172.21.15.33:0/3240738289 conn(0x55a534984460 msgr2=0x55a534d38460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d22ff5640 0 client.19797 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/3240738289 shutdown_connections 2024-08-28T19:48:26.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/3240738289 wait complete. 2024-08-28T19:48:26.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.327+0000 7f7d4b6bd740 20 client.19797 trim_cache size 0 max 16384 2024-08-28T19:48:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d4b6bd740 1 Processor -- start 2024-08-28T19:48:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d4b6bd740 1 -- start start 2024-08-28T19:48:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d46a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 0x55a534d327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a534990070 0x55a534d32d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401aeac0 con 0x55a534990070 2024-08-28T19:48:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401b0600 con 0x55a5349671b0 2024-08-28T19:48:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401af190 con 0x55a53496f390 2024-08-28T19:48:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d3f59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a534990070 0x55a534d32d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d3f59e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a534990070 0x55a534d32d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55376/0 (socket says 172.21.15.33:55376) 2024-08-28T19:48:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d3f59e640 1 -- 172.21.15.33:0/2023706640 learned_addr learned my addr 172.21.15.33:0/2023706640 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.340+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/2023706640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d46a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/2023706640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 0x55a534d327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d3f59e640 1 -- 172.21.15.33:0/2023706640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 msgr2=0x55a534d327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/2023706640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 0x55a534d327d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d3f59e640 1 -- 172.21.15.33:0/2023706640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 msgr2=0x55a534d46a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/2023706640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d46a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d3f59e640 1 -- 172.21.15.33:0/2023706640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a534d45eb0 con 0x55a534990070 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/2023706640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d46a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/2023706640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a534990070 0x55a534d32d10 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f7d380106e0 tx=0x7f7d38012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d15f0eea2a45ec3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d24ff9640 1 -- 172.21.15.33:0/2023706640 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38004d20 con 0x55a534990070 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d24ff9640 1 -- 172.21.15.33:0/2023706640 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d38020b00 con 0x55a534990070 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.341+0000 7f7d24ff9640 1 -- 172.21.15.33:0/2023706640 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38005840 con 0x55a534990070 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/2023706640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a534990070 msgr2=0x55a534d32d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/2023706640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a534990070 0x55a534d32d10 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f7d380106e0 tx=0x7f7d38012f90 comp rx=0 tx=0).stop 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/2023706640 shutdown_connections 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/2023706640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a534990070 0x55a534d32d10 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/2023706640 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 0x55a534d327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/2023706640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5349671b0 0x55a534d46a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/2023706640 >> 172.21.15.33:0/2023706640 conn(0x55a534984460 msgr2=0x55a534d46330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/2023706640 shutdown_connections 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/2023706640 wait complete. 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 -- start start 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.342+0000 7f7d4b6bd740 1 Processor -- start 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a5349671b0 0x55a534d581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 0x55a534d58730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d4b6bd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a534990070 0x55a534d58cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401aff30 con 0x55a5349671b0 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401af860 con 0x55a534990070 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d4b6bd740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401acac0 con 0x55a53496f390 2024-08-28T19:48:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d4b6bd740 10 client.0 _ll_register_callbacks cb 0x7f7d30009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a5349671b0 0x55a534d581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3ed9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a5349671b0 0x55a534d581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55382/0 (socket says 172.21.15.33:55382) 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3ed9d640 1 -- 172.21.15.33:0/502978203 learned_addr learned my addr 172.21.15.33:0/502978203 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 0x55a534d58730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a534990070 0x55a534d58cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3ed9d640 1 -- 172.21.15.33:0/502978203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 msgr2=0x55a534d58730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 0x55a534d58730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3ed9d640 1 -- 172.21.15.33:0/502978203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a534990070 msgr2=0x55a534d58cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a534990070 0x55a534d58cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3ed9d640 1 -- 172.21.15.33:0/502978203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a534dc0900 con 0x55a5349671b0 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 0x55a534d58730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3f59e640 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a534990070 0x55a534d58cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:48:26.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d3ed9d640 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a5349671b0 0x55a534d581f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f7d3002a930 tx=0x7f7d300041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20deb50b77059b31 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d22ff5640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d22ff5640 1 -- 172.21.15.33:0/502978203 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30035040 con 0x55a5349671b0 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.343+0000 7f7d22ff5640 1 -- 172.21.15.33:0/502978203 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f7d30005240 con 0x55a5349671b0 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/502978203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d38020b00 con 0x55a5349671b0 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d22ff5640 1 -- 172.21.15.33:0/502978203 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d30053050 con 0x55a5349671b0 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d4b6bd740 10 client.19803 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/502978203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a534dc1c10 con 0x55a5349671b0 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d22ff5640 1 -- 172.21.15.33:0/502978203 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d38020b00 con 0x55a5349671b0 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d22ff5640 1 -- 172.21.15.33:0/502978203 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7d30003680 con 0x55a5349671b0 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d4b6bd740 10 client.19803 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d4b6bd740 10 client.19803 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d4b6bd740 20 client.19803 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a534923da0 0x55a534dc4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:26.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d4b6bd740 4 client.19803 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:48:26.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/502978203 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a534caa070 con 0x55a534923da0 2024-08-28T19:48:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.344+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a534923da0 0x55a534dc4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d3e59c640 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a534923da0 0x55a534dc4400 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b76915a0ca746cdd server_cookie=4bdf7f844cdcbc94 in_seq=0 out_seq=0 2024-08-28T19:48:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d22ff5640 10 client.19803 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:48:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d22ff5640 1 -- 172.21.15.33:0/502978203 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a534caa070 con 0x55a534923da0 2024-08-28T19:48:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d22ff5640 10 client.19803 handle_command_reply: tid=0 2024-08-28T19:48:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 client.19803 shutdown 2024-08-28T19:48:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/502978203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a5349671b0 msgr2=0x55a534d581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a5349671b0 0x55a534d581f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f7d3002a930 tx=0x7f7d300041f0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/502978203 shutdown_connections 2024-08-28T19:48:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55a534923da0 0x55a534dc4400 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a534990070 0x55a534d58cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55a53496f390 0x55a534d58730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d22ff5640 0 client.19803 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:48:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 --2- 172.21.15.33:0/502978203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55a5349671b0 0x55a534d581f0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/502978203 >> 172.21.15.33:0/502978203 conn(0x55a534984460 msgr2=0x55a534d46bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/502978203 shutdown_connections 2024-08-28T19:48:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 1 -- 172.21.15.33:0/502978203 wait complete. 2024-08-28T19:48:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.345+0000 7f7d4b6bd740 20 client.19803 trim_cache size 0 max 16384 2024-08-28T19:48:26.354 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:48:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 -- 172.21.15.33:0/482614382 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d280b4ca0 msgr2=0x7f7d280b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d280b4ca0 0x7f7d280b71b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7d38005fd0 tx=0x7f7d38009820 comp rx=0 tx=0).stop 2024-08-28T19:48:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 -- 172.21.15.33:0/482614382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d401081f0 msgr2=0x7f7d4019a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d401081f0 0x7f7d4019a910 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400c970 tx=0x7f7d3400ce30 comp rx=0 tx=0).stop 2024-08-28T19:48:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 -- 172.21.15.33:0/482614382 shutdown_connections 2024-08-28T19:48:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f7d280b4ca0 0x7f7d280b71b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d40108b40 0x7f7d4019fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d401081f0 0x7f7d4019a910 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 --2- 172.21.15.33:0/482614382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d401028b0 0x7f7d4019a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 -- 172.21.15.33:0/482614382 >> 172.21.15.33:0/482614382 conn(0x7f7d40079470 msgr2=0x7f7d401062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 -- 172.21.15.33:0/482614382 shutdown_connections 2024-08-28T19:48:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:26.346+0000 7f7d45148640 1 -- 172.21.15.33:0/482614382 wait complete. 2024-08-28T19:48:27.302 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:48:27.387 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:27.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:27 smithi033 ceph-mon[18549]: pgmap v842: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:27.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.888+0000 7efff9d95640 1 -- 172.21.15.33:0/4022315911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff4108a90 msgr2=0x7efff410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:27.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.888+0000 7efff9d95640 1 --2- 172.21.15.33:0/4022315911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff4108a90 0x7efff410f2c0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7effec009ca0 tx=0x7effec02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.888+0000 7efff9d95640 1 -- 172.21.15.33:0/4022315911 shutdown_connections 2024-08-28T19:48:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.888+0000 7efff9d95640 1 --2- 172.21.15.33:0/4022315911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff4108a90 0x7efff410f2c0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.888+0000 7efff9d95640 1 --2- 172.21.15.33:0/4022315911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff4108140 0x7efff4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.888+0000 7efff9d95640 1 --2- 172.21.15.33:0/4022315911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efff4102800 0x7efff4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.888+0000 7efff9d95640 1 -- 172.21.15.33:0/4022315911 >> 172.21.15.33:0/4022315911 conn(0x7efff40794d0 msgr2=0x7efff40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.888+0000 7efff9d95640 1 -- 172.21.15.33:0/4022315911 shutdown_connections 2024-08-28T19:48:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.888+0000 7efff9d95640 1 -- 172.21.15.33:0/4022315911 wait complete. 2024-08-28T19:48:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.889+0000 7efff9d95640 1 Processor -- start 2024-08-28T19:48:27.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.889+0000 7efff9d95640 1 -- start start 2024-08-28T19:48:27.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.889+0000 7efff9d95640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff4102800 0x7efff419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.889+0000 7efff9d95640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efff4108140 0x7efff419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.890+0000 7efff9d95640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff4108a90 0x7efff419f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.890+0000 7efff9d95640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efff4113820 con 0x7efff4108a90 2024-08-28T19:48:27.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.890+0000 7efff9d95640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efff41136a0 con 0x7efff4102800 2024-08-28T19:48:27.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.890+0000 7efff9d95640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efff41139a0 con 0x7efff4108140 2024-08-28T19:48:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.890+0000 7efff3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff4108a90 0x7efff419f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.890+0000 7efff3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff4108a90 0x7efff419f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55396/0 (socket says 172.21.15.33:55396) 2024-08-28T19:48:27.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.890+0000 7efff3fff640 1 -- 172.21.15.33:0/2840882678 learned_addr learned my addr 172.21.15.33:0/2840882678 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.890+0000 7effeaffd640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efff4108140 0x7efff419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.890+0000 7efff37fe640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff4102800 0x7efff419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7effeaffd640 1 -- 172.21.15.33:0/2840882678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff4102800 msgr2=0x7efff419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7effeaffd640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff4102800 0x7efff419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7effeaffd640 1 -- 172.21.15.33:0/2840882678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff4108a90 msgr2=0x7efff419f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7effeaffd640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff4108a90 0x7efff419f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7effeaffd640 1 -- 172.21.15.33:0/2840882678 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff41a0120 con 0x7efff4108140 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7efff3fff640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff4108a90 0x7efff419f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7effeaffd640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efff4108140 0x7efff419a750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7effdc005fd0 tx=0x7effdc00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7efff17fa640 1 -- 172.21.15.33:0/2840882678 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc009c00 con 0x7efff4108140 2024-08-28T19:48:27.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7efff17fa640 1 -- 172.21.15.33:0/2840882678 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effdc009da0 con 0x7efff4108140 2024-08-28T19:48:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7efff9d95640 1 -- 172.21.15.33:0/2840882678 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff41a0410 con 0x7efff4108140 2024-08-28T19:48:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7efff17fa640 1 -- 172.21.15.33:0/2840882678 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc003de0 con 0x7efff4108140 2024-08-28T19:48:27.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.891+0000 7efff9d95640 1 -- 172.21.15.33:0/2840882678 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff410fc30 con 0x7efff4108140 2024-08-28T19:48:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.894+0000 7f000030a740 1 Processor -- start 2024-08-28T19:48:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.894+0000 7f000030a740 1 -- start start 2024-08-28T19:48:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.894+0000 7f000030a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e4fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.894+0000 7f000030a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e4fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.894+0000 7f000030a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e4fc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.894+0000 7f000030a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cd3e472a70 con 0x55cd3e135840 2024-08-28T19:48:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.894+0000 7f000030a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cd3e462000 con 0x55cd3e156520 2024-08-28T19:48:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.894+0000 7f000030a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cd3e465fb0 con 0x55cd3e12d660 2024-08-28T19:48:27.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff17fa640 1 -- 172.21.15.33:0/2840882678 <== mon.1 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7effdc004030 con 0x7efff4108140 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e4fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e4fbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:60472/0 (socket says 172.21.15.33:60472) 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff3fff640 1 -- 172.21.15.33:0/4249254758 learned_addr learned my addr 172.21.15.33:0/4249254758 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7effeaffd640 1 --2- 172.21.15.33:0/4249254758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e4fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff37fe640 1 --2- 172.21.15.33:0/4249254758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e4fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff3fff640 1 -- 172.21.15.33:0/4249254758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 msgr2=0x55cd3e4fc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff3fff640 1 --2- 172.21.15.33:0/4249254758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e4fc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff3fff640 1 -- 172.21.15.33:0/4249254758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 msgr2=0x55cd3e4fc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff3fff640 1 --2- 172.21.15.33:0/4249254758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e4fc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff3fff640 1 -- 172.21.15.33:0/4249254758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd3e1c1b00 con 0x55cd3e156520 2024-08-28T19:48:27.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7effeaffd640 1 --2- 172.21.15.33:0/4249254758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e4fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:27.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff3fff640 1 --2- 172.21.15.33:0/4249254758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e4fbc80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7effec033040 tx=0x7effec02f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e62e9f6e6516738 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:27.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.895+0000 7efff17fa640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7effe00b4ca0 0x7effe00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.896+0000 7effe9ffb640 1 -- 172.21.15.33:0/4249254758 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec031650 con 0x55cd3e156520 2024-08-28T19:48:27.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.896+0000 7efff37fe640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7effe00b4ca0 0x7effe00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.896+0000 7effe9ffb640 1 -- 172.21.15.33:0/4249254758 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effec036040 con 0x55cd3e156520 2024-08-28T19:48:27.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.896+0000 7effe9ffb640 1 -- 172.21.15.33:0/4249254758 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec004680 con 0x55cd3e156520 2024-08-28T19:48:27.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.896+0000 7efff17fa640 1 -- 172.21.15.33:0/2840882678 <== mon.1 v2:172.21.15.122:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7effdc0e5310 con 0x7efff4108140 2024-08-28T19:48:27.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 -- 172.21.15.33:0/4249254758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 msgr2=0x55cd3e4fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:27.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7efff37fe640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7effe00b4ca0 0x7effe00b71b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55cd3e4fa900 tx=0x7effe400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:27.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 --2- 172.21.15.33:0/4249254758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e4fbc80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7effec033040 tx=0x7effec02f440 comp rx=0 tx=0).stop 2024-08-28T19:48:27.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 -- 172.21.15.33:0/4249254758 shutdown_connections 2024-08-28T19:48:27.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 --2- 172.21.15.33:0/4249254758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e4fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.904 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 --2- 172.21.15.33:0/4249254758 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e4fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 --2- 172.21.15.33:0/4249254758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e4fbc80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 -- 172.21.15.33:0/4249254758 >> 172.21.15.33:0/4249254758 conn(0x55cd3e14a910 msgr2=0x55cd3e4f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 -- 172.21.15.33:0/4249254758 shutdown_connections 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 -- 172.21.15.33:0/4249254758 wait complete. 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 -- start start 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.897+0000 7f000030a740 1 Processor -- start 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7f000030a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e507840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7f000030a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e507d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7f000030a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e5136f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7f000030a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55cd3e50a280 con 0x55cd3e135840 2024-08-28T19:48:27.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7f000030a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cd3e423520 con 0x55cd3e156520 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7f000030a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55cd3e50a400 con 0x55cd3e12d660 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7f000030a740 10 client.0 _ll_register_callbacks cb 0x55cd3e45bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7effeaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e507d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7efff37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e507840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7effeaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e507d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55404/0 (socket says 172.21.15.33:55404) 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7effeaffd640 1 -- 172.21.15.33:0/3188898666 learned_addr learned my addr 172.21.15.33:0/3188898666 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7efff3fff640 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e5136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7efff37fe640 1 -- 172.21.15.33:0/3188898666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 msgr2=0x55cd3e5136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7efff37fe640 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e5136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7efff37fe640 1 -- 172.21.15.33:0/3188898666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 msgr2=0x55cd3e507d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7efff37fe640 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e507d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7efff37fe640 1 -- 172.21.15.33:0/3188898666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd3e238960 con 0x55cd3e12d660 2024-08-28T19:48:27.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7efff3fff640 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e5136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.898+0000 7effeaffd640 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e507d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.899+0000 7efff37fe640 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e507840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7effe4005fd0 tx=0x7effe4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a94106b73362bad server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.899+0000 7effd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.899+0000 7effd2ffd640 1 -- 172.21.15.33:0/3188898666 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4005020 con 0x55cd3e12d660 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.899+0000 7f000030a740 1 -- 172.21.15.33:0/3188898666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd3e4019a0 con 0x55cd3e12d660 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.899+0000 7effd2ffd640 1 -- 172.21.15.33:0/3188898666 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7effe4017030 con 0x55cd3e12d660 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.899+0000 7effd2ffd640 1 -- 172.21.15.33:0/3188898666 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7effe4032050 con 0x55cd3e12d660 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.899+0000 7f000030a740 10 client.28414 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.899+0000 7f000030a740 1 -- 172.21.15.33:0/3188898666 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd3e516440 con 0x55cd3e12d660 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.900+0000 7effd2ffd640 1 -- 172.21.15.33:0/3188898666 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cd3e4019a0 con 0x55cd3e12d660 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.900+0000 7effd2ffd640 1 -- 172.21.15.33:0/3188898666 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7effe401c600 con 0x55cd3e12d660 2024-08-28T19:48:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.900+0000 7f000030a740 10 client.28414 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.900+0000 7f000030a740 10 client.28414 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.900+0000 7f000030a740 20 client.28414 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.900+0000 7f000030a740 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55cd3e114ea0 0x55cd3e5199a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.900+0000 7f000030a740 4 client.28414 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.900+0000 7f000030a740 1 -- 172.21.15.33:0/3188898666 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd3e4749c0 con 0x55cd3e114ea0 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.900+0000 7effeaffd640 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55cd3e114ea0 0x55cd3e5199a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.901+0000 7effeaffd640 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55cd3e114ea0 0x55cd3e5199a0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4a3db4c3098a229 server_cookie=d1ea10e674523df0 in_seq=0 out_seq=0 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.901+0000 7effd2ffd640 10 client.28414 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7effd2ffd640 1 -- 172.21.15.33:0/3188898666 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd3e4749c0 con 0x55cd3e114ea0 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7effd2ffd640 10 client.28414 handle_command_reply: tid=0 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 client.28414 shutdown 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 -- 172.21.15.33:0/3188898666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 msgr2=0x55cd3e507840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:27.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e507840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7effe4005fd0 tx=0x7effe4004730 comp rx=0 tx=0).stop 2024-08-28T19:48:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 -- 172.21.15.33:0/3188898666 shutdown_connections 2024-08-28T19:48:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e5136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55cd3e114ea0 0x55cd3e5199a0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e507d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 --2- 172.21.15.33:0/3188898666 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e507840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7effd2ffd640 0 client.28414 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 -- 172.21.15.33:0/3188898666 >> 172.21.15.33:0/3188898666 conn(0x55cd3e14a910 msgr2=0x55cd3e4fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 -- 172.21.15.33:0/3188898666 shutdown_connections 2024-08-28T19:48:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 1 -- 172.21.15.33:0/3188898666 wait complete. 2024-08-28T19:48:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.902+0000 7f000030a740 20 client.28414 trim_cache size 0 max 16384 2024-08-28T19:48:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.930+0000 7f000030a740 1 Processor -- start 2024-08-28T19:48:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.930+0000 7f000030a740 1 -- start start 2024-08-28T19:48:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7f000030a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e509270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7f000030a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e5135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7f000030a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e513b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7f000030a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b2d70 con 0x55cd3e135840 2024-08-28T19:48:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7f000030a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b48b0 con 0x55cd3e156520 2024-08-28T19:48:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7f000030a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b3440 con 0x55cd3e12d660 2024-08-28T19:48:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7effeaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e5135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7effeaffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e5135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55414/0 (socket says 172.21.15.33:55414) 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7effeaffd640 1 -- 172.21.15.33:0/2824346323 learned_addr learned my addr 172.21.15.33:0/2824346323 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7efff3fff640 1 --2- 172.21.15.33:0/2824346323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e513b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7effeaffd640 1 -- 172.21.15.33:0/2824346323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 msgr2=0x55cd3e509270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7efff37fe640 1 --2- 172.21.15.33:0/2824346323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e509270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7effeaffd640 1 --2- 172.21.15.33:0/2824346323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e509270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7effeaffd640 1 -- 172.21.15.33:0/2824346323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 msgr2=0x55cd3e513b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7effeaffd640 1 --2- 172.21.15.33:0/2824346323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e513b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7effeaffd640 1 -- 172.21.15.33:0/2824346323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd3e507f00 con 0x55cd3e135840 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.931+0000 7efff3fff640 1 --2- 172.21.15.33:0/2824346323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e513b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.932+0000 7effeaffd640 1 --2- 172.21.15.33:0/2824346323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e5135f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7effdc0ab6a0 tx=0x7effdc0e7820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52e265ffcfe0561 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:27.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.932+0000 7effe97fa640 1 -- 172.21.15.33:0/2824346323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc020040 con 0x55cd3e135840 2024-08-28T19:48:27.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.932+0000 7effe97fa640 1 -- 172.21.15.33:0/2824346323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effdc0ab220 con 0x55cd3e135840 2024-08-28T19:48:27.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.932+0000 7effe97fa640 1 -- 172.21.15.33:0/2824346323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc0e2940 con 0x55cd3e135840 2024-08-28T19:48:27.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.933+0000 7f000030a740 1 -- 172.21.15.33:0/2824346323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 msgr2=0x55cd3e5135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:27.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.933+0000 7f000030a740 1 --2- 172.21.15.33:0/2824346323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e5135f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7effdc0ab6a0 tx=0x7effdc0e7820 comp rx=0 tx=0).stop 2024-08-28T19:48:27.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.933+0000 7f000030a740 1 -- 172.21.15.33:0/2824346323 shutdown_connections 2024-08-28T19:48:27.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.933+0000 7f000030a740 1 --2- 172.21.15.33:0/2824346323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e513b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.933+0000 7f000030a740 1 --2- 172.21.15.33:0/2824346323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e5135f0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.933+0000 7f000030a740 1 --2- 172.21.15.33:0/2824346323 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e509270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.933+0000 7f000030a740 1 -- 172.21.15.33:0/2824346323 >> 172.21.15.33:0/2824346323 conn(0x55cd3e14a910 msgr2=0x55cd3e508b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:27.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.933+0000 7f000030a740 1 -- 172.21.15.33:0/2824346323 shutdown_connections 2024-08-28T19:48:27.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.933+0000 7f000030a740 1 -- 172.21.15.33:0/2824346323 wait complete. 2024-08-28T19:48:27.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.933+0000 7f000030a740 1 -- start start 2024-08-28T19:48:27.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7f000030a740 1 Processor -- start 2024-08-28T19:48:27.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7f000030a740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e50b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7f000030a740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e50bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7f000030a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e583360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7f000030a740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b41e0 con 0x55cd3e135840 2024-08-28T19:48:27.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7f000030a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b3b10 con 0x55cd3e156520 2024-08-28T19:48:27.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7f000030a740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b0d70 con 0x55cd3e12d660 2024-08-28T19:48:27.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7f000030a740 10 client.0 _ll_register_callbacks cb 0x7effe400bb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:27.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7efff37fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e50b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7efff3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e583360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7efff3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e583360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:60500/0 (socket says 172.21.15.33:60500) 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.934+0000 7efff3fff640 1 -- 172.21.15.33:0/1867369617 learned_addr learned my addr 172.21.15.33:0/1867369617 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7effeaffd640 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e50bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7efff3fff640 1 -- 172.21.15.33:0/1867369617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 msgr2=0x55cd3e50b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7efff3fff640 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e50b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7efff3fff640 1 -- 172.21.15.33:0/1867369617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 msgr2=0x55cd3e50bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7efff3fff640 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e50bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7efff3fff640 1 -- 172.21.15.33:0/1867369617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd3e5838a0 con 0x55cd3e156520 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7effeaffd640 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e50bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:27.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7efff3fff640 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e583360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7effec0097b0 tx=0x7effec0098a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31d7431d0f91f3ce server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7effd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7effd2ffd640 1 -- 172.21.15.33:0/1867369617 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec055070 con 0x55cd3e156520 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7f000030a740 1 -- 172.21.15.33:0/1867369617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effdc0ab220 con 0x55cd3e156520 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7effd2ffd640 1 -- 172.21.15.33:0/1867369617 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7effec003b70 con 0x55cd3e156520 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.935+0000 7effd2ffd640 1 -- 172.21.15.33:0/1867369617 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7effec05e050 con 0x55cd3e156520 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7f000030a740 10 client.28523 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7f000030a740 1 -- 172.21.15.33:0/1867369617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd3e5849d0 con 0x55cd3e156520 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7effd2ffd640 1 -- 172.21.15.33:0/1867369617 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effdc0ab220 con 0x55cd3e156520 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7effd2ffd640 1 -- 172.21.15.33:0/1867369617 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7effec058020 con 0x55cd3e156520 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7f000030a740 10 client.28523 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7f000030a740 10 client.28523 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:48:27.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7f000030a740 20 client.28523 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:27.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7f000030a740 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55cd3e0ea250 0x55cd3e586e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:27.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7f000030a740 4 client.28523 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d4f8b6ef", "release": true, "await": true}] 2024-08-28T19:48:27.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7f000030a740 1 -- 172.21.15.33:0/1867369617 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d4f8b6ef", "release": true, "await": true}) -- 0x55cd3e470460 con 0x55cd3e0ea250 2024-08-28T19:48:27.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.936+0000 7efff37fe640 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55cd3e0ea250 0x55cd3e586e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:27.943 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:27.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.937+0000 7effd2ffd640 10 client.28523 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:27.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.937+0000 7efff37fe640 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55cd3e0ea250 0x55cd3e586e70 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21e07767a800f94 server_cookie=b9bbd6664f0538d6 in_seq=0 out_seq=0 2024-08-28T19:48:27.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7effd2ffd640 1 -- 172.21.15.33:0/1867369617 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55cd3e470460 con 0x55cd3e0ea250 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7effd2ffd640 10 client.28523 handle_command_reply: tid=0 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 client.28523 shutdown 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 -- 172.21.15.33:0/1867369617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 msgr2=0x55cd3e583360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e583360 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7effec0097b0 tx=0x7effec0098a0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 -- 172.21.15.33:0/1867369617 shutdown_connections 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd3e156520 0x55cd3e583360 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55cd3e0ea250 0x55cd3e586e70 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55cd3e135840 0x55cd3e50bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 --2- 172.21.15.33:0/1867369617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55cd3e12d660 0x55cd3e50b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7effd2ffd640 0 client.28523 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 -- 172.21.15.33:0/1867369617 >> 172.21.15.33:0/1867369617 conn(0x55cd3e14a910 msgr2=0x55cd3e4fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:27.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 -- 172.21.15.33:0/1867369617 shutdown_connections 2024-08-28T19:48:27.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.940+0000 7f000030a740 1 -- 172.21.15.33:0/1867369617 wait complete. 2024-08-28T19:48:27.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7f000030a740 20 client.28523 trim_cache size 0 max 16384 2024-08-28T19:48:27.946 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:48:27.946 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:48:27.946 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:48:27.946 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 52, 2024-08-28T19:48:27.946 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": { 2024-08-28T19:48:27.946 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f8b6ef": { 2024-08-28T19:48:27.946 INFO:teuthology.orchestra.run.smithi033.stdout: "version": 52, 2024-08-28T19:48:27.946 INFO:teuthology.orchestra.run.smithi033.stdout: "age_ref": 0.0, 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "timeout": 90.0, 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "expiration": 150.0, 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "members": { 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "file:/": { 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "excluded": false, 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "state": { 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RELEASED", 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: "age": 0.0 2024-08-28T19:48:27.947 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:48:27.948 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:48:27.948 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:48:27.948 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:48:27.948 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:48:27.948 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:48:27.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 -- 172.21.15.33:0/2840882678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7effe00b4ca0 msgr2=0x7effe00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7effe00b4ca0 0x7effe00b71b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55cd3e4fa900 tx=0x7effe400b410 comp rx=0 tx=0).stop 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 -- 172.21.15.33:0/2840882678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efff4108140 msgr2=0x7efff419a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efff4108140 0x7efff419a750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7effdc005fd0 tx=0x7effdc00dde0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 -- 172.21.15.33:0/2840882678 shutdown_connections 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efff4108a90 0x7efff419f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7effe00b4ca0 0x7effe00b71b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efff4108140 0x7efff419a750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 --2- 172.21.15.33:0/2840882678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff4102800 0x7efff419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 -- 172.21.15.33:0/2840882678 >> 172.21.15.33:0/2840882678 conn(0x7efff40794d0 msgr2=0x7efff4105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 -- 172.21.15.33:0/2840882678 shutdown_connections 2024-08-28T19:48:27.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:27.941+0000 7efff9d95640 1 -- 172.21.15.33:0/2840882678 wait complete. 2024-08-28T19:48:28.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:27 smithi059 ceph-mon[22052]: pgmap v842: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:28.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:27 smithi122 ceph-mon[22174]: pgmap v842: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 307 B/s wr, 10 op/s 2024-08-28T19:48:29.027 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd4f8b6ef', total seconds elapsed: 36.1 2024-08-28T19:48:29.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.303+0000 7f2321c42640 1 -- 172.21.15.33:0/3320132693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f231c105030 msgr2=0x7f231c10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.303+0000 7f2321c42640 1 --2- 172.21.15.33:0/3320132693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f231c105030 0x7f231c10d670 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2310009900 tx=0x7f231002a410 comp rx=0 tx=0).stop 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.303+0000 7f2321c42640 1 -- 172.21.15.33:0/3320132693 shutdown_connections 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.303+0000 7f2321c42640 1 --2- 172.21.15.33:0/3320132693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f231c10dbb0 0x7f231c1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.303+0000 7f2321c42640 1 --2- 172.21.15.33:0/3320132693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f231c105030 0x7f231c10d670 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.303+0000 7f2321c42640 1 --2- 172.21.15.33:0/3320132693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f231c104600 0x7f231c104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.303+0000 7f2321c42640 1 -- 172.21.15.33:0/3320132693 >> 172.21.15.33:0/3320132693 conn(0x7f231c0794e0 msgr2=0x7f231c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.303+0000 7f2321c42640 1 -- 172.21.15.33:0/3320132693 shutdown_connections 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.303+0000 7f2321c42640 1 -- 172.21.15.33:0/3320132693 wait complete. 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f2321c42640 1 Processor -- start 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f2321c42640 1 -- start start 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f2321c42640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f231c104600 0x7f231c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f2321c42640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f231c105030 0x7f231c19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f2321c42640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f231c10dbb0 0x7f231c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f2321c42640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f231c1137f0 con 0x7f231c10dbb0 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f2321c42640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f231c113670 con 0x7f231c104600 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f2321c42640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f231c113970 con 0x7f231c105030 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f231bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f231c10dbb0 0x7f231c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f231bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f231c10dbb0 0x7f231c19fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42968/0 (socket says 172.21.15.33:42968) 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.304+0000 7f231bfff640 1 -- 172.21.15.33:0/3534873692 learned_addr learned my addr 172.21.15.33:0/3534873692 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f231b7fe640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f231c104600 0x7f231c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f231affd640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f231c105030 0x7f231c19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f231bfff640 1 -- 172.21.15.33:0/3534873692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f231c105030 msgr2=0x7f231c19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f231bfff640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f231c105030 0x7f231c19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f231bfff640 1 -- 172.21.15.33:0/3534873692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f231c104600 msgr2=0x7f231c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f231bfff640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f231c104600 0x7f231c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f231bfff640 1 -- 172.21.15.33:0/3534873692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c1a0130 con 0x7f231c10dbb0 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f231affd640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f231c105030 0x7f231c19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f231bfff640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f231c10dbb0 0x7f231c19fac0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f2314009fd0 tx=0x7f231400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f2318ff9640 1 -- 172.21.15.33:0/3534873692 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314017070 con 0x7f231c10dbb0 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f2321c42640 1 -- 172.21.15.33:0/3534873692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231c1a0420 con 0x7f231c10dbb0 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f2318ff9640 1 -- 172.21.15.33:0/3534873692 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2314003e20 con 0x7f231c10dbb0 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f2318ff9640 1 -- 172.21.15.33:0/3534873692 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314010460 con 0x7f231c10dbb0 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.305+0000 7f2321c42640 1 -- 172.21.15.33:0/3534873692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231c1a6c40 con 0x7f231c10dbb0 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f23281b7740 1 Processor -- start 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f2318ff9640 1 -- 172.21.15.33:0/3534873692 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2314003970 con 0x7f231c10dbb0 2024-08-28T19:48:29.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f23281b7740 1 -- start start 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f23281b7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d3394310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f23281b7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d3394850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f23281b7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d3394d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f23281b7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5583d330b680 con 0x5583d2fc61b0 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f23281b7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5583d32fac10 con 0x5583d2fef070 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f23281b7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5583d32febc0 con 0x5583d2fce390 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f231b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d3394850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f231b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d3394850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42984/0 (socket says 172.21.15.33:42984) 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.309+0000 7f231b7fe640 1 -- 172.21.15.33:0/1894966334 learned_addr learned my addr 172.21.15.33:0/1894966334 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f231affd640 1 --2- 172.21.15.33:0/1894966334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d3394310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f231affd640 1 --2- 172.21.15.33:0/1894966334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d3394d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f2318ff9640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23040b4cd0 0x7f23040b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f231b7fe640 1 -- 172.21.15.33:0/1894966334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 msgr2=0x5583d3394d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f231b7fe640 1 --2- 172.21.15.33:0/1894966334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d3394d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f231b7fe640 1 -- 172.21.15.33:0/1894966334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 msgr2=0x5583d3394310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f231b7fe640 1 --2- 172.21.15.33:0/1894966334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d3394310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f231b7fe640 1 -- 172.21.15.33:0/1894966334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583d305a650 con 0x5583d2fc61b0 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f231affd640 1 --2- 172.21.15.33:0/1894966334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d3394310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f231bfff640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23040b4cd0 0x7f23040b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f2318ff9640 1 -- 172.21.15.33:0/3534873692 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f23140e5700 con 0x7f231c10dbb0 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f231b7fe640 1 --2- 172.21.15.33:0/1894966334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d3394850 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f230c00cc40 tx=0x7f230c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e149fb41fb1a350 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f2301ffb640 1 -- 172.21.15.33:0/1894966334 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c014070 con 0x5583d2fc61b0 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f2301ffb640 1 -- 172.21.15.33:0/1894966334 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f230c0054d0 con 0x5583d2fc61b0 2024-08-28T19:48:29.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.310+0000 7f2301ffb640 1 -- 172.21.15.33:0/1894966334 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c004c00 con 0x5583d2fc61b0 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.311+0000 7f231bfff640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23040b4cd0 0x7f23040b71e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f23140e2b60 tx=0x7f2314078ef0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.311+0000 7f23281b7740 1 -- 172.21.15.33:0/1894966334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 msgr2=0x5583d3394850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.311+0000 7f23281b7740 1 --2- 172.21.15.33:0/1894966334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d3394850 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f230c00cc40 tx=0x7f230c00e720 comp rx=0 tx=0).stop 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.311+0000 7f23281b7740 1 -- 172.21.15.33:0/1894966334 shutdown_connections 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.311+0000 7f23281b7740 1 --2- 172.21.15.33:0/1894966334 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d3394d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.311+0000 7f23281b7740 1 --2- 172.21.15.33:0/1894966334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d3394850 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.311+0000 7f23281b7740 1 --2- 172.21.15.33:0/1894966334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d3394310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.311+0000 7f23281b7740 1 -- 172.21.15.33:0/1894966334 >> 172.21.15.33:0/1894966334 conn(0x5583d2fe3460 msgr2=0x5583d3392200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.312+0000 7f23281b7740 1 -- 172.21.15.33:0/1894966334 shutdown_connections 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.312+0000 7f23281b7740 1 -- 172.21.15.33:0/1894966334 wait complete. 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.312+0000 7f23281b7740 1 -- start start 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.312+0000 7f23281b7740 1 Processor -- start 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.312+0000 7f23281b7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fc61b0 0x5583d339fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.312+0000 7f23281b7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fce390 0x5583d339ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.312+0000 7f23281b7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d33abde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.312+0000 7f23281b7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5583d315d700 con 0x5583d2fce390 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.312+0000 7f23281b7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5583d3281750 con 0x5583d2fef070 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.312+0000 7f23281b7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5583d33a2af0 con 0x5583d2fc61b0 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f23281b7740 10 client.0 _ll_register_callbacks cb 0x5583d32b0e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fce390 0x5583d339ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fce390 0x5583d339ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42998/0 (socket says 172.21.15.33:42998) 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231b7fe640 1 -- 172.21.15.33:0/35929796 learned_addr learned my addr 172.21.15.33:0/35929796 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231affd640 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fc61b0 0x5583d339fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231affd640 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d33abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231b7fe640 1 -- 172.21.15.33:0/35929796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fc61b0 msgr2=0x5583d339fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231b7fe640 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fc61b0 0x5583d339fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231b7fe640 1 -- 172.21.15.33:0/35929796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 msgr2=0x5583d33abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231b7fe640 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d33abde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231b7fe640 1 -- 172.21.15.33:0/35929796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583d32ba900 con 0x5583d2fce390 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231affd640 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d33abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f231b7fe640 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fce390 0x5583d339ffa0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f230c000c00 tx=0x7f230c005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ad82dd581f8571 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f22faffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f22faffd640 1 -- 172.21.15.33:0/35929796 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c014040 con 0x5583d2fce390 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f22faffd640 1 -- 172.21.15.33:0/35929796 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f230c010430 con 0x5583d2fce390 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.313+0000 7f23281b7740 1 -- 172.21.15.33:0/35929796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f230c0054d0 con 0x5583d2fce390 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f22faffd640 1 -- 172.21.15.33:0/35929796 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f230c010630 con 0x5583d2fce390 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f23281b7740 10 client.19833 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f23281b7740 1 -- 172.21.15.33:0/35929796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5583d33ae830 con 0x5583d2fce390 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f22faffd640 1 -- 172.21.15.33:0/35929796 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f230c0054d0 con 0x5583d2fce390 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f22faffd640 1 -- 172.21.15.33:0/35929796 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f230c024620 con 0x5583d2fce390 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f23281b7740 10 client.19833 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f23281b7740 10 client.19833 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f23281b7740 20 client.19833 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f23281b7740 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5583d2fad9f0 0x5583d33b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f23281b7740 4 client.19833 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f23281b7740 1 -- 172.21.15.33:0/35929796 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583d330d5d0 con 0x5583d2fad9f0 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.314+0000 7f231affd640 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5583d2fad9f0 0x5583d33b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.315+0000 7f231affd640 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5583d2fad9f0 0x5583d33b1ca0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=900363bb5d06a95 server_cookie=d70d60e3027597b2 in_seq=0 out_seq=0 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.315+0000 7f22faffd640 10 client.19833 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f22faffd640 1 -- 172.21.15.33:0/35929796 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583d330d5d0 con 0x5583d2fad9f0 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f22faffd640 10 client.19833 handle_command_reply: tid=0 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f23281b7740 1 client.19833 shutdown 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f23281b7740 1 -- 172.21.15.33:0/35929796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fce390 msgr2=0x5583d339ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f23281b7740 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fce390 0x5583d339ffa0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f230c000c00 tx=0x7f230c005230 comp rx=0 tx=0).stop 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f23281b7740 1 -- 172.21.15.33:0/35929796 shutdown_connections 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f23281b7740 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d33abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f23281b7740 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5583d2fad9f0 0x5583d33b1ca0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f23281b7740 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fce390 0x5583d339ffa0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f23281b7740 1 --2- 172.21.15.33:0/35929796 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fc61b0 0x5583d339fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f22faffd640 0 client.19833 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:48:29.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.316+0000 7f23281b7740 1 -- 172.21.15.33:0/35929796 >> 172.21.15.33:0/35929796 conn(0x5583d2fe3460 msgr2=0x5583d33974f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:29.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.317+0000 7f23281b7740 1 -- 172.21.15.33:0/35929796 shutdown_connections 2024-08-28T19:48:29.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.317+0000 7f23281b7740 1 -- 172.21.15.33:0/35929796 wait complete. 2024-08-28T19:48:29.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.317+0000 7f23281b7740 20 client.19833 trim_cache size 0 max 16384 2024-08-28T19:48:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f23281b7740 1 Processor -- start 2024-08-28T19:48:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f23281b7740 1 -- start start 2024-08-28T19:48:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f23281b7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d339fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f23281b7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d3397b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f23281b7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d33abce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f23281b7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f231c1b0c10 con 0x5583d2fc61b0 2024-08-28T19:48:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f23281b7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f231c1b2750 con 0x5583d2fef070 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f23281b7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f231c1b12e0 con 0x5583d2fce390 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f231affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d339fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f231affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d339fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43000/0 (socket says 172.21.15.33:43000) 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.330+0000 7f231affd640 1 -- 172.21.15.33:0/703035668 learned_addr learned my addr 172.21.15.33:0/703035668 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f231b7fe640 1 --2- 172.21.15.33:0/703035668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d3397b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f231affd640 1 --2- 172.21.15.33:0/703035668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d33abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f231affd640 1 -- 172.21.15.33:0/703035668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 msgr2=0x5583d3397b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f231affd640 1 --2- 172.21.15.33:0/703035668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d3397b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f231affd640 1 -- 172.21.15.33:0/703035668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 msgr2=0x5583d33abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f231affd640 1 --2- 172.21.15.33:0/703035668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d33abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f231affd640 1 -- 172.21.15.33:0/703035668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583d3398060 con 0x5583d2fc61b0 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f231b7fe640 1 --2- 172.21.15.33:0/703035668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d3397b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f231affd640 1 --2- 172.21.15.33:0/703035668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d339fe80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f23100092a0 tx=0x7f2310031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db9fe1fa4cee9ee server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f23017fa640 1 -- 172.21.15.33:0/703035668 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310035040 con 0x5583d2fc61b0 2024-08-28T19:48:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f23017fa640 1 -- 172.21.15.33:0/703035668 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2310031960 con 0x5583d2fc61b0 2024-08-28T19:48:29.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.331+0000 7f23017fa640 1 -- 172.21.15.33:0/703035668 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310052650 con 0x5583d2fc61b0 2024-08-28T19:48:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.332+0000 7f23281b7740 1 -- 172.21.15.33:0/703035668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 msgr2=0x5583d339fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.332+0000 7f23281b7740 1 --2- 172.21.15.33:0/703035668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d339fe80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f23100092a0 tx=0x7f2310031400 comp rx=0 tx=0).stop 2024-08-28T19:48:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.332+0000 7f23281b7740 1 -- 172.21.15.33:0/703035668 shutdown_connections 2024-08-28T19:48:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.332+0000 7f23281b7740 1 --2- 172.21.15.33:0/703035668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fef070 0x5583d33abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.332+0000 7f23281b7740 1 --2- 172.21.15.33:0/703035668 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d3397b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.332+0000 7f23281b7740 1 --2- 172.21.15.33:0/703035668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fc61b0 0x5583d339fe80 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.332+0000 7f23281b7740 1 -- 172.21.15.33:0/703035668 >> 172.21.15.33:0/703035668 conn(0x5583d2fe3460 msgr2=0x5583d3397410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.332+0000 7f23281b7740 1 -- 172.21.15.33:0/703035668 shutdown_connections 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.332+0000 7f23281b7740 1 -- 172.21.15.33:0/703035668 wait complete. 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.332+0000 7f23281b7740 1 -- start start 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f23281b7740 1 Processor -- start 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f23281b7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fc61b0 0x5583d33a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f23281b7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d33a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f23281b7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fef070 0x5583d33a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f23281b7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f231c1b2080 con 0x5583d2fef070 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f23281b7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f231c1b19b0 con 0x5583d2fc61b0 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f23281b7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f231c1aec10 con 0x5583d2fce390 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f23281b7740 10 client.0 _ll_register_callbacks cb 0x7f230c00ca90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f231affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fef070 0x5583d33a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f231affd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fef070 0x5583d33a3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43006/0 (socket says 172.21.15.33:43006) 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f231affd640 1 -- 172.21.15.33:0/1456284017 learned_addr learned my addr 172.21.15.33:0/1456284017 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f231b7fe640 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d33a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f231affd640 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fc61b0 0x5583d33a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f231affd640 1 -- 172.21.15.33:0/1456284017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 msgr2=0x5583d33a37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f231affd640 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d33a37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f231affd640 1 -- 172.21.15.33:0/1456284017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fc61b0 msgr2=0x5583d33a82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f231affd640 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fc61b0 0x5583d33a82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.333+0000 7f231affd640 1 -- 172.21.15.33:0/1456284017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583d33a42a0 con 0x5583d2fef070 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f231affd640 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fef070 0x5583d33a3d30 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f231003e820 tx=0x7f2310040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eceecbc7af51c356 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f22faffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f22faffd640 1 -- 172.21.15.33:0/1456284017 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310035070 con 0x5583d2fef070 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f22faffd640 1 -- 172.21.15.33:0/1456284017 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f231003e940 con 0x5583d2fef070 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f23281b7740 1 -- 172.21.15.33:0/1456284017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2310031960 con 0x5583d2fef070 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f22faffd640 1 -- 172.21.15.33:0/1456284017 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f231003eb40 con 0x5583d2fef070 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f23281b7740 10 client.19839 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f23281b7740 1 -- 172.21.15.33:0/1456284017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5583d341c290 con 0x5583d2fef070 2024-08-28T19:48:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f22faffd640 1 -- 172.21.15.33:0/1456284017 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2310031960 con 0x5583d2fef070 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f22faffd640 1 -- 172.21.15.33:0/1456284017 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2310051030 con 0x5583d2fef070 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f23281b7740 10 client.19839 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f23281b7740 10 client.19839 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f23281b7740 20 client.19839 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f23281b7740 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5583d2f82da0 0x5583d341e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f23281b7740 4 client.19839 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.334+0000 7f23281b7740 1 -- 172.21.15.33:0/1456284017 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583d3309070 con 0x5583d2f82da0 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.335+0000 7f231b7fe640 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5583d2f82da0 0x5583d341e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.335+0000 7f231b7fe640 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5583d2f82da0 0x5583d341e980 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=972a74f0ec1f8744 server_cookie=afc9a4d8ffa7733b in_seq=0 out_seq=0 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.335+0000 7f22faffd640 10 client.19839 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:48:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.335+0000 7f22faffd640 1 -- 172.21.15.33:0/1456284017 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583d3309070 con 0x5583d2f82da0 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.335+0000 7f22faffd640 10 client.19839 handle_command_reply: tid=0 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.335+0000 7f23281b7740 1 client.19839 shutdown 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 1 -- 172.21.15.33:0/1456284017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fef070 msgr2=0x5583d33a3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fef070 0x5583d33a3d30 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f231003e820 tx=0x7f2310040040 comp rx=0 tx=0).stop 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 1 -- 172.21.15.33:0/1456284017 shutdown_connections 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x5583d2f82da0 0x5583d341e980 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5583d2fef070 0x5583d33a3d30 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5583d2fce390 0x5583d33a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f22faffd640 0 client.19839 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 1 --2- 172.21.15.33:0/1456284017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5583d2fc61b0 0x5583d33a82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 1 -- 172.21.15.33:0/1456284017 >> 172.21.15.33:0/1456284017 conn(0x5583d2fe3460 msgr2=0x5583d33a0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 1 -- 172.21.15.33:0/1456284017 shutdown_connections 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 1 -- 172.21.15.33:0/1456284017 wait complete. 2024-08-28T19:48:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f23281b7740 20 client.19839 trim_cache size 0 max 16384 2024-08-28T19:48:29.343 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:48:29.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f2321c42640 1 -- 172.21.15.33:0/3534873692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23040b4cd0 msgr2=0x7f23040b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:29.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f2321c42640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23040b4cd0 0x7f23040b71e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f23140e2b60 tx=0x7f2314078ef0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f2321c42640 1 -- 172.21.15.33:0/3534873692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f231c10dbb0 msgr2=0x7f231c19fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:29.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f2321c42640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f231c10dbb0 0x7f231c19fac0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f2314009fd0 tx=0x7f231400b260 comp rx=0 tx=0).stop 2024-08-28T19:48:29.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f2321c42640 1 -- 172.21.15.33:0/3534873692 shutdown_connections 2024-08-28T19:48:29.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f2321c42640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f231c10dbb0 0x7f231c19fac0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.336+0000 7f2321c42640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f23040b4cd0 0x7f23040b71e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.337+0000 7f2321c42640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f231c105030 0x7f231c19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.337+0000 7f2321c42640 1 --2- 172.21.15.33:0/3534873692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f231c104600 0x7f231c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:29.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.337+0000 7f2321c42640 1 -- 172.21.15.33:0/3534873692 >> 172.21.15.33:0/3534873692 conn(0x7f231c0794e0 msgr2=0x7f231c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:29.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.337+0000 7f2321c42640 1 -- 172.21.15.33:0/3534873692 shutdown_connections 2024-08-28T19:48:29.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:29.337+0000 7f2321c42640 1 -- 172.21.15.33:0/3534873692 wait complete. 2024-08-28T19:48:29.991 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:29 smithi033 ceph-mon[18549]: pgmap v843: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-08-28T19:48:30.017 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:48:30.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:29 smithi059 ceph-mon[22052]: pgmap v843: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-08-28T19:48:30.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:29 smithi122 ceph-mon[22174]: pgmap v843: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-08-28T19:48:30.271 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.788+0000 7fe0c280f640 1 -- 172.21.15.33:0/1609272014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc103900 msgr2=0x7fe0bc103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.788+0000 7fe0c280f640 1 --2- 172.21.15.33:0/1609272014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc103900 0x7fe0bc103d10 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009900 tx=0x7fe0ac02a410 comp rx=0 tx=0).stop 2024-08-28T19:48:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.788+0000 7fe0c280f640 1 -- 172.21.15.33:0/1609272014 shutdown_connections 2024-08-28T19:48:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.788+0000 7fe0c280f640 1 --2- 172.21.15.33:0/1609272014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0bc109b90 0x7fe0bc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.788+0000 7fe0c280f640 1 --2- 172.21.15.33:0/1609272014 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0bc109240 0x7fe0bc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.788+0000 7fe0c280f640 1 --2- 172.21.15.33:0/1609272014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc103900 0x7fe0bc103d10 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.788+0000 7fe0c280f640 1 -- 172.21.15.33:0/1609272014 >> 172.21.15.33:0/1609272014 conn(0x7fe0bc07b5f0 msgr2=0x7fe0bc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.788+0000 7fe0c280f640 1 -- 172.21.15.33:0/1609272014 shutdown_connections 2024-08-28T19:48:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.788+0000 7fe0c280f640 1 -- 172.21.15.33:0/1609272014 wait complete. 2024-08-28T19:48:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.789+0000 7fe0c280f640 1 Processor -- start 2024-08-28T19:48:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.789+0000 7fe0c280f640 1 -- start start 2024-08-28T19:48:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0c280f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0bc103900 0x7fe0bc19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0c280f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc109240 0x7fe0bc19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0c280f640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0bc109b90 0x7fe0bc19fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0c280f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1138a0 con 0x7fe0bc109240 2024-08-28T19:48:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0c280f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc113720 con 0x7fe0bc103900 2024-08-28T19:48:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0c280f640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc113a20 con 0x7fe0bc109b90 2024-08-28T19:48:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc109240 0x7fe0bc19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc109240 0x7fe0bc19a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43014/0 (socket says 172.21.15.33:43014) 2024-08-28T19:48:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bb7fe640 1 -- 172.21.15.33:0/652491840 learned_addr learned my addr 172.21.15.33:0/652491840 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0bc103900 0x7fe0bc19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0bc109b90 0x7fe0bc19fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bb7fe640 1 -- 172.21.15.33:0/652491840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0bc109b90 msgr2=0x7fe0bc19fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0bc109b90 0x7fe0bc19fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bb7fe640 1 -- 172.21.15.33:0/652491840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0bc103900 msgr2=0x7fe0bc19a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0bc103900 0x7fe0bc19a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bb7fe640 1 -- 172.21.15.33:0/652491840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc1a00c0 con 0x7fe0bc109240 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0bc103900 0x7fe0bc19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.790+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc109240 0x7fe0bc19a7b0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c8c0 tx=0x7fe0b000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.791+0000 7fe0b97fa640 1 -- 172.21.15.33:0/652491840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0007bb0 con 0x7fe0bc109240 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.791+0000 7fe0c280f640 1 -- 172.21.15.33:0/652491840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0bc1a03b0 con 0x7fe0bc109240 2024-08-28T19:48:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.791+0000 7fe0b97fa640 1 -- 172.21.15.33:0/652491840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b0007d50 con 0x7fe0bc109240 2024-08-28T19:48:30.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.791+0000 7fe0b97fa640 1 -- 172.21.15.33:0/652491840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00187c0 con 0x7fe0bc109240 2024-08-28T19:48:30.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.791+0000 7fe0c280f640 1 -- 172.21.15.33:0/652491840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0bc1a6bd0 con 0x7fe0bc109240 2024-08-28T19:48:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.793+0000 7fe0c8d84740 1 Processor -- start 2024-08-28T19:48:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.793+0000 7fe0b97fa640 1 -- 172.21.15.33:0/652491840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fe0b000fa20 con 0x7fe0bc109240 2024-08-28T19:48:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.793+0000 7fe0c8d84740 1 -- start start 2024-08-28T19:48:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccee9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb1b1b0 0x55dcccee9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb23390 0x55dcccee9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55dccce60680 con 0x55dcccb44070 2024-08-28T19:48:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dccce4fc10 con 0x55dcccb1b1b0 2024-08-28T19:48:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dccce53bc0 con 0x55dcccb23390 2024-08-28T19:48:30.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c0dac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccee9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c0dac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccee9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43020/0 (socket says 172.21.15.33:43020) 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c0dac640 1 -- 172.21.15.33:0/209363105 learned_addr learned my addr 172.21.15.33:0/209363105 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/209363105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb1b1b0 0x55dcccee9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/209363105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb23390 0x55dcccee9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0b97fa640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0a40b4cd0 0x7fe0a40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c0dac640 1 -- 172.21.15.33:0/209363105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb23390 msgr2=0x55dcccee9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/209363105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb23390 0x55dcccee9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c0dac640 1 -- 172.21.15.33:0/209363105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb1b1b0 msgr2=0x55dcccee9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/209363105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb1b1b0 0x55dcccee9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0c0dac640 1 -- 172.21.15.33:0/209363105 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcccbaf650 con 0x55dcccb44070 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.794+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/209363105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb1b1b0 0x55dcccee9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:30.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.795+0000 7fe0b97fa640 1 -- 172.21.15.33:0/652491840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7fe0b00e5a40 con 0x7fe0bc109240 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.795+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/209363105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccee9350 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009ee0 tx=0x7fe0b4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b234837a627874e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.795+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0a40b4cd0 0x7fe0a40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.795+0000 7fe0a27fc640 1 -- 172.21.15.33:0/209363105 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4016070 con 0x55dcccb44070 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.795+0000 7fe0a27fc640 1 -- 172.21.15.33:0/209363105 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b401a410 con 0x55dcccb44070 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.795+0000 7fe0a27fc640 1 -- 172.21.15.33:0/209363105 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40115e0 con 0x55dcccb44070 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 -- 172.21.15.33:0/209363105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 msgr2=0x55dcccee9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0a40b4cd0 0x7fe0a40b71e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4019000 tx=0x7fe0b4011c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/209363105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccee9350 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009ee0 tx=0x7fe0b4010740 comp rx=0 tx=0).stop 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 -- 172.21.15.33:0/209363105 shutdown_connections 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/209363105 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb23390 0x55dcccee9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/209363105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb1b1b0 0x55dcccee9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/209363105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccee9350 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 -- 172.21.15.33:0/209363105 >> 172.21.15.33:0/209363105 conn(0x55dcccb38460 msgr2=0x55dcccee7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 -- 172.21.15.33:0/209363105 shutdown_connections 2024-08-28T19:48:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 -- 172.21.15.33:0/209363105 wait complete. 2024-08-28T19:48:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 -- start start 2024-08-28T19:48:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.796+0000 7fe0c8d84740 1 Processor -- start 2024-08-28T19:48:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb1b1b0 0x55dcccef4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb23390 0x55dcccef5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccf05230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55dccccb2700 con 0x55dcccb44070 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dcccdd6750 con 0x55dcccb23390 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55dcccefbf40 con 0x55dcccb1b1b0 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c8d84740 10 client.0 _ll_register_callbacks cb 0x55dccce05e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c0dac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccf05230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c0dac640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccf05230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43026/0 (socket says 172.21.15.33:43026) 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c0dac640 1 -- 172.21.15.33:0/1784136002 learned_addr learned my addr 172.21.15.33:0/1784136002 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb1b1b0 0x55dcccef4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb23390 0x55dcccef5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c0dac640 1 -- 172.21.15.33:0/1784136002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb1b1b0 msgr2=0x55dcccef4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb1b1b0 0x55dcccef4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c0dac640 1 -- 172.21.15.33:0/1784136002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb23390 msgr2=0x55dcccef5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb23390 0x55dcccef5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c0dac640 1 -- 172.21.15.33:0/1784136002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dccce0f900 con 0x55dcccb44070 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccf05230 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fe0b401ada0 tx=0x7fe0b401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fc7b9f9041b31a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.797+0000 7fe09b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe09b7fe640 1 -- 172.21.15.33:0/1784136002 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4033060 con 0x55dcccb44070 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe09b7fe640 1 -- 172.21.15.33:0/1784136002 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7fe0b4011db0 con 0x55dcccb44070 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1784136002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0b401a410 con 0x55dcccb44070 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe09b7fe640 1 -- 172.21.15.33:0/1784136002 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0b403a050 con 0x55dcccb44070 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe0c8d84740 10 client.19851 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1784136002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dcccf07d80 con 0x55dcccb44070 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe09b7fe640 1 -- 172.21.15.33:0/1784136002 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b401a410 con 0x55dcccb44070 2024-08-28T19:48:30.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe09b7fe640 1 -- 172.21.15.33:0/1784136002 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe0b400f040 con 0x55dcccb44070 2024-08-28T19:48:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe0c8d84740 10 client.19851 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe0c8d84740 10 client.19851 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:48:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe0c8d84740 20 client.19851 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55dcccb029f0 0x55dcccf0b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe0c8d84740 4 client.19851 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:48:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.798+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1784136002 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dccce625d0 con 0x55dcccb029f0 2024-08-28T19:48:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.799+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55dcccb029f0 0x55dcccf0b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.799+0000 7fe09b7fe640 10 client.19851 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:48:30.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.799+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55dcccb029f0 0x55dcccf0b1f0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=744b6cb83671965e server_cookie=d69e821426658410 in_seq=0 out_seq=0 2024-08-28T19:48:30.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe09b7fe640 1 -- 172.21.15.33:0/1784136002 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dccce625d0 con 0x55dcccb029f0 2024-08-28T19:48:30.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe09b7fe640 10 client.19851 handle_command_reply: tid=0 2024-08-28T19:48:30.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 client.19851 shutdown 2024-08-28T19:48:30.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1784136002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 msgr2=0x55dcccf05230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:30.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccf05230 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fe0b401ada0 tx=0x7fe0b401a000 comp rx=0 tx=0).stop 2024-08-28T19:48:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1784136002 shutdown_connections 2024-08-28T19:48:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55dcccb029f0 0x55dcccf0b1f0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb44070 0x55dcccf05230 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb23390 0x55dcccef5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/1784136002 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb1b1b0 0x55dcccef4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1784136002 >> 172.21.15.33:0/1784136002 conn(0x55dcccb38460 msgr2=0x55dccceec530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe09b7fe640 0 client.19851 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:48:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1784136002 shutdown_connections 2024-08-28T19:48:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.800+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1784136002 wait complete. 2024-08-28T19:48:30.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.801+0000 7fe0c8d84740 20 client.19851 trim_cache size 0 max 16384 2024-08-28T19:48:30.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0c8d84740 1 Processor -- start 2024-08-28T19:48:30.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0c8d84740 1 -- start start 2024-08-28T19:48:30.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb1b1b0 0x55dccceecb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb23390 0x55dcccf051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb44070 0x55dcccef1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1ae9a0 con 0x55dcccb23390 2024-08-28T19:48:30.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1b04e0 con 0x55dcccb44070 2024-08-28T19:48:30.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1af070 con 0x55dcccb1b1b0 2024-08-28T19:48:30.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb23390 0x55dcccf051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb23390 0x55dcccf051a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43040/0 (socket says 172.21.15.33:43040) 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0bb7fe640 1 -- 172.21.15.33:0/1061696795 learned_addr learned my addr 172.21.15.33:0/1061696795 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.814+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/1061696795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb44070 0x55dcccef1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.815+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/1061696795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb1b1b0 0x55dccceecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.815+0000 7fe0bb7fe640 1 -- 172.21.15.33:0/1061696795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb1b1b0 msgr2=0x55dccceecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.815+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/1061696795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb1b1b0 0x55dccceecb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.815+0000 7fe0bb7fe640 1 -- 172.21.15.33:0/1061696795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb44070 msgr2=0x55dcccef1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.815+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/1061696795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb44070 0x55dcccef1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.815+0000 7fe0bb7fe640 1 -- 172.21.15.33:0/1061696795 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dccceed0a0 con 0x55dcccb23390 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.815+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/1061696795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb23390 0x55dcccf051a0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00a7e10 tx=0x7fe0b000fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531a1b54e189c169 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.815+0000 7fe0a1ffb640 1 -- 172.21.15.33:0/1061696795 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00ab500 con 0x55dcccb23390 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.815+0000 7fe0a1ffb640 1 -- 172.21.15.33:0/1061696795 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b00ab8a0 con 0x55dcccb23390 2024-08-28T19:48:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.815+0000 7fe0a1ffb640 1 -- 172.21.15.33:0/1061696795 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00b0250 con 0x55dcccb23390 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1061696795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb23390 msgr2=0x55dcccf051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/1061696795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb23390 0x55dcccf051a0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00a7e10 tx=0x7fe0b000fdc0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1061696795 shutdown_connections 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/1061696795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb44070 0x55dcccef1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/1061696795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb23390 0x55dcccf051a0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/1061696795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb1b1b0 0x55dccceecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1061696795 >> 172.21.15.33:0/1061696795 conn(0x55dcccb38460 msgr2=0x55dccceec450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1061696795 shutdown_connections 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 -- 172.21.15.33:0/1061696795 wait complete. 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 -- start start 2024-08-28T19:48:30.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.816+0000 7fe0c8d84740 1 Processor -- start 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb1b1b0 0x55dcccf0c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb23390 0x55dcccf0c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0c8d84740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb44070 0x55dcccf0cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1afe10 con 0x55dcccb1b1b0 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1af740 con 0x55dcccb44070 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0c8d84740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1ac9a0 con 0x55dcccb23390 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0c8d84740 10 client.0 _ll_register_callbacks cb 0x7fe0b00e9460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0bbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb1b1b0 0x55dcccf0c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0bbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb1b1b0 0x55dcccf0c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43050/0 (socket says 172.21.15.33:43050) 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0bbfff640 1 -- 172.21.15.33:0/2895234234 learned_addr learned my addr 172.21.15.33:0/2895234234 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0c0dac640 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb44070 0x55dcccf0cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb23390 0x55dcccf0c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0bbfff640 1 -- 172.21.15.33:0/2895234234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb23390 msgr2=0x55dcccf0c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb23390 0x55dcccf0c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0bbfff640 1 -- 172.21.15.33:0/2895234234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb44070 msgr2=0x55dcccf0cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb44070 0x55dcccf0cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0bbfff640 1 -- 172.21.15.33:0/2895234234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcccf74970 con 0x55dcccb1b1b0 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe0bbfff640 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb1b1b0 0x55dcccf0c1c0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009900 tx=0x7fe0ac0043a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e1c3dc227eed0a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.817+0000 7fe09b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe09b7fe640 1 -- 172.21.15.33:0/2895234234 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac048070 con 0x55dcccb1b1b0 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe09b7fe640 1 -- 172.21.15.33:0/2895234234 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7fe0ac005590 con 0x55dcccb1b1b0 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe0c8d84740 1 -- 172.21.15.33:0/2895234234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0b00ab8a0 con 0x55dcccb1b1b0 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe09b7fe640 1 -- 172.21.15.33:0/2895234234 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0ac054050 con 0x55dcccb1b1b0 2024-08-28T19:48:30.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe0c8d84740 10 client.19857 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe0c8d84740 1 -- 172.21.15.33:0/2895234234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dcccf75c20 con 0x55dcccb1b1b0 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe09b7fe640 1 -- 172.21.15.33:0/2895234234 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b00ab8a0 con 0x55dcccb1b1b0 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe09b7fe640 1 -- 172.21.15.33:0/2895234234 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe0ac003a00 con 0x55dcccb1b1b0 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe0c8d84740 10 client.19857 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe0c8d84740 10 client.19857 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe0c8d84740 20 client.19857 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55dcccad7da0 0x55dcccf783c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe0c8d84740 4 client.19857 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.818+0000 7fe0c8d84740 1 -- 172.21.15.33:0/2895234234 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dcccef5420 con 0x55dcccad7da0 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.819+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55dcccad7da0 0x55dcccf783c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.819+0000 7fe09b7fe640 10 client.19857 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.819+0000 7fe0bb7fe640 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55dcccad7da0 0x55dcccf783c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20ba38d5c0ea5315 server_cookie=de2ac3999a77cce5 in_seq=0 out_seq=0 2024-08-28T19:48:30.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.819+0000 7fe09b7fe640 1 -- 172.21.15.33:0/2895234234 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dcccef5420 con 0x55dcccad7da0 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.819+0000 7fe09b7fe640 10 client.19857 handle_command_reply: tid=0 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.819+0000 7fe0c8d84740 1 client.19857 shutdown 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 1 -- 172.21.15.33:0/2895234234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb1b1b0 msgr2=0x55dcccf0c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb1b1b0 0x55dcccf0c1c0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009900 tx=0x7fe0ac0043a0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 1 -- 172.21.15.33:0/2895234234 shutdown_connections 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x55dcccad7da0 0x55dcccf783c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dcccb44070 0x55dcccf0cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55dcccb23390 0x55dcccf0c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 1 --2- 172.21.15.33:0/2895234234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55dcccb1b1b0 0x55dcccf0c1c0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 1 -- 172.21.15.33:0/2895234234 >> 172.21.15.33:0/2895234234 conn(0x55dcccb38460 msgr2=0x55dccceea380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe09b7fe640 0 client.19857 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:48:30.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 1 -- 172.21.15.33:0/2895234234 shutdown_connections 2024-08-28T19:48:30.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 1 -- 172.21.15.33:0/2895234234 wait complete. 2024-08-28T19:48:30.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.820+0000 7fe0c8d84740 20 client.19857 trim_cache size 0 max 16384 2024-08-28T19:48:30.827 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:48:30.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 -- 172.21.15.33:0/652491840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0a40b4cd0 msgr2=0x7fe0a40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:30.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0a40b4cd0 0x7fe0a40b71e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4019000 tx=0x7fe0b4011c80 comp rx=0 tx=0).stop 2024-08-28T19:48:30.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 -- 172.21.15.33:0/652491840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc109240 msgr2=0x7fe0bc19a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:30.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc109240 0x7fe0bc19a7b0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c8c0 tx=0x7fe0b000cd80 comp rx=0 tx=0).stop 2024-08-28T19:48:30.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 -- 172.21.15.33:0/652491840 shutdown_connections 2024-08-28T19:48:30.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fe0a40b4cd0 0x7fe0a40b71e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe0bc109b90 0x7fe0bc19fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0bc109240 0x7fe0bc19a7b0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 --2- 172.21.15.33:0/652491840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0bc103900 0x7fe0bc19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:30.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 -- 172.21.15.33:0/652491840 >> 172.21.15.33:0/652491840 conn(0x7fe0bc07b5f0 msgr2=0x7fe0bc107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:30.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 -- 172.21.15.33:0/652491840 shutdown_connections 2024-08-28T19:48:30.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:30.821+0000 7fe0c280f640 1 -- 172.21.15.33:0/652491840 wait complete. 2024-08-28T19:48:31.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:48:31.863 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:31.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:31 smithi033 ceph-mon[18549]: pgmap v844: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 96 B/s wr, 9 op/s 2024-08-28T19:48:32.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:31 smithi059 ceph-mon[22052]: pgmap v844: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 96 B/s wr, 9 op/s 2024-08-28T19:48:32.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:31 smithi122 ceph-mon[22174]: pgmap v844: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 96 B/s wr, 9 op/s 2024-08-28T19:48:32.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 -- 172.21.15.33:0/482635280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd630103900 msgr2=0x7fd630103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 --2- 172.21.15.33:0/482635280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd630103900 0x7fd630103d10 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fd620009900 tx=0x7fd62002a410 comp rx=0 tx=0).stop 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 -- 172.21.15.33:0/482635280 shutdown_connections 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 --2- 172.21.15.33:0/482635280 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd630109b90 0x7fd6301103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 --2- 172.21.15.33:0/482635280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd630109240 0x7fd630109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 --2- 172.21.15.33:0/482635280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd630103900 0x7fd630103d10 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 -- 172.21.15.33:0/482635280 >> 172.21.15.33:0/482635280 conn(0x7fd63007b5f0 msgr2=0x7fd63007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 -- 172.21.15.33:0/482635280 shutdown_connections 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 -- 172.21.15.33:0/482635280 wait complete. 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 Processor -- start 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.340+0000 7fd636a59640 1 -- start start 2024-08-28T19:48:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd636a59640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd630103900 0x7fd6300754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd636a59640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd630109240 0x7fd6300759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd636a59640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd630109b90 0x7fd630075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd636a59640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd630113850 con 0x7fd630103900 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd636a59640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6301136d0 con 0x7fd630109b90 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd636a59640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6301139d0 con 0x7fd630109240 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd62ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd630103900 0x7fd6300754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd62ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd630103900 0x7fd6300754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43064/0 (socket says 172.21.15.33:43064) 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd62ffff640 1 -- 172.21.15.33:0/911007421 learned_addr learned my addr 172.21.15.33:0/911007421 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd634ff6640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd630109b90 0x7fd630075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd630109240 0x7fd6300759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd62ffff640 1 -- 172.21.15.33:0/911007421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd630109240 msgr2=0x7fd6300759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:32.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd62ffff640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd630109240 0x7fd6300759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd62ffff640 1 -- 172.21.15.33:0/911007421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd630109b90 msgr2=0x7fd630075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd62ffff640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd630109b90 0x7fd630075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.341+0000 7fd62ffff640 1 -- 172.21.15.33:0/911007421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6301a8450 con 0x7fd630103900 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.342+0000 7fd62ffff640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd630103900 0x7fd6300754b0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fd620005940 tx=0x7fd6200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.342+0000 7fd62d7fa640 1 -- 172.21.15.33:0/911007421 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62003f030 con 0x7fd630103900 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.342+0000 7fd62d7fa640 1 -- 172.21.15.33:0/911007421 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd620003cb0 con 0x7fd630103900 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.342+0000 7fd62d7fa640 1 -- 172.21.15.33:0/911007421 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620035070 con 0x7fd630103900 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.342+0000 7fd636a59640 1 -- 172.21.15.33:0/911007421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6301a86e0 con 0x7fd630103900 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.342+0000 7fd636a59640 1 -- 172.21.15.33:0/911007421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6301a8b70 con 0x7fd630103900 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd63cfce740 1 Processor -- start 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd63cfce740 1 -- start start 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd62d7fa640 1 -- 172.21.15.33:0/911007421 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd620042030 con 0x7fd630103900 2024-08-28T19:48:32.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8223070 0x5586a85c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a81fa1b0 0x5586a85c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd63cfce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586a853f680 con 0x5586a8202390 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd63cfce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5586a852ec10 con 0x5586a8223070 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd63cfce740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5586a8532bc0 con 0x5586a81fa1b0 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43076/0 (socket says 172.21.15.33:43076) 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd62f7fe640 1 -- 172.21.15.33:0/1094878686 learned_addr learned my addr 172.21.15.33:0/1094878686 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd62ffff640 1 --2- 172.21.15.33:0/1094878686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a81fa1b0 0x5586a85c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.345+0000 7fd634ff6640 1 --2- 172.21.15.33:0/1094878686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8223070 0x5586a85c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd634ff6640 1 -- 172.21.15.33:0/1094878686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a81fa1b0 msgr2=0x5586a85c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd634ff6640 1 --2- 172.21.15.33:0/1094878686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a81fa1b0 0x5586a85c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd634ff6640 1 -- 172.21.15.33:0/1094878686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 msgr2=0x5586a85c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd634ff6640 1 --2- 172.21.15.33:0/1094878686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd634ff6640 1 -- 172.21.15.33:0/1094878686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586a828e650 con 0x5586a8223070 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/1094878686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd62d7fa640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd6180b4d20 0x7fd6180b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd634ff6640 1 --2- 172.21.15.33:0/1094878686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8223070 0x5586a85c8310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd628009f30 tx=0x7fd628010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd061aa9036ba30e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd62ffff640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd6180b4d20 0x7fd6180b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd6167fc640 1 -- 172.21.15.33:0/1094878686 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628016070 con 0x5586a8223070 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd62d7fa640 1 -- 172.21.15.33:0/911007421 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7fd6201060f0 con 0x7fd630103900 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd6167fc640 1 -- 172.21.15.33:0/1094878686 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd628004d20 con 0x5586a8223070 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.346+0000 7fd6167fc640 1 -- 172.21.15.33:0/1094878686 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6280127d0 con 0x5586a8223070 2024-08-28T19:48:32.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.347+0000 7fd63cfce740 1 -- 172.21.15.33:0/1094878686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8223070 msgr2=0x5586a85c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.347+0000 7fd62ffff640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd6180b4d20 0x7fd6180b7230 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd620103550 tx=0x7fd620109c40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.347+0000 7fd63cfce740 1 --2- 172.21.15.33:0/1094878686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8223070 0x5586a85c8310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd628009f30 tx=0x7fd628010800 comp rx=0 tx=0).stop 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.347+0000 7fd63cfce740 1 -- 172.21.15.33:0/1094878686 shutdown_connections 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.347+0000 7fd63cfce740 1 --2- 172.21.15.33:0/1094878686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.347+0000 7fd63cfce740 1 --2- 172.21.15.33:0/1094878686 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a81fa1b0 0x5586a85c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.347+0000 7fd63cfce740 1 --2- 172.21.15.33:0/1094878686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8223070 0x5586a85c8310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.347+0000 7fd63cfce740 1 -- 172.21.15.33:0/1094878686 >> 172.21.15.33:0/1094878686 conn(0x5586a8217460 msgr2=0x5586a85c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.347+0000 7fd63cfce740 1 -- 172.21.15.33:0/1094878686 shutdown_connections 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.347+0000 7fd63cfce740 1 -- 172.21.15.33:0/1094878686 wait complete. 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd63cfce740 1 -- start start 2024-08-28T19:48:32.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd63cfce740 1 Processor -- start 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a81fa1b0 0x5586a85d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8202390 0x5586a85d4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8223070 0x5586a85dfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd63cfce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5586a8391700 con 0x5586a8223070 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd63cfce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5586a84b5750 con 0x5586a8202390 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd63cfce740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5586a85d6af0 con 0x5586a81fa1b0 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd63cfce740 10 client.0 _ll_register_callbacks cb 0x5586a84e4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd634ff6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8223070 0x5586a85dfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd634ff6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8223070 0x5586a85dfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43078/0 (socket says 172.21.15.33:43078) 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.348+0000 7fd634ff6640 1 -- 172.21.15.33:0/3267349141 learned_addr learned my addr 172.21.15.33:0/3267349141 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8202390 0x5586a85d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd634ff6640 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a81fa1b0 0x5586a85d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd634ff6640 1 -- 172.21.15.33:0/3267349141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a81fa1b0 msgr2=0x5586a85d3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd634ff6640 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a81fa1b0 0x5586a85d3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd634ff6640 1 -- 172.21.15.33:0/3267349141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8202390 msgr2=0x5586a85d4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd634ff6640 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8202390 0x5586a85d4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd634ff6640 1 -- 172.21.15.33:0/3267349141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586a84ee900 con 0x5586a8223070 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8202390 0x5586a85d4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd634ff6640 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8223070 0x5586a85dfde0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fd628009cf0 tx=0x7fd628005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d4f9f52b7f0f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd60f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3267349141 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62801e030 con 0x5586a8223070 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd63cfce740 1 -- 172.21.15.33:0/3267349141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd628004d20 con 0x5586a8223070 2024-08-28T19:48:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3267349141 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7fd628023030 con 0x5586a8223070 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3267349141 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd628016070 con 0x5586a8223070 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.349+0000 7fd63cfce740 10 client.19869 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.350+0000 7fd63cfce740 1 -- 172.21.15.33:0/3267349141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586a85e2950 con 0x5586a8223070 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.350+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3267349141 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd628004d20 con 0x5586a8223070 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.350+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3267349141 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd62800f040 con 0x5586a8223070 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.350+0000 7fd63cfce740 10 client.19869 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.350+0000 7fd63cfce740 10 client.19869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.350+0000 7fd63cfce740 20 client.19869 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.350+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5586a81e19f0 0x5586a85e5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.350+0000 7fd63cfce740 4 client.19869 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.350+0000 7fd63cfce740 1 -- 172.21.15.33:0/3267349141 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586a85415d0 con 0x5586a81e19f0 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.350+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5586a81e19f0 0x5586a85e5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.351+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5586a81e19f0 0x5586a85e5dc0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1711657911f4994a server_cookie=a6c1346e11b02a09 in_seq=0 out_seq=0 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.351+0000 7fd60f7fe640 10 client.19869 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.351+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3267349141 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586a85415d0 con 0x5586a81e19f0 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.351+0000 7fd60f7fe640 10 client.19869 handle_command_reply: tid=0 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.351+0000 7fd63cfce740 1 client.19869 shutdown 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 1 -- 172.21.15.33:0/3267349141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8223070 msgr2=0x5586a85dfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8223070 0x5586a85dfde0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fd628009cf0 tx=0x7fd628005a70 comp rx=0 tx=0).stop 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 1 -- 172.21.15.33:0/3267349141 shutdown_connections 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5586a81e19f0 0x5586a85e5dc0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8223070 0x5586a85dfde0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a8202390 0x5586a85d4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd60f7fe640 0 client.19869 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3267349141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a81fa1b0 0x5586a85d3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 1 -- 172.21.15.33:0/3267349141 >> 172.21.15.33:0/3267349141 conn(0x5586a8217460 msgr2=0x5586a85cb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:32.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 1 -- 172.21.15.33:0/3267349141 shutdown_connections 2024-08-28T19:48:32.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 1 -- 172.21.15.33:0/3267349141 wait complete. 2024-08-28T19:48:32.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.352+0000 7fd63cfce740 20 client.19869 trim_cache size 0 max 16384 2024-08-28T19:48:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd63cfce740 1 Processor -- start 2024-08-28T19:48:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd63cfce740 1 -- start start 2024-08-28T19:48:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 0x5586a85c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85d5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 0x5586a85dfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd63cfce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd6301b2d70 con 0x5586a8202390 2024-08-28T19:48:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd63cfce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6301b48b0 con 0x5586a81fa1b0 2024-08-28T19:48:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd63cfce740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6301b3440 con 0x5586a8223070 2024-08-28T19:48:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85d5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85d5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43080/0 (socket says 172.21.15.33:43080) 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.365+0000 7fd62f7fe640 1 -- 172.21.15.33:0/2404607872 learned_addr learned my addr 172.21.15.33:0/2404607872 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd634ff6640 1 --2- 172.21.15.33:0/2404607872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 0x5586a85dfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd634ff6640 1 --2- 172.21.15.33:0/2404607872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 0x5586a85c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd62f7fe640 1 -- 172.21.15.33:0/2404607872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 msgr2=0x5586a85dfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/2404607872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 0x5586a85dfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd62f7fe640 1 -- 172.21.15.33:0/2404607872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 msgr2=0x5586a85c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/2404607872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 0x5586a85c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd62f7fe640 1 -- 172.21.15.33:0/2404607872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586a85c6e00 con 0x5586a8202390 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd634ff6640 1 --2- 172.21.15.33:0/2404607872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 0x5586a85c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/2404607872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85d5740 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fd624000c00 tx=0x7fd6240108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e6c858cd3d87f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd615ffb640 1 -- 172.21.15.33:0/2404607872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624005220 con 0x5586a8202390 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd615ffb640 1 -- 172.21.15.33:0/2404607872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd624004c50 con 0x5586a8202390 2024-08-28T19:48:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.366+0000 7fd615ffb640 1 -- 172.21.15.33:0/2404607872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62401e9a0 con 0x5586a8202390 2024-08-28T19:48:32.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 -- 172.21.15.33:0/2404607872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 msgr2=0x5586a85d5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:32.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 --2- 172.21.15.33:0/2404607872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85d5740 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fd624000c00 tx=0x7fd6240108c0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 -- 172.21.15.33:0/2404607872 shutdown_connections 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 --2- 172.21.15.33:0/2404607872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 0x5586a85dfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 --2- 172.21.15.33:0/2404607872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85d5740 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 --2- 172.21.15.33:0/2404607872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 0x5586a85c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 -- 172.21.15.33:0/2404607872 >> 172.21.15.33:0/2404607872 conn(0x5586a8217460 msgr2=0x5586a85d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 -- 172.21.15.33:0/2404607872 shutdown_connections 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 -- 172.21.15.33:0/2404607872 wait complete. 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 -- start start 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.367+0000 7fd63cfce740 1 Processor -- start 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 0x5586a85da190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85da750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd63cfce740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 0x5586a864f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd63cfce740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd6301b41e0 con 0x5586a8202390 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd63cfce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6301b3b10 con 0x5586a81fa1b0 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd63cfce740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd6301b0d70 con 0x5586a8223070 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd63cfce740 10 client.0 _ll_register_callbacks cb 0x7fd62400a650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85da750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85da750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43082/0 (socket says 172.21.15.33:43082) 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd62f7fe640 1 -- 172.21.15.33:0/3930819878 learned_addr learned my addr 172.21.15.33:0/3930819878 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd634ff6640 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 0x5586a864f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd634ff6640 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 0x5586a85da190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd62f7fe640 1 -- 172.21.15.33:0/3930819878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 msgr2=0x5586a864f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 0x5586a864f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd62f7fe640 1 -- 172.21.15.33:0/3930819878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 msgr2=0x5586a85da190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 0x5586a85da190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd62f7fe640 1 -- 172.21.15.33:0/3930819878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586a864fbc0 con 0x5586a8202390 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.368+0000 7fd634ff6640 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 0x5586a864f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd62f7fe640 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85da750 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fd624004990 tx=0x7fd6240049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2648763a257515e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd60f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3930819878 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6240054f0 con 0x5586a8202390 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3930819878 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7fd62401e4d0 con 0x5586a8202390 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd63cfce740 1 -- 172.21.15.33:0/3930819878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd624004c50 con 0x5586a8202390 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3930819878 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd62403a050 con 0x5586a8202390 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd63cfce740 10 client.19875 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd63cfce740 1 -- 172.21.15.33:0/3930819878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586a8650cc0 con 0x5586a8202390 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3930819878 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd624004c50 con 0x5586a8202390 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3930819878 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd62402c820 con 0x5586a8202390 2024-08-28T19:48:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd63cfce740 10 client.19875 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd63cfce740 10 client.19875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd63cfce740 20 client.19875 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5586a81b6da0 0x5586a86533b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd63cfce740 4 client.19875 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.369+0000 7fd63cfce740 1 -- 172.21.15.33:0/3930819878 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5586a853d070 con 0x5586a81b6da0 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.370+0000 7fd634ff6640 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5586a81b6da0 0x5586a86533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.370+0000 7fd634ff6640 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5586a81b6da0 0x5586a86533b0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=614fb86f6c6dc925 server_cookie=64803d5cac79c192 in_seq=0 out_seq=0 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.370+0000 7fd60f7fe640 10 client.19875 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.370+0000 7fd60f7fe640 1 -- 172.21.15.33:0/3930819878 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5586a853d070 con 0x5586a81b6da0 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.370+0000 7fd60f7fe640 10 client.19875 handle_command_reply: tid=0 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.370+0000 7fd63cfce740 1 client.19875 shutdown 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.370+0000 7fd63cfce740 1 -- 172.21.15.33:0/3930819878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 msgr2=0x5586a85da750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.370+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85da750 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fd624004990 tx=0x7fd6240049c0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd63cfce740 1 -- 172.21.15.33:0/3930819878 shutdown_connections 2024-08-28T19:48:32.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5586a8223070 0x5586a864f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5586a81b6da0 0x5586a86533b0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5586a8202390 0x5586a85da750 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd63cfce740 1 --2- 172.21.15.33:0/3930819878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5586a81fa1b0 0x5586a85da190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd63cfce740 1 -- 172.21.15.33:0/3930819878 >> 172.21.15.33:0/3930819878 conn(0x5586a8217460 msgr2=0x5586a85d58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:32.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd60f7fe640 0 client.19875 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:32.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd63cfce740 1 -- 172.21.15.33:0/3930819878 shutdown_connections 2024-08-28T19:48:32.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd63cfce740 1 -- 172.21.15.33:0/3930819878 wait complete. 2024-08-28T19:48:32.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd63cfce740 20 client.19875 trim_cache size 0 max 16384 2024-08-28T19:48:32.379 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:48:32.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 -- 172.21.15.33:0/911007421 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd6180b4d20 msgr2=0x7fd6180b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:32.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd6180b4d20 0x7fd6180b7230 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd620103550 tx=0x7fd620109c40 comp rx=0 tx=0).stop 2024-08-28T19:48:32.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 -- 172.21.15.33:0/911007421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd630103900 msgr2=0x7fd6300754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:32.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd630103900 0x7fd6300754b0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fd620005940 tx=0x7fd6200042f0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 -- 172.21.15.33:0/911007421 shutdown_connections 2024-08-28T19:48:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd630109b90 0x7fd630075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd6180b4d20 0x7fd6180b7230 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd630109240 0x7fd6300759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 --2- 172.21.15.33:0/911007421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd630103900 0x7fd6300754b0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 -- 172.21.15.33:0/911007421 >> 172.21.15.33:0/911007421 conn(0x7fd63007b5f0 msgr2=0x7fd6301072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 -- 172.21.15.33:0/911007421 shutdown_connections 2024-08-28T19:48:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:32.371+0000 7fd636a59640 1 -- 172.21.15.33:0/911007421 wait complete. 2024-08-28T19:48:34.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:33 smithi059 ceph-mon[22052]: pgmap v845: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-08-28T19:48:34.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:33 smithi122 ceph-mon[22174]: pgmap v845: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-08-28T19:48:34.128 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-28T19:48:34.128 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-28T19:48:34.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:33 smithi033 ceph-mon[18549]: pgmap v845: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-08-28T19:48:34.399 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:34.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.877+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/1465091432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a18102820 msgr2=0x7f5a18102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.877+0000 7f5a1f6d1640 1 --2- 172.21.15.33:0/1465091432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a18102820 0x7f5a18102c30 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009900 tx=0x7f5a1402a410 comp rx=0 tx=0).stop 2024-08-28T19:48:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.877+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/1465091432 shutdown_connections 2024-08-28T19:48:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.877+0000 7f5a1f6d1640 1 --2- 172.21.15.33:0/1465091432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a18108ab0 0x7f5a1810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.877+0000 7f5a1f6d1640 1 --2- 172.21.15.33:0/1465091432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a18108160 0x7f5a18108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.877+0000 7f5a1f6d1640 1 --2- 172.21.15.33:0/1465091432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a18102820 0x7f5a18102c30 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.877+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/1465091432 >> 172.21.15.33:0/1465091432 conn(0x7f5a180794e0 msgr2=0x7f5a180798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.877+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/1465091432 shutdown_connections 2024-08-28T19:48:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.877+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/1465091432 wait complete. 2024-08-28T19:48:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1f6d1640 1 Processor -- start 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1f6d1640 1 -- start start 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1f6d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a18102820 0x7f5a1810fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1f6d1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a18108160 0x7f5a181102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1f6d1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a18108ab0 0x7f5a181107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1f6d1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5a18113840 con 0x7f5a18108ab0 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1f6d1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5a181136c0 con 0x7f5a18102820 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1f6d1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5a181139c0 con 0x7f5a18108160 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1dc6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a18108ab0 0x7f5a181107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1dc6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a18108ab0 0x7f5a181107f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43098/0 (socket says 172.21.15.33:43098) 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1dc6e640 1 -- 172.21.15.33:0/2550056910 learned_addr learned my addr 172.21.15.33:0/2550056910 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.878+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a18102820 0x7f5a1810fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a18108160 0x7f5a181102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a1dc6e640 1 -- 172.21.15.33:0/2550056910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a18108160 msgr2=0x7f5a181102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a1dc6e640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a18108160 0x7f5a181102b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a1dc6e640 1 -- 172.21.15.33:0/2550056910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a18102820 msgr2=0x7f5a1810fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a1dc6e640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a18102820 0x7f5a1810fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a1dc6e640 1 -- 172.21.15.33:0/2550056910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a181a84b0 con 0x7f5a18108ab0 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a1dc6e640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a18108ab0 0x7f5a181107f0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000eaa0 tx=0x7f5a1000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a0e7fc640 1 -- 172.21.15.33:0/2550056910 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000cdb0 con 0x7f5a18108ab0 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a0e7fc640 1 -- 172.21.15.33:0/2550056910 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a10005020 con 0x7f5a18108ab0 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/2550056910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a181a87a0 con 0x7f5a18108ab0 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a0e7fc640 1 -- 172.21.15.33:0/2550056910 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a100116d0 con 0x7f5a18108ab0 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.879+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/2550056910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a181a8ce0 con 0x7f5a18108ab0 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a0e7fc640 1 -- 172.21.15.33:0/2550056910 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f5a100051d0 con 0x7f5a18108ab0 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a25c46740 1 Processor -- start 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a25c46740 1 -- start start 2024-08-28T19:48:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 0x55c3ce0a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0a2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a25c46740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c3ce0175f0 con 0x55c3cdcda670 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a25c46740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c3ce006b80 con 0x55c3cdcd2490 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a25c46740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c3ce00ab30 con 0x55c3cdcfb350 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a1cc6c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a1cc6c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0a2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43104/0 (socket says 172.21.15.33:43104) 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.882+0000 7f5a1cc6c640 1 -- 172.21.15.33:0/1244385112 learned_addr learned my addr 172.21.15.33:0/1244385112 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/1244385112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 0x55c3ce0a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/1244385112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a0e7fc640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a040b4ca0 0x7f5a040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a1cc6c640 1 -- 172.21.15.33:0/1244385112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 msgr2=0x55c3ce0a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/1244385112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 0x55c3ce0a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a1cc6c640 1 -- 172.21.15.33:0/1244385112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 msgr2=0x55c3ce0a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/1244385112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a1cc6c640 1 -- 172.21.15.33:0/1244385112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3cdd66930 con 0x55c3cdcda670 2024-08-28T19:48:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a1dc6e640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a040b4ca0 0x7f5a040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a0e7fc640 1 -- 172.21.15.33:0/2550056910 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f5a100e5a30 con 0x7f5a18108ab0 2024-08-28T19:48:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/1244385112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0a2200 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f5a080103a0 tx=0x7f5a0800b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95741353197373d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a037fe640 1 -- 172.21.15.33:0/1244385112 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08018030 con 0x55c3cdcda670 2024-08-28T19:48:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a037fe640 1 -- 172.21.15.33:0/1244385112 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a08012900 con 0x55c3cdcda670 2024-08-28T19:48:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.883+0000 7f5a037fe640 1 -- 172.21.15.33:0/1244385112 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a080118a0 con 0x55c3cdcda670 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.884+0000 7f5a25c46740 1 -- 172.21.15.33:0/1244385112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 msgr2=0x55c3ce0a2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.884+0000 7f5a1dc6e640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a040b4ca0 0x7f5a040b71b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5a100e2e90 tx=0x7f5a10077f80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.884+0000 7f5a25c46740 1 --2- 172.21.15.33:0/1244385112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0a2200 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f5a080103a0 tx=0x7f5a0800b570 comp rx=0 tx=0).stop 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.884+0000 7f5a25c46740 1 -- 172.21.15.33:0/1244385112 shutdown_connections 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.884+0000 7f5a25c46740 1 --2- 172.21.15.33:0/1244385112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0a2200 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.884+0000 7f5a25c46740 1 --2- 172.21.15.33:0/1244385112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.884+0000 7f5a25c46740 1 --2- 172.21.15.33:0/1244385112 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 0x55c3ce0a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.884+0000 7f5a25c46740 1 -- 172.21.15.33:0/1244385112 >> 172.21.15.33:0/1244385112 conn(0x55c3cdcef740 msgr2=0x55c3ce09f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.884+0000 7f5a25c46740 1 -- 172.21.15.33:0/1244385112 shutdown_connections 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.884+0000 7f5a25c46740 1 -- 172.21.15.33:0/1244385112 wait complete. 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.885+0000 7f5a25c46740 1 -- start start 2024-08-28T19:48:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.885+0000 7f5a25c46740 1 Processor -- start 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.885+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.885+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcda670 0x55c3ce0ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.885+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcfb350 0x55c3ce0b9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.885+0000 7f5a25c46740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55c3cde69890 con 0x55c3cdcfb350 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.885+0000 7f5a25c46740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c3cdf8d790 con 0x55c3cdcd2490 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.885+0000 7f5a25c46740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55c3ce0aff60 con 0x55c3cdcda670 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.885+0000 7f5a25c46740 10 client.0 _ll_register_callbacks cb 0x55c3cdd12ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1cc6c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcfb350 0x55c3ce0b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1cc6c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcfb350 0x55c3ce0b9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43112/0 (socket says 172.21.15.33:43112) 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1cc6c640 1 -- 172.21.15.33:0/3159160412 learned_addr learned my addr 172.21.15.33:0/3159160412 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcda670 0x55c3ce0ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1cc6c640 1 -- 172.21.15.33:0/3159160412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcda670 msgr2=0x55c3ce0ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcda670 0x55c3ce0ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1cc6c640 1 -- 172.21.15.33:0/3159160412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 msgr2=0x55c3ce0acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1cc6c640 1 -- 172.21.15.33:0/3159160412 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3cdfc4f30 con 0x55c3cdcfb350 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcfb350 0x55c3ce0b9250 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x55c3ce0af760 tx=0x7f5a08014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8f5fa85f67aed0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3159160412 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a08018070 con 0x55c3cdcfb350 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3159160412 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f5a08012d10 con 0x55c3cdcfb350 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a25c46740 1 -- 172.21.15.33:0/3159160412 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a08012900 con 0x55c3cdcfb350 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3159160412 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a080047e0 con 0x55c3cdcfb350 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a25c46740 10 client.19887 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.886+0000 7f5a25c46740 1 -- 172.21.15.33:0/3159160412 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c3ce0bbd40 con 0x55c3cdcfb350 2024-08-28T19:48:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.887+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3159160412 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a08012900 con 0x55c3cdcfb350 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.887+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3159160412 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5a0800f040 con 0x55c3cdcfb350 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.887+0000 7f5a25c46740 10 client.19887 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.887+0000 7f5a25c46740 10 client.19887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.887+0000 7f5a25c46740 20 client.19887 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.887+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c3cdcb9cd0 0x55c3ce0bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.887+0000 7f5a25c46740 4 client.19887 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.887+0000 7f5a25c46740 1 -- 172.21.15.33:0/3159160412 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3ce019540 con 0x55c3cdcb9cd0 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.887+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c3cdcb9cd0 0x55c3ce0bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.888+0000 7f5a00ff9640 10 client.19887 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.888+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c3cdcb9cd0 0x55c3ce0bf1b0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ce18d12c463dfc5 server_cookie=65b83d02ae7b9ace in_seq=0 out_seq=0 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.888+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3159160412 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3ce019540 con 0x55c3cdcb9cd0 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.888+0000 7f5a00ff9640 10 client.19887 handle_command_reply: tid=0 2024-08-28T19:48:34.897 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 client.19887 shutdown 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 -- 172.21.15.33:0/3159160412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcfb350 msgr2=0x55c3ce0b9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcfb350 0x55c3ce0b9250 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x55c3ce0af760 tx=0x7f5a08014040 comp rx=0 tx=0).stop 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 -- 172.21.15.33:0/3159160412 shutdown_connections 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c3cdcb9cd0 0x55c3ce0bf1b0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcfb350 0x55c3ce0b9250 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcda670 0x55c3ce0ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3159160412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a00ff9640 0 client.19887 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 -- 172.21.15.33:0/3159160412 >> 172.21.15.33:0/3159160412 conn(0x55c3cdcef740 msgr2=0x55c3ce0a4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 -- 172.21.15.33:0/3159160412 shutdown_connections 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 1 -- 172.21.15.33:0/3159160412 wait complete. 2024-08-28T19:48:34.898 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.889+0000 7f5a25c46740 20 client.19887 trim_cache size 0 max 16384 2024-08-28T19:48:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a25c46740 1 Processor -- start 2024-08-28T19:48:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a25c46740 1 -- start start 2024-08-28T19:48:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcd2490 0x55c3ce0a2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcfb350 0x55c3ce0b9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a25c46740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5a181b2ef0 con 0x55c3cdcda670 2024-08-28T19:48:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a25c46740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5a181b4a30 con 0x55c3cdcfb350 2024-08-28T19:48:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a25c46740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5a181b35c0 con 0x55c3cdcd2490 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a1d46d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a1d46d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43122/0 (socket says 172.21.15.33:43122) 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a1d46d640 1 -- 172.21.15.33:0/1949464286 learned_addr learned my addr 172.21.15.33:0/1949464286 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/1949464286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcd2490 0x55c3ce0a2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/1949464286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcfb350 0x55c3ce0b9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a1d46d640 1 -- 172.21.15.33:0/1949464286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcd2490 msgr2=0x55c3ce0a2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/1949464286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcd2490 0x55c3ce0a2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a1d46d640 1 -- 172.21.15.33:0/1949464286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcfb350 msgr2=0x55c3ce0b9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.907+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/1949464286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcfb350 0x55c3ce0b9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.908+0000 7f5a1d46d640 1 -- 172.21.15.33:0/1949464286 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ce0ae1d0 con 0x55c3cdcda670 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.908+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/1949464286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b9150 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f5a1402a930 tx=0x7f5a14031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cc616260ed4ee7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.908+0000 7f5a02ffd640 1 -- 172.21.15.33:0/1949464286 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14035040 con 0x55c3cdcda670 2024-08-28T19:48:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.908+0000 7f5a02ffd640 1 -- 172.21.15.33:0/1949464286 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a140044b0 con 0x55c3cdcda670 2024-08-28T19:48:34.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.908+0000 7f5a02ffd640 1 -- 172.21.15.33:0/1949464286 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a140035f0 con 0x55c3cdcda670 2024-08-28T19:48:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 -- 172.21.15.33:0/1949464286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 msgr2=0x55c3ce0b9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 --2- 172.21.15.33:0/1949464286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b9150 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f5a1402a930 tx=0x7f5a14031400 comp rx=0 tx=0).stop 2024-08-28T19:48:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 -- 172.21.15.33:0/1949464286 shutdown_connections 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 --2- 172.21.15.33:0/1949464286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcfb350 0x55c3ce0b9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 --2- 172.21.15.33:0/1949464286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b9150 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 --2- 172.21.15.33:0/1949464286 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcd2490 0x55c3ce0a2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 -- 172.21.15.33:0/1949464286 >> 172.21.15.33:0/1949464286 conn(0x55c3cdcef740 msgr2=0x55c3ce0a27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 -- 172.21.15.33:0/1949464286 shutdown_connections 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 -- 172.21.15.33:0/1949464286 wait complete. 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 -- start start 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.909+0000 7f5a25c46740 1 Processor -- start 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a25c46740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 0x55c3ce1289b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a25c46740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5a181b4360 con 0x55c3cdcda670 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a25c46740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5a181b3c90 con 0x55c3cdcd2490 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a25c46740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f5a181b0ef0 con 0x55c3cdcfb350 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a25c46740 10 client.0 _ll_register_callbacks cb 0x7f5a0800bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1d46d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1d46d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43134/0 (socket says 172.21.15.33:43134) 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1d46d640 1 -- 172.21.15.33:0/3194607941 learned_addr learned my addr 172.21.15.33:0/3194607941 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 0x55c3ce1289b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1d46d640 1 -- 172.21.15.33:0/3194607941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 msgr2=0x55c3ce1289b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 0x55c3ce1289b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1d46d640 1 -- 172.21.15.33:0/3194607941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 msgr2=0x55c3ce0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1d46d640 1 -- 172.21.15.33:0/3194607941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ce128ef0 con 0x55c3cdcda670 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 0x55c3ce1289b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a1d46d640 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b1dd0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f5a14032d90 tx=0x7f5a14004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4607d60940cbc808 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3194607941 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14053020 con 0x55c3cdcda670 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.910+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3194607941 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f5a140037f0 con 0x55c3cdcda670 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a25c46740 1 -- 172.21.15.33:0/3194607941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a140044b0 con 0x55c3cdcda670 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3194607941 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a14035040 con 0x55c3cdcda670 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a25c46740 10 client.19893 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a25c46740 1 -- 172.21.15.33:0/3194607941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c3ce12a180 con 0x55c3cdcda670 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3194607941 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a140044b0 con 0x55c3cdcda670 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3194607941 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5a14004ce0 con 0x55c3cdcda670 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a25c46740 10 client.19893 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a25c46740 10 client.19893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:48:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a25c46740 20 client.19893 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c3cdc8f080 0x55c3ce12c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a25c46740 4 client.19893 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-28T19:48:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a25c46740 1 -- 172.21.15.33:0/3194607941 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c3ce014fe0 con 0x55c3cdc8f080 2024-08-28T19:48:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.911+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c3cdc8f080 0x55c3ce12c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.912+0000 7f5a1cc6c640 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c3cdc8f080 0x55c3ce12c8d0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c999a91be817e52 server_cookie=8d9a39bfda244e4b in_seq=0 out_seq=0 2024-08-28T19:48:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.912+0000 7f5a00ff9640 10 client.19893 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:34.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a00ff9640 1 -- 172.21.15.33:0/3194607941 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c3ce014fe0 con 0x55c3cdc8f080 2024-08-28T19:48:34.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a00ff9640 10 client.19893 handle_command_reply: tid=0 2024-08-28T19:48:34.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 client.19893 shutdown 2024-08-28T19:48:34.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 -- 172.21.15.33:0/3194607941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 msgr2=0x55c3ce0b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:34.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b1dd0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f5a14032d90 tx=0x7f5a14004410 comp rx=0 tx=0).stop 2024-08-28T19:48:34.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 -- 172.21.15.33:0/3194607941 shutdown_connections 2024-08-28T19:48:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c3cdcfb350 0x55c3ce1289b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55c3cdc8f080 0x55c3ce12c8d0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c3cdcda670 0x55c3ce0b1dd0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 --2- 172.21.15.33:0/3194607941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3cdcd2490 0x55c3ce0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a00ff9640 0 client.19893 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 -- 172.21.15.33:0/3194607941 >> 172.21.15.33:0/3194607941 conn(0x55c3cdcef740 msgr2=0x55c3ce0a5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 -- 172.21.15.33:0/3194607941 shutdown_connections 2024-08-28T19:48:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 1 -- 172.21.15.33:0/3194607941 wait complete. 2024-08-28T19:48:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.914+0000 7f5a25c46740 20 client.19893 trim_cache size 0 max 16384 2024-08-28T19:48:34.920 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:48:34.921 INFO:teuthology.orchestra.run.smithi033.stdout: "return_code": 0, 2024-08-28T19:48:34.921 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_tag": "8ffc9e14-97cc-410d-b583-8de689f35b0f", 2024-08-28T19:48:34.921 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": "asynchronous" 2024-08-28T19:48:34.921 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:48:34.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/2550056910 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a040b4ca0 msgr2=0x7f5a040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:34.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a040b4ca0 0x7f5a040b71b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5a100e2e90 tx=0x7f5a10077f80 comp rx=0 tx=0).stop 2024-08-28T19:48:34.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/2550056910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a18108ab0 msgr2=0x7f5a181107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:34.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a18108ab0 0x7f5a181107f0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000eaa0 tx=0x7f5a1000ef60 comp rx=0 tx=0).stop 2024-08-28T19:48:34.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/2550056910 shutdown_connections 2024-08-28T19:48:34.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a18108ab0 0x7f5a181107f0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f5a040b4ca0 0x7f5a040b71b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5a18108160 0x7f5a181102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 --2- 172.21.15.33:0/2550056910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a18102820 0x7f5a1810fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:34.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/2550056910 >> 172.21.15.33:0/2550056910 conn(0x7f5a180794e0 msgr2=0x7f5a18101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:34.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/2550056910 shutdown_connections 2024-08-28T19:48:34.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:34.915+0000 7f5a1f6d1640 1 -- 172.21.15.33:0/2550056910 wait complete. 2024-08-28T19:48:35.609 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:48:35.863 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:48:35.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:35 smithi033 ceph-mon[18549]: pgmap v846: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-08-28T19:48:35.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:35 smithi033 ceph-mon[18549]: scrub queued for path: / 2024-08-28T19:48:35.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:35 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:48:35.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:35 smithi033 ceph-mon[18549]: scrub summary: active paths [/] 2024-08-28T19:48:35.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:35 smithi033 ceph-mon[18549]: scrub summary: idle+waiting paths [/] 2024-08-28T19:48:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:35 smithi059 ceph-mon[22052]: pgmap v846: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-08-28T19:48:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:35 smithi059 ceph-mon[22052]: scrub queued for path: / 2024-08-28T19:48:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:35 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:48:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:35 smithi059 ceph-mon[22052]: scrub summary: active paths [/] 2024-08-28T19:48:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:35 smithi059 ceph-mon[22052]: scrub summary: idle+waiting paths [/] 2024-08-28T19:48:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:35 smithi122 ceph-mon[22174]: pgmap v846: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-08-28T19:48:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:35 smithi122 ceph-mon[22174]: scrub queued for path: / 2024-08-28T19:48:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:35 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:48:36.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:35 smithi122 ceph-mon[22174]: scrub summary: active paths [/] 2024-08-28T19:48:36.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:35 smithi122 ceph-mon[22174]: scrub summary: idle+waiting paths [/] 2024-08-28T19:48:36.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.442+0000 7ff37b14c640 1 -- 172.21.15.33:0/3968175298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff374104770 msgr2=0x7ff374104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:36.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.442+0000 7ff37b14c640 1 --2- 172.21.15.33:0/3968175298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff374104770 0x7ff374104b80 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7ff364009900 tx=0x7ff36402a410 comp rx=0 tx=0).stop 2024-08-28T19:48:36.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.442+0000 7ff37b14c640 1 -- 172.21.15.33:0/3968175298 shutdown_connections 2024-08-28T19:48:36.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.442+0000 7ff37b14c640 1 --2- 172.21.15.33:0/3968175298 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff37410dbd0 0x7ff3741100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.442+0000 7ff37b14c640 1 --2- 172.21.15.33:0/3968175298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3741050c0 0x7ff37410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.442+0000 7ff37b14c640 1 --2- 172.21.15.33:0/3968175298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff374104770 0x7ff374104b80 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.442+0000 7ff37b14c640 1 -- 172.21.15.33:0/3968175298 >> 172.21.15.33:0/3968175298 conn(0x7ff3740794e0 msgr2=0x7ff3740798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:36.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.442+0000 7ff37b14c640 1 -- 172.21.15.33:0/3968175298 shutdown_connections 2024-08-28T19:48:36.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.442+0000 7ff37b14c640 1 -- 172.21.15.33:0/3968175298 wait complete. 2024-08-28T19:48:36.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff37b14c640 1 Processor -- start 2024-08-28T19:48:36.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff37b14c640 1 -- start start 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff37b14c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff374104770 0x7ff37419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff37b14c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3741050c0 0x7ff37419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff37b14c640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff37410dbd0 0x7ff37419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff37b14c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff374113850 con 0x7ff3741050c0 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff37b14c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741136d0 con 0x7ff374104770 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff37b14c640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741139d0 con 0x7ff37410dbd0 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff373fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3741050c0 0x7ff37419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff373fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3741050c0 0x7ff37419a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43150/0 (socket says 172.21.15.33:43150) 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff373fff640 1 -- 172.21.15.33:0/2906191102 learned_addr learned my addr 172.21.15.33:0/2906191102 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff378ee8640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff374104770 0x7ff37419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff3796e9640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff37410dbd0 0x7ff37419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff373fff640 1 -- 172.21.15.33:0/2906191102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff37410dbd0 msgr2=0x7ff37419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff373fff640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff37410dbd0 0x7ff37419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff373fff640 1 -- 172.21.15.33:0/2906191102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff374104770 msgr2=0x7ff37419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff373fff640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff374104770 0x7ff37419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff373fff640 1 -- 172.21.15.33:0/2906191102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3741a02b0 con 0x7ff3741050c0 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.443+0000 7ff373fff640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3741050c0 0x7ff37419a8e0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00d740 tx=0x7ff35c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.444+0000 7ff371ffb640 1 -- 172.21.15.33:0/2906191102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c017070 con 0x7ff3741050c0 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.444+0000 7ff371ffb640 1 -- 172.21.15.33:0/2906191102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff35c00de50 con 0x7ff3741050c0 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.444+0000 7ff37b14c640 1 -- 172.21.15.33:0/2906191102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3741a05a0 con 0x7ff3741050c0 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.444+0000 7ff371ffb640 1 -- 172.21.15.33:0/2906191102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00f620 con 0x7ff3741050c0 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.444+0000 7ff37b14c640 1 -- 172.21.15.33:0/2906191102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3741a6d00 con 0x7ff3741050c0 2024-08-28T19:48:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.446+0000 7ff3816c1740 1 Processor -- start 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.446+0000 7ff3816c1740 1 -- start start 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db13b070 0x55e3db4e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4e0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4e0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff3816c1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e3db457630 con 0x55e3db11a390 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff3816c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e3db446bc0 con 0x55e3db13b070 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff3816c1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e3db44ab70 con 0x55e3db1121b0 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff371ffb640 1 -- 172.21.15.33:0/2906191102 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff35c01a070 con 0x7ff3741050c0 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff378ee8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4e0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff373fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4e0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff3796e9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db13b070 0x55e3db4e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.523 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff378ee8640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4e0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:41952/0 (socket says 172.21.15.33:41952) 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff378ee8640 1 -- 172.21.15.33:0/817473404 learned_addr learned my addr 172.21.15.33:0/817473404 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff378ee8640 1 -- 172.21.15.33:0/817473404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db13b070 msgr2=0x55e3db4e02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff378ee8640 1 --2- 172.21.15.33:0/817473404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db13b070 0x55e3db4e02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff378ee8640 1 -- 172.21.15.33:0/817473404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 msgr2=0x55e3db4e0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff378ee8640 1 --2- 172.21.15.33:0/817473404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4e0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff378ee8640 1 -- 172.21.15.33:0/817473404 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3db1a6650 con 0x55e3db1121b0 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.447+0000 7ff373fff640 1 --2- 172.21.15.33:0/817473404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4e0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.448+0000 7ff371ffb640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3600b4ca0 0x7ff3600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.448+0000 7ff378ee8640 1 --2- 172.21.15.33:0/817473404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4e0800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff37406c3c0 tx=0x7ff364032c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae3a576ab79b8430 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.448+0000 7ff3796e9640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3600b4ca0 0x7ff3600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.448+0000 7ff371ffb640 1 -- 172.21.15.33:0/2906191102 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7ff35c0e5250 con 0x7ff3741050c0 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.448+0000 7ff36affd640 1 -- 172.21.15.33:0/817473404 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364040070 con 0x55e3db1121b0 2024-08-28T19:48:36.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.448+0000 7ff36affd640 1 -- 172.21.15.33:0/817473404 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff364032e50 con 0x55e3db1121b0 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.448+0000 7ff36affd640 1 -- 172.21.15.33:0/817473404 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364035040 con 0x55e3db1121b0 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3816c1740 1 -- 172.21.15.33:0/817473404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 msgr2=0x55e3db4e0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3796e9640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3600b4ca0 0x7ff3600b71b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff36c005fd0 tx=0x7ff36c009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3816c1740 1 --2- 172.21.15.33:0/817473404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4e0800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff37406c3c0 tx=0x7ff364032c60 comp rx=0 tx=0).stop 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3816c1740 1 -- 172.21.15.33:0/817473404 shutdown_connections 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3816c1740 1 --2- 172.21.15.33:0/817473404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4e0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3816c1740 1 --2- 172.21.15.33:0/817473404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4e0800 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3816c1740 1 --2- 172.21.15.33:0/817473404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db13b070 0x55e3db4e02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3816c1740 1 -- 172.21.15.33:0/817473404 >> 172.21.15.33:0/817473404 conn(0x55e3db12f460 msgr2=0x55e3db4de1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3816c1740 1 -- 172.21.15.33:0/817473404 shutdown_connections 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3816c1740 1 -- 172.21.15.33:0/817473404 wait complete. 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.449+0000 7ff3816c1740 1 -- start start 2024-08-28T19:48:36.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff3816c1740 1 Processor -- start 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4ebf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db13b070 0x55e3db4f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff3816c1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e3db2a9700 con 0x55e3db11a390 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff3816c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e3db3cd700 con 0x55e3db13b070 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff3816c1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e3db4eea40 con 0x55e3db1121b0 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff3816c1740 10 client.0 _ll_register_callbacks cb 0x55e3db3fcdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff373fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4ebf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff373fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4ebf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43158/0 (socket says 172.21.15.33:43158) 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff373fff640 1 -- 172.21.15.33:0/653006669 learned_addr learned my addr 172.21.15.33:0/653006669 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff3796e9640 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db13b070 0x55e3db4f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff378ee8640 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff373fff640 1 -- 172.21.15.33:0/653006669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 msgr2=0x55e3db4eba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff373fff640 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4eba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff373fff640 1 -- 172.21.15.33:0/653006669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db13b070 msgr2=0x55e3db4f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff373fff640 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db13b070 0x55e3db4f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.450+0000 7ff373fff640 1 -- 172.21.15.33:0/653006669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3db4068b0 con 0x55e3db11a390 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff373fff640 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4ebf50 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0e2660 tx=0x7ff35c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b41eb205c64f6b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff353fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff353fff640 1 -- 172.21.15.33:0/653006669 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c021070 con 0x55e3db11a390 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff353fff640 1 -- 172.21.15.33:0/653006669 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7ff35c0ce0e0 con 0x55e3db11a390 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff3816c1740 1 -- 172.21.15.33:0/653006669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff364032e50 con 0x55e3db11a390 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff353fff640 1 -- 172.21.15.33:0/653006669 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff35c0ab420 con 0x55e3db11a390 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff3816c1740 10 client.19905 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:36.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff3816c1740 1 -- 172.21.15.33:0/653006669 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e3db4fa850 con 0x55e3db11a390 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff353fff640 1 -- 172.21.15.33:0/653006669 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff364032e50 con 0x55e3db11a390 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff353fff640 1 -- 172.21.15.33:0/653006669 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff35c0a6fc0 con 0x55e3db11a390 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff3816c1740 10 client.19905 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff3816c1740 10 client.19905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff3816c1740 20 client.19905 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff3816c1740 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e3db0f99f0 0x55e3db4fdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff3816c1740 4 client.19905 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.451+0000 7ff3816c1740 1 -- 172.21.15.33:0/653006669 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3db459580 con 0x55e3db0f99f0 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.452+0000 7ff378ee8640 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e3db0f99f0 0x55e3db4fdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.452+0000 7ff378ee8640 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e3db0f99f0 0x55e3db4fdd70 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55d59eeaa0134ded server_cookie=6c49adbd8135e899 in_seq=0 out_seq=0 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.452+0000 7ff353fff640 10 client.19905 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:36.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff353fff640 1 -- 172.21.15.33:0/653006669 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3db459580 con 0x55e3db0f99f0 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff353fff640 10 client.19905 handle_command_reply: tid=0 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 client.19905 shutdown 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 -- 172.21.15.33:0/653006669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 msgr2=0x55e3db4ebf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4ebf50 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0e2660 tx=0x7ff35c000bc0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 -- 172.21.15.33:0/653006669 shutdown_connections 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db13b070 0x55e3db4f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e3db0f99f0 0x55e3db4fdd70 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4ebf50 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff353fff640 0 client.19905 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 --2- 172.21.15.33:0/653006669 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 -- 172.21.15.33:0/653006669 >> 172.21.15.33:0/653006669 conn(0x55e3db12f460 msgr2=0x55e3db4e3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 -- 172.21.15.33:0/653006669 shutdown_connections 2024-08-28T19:48:36.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 1 -- 172.21.15.33:0/653006669 wait complete. 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.453+0000 7ff3816c1740 20 client.19905 trim_cache size 0 max 16384 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff3816c1740 1 Processor -- start 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff3816c1740 1 -- start start 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db1121b0 0x55e3db4e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db13b070 0x55e3db4ddad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff3816c1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741b0d30 con 0x55e3db11a390 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff3816c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741b2870 con 0x55e3db1121b0 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff3816c1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741b1400 con 0x55e3db13b070 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff373fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff373fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4f7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43162/0 (socket says 172.21.15.33:43162) 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff373fff640 1 -- 172.21.15.33:0/2033185776 learned_addr learned my addr 172.21.15.33:0/2033185776 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:36.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff378ee8640 1 --2- 172.21.15.33:0/2033185776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db1121b0 0x55e3db4e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.471+0000 7ff3796e9640 1 --2- 172.21.15.33:0/2033185776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db13b070 0x55e3db4ddad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.472+0000 7ff373fff640 1 -- 172.21.15.33:0/2033185776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db13b070 msgr2=0x55e3db4ddad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.472+0000 7ff373fff640 1 --2- 172.21.15.33:0/2033185776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db13b070 0x55e3db4ddad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.472+0000 7ff373fff640 1 -- 172.21.15.33:0/2033185776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db1121b0 msgr2=0x55e3db4e3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.472+0000 7ff373fff640 1 --2- 172.21.15.33:0/2033185776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db1121b0 0x55e3db4e3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.472+0000 7ff373fff640 1 -- 172.21.15.33:0/2033185776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3db4e9f10 con 0x55e3db11a390 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.472+0000 7ff378ee8640 1 --2- 172.21.15.33:0/2033185776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db1121b0 0x55e3db4e3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.472+0000 7ff373fff640 1 --2- 172.21.15.33:0/2033185776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4f7c90 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0a88c0 tx=0x7ff35c010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68eaa4d06660dd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.472+0000 7ff36a7fc640 1 -- 172.21.15.33:0/2033185776 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c021070 con 0x55e3db11a390 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.472+0000 7ff36a7fc640 1 -- 172.21.15.33:0/2033185776 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff35c0ab160 con 0x55e3db11a390 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.472+0000 7ff36a7fc640 1 -- 172.21.15.33:0/2033185776 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0aadc0 con 0x55e3db11a390 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 -- 172.21.15.33:0/2033185776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 msgr2=0x55e3db4f7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:36.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 --2- 172.21.15.33:0/2033185776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4f7c90 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0a88c0 tx=0x7ff35c010c70 comp rx=0 tx=0).stop 2024-08-28T19:48:36.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 -- 172.21.15.33:0/2033185776 shutdown_connections 2024-08-28T19:48:36.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 --2- 172.21.15.33:0/2033185776 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db13b070 0x55e3db4ddad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 --2- 172.21.15.33:0/2033185776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db11a390 0x55e3db4f7c90 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.532 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:48:36.532 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-28T19:48:36.532 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": { 2024-08-28T19:48:36.532 INFO:teuthology.orchestra.run.smithi033.stdout: "8ffc9e14-97cc-410d-b583-8de689f35b0f": { 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "tag": "8ffc9e14-97cc-410d-b583-8de689f35b0f", 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "options": "recursive,force" 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "8ffc9e14-97cc-410d-b583-8de689f35b0f": { 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:48:34.913714+0000", 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.533 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.534 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:48:36.535 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "7bc9ceff-c40a-4b60-a12f-cc9f203af1aa": { 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:47:00.994176+0000", 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.537 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:45:27.534627+0000", 2024-08-28T19:48:36.538 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.539 INFO:teuthology.orchestra.run.smithi033.stdout: "48fef576-2648-4bab-8772-21d3637a9125": { 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:46:15.427396+0000", 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.540 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "153c14e4-9cf6-465d-b1e1-c611091f3f27": { 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:47:47.242949+0000", 2024-08-28T19:48:36.541 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.542 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.543 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.544 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.545 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.546 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.547 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:48:36.548 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 --2- 172.21.15.33:0/2033185776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db1121b0 0x55e3db4e3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 -- 172.21.15.33:0/2033185776 >> 172.21.15.33:0/2033185776 conn(0x55e3db12f460 msgr2=0x55e3db4e33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 -- 172.21.15.33:0/2033185776 shutdown_connections 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 -- 172.21.15.33:0/2033185776 wait complete. 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 -- start start 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.473+0000 7ff3816c1740 1 Processor -- start 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db11a390 0x55e3db4f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3816c1740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db13b070 0x55e3db567750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3816c1740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741b21a0 con 0x55e3db13b070 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3816c1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741b1ad0 con 0x55e3db11a390 2024-08-28T19:48:36.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3816c1740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741aed30 con 0x55e3db1121b0 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3816c1740 10 client.0 _ll_register_callbacks cb 0x7ff35c0e8f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3796e9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db13b070 0x55e3db567750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3796e9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db13b070 0x55e3db567750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43176/0 (socket says 172.21.15.33:43176) 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3796e9640 1 -- 172.21.15.33:0/3963455987 learned_addr learned my addr 172.21.15.33:0/3963455987 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff378ee8640 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff373fff640 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db11a390 0x55e3db4f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3796e9640 1 -- 172.21.15.33:0/3963455987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 msgr2=0x55e3db4f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3796e9640 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3796e9640 1 -- 172.21.15.33:0/3963455987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db11a390 msgr2=0x55e3db4f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3796e9640 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db11a390 0x55e3db4f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.474+0000 7ff3796e9640 1 -- 172.21.15.33:0/3963455987 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3db567d40 con 0x55e3db13b070 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff3796e9640 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db13b070 0x55e3db567750 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7ff36c011ee0 tx=0x7ff36c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd20ad3f0445bbe server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:48:36.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff353fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff353fff640 1 -- 172.21.15.33:0/3963455987 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c021c00 con 0x55e3db13b070 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff353fff640 1 -- 172.21.15.33:0/3963455987 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7ff36c021da0 con 0x55e3db13b070 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff3816c1740 1 -- 172.21.15.33:0/3963455987 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff35c0ab160 con 0x55e3db13b070 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff353fff640 1 -- 172.21.15.33:0/3963455987 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff36c035050 con 0x55e3db13b070 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff3816c1740 10 client.19911 fetch_fsmap learned FSMap version 28 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff3816c1740 1 -- 172.21.15.33:0/3963455987 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e3db568fd0 con 0x55e3db13b070 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff353fff640 1 -- 172.21.15.33:0/3963455987 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff35c0ab160 con 0x55e3db13b070 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff353fff640 1 -- 172.21.15.33:0/3963455987 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff36c00f040 con 0x55e3db13b070 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff3816c1740 10 client.19911 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff3816c1740 10 client.19911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff3816c1740 20 client.19911 populate_metadata read hostname 'smithi033' 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff3816c1740 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e3db0ceda0 0x55e3db56b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:48:36.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff3816c1740 4 client.19911 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.475+0000 7ff3816c1740 1 -- 172.21.15.33:0/3963455987 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e3db455020 con 0x55e3db0ceda0 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.476+0000 7ff378ee8640 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e3db0ceda0 0x55e3db56b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.476+0000 7ff378ee8640 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e3db0ceda0 0x55e3db56b810 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=435d9ccde04dc799 server_cookie=d143ed9ac03c66f3 in_seq=0 out_seq=0 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.476+0000 7ff353fff640 10 client.19911 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.476+0000 7ff353fff640 1 -- 172.21.15.33:0/3963455987 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7386 (crc 0 0 0) 0x55e3db455020 con 0x55e3db0ceda0 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.476+0000 7ff353fff640 10 client.19911 handle_command_reply: tid=0 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 client.19911 shutdown 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 -- 172.21.15.33:0/3963455987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db13b070 msgr2=0x55e3db567750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db13b070 0x55e3db567750 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7ff36c011ee0 tx=0x7ff36c004a40 comp rx=0 tx=0).stop 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 -- 172.21.15.33:0/3963455987 shutdown_connections 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e3db0ceda0 0x55e3db56b810 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e3db13b070 0x55e3db567750 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3db11a390 0x55e3db4f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff353fff640 0 client.19911 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 --2- 172.21.15.33:0/3963455987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e3db1121b0 0x55e3db4f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 -- 172.21.15.33:0/3963455987 >> 172.21.15.33:0/3963455987 conn(0x55e3db12f460 msgr2=0x55e3db4dd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 -- 172.21.15.33:0/3963455987 shutdown_connections 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 1 -- 172.21.15.33:0/3963455987 wait complete. 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.477+0000 7ff3816c1740 20 client.19911 trim_cache size 0 max 16384 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 -- 172.21.15.33:0/2906191102 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3600b4ca0 msgr2=0x7ff3600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3600b4ca0 0x7ff3600b71b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff36c005fd0 tx=0x7ff36c009600 comp rx=0 tx=0).stop 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 -- 172.21.15.33:0/2906191102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3741050c0 msgr2=0x7ff37419a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3741050c0 0x7ff37419a8e0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00d740 tx=0x7ff35c00dc00 comp rx=0 tx=0).stop 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 -- 172.21.15.33:0/2906191102 shutdown_connections 2024-08-28T19:48:36.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff3600b4ca0 0x7ff3600b71b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff37410dbd0 0x7ff37419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3741050c0 0x7ff37419a8e0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 --2- 172.21.15.33:0/2906191102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff374104770 0x7ff37419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:48:36.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 -- 172.21.15.33:0/2906191102 >> 172.21.15.33:0/2906191102 conn(0x7ff3740794e0 msgr2=0x7ff374106650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:48:36.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 -- 172.21.15.33:0/2906191102 shutdown_connections 2024-08-28T19:48:36.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:48:36.478+0000 7ff37b14c640 1 -- 172.21.15.33:0/2906191102 wait complete. 2024-08-28T19:48:37.312 INFO:tasks.cephfs.filesystem:scrub status for tag:8ffc9e14-97cc-410d-b583-8de689f35b0f - {'path': '/', 'tag': '8ffc9e14-97cc-410d-b583-8de689f35b0f', 'options': 'recursive,force'} 2024-08-28T19:48:38.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:37 smithi059 ceph-mon[22052]: pgmap v847: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-08-28T19:48:38.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:37 smithi122 ceph-mon[22174]: pgmap v847: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-08-28T19:48:38.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:37 smithi033 ceph-mon[18549]: pgmap v847: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-08-28T19:48:40.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:39 smithi059 ceph-mon[22052]: pgmap v848: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-08-28T19:48:40.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:39 smithi059 ceph-mon[22052]: scrub summary: idle 2024-08-28T19:48:40.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:39 smithi122 ceph-mon[22174]: pgmap v848: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-08-28T19:48:40.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:39 smithi122 ceph-mon[22174]: scrub summary: idle 2024-08-28T19:48:40.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:39 smithi033 ceph-mon[18549]: pgmap v848: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-08-28T19:48:40.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:39 smithi033 ceph-mon[18549]: scrub summary: idle 2024-08-28T19:48:42.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:41 smithi059 ceph-mon[22052]: pgmap v849: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 13 op/s 2024-08-28T19:48:42.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:41 smithi122 ceph-mon[22174]: pgmap v849: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 13 op/s 2024-08-28T19:48:42.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:41 smithi033 ceph-mon[18549]: pgmap v849: 129 pgs: 129 active+clean; 28 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 13 op/s 2024-08-28T19:48:44.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:43 smithi059 ceph-mon[22052]: pgmap v850: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-08-28T19:48:44.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:43 smithi122 ceph-mon[22174]: pgmap v850: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-08-28T19:48:44.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:43 smithi033 ceph-mon[18549]: pgmap v850: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-08-28T19:48:46.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:45 smithi059 ceph-mon[22052]: pgmap v851: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 63 KiB/s wr, 16 op/s 2024-08-28T19:48:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:45 smithi122 ceph-mon[22174]: pgmap v851: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 63 KiB/s wr, 16 op/s 2024-08-28T19:48:46.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:45 smithi033 ceph-mon[18549]: pgmap v851: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 63 KiB/s wr, 16 op/s 2024-08-28T19:48:48.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:47 smithi059 ceph-mon[22052]: pgmap v852: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 13 op/s 2024-08-28T19:48:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:47 smithi122 ceph-mon[22174]: pgmap v852: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 13 op/s 2024-08-28T19:48:48.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:47 smithi033 ceph-mon[18549]: pgmap v852: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 13 op/s 2024-08-28T19:48:50.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:49 smithi059 ceph-mon[22052]: pgmap v853: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 96 KiB/s wr, 17 op/s 2024-08-28T19:48:50.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:49 smithi122 ceph-mon[22174]: pgmap v853: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 96 KiB/s wr, 17 op/s 2024-08-28T19:48:50.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:49 smithi033 ceph-mon[18549]: pgmap v853: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 96 KiB/s wr, 17 op/s 2024-08-28T19:48:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:50 smithi059 ceph-mon[22052]: pgmap v854: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 14 op/s 2024-08-28T19:48:51.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:50 smithi122 ceph-mon[22174]: pgmap v854: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 14 op/s 2024-08-28T19:48:51.129 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:50 smithi033 ceph-mon[18549]: pgmap v854: 129 pgs: 129 active+clean; 29 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 14 op/s 2024-08-28T19:48:53.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:53 smithi059 ceph-mon[22052]: pgmap v855: 129 pgs: 129 active+clean; 30 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 15 op/s 2024-08-28T19:48:53.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:53 smithi122 ceph-mon[22174]: pgmap v855: 129 pgs: 129 active+clean; 30 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 15 op/s 2024-08-28T19:48:53.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:53 smithi033 ceph-mon[18549]: pgmap v855: 129 pgs: 129 active+clean; 30 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 97 KiB/s wr, 15 op/s 2024-08-28T19:48:55.432 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:55 smithi033 ceph-mon[18549]: pgmap v856: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 65 KiB/s wr, 16 op/s 2024-08-28T19:48:55.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:55 smithi059 ceph-mon[22052]: pgmap v856: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 65 KiB/s wr, 16 op/s 2024-08-28T19:48:55.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:55 smithi122 ceph-mon[22174]: pgmap v856: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 65 KiB/s wr, 16 op/s 2024-08-28T19:48:57.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:57 smithi059 ceph-mon[22052]: pgmap v857: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 14 op/s 2024-08-28T19:48:57.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:57 smithi122 ceph-mon[22174]: pgmap v857: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 14 op/s 2024-08-28T19:48:57.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:57 smithi033 ceph-mon[18549]: pgmap v857: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 14 op/s 2024-08-28T19:48:59.220 INFO:tasks.workunit.client.0.smithi033.stdout:561/600: open fd = 3 2024-08-28T19:48:59.220 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.220 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.220 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.220 INFO:tasks.workunit.client.0.smithi033.stdout:562/600: open fd = 3 2024-08-28T19:48:59.220 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.220 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.220 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.220 INFO:tasks.workunit.client.0.smithi033.stdout:563/600: open fd = 3 2024-08-28T19:48:59.220 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:564/600: open fd = 3 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:565/600: open fd = 3 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:566/600: open fd = 3 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.221 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:567/600: open fd = 3 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:568/600: open fd = 3 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:569/600: open fd = 3 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.222 INFO:tasks.workunit.client.0.smithi033.stdout:570/600: open fd = 3 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:571/600: open fd = 3 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:572/600: open fd = 3 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:573/600: open fd = 3 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.223 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:574/600: open fd = 3 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:575/600: open fd = 3 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:576/600: open fd = 3 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.224 INFO:tasks.workunit.client.0.smithi033.stdout:577/600: open fd = 3 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:578/600: open fd = 3 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:579/600: open fd = 3 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:580/600: open fd = 3 2024-08-28T19:48:59.225 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:581/600: open fd = 3 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:582/600: open fd = 3 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:583/600: open fd = 3 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.226 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:584/600: open fd = 3 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:585/600: open fd = 3 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:586/600: open fd = 3 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:587/600: open fd = 3 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.227 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:588/600: open fd = 3 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:589/600: open fd = 3 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:590/600: open fd = 3 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.228 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:591/600: open fd = 3 2024-08-28T19:48:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:592/600: open fd = 3 2024-08-28T19:48:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.229 INFO:tasks.workunit.client.0.smithi033.stdout:593/600: open fd = 3 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:594/600: open fd = 3 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:595/600: open fd = 3 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:596/600: open fd = 3 2024-08-28T19:48:59.230 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:597/600: open fd = 3 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:598/600: open fd = 3 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:599/600: open fd = 3 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.231 INFO:tasks.workunit.client.0.smithi033.stdout:600/600: open fd = 3 2024-08-28T19:48:59.232 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.232 INFO:tasks.workunit.client.0.smithi033.stdout:write ret = 32 2024-08-28T19:48:59.232 INFO:tasks.workunit.client.0.smithi033.stdout:pread ret = 64 2024-08-28T19:48:59.232 INFO:tasks.workunit.client.0.smithi033.stderr:+ echo OK 2024-08-28T19:48:59.233 INFO:tasks.workunit.client.0.smithi033.stdout:OK 2024-08-28T19:48:59.234 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-28T19:48:59.234 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-28T19:48:59.282 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-08-28T19:48:59.282 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-28T19:48:59.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:48:59 smithi059 ceph-mon[22052]: pgmap v858: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 100 KiB/s wr, 18 op/s 2024-08-28T19:48:59.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:48:59 smithi122 ceph-mon[22174]: pgmap v858: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 100 KiB/s wr, 18 op/s 2024-08-28T19:48:59.576 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:48:59 smithi033 ceph-mon[18549]: pgmap v858: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 100 KiB/s wr, 18 op/s 2024-08-28T19:48:59.577 DEBUG:teuthology.parallel:result is None 2024-08-28T19:48:59.577 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-28T19:48:59.614 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-28T19:48:59.615 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-08-28T19:48:59.627 INFO:tasks.quiescer:joining Quiescers 2024-08-28T19:48:59.627 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-08-28T19:48:59.627 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:48:59.907 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:00.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.464+0000 7ffb80cfd640 1 -- 172.21.15.33:0/123566190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb7c108ac0 msgr2=0x7ffb7c10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:00.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.464+0000 7ffb80cfd640 1 --2- 172.21.15.33:0/123566190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb7c108ac0 0x7ffb7c10f2f0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009ca0 tx=0x7ffb7402a8c0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.464+0000 7ffb80cfd640 1 -- 172.21.15.33:0/123566190 shutdown_connections 2024-08-28T19:49:00.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.464+0000 7ffb80cfd640 1 --2- 172.21.15.33:0/123566190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb7c108ac0 0x7ffb7c10f2f0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.464+0000 7ffb80cfd640 1 --2- 172.21.15.33:0/123566190 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb7c108170 0x7ffb7c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.464+0000 7ffb80cfd640 1 --2- 172.21.15.33:0/123566190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb7c102880 0x7ffb7c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.464+0000 7ffb80cfd640 1 -- 172.21.15.33:0/123566190 >> 172.21.15.33:0/123566190 conn(0x7ffb7c079500 msgr2=0x7ffb7c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:00.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.464+0000 7ffb80cfd640 1 -- 172.21.15.33:0/123566190 shutdown_connections 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.464+0000 7ffb80cfd640 1 -- 172.21.15.33:0/123566190 wait complete. 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.465+0000 7ffb80cfd640 1 Processor -- start 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.465+0000 7ffb80cfd640 1 -- start start 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb80cfd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb7c102880 0x7ffb7c1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb80cfd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb7c108170 0x7ffb7c199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb80cfd640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb7c108ac0 0x7ffb7c19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb80cfd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c112720 con 0x7ffb7c108170 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb80cfd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c1125a0 con 0x7ffb7c102880 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb80cfd640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c1128a0 con 0x7ffb7c108ac0 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb79d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb7c108170 0x7ffb7c199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb79d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb7c108170 0x7ffb7c199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39550/0 (socket says 172.21.15.33:39550) 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb79d9b640 1 -- 172.21.15.33:0/3475300139 learned_addr learned my addr 172.21.15.33:0/3475300139 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb7ad9d640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb7c108ac0 0x7ffb7c19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb7a59c640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb7c102880 0x7ffb7c1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb79d9b640 1 -- 172.21.15.33:0/3475300139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb7c108ac0 msgr2=0x7ffb7c19e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb79d9b640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb7c108ac0 0x7ffb7c19e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb79d9b640 1 -- 172.21.15.33:0/3475300139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb7c102880 msgr2=0x7ffb7c1990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb79d9b640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb7c102880 0x7ffb7c1990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb79d9b640 1 -- 172.21.15.33:0/3475300139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c19f020 con 0x7ffb7c108170 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb79d9b640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb7c108170 0x7ffb7c199650 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7ffb70005fd0 tx=0x7ffb7000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.466+0000 7ffb6b7fe640 1 -- 172.21.15.33:0/3475300139 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70017070 con 0x7ffb7c108170 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.467+0000 7ffb6b7fe640 1 -- 172.21.15.33:0/3475300139 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb70009c30 con 0x7ffb7c108170 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.467+0000 7ffb80cfd640 1 -- 172.21.15.33:0/3475300139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c19f310 con 0x7ffb7c108170 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.467+0000 7ffb6b7fe640 1 -- 172.21.15.33:0/3475300139 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70003d30 con 0x7ffb7c108170 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.467+0000 7ffb80cfd640 1 -- 172.21.15.33:0/3475300139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c1a5a70 con 0x7ffb7c108170 2024-08-28T19:49:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.468+0000 7ffb80cfd640 1 -- 172.21.15.33:0/3475300139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7c103ab0 con 0x7ffb7c108170 2024-08-28T19:49:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.469+0000 7ffb6b7fe640 1 -- 172.21.15.33:0/3475300139 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ffb70003ed0 con 0x7ffb7c108170 2024-08-28T19:49:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.470+0000 7ffb6b7fe640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb640b4ca0 0x7ffb640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.470+0000 7ffb6b7fe640 1 -- 172.21.15.33:0/3475300139 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7ffb700e5ca0 con 0x7ffb7c108170 2024-08-28T19:49:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.470+0000 7ffb7a59c640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb640b4ca0 0x7ffb640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.471+0000 7ffb7a59c640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb640b4ca0 0x7ffb640b71b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c005d00 tx=0x7ffb6c005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.473+0000 7ffb6b7fe640 1 -- 172.21.15.33:0/3475300139 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffb70020030 con 0x7ffb7c108170 2024-08-28T19:49:00.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.697+0000 7ffb80cfd640 1 -- 172.21.15.33:0/3475300139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb7c102c90 con 0x7ffb7c108170 2024-08-28T19:49:00.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.698+0000 7ffb6b7fe640 1 -- 172.21.15.33:0/3475300139 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7ffb700ac6f0 con 0x7ffb7c108170 2024-08-28T19:49:00.699 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:49:00.699 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:49:00.699 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:49:00.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 -- 172.21.15.33:0/3475300139 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb640b4ca0 msgr2=0x7ffb640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:00.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb640b4ca0 0x7ffb640b71b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c005d00 tx=0x7ffb6c005c50 comp rx=0 tx=0).stop 2024-08-28T19:49:00.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 -- 172.21.15.33:0/3475300139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb7c108170 msgr2=0x7ffb7c199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:00.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb7c108170 0x7ffb7c199650 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7ffb70005fd0 tx=0x7ffb7000dde0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 -- 172.21.15.33:0/3475300139 shutdown_connections 2024-08-28T19:49:00.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ffb640b4ca0 0x7ffb640b71b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb7c108ac0 0x7ffb7c19e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb7c108170 0x7ffb7c199650 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 --2- 172.21.15.33:0/3475300139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb7c102880 0x7ffb7c1990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:00.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 -- 172.21.15.33:0/3475300139 >> 172.21.15.33:0/3475300139 conn(0x7ffb7c079500 msgr2=0x7ffb7c104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:00.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 -- 172.21.15.33:0/3475300139 shutdown_connections 2024-08-28T19:49:00.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:00.700+0000 7ffb80cfd640 1 -- 172.21.15.33:0/3475300139 wait complete. 2024-08-28T19:49:01.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:01 smithi033 ceph-mon[18549]: pgmap v859: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 14 op/s 2024-08-28T19:49:01.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:01 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3475300139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:01.465 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24658 quiesce db --cancel --all' 2024-08-28T19:49:01.465 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24658 quiesce db --cancel --all 2024-08-28T19:49:01.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:01 smithi059 ceph-mon[22052]: pgmap v859: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 14 op/s 2024-08-28T19:49:01.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:01 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3475300139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:01.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:01 smithi122 ceph-mon[22174]: pgmap v859: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 14 op/s 2024-08-28T19:49:01.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:01 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3475300139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:02.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.278+0000 7f2e55c8d640 1 -- 172.21.15.33:0/664935941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e50102fb0 msgr2=0x7f2e501033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.278+0000 7f2e55c8d640 1 --2- 172.21.15.33:0/664935941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e50102fb0 0x7f2e501033c0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009900 tx=0x7f2e4002a410 comp rx=0 tx=0).stop 2024-08-28T19:49:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.278+0000 7f2e55c8d640 1 -- 172.21.15.33:0/664935941 shutdown_connections 2024-08-28T19:49:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.278+0000 7f2e55c8d640 1 --2- 172.21.15.33:0/664935941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e501058d0 0x7f2e5010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.278+0000 7f2e55c8d640 1 --2- 172.21.15.33:0/664935941 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e50104f80 0x7f2e50105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.278+0000 7f2e55c8d640 1 --2- 172.21.15.33:0/664935941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e50102fb0 0x7f2e501033c0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.278+0000 7f2e55c8d640 1 -- 172.21.15.33:0/664935941 >> 172.21.15.33:0/664935941 conn(0x7f2e50079d30 msgr2=0x7f2e5007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:02.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.278+0000 7f2e55c8d640 1 -- 172.21.15.33:0/664935941 shutdown_connections 2024-08-28T19:49:02.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.278+0000 7f2e55c8d640 1 -- 172.21.15.33:0/664935941 wait complete. 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.279+0000 7f2e55c8d640 1 Processor -- start 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.279+0000 7f2e55c8d640 1 -- start start 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e55c8d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e50102fb0 0x7f2e5019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e55c8d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e50104f80 0x7f2e5019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e55c8d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e501058d0 0x7f2e5019fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e55c8d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2e50112770 con 0x7f2e501058d0 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e55c8d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501125f0 con 0x7f2e50102fb0 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e55c8d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501128f0 con 0x7f2e50104f80 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e4ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e501058d0 0x7f2e5019fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e4ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e501058d0 0x7f2e5019fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39556/0 (socket says 172.21.15.33:39556) 2024-08-28T19:49:02.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e4ffff640 1 -- 172.21.15.33:0/32123719 learned_addr learned my addr 172.21.15.33:0/32123719 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e50102fb0 0x7f2e5019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e50104f80 0x7f2e5019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e4ffff640 1 -- 172.21.15.33:0/32123719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e50104f80 msgr2=0x7f2e5019a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e4ffff640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e50104f80 0x7f2e5019a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e4ffff640 1 -- 172.21.15.33:0/32123719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e50102fb0 msgr2=0x7f2e5019a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e4ffff640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e50102fb0 0x7f2e5019a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e4ffff640 1 -- 172.21.15.33:0/32123719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e501a01c0 con 0x7f2e501058d0 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e50104f80 0x7f2e5019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.280+0000 7f2e4ffff640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e501058d0 0x7f2e5019fa90 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800cad0 tx=0x7f2e4800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.281+0000 7f2e4d7fa640 1 -- 172.21.15.33:0/32123719 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800ae20 con 0x7f2e501058d0 2024-08-28T19:49:02.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.281+0000 7f2e4d7fa640 1 -- 172.21.15.33:0/32123719 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e48005020 con 0x7f2e501058d0 2024-08-28T19:49:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.281+0000 7f2e55c8d640 1 -- 172.21.15.33:0/32123719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e501a04b0 con 0x7f2e501058d0 2024-08-28T19:49:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.281+0000 7f2e4d7fa640 1 -- 172.21.15.33:0/32123719 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800f6b0 con 0x7f2e501058d0 2024-08-28T19:49:02.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.281+0000 7f2e55c8d640 1 -- 172.21.15.33:0/32123719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e501a6c10 con 0x7f2e501058d0 2024-08-28T19:49:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.283+0000 7f2e5c202740 1 Processor -- start 2024-08-28T19:49:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.284+0000 7f2e4d7fa640 1 -- 172.21.15.33:0/32123719 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2e480051d0 con 0x7f2e501058d0 2024-08-28T19:49:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.284+0000 7f2e5c202740 1 -- start start 2024-08-28T19:49:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.284+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa23ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.284+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 0x55f5aa23b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.284+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa23b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.284+0000 7f2e5c202740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f5aa1b1610 con 0x55f5a9e745f0 2024-08-28T19:49:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.284+0000 7f2e5c202740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f5aa1a0ba0 con 0x55f5a9e6c410 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.284+0000 7f2e5c202740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f5aa1a4b50 con 0x55f5a9e952d0 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa23b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa23b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39566/0 (socket says 172.21.15.33:39566) 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e46ffd640 1 -- 172.21.15.33:0/55184544 learned_addr learned my addr 172.21.15.33:0/55184544 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/55184544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa23ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/55184544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 0x55f5aa23b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e4d7fa640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2e3c0b4ca0 0x7f2e3c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e46ffd640 1 -- 172.21.15.33:0/55184544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 msgr2=0x55f5aa23ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/55184544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa23ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e46ffd640 1 -- 172.21.15.33:0/55184544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 msgr2=0x55f5aa23b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/55184544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 0x55f5aa23b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e46ffd640 1 -- 172.21.15.33:0/55184544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5a9f008b0 con 0x55f5a9e745f0 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e4d7fa640 1 -- 172.21.15.33:0/32123719 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f2e480e5890 con 0x7f2e501058d0 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e4ffff640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2e3c0b4ca0 0x7f2e3c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/55184544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa23b780 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f2e380138d0 tx=0x7f2e3800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbf5c2031770a13 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.285+0000 7f2e45ffb640 1 -- 172.21.15.33:0/55184544 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800e8f0 con 0x55f5a9e745f0 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.286+0000 7f2e45ffb640 1 -- 172.21.15.33:0/55184544 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e38013e50 con 0x55f5a9e745f0 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.286+0000 7f2e45ffb640 1 -- 172.21.15.33:0/55184544 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3801ebd0 con 0x55f5a9e745f0 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.286+0000 7f2e5c202740 1 -- 172.21.15.33:0/55184544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 msgr2=0x55f5aa23b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.286+0000 7f2e4ffff640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2e3c0b4ca0 0x7f2e3c0b71b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800a6e0 tx=0x7f2e48093040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.286+0000 7f2e5c202740 1 --2- 172.21.15.33:0/55184544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa23b780 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f2e380138d0 tx=0x7f2e3800b480 comp rx=0 tx=0).stop 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.287+0000 7f2e5c202740 1 -- 172.21.15.33:0/55184544 shutdown_connections 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.287+0000 7f2e5c202740 1 --2- 172.21.15.33:0/55184544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa23b780 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.287+0000 7f2e5c202740 1 --2- 172.21.15.33:0/55184544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 0x55f5aa23b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.287+0000 7f2e5c202740 1 --2- 172.21.15.33:0/55184544 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa23ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.287+0000 7f2e5c202740 1 -- 172.21.15.33:0/55184544 >> 172.21.15.33:0/55184544 conn(0x55f5a9e896c0 msgr2=0x55f5aa238bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.287+0000 7f2e5c202740 1 -- 172.21.15.33:0/55184544 shutdown_connections 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.287+0000 7f2e5c202740 1 -- 172.21.15.33:0/55184544 wait complete. 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.287+0000 7f2e5c202740 1 -- start start 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.287+0000 7f2e5c202740 1 Processor -- start 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e6c410 0x55f5aa246870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e745f0 0x55f5aa246db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e952d0 0x55f5aa252800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e5c202740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55f5aa003810 con 0x55f5a9e952d0 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e5c202740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f5aa127960 con 0x55f5a9e745f0 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e5c202740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55f5aa2494e0 con 0x55f5a9e6c410 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e5c202740 10 client.0 _ll_register_callbacks cb 0x55f5a9eacb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e952d0 0x55f5aa252800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e952d0 0x55f5aa252800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39570/0 (socket says 172.21.15.33:39570) 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e46ffd640 1 -- 172.21.15.33:0/2848501350 learned_addr learned my addr 172.21.15.33:0/2848501350 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e6c410 0x55f5aa246870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e745f0 0x55f5aa246db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e46ffd640 1 -- 172.21.15.33:0/2848501350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e6c410 msgr2=0x55f5aa246870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e6c410 0x55f5aa246870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e46ffd640 1 -- 172.21.15.33:0/2848501350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e745f0 msgr2=0x55f5aa246db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e745f0 0x55f5aa246db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e46ffd640 1 -- 172.21.15.33:0/2848501350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5aa252d90 con 0x55f5a9e952d0 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e952d0 0x55f5aa252800 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x55f5aa248ec0 tx=0x7f2e38022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1048370aa90a9ae3 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e2effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e2effd640 1 -- 172.21.15.33:0/2848501350 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3801eb60 con 0x55f5a9e952d0 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.288+0000 7f2e2effd640 1 -- 172.21.15.33:0/2848501350 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f2e38029040 con 0x55f5a9e952d0 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e5c202740 1 -- 172.21.15.33:0/2848501350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e38013e50 con 0x55f5a9e952d0 2024-08-28T19:49:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e2effd640 1 -- 172.21.15.33:0/2848501350 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2e3801ed00 con 0x55f5a9e952d0 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e5c202740 10 client.19929 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e5c202740 1 -- 172.21.15.33:0/2848501350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f5aa2556a0 con 0x55f5a9e952d0 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e2effd640 1 -- 172.21.15.33:0/2848501350 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e38013e50 con 0x55f5a9e952d0 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e2effd640 1 -- 172.21.15.33:0/2848501350 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2e3800f040 con 0x55f5a9e952d0 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e5c202740 10 client.19929 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e5c202740 10 client.19929 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e5c202740 20 client.19929 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e5c202740 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f5a9e53c50 0x55f5aa258ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e5c202740 4 client.19929 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e5c202740 1 -- 172.21.15.33:0/2848501350 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5aa1b3560 con 0x55f5a9e53c50 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.289+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f5a9e53c50 0x55f5aa258ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.290+0000 7f2e2effd640 10 client.19929 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.290+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f5a9e53c50 0x55f5aa258ab0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3168248692fd969 server_cookie=81bb2888c5d9e192 in_seq=0 out_seq=0 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e2effd640 1 -- 172.21.15.33:0/2848501350 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f5aa1b3560 con 0x55f5a9e53c50 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e2effd640 10 client.19929 handle_command_reply: tid=0 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 client.19929 shutdown 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 -- 172.21.15.33:0/2848501350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e952d0 msgr2=0x55f5aa252800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e952d0 0x55f5aa252800 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x55f5aa248ec0 tx=0x7f2e38022040 comp rx=0 tx=0).stop 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 -- 172.21.15.33:0/2848501350 shutdown_connections 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f5a9e53c50 0x55f5aa258ab0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e952d0 0x55f5aa252800 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e745f0 0x55f5aa246db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e2effd640 0 client.19929 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 --2- 172.21.15.33:0/2848501350 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e6c410 0x55f5aa246870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 -- 172.21.15.33:0/2848501350 >> 172.21.15.33:0/2848501350 conn(0x55f5a9e896c0 msgr2=0x55f5aa23de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:02.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 -- 172.21.15.33:0/2848501350 shutdown_connections 2024-08-28T19:49:02.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 1 -- 172.21.15.33:0/2848501350 wait complete. 2024-08-28T19:49:02.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.291+0000 7f2e5c202740 20 client.19929 trim_cache size 0 max 16384 2024-08-28T19:49:02.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.308+0000 7f2e5c202740 1 Processor -- start 2024-08-28T19:49:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e5c202740 1 -- start start 2024-08-28T19:49:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 0x55f5aa23fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa2402d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa23ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e5c202740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501b0d30 con 0x55f5a9e745f0 2024-08-28T19:49:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e5c202740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501b2870 con 0x55f5a9e6c410 2024-08-28T19:49:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e5c202740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501b1400 con 0x55f5a9e952d0 2024-08-28T19:49:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e4f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa2402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e4f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa2402d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39580/0 (socket says 172.21.15.33:39580) 2024-08-28T19:49:02.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e4f7fe640 1 -- 172.21.15.33:0/2159632561 learned_addr learned my addr 172.21.15.33:0/2159632561 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/2159632561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 0x55f5aa23fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/2159632561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa23ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e4f7fe640 1 -- 172.21.15.33:0/2159632561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 msgr2=0x55f5aa23ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/2159632561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa23ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e4f7fe640 1 -- 172.21.15.33:0/2159632561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 msgr2=0x55f5aa23fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/2159632561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 0x55f5aa23fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e4f7fe640 1 -- 172.21.15.33:0/2159632561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5aa2455d0 con 0x55f5a9e745f0 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/2159632561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 0x55f5aa23fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.309+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/2159632561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa2402d0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009900 tx=0x7f2e40005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b4db2d067114b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e457fa640 1 -- 172.21.15.33:0/2159632561 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40035040 con 0x55f5a9e745f0 2024-08-28T19:49:02.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e457fa640 1 -- 172.21.15.33:0/2159632561 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e400054f0 con 0x55f5a9e745f0 2024-08-28T19:49:02.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e457fa640 1 -- 172.21.15.33:0/2159632561 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40003850 con 0x55f5a9e745f0 2024-08-28T19:49:02.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e5c202740 1 -- 172.21.15.33:0/2159632561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 msgr2=0x55f5aa2402d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e5c202740 1 --2- 172.21.15.33:0/2159632561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa2402d0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009900 tx=0x7f2e40005f10 comp rx=0 tx=0).stop 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e5c202740 1 -- 172.21.15.33:0/2159632561 shutdown_connections 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e5c202740 1 --2- 172.21.15.33:0/2159632561 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa23ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e5c202740 1 --2- 172.21.15.33:0/2159632561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e745f0 0x55f5aa2402d0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e5c202740 1 --2- 172.21.15.33:0/2159632561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e6c410 0x55f5aa23fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e5c202740 1 -- 172.21.15.33:0/2159632561 >> 172.21.15.33:0/2159632561 conn(0x55f5a9e896c0 msgr2=0x55f5aa246870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.310+0000 7f2e5c202740 1 -- 172.21.15.33:0/2159632561 shutdown_connections 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.311+0000 7f2e5c202740 1 -- 172.21.15.33:0/2159632561 wait complete. 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.311+0000 7f2e5c202740 1 -- start start 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.311+0000 7f2e5c202740 1 Processor -- start 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.311+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e6c410 0x55f5aa259dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e745f0 0x55f5aa25a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e5c202740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa2c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e5c202740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501b21a0 con 0x55f5a9e6c410 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e5c202740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501b1ad0 con 0x55f5a9e745f0 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e5c202740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501aed30 con 0x55f5a9e952d0 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e5c202740 10 client.0 _ll_register_callbacks cb 0x7f2e3800bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e6c410 0x55f5aa259dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e6c410 0x55f5aa259dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39584/0 (socket says 172.21.15.33:39584) 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e46ffd640 1 -- 172.21.15.33:0/3363129272 learned_addr learned my addr 172.21.15.33:0/3363129272 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa2c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e745f0 0x55f5aa25a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e46ffd640 1 -- 172.21.15.33:0/3363129272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 msgr2=0x55f5aa2c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa2c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e46ffd640 1 -- 172.21.15.33:0/3363129272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e745f0 msgr2=0x55f5aa25a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e745f0 0x55f5aa25a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e46ffd640 1 -- 172.21.15.33:0/3363129272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5aa25ab90 con 0x55f5a9e6c410 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e46ffd640 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e6c410 0x55f5aa259dd0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f2e38021040 tx=0x7f2e38022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91d09d3de6f1e5a server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e2effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e2effd640 1 -- 172.21.15.33:0/3363129272 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800b900 con 0x55f5a9e6c410 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e2effd640 1 -- 172.21.15.33:0/3363129272 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f2e3800e6c0 con 0x55f5a9e6c410 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.312+0000 7f2e5c202740 1 -- 172.21.15.33:0/3363129272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e400054f0 con 0x55f5a9e6c410 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e2effd640 1 -- 172.21.15.33:0/3363129272 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2e3801e550 con 0x55f5a9e6c410 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e5c202740 10 client.19935 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e5c202740 1 -- 172.21.15.33:0/3363129272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f5aa2c37f0 con 0x55f5a9e6c410 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e2effd640 1 -- 172.21.15.33:0/3363129272 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e400054f0 con 0x55f5a9e6c410 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e2effd640 1 -- 172.21.15.33:0/3363129272 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2e380399a0 con 0x55f5a9e6c410 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e5c202740 10 client.19935 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:02.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e5c202740 10 client.19935 resolve_mds: validated gid 24658 aka daemon mds.i 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e5c202740 20 client.19935 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e5c202740 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f5a9e29000 0x55f5aa2c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e5c202740 4 client.19935 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e5c202740 1 -- 172.21.15.33:0/3363129272 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55f5aa1af000 con 0x55f5a9e29000 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.313+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f5a9e29000 0x55f5aa2c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e2effd640 10 client.19935 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e4f7fe640 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f5a9e29000 0x55f5aa2c5fe0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df8e2a9d5eea5fd4 server_cookie=e2f07c3ea91ba07c in_seq=0 out_seq=0 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e2effd640 1 -- 172.21.15.33:0/3363129272 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55f5aa1af000 con 0x55f5a9e29000 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e2effd640 10 client.19935 handle_command_reply: tid=0 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e5c202740 1 client.19935 shutdown 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e5c202740 1 -- 172.21.15.33:0/3363129272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e6c410 msgr2=0x55f5aa259dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:02.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e5c202740 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e6c410 0x55f5aa259dd0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f2e38021040 tx=0x7f2e38022040 comp rx=0 tx=0).stop 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e5c202740 1 -- 172.21.15.33:0/3363129272 shutdown_connections 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e5c202740 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f5a9e952d0 0x55f5aa2c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e5c202740 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f5a9e745f0 0x55f5aa25a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e5c202740 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55f5a9e29000 0x55f5aa2c5fe0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e5c202740 1 --2- 172.21.15.33:0/3363129272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55f5a9e6c410 0x55f5aa259dd0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e5c202740 1 -- 172.21.15.33:0/3363129272 >> 172.21.15.33:0/3363129272 conn(0x55f5a9e896c0 msgr2=0x55f5aa23dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.314+0000 7f2e2effd640 0 client.19935 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e5c202740 1 -- 172.21.15.33:0/3363129272 shutdown_connections 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e5c202740 1 -- 172.21.15.33:0/3363129272 wait complete. 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e5c202740 20 client.19935 trim_cache size 0 max 16384 2024-08-28T19:49:02.321 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:49:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 28, 2024-08-28T19:49:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: "leader": 24658, 2024-08-28T19:49:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: "set_version": 52, 2024-08-28T19:49:02.322 INFO:teuthology.orchestra.run.smithi033.stdout: "sets": {} 2024-08-28T19:49:02.322 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:49:02.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 -- 172.21.15.33:0/32123719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2e3c0b4ca0 msgr2=0x7f2e3c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:02.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2e3c0b4ca0 0x7f2e3c0b71b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800a6e0 tx=0x7f2e48093040 comp rx=0 tx=0).stop 2024-08-28T19:49:02.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 -- 172.21.15.33:0/32123719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e501058d0 msgr2=0x7f2e5019fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:02.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e501058d0 0x7f2e5019fa90 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800cad0 tx=0x7f2e4800cf90 comp rx=0 tx=0).stop 2024-08-28T19:49:02.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 -- 172.21.15.33:0/32123719 shutdown_connections 2024-08-28T19:49:02.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e501058d0 0x7f2e5019fa90 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2e3c0b4ca0 0x7f2e3c0b71b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2e50104f80 0x7f2e5019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 --2- 172.21.15.33:0/32123719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e50102fb0 0x7f2e5019a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:02.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 -- 172.21.15.33:0/32123719 >> 172.21.15.33:0/32123719 conn(0x7f2e50079d30 msgr2=0x7f2e50107270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:02.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 -- 172.21.15.33:0/32123719 shutdown_connections 2024-08-28T19:49:02.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:02.315+0000 7f2e55c8d640 1 -- 172.21.15.33:0/32123719 wait complete. 2024-08-28T19:49:03.106 INFO:tasks.quiescer:done joining Quiescers 2024-08-28T19:49:03.106 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-08-28T19:49:03.116 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-08-28T19:49:03.116 INFO:teuthology.task.exec:Executing custom commands... 2024-08-28T19:49:03.117 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-08-28T19:49:03.117 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-08-28T19:49:03.147 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-08-28T19:49:03.216 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-28T19:49:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.371+0000 7f40a1ebb640 1 -- 172.21.15.33:0/3948830938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c105020 msgr2=0x7f409c10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.371+0000 7f40a1ebb640 1 --2- 172.21.15.33:0/3948830938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c105020 0x7f409c10d560 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f4084009900 tx=0x7f408402a410 comp rx=0 tx=0).stop 2024-08-28T19:49:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.371+0000 7f40a1ebb640 1 -- 172.21.15.33:0/3948830938 shutdown_connections 2024-08-28T19:49:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.371+0000 7f40a1ebb640 1 --2- 172.21.15.33:0/3948830938 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f409c10db30 0x7f409c110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.371+0000 7f40a1ebb640 1 --2- 172.21.15.33:0/3948830938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c105020 0x7f409c10d560 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.371+0000 7f40a1ebb640 1 --2- 172.21.15.33:0/3948830938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f409c1046d0 0x7f409c104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.371+0000 7f40a1ebb640 1 -- 172.21.15.33:0/3948830938 >> 172.21.15.33:0/3948830938 conn(0x7f409c0fe160 msgr2=0x7f409c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.371+0000 7f40a1ebb640 1 -- 172.21.15.33:0/3948830938 shutdown_connections 2024-08-28T19:49:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.371+0000 7f40a1ebb640 1 -- 172.21.15.33:0/3948830938 wait complete. 2024-08-28T19:49:03.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.371+0000 7f40a1ebb640 1 Processor -- start 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f40a1ebb640 1 -- start start 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f40a1ebb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f409c1046d0 0x7f409c102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f40a1ebb640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f409c105020 0x7f409c102940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f40a1ebb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c10db30 0x7f409c102e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f40a1ebb640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f409c113790 con 0x7f409c10db30 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f40a1ebb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f409c113610 con 0x7f409c1046d0 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f40a1ebb640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f409c113910 con 0x7f409c105020 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f409bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c10db30 0x7f409c102e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f409bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c10db30 0x7f409c102e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39598/0 (socket says 172.21.15.33:39598) 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f409bfff640 1 -- 172.21.15.33:0/2435120639 learned_addr learned my addr 172.21.15.33:0/2435120639 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f4093fff640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f409c105020 0x7f409c102940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f409b7fe640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f409c1046d0 0x7f409c102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f409bfff640 1 -- 172.21.15.33:0/2435120639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f409c105020 msgr2=0x7f409c102940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:03.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f409bfff640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f409c105020 0x7f409c102940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f409bfff640 1 -- 172.21.15.33:0/2435120639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f409c1046d0 msgr2=0x7f409c102400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f409bfff640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f409c1046d0 0x7f409c102400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.372+0000 7f409bfff640 1 -- 172.21.15.33:0/2435120639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c1a8560 con 0x7f409c10db30 2024-08-28T19:49:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.373+0000 7f409bfff640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c10db30 0x7f409c102e80 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f409400cad0 tx=0x7f409400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.373+0000 7f40997fa640 1 -- 172.21.15.33:0/2435120639 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409400ae20 con 0x7f409c10db30 2024-08-28T19:49:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.373+0000 7f40997fa640 1 -- 172.21.15.33:0/2435120639 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4094005020 con 0x7f409c10db30 2024-08-28T19:49:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.373+0000 7f40997fa640 1 -- 172.21.15.33:0/2435120639 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409400f6b0 con 0x7f409c10db30 2024-08-28T19:49:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.373+0000 7f40a1ebb640 1 -- 172.21.15.33:0/2435120639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409c1a8850 con 0x7f409c10db30 2024-08-28T19:49:03.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.373+0000 7f40a1ebb640 1 -- 172.21.15.33:0/2435120639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f409c1a8d70 con 0x7f409c10db30 2024-08-28T19:49:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.374+0000 7f40a1ebb640 1 -- 172.21.15.33:0/2435120639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409c06be40 con 0x7f409c10db30 2024-08-28T19:49:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.375+0000 7f40997fa640 1 -- 172.21.15.33:0/2435120639 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f40940051d0 con 0x7f409c10db30 2024-08-28T19:49:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.376+0000 7f40997fa640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40880b4cd0 0x7f40880b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.376+0000 7f409b7fe640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40880b4cd0 0x7f40880b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.376+0000 7f40997fa640 1 -- 172.21.15.33:0/2435120639 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f40940e5770 con 0x7f409c10db30 2024-08-28T19:49:03.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.377+0000 7f409b7fe640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40880b4cd0 0x7f40880b71e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f409c103e50 tx=0x7f408c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:03.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:03 smithi033 ceph-mon[18549]: pgmap v860: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 90 KiB/s wr, 16 op/s 2024-08-28T19:49:03.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.380+0000 7f40997fa640 1 -- 172.21.15.33:0/2435120639 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4094014030 con 0x7f409c10db30 2024-08-28T19:49:03.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:03 smithi059 ceph-mon[22052]: pgmap v860: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 90 KiB/s wr, 16 op/s 2024-08-28T19:49:03.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:03 smithi122 ceph-mon[22174]: pgmap v860: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 90 KiB/s wr, 16 op/s 2024-08-28T19:49:03.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.587+0000 7f40a1ebb640 1 -- 172.21.15.33:0/2435120639 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f409c107d50 con 0x7f40880b4cd0 2024-08-28T19:49:03.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.595+0000 7f40997fa640 1 -- 172.21.15.33:0/2435120639 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f409c107d50 con 0x7f40880b4cd0 2024-08-28T19:49:03.596 INFO:teuthology.orchestra.run.smithi033.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-28T00:00:00", "created": "2024-08-28T19:32:32", "first": "2024-08-28T19:33:00", "last": "2024-08-28T19:49:00", "last_pruned": "2024-08-28T19:49:00", "created_count": 17, "pruned_count": 11, "active": true} 2024-08-28T19:49:03.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 -- 172.21.15.33:0/2435120639 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40880b4cd0 msgr2=0x7f40880b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:03.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40880b4cd0 0x7f40880b71e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f409c103e50 tx=0x7f408c00b390 comp rx=0 tx=0).stop 2024-08-28T19:49:03.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 -- 172.21.15.33:0/2435120639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c10db30 msgr2=0x7f409c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:03.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c10db30 0x7f409c102e80 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f409400cad0 tx=0x7f409400cf90 comp rx=0 tx=0).stop 2024-08-28T19:49:03.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 -- 172.21.15.33:0/2435120639 shutdown_connections 2024-08-28T19:49:03.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c10db30 0x7f409c102e80 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f40880b4cd0 0x7f40880b71e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f409c105020 0x7f409c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 --2- 172.21.15.33:0/2435120639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f409c1046d0 0x7f409c102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 -- 172.21.15.33:0/2435120639 >> 172.21.15.33:0/2435120639 conn(0x7f409c0fe160 msgr2=0x7f409c107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 -- 172.21.15.33:0/2435120639 shutdown_connections 2024-08-28T19:49:03.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.598+0000 7f40a1ebb640 1 -- 172.21.15.33:0/2435120639 wait complete. 2024-08-28T19:49:03.610 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-28T19:49:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.722+0000 7fd925f68640 1 -- 172.21.15.33:0/583252645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd920104730 msgr2=0x7fd920104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.722+0000 7fd925f68640 1 --2- 172.21.15.33:0/583252645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd920104730 0x7fd920104b40 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fd910009900 tx=0x7fd91002a410 comp rx=0 tx=0).stop 2024-08-28T19:49:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.722+0000 7fd925f68640 1 -- 172.21.15.33:0/583252645 shutdown_connections 2024-08-28T19:49:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.722+0000 7fd925f68640 1 --2- 172.21.15.33:0/583252645 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd92010db50 0x7fd920110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.722+0000 7fd925f68640 1 --2- 172.21.15.33:0/583252645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920105080 0x7fd92010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.722+0000 7fd925f68640 1 --2- 172.21.15.33:0/583252645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd920104730 0x7fd920104b40 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.722+0000 7fd925f68640 1 -- 172.21.15.33:0/583252645 >> 172.21.15.33:0/583252645 conn(0x7fd9200fe160 msgr2=0x7fd9201005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.723+0000 7fd925f68640 1 -- 172.21.15.33:0/583252645 shutdown_connections 2024-08-28T19:49:03.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.723+0000 7fd925f68640 1 -- 172.21.15.33:0/583252645 wait complete. 2024-08-28T19:49:03.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.723+0000 7fd925f68640 1 Processor -- start 2024-08-28T19:49:03.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.723+0000 7fd925f68640 1 -- start start 2024-08-28T19:49:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd925f68640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd920104730 0x7fd92019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd925f68640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920105080 0x7fd92019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd925f68640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92010db50 0x7fd92019fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd925f68640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd920113880 con 0x7fd92010db50 2024-08-28T19:49:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd925f68640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd920113700 con 0x7fd920105080 2024-08-28T19:49:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd925f68640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd920113a00 con 0x7fd920104730 2024-08-28T19:49:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92010db50 0x7fd92019fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92010db50 0x7fd92019fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39630/0 (socket says 172.21.15.33:39630) 2024-08-28T19:49:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91ffff640 1 -- 172.21.15.33:0/408616992 learned_addr learned my addr 172.21.15.33:0/408616992 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91f7fe640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd920104730 0x7fd92019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd916ffd640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920105080 0x7fd92019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91ffff640 1 -- 172.21.15.33:0/408616992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd920104730 msgr2=0x7fd92019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91ffff640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd920104730 0x7fd92019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91ffff640 1 -- 172.21.15.33:0/408616992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920105080 msgr2=0x7fd92019a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91ffff640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920105080 0x7fd92019a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91ffff640 1 -- 172.21.15.33:0/408616992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9201a0270 con 0x7fd92010db50 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91f7fe640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd920104730 0x7fd92019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91ffff640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92010db50 0x7fd92019fb70 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fd91800b970 tx=0x7fd91800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91d7fa640 1 -- 172.21.15.33:0/408616992 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918019070 con 0x7fd92010db50 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91d7fa640 1 -- 172.21.15.33:0/408616992 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd918014440 con 0x7fd92010db50 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd925f68640 1 -- 172.21.15.33:0/408616992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9201a0560 con 0x7fd92010db50 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd91d7fa640 1 -- 172.21.15.33:0/408616992 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9180075d0 con 0x7fd92010db50 2024-08-28T19:49:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.724+0000 7fd925f68640 1 -- 172.21.15.33:0/408616992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9201a6cf0 con 0x7fd92010db50 2024-08-28T19:49:03.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.725+0000 7fd925f68640 1 -- 172.21.15.33:0/408616992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd920104bc0 con 0x7fd92010db50 2024-08-28T19:49:03.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.727+0000 7fd91d7fa640 1 -- 172.21.15.33:0/408616992 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd91801c070 con 0x7fd92010db50 2024-08-28T19:49:03.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.728+0000 7fd91d7fa640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd90c0b4ca0 0x7fd90c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:03.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.728+0000 7fd91f7fe640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd90c0b4ca0 0x7fd90c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:03.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.728+0000 7fd91d7fa640 1 -- 172.21.15.33:0/408616992 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7fd9180e52d0 con 0x7fd92010db50 2024-08-28T19:49:03.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.728+0000 7fd91f7fe640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd90c0b4ca0 0x7fd90c0b71b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd910031440 tx=0x7fd910005d10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:03.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.731+0000 7fd91d7fa640 1 -- 172.21.15.33:0/408616992 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd9180abd20 con 0x7fd92010db50 2024-08-28T19:49:03.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.937+0000 7fd925f68640 1 -- 172.21.15.33:0/408616992 --> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fd920106ce0 con 0x7fd90c0b4ca0 2024-08-28T19:49:03.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.945+0000 7fd91d7fa640 1 -- 172.21.15.33:0/408616992 <== mgr.14223 v2:172.21.15.33:6800/3015249273 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fd920106ce0 con 0x7fd90c0b4ca0 2024-08-28T19:49:03.946 INFO:teuthology.orchestra.run.smithi033.stdout:/ 1m 6m3h 2024-08-28T19:49:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 -- 172.21.15.33:0/408616992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd90c0b4ca0 msgr2=0x7fd90c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd90c0b4ca0 0x7fd90c0b71b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd910031440 tx=0x7fd910005d10 comp rx=0 tx=0).stop 2024-08-28T19:49:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 -- 172.21.15.33:0/408616992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92010db50 msgr2=0x7fd92019fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92010db50 0x7fd92019fb70 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fd91800b970 tx=0x7fd91800be30 comp rx=0 tx=0).stop 2024-08-28T19:49:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 -- 172.21.15.33:0/408616992 shutdown_connections 2024-08-28T19:49:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92010db50 0x7fd92019fb70 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920105080 0x7fd92019a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd90c0b4ca0 0x7fd90c0b71b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 --2- 172.21.15.33:0/408616992 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd920104730 0x7fd92019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 -- 172.21.15.33:0/408616992 >> 172.21.15.33:0/408616992 conn(0x7fd9200fe160 msgr2=0x7fd9201065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:03.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 -- 172.21.15.33:0/408616992 shutdown_connections 2024-08-28T19:49:03.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:03.948+0000 7fd925f68640 1 -- 172.21.15.33:0/408616992 wait complete. 2024-08-28T19:49:03.960 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-28T19:49:03.970 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-28T19:49:04.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:04 smithi033 ceph-mon[18549]: from='client.19941 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:49:04.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:04 smithi059 ceph-mon[22052]: from='client.19941 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:49:04.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:04 smithi122 ceph-mon[22174]: from='client.19941 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:49:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:05 smithi059 ceph-mon[22052]: from='client.19947 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:49:05.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:05 smithi059 ceph-mon[22052]: pgmap v861: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 103 KiB/s wr, 33 op/s 2024-08-28T19:49:05.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:05 smithi122 ceph-mon[22174]: from='client.19947 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:49:05.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:05 smithi122 ceph-mon[22174]: pgmap v861: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 103 KiB/s wr, 33 op/s 2024-08-28T19:49:05.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:05 smithi033 ceph-mon[18549]: from='client.19947 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-28T19:49:05.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:05 smithi033 ceph-mon[18549]: pgmap v861: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 103 KiB/s wr, 33 op/s 2024-08-28T19:49:06.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:49:06.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:49:06.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:49:06.534 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:06 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:49:06.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:49:06.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:49:06.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:06 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:49:06.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-28T19:49:06.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-28T19:49:06.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-28T19:49:06.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-28T19:49:06.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:06 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' 2024-08-28T19:49:07.313 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-28T19:49:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:07 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-08-28T19:49:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:07 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-08-28T19:49:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:07 smithi059 ceph-mon[22052]: Adjusting osd_memory_target on smithi033 to 177.0M 2024-08-28T19:49:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:07 smithi059 ceph-mon[22052]: Unable to set osd_memory_target on smithi122 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-08-28T19:49:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:07 smithi059 ceph-mon[22052]: Unable to set osd_memory_target on smithi059 to 185701376: error parsing value: Value '185701376' is below minimum 939524096 2024-08-28T19:49:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:07 smithi059 ceph-mon[22052]: Unable to set osd_memory_target on smithi033 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-28T19:49:07.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:07 smithi059 ceph-mon[22052]: pgmap v862: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 103 KiB/s wr, 31 op/s 2024-08-28T19:49:07.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:07 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-08-28T19:49:07.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:07 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-08-28T19:49:07.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:07 smithi122 ceph-mon[22174]: Adjusting osd_memory_target on smithi033 to 177.0M 2024-08-28T19:49:07.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:07 smithi122 ceph-mon[22174]: Unable to set osd_memory_target on smithi122 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-08-28T19:49:07.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:07 smithi122 ceph-mon[22174]: Unable to set osd_memory_target on smithi059 to 185701376: error parsing value: Value '185701376' is below minimum 939524096 2024-08-28T19:49:07.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:07 smithi122 ceph-mon[22174]: Unable to set osd_memory_target on smithi033 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-28T19:49:07.544 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:07 smithi122 ceph-mon[22174]: pgmap v862: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 103 KiB/s wr, 31 op/s 2024-08-28T19:49:07.584 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:07.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:07 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi122 to 175.9M 2024-08-28T19:49:07.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:07 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-08-28T19:49:07.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:07 smithi033 ceph-mon[18549]: Adjusting osd_memory_target on smithi033 to 177.0M 2024-08-28T19:49:07.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:07 smithi033 ceph-mon[18549]: Unable to set osd_memory_target on smithi122 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-08-28T19:49:07.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:07 smithi033 ceph-mon[18549]: Unable to set osd_memory_target on smithi059 to 185701376: error parsing value: Value '185701376' is below minimum 939524096 2024-08-28T19:49:07.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:07 smithi033 ceph-mon[18549]: Unable to set osd_memory_target on smithi033 to 185702092: error parsing value: Value '185702092' is below minimum 939524096 2024-08-28T19:49:07.631 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:07 smithi033 ceph-mon[18549]: pgmap v862: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 103 KiB/s wr, 31 op/s 2024-08-28T19:49:08.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.112+0000 7f11e9ed2640 1 -- 172.21.15.33:0/2638659234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11e4108a90 msgr2=0x7f11e410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:08.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.112+0000 7f11e9ed2640 1 --2- 172.21.15.33:0/2638659234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11e4108a90 0x7f11e410f2c0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009ca0 tx=0x7f11dc02a8c0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.112+0000 7f11e9ed2640 1 -- 172.21.15.33:0/2638659234 shutdown_connections 2024-08-28T19:49:08.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.112+0000 7f11e9ed2640 1 --2- 172.21.15.33:0/2638659234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11e4108a90 0x7f11e410f2c0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.112+0000 7f11e9ed2640 1 --2- 172.21.15.33:0/2638659234 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e4108140 0x7f11e4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.112+0000 7f11e9ed2640 1 --2- 172.21.15.33:0/2638659234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e4102800 0x7f11e4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.112+0000 7f11e9ed2640 1 -- 172.21.15.33:0/2638659234 >> 172.21.15.33:0/2638659234 conn(0x7f11e40794d0 msgr2=0x7f11e40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:08.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.112+0000 7f11e9ed2640 1 -- 172.21.15.33:0/2638659234 shutdown_connections 2024-08-28T19:49:08.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.112+0000 7f11e9ed2640 1 -- 172.21.15.33:0/2638659234 wait complete. 2024-08-28T19:49:08.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11e9ed2640 1 Processor -- start 2024-08-28T19:49:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11e9ed2640 1 -- start start 2024-08-28T19:49:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11e9ed2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e4102800 0x7f11e419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11e9ed2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11e4108140 0x7f11e419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11e9ed2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e4108a90 0x7f11e419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11e9ed2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f11e4112710 con 0x7f11e4108140 2024-08-28T19:49:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11e9ed2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f11e4112590 con 0x7f11e4102800 2024-08-28T19:49:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11e9ed2640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f11e4112890 con 0x7f11e4108a90 2024-08-28T19:49:08.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11daffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11e4108140 0x7f11e419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11daffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11e4108140 0x7f11e419a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39642/0 (socket says 172.21.15.33:39642) 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.113+0000 7f11daffd640 1 -- 172.21.15.33:0/816542696 learned_addr learned my addr 172.21.15.33:0/816542696 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11e37fe640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e4102800 0x7f11e419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11e3fff640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e4108a90 0x7f11e419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11daffd640 1 -- 172.21.15.33:0/816542696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e4108a90 msgr2=0x7f11e419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11daffd640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e4108a90 0x7f11e419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11daffd640 1 -- 172.21.15.33:0/816542696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e4102800 msgr2=0x7f11e419a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11daffd640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e4102800 0x7f11e419a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11daffd640 1 -- 172.21.15.33:0/816542696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e41a0160 con 0x7f11e4108140 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11e3fff640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e4108a90 0x7f11e419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11e37fe640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e4102800 0x7f11e419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11daffd640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11e4108140 0x7f11e419a790 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00d740 tx=0x7f11cc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11e17fa640 1 -- 172.21.15.33:0/816542696 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc017070 con 0x7f11e4108140 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11e17fa640 1 -- 172.21.15.33:0/816542696 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11cc00de50 con 0x7f11e4108140 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11e9ed2640 1 -- 172.21.15.33:0/816542696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e41a0450 con 0x7f11e4108140 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11e17fa640 1 -- 172.21.15.33:0/816542696 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc004ce0 con 0x7f11e4108140 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.114+0000 7f11e9ed2640 1 -- 172.21.15.33:0/816542696 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e41a6bb0 con 0x7f11e4108140 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11e17fa640 1 -- 172.21.15.33:0/816542696 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f11cc004e80 con 0x7f11e4108140 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11f0447740 1 Processor -- start 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11f0447740 1 -- start start 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11f0447740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64283b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11f0447740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e64246d1b0 0x55e64283b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11f0447740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e642475390 0x55e64283bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11f0447740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e6427b2630 con 0x55e642496070 2024-08-28T19:49:08.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11f0447740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e6427a1bc0 con 0x55e64246d1b0 2024-08-28T19:49:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11f0447740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e6427a5b70 con 0x55e642475390 2024-08-28T19:49:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64283b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64283b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39652/0 (socket says 172.21.15.33:39652) 2024-08-28T19:49:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11e3fff640 1 -- 172.21.15.33:0/2505381259 learned_addr learned my addr 172.21.15.33:0/2505381259 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.117+0000 7f11e37fe640 1 --2- 172.21.15.33:0/2505381259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e64246d1b0 0x55e64283b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11daffd640 1 --2- 172.21.15.33:0/2505381259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e642475390 0x55e64283bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11e3fff640 1 -- 172.21.15.33:0/2505381259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e642475390 msgr2=0x55e64283bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:08.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11e17fa640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f11d00b4ca0 0x7f11d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11e3fff640 1 --2- 172.21.15.33:0/2505381259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e642475390 0x55e64283bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11e3fff640 1 -- 172.21.15.33:0/2505381259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e64246d1b0 msgr2=0x55e64283b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:08.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11e3fff640 1 --2- 172.21.15.33:0/2505381259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e64246d1b0 0x55e64283b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11e3fff640 1 -- 172.21.15.33:0/2505381259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e642501650 con 0x55e642496070 2024-08-28T19:49:08.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11e37fe640 1 --2- 172.21.15.33:0/2505381259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e64246d1b0 0x55e64283b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:49:08.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11e17fa640 1 -- 172.21.15.33:0/816542696 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f11cc0e5350 con 0x7f11e4108140 2024-08-28T19:49:08.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11e3fff640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f11d00b4ca0 0x7f11d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11e3fff640 1 --2- 172.21.15.33:0/2505381259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64283b2c0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f11dc006010 tx=0x7f11dc009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34672aa7f0dbd94 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:08.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.118+0000 7f11d9ffb640 1 -- 172.21.15.33:0/2505381259 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc04c070 con 0x55e642496070 2024-08-28T19:49:08.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.119+0000 7f11d9ffb640 1 -- 172.21.15.33:0/2505381259 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11dc036070 con 0x55e642496070 2024-08-28T19:49:08.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.119+0000 7f11d9ffb640 1 -- 172.21.15.33:0/2505381259 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc02f660 con 0x55e642496070 2024-08-28T19:49:08.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.119+0000 7f11f0447740 1 -- 172.21.15.33:0/2505381259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 msgr2=0x55e64283b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:08.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.119+0000 7f11e3fff640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f11d00b4ca0 0x7f11d00b71b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f11dc049000 tx=0x7f11dc04a000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:08.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.119+0000 7f11f0447740 1 --2- 172.21.15.33:0/2505381259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64283b2c0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f11dc006010 tx=0x7f11dc009880 comp rx=0 tx=0).stop 2024-08-28T19:49:08.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.120+0000 7f11f0447740 1 -- 172.21.15.33:0/2505381259 shutdown_connections 2024-08-28T19:49:08.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.120+0000 7f11f0447740 1 --2- 172.21.15.33:0/2505381259 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e642475390 0x55e64283bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.120+0000 7f11f0447740 1 --2- 172.21.15.33:0/2505381259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e64246d1b0 0x55e64283b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.120+0000 7f11f0447740 1 --2- 172.21.15.33:0/2505381259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64283b2c0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.120+0000 7f11f0447740 1 -- 172.21.15.33:0/2505381259 >> 172.21.15.33:0/2505381259 conn(0x55e64248a460 msgr2=0x55e6428391b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:08.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.120+0000 7f11f0447740 1 -- 172.21.15.33:0/2505381259 shutdown_connections 2024-08-28T19:49:08.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.120+0000 7f11f0447740 1 -- 172.21.15.33:0/2505381259 wait complete. 2024-08-28T19:49:08.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.120+0000 7f11f0447740 1 -- start start 2024-08-28T19:49:08.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.120+0000 7f11f0447740 1 Processor -- start 2024-08-28T19:49:08.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11f0447740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e64246d1b0 0x55e642846ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11f0447740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642475390 0x55e642847000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11f0447740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 0x55e642852dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11f0447740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e642604700 con 0x55e642475390 2024-08-28T19:49:08.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11f0447740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e642728700 con 0x55e642496070 2024-08-28T19:49:08.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11f0447740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e642849aa0 con 0x55e64246d1b0 2024-08-28T19:49:08.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11f0447740 10 client.0 _ll_register_callbacks cb 0x55e642757dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:08.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11daffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642475390 0x55e642847000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11daffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642475390 0x55e642847000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39668/0 (socket says 172.21.15.33:39668) 2024-08-28T19:49:08.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11daffd640 1 -- 172.21.15.33:0/4068324146 learned_addr learned my addr 172.21.15.33:0/4068324146 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:08.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11e37fe640 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e64246d1b0 0x55e642846ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11e3fff640 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 0x55e642852dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11daffd640 1 -- 172.21.15.33:0/4068324146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e64246d1b0 msgr2=0x55e642846ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:08.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11daffd640 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e64246d1b0 0x55e642846ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11daffd640 1 -- 172.21.15.33:0/4068324146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 msgr2=0x55e642852dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:08.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11daffd640 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 0x55e642852dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11daffd640 1 -- 172.21.15.33:0/4068324146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6427618b0 con 0x55e642475390 2024-08-28T19:49:08.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11daffd640 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642475390 0x55e642847000 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009610 tx=0x7f11cc0ab470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e91ad8601ef18b server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.121+0000 7f11c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11c2ffd640 1 -- 172.21.15.33:0/4068324146 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc020050 con 0x55e642475390 2024-08-28T19:49:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11c2ffd640 1 -- 172.21.15.33:0/4068324146 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f11cc0e5120 con 0x55e642475390 2024-08-28T19:49:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11f0447740 1 -- 172.21.15.33:0/4068324146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11dc036070 con 0x55e642475390 2024-08-28T19:49:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11c2ffd640 1 -- 172.21.15.33:0/4068324146 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11cc0b4300 con 0x55e642475390 2024-08-28T19:49:08.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11f0447740 10 client.19959 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:08.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11f0447740 1 -- 172.21.15.33:0/4068324146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e642855890 con 0x55e642475390 2024-08-28T19:49:08.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11c2ffd640 1 -- 172.21.15.33:0/4068324146 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11dc036070 con 0x55e642475390 2024-08-28T19:49:08.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11c2ffd640 1 -- 172.21.15.33:0/4068324146 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f11cc0a7010 con 0x55e642475390 2024-08-28T19:49:08.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11f0447740 10 client.19959 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:08.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11f0447740 10 client.19959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:49:08.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11f0447740 20 client.19959 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:08.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11f0447740 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e6424549f0 0x55e642858d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11f0447740 4 client.19959 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:49:08.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.122+0000 7f11f0447740 1 -- 172.21.15.33:0/4068324146 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6427b4580 con 0x55e6424549f0 2024-08-28T19:49:08.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.123+0000 7f11e37fe640 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e6424549f0 0x55e642858d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.123+0000 7f11c2ffd640 10 client.19959 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:08.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.123+0000 7f11e37fe640 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e6424549f0 0x55e642858d60 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0bbe77f3dc9ebd5 server_cookie=b16d0918952eedc4 in_seq=0 out_seq=0 2024-08-28T19:49:08.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11c2ffd640 1 -- 172.21.15.33:0/4068324146 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6427b4580 con 0x55e6424549f0 2024-08-28T19:49:08.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11c2ffd640 10 client.19959 handle_command_reply: tid=0 2024-08-28T19:49:08.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 client.19959 shutdown 2024-08-28T19:49:08.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 -- 172.21.15.33:0/4068324146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642475390 msgr2=0x55e642847000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642475390 0x55e642847000 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009610 tx=0x7f11cc0ab470 comp rx=0 tx=0).stop 2024-08-28T19:49:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 -- 172.21.15.33:0/4068324146 shutdown_connections 2024-08-28T19:49:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 0x55e642852dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e6424549f0 0x55e642858d60 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642475390 0x55e642847000 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11c2ffd640 0 client.19959 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:08.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 --2- 172.21.15.33:0/4068324146 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e64246d1b0 0x55e642846ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 -- 172.21.15.33:0/4068324146 >> 172.21.15.33:0/4068324146 conn(0x55e64248a460 msgr2=0x55e64283e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:08.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 -- 172.21.15.33:0/4068324146 shutdown_connections 2024-08-28T19:49:08.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 1 -- 172.21.15.33:0/4068324146 wait complete. 2024-08-28T19:49:08.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.124+0000 7f11f0447740 20 client.19959 trim_cache size 0 max 16384 2024-08-28T19:49:08.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.142+0000 7f11f0447740 1 Processor -- start 2024-08-28T19:49:08.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.142+0000 7f11f0447740 1 -- start start 2024-08-28T19:49:08.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.142+0000 7f11f0447740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6424549f0 0x55e64283ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.142+0000 7f11f0447740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e64246d1b0 0x55e642852cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.142+0000 7f11f0447740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 0x55e642843cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.142+0000 7f11f0447740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f11e41b0be0 con 0x55e64246d1b0 2024-08-28T19:49:08.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.142+0000 7f11f0447740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f11e41b2720 con 0x55e642496070 2024-08-28T19:49:08.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.142+0000 7f11f0447740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f11e41b12b0 con 0x55e6424549f0 2024-08-28T19:49:08.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.142+0000 7f11daffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e64246d1b0 0x55e642852cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11daffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e64246d1b0 0x55e642852cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39680/0 (socket says 172.21.15.33:39680) 2024-08-28T19:49:08.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11daffd640 1 -- 172.21.15.33:0/1285336537 learned_addr learned my addr 172.21.15.33:0/1285336537 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:08.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11e37fe640 1 --2- 172.21.15.33:0/1285336537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6424549f0 0x55e64283ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11e3fff640 1 --2- 172.21.15.33:0/1285336537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 0x55e642843cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11daffd640 1 -- 172.21.15.33:0/1285336537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6424549f0 msgr2=0x55e64283ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:08.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11daffd640 1 --2- 172.21.15.33:0/1285336537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6424549f0 0x55e64283ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11daffd640 1 -- 172.21.15.33:0/1285336537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 msgr2=0x55e642843cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:08.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11daffd640 1 --2- 172.21.15.33:0/1285336537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 0x55e642843cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11daffd640 1 -- 172.21.15.33:0/1285336537 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e642849200 con 0x55e64246d1b0 2024-08-28T19:49:08.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11e3fff640 1 --2- 172.21.15.33:0/1285336537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 0x55e642843cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:08.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11daffd640 1 --2- 172.21.15.33:0/1285336537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e64246d1b0 0x55e642852cc0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0e2d00 tx=0x7f11cc0ab5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970a5a16f51a361f server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:08.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11d97fa640 1 -- 172.21.15.33:0/1285336537 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc020070 con 0x55e64246d1b0 2024-08-28T19:49:08.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11d97fa640 1 -- 172.21.15.33:0/1285336537 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11cc0e2e50 con 0x55e64246d1b0 2024-08-28T19:49:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.143+0000 7f11d97fa640 1 -- 172.21.15.33:0/1285336537 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0ab6a0 con 0x55e64246d1b0 2024-08-28T19:49:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.144+0000 7f11f0447740 1 -- 172.21.15.33:0/1285336537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e64246d1b0 msgr2=0x55e642852cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.144+0000 7f11f0447740 1 --2- 172.21.15.33:0/1285336537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e64246d1b0 0x55e642852cc0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0e2d00 tx=0x7f11cc0ab5a0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.144+0000 7f11f0447740 1 -- 172.21.15.33:0/1285336537 shutdown_connections 2024-08-28T19:49:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.144+0000 7f11f0447740 1 --2- 172.21.15.33:0/1285336537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e642496070 0x55e642843cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.144+0000 7f11f0447740 1 --2- 172.21.15.33:0/1285336537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e64246d1b0 0x55e642852cc0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.144+0000 7f11f0447740 1 --2- 172.21.15.33:0/1285336537 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e6424549f0 0x55e64283ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.144+0000 7f11f0447740 1 -- 172.21.15.33:0/1285336537 >> 172.21.15.33:0/1285336537 conn(0x55e64248a460 msgr2=0x55e64283e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:08.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.144+0000 7f11f0447740 1 -- 172.21.15.33:0/1285336537 shutdown_connections 2024-08-28T19:49:08.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.144+0000 7f11f0447740 1 -- 172.21.15.33:0/1285336537 wait complete. 2024-08-28T19:49:08.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11f0447740 1 -- start start 2024-08-28T19:49:08.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11f0447740 1 Processor -- start 2024-08-28T19:49:08.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11f0447740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6424549f0 0x55e64284f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11f0447740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e64246d1b0 0x55e64284b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11f0447740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64284bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11f0447740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f11e41b2050 con 0x55e642496070 2024-08-28T19:49:08.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11f0447740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f11e41b1980 con 0x55e6424549f0 2024-08-28T19:49:08.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11f0447740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f11e41aebe0 con 0x55e64246d1b0 2024-08-28T19:49:08.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11f0447740 10 client.0 _ll_register_callbacks cb 0x7f11cc009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:08.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64284bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11e3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64284bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39684/0 (socket says 172.21.15.33:39684) 2024-08-28T19:49:08.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11e3fff640 1 -- 172.21.15.33:0/922660318 learned_addr learned my addr 172.21.15.33:0/922660318 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11daffd640 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e64246d1b0 0x55e64284b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.145+0000 7f11e37fe640 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6424549f0 0x55e64284f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11e3fff640 1 -- 172.21.15.33:0/922660318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e64246d1b0 msgr2=0x55e64284b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11e3fff640 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e64246d1b0 0x55e64284b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11e3fff640 1 -- 172.21.15.33:0/922660318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6424549f0 msgr2=0x55e64284f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11e3fff640 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6424549f0 0x55e64284f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11e3fff640 1 -- 172.21.15.33:0/922660318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e64284c6d0 con 0x55e642496070 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11e3fff640 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64284bf40 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009ca0 tx=0x7f11dc04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996ef437a10da91e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11c2ffd640 1 -- 172.21.15.33:0/922660318 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc04c040 con 0x55e642496070 2024-08-28T19:49:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11c2ffd640 1 -- 172.21.15.33:0/922660318 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9453+0+0 (secure 0 0 0) 0x7f11dc0041c0 con 0x55e642496070 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11f0447740 1 -- 172.21.15.33:0/922660318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11cc0e2e50 con 0x55e642496070 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11c2ffd640 1 -- 172.21.15.33:0/922660318 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11dc0043c0 con 0x55e642496070 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11f0447740 10 client.19965 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.146+0000 7f11f0447740 1 -- 172.21.15.33:0/922660318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6428c4620 con 0x55e642496070 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11c2ffd640 1 -- 172.21.15.33:0/922660318 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11cc0e2e50 con 0x55e642496070 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11c2ffd640 1 -- 172.21.15.33:0/922660318 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f11dc042070 con 0x55e642496070 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11f0447740 10 client.19965 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11f0447740 10 client.19965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11f0447740 20 client.19965 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11f0447740 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e642429da0 0x55e6428c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11f0447740 4 client.19965 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11f0447740 1 -- 172.21.15.33:0/922660318 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e6427b0020 con 0x55e642429da0 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11e37fe640 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e642429da0 0x55e6428c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11c2ffd640 10 client.19965 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.147+0000 7f11e37fe640 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e642429da0 0x55e6428c6970 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e78f416bbde6ab3b server_cookie=f9dd56e4fd761fa1 in_seq=0 out_seq=0 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11c2ffd640 1 -- 172.21.15.33:0/922660318 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7190 (crc 0 0 0) 0x55e6427b0020 con 0x55e642429da0 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11c2ffd640 10 client.19965 handle_command_reply: tid=0 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 client.19965 shutdown 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 -- 172.21.15.33:0/922660318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 msgr2=0x55e64284bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64284bf40 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009ca0 tx=0x7f11dc04f000 comp rx=0 tx=0).stop 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 -- 172.21.15.33:0/922660318 shutdown_connections 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x55e642429da0 0x55e6428c6970 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e642496070 0x55e64284bf40 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11c2ffd640 0 client.19965 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e64246d1b0 0x55e64284b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 --2- 172.21.15.33:0/922660318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6424549f0 0x55e64284f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 -- 172.21.15.33:0/922660318 >> 172.21.15.33:0/922660318 conn(0x55e64248a460 msgr2=0x55e64283eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 -- 172.21.15.33:0/922660318 shutdown_connections 2024-08-28T19:49:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 1 -- 172.21.15.33:0/922660318 wait complete. 2024-08-28T19:49:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.148+0000 7f11f0447740 20 client.19965 trim_cache size 0 max 16384 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: "status": "no active scrubs running", 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: "scrubs": {}, 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_stats": { 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: "8ffc9e14-97cc-410d-b583-8de689f35b0f": { 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:48:34.913714+0000", 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "36820268-5bed-48c3-bfaa-51c3537532e6": { 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:44:39.959857+0000", 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "f5ea7231-3e1a-4401-bac3-5b2c26666b1f": { 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:54.484079+0000", 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.166 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: "2fe9f8bd-e811-43a4-af9e-ebbc014a1cbb": { 2024-08-28T19:49:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:43:08.613307+0000", 2024-08-28T19:49:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.167 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: "9f7d985d-a935-4616-b3c6-f9caddb846a5": { 2024-08-28T19:49:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:07.758605+0000", 2024-08-28T19:49:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.168 INFO:teuthology.orchestra.run.smithi033.stdout: "c7a8cfcc-eae0-4a68-ad75-ee6cc3428dc4": { 2024-08-28T19:49:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:53.074676+0000", 2024-08-28T19:49:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: "7bc9ceff-c40a-4b60-a12f-cc9f203af1aa": { 2024-08-28T19:49:08.169 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:47:00.994176+0000", 2024-08-28T19:49:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: "accb3403-fa32-4006-9838-9a16020a6c42": { 2024-08-28T19:49:08.170 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:41:04.659908+0000", 2024-08-28T19:49:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: "3b385a22-8710-4cc9-9519-872af6231c9a": { 2024-08-28T19:49:08.171 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:32:32.886317+0000", 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "31a7d457-d6d6-4057-9174-bbe79f84c62c": { 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:45:27.534627+0000", 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.172 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "7ae88ab8-65d5-42d4-8e6c-16ddf80e59f6": { 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:09.681868+0000", 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "48fef576-2648-4bab-8772-21d3637a9125": { 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:46:15.427396+0000", 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.173 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "95af3405-6989-47bb-8757-0c4413bc1f6d": { 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:42:23.684527+0000", 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "8d4916ee-3aa5-498f-b19e-ffb12b88516d": { 2024-08-28T19:49:08.174 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:34:56.045653+0000", 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "153c14e4-9cf6-465d-b1e1-c611091f3f27": { 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:47:47.242949+0000", 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.175 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: "f53b0aa4-957f-44a9-bb72-a48225282b53": { 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:43.067434+0000", 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: "cdd402b6-fb58-45b1-9ec1-948fff4a2068": { 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:35:56.937370+0000", 2024-08-28T19:49:08.176 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.177 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.177 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.177 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.180 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.180 INFO:teuthology.orchestra.run.smithi033.stdout: "44f3a863-ce5b-4c51-b841-9de3d1e00689": { 2024-08-28T19:49:08.180 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:58.424083+0000", 2024-08-28T19:49:08.180 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.180 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.180 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.181 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.181 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.181 INFO:teuthology.orchestra.run.smithi033.stdout: "0d2ec7ad-63e2-4255-a66a-f158a142ebf4": { 2024-08-28T19:49:08.182 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:36:43.032155+0000", 2024-08-28T19:49:08.182 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.182 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.183 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.183 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.183 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.184 INFO:teuthology.orchestra.run.smithi033.stdout: "a2873d41-eb7f-49e9-8acb-f43ef3f1ee73": { 2024-08-28T19:49:08.184 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:59.255796+0000", 2024-08-28T19:49:08.184 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.184 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.184 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.184 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.184 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.184 INFO:teuthology.orchestra.run.smithi033.stdout: "3188dec0-29fb-4644-91c6-a89667b41421": { 2024-08-28T19:49:08.185 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:33:23.895080+0000", 2024-08-28T19:49:08.185 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.185 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.185 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.185 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.186 INFO:teuthology.orchestra.run.smithi033.stdout: "c6a79f9d-3c60-486c-b1ff-16bb65314e80": { 2024-08-28T19:49:08.186 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:38:46.498570+0000", 2024-08-28T19:49:08.186 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.186 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.187 INFO:teuthology.orchestra.run.smithi033.stdout: "d306a83e-11d8-47b7-8d28-659371ebb837": { 2024-08-28T19:49:08.187 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:39:31.757353+0000", 2024-08-28T19:49:08.187 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.187 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.188 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.188 INFO:teuthology.orchestra.run.smithi033.stdout: "09273d72-a1bf-43d9-9144-716a0371f2ac": { 2024-08-28T19:49:08.188 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:37:12.477018+0000", 2024-08-28T19:49:08.188 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.188 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.188 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.188 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.189 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:08.189 INFO:teuthology.orchestra.run.smithi033.stdout: "d4f12ae3-5311-4fb9-b959-e7df483556b2": { 2024-08-28T19:49:08.189 INFO:teuthology.orchestra.run.smithi033.stdout: "start_time": "2024-08-28T19:40:17.114136+0000", 2024-08-28T19:49:08.189 INFO:teuthology.orchestra.run.smithi033.stdout: "path": "/", 2024-08-28T19:49:08.189 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:08.189 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_passed": 0, 2024-08-28T19:49:08.189 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_failed": 0, 2024-08-28T19:49:08.190 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_skipped": 0 2024-08-28T19:49:08.190 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:08.190 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:08.190 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:49:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 -- 172.21.15.33:0/816542696 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f11d00b4ca0 msgr2=0x7f11d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f11d00b4ca0 0x7f11d00b71b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f11dc049000 tx=0x7f11dc04a000 comp rx=0 tx=0).stop 2024-08-28T19:49:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 -- 172.21.15.33:0/816542696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11e4108140 msgr2=0x7f11e419a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11e4108140 0x7f11e419a790 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f11cc00d740 tx=0x7f11cc00dc00 comp rx=0 tx=0).stop 2024-08-28T19:49:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 -- 172.21.15.33:0/816542696 shutdown_connections 2024-08-28T19:49:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f11d00b4ca0 0x7f11d00b71b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f11e4108a90 0x7f11e419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11e4108140 0x7f11e419a790 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 --2- 172.21.15.33:0/816542696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11e4102800 0x7f11e419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 -- 172.21.15.33:0/816542696 >> 172.21.15.33:0/816542696 conn(0x7f11e40794d0 msgr2=0x7f11e406af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 -- 172.21.15.33:0/816542696 shutdown_connections 2024-08-28T19:49:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:08.149+0000 7f11e9ed2640 1 -- 172.21.15.33:0/816542696 wait complete. 2024-08-28T19:49:08.869 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-28T19:49:08.870 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:49:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:09.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:09 smithi059 ceph-mon[22052]: pgmap v863: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 107 KiB/s wr, 36 op/s 2024-08-28T19:49:09.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:09 smithi122 ceph-mon[22174]: pgmap v863: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 107 KiB/s wr, 36 op/s 2024-08-28T19:49:09.596 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:09 smithi033 ceph-mon[18549]: pgmap v863: 129 pgs: 129 active+clean; 30 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 107 KiB/s wr, 36 op/s 2024-08-28T19:49:09.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.686+0000 7f2c3fa23640 1 -- 172.21.15.33:0/3343427585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c381050a0 msgr2=0x7f2c3810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:09.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.686+0000 7f2c3fa23640 1 --2- 172.21.15.33:0/3343427585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c381050a0 0x7f2c3810d5f0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009900 tx=0x7f2c3402a410 comp rx=0 tx=0).stop 2024-08-28T19:49:09.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.686+0000 7f2c3fa23640 1 -- 172.21.15.33:0/3343427585 shutdown_connections 2024-08-28T19:49:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.686+0000 7f2c3fa23640 1 --2- 172.21.15.33:0/3343427585 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c3810dbb0 0x7f2c381100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.686+0000 7f2c3fa23640 1 --2- 172.21.15.33:0/3343427585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c381050a0 0x7f2c3810d5f0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.686+0000 7f2c3fa23640 1 --2- 172.21.15.33:0/3343427585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c38104750 0x7f2c38104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.686+0000 7f2c3fa23640 1 -- 172.21.15.33:0/3343427585 >> 172.21.15.33:0/3343427585 conn(0x7f2c380794d0 msgr2=0x7f2c380798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.686+0000 7f2c3fa23640 1 -- 172.21.15.33:0/3343427585 shutdown_connections 2024-08-28T19:49:09.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.686+0000 7f2c3fa23640 1 -- 172.21.15.33:0/3343427585 wait complete. 2024-08-28T19:49:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.687+0000 7f2c3fa23640 1 Processor -- start 2024-08-28T19:49:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.687+0000 7f2c3fa23640 1 -- start start 2024-08-28T19:49:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3fa23640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c38104750 0x7f2c38102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3fa23640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c381050a0 0x7f2c381029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3fa23640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c3810dbb0 0x7f2c38102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3fa23640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2c381137f0 con 0x7f2c38104750 2024-08-28T19:49:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3fa23640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c38113670 con 0x7f2c3810dbb0 2024-08-28T19:49:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3fa23640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f2c38113970 con 0x7f2c381050a0 2024-08-28T19:49:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3d7bf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c38104750 0x7f2c38102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:09.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3d7bf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c38104750 0x7f2c38102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59772/0 (socket says 172.21.15.33:59772) 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3d7bf640 1 -- 172.21.15.33:0/618536068 learned_addr learned my addr 172.21.15.33:0/618536068 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3cfbe640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c381050a0 0x7f2c381029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3dfc0640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c3810dbb0 0x7f2c38102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3d7bf640 1 -- 172.21.15.33:0/618536068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c381050a0 msgr2=0x7f2c381029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3d7bf640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c381050a0 0x7f2c381029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3d7bf640 1 -- 172.21.15.33:0/618536068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c3810dbb0 msgr2=0x7f2c38102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3d7bf640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c3810dbb0 0x7f2c38102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3d7bf640 1 -- 172.21.15.33:0/618536068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c381a8520 con 0x7f2c38104750 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.688+0000 7f2c3d7bf640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c38104750 0x7f2c38102490 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00d770 tx=0x7f2c2c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.689+0000 7f2c2a7fc640 1 -- 172.21.15.33:0/618536068 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c017070 con 0x7f2c38104750 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.689+0000 7f2c2a7fc640 1 -- 172.21.15.33:0/618536068 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c2c009c30 con 0x7f2c38104750 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.689+0000 7f2c3fa23640 1 -- 172.21.15.33:0/618536068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c381a8810 con 0x7f2c38104750 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.689+0000 7f2c2a7fc640 1 -- 172.21.15.33:0/618536068 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c003cc0 con 0x7f2c38104750 2024-08-28T19:49:09.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.689+0000 7f2c3fa23640 1 -- 172.21.15.33:0/618536068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c381a8d70 con 0x7f2c38104750 2024-08-28T19:49:09.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.690+0000 7f2c3fa23640 1 -- 172.21.15.33:0/618536068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c38104b60 con 0x7f2c38104750 2024-08-28T19:49:09.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.691+0000 7f2c2a7fc640 1 -- 172.21.15.33:0/618536068 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f2c2c003e60 con 0x7f2c38104750 2024-08-28T19:49:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.692+0000 7f2c2a7fc640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c240b4d20 0x7f2c240b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.692+0000 7f2c3cfbe640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c240b4d20 0x7f2c240b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.692+0000 7f2c2a7fc640 1 -- 172.21.15.33:0/618536068 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9541+0+0 (secure 0 0 0) 0x7f2c2c0e5620 con 0x7f2c38104750 2024-08-28T19:49:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.693+0000 7f2c3cfbe640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c240b4d20 0x7f2c240b7230 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009230 tx=0x7f2c34031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.695+0000 7f2c2a7fc640 1 -- 172.21.15.33:0/618536068 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2c2c009de0 con 0x7f2c38104750 2024-08-28T19:49:09.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.920+0000 7f2c3fa23640 1 -- 172.21.15.33:0/618536068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c38103790 con 0x7f2c38104750 2024-08-28T19:49:09.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.921+0000 7f2c2a7fc640 1 -- 172.21.15.33:0/618536068 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f2c2c0ab9e0 con 0x7f2c38104750 2024-08-28T19:49:09.922 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:49:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:49:09.922 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:49:09.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 -- 172.21.15.33:0/618536068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c240b4d20 msgr2=0x7f2c240b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:09.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c240b4d20 0x7f2c240b7230 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009230 tx=0x7f2c34031400 comp rx=0 tx=0).stop 2024-08-28T19:49:09.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 -- 172.21.15.33:0/618536068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c38104750 msgr2=0x7f2c38102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:09.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c38104750 0x7f2c38102490 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00d770 tx=0x7f2c2c00dc30 comp rx=0 tx=0).stop 2024-08-28T19:49:09.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 -- 172.21.15.33:0/618536068 shutdown_connections 2024-08-28T19:49:09.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c3810dbb0 0x7f2c38102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:09.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f2c240b4d20 0x7f2c240b7230 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:09.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2c381050a0 0x7f2c381029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:09.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 --2- 172.21.15.33:0/618536068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c38104750 0x7f2c38102490 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:09.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 -- 172.21.15.33:0/618536068 >> 172.21.15.33:0/618536068 conn(0x7f2c380794d0 msgr2=0x7f2c38100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:09.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 -- 172.21.15.33:0/618536068 shutdown_connections 2024-08-28T19:49:09.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:09.923+0000 7f2c3fa23640 1 -- 172.21.15.33:0/618536068 wait complete. 2024-08-28T19:49:10.532 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:10 smithi059 ceph-mon[22052]: osdmap e105: 12 total, 12 up, 12 in 2024-08-28T19:49:10.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:10 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/618536068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:10.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:10 smithi122 ceph-mon[22174]: osdmap e105: 12 total, 12 up, 12 in 2024-08-28T19:49:10.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:10 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/618536068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:10.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:10 smithi033 ceph-mon[18549]: osdmap e105: 12 total, 12 up, 12 in 2024-08-28T19:49:10.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:10 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/618536068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:10.648 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-28T19:49:10.906 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:11.330 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:11 smithi033 ceph-mon[18549]: pgmap v865: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 86 KiB/s wr, 36 op/s 2024-08-28T19:49:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.423+0000 7f8b45d24640 1 -- 172.21.15.33:0/3229480033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b40109c50 msgr2=0x7f8b40110480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.423+0000 7f8b45d24640 1 --2- 172.21.15.33:0/3229480033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b40109c50 0x7f8b40110480 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009ca0 tx=0x7f8b3802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.423+0000 7f8b45d24640 1 -- 172.21.15.33:0/3229480033 shutdown_connections 2024-08-28T19:49:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.423+0000 7f8b45d24640 1 --2- 172.21.15.33:0/3229480033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b40109c50 0x7f8b40110480 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.423+0000 7f8b45d24640 1 --2- 172.21.15.33:0/3229480033 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b40109300 0x7f8b40109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.423+0000 7f8b45d24640 1 --2- 172.21.15.33:0/3229480033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b40101e20 0x7f8b40102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.423+0000 7f8b45d24640 1 -- 172.21.15.33:0/3229480033 >> 172.21.15.33:0/3229480033 conn(0x7f8b40079c60 msgr2=0x7f8b4007a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.423+0000 7f8b45d24640 1 -- 172.21.15.33:0/3229480033 shutdown_connections 2024-08-28T19:49:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.423+0000 7f8b45d24640 1 -- 172.21.15.33:0/3229480033 wait complete. 2024-08-28T19:49:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.424+0000 7f8b45d24640 1 Processor -- start 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.424+0000 7f8b45d24640 1 -- start start 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.424+0000 7f8b45d24640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b40101e20 0x7f8b40102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.424+0000 7f8b45d24640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b40109300 0x7f8b40103300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.424+0000 7f8b45d24640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b40109c50 0x7f8b40103840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.424+0000 7f8b45d24640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40113960 con 0x7f8b40109c50 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.424+0000 7f8b45d24640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401137e0 con 0x7f8b40109300 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.424+0000 7f8b45d24640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40113ae0 con 0x7f8b40101e20 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b40109c50 0x7f8b40103840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3ffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b40109c50 0x7f8b40103840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59796/0 (socket says 172.21.15.33:59796) 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3ffff640 1 -- 172.21.15.33:0/3714718138 learned_addr learned my addr 172.21.15.33:0/3714718138 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b40109300 0x7f8b40103300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b40101e20 0x7f8b40102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3ffff640 1 -- 172.21.15.33:0/3714718138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b40101e20 msgr2=0x7f8b40102dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3ffff640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b40101e20 0x7f8b40102dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3ffff640 1 -- 172.21.15.33:0/3714718138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b40109300 msgr2=0x7f8b40103300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3ffff640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b40109300 0x7f8b40103300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3ffff640 1 -- 172.21.15.33:0/3714718138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b401a84f0 con 0x7f8b40109c50 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b40109300 0x7f8b40103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3ffff640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b40109c50 0x7f8b40103840 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009430 tx=0x7f8b380319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3d7fa640 1 -- 172.21.15.33:0/3714718138 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38003c30 con 0x7f8b40109c50 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b45d24640 1 -- 172.21.15.33:0/3714718138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b401a8780 con 0x7f8b40109c50 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3d7fa640 1 -- 172.21.15.33:0/3714718138 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b38003dd0 con 0x7f8b40109c50 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.425+0000 7f8b3d7fa640 1 -- 172.21.15.33:0/3714718138 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3802faa0 con 0x7f8b40109c50 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.426+0000 7f8b45d24640 1 -- 172.21.15.33:0/3714718138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b401a8cc0 con 0x7f8b40109c50 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.428+0000 7f8b3d7fa640 1 -- 172.21.15.33:0/3714718138 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8b3802fc40 con 0x7f8b40109c50 2024-08-28T19:49:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.428+0000 7f8b4c299740 1 Processor -- start 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.428+0000 7f8b4c299740 1 -- start start 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.428+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c259b070 0x5604c2940310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.428+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c25721b0 0x5604c2940850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c257a390 0x5604c2940d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b4c299740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5604c28b7680 con 0x5604c25721b0 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b4c299740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5604c28a6c10 con 0x5604c257a390 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b4c299740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5604c28aabc0 con 0x5604c259b070 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b3f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c25721b0 0x5604c2940850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b3f7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c25721b0 0x5604c2940850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59804/0 (socket says 172.21.15.33:59804) 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b3f7fe640 1 -- 172.21.15.33:0/953716917 learned_addr learned my addr 172.21.15.33:0/953716917 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/953716917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c259b070 0x5604c2940310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/953716917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c257a390 0x5604c2940d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b3d7fa640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b2c0b4ca0 0x7f8b2c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b3ffff640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b2c0b4ca0 0x7f8b2c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b36ffd640 1 -- 172.21.15.33:0/953716917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c257a390 msgr2=0x5604c2940d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/953716917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c257a390 0x5604c2940d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b36ffd640 1 -- 172.21.15.33:0/953716917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c25721b0 msgr2=0x5604c2940850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/953716917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c25721b0 0x5604c2940850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b36ffd640 1 -- 172.21.15.33:0/953716917 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c2606650 con 0x5604c259b070 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/953716917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c25721b0 0x5604c2940850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.429+0000 7f8b3d7fa640 1 -- 172.21.15.33:0/3714718138 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9541+0+0 (secure 0 0 0) 0x7f8b38106dd0 con 0x7f8b40109c50 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.430+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/953716917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c259b070 0x5604c2940310 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8b28005fd0 tx=0x7f8b2800b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46329bbc305386f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.430+0000 7f8b3ffff640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b2c0b4ca0 0x7f8b2c0b71b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8b380ca330 tx=0x7f8b3802f500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.430+0000 7f8b35ffb640 1 -- 172.21.15.33:0/953716917 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b280142d0 con 0x5604c259b070 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.430+0000 7f8b35ffb640 1 -- 172.21.15.33:0/953716917 <== mon.1 v2:172.21.15.122:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b28005020 con 0x5604c259b070 2024-08-28T19:49:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.430+0000 7f8b35ffb640 1 -- 172.21.15.33:0/953716917 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28004a00 con 0x5604c259b070 2024-08-28T19:49:11.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.431+0000 7f8b4c299740 1 -- 172.21.15.33:0/953716917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c259b070 msgr2=0x5604c2940310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:11.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.431+0000 7f8b4c299740 1 --2- 172.21.15.33:0/953716917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c259b070 0x5604c2940310 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8b28005fd0 tx=0x7f8b2800b4a0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.431+0000 7f8b4c299740 1 -- 172.21.15.33:0/953716917 shutdown_connections 2024-08-28T19:49:11.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.431+0000 7f8b4c299740 1 --2- 172.21.15.33:0/953716917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c257a390 0x5604c2940d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.431+0000 7f8b4c299740 1 --2- 172.21.15.33:0/953716917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c25721b0 0x5604c2940850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.431+0000 7f8b4c299740 1 --2- 172.21.15.33:0/953716917 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c259b070 0x5604c2940310 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.431+0000 7f8b4c299740 1 -- 172.21.15.33:0/953716917 >> 172.21.15.33:0/953716917 conn(0x5604c258f460 msgr2=0x5604c293e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.431+0000 7f8b4c299740 1 -- 172.21.15.33:0/953716917 shutdown_connections 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.431+0000 7f8b4c299740 1 -- 172.21.15.33:0/953716917 wait complete. 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.431+0000 7f8b4c299740 1 -- start start 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b4c299740 1 Processor -- start 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25721b0 0x5604c294ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c257a390 0x5604c294bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c259b070 0x5604c2957db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b4c299740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x5604c2709700 con 0x5604c259b070 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b4c299740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5604c282d750 con 0x5604c25721b0 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b4c299740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x5604c294ea90 con 0x5604c257a390 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b4c299740 10 client.0 _ll_register_callbacks cb 0x5604c285ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b36ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c259b070 0x5604c2957db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b3f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c257a390 0x5604c294bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b3f7fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c257a390 0x5604c294bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.33:45968/0 (socket says 172.21.15.33:45968) 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b3f7fe640 1 -- 172.21.15.33:0/2331786704 learned_addr learned my addr 172.21.15.33:0/2331786704 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b36ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c259b070 0x5604c2957db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59810/0 (socket says 172.21.15.33:59810) 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25721b0 0x5604c294ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b3f7fe640 1 -- 172.21.15.33:0/2331786704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25721b0 msgr2=0x5604c294ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25721b0 0x5604c294ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b3f7fe640 1 -- 172.21.15.33:0/2331786704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c259b070 msgr2=0x5604c2957db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c259b070 0x5604c2957db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.432+0000 7f8b3f7fe640 1 -- 172.21.15.33:0/2331786704 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c2866900 con 0x5604c257a390 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.433+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c257a390 0x5604c294bf90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8b30011790 tx=0x7f8b30011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f4098a316ca38a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.433+0000 7f8b1effd640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-08-28T19:49:11.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.433+0000 7f8b1effd640 1 -- 172.21.15.33:0/2331786704 <== mon.1 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000fd30 con 0x5604c257a390 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.433+0000 7f8b4c299740 1 -- 172.21.15.33:0/2331786704 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b28005020 con 0x5604c257a390 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.433+0000 7f8b1effd640 1 -- 172.21.15.33:0/2331786704 <== mon.1 v2:172.21.15.122:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9541+0+0 (secure 0 0 0) 0x7f8b30004020 con 0x5604c257a390 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.433+0000 7f8b1effd640 1 -- 172.21.15.33:0/2331786704 <== mon.1 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8b30024050 con 0x5604c257a390 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.433+0000 7f8b4c299740 10 client.28552 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.433+0000 7f8b4c299740 1 -- 172.21.15.33:0/2331786704 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5604c295a860 con 0x5604c257a390 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.433+0000 7f8b1effd640 1 -- 172.21.15.33:0/2331786704 <== mon.1 v2:172.21.15.122:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b28005020 con 0x5604c257a390 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.434+0000 7f8b1effd640 1 -- 172.21.15.33:0/2331786704 <== mon.1 v2:172.21.15.122:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8b30018030 con 0x5604c257a390 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.434+0000 7f8b4c299740 10 client.28552 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.434+0000 7f8b4c299740 10 client.28552 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.434+0000 7f8b4c299740 20 client.28552 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.434+0000 7f8b4c299740 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5604c25599f0 0x5604c295de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.434+0000 7f8b4c299740 4 client.28552 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:49:11.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.434+0000 7f8b4c299740 1 -- 172.21.15.33:0/2331786704 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604c28b95d0 con 0x5604c25599f0 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.434+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5604c25599f0 0x5604c295de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.434+0000 7f8b1effd640 10 client.28552 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.434+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5604c25599f0 0x5604c295de00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=15c50cd0a084bdc0 server_cookie=cec5a592e8df7a14 in_seq=0 out_seq=0 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.435+0000 7f8b1effd640 1 -- 172.21.15.33:0/2331786704 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604c28b95d0 con 0x5604c25599f0 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.435+0000 7f8b1effd640 10 client.28552 handle_command_reply: tid=0 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.435+0000 7f8b4c299740 1 client.28552 shutdown 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 1 -- 172.21.15.33:0/2331786704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c257a390 msgr2=0x5604c294bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c257a390 0x5604c294bf90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8b30011790 tx=0x7f8b30011c50 comp rx=0 tx=0).stop 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 1 -- 172.21.15.33:0/2331786704 shutdown_connections 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5604c25599f0 0x5604c295de00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c259b070 0x5604c2957db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c257a390 0x5604c294bf90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b1effd640 0 client.28552 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:49:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 1 --2- 172.21.15.33:0/2331786704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25721b0 0x5604c294ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 1 -- 172.21.15.33:0/2331786704 >> 172.21.15.33:0/2331786704 conn(0x5604c258f460 msgr2=0x5604c29434a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 1 -- 172.21.15.33:0/2331786704 shutdown_connections 2024-08-28T19:49:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 1 -- 172.21.15.33:0/2331786704 wait complete. 2024-08-28T19:49:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.436+0000 7f8b4c299740 20 client.28552 trim_cache size 0 max 16384 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b4c299740 1 Processor -- start 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b4c299740 1 -- start start 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25599f0 0x5604c2941d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 0x5604c294d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c2957cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b4c299740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401b2f80 con 0x5604c257a390 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b4c299740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401b4ac0 con 0x5604c25599f0 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b4c299740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401b3650 con 0x5604c25721b0 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b36ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c2957cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b36ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c2957cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59812/0 (socket says 172.21.15.33:59812) 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.449+0000 7f8b36ffd640 1 -- 172.21.15.33:0/3171355148 learned_addr learned my addr 172.21.15.33:0/3171355148 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:11.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/3171355148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25599f0 0x5604c2941d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/3171355148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 0x5604c294d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b36ffd640 1 -- 172.21.15.33:0/3171355148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 msgr2=0x5604c294d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/3171355148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 0x5604c294d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b36ffd640 1 -- 172.21.15.33:0/3171355148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25599f0 msgr2=0x5604c2941d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/3171355148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25599f0 0x5604c2941d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b36ffd640 1 -- 172.21.15.33:0/3171355148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c294cd10 con 0x5604c257a390 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/3171355148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 0x5604c294d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/3171355148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c2957cb0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f8b28014f40 tx=0x7f8b28016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc86428032dacfcf server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b357fa640 1 -- 172.21.15.33:0/3171355148 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b280052c0 con 0x5604c257a390 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b357fa640 1 -- 172.21.15.33:0/3171355148 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b28005460 con 0x5604c257a390 2024-08-28T19:49:11.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.450+0000 7f8b357fa640 1 -- 172.21.15.33:0/3171355148 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b280035f0 con 0x5604c257a390 2024-08-28T19:49:11.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 -- 172.21.15.33:0/3171355148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 msgr2=0x5604c2957cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:11.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 --2- 172.21.15.33:0/3171355148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c2957cb0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f8b28014f40 tx=0x7f8b28016040 comp rx=0 tx=0).stop 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 -- 172.21.15.33:0/3171355148 shutdown_connections 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 --2- 172.21.15.33:0/3171355148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c2957cb0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 --2- 172.21.15.33:0/3171355148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 0x5604c294d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 --2- 172.21.15.33:0/3171355148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25599f0 0x5604c2941d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 -- 172.21.15.33:0/3171355148 >> 172.21.15.33:0/3171355148 conn(0x5604c258f460 msgr2=0x5604c294cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 -- 172.21.15.33:0/3171355148 shutdown_connections 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 -- 172.21.15.33:0/3171355148 wait complete. 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 -- start start 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.451+0000 7f8b4c299740 1 Processor -- start 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25599f0 0x5604c2950090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 0x5604c29505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b4c299740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c29c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b4c299740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401b43f0 con 0x5604c257a390 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b4c299740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401b3d20 con 0x5604c25599f0 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b4c299740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8b401b0f80 con 0x5604c25721b0 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b4c299740 10 client.0 _ll_register_callbacks cb 0x7f8b3000c710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b36ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c29c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b36ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c29c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59828/0 (socket says 172.21.15.33:59828) 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b36ffd640 1 -- 172.21.15.33:0/1859259896 learned_addr learned my addr 172.21.15.33:0/1859259896 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 0x5604c29505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25599f0 0x5604c2950090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b36ffd640 1 -- 172.21.15.33:0/1859259896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 msgr2=0x5604c29505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 0x5604c29505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b36ffd640 1 -- 172.21.15.33:0/1859259896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25599f0 msgr2=0x5604c2950090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25599f0 0x5604c2950090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b36ffd640 1 -- 172.21.15.33:0/1859259896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c2950ec0 con 0x5604c257a390 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.452+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 0x5604c29505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b36ffd640 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c29c7780 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x5604c295a800 tx=0x7f8b2800ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf8f9255d7789de server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b1effd640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b1effd640 1 -- 172.21.15.33:0/1859259896 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2800f730 con 0x5604c257a390 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b1effd640 1 -- 172.21.15.33:0/1859259896 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9541+0+0 (secure 0 0 0) 0x7f8b2800f8d0 con 0x5604c257a390 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b4c299740 1 -- 172.21.15.33:0/1859259896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b28005460 con 0x5604c257a390 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b1effd640 1 -- 172.21.15.33:0/1859259896 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8b2800fad0 con 0x5604c257a390 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b4c299740 10 client.19989 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b4c299740 1 -- 172.21.15.33:0/1859259896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5604c29c8ce0 con 0x5604c257a390 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b1effd640 1 -- 172.21.15.33:0/1859259896 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b28005460 con 0x5604c257a390 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b1effd640 1 -- 172.21.15.33:0/1859259896 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8b28012450 con 0x5604c257a390 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b4c299740 10 client.19989 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b4c299740 10 client.19989 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-28T19:49:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b4c299740 20 client.19989 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b4c299740 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5604c259b070 0x5604c29cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b4c299740 4 client.19989 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.453+0000 7f8b4c299740 1 -- 172.21.15.33:0/1859259896 --> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604c28b5070 con 0x5604c259b070 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.454+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5604c259b070 0x5604c29cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.454+0000 7f8b3f7fe640 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5604c259b070 0x5604c29cb240 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9af4b13e01706069 server_cookie=49ff0f40e889fe4a in_seq=0 out_seq=0 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.454+0000 7f8b1effd640 10 client.19989 ms_handle_connect on v2:172.21.15.59:6836/4143114753 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.454+0000 7f8b1effd640 1 -- 172.21.15.33:0/1859259896 <== mds.4 v2:172.21.15.59:6836/4143114753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604c28b5070 con 0x5604c259b070 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.454+0000 7f8b1effd640 10 client.19989 handle_command_reply: tid=0 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.454+0000 7f8b4c299740 1 client.19989 shutdown 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 1 -- 172.21.15.33:0/1859259896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 msgr2=0x5604c29c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c29c7780 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x5604c295a800 tx=0x7f8b2800ba80 comp rx=0 tx=0).stop 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 1 -- 172.21.15.33:0/1859259896 shutdown_connections 2024-08-28T19:49:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.59:6836/4143114753,v1:172.21.15.59:6837/4143114753] conn(0x5604c259b070 0x5604c29cb240 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5604c257a390 0x5604c29c7780 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5604c25721b0 0x5604c29505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 1 --2- 172.21.15.33:0/1859259896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5604c25599f0 0x5604c2950090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 1 -- 172.21.15.33:0/1859259896 >> 172.21.15.33:0/1859259896 conn(0x5604c258f460 msgr2=0x5604c2941ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b1effd640 0 client.19989 ms_handle_reset on v2:172.21.15.59:6836/4143114753 2024-08-28T19:49:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 1 -- 172.21.15.33:0/1859259896 shutdown_connections 2024-08-28T19:49:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 1 -- 172.21.15.33:0/1859259896 wait complete. 2024-08-28T19:49:11.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b4c299740 20 client.19989 trim_cache size 0 max 16384 2024-08-28T19:49:11.464 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:49:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b45d24640 1 -- 172.21.15.33:0/3714718138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b2c0b4ca0 msgr2=0x7f8b2c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b45d24640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b2c0b4ca0 0x7f8b2c0b71b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8b380ca330 tx=0x7f8b3802f500 comp rx=0 tx=0).stop 2024-08-28T19:49:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b45d24640 1 -- 172.21.15.33:0/3714718138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b40109c50 msgr2=0x7f8b40103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.455+0000 7f8b45d24640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b40109c50 0x7f8b40103840 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009430 tx=0x7f8b380319f0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.456+0000 7f8b45d24640 1 -- 172.21.15.33:0/3714718138 shutdown_connections 2024-08-28T19:49:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.456+0000 7f8b45d24640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b40109c50 0x7f8b40103840 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.456+0000 7f8b45d24640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b40109300 0x7f8b40103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.456+0000 7f8b45d24640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f8b2c0b4ca0 0x7f8b2c0b71b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.456+0000 7f8b45d24640 1 --2- 172.21.15.33:0/3714718138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8b40101e20 0x7f8b40102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.456+0000 7f8b45d24640 1 -- 172.21.15.33:0/3714718138 >> 172.21.15.33:0/3714718138 conn(0x7f8b40079c60 msgr2=0x7f8b401072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.456+0000 7f8b45d24640 1 -- 172.21.15.33:0/3714718138 shutdown_connections 2024-08-28T19:49:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:11.456+0000 7f8b45d24640 1 -- 172.21.15.33:0/3714718138 wait complete. 2024-08-28T19:49:11.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:11 smithi059 ceph-mon[22052]: pgmap v865: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 86 KiB/s wr, 36 op/s 2024-08-28T19:49:11.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:11 smithi122 ceph-mon[22174]: pgmap v865: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 86 KiB/s wr, 36 op/s 2024-08-28T19:49:12.170 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-28T19:49:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:12.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.930+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/1533051086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b4108170 msgr2=0x7fb6b4108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:12.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.930+0000 7fb6bb0e1640 1 --2- 172.21.15.33:0/1533051086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b4108170 0x7fb6b4108580 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009900 tx=0x7fb6a002a410 comp rx=0 tx=0).stop 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.930+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/1533051086 shutdown_connections 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.930+0000 7fb6bb0e1640 1 --2- 172.21.15.33:0/1533051086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b4108ac0 0x7fb6b410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.930+0000 7fb6bb0e1640 1 --2- 172.21.15.33:0/1533051086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b4108170 0x7fb6b4108580 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.930+0000 7fb6bb0e1640 1 --2- 172.21.15.33:0/1533051086 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6b4102880 0x7fb6b4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.930+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/1533051086 >> 172.21.15.33:0/1533051086 conn(0x7fb6b4079550 msgr2=0x7fb6b4079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.930+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/1533051086 shutdown_connections 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.930+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/1533051086 wait complete. 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6bb0e1640 1 Processor -- start 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6bb0e1640 1 -- start start 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6bb0e1640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6b4102880 0x7fb6b4199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6bb0e1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b4108170 0x7fb6b4199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6bb0e1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b4108ac0 0x7fb6b419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6bb0e1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b4112730 con 0x7fb6b4108170 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6bb0e1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41125b0 con 0x7fb6b4108ac0 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6bb0e1640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41128b0 con 0x7fb6b4102880 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b4108170 0x7fb6b4199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b4108170 0x7fb6b4199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59836/0 (socket says 172.21.15.33:59836) 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6b3fff640 1 -- 172.21.15.33:0/3246264333 learned_addr learned my addr 172.21.15.33:0/3246264333 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6b967e640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b4108ac0 0x7fb6b419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6b4102880 0x7fb6b4199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6b3fff640 1 -- 172.21.15.33:0/3246264333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6b4102880 msgr2=0x7fb6b4199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6b4102880 0x7fb6b4199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6b3fff640 1 -- 172.21.15.33:0/3246264333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b4108ac0 msgr2=0x7fb6b419e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b4108ac0 0x7fb6b419e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.931+0000 7fb6b3fff640 1 -- 172.21.15.33:0/3246264333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b419f0f0 con 0x7fb6b4108170 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.932+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b4108170 0x7fb6b4199720 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fb6a002a930 tx=0x7fb6a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.932+0000 7fb6b1ffb640 1 -- 172.21.15.33:0/3246264333 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a003f030 con 0x7fb6b4108170 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.932+0000 7fb6b1ffb640 1 -- 172.21.15.33:0/3246264333 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6a0003aa0 con 0x7fb6b4108170 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.932+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/3246264333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b419f380 con 0x7fb6b4108170 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.932+0000 7fb6b1ffb640 1 -- 172.21.15.33:0/3246264333 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0035070 con 0x7fb6b4108170 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.932+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/3246264333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b41a5b40 con 0x7fb6b4108170 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6b1ffb640 1 -- 172.21.15.33:0/3246264333 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb6a0042030 con 0x7fb6b4108170 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6c1656740 1 Processor -- start 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6c1656740 1 -- start start 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81c1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7df31b0 0x55ebc81c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7dfb390 0x55ebc81c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6c1656740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ebc8138680 con 0x55ebc7e1c070 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6c1656740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ebc8127c10 con 0x55ebc7dfb390 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6c1656740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ebc812bbc0 con 0x55ebc7df31b0 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6b967e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6b967e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81c1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59850/0 (socket says 172.21.15.33:59850) 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6b967e640 1 -- 172.21.15.33:0/4104395331 learned_addr learned my addr 172.21.15.33:0/4104395331 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/4104395331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7df31b0 0x55ebc81c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/4104395331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7dfb390 0x55ebc81c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6b967e640 1 -- 172.21.15.33:0/4104395331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7df31b0 msgr2=0x55ebc81c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.935+0000 7fb6b967e640 1 --2- 172.21.15.33:0/4104395331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7df31b0 0x55ebc81c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb6b967e640 1 -- 172.21.15.33:0/4104395331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7dfb390 msgr2=0x55ebc81c1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb6b967e640 1 --2- 172.21.15.33:0/4104395331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7dfb390 0x55ebc81c1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb6b967e640 1 -- 172.21.15.33:0/4104395331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc7e87650 con 0x55ebc7e1c070 2024-08-28T19:49:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/4104395331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7dfb390 0x55ebc81c1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb6b1ffb640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb6a40b4ca0 0x7fb6a40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb6a40b4ca0 0x7fb6a40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb6b967e640 1 --2- 172.21.15.33:0/4104395331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81c1310 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac008dc0 tx=0x7fb6ac00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5575300eab78ef98 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb6b1ffb640 1 -- 172.21.15.33:0/3246264333 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9541+0+0 (secure 0 0 0) 0x7fb6a0106110 con 0x7fb6b4108170 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb69effd640 1 -- 172.21.15.33:0/4104395331 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac014070 con 0x55ebc7e1c070 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb69effd640 1 -- 172.21.15.33:0/4104395331 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6ac003b70 con 0x55ebc7e1c070 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.936+0000 7fb69effd640 1 -- 172.21.15.33:0/4104395331 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac010700 con 0x55ebc7e1c070 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6c1656740 1 -- 172.21.15.33:0/4104395331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 msgr2=0x55ebc81c1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb6a40b4ca0 0x7fb6a40b71b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800bd20 tx=0x7fb6a800b4d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6c1656740 1 --2- 172.21.15.33:0/4104395331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81c1310 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac008dc0 tx=0x7fb6ac00e720 comp rx=0 tx=0).stop 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6c1656740 1 -- 172.21.15.33:0/4104395331 shutdown_connections 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6c1656740 1 --2- 172.21.15.33:0/4104395331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7dfb390 0x55ebc81c1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6c1656740 1 --2- 172.21.15.33:0/4104395331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7df31b0 0x55ebc81c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6c1656740 1 --2- 172.21.15.33:0/4104395331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81c1310 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6c1656740 1 -- 172.21.15.33:0/4104395331 >> 172.21.15.33:0/4104395331 conn(0x55ebc7e10460 msgr2=0x55ebc81bf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6c1656740 1 -- 172.21.15.33:0/4104395331 shutdown_connections 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6c1656740 1 -- 172.21.15.33:0/4104395331 wait complete. 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.937+0000 7fb6c1656740 1 -- start start 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6c1656740 1 Processor -- start 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7df31b0 0x55ebc81cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7e1c070 0x55ebc81dafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6c1656740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55ebc7f8a700 con 0x55ebc7dfb390 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6c1656740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ebc80ae750 con 0x55ebc7e1c070 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6c1656740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55ebc81d1c50 con 0x55ebc7df31b0 2024-08-28T19:49:12.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6c1656740 10 client.0 _ll_register_callbacks cb 0x55ebc80dde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59866/0 (socket says 172.21.15.33:59866) 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6b3fff640 1 -- 172.21.15.33:0/920800592 learned_addr learned my addr 172.21.15.33:0/920800592 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6b967e640 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7e1c070 0x55ebc81dafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.938+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7df31b0 0x55ebc81cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6b3fff640 1 -- 172.21.15.33:0/920800592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7df31b0 msgr2=0x55ebc81cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7df31b0 0x55ebc81cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6b3fff640 1 -- 172.21.15.33:0/920800592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7e1c070 msgr2=0x55ebc81dafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7e1c070 0x55ebc81dafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6b3fff640 1 -- 172.21.15.33:0/920800592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebc80e7900 con 0x55ebc7dfb390 2024-08-28T19:49:12.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81cf130 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0031440 tx=0x7fb6a002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a627c11e5f55f82 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb693fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb693fff640 1 -- 172.21.15.33:0/920800592 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0049070 con 0x55ebc7dfb390 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb693fff640 1 -- 172.21.15.33:0/920800592 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9541+0+0 (secure 0 0 0) 0x7fb6a00ef0b0 con 0x55ebc7dfb390 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6c1656740 1 -- 172.21.15.33:0/920800592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6ac003b70 con 0x55ebc7dfb390 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb693fff640 1 -- 172.21.15.33:0/920800592 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6a00d5060 con 0x55ebc7dfb390 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6c1656740 10 client.20001 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6c1656740 1 -- 172.21.15.33:0/920800592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ebc81dd9e0 con 0x55ebc7dfb390 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb693fff640 1 -- 172.21.15.33:0/920800592 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6ac003b70 con 0x55ebc7dfb390 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb693fff640 1 -- 172.21.15.33:0/920800592 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb6a01036e0 con 0x55ebc7dfb390 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6c1656740 10 client.20001 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6c1656740 10 client.20001 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:49:12.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.939+0000 7fb6c1656740 20 client.20001 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.940+0000 7fb6c1656740 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ebc7dda9f0 0x55ebc81e0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.940+0000 7fb6c1656740 4 client.20001 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.940+0000 7fb6c1656740 1 -- 172.21.15.33:0/920800592 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebc813a5d0 con 0x55ebc7dda9f0 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.940+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ebc7dda9f0 0x55ebc81e0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.940+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ebc7dda9f0 0x55ebc81e0e10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=784611949f4217b0 server_cookie=5c3fa03539611530 in_seq=0 out_seq=0 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.940+0000 7fb693fff640 10 client.20001 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb693fff640 1 -- 172.21.15.33:0/920800592 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ebc813a5d0 con 0x55ebc7dda9f0 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb693fff640 10 client.20001 handle_command_reply: tid=0 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb6c1656740 1 client.20001 shutdown 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb6c1656740 1 -- 172.21.15.33:0/920800592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 msgr2=0x55ebc81cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb6c1656740 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81cf130 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0031440 tx=0x7fb6a002a410 comp rx=0 tx=0).stop 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb6c1656740 1 -- 172.21.15.33:0/920800592 shutdown_connections 2024-08-28T19:49:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb6c1656740 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ebc7dda9f0 0x55ebc81e0e10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb6c1656740 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7e1c070 0x55ebc81dafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb6c1656740 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81cf130 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb693fff640 0 client.20001 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:49:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb6c1656740 1 --2- 172.21.15.33:0/920800592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7df31b0 0x55ebc81cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.941+0000 7fb6c1656740 1 -- 172.21.15.33:0/920800592 >> 172.21.15.33:0/920800592 conn(0x55ebc7e10460 msgr2=0x55ebc81bd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.942+0000 7fb6c1656740 1 -- 172.21.15.33:0/920800592 shutdown_connections 2024-08-28T19:49:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.942+0000 7fb6c1656740 1 -- 172.21.15.33:0/920800592 wait complete. 2024-08-28T19:49:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.942+0000 7fb6c1656740 20 client.20001 trim_cache size 0 max 16384 2024-08-28T19:49:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.955+0000 7fb6c1656740 1 Processor -- start 2024-08-28T19:49:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.955+0000 7fb6c1656740 1 -- start start 2024-08-28T19:49:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.955+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7df31b0 0x55ebc81daee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.955+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81beb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.955+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7e1c070 0x55ebc81bf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.955+0000 7fb6c1656740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41aeb90 con 0x55ebc7dfb390 2024-08-28T19:49:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.955+0000 7fb6c1656740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41b06d0 con 0x55ebc7df31b0 2024-08-28T19:49:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.955+0000 7fb6c1656740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41af260 con 0x55ebc7e1c070 2024-08-28T19:49:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.955+0000 7fb6b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81beb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.955+0000 7fb6b3fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81beb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59882/0 (socket says 172.21.15.33:59882) 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb6b3fff640 1 -- 172.21.15.33:0/3043119258 learned_addr learned my addr 172.21.15.33:0/3043119258 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb6b967e640 1 --2- 172.21.15.33:0/3043119258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7e1c070 0x55ebc81bf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/3043119258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7df31b0 0x55ebc81daee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb6b3fff640 1 -- 172.21.15.33:0/3043119258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7e1c070 msgr2=0x55ebc81bf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/3043119258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7e1c070 0x55ebc81bf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb6b3fff640 1 -- 172.21.15.33:0/3043119258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7df31b0 msgr2=0x55ebc81daee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/3043119258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7df31b0 0x55ebc81daee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb6b3fff640 1 -- 172.21.15.33:0/3043119258 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc81d1330 con 0x55ebc7dfb390 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/3043119258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81beb20 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00cc390 tx=0x7fb6a0003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489e796f95f479d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb69e7fc640 1 -- 172.21.15.33:0/3043119258 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00cbf10 con 0x55ebc7dfb390 2024-08-28T19:49:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb69e7fc640 1 -- 172.21.15.33:0/3043119258 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6a00ccb00 con 0x55ebc7dfb390 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.956+0000 7fb69e7fc640 1 -- 172.21.15.33:0/3043119258 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00d5290 con 0x55ebc7dfb390 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.957+0000 7fb6c1656740 1 -- 172.21.15.33:0/3043119258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 msgr2=0x55ebc81beb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.957+0000 7fb6c1656740 1 --2- 172.21.15.33:0/3043119258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81beb20 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00cc390 tx=0x7fb6a0003e60 comp rx=0 tx=0).stop 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.957+0000 7fb6c1656740 1 -- 172.21.15.33:0/3043119258 shutdown_connections 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.957+0000 7fb6c1656740 1 --2- 172.21.15.33:0/3043119258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7e1c070 0x55ebc81bf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.957+0000 7fb6c1656740 1 --2- 172.21.15.33:0/3043119258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7dfb390 0x55ebc81beb20 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.957+0000 7fb6c1656740 1 --2- 172.21.15.33:0/3043119258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7df31b0 0x55ebc81daee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.957+0000 7fb6c1656740 1 -- 172.21.15.33:0/3043119258 >> 172.21.15.33:0/3043119258 conn(0x55ebc7e10460 msgr2=0x55ebc81cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.957+0000 7fb6c1656740 1 -- 172.21.15.33:0/3043119258 shutdown_connections 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.957+0000 7fb6c1656740 1 -- 172.21.15.33:0/3043119258 wait complete. 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.957+0000 7fb6c1656740 1 -- start start 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6c1656740 1 Processor -- start 2024-08-28T19:49:12.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7df31b0 0x55ebc81d7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7dfb390 0x55ebc81d7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6c1656740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6c1656740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41b0000 con 0x55ebc7e1c070 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6c1656740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41af930 con 0x55ebc7df31b0 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6c1656740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b41acb90 con 0x55ebc7dfb390 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6c1656740 10 client.0 _ll_register_callbacks cb 0x7fb6a0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6b967e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6b967e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81d1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59886/0 (socket says 172.21.15.33:59886) 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6b967e640 1 -- 172.21.15.33:0/2854682863 learned_addr learned my addr 172.21.15.33:0/2854682863 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7df31b0 0x55ebc81d7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.958+0000 7fb6b3fff640 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7dfb390 0x55ebc81d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb6b967e640 1 -- 172.21.15.33:0/2854682863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7dfb390 msgr2=0x55ebc81d7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb6b967e640 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7dfb390 0x55ebc81d7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb6b967e640 1 -- 172.21.15.33:0/2854682863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7df31b0 msgr2=0x55ebc81d7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb6b967e640 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7df31b0 0x55ebc81d7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb6b967e640 1 -- 172.21.15.33:0/2854682863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebc81d2710 con 0x55ebc7e1c070 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb6b967e640 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81d1f80 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac000f80 tx=0x7fb6ac010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcc5038ca1e1459 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb693fff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb693fff640 1 -- 172.21.15.33:0/2854682863 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac014040 con 0x55ebc7e1c070 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb693fff640 1 -- 172.21.15.33:0/2854682863 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9541+0+0 (secure 0 0 0) 0x7fb6ac025650 con 0x55ebc7e1c070 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb6c1656740 1 -- 172.21.15.33:0/2854682863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6a00ccb00 con 0x55ebc7e1c070 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb693fff640 1 -- 172.21.15.33:0/2854682863 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb6ac033050 con 0x55ebc7e1c070 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb6c1656740 10 client.20007 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:12.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb6c1656740 1 -- 172.21.15.33:0/2854682863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ebc824c230 con 0x55ebc7e1c070 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.959+0000 7fb693fff640 1 -- 172.21.15.33:0/2854682863 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6a00ccb00 con 0x55ebc7e1c070 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.960+0000 7fb693fff640 1 -- 172.21.15.33:0/2854682863 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb6ac0186e0 con 0x55ebc7e1c070 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.960+0000 7fb6c1656740 10 client.20007 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.960+0000 7fb6c1656740 10 client.20007 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.960+0000 7fb6c1656740 20 client.20007 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.960+0000 7fb6c1656740 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ebc7dafda0 0x55ebc824e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.960+0000 7fb6c1656740 4 client.20007 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.960+0000 7fb6c1656740 1 -- 172.21.15.33:0/2854682863 --> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ebc8136070 con 0x55ebc7dafda0 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.960+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ebc7dafda0 0x55ebc824e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.960+0000 7fb693fff640 10 client.20007 ms_handle_connect on v2:172.21.15.122:6834/364668654 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.960+0000 7fb6b8e7d640 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ebc7dafda0 0x55ebc824e6d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=379b860fa88facf7 server_cookie=ad9c2a6398d7ea88 in_seq=0 out_seq=0 2024-08-28T19:49:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb693fff640 1 -- 172.21.15.33:0/2854682863 <== mds.3 v2:172.21.15.122:6834/364668654 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ebc8136070 con 0x55ebc7dafda0 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb693fff640 10 client.20007 handle_command_reply: tid=0 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 client.20007 shutdown 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 -- 172.21.15.33:0/2854682863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 msgr2=0x55ebc81d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81d1f80 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac000f80 tx=0x7fb6ac010b80 comp rx=0 tx=0).stop 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 -- 172.21.15.33:0/2854682863 shutdown_connections 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.122:6834/364668654,v1:172.21.15.122:6835/364668654] conn(0x55ebc7dafda0 0x55ebc824e6d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ebc7e1c070 0x55ebc81d1f80 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55ebc7dfb390 0x55ebc81d7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 --2- 172.21.15.33:0/2854682863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ebc7df31b0 0x55ebc81d7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 -- 172.21.15.33:0/2854682863 >> 172.21.15.33:0/2854682863 conn(0x55ebc7e10460 msgr2=0x55ebc81be9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb693fff640 0 client.20007 ms_handle_reset on v2:172.21.15.122:6834/364668654 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 -- 172.21.15.33:0/2854682863 shutdown_connections 2024-08-28T19:49:12.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 1 -- 172.21.15.33:0/2854682863 wait complete. 2024-08-28T19:49:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.961+0000 7fb6c1656740 20 client.20007 trim_cache size 0 max 16384 2024-08-28T19:49:12.970 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:49:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/3246264333 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb6a40b4ca0 msgr2=0x7fb6a40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb6a40b4ca0 0x7fb6a40b71b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800bd20 tx=0x7fb6a800b4d0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/3246264333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b4108170 msgr2=0x7fb6b4199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b4108170 0x7fb6b4199720 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fb6a002a930 tx=0x7fb6a0004270 comp rx=0 tx=0).stop 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/3246264333 shutdown_connections 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b4108ac0 0x7fb6b419e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b4108170 0x7fb6b4199720 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb6a40b4ca0 0x7fb6a40b71b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 --2- 172.21.15.33:0/3246264333 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb6b4102880 0x7fb6b4199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/3246264333 >> 172.21.15.33:0/3246264333 conn(0x7fb6b4079550 msgr2=0x7fb6b4106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/3246264333 shutdown_connections 2024-08-28T19:49:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:12.962+0000 7fb6bb0e1640 1 -- 172.21.15.33:0/3246264333 wait complete. 2024-08-28T19:49:13.533 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:13 smithi059 ceph-mon[22052]: pgmap v866: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 62 KiB/s wr, 34 op/s 2024-08-28T19:49:13.543 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:13 smithi122 ceph-mon[22174]: pgmap v866: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 62 KiB/s wr, 34 op/s 2024-08-28T19:49:13.612 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:13 smithi033 ceph-mon[18549]: pgmap v866: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 62 KiB/s wr, 34 op/s 2024-08-28T19:49:13.642 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-28T19:49:13.899 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.415+0000 7fb4db632640 1 -- 172.21.15.33:0/3573987289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4d4103900 msgr2=0x7fb4d4103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.415+0000 7fb4db632640 1 --2- 172.21.15.33:0/3573987289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4d4103900 0x7fb4d4103d10 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009900 tx=0x7fb4d002a410 comp rx=0 tx=0).stop 2024-08-28T19:49:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.415+0000 7fb4db632640 1 -- 172.21.15.33:0/3573987289 shutdown_connections 2024-08-28T19:49:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.415+0000 7fb4db632640 1 --2- 172.21.15.33:0/3573987289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4d4109b90 0x7fb4d41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.415+0000 7fb4db632640 1 --2- 172.21.15.33:0/3573987289 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4d4109240 0x7fb4d4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.415+0000 7fb4db632640 1 --2- 172.21.15.33:0/3573987289 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4d4103900 0x7fb4d4103d10 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.415+0000 7fb4db632640 1 -- 172.21.15.33:0/3573987289 >> 172.21.15.33:0/3573987289 conn(0x7fb4d407b5f0 msgr2=0x7fb4d407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.415+0000 7fb4db632640 1 -- 172.21.15.33:0/3573987289 shutdown_connections 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.415+0000 7fb4db632640 1 -- 172.21.15.33:0/3573987289 wait complete. 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4db632640 1 Processor -- start 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4db632640 1 -- start start 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4db632640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4d4103900 0x7fb4d419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4db632640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4d4109240 0x7fb4d419a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4db632640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4d4109b90 0x7fb4d419fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4db632640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d4113850 con 0x7fb4d4109240 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4db632640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d41136d0 con 0x7fb4d4109b90 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4db632640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d41139d0 con 0x7fb4d4103900 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d8bcd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4d4109240 0x7fb4d419a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d8bcd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4d4109240 0x7fb4d419a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59900/0 (socket says 172.21.15.33:59900) 2024-08-28T19:49:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d8bcd640 1 -- 172.21.15.33:0/1629902225 learned_addr learned my addr 172.21.15.33:0/1629902225 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4d4103900 0x7fb4d419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d9bcf640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4d4109b90 0x7fb4d419fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d8bcd640 1 -- 172.21.15.33:0/1629902225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4d4103900 msgr2=0x7fb4d419a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4d4103900 0x7fb4d419a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d8bcd640 1 -- 172.21.15.33:0/1629902225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4d4109b90 msgr2=0x7fb4d419fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4d4109b90 0x7fb4d419fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d8bcd640 1 -- 172.21.15.33:0/1629902225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d41a0230 con 0x7fb4d4109240 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.416+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4d4109240 0x7fb4d419a860 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400d750 tx=0x7fb4c400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.417+0000 7fb4ca7fc640 1 -- 172.21.15.33:0/1629902225 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4017070 con 0x7fb4d4109240 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.417+0000 7fb4ca7fc640 1 -- 172.21.15.33:0/1629902225 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4c40054d0 con 0x7fb4d4109240 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.417+0000 7fb4db632640 1 -- 172.21.15.33:0/1629902225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d41a0520 con 0x7fb4d4109240 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.417+0000 7fb4ca7fc640 1 -- 172.21.15.33:0/1629902225 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4004c30 con 0x7fb4d4109240 2024-08-28T19:49:14.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.417+0000 7fb4db632640 1 -- 172.21.15.33:0/1629902225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d41a6c80 con 0x7fb4d4109240 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.419+0000 7fb4e1ba7740 1 Processor -- start 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.419+0000 7fb4ca7fc640 1 -- 172.21.15.33:0/1629902225 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb4c4004dd0 con 0x7fb4d4109240 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4e1ba7740 1 -- start start 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57d7070 0x55e0b5b7c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57b6390 0x55e0b5b7cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e0b5af3680 con 0x55e0b57ae1b0 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0b5ae2c10 con 0x55e0b57b6390 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e0b5ae6bc0 con 0x55e0b57d7070 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4d93ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4d9bcf640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57d7070 0x55e0b5b7c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4d93ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59914/0 (socket says 172.21.15.33:59914) 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4d93ce640 1 -- 172.21.15.33:0/1222426040 learned_addr learned my addr 172.21.15.33:0/1222426040 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/1222426040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57b6390 0x55e0b5b7cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4d93ce640 1 -- 172.21.15.33:0/1222426040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57d7070 msgr2=0x55e0b5b7c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/1222426040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57d7070 0x55e0b5b7c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4d93ce640 1 -- 172.21.15.33:0/1222426040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57b6390 msgr2=0x55e0b5b7cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/1222426040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57b6390 0x55e0b5b7cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4d93ce640 1 -- 172.21.15.33:0/1222426040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0b5842650 con 0x55e0b57ae1b0 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.420+0000 7fb4ca7fc640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb4c00b4d20 0x7fb4c00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.421+0000 7fb4d9bcf640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb4c00b4d20 0x7fb4c00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.421+0000 7fb4ca7fc640 1 -- 172.21.15.33:0/1629902225 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9541+0+0 (secure 0 0 0) 0x7fb4c40e5380 con 0x7fb4d4109240 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.421+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/1222426040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7c890 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fb4d002a930 tx=0x7fb4d0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63a2d589208c0e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.421+0000 7fb4bf7fe640 1 -- 172.21.15.33:0/1222426040 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d003f070 con 0x55e0b57ae1b0 2024-08-28T19:49:14.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.421+0000 7fb4bf7fe640 1 -- 172.21.15.33:0/1222426040 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4d00316a0 con 0x55e0b57ae1b0 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.421+0000 7fb4bf7fe640 1 -- 172.21.15.33:0/1222426040 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0035070 con 0x55e0b57ae1b0 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/1222426040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 msgr2=0x55e0b5b7c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/1222426040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7c890 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fb4d002a930 tx=0x7fb4d0032ce0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4d9bcf640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb4c00b4d20 0x7fb4c00b7230 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00be10 tx=0x7fb4cc00b560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/1222426040 shutdown_connections 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/1222426040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57b6390 0x55e0b5b7cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/1222426040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7c890 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/1222426040 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57d7070 0x55e0b5b7c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/1222426040 >> 172.21.15.33:0/1222426040 conn(0x55e0b57cb460 msgr2=0x55e0b5b7a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/1222426040 shutdown_connections 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/1222426040 wait complete. 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.422+0000 7fb4e1ba7740 1 -- start start 2024-08-28T19:49:14.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.423+0000 7fb4e1ba7740 1 Processor -- start 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.423+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b87ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.423+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57b6390 0x55e0b5b87ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 0x55e0b5b93df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x55e0b5945700 con 0x55e0b57ae1b0 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0b5a69750 con 0x55e0b57d7070 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d93ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b87ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x55e0b5b8aad0 con 0x55e0b57b6390 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d93ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b87ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59924/0 (socket says 172.21.15.33:59924) 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d93ce640 1 -- 172.21.15.33:0/2272452722 learned_addr learned my addr 172.21.15.33:0/2272452722 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d9bcf640 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 0x55e0b5b93df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57b6390 0x55e0b5b87ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4e1ba7740 10 client.0 _ll_register_callbacks cb 0x55e0b5a98e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d93ce640 1 -- 172.21.15.33:0/2272452722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57b6390 msgr2=0x55e0b5b87ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57b6390 0x55e0b5b87ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d93ce640 1 -- 172.21.15.33:0/2272452722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 msgr2=0x55e0b5b93df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 0x55e0b5b93df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d93ce640 1 -- 172.21.15.33:0/2272452722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0b5aa2900 con 0x55e0b57ae1b0 2024-08-28T19:49:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.424+0000 7fb4d9bcf640 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 0x55e0b5b93df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b87ab0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0005270 tx=0x7fb4d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddad677cd0185502 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4bcff9640 1 -- 172.21.15.33:0/2272452722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d004a020 con 0x55e0b57ae1b0 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4bcff9640 1 -- 172.21.15.33:0/2272452722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9541+0+0 (secure 0 0 0) 0x7fb4d00035f0 con 0x55e0b57ae1b0 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/2272452722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4d00316a0 con 0x55e0b57ae1b0 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4bcff9640 1 -- 172.21.15.33:0/2272452722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb4d0055050 con 0x55e0b57ae1b0 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4e1ba7740 10 client.20019 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/2272452722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0b5b96850 con 0x55e0b57ae1b0 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4bcff9640 1 -- 172.21.15.33:0/2272452722 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4d00316a0 con 0x55e0b57ae1b0 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4bcff9640 1 -- 172.21.15.33:0/2272452722 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb4d0004aa0 con 0x55e0b57ae1b0 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4e1ba7740 10 client.20019 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.425+0000 7fb4e1ba7740 10 client.20019 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.426+0000 7fb4e1ba7740 20 client.20019 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.426+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e0b57959f0 0x55e0b5b99bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.426+0000 7fb4e1ba7740 4 client.20019 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:49:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.426+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/2272452722 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0b5af55d0 con 0x55e0b57959f0 2024-08-28T19:49:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.426+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e0b57959f0 0x55e0b5b99bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.426+0000 7fb4bcff9640 10 client.20019 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:49:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.426+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e0b57959f0 0x55e0b5b99bb0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=acd8fc0cffb6413f server_cookie=bb7fb6a10d61fb0e in_seq=0 out_seq=0 2024-08-28T19:49:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4bcff9640 1 -- 172.21.15.33:0/2272452722 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0b5af55d0 con 0x55e0b57959f0 2024-08-28T19:49:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4bcff9640 10 client.20019 handle_command_reply: tid=0 2024-08-28T19:49:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4e1ba7740 1 client.20019 shutdown 2024-08-28T19:49:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/2272452722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 msgr2=0x55e0b5b87ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b87ab0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0005270 tx=0x7fb4d00042f0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/2272452722 shutdown_connections 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 0x55e0b5b93df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57b6390 0x55e0b5b87ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e0b57959f0 0x55e0b5b99bb0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/2272452722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b87ab0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/2272452722 >> 172.21.15.33:0/2272452722 conn(0x55e0b57cb460 msgr2=0x55e0b5b7f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.427+0000 7fb4bcff9640 0 client.20019 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.428+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/2272452722 shutdown_connections 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.428+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/2272452722 wait complete. 2024-08-28T19:49:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.428+0000 7fb4e1ba7740 20 client.20019 trim_cache size 0 max 16384 2024-08-28T19:49:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4e1ba7740 1 Processor -- start 2024-08-28T19:49:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4e1ba7740 1 -- start start 2024-08-28T19:49:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57b6390 0x55e0b5b7f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57d7070 0x55e0b5b84ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d41b0ce0 con 0x55e0b57ae1b0 2024-08-28T19:49:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d41b2820 con 0x55e0b57b6390 2024-08-28T19:49:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d41b13b0 con 0x55e0b57d7070 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4d93ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4d93ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59930/0 (socket says 172.21.15.33:59930) 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4d93ce640 1 -- 172.21.15.33:0/3963633000 learned_addr learned my addr 172.21.15.33:0/3963633000 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.441+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/3963633000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57b6390 0x55e0b5b7f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.442+0000 7fb4d9bcf640 1 --2- 172.21.15.33:0/3963633000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57d7070 0x55e0b5b84ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.442+0000 7fb4d93ce640 1 -- 172.21.15.33:0/3963633000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57d7070 msgr2=0x55e0b5b84ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.442+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/3963633000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57d7070 0x55e0b5b84ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.442+0000 7fb4d93ce640 1 -- 172.21.15.33:0/3963633000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57b6390 msgr2=0x55e0b5b7f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.442+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/3963633000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57b6390 0x55e0b5b7f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.442+0000 7fb4d93ce640 1 -- 172.21.15.33:0/3963633000 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0b5b8a660 con 0x55e0b57ae1b0 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.442+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/3963633000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7f450 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fb4d002a930 tx=0x7fb4d0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6477700ea8df7efd server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.442+0000 7fb4beffd640 1 -- 172.21.15.33:0/3963633000 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d004a070 con 0x55e0b57ae1b0 2024-08-28T19:49:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.442+0000 7fb4beffd640 1 -- 172.21.15.33:0/3963633000 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4d0032ce0 con 0x55e0b57ae1b0 2024-08-28T19:49:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.442+0000 7fb4beffd640 1 -- 172.21.15.33:0/3963633000 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d003f070 con 0x55e0b57ae1b0 2024-08-28T19:49:14.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.443+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3963633000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 msgr2=0x55e0b5b7f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.443+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/3963633000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7f450 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fb4d002a930 tx=0x7fb4d0005780 comp rx=0 tx=0).stop 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.443+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3963633000 shutdown_connections 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.443+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/3963633000 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57d7070 0x55e0b5b84ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.443+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/3963633000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57b6390 0x55e0b5b7f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.443+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/3963633000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b7f450 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.443+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3963633000 >> 172.21.15.33:0/3963633000 conn(0x55e0b57cb460 msgr2=0x55e0b5b86330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.443+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3963633000 shutdown_connections 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.443+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3963633000 wait complete. 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.443+0000 7fb4e1ba7740 1 -- start start 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4e1ba7740 1 Processor -- start 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b9ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57b6390 0x55e0b5b9b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4e1ba7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 0x55e0b5b9b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d41b2150 con 0x55e0b57b6390 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d41b1a80 con 0x55e0b57d7070 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4e1ba7740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d41aece0 con 0x55e0b57ae1b0 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4e1ba7740 10 client.0 _ll_register_callbacks cb 0x7fb4cc00b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4d8bcd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57b6390 0x55e0b5b9b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4d8bcd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57b6390 0x55e0b5b9b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59940/0 (socket says 172.21.15.33:59940) 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4d8bcd640 1 -- 172.21.15.33:0/3423954466 learned_addr learned my addr 172.21.15.33:0/3423954466 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b9ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4d8bcd640 1 -- 172.21.15.33:0/3423954466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57ae1b0 msgr2=0x55e0b5b9ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b9ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4d9bcf640 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 0x55e0b5b9b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4d8bcd640 1 -- 172.21.15.33:0/3423954466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 msgr2=0x55e0b5b9b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 0x55e0b5b9b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.444+0000 7fb4d8bcd640 1 -- 172.21.15.33:0/3423954466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0b5c03330 con 0x55e0b57b6390 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b9ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4d8bcd640 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57b6390 0x55e0b5b9b0c0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400d720 tx=0x7fb4c4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33f55ec19494edc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4bcff9640 1 -- 172.21.15.33:0/3423954466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4020040 con 0x55e0b57b6390 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4bcff9640 1 -- 172.21.15.33:0/3423954466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9541+0+0 (secure 0 0 0) 0x7fb4c4005680 con 0x55e0b57b6390 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3423954466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4d0032ce0 con 0x55e0b57b6390 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4bcff9640 1 -- 172.21.15.33:0/3423954466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb4c40afee0 con 0x55e0b57b6390 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4e1ba7740 10 client.20025 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3423954466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0b5c089c0 con 0x55e0b57b6390 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4bcff9640 1 -- 172.21.15.33:0/3423954466 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4d0032ce0 con 0x55e0b57b6390 2024-08-28T19:49:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.445+0000 7fb4bcff9640 1 -- 172.21.15.33:0/3423954466 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb4c405b1a0 con 0x55e0b57b6390 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.446+0000 7fb4e1ba7740 10 client.20025 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.446+0000 7fb4e1ba7740 10 client.20025 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.446+0000 7fb4e1ba7740 20 client.20025 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.446+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e0b576ada0 0x55e0b5c0b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.446+0000 7fb4e1ba7740 4 client.20025 mds_command: new command op to 24643 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.446+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3423954466 --> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e0b5af1070 con 0x55e0b576ada0 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.446+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e0b576ada0 0x55e0b5c0b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.446+0000 7fb4bcff9640 10 client.20025 ms_handle_connect on v2:172.21.15.122:6836/3665976487 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.446+0000 7fb4d93ce640 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e0b576ada0 0x55e0b5c0b100 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f09a28dbef7c2c87 server_cookie=3b9884a0c5f579f8 in_seq=0 out_seq=0 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4bcff9640 1 -- 172.21.15.33:0/3423954466 <== mds.2 v2:172.21.15.122:6836/3665976487 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e0b5af1070 con 0x55e0b576ada0 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4bcff9640 10 client.20025 handle_command_reply: tid=0 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 client.20025 shutdown 2024-08-28T19:49:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3423954466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57b6390 msgr2=0x55e0b5b9b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57b6390 0x55e0b5b9b0c0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400d720 tx=0x7fb4c4009f90 comp rx=0 tx=0).stop 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3423954466 shutdown_connections 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0b57d7070 0x55e0b5b9b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.122:6836/3665976487,v1:172.21.15.122:6837/3665976487] conn(0x55e0b576ada0 0x55e0b5c0b100 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e0b57b6390 0x55e0b5b9b0c0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 --2- 172.21.15.33:0/3423954466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55e0b57ae1b0 0x55e0b5b9ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3423954466 >> 172.21.15.33:0/3423954466 conn(0x55e0b57cb460 msgr2=0x55e0b5b7f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4bcff9640 0 client.20025 ms_handle_reset on v2:172.21.15.122:6836/3665976487 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3423954466 shutdown_connections 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 1 -- 172.21.15.33:0/3423954466 wait complete. 2024-08-28T19:49:14.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.447+0000 7fb4e1ba7740 20 client.20025 trim_cache size 0 max 16384 2024-08-28T19:49:14.455 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:49:14.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 -- 172.21.15.33:0/1629902225 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb4c00b4d20 msgr2=0x7fb4c00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:14.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb4c00b4d20 0x7fb4c00b7230 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00be10 tx=0x7fb4cc00b560 comp rx=0 tx=0).stop 2024-08-28T19:49:14.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 -- 172.21.15.33:0/1629902225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4d4109240 msgr2=0x7fb4d419a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:14.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4d4109240 0x7fb4d419a860 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400d750 tx=0x7fb4c400dc10 comp rx=0 tx=0).stop 2024-08-28T19:49:14.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 -- 172.21.15.33:0/1629902225 shutdown_connections 2024-08-28T19:49:14.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4d4109b90 0x7fb4d419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4d4109240 0x7fb4d419a860 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb4c00b4d20 0x7fb4c00b7230 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 --2- 172.21.15.33:0/1629902225 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb4d4103900 0x7fb4d419a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:14.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 -- 172.21.15.33:0/1629902225 >> 172.21.15.33:0/1629902225 conn(0x7fb4d407b5f0 msgr2=0x7fb4d4107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:14.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 -- 172.21.15.33:0/1629902225 shutdown_connections 2024-08-28T19:49:14.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:14.448+0000 7fb4db632640 1 -- 172.21.15.33:0/1629902225 wait complete. 2024-08-28T19:49:15.193 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-28T19:49:15.449 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:15.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:15 smithi033 ceph-mon[18549]: pgmap v867: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.5 KiB/s wr, 13 op/s 2024-08-28T19:49:15.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:15 smithi033 ceph-mon[18549]: osdmap e106: 12 total, 12 up, 12 in 2024-08-28T19:49:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.995+0000 7fd8ed454640 1 -- 172.21.15.33:0/3202301167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8e8075e20 msgr2=0x7fd8e810f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.995+0000 7fd8ed454640 1 --2- 172.21.15.33:0/3202301167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8e8075e20 0x7fd8e810f9a0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009900 tx=0x7fd8d002a410 comp rx=0 tx=0).stop 2024-08-28T19:49:16.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.995+0000 7fd8ed454640 1 -- 172.21.15.33:0/3202301167 shutdown_connections 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.995+0000 7fd8ed454640 1 --2- 172.21.15.33:0/3202301167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e810fee0 0x7fd8e8112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.995+0000 7fd8ed454640 1 --2- 172.21.15.33:0/3202301167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8e8075e20 0x7fd8e810f9a0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.995+0000 7fd8ed454640 1 --2- 172.21.15.33:0/3202301167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e80754d0 0x7fd8e80758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.995+0000 7fd8ed454640 1 -- 172.21.15.33:0/3202301167 >> 172.21.15.33:0/3202301167 conn(0x7fd8e807b5f0 msgr2=0x7fd8e807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.995+0000 7fd8ed454640 1 -- 172.21.15.33:0/3202301167 shutdown_connections 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.995+0000 7fd8ed454640 1 -- 172.21.15.33:0/3202301167 wait complete. 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8ed454640 1 Processor -- start 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8ed454640 1 -- start start 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8ed454640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8e80754d0 0x7fd8e819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8ed454640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e8075e20 0x7fd8e819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8ed454640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e810fee0 0x7fd8e81a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8ed454640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e8115ae0 con 0x7fd8e80754d0 2024-08-28T19:49:16.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8ed454640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e8115960 con 0x7fd8e8075e20 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8ed454640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e8115c60 con 0x7fd8e810fee0 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8e6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8e80754d0 0x7fd8e819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8e6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8e80754d0 0x7fd8e819c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59944/0 (socket says 172.21.15.33:59944) 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/1026693454 learned_addr learned my addr 172.21.15.33:0/1026693454 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8dffff640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e8075e20 0x7fd8e819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8e77fe640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e810fee0 0x7fd8e81a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/1026693454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e810fee0 msgr2=0x7fd8e81a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e810fee0 0x7fd8e81a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/1026693454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e8075e20 msgr2=0x7fd8e819cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e8075e20 0x7fd8e819cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.996+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/1026693454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e81a2500 con 0x7fd8e80754d0 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.997+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8e80754d0 0x7fd8e819c590 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800b4a0 tx=0x7fd8d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.997+0000 7fd8e4ff9640 1 -- 172.21.15.33:0/1026693454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8014070 con 0x7fd8e80754d0 2024-08-28T19:49:16.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.997+0000 7fd8e4ff9640 1 -- 172.21.15.33:0/1026693454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d8010ac0 con 0x7fd8e80754d0 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.997+0000 7fd8e4ff9640 1 -- 172.21.15.33:0/1026693454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8017c30 con 0x7fd8e80754d0 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.997+0000 7fd8ed454640 1 -- 172.21.15.33:0/1026693454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e81a27f0 con 0x7fd8e80754d0 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.997+0000 7fd8ed454640 1 -- 172.21.15.33:0/1026693454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e81a8f50 con 0x7fd8e80754d0 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:15.999+0000 7fd8f39c9740 1 Processor -- start 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8f39c9740 1 -- start start 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8e4ff9640 1 -- 172.21.15.33:0/1026693454 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd8d8017070 con 0x7fd8e80754d0 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438fd070 0x559c43ca2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438d41b0 0x559c43ca2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43ca2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559c43c19680 con 0x559c438fd070 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559c43c08c10 con 0x559c438d41b0 2024-08-28T19:49:16.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559c43c0cbc0 con 0x559c438dc390 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8e77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438fd070 0x559c43ca2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8e77fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438fd070 0x559c43ca2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59960/0 (socket says 172.21.15.33:59960) 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8e77fe640 1 -- 172.21.15.33:0/2242630901 learned_addr learned my addr 172.21.15.33:0/2242630901 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/2242630901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438d41b0 0x559c43ca2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.000+0000 7fd8dffff640 1 --2- 172.21.15.33:0/2242630901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43ca2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8e77fe640 1 -- 172.21.15.33:0/2242630901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 msgr2=0x559c43ca2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8e77fe640 1 --2- 172.21.15.33:0/2242630901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43ca2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8e77fe640 1 -- 172.21.15.33:0/2242630901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438d41b0 msgr2=0x559c43ca2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8e77fe640 1 --2- 172.21.15.33:0/2242630901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438d41b0 0x559c43ca2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8e77fe640 1 -- 172.21.15.33:0/2242630901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c43968650 con 0x559c438fd070 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8e4ff9640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8d40b4ca0 0x7fd8d40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8dffff640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8d40b4ca0 0x7fd8d40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8e4ff9640 1 -- 172.21.15.33:0/1026693454 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7fd8d80e4ea0 con 0x7fd8e80754d0 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8e77fe640 1 --2- 172.21.15.33:0/2242630901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438fd070 0x559c43ca2350 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009f20 tx=0x7fd8e000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610a818aed54fd51 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8dd7fa640 1 -- 172.21.15.33:0/2242630901 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e001a070 con 0x559c438fd070 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8dd7fa640 1 -- 172.21.15.33:0/2242630901 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8e00158c0 con 0x559c438fd070 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.001+0000 7fd8dd7fa640 1 -- 172.21.15.33:0/2242630901 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e000a820 con 0x559c438fd070 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.002+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2242630901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438fd070 msgr2=0x559c43ca2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.002+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/2242630901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438fd070 0x559c43ca2350 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009f20 tx=0x7fd8e000c8b0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.002+0000 7fd8dffff640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8d40b4ca0 0x7fd8d40b71b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009230 tx=0x7fd8d0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.002+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2242630901 shutdown_connections 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.002+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/2242630901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43ca2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.002+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/2242630901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438d41b0 0x559c43ca2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.002+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/2242630901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438fd070 0x559c43ca2350 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.002+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2242630901 >> 172.21.15.33:0/2242630901 conn(0x559c438f1460 msgr2=0x559c43ca0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:16.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.002+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2242630901 shutdown_connections 2024-08-28T19:49:16.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.002+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2242630901 wait complete. 2024-08-28T19:49:16.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8f39c9740 1 -- start start 2024-08-28T19:49:16.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8f39c9740 1 Processor -- start 2024-08-28T19:49:16.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cadad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43cb9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x559c43a6b700 con 0x559c438d41b0 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559c43b8f750 con 0x559c438fd070 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x559c43cb0b30 con 0x559c438dc390 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8f39c9740 10 client.0 _ll_register_callbacks cb 0x559c43bbee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8e6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cadad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8e6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cadad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59968/0 (socket says 172.21.15.33:59968) 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/4157889463 learned_addr learned my addr 172.21.15.33:0/4157889463 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8e77fe640 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43cb9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8dffff640 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/4157889463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 msgr2=0x559c43cae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/4157889463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 msgr2=0x559c43cb9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43cb9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/4157889463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c43bc8900 con 0x559c438d41b0 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.003+0000 7fd8dffff640 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cadad0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800be60 tx=0x7fd8d80ab080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc448d4f00231424 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/4157889463 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d801e070 con 0x559c438d41b0 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/4157889463 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7fd8d80e24d0 con 0x559c438d41b0 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8f39c9740 1 -- 172.21.15.33:0/4157889463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e00158c0 con 0x559c438d41b0 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/4157889463 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd8d8017360 con 0x559c438d41b0 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8f39c9740 10 client.20037 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8f39c9740 1 -- 172.21.15.33:0/4157889463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559c43cbc900 con 0x559c438d41b0 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/4157889463 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8e00158c0 con 0x559c438d41b0 2024-08-28T19:49:16.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/4157889463 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd8d80a7480 con 0x559c438d41b0 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8f39c9740 10 client.20037 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8f39c9740 10 client.20037 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.004+0000 7fd8f39c9740 20 client.20037 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.005+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559c438bb9f0 0x559c43cbfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.005+0000 7fd8f39c9740 4 client.20037 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.005+0000 7fd8f39c9740 1 -- 172.21.15.33:0/4157889463 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c43c1b5d0 con 0x559c438bb9f0 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.005+0000 7fd8dffff640 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559c438bb9f0 0x559c43cbfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.005+0000 7fd8ce7fc640 10 client.20037 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.005+0000 7fd8dffff640 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559c438bb9f0 0x559c43cbfdf0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d1b03d45cc58a7e server_cookie=ec36859e2e263e1a in_seq=0 out_seq=0 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/4157889463 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c43c1b5d0 con 0x559c438bb9f0 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8ce7fc640 10 client.20037 handle_command_reply: tid=0 2024-08-28T19:49:16.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 client.20037 shutdown 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 -- 172.21.15.33:0/4157889463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 msgr2=0x559c43cadad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cadad0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800be60 tx=0x7fd8d80ab080 comp rx=0 tx=0).stop 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 -- 172.21.15.33:0/4157889463 shutdown_connections 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559c438bb9f0 0x559c43cbfdf0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43cb9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8ce7fc640 0 client.20037 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/4157889463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cadad0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 -- 172.21.15.33:0/4157889463 >> 172.21.15.33:0/4157889463 conn(0x559c438f1460 msgr2=0x559c43ca5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 -- 172.21.15.33:0/4157889463 shutdown_connections 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.006+0000 7fd8f39c9740 1 -- 172.21.15.33:0/4157889463 wait complete. 2024-08-28T19:49:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.007+0000 7fd8f39c9740 20 client.20037 trim_cache size 0 max 16384 2024-08-28T19:49:16.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8f39c9740 1 Processor -- start 2024-08-28T19:49:16.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8f39c9740 1 -- start start 2024-08-28T19:49:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43ca0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cb9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43ca5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e81b2ec0 con 0x559c438d41b0 2024-08-28T19:49:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e81b4a00 con 0x559c438fd070 2024-08-28T19:49:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e81b3590 con 0x559c438dc390 2024-08-28T19:49:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8e6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43ca0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8e6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43ca0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59980/0 (socket says 172.21.15.33:59980) 2024-08-28T19:49:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.021+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/540658072 learned_addr learned my addr 172.21.15.33:0/540658072 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8dffff640 1 --2- 172.21.15.33:0/540658072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cb9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8e77fe640 1 --2- 172.21.15.33:0/540658072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43ca5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/540658072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 msgr2=0x559c43cb9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/540658072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cb9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/540658072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 msgr2=0x559c43ca5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/540658072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43ca5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/540658072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c43caed90 con 0x559c438d41b0 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8e77fe640 1 --2- 172.21.15.33:0/540658072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43ca5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/540658072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43ca0340 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80aaef0 tx=0x7fd8d800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43122ac1af22abd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8dcff9640 1 -- 172.21.15.33:0/540658072 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d801e070 con 0x559c438d41b0 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8dcff9640 1 -- 172.21.15.33:0/540658072 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d80aad00 con 0x559c438d41b0 2024-08-28T19:49:16.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.022+0000 7fd8dcff9640 1 -- 172.21.15.33:0/540658072 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80e24d0 con 0x559c438d41b0 2024-08-28T19:49:16.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.023+0000 7fd8f39c9740 1 -- 172.21.15.33:0/540658072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 msgr2=0x559c43ca0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:16.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.023+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/540658072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43ca0340 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80aaef0 tx=0x7fd8d800bf90 comp rx=0 tx=0).stop 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.023+0000 7fd8f39c9740 1 -- 172.21.15.33:0/540658072 shutdown_connections 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.023+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/540658072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43ca5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.023+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/540658072 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cb9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.023+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/540658072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43ca0340 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.023+0000 7fd8f39c9740 1 -- 172.21.15.33:0/540658072 >> 172.21.15.33:0/540658072 conn(0x559c438f1460 msgr2=0x559c43c9fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.023+0000 7fd8f39c9740 1 -- 172.21.15.33:0/540658072 shutdown_connections 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.023+0000 7fd8f39c9740 1 -- 172.21.15.33:0/540658072 wait complete. 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8f39c9740 1 -- start start 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8f39c9740 1 Processor -- start 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cb25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cb2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8f39c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43d297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e81b4330 con 0x559c438d41b0 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e81b3c60 con 0x559c438fd070 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8f39c9740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e81b0ec0 con 0x559c438dc390 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8e6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cb25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8f39c9740 10 client.0 _ll_register_callbacks cb 0x7fd8d80e86e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8e6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cb25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59984/0 (socket says 172.21.15.33:59984) 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/2485226016 learned_addr learned my addr 172.21.15.33:0/2485226016 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8e77fe640 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43d297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8dffff640 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cb2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/2485226016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 msgr2=0x559c43cb2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cb2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.024+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/2485226016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 msgr2=0x559c43d297b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43d297b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8e6ffd640 1 -- 172.21.15.33:0/2485226016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c43d29e20 con 0x559c438d41b0 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8e6ffd640 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cb25e0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80e2390 tx=0x7fd8d80e8970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe07491f289c0bc server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/2485226016 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d801e070 con 0x559c438d41b0 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/2485226016 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7fd8d80e8ba0 con 0x559c438d41b0 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2485226016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8d80aad00 con 0x559c438d41b0 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/2485226016 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd8d80ab1f0 con 0x559c438d41b0 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8f39c9740 10 client.20043 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2485226016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559c43d2b0a0 con 0x559c438d41b0 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/2485226016 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d80aad00 con 0x559c438d41b0 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/2485226016 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd8d80c0b90 con 0x559c438d41b0 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8f39c9740 10 client.20043 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:16.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8f39c9740 10 client.20043 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8f39c9740 20 client.20043 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.025+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559c43890da0 0x559c43d2d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.026+0000 7fd8f39c9740 4 client.20043 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.026+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2485226016 --> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c43c17070 con 0x559c43890da0 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.026+0000 7fd8dffff640 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559c43890da0 0x559c43d2d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.026+0000 7fd8ce7fc640 10 client.20043 ms_handle_connect on v2:172.21.15.59:6838/2455612621 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.026+0000 7fd8dffff640 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559c43890da0 0x559c43d2d610 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=957658a14392a80a server_cookie=265d7abeecd5e2dd in_seq=0 out_seq=0 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.026+0000 7fd8ce7fc640 1 -- 172.21.15.33:0/2485226016 <== mds.1 v2:172.21.15.59:6838/2455612621 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c43c17070 con 0x559c43890da0 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.026+0000 7fd8ce7fc640 10 client.20043 handle_command_reply: tid=0 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.026+0000 7fd8f39c9740 1 client.20043 shutdown 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2485226016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 msgr2=0x559c43cb25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cb25e0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80e2390 tx=0x7fd8d80e8970 comp rx=0 tx=0).stop 2024-08-28T19:49:16.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2485226016 shutdown_connections 2024-08-28T19:49:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.59:6838/2455612621,v1:172.21.15.59:6839/2455612621] conn(0x559c43890da0 0x559c43d2d610 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559c438fd070 0x559c43d297b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x559c438dc390 0x559c43cb2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 1 --2- 172.21.15.33:0/2485226016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559c438d41b0 0x559c43cb25e0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2485226016 >> 172.21.15.33:0/2485226016 conn(0x559c438f1460 msgr2=0x559c43ca5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8ce7fc640 0 client.20043 ms_handle_reset on v2:172.21.15.59:6838/2455612621 2024-08-28T19:49:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2485226016 shutdown_connections 2024-08-28T19:49:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 1 -- 172.21.15.33:0/2485226016 wait complete. 2024-08-28T19:49:16.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8f39c9740 20 client.20043 trim_cache size 0 max 16384 2024-08-28T19:49:16.034 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:49:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8ed454640 1 -- 172.21.15.33:0/1026693454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8d40b4ca0 msgr2=0x7fd8d40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8ed454640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8d40b4ca0 0x7fd8d40b71b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009230 tx=0x7fd8d0031400 comp rx=0 tx=0).stop 2024-08-28T19:49:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8ed454640 1 -- 172.21.15.33:0/1026693454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8e80754d0 msgr2=0x7fd8e819c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.027+0000 7fd8ed454640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8e80754d0 0x7fd8e819c590 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800b4a0 tx=0x7fd8d800b960 comp rx=0 tx=0).stop 2024-08-28T19:49:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.028+0000 7fd8ed454640 1 -- 172.21.15.33:0/1026693454 shutdown_connections 2024-08-28T19:49:16.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.028+0000 7fd8ed454640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd8d40b4ca0 0x7fd8d40b71b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.028+0000 7fd8ed454640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd8e810fee0 0x7fd8e81a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.028+0000 7fd8ed454640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e8075e20 0x7fd8e819cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.028+0000 7fd8ed454640 1 --2- 172.21.15.33:0/1026693454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8e80754d0 0x7fd8e819c590 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.028+0000 7fd8ed454640 1 -- 172.21.15.33:0/1026693454 >> 172.21.15.33:0/1026693454 conn(0x7fd8e807b5f0 msgr2=0x7fd8e81017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.028+0000 7fd8ed454640 1 -- 172.21.15.33:0/1026693454 shutdown_connections 2024-08-28T19:49:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:16.028+0000 7fd8ed454640 1 -- 172.21.15.33:0/1026693454 wait complete. 2024-08-28T19:49:16.036 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:15 smithi059 ceph-mon[22052]: pgmap v867: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.5 KiB/s wr, 13 op/s 2024-08-28T19:49:16.036 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:15 smithi059 ceph-mon[22052]: osdmap e106: 12 total, 12 up, 12 in 2024-08-28T19:49:16.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:15 smithi122 ceph-mon[22174]: pgmap v867: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.5 KiB/s wr, 13 op/s 2024-08-28T19:49:16.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:15 smithi122 ceph-mon[22174]: osdmap e106: 12 total, 12 up, 12 in 2024-08-28T19:49:16.792 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-28T19:49:17.044 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:17.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.560+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/3837159854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0108b10 msgr2=0x7fd5f010f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.560+0000 7fd5f4b4b640 1 --2- 172.21.15.33:0/3837159854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0108b10 0x7fd5f010f340 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009ca0 tx=0x7fd5e802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.561+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/3837159854 shutdown_connections 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.561+0000 7fd5f4b4b640 1 --2- 172.21.15.33:0/3837159854 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0108b10 0x7fd5f010f340 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.561+0000 7fd5f4b4b640 1 --2- 172.21.15.33:0/3837159854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f01081c0 0x7fd5f01085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.561+0000 7fd5f4b4b640 1 --2- 172.21.15.33:0/3837159854 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f0102880 0x7fd5f0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.561+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/3837159854 >> 172.21.15.33:0/3837159854 conn(0x7fd5f0079510 msgr2=0x7fd5f0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.561+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/3837159854 shutdown_connections 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.561+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/3837159854 wait complete. 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.561+0000 7fd5f4b4b640 1 Processor -- start 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5f4b4b640 1 -- start start 2024-08-28T19:49:17.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5f4b4b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0102880 0x7fd5f019a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5f4b4b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f01081c0 0x7fd5f019a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5f4b4b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108b10 0x7fd5f019fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5f4b4b640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f01138f0 con 0x7fd5f0102880 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5f4b4b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0113770 con 0x7fd5f0108b10 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5f4b4b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0113a70 con 0x7fd5f01081c0 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0102880 0x7fd5f019a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0102880 0x7fd5f019a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60000/0 (socket says 172.21.15.33:60000) 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5ee59c640 1 -- 172.21.15.33:0/990928036 learned_addr learned my addr 172.21.15.33:0/990928036 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5edd9b640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f01081c0 0x7fd5f019a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108b10 0x7fd5f019fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5ee59c640 1 -- 172.21.15.33:0/990928036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f01081c0 msgr2=0x7fd5f019a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f01081c0 0x7fd5f019a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5ee59c640 1 -- 172.21.15.33:0/990928036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108b10 msgr2=0x7fd5f019fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108b10 0x7fd5f019fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5ee59c640 1 -- 172.21.15.33:0/990928036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f01a0230 con 0x7fd5f0102880 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.562+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0102880 0x7fd5f019a2c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000d950 tx=0x7fd5e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.563+0000 7fd5df7fe640 1 -- 172.21.15.33:0/990928036 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0017070 con 0x7fd5f0102880 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.563+0000 7fd5df7fe640 1 -- 172.21.15.33:0/990928036 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5e0009c30 con 0x7fd5f0102880 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.563+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/990928036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f01a0520 con 0x7fd5f0102880 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.563+0000 7fd5df7fe640 1 -- 172.21.15.33:0/990928036 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e000f620 con 0x7fd5f0102880 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.563+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/990928036 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f01a6c80 con 0x7fd5f0102880 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5fb0c0740 1 Processor -- start 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5df7fe640 1 -- 172.21.15.33:0/990928036 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fd5e0010460 con 0x7fd5f0102880 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5fb0c0740 1 -- start start 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643959a5070 0x564395d4a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 0x564395d4a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564395984390 0x564395d4add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564395cc1680 con 0x564395984390 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564395cb0c10 con 0x5643959a5070 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564395cb4bc0 con 0x56439597c1b0 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5edd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564395984390 0x564395d4add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5edd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564395984390 0x564395d4add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60002/0 (socket says 172.21.15.33:60002) 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5edd9b640 1 -- 172.21.15.33:0/3333986319 learned_addr learned my addr 172.21.15.33:0/3333986319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.566+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/3333986319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643959a5070 0x564395d4a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/3333986319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 0x564395d4a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5df7fe640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5d80b4ca0 0x7fd5d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5eed9d640 1 -- 172.21.15.33:0/3333986319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 msgr2=0x564395d4a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/3333986319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 0x564395d4a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5eed9d640 1 -- 172.21.15.33:0/3333986319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564395984390 msgr2=0x564395d4add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:17.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/3333986319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564395984390 0x564395d4add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5eed9d640 1 -- 172.21.15.33:0/3333986319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564395a10650 con 0x5643959a5070 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5d80b4ca0 0x7fd5d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5df7fe640 1 -- 172.21.15.33:0/990928036 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7fd5e00e5490 con 0x7fd5f0102880 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/3333986319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643959a5070 0x564395d4a350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8005e30 tx=0x7fd5e8009820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41e0d6c418e5aad4 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5dcff9640 1 -- 172.21.15.33:0/3333986319 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8042040 con 0x5643959a5070 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5dcff9640 1 -- 172.21.15.33:0/3333986319 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5e8036070 con 0x5643959a5070 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5dcff9640 1 -- 172.21.15.33:0/3333986319 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8004700 con 0x5643959a5070 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.567+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5d80b4ca0 0x7fd5d80b71b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd5e804d000 tx=0x7fd5e804e000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.568+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3333986319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643959a5070 msgr2=0x564395d4a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.568+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3333986319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643959a5070 0x564395d4a350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8005e30 tx=0x7fd5e8009820 comp rx=0 tx=0).stop 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.568+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3333986319 shutdown_connections 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.568+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3333986319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x564395984390 0x564395d4add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.568+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3333986319 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 0x564395d4a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.568+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3333986319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643959a5070 0x564395d4a350 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.568+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3333986319 >> 172.21.15.33:0/3333986319 conn(0x564395999460 msgr2=0x564395d48240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.568+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3333986319 shutdown_connections 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.568+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3333986319 wait complete. 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5fb0c0740 1 -- start start 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5fb0c0740 1 Processor -- start 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56439597c1b0 0x564395d55af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 0x564395d56030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643959a5070 0x564395d61e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x564395b13700 con 0x56439597c1b0 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564395c37750 con 0x564395984390 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x564395d58b30 con 0x5643959a5070 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5fb0c0740 10 client.0 _ll_register_callbacks cb 0x564395c66e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56439597c1b0 0x564395d55af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56439597c1b0 0x564395d55af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60004/0 (socket says 172.21.15.33:60004) 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.569+0000 7fd5ee59c640 1 -- 172.21.15.33:0/3114214832 learned_addr learned my addr 172.21.15.33:0/3114214832 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5edd9b640 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 0x564395d56030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643959a5070 0x564395d61e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5ee59c640 1 -- 172.21.15.33:0/3114214832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643959a5070 msgr2=0x564395d61e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643959a5070 0x564395d61e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5ee59c640 1 -- 172.21.15.33:0/3114214832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 msgr2=0x564395d56030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 0x564395d56030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5ee59c640 1 -- 172.21.15.33:0/3114214832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564395c70900 con 0x56439597c1b0 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56439597c1b0 0x564395d55af0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0000c00 tx=0x7fd5e00e8bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dc7400cf17753e server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3114214832 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0020070 con 0x56439597c1b0 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3114214832 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7fd5e00ce0d0 con 0x56439597c1b0 2024-08-28T19:49:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3114214832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5e8036070 con 0x56439597c1b0 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3114214832 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd5e00ab660 con 0x56439597c1b0 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5fb0c0740 10 client.20055 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3114214832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564395d64930 con 0x56439597c1b0 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.570+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3114214832 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5e8036070 con 0x56439597c1b0 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.571+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3114214832 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd5e00e5160 con 0x56439597c1b0 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.571+0000 7fd5fb0c0740 10 client.20055 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.571+0000 7fd5fb0c0740 10 client.20055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.571+0000 7fd5fb0c0740 20 client.20055 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.571+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643959639f0 0x564395d67cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.571+0000 7fd5fb0c0740 4 client.20055 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.571+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3114214832 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564395cc35d0 con 0x5643959639f0 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.571+0000 7fd5edd9b640 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643959639f0 0x564395d67cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.571+0000 7fd5edd9b640 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643959639f0 0x564395d67cd0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25ce2eabef7c2bcc server_cookie=517247d085c9cde9 in_seq=0 out_seq=0 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.571+0000 7fd5d5ffb640 10 client.20055 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3114214832 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564395cc35d0 con 0x5643959639f0 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5d5ffb640 10 client.20055 handle_command_reply: tid=0 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5fb0c0740 1 client.20055 shutdown 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3114214832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56439597c1b0 msgr2=0x564395d55af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56439597c1b0 0x564395d55af0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0000c00 tx=0x7fd5e00e8bc0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3114214832 shutdown_connections 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5643959a5070 0x564395d61e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 0x564395d56030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643959639f0 0x564395d67cd0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5d5ffb640 0 client.20055 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3114214832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56439597c1b0 0x564395d55af0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3114214832 >> 172.21.15.33:0/3114214832 conn(0x564395999460 msgr2=0x564395d4d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:17.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.572+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3114214832 shutdown_connections 2024-08-28T19:49:17.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.573+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3114214832 wait complete. 2024-08-28T19:49:17.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.573+0000 7fd5fb0c0740 20 client.20055 trim_cache size 0 max 16384 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5fb0c0740 1 Processor -- start 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5fb0c0740 1 -- start start 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d4bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 0x564395d576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 0x564395d61d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f01b0bc0 con 0x5643959639f0 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f01b2700 con 0x564395984390 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f01b1290 con 0x56439597c1b0 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d4bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d4bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60010/0 (socket says 172.21.15.33:60010) 2024-08-28T19:49:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.586+0000 7fd5ee59c640 1 -- 172.21.15.33:0/2638557371 learned_addr learned my addr 172.21.15.33:0/2638557371 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5edd9b640 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 0x564395d576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 0x564395d61d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5ee59c640 1 -- 172.21.15.33:0/2638557371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 msgr2=0x564395d576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 0x564395d576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5ee59c640 1 -- 172.21.15.33:0/2638557371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 msgr2=0x564395d61d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 0x564395d61d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5ee59c640 1 -- 172.21.15.33:0/2638557371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564395d4c870 con 0x5643959639f0 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5edd9b640 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 0x564395d576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 0x564395d61d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d4bd40 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00a7910 tx=0x7fd5e00ab890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53fa5ded6498482 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5d7fff640 1 -- 172.21.15.33:0/2638557371 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0020030 con 0x5643959639f0 2024-08-28T19:49:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5d7fff640 1 -- 172.21.15.33:0/2638557371 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5e00ab3a0 con 0x5643959639f0 2024-08-28T19:49:17.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.587+0000 7fd5d7fff640 1 -- 172.21.15.33:0/2638557371 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00ab000 con 0x5643959639f0 2024-08-28T19:49:17.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/2638557371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 msgr2=0x564395d4bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:17.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d4bd40 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00a7910 tx=0x7fd5e00ab890 comp rx=0 tx=0).stop 2024-08-28T19:49:17.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/2638557371 shutdown_connections 2024-08-28T19:49:17.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564395984390 0x564395d61d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x56439597c1b0 0x564395d576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/2638557371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d4bd40 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/2638557371 >> 172.21.15.33:0/2638557371 conn(0x564395999460 msgr2=0x564395d56fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/2638557371 shutdown_connections 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/2638557371 wait complete. 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 -- start start 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.588+0000 7fd5fb0c0740 1 Processor -- start 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d5e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439597c1b0 0x564395d5cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5fb0c0740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564395984390 0x564395d5d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f01b2030 con 0x5643959639f0 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f01b1960 con 0x56439597c1b0 2024-08-28T19:49:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5fb0c0740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f01aebc0 con 0x564395984390 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5fb0c0740 10 client.0 _ll_register_callbacks cb 0x7fd5e00a7d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d5e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5ee59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d5e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60012/0 (socket says 172.21.15.33:60012) 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5ee59c640 1 -- 172.21.15.33:0/3093979448 learned_addr learned my addr 172.21.15.33:0/3093979448 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5edd9b640 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439597c1b0 0x564395d5cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564395984390 0x564395d5d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5ee59c640 1 -- 172.21.15.33:0/3093979448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564395984390 msgr2=0x564395d5d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564395984390 0x564395d5d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5ee59c640 1 -- 172.21.15.33:0/3093979448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439597c1b0 msgr2=0x564395d5cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439597c1b0 0x564395d5cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5ee59c640 1 -- 172.21.15.33:0/3093979448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564395d5d940 con 0x5643959639f0 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5edd9b640 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439597c1b0 0x564395d5cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:49:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5eed9d640 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564395984390 0x564395d5d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5ee59c640 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d5e680 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00a77d0 tx=0x7fd5e00a7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7a3fa535eb86ef server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3093979448 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0020070 con 0x5643959639f0 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3093979448 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7fd5e00acb10 con 0x5643959639f0 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.589+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3093979448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5e00ab3a0 con 0x5643959639f0 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3093979448 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd5e00ab1e0 con 0x5643959639f0 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5fb0c0740 10 client.20061 fetch_fsmap learned FSMap version 28 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3093979448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564395dd79c0 con 0x5643959639f0 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3093979448 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5e00ab3a0 con 0x5643959639f0 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3093979448 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd5e0010750 con 0x5643959639f0 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5fb0c0740 10 client.20061 fetch_fsmap finished waiting for FSMap version 28 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5fb0c0740 10 client.20061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-28T19:49:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5fb0c0740 20 client.20061 populate_metadata read hostname 'smithi033' 2024-08-28T19:49:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643959a5070 0x564395dd9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5fb0c0740 4 client.20061 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-28T19:49:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3093979448 --> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564395cbf070 con 0x5643959a5070 2024-08-28T19:49:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.590+0000 7fd5edd9b640 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643959a5070 0x564395dd9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5edd9b640 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643959a5070 0x564395dd9f60 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed5daf738de09780 server_cookie=572464a85008b231 in_seq=0 out_seq=0 2024-08-28T19:49:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5d5ffb640 10 client.20061 ms_handle_connect on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5d5ffb640 1 -- 172.21.15.33:0/3093979448 <== mds.0 v2:172.21.15.122:6838/2515249026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564395cbf070 con 0x5643959a5070 2024-08-28T19:49:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5d5ffb640 10 client.20061 handle_command_reply: tid=0 2024-08-28T19:49:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 client.20061 shutdown 2024-08-28T19:49:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3093979448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 msgr2=0x564395d5e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d5e680 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00a77d0 tx=0x7fd5e00a7800 comp rx=0 tx=0).stop 2024-08-28T19:49:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3093979448 shutdown_connections 2024-08-28T19:49:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x564395984390 0x564395d5d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56439597c1b0 0x564395d5cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.122:6838/2515249026,v1:172.21.15.122:6839/2515249026] conn(0x5643959a5070 0x564395dd9f60 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 --2- 172.21.15.33:0/3093979448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5643959639f0 0x564395d5e680 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5d5ffb640 0 client.20061 ms_handle_reset on v2:172.21.15.122:6838/2515249026 2024-08-28T19:49:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3093979448 >> 172.21.15.33:0/3093979448 conn(0x564395999460 msgr2=0x564395d578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3093979448 shutdown_connections 2024-08-28T19:49:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 1 -- 172.21.15.33:0/3093979448 wait complete. 2024-08-28T19:49:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.591+0000 7fd5fb0c0740 20 client.20061 trim_cache size 0 max 16384 2024-08-28T19:49:17.601 INFO:teuthology.orchestra.run.smithi033.stdout:[] 2024-08-28T19:49:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/990928036 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5d80b4ca0 msgr2=0x7fd5d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5d80b4ca0 0x7fd5d80b71b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd5e804d000 tx=0x7fd5e804e000 comp rx=0 tx=0).stop 2024-08-28T19:49:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/990928036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0102880 msgr2=0x7fd5f019a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0102880 0x7fd5f019a2c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000d950 tx=0x7fd5e000de10 comp rx=0 tx=0).stop 2024-08-28T19:49:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/990928036 shutdown_connections 2024-08-28T19:49:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f0108b10 0x7fd5f019fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fd5d80b4ca0 0x7fd5d80b71b0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd5f01081c0 0x7fd5f019a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 --2- 172.21.15.33:0/990928036 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5f0102880 0x7fd5f019a2c0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/990928036 >> 172.21.15.33:0/990928036 conn(0x7fd5f0079510 msgr2=0x7fd5f01061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/990928036 shutdown_connections 2024-08-28T19:49:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:17.592+0000 7fd5f4b4b640 1 -- 172.21.15.33:0/990928036 wait complete. 2024-08-28T19:49:17.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:17 smithi033 ceph-mon[18549]: pgmap v869: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-08-28T19:49:18.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:17 smithi059 ceph-mon[22052]: pgmap v869: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-08-28T19:49:18.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:17 smithi122 ceph-mon[22174]: pgmap v869: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.6 KiB/s wr, 8 op/s 2024-08-28T19:49:18.380 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-08-28T19:49:18.381 INFO:tasks.fwd_scrub:done joining 2024-08-28T19:49:18.381 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-28T19:49:18.392 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-28T19:49:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 -- 172.21.15.33:0/1790320035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa8102760 msgr2=0x7f1fa8102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 --2- 172.21.15.33:0/1790320035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa8102760 0x7f1fa8102b70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009900 tx=0x7f1fa402a410 comp rx=0 tx=0).stop 2024-08-28T19:49:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 -- 172.21.15.33:0/1790320035 shutdown_connections 2024-08-28T19:49:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 --2- 172.21.15.33:0/1790320035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa81089e0 0x7f1fa810f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 --2- 172.21.15.33:0/1790320035 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fa8108090 0x7f1fa81084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 --2- 172.21.15.33:0/1790320035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa8102760 0x7f1fa8102b70 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 -- 172.21.15.33:0/1790320035 >> 172.21.15.33:0/1790320035 conn(0x7f1fa807a410 msgr2=0x7f1fa807a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 -- 172.21.15.33:0/1790320035 shutdown_connections 2024-08-28T19:49:18.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 -- 172.21.15.33:0/1790320035 wait complete. 2024-08-28T19:49:18.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 Processor -- start 2024-08-28T19:49:18.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.503+0000 7f1fafc92640 1 -- start start 2024-08-28T19:49:18.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fafc92640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa8102760 0x7f1fa819b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fafc92640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fa8108090 0x7f1fa819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fafc92640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa81089e0 0x7f1fa819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fafc92640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa8112690 con 0x7f1fa8102760 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fafc92640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa8112510 con 0x7f1fa81089e0 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fafc92640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa8112810 con 0x7f1fa8108090 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fada2e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa8102760 0x7f1fa819b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fada2e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa8102760 0x7f1fa819b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56788/0 (socket says 172.21.15.33:56788) 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fada2e640 1 -- 172.21.15.33:0/1724291362 learned_addr learned my addr 172.21.15.33:0/1724291362 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fad22d640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fa8108090 0x7f1fa819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fae22f640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa81089e0 0x7f1fa819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fada2e640 1 -- 172.21.15.33:0/1724291362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fa8108090 msgr2=0x7f1fa819b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fada2e640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fa8108090 0x7f1fa819b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fada2e640 1 -- 172.21.15.33:0/1724291362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa81089e0 msgr2=0x7f1fa819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:18.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fada2e640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa81089e0 0x7f1fa819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fada2e640 1 -- 172.21.15.33:0/1724291362 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa81a6290 con 0x7f1fa8102760 2024-08-28T19:49:18.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1fada2e640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa8102760 0x7f1fa819b000 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4005940 tx=0x7f1fa4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:18.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.504+0000 7f1f9effd640 1 -- 172.21.15.33:0/1724291362 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa403f030 con 0x7f1fa8102760 2024-08-28T19:49:18.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.505+0000 7f1f9effd640 1 -- 172.21.15.33:0/1724291362 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fa4003aa0 con 0x7f1fa8102760 2024-08-28T19:49:18.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.505+0000 7f1fafc92640 1 -- 172.21.15.33:0/1724291362 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa81a6520 con 0x7f1fa8102760 2024-08-28T19:49:18.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.505+0000 7f1f9effd640 1 -- 172.21.15.33:0/1724291362 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4035070 con 0x7f1fa8102760 2024-08-28T19:49:18.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.505+0000 7f1fafc92640 1 -- 172.21.15.33:0/1724291362 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa81a6a60 con 0x7f1fa8102760 2024-08-28T19:49:18.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.506+0000 7f1fafc92640 1 -- 172.21.15.33:0/1724291362 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa8102b70 con 0x7f1fa8102760 2024-08-28T19:49:18.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.508+0000 7f1f9effd640 1 -- 172.21.15.33:0/1724291362 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f1fa4042030 con 0x7f1fa8102760 2024-08-28T19:49:18.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.509+0000 7f1f9effd640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1f940b4d20 0x7f1f940b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:18.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.509+0000 7f1fad22d640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1f940b4d20 0x7f1f940b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:18.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.509+0000 7f1f9effd640 1 -- 172.21.15.33:0/1724291362 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7f1fa4106220 con 0x7f1fa8102760 2024-08-28T19:49:18.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.509+0000 7f1fad22d640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1f940b4d20 0x7f1f940b7230 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8069f40 tx=0x7f1f9800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:18.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.512+0000 7f1f9effd640 1 -- 172.21.15.33:0/1724291362 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1fa40ccc10 con 0x7f1fa8102760 2024-08-28T19:49:18.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.702+0000 7f1fafc92640 1 -- 172.21.15.33:0/1724291362 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1fa802e430 con 0x7f1fa8102760 2024-08-28T19:49:18.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.703+0000 7f1f9effd640 1 -- 172.21.15.33:0/1724291362 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+25280 (secure 0 0 0) 0x7f1fa40cc510 con 0x7f1fa8102760 2024-08-28T19:49:18.706 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:49:18.706 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":106,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:49:14.546283+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":29,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":29,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":16,"length":1},{"begin":29,"length":1}]},{"pool":4,"snaps":[{"begin":16,"length":1},{"begin":29,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:49:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 -- 172.21.15.33:0/1724291362 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1f940b4d20 msgr2=0x7f1f940b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1f940b4d20 0x7f1f940b7230 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8069f40 tx=0x7f1f9800b390 comp rx=0 tx=0).stop 2024-08-28T19:49:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 -- 172.21.15.33:0/1724291362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa8102760 msgr2=0x7f1fa819b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa8102760 0x7f1fa819b000 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4005940 tx=0x7f1fa4004270 comp rx=0 tx=0).stop 2024-08-28T19:49:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 -- 172.21.15.33:0/1724291362 shutdown_connections 2024-08-28T19:49:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fa81089e0 0x7f1fa819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f1f940b4d20 0x7f1f940b7230 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1fa8108090 0x7f1fa819b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 --2- 172.21.15.33:0/1724291362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa8102760 0x7f1fa819b000 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 -- 172.21.15.33:0/1724291362 >> 172.21.15.33:0/1724291362 conn(0x7f1fa807a410 msgr2=0x7f1fa81061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:18.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 -- 172.21.15.33:0/1724291362 shutdown_connections 2024-08-28T19:49:18.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.706+0000 7f1fafc92640 1 -- 172.21.15.33:0/1724291362 wait complete. 2024-08-28T19:49:18.720 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-28T19:25:14.079616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-28T19:29:44.553677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-28T19:29:46.793616+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 29, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-28T19:29:53.252864+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 29, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-28T19:49:18.720 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-28T19:49:18.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.833+0000 7f6703458640 1 -- 172.21.15.33:0/3547437554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc102e30 msgr2=0x7f66fc103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:18.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.833+0000 7f6703458640 1 --2- 172.21.15.33:0/3547437554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc102e30 0x7f66fc103240 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009900 tx=0x7f66f802a410 comp rx=0 tx=0).stop 2024-08-28T19:49:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.833+0000 7f6703458640 1 -- 172.21.15.33:0/3547437554 shutdown_connections 2024-08-28T19:49:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.833+0000 7f6703458640 1 --2- 172.21.15.33:0/3547437554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc1089e0 0x7f66fc10f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.833+0000 7f6703458640 1 --2- 172.21.15.33:0/3547437554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66fc108090 0x7f66fc1084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.833+0000 7f6703458640 1 --2- 172.21.15.33:0/3547437554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc102e30 0x7f66fc103240 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.833+0000 7f6703458640 1 -- 172.21.15.33:0/3547437554 >> 172.21.15.33:0/3547437554 conn(0x7f66fc079a50 msgr2=0x7f66fc079e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.834+0000 7f6703458640 1 -- 172.21.15.33:0/3547437554 shutdown_connections 2024-08-28T19:49:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.834+0000 7f6703458640 1 -- 172.21.15.33:0/3547437554 wait complete. 2024-08-28T19:49:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.834+0000 7f6703458640 1 Processor -- start 2024-08-28T19:49:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.834+0000 7f6703458640 1 -- start start 2024-08-28T19:49:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.834+0000 7f6703458640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc102e30 0x7f66fc19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.834+0000 7f6703458640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66fc108090 0x7f66fc19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.834+0000 7f6703458640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc1089e0 0x7f66fc19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.834+0000 7f6703458640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc1137c0 con 0x7f66fc1089e0 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.834+0000 7f6703458640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc113640 con 0x7f66fc108090 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.834+0000 7f6703458640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc113940 con 0x7f66fc102e30 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67019f5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc1089e0 0x7f66fc19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67019f5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc1089e0 0x7f66fc19fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56806/0 (socket says 172.21.15.33:56806) 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67019f5640 1 -- 172.21.15.33:0/1385711161 learned_addr learned my addr 172.21.15.33:0/1385711161 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67009f3640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66fc108090 0x7f66fc19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67011f4640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc102e30 0x7f66fc19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:18.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67019f5640 1 -- 172.21.15.33:0/1385711161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc102e30 msgr2=0x7f66fc19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:18.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67019f5640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc102e30 0x7f66fc19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67019f5640 1 -- 172.21.15.33:0/1385711161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66fc108090 msgr2=0x7f66fc19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:18.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67019f5640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66fc108090 0x7f66fc19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:18.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67019f5640 1 -- 172.21.15.33:0/1385711161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc1a00e0 con 0x7f66fc1089e0 2024-08-28T19:49:18.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f67019f5640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc1089e0 0x7f66fc19fa70 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f66f400cce0 tx=0x7f66f400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:18.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f66f27fc640 1 -- 172.21.15.33:0/1385711161 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f400f450 con 0x7f66fc1089e0 2024-08-28T19:49:18.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f66f27fc640 1 -- 172.21.15.33:0/1385711161 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66f400faa0 con 0x7f66fc1089e0 2024-08-28T19:49:18.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f6703458640 1 -- 172.21.15.33:0/1385711161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66fc1a03d0 con 0x7f66fc1089e0 2024-08-28T19:49:18.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f66f27fc640 1 -- 172.21.15.33:0/1385711161 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4018b70 con 0x7f66fc1089e0 2024-08-28T19:49:18.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.835+0000 7f6703458640 1 -- 172.21.15.33:0/1385711161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66fc1a6bf0 con 0x7f66fc1089e0 2024-08-28T19:49:18.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.837+0000 7f6703458640 1 -- 172.21.15.33:0/1385711161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66fc103240 con 0x7f66fc1089e0 2024-08-28T19:49:18.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.838+0000 7f66f27fc640 1 -- 172.21.15.33:0/1385711161 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f66f4018d10 con 0x7f66fc1089e0 2024-08-28T19:49:18.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.839+0000 7f66f27fc640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66e80b4ca0 0x7f66e80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:18.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.839+0000 7f67011f4640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66e80b4ca0 0x7f66e80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:18.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.839+0000 7f66f27fc640 1 -- 172.21.15.33:0/1385711161 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7f66f40e5dc0 con 0x7f66fc1089e0 2024-08-28T19:49:18.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.839+0000 7f67011f4640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66e80b4ca0 0x7f66e80b71b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f66f8031440 tx=0x7f66f8005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:18.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:18.843+0000 7f66f27fc640 1 -- 172.21.15.33:0/1385711161 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f66f4014030 con 0x7f66fc1089e0 2024-08-28T19:49:19.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.028+0000 7f6703458640 1 -- 172.21.15.33:0/1385711161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f66fc10a220 con 0x7f66fc1089e0 2024-08-28T19:49:19.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.028+0000 7f66f27fc640 1 -- 172.21.15.33:0/1385711161 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) ==== 93+0+10 (secure 0 0 0) 0x7f66f40ac7b0 con 0x7f66fc1089e0 2024-08-28T19:49:19.030 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-08-28T19:49:19.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 -- 172.21.15.33:0/1385711161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66e80b4ca0 msgr2=0x7f66e80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66e80b4ca0 0x7f66e80b71b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f66f8031440 tx=0x7f66f8005d50 comp rx=0 tx=0).stop 2024-08-28T19:49:19.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 -- 172.21.15.33:0/1385711161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc1089e0 msgr2=0x7f66fc19fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc1089e0 0x7f66fc19fa70 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f66f400cce0 tx=0x7f66f400a620 comp rx=0 tx=0).stop 2024-08-28T19:49:19.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 -- 172.21.15.33:0/1385711161 shutdown_connections 2024-08-28T19:49:19.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66fc1089e0 0x7f66fc19fa70 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66fc108090 0x7f66fc19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f66e80b4ca0 0x7f66e80b71b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 --2- 172.21.15.33:0/1385711161 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66fc102e30 0x7f66fc19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 -- 172.21.15.33:0/1385711161 >> 172.21.15.33:0/1385711161 conn(0x7f66fc079a50 msgr2=0x7f66fc106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:19.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 -- 172.21.15.33:0/1385711161 shutdown_connections 2024-08-28T19:49:19.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.030+0000 7f6703458640 1 -- 172.21.15.33:0/1385711161 wait complete. 2024-08-28T19:49:19.044 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-28T19:49:19.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 -- 172.21.15.33:0/3585918361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c0102740 msgr2=0x7f38c0102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 --2- 172.21.15.33:0/3585918361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c0102740 0x7f38c0102b50 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009900 tx=0x7f38bc02a410 comp rx=0 tx=0).stop 2024-08-28T19:49:19.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 -- 172.21.15.33:0/3585918361 shutdown_connections 2024-08-28T19:49:19.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 --2- 172.21.15.33:0/3585918361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c01089c0 0x7f38c010f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 --2- 172.21.15.33:0/3585918361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c0108070 0x7f38c0108480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 --2- 172.21.15.33:0/3585918361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c0102740 0x7f38c0102b50 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 -- 172.21.15.33:0/3585918361 >> 172.21.15.33:0/3585918361 conn(0x7f38c00fe160 msgr2=0x7f38c01005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:19.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 -- 172.21.15.33:0/3585918361 shutdown_connections 2024-08-28T19:49:19.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 -- 172.21.15.33:0/3585918361 wait complete. 2024-08-28T19:49:19.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 Processor -- start 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.156+0000 7f38c7f09640 1 -- start start 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c7f09640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c0102740 0x7f38c019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c7f09640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0108070 0x7f38c019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c7f09640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c01089c0 0x7f38c019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c7f09640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f38c01137a0 con 0x7f38c0102740 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c7f09640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0113620 con 0x7f38c0108070 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c7f09640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0113920 con 0x7f38c01089c0 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c5ca5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c0102740 0x7f38c019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c5ca5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c0102740 0x7f38c019a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56822/0 (socket says 172.21.15.33:56822) 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c5ca5640 1 -- 172.21.15.33:0/3250014285 learned_addr learned my addr 172.21.15.33:0/3250014285 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c54a4640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0108070 0x7f38c019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c64a6640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c01089c0 0x7f38c019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c5ca5640 1 -- 172.21.15.33:0/3250014285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c01089c0 msgr2=0x7f38c019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c5ca5640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c01089c0 0x7f38c019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c5ca5640 1 -- 172.21.15.33:0/3250014285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0108070 msgr2=0x7f38c019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c5ca5640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0108070 0x7f38c019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c5ca5640 1 -- 172.21.15.33:0/3250014285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c01a00d0 con 0x7f38c0102740 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c5ca5640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c0102740 0x7f38c019a1a0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f38bc005940 tx=0x7f38bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38b6ffd640 1 -- 172.21.15.33:0/3250014285 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc03f030 con 0x7f38c0102740 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38b6ffd640 1 -- 172.21.15.33:0/3250014285 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38bc003cb0 con 0x7f38c0102740 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.157+0000 7f38c7f09640 1 -- 172.21.15.33:0/3250014285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c01a0360 con 0x7f38c0102740 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.158+0000 7f38b6ffd640 1 -- 172.21.15.33:0/3250014285 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc035070 con 0x7f38c0102740 2024-08-28T19:49:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.158+0000 7f38c7f09640 1 -- 172.21.15.33:0/3250014285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c01a6b50 con 0x7f38c0102740 2024-08-28T19:49:19.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.158+0000 7f38c7f09640 1 -- 172.21.15.33:0/3250014285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c01039b0 con 0x7f38c0102740 2024-08-28T19:49:19.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.161+0000 7f38b6ffd640 1 -- 172.21.15.33:0/3250014285 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f38bc042030 con 0x7f38c0102740 2024-08-28T19:49:19.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.162+0000 7f38b6ffd640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38ac0b4d20 0x7f38ac0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.162+0000 7f38c54a4640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38ac0b4d20 0x7f38ac0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.162+0000 7f38b6ffd640 1 -- 172.21.15.33:0/3250014285 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7f38bc106350 con 0x7f38c0102740 2024-08-28T19:49:19.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.162+0000 7f38c54a4640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38ac0b4d20 0x7f38ac0b7230 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f38c0107b30 tx=0x7f38b000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.165+0000 7f38b6ffd640 1 -- 172.21.15.33:0/3250014285 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f38bc0cc6f0 con 0x7f38c0102740 2024-08-28T19:49:19.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.353+0000 7f38c7f09640 1 -- 172.21.15.33:0/3250014285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f38c002e430 con 0x7f38c0102740 2024-08-28T19:49:19.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.353+0000 7f38b6ffd640 1 -- 172.21.15.33:0/3250014285 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v106) ==== 104+0+11 (secure 0 0 0) 0x7f38bc0d0eb0 con 0x7f38c0102740 2024-08-28T19:49:19.355 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-28T19:49:19.357 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.355+0000 7f38c7f09640 1 -- 172.21.15.33:0/3250014285 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38ac0b4d20 msgr2=0x7f38ac0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.355+0000 7f38c7f09640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38ac0b4d20 0x7f38ac0b7230 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f38c0107b30 tx=0x7f38b000b390 comp rx=0 tx=0).stop 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.355+0000 7f38c7f09640 1 -- 172.21.15.33:0/3250014285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c0102740 msgr2=0x7f38c019a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.355+0000 7f38c7f09640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c0102740 0x7f38c019a1a0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f38bc005940 tx=0x7f38bc0042f0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.356+0000 7f38c7f09640 1 -- 172.21.15.33:0/3250014285 shutdown_connections 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.356+0000 7f38c7f09640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38ac0b4d20 0x7f38ac0b7230 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.356+0000 7f38c7f09640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f38c01089c0 0x7f38c019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.356+0000 7f38c7f09640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0108070 0x7f38c019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.356+0000 7f38c7f09640 1 --2- 172.21.15.33:0/3250014285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c0102740 0x7f38c019a1a0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.356+0000 7f38c7f09640 1 -- 172.21.15.33:0/3250014285 >> 172.21.15.33:0/3250014285 conn(0x7f38c00fe160 msgr2=0x7f38c0100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.356+0000 7f38c7f09640 1 -- 172.21.15.33:0/3250014285 shutdown_connections 2024-08-28T19:49:19.358 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.356+0000 7f38c7f09640 1 -- 172.21.15.33:0/3250014285 wait complete. 2024-08-28T19:49:19.369 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-28T19:49:19.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.481+0000 7fcd9f596640 1 -- 172.21.15.33:0/3569143243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd981089f0 msgr2=0x7fcd9810f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.481+0000 7fcd9f596640 1 --2- 172.21.15.33:0/3569143243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd981089f0 0x7fcd9810f220 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009ca0 tx=0x7fcd9002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.481+0000 7fcd9f596640 1 -- 172.21.15.33:0/3569143243 shutdown_connections 2024-08-28T19:49:19.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.481+0000 7fcd9f596640 1 --2- 172.21.15.33:0/3569143243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd981089f0 0x7fcd9810f220 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.481+0000 7fcd9f596640 1 --2- 172.21.15.33:0/3569143243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd981080a0 0x7fcd981084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.481+0000 7fcd9f596640 1 --2- 172.21.15.33:0/3569143243 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd981027c0 0x7fcd98102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.481+0000 7fcd9f596640 1 -- 172.21.15.33:0/3569143243 >> 172.21.15.33:0/3569143243 conn(0x7fcd980793d0 msgr2=0x7fcd980797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.481+0000 7fcd9f596640 1 -- 172.21.15.33:0/3569143243 shutdown_connections 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.481+0000 7fcd9f596640 1 -- 172.21.15.33:0/3569143243 wait complete. 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9f596640 1 Processor -- start 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9f596640 1 -- start start 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9f596640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd981027c0 0x7fcd9819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9f596640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd981080a0 0x7fcd9819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9f596640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd981089f0 0x7fcd9819f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9f596640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcd981137d0 con 0x7fcd981089f0 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9f596640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcd98113650 con 0x7fcd981080a0 2024-08-28T19:49:19.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9f596640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcd98113950 con 0x7fcd981027c0 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9db33640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd981089f0 0x7fcd9819f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9db33640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd981089f0 0x7fcd9819f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56830/0 (socket says 172.21.15.33:56830) 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9db33640 1 -- 172.21.15.33:0/3764884460 learned_addr learned my addr 172.21.15.33:0/3764884460 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9d332640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd981027c0 0x7fcd9819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.482+0000 7fcd9cb31640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd981080a0 0x7fcd9819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd9db33640 1 -- 172.21.15.33:0/3764884460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd981027c0 msgr2=0x7fcd9819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd9db33640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd981027c0 0x7fcd9819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd9db33640 1 -- 172.21.15.33:0/3764884460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd981080a0 msgr2=0x7fcd9819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd9db33640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd981080a0 0x7fcd9819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd9db33640 1 -- 172.21.15.33:0/3764884460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd981a0000 con 0x7fcd981089f0 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd9db33640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd981089f0 0x7fcd9819f900 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fcd90005cc0 tx=0x7fcd9002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd8e7fc640 1 -- 172.21.15.33:0/3764884460 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd90003cf0 con 0x7fcd981089f0 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd9f596640 1 -- 172.21.15.33:0/3764884460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd981a0290 con 0x7fcd981089f0 2024-08-28T19:49:19.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd8e7fc640 1 -- 172.21.15.33:0/3764884460 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd900044f0 con 0x7fcd981089f0 2024-08-28T19:49:19.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd8e7fc640 1 -- 172.21.15.33:0/3764884460 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9002fd10 con 0x7fcd981089f0 2024-08-28T19:49:19.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.483+0000 7fcd9f596640 1 -- 172.21.15.33:0/3764884460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd981a6a80 con 0x7fcd981089f0 2024-08-28T19:49:19.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.484+0000 7fcd9f596640 1 -- 172.21.15.33:0/3764884460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd98102bd0 con 0x7fcd981089f0 2024-08-28T19:49:19.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.486+0000 7fcd8e7fc640 1 -- 172.21.15.33:0/3764884460 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcd90004040 con 0x7fcd981089f0 2024-08-28T19:49:19.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.486+0000 7fcd8e7fc640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd840b4ca0 0x7fcd840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.487+0000 7fcd9d332640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd840b4ca0 0x7fcd840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.487+0000 7fcd8e7fc640 1 -- 172.21.15.33:0/3764884460 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7fcd901070f0 con 0x7fcd981089f0 2024-08-28T19:49:19.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.487+0000 7fcd9d332640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd840b4ca0 0x7fcd840b71b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcd940058c0 tx=0x7fcd9400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:19.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.490+0000 7fcd8e7fc640 1 -- 172.21.15.33:0/3764884460 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcd900cdb40 con 0x7fcd981089f0 2024-08-28T19:49:19.629 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:19 smithi033 ceph-mon[18549]: pgmap v870: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2024-08-28T19:49:19.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:19 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1724291362' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:49:19.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:19 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1385711161' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T19:49:19.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:19 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3250014285' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-28T19:49:19.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.680+0000 7fcd9f596640 1 -- 172.21.15.33:0/3764884460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcd9802e430 con 0x7fcd981089f0 2024-08-28T19:49:19.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.681+0000 7fcd8e7fc640 1 -- 172.21.15.33:0/3764884460 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v106) ==== 100+0+11 (secure 0 0 0) 0x7fcd900cd440 con 0x7fcd981089f0 2024-08-28T19:49:19.683 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-08-28T19:49:19.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 -- 172.21.15.33:0/3764884460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd840b4ca0 msgr2=0x7fcd840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd840b4ca0 0x7fcd840b71b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcd940058c0 tx=0x7fcd9400a2d0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 -- 172.21.15.33:0/3764884460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd981089f0 msgr2=0x7fcd9819f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd981089f0 0x7fcd9819f900 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fcd90005cc0 tx=0x7fcd9002f470 comp rx=0 tx=0).stop 2024-08-28T19:49:19.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 -- 172.21.15.33:0/3764884460 shutdown_connections 2024-08-28T19:49:19.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd981089f0 0x7fcd9819f900 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd981080a0 0x7fcd9819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcd840b4ca0 0x7fcd840b71b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 --2- 172.21.15.33:0/3764884460 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd981027c0 0x7fcd9819a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 -- 172.21.15.33:0/3764884460 >> 172.21.15.33:0/3764884460 conn(0x7fcd980793d0 msgr2=0x7fcd98103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:19.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 -- 172.21.15.33:0/3764884460 shutdown_connections 2024-08-28T19:49:19.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.683+0000 7fcd9f596640 1 -- 172.21.15.33:0/3764884460 wait complete. 2024-08-28T19:49:19.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-28T19:49:19.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 -- 172.21.15.33:0/2672981761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87101057c0 msgr2=0x7f871010f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 --2- 172.21.15.33:0/2672981761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87101057c0 0x7f871010f210 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f8708009cd0 tx=0x7f870802a8e0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 -- 172.21.15.33:0/2672981761 shutdown_connections 2024-08-28T19:49:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 --2- 172.21.15.33:0/2672981761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87101057c0 0x7f871010f210 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 --2- 172.21.15.33:0/2672981761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8710104e70 0x7f8710105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 --2- 172.21.15.33:0/2672981761 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8710102eb0 0x7f87101032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 -- 172.21.15.33:0/2672981761 >> 172.21.15.33:0/2672981761 conn(0x7f8710079a50 msgr2=0x7f8710079e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 -- 172.21.15.33:0/2672981761 shutdown_connections 2024-08-28T19:49:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 -- 172.21.15.33:0/2672981761 wait complete. 2024-08-28T19:49:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 Processor -- start 2024-08-28T19:49:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.808+0000 7f8718405640 1 -- start start 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f8718405640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8710102eb0 0x7f871019afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f8718405640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8710104e70 0x7f871019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f8718405640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87101057c0 0x7f871019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f8718405640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8710112690 con 0x7f87101057c0 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f8718405640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8710112510 con 0x7f8710104e70 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f8718405640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f8710112810 con 0x7f8710102eb0 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87169a2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87101057c0 0x7f871019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87169a2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87101057c0 0x7f871019ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56852/0 (socket says 172.21.15.33:56852) 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87169a2640 1 -- 172.21.15.33:0/1020132762 learned_addr learned my addr 172.21.15.33:0/1020132762 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87159a0640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8710104e70 0x7f871019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87161a1640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8710102eb0 0x7f871019afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87169a2640 1 -- 172.21.15.33:0/1020132762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8710102eb0 msgr2=0x7f871019afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87169a2640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8710102eb0 0x7f871019afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87169a2640 1 -- 172.21.15.33:0/1020132762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8710104e70 msgr2=0x7f871019b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87169a2640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8710104e70 0x7f871019b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87169a2640 1 -- 172.21.15.33:0/1020132762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87101a61c0 con 0x7f87101057c0 2024-08-28T19:49:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.809+0000 7f87169a2640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87101057c0 0x7f871019ba40 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f8708005cc0 tx=0x7f8708003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.810+0000 7f87077fe640 1 -- 172.21.15.33:0/1020132762 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708004240 con 0x7f87101057c0 2024-08-28T19:49:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.810+0000 7f87077fe640 1 -- 172.21.15.33:0/1020132762 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87080305a0 con 0x7f87101057c0 2024-08-28T19:49:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.810+0000 7f8718405640 1 -- 172.21.15.33:0/1020132762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87101a6450 con 0x7f87101057c0 2024-08-28T19:49:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.810+0000 7f87077fe640 1 -- 172.21.15.33:0/1020132762 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87080466c0 con 0x7f87101057c0 2024-08-28T19:49:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.810+0000 7f8718405640 1 -- 172.21.15.33:0/1020132762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87101a69f0 con 0x7f87101057c0 2024-08-28T19:49:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.811+0000 7f8718405640 1 -- 172.21.15.33:0/1020132762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87101032c0 con 0x7f87101057c0 2024-08-28T19:49:19.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.813+0000 7f87077fe640 1 -- 172.21.15.33:0/1020132762 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f8708030a50 con 0x7f87101057c0 2024-08-28T19:49:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.813+0000 7f87077fe640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86fc0b4d20 0x7f86fc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.813+0000 7f87077fe640 1 -- 172.21.15.33:0/1020132762 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7f870802e030 con 0x7f87101057c0 2024-08-28T19:49:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.813+0000 7f87161a1640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86fc0b4d20 0x7f86fc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.814+0000 7f87161a1640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86fc0b4d20 0x7f86fc0b7230 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f870c0058c0 tx=0x7f870c00a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:19.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:19.816+0000 7f87077fe640 1 -- 172.21.15.33:0/1020132762 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f870804b060 con 0x7f87101057c0 2024-08-28T19:49:20.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.004+0000 7f8718405640 1 -- 172.21.15.33:0/1020132762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f871002e430 con 0x7f87101057c0 2024-08-28T19:49:20.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.005+0000 7f87077fe640 1 -- 172.21.15.33:0/1020132762 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v106) ==== 103+0+11 (secure 0 0 0) 0x7f87080cd840 con 0x7f87101057c0 2024-08-28T19:49:20.006 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 -- 172.21.15.33:0/1020132762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86fc0b4d20 msgr2=0x7f86fc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86fc0b4d20 0x7f86fc0b7230 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f870c0058c0 tx=0x7f870c00a250 comp rx=0 tx=0).stop 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 -- 172.21.15.33:0/1020132762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87101057c0 msgr2=0x7f871019ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87101057c0 0x7f871019ba40 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f8708005cc0 tx=0x7f8708003ba0 comp rx=0 tx=0).stop 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 -- 172.21.15.33:0/1020132762 shutdown_connections 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87101057c0 0x7f871019ba40 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8710104e70 0x7f871019b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f86fc0b4d20 0x7f86fc0b7230 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 --2- 172.21.15.33:0/1020132762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8710102eb0 0x7f871019afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 -- 172.21.15.33:0/1020132762 >> 172.21.15.33:0/1020132762 conn(0x7f8710079a50 msgr2=0x7f8710108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:20.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 -- 172.21.15.33:0/1020132762 shutdown_connections 2024-08-28T19:49:20.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.007+0000 7f8718405640 1 -- 172.21.15.33:0/1020132762 wait complete. 2024-08-28T19:49:20.021 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-28T19:49:20.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:19 smithi059 ceph-mon[22052]: pgmap v870: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2024-08-28T19:49:20.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:19 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1724291362' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:49:20.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:19 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1385711161' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T19:49:20.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:19 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3250014285' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-28T19:49:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:19 smithi122 ceph-mon[22174]: pgmap v870: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2024-08-28T19:49:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:19 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1724291362' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:49:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:19 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1385711161' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-28T19:49:20.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:19 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3250014285' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-28T19:49:20.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.130+0000 7f3865781640 1 -- 172.21.15.33:0/4093343873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3860104f50 msgr2=0x7f386010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:20.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.130+0000 7f3865781640 1 --2- 172.21.15.33:0/4093343873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3860104f50 0x7f386010d590 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f3854009900 tx=0x7f385402a410 comp rx=0 tx=0).stop 2024-08-28T19:49:20.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.130+0000 7f3865781640 1 -- 172.21.15.33:0/4093343873 shutdown_connections 2024-08-28T19:49:20.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.130+0000 7f3865781640 1 --2- 172.21.15.33:0/4093343873 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f386010dad0 0x7f386010ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.130+0000 7f3865781640 1 --2- 172.21.15.33:0/4093343873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3860104f50 0x7f386010d590 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.130+0000 7f3865781640 1 --2- 172.21.15.33:0/4093343873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3860104520 0x7f3860104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.130+0000 7f3865781640 1 -- 172.21.15.33:0/4093343873 >> 172.21.15.33:0/4093343873 conn(0x7f38600fe0f0 msgr2=0x7f3860100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.130+0000 7f3865781640 1 -- 172.21.15.33:0/4093343873 shutdown_connections 2024-08-28T19:49:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.130+0000 7f3865781640 1 -- 172.21.15.33:0/4093343873 wait complete. 2024-08-28T19:49:20.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f3865781640 1 Processor -- start 2024-08-28T19:49:20.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f3865781640 1 -- start start 2024-08-28T19:49:20.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f3865781640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3860104520 0x7f386019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:20.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f3865781640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3860104f50 0x7f386019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:20.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f3865781640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386010dad0 0x7f386019f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f3865781640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3860113740 con 0x7f3860104f50 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f3865781640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38601135c0 con 0x7f386010dad0 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f3865781640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f38601138c0 con 0x7f3860104520 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f385e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3860104f50 0x7f386019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f385e7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3860104f50 0x7f386019a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56862/0 (socket says 172.21.15.33:56862) 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f385e7fc640 1 -- 172.21.15.33:0/3442485892 learned_addr learned my addr 172.21.15.33:0/3442485892 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f385f7fe640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386010dad0 0x7f386019f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f385effd640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3860104520 0x7f386019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f385e7fc640 1 -- 172.21.15.33:0/3442485892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3860104520 msgr2=0x7f386019a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f385e7fc640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3860104520 0x7f386019a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:20.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.131+0000 7f385e7fc640 1 -- 172.21.15.33:0/3442485892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386010dad0 msgr2=0x7f386019f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:20.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.132+0000 7f385e7fc640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386010dad0 0x7f386019f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:20.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.132+0000 7f385e7fc640 1 -- 172.21.15.33:0/3442485892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38601a00f0 con 0x7f3860104f50 2024-08-28T19:49:20.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.132+0000 7f385e7fc640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3860104f50 0x7f386019a760 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f3854006010 tx=0x7f3854004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:20.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.132+0000 7f3847fff640 1 -- 172.21.15.33:0/3442485892 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385403f030 con 0x7f3860104f50 2024-08-28T19:49:20.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.132+0000 7f3847fff640 1 -- 172.21.15.33:0/3442485892 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3854003aa0 con 0x7f3860104f50 2024-08-28T19:49:20.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.132+0000 7f3847fff640 1 -- 172.21.15.33:0/3442485892 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854035070 con 0x7f3860104f50 2024-08-28T19:49:20.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.132+0000 7f3865781640 1 -- 172.21.15.33:0/3442485892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38601a0380 con 0x7f3860104f50 2024-08-28T19:49:20.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.132+0000 7f3865781640 1 -- 172.21.15.33:0/3442485892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38601a6b70 con 0x7f3860104f50 2024-08-28T19:49:20.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.133+0000 7f3865781640 1 -- 172.21.15.33:0/3442485892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3860104930 con 0x7f3860104f50 2024-08-28T19:49:20.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.135+0000 7f3847fff640 1 -- 172.21.15.33:0/3442485892 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f3854042030 con 0x7f3860104f50 2024-08-28T19:49:20.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.136+0000 7f3847fff640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38480b4d20 0x7f38480b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:20.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.136+0000 7f385effd640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38480b4d20 0x7f38480b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:20.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.136+0000 7f3847fff640 1 -- 172.21.15.33:0/3442485892 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7f3854106070 con 0x7f3860104f50 2024-08-28T19:49:20.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.136+0000 7f385effd640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38480b4d20 0x7f38480b7230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f385000bbe0 tx=0x7f385000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:20.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.139+0000 7f3847fff640 1 -- 172.21.15.33:0/3442485892 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f38540cc470 con 0x7f3860104f50 2024-08-28T19:49:20.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.381+0000 7f3865781640 1 -- 172.21.15.33:0/3442485892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f386019b2e0 con 0x7f3860104f50 2024-08-28T19:49:20.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.389+0000 7f3847fff640 1 -- 172.21.15.33:0/3442485892 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) ==== 81+0+826323 (secure 0 0 0) 0x7f386019b2e0 con 0x7f3860104f50 2024-08-28T19:49:20.402 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 24, 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "active_gid": 14223, 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "active_name": "x", 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "active_addrs": { 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:6800", 2024-08-28T19:49:20.403 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 3015249273 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:6801", 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 3015249273 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "active_addr": "172.21.15.33:6801/3015249273", 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "active_change": "2024-08-28T19:23:25.613878+0000", 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "active_mgr_features": 4540701547738038271, 2024-08-28T19:49:20.404 INFO:teuthology.orchestra.run.smithi033.stdout: "available": true, 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "standbys": [ 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "gid": 24140, 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "y", 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr_features": 4540701547738038271, 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.406 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.407 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.408 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.409 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.410 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.411 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.412 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.413 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.414 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.415 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-08-28T19:49:20.416 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.417 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-08-28T19:49:20.418 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-08-28T19:49:20.419 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.420 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.421 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.422 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.423 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:20.424 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:20.425 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.426 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.427 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-08-28T19:49:20.428 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-08-28T19:49:20.429 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.430 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.431 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.432 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.433 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-08-28T19:49:20.437 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.438 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.439 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.441 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.442 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.443 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.444 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.446 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-28T19:49:20.447 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.448 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.449 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.450 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-08-28T19:49:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-08-28T19:49:20.453 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-08-28T19:49:20.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-08-28T19:49:20.455 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-08-28T19:49:20.456 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-28T19:49:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.457 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-08-28T19:49:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-08-28T19:49:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-08-28T19:49:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.460 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-08-28T19:49:20.461 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-08-28T19:49:20.462 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-08-28T19:49:20.463 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.464 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nginx": { 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nginx", 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nginx container image", 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:20.469 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-08-28T19:49:20.470 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_oauth2_proxy": { 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_oauth2_proxy", 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.471 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "oauth2-proxy container image", 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.472 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.473 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.474 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.475 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.476 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.477 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-08-28T19:49:20.478 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-08-28T19:49:20.479 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.480 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.481 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.482 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.484 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-08-28T19:49:20.485 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.486 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.487 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.488 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.489 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.490 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.491 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.492 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.493 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.494 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-28T19:49:20.495 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-08-28T19:49:20.496 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.497 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.499 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.500 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.501 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.502 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-08-28T19:49:20.503 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-08-28T19:49:20.504 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-08-28T19:49:20.505 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.507 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.509 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.510 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-28T19:49:20.511 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.512 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.513 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.515 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.516 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-08-28T19:49:20.517 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.518 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.519 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.520 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.521 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.522 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.523 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.524 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-08-28T19:49:20.525 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-08-28T19:49:20.526 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.527 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.528 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.529 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.530 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.531 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.532 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.533 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.534 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-28T19:49:20.535 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-28T19:49:20.536 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.537 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.538 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.540 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.541 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.542 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.543 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.544 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.545 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.546 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.547 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.548 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.549 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.550 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "[]", 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "MULTICLUSTER_CONFIG": { 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.551 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "{}", 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.552 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-28T19:49:20.553 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-28T19:49:20.554 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.555 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.557 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.558 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.559 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.560 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.561 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.562 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.563 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.565 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.566 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.567 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-28T19:49:20.568 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-08-28T19:49:20.569 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-08-28T19:49:20.570 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.571 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.574 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.575 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.576 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.577 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.578 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.579 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.580 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.581 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.583 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.584 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.585 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.586 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.587 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-08-28T19:49:20.588 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.589 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.590 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.591 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.592 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.593 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.594 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.595 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.596 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-08-28T19:49:20.597 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.598 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.600 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.601 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.602 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.603 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.604 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.605 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.606 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.607 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.608 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.609 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.610 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-08-28T19:49:20.611 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.612 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.613 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.614 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.616 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.617 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.618 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.619 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:20.620 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.621 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.622 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-08-28T19:49:20.623 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.624 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-08-28T19:49:20.625 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:20.626 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.627 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.628 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.629 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.630 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.631 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.632 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.633 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.634 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.635 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.636 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-28T19:49:20.637 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-08-28T19:49:20.638 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.640 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.641 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.642 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.643 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.644 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.645 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.646 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.647 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.648 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.649 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.650 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.651 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.652 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.653 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-08-28T19:49:20.654 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-08-28T19:49:20.655 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.656 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.657 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.658 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.659 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.660 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.661 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.662 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.663 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.664 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.665 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.666 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.667 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.669 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-28T19:49:20.670 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-08-28T19:49:20.671 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.672 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.673 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.674 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.675 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.676 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.677 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.678 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.679 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.680 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.681 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.682 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.683 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.684 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.685 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.686 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.687 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.688 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.689 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.690 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.691 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.692 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.693 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.694 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.695 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.696 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.697 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.698 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.699 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.700 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.701 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.702 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-08-28T19:49:20.703 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.704 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.705 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.706 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.707 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.708 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.709 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.710 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.711 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.713 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.714 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.716 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.717 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.718 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.719 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.720 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.721 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.724 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.725 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.726 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.727 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.729 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.730 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.731 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.733 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.734 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.735 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.736 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.737 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.738 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.739 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.740 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.741 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.741 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.741 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.741 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.741 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-08-28T19:49:20.741 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-08-28T19:49:20.741 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.741 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.741 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.742 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.743 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.744 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.745 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.746 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.747 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.748 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.750 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.751 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.752 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.753 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.754 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-08-28T19:49:20.755 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-08-28T19:49:20.756 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.757 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.758 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.759 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.760 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.761 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.762 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.763 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.764 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.766 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-08-28T19:49:20.767 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-08-28T19:49:20.768 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.770 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.771 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.772 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.773 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.774 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "max_requests": { 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_requests", 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.775 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.776 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.777 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.778 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.779 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.780 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.781 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.782 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.783 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.784 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "secondary_zone_period_retry_limit": { 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-28T19:49:20.785 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.786 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.787 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.788 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.789 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.790 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.792 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.793 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.794 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.795 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.796 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.797 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.798 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.799 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.800 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.801 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.804 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.805 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.807 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.808 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.809 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.810 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.811 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.812 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.813 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smb", 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: "internal_store_backend": { 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "internal_store_backend", 2024-08-28T19:49:20.814 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.815 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.816 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.817 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.818 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.819 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.820 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.821 INFO:teuthology.orchestra.run.smithi033.stdout: "update_orchestration": { 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "update_orchestration", 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.823 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.824 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.825 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.826 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.827 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.828 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.829 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.830 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.831 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.832 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.833 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.834 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.835 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.836 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.838 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.839 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.840 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.841 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.842 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.843 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.844 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.845 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.846 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.847 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.848 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.849 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.850 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.851 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.852 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.853 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.854 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.855 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.856 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-08-28T19:49:20.857 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-08-28T19:49:20.858 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-08-28T19:49:20.859 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-08-28T19:49:20.860 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.861 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.862 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.864 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.866 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.867 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.868 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.869 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.869 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.869 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.869 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.869 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.869 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.872 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.872 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.872 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.872 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.872 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.872 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.872 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.872 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.873 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.874 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.875 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.876 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.877 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.878 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.879 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-08-28T19:49:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.882 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.883 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.884 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.885 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.886 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.887 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.888 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.889 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.890 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.891 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.892 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.893 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.894 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.895 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.896 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.897 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.898 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.900 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.901 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.903 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.904 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.905 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.906 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.907 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.908 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.909 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.910 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.911 INFO:teuthology.orchestra.run.smithi033.stdout: "gid": 24142, 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "z", 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr_features": 4540701547738038271, 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.912 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.913 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.914 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.915 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.916 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.917 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.918 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.919 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-08-28T19:49:20.920 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.921 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.922 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.923 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.924 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.925 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.926 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.927 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.928 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.929 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T19:49:20.930 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-28T19:49:20.931 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.932 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.933 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-08-28T19:49:20.934 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.935 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.936 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.937 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.938 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.939 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.940 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.941 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-08-28T19:49:20.942 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-08-28T19:49:20.943 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-08-28T19:49:20.944 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.945 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:20.946 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.947 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.948 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:20.949 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:20.950 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-28T19:49:20.951 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.952 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.953 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.954 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.955 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.956 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.957 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.960 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-28T19:49:20.961 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.962 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.963 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.964 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.965 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.966 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-28T19:49:20.967 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-28T19:49:20.968 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.969 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.970 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.971 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nginx": { 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nginx", 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.972 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nginx container image", 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-08-28T19:49:20.973 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-08-28T19:49:20.974 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_oauth2_proxy": { 2024-08-28T19:49:20.975 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_oauth2_proxy", 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "oauth2-proxy container image", 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-08-28T19:49:20.976 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.977 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.980 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.981 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-28T19:49:20.982 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.983 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.984 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-08-28T19:49:20.985 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.986 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.987 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.988 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:20.989 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.990 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-08-28T19:49:20.991 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:20.992 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.993 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.994 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.995 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.996 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.997 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.998 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:20.999 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.000 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.001 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.002 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.003 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.004 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-08-28T19:49:21.005 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.006 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.008 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-28T19:49:21.009 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.010 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.011 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.012 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-08-28T19:49:21.013 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.014 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.015 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.016 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.017 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-08-28T19:49:21.018 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-08-28T19:49:21.019 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.020 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.021 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.022 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.023 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.024 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.025 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.026 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.027 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.028 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.029 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.030 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.031 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.032 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.033 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-08-28T19:49:21.034 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-28T19:49:21.035 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.036 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.037 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.038 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.040 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.042 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.043 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.044 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.045 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.046 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.047 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.048 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-08-28T19:49:21.049 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.050 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.051 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.052 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.053 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.054 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "[]", 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "MULTICLUSTER_CONFIG": { 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-28T19:49:21.055 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "{}", 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-28T19:49:21.056 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-28T19:49:21.057 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.058 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.061 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.062 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.063 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.064 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.065 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.066 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.067 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.068 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.069 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.070 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.071 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.072 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-28T19:49:21.073 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.074 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.074 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.074 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.076 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.076 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.076 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.076 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.076 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.076 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.076 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.076 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-08-28T19:49:21.076 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.078 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.079 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.080 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.081 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.082 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.083 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.084 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-08-28T19:49:21.085 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.086 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.087 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.088 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.089 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.090 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.091 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-08-28T19:49:21.092 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-08-28T19:49:21.093 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.095 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.096 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.097 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.098 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.099 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.100 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.101 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-08-28T19:49:21.103 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-08-28T19:49:21.104 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.105 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.106 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.107 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.108 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.109 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.110 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-08-28T19:49:21.111 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-08-28T19:49:21.112 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-08-28T19:49:21.113 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.114 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.115 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.118 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.119 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.120 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.121 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.122 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.123 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-08-28T19:49:21.124 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-08-28T19:49:21.125 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:21.126 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.127 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.128 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-08-28T19:49:21.129 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-08-28T19:49:21.130 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.131 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.133 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.134 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.135 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.136 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.140 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.141 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.142 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-08-28T19:49:21.143 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.144 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.145 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.146 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.147 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.148 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.149 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.150 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.151 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.152 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.153 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.154 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.155 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.156 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.157 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.158 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.159 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-08-28T19:49:21.160 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-08-28T19:49:21.161 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.162 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.163 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.164 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.169 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.171 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.172 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.173 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.174 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.175 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-08-28T19:49:21.176 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-08-28T19:49:21.177 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-08-28T19:49:21.178 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.179 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.180 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-08-28T19:49:21.181 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.182 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.183 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.184 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.185 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.186 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.187 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.188 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.189 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.190 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.191 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.192 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.193 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.194 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.195 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.196 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.197 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.198 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.199 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.200 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.201 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.202 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.203 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.204 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.205 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.206 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.207 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.208 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.209 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.210 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.211 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.212 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.213 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.214 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.215 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.216 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.217 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.219 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.221 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.222 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.223 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.224 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.225 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.226 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.227 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.228 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.229 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.230 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:21.231 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.232 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.233 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.234 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.235 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-08-28T19:49:21.236 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.237 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.238 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.239 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.240 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.241 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.242 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.243 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-08-28T19:49:21.244 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.245 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-08-28T19:49:21.246 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-08-28T19:49:21.247 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.248 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.249 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.250 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.251 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.253 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.254 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.255 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.256 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.257 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.258 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.259 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-08-28T19:49:21.260 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-08-28T19:49:21.261 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-08-28T19:49:21.262 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.264 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.265 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.267 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.268 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.269 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.270 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.271 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.272 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.273 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.274 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.275 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.276 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.277 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.278 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.279 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.280 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "max_requests": { 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_requests", 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.281 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.282 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.283 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.284 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-08-28T19:49:21.285 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.286 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.287 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.288 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.289 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.290 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "secondary_zone_period_retry_limit": { 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.291 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.292 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.293 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.294 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.295 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.296 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.297 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.298 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.299 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.300 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.301 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.302 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.303 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.304 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.305 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.306 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.307 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.308 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.309 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.310 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.311 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.312 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.313 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.314 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.315 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.316 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.317 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-08-28T19:49:21.318 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-08-28T19:49:21.319 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.320 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smb", 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "internal_store_backend": { 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "internal_store_backend", 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.321 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.322 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.323 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.326 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.327 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "update_orchestration": { 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "update_orchestration", 2024-08-28T19:49:21.328 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.330 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.331 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.332 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.333 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.334 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.335 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.336 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.337 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.338 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.339 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.341 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.342 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.415 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.416 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.417 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.418 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.419 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.420 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.421 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.422 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.423 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.424 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.425 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:21.426 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.427 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.428 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.429 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.430 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.431 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.432 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.433 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-08-28T19:49:21.434 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-08-28T19:49:21.435 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.436 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.440 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.441 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.442 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.443 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-08-28T19:49:21.444 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.445 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.446 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.447 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.448 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.449 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.450 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.451 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.452 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.453 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.454 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.455 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.456 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.457 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.458 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.459 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.460 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.461 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.462 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.463 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.464 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.465 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.466 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.467 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.468 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.469 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.470 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.473 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-28T19:49:21.474 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.475 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:21.476 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-08-28T19:49:21.477 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:21.478 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.479 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.480 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.481 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.482 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.483 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.484 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.485 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.486 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.487 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.488 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.489 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.489 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.489 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.489 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.489 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.489 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:21.489 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.489 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.489 INFO:teuthology.orchestra.run.smithi033.stdout: "modules": [ 2024-08-28T19:49:21.491 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-08-28T19:49:21.492 INFO:teuthology.orchestra.run.smithi033.stdout: "dashboard", 2024-08-28T19:49:21.492 INFO:teuthology.orchestra.run.smithi033.stdout: "iostat", 2024-08-28T19:49:21.492 INFO:teuthology.orchestra.run.smithi033.stdout: "nfs", 2024-08-28T19:49:21.492 INFO:teuthology.orchestra.run.smithi033.stdout: "restful", 2024-08-28T19:49:21.492 INFO:teuthology.orchestra.run.smithi033.stdout: "snap_schedule" 2024-08-28T19:49:21.492 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.492 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-08-28T19:49:21.492 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.492 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.493 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.494 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.496 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.497 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.498 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.499 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.500 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-08-28T19:49:21.501 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.502 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.502 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.502 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.502 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.502 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.502 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.502 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-08-28T19:49:21.502 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.502 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.502 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.503 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.504 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.505 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.506 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.507 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.508 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.509 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.510 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-08-28T19:49:21.511 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.512 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-08-28T19:49:21.513 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.514 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-08-28T19:49:21.515 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.516 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-08-28T19:49:21.517 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.518 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.519 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.520 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.521 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.523 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.524 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-08-28T19:49:21.525 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.526 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:21.527 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.528 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-08-28T19:49:21.529 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.531 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.532 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.533 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.534 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-08-28T19:49:21.535 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.536 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.537 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.538 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-08-28T19:49:21.539 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.540 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.541 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.542 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-08-28T19:49:21.543 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-08-28T19:49:21.544 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-08-28T19:49:21.545 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.546 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-08-28T19:49:21.547 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.548 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.551 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-08-28T19:49:21.552 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.553 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nginx": { 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nginx", 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.554 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nginx container image", 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.555 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.556 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_oauth2_proxy": { 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_oauth2_proxy", 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.557 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "oauth2-proxy container image", 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.558 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.559 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.560 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.561 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.562 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.563 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.564 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.565 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.566 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-08-28T19:49:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-08-28T19:49:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.568 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.569 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.570 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.571 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-28T19:49:21.572 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.573 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.574 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.575 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.578 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.579 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.580 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.581 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.582 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.583 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-08-28T19:49:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.586 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.587 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.588 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-28T19:49:21.589 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.590 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.591 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.592 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.593 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-08-28T19:49:21.594 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.595 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.596 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.597 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.598 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.599 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-08-28T19:49:21.600 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-08-28T19:49:21.601 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.602 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.603 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.604 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.605 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.606 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.607 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.608 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.609 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.610 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.611 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.612 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.613 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.614 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.617 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.618 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.619 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.620 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.621 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.622 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.623 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.624 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.625 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.626 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.627 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.628 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.629 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.631 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.632 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.633 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.634 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "[]", 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "MULTICLUSTER_CONFIG": { 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.635 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "{}", 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.636 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.637 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.638 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-28T19:49:21.639 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-28T19:49:21.640 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-28T19:49:21.641 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-28T19:49:21.642 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-28T19:49:21.643 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.644 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.645 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.646 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-28T19:49:21.647 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.649 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.650 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.651 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.652 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.653 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.654 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.655 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.656 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.657 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.658 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.659 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.660 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.661 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.662 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.663 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.664 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.665 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.666 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.667 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.668 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.669 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.672 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.673 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.674 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.675 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.676 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.677 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-08-28T19:49:21.680 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-08-28T19:49:21.681 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.682 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.683 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.684 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.685 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.686 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.687 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-08-28T19:49:21.688 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.689 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.690 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.691 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.692 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.693 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-08-28T19:49:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-08-28T19:49:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-08-28T19:49:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.696 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.697 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.698 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.699 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.700 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.701 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.702 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.703 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.704 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.705 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.706 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-08-28T19:49:21.707 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.708 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.710 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.711 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.712 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.713 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.714 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.715 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.716 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.717 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.718 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.719 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-08-28T19:49:21.720 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.721 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.722 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.723 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-08-28T19:49:21.724 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.725 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.726 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.727 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.728 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.729 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.730 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.731 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.732 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.733 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.734 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.735 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.736 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.737 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.738 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.739 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-28T19:49:21.740 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.741 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.742 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.743 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.744 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.745 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.746 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-08-28T19:49:21.747 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-28T19:49:21.748 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.749 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.750 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.751 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.752 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.753 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.754 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.755 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.756 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.757 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.758 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.759 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-08-28T19:49:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.761 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.762 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.763 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.764 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.765 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.766 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.767 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.768 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.769 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.770 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.771 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.772 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.773 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.774 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.775 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.776 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.777 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.778 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.779 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.780 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-08-28T19:49:21.781 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.782 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.783 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.784 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.786 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.787 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.788 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.789 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.790 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.791 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.792 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.793 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.794 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.795 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.798 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.799 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.800 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.801 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.802 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-08-28T19:49:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.805 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.806 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.807 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.808 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.809 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.810 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.811 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.812 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.813 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.814 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.815 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.816 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.817 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.818 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.819 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.820 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.821 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.822 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.823 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-08-28T19:49:21.824 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-08-28T19:49:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.826 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.827 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.828 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.829 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.831 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.832 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.833 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.834 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.835 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-28T19:49:21.836 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.837 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.838 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.839 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.840 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.841 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.842 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.843 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.844 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.845 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.846 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.847 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.848 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.849 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.850 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-08-28T19:49:21.851 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.852 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.854 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.855 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.856 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.857 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.858 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "max_requests": { 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_requests", 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.859 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.860 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.861 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.862 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.863 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.864 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.865 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.866 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.867 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "secondary_zone_period_retry_limit": { 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.870 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.871 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.872 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.873 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.874 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.875 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.876 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-08-28T19:49:21.877 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.879 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.880 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.881 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.882 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.883 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.884 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.885 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.886 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.887 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-08-28T19:49:21.888 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-08-28T19:49:21.889 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-08-28T19:49:21.890 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-08-28T19:49:21.891 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-08-28T19:49:21.892 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.894 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.895 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.896 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-08-28T19:49:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-08-28T19:49:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.897 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smb", 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "internal_store_backend": { 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "internal_store_backend", 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.901 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.902 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.903 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.905 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.906 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.907 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "update_orchestration": { 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "update_orchestration", 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.908 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.909 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.910 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.911 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.912 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.913 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.914 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.915 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.916 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.917 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.918 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.919 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.920 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.921 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.922 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.923 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.924 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.925 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.926 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.927 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.928 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.929 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.930 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.932 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-08-28T19:49:21.933 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.934 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.935 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.936 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.937 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.938 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.939 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.941 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.943 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.944 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.945 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.946 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.947 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.948 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.949 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.950 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.951 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.952 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-08-28T19:49:21.953 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.954 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.955 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.956 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.957 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.958 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.960 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.961 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.962 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.963 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.964 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.965 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.966 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.967 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.968 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.969 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.971 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.972 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.973 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.974 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.975 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.976 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.977 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.978 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.979 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.980 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.981 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.982 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.983 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.984 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.985 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-08-28T19:49:21.988 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-08-28T19:49:21.989 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-08-28T19:49:21.990 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-08-28T19:49:21.991 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-08-28T19:49:21.992 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-08-28T19:49:21.993 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.994 INFO:teuthology.orchestra.run.smithi033.stdout: "services": { 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "dashboard": "https://172.21.15.33:8443/" 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "always_on_modules": { 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "octopus": [ 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-08-28T19:49:21.995 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "pacific": [ 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.996 INFO:teuthology.orchestra.run.smithi033.stdout: "quincy": [ 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "reef": [ 2024-08-28T19:49:21.997 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "squid": [ 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-08-28T19:49:21.998 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "last_failure_osd_epoch": 5, 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "active_clients": [ 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-08-28T19:49:21.999 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 1786980145 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "libcephsqlite", 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-08-28T19:49:22.000 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 168987308 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 2460370459 2024-08-28T19:49:22.001 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 1912524002 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.002 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 3969166407 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-08-28T19:49:22.003 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-08-28T19:49:22.004 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-08-28T19:49:22.004 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 2856994647 2024-08-28T19:49:22.004 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.004 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:22.004 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.004 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-08-28T19:49:22.004 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:49:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 -- 172.21.15.33:0/3442485892 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38480b4d20 msgr2=0x7f38480b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38480b4d20 0x7f38480b7230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f385000bbe0 tx=0x7f385000b390 comp rx=0 tx=0).stop 2024-08-28T19:49:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 -- 172.21.15.33:0/3442485892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3860104f50 msgr2=0x7f386019a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3860104f50 0x7f386019a760 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f3854006010 tx=0x7f3854004060 comp rx=0 tx=0).stop 2024-08-28T19:49:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 -- 172.21.15.33:0/3442485892 shutdown_connections 2024-08-28T19:49:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f386010dad0 0x7f386019f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3860104f50 0x7f386019a760 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f38480b4d20 0x7f38480b7230 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 --2- 172.21.15.33:0/3442485892 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3860104520 0x7f386019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 -- 172.21.15.33:0/3442485892 >> 172.21.15.33:0/3442485892 conn(0x7f38600fe0f0 msgr2=0x7f386010fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 -- 172.21.15.33:0/3442485892 shutdown_connections 2024-08-28T19:49:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:20.395+0000 7f3865781640 1 -- 172.21.15.33:0/3442485892 wait complete. 2024-08-28T19:49:22.013 DEBUG:tasks.check_counter:Getting stats from a 2024-08-28T19:49:22.013 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-28T19:49:22.014 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:20 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3764884460' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-28T19:49:22.014 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:20 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1020132762' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-28T19:49:22.014 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:20 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3442485892' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-28T19:49:22.014 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:21 smithi033 ceph-mon[18549]: pgmap v871: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-08-28T19:49:22.015 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:20 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3764884460' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-28T19:49:22.015 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:20 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1020132762' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-28T19:49:22.015 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:20 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3442485892' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-28T19:49:22.015 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:20 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3764884460' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-28T19:49:22.015 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:20 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1020132762' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-28T19:49:22.015 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:20 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3442485892' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-28T19:49:22.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:21 smithi059 ceph-mon[22052]: pgmap v871: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-08-28T19:49:22.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:21 smithi122 ceph-mon[22174]: pgmap v871: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-08-28T19:49:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:22.821 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 2272, 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2274, 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 680271, 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 722497, 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 6, 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.278401308, 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.123294372, 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.061280855, 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.073388277, 2024-08-28T19:49:22.822 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 2272, 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.082324360, 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000036234 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:22.823 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 353, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 347, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 902206, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 201038, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 6, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 3, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.058553066, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.030677948, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.035382940, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000080790, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 346, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.020804623, 2024-08-28T19:49:22.824 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000060128 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 900816, 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 200016 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 1051, 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 1289, 2024-08-28T19:49:22.825 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 260490, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 839172, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 6, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 4, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.148058203, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.068640189, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.027723546, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.040324851, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 1288, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.053130095, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000041250 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:22.826 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 506544 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 1, 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "finisher-MDSRank": { 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "queue_len": 0, 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "complete_latency": { 2024-08-28T19:49:22.827 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 5252, 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.169179373, 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000032212 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: "finisher-PurgeQueue": { 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: "queue_len": 0, 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: "complete_latency": { 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.828 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: "request": 0, 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: "reply": 0, 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: "reply_latency": { 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: "slow_reply": 0, 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: "forward": 0, 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_fetch_complete": 0, 2024-08-28T19:49:22.829 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_fetch_keys": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_commit": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_split": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_merge": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_top": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_bottom": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_pin_tail": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_pinned": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_expired": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_with_caps": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "subtrees": 1, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse": 0, 2024-08-28T19:49:22.830 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_hit": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_forward": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_discover": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_dir_fetch": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_remote_ino": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_lock": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "load_cent": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "q": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "exported": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "exported_inodes": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "imported": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "imported_inodes": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_dir_fetch": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_backtrace_fetch": 0, 2024-08-28T19:49:22.831 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_peer_discover": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rfiles": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rbytes": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rsnaps": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_set_tag": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_inotable_repaired": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dir_inodes": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_file_inodes": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_inode_file_caps": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T19:49:22.832 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_grant": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_caps": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_caps_dirty": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_cap_release": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "process_request_cap_release": 0 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_cache": { 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_update": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_update_receipt": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_try_discover": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_send_discover": 0, 2024-08-28T19:49:22.833 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_handle_discover": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays_delayed": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays_enqueuing": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_created": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_enqueued": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_reintegrated": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_migrated": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_processing": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_enqueued": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_prioritized": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "recovery_started": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "recovery_completed": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_quiesce_path": 0, 2024-08-28T19:49:22.834 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_quiesce_inode": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_exportdir": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_flush": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_fragmentdir": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_fragstats": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_inodestats": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_succeeded": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_write_failed": 0 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_log": { 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "evlrg": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "evadd": 0, 2024-08-28T19:49:22.835 INFO:teuthology.orchestra.run.smithi033.stdout: "evex": 0, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "evtrm": 0, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "ev": 4, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "evexg": 0, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "evexd": 0, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "segadd": 0, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "segex": 0, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "segtrm": 0, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "seg": 2, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "segmjr": 2, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "segexg": 0, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "segexd": 0, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "expos": 4194304, 2024-08-28T19:49:22.836 INFO:teuthology.orchestra.run.smithi033.stdout: "wrpos": 4195424, 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "rdpos": 4195283, 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "jlat": { 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "replayed": 4 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_mem": { 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "ino": 3, 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "ino+": 3, 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "ino-": 0, 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "dir": 1, 2024-08-28T19:49:22.837 INFO:teuthology.orchestra.run.smithi033.stdout: "dir+": 1, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "dir-": 0, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "dn": 0, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "dn+": 0, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "dn-": 0, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "cap": 0, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "cap+": 0, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "cap-": 0, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "rss": 119728, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "heap": 316424192 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_server": { 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "dispatch_client_request": 0, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "dispatch_server_request": 0, 2024-08-28T19:49:22.838 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_request": 0, 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_session": 0, 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_peer_request": 0, 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "req_create_latency": { 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getattr_latency": { 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getfilelock_latency": { 2024-08-28T19:49:22.839 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: "req_link_latency": { 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookup_latency": { 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookuphash_latency": { 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupino_latency": { 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupname_latency": { 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.841 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupparent_latency": { 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupsnap_latency": { 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lssnap_latency": { 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.842 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.843 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.843 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mkdir_latency": { 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mknod_latency": { 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mksnap_latency": { 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.844 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "req_open_latency": { 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "req_readdir_latency": { 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rename_latency": { 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.845 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: "req_renamesnap_latency": { 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: "req_snapdiff_latency": { 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.846 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmdir_latency": { 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmsnap_latency": { 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmxattr_latency": { 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setattr_latency": { 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setdirlayout_latency": { 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setfilelock_latency": { 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.848 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setlayout_latency": { 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setxattr_latency": { 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "req_symlink_latency": { 2024-08-28T19:49:22.849 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "req_unlink_latency": { 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "cap_revoke_eviction": 0, 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "cap_acquisition_throttle": 0, 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getvxattr_latency": { 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_sessions": { 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "session_count": 0, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "session_add": 1, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "session_remove": 1, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "sessions_open": 1, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "sessions_stale": 0, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "total_load": 0, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "average_load": 0, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "avg_session_uptime": 1009, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "mdthresh_evicted": 0 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.851 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:22.852 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:22.853 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 198242, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 57, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-08-28T19:49:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 9544, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 193, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 8512, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 13, 2024-08-28T19:49:22.855 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "objecter": { 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "op_active": 0, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "op_laggy": 0, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "op_send": 3321, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "op_send_bytes": 21, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "op_resend": 3, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "op_reply": 3321, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "op_latency": { 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3321, 2024-08-28T19:49:22.856 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 2.341959935, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000705197 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "op_inflight": 0, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "oplen_avg": { 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3321, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 3322 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "op": 3321, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "op_r": 3321, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "op_w": 0, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "op_rmw": 0, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "op_pg": 0, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_stat": 2179, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_create": 0, 2024-08-28T19:49:22.857 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_read": 1140, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_write": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_writefull": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_writesame": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_append": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_zero": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_truncate": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_delete": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_mapext": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_sparse_read": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_clonerange": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_getxattr": 1, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_setxattr": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_cmpxattr": 0, 2024-08-28T19:49:22.858 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_rmxattr": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_resetxattrs": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_call": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_watch": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_notify": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_pgls": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_pgls_filter": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_other": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_active": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_send": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_resend": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_ping": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_active": 0, 2024-08-28T19:49:22.859 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_send": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_resend": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_active": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_send": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_resend": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_active": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_send": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_resend": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "command_active": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "command_send": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "command_resend": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "map_epoch": 106, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "map_full": 0, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "map_inc": 24, 2024-08-28T19:49:22.860 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_sessions": 6, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_session_open": 9, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_session_close": 3, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_laggy": 0, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_wr": 0, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_rd": 2, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_del": 0 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "oft": { 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_objs": 0, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_kv_pairs": 0, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_updates": 0, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_removes": 0 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: "purge_queue": { 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_ops": 0, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing": 0, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_high_water": 0, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executed_ops": 0, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executed": 0, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_item_in_journal": 0 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 3672, 2024-08-28T19:49:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 1491557, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 3672, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 3672, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 1491557, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-objecter_bytes": { 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:22.863 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 3321, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 1125, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 3321, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 1125, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.864 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-objecter_ops": { 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 1024, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 3321, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 3321, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 3321, 2024-08-28T19:49:22.865 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 3321, 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-write_buf_throttle": { 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 3758096384, 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:22.866 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 0, 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 0, 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-write_buf_throttle-0x5555b17f4c30": { 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 3758096384, 2024-08-28T19:49:22.867 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 0, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 0, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:22.869 INFO:teuthology.orchestra.run.smithi033.stdout: "trackedop": { 2024-08-28T19:49:22.869 INFO:teuthology.orchestra.run.smithi033.stdout: "slow_ops_count": 0 2024-08-28T19:49:22.869 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:22.869 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:49:23.799 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:23 smithi033 ceph-mon[18549]: pgmap v872: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-08-28T19:49:23.826 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-08-28T19:49:23.826 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-08-28T19:49:23.826 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-08-28T19:49:23.826 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-08-28T19:49:23.826 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-08-28T19:49:23.826 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-08-28T19:49:23.826 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-08-28T19:49:23.826 DEBUG:tasks.check_counter:Getting stats from d 2024-08-28T19:49:23.826 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-28T19:49:24.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:23 smithi059 ceph-mon[22052]: pgmap v872: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-08-28T19:49:24.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:23 smithi122 ceph-mon[22174]: pgmap v872: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-08-28T19:49:24.078 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:24.725 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:49:24.725 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:24.725 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 0, 2024-08-28T19:49:24.725 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2, 2024-08-28T19:49:24.725 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 0, 2024-08-28T19:49:24.725 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 0, 2024-08-28T19:49:24.725 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-08-28T19:49:24.725 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.001247954, 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000000000, 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.000322264, 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:24.726 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 331, 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 324, 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 861408, 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 199408, 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-08-28T19:49:24.727 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.057602420, 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.030137290, 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.034298861, 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 324, 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.021578773, 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000066601 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:24.728 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 861408, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 199408 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 2, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 246, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 320, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 203520, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.025624994, 2024-08-28T19:49:24.729 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.021084833, 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.001842888, 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 244, 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.014456993, 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000059249 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-28T19:49:24.730 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 203520 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:24.731 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:24.732 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:24.733 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 148721, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 30, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-08-28T19:49:24.734 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 928, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:24.735 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 329, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 812182, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 329, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 329, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 812182, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:24.736 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:24.737 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:24.737 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:49:25.464 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-28T19:49:25.464 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-28T19:49:25.464 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-08-28T19:49:25.464 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-08-28T19:49:25.464 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-08-28T19:49:25.464 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-08-28T19:49:25.464 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-08-28T19:49:25.464 DEBUG:tasks.check_counter:Getting stats from g 2024-08-28T19:49:25.464 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-28T19:49:25.718 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:25.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:25 smithi033 ceph-mon[18549]: pgmap v873: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-08-28T19:49:26.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:25 smithi059 ceph-mon[22052]: pgmap v873: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-08-28T19:49:26.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:25 smithi122 ceph-mon[22174]: pgmap v873: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-08-28T19:49:26.283 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:49:26.283 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:26.283 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 1491, 2024-08-28T19:49:26.283 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 1485, 2024-08-28T19:49:26.283 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 1284064, 2024-08-28T19:49:26.283 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 563340, 2024-08-28T19:49:26.283 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 5, 2024-08-28T19:49:26.283 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-08-28T19:49:26.283 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.212018571, 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.111765140, 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.063387966, 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.033116312, 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 1484, 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.074475718, 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000050185 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.284 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 901696, 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 201456 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 2140, 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2381, 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 545522, 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 1188163, 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 5, 2024-08-28T19:49:26.285 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 4, 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.186567300, 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.085551558, 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.037017356, 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.051498521, 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 2379, 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.089847097, 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000037766 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.286 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 507904 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 8, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 8, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 4621, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 1732, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 7, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 4, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.004075853, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000178861, 2024-08-28T19:49:26.287 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.003732839, 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000084317, 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 7, 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.006749544, 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000964220 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.288 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 448 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 1, 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: "finisher-MDSRank": { 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: "queue_len": 0, 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: "complete_latency": { 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 5551, 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.142207998, 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000025618 2024-08-28T19:49:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "finisher-PurgeQueue": { 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "queue_len": 0, 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "complete_latency": { 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "request": 0, 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "reply": 0, 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "reply_latency": { 2024-08-28T19:49:26.290 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "slow_reply": 0, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "forward": 0, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_fetch_complete": 0, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_fetch_keys": 0, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_commit": 0, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_split": 0, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_merge": 0, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes": 0, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_top": 0, 2024-08-28T19:49:26.291 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_bottom": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_pin_tail": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_pinned": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_expired": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_with_caps": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "subtrees": 1, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_hit": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_forward": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_discover": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_dir_fetch": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_remote_ino": 0, 2024-08-28T19:49:26.292 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_lock": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "load_cent": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "q": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "exported": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "exported_inodes": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "imported": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "imported_inodes": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_dir_fetch": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_backtrace_fetch": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_peer_discover": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rfiles": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rbytes": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rsnaps": 0, 2024-08-28T19:49:26.293 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_set_tag": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_inotable_repaired": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dir_inodes": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_file_inodes": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_inode_file_caps": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_grant": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T19:49:26.294 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T19:49:26.295 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_caps": 0, 2024-08-28T19:49:26.295 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_caps_dirty": 0, 2024-08-28T19:49:26.295 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_cap_release": 0, 2024-08-28T19:49:26.295 INFO:teuthology.orchestra.run.smithi033.stdout: "process_request_cap_release": 0 2024-08-28T19:49:26.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.295 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_cache": { 2024-08-28T19:49:26.295 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_update": 0, 2024-08-28T19:49:26.295 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_update_receipt": 0, 2024-08-28T19:49:26.295 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_try_discover": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_send_discover": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_handle_discover": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays_delayed": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays_enqueuing": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_created": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_enqueued": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_reintegrated": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_migrated": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_processing": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_enqueued": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_prioritized": 0, 2024-08-28T19:49:26.296 INFO:teuthology.orchestra.run.smithi033.stdout: "recovery_started": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "recovery_completed": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_quiesce_path": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_quiesce_inode": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_exportdir": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_flush": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_fragmentdir": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_fragstats": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_inodestats": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_started": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_succeeded": 0, 2024-08-28T19:49:26.297 INFO:teuthology.orchestra.run.smithi033.stdout: "uninline_write_failed": 0 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_log": { 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "evlrg": 0, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "evadd": 0, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "evex": 0, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "evtrm": 0, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "ev": 3, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "evexg": 0, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "evexd": 0, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "segadd": 0, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "segex": 0, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "segtrm": 0, 2024-08-28T19:49:26.298 INFO:teuthology.orchestra.run.smithi033.stdout: "seg": 2, 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "segmjr": 2, 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "segexg": 0, 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "segexd": 0, 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "expos": 4194304, 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "wrpos": 4195200, 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "rdpos": 4194892, 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "jlat": { 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: "replayed": 3 2024-08-28T19:49:26.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_mem": { 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "ino": 3, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "ino+": 3, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "ino-": 0, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "dir": 1, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "dir+": 1, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "dir-": 0, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "dn": 0, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "dn+": 0, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "dn-": 0, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "cap": 0, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "cap+": 0, 2024-08-28T19:49:26.300 INFO:teuthology.orchestra.run.smithi033.stdout: "cap-": 0, 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "rss": 119240, 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "heap": 315371520 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_server": { 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "dispatch_client_request": 0, 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "dispatch_server_request": 0, 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_request": 0, 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_session": 0, 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_peer_request": 0, 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "req_create_latency": { 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getattr_latency": { 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getfilelock_latency": { 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "req_link_latency": { 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.302 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookup_latency": { 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookuphash_latency": { 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.303 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupino_latency": { 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupname_latency": { 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupparent_latency": { 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.304 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.305 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.305 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupsnap_latency": { 2024-08-28T19:49:26.305 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.305 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.305 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.305 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lssnap_latency": { 2024-08-28T19:49:26.305 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.305 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.306 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.306 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mkdir_latency": { 2024-08-28T19:49:26.306 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.306 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.306 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.306 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mknod_latency": { 2024-08-28T19:49:26.306 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mksnap_latency": { 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: "req_open_latency": { 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: "req_readdir_latency": { 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rename_latency": { 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: "req_renamesnap_latency": { 2024-08-28T19:49:26.308 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "req_snapdiff_latency": { 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmdir_latency": { 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.309 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmsnap_latency": { 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmxattr_latency": { 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setattr_latency": { 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.310 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setdirlayout_latency": { 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setfilelock_latency": { 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setlayout_latency": { 2024-08-28T19:49:26.311 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setxattr_latency": { 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: "req_symlink_latency": { 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: "req_unlink_latency": { 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: "cap_revoke_eviction": 0, 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: "cap_acquisition_throttle": 0, 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getvxattr_latency": { 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:26.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_sessions": { 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "session_count": 1, 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "session_add": 1, 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "session_remove": 0, 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "sessions_open": 1, 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "sessions_stale": 0, 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "total_load": 0, 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "average_load": 0, 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "avg_session_uptime": 2056, 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "mdthresh_evicted": 0 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-08-28T19:49:26.314 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:26.315 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:26.316 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 198304, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 58, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:26.317 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 9544, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 193, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 8512, 2024-08-28T19:49:26.318 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 13, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "objecter": { 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "op_active": 0, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "op_laggy": 0, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "op_send": 3281, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "op_send_bytes": 21, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "op_resend": 3, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "op_reply": 3281, 2024-08-28T19:49:26.319 INFO:teuthology.orchestra.run.smithi033.stdout: "op_latency": { 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3281, 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 1.790969380, 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000545860 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "op_inflight": 0, 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "oplen_avg": { 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3281, 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 3282 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "op": 3281, 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "op_r": 3281, 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "op_w": 0, 2024-08-28T19:49:26.320 INFO:teuthology.orchestra.run.smithi033.stdout: "op_rmw": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "op_pg": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_stat": 2136, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_create": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_read": 1143, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_write": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_writefull": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_writesame": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_append": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_zero": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_truncate": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_delete": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_mapext": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_sparse_read": 0, 2024-08-28T19:49:26.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_clonerange": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_getxattr": 1, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_setxattr": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_cmpxattr": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_rmxattr": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_resetxattrs": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_call": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_watch": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_notify": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_pgls": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_pgls_filter": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_other": 0, 2024-08-28T19:49:26.322 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_active": 0, 2024-08-28T19:49:26.323 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_send": 0, 2024-08-28T19:49:26.323 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_resend": 0, 2024-08-28T19:49:26.323 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_ping": 0, 2024-08-28T19:49:26.323 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_active": 0, 2024-08-28T19:49:26.323 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_send": 0, 2024-08-28T19:49:26.323 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_resend": 0, 2024-08-28T19:49:26.323 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_active": 0, 2024-08-28T19:49:26.323 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_send": 0, 2024-08-28T19:49:26.323 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_resend": 0, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_active": 0, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_send": 0, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_resend": 0, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "command_active": 0, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "command_send": 0, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "command_resend": 0, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "map_epoch": 106, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "map_full": 0, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "map_inc": 24, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_sessions": 6, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_session_open": 8, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_session_close": 2, 2024-08-28T19:49:26.324 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_laggy": 0, 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_wr": 0, 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_rd": 2, 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_del": 0 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "oft": { 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_objs": 0, 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_kv_pairs": 0, 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_updates": 0, 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_removes": 0 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "purge_queue": { 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_ops": 0, 2024-08-28T19:49:26.325 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing": 0, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_high_water": 0, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executed_ops": 0, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executed": 0, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_item_in_journal": 0 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 3635, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 1485971, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:26.326 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 3635, 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 3635, 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 1485971, 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-objecter_bytes": { 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-08-28T19:49:26.327 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 3281, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 901, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 3281, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 901, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.328 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-objecter_ops": { 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 1024, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 3281, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 3281, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 3281, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 3281, 2024-08-28T19:49:26.329 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-write_buf_throttle": { 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 3758096384, 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:26.330 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 0, 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 0, 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-write_buf_throttle-0x556628fc8750": { 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 3758096384, 2024-08-28T19:49:26.331 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 0, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 0, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:26.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:26.333 INFO:teuthology.orchestra.run.smithi033.stdout: "trackedop": { 2024-08-28T19:49:26.333 INFO:teuthology.orchestra.run.smithi033.stdout: "slow_ops_count": 0 2024-08-28T19:49:26.333 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:26.333 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:49:27.014 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-08-28T19:49:27.014 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-08-28T19:49:27.014 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-08-28T19:49:27.014 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-08-28T19:49:27.014 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-08-28T19:49:27.014 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-08-28T19:49:27.014 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-08-28T19:49:27.014 DEBUG:tasks.check_counter:Getting stats from j 2024-08-28T19:49:27.015 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-28T19:49:27.273 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:27.788 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-08-28T19:49:27.788 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:27.788 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 328, 2024-08-28T19:49:27.788 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 323, 2024-08-28T19:49:27.788 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 858688, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 199600, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.057339797, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.030012501, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.034507937, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 322, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.017192510, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000053392 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.789 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 858688, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 199600 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 2, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 247, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 320, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 203696, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 2, 2024-08-28T19:49:27.790 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.025058883, 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.020384790, 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.002009082, 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 245, 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.013293129, 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000054257 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:27.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 203696 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 4, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 4, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 2992, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 448, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.002114514, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000038017, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.002044405, 2024-08-28T19:49:27.792 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3, 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.003800805, 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001266935 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 448 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-08-28T19:49:27.793 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:27.794 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:27.795 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:27.796 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 148704, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 29, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:27.797 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 928, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 330, 2024-08-28T19:49:27.798 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 812312, 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 330, 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 330, 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 812312, 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-08-28T19:49:27.799 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-08-28T19:49:27.800 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:27 smithi033 ceph-mon[18549]: pgmap v874: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:49:28.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:27 smithi059 ceph-mon[22052]: pgmap v874: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:49:28.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:27 smithi122 ceph-mon[22174]: pgmap v874: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-08-28T19:49:28.609 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-28T19:49:28.609 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-28T19:49:28.609 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-08-28T19:49:28.609 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-08-28T19:49:28.609 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-08-28T19:49:28.609 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-08-28T19:49:28.609 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-08-28T19:49:28.610 DEBUG:tasks.check_counter:Getting stats from b 2024-08-28T19:49:28.610 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-28T19:49:28.875 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:49:29.462 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-08-28T19:49:29.462 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1819, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1660, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1342444, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 1099640, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 50, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 5, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.246304874, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.112191394, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.142513749, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.007744001, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1657, 2024-08-28T19:49:29.463 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.085385427, 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000051530 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2535, 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000625812, 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000246 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 930528, 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 404176 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 181, 2024-08-28T19:49:29.464 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 361, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 64268, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 662861, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 28, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 7, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.041448104, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.018820530, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.021581257, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000355269, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 360, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.041225955, 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000114516 2024-08-28T19:49:29.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 301, 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000092238, 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000306 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 404032 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 88, 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 88, 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 31632, 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 39654, 2024-08-28T19:49:29.466 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 11, 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.014287374, 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.005255818, 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.009089970, 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000408135, 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 88, 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.026255705, 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000298360 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 139, 2024-08-28T19:49:29.467 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000064534, 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000464 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-08-28T19:49:29.468 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 41, 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001793775, 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000043750 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000074974, 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000037487 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.469 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 0, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 0, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 11, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-08-28T19:49:29.470 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 16, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 16, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 13, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 4, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 0, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 0, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 3, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 40, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 31, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-08-28T19:49:29.471 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 7, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 1, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-08-28T19:49:29.472 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 5, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 298, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 6, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-08-28T19:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 0, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 19, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 14, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 11, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-08-28T19:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 13, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 77, 2024-08-28T19:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_succeeded": 0, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_write_failed": 0 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 2, 2024-08-28T19:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 2, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 2, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 2, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 4194892, 2024-08-28T19:49:29.477 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 0, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001725051, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001725051 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 0 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 20, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 22, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 2, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 19, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 22, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 3, 2024-08-28T19:49:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 16, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 20, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 4, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 0, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 0, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 0, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 119004, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 325861376 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 0, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 0, 2024-08-28T19:49:29.479 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 0, 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.480 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-08-28T19:49:29.481 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.482 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-08-28T19:49:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.485 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.486 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.488 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-08-28T19:49:29.489 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.490 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.491 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 0, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 0, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 0, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 0, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 0, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 0, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 0, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:29.492 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:29.493 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:29.494 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 239047, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 82, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:29.495 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 9544, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 193, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 82237, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 328, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:29.496 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 35, 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 10710, 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 33, 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 35, 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 35, 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.253996952, 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.007257055 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.497 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 35, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 57 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 35, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 0, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 35, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 0, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 10, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 0, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 1, 2024-08-28T19:49:29.498 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 5, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 6, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 20, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-08-28T19:49:29.499 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-08-28T19:49:29.500 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 106, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 26, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 9, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 16, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 7, 2024-08-28T19:49:29.501 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 14, 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 0, 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 1 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 1, 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T19:49:29.502 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2084, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 1227863, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2084, 2024-08-28T19:49:29.503 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2084, 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1227863, 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:29.504 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 35, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 10710, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 35, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 10710, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.505 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-08-28T19:49:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-08-28T19:49:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 35, 2024-08-28T19:49:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 35, 2024-08-28T19:49:29.506 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 35, 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 35, 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:29.507 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x563ebe24a8f0": { 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:29.508 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 588, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 1, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 588, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:29.509 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "trackedop": { 2024-08-28T19:49:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 90 2024-08-28T19:49:29.510 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:29.510 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-08-28T19:49:29.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:29 smithi033 ceph-mon[18549]: pgmap v875: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-28T19:49:29.935 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:29 smithi059 ceph-mon[22052]: pgmap v875: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-28T19:49:30.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:29 smithi122 ceph-mon[22174]: pgmap v875: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-28T19:49:30.273 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-08-28T19:49:30.273 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-08-28T19:49:30.273 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-08-28T19:49:30.273 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=19 2024-08-28T19:49:30.273 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-08-28T19:49:30.273 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-08-28T19:49:30.273 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-08-28T19:49:30.273 DEBUG:tasks.check_counter:Getting stats from e 2024-08-28T19:49:30.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-28T19:49:30.525 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:49:31.038 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-08-28T19:49:31.038 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 2291, 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2291, 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 687857, 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 727721, 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 6, 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.272494552, 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.127256172, 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.057570274, 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.067205480, 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:31.039 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2290, 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.090106817, 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000039347 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 448 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.040 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 4, 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 249, 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 876, 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 601066, 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 3, 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.019475228, 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.014616346, 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.002270433, 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000056934, 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:31.041 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 247, 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.013827458, 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000055981 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 600368 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 359, 2024-08-28T19:49:31.042 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 353, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 903324, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 204974, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.066000362, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.032823577, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.043208785, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000029980, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 352, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.022407991, 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000063659 2024-08-28T19:49:31.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 903056, 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 204656 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.044 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 4573, 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.131343109, 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000028721 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.045 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 0, 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 0, 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-08-28T19:49:31.046 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 0, 2024-08-28T19:49:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 1, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-08-28T19:49:31.048 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T19:49:31.049 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-08-28T19:49:31.050 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-08-28T19:49:31.050 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T19:49:31.050 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-08-28T19:49:31.050 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T19:49:31.050 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T19:49:31.050 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T19:49:31.050 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 0, 2024-08-28T19:49:31.050 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-08-28T19:49:31.050 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 0, 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-08-28T19:49:31.051 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-08-28T19:49:31.052 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-08-28T19:49:31.052 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-08-28T19:49:31.052 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-08-28T19:49:31.052 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-08-28T19:49:31.052 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-08-28T19:49:31.052 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-08-28T19:49:31.052 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-08-28T19:49:31.052 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-08-28T19:49:31.052 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-08-28T19:49:31.052 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0, 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_succeeded": 0, 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_write_failed": 0 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-08-28T19:49:31.053 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-08-28T19:49:31.054 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 0, 2024-08-28T19:49:31.054 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-08-28T19:49:31.054 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-08-28T19:49:31.054 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 2, 2024-08-28T19:49:31.054 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-08-28T19:49:31.054 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-08-28T19:49:31.054 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 0, 2024-08-28T19:49:31.054 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-08-28T19:49:31.054 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-08-28T19:49:31.054 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 2, 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 4194892, 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 4194352, 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 2 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 3, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 3, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 0, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 1, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 1, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 0, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 0, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 0, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 0, 2024-08-28T19:49:31.056 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 0, 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 0, 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 0, 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 119288, 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 316424192 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 0, 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 0, 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 0, 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-08-28T19:49:31.057 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.059 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-08-28T19:49:31.059 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.059 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.059 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.059 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-08-28T19:49:31.059 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.059 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.059 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.061 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-08-28T19:49:31.061 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.061 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.061 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.061 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-08-28T19:49:31.061 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.061 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.061 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.062 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-08-28T19:49:31.062 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.062 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.062 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.062 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-08-28T19:49:31.062 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.062 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.063 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.063 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-08-28T19:49:31.063 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.063 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.063 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.063 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-08-28T19:49:31.063 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-08-28T19:49:31.065 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.066 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.068 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.069 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.069 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-08-28T19:49:31.069 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.069 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.069 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.069 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-08-28T19:49:31.069 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 0, 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 0, 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 0, 2024-08-28T19:49:31.071 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 0, 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 0, 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 0, 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 0, 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:31.073 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:31.074 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 182087, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 48, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-08-28T19:49:31.075 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 9544, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 193, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 8512, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 13, 2024-08-28T19:49:31.076 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 2290, 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 21, 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 3, 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 2290, 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-08-28T19:49:31.077 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2290, 2024-08-28T19:49:31.078 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1.221985106, 2024-08-28T19:49:31.078 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000533617 2024-08-28T19:49:31.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.078 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-08-28T19:49:31.080 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-08-28T19:49:31.080 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2290, 2024-08-28T19:49:31.080 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 2291 2024-08-28T19:49:31.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 2290, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 2290, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 0, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 1142, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 0, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 1146, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 0, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 0, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-08-28T19:49:31.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 1, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-08-28T19:49:31.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-08-28T19:49:31.083 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 106, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 24, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 4, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 5, 2024-08-28T19:49:31.084 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 1, 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 0, 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 2, 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 0 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 0, 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-08-28T19:49:31.085 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2650, 2024-08-28T19:49:31.086 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 1332168, 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2650, 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2650, 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1332168, 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.087 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 2290, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 593, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2290, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 593, 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:31.088 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 2290, 2024-08-28T19:49:31.089 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 2290, 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2290, 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2290, 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-08-28T19:49:31.090 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:31.091 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:31.091 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:31.091 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:31.091 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:31.091 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:31.091 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:31.091 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-08-28T19:49:31.091 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-08-28T19:49:31.091 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:31.091 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x55a283a36c30": { 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:31.092 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:31.093 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:31.093 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:31.093 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-08-28T19:49:31.093 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-08-28T19:49:31.093 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:31.093 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:31.093 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:31.093 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:31.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:31.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:31.094 INFO:teuthology.orchestra.run.smithi059.stdout: "trackedop": { 2024-08-28T19:49:31.094 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-08-28T19:49:31.094 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:31.094 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-08-28T19:49:31.865 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:31 smithi059 ceph-mon[22052]: pgmap v876: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:49:31.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:31 smithi033 ceph-mon[18549]: pgmap v876: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:49:31.891 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-28T19:49:31.891 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-28T19:49:31.891 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-08-28T19:49:31.891 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-08-28T19:49:31.891 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-08-28T19:49:31.891 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-08-28T19:49:31.892 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-08-28T19:49:31.892 DEBUG:tasks.check_counter:Getting stats from h 2024-08-28T19:49:31.892 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-28T19:49:32.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:31 smithi122 ceph-mon[22174]: pgmap v876: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:49:32.142 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:49:32.649 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-08-28T19:49:32.649 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:32.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1403, 2024-08-28T19:49:32.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1253, 2024-08-28T19:49:32.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 414261, 2024-08-28T19:49:32.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 388482, 2024-08-28T19:49:32.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 12, 2024-08-28T19:49:32.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-08-28T19:49:32.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.178970511, 2024-08-28T19:49:32.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.080147037, 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.097851275, 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.007386233, 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1252, 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.065223520, 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000052095 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2555, 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000643198, 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000251 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 6800, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 18768 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 519, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 511, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 952610, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 813911, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 58, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 6, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.097466165, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.038931537, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.068141562, 2024-08-28T19:49:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000233865, 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 510, 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.048719112, 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000095527 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 183, 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000125904, 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000688 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 915456, 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 208352 2024-08-28T19:49:32.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 177, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 421, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 61992, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 698893, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 19, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 5, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.042014810, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.023962382, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.016574477, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000367399, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 419, 2024-08-28T19:49:32.653 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.041558948, 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000099186 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 284, 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000084908, 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000298 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 511728 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-08-28T19:49:32.654 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 23, 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001720506, 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000074804 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-08-28T19:49:32.655 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000022441, 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000011220 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 2, 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 2, 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000237362, 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000118681 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.656 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 11, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 16, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 16, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 13, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 4, 2024-08-28T19:49:32.657 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 2, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 2, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 3, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 40, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 31, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 7, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 1, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-08-28T19:49:32.658 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 5, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 298, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 6, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-08-28T19:49:32.659 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 2, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 2, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-08-28T19:49:32.660 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 19, 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 14, 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 11, 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-08-28T19:49:32.661 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 13, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 77, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T19:49:32.662 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_succeeded": 0, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_write_failed": 0 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 3, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-08-28T19:49:32.663 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 3, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 2, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 2, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 4195200, 2024-08-28T19:49:32.664 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 0, 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.003349621, 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001674810 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 0 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 20, 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 22, 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 2, 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 19, 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 22, 2024-08-28T19:49:32.665 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 3, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 16, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 20, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 4, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 2, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 2, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 0, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 119256, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 325861376 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 2, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 2, 2024-08-28T19:49:32.666 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 14, 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.667 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000237362, 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000118681 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.669 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-08-28T19:49:32.670 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.671 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.671 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.671 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-08-28T19:49:32.671 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.671 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.672 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.677 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.678 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 1, 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 1, 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 0, 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 1, 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 2, 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 2, 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 1004, 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-08-28T19:49:32.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:32.680 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:32.681 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 295847, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 98, 2024-08-28T19:49:32.682 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 9544, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 193, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-08-28T19:49:32.683 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 82893, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 334, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 38, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 11319, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 33, 2024-08-28T19:49:32.684 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 38, 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 38, 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.227997282, 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.005999928 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 38, 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 61 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 38, 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 0, 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 38, 2024-08-28T19:49:32.685 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 0, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 10, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 0, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 2, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 6, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 6, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-08-28T19:49:32.686 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 20, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-08-28T19:49:32.687 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-08-28T19:49:32.688 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 106, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 25, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 9, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 15, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 6, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 16, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 0, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 1 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 1, 2024-08-28T19:49:32.689 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:32.690 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2095, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 1216774, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2095, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2095, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1216774, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.691 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 38, 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 11319, 2024-08-28T19:49:32.692 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 38, 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 11319, 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:32.693 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 38, 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 38, 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 38, 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 38, 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:32.694 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x55e4f123a750": { 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 3, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 896, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 3, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2, 2024-08-28T19:49:32.696 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 896, 2024-08-28T19:49:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "trackedop": { 2024-08-28T19:49:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 90 2024-08-28T19:49:32.697 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:32.697 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-08-28T19:49:33.352 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-28T19:49:33.352 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-28T19:49:33.352 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-08-28T19:49:33.352 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=19 2024-08-28T19:49:33.353 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-08-28T19:49:33.353 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-08-28T19:49:33.353 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-08-28T19:49:33.353 DEBUG:tasks.check_counter:Getting stats from k 2024-08-28T19:49:33.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-28T19:49:33.605 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.b/config 2024-08-28T19:49:33.846 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:33 smithi059 ceph-mon[22052]: pgmap v877: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:49:33.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:33 smithi033 ceph-mon[18549]: pgmap v877: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:49:34.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:33 smithi122 ceph-mon[22174]: pgmap v877: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-28T19:49:34.173 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-08-28T19:49:34.173 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:34.174 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1153, 2024-08-28T19:49:34.174 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1155, 2024-08-28T19:49:34.174 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 304464, 2024-08-28T19:49:34.174 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 366718, 2024-08-28T19:49:34.174 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 7, 2024-08-28T19:49:34.174 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-08-28T19:49:34.174 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.137312870, 2024-08-28T19:49:34.174 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.067726892, 2024-08-28T19:49:34.174 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.028104675, 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.030330454, 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1153, 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.042905396, 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000037211 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.176 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T19:49:34.176 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T19:49:34.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.176 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:34.176 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1063, 2024-08-28T19:49:34.176 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1308, 2024-08-28T19:49:34.176 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 263442, 2024-08-28T19:49:34.176 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 847521, 2024-08-28T19:49:34.176 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.146946332, 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.067435393, 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.027127813, 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.040626899, 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1307, 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.052395624, 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000040088 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.177 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 511072 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1506, 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1500, 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1288592, 2024-08-28T19:49:34.178 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 570686, 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 3, 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.237839328, 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.112425324, 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.078911247, 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.042232457, 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1499, 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.088673640, 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000059155 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:34.179 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 903872, 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 206576 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-08-28T19:49:34.180 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 5495, 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.171691170, 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000031244 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:34.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 0, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 0, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 0, 2024-08-28T19:49:34.182 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 1, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-08-28T19:49:34.183 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 0, 2024-08-28T19:49:34.184 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T19:49:34.185 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 0, 2024-08-28T19:49:34.186 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-08-28T19:49:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-08-28T19:49:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-08-28T19:49:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-08-28T19:49:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-08-28T19:49:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-08-28T19:49:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-08-28T19:49:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-08-28T19:49:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-08-28T19:49:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-08-28T19:49:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-08-28T19:49:34.188 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_succeeded": 0, 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_write_failed": 0 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 0, 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 6, 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 0, 2024-08-28T19:49:34.189 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 2, 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 4196123, 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 4195732, 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.190 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 6 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 3, 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 3, 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 0, 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 1, 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 1, 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 0, 2024-08-28T19:49:34.191 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 0, 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 0, 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 0, 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 0, 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 0, 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 0, 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 116568, 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 316420096 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 0, 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-08-28T19:49:34.192 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 0, 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 0, 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.193 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-08-28T19:49:34.194 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.197 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.198 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-08-28T19:49:34.199 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.202 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-08-28T19:49:34.203 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-08-28T19:49:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 2, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 3, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 1, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 2, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 0, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 0, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 2048, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:34.205 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:34.206 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:34.206 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:34.206 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:34.206 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:34.206 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:34.206 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:34.206 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:34.206 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:34.206 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:34.207 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:34.208 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:34.208 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:34.208 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:34.208 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:34.208 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:34.208 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-08-28T19:49:34.208 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:34.208 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:34.208 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 190167, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 52, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 9544, 2024-08-28T19:49:34.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 193, 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 8512, 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 13, 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-08-28T19:49:34.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 3356, 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 21, 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 3, 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 3356, 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 3356, 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1.707979125, 2024-08-28T19:49:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000508932 2024-08-28T19:49:34.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.212 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-08-28T19:49:34.212 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-08-28T19:49:34.212 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 3356, 2024-08-28T19:49:34.212 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 3357 2024-08-28T19:49:34.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.212 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 3356, 2024-08-28T19:49:34.212 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 3356, 2024-08-28T19:49:34.212 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 0, 2024-08-28T19:49:34.212 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 2201, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 1153, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-08-28T19:49:34.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 1, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 0, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T19:49:34.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-08-28T19:49:34.215 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 106, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 24, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 5, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 6, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 1, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-08-28T19:49:34.216 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 0, 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 2, 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 0 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 0, 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-08-28T19:49:34.217 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 3718, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 1500376, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 3718, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:34.218 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 3718, 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1500376, 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:34.219 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:34.220 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:34.220 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:34.220 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 3356, 2024-08-28T19:49:34.220 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 1824, 2024-08-28T19:49:34.220 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 3356, 2024-08-28T19:49:34.220 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1824, 2024-08-28T19:49:34.220 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:34.220 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.220 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:34.221 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 3356, 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 3356, 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 3356, 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 3356, 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:34.222 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.223 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.224 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.224 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:34.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.224 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x5622ea086c30": { 2024-08-28T19:49:34.224 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-08-28T19:49:34.224 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-08-28T19:49:34.224 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-08-28T19:49:34.224 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-08-28T19:49:34.224 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-08-28T19:49:34.224 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-08-28T19:49:34.225 INFO:teuthology.orchestra.run.smithi059.stdout: "trackedop": { 2024-08-28T19:49:34.226 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-08-28T19:49:34.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-08-28T19:49:34.226 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-08-28T19:49:34.963 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-08-28T19:49:34.963 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-08-28T19:49:34.963 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-08-28T19:49:34.963 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-08-28T19:49:34.963 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-08-28T19:49:34.963 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-08-28T19:49:34.963 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-08-28T19:49:34.964 DEBUG:tasks.check_counter:Getting stats from c 2024-08-28T19:49:34.964 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-28T19:49:35.222 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:49:35.839 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-08-28T19:49:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1863, 2024-08-28T19:49:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1645, 2024-08-28T19:49:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 1364660, 2024-08-28T19:49:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 793876, 2024-08-28T19:49:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 10, 2024-08-28T19:49:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-08-28T19:49:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.249160842, 2024-08-28T19:49:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.128997619, 2024-08-28T19:49:35.840 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.131494586, 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.006213507, 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1646, 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.095453350, 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000057991 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2617, 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000788477, 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000301 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.841 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 928080, 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 209808 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 112, 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 383, 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 38177, 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 704162, 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 16, 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 6, 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.038313654, 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.021456542, 2024-08-28T19:49:35.842 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.014286916, 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000673231, 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 382, 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.043320557, 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000113404 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 189, 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000148508, 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000785 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 5520, 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 613824 2024-08-28T19:49:35.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 160, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 192, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 43036, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 685892, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 64, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 6, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.052825252, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.014039688, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.036084333, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000683821, 2024-08-28T19:49:35.844 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 188, 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.021214648, 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000112843 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 242, 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000066651, 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000275 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 3696, 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 10240 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.845 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 34, 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002056238, 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000060477 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-08-28T19:49:35.846 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000007301, 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000003650 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 1, 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 0, 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.847 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 1, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 11, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 16, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 16, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-08-28T19:49:35.848 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 13, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 4, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 0, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 0, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 3, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 39, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 32, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 1, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 6, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-08-28T19:49:35.849 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 5, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 298, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 6, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-08-28T19:49:35.850 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 0, 2024-08-28T19:49:35.851 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 0, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 0, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 0 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 18, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 12, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 12, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-08-28T19:49:35.852 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 13, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 77, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-08-28T19:49:35.853 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_started": 0, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_succeeded": 0, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_write_failed": 0 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 6, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 6, 2024-08-28T19:49:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 2, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 2, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 4196123, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-08-28T19:49:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 5, 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.010943540, 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002188708 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 20, 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 22, 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 2, 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 19, 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 23, 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 4, 2024-08-28T19:49:35.856 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 16, 2024-08-28T19:49:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 20, 2024-08-28T19:49:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 4, 2024-08-28T19:49:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 0, 2024-08-28T19:49:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 0, 2024-08-28T19:49:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 0, 2024-08-28T19:49:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 121768, 2024-08-28T19:49:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 325857280 2024-08-28T19:49:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-08-28T19:49:35.857 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 1, 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 0, 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 1, 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 30, 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 0, 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-08-28T19:49:35.858 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.859 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.861 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.862 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.862 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-08-28T19:49:35.862 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.862 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.862 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-08-28T19:49:35.863 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.865 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-08-28T19:49:35.866 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.868 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.869 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 2, 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 3, 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 1, 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 2, 2024-08-28T19:49:35.870 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 0, 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 0, 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 1012, 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:35.871 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:35.872 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:35.873 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 247847, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 85, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:35.874 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 9544, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 193, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 82261, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 331, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:35.875 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 42, 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 12211, 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 33, 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 42, 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 42, 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.260998795, 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.006214257 2024-08-28T19:49:35.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 42, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 64 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 42, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 0, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 42, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 0, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 10, 2024-08-28T19:49:35.877 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 0, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 5, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 8, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 6, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 0, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 20, 2024-08-28T19:49:35.878 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-08-28T19:49:35.879 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 106, 2024-08-28T19:49:35.880 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 26, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 8, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 13, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 5, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 14, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 0, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 1 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-08-28T19:49:35.881 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 0, 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 0, 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 0, 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:35.882 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 2131, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1229627, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 2131, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2131, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1229627, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 42, 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 12211, 2024-08-28T19:49:35.884 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 42, 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 12211, 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:35.885 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 42, 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 42, 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 42, 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 42, 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:35.886 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.887 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x5644995ee8f0": { 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 6, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1819, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 6, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 5, 2024-08-28T19:49:35.888 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1819, 2024-08-28T19:49:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "trackedop": { 2024-08-28T19:49:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 90 2024-08-28T19:49:35.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:35.889 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-08-28T19:49:35.889 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:35 smithi122 ceph-mon[22174]: pgmap v878: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:49:35.890 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:35 smithi033 ceph-mon[18549]: pgmap v878: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:49:36.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:35 smithi059 ceph-mon[22052]: pgmap v878: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-08-28T19:49:36.755 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-08-28T19:49:36.755 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-08-28T19:49:36.755 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-08-28T19:49:36.755 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=18 2024-08-28T19:49:36.755 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-08-28T19:49:36.755 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-08-28T19:49:36.755 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-08-28T19:49:36.755 DEBUG:tasks.check_counter:Getting stats from f 2024-08-28T19:49:36.756 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-28T19:49:37.001 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:49:37.568 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-08-28T19:49:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1475, 2024-08-28T19:49:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1267, 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 439219, 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 253960, 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 10, 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.187565009, 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.096030350, 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.092017178, 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.006084150, 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1267, 2024-08-28T19:49:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.081757239, 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000064528 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2626, 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000681465, 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000259 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 566, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 550, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 986567, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 298764, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 9, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 4, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.086535534, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.041446130, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.058274126, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000356253, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 554, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.057108220, 2024-08-28T19:49:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000103083 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 285, 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000069174, 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000242 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 926400, 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 211536 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 68, 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 320, 2024-08-28T19:49:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 11309, 2024-08-28T19:49:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 1279840, 2024-08-28T19:49:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 65, 2024-08-28T19:49:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 6, 2024-08-28T19:49:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.045405095, 2024-08-28T19:49:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.017316681, 2024-08-28T19:49:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.023510494, 2024-08-28T19:49:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000156893, 2024-08-28T19:49:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 312, 2024-08-28T19:49:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.025338040, 2024-08-28T19:49:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000081211 2024-08-28T19:49:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 65, 2024-08-28T19:49:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000007286, 2024-08-28T19:49:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000112 2024-08-28T19:49:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 1904, 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 605280 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 46, 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.001621662, 2024-08-28T19:49:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000035253 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000019733, 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000009866 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 2, 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 1, 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000233495, 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000233495 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 1, 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 11, 2024-08-28T19:49:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 16, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 16, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 13, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 4, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 0, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 0, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 3, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 41, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 33, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-08-28T19:49:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 7, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-08-28T19:49:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 5, 2024-08-28T19:49:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 298, 2024-08-28T19:49:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 6, 2024-08-28T19:49:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T19:49:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-08-28T19:49:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T19:49:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-08-28T19:49:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-08-28T19:49:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T19:49:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T19:49:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-08-28T19:49:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-08-28T19:49:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T19:49:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 0, 2024-08-28T19:49:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T19:49:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T19:49:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 0, 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 0, 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 0, 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 1 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 16, 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 11, 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 12, 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-08-28T19:49:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 13, 2024-08-28T19:49:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 77, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_started": 0, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_succeeded": 0, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_write_failed": 0 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-08-28T19:49:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 4, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 4, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 2, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 2, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-08-28T19:49:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 4195424, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.005297156, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001765718 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 20, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 22, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 2, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 19, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 22, 2024-08-28T19:49:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 3, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 16, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 20, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 4, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 0, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 1, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 1, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 119156, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 325857280 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 3, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 0, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 2, 2024-08-28T19:49:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 4, 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 0, 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000233495, 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000233495 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-08-28T19:49:37.588 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.589 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.591 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-08-28T19:49:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.592 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-08-28T19:49:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-08-28T19:49:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.593 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.594 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.596 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-08-28T19:49:37.597 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.599 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 0, 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 1, 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 1, 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 0, 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 1, 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 1, 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 81, 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-08-28T19:49:37.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:37.601 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:37.602 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 231271, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 71, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:37.603 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 9544, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 193, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-08-28T19:49:37.604 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 82269, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 332, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 38, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 11332, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 33, 2024-08-28T19:49:37.605 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 38, 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 38, 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.232998929, 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.006131550 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 38, 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 60 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 38, 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 0, 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 38, 2024-08-28T19:49:37.606 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 10, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 3, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 6, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 6, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-08-28T19:49:37.607 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 0, 2024-08-28T19:49:37.608 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 20, 2024-08-28T19:49:37.608 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-08-28T19:49:37.608 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-08-28T19:49:37.608 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-08-28T19:49:37.608 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-08-28T19:49:37.608 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-08-28T19:49:37.608 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-08-28T19:49:37.608 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T19:49:37.608 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-08-28T19:49:37.609 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 106, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 26, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 8, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 9, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 1, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 14, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 0, 2024-08-28T19:49:37.610 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 1 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 0, 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 0, 2024-08-28T19:49:37.611 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 0, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 2105, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1224233, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 2105, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2105, 2024-08-28T19:49:37.612 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1224233, 2024-08-28T19:49:37.613 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:37.613 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.613 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.613 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.613 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:37.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.613 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-08-28T19:49:37.613 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:37.613 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-08-28T19:49:37.613 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 38, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 11332, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 38, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 11332, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:37.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 38, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 38, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 38, 2024-08-28T19:49:37.615 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 38, 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:37.616 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x5649fb2325b0": { 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:37.617 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 4, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1120, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 4, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1120, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:37.618 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:37.619 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:37.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:37.619 INFO:teuthology.orchestra.run.smithi122.stdout: "trackedop": { 2024-08-28T19:49:37.619 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 90 2024-08-28T19:49:37.619 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:37.619 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-08-28T19:49:37.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:37 smithi122 ceph-mon[22174]: pgmap v879: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:49:37.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:37 smithi033 ceph-mon[18549]: pgmap v879: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:49:38.036 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:37 smithi059 ceph-mon[22052]: pgmap v879: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-28T19:49:38.348 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-08-28T19:49:38.349 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-08-28T19:49:38.349 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-08-28T19:49:38.349 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=16 2024-08-28T19:49:38.349 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-08-28T19:49:38.349 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-08-28T19:49:38.349 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-08-28T19:49:38.349 DEBUG:tasks.check_counter:Getting stats from i 2024-08-28T19:49:38.349 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-28T19:49:38.593 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:49:39.114 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-08-28T19:49:39.114 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:39.114 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 4252, 2024-08-28T19:49:39.114 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 4648, 2024-08-28T19:49:39.114 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 2207293, 2024-08-28T19:49:39.114 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 8819957, 2024-08-28T19:49:39.114 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 249, 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 8, 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.590877167, 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.260140308, 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.320374861, 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.033835075, 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4650, 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.998533677, 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000214738 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 5188, 2024-08-28T19:49:39.115 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.001295926, 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000249 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 954016, 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 244064 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 2286, 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 2735, 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 494868, 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 14947124, 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 12, 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 7, 2024-08-28T19:49:39.116 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.305526564, 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.169158543, 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.109398862, 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.033416985, 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2734, 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.378068886, 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000138284 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2485, 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000696530, 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000280 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.117 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 530816 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 6546, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 7259, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 2202125, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 15411283, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 23, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 8, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.985615122, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.425453951, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.393497707, 2024-08-28T19:49:39.118 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.180876829, 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 7254, 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.478703712, 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000065991 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 9532, 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002486242, 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000260 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 1597824, 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 1784080 2024-08-28T19:49:39.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 5269, 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1.787121309, 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000339176 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.120 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 16, 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000427543, 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000026721 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 879, 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 879, 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 879, 2024-08-28T19:49:39.121 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 3.690218811, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.004198201 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 0, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 12, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 46, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 46, 2024-08-28T19:49:39.122 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 45, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 0, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 2, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 2, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 2, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 1155, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 1145, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 0, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-08-28T19:49:39.123 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 345, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 4, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 234, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 6, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 345, 2024-08-28T19:49:39.124 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 222, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 25, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 197, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 123, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 708, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 684, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 599, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T19:49:39.125 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 774, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 686, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 3, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 627 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 23, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 0, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 0, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 0, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 46, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 2, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-08-28T19:49:39.126 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 3, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 1, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 13, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 180, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 25, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-08-28T19:49:39.127 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_started": 0, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_succeeded": 0, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_write_failed": 0 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 2300, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-08-28T19:49:39.128 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 2300, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 9, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 9, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 34599311, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-08-28T19:49:39.129 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2214, 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 4.821717604, 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002177830 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 41, 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 66, 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 25, 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 20, 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 20, 2024-08-28T19:49:39.130 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 0, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 46, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 46, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 0, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 2, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 18, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 16, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 126688, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 341721088 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 2157, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 0, 2024-08-28T19:49:39.131 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 879, 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 36, 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 0, 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 17, 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.010625648, 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000625038 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 189, 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.034861122, 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000184450 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.132 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3, 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.001369814, 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000456604 2024-08-28T19:49:39.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.134 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-08-28T19:49:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 17, 2024-08-28T19:49:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002760336, 2024-08-28T19:49:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000162372 2024-08-28T19:49:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-08-28T19:49:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 8, 2024-08-28T19:49:39.136 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.014554052, 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001819256 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 17, 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.097090101, 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.005711182 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.137 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000256861, 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000256861 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.005117717, 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002558858 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002369818, 2024-08-28T19:49:39.138 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001184909 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-08-28T19:49:39.139 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.014662834, 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.007331417 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 11, 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.052743295, 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.004794845 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 601, 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 3.427114648, 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.005702353 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.141 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 8, 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.023858653, 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002982331 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.142 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002833912, 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002833912 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.143 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 2, 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 4, 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 2, 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 2, 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 85, 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 42, 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 1012, 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.144 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:39.145 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:39.146 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 375510, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 133, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-08-28T19:49:39.147 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 9544, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 193, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 227364, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 1785, 2024-08-28T19:49:39.148 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 3855, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 30427580, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 37, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 3855, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3855, 2024-08-28T19:49:39.149 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 26.373876980, 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.006841472 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 3855, 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 3898 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 3855, 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 396, 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 3459, 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-08-28T19:49:39.150 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 0, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 11, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 26, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 2215, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 73, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 521, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 370, 2024-08-28T19:49:39.151 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 22, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 599, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-08-28T19:49:39.152 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 106, 2024-08-28T19:49:39.153 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 32, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 12, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 12, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 0, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 53, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 0, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 8 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-08-28T19:49:39.154 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 2, 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 1, 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 2, 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 1, 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-08-28T19:49:39.155 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 13080, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 3527922, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 13080, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 13080, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 3527922, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 3855, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 30427729, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3855, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 30427729, 2024-08-28T19:49:39.157 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:39.158 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 3855, 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 3855, 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 3855, 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 3855, 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-08-28T19:49:39.159 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 1, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 149, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 1, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 1, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 149, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:39.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x55bdf3f2e8f0": { 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 599, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 2300, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 30405007, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 2300, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 2214, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 30404408, 2024-08-28T19:49:39.161 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "trackedop": { 2024-08-28T19:49:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 207 2024-08-28T19:49:39.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:39.162 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-08-28T19:49:39.751 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:39 smithi122 ceph-mon[22174]: pgmap v880: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-28T19:49:39.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:39 smithi033 ceph-mon[18549]: pgmap v880: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-28T19:49:39.919 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-08-28T19:49:39.920 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-08-28T19:49:39.920 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=23 2024-08-28T19:49:39.920 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2024-08-28T19:49:39.920 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-08-28T19:49:39.920 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=17 2024-08-28T19:49:39.920 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=11 2024-08-28T19:49:39.920 DEBUG:tasks.check_counter:Getting stats from l 2024-08-28T19:49:39.920 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-28T19:49:40.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:39 smithi059 ceph-mon[22052]: pgmap v880: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-28T19:49:40.175 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.c/config 2024-08-28T19:49:40.719 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-08-28T19:49:40.719 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-08-28T19:49:40.719 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 2082, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 2084, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 9013231, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 662086, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 7, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.286894392, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.116031884, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.071783775, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.077827549, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2082, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.097800485, 2024-08-28T19:49:40.720 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000046974 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 0 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1133, 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1382, 2024-08-28T19:49:40.721 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 13914023, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 872666, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 5, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 4, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.146275247, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.066228980, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.036723532, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.033088710, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1380, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.064740822, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000046913 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.722 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 512624 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 1287, 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 1279, 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 9526433, 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 500707, 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 4, 2024-08-28T19:49:40.723 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.179782008, 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.081610615, 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.074165093, 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.027790042, 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1279, 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.061524741, 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000048103 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.724 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 907568, 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 208464 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 6998, 2024-08-28T19:49:40.725 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.200938302, 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000028713 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-08-28T19:49:40.726 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 0, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 0, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 0, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 0, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-08-28T19:49:40.727 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 36, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 36, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 36, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 0, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 0, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 0, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 2, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 0, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 0, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-08-28T19:49:40.728 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-08-28T19:49:40.729 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 4, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 234, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 6, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 0, 2024-08-28T19:49:40.730 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 0 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 0, 2024-08-28T19:49:40.731 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-08-28T19:49:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_path": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_quiesce_inode": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_started": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_succeeded": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "uninline_write_failed": 0 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "evlrg": 0, 2024-08-28T19:49:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 0, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 2300, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 0, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 9, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "segmjr": 2, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-08-28T19:49:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 34599311, 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 34598712, 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 2300 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 31, 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 32, 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 1, 2024-08-28T19:49:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 11, 2024-08-28T19:49:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 11, 2024-08-28T19:49:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 0, 2024-08-28T19:49:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 36, 2024-08-28T19:49:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 36, 2024-08-28T19:49:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 0, 2024-08-28T19:49:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 0, 2024-08-28T19:49:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 0, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 0, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 117492, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 317472768 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 0, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 0, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 0, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 0, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 0, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-08-28T19:49:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-08-28T19:49:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-08-28T19:49:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-08-28T19:49:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-08-28T19:49:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-08-28T19:49:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 2, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 4, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 2, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 2, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 0, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 0, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 2044, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-08-28T19:49:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-08-28T19:49:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-08-28T19:49:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 207827, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 101, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-08-28T19:49:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 9544, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 193, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 188959, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 1527, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-08-28T19:49:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 4133, 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 26, 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 4, 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 4133, 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4133, 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 2.289989054, 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000554074 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 4133, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 4134 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 4133, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 4133, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 0, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 2302, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 0, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 1828, 2024-08-28T19:49:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 2, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-08-28T19:49:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-08-28T19:49:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 106, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 24, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 7, 2024-08-28T19:49:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 7, 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 0, 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 0, 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 2, 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 0 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 0, 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-08-28T19:49:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 0, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 0, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 0, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 0, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 4498, 2024-08-28T19:49:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 32027215, 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 4498, 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 4498, 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 32027215, 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-08-28T19:49:40.762 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 4133, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 30405017, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 4133, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 30405017, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.763 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 4133, 2024-08-28T19:49:40.764 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 4133, 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 4133, 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 4133, 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:40.765 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x55a024f108f0": { 2024-08-28T19:49:40.766 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-08-28T19:49:40.767 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-08-28T19:49:40.768 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:40.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-08-28T19:49:40.768 INFO:teuthology.orchestra.run.smithi122.stdout: "trackedop": { 2024-08-28T19:49:40.768 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-08-28T19:49:40.768 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-08-28T19:49:40.768 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-08-28T19:49:41.502 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-08-28T19:49:41.503 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-08-28T19:49:41.503 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-08-28T19:49:41.503 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-08-28T19:49:41.503 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=6 2024-08-28T19:49:41.503 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-08-28T19:49:41.503 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-08-28T19:49:41.503 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-28T19:49:41.513 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-28T19:49:41.513 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:49:41.513 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-28T19:49:41.535 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-08-28T19:49:41.535 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-28T19:49:41.596 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-28T19:49:41.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:41 smithi122 ceph-mon[22174]: pgmap v881: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 852 B/s wr, 10 op/s 2024-08-28T19:49:41.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:41 smithi033 ceph-mon[18549]: pgmap v881: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 852 B/s wr, 10 op/s 2024-08-28T19:49:41.902 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:42.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:41 smithi059 ceph-mon[22052]: pgmap v881: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 852 B/s wr, 10 op/s 2024-08-28T19:49:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.415+0000 7fcf3b587640 1 -- 172.21.15.33:0/2624276840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf34108140 msgr2=0x7fcf34108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.415+0000 7fcf3b587640 1 --2- 172.21.15.33:0/2624276840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf34108140 0x7fcf34108550 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009900 tx=0x7fcf2402a410 comp rx=0 tx=0).stop 2024-08-28T19:49:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.415+0000 7fcf3b587640 1 -- 172.21.15.33:0/2624276840 shutdown_connections 2024-08-28T19:49:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.415+0000 7fcf3b587640 1 --2- 172.21.15.33:0/2624276840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf34108a90 0x7fcf3410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.415+0000 7fcf3b587640 1 --2- 172.21.15.33:0/2624276840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf34108140 0x7fcf34108550 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.415+0000 7fcf3b587640 1 --2- 172.21.15.33:0/2624276840 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf34102800 0x7fcf34102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.415+0000 7fcf3b587640 1 -- 172.21.15.33:0/2624276840 >> 172.21.15.33:0/2624276840 conn(0x7fcf340794d0 msgr2=0x7fcf340798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.415+0000 7fcf3b587640 1 -- 172.21.15.33:0/2624276840 shutdown_connections 2024-08-28T19:49:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.415+0000 7fcf3b587640 1 -- 172.21.15.33:0/2624276840 wait complete. 2024-08-28T19:49:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.416+0000 7fcf3b587640 1 Processor -- start 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.416+0000 7fcf3b587640 1 -- start start 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf3b587640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf34102800 0x7fcf3419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf3b587640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf34108140 0x7fcf3419a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf3b587640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf34108a90 0x7fcf3419fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf3b587640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcf341126e0 con 0x7fcf34108140 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf3b587640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf34112560 con 0x7fcf34108a90 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf3b587640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcf34112860 con 0x7fcf34102800 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf38b22640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf34108140 0x7fcf3419a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf38b22640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf34108140 0x7fcf3419a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36772/0 (socket says 172.21.15.33:36772) 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf38b22640 1 -- 172.21.15.33:0/3519058156 learned_addr learned my addr 172.21.15.33:0/3519058156 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf39b24640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf34108a90 0x7fcf3419fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf39323640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf34102800 0x7fcf3419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf38b22640 1 -- 172.21.15.33:0/3519058156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf34102800 msgr2=0x7fcf3419a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf38b22640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf34102800 0x7fcf3419a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf38b22640 1 -- 172.21.15.33:0/3519058156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf34108a90 msgr2=0x7fcf3419fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf38b22640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf34108a90 0x7fcf3419fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf38b22640 1 -- 172.21.15.33:0/3519058156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf341a0230 con 0x7fcf34108140 2024-08-28T19:49:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf39b24640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf34108a90 0x7fcf3419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf38b22640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf34108140 0x7fcf3419a860 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fcf24032fd0 tx=0x7fcf24004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf2a7fc640 1 -- 172.21.15.33:0/3519058156 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2403f030 con 0x7fcf34108140 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf3b587640 1 -- 172.21.15.33:0/3519058156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf341a04c0 con 0x7fcf34108140 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf2a7fc640 1 -- 172.21.15.33:0/3519058156 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf24004490 con 0x7fcf34108140 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.417+0000 7fcf2a7fc640 1 -- 172.21.15.33:0/3519058156 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24035070 con 0x7fcf34108140 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.418+0000 7fcf3b587640 1 -- 172.21.15.33:0/3519058156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf341a6c80 con 0x7fcf34108140 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.418+0000 7fcf3b587640 1 -- 172.21.15.33:0/3519058156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf34103a80 con 0x7fcf34108140 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.420+0000 7fcf2a7fc640 1 -- 172.21.15.33:0/3519058156 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fcf24042030 con 0x7fcf34108140 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.421+0000 7fcf2a7fc640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf200b4ca0 0x7fcf200b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.421+0000 7fcf39323640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf200b4ca0 0x7fcf200b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.421+0000 7fcf2a7fc640 1 -- 172.21.15.33:0/3519058156 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7fcf241062e0 con 0x7fcf34108140 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.421+0000 7fcf39323640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf200b4ca0 0x7fcf200b71b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcf30005fd0 tx=0x7fcf30005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.424+0000 7fcf2a7fc640 1 -- 172.21.15.33:0/3519058156 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcf240ccd30 con 0x7fcf34108140 2024-08-28T19:49:42.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.625+0000 7fcf3b587640 1 -- 172.21.15.33:0/3519058156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcf34102c10 con 0x7fcf34108140 2024-08-28T19:49:42.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.626+0000 7fcf2a7fc640 1 -- 172.21.15.33:0/3519058156 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v106) ==== 81+0+877 (secure 0 0 0) 0x7fcf34102c10 con 0x7fcf34108140 2024-08-28T19:49:42.627 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2991102711 2024-08-29T19:23:25.613755+0000 2024-08-28T19:49:42.627 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/422613927 2024-08-29T19:23:25.613755+0000 2024-08-28T19:49:42.627 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/3998463883 2024-08-29T19:21:57.279024+0000 2024-08-28T19:49:42.627 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/269585061 2024-08-29T19:21:57.279024+0000 2024-08-28T19:49:42.627 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/3998463883 2024-08-29T19:21:57.279024+0000 2024-08-28T19:49:42.627 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1610535564 2024-08-29T19:21:57.279024+0000 2024-08-28T19:49:42.627 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/1410887649 2024-08-29T19:22:21.786187+0000 2024-08-28T19:49:42.627 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/456937089 2024-08-29T19:22:21.786187+0000 2024-08-28T19:49:42.628 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/402597277 2024-08-29T19:22:21.786187+0000 2024-08-28T19:49:42.628 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/500247 2024-08-29T19:22:21.786187+0000 2024-08-28T19:49:42.628 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/1410887649 2024-08-29T19:22:21.786187+0000 2024-08-28T19:49:42.628 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/4021316048 2024-08-29T19:21:57.279024+0000 2024-08-28T19:49:42.628 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/855163195 2024-08-29T19:23:25.613755+0000 2024-08-28T19:49:42.628 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/855163195 2024-08-29T19:23:25.613755+0000 2024-08-28T19:49:42.628 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/458032239 2024-08-29T19:23:25.613755+0000 2024-08-28T19:49:42.629 INFO:teuthology.orchestra.run.smithi033.stderr:listed 15 entries 2024-08-28T19:49:42.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 -- 172.21.15.33:0/3519058156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf200b4ca0 msgr2=0x7fcf200b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:42.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf200b4ca0 0x7fcf200b71b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcf30005fd0 tx=0x7fcf30005850 comp rx=0 tx=0).stop 2024-08-28T19:49:42.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 -- 172.21.15.33:0/3519058156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf34108140 msgr2=0x7fcf3419a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:42.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf34108140 0x7fcf3419a860 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fcf24032fd0 tx=0x7fcf24004270 comp rx=0 tx=0).stop 2024-08-28T19:49:42.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 -- 172.21.15.33:0/3519058156 shutdown_connections 2024-08-28T19:49:42.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf34108a90 0x7fcf3419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:42.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf34108140 0x7fcf3419a860 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:42.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fcf200b4ca0 0x7fcf200b71b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:42.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 --2- 172.21.15.33:0/3519058156 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcf34102800 0x7fcf3419a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:42.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 -- 172.21.15.33:0/3519058156 >> 172.21.15.33:0/3519058156 conn(0x7fcf340794d0 msgr2=0x7fcf3406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:42.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 -- 172.21.15.33:0/3519058156 shutdown_connections 2024-08-28T19:49:42.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:42.628+0000 7fcf3b587640 1 -- 172.21.15.33:0/3519058156 wait complete. 2024-08-28T19:49:43.384 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-28T19:49:43.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:49:43.384 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-28T19:49:43.428 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-08-28T19:49:43.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:49:43.428 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-28T19:49:43.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:49:43.453 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-08-28T19:49:43.509 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-28T19:49:43.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:49:43.509 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-28T19:49:43.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-28T19:49:43.575 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-08-28T19:49:43.675 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-28T19:49:43.686 INFO:tasks.cephadm:Teardown begin 2024-08-28T19:49:43.686 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-28T19:49:43.687 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:49:43.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:43 smithi033 ceph-mon[18549]: pgmap v882: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-28T19:49:43.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:43 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3519058156' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T19:49:43.953 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:44.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:43 smithi059 ceph-mon[22052]: pgmap v882: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-28T19:49:44.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:43 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3519058156' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T19:49:44.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:43 smithi122 ceph-mon[22174]: pgmap v882: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-28T19:49:44.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:43 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3519058156' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-28T19:49:44.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.469+0000 7fcee6ac7640 1 -- 172.21.15.33:0/2945348809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcee0108ac0 msgr2=0x7fcee010f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:44.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.469+0000 7fcee6ac7640 1 --2- 172.21.15.33:0/2945348809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcee0108ac0 0x7fcee010f2f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fced8009ca0 tx=0x7fced802a8c0 comp rx=0 tx=0).stop 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.469+0000 7fcee6ac7640 1 -- 172.21.15.33:0/2945348809 shutdown_connections 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.469+0000 7fcee6ac7640 1 --2- 172.21.15.33:0/2945348809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcee0108ac0 0x7fcee010f2f0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.469+0000 7fcee6ac7640 1 --2- 172.21.15.33:0/2945348809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcee0108170 0x7fcee0108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.469+0000 7fcee6ac7640 1 --2- 172.21.15.33:0/2945348809 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcee0102830 0x7fcee0102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.469+0000 7fcee6ac7640 1 -- 172.21.15.33:0/2945348809 >> 172.21.15.33:0/2945348809 conn(0x7fcee00794f0 msgr2=0x7fcee0079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.470+0000 7fcee6ac7640 1 -- 172.21.15.33:0/2945348809 shutdown_connections 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.470+0000 7fcee6ac7640 1 -- 172.21.15.33:0/2945348809 wait complete. 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.470+0000 7fcee6ac7640 1 Processor -- start 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.470+0000 7fcee6ac7640 1 -- start start 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee6ac7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcee0102830 0x7fcee019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee6ac7640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcee0108170 0x7fcee019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee6ac7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcee0108ac0 0x7fcee019f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:44.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee6ac7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcee0113850 con 0x7fcee0102830 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee6ac7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01136d0 con 0x7fcee0108ac0 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee6ac7640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01139d0 con 0x7fcee0108170 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee4863640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcee0102830 0x7fcee019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee4863640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcee0102830 0x7fcee019a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36790/0 (socket says 172.21.15.33:36790) 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee4863640 1 -- 172.21.15.33:0/3150621697 learned_addr learned my addr 172.21.15.33:0/3150621697 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee5064640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcee0108ac0 0x7fcee019f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcedffff640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcee0108170 0x7fcee019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee4863640 1 -- 172.21.15.33:0/3150621697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcee0108170 msgr2=0x7fcee019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee4863640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcee0108170 0x7fcee019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee4863640 1 -- 172.21.15.33:0/3150621697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcee0108ac0 msgr2=0x7fcee019f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee4863640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcee0108ac0 0x7fcee019f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee4863640 1 -- 172.21.15.33:0/3150621697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee01a0110 con 0x7fcee0102830 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.471+0000 7fcee4863640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcee0102830 0x7fcee019a1a0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fced400d950 tx=0x7fced400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.472+0000 7fceddffb640 1 -- 172.21.15.33:0/3150621697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4017030 con 0x7fcee0102830 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.472+0000 7fceddffb640 1 -- 172.21.15.33:0/3150621697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced4004020 con 0x7fcee0102830 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.472+0000 7fcee6ac7640 1 -- 172.21.15.33:0/3150621697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee01a0400 con 0x7fcee0102830 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.472+0000 7fceddffb640 1 -- 172.21.15.33:0/3150621697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced40047a0 con 0x7fcee0102830 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.472+0000 7fcee6ac7640 1 -- 172.21.15.33:0/3150621697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee01a6b60 con 0x7fcee0102830 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.473+0000 7fcee6ac7640 1 -- 172.21.15.33:0/3150621697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee0103ab0 con 0x7fcee0102830 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.475+0000 7fceddffb640 1 -- 172.21.15.33:0/3150621697 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fced4009a30 con 0x7fcee0102830 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.475+0000 7fceddffb640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fced00b4d20 0x7fced00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.475+0000 7fcedffff640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fced00b4d20 0x7fced00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.475+0000 7fceddffb640 1 -- 172.21.15.33:0/3150621697 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7fced40e59a0 con 0x7fcee0102830 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.476+0000 7fcedffff640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fced00b4d20 0x7fced00b7230 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcecc005fd0 tx=0x7fcecc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:44.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.478+0000 7fceddffb640 1 -- 172.21.15.33:0/3150621697 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fced40ac470 con 0x7fcee0102830 2024-08-28T19:49:44.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.703+0000 7fcee6ac7640 1 -- 172.21.15.33:0/3150621697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcee0102c40 con 0x7fcee0102830 2024-08-28T19:49:44.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.703+0000 7fceddffb640 1 -- 172.21.15.33:0/3150621697 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fced40abd70 con 0x7fcee0102830 2024-08-28T19:49:44.705 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:49:44.705 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:49:44.705 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:49:44.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 -- 172.21.15.33:0/3150621697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fced00b4d20 msgr2=0x7fced00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:44.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fced00b4d20 0x7fced00b7230 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcecc005fd0 tx=0x7fcecc005850 comp rx=0 tx=0).stop 2024-08-28T19:49:44.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 -- 172.21.15.33:0/3150621697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcee0102830 msgr2=0x7fcee019a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:44.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcee0102830 0x7fcee019a1a0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fced400d950 tx=0x7fced400de10 comp rx=0 tx=0).stop 2024-08-28T19:49:44.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 -- 172.21.15.33:0/3150621697 shutdown_connections 2024-08-28T19:49:44.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcee0108ac0 0x7fcee019f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:44.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fced00b4d20 0x7fced00b7230 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:44.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcee0108170 0x7fcee019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:44.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 --2- 172.21.15.33:0/3150621697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcee0102830 0x7fcee019a1a0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:44.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 -- 172.21.15.33:0/3150621697 >> 172.21.15.33:0/3150621697 conn(0x7fcee00794f0 msgr2=0x7fcee0104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:44.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 -- 172.21.15.33:0/3150621697 shutdown_connections 2024-08-28T19:49:44.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:44.706+0000 7fcee6ac7640 1 -- 172.21.15.33:0/3150621697 wait complete. 2024-08-28T19:49:45.398 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-28T19:49:45.656 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:45.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:45 smithi033 ceph-mon[18549]: pgmap v883: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-28T19:49:45.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:45 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3150621697' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:46.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:45 smithi059 ceph-mon[22052]: pgmap v883: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-28T19:49:46.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:45 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3150621697' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:45 smithi122 ceph-mon[22174]: pgmap v883: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-28T19:49:46.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:45 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3150621697' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:46.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.204+0000 7fb84ebd3640 1 -- 172.21.15.33:0/1205619294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb848109240 msgr2=0x7fb848109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:46.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.204+0000 7fb84ebd3640 1 --2- 172.21.15.33:0/1205619294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb848109240 0x7fb848109650 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fb834009900 tx=0x7fb83402a410 comp rx=0 tx=0).stop 2024-08-28T19:49:46.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.205+0000 7fb84ebd3640 1 -- 172.21.15.33:0/1205619294 shutdown_connections 2024-08-28T19:49:46.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.205+0000 7fb84ebd3640 1 --2- 172.21.15.33:0/1205619294 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb848109b90 0x7fb8481103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:46.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.205+0000 7fb84ebd3640 1 --2- 172.21.15.33:0/1205619294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb848109240 0x7fb848109650 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:46.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.205+0000 7fb84ebd3640 1 --2- 172.21.15.33:0/1205619294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848103900 0x7fb848103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:46.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.205+0000 7fb84ebd3640 1 -- 172.21.15.33:0/1205619294 >> 172.21.15.33:0/1205619294 conn(0x7fb84807b5f0 msgr2=0x7fb84807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:46.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.205+0000 7fb84ebd3640 1 -- 172.21.15.33:0/1205619294 shutdown_connections 2024-08-28T19:49:46.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.205+0000 7fb84ebd3640 1 -- 172.21.15.33:0/1205619294 wait complete. 2024-08-28T19:49:46.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.205+0000 7fb84ebd3640 1 Processor -- start 2024-08-28T19:49:46.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.205+0000 7fb84ebd3640 1 -- start start 2024-08-28T19:49:46.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb84ebd3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848103900 0x7fb84819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:46.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb84ebd3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb848109240 0x7fb84819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:46.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb84ebd3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb848109b90 0x7fb84819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:46.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb84ebd3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb848113850 con 0x7fb848109240 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb84ebd3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb8481136d0 con 0x7fb848103900 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb84ebd3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb8481139d0 con 0x7fb848109b90 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb847fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb848109240 0x7fb84819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb847fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb848109240 0x7fb84819a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36808/0 (socket says 172.21.15.33:36808) 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb847fff640 1 -- 172.21.15.33:0/3288581872 learned_addr learned my addr 172.21.15.33:0/3288581872 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb84d170640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb848109b90 0x7fb84819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb84c96f640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848103900 0x7fb84819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb847fff640 1 -- 172.21.15.33:0/3288581872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb848109b90 msgr2=0x7fb84819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb847fff640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb848109b90 0x7fb84819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb847fff640 1 -- 172.21.15.33:0/3288581872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848103900 msgr2=0x7fb84819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb847fff640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848103900 0x7fb84819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb847fff640 1 -- 172.21.15.33:0/3288581872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8481a01f0 con 0x7fb848109240 2024-08-28T19:49:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.206+0000 7fb847fff640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb848109240 0x7fb84819a8e0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fb83402a930 tx=0x7fb834004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.207+0000 7fb845ffb640 1 -- 172.21.15.33:0/3288581872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83403f030 con 0x7fb848109240 2024-08-28T19:49:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.207+0000 7fb84ebd3640 1 -- 172.21.15.33:0/3288581872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8481a0480 con 0x7fb848109240 2024-08-28T19:49:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.207+0000 7fb845ffb640 1 -- 172.21.15.33:0/3288581872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb834003aa0 con 0x7fb848109240 2024-08-28T19:49:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.207+0000 7fb845ffb640 1 -- 172.21.15.33:0/3288581872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834035070 con 0x7fb848109240 2024-08-28T19:49:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.207+0000 7fb84ebd3640 1 -- 172.21.15.33:0/3288581872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8481a0960 con 0x7fb848109240 2024-08-28T19:49:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.208+0000 7fb84ebd3640 1 -- 172.21.15.33:0/3288581872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb848103d10 con 0x7fb848109240 2024-08-28T19:49:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.210+0000 7fb845ffb640 1 -- 172.21.15.33:0/3288581872 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb834042030 con 0x7fb848109240 2024-08-28T19:49:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.210+0000 7fb845ffb640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8380b4cd0 0x7fb8380b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.211+0000 7fb84c96f640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8380b4cd0 0x7fb8380b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.211+0000 7fb845ffb640 1 -- 172.21.15.33:0/3288581872 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7fb8341063f0 con 0x7fb848109240 2024-08-28T19:49:46.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.211+0000 7fb84c96f640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8380b4cd0 0x7fb8380b71e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb83c005fd0 tx=0x7fb83c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:46.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.215+0000 7fb845ffb640 1 -- 172.21.15.33:0/3288581872 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb8340cce40 con 0x7fb848109240 2024-08-28T19:49:46.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.439+0000 7fb84ebd3640 1 -- 172.21.15.33:0/3288581872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb84819b470 con 0x7fb848109240 2024-08-28T19:49:46.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.440+0000 7fb845ffb640 1 -- 172.21.15.33:0/3288581872 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fb8340cc740 con 0x7fb848109240 2024-08-28T19:49:46.440 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:49:46.441 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"btime":"2024-08-28T19:32:24:361960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/3694119808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3694119808},{"type":"v1","addr":"172.21.15.33:6835","nonce":3694119808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1498510399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":1498510399},{"type":"v1","addr":"172.21.15.33:6837","nonce":1498510399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-28T19:29:48.755873+0000","modified":"2024-08-28T19:32:23.633089+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24658,"mds_1":24653,"mds_2":24643,"mds_3":24631,"mds_4":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14799":{"gid":14799,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6839/854752752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":854752752},{"type":"v1","addr":"172.21.15.33:6839","nonce":854752752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14805":{"gid":14805,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.33:6841/4138539893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":4138539893},{"type":"v1","addr":"172.21.15.33:6841","nonce":4138539893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24572":{"gid":24572,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/1923629681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1923629681},{"type":"v1","addr":"172.21.15.59:6833","nonce":1923629681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/2308401306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2308401306},{"type":"v1","addr":"172.21.15.59:6835","nonce":2308401306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/2139914522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":2139914522},{"type":"v1","addr":"172.21.15.122:6833","nonce":2139914522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.59:6837/4143114753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4143114753},{"type":"v1","addr":"172.21.15.59:6837","nonce":4143114753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.122:6835/364668654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":364668654},{"type":"v1","addr":"172.21.15.122:6835","nonce":364668654}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.122:6837/3665976487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":3665976487},{"type":"v1","addr":"172.21.15.122:6837","nonce":3665976487}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.59:6839/2455612621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":2455612621},{"type":"v1","addr":"172.21.15.59:6839","nonce":2455612621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.122:6839/2515249026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":2515249026},{"type":"v1","addr":"172.21.15.122:6839","nonce":2515249026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24658,"qdb_cluster":[24620,24631,24643,24653,24658]},"id":1}]} 2024-08-28T19:49:46.441 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 28 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 -- 172.21.15.33:0/3288581872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8380b4cd0 msgr2=0x7fb8380b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8380b4cd0 0x7fb8380b71e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb83c005fd0 tx=0x7fb83c005850 comp rx=0 tx=0).stop 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 -- 172.21.15.33:0/3288581872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb848109240 msgr2=0x7fb84819a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb848109240 0x7fb84819a8e0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fb83402a930 tx=0x7fb834004270 comp rx=0 tx=0).stop 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 -- 172.21.15.33:0/3288581872 shutdown_connections 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb8380b4cd0 0x7fb8380b71e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb848109b90 0x7fb84819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb848109240 0x7fb84819a8e0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 --2- 172.21.15.33:0/3288581872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb848103900 0x7fb84819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 -- 172.21.15.33:0/3288581872 >> 172.21.15.33:0/3288581872 conn(0x7fb84807b5f0 msgr2=0x7fb848105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 -- 172.21.15.33:0/3288581872 shutdown_connections 2024-08-28T19:49:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:46.442+0000 7fb84ebd3640 1 -- 172.21.15.33:0/3288581872 wait complete. 2024-08-28T19:49:46.817 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:46 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/3288581872' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:47.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:46 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/3288581872' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:47.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:46 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/3288581872' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-28T19:49:47.174 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-28T19:49:47.434 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:47.857 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:47 smithi033 ceph-mon[18549]: pgmap v884: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 10 op/s 2024-08-28T19:49:47.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.947+0000 7f094ee27640 1 -- 172.21.15.33:0/1054688848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0948109b90 msgr2=0x7f09481103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.947+0000 7f094ee27640 1 --2- 172.21.15.33:0/1054688848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0948109b90 0x7f09481103c0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f0940009ca0 tx=0x7f094002a8e0 comp rx=0 tx=0).stop 2024-08-28T19:49:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.947+0000 7f094ee27640 1 -- 172.21.15.33:0/1054688848 shutdown_connections 2024-08-28T19:49:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.947+0000 7f094ee27640 1 --2- 172.21.15.33:0/1054688848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0948109b90 0x7f09481103c0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.947+0000 7f094ee27640 1 --2- 172.21.15.33:0/1054688848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0948109240 0x7f0948109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.947+0000 7f094ee27640 1 --2- 172.21.15.33:0/1054688848 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0948103900 0x7f0948103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.947+0000 7f094ee27640 1 -- 172.21.15.33:0/1054688848 >> 172.21.15.33:0/1054688848 conn(0x7f094807b5f0 msgr2=0x7f094807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.947+0000 7f094ee27640 1 -- 172.21.15.33:0/1054688848 shutdown_connections 2024-08-28T19:49:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.947+0000 7f094ee27640 1 -- 172.21.15.33:0/1054688848 wait complete. 2024-08-28T19:49:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094ee27640 1 Processor -- start 2024-08-28T19:49:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094ee27640 1 -- start start 2024-08-28T19:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094ee27640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0948103900 0x7f094819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094ee27640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0948109240 0x7f094819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094ee27640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0948109b90 0x7f094819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094ee27640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0948113890 con 0x7f0948109b90 2024-08-28T19:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094ee27640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0948113710 con 0x7f0948103900 2024-08-28T19:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094ee27640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f0948113a10 con 0x7f0948109240 2024-08-28T19:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094d3c4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0948109b90 0x7f094819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094d3c4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0948109b90 0x7f094819faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36826/0 (socket says 172.21.15.33:36826) 2024-08-28T19:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.948+0000 7f094d3c4640 1 -- 172.21.15.33:0/638528032 learned_addr learned my addr 172.21.15.33:0/638528032 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f0947fff640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0948109240 0x7f094819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f094cbc3640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0948103900 0x7f094819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f094d3c4640 1 -- 172.21.15.33:0/638528032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0948109240 msgr2=0x7f094819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f094d3c4640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0948109240 0x7f094819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f094d3c4640 1 -- 172.21.15.33:0/638528032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0948103900 msgr2=0x7f094819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f094d3c4640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0948103900 0x7f094819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f094d3c4640 1 -- 172.21.15.33:0/638528032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09481a0110 con 0x7f0948109b90 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f0947fff640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0948109240 0x7f094819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f094d3c4640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0948109b90 0x7f094819faa0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f0940005cc0 tx=0x7f0940003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f0945ffb640 1 -- 172.21.15.33:0/638528032 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940004040 con 0x7f0948109b90 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f0945ffb640 1 -- 172.21.15.33:0/638528032 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0940004690 con 0x7f0948109b90 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f094ee27640 1 -- 172.21.15.33:0/638528032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09481a03a0 con 0x7f0948109b90 2024-08-28T19:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f0945ffb640 1 -- 172.21.15.33:0/638528032 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940030e20 con 0x7f0948109b90 2024-08-28T19:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.949+0000 7f094ee27640 1 -- 172.21.15.33:0/638528032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09481a6c20 con 0x7f0948109b90 2024-08-28T19:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.950+0000 7f094ee27640 1 -- 172.21.15.33:0/638528032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0948103d10 con 0x7f0948109b90 2024-08-28T19:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.952+0000 7f0945ffb640 1 -- 172.21.15.33:0/638528032 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f09400305e0 con 0x7f0948109b90 2024-08-28T19:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.953+0000 7f0945ffb640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09380b4cd0 0x7f09380b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.953+0000 7f0945ffb640 1 -- 172.21.15.33:0/638528032 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7f0940106ec0 con 0x7f0948109b90 2024-08-28T19:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.953+0000 7f094cbc3640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09380b4cd0 0x7f09380b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.953+0000 7f094cbc3640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09380b4cd0 0x7f09380b71e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f093c005e10 tx=0x7f093c005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:47.956+0000 7f0945ffb640 1 -- 172.21.15.33:0/638528032 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f09400cd910 con 0x7f0948109b90 2024-08-28T19:49:48.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:47 smithi059 ceph-mon[22052]: pgmap v884: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 10 op/s 2024-08-28T19:49:48.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:47 smithi122 ceph-mon[22174]: pgmap v884: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 10 op/s 2024-08-28T19:49:48.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.146+0000 7f094ee27640 1 -- 172.21.15.33:0/638528032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f094819b390 con 0x7f0948109b90 2024-08-28T19:49:48.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.147+0000 7f0945ffb640 1 -- 172.21.15.33:0/638528032 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+25280 (secure 0 0 0) 0x7f094819b390 con 0x7f0948109b90 2024-08-28T19:49:48.149 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-08-28T19:49:48.149 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":106,"fsid":"9a2fc37c-6572-11ef-bcd4-c7b262605968","created":"2024-08-28T19:21:33.380476+0000","modified":"2024-08-28T19:49:14.546283+0000","last_up_change":"2024-08-28T19:28:56.341674+0000","last_in_change":"2024-08-28T19:28:32.783164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-28T19:25:14.079616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-28T19:29:44.553677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-28T19:29:46.793616+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":29,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-28T19:29:53.252864+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":29,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b050d5-5123-449b-a514-0404c1520c85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6803","nonce":758428304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6805","nonce":758428304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6809","nonce":758428304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":758428304},{"type":"v1","addr":"172.21.15.33:6807","nonce":758428304}]},"public_addr":"172.21.15.33:6803/758428304","cluster_addr":"172.21.15.33:6805/758428304","heartbeat_back_addr":"172.21.15.33:6809/758428304","heartbeat_front_addr":"172.21.15.33:6807/758428304","state":["exists","up"]},{"osd":1,"uuid":"f5a49e77-f9e9-4419-a08f-d61a8b5d08bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6801","nonce":4789314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6803","nonce":4789314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6807","nonce":4789314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4789314},{"type":"v1","addr":"172.21.15.59:6805","nonce":4789314}]},"public_addr":"172.21.15.59:6801/4789314","cluster_addr":"172.21.15.59:6803/4789314","heartbeat_back_addr":"172.21.15.59:6807/4789314","heartbeat_front_addr":"172.21.15.59:6805/4789314","state":["exists","up"]},{"osd":2,"uuid":"f65f62b9-a463-4efc-b62d-ee08a3ae7a29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6801","nonce":1716397894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6803","nonce":1716397894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6807","nonce":1716397894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":1716397894},{"type":"v1","addr":"172.21.15.122:6805","nonce":1716397894}]},"public_addr":"172.21.15.122:6801/1716397894","cluster_addr":"172.21.15.122:6803/1716397894","heartbeat_back_addr":"172.21.15.122:6807/1716397894","heartbeat_front_addr":"172.21.15.122:6805/1716397894","state":["exists","up"]},{"osd":3,"uuid":"8d8d82b3-299e-4ee6-ba28-19aeb3d9def4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6811","nonce":3029290427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6813","nonce":3029290427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6817","nonce":3029290427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3029290427},{"type":"v1","addr":"172.21.15.33:6815","nonce":3029290427}]},"public_addr":"172.21.15.33:6811/3029290427","cluster_addr":"172.21.15.33:6813/3029290427","heartbeat_back_addr":"172.21.15.33:6817/3029290427","heartbeat_front_addr":"172.21.15.33:6815/3029290427","state":["exists","up"]},{"osd":4,"uuid":"b2a493d3-6deb-48d7-9e3c-984bc4ef7837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6809","nonce":1846789245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6811","nonce":1846789245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6815","nonce":1846789245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1846789245},{"type":"v1","addr":"172.21.15.59:6813","nonce":1846789245}]},"public_addr":"172.21.15.59:6809/1846789245","cluster_addr":"172.21.15.59:6811/1846789245","heartbeat_back_addr":"172.21.15.59:6815/1846789245","heartbeat_front_addr":"172.21.15.59:6813/1846789245","state":["exists","up"]},{"osd":5,"uuid":"8b68288c-6c14-46db-9a5a-eff806c6bc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6809","nonce":1476880697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6811","nonce":1476880697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6815","nonce":1476880697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":1476880697},{"type":"v1","addr":"172.21.15.122:6813","nonce":1476880697}]},"public_addr":"172.21.15.122:6809/1476880697","cluster_addr":"172.21.15.122:6811/1476880697","heartbeat_back_addr":"172.21.15.122:6815/1476880697","heartbeat_front_addr":"172.21.15.122:6813/1476880697","state":["exists","up"]},{"osd":6,"uuid":"35915467-02f3-452e-905a-6587abdb8224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6819","nonce":1759127784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6821","nonce":1759127784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6825","nonce":1759127784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1759127784},{"type":"v1","addr":"172.21.15.33:6823","nonce":1759127784}]},"public_addr":"172.21.15.33:6819/1759127784","cluster_addr":"172.21.15.33:6821/1759127784","heartbeat_back_addr":"172.21.15.33:6825/1759127784","heartbeat_front_addr":"172.21.15.33:6823/1759127784","state":["exists","up"]},{"osd":7,"uuid":"b817ce35-db7a-4d3d-828b-c10ac52c6681","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6817","nonce":4018917656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6819","nonce":4018917656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6823","nonce":4018917656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":4018917656},{"type":"v1","addr":"172.21.15.59:6821","nonce":4018917656}]},"public_addr":"172.21.15.59:6817/4018917656","cluster_addr":"172.21.15.59:6819/4018917656","heartbeat_back_addr":"172.21.15.59:6823/4018917656","heartbeat_front_addr":"172.21.15.59:6821/4018917656","state":["exists","up"]},{"osd":8,"uuid":"6fda6eb9-377c-426e-8dc6-5a16f4b0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6817","nonce":3673274503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6819","nonce":3673274503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6823","nonce":3673274503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":3673274503},{"type":"v1","addr":"172.21.15.122:6821","nonce":3673274503}]},"public_addr":"172.21.15.122:6817/3673274503","cluster_addr":"172.21.15.122:6819/3673274503","heartbeat_back_addr":"172.21.15.122:6823/3673274503","heartbeat_front_addr":"172.21.15.122:6821/3673274503","state":["exists","up"]},{"osd":9,"uuid":"3410400b-dc26-4823-b1d3-b1811bae8b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6827","nonce":3701959961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6829","nonce":3701959961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6833","nonce":3701959961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3701959961},{"type":"v1","addr":"172.21.15.33:6831","nonce":3701959961}]},"public_addr":"172.21.15.33:6827/3701959961","cluster_addr":"172.21.15.33:6829/3701959961","heartbeat_back_addr":"172.21.15.33:6833/3701959961","heartbeat_front_addr":"172.21.15.33:6831/3701959961","state":["exists","up"]},{"osd":10,"uuid":"e6d6159a-9538-4ae7-8950-46356be55137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6825","nonce":3281579619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6827","nonce":3281579619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6831","nonce":3281579619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3281579619},{"type":"v1","addr":"172.21.15.59:6829","nonce":3281579619}]},"public_addr":"172.21.15.59:6825/3281579619","cluster_addr":"172.21.15.59:6827/3281579619","heartbeat_back_addr":"172.21.15.59:6831/3281579619","heartbeat_front_addr":"172.21.15.59:6829/3281579619","state":["exists","up"]},{"osd":11,"uuid":"539ae544-528f-4eb7-bca0-dc8adebffbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6825","nonce":2920209132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6827","nonce":2920209132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6831","nonce":2920209132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":2920209132},{"type":"v1","addr":"172.21.15.122:6829","nonce":2920209132}]},"public_addr":"172.21.15.122:6825/2920209132","cluster_addr":"172.21.15.122:6827/2920209132","heartbeat_back_addr":"172.21.15.122:6831/2920209132","heartbeat_front_addr":"172.21.15.122:6829/2920209132","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:26.012190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:24:49.229841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:11.941743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:25:37.530507+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:01.334037+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:25.090897+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:26:50.597322+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:13.803906+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:27:38.767591+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:04.854702+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:29.529823+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-28T19:28:53.958116+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.9","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2991102711":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/422613927":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6800/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/269585061":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/3998463883":"2024-08-29T19:21:57.279024+0000","172.21.15.33:0/1610535564":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6801/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/456937089":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/402597277":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/500247":"2024-08-29T19:22:21.786187+0000","172.21.15.33:6800/1410887649":"2024-08-29T19:22:21.786187+0000","172.21.15.33:0/4021316048":"2024-08-29T19:21:57.279024+0000","172.21.15.33:6800/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:6801/855163195":"2024-08-29T19:23:25.613755+0000","172.21.15.33:0/458032239":"2024-08-29T19:23:25.613755+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":16,"length":1},{"begin":29,"length":1}]},{"pool":4,"snaps":[{"begin":16,"length":1},{"begin":29,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-28T19:49:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 -- 172.21.15.33:0/638528032 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09380b4cd0 msgr2=0x7f09380b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09380b4cd0 0x7f09380b71e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f093c005e10 tx=0x7f093c005da0 comp rx=0 tx=0).stop 2024-08-28T19:49:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 -- 172.21.15.33:0/638528032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0948109b90 msgr2=0x7f094819faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0948109b90 0x7f094819faa0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f0940005cc0 tx=0x7f0940003ba0 comp rx=0 tx=0).stop 2024-08-28T19:49:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 -- 172.21.15.33:0/638528032 shutdown_connections 2024-08-28T19:49:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0948109b90 0x7f094819faa0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f09380b4cd0 0x7f09380b71e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0948109240 0x7f094819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 --2- 172.21.15.33:0/638528032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0948103900 0x7f094819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 -- 172.21.15.33:0/638528032 >> 172.21.15.33:0/638528032 conn(0x7f094807b5f0 msgr2=0x7f0948107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 -- 172.21.15.33:0/638528032 shutdown_connections 2024-08-28T19:49:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:48.150+0000 7f094ee27640 1 -- 172.21.15.33:0/638528032 wait complete. 2024-08-28T19:49:48.854 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:48 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/638528032' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:49:48.885 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs fail cephfs 2024-08-28T19:49:49.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:48 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/638528032' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:49:49.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:48 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/638528032' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-28T19:49:49.139 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.644+0000 7f58a82e4640 1 -- 172.21.15.33:0/3654224859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a0108180 msgr2=0x7f58a0108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.644+0000 7f58a82e4640 1 --2- 172.21.15.33:0/3654224859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a0108180 0x7f58a0108590 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5890009900 tx=0x7f589002a410 comp rx=0 tx=0).stop 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.644+0000 7f58a82e4640 1 -- 172.21.15.33:0/3654224859 shutdown_connections 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.644+0000 7f58a82e4640 1 --2- 172.21.15.33:0/3654224859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a0108ad0 0x7f58a010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.644+0000 7f58a82e4640 1 --2- 172.21.15.33:0/3654224859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a0108180 0x7f58a0108590 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.644+0000 7f58a82e4640 1 --2- 172.21.15.33:0/3654224859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0102840 0x7f58a0102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.644+0000 7f58a82e4640 1 -- 172.21.15.33:0/3654224859 >> 172.21.15.33:0/3654224859 conn(0x7f58a00794f0 msgr2=0x7f58a0079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.644+0000 7f58a82e4640 1 -- 172.21.15.33:0/3654224859 shutdown_connections 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.644+0000 7f58a82e4640 1 -- 172.21.15.33:0/3654224859 wait complete. 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.644+0000 7f58a82e4640 1 Processor -- start 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a82e4640 1 -- start start 2024-08-28T19:49:49.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a82e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a0102840 0x7f58a019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a82e4640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0108180 0x7f58a019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a82e4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a0108ad0 0x7f58a019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a82e4640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f58a01127b0 con 0x7f58a0108ad0 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a82e4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0112630 con 0x7f58a0102840 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a82e4640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0112930 con 0x7f58a0108180 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a6881640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a0108ad0 0x7f58a019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a6881640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a0108ad0 0x7f58a019fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47366/0 (socket says 172.21.15.33:47366) 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a6881640 1 -- 172.21.15.33:0/1912400772 learned_addr learned my addr 172.21.15.33:0/1912400772 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a6080640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a0102840 0x7f58a019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a587f640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0108180 0x7f58a019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:49.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a6881640 1 -- 172.21.15.33:0/1912400772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0108180 msgr2=0x7f58a019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a6881640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0108180 0x7f58a019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a6881640 1 -- 172.21.15.33:0/1912400772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a0102840 msgr2=0x7f58a019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a6881640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a0102840 0x7f58a019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a6881640 1 -- 172.21.15.33:0/1912400772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a01a0360 con 0x7f58a0108ad0 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.645+0000 7f58a6080640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a0102840 0x7f58a019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.646+0000 7f58a6881640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a0108ad0 0x7f58a019fc30 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f589800eaa0 tx=0x7f589800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.646+0000 7f58977fe640 1 -- 172.21.15.33:0/1912400772 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898004d20 con 0x7f58a0108ad0 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.646+0000 7f58977fe640 1 -- 172.21.15.33:0/1912400772 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5898005020 con 0x7f58a0108ad0 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.646+0000 7f58a82e4640 1 -- 172.21.15.33:0/1912400772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a01a0650 con 0x7f58a0108ad0 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.646+0000 7f58977fe640 1 -- 172.21.15.33:0/1912400772 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58980116b0 con 0x7f58a0108ad0 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.646+0000 7f58a82e4640 1 -- 172.21.15.33:0/1912400772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a01a6db0 con 0x7f58a0108ad0 2024-08-28T19:49:49.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.647+0000 7f58a82e4640 1 -- 172.21.15.33:0/1912400772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a0102c50 con 0x7f58a0108ad0 2024-08-28T19:49:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.648+0000 7f58977fe640 1 -- 172.21.15.33:0/1912400772 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7f58980051d0 con 0x7f58a0108ad0 2024-08-28T19:49:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.649+0000 7f58977fe640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f588c0b4d20 0x7f588c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.649+0000 7f58a6080640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f588c0b4d20 0x7f588c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.649+0000 7f58977fe640 1 -- 172.21.15.33:0/1912400772 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9453+0+0 (secure 0 0 0) 0x7f58980e5e30 con 0x7f58a0108ad0 2024-08-28T19:49:49.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.650+0000 7f58a6080640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f588c0b4d20 0x7f588c0b7230 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f589c009d60 tx=0x7f589c009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:49.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.652+0000 7f58977fe640 1 -- 172.21.15.33:0/1912400772 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5898016030 con 0x7f58a0108ad0 2024-08-28T19:49:49.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.876+0000 7f58a82e4640 1 -- 172.21.15.33:0/1912400772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f58a019b520 con 0x7f58a0108ad0 2024-08-28T19:49:49.877 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-mon[18549]: pgmap v885: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-08-28T19:49:49.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.879+0000 7f58977fe640 1 -- 172.21.15.33:0/1912400772 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f58a019b520 con 0x7f58a0108ad0 2024-08-28T19:49:49.880 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-28T19:49:49.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.882+0000 7f58a82e4640 1 -- 172.21.15.33:0/1912400772 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f588c0b4d20 msgr2=0x7f588c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:49.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.882+0000 7f58a82e4640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f588c0b4d20 0x7f588c0b7230 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f589c009d60 tx=0x7f589c009110 comp rx=0 tx=0).stop 2024-08-28T19:49:49.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.882+0000 7f58a82e4640 1 -- 172.21.15.33:0/1912400772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a0108ad0 msgr2=0x7f58a019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:49.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.882+0000 7f58a82e4640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a0108ad0 0x7f58a019fc30 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f589800eaa0 tx=0x7f589800eea0 comp rx=0 tx=0).stop 2024-08-28T19:49:49.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.883+0000 7f58a82e4640 1 -- 172.21.15.33:0/1912400772 shutdown_connections 2024-08-28T19:49:49.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.883+0000 7f58a82e4640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a0108ad0 0x7f58a019fc30 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:49.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.883+0000 7f58a82e4640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7f588c0b4d20 0x7f588c0b7230 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:49.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.883+0000 7f58a82e4640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f58a0108180 0x7f58a019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:49.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.883+0000 7f58a82e4640 1 --2- 172.21.15.33:0/1912400772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a0102840 0x7f58a019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:49.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.883+0000 7f58a82e4640 1 -- 172.21.15.33:0/1912400772 >> 172.21.15.33:0/1912400772 conn(0x7f58a00794f0 msgr2=0x7f58a0101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:49.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.883+0000 7f58a82e4640 1 -- 172.21.15.33:0/1912400772 shutdown_connections 2024-08-28T19:49:49.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:49.883+0000 7f58a82e4640 1 -- 172.21.15.33:0/1912400772 wait complete. 2024-08-28T19:49:49.949 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-mon[22174]: pgmap v885: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-08-28T19:49:49.949 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-mon[22052]: pgmap v885: 129 pgs: 129 active+clean; 30 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-08-28T19:49:50.130 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a[18545]: 2024-08-28T19:49:49.877+0000 7f09a7391640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-28T19:49:50.130 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a[64517]: ignoring --setuser ceph since I am not root 2024-08-28T19:49:50.130 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a[64517]: ignoring --setgroup ceph since I am not root 2024-08-28T19:49:50.130 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-mds[64521]: -- 172.21.15.33:0/3311660577 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ad3cdc9520 con 0x55ad40f65a80 2024-08-28T19:49:50.131 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-mds[64521]: -- 172.21.15.33:0/3311660577 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad3cdbf860 con 0x55ad40f65a80 2024-08-28T19:49:50.131 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a[64517]: starting mds.a at 2024-08-28T19:49:50.131 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-g[64169]: ignoring --setuser ceph since I am not root 2024-08-28T19:49:50.131 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-g[64169]: ignoring --setgroup ceph since I am not root 2024-08-28T19:49:50.131 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-mds[64174]: -- 172.21.15.33:0/1439213625 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e78c54fc20 con 0x55e7906f5600 2024-08-28T19:49:50.131 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:49:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-g[64169]: starting mds.g at 2024-08-28T19:49:50.283 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b[53155]: ignoring --setuser ceph since I am not root 2024-08-28T19:49:50.283 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b[53155]: ignoring --setgroup ceph since I am not root 2024-08-28T19:49:50.283 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-mds[53159]: -- 172.21.15.59:0/551273164 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c97548f860 con 0x55c979635180 2024-08-28T19:49:50.283 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b[53155]: starting mds.b at 2024-08-28T19:49:50.284 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h[52843]: ignoring --setuser ceph since I am not root 2024-08-28T19:49:50.284 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h[52843]: ignoring --setgroup ceph since I am not root 2024-08-28T19:49:50.284 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-mds[52847]: -- 172.21.15.59:0/591353079 <== mon.1 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558a16b9b860 con 0x558a1ad41180 2024-08-28T19:49:50.284 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h[52843]: starting mds.h at 2024-08-28T19:49:50.284 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k[52242]: ignoring --setuser ceph since I am not root 2024-08-28T19:49:50.284 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k[52242]: ignoring --setgroup ceph since I am not root 2024-08-28T19:49:50.284 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-mds[52246]: -- 172.21.15.59:0/108569449 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56200ecbf860 con 0x562012e65180 2024-08-28T19:49:50.285 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k[52242]: starting mds.k at 2024-08-28T19:49:50.285 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e[52539]: ignoring --setuser ceph since I am not root 2024-08-28T19:49:50.285 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e[52539]: ignoring --setgroup ceph since I am not root 2024-08-28T19:49:50.285 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:49:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e[52539]: starting mds.e at 2024-08-28T19:49:50.293 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c[53811]: ignoring --setuser ceph since I am not root 2024-08-28T19:49:50.293 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c[53811]: ignoring --setgroup ceph since I am not root 2024-08-28T19:49:50.293 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-mds[53815]: --2- 172.21.15.122:0/793743062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b51ba75180 0x55b51ba66000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55b51ba86ba0 tx=0x55b51b9ae780 comp rx=0 tx=0).write_message sending message m=0x55b51b93c8c0 seq=3 auth(proto 2 2 bytes epoch 0) 2024-08-28T19:49:50.293 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-mds[53815]: -- 172.21.15.122:0/793743062 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b5178cfc20 con 0x55b51ba75180 2024-08-28T19:49:50.294 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c[53811]: starting mds.c at 2024-08-28T19:49:50.294 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i[54112]: ignoring --setuser ceph since I am not root 2024-08-28T19:49:50.294 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i[54112]: ignoring --setgroup ceph since I am not root 2024-08-28T19:49:50.294 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-mds[54116]: -- 172.21.15.122:0/4132419982 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc21ca3c20 con 0x55fc25e49600 2024-08-28T19:49:50.294 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i[54112]: starting mds.i at 2024-08-28T19:49:50.294 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f[53511]: ignoring --setuser ceph since I am not root 2024-08-28T19:49:50.295 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f[53511]: ignoring --setgroup ceph since I am not root 2024-08-28T19:49:50.295 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-mds[53515]: -- 172.21.15.122:0/879725111 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c79e5cf860 con 0x55c7a2775180 2024-08-28T19:49:50.295 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:49:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f[53511]: starting mds.f at 2024-08-28T19:49:50.609 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-28T19:49:50.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:50 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1912400772' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-28T19:49:50.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:50 smithi122 ceph-mon[22174]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-28T19:49:50.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:50 smithi122 ceph-mon[22174]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-28T19:49:50.793 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:50 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1912400772' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-28T19:49:50.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:50 smithi122 ceph-mon[22174]: osdmap e107: 12 total, 12 up, 12 in 2024-08-28T19:49:50.794 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:50 smithi122 ceph-mon[22174]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-28T19:49:50.865 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:50.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:50 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1912400772' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-28T19:49:50.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:50 smithi033 ceph-mon[18549]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-28T19:49:50.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:50 smithi033 ceph-mon[18549]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-28T19:49:50.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:50 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1912400772' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-28T19:49:50.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:50 smithi033 ceph-mon[18549]: osdmap e107: 12 total, 12 up, 12 in 2024-08-28T19:49:50.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:50 smithi033 ceph-mon[18549]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-28T19:49:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:50 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1912400772' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-28T19:49:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:50 smithi059 ceph-mon[22052]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-28T19:49:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:50 smithi059 ceph-mon[22052]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-28T19:49:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:50 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1912400772' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-28T19:49:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:50 smithi059 ceph-mon[22052]: osdmap e107: 12 total, 12 up, 12 in 2024-08-28T19:49:51.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:50 smithi059 ceph-mon[22052]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-28T19:49:51.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.352+0000 7fb788651640 1 -- 172.21.15.33:0/181478523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb780103900 msgr2=0x7fb780103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:51.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.352+0000 7fb788651640 1 --2- 172.21.15.33:0/181478523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb780103900 0x7fb780103d10 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009900 tx=0x7fb77c02a410 comp rx=0 tx=0).stop 2024-08-28T19:49:51.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.353+0000 7fb788651640 1 -- 172.21.15.33:0/181478523 shutdown_connections 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.353+0000 7fb788651640 1 --2- 172.21.15.33:0/181478523 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb780109b90 0x7fb7801103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.353+0000 7fb788651640 1 --2- 172.21.15.33:0/181478523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb780109240 0x7fb780109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.353+0000 7fb788651640 1 --2- 172.21.15.33:0/181478523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb780103900 0x7fb780103d10 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.353+0000 7fb788651640 1 -- 172.21.15.33:0/181478523 >> 172.21.15.33:0/181478523 conn(0x7fb78007b5f0 msgr2=0x7fb78007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.353+0000 7fb788651640 1 -- 172.21.15.33:0/181478523 shutdown_connections 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.353+0000 7fb788651640 1 -- 172.21.15.33:0/181478523 wait complete. 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.353+0000 7fb788651640 1 Processor -- start 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb788651640 1 -- start start 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb788651640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb780103900 0x7fb78019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb788651640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb780109240 0x7fb78019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb788651640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb780109b90 0x7fb78019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:51.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb788651640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb780113850 con 0x7fb780103900 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb788651640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801136d0 con 0x7fb780109240 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb788651640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fb7801139d0 con 0x7fb780109b90 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb7863ed640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb780103900 0x7fb78019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb7863ed640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb780103900 0x7fb78019a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47436/0 (socket says 172.21.15.33:47436) 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb7863ed640 1 -- 172.21.15.33:0/139301117 learned_addr learned my addr 172.21.15.33:0/139301117 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb785bec640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb780109240 0x7fb78019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb786bee640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb780109b90 0x7fb78019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb7863ed640 1 -- 172.21.15.33:0/139301117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb780109b90 msgr2=0x7fb78019fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb7863ed640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb780109b90 0x7fb78019fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb7863ed640 1 -- 172.21.15.33:0/139301117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb780109240 msgr2=0x7fb78019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb7863ed640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb780109240 0x7fb78019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb7863ed640 1 -- 172.21.15.33:0/139301117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7801a00b0 con 0x7fb780103900 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.354+0000 7fb785bec640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb780109240 0x7fb78019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.355+0000 7fb7863ed640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb780103900 0x7fb78019a200 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fb77c005940 tx=0x7fb77c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.355+0000 7fb7737fe640 1 -- 172.21.15.33:0/139301117 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c03f030 con 0x7fb780103900 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.355+0000 7fb788651640 1 -- 172.21.15.33:0/139301117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7801a0340 con 0x7fb780103900 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.355+0000 7fb7737fe640 1 -- 172.21.15.33:0/139301117 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb77c003cb0 con 0x7fb780103900 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.355+0000 7fb7737fe640 1 -- 172.21.15.33:0/139301117 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c035070 con 0x7fb780103900 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.355+0000 7fb788651640 1 -- 172.21.15.33:0/139301117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7801a0820 con 0x7fb780103900 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.356+0000 7fb788651640 1 -- 172.21.15.33:0/139301117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb780103d10 con 0x7fb780103900 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.357+0000 7fb7737fe640 1 -- 172.21.15.33:0/139301117 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fb77c042030 con 0x7fb780103900 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.359+0000 7fb7737fe640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb76c0b4cd0 0x7fb76c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.359+0000 7fb785bec640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb76c0b4cd0 0x7fb76c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.359+0000 7fb7737fe640 1 -- 172.21.15.33:0/139301117 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9795+0+0 (secure 0 0 0) 0x7fb77c106210 con 0x7fb780103900 2024-08-28T19:49:51.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.359+0000 7fb785bec640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb76c0b4cd0 0x7fb76c0b71e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb780106260 tx=0x7fb77400a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:51.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.362+0000 7fb7737fe640 1 -- 172.21.15.33:0/139301117 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb77c0ccb00 con 0x7fb780103900 2024-08-28T19:49:51.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.584+0000 7fb788651640 1 -- 172.21.15.33:0/139301117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb78002e430 con 0x7fb780103900 2024-08-28T19:49:51.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: pgmap v887: 129 pgs: 129 active+clean; 30 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 716 B/s wr, 11 op/s 2024-08-28T19:49:51.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.33:6838/4188870474,v1:172.21.15.33:6841/4188870474] up:boot 2024-08-28T19:49:51.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.33:6839/530712408,v1:172.21.15.33:6840/530712408] up:boot 2024-08-28T19:49:51.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6832/3457928808,v1:172.21.15.122:6833/3457928808] up:boot 2024-08-28T19:49:51.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.59:6832/2058471089,v1:172.21.15.59:6834/2058471089] up:boot 2024-08-28T19:49:51.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.59:6833/1541402806,v1:172.21.15.59:6835/1541402806] up:boot 2024-08-28T19:49:51.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6834/501546183,v1:172.21.15.122:6836/501546183] up:boot 2024-08-28T19:49:51.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6835/3277871089,v1:172.21.15.122:6837/3277871089] up:boot 2024-08-28T19:49:51.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.59:6836/4029431607,v1:172.21.15.59:6838/4029431607] up:boot 2024-08-28T19:49:51.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.59:6837/2170662142,v1:172.21.15.59:6839/2170662142] up:boot 2024-08-28T19:49:51.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: mds.? [v2:172.21.15.122:6838/3369295131,v1:172.21.15.122:6839/3369295131] up:boot 2024-08-28T19:49:51.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-28T19:49:51.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-28T19:49:51.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T19:49:51.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-28T19:49:51.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-28T19:49:51.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T19:49:51.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T19:49:51.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T19:49:51.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T19:49:51.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T19:49:51.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T19:49:51.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T19:49:51.884 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:51 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/139301117' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-28T19:49:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.886+0000 7fb7737fe640 1 -- 172.21.15.33:0/139301117 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fb77c0cc400 con 0x7fb780103900 2024-08-28T19:49:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.888+0000 7fb788651640 1 -- 172.21.15.33:0/139301117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb76c0b4cd0 msgr2=0x7fb76c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.888+0000 7fb788651640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb76c0b4cd0 0x7fb76c0b71e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb780106260 tx=0x7fb77400a5c0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.888+0000 7fb788651640 1 -- 172.21.15.33:0/139301117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb780103900 msgr2=0x7fb78019a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.888+0000 7fb788651640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb780103900 0x7fb78019a200 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fb77c005940 tx=0x7fb77c0042f0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.888+0000 7fb788651640 1 -- 172.21.15.33:0/139301117 shutdown_connections 2024-08-28T19:49:51.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.888+0000 7fb788651640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fb76c0b4cd0 0x7fb76c0b71e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.888+0000 7fb788651640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb780109b90 0x7fb78019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.888+0000 7fb788651640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb780109240 0x7fb78019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.889+0000 7fb788651640 1 --2- 172.21.15.33:0/139301117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb780103900 0x7fb78019a200 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.889+0000 7fb788651640 1 -- 172.21.15.33:0/139301117 >> 172.21.15.33:0/139301117 conn(0x7fb78007b5f0 msgr2=0x7fb7801072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:51.892 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.889+0000 7fb788651640 1 -- 172.21.15.33:0/139301117 shutdown_connections 2024-08-28T19:49:51.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:51.889+0000 7fb788651640 1 -- 172.21.15.33:0/139301117 wait complete. 2024-08-28T19:49:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: pgmap v887: 129 pgs: 129 active+clean; 30 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 716 B/s wr, 11 op/s 2024-08-28T19:49:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.33:6838/4188870474,v1:172.21.15.33:6841/4188870474] up:boot 2024-08-28T19:49:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.33:6839/530712408,v1:172.21.15.33:6840/530712408] up:boot 2024-08-28T19:49:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6832/3457928808,v1:172.21.15.122:6833/3457928808] up:boot 2024-08-28T19:49:52.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.59:6832/2058471089,v1:172.21.15.59:6834/2058471089] up:boot 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.59:6833/1541402806,v1:172.21.15.59:6835/1541402806] up:boot 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6834/501546183,v1:172.21.15.122:6836/501546183] up:boot 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6835/3277871089,v1:172.21.15.122:6837/3277871089] up:boot 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.59:6836/4029431607,v1:172.21.15.59:6838/4029431607] up:boot 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.59:6837/2170662142,v1:172.21.15.59:6839/2170662142] up:boot 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: mds.? [v2:172.21.15.122:6838/3369295131,v1:172.21.15.122:6839/3369295131] up:boot 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-28T19:49:52.034 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T19:49:52.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T19:49:52.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T19:49:52.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T19:49:52.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T19:49:52.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T19:49:52.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T19:49:52.035 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:51 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/139301117' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-28T19:49:52.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: pgmap v887: 129 pgs: 129 active+clean; 30 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 716 B/s wr, 11 op/s 2024-08-28T19:49:52.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.33:6838/4188870474,v1:172.21.15.33:6841/4188870474] up:boot 2024-08-28T19:49:52.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.33:6839/530712408,v1:172.21.15.33:6840/530712408] up:boot 2024-08-28T19:49:52.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6832/3457928808,v1:172.21.15.122:6833/3457928808] up:boot 2024-08-28T19:49:52.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.59:6832/2058471089,v1:172.21.15.59:6834/2058471089] up:boot 2024-08-28T19:49:52.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.59:6833/1541402806,v1:172.21.15.59:6835/1541402806] up:boot 2024-08-28T19:49:52.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6834/501546183,v1:172.21.15.122:6836/501546183] up:boot 2024-08-28T19:49:52.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6835/3277871089,v1:172.21.15.122:6837/3277871089] up:boot 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.59:6836/4029431607,v1:172.21.15.59:6838/4029431607] up:boot 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.59:6837/2170662142,v1:172.21.15.59:6839/2170662142] up:boot 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: mds.? [v2:172.21.15.122:6838/3369295131,v1:172.21.15.122:6839/3369295131] up:boot 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-28T19:49:52.045 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-28T19:49:52.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='mgr.14223 172.21.15.33:0/138560176' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-28T19:49:52.046 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:51 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/139301117' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-28T19:49:52.647 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-28T19:49:52.879 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:52 smithi033 ceph-mon[18549]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-28T19:49:52.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:52 smithi033 ceph-mon[18549]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-28T19:49:52.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:52 smithi033 ceph-mon[18549]: Cluster is now healthy 2024-08-28T19:49:52.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:52 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/139301117' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-28T19:49:52.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:52 smithi033 ceph-mon[18549]: fsmap 12 up:standby 2024-08-28T19:49:52.943 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:52 smithi059 ceph-mon[22052]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-28T19:49:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:52 smithi059 ceph-mon[22052]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-28T19:49:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:52 smithi059 ceph-mon[22052]: Cluster is now healthy 2024-08-28T19:49:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:52 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/139301117' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-28T19:49:53.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:52 smithi059 ceph-mon[22052]: fsmap 12 up:standby 2024-08-28T19:49:53.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:52 smithi122 ceph-mon[22174]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-28T19:49:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:52 smithi122 ceph-mon[22174]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-28T19:49:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:52 smithi122 ceph-mon[22174]: Cluster is now healthy 2024-08-28T19:49:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:52 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/139301117' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-28T19:49:53.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:52 smithi122 ceph-mon[22174]: fsmap 12 up:standby 2024-08-28T19:49:53.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.482+0000 7ff080050640 1 -- 172.21.15.33:0/3084591730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078102820 msgr2=0x7ff078102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:53.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.482+0000 7ff080050640 1 --2- 172.21.15.33:0/3084591730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078102820 0x7ff078102c30 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7ff074009900 tx=0x7ff07402a410 comp rx=0 tx=0).stop 2024-08-28T19:49:53.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.483+0000 7ff080050640 1 -- 172.21.15.33:0/3084591730 shutdown_connections 2024-08-28T19:49:53.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.483+0000 7ff080050640 1 --2- 172.21.15.33:0/3084591730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff078108ab0 0x7ff07810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:53.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.483+0000 7ff080050640 1 --2- 172.21.15.33:0/3084591730 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff078108160 0x7ff078108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:53.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.483+0000 7ff080050640 1 --2- 172.21.15.33:0/3084591730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078102820 0x7ff078102c30 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:53.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.483+0000 7ff080050640 1 -- 172.21.15.33:0/3084591730 >> 172.21.15.33:0/3084591730 conn(0x7ff0780794e0 msgr2=0x7ff0780798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:53.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.483+0000 7ff080050640 1 -- 172.21.15.33:0/3084591730 shutdown_connections 2024-08-28T19:49:53.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.483+0000 7ff080050640 1 -- 172.21.15.33:0/3084591730 wait complete. 2024-08-28T19:49:53.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.483+0000 7ff080050640 1 Processor -- start 2024-08-28T19:49:53.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.483+0000 7ff080050640 1 -- start start 2024-08-28T19:49:53.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff080050640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078102820 0x7ff07810fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:53.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff080050640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff078108160 0x7ff0781102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:53.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff080050640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff078108ab0 0x7ff0781107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff080050640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff078113840 con 0x7ff078102820 2024-08-28T19:49:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff080050640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff0781136c0 con 0x7ff078108ab0 2024-08-28T19:49:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff080050640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7ff0781139c0 con 0x7ff078108160 2024-08-28T19:49:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07ddec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078102820 0x7ff07810fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07ddec640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078102820 0x7ff07810fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47448/0 (socket says 172.21.15.33:47448) 2024-08-28T19:49:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07ddec640 1 -- 172.21.15.33:0/1449822904 learned_addr learned my addr 172.21.15.33:0/1449822904 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07e5ed640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff078108ab0 0x7ff0781107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07d5eb640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff078108160 0x7ff0781102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07ddec640 1 -- 172.21.15.33:0/1449822904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff078108160 msgr2=0x7ff0781102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07ddec640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff078108160 0x7ff0781102b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07ddec640 1 -- 172.21.15.33:0/1449822904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff078108ab0 msgr2=0x7ff0781107f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07ddec640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff078108ab0 0x7ff0781107f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07ddec640 1 -- 172.21.15.33:0/1449822904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0781a8530 con 0x7ff078102820 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07e5ed640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff078108ab0 0x7ff0781107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.484+0000 7ff07ddec640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078102820 0x7ff07810fd70 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7ff074005940 tx=0x7ff0740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.485+0000 7ff06effd640 1 -- 172.21.15.33:0/1449822904 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07403f030 con 0x7ff078102820 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.485+0000 7ff080050640 1 -- 172.21.15.33:0/1449822904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0781a87c0 con 0x7ff078102820 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.485+0000 7ff06effd640 1 -- 172.21.15.33:0/1449822904 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff074003cb0 con 0x7ff078102820 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.485+0000 7ff06effd640 1 -- 172.21.15.33:0/1449822904 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074035070 con 0x7ff078102820 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.485+0000 7ff080050640 1 -- 172.21.15.33:0/1449822904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0781a8cf0 con 0x7ff078102820 2024-08-28T19:49:53.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.486+0000 7ff080050640 1 -- 172.21.15.33:0/1449822904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff078102c30 con 0x7ff078102820 2024-08-28T19:49:53.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.487+0000 7ff06effd640 1 -- 172.21.15.33:0/1449822904 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7ff074042030 con 0x7ff078102820 2024-08-28T19:49:53.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.488+0000 7ff06effd640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff0640b4d20 0x7ff0640b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:53.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.488+0000 7ff07d5eb640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff0640b4d20 0x7ff0640b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:53.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.488+0000 7ff06effd640 1 -- 172.21.15.33:0/1449822904 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9795+0+0 (secure 0 0 0) 0x7ff0741065f0 con 0x7ff078102820 2024-08-28T19:49:53.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.488+0000 7ff07d5eb640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff0640b4d20 0x7ff0640b7230 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff068005fd0 tx=0x7ff068005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:53.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.491+0000 7ff06effd640 1 -- 172.21.15.33:0/1449822904 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff0740ccee0 con 0x7ff078102820 2024-08-28T19:49:53.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:53.682+0000 7ff080050640 1 -- 172.21.15.33:0/1449822904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff078111070 con 0x7ff078102820 2024-08-28T19:49:53.970 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:53 smithi033 ceph-mon[18549]: pgmap v888: 129 pgs: 129 active+clean; 30 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 614 B/s wr, 10 op/s 2024-08-28T19:49:54.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:53 smithi059 ceph-mon[22052]: pgmap v888: 129 pgs: 129 active+clean; 30 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 614 B/s wr, 10 op/s 2024-08-28T19:49:54.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:53 smithi122 ceph-mon[22174]: pgmap v888: 129 pgs: 129 active+clean; 30 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 614 B/s wr, 10 op/s 2024-08-28T19:49:54.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.636+0000 7ff06effd640 1 -- 172.21.15.33:0/1449822904 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v108) ==== 181+0+0 (secure 0 0 0) 0x7ff0740d5420 con 0x7ff078102820 2024-08-28T19:49:54.637 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-08-28T19:49:54.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 -- 172.21.15.33:0/1449822904 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff0640b4d20 msgr2=0x7ff0640b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:54.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff0640b4d20 0x7ff0640b7230 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff068005fd0 tx=0x7ff068005850 comp rx=0 tx=0).stop 2024-08-28T19:49:54.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 -- 172.21.15.33:0/1449822904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078102820 msgr2=0x7ff07810fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:54.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078102820 0x7ff07810fd70 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7ff074005940 tx=0x7ff0740042f0 comp rx=0 tx=0).stop 2024-08-28T19:49:54.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 -- 172.21.15.33:0/1449822904 shutdown_connections 2024-08-28T19:49:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff078108ab0 0x7ff0781107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7ff0640b4d20 0x7ff0640b7230 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff078108160 0x7ff0781102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 --2- 172.21.15.33:0/1449822904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff078102820 0x7ff07810fd70 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:54.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 -- 172.21.15.33:0/1449822904 >> 172.21.15.33:0/1449822904 conn(0x7ff0780794e0 msgr2=0x7ff078101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.640+0000 7ff080050640 1 -- 172.21.15.33:0/1449822904 shutdown_connections 2024-08-28T19:49:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:54.641+0000 7ff080050640 1 -- 172.21.15.33:0/1449822904 wait complete. 2024-08-28T19:49:55.017 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:54 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1449822904' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T19:49:55.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:54 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1449822904' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T19:49:55.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:54 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1449822904' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T19:49:55.388 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-28T19:49:55.652 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:55.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:55 smithi033 ceph-mon[18549]: pgmap v889: 129 pgs: 129 active+clean; 30 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 614 B/s wr, 8 op/s 2024-08-28T19:49:55.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:55 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/1449822904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T19:49:55.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:55 smithi033 ceph-mon[18549]: osdmap e108: 12 total, 12 up, 12 in 2024-08-28T19:49:56.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:55 smithi059 ceph-mon[22052]: pgmap v889: 129 pgs: 129 active+clean; 30 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 614 B/s wr, 8 op/s 2024-08-28T19:49:56.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:55 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/1449822904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T19:49:56.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:55 smithi059 ceph-mon[22052]: osdmap e108: 12 total, 12 up, 12 in 2024-08-28T19:49:56.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:55 smithi122 ceph-mon[22174]: pgmap v889: 129 pgs: 129 active+clean; 30 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 614 B/s wr, 8 op/s 2024-08-28T19:49:56.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:55 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/1449822904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T19:49:56.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:55 smithi122 ceph-mon[22174]: osdmap e108: 12 total, 12 up, 12 in 2024-08-28T19:49:56.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.186+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/4216423012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e810dc50 msgr2=0x7fc3e8110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.186+0000 7fc3ef1f9640 1 --2- 172.21.15.33:0/4216423012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e810dc50 0x7fc3e8110120 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009ca0 tx=0x7fc3e002a8c0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.187+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/4216423012 shutdown_connections 2024-08-28T19:49:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.187+0000 7fc3ef1f9640 1 --2- 172.21.15.33:0/4216423012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e810dc50 0x7fc3e8110120 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.187+0000 7fc3ef1f9640 1 --2- 172.21.15.33:0/4216423012 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3e81050d0 0x7fc3e810d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.187+0000 7fc3ef1f9640 1 --2- 172.21.15.33:0/4216423012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81046a0 0x7fc3e8104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.187+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/4216423012 >> 172.21.15.33:0/4216423012 conn(0x7fc3e8079510 msgr2=0x7fc3e8079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.187+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/4216423012 shutdown_connections 2024-08-28T19:49:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.187+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/4216423012 wait complete. 2024-08-28T19:49:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.187+0000 7fc3ef1f9640 1 Processor -- start 2024-08-28T19:49:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.187+0000 7fc3ef1f9640 1 -- start start 2024-08-28T19:49:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ef1f9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e81046a0 0x7fc3e819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ef1f9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81050d0 0x7fc3e819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ef1f9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3e810dc50 0x7fc3e819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ef1f9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e8113890 con 0x7fc3e81046a0 2024-08-28T19:49:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ef1f9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e8113710 con 0x7fc3e81050d0 2024-08-28T19:49:56.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ef1f9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e8113a10 con 0x7fc3e810dc50 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ecf95640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e81046a0 0x7fc3e819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ecf95640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e81046a0 0x7fc3e819a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47470/0 (socket says 172.21.15.33:47470) 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ecf95640 1 -- 172.21.15.33:0/340875712 learned_addr learned my addr 172.21.15.33:0/340875712 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3e7fff640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81050d0 0x7fc3e819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ed796640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3e810dc50 0x7fc3e819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ecf95640 1 -- 172.21.15.33:0/340875712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3e810dc50 msgr2=0x7fc3e819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ecf95640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3e810dc50 0x7fc3e819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ecf95640 1 -- 172.21.15.33:0/340875712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81050d0 msgr2=0x7fc3e819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ecf95640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81050d0 0x7fc3e819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ecf95640 1 -- 172.21.15.33:0/340875712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e81a0150 con 0x7fc3e81046a0 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3e7fff640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81050d0 0x7fc3e819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ecf95640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e81046a0 0x7fc3e819a2a0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800d950 tx=0x7fc3d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:56.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3e5ffb640 1 -- 172.21.15.33:0/340875712 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8017070 con 0x7fc3e81046a0 2024-08-28T19:49:56.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3e5ffb640 1 -- 172.21.15.33:0/340875712 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3d8009c30 con 0x7fc3e81046a0 2024-08-28T19:49:56.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3e5ffb640 1 -- 172.21.15.33:0/340875712 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800f620 con 0x7fc3e81046a0 2024-08-28T19:49:56.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.188+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/340875712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e81a0440 con 0x7fc3e81046a0 2024-08-28T19:49:56.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.189+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/340875712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e81a6c60 con 0x7fc3e81046a0 2024-08-28T19:49:56.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.190+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/340875712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e806bf60 con 0x7fc3e81046a0 2024-08-28T19:49:56.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.191+0000 7fc3e5ffb640 1 -- 172.21.15.33:0/340875712 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7fc3d8010460 con 0x7fc3e81046a0 2024-08-28T19:49:56.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.192+0000 7fc3e5ffb640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3d00b4d50 0x7fc3d00b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:56.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.192+0000 7fc3e7fff640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3d00b4d50 0x7fc3d00b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:56.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.192+0000 7fc3e5ffb640 1 -- 172.21.15.33:0/340875712 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9299+0+0 (secure 0 0 0) 0x7fc3d80e5500 con 0x7fc3e81046a0 2024-08-28T19:49:56.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.192+0000 7fc3e7fff640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3d00b4d50 0x7fc3d00b7260 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc005e10 tx=0x7fc3dc005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:56.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.196+0000 7fc3e5ffb640 1 -- 172.21.15.33:0/340875712 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc3d80abf80 con 0x7fc3e81046a0 2024-08-28T19:49:56.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.383+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/340875712 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc3e8104ab0 con 0x7fc3e81046a0 2024-08-28T19:49:56.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.643+0000 7fc3e5ffb640 1 -- 172.21.15.33:0/340875712 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v109) ==== 169+0+0 (secure 0 0 0) 0x7fc3d8009de0 con 0x7fc3e81046a0 2024-08-28T19:49:56.644 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-08-28T19:49:56.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.647+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/340875712 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3d00b4d50 msgr2=0x7fc3d00b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:56.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.647+0000 7fc3ef1f9640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3d00b4d50 0x7fc3d00b7260 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc005e10 tx=0x7fc3dc005da0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.647+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/340875712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e81046a0 msgr2=0x7fc3e819a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:56.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.647+0000 7fc3ef1f9640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e81046a0 0x7fc3e819a2a0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800d950 tx=0x7fc3d800de10 comp rx=0 tx=0).stop 2024-08-28T19:49:56.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.647+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/340875712 shutdown_connections 2024-08-28T19:49:56.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.647+0000 7fc3ef1f9640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7fc3d00b4d50 0x7fc3d00b7260 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.647+0000 7fc3ef1f9640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc3e810dc50 0x7fc3e819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.647+0000 7fc3ef1f9640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81050d0 0x7fc3e819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.647+0000 7fc3ef1f9640 1 --2- 172.21.15.33:0/340875712 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e81046a0 0x7fc3e819a2a0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:56.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.647+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/340875712 >> 172.21.15.33:0/340875712 conn(0x7fc3e8079510 msgr2=0x7fc3e8106700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:56.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.648+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/340875712 shutdown_connections 2024-08-28T19:49:56.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:56.648+0000 7fc3ef1f9640 1 -- 172.21.15.33:0/340875712 wait complete. 2024-08-28T19:49:56.944 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:56 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/340875712' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T19:49:57.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:56 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/340875712' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T19:49:57.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:56 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/340875712' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T19:49:57.389 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-28T19:49:57.666 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/mon.a/config 2024-08-28T19:49:57.921 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:57 smithi033 ceph-mon[18549]: pgmap v891: 97 pgs: 97 active+clean; 577 KiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:49:57.921 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:57 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/340875712' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T19:49:57.921 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:57 smithi033 ceph-mon[18549]: osdmap e109: 12 total, 12 up, 12 in 2024-08-28T19:49:58.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:57 smithi059 ceph-mon[22052]: pgmap v891: 97 pgs: 97 active+clean; 577 KiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:49:58.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:57 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/340875712' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T19:49:58.033 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:57 smithi059 ceph-mon[22052]: osdmap e109: 12 total, 12 up, 12 in 2024-08-28T19:49:58.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:57 smithi122 ceph-mon[22174]: pgmap v891: 97 pgs: 97 active+clean; 577 KiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:49:58.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:57 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/340875712' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T19:49:58.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:57 smithi122 ceph-mon[22174]: osdmap e109: 12 total, 12 up, 12 in 2024-08-28T19:49:58.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.186+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2430025411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff0810dbf0 msgr2=0x7eff081100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:58.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.186+0000 7eff0f2ee640 1 --2- 172.21.15.33:0/2430025411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff0810dbf0 0x7eff081100c0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7eff00009900 tx=0x7eff0002a410 comp rx=0 tx=0).stop 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.186+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2430025411 shutdown_connections 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.186+0000 7eff0f2ee640 1 --2- 172.21.15.33:0/2430025411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff0810dbf0 0x7eff081100c0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.186+0000 7eff0f2ee640 1 --2- 172.21.15.33:0/2430025411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff08105110 0x7eff0810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.186+0000 7eff0f2ee640 1 --2- 172.21.15.33:0/2430025411 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff081047c0 0x7eff08104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.186+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2430025411 >> 172.21.15.33:0/2430025411 conn(0x7eff08079470 msgr2=0x7eff08079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.186+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2430025411 shutdown_connections 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.186+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2430025411 wait complete. 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.187+0000 7eff0f2ee640 1 Processor -- start 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.187+0000 7eff0f2ee640 1 -- start start 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.187+0000 7eff0f2ee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff081047c0 0x7eff0819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.187+0000 7eff0f2ee640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff08105110 0x7eff0819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:58.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.187+0000 7eff0f2ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff0810dbf0 0x7eff0819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.187+0000 7eff0f2ee640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7eff08113840 con 0x7eff081047c0 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.187+0000 7eff0f2ee640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff081136c0 con 0x7eff0810dbf0 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.187+0000 7eff0f2ee640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 -- 0x7eff081139c0 con 0x7eff08105110 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d08a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff081047c0 0x7eff0819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d08a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff081047c0 0x7eff0819a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47492/0 (socket says 172.21.15.33:47492) 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d08a640 1 -- 172.21.15.33:0/2334617751 learned_addr learned my addr 172.21.15.33:0/2334617751 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0c889640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff08105110 0x7eff0819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d88b640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff0810dbf0 0x7eff0819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d08a640 1 -- 172.21.15.33:0/2334617751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff08105110 msgr2=0x7eff0819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d08a640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff08105110 0x7eff0819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d08a640 1 -- 172.21.15.33:0/2334617751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff0810dbf0 msgr2=0x7eff0819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d08a640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff0810dbf0 0x7eff0819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:58.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d08a640 1 -- 172.21.15.33:0/2334617751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff081a0120 con 0x7eff081047c0 2024-08-28T19:49:58.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d88b640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff0810dbf0 0x7eff0819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-28T19:49:58.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0d08a640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff081047c0 0x7eff0819a1b0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7efef800db80 tx=0x7efef800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:58.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff067fc640 1 -- 172.21.15.33:0/2334617751 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8017070 con 0x7eff081047c0 2024-08-28T19:49:58.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff067fc640 1 -- 172.21.15.33:0/2334617751 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef8003b70 con 0x7eff081047c0 2024-08-28T19:49:58.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2334617751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff081a0410 con 0x7eff081047c0 2024-08-28T19:49:58.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff067fc640 1 -- 172.21.15.33:0/2334617751 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef80106c0 con 0x7eff081047c0 2024-08-28T19:49:58.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.188+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2334617751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff081a6b70 con 0x7eff081047c0 2024-08-28T19:49:58.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.190+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2334617751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff0806bf90 con 0x7eff081047c0 2024-08-28T19:49:58.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.192+0000 7eff067fc640 1 -- 172.21.15.33:0/2334617751 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) ==== 152708+0+0 (secure 0 0 0) 0x7efef8004020 con 0x7eff081047c0 2024-08-28T19:49:58.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.193+0000 7eff067fc640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef00b4d20 0x7efef00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-28T19:49:58.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.193+0000 7eff0c889640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef00b4d20 0x7efef00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-28T19:49:58.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.193+0000 7eff067fc640 1 -- 172.21.15.33:0/2334617751 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 8711+0+0 (secure 0 0 0) 0x7efef80e5a30 con 0x7eff081047c0 2024-08-28T19:49:58.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.193+0000 7eff0c889640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef00b4d20 0x7efef00b7230 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7eff080fffc0 tx=0x7efefc00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-28T19:49:58.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.196+0000 7eff067fc640 1 -- 172.21.15.33:0/2334617751 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efef80ac780 con 0x7eff081047c0 2024-08-28T19:49:58.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.383+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2334617751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7eff08104bd0 con 0x7eff081047c0 2024-08-28T19:49:58.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.654+0000 7eff067fc640 1 -- 172.21.15.33:0/2334617751 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v110) ==== 178+0+0 (secure 0 0 0) 0x7efef80ac080 con 0x7eff081047c0 2024-08-28T19:49:58.656 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data_ec' removed 2024-08-28T19:49:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2334617751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef00b4d20 msgr2=0x7efef00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef00b4d20 0x7efef00b7230 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7eff080fffc0 tx=0x7efefc00b410 comp rx=0 tx=0).stop 2024-08-28T19:49:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2334617751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff081047c0 msgr2=0x7eff0819a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-28T19:49:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff081047c0 0x7eff0819a1b0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7efef800db80 tx=0x7efef800b630 comp rx=0 tx=0).stop 2024-08-28T19:49:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2334617751 shutdown_connections 2024-08-28T19:49:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff0810dbf0 0x7eff0819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.33:6800/3015249273,v1:172.21.15.33:6801/3015249273] conn(0x7efef00b4d20 0x7efef00b7230 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff08105110 0x7eff0819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 --2- 172.21.15.33:0/2334617751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff081047c0 0x7eff0819a1b0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-28T19:49:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2334617751 >> 172.21.15.33:0/2334617751 conn(0x7eff08079470 msgr2=0x7eff081055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-28T19:49:58.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2334617751 shutdown_connections 2024-08-28T19:49:58.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-08-28T19:49:58.657+0000 7eff0f2ee640 1 -- 172.21.15.33:0/2334617751 wait complete. 2024-08-28T19:49:59.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:58 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2334617751' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T19:49:59.032 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:58 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2334617751' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T19:49:59.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:58 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2334617751' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-28T19:49:59.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T19:49:59.499 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T19:49:59.533 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T19:49:59.567 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-28T19:49:59.567 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-28T19:49:59.582 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-28T19:49:59.600 DEBUG:teuthology.orchestra.run.smithi122:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-28T19:49:59.624 INFO:tasks.cephadm:Stopping all daemons... 2024-08-28T19:49:59.624 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-28T19:49:59.624 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.a 2024-08-28T19:49:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:59 smithi059 ceph-mon[22052]: pgmap v893: 33 pgs: 33 active+clean; 577 KiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:49:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:59 smithi059 ceph-mon[22052]: from='client.? 172.21.15.33:0/2334617751' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T19:49:59.783 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:49:59 smithi059 ceph-mon[22052]: osdmap e110: 12 total, 12 up, 12 in 2024-08-28T19:49:59.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:59 smithi033 ceph-mon[18549]: pgmap v893: 33 pgs: 33 active+clean; 577 KiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:49:59.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:59 smithi033 ceph-mon[18549]: from='client.? 172.21.15.33:0/2334617751' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T19:49:59.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:59 smithi033 ceph-mon[18549]: osdmap e110: 12 total, 12 up, 12 in 2024-08-28T19:49:59.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:59 smithi033 systemd[1]: Stopping Ceph mon.a for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:00.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:59 smithi122 ceph-mon[22174]: pgmap v893: 33 pgs: 33 active+clean; 577 KiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-28T19:50:00.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:59 smithi122 ceph-mon[22174]: from='client.? 172.21.15.33:0/2334617751' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-28T19:50:00.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:49:59 smithi122 ceph-mon[22174]: osdmap e110: 12 total, 12 up, 12 in 2024-08-28T19:50:00.357 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:59 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a[18545]: 2024-08-28T19:49:59.926+0000 7f09acb9c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:00.357 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:49:59 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a[18545]: 2024-08-28T19:49:59.926+0000 7f09acb9c640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-28T19:50:00.357 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:50:00 smithi033 podman[122697]: 2024-08-28 19:50:00.151342868 +0000 UTC m=+0.328986173 container died 35ddce2b1800f9567bb54a228711bd7eea7f7c5f3b14be89fbc33bb9b405167e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-28T19:50:00.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:50:00 smithi033 podman[122697]: 2024-08-28 19:50:00.543613742 +0000 UTC m=+0.721257002 container cleanup 35ddce2b1800f9567bb54a228711bd7eea7f7c5f3b14be89fbc33bb9b405167e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-28T19:50:00.630 INFO:journalctl@ceph.mon.a.smithi033.stdout:Aug 28 19:50:00 smithi033 bash[122697]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-a 2024-08-28T19:50:00.630 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:50:00.391+0000 7feaead51640 -1 client.14235: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-08-28T19:50:00.630 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:50:00.392+0000 7feaead51640 -1 client.14235: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-08-28T19:50:00.630 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: Exception in thread Thread-22: 2024-08-28T19:50:00.630 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: Traceback (most recent call last): 2024-08-28T19:50:00.631 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/threading.py", line 980, in _bootstrap_inner 2024-08-28T19:50:00.631 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self.run() 2024-08-28T19:50:00.631 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/lib64/python3.9/threading.py", line 1306, in run 2024-08-28T19:50:00.631 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self.function(*self.args, **self.kwargs) 2024-08-28T19:50:00.631 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: File "/usr/share/ceph/mgr/snap_schedule/fs/schedule_client.py", line 355, in create_scheduled_snapshot 2024-08-28T19:50:00.631 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: self.prune_snapshots(sched) 2024-08-28T19:50:00.631 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: UnboundLocalError: local variable 'sched' referenced before assignment 2024-08-28T19:50:00.966 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.a.service' 2024-08-28T19:50:01.010 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:01.011 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-28T19:50:01.011 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-28T19:50:01.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.b 2024-08-28T19:50:01.396 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:50:01 smithi059 systemd[1]: Stopping Ceph mon.b for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:01.722 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:50:01 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-b[22048]: 2024-08-28T19:50:01.394+0000 7fd7de0d9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:01.722 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:50:01 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-b[22048]: 2024-08-28T19:50:01.394+0000 7fd7de0d9640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-28T19:50:01.722 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:50:01 smithi059 podman[58344]: 2024-08-28 19:50:01.436230578 +0000 UTC m=+0.222148711 container died 2a861e19a77454b6fb0914fb51ed3d17735370621f6e6054b2ff2c3ff03dc3a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-28T19:50:01.998 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:50:01 smithi059 podman[58344]: 2024-08-28 19:50:01.812668391 +0000 UTC m=+0.598586573 container cleanup 2a861e19a77454b6fb0914fb51ed3d17735370621f6e6054b2ff2c3ff03dc3a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-28T19:50:01.998 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:50:01 smithi059 bash[58344]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-b 2024-08-28T19:50:02.249 INFO:journalctl@ceph.mon.b.smithi059.stdout:Aug 28 19:50:01 smithi059 podman[58356]: 2024-08-28 19:50:01.997589316 +0000 UTC m=+0.560989935 container remove 2a861e19a77454b6fb0914fb51ed3d17735370621f6e6054b2ff2c3ff03dc3a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-b, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-28T19:50:02.252 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.b.service' 2024-08-28T19:50:02.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:02.302 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-28T19:50:02.302 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-28T19:50:02.302 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.c 2024-08-28T19:50:02.626 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:50:02 smithi122 systemd[1]: Stopping Ceph mon.c for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:03.043 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:50:02 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-c[22169]: 2024-08-28T19:50:02.624+0000 7f00b0c3d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:03.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:50:02 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-c[22169]: 2024-08-28T19:50:02.624+0000 7f00b0c3d640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-28T19:50:03.044 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:50:02 smithi122 podman[59974]: 2024-08-28 19:50:02.859669652 +0000 UTC m=+0.356961990 container died a3d815d81d0f19bade5996e36f5898ca5a979e08a49140cb6ca90b2140b6be2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-08-28T19:50:03.495 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:50:03 smithi122 podman[59974]: 2024-08-28 19:50:03.259241632 +0000 UTC m=+0.756533959 container cleanup a3d815d81d0f19bade5996e36f5898ca5a979e08a49140cb6ca90b2140b6be2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-28T19:50:03.495 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:50:03 smithi122 bash[59974]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-c 2024-08-28T19:50:03.738 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.c.service' 2024-08-28T19:50:03.761 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:50:03 smithi122 podman[59986]: 2024-08-28 19:50:03.494839045 +0000 UTC m=+0.633462256 container remove a3d815d81d0f19bade5996e36f5898ca5a979e08a49140cb6ca90b2140b6be2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-28T19:50:03.974 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:50:03 smithi122 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.c.service: Deactivated successfully. 2024-08-28T19:50:03.974 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:50:03 smithi122 systemd[1]: Stopped Ceph mon.c for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:50:03.974 INFO:journalctl@ceph.mon.c.smithi122.stdout:Aug 28 19:50:03 smithi122 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mon.c.service: Consumed 16.732s CPU time. 2024-08-28T19:50:03.976 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:03.976 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-28T19:50:03.977 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-28T19:50:03.977 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.x 2024-08-28T19:50:04.283 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:04 smithi033 systemd[1]: Stopping Ceph mgr.x for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:04.626 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:04 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x[18777]: 2024-08-28T19:50:04.282+0000 7feb9f933640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:04.626 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:04 smithi033 podman[122818]: 2024-08-28 19:50:04.323543031 +0000 UTC m=+0.149188768 container died bb24acc153bbd360a38ae44807b79e4ea364cb18feed854ba4db43b381fc15f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:50:04.879 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:04 smithi033 podman[122818]: 2024-08-28 19:50:04.733129375 +0000 UTC m=+0.558775107 container cleanup bb24acc153bbd360a38ae44807b79e4ea364cb18feed854ba4db43b381fc15f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-08-28T19:50:04.879 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:04 smithi033 bash[122818]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x 2024-08-28T19:50:05.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.x.service' 2024-08-28T19:50:05.282 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:05 smithi033 podman[122830]: 2024-08-28 19:50:05.002209108 +0000 UTC m=+0.681505432 container remove bb24acc153bbd360a38ae44807b79e4ea364cb18feed854ba4db43b381fc15f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-28T19:50:05.283 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:05 smithi033 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.x.service: Deactivated successfully. 2024-08-28T19:50:05.283 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:05 smithi033 systemd[1]: Stopped Ceph mgr.x for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:50:05.283 INFO:journalctl@ceph.mgr.x.smithi033.stdout:Aug 28 19:50:05 smithi033 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.x.service: Consumed 1min 2.420s CPU time. 2024-08-28T19:50:05.296 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:05.296 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-28T19:50:05.296 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-28T19:50:05.296 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.y 2024-08-28T19:50:05.647 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:50:05 smithi059 systemd[1]: Stopping Ceph mgr.y for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:05.920 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:50:05 smithi059 podman[58468]: 2024-08-28 19:50:05.646573952 +0000 UTC m=+0.144032583 container died 9ffbb7fe24ac6b05fb5b75f4c387213da9c47bf91e34c26e4de56e3d78d3546e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-28T19:50:06.282 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:50:06 smithi059 podman[58468]: 2024-08-28 19:50:06.043705681 +0000 UTC m=+0.541164321 container cleanup 9ffbb7fe24ac6b05fb5b75f4c387213da9c47bf91e34c26e4de56e3d78d3546e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-28T19:50:06.283 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Aug 28 19:50:06 smithi059 bash[58468]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-y 2024-08-28T19:50:06.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.y.service' 2024-08-28T19:50:06.493 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:06.493 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-28T19:50:06.493 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-28T19:50:06.493 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.z 2024-08-28T19:50:06.793 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Aug 28 19:50:06 smithi122 systemd[1]: Stopping Ceph mgr.z for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:07.100 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Aug 28 19:50:06 smithi122 podman[60096]: 2024-08-28 19:50:06.818794636 +0000 UTC m=+0.133278051 container died 9fcb43ec1ad25926d12334e2906887a18916dc4e3695195443b2d24e22ea4143 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-z, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-28T19:50:07.468 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Aug 28 19:50:07 smithi122 podman[60096]: 2024-08-28 19:50:07.190806683 +0000 UTC m=+0.505290098 container cleanup 9fcb43ec1ad25926d12334e2906887a18916dc4e3695195443b2d24e22ea4143 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-28T19:50:07.469 INFO:journalctl@ceph.mgr.z.smithi122.stdout:Aug 28 19:50:07 smithi122 bash[60096]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mgr-z 2024-08-28T19:50:07.610 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mgr.z.service' 2024-08-28T19:50:07.646 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:07.646 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-28T19:50:07.647 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-28T19:50:07.647 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.0 2024-08-28T19:50:07.981 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:07 smithi033 systemd[1]: Stopping Ceph osd.0 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:08.379 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:08 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0[37223]: 2024-08-28T19:50:08.038+0000 7f051d1d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:08.380 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:08 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0[37223]: 2024-08-28T19:50:08.038+0000 7f051d1d0640 -1 osd.0 110 *** Got signal Terminated *** 2024-08-28T19:50:08.380 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:08 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0[37223]: 2024-08-28T19:50:08.038+0000 7f051d1d0640 -1 osd.0 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:50:13.807 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:13 smithi033 podman[122938]: 2024-08-28 19:50:13.528613551 +0000 UTC m=+5.683309323 container died a19dd24f046ca977c8c892553d03475aacbe83f01c4fcc0810a7581196f76416 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:50:14.129 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:14 smithi033 podman[122938]: 2024-08-28 19:50:14.006356738 +0000 UTC m=+6.161052497 container cleanup a19dd24f046ca977c8c892553d03475aacbe83f01c4fcc0810a7581196f76416 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:50:14.130 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:14 smithi033 bash[122938]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0 2024-08-28T19:50:14.785 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:14 smithi033 podman[122953]: 2024-08-28 19:50:14.400490692 +0000 UTC m=+0.866800759 container remove a19dd24f046ca977c8c892553d03475aacbe83f01c4fcc0810a7581196f76416 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-28T19:50:15.080 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:14 smithi033 podman[123046]: 2024-08-28 19:50:14.784630412 +0000 UTC m=+0.108322148 container create 8280d4260d49e98d719fa448b8f6cb278823b299e6d4684e624935b6e5871f55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:50:15.080 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:14 smithi033 podman[123046]: 2024-08-28 19:50:14.692636642 +0000 UTC m=+0.016328388 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:50:15.380 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:15 smithi033 podman[123046]: 2024-08-28 19:50:15.079630099 +0000 UTC m=+0.403321850 container init 8280d4260d49e98d719fa448b8f6cb278823b299e6d4684e624935b6e5871f55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:50:15.380 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:15 smithi033 podman[123046]: 2024-08-28 19:50:15.083919368 +0000 UTC m=+0.407611105 container start 8280d4260d49e98d719fa448b8f6cb278823b299e6d4684e624935b6e5871f55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-28T19:50:15.380 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:15 smithi033 podman[123046]: 2024-08-28 19:50:15.171129132 +0000 UTC m=+0.494820871 container attach 8280d4260d49e98d719fa448b8f6cb278823b299e6d4684e624935b6e5871f55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:50:15.381 INFO:journalctl@ceph.osd.0.smithi033.stdout:Aug 28 19:50:15 smithi033 podman[123046]: 2024-08-28 19:50:15.273866617 +0000 UTC m=+0.597558358 container died 8280d4260d49e98d719fa448b8f6cb278823b299e6d4684e624935b6e5871f55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-28T19:50:15.999 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.0.service' 2024-08-28T19:50:16.037 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:16.037 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-28T19:50:16.038 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-28T19:50:16.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.1 2024-08-28T19:50:16.358 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:16 smithi059 systemd[1]: Stopping Ceph osd.1 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:16.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:16 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1[27610]: 2024-08-28T19:50:16.356+0000 7fe183ced640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:16.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:16 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1[27610]: 2024-08-28T19:50:16.356+0000 7fe183ced640 -1 osd.1 110 *** Got signal Terminated *** 2024-08-28T19:50:16.783 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:16 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1[27610]: 2024-08-28T19:50:16.356+0000 7fe183ced640 -1 osd.1 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:50:22.033 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:21 smithi059 podman[58605]: 2024-08-28 19:50:21.779240689 +0000 UTC m=+5.536645706 container died acd1b7d7de3852a64e8f8daeb53b397933dd099857a085894ab4e7a85118c23f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:50:22.533 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:22 smithi059 podman[58605]: 2024-08-28 19:50:22.25746814 +0000 UTC m=+6.014873149 container cleanup acd1b7d7de3852a64e8f8daeb53b397933dd099857a085894ab4e7a85118c23f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:50:22.533 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:22 smithi059 bash[58605]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1 2024-08-28T19:50:22.860 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:22 smithi059 podman[58624]: 2024-08-28 19:50:22.551022297 +0000 UTC m=+0.763041292 container remove acd1b7d7de3852a64e8f8daeb53b397933dd099857a085894ab4e7a85118c23f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:50:23.188 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:22 smithi059 podman[58711]: 2024-08-28 19:50:22.86006254 +0000 UTC m=+0.110556937 container create e5bb5eb961a2d80be753a1f8dc829875faec0d290d07a10542ea12bf1666e34f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:50:23.188 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:22 smithi059 podman[58711]: 2024-08-28 19:50:22.765258105 +0000 UTC m=+0.015752496 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:50:23.188 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:23 smithi059 podman[58711]: 2024-08-28 19:50:23.087838784 +0000 UTC m=+0.338333175 container init e5bb5eb961a2d80be753a1f8dc829875faec0d290d07a10542ea12bf1666e34f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-28T19:50:23.188 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:23 smithi059 podman[58711]: 2024-08-28 19:50:23.091158821 +0000 UTC m=+0.341653214 container start e5bb5eb961a2d80be753a1f8dc829875faec0d290d07a10542ea12bf1666e34f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:50:23.188 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:23 smithi059 podman[58711]: 2024-08-28 19:50:23.18788481 +0000 UTC m=+0.438379211 container attach e5bb5eb961a2d80be753a1f8dc829875faec0d290d07a10542ea12bf1666e34f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-28T19:50:23.469 INFO:journalctl@ceph.osd.1.smithi059.stdout:Aug 28 19:50:23 smithi059 podman[58711]: 2024-08-28 19:50:23.292449724 +0000 UTC m=+0.542944112 container died e5bb5eb961a2d80be753a1f8dc829875faec0d290d07a10542ea12bf1666e34f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-1-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:50:23.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.1.service' 2024-08-28T19:50:23.881 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:23.882 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-28T19:50:23.882 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-28T19:50:23.882 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.2 2024-08-28T19:50:24.263 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:23 smithi122 systemd[1]: Stopping Ceph osd.2 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:24.543 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2[28490]: 2024-08-28T19:50:24.262+0000 7fe9d0bff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:24.543 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2[28490]: 2024-08-28T19:50:24.262+0000 7fe9d0bff640 -1 osd.2 110 *** Got signal Terminated *** 2024-08-28T19:50:24.544 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2[28490]: 2024-08-28T19:50:24.262+0000 7fe9d0bff640 -1 osd.2 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:50:30.023 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:29 smithi122 podman[60236]: 2024-08-28 19:50:29.743317705 +0000 UTC m=+5.656361228 container died 97edf6428321ab8ad81ac4ed5256794bf51b653eb11781f4a3800d98841d4355 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1) 2024-08-28T19:50:30.293 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:30 smithi122 podman[60236]: 2024-08-28 19:50:30.122052144 +0000 UTC m=+6.035095668 container cleanup 97edf6428321ab8ad81ac4ed5256794bf51b653eb11781f4a3800d98841d4355 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-28T19:50:30.293 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:30 smithi122 bash[60236]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2 2024-08-28T19:50:30.740 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:30 smithi122 podman[60255]: 2024-08-28 19:50:30.390191508 +0000 UTC m=+0.644026955 container remove 97edf6428321ab8ad81ac4ed5256794bf51b653eb11781f4a3800d98841d4355 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-28T19:50:31.028 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:30 smithi122 podman[60340]: 2024-08-28 19:50:30.642911814 +0000 UTC m=+0.015936391 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:50:31.028 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:30 smithi122 podman[60340]: 2024-08-28 19:50:30.76796035 +0000 UTC m=+0.140984916 container create e8eaada9d38715eda4d2eeb2700cc3fee495db4f2f7ce87474d90d842a7ad1b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1) 2024-08-28T19:50:31.028 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:31 smithi122 podman[60340]: 2024-08-28 19:50:31.027582775 +0000 UTC m=+0.400607342 container init e8eaada9d38715eda4d2eeb2700cc3fee495db4f2f7ce87474d90d842a7ad1b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-28T19:50:31.293 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:31 smithi122 podman[60340]: 2024-08-28 19:50:31.03116758 +0000 UTC m=+0.404192146 container start e8eaada9d38715eda4d2eeb2700cc3fee495db4f2f7ce87474d90d842a7ad1b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-28T19:50:31.294 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:31 smithi122 podman[60340]: 2024-08-28 19:50:31.127796044 +0000 UTC m=+0.500820616 container attach e8eaada9d38715eda4d2eeb2700cc3fee495db4f2f7ce87474d90d842a7ad1b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:50:31.294 INFO:journalctl@ceph.osd.2.smithi122.stdout:Aug 28 19:50:31 smithi122 podman[60340]: 2024-08-28 19:50:31.228873764 +0000 UTC m=+0.601898337 container died e8eaada9d38715eda4d2eeb2700cc3fee495db4f2f7ce87474d90d842a7ad1b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-28T19:50:31.860 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.2.service' 2024-08-28T19:50:31.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:31.898 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-28T19:50:31.898 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-28T19:50:31.898 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.3 2024-08-28T19:50:32.205 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:31 smithi033 systemd[1]: Stopping Ceph osd.3 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:32.630 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:32 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3[43973]: 2024-08-28T19:50:32.202+0000 7f883f083640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:32.630 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:32 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3[43973]: 2024-08-28T19:50:32.202+0000 7f883f083640 -1 osd.3 110 *** Got signal Terminated *** 2024-08-28T19:50:32.630 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:32 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3[43973]: 2024-08-28T19:50:32.202+0000 7f883f083640 -1 osd.3 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:50:35.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:34 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:34.737+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:36.043 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:35.780+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:36.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:35.884+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:36.585 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:36 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:36.307+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:37.293 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:36 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:36.827+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:37.294 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:36 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:36.933+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:37.783 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:37 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:37.335+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:37.864 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:37 smithi033 podman[123160]: 2024-08-28 19:50:37.537673319 +0000 UTC m=+5.442782673 container died 256fae48bfee9dd61f96cd7bee6d37cf0339ee93fc2d322a983c52007737d9d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-28T19:50:38.043 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:37 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:37.781+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:38.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:37 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:37.898+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:38.130 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:38 smithi033 podman[123160]: 2024-08-28 19:50:38.081534416 +0000 UTC m=+5.986643769 container cleanup 256fae48bfee9dd61f96cd7bee6d37cf0339ee93fc2d322a983c52007737d9d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3, ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-28T19:50:38.130 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:38 smithi033 bash[123160]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3 2024-08-28T19:50:38.553 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:38 smithi033 podman[123176]: 2024-08-28 19:50:38.291676228 +0000 UTC m=+0.747852690 container remove 256fae48bfee9dd61f96cd7bee6d37cf0339ee93fc2d322a983c52007737d9d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-28T19:50:38.782 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:38 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:38.292+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:38.859 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:38 smithi033 podman[123266]: 2024-08-28 19:50:38.611365542 +0000 UTC m=+0.015934810 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:50:38.859 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:38 smithi033 podman[123266]: 2024-08-28 19:50:38.742668501 +0000 UTC m=+0.147237799 container create 565a057cf3f01240c59bd0515fa6aee83b9b00a4aae5b18baf493f1e3bdfcb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:50:38.860 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:38 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:38.552+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:39.043 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:38 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:38.736+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:39.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:38 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:38.868+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:39.130 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:39 smithi033 podman[123266]: 2024-08-28 19:50:39.020745673 +0000 UTC m=+0.425314930 container init 565a057cf3f01240c59bd0515fa6aee83b9b00a4aae5b18baf493f1e3bdfcb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-28T19:50:39.130 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:39 smithi033 podman[123266]: 2024-08-28 19:50:39.024081682 +0000 UTC m=+0.428650939 container start 565a057cf3f01240c59bd0515fa6aee83b9b00a4aae5b18baf493f1e3bdfcb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-28T19:50:39.130 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:39 smithi033 podman[123266]: 2024-08-28 19:50:39.103978443 +0000 UTC m=+0.508547716 container attach 565a057cf3f01240c59bd0515fa6aee83b9b00a4aae5b18baf493f1e3bdfcb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1) 2024-08-28T19:50:39.541 INFO:journalctl@ceph.osd.3.smithi033.stdout:Aug 28 19:50:39 smithi033 podman[123266]: 2024-08-28 19:50:39.221717458 +0000 UTC m=+0.626286732 container died 565a057cf3f01240c59bd0515fa6aee83b9b00a4aae5b18baf493f1e3bdfcb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-28T19:50:39.783 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:39 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:39.311+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:39.855 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:39 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:39.542+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:39.877 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.3.service' 2024-08-28T19:50:39.918 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:39.919 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-28T19:50:39.919 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-28T19:50:39.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.4 2024-08-28T19:50:40.043 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:39.707+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:40.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:39.825+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:40.238 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:39 smithi059 systemd[1]: Stopping Ceph osd.4 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:40.534 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:40 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:40.265+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:40.535 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:40 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4[34214]: 2024-08-28T19:50:40.236+0000 7fd7e4e92640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:40.535 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:40 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4[34214]: 2024-08-28T19:50:40.236+0000 7fd7e4e92640 -1 osd.4 110 *** Got signal Terminated *** 2024-08-28T19:50:40.535 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:40 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4[34214]: 2024-08-28T19:50:40.236+0000 7fd7e4e92640 -1 osd.4 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:50:40.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:40 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:40.551+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:41.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:40 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:40.865+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:41.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:40 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:40.751+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:41.532 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:41 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:41.235+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:41.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:41 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:41.565+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:42.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:41 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:41.864+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:42.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:41 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:41.779+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:42.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:42 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:42.260+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:42.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:42 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:42.574+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:43.293 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:42 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:42.797+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:43.294 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:42 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:42.910+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:43.532 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:43 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:43.257+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:43.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:43 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:43.551+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:44.293 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:43 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:43.915+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:44.294 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:43 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:43.795+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:44.623 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:44 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:44.286+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:44.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:44 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:44.585+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:44.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:44 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:44.585+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:45.033 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:44 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4[34214]: 2024-08-28T19:50:44.622+0000 7fd7e147d640 -1 osd.4 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.804461+0000 front 2024-08-28T19:50:19.804504+0000 (oldest deadline 2024-08-28T19:50:44.504672+0000) 2024-08-28T19:50:45.154 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:44 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:44.887+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:45.154 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:44 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:44.838+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:45.154 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:44 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:44.838+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.300601+0000 front 2024-08-28T19:50:20.300492+0000 (oldest deadline 2024-08-28T19:50:43.800331+0000) 2024-08-28T19:50:45.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:44 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:44.952+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:45.425 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:45 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:45.153+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:45.532 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:45 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:45.280+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:45.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:45 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:45.276+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:45.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:45 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:45.566+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:45.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:45 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:45.566+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:46.005 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:45 smithi059 podman[58839]: 2024-08-28 19:50:45.703001836 +0000 UTC m=+5.588421762 container died 64334947cfaca61b4baed91adbc553a1c6411e2fa9402e5e191bcfac8ecf6bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:50:46.201 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:45 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:45.925+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:46.201 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:45 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:45.801+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:46.202 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:45 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:45.801+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.300601+0000 front 2024-08-28T19:50:20.300492+0000 (oldest deadline 2024-08-28T19:50:43.800331+0000) 2024-08-28T19:50:46.266 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:46 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:46.240+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:46.266 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:46 smithi059 podman[58839]: 2024-08-28 19:50:46.078755798 +0000 UTC m=+5.964175715 container cleanup 64334947cfaca61b4baed91adbc553a1c6411e2fa9402e5e191bcfac8ecf6bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-28T19:50:46.266 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:46 smithi059 bash[58839]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4 2024-08-28T19:50:46.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:45 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:45.913+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:46.532 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:46 smithi059 podman[58856]: 2024-08-28 19:50:46.347039732 +0000 UTC m=+0.641060898 container remove 64334947cfaca61b4baed91adbc553a1c6411e2fa9402e5e191bcfac8ecf6bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-28T19:50:46.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:46 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:46.264+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:46.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:46 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:46.264+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:46.543 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:46 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:46.200+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:46.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:46 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:46.614+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:46.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:46 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:46.614+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:46.959 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:46 smithi059 podman[58944]: 2024-08-28 19:50:46.607184967 +0000 UTC m=+0.016225544 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:50:46.959 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:46 smithi059 podman[58944]: 2024-08-28 19:50:46.723403639 +0000 UTC m=+0.132444266 container create 0a546dd66415315fac799a1a4cb0609a0d655bef621bd6779db5829625d0367e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-28T19:50:47.043 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:46 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:46.753+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:47.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:46 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:46.753+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.300601+0000 front 2024-08-28T19:50:20.300492+0000 (oldest deadline 2024-08-28T19:50:43.800331+0000) 2024-08-28T19:50:47.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:46 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:46.957+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:47.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:46 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:46.957+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:47.223 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:46 smithi059 podman[58944]: 2024-08-28 19:50:46.959125572 +0000 UTC m=+0.368166143 container init 0a546dd66415315fac799a1a4cb0609a0d655bef621bd6779db5829625d0367e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-28T19:50:47.223 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:46 smithi059 podman[58944]: 2024-08-28 19:50:46.962456537 +0000 UTC m=+0.371497108 container start 0a546dd66415315fac799a1a4cb0609a0d655bef621bd6779db5829625d0367e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:50:47.224 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:47 smithi059 podman[58944]: 2024-08-28 19:50:47.167423751 +0000 UTC m=+0.576464324 container attach 0a546dd66415315fac799a1a4cb0609a0d655bef621bd6779db5829625d0367e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-28T19:50:47.224 INFO:journalctl@ceph.osd.4.smithi059.stdout:Aug 28 19:50:47 smithi059 podman[58944]: 2024-08-28 19:50:47.167656654 +0000 UTC m=+0.576697227 container died 0a546dd66415315fac799a1a4cb0609a0d655bef621bd6779db5829625d0367e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-28T19:50:47.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:46 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:46.916+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:47.496 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:47 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:47.272+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:47.496 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:47 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:47.221+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:47.496 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:47 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:47.221+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:47.543 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:47 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:47.173+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:47.786 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.4.service' 2024-08-28T19:50:47.824 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:47.824 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-28T19:50:47.824 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-28T19:50:47.824 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.5 2024-08-28T19:50:47.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:47 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:47.604+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:47.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:47 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:47.604+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:48.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:47 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:47.912+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:48.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:47 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:47.912+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:48.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:47 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:47.734+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:48.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:47 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:47.734+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.300601+0000 front 2024-08-28T19:50:20.300492+0000 (oldest deadline 2024-08-28T19:50:43.800331+0000) 2024-08-28T19:50:48.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:47 smithi122 systemd[1]: Stopping Ceph osd.5 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:48.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:47 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:47.906+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:48.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:48 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:48.255+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:48.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:48 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:48.217+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:48.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:48 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:48.217+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:48.544 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:48 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:48.192+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:48.544 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:48 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:48.153+0000 7f06ea44b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:48.544 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:48 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:48.153+0000 7f06ea44b640 -1 osd.5 110 *** Got signal Terminated *** 2024-08-28T19:50:48.544 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:48 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:48.153+0000 7f06ea44b640 -1 osd.5 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:50:48.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:48 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:48.622+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:48.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:48 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:48.622+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:49.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:48 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:48.901+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:49.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:48 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:48.901+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:49.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:48 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:48.693+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:49.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:48 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:48.693+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.300601+0000 front 2024-08-28T19:50:20.300492+0000 (oldest deadline 2024-08-28T19:50:43.800331+0000) 2024-08-28T19:50:49.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:48 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:48.919+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:49.532 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:49.254+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:49.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:49.184+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:49.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:49 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:49.184+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:49.543 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:49.156+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:49.908 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:49.656+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:49.908 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:49.656+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:50.043 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:49.719+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:50.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:49.719+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.300601+0000 front 2024-08-28T19:50:20.300492+0000 (oldest deadline 2024-08-28T19:50:43.800331+0000) 2024-08-28T19:50:50.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:49.867+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:50.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:49 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:49.867+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:50.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:49 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:49.907+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:50.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:50 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:50.276+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:50.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:50 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:50.198+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:50.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:50 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:50.198+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:50.543 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:50 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:50.205+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:50.918 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:50 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:50.660+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:50.918 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:50 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:50.660+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:51.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:50 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:50.705+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:51.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:50 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:50.705+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.300601+0000 front 2024-08-28T19:50:20.300492+0000 (oldest deadline 2024-08-28T19:50:43.800331+0000) 2024-08-28T19:50:51.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:50 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:50.829+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:51.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:50 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:50.829+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:51.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:50 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:50.917+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:51.532 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:51 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:51.270+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:51.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:51 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:51.169+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:51.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:51 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:51.169+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:51.543 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:51 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:51.224+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:51.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:51 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:51.619+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:51.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:51 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:51.619+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:52.043 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:51 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:51.694+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:52.044 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:51 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:51.694+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.300601+0000 front 2024-08-28T19:50:20.300492+0000 (oldest deadline 2024-08-28T19:50:43.800331+0000) 2024-08-28T19:50:52.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:51 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:51.795+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:52.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:51 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:51.795+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:52.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:51 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:51.795+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:50:52.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:51 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:51.914+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:52.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:51 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:51.914+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.689284+0000 front 2024-08-28T19:50:25.689397+0000 (oldest deadline 2024-08-28T19:50:50.989148+0000) 2024-08-28T19:50:52.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:52 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:52.321+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:52.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:52 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:52.176+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:52.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:52 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:52.176+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:52.543 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:52 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:52.263+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:52.543 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:52 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:52.263+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:50:52.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:52 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:52.578+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:52.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:52 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:52.578+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:53.043 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:52 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:52.667+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:08.098159+0000 front 2024-08-28T19:50:08.098082+0000 (oldest deadline 2024-08-28T19:50:33.998111+0000) 2024-08-28T19:50:53.043 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:52 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5[34934]: 2024-08-28T19:50:52.667+0000 7f06e2a2e640 -1 osd.5 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.300601+0000 front 2024-08-28T19:50:20.300492+0000 (oldest deadline 2024-08-28T19:50:43.800331+0000) 2024-08-28T19:50:53.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:52 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:52.828+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:53.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:52 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:52.828+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:53.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:52 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:52.828+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:50:53.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:52 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:52.935+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:53.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:52 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:52.935+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.689284+0000 front 2024-08-28T19:50:25.689397+0000 (oldest deadline 2024-08-28T19:50:50.989148+0000) 2024-08-28T19:50:53.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:53 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:53.327+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:53.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:53 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:53.327+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:50:53.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:53 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:53.166+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:53.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:53 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:53.166+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:53.605 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:53 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:53.302+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:53.605 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:53 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:53.302+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:50:53.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:53 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:53.546+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:53.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:53 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:53.546+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:53.905 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:53 smithi122 podman[60467]: 2024-08-28 19:50:53.604430772 +0000 UTC m=+5.579460863 container died 10c9bb67e4ed2ccef8f66439031056eb2bd7b38733cecf518db024f7c6c22d94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-28T19:50:53.906 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:53 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:53.835+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:53.906 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:53 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:53.835+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:53.906 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:53 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:53.835+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:50:54.248 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:54 smithi122 podman[60467]: 2024-08-28 19:50:54.013180722 +0000 UTC m=+5.988210847 container cleanup 10c9bb67e4ed2ccef8f66439031056eb2bd7b38733cecf518db024f7c6c22d94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-28T19:50:54.249 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:54 smithi122 bash[60467]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5 2024-08-28T19:50:54.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:53 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:53.919+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:54.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:53 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:53.919+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.689284+0000 front 2024-08-28T19:50:25.689397+0000 (oldest deadline 2024-08-28T19:50:50.989148+0000) 2024-08-28T19:50:54.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:54 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:54.361+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:54.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:54 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:54.361+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:50:54.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:54 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:54.150+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:54.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:54 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:54.150+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:54.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:54 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:54.150+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:50:54.543 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:54 smithi122 podman[60483]: 2024-08-28 19:50:54.248027485 +0000 UTC m=+0.633895867 container remove 10c9bb67e4ed2ccef8f66439031056eb2bd7b38733cecf518db024f7c6c22d94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-28T19:50:54.544 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:54 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:54.309+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:54.544 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:54 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:54.309+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:50:54.878 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:54 smithi122 podman[60575]: 2024-08-28 19:50:54.479895865 +0000 UTC m=+0.015738564 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:50:54.878 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:54 smithi122 podman[60575]: 2024-08-28 19:50:54.599069746 +0000 UTC m=+0.134912474 container create 3f259d6e16ca7b8020d87716a8bffe5b9dadd75d614fbcfbd2fc18c738191415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:50:54.878 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:54 smithi122 podman[60575]: 2024-08-28 19:50:54.810376484 +0000 UTC m=+0.346219169 container init 3f259d6e16ca7b8020d87716a8bffe5b9dadd75d614fbcfbd2fc18c738191415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T19:50:54.878 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:54 smithi122 podman[60575]: 2024-08-28 19:50:54.81366577 +0000 UTC m=+0.349508456 container start 3f259d6e16ca7b8020d87716a8bffe5b9dadd75d614fbcfbd2fc18c738191415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-28T19:50:54.878 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:54 smithi122 podman[60575]: 2024-08-28 19:50:54.877002127 +0000 UTC m=+0.412844813 container attach 3f259d6e16ca7b8020d87716a8bffe5b9dadd75d614fbcfbd2fc18c738191415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-28T19:50:54.879 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:54 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:54.805+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:54.879 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:54 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:54.805+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:54.879 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:54 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:54.805+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:50:54.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:54 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:54.566+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:54.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:54 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:54.566+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:55.291 INFO:journalctl@ceph.osd.5.smithi122.stdout:Aug 28 19:50:54 smithi122 podman[60575]: 2024-08-28 19:50:54.999896512 +0000 UTC m=+0.535739209 container died 3f259d6e16ca7b8020d87716a8bffe5b9dadd75d614fbcfbd2fc18c738191415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-28T19:50:55.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:54 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:54.959+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:55.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:54 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:54.959+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.689284+0000 front 2024-08-28T19:50:25.689397+0000 (oldest deadline 2024-08-28T19:50:50.989148+0000) 2024-08-28T19:50:55.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:55 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:55.341+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:55.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:55 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:55.341+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:50:55.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:55 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:55.118+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:55.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:55 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:55.119+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:55.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:55 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:55.119+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:50:55.543 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:55 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:55.289+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:55.543 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:55 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:55.289+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:50:55.715 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.5.service' 2024-08-28T19:50:55.754 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:50:55.754 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-28T19:50:55.754 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-28T19:50:55.754 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.6 2024-08-28T19:50:55.879 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:55 smithi033 systemd[1]: Stopping Ceph osd.6 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:50:55.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:55 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:55.610+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:55.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:55 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:55.610+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:55.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:55 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:55.610+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:50:56.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:55 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:55.847+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:56.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:55 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:55.847+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:56.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:55 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:55.847+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:50:56.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:55 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:55.988+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:56.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:55 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:55.988+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.689284+0000 front 2024-08-28T19:50:25.689397+0000 (oldest deadline 2024-08-28T19:50:50.989148+0000) 2024-08-28T19:50:56.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:56 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:56.065+0000 7efc4634d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:50:56.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:56 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:56.065+0000 7efc4634d640 -1 osd.6 110 *** Got signal Terminated *** 2024-08-28T19:50:56.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:56 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:56.065+0000 7efc4634d640 -1 osd.6 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:50:56.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:56 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:56.344+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:56.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:56 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:56.344+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:50:56.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:56 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:56.109+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:56.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:56 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:56.109+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:56.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:56 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:56.109+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:50:56.661 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:56 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:56.605+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:56.661 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:56 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:56.605+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:56.661 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:56 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:56.605+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:50:56.793 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:56 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:56.332+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:56.793 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:56 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:56.332+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:50:57.293 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:56 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:56.806+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:57.293 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:56 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:56.806+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:57.294 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:56 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:56.806+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:50:57.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:56 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:56.975+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:57.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:56 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:56.975+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.689284+0000 front 2024-08-28T19:50:25.689397+0000 (oldest deadline 2024-08-28T19:50:50.989148+0000) 2024-08-28T19:50:57.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:57 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:57.330+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:57.533 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:57 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:57.330+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:50:57.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:57 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:57.087+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:57.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:57 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:57.087+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:57.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:57 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:57.087+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:50:57.793 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:57 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:57.342+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:57.793 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:57 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:57.342+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:50:57.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:57 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:57.602+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:57.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:57 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:57.602+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:57.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:57 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:57.602+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:50:58.293 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:57 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:57.796+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:58.293 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:57 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:57.796+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:58.294 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:57 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:57.796+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:50:58.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:57 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:57.940+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:58.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:57 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:57.940+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.689284+0000 front 2024-08-28T19:50:25.689397+0000 (oldest deadline 2024-08-28T19:50:50.989148+0000) 2024-08-28T19:50:58.380 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:58 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:58.077+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:58.380 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:58 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:58.077+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:58.380 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:58 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:58.077+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:50:58.380 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:58 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:58.077+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:50:58.760 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:58 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:58.344+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:58.760 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:58 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:58.344+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:50:58.782 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:58 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:58.378+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:58.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:58 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:58.378+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:50:58.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:58 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:58.567+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:58.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:58 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:58.567+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:58.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:58 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:58.567+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:50:58.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:58 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:58.567+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:50:59.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:58 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:58.759+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:50:59.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:58 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:58.759+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:50:59.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:58 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:58.759+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:50:59.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:59 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:59.030+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:50:59.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:59 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:59.030+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:50:59.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:59 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:59.030+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:50:59.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:50:59 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:50:59.030+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:50:59.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:58 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:58.958+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:50:59.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:58 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:58.958+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.689284+0000 front 2024-08-28T19:50:25.689397+0000 (oldest deadline 2024-08-28T19:50:50.989148+0000) 2024-08-28T19:50:59.765 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:59 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:59.309+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:50:59.765 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:50:59 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:50:59.309+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:50:59.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:59 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:59.393+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:50:59.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:50:59 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:50:59.393+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:50:59.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:59 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:59.560+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:50:59.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:59 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:59.560+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:50:59.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:59 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:59.560+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:50:59.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:50:59 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:50:59.560+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:00.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:59 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:59.764+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:00.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:59 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:59.764+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:00.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:50:59 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:50:59.764+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:00.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:59 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:59.937+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:51:00.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:50:59 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:50:59.937+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.689284+0000 front 2024-08-28T19:50:25.689397+0000 (oldest deadline 2024-08-28T19:50:50.989148+0000) 2024-08-28T19:51:00.383 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:00 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:00.078+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:00.383 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:00 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:00.078+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:00.383 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:00 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:00.078+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:00.383 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:00 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:00.078+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:00.737 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:00 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:00.332+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:00.738 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:00 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:00.332+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:00.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:00 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:00.382+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:51:00.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:00 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:00.382+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:51:00.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:00 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:00.382+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.374510+0000 front 2024-08-28T19:50:35.374532+0000 (oldest deadline 2024-08-28T19:50:59.474277+0000) 2024-08-28T19:51:00.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:00.598+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:00.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:00.598+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:00.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:00.598+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:00.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:00.598+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:01.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:00 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:00.737+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:01.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:00 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:00.737+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:01.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:00 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:00.737+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:01.379 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:51:00.935+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.287788+0000 front 2024-08-28T19:50:19.287965+0000 (oldest deadline 2024-08-28T19:50:44.587998+0000) 2024-08-28T19:51:01.380 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:00 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6[50868]: 2024-08-28T19:51:00.935+0000 7efc3e930640 -1 osd.6 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.689284+0000 front 2024-08-28T19:50:25.689397+0000 (oldest deadline 2024-08-28T19:50:50.989148+0000) 2024-08-28T19:51:01.412 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:01 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:01.050+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:01.412 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:01 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:01.050+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:01.412 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:01 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:01.050+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:01.412 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:01 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:01.050+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:01.706 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:01 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:01.311+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:01.706 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:01 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:01.311+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:01.707 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:01 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:01.311+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:01.782 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:01 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:01.411+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:51:01.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:01 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:01.411+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:51:01.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:01 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:01.411+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.374510+0000 front 2024-08-28T19:50:35.374532+0000 (oldest deadline 2024-08-28T19:50:59.474277+0000) 2024-08-28T19:51:01.800 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:01 smithi033 podman[123368]: 2024-08-28 19:51:01.415781464 +0000 UTC m=+5.463208773 container died de71e0a6d8500a5ef61d7267775e1aca0f5717ed94a00c7af6301bc4066df8d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-28T19:51:01.800 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:01 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:01.631+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:01.800 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:01 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:01.631+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:01.800 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:01 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:01.631+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:01.800 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:01 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:01.631+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:02.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:01 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:01.706+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:02.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:01 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:01.706+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:02.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:01 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:01.706+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:02.130 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:01 smithi033 podman[123368]: 2024-08-28 19:51:01.981949019 +0000 UTC m=+6.029376369 container cleanup de71e0a6d8500a5ef61d7267775e1aca0f5717ed94a00c7af6301bc4066df8d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-28T19:51:02.130 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:01 smithi033 bash[123368]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6 2024-08-28T19:51:02.433 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:02 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:02.060+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:02.433 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:02 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:02.060+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:02.434 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:02 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:02.060+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:02.434 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:02 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:02.060+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:02.629 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:02 smithi033 podman[123397]: 2024-08-28 19:51:02.375460389 +0000 UTC m=+0.950738881 container remove de71e0a6d8500a5ef61d7267775e1aca0f5717ed94a00c7af6301bc4066df8d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-28T19:51:02.675 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:02 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:02.324+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:02.675 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:02 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:02.324+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:02.675 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:02 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:02.324+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:02.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:02 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:02.432+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:51:02.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:02 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:02.432+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:51:02.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:02 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:02.432+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.374510+0000 front 2024-08-28T19:50:35.374532+0000 (oldest deadline 2024-08-28T19:50:59.474277+0000) 2024-08-28T19:51:02.995 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:02 smithi033 podman[123484]: 2024-08-28 19:51:02.657695149 +0000 UTC m=+0.016084453 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:51:02.995 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:02 smithi033 podman[123484]: 2024-08-28 19:51:02.884715311 +0000 UTC m=+0.243104656 container create 66a2ae1d2c008b0331f761122eace7e5c64b23d35ec41e394a87c45989bdab90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6-deactivate, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-28T19:51:02.995 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:02.669+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:02.995 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:02.669+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:02.995 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:02.669+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:02.996 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:02 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:02.669+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:03.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:02 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:02.674+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:03.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:02 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:02.674+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:03.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:02 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:02.674+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:03.254 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:03 smithi033 podman[123484]: 2024-08-28 19:51:03.128750036 +0000 UTC m=+0.487139342 container init 66a2ae1d2c008b0331f761122eace7e5c64b23d35ec41e394a87c45989bdab90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:51:03.254 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:03 smithi033 podman[123484]: 2024-08-28 19:51:03.132253555 +0000 UTC m=+0.490642861 container start 66a2ae1d2c008b0331f761122eace7e5c64b23d35ec41e394a87c45989bdab90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-28T19:51:03.254 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:03 smithi033 podman[123484]: 2024-08-28 19:51:03.253731565 +0000 UTC m=+0.612120873 container attach 66a2ae1d2c008b0331f761122eace7e5c64b23d35ec41e394a87c45989bdab90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:51:03.476 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:03 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:03.091+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:03.476 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:03 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:03.091+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:03.476 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:03 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:03.091+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:03.476 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:03 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:03.091+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:03.624 INFO:journalctl@ceph.osd.6.smithi033.stdout:Aug 28 19:51:03 smithi033 podman[123484]: 2024-08-28 19:51:03.329165927 +0000 UTC m=+0.687555231 container died 66a2ae1d2c008b0331f761122eace7e5c64b23d35ec41e394a87c45989bdab90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-28T19:51:03.673 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:03 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:03.330+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:03.673 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:03 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:03.330+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:03.673 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:03 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:03.330+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:03.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:03 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:03.475+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:51:03.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:03 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:03.475+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:51:03.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:03 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:03.475+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.374510+0000 front 2024-08-28T19:50:35.374532+0000 (oldest deadline 2024-08-28T19:50:59.474277+0000) 2024-08-28T19:51:03.879 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:03 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:03.642+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:03.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:03 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:03.642+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:03.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:03 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:03.642+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:03.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:03 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:03.642+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:03.953 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.6.service' 2024-08-28T19:51:03.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:51:03.996 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-28T19:51:03.996 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-28T19:51:03.996 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.7 2024-08-28T19:51:04.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:03 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:03.671+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:04.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:03 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:03.671+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:04.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:03 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:03.671+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:04.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:04 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:04.091+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:04.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:04 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:04.091+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:04.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:04 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:04.091+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:04.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:04 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:04.091+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:04.283 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:04 smithi059 systemd[1]: Stopping Ceph osd.7 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:51:04.283 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:04 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:04.265+0000 7fd03f6be640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:51:04.283 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:04 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:04.265+0000 7fd03f6be640 -1 osd.7 110 *** Got signal Terminated *** 2024-08-28T19:51:04.284 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:04 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:04.265+0000 7fd03f6be640 -1 osd.7 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:51:04.640 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:04 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:04.313+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:04.640 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:04 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:04.313+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:04.641 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:04 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:04.313+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:04.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:04 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:04.494+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:51:04.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:04 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:04.494+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:51:04.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:04 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:04.494+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.374510+0000 front 2024-08-28T19:50:35.374532+0000 (oldest deadline 2024-08-28T19:50:59.474277+0000) 2024-08-28T19:51:05.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:04 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:04.639+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:05.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:04 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:04.639+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:05.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:04 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:04.639+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:05.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:04 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:04.654+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:05.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:04 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:04.654+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:05.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:04 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:04.654+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:05.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:04 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:04.654+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:05.475 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:05 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:05.100+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:05.476 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:05 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:05.100+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:05.476 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:05 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:05.100+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:05.476 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:05 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:05.100+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:05.645 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:05 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:05.332+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:05.645 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:05 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:05.332+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:05.645 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:05 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:05.332+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:05.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:05 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:05.475+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:51:05.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:05 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:05.475+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:51:05.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:05 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:05.475+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.374510+0000 front 2024-08-28T19:50:35.374532+0000 (oldest deadline 2024-08-28T19:50:59.474277+0000) 2024-08-28T19:51:06.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:05 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:05.644+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:06.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:05 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:05.644+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:06.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:05 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:05.644+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:06.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:05 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:05.682+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:06.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:05 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:05.682+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:06.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:05 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:05.682+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:06.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:05 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:05.682+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:06.494 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:06 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:06.078+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:06.494 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:06 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:06.078+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:06.494 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:06 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:06.078+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:06.494 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:06 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:06.078+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:06.685 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:06 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:06.342+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:06.803 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:06 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:06.342+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:06.803 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:06 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:06.342+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:06.804 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:06 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:06.492+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:51:06.804 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:06 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:06.493+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:51:06.804 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:06 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:06.493+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.374510+0000 front 2024-08-28T19:50:35.374532+0000 (oldest deadline 2024-08-28T19:50:59.474277+0000) 2024-08-28T19:51:06.804 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:06 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:06.493+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.175191+0000 front 2024-08-28T19:50:44.175171+0000 (oldest deadline 2024-08-28T19:51:06.475295+0000) 2024-08-28T19:51:07.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:06 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:06.675+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:07.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:06 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:06.675+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:07.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:06 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:06.675+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:07.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:06 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:06.675+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:07.102 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:06 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:06.668+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:07.102 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:06 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:06.668+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:07.102 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:06 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:06.668+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:07.103 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:06 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:06.668+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:07.520 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:07 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:07.119+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:07.520 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:07 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:07.119+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:07.520 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:07 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:07.119+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:07.520 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:07 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:07.119+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:07.665 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:07 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:07.378+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:07.666 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:07 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:07.378+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:07.666 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:07 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:07.378+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:07.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:07 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:07.518+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:51:07.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:07 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:07.518+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:51:07.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:07 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:07.518+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.374510+0000 front 2024-08-28T19:50:35.374532+0000 (oldest deadline 2024-08-28T19:50:59.474277+0000) 2024-08-28T19:51:07.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:07 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:07.518+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.175191+0000 front 2024-08-28T19:50:44.175171+0000 (oldest deadline 2024-08-28T19:51:06.475295+0000) 2024-08-28T19:51:08.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:07 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:07.664+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:08.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:07 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:07.664+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:08.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:07 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:07.664+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:08.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:07 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:07.664+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:08.129 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:07 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:07.703+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:08.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:07 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:07.703+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:08.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:07 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:07.704+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:08.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:07 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:07.704+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:08.521 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:08 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:08.087+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:08.521 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:08 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:08.087+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:08.522 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:08 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:08.087+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:08.522 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:08 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:08.087+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:08.522 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:08 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:08.087+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:08.656 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:08 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:08.386+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:08.657 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:08 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:08.386+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:08.657 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:08 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:08.386+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:08.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:08 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:08.519+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:19.671811+0000 front 2024-08-28T19:50:19.672039+0000 (oldest deadline 2024-08-28T19:50:44.371967+0000) 2024-08-28T19:51:08.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:08 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:08.519+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.973568+0000 front 2024-08-28T19:50:28.973586+0000 (oldest deadline 2024-08-28T19:50:52.473325+0000) 2024-08-28T19:51:08.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:08 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:08.519+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.374510+0000 front 2024-08-28T19:50:35.374532+0000 (oldest deadline 2024-08-28T19:50:59.474277+0000) 2024-08-28T19:51:08.783 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:08 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7[40984]: 2024-08-28T19:51:08.519+0000 7fd03bca9640 -1 osd.7 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.175191+0000 front 2024-08-28T19:50:44.175171+0000 (oldest deadline 2024-08-28T19:51:06.475295+0000) 2024-08-28T19:51:09.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:08 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:08.654+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:09.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:08 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:08.654+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:09.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:08 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:08.654+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:09.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:08 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:08.654+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:09.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:08 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:08.722+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:09.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:08 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:08.722+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:09.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:08 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:08.722+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:09.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:08 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:08.722+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:09.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:08 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:08.722+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:09.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:09 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:09.070+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:09.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:09 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:09.070+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:09.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:09 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:09.070+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:09.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:09 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:09.070+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:09.534 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:09 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:09.070+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:09.793 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:09 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:09.624+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:09.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:09 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:09.624+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:09.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:09 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:09.624+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:09.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:09 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:09.624+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:09.794 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:09 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:09.435+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:09.795 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:09 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:09.435+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:09.795 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:09 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:09.435+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:09.985 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:09 smithi059 podman[59043]: 2024-08-28 19:51:09.707795917 +0000 UTC m=+5.520609887 container died 1cf608bfa46becb0cdb4f1ae29cbad0dba1470cc64969a8ddcf1d51a083292e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-28T19:51:10.129 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:09 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:09.770+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:10.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:09 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:09.770+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:10.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:09 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:09.770+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:10.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:09 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:09.770+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:10.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:09 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:09.770+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:10.283 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:10 smithi059 podman[59043]: 2024-08-28 19:51:10.083031117 +0000 UTC m=+5.895845135 container cleanup 1cf608bfa46becb0cdb4f1ae29cbad0dba1470cc64969a8ddcf1d51a083292e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:51:10.283 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:10 smithi059 bash[59043]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7 2024-08-28T19:51:10.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:10 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:10.079+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:10.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:10 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:10.079+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:10.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:10 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:10.079+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:10.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:10 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:10.079+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:10.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:10 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:10.079+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:10.709 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:10 smithi059 podman[59070]: 2024-08-28 19:51:10.35105025 +0000 UTC m=+0.642042417 container remove 1cf608bfa46becb0cdb4f1ae29cbad0dba1470cc64969a8ddcf1d51a083292e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T19:51:10.793 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:10 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:10.455+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:10.794 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:10 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:10.455+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:10.794 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:10 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:10.455+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:10.794 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:10 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:10.455+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:45.222706+0000 front 2024-08-28T19:50:45.222689+0000 (oldest deadline 2024-08-28T19:51:09.922526+0000) 2024-08-28T19:51:10.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:10 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:10.587+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:10.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:10 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:10.587+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:10.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:10 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:10.587+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:10.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:10 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:10.587+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:10.988 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:10 smithi059 podman[59157]: 2024-08-28 19:51:10.612111155 +0000 UTC m=+0.016149046 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:51:10.988 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:10 smithi059 podman[59157]: 2024-08-28 19:51:10.71016419 +0000 UTC m=+0.114202110 container create 88831a8b9ae883f806aed6ceb9af1698167f33cf4bce2140f9b19e3235bbc57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-28T19:51:10.988 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:10 smithi059 podman[59157]: 2024-08-28 19:51:10.912943719 +0000 UTC m=+0.316981597 container init 88831a8b9ae883f806aed6ceb9af1698167f33cf4bce2140f9b19e3235bbc57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-28T19:51:10.989 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:10 smithi059 podman[59157]: 2024-08-28 19:51:10.916256889 +0000 UTC m=+0.320294767 container start 88831a8b9ae883f806aed6ceb9af1698167f33cf4bce2140f9b19e3235bbc57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-28T19:51:10.989 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:10 smithi059 podman[59157]: 2024-08-28 19:51:10.987770542 +0000 UTC m=+0.391808439 container attach 88831a8b9ae883f806aed6ceb9af1698167f33cf4bce2140f9b19e3235bbc57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, ceph=True, GIT_BRANCH=HEAD) 2024-08-28T19:51:11.129 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:10 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:10.783+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:11.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:10 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:10.783+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:11.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:10 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:10.783+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:11.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:10 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:10.783+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:11.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:10 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:10.783+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:11.283 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:11 smithi059 podman[59157]: 2024-08-28 19:51:11.112293531 +0000 UTC m=+0.516331416 container died 88831a8b9ae883f806aed6ceb9af1698167f33cf4bce2140f9b19e3235bbc57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-28T19:51:11.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:11 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:11.063+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:11.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:11 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:11.063+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:11.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:11 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:11.063+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:11.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:11 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:11.063+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:11.283 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:11 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:11.063+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:11.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.7.service' 2024-08-28T19:51:11.650 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:11 smithi059 podman[59180]: 2024-08-28 19:51:11.600019038 +0000 UTC m=+0.481472452 container remove 88831a8b9ae883f806aed6ceb9af1698167f33cf4bce2140f9b19e3235bbc57e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-28T19:51:11.650 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:11 smithi059 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.7.service: Deactivated successfully. 2024-08-28T19:51:11.650 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:11 smithi059 systemd[1]: Stopped Ceph osd.7 for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:51:11.650 INFO:journalctl@ceph.osd.7.smithi059.stdout:Aug 28 19:51:11 smithi059 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.7.service: Consumed 17.727s CPU time. 2024-08-28T19:51:11.667 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:51:11.668 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-28T19:51:11.668 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-28T19:51:11.668 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.8 2024-08-28T19:51:11.695 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:11.420+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:11.695 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:11.420+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:11.695 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:11.420+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:11.696 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:11.420+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:45.222706+0000 front 2024-08-28T19:50:45.222689+0000 (oldest deadline 2024-08-28T19:51:09.922526+0000) 2024-08-28T19:51:11.696 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:11.632+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:11.696 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:11.632+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:11.696 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:11.632+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:11.696 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:11.632+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:11.961 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:11 smithi122 systemd[1]: Stopping Ceph osd.8 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:51:12.129 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:11 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:11.829+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:12.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:11 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:11.829+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:12.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:11 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:11.829+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:12.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:11 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:11.829+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:12.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:11 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:11.829+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:12.293 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:11.959+0000 7f023d387640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:51:12.293 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:11.959+0000 7f023d387640 -1 osd.8 110 *** Got signal Terminated *** 2024-08-28T19:51:12.293 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:11 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:11.959+0000 7f023d387640 -1 osd.8 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:51:12.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:12 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:12.097+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:12.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:12 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:12.097+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:12.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:12 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:12.097+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:12.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:12 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:12.097+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:12.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:12 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:12.097+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:12.794 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:12 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:12.445+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:12.794 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:12 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:12.445+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:12.794 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:12 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:12.445+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:12.794 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:12 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:12.445+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:45.222706+0000 front 2024-08-28T19:50:45.222689+0000 (oldest deadline 2024-08-28T19:51:09.922526+0000) 2024-08-28T19:51:12.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:12 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:12.674+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:12.795 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:12 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:12.674+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:12.795 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:12 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:12.674+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:12.795 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:12 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:12.674+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:13.129 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:12 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:12.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:13.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:12 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:12.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:13.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:12 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:12.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:13.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:12 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:12.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:13.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:12 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:12.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:13.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:13 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:13.109+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:13.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:13 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:13.109+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:13.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:13 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:13.109+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:13.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:13 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:13.109+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:13.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:13 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:13.109+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:13.722 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:13 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:13.459+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:13.722 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:13 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:13.459+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:13.722 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:13 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:13.459+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:13.722 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:13 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:13.459+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:45.222706+0000 front 2024-08-28T19:50:45.222689+0000 (oldest deadline 2024-08-28T19:51:09.922526+0000) 2024-08-28T19:51:14.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:13 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:13.720+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:14.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:13 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:13.720+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:14.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:13 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:13.720+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:14.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:13 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:13.720+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:14.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:13 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:13.783+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:14.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:13 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:13.783+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:14.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:13 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:13.783+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:14.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:13 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:13.783+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:14.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:13 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:13.783+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:14.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:14 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:14.143+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:14.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:14 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:14.143+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:14.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:14 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:14.143+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:14.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:14 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:14.143+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:14.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:14 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:14.143+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:14.733 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:14 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:14.414+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:14.734 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:14 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:14.414+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:14.734 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:14 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:14.414+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:14.734 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:14 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:14.414+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:45.222706+0000 front 2024-08-28T19:50:45.222689+0000 (oldest deadline 2024-08-28T19:51:09.922526+0000) 2024-08-28T19:51:15.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:14 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:14.731+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:15.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:14 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:14.731+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:15.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:14 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:14.731+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:15.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:14 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:14.731+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:15.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:14 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:14.796+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:15.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:14 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:14.796+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:15.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:14 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:14.796+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:15.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:14 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:14.796+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:15.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:14 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:14.796+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:15.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:15 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:15.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:15.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:15 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:15.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:15.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:15 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:15.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:15.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:15 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:15.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:15.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:15 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:15.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:15.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:15 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:15.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:15.779 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:15 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:15.385+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:15.779 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:15 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:15.385+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:15.780 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:15 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:15.385+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:15.780 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:15 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:15.385+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:45.222706+0000 front 2024-08-28T19:50:45.222689+0000 (oldest deadline 2024-08-28T19:51:09.922526+0000) 2024-08-28T19:51:15.780 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:15 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:15.385+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:51.523791+0000 front 2024-08-28T19:50:51.523821+0000 (oldest deadline 2024-08-28T19:51:14.423900+0000) 2024-08-28T19:51:16.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:15 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:15.777+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:16.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:15 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:15.777+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:16.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:15 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:15.777+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:16.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:15 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:15.777+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:16.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:15 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:15.777+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:16.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:15 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:15.832+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:16.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:15 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:15.832+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:16.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:15 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:15.832+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:16.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:15 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:15.832+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:16.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:15 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:15.832+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:16.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:16 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:16.147+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:16.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:16 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:16.147+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:16.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:16 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:16.147+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:16.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:16 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:16.147+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:16.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:16 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:16.147+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:16.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:16 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:16.147+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:16.790 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:16 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:16.413+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.819122+0000 front 2024-08-28T19:50:20.818982+0000 (oldest deadline 2024-08-28T19:50:44.319033+0000) 2024-08-28T19:51:16.790 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:16 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:16.413+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.419867+0000 front 2024-08-28T19:50:28.419905+0000 (oldest deadline 2024-08-28T19:50:51.320069+0000) 2024-08-28T19:51:16.790 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:16 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:16.413+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.421964+0000 front 2024-08-28T19:50:36.421823+0000 (oldest deadline 2024-08-28T19:51:01.121705+0000) 2024-08-28T19:51:16.791 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:16 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:16.413+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:45.222706+0000 front 2024-08-28T19:50:45.222689+0000 (oldest deadline 2024-08-28T19:51:09.922526+0000) 2024-08-28T19:51:16.791 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:16 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8[41840]: 2024-08-28T19:51:16.413+0000 7f023596a640 -1 osd.8 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:51.523791+0000 front 2024-08-28T19:50:51.523821+0000 (oldest deadline 2024-08-28T19:51:14.423900+0000) 2024-08-28T19:51:17.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:16 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:16.791+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:17.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:16 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:16.791+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:17.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:16 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:16.791+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:17.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:16 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:16.791+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:17.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:16 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:16.791+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:17.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:16 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:16.870+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:17.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:16 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:16.870+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:17.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:16 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:16.870+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:17.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:16 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:16.870+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:17.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:16 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:16.870+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:17.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:17 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:17.117+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:17.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:17 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:17.117+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:17.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:17 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:17.117+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:17.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:17 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:17.117+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:17.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:17 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:17.117+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:17.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:17 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:17.117+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:17.678 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:17 smithi122 podman[60678]: 2024-08-28 19:51:17.379909369 +0000 UTC m=+5.523803794 container died ee95fd10e180649d242be89bc63b33672bd5b3925fd03da32daa052e6fa54b90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:51:17.986 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:17 smithi122 podman[60678]: 2024-08-28 19:51:17.77712172 +0000 UTC m=+5.921016135 container cleanup ee95fd10e180649d242be89bc63b33672bd5b3925fd03da32daa052e6fa54b90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-28T19:51:17.987 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:17 smithi122 bash[60678]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8 2024-08-28T19:51:17.987 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:17 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:17.745+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:17.987 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:17 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:17.745+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:17.987 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:17 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:17.745+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:17.987 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:17 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:17.745+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:17.987 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:17 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:17.745+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:18.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:17 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:17.831+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:18.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:17 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:17.831+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:18.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:17 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:17.831+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:18.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:17 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:17.831+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:18.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:17 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:17.831+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:18.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:17 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:17.831+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:53.017544+0000 front 2024-08-28T19:50:53.017745+0000 (oldest deadline 2024-08-28T19:51:17.117461+0000) 2024-08-28T19:51:18.293 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:18 smithi122 podman[60703]: 2024-08-28 19:51:18.037176534 +0000 UTC m=+0.656193225 container remove ee95fd10e180649d242be89bc63b33672bd5b3925fd03da32daa052e6fa54b90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-28T19:51:18.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:18 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:18.111+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:18.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:18 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:18.111+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:18.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:18 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:18.111+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:18.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:18 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:18.111+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:18.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:18 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:18.111+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:18.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:18 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:18.111+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:18.658 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:18 smithi122 podman[60794]: 2024-08-28 19:51:18.371598605 +0000 UTC m=+0.096582617 container create f078e3c868b7a34ae4d80ca62993db2db0c9c8a4f668a411eb02c02a8219a590 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.1) 2024-08-28T19:51:18.658 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:18 smithi122 podman[60794]: 2024-08-28 19:51:18.290937734 +0000 UTC m=+0.015921756 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:51:18.659 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:18 smithi122 podman[60794]: 2024-08-28 19:51:18.590900872 +0000 UTC m=+0.315884882 container init f078e3c868b7a34ae4d80ca62993db2db0c9c8a4f668a411eb02c02a8219a590 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-28T19:51:18.659 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:18 smithi122 podman[60794]: 2024-08-28 19:51:18.594517043 +0000 UTC m=+0.319501055 container start f078e3c868b7a34ae4d80ca62993db2db0c9c8a4f668a411eb02c02a8219a590 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD) 2024-08-28T19:51:18.659 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:18 smithi122 podman[60794]: 2024-08-28 19:51:18.657725264 +0000 UTC m=+0.382709283 container attach f078e3c868b7a34ae4d80ca62993db2db0c9c8a4f668a411eb02c02a8219a590 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-28T19:51:19.043 INFO:journalctl@ceph.osd.8.smithi122.stdout:Aug 28 19:51:18 smithi122 podman[60794]: 2024-08-28 19:51:18.780397245 +0000 UTC m=+0.505381265 container died f078e3c868b7a34ae4d80ca62993db2db0c9c8a4f668a411eb02c02a8219a590 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-28T19:51:19.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:18 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:18.786+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:19.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:18 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:18.787+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:19.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:18 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:18.787+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:19.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:18 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:18.787+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:19.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:18 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:18.787+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:19.129 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:18 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:18.785+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:19.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:18 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:18.785+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:19.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:18 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:18.785+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:19.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:18 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:18.785+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:19.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:18 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:18.785+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:19.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:18 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:18.785+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:53.017544+0000 front 2024-08-28T19:50:53.017745+0000 (oldest deadline 2024-08-28T19:51:17.117461+0000) 2024-08-28T19:51:19.447 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.8.service' 2024-08-28T19:51:19.527 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:51:19.527 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-28T19:51:19.527 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-28T19:51:19.527 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.9 2024-08-28T19:51:19.532 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:19 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:19.095+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:19.532 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:19 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:19.095+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:19.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:19 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:19.095+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:19.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:19 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:19.095+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:19.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:19 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:19.095+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:19.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:19 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:19.095+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:19.804 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:19 smithi033 systemd[1]: Stopping Ceph osd.9 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:51:20.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:19 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:19.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:20.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:19 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:19.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:20.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:19 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:19.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:20.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:19 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:19.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:20.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:19 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:19.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:20.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:19 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:19.803+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:20.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:19 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:19.803+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:20.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:19 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:19.803+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:20.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:19 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:19.803+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:20.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:19 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:19.803+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:20.131 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:19 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:19.803+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:53.017544+0000 front 2024-08-28T19:50:53.017745+0000 (oldest deadline 2024-08-28T19:51:17.117461+0000) 2024-08-28T19:51:20.131 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:19 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:19.825+0000 7ff1dfac2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:51:20.131 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:19 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:19.825+0000 7ff1dfac2640 -1 osd.9 110 *** Got signal Terminated *** 2024-08-28T19:51:20.131 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:19 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:19.825+0000 7ff1dfac2640 -1 osd.9 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:51:20.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:20 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:20.103+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:20.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:20 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:20.103+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:20.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:20 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:20.103+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:20.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:20 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:20.103+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:20.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:20 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:20.103+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:20.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:20 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:20.103+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:21.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:20 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:20.705+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:21.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:20 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:20.705+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:21.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:20 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:20.705+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:21.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:20 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:20.705+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:21.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:20 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:20.705+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:21.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:20 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:20.813+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:21.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:20 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:20.813+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:21.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:20 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:20.813+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:21.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:20 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:20.813+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:21.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:20 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:20.813+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:21.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:20 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:20.813+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:53.017544+0000 front 2024-08-28T19:50:53.017745+0000 (oldest deadline 2024-08-28T19:51:17.117461+0000) 2024-08-28T19:51:21.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:21 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:21.110+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:21.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:21 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:21.110+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:21.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:21 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:21.110+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:21.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:21 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:21.110+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:21.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:21 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:21.110+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:21.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:21 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:21.110+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:22.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:21 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:21.733+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:22.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:21 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:21.733+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:22.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:21 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:21.733+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:22.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:21 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:21.733+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:22.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:21 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:21.733+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:22.129 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:21 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:21.801+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:22.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:21 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:21.801+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:22.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:21 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:21.801+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:22.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:21 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:21.801+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:22.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:21 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:21.801+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:22.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:21 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:21.801+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:53.017544+0000 front 2024-08-28T19:50:53.017745+0000 (oldest deadline 2024-08-28T19:51:17.117461+0000) 2024-08-28T19:51:22.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:22 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:22.136+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:22.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:22 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:22.136+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:22.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:22 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:22.136+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:22.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:22 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:22.136+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:22.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:22 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:22.136+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:22.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:22 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:22.136+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:23.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:22 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:22.728+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:23.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:22 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:22.728+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:23.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:22 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:22.728+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:23.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:22 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:22.728+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:23.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:22 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:22.728+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:23.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:22 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:22.820+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:23.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:22 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:22.820+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:23.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:22 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:22.820+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:23.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:22 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:22.820+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:23.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:22 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:22.820+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:23.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:22 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:22.820+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:53.017544+0000 front 2024-08-28T19:50:53.017745+0000 (oldest deadline 2024-08-28T19:51:17.117461+0000) 2024-08-28T19:51:23.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:23 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:23.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:23.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:23 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:23.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:23.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:23 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:23.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:23.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:23 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:23.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:23.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:23 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:23.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:23.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:23 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:23.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:24.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:23 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:23.749+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:24.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:23 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:23.749+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:24.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:23 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:23.749+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:24.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:23 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:23.749+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:24.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:23 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:23.749+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:24.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:23 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:23.749+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:24.129 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:23.828+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:24.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:23.828+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:24.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:23.828+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:24.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:23.828+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:24.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:23.828+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:24.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:23 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:23.828+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:53.017544+0000 front 2024-08-28T19:50:53.017745+0000 (oldest deadline 2024-08-28T19:51:17.117461+0000) 2024-08-28T19:51:24.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:24 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:24.120+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:24.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:24 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:24.120+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:24.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:24 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:24.120+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:24.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:24 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:24.120+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:24.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:24 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:24.120+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:24.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:24 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:24.120+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:25.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:24.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:25.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:24.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:25.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:24.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:25.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:24.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:25.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:24.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:25.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:24 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:24.738+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:25.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:24 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:24.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:12.111610+0000 front 2024-08-28T19:50:12.111772+0000 (oldest deadline 2024-08-28T19:50:38.512466+0000) 2024-08-28T19:51:25.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:24 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:24.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:18.513275+0000 front 2024-08-28T19:50:18.513097+0000 (oldest deadline 2024-08-28T19:50:43.812981+0000) 2024-08-28T19:51:25.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:24 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:24.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:23.813604+0000 front 2024-08-28T19:50:23.813807+0000 (oldest deadline 2024-08-28T19:50:55.014258+0000) 2024-08-28T19:51:25.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:24 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:24.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:35.014697+0000 front 2024-08-28T19:50:35.014746+0000 (oldest deadline 2024-08-28T19:50:57.914896+0000) 2024-08-28T19:51:25.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:24 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:24.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:44.816789+0000 front 2024-08-28T19:50:44.816864+0000 (oldest deadline 2024-08-28T19:51:07.716521+0000) 2024-08-28T19:51:25.130 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:24 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9[57564]: 2024-08-28T19:51:24.798+0000 7ff1dc0ad640 -1 osd.9 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:53.017544+0000 front 2024-08-28T19:50:53.017745+0000 (oldest deadline 2024-08-28T19:51:17.117461+0000) 2024-08-28T19:51:25.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:25 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:25.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:25.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:25 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:25.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:25.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:25 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:25.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:25.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:25 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:25.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:25.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:25 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:25.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:25.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:25 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:25.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:25.578 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:25 smithi033 podman[123589]: 2024-08-28 19:51:25.216012908 +0000 UTC m=+5.490099991 container died 7085be2043e1f2e71576f2b8a168387c8003b6d4588d022e3b17b15b3d47fd4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-08-28T19:51:25.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:25 smithi033 podman[123589]: 2024-08-28 19:51:25.755779948 +0000 UTC m=+6.029867073 container cleanup 7085be2043e1f2e71576f2b8a168387c8003b6d4588d022e3b17b15b3d47fd4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-28T19:51:25.880 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:25 smithi033 bash[123589]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9 2024-08-28T19:51:26.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:25 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:25.762+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:26.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:25 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:25.762+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:26.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:25 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:25.762+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:26.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:25 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:25.762+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:26.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:25 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:25.762+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:26.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:25 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:25.762+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:26.353 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:25 smithi033 podman[123603]: 2024-08-28 19:51:25.944855919 +0000 UTC m=+0.726367819 container remove 7085be2043e1f2e71576f2b8a168387c8003b6d4588d022e3b17b15b3d47fd4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-28T19:51:26.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:26 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:26.137+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:26.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:26 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:26.137+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:26.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:26 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:26.137+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:26.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:26 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:26.137+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:26.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:26 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:26.137+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:26.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:26 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:26.137+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:26.629 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:26 smithi033 podman[123690]: 2024-08-28 19:51:26.254976338 +0000 UTC m=+0.015938149 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:51:26.630 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:26 smithi033 podman[123690]: 2024-08-28 19:51:26.354052251 +0000 UTC m=+0.115014043 container create ae84fd5763d6f11d5a25f10a3debec7bea0a9623dabe8c4132c3c842c7d7d579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-28T19:51:26.630 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:26 smithi033 podman[123690]: 2024-08-28 19:51:26.598061816 +0000 UTC m=+0.359023608 container init ae84fd5763d6f11d5a25f10a3debec7bea0a9623dabe8c4132c3c842c7d7d579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:51:26.630 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:26 smithi033 podman[123690]: 2024-08-28 19:51:26.601314462 +0000 UTC m=+0.362276257 container start ae84fd5763d6f11d5a25f10a3debec7bea0a9623dabe8c4132c3c842c7d7d579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:51:27.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:26 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:26.763+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:27.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:26 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:26.763+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:27.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:26 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:26.763+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:27.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:26 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:26.763+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:27.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:26 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:26.763+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:27.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:26 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:26.763+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:27.077 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:26 smithi033 podman[123690]: 2024-08-28 19:51:26.698158713 +0000 UTC m=+0.459120524 container attach ae84fd5763d6f11d5a25f10a3debec7bea0a9623dabe8c4132c3c842c7d7d579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:51:27.077 INFO:journalctl@ceph.osd.9.smithi033.stdout:Aug 28 19:51:26 smithi033 podman[123690]: 2024-08-28 19:51:26.796060346 +0000 UTC m=+0.557022153 container died ae84fd5763d6f11d5a25f10a3debec7bea0a9623dabe8c4132c3c842c7d7d579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-28T19:51:27.366 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.9.service' 2024-08-28T19:51:27.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:51:27.410 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-28T19:51:27.410 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-28T19:51:27.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.10 2024-08-28T19:51:27.437 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:27.114+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:27.437 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:27.114+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:27.437 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:27.114+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:27.437 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:27.114+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:27.437 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:27.114+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:27.437 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:27.114+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:27.437 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:27.114+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.866834+0000 front 2024-08-28T19:51:00.866748+0000 (oldest deadline 2024-08-28T19:51:26.166486+0000) 2024-08-28T19:51:27.687 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 systemd[1]: Stopping Ceph osd.10 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:51:27.687 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:27.684+0000 7f153ebc1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:51:27.687 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:27.684+0000 7f153ebc1640 -1 osd.10 110 *** Got signal Terminated *** 2024-08-28T19:51:27.687 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:27 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:27.684+0000 7f153ebc1640 -1 osd.10 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:51:28.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:27 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:27.715+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:28.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:27 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:27.715+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:28.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:27 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:27.715+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:28.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:27 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:27.715+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:28.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:27 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:27.715+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:28.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:27 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:27.715+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:28.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:28 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:28.141+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:28.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:28 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:28.141+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:28.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:28 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:28.141+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:28.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:28 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:28.141+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:28.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:28 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:28.141+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:28.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:28 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:28.141+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:28.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:28 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:28.141+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.866834+0000 front 2024-08-28T19:51:00.866748+0000 (oldest deadline 2024-08-28T19:51:26.166486+0000) 2024-08-28T19:51:29.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:28 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:28.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:29.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:28 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:28.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:29.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:28 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:28.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:29.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:28 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:28.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:29.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:28 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:28.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:29.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:28 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:28.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:29.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:29 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:29.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:29.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:29 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:29.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:29.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:29 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:29.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:29.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:29 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:29.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:29.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:29 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:29.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:29.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:29 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:29.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:29.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:29 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:29.125+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.866834+0000 front 2024-08-28T19:51:00.866748+0000 (oldest deadline 2024-08-28T19:51:26.166486+0000) 2024-08-28T19:51:29.793 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:29 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:29.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:29.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:29 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:29.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:29.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:29 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:29.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:29.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:29 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:29.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:29.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:29 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:29.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:29.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:29 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:29.681+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:30.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:30 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:30.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:30.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:30 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:30.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:30.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:30 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:30.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:30.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:30 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:30.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:30.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:30 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:30.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:30.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:30 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:30.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:30.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:30 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:30.129+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.866834+0000 front 2024-08-28T19:51:00.866748+0000 (oldest deadline 2024-08-28T19:51:26.166486+0000) 2024-08-28T19:51:31.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:30 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:30.660+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:31.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:30 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:30.660+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:31.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:30 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:30.660+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:31.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:30 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:30.660+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:31.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:30 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:30.660+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:31.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:30 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:30.660+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:31.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:31 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:31.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:31.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:31 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:31.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:31.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:31 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:31.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:31.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:31 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:31.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:31.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:31 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:31.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:31.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:31 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:31.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:31.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:31 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:31.144+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.866834+0000 front 2024-08-28T19:51:00.866748+0000 (oldest deadline 2024-08-28T19:51:26.166486+0000) 2024-08-28T19:51:32.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:31 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:31.648+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:32.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:31 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:31.648+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:32.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:31 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:31.648+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:32.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:31 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:31.648+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:32.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:31 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:31.648+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:32.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:31 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:31.648+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:32.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:31 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:31.648+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-08-28T19:51:08.859762+0000 front 2024-08-28T19:51:08.859746+0000 (oldest deadline 2024-08-28T19:51:31.159568+0000) 2024-08-28T19:51:32.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:32 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:32.159+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:10.659278+0000 front 2024-08-28T19:50:10.659391+0000 (oldest deadline 2024-08-28T19:50:35.359329+0000) 2024-08-28T19:51:32.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:32 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:32.159+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:21.260333+0000 front 2024-08-28T19:50:21.260268+0000 (oldest deadline 2024-08-28T19:50:45.960433+0000) 2024-08-28T19:51:32.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:32 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:32.159+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:25.960997+0000 front 2024-08-28T19:50:25.960976+0000 (oldest deadline 2024-08-28T19:50:53.561667+0000) 2024-08-28T19:51:32.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:32 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:32.159+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-08-28T19:50:36.462838+0000 front 2024-08-28T19:50:36.462803+0000 (oldest deadline 2024-08-28T19:50:57.562779+0000) 2024-08-28T19:51:32.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:32 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:32.159+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.964334+0000 front 2024-08-28T19:50:43.964309+0000 (oldest deadline 2024-08-28T19:51:07.464495+0000) 2024-08-28T19:51:32.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:32 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:32.159+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:52.165597+0000 front 2024-08-28T19:50:52.165615+0000 (oldest deadline 2024-08-28T19:51:15.065238+0000) 2024-08-28T19:51:32.533 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:32 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10[47954]: 2024-08-28T19:51:32.159+0000 7f15371a4640 -1 osd.10 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.866834+0000 front 2024-08-28T19:51:00.866748+0000 (oldest deadline 2024-08-28T19:51:26.166486+0000) 2024-08-28T19:51:33.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:32 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:32.628+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:33.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:32 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:32.628+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:33.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:32 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:32.628+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:33.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:32 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:32.628+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:33.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:32 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:32.628+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:33.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:32 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:32.628+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:33.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:32 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:32.628+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-08-28T19:51:08.859762+0000 front 2024-08-28T19:51:08.859746+0000 (oldest deadline 2024-08-28T19:51:31.159568+0000) 2024-08-28T19:51:33.519 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:33 smithi059 podman[59259]: 2024-08-28 19:51:33.213481452 +0000 UTC m=+5.604726683 container died 8d2911b3d484eb86596a39031c11a5bdb7088e02af648a7c58df2ee355bc2f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-28T19:51:33.519 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:33 smithi059 podman[59259]: 2024-08-28 19:51:33.518686772 +0000 UTC m=+5.909931999 container cleanup 8d2911b3d484eb86596a39031c11a5bdb7088e02af648a7c58df2ee355bc2f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-28T19:51:33.782 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:33 smithi059 bash[59259]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10 2024-08-28T19:51:33.783 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:33 smithi059 podman[59276]: 2024-08-28 19:51:33.728265904 +0000 UTC m=+0.514110993 container remove 8d2911b3d484eb86596a39031c11a5bdb7088e02af648a7c58df2ee355bc2f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:51:34.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:33 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:33.616+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:34.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:33 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:33.616+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:34.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:33 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:33.616+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:34.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:33 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:33.616+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:34.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:33 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:33.616+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:34.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:33 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:33.616+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:34.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:33 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:33.616+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-08-28T19:51:08.859762+0000 front 2024-08-28T19:51:08.859746+0000 (oldest deadline 2024-08-28T19:51:31.159568+0000) 2024-08-28T19:51:34.332 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:34 smithi059 podman[59365]: 2024-08-28 19:51:34.037515249 +0000 UTC m=+0.112478759 container create b3cd0113e7c20991c5fd861d7f6d1069f5d86fb48e5fa3436f3dafb801c945e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:51:34.332 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:34 smithi059 podman[59365]: 2024-08-28 19:51:33.94076263 +0000 UTC m=+0.015726151 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:51:34.332 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:34 smithi059 podman[59365]: 2024-08-28 19:51:34.256502657 +0000 UTC m=+0.331466172 container init b3cd0113e7c20991c5fd861d7f6d1069f5d86fb48e5fa3436f3dafb801c945e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T19:51:34.332 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:34 smithi059 podman[59365]: 2024-08-28 19:51:34.259822063 +0000 UTC m=+0.334785575 container start b3cd0113e7c20991c5fd861d7f6d1069f5d86fb48e5fa3436f3dafb801c945e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-28T19:51:34.332 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:34 smithi059 podman[59365]: 2024-08-28 19:51:34.331434368 +0000 UTC m=+0.406397892 container attach b3cd0113e7c20991c5fd861d7f6d1069f5d86fb48e5fa3436f3dafb801c945e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-28T19:51:34.685 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:34 smithi059 podman[59365]: 2024-08-28 19:51:34.463014808 +0000 UTC m=+0.537978320 container died b3cd0113e7c20991c5fd861d7f6d1069f5d86fb48e5fa3436f3dafb801c945e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-28T19:51:34.892 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.10.service' 2024-08-28T19:51:34.957 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:34 smithi059 podman[59388]: 2024-08-28 19:51:34.868300969 +0000 UTC m=+0.397387530 container remove b3cd0113e7c20991c5fd861d7f6d1069f5d86fb48e5fa3436f3dafb801c945e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-28T19:51:34.957 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:34 smithi059 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.10.service: Deactivated successfully. 2024-08-28T19:51:34.957 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:34 smithi059 systemd[1]: Stopped Ceph osd.10 for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:51:34.957 INFO:journalctl@ceph.osd.10.smithi059.stdout:Aug 28 19:51:34 smithi059 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.10.service: Consumed 19.346s CPU time. 2024-08-28T19:51:34.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:51:34.973 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-28T19:51:34.973 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-28T19:51:34.973 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.11 2024-08-28T19:51:34.999 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:34 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:34.610+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:34.999 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:34 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:34.610+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:35.000 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:34 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:34.610+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:35.000 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:34 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:34.610+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:35.000 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:34 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:34.610+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:35.000 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:34 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:34.610+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:35.000 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:34 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:34.610+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-08-28T19:51:08.859762+0000 front 2024-08-28T19:51:08.859746+0000 (oldest deadline 2024-08-28T19:51:31.159568+0000) 2024-08-28T19:51:35.266 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 systemd[1]: Stopping Ceph osd.11 for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:51:35.543 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:35.263+0000 7f7c5420e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:51:35.544 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:35.263+0000 7f7c5420e640 -1 osd.11 110 *** Got signal Terminated *** 2024-08-28T19:51:35.544 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:35.263+0000 7f7c5420e640 -1 osd.11 110 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-28T19:51:36.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:35.580+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:36.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:35.580+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:36.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:35.580+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:36.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:35.580+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:36.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:35.580+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:36.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:35.580+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:36.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:35 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:35.580+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-08-28T19:51:08.859762+0000 front 2024-08-28T19:51:08.859746+0000 (oldest deadline 2024-08-28T19:51:31.159568+0000) 2024-08-28T19:51:37.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:36 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:36.611+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:37.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:36 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:36.611+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:37.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:36 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:36.611+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:37.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:36 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:36.611+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:37.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:36 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:36.611+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:37.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:36 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:36.611+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:37.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:36 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:36.611+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-08-28T19:51:08.859762+0000 front 2024-08-28T19:51:08.859746+0000 (oldest deadline 2024-08-28T19:51:31.159568+0000) 2024-08-28T19:51:38.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:37 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:37.597+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:38.678 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:37 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:37.597+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:38.678 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:37 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:37.597+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:38.678 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:37 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:37.597+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:38.678 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:37 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:37.597+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:38.678 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:37 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:37.597+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:38.678 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:37 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:37.597+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-08-28T19:51:08.859762+0000 front 2024-08-28T19:51:08.859746+0000 (oldest deadline 2024-08-28T19:51:31.159568+0000) 2024-08-28T19:51:39.043 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:38 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:38.603+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:39.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:38 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:38.603+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:39.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:38 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:38.603+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:39.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:38 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:38.603+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:39.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:38 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:38.603+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:39.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:38 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:38.603+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:39.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:38 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:38.603+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-08-28T19:51:08.859762+0000 front 2024-08-28T19:51:08.859746+0000 (oldest deadline 2024-08-28T19:51:31.159568+0000) 2024-08-28T19:51:40.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:39.554+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-08-28T19:50:11.448253+0000 front 2024-08-28T19:50:11.448292+0000 (oldest deadline 2024-08-28T19:50:35.548302+0000) 2024-08-28T19:51:40.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:39.554+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-08-28T19:50:20.849612+0000 front 2024-08-28T19:50:20.849518+0000 (oldest deadline 2024-08-28T19:50:46.149603+0000) 2024-08-28T19:51:40.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:39.554+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6804 osd.2 since back 2024-08-28T19:50:28.951107+0000 front 2024-08-28T19:50:28.951137+0000 (oldest deadline 2024-08-28T19:50:51.151911+0000) 2024-08-28T19:51:40.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:39.554+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-08-28T19:50:43.755894+0000 front 2024-08-28T19:50:43.755867+0000 (oldest deadline 2024-08-28T19:51:06.656005+0000) 2024-08-28T19:51:40.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:39.554+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.122:6812 osd.5 since back 2024-08-28T19:50:50.757085+0000 front 2024-08-28T19:50:50.756971+0000 (oldest deadline 2024-08-28T19:51:14.857130+0000) 2024-08-28T19:51:40.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:39.554+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-08-28T19:51:00.158127+0000 front 2024-08-28T19:51:00.158234+0000 (oldest deadline 2024-08-28T19:51:22.958619+0000) 2024-08-28T19:51:40.044 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:39 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11[48799]: 2024-08-28T19:51:39.554+0000 7f7c4c7f1640 -1 osd.11 110 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-08-28T19:51:08.859762+0000 front 2024-08-28T19:51:08.859746+0000 (oldest deadline 2024-08-28T19:51:31.159568+0000) 2024-08-28T19:51:40.858 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:40 smithi122 podman[60897]: 2024-08-28 19:51:40.592143921 +0000 UTC m=+5.413294824 container died def772704a4be0747d3bc5c29cb439450218241e2030262583d2289bddb6e6f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-28T19:51:41.209 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:40 smithi122 podman[60897]: 2024-08-28 19:51:40.957035447 +0000 UTC m=+5.778186334 container cleanup def772704a4be0747d3bc5c29cb439450218241e2030262583d2289bddb6e6f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-28T19:51:41.209 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:40 smithi122 bash[60897]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11 2024-08-28T19:51:41.527 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:41 smithi122 podman[60915]: 2024-08-28 19:51:41.208327192 +0000 UTC m=+0.617148125 container remove def772704a4be0747d3bc5c29cb439450218241e2030262583d2289bddb6e6f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:51:41.793 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:41 smithi122 podman[61004]: 2024-08-28 19:51:41.429727653 +0000 UTC m=+0.015631616 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-28T19:51:41.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:41 smithi122 podman[61004]: 2024-08-28 19:51:41.534058118 +0000 UTC m=+0.119962119 container create 47d8d4cd05a17854a639503769fe91e0916b34cfcf29a308febe6710ccca7377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-28T19:51:41.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:41 smithi122 podman[61004]: 2024-08-28 19:51:41.761513727 +0000 UTC m=+0.347417682 container init 47d8d4cd05a17854a639503769fe91e0916b34cfcf29a308febe6710ccca7377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-28T19:51:41.794 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:41 smithi122 podman[61004]: 2024-08-28 19:51:41.764903094 +0000 UTC m=+0.350807058 container start 47d8d4cd05a17854a639503769fe91e0916b34cfcf29a308febe6710ccca7377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-28T19:51:42.257 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:41 smithi122 podman[61004]: 2024-08-28 19:51:41.828411986 +0000 UTC m=+0.414315945 container attach 47d8d4cd05a17854a639503769fe91e0916b34cfcf29a308febe6710ccca7377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-28T19:51:42.258 INFO:journalctl@ceph.osd.11.smithi122.stdout:Aug 28 19:51:41 smithi122 podman[61004]: 2024-08-28 19:51:41.96279365 +0000 UTC m=+0.548697606 container died 47d8d4cd05a17854a639503769fe91e0916b34cfcf29a308febe6710ccca7377 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:51:42.554 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@osd.11.service' 2024-08-28T19:51:42.633 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:51:42.634 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-28T19:51:42.634 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-28T19:51:42.634 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.a 2024-08-28T19:51:42.946 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:51:42 smithi033 systemd[1]: Stopping Ceph mds.a for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:51:43.380 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:51:42 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a[64517]: 2024-08-28T19:51:42.944+0000 7f65d0c07640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:51:43.380 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:51:42 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a[64517]: 2024-08-28T19:51:42.944+0000 7f65d0c07640 -1 mds.a *** got signal Terminated *** 2024-08-28T19:51:46.297 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:51:45 smithi033 podman[123805]: 2024-08-28 19:51:45.979094326 +0000 UTC m=+3.140783057 container died 326feb1f85e51a5be4b0057877123952f6e13691650387e73fdc6e9889844f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-28T19:51:46.629 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:51:46 smithi033 podman[123805]: 2024-08-28 19:51:46.460697607 +0000 UTC m=+3.622386325 container cleanup 326feb1f85e51a5be4b0057877123952f6e13691650387e73fdc6e9889844f68 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T19:51:46.630 INFO:journalctl@ceph.mds.a.smithi033.stdout:Aug 28 19:51:46 smithi033 bash[123805]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-a 2024-08-28T19:51:46.864 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.a.service' 2024-08-28T19:51:46.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:51:46.900 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-28T19:51:46.900 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-28T19:51:46.900 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.d 2024-08-28T19:51:47.380 INFO:journalctl@ceph.mds.d.smithi033.stdout:Aug 28 19:51:47 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-d[63396]: 2024-08-28T19:51:47.206+0000 7f6633baa640 -1 mds.d *** got signal Terminated *** 2024-08-28T19:51:51.616 INFO:journalctl@ceph.mds.d.smithi033.stdout:Aug 28 19:51:51 smithi033 podman[123926]: 2024-08-28 19:51:51.214873848 +0000 UTC m=+4.098623518 container died b390429d60dd44c348ec51645f1ab24ebbaf98f29b45a057cf29321e39030723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=) 2024-08-28T19:51:51.880 INFO:journalctl@ceph.mds.d.smithi033.stdout:Aug 28 19:51:51 smithi033 podman[123926]: 2024-08-28 19:51:51.806382346 +0000 UTC m=+4.690132009 container cleanup b390429d60dd44c348ec51645f1ab24ebbaf98f29b45a057cf29321e39030723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-d, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-28T19:51:51.880 INFO:journalctl@ceph.mds.d.smithi033.stdout:Aug 28 19:51:51 smithi033 bash[123926]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-d 2024-08-28T19:51:52.241 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.d.service' 2024-08-28T19:51:52.275 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:51:52.275 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-28T19:51:52.275 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-28T19:51:52.276 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.g 2024-08-28T19:51:52.603 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:51:52 smithi033 systemd[1]: Stopping Ceph mds.g for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:51:52.879 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:51:52 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-g[64169]: 2024-08-28T19:51:52.602+0000 7fd15c94c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:51:52.880 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:51:52 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-g[64169]: 2024-08-28T19:51:52.602+0000 7fd15c94c640 -1 mds.g *** got signal Terminated *** 2024-08-28T19:51:54.261 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:51:53 smithi033 podman[124048]: 2024-08-28 19:51:53.975051914 +0000 UTC m=+1.475709606 container died 207c1d2d2c394be853155abb8020d9285e91211933fdd1dfdf7f6b44a5afea3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-g, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-28T19:51:54.629 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:51:54 smithi033 podman[124048]: 2024-08-28 19:51:54.443865796 +0000 UTC m=+1.944523476 container cleanup 207c1d2d2c394be853155abb8020d9285e91211933fdd1dfdf7f6b44a5afea3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-28T19:51:54.630 INFO:journalctl@ceph.mds.g.smithi033.stdout:Aug 28 19:51:54 smithi033 bash[124048]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-g 2024-08-28T19:51:54.882 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.g.service' 2024-08-28T19:51:54.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:51:54.915 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-28T19:51:54.915 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-28T19:51:54.915 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.j 2024-08-28T19:51:55.232 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:51:55 smithi033 systemd[1]: Stopping Ceph mds.j for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:51:55.629 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:51:55 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-j[62985]: 2024-08-28T19:51:55.231+0000 7fe085b64640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:51:55.630 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:51:55 smithi033 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-j[62985]: 2024-08-28T19:51:55.231+0000 7fe085b64640 -1 mds.j *** got signal Terminated *** 2024-08-28T19:51:57.274 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:51:56 smithi033 podman[124172]: 2024-08-28 19:51:56.902225331 +0000 UTC m=+1.759865794 container died 0ee44fa640aeae23f1dd0f7cd3f1df99aa996130c8727d8b9d98c2fb18079abe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-j, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:51:57.630 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:51:57 smithi033 podman[124172]: 2024-08-28 19:51:57.456642875 +0000 UTC m=+2.314283399 container cleanup 0ee44fa640aeae23f1dd0f7cd3f1df99aa996130c8727d8b9d98c2fb18079abe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-j, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-28T19:51:57.630 INFO:journalctl@ceph.mds.j.smithi033.stdout:Aug 28 19:51:57 smithi033 bash[124172]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-j 2024-08-28T19:51:57.884 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.j.service' 2024-08-28T19:51:57.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:51:57.917 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-28T19:51:57.917 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-28T19:51:57.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.b 2024-08-28T19:51:58.212 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:51:57 smithi059 systemd[1]: Stopping Ceph mds.b for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:51:58.478 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:51:58 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b[53155]: 2024-08-28T19:51:58.210+0000 7fc01dbb7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:51:58.479 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:51:58 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b[53155]: 2024-08-28T19:51:58.210+0000 7fc01dbb7640 -1 mds.b *** got signal Terminated *** 2024-08-28T19:52:02.283 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:52:01 smithi059 podman[59467]: 2024-08-28 19:52:01.981720135 +0000 UTC m=+3.861357361 container died 74546f5e36ea93393af37225163ee35592f29b9795d468acc15fb74d242142ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS) 2024-08-28T19:52:02.604 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:52:02 smithi059 podman[59467]: 2024-08-28 19:52:02.369108755 +0000 UTC m=+4.248745980 container cleanup 74546f5e36ea93393af37225163ee35592f29b9795d468acc15fb74d242142ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-28T19:52:02.604 INFO:journalctl@ceph.mds.b.smithi059.stdout:Aug 28 19:52:02 smithi059 bash[59467]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-b 2024-08-28T19:52:02.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.b.service' 2024-08-28T19:52:02.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:52:02.787 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-28T19:52:02.788 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-28T19:52:02.788 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.e 2024-08-28T19:52:03.283 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:52:02 smithi059 systemd[1]: Stopping Ceph mds.e for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:52:03.283 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:52:03 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e[52539]: 2024-08-28T19:52:03.106+0000 7f23576a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:52:03.283 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:52:03 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e[52539]: 2024-08-28T19:52:03.106+0000 7f23576a9640 -1 mds.e *** got signal Terminated *** 2024-08-28T19:52:06.241 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:52:05 smithi059 podman[59600]: 2024-08-28 19:52:05.985395531 +0000 UTC m=+2.965982205 container died 265c8af5c929f09c02984d53dc0a8efc741bf264b3cb4b6e6fde22174ed33eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-28T19:52:06.500 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:52:06 smithi059 podman[59600]: 2024-08-28 19:52:06.331374203 +0000 UTC m=+3.311960884 container cleanup 265c8af5c929f09c02984d53dc0a8efc741bf264b3cb4b6e6fde22174ed33eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-28T19:52:06.500 INFO:journalctl@ceph.mds.e.smithi059.stdout:Aug 28 19:52:06 smithi059 bash[59600]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-e 2024-08-28T19:52:06.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.e.service' 2024-08-28T19:52:06.747 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:52:06.748 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-28T19:52:06.748 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-28T19:52:06.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.h 2024-08-28T19:52:07.069 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:52:06 smithi059 systemd[1]: Stopping Ceph mds.h for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:52:07.533 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:52:07 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h[52843]: 2024-08-28T19:52:07.068+0000 7fcc2153c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:52:07.533 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:52:07 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h[52843]: 2024-08-28T19:52:07.068+0000 7fcc2153c640 -1 mds.h *** got signal Terminated *** 2024-08-28T19:52:10.283 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:52:09 smithi059 podman[59720]: 2024-08-28 19:52:09.984889618 +0000 UTC m=+3.014683393 container died 9175ca488cbea004a65c58083a22bb6a190861240e84458cb32c5152d5d0d51a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-28T19:52:10.641 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:52:10 smithi059 podman[59720]: 2024-08-28 19:52:10.293609749 +0000 UTC m=+3.323403515 container cleanup 9175ca488cbea004a65c58083a22bb6a190861240e84458cb32c5152d5d0d51a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:52:10.641 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:52:10 smithi059 bash[59720]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h 2024-08-28T19:52:10.641 INFO:journalctl@ceph.mds.h.smithi059.stdout:Aug 28 19:52:10 smithi059 podman[59732]: 2024-08-28 19:52:10.503022613 +0000 UTC m=+0.508037039 container remove 9175ca488cbea004a65c58083a22bb6a190861240e84458cb32c5152d5d0d51a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-h, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-28T19:52:10.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.h.service' 2024-08-28T19:52:10.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:52:10.682 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-28T19:52:10.683 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-28T19:52:10.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.k 2024-08-28T19:52:10.997 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:52:10 smithi059 systemd[1]: Stopping Ceph mds.k for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:52:11.282 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:52:10 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k[52242]: 2024-08-28T19:52:10.996+0000 7f4516915640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:52:11.282 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:52:10 smithi059 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k[52242]: 2024-08-28T19:52:10.996+0000 7f4516915640 -1 mds.k *** got signal Terminated *** 2024-08-28T19:52:14.256 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:52:13 smithi059 podman[59842]: 2024-08-28 19:52:13.979383548 +0000 UTC m=+3.085399413 container died a4377b1f53eb50585f8ac069a17b1717a7ada0aafbd66cf0ee2e9d304e85d655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-08-28T19:52:14.524 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:52:14 smithi059 podman[59842]: 2024-08-28 19:52:14.305409271 +0000 UTC m=+3.411425141 container cleanup a4377b1f53eb50585f8ac069a17b1717a7ada0aafbd66cf0ee2e9d304e85d655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-28T19:52:14.524 INFO:journalctl@ceph.mds.k.smithi059.stdout:Aug 28 19:52:14 smithi059 bash[59842]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-k 2024-08-28T19:52:14.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.k.service' 2024-08-28T19:52:14.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:52:14.681 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-28T19:52:14.681 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-28T19:52:14.681 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.c 2024-08-28T19:52:14.975 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:52:14 smithi122 systemd[1]: Stopping Ceph mds.c for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:52:15.237 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:52:14 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c[53811]: 2024-08-28T19:52:14.974+0000 7f4c208bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:52:15.237 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:52:14 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c[53811]: 2024-08-28T19:52:14.974+0000 7f4c208bd640 -1 mds.c *** got signal Terminated *** 2024-08-28T19:52:18.251 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:52:17 smithi122 podman[61106]: 2024-08-28 19:52:17.993978207 +0000 UTC m=+3.124454650 container died 36b99b71560e414b7964e3e41c92f88cfe9e5709c22853e27e6e5ed7d83367cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-28T19:52:18.543 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:52:18 smithi122 podman[61106]: 2024-08-28 19:52:18.341204673 +0000 UTC m=+3.471681116 container cleanup 36b99b71560e414b7964e3e41c92f88cfe9e5709c22853e27e6e5ed7d83367cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-28T19:52:18.544 INFO:journalctl@ceph.mds.c.smithi122.stdout:Aug 28 19:52:18 smithi122 bash[61106]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-c 2024-08-28T19:52:18.775 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.c.service' 2024-08-28T19:52:18.811 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:52:18.811 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-28T19:52:18.811 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-28T19:52:18.811 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.f 2024-08-28T19:52:19.293 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:52:18 smithi122 systemd[1]: Stopping Ceph mds.f for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:52:19.293 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:52:19 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f[53511]: 2024-08-28T19:52:19.128+0000 7fceab646640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:52:19.293 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:52:19 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f[53511]: 2024-08-28T19:52:19.128+0000 7fceab646640 -1 mds.f *** got signal Terminated *** 2024-08-28T19:52:22.288 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:52:21 smithi122 podman[61234]: 2024-08-28 19:52:21.984945157 +0000 UTC m=+2.957265662 container died 3acba08b0a75d32d7209f7ad0d10a07419e26285dd4a810915b98524505a8c5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-28T19:52:22.288 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:52:22 smithi122 podman[61234]: 2024-08-28 19:52:22.287646351 +0000 UTC m=+3.259966852 container cleanup 3acba08b0a75d32d7209f7ad0d10a07419e26285dd4a810915b98524505a8c5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True) 2024-08-28T19:52:22.543 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:52:22 smithi122 bash[61234]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f 2024-08-28T19:52:22.543 INFO:journalctl@ceph.mds.f.smithi122.stdout:Aug 28 19:52:22 smithi122 podman[61246]: 2024-08-28 19:52:22.4889846 +0000 UTC m=+0.498508307 container remove 3acba08b0a75d32d7209f7ad0d10a07419e26285dd4a810915b98524505a8c5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-f, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-28T19:52:22.620 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.f.service' 2024-08-28T19:52:22.653 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:52:22.654 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-28T19:52:22.654 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-28T19:52:22.654 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.i 2024-08-28T19:52:22.975 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:52:22 smithi122 systemd[1]: Stopping Ceph mds.i for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:52:23.293 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:52:22 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i[54112]: 2024-08-28T19:52:22.974+0000 7fcabe6bc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:52:23.293 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:52:22 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i[54112]: 2024-08-28T19:52:22.974+0000 7fcabe6bc640 -1 mds.i *** got signal Terminated *** 2024-08-28T19:52:26.293 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:52:25 smithi122 podman[61355]: 2024-08-28 19:52:25.978510054 +0000 UTC m=+3.110602240 container died 7a9af04faa1aa60ae64f58561c839d0543a18a4c8dda00f57937b82fd692e9f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-28T19:52:26.710 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:52:26 smithi122 podman[61355]: 2024-08-28 19:52:26.300404371 +0000 UTC m=+3.432496546 container cleanup 7a9af04faa1aa60ae64f58561c839d0543a18a4c8dda00f57937b82fd692e9f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-28T19:52:26.710 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:52:26 smithi122 bash[61355]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i 2024-08-28T19:52:26.710 INFO:journalctl@ceph.mds.i.smithi122.stdout:Aug 28 19:52:26 smithi122 podman[61367]: 2024-08-28 19:52:26.510122574 +0000 UTC m=+0.526292474 container remove 7a9af04faa1aa60ae64f58561c839d0543a18a4c8dda00f57937b82fd692e9f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-08-28T19:52:26.730 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.i.service' 2024-08-28T19:52:26.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:52:26.762 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-28T19:52:26.763 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-28T19:52:26.763 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.l 2024-08-28T19:52:27.043 INFO:journalctl@ceph.mds.l.smithi122.stdout:Aug 28 19:52:26 smithi122 systemd[1]: Stopping Ceph mds.l for 9a2fc37c-6572-11ef-bcd4-c7b262605968... 2024-08-28T19:52:27.544 INFO:journalctl@ceph.mds.l.smithi122.stdout:Aug 28 19:52:27 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-l[53207]: 2024-08-28T19:52:27.070+0000 7fd32f806640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-28T19:52:27.544 INFO:journalctl@ceph.mds.l.smithi122.stdout:Aug 28 19:52:27 smithi122 ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-l[53207]: 2024-08-28T19:52:27.070+0000 7fd32f806640 -1 mds.l *** got signal Terminated *** 2024-08-28T19:52:30.239 INFO:journalctl@ceph.mds.l.smithi122.stdout:Aug 28 19:52:29 smithi122 podman[61473]: 2024-08-28 19:52:29.986375723 +0000 UTC m=+3.009878950 container died b88c84cba9898833ecade0677e796dfa4a1576c33a34b63cd9529404acee531c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-l, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-28T19:52:30.506 INFO:journalctl@ceph.mds.l.smithi122.stdout:Aug 28 19:52:30 smithi122 podman[61473]: 2024-08-28 19:52:30.321371546 +0000 UTC m=+3.344874844 container cleanup b88c84cba9898833ecade0677e796dfa4a1576c33a34b63cd9529404acee531c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-28T19:52:30.506 INFO:journalctl@ceph.mds.l.smithi122.stdout:Aug 28 19:52:30 smithi122 bash[61473]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-l 2024-08-28T19:52:30.741 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.l.service' 2024-08-28T19:52:30.762 INFO:journalctl@ceph.mds.l.smithi122.stdout:Aug 28 19:52:30 smithi122 podman[61485]: 2024-08-28 19:52:30.505829761 +0000 UTC m=+0.513157999 container remove b88c84cba9898833ecade0677e796dfa4a1576c33a34b63cd9529404acee531c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-28T19:52:30.762 INFO:journalctl@ceph.mds.l.smithi122.stdout:Aug 28 19:52:30 smithi122 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.l.service: Deactivated successfully. 2024-08-28T19:52:30.762 INFO:journalctl@ceph.mds.l.smithi122.stdout:Aug 28 19:52:30 smithi122 systemd[1]: Stopped Ceph mds.l for 9a2fc37c-6572-11ef-bcd4-c7b262605968. 2024-08-28T19:52:30.762 INFO:journalctl@ceph.mds.l.smithi122.stdout:Aug 28 19:52:30 smithi122 systemd[1]: ceph-9a2fc37c-6572-11ef-bcd4-c7b262605968@mds.l.service: Consumed 3.883s CPU time. 2024-08-28T19:52:30.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-28T19:52:30.772 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-28T19:52:30.772 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-28T19:52:30.983 INFO:teuthology.orchestra.run.smithi033.stdout:Deleting cluster with fsid: 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:52:33.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-28T19:52:33.585 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:52:36.066 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-28T19:52:36.275 INFO:teuthology.orchestra.run.smithi122.stdout:Deleting cluster with fsid: 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:52:38.557 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T19:52:38.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T19:52:38.621 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-28T19:52:38.649 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-28T19:52:38.651 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762/remote/smithi033/crash 2024-08-28T19:52:38.652 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/crash -- . 2024-08-28T19:52:38.716 INFO:teuthology.orchestra.run.smithi033.stderr:tar: /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-28T19:52:38.716 INFO:teuthology.orchestra.run.smithi033.stderr:tar: Error is not recoverable: exiting now 2024-08-28T19:52:38.718 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762/remote/smithi059/crash 2024-08-28T19:52:38.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/crash -- . 2024-08-28T19:52:38.772 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-28T19:52:38.772 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2024-08-28T19:52:38.774 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762/remote/smithi122/crash 2024-08-28T19:52:38.775 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/crash -- . 2024-08-28T19:52:38.811 INFO:teuthology.orchestra.run.smithi122.stderr:tar: /var/lib/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-28T19:52:38.811 INFO:teuthology.orchestra.run.smithi122.stderr:tar: Error is not recoverable: exiting now 2024-08-28T19:52:38.812 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-28T19:52:38.813 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-28T19:52:38.852 INFO:teuthology.orchestra.run.smithi033.stdout:2024-08-28T19:30:00.000138+0000 mon.a (mon.0) 1092 : cluster [WRN] application not enabled on pool 'cephfs_data_ec' 2024-08-28T19:52:38.853 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-28T19:52:38.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[SEC\]' /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-28T19:52:38.929 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]' /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-28T19:52:39.005 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[WRN\]' /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-28T19:52:39.078 INFO:teuthology.orchestra.run.smithi033.stdout:2024-08-28T19:30:00.000138+0000 mon.a (mon.0) 1092 : cluster [WRN] application not enabled on pool 'cephfs_data_ec' 2024-08-28T19:52:39.079 INFO:tasks.cephadm:Compressing logs... 2024-08-28T19:52:39.079 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-28T19:52:39.122 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-28T19:52:39.125 DEBUG:teuthology.orchestra.run.smithi122:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-28T19:52:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-28T19:52:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:: No such file or directory 2024-08-28T19:52:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-08-28T19:52:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.d.log 2024-08-28T19:52:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.a.log 2024-08-28T19:52:39.146 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log 2024-08-28T19:52:39.146 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-28T19:52:39.146 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.a.log: /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.0.log 2024-08-28T19:52:39.148 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.3.log 2024-08-28T19:52:39.148 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.0.log: 84.5% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-28T19:52:39.148 INFO:teuthology.orchestra.run.smithi033.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-08-28T19:52:39.148 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.g.log 2024-08-28T19:52:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.j.log 2024-08-28T19:52:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mgr.x.log 2024-08-28T19:52:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.j.log: 87.4% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-28T19:52:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-28T19:52:39.154 INFO:teuthology.orchestra.run.smithi122.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-28T19:52:39.154 INFO:teuthology.orchestra.run.smithi122.stderr:: No such file or directory 2024-08-28T19:52:39.154 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mon.c.log 2024-08-28T19:52:39.154 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.l.log 2024-08-28T19:52:39.154 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.2.log 2024-08-28T19:52:39.154 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log 2024-08-28T19:52:39.154 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mgr.z.log 2024-08-28T19:52:39.154 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.2.log: /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-28T19:52:39.155 INFO:teuthology.orchestra.run.smithi122.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-28T19:52:39.155 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.i.log 2024-08-28T19:52:39.155 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.f.log 2024-08-28T19:52:39.155 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.i.log: 82.1% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-28T19:52:39.155 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.c.log 2024-08-28T19:52:39.155 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.8.log 2024-08-28T19:52:39.156 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.c.log: /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.f.log: 87.4% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-28T19:52:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mgr.x.log: 95.0% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.d.log.gz 2024-08-28T19:52:39.157 INFO:teuthology.orchestra.run.smithi033.stderr: 94.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr:: No such file or directory 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.e.log 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mon.b.log 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.k.log 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.e.log: /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.10.log 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mgr.y.log 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.10.log: -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-28T19:52:39.159 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.h.log 2024-08-28T19:52:39.160 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.cephadm.log: 82.1% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-28T19:52:39.160 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.h.log: 87.4% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-28T19:52:39.160 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-28T19:52:39.160 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.1.log 2024-08-28T19:52:39.162 INFO:teuthology.orchestra.run.smithi122.stderr: 93.0% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mgr.z.log.gz 2024-08-28T19:52:39.162 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-28T19:52:39.162 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-28T19:52:39.163 INFO:teuthology.orchestra.run.smithi033.stderr: 95.0% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.j.log.gz 2024-08-28T19:52:39.163 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.6.log 2024-08-28T19:52:39.163 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-28T19:52:39.163 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mon.a.log 2024-08-28T19:52:39.163 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.audit.log: 90.1% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-28T19:52:39.164 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-28T19:52:39.164 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.1.log: 92.9% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mgr.y.log.gz 2024-08-28T19:52:39.165 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.9.log 2024-08-28T19:52:39.169 INFO:teuthology.orchestra.run.smithi059.stderr: 91.0% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-28T19:52:39.173 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mon.a.log: 91.1% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-28T19:52:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.b.log 2024-08-28T19:52:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.7.log 2024-08-28T19:52:39.174 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-28T19:52:39.177 INFO:teuthology.orchestra.run.smithi122.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.11.log 2024-08-28T19:52:39.177 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.5.log 2024-08-28T19:52:39.178 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.b.log: 90.2% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-28T19:52:39.178 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.4.log 2024-08-28T19:52:39.192 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.11.log: 90.2% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-28T19:52:39.255 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.7.log: /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.4.log: 94.6% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.e.log.gz 2024-08-28T19:52:39.265 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.9.log: 94.4% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.a.log.gz 2024-08-28T19:52:39.266 INFO:teuthology.orchestra.run.smithi033.stderr: 94.5% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.g.log.gz 2024-08-28T19:52:39.273 INFO:teuthology.orchestra.run.smithi059.stderr: 94.5% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.k.log.gz 2024-08-28T19:52:39.284 INFO:teuthology.orchestra.run.smithi122.stderr:/var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.5.log: 92.7% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.f.log.gz 2024-08-28T19:52:39.295 INFO:teuthology.orchestra.run.smithi059.stderr: 92.6% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.h.log.gz 2024-08-28T19:52:39.303 INFO:teuthology.orchestra.run.smithi122.stderr: 92.5% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.c.log.gz 2024-08-28T19:52:39.329 INFO:teuthology.orchestra.run.smithi059.stderr: 92.7% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.b.log.gz 2024-08-28T19:52:39.429 INFO:teuthology.orchestra.run.smithi122.stderr: 93.5% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.l.log.gz 2024-08-28T19:52:39.499 INFO:teuthology.orchestra.run.smithi033.stderr: 90.5% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mgr.x.log.gz 2024-08-28T19:52:39.699 INFO:teuthology.orchestra.run.smithi122.stderr: 91.8% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mon.c.log.gz 2024-08-28T19:52:39.701 INFO:teuthology.orchestra.run.smithi059.stderr: 91.8% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mon.b.log.gz 2024-08-28T19:52:40.342 INFO:teuthology.orchestra.run.smithi059.stderr: 92.7% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.4.log.gz 2024-08-28T19:52:40.600 INFO:teuthology.orchestra.run.smithi033.stderr: 92.6% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.3.log.gz 2024-08-28T19:52:40.673 INFO:teuthology.orchestra.run.smithi033.stderr: 92.6% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.0.log.gz 2024-08-28T19:52:40.729 INFO:teuthology.orchestra.run.smithi033.stderr: 92.2% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.9.log.gz 2024-08-28T19:52:40.827 INFO:teuthology.orchestra.run.smithi033.stderr: 90.4% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mon.a.log.gz 2024-08-28T19:52:40.839 INFO:teuthology.orchestra.run.smithi059.stderr: 92.8% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.1.log.gz 2024-08-28T19:52:40.910 INFO:teuthology.orchestra.run.smithi033.stderr: 93.0% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.6.log.gz 2024-08-28T19:52:40.912 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-08-28T19:52:40.912 INFO:teuthology.orchestra.run.smithi033.stderr:real 0m1.778s 2024-08-28T19:52:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:user 0m8.318s 2024-08-28T19:52:40.913 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m0.286s 2024-08-28T19:52:40.954 INFO:teuthology.orchestra.run.smithi122.stderr: 92.6% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.11.log.gz 2024-08-28T19:52:41.018 INFO:teuthology.orchestra.run.smithi059.stderr: 91.7% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.7.log.gz 2024-08-28T19:52:41.325 INFO:teuthology.orchestra.run.smithi122.stderr: 92.5% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.8.log.gz 2024-08-28T19:52:41.644 INFO:teuthology.orchestra.run.smithi059.stderr: 92.5% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.10.log.gz 2024-08-28T19:52:41.646 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-08-28T19:52:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m2.507s 2024-08-28T19:52:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m7.935s 2024-08-28T19:52:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.276s 2024-08-28T19:52:41.662 INFO:teuthology.orchestra.run.smithi122.stderr: 92.3% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.5.log.gz 2024-08-28T19:52:41.849 INFO:teuthology.orchestra.run.smithi122.stderr: 92.9% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-mds.i.log.gz 2024-08-28T19:52:41.909 INFO:teuthology.orchestra.run.smithi122.stderr: 91.5% -- replaced with /var/log/ceph/9a2fc37c-6572-11ef-bcd4-c7b262605968/ceph-osd.2.log.gz 2024-08-28T19:52:41.912 INFO:teuthology.orchestra.run.smithi122.stderr: 2024-08-28T19:52:41.912 INFO:teuthology.orchestra.run.smithi122.stderr:real 0m2.772s 2024-08-28T19:52:41.912 INFO:teuthology.orchestra.run.smithi122.stderr:user 0m12.480s 2024-08-28T19:52:41.912 INFO:teuthology.orchestra.run.smithi122.stderr:sys 0m0.432s 2024-08-28T19:52:41.912 INFO:tasks.cephadm:Archiving logs... 2024-08-28T19:52:41.912 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762/remote/smithi033/log 2024-08-28T19:52:41.913 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-28T19:52:42.996 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762/remote/smithi059/log 2024-08-28T19:52:42.997 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-28T19:52:44.263 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762/remote/smithi122/log 2024-08-28T19:52:44.264 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-28T19:52:45.978 INFO:tasks.cephadm:Removing cluster... 2024-08-28T19:52:45.978 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 --force 2024-08-28T19:52:46.188 INFO:teuthology.orchestra.run.smithi033.stdout:Deleting cluster with fsid: 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:52:46.451 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 --force 2024-08-28T19:52:46.663 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:52:46.930 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a2fc37c-6572-11ef-bcd4-c7b262605968 --force 2024-08-28T19:52:47.134 INFO:teuthology.orchestra.run.smithi122.stdout:Deleting cluster with fsid: 9a2fc37c-6572-11ef-bcd4-c7b262605968 2024-08-28T19:52:47.395 INFO:tasks.cephadm:Removing cephadm ... 2024-08-28T19:52:47.396 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-28T19:52:47.414 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-28T19:52:47.430 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-28T19:52:47.446 INFO:tasks.cephadm:Teardown complete 2024-08-28T19:52:47.446 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-28T19:52:47.457 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-28T19:52:47.457 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-28T19:52:47.460 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-28T19:52:47.473 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-28T19:52:47.604 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-28T19:52:47.614 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-28T19:52:47.614 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T19:52:47.616 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T19:52:47.619 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-28T19:52:47.630 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-08-28T19:52:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-08-28T19:52:47.632 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-08-28T19:52:47.635 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T19:52:47.635 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-08-28T19:52:47.635 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +337us[ +326us] +/- 50ms 2024-08-28T19:52:47.635 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 -884us[ -895us] +/- 52ms 2024-08-28T19:52:47.635 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +699us[ +688us] +/- 70ms 2024-08-28T19:52:47.635 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:52:47.637 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T19:52:47.637 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-08-28T19:52:47.637 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +311us[ +292us] +/- 50ms 2024-08-28T19:52:47.637 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -910us[ -929us] +/- 52ms 2024-08-28T19:52:47.637 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +656us[ +656us] +/- 70ms 2024-08-28T19:52:47.637 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:52:47.638 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-28T19:52:47.638 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-08-28T19:52:47.638 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +283us[ +278us] +/- 50ms 2024-08-28T19:52:47.638 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -917us[ -922us] +/- 52ms 2024-08-28T19:52:47.638 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +651us[ +651us] +/- 70ms 2024-08-28T19:52:47.638 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-28T19:52:47.639 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-28T19:52:47.649 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-28T19:52:47.649 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-28T19:52:47.658 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-28T19:52:47.757 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-28T19:52:47.812 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-28T19:52:47.865 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T19:52:47.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:52:47.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T19:52:47.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:52:47.922 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-28T19:52:47.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:52:47.948 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-28T19:52:47.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-28T19:52:47.969 INFO:teuthology.task.internal:Duration was 2155.870370 seconds 2024-08-28T19:52:47.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-28T19:52:47.978 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-28T19:52:47.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-28T19:52:47.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-28T19:52:47.983 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-28T19:52:48.019 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T19:52:48.020 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T19:52:48.027 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-28T19:52:48.417 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-28T19:52:48.418 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-08-28T19:52:48.418 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-28T19:52:48.480 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-08-28T19:52:48.481 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-28T19:52:48.514 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-08-28T19:52:48.514 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-28T19:52:48.537 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-28T19:52:48.538 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-28T19:52:48.540 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-28T19:52:48.556 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-28T19:52:48.605 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-28T19:52:48.605 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-28T19:52:48.608 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-28T19:52:48.622 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-28T19:52:50.497 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-28T19:52:50.508 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-28T19:52:50.508 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-28T19:52:50.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-28T19:52:50.562 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-28T19:52:50.593 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-28T19:52:50.603 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-28T19:52:50.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-28T19:52:50.608 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-28T19:52:50.626 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-08-28T19:52:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-08-28T19:52:50.659 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-08-28T19:52:50.721 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-28T19:52:50.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:52:50.735 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-28T19:52:50.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:52:50.752 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-28T19:52:50.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-28T19:52:50.777 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-28T19:52:50.787 INFO:teuthology.task.internal:Transferring archived files... 2024-08-28T19:52:50.788 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762/remote/smithi033 2024-08-28T19:52:50.788 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-28T19:52:50.862 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762/remote/smithi059 2024-08-28T19:52:50.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-28T19:52:50.900 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-28_12:36:35-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7877762/remote/smithi122 2024-08-28T19:52:50.900 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-28T19:52:50.934 INFO:teuthology.task.internal:Removing archive directory... 2024-08-28T19:52:50.934 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-28T19:52:50.937 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-28T19:52:50.940 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-28T19:52:50.986 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-28T19:52:50.997 INFO:teuthology.task.internal:Not uploading archives. 2024-08-28T19:52:50.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-28T19:52:51.008 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-28T19:52:51.008 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-28T19:52:51.010 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-28T19:52:51.013 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-28T19:52:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 28 19:52 /home/ubuntu/cephtest 2024-08-28T19:52:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 28 19:52 /home/ubuntu/cephtest 2024-08-28T19:52:51.042 INFO:teuthology.orchestra.run.smithi122.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 28 19:52 /home/ubuntu/cephtest 2024-08-28T19:52:51.043 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-28T19:52:51.053 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-28T19:52:51.080 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} duration: 2155.870369911194 failure_reason: '"2024-08-28T19:30:00.000138+0000 mon.a (mon.0) 1092 : cluster [WRN] application not enabled on pool ''cephfs_data_ec''" in cluster log' flavor: default owner: scheduled_mchangir@teuthology success: false 2024-08-28T19:52:51.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-28T19:52:51.166 INFO:teuthology.run:FAIL